2024-04-26T23:33:57.233 INFO:root:teuthology version: 0.0.1.dev269+g9481b1d 2024-04-26T23:33:57.233 DEBUG:teuthology.run:Teuthology command: teuthology --verbose --name rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi --description fs/thrash/multifs/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-2c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} msgr-failures/none objectstore/bluestore-bitmap overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down multifs pg_health session_timeout thrashosds-health} tasks/{1-thrash/mon 2-workunit/ffsb}} --archive /home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675323 --owner scheduled_rishabh@teuthology -- /home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675323/orig.config.yaml 2024-04-26T23:33:57.285 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-26T23:33:57.366 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675323 branch: wip-rishabh-testing-20240426.111959 description: fs/thrash/multifs/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-2c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} msgr-failures/none objectstore/bluestore-bitmap overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down multifs pg_health session_timeout thrashosds-health} tasks/{1-thrash/mon 2-workunit/ffsb}} email: null first_in_suite: false job_id: '7675323' kernel: client: sha1: distro flavor: default kdb: true sha1: 806ec36b21129f113ce356c007dd59694d340b37 ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-rishabh-testing-20240426.111959 ceph: cephfs: fs: - name: a - name: b session_timeout: 300 conf: client: client mount timeout: 600 client_shutdown_timeout: 120 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 filestore flush min: 0 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd blocked scrub grace period: 3600 osd failsafe full ratio: 0.95 osd max markdown count: 1000 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(POOL_ - \(CACHE_POOL_ - \(SMALLER_PGP_NUM\) - \(OBJECT_ - \(SLOW_OPS\) - \(REQUEST_SLOW\) - \(TOO_FEW_PGS\) - slow request - timeout on replica - late reservation from - MON_DOWN - OSDMAP_FLAGS - OSD_DOWN - PG_DEGRADED - PG_AVAILABILITY - POOL_APP_NOT_ENABLED - mons down - mon down - out of quorum - overall HEALTH_ - \(MON_DOWN\) - SLOW_OPS - slow request sha1: bc612ffb9c1d5bc27536bc917a705262a36d4387 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs ceph-fuse: client.0: cephfs_name: a client.1: cephfs_name: b install: ceph: flavor: default sha1: bc612ffb9c1d5bc27536bc917a705262a36d4387 kclient: client.0: cephfs_name: a client.1: cephfs_name: b syntax: v2 selinux: allowlist: - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-rishabh-testing-20240426.111959 sha1: bc612ffb9c1d5bc27536bc917a705262a36d4387 owner: scheduled_rishabh@teuthology priority: 50 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 seed: 816 sha1: bc612ffb9c1d5bc27536bc917a705262a36d4387 sleep_before_teardown: 0 subset: 166/512 suite: fs suite_branch: wip-rishabh-testing-20240426.111959 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_bc612ffb9c1d5bc27536bc917a705262a36d4387/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: bc612ffb9c1d5bc27536bc917a705262a36d4387 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi088.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPmYMML+KEyJouHdBaKX7ErH7IRDfOFbbAQFXpqmTBRNEQJnWrMFBWAeKwO2oNw3V+BMrptb+6vF9os7fUngBd0= smithi175.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBpuf989vQr0xZ8KOg5DiIN4+bFT8bAH9ODwFUb3qpvthwcyrULyXnmFnS0IVWttXHu2QaFI+bog7v2wNgr7/3E= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - sequential: - mgrmodules - kclient: null - mon_thrash: check_mds_failover: true revive_delay: 20 thrash_delay: 10 - workunit: clients: all: - suites/ffsb.sh teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17 timestamp: 2024-04-26_19:30:57 tube: smithi user: rishabh verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-04-26T23:33:57.367 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_bc612ffb9c1d5bc27536bc917a705262a36d4387/qa; will attempt to use it 2024-04-26T23:33:57.367 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_bc612ffb9c1d5bc27536bc917a705262a36d4387/qa/tasks 2024-04-26T23:33:57.367 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-04-26T23:33:57.369 INFO:teuthology.task.internal:Checking packages... 2024-04-26T23:33:57.390 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'bc612ffb9c1d5bc27536bc917a705262a36d4387' 2024-04-26T23:33:57.390 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-26T23:33:57.390 INFO:teuthology.packaging:ref: None 2024-04-26T23:33:57.390 INFO:teuthology.packaging:tag: None 2024-04-26T23:33:57.390 INFO:teuthology.packaging:branch: wip-rishabh-testing-20240426.111959 2024-04-26T23:33:57.390 INFO:teuthology.packaging:sha1: bc612ffb9c1d5bc27536bc917a705262a36d4387 2024-04-26T23:33:57.390 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-rishabh-testing-20240426.111959 2024-04-26T23:33:57.607 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-3306.gbc612ffb 2024-04-26T23:33:57.608 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-04-26T23:33:57.617 INFO:teuthology.task.internal:no buildpackages task found 2024-04-26T23:33:57.617 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-04-26T23:33:57.672 INFO:teuthology.task.internal:Saving configuration 2024-04-26T23:33:57.690 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-04-26T23:33:57.703 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-26T23:33:57.724 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi088.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675323', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-26 23:28:31.122723', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPmYMML+KEyJouHdBaKX7ErH7IRDfOFbbAQFXpqmTBRNEQJnWrMFBWAeKwO2oNw3V+BMrptb+6vF9os7fUngBd0='} 2024-04-26T23:33:57.745 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi175.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675323', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-26 23:28:31.120001', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBpuf989vQr0xZ8KOg5DiIN4+bFT8bAH9ODwFUb3qpvthwcyrULyXnmFnS0IVWttXHu2QaFI+bog7v2wNgr7/3E='} 2024-04-26T23:33:57.745 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-04-26T23:33:57.756 INFO:teuthology.task.internal:roles: ubuntu@smithi088.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2024-04-26T23:33:57.756 INFO:teuthology.task.internal:roles: ubuntu@smithi175.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1'] 2024-04-26T23:33:57.756 INFO:teuthology.run_tasks:Running task console_log... 2024-04-26T23:33:57.847 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fd1c2044160>, signals=[15]) 2024-04-26T23:33:57.848 INFO:teuthology.run_tasks:Running task internal.connect... 2024-04-26T23:33:57.859 INFO:teuthology.task.internal:Opening connections... 2024-04-26T23:33:57.860 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi088.front.sepia.ceph.com 2024-04-26T23:33:57.861 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T23:33:57.946 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi175.front.sepia.ceph.com 2024-04-26T23:33:57.947 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T23:33:58.021 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-04-26T23:33:58.033 DEBUG:teuthology.orchestra.run.smithi088:> uname -m 2024-04-26T23:33:58.050 INFO:teuthology.orchestra.run.smithi088.stdout:x86_64 2024-04-26T23:33:58.051 DEBUG:teuthology.orchestra.run.smithi088:> cat /etc/os-release 2024-04-26T23:33:58.108 INFO:teuthology.orchestra.run.smithi088.stdout:NAME="CentOS Stream" 2024-04-26T23:33:58.108 INFO:teuthology.orchestra.run.smithi088.stdout:VERSION="9" 2024-04-26T23:33:58.108 INFO:teuthology.orchestra.run.smithi088.stdout:ID="centos" 2024-04-26T23:33:58.109 INFO:teuthology.orchestra.run.smithi088.stdout:ID_LIKE="rhel fedora" 2024-04-26T23:33:58.109 INFO:teuthology.orchestra.run.smithi088.stdout:VERSION_ID="9" 2024-04-26T23:33:58.109 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM_ID="platform:el9" 2024-04-26T23:33:58.109 INFO:teuthology.orchestra.run.smithi088.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-26T23:33:58.109 INFO:teuthology.orchestra.run.smithi088.stdout:ANSI_COLOR="0;31" 2024-04-26T23:33:58.109 INFO:teuthology.orchestra.run.smithi088.stdout:LOGO="fedora-logo-icon" 2024-04-26T23:33:58.109 INFO:teuthology.orchestra.run.smithi088.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-26T23:33:58.109 INFO:teuthology.orchestra.run.smithi088.stdout:HOME_URL="https://centos.org/" 2024-04-26T23:33:58.109 INFO:teuthology.orchestra.run.smithi088.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-26T23:33:58.109 INFO:teuthology.orchestra.run.smithi088.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-26T23:33:58.109 INFO:teuthology.orchestra.run.smithi088.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-26T23:33:58.110 INFO:teuthology.lock.ops:Updating smithi088.front.sepia.ceph.com on lock server 2024-04-26T23:33:58.128 DEBUG:teuthology.orchestra.run.smithi175:> uname -m 2024-04-26T23:33:58.146 INFO:teuthology.orchestra.run.smithi175.stdout:x86_64 2024-04-26T23:33:58.146 DEBUG:teuthology.orchestra.run.smithi175:> cat /etc/os-release 2024-04-26T23:33:58.204 INFO:teuthology.orchestra.run.smithi175.stdout:NAME="CentOS Stream" 2024-04-26T23:33:58.204 INFO:teuthology.orchestra.run.smithi175.stdout:VERSION="9" 2024-04-26T23:33:58.204 INFO:teuthology.orchestra.run.smithi175.stdout:ID="centos" 2024-04-26T23:33:58.204 INFO:teuthology.orchestra.run.smithi175.stdout:ID_LIKE="rhel fedora" 2024-04-26T23:33:58.204 INFO:teuthology.orchestra.run.smithi175.stdout:VERSION_ID="9" 2024-04-26T23:33:58.205 INFO:teuthology.orchestra.run.smithi175.stdout:PLATFORM_ID="platform:el9" 2024-04-26T23:33:58.205 INFO:teuthology.orchestra.run.smithi175.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-26T23:33:58.205 INFO:teuthology.orchestra.run.smithi175.stdout:ANSI_COLOR="0;31" 2024-04-26T23:33:58.205 INFO:teuthology.orchestra.run.smithi175.stdout:LOGO="fedora-logo-icon" 2024-04-26T23:33:58.205 INFO:teuthology.orchestra.run.smithi175.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-26T23:33:58.205 INFO:teuthology.orchestra.run.smithi175.stdout:HOME_URL="https://centos.org/" 2024-04-26T23:33:58.206 INFO:teuthology.orchestra.run.smithi175.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-26T23:33:58.206 INFO:teuthology.orchestra.run.smithi175.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-26T23:33:58.206 INFO:teuthology.orchestra.run.smithi175.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-26T23:33:58.207 INFO:teuthology.lock.ops:Updating smithi175.front.sepia.ceph.com on lock server 2024-04-26T23:33:58.228 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-04-26T23:33:58.243 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-04-26T23:33:58.267 INFO:teuthology.task.internal:Checking for old test directory... 2024-04-26T23:33:58.267 DEBUG:teuthology.orchestra.run.smithi088:> test '!' -e /home/ubuntu/cephtest 2024-04-26T23:33:58.269 DEBUG:teuthology.orchestra.run.smithi175:> test '!' -e /home/ubuntu/cephtest 2024-04-26T23:33:58.286 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-04-26T23:33:58.306 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-04-26T23:33:58.307 DEBUG:teuthology.orchestra.run.smithi088:> test -z $(ls -A /var/lib/ceph) 2024-04-26T23:33:58.326 DEBUG:teuthology.orchestra.run.smithi175:> test -z $(ls -A /var/lib/ceph) 2024-04-26T23:33:58.634 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-04-26T23:33:58.692 INFO:teuthology.run_tasks:Running task kernel... 2024-04-26T23:33:58.711 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'flavor': 'default', 'kdb': True, 'sha1': '806ec36b21129f113ce356c007dd59694d340b37'} 2024-04-26T23:33:58.711 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}} 2024-04-26T23:33:58.711 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}}, timeout 300 2024-04-26T23:33:58.711 DEBUG:teuthology.orchestra.run.smithi088:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-26T23:33:58.712 DEBUG:teuthology.orchestra.run.smithi175:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-26T23:33:58.728 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T23:33:58.728 DEBUG:teuthology.orchestra.run.smithi088:> uname -r 2024-04-26T23:33:58.729 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T23:33:58.729 DEBUG:teuthology.orchestra.run.smithi175:> uname -r 2024-04-26T23:33:58.786 INFO:teuthology.orchestra.run.smithi088.stdout:5.14.0-437.el9.x86_64 2024-04-26T23:33:58.786 INFO:teuthology.task.kernel:Running kernel on smithi088: 5.14.0-437.el9.x86_64 2024-04-26T23:33:58.786 DEBUG:teuthology.orchestra.run.smithi088:> sudo yum install -y kernel 2024-04-26T23:33:58.787 INFO:teuthology.orchestra.run.smithi175.stdout:5.14.0-437.el9.x86_64 2024-04-26T23:33:58.787 INFO:teuthology.task.kernel:Running kernel on smithi175: 5.14.0-437.el9.x86_64 2024-04-26T23:33:58.787 DEBUG:teuthology.orchestra.run.smithi175:> sudo yum install -y kernel 2024-04-26T23:34:01.224 INFO:teuthology.orchestra.run.smithi088.stdout:CentOS Stream 9 - BaseOS 9.8 MB/s | 8.0 MB 00:00 2024-04-26T23:34:01.712 INFO:teuthology.orchestra.run.smithi175.stdout:CentOS Stream 9 - BaseOS 6.3 MB/s | 8.0 MB 00:01 2024-04-26T23:34:03.521 INFO:teuthology.orchestra.run.smithi175.stdout:CentOS Stream 9 - AppStream 26 MB/s | 19 MB 00:00 2024-04-26T23:34:05.183 INFO:teuthology.orchestra.run.smithi088.stdout:CentOS Stream 9 - AppStream 6.6 MB/s | 19 MB 00:02 2024-04-26T23:34:07.605 INFO:teuthology.orchestra.run.smithi175.stdout:CentOS Stream 9 - CRB 12 MB/s | 6.2 MB 00:00 2024-04-26T23:34:09.258 INFO:teuthology.orchestra.run.smithi088.stdout:CentOS Stream 9 - CRB 11 MB/s | 6.2 MB 00:00 2024-04-26T23:34:10.180 INFO:teuthology.orchestra.run.smithi175.stdout:CentOS Stream 9 - Extras packages 13 kB/s | 16 kB 00:01 2024-04-26T23:34:10.652 INFO:teuthology.orchestra.run.smithi088.stdout:CentOS Stream 9 - Extras packages 65 kB/s | 16 kB 00:00 2024-04-26T23:34:12.017 INFO:teuthology.orchestra.run.smithi175.stdout:Extra Packages for Enterprise Linux 12 MB/s | 21 MB 00:01 2024-04-26T23:34:12.063 INFO:teuthology.orchestra.run.smithi088.stdout:Extra Packages for Enterprise Linux 16 MB/s | 21 MB 00:01 2024-04-26T23:34:17.156 INFO:teuthology.orchestra.run.smithi175.stdout:lab-extras 13 kB/s | 1.7 kB 00:00 2024-04-26T23:34:17.243 INFO:teuthology.orchestra.run.smithi088.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-04-26T23:34:19.020 INFO:teuthology.orchestra.run.smithi175.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-04-26T23:34:19.021 INFO:teuthology.orchestra.run.smithi175.stdout:Package kernel-5.14.0-437.el9.x86_64 is already installed. 2024-04-26T23:34:19.108 INFO:teuthology.orchestra.run.smithi175.stdout:Dependencies resolved. 2024-04-26T23:34:19.109 INFO:teuthology.orchestra.run.smithi175.stdout:Nothing to do. 2024-04-26T23:34:19.109 INFO:teuthology.orchestra.run.smithi175.stdout:Complete! 2024-04-26T23:34:19.140 INFO:teuthology.orchestra.run.smithi088.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-04-26T23:34:19.141 INFO:teuthology.orchestra.run.smithi088.stdout:Package kernel-5.14.0-437.el9.x86_64 is already installed. 2024-04-26T23:34:19.203 DEBUG:teuthology.orchestra.run.smithi175:> echo no | sudo yum reinstall kernel || true 2024-04-26T23:34:19.235 INFO:teuthology.orchestra.run.smithi088.stdout:Dependencies resolved. 2024-04-26T23:34:19.236 INFO:teuthology.orchestra.run.smithi088.stdout:Nothing to do. 2024-04-26T23:34:19.236 INFO:teuthology.orchestra.run.smithi088.stdout:Complete! 2024-04-26T23:34:19.330 DEBUG:teuthology.orchestra.run.smithi088:> echo no | sudo yum reinstall kernel || true 2024-04-26T23:34:19.702 INFO:teuthology.orchestra.run.smithi175.stdout:Last metadata expiration check: 0:00:02 ago on Fri 26 Apr 2024 11:34:17 PM UTC. 2024-04-26T23:34:19.821 INFO:teuthology.orchestra.run.smithi175.stdout:Dependencies resolved. 2024-04-26T23:34:19.831 INFO:teuthology.orchestra.run.smithi088.stdout:Last metadata expiration check: 0:00:02 ago on Fri 26 Apr 2024 11:34:17 PM UTC. 2024-04-26T23:34:19.834 INFO:teuthology.orchestra.run.smithi175.stdout:================================================================================ 2024-04-26T23:34:19.834 INFO:teuthology.orchestra.run.smithi175.stdout: Package Architecture Version Repository Size 2024-04-26T23:34:19.834 INFO:teuthology.orchestra.run.smithi175.stdout:================================================================================ 2024-04-26T23:34:19.834 INFO:teuthology.orchestra.run.smithi175.stdout:Reinstalling: 2024-04-26T23:34:19.834 INFO:teuthology.orchestra.run.smithi175.stdout: kernel x86_64 5.14.0-437.el9 baseos 255 k 2024-04-26T23:34:19.834 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-26T23:34:19.834 INFO:teuthology.orchestra.run.smithi175.stdout:Transaction Summary 2024-04-26T23:34:19.835 INFO:teuthology.orchestra.run.smithi175.stdout:================================================================================ 2024-04-26T23:34:19.835 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-26T23:34:19.835 INFO:teuthology.orchestra.run.smithi175.stdout:Total download size: 255 k 2024-04-26T23:34:19.835 INFO:teuthology.orchestra.run.smithi175.stdout:Installed size: 0 2024-04-26T23:34:19.835 INFO:teuthology.orchestra.run.smithi175.stderr:Operation aborted. 2024-04-26T23:34:19.887 INFO:teuthology.orchestra.run.smithi175.stdout:Is this ok [y/N]: 2024-04-26T23:34:19.887 DEBUG:teuthology.orchestra.run.smithi175:> sudo yum reinstall -y kernel || true 2024-04-26T23:34:19.950 INFO:teuthology.orchestra.run.smithi088.stdout:Dependencies resolved. 2024-04-26T23:34:19.958 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2024-04-26T23:34:19.959 INFO:teuthology.orchestra.run.smithi088.stdout: Package Architecture Version Repository Size 2024-04-26T23:34:19.959 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2024-04-26T23:34:19.959 INFO:teuthology.orchestra.run.smithi088.stdout:Reinstalling: 2024-04-26T23:34:19.959 INFO:teuthology.orchestra.run.smithi088.stdout: kernel x86_64 5.14.0-437.el9 baseos 255 k 2024-04-26T23:34:19.959 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-26T23:34:19.959 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction Summary 2024-04-26T23:34:19.959 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2024-04-26T23:34:19.959 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-26T23:34:19.959 INFO:teuthology.orchestra.run.smithi088.stdout:Total download size: 255 k 2024-04-26T23:34:19.959 INFO:teuthology.orchestra.run.smithi088.stdout:Installed size: 0 2024-04-26T23:34:19.959 INFO:teuthology.orchestra.run.smithi088.stderr:Operation aborted. 2024-04-26T23:34:20.012 INFO:teuthology.orchestra.run.smithi088.stdout:Is this ok [y/N]: 2024-04-26T23:34:20.013 DEBUG:teuthology.orchestra.run.smithi088:> sudo yum reinstall -y kernel || true 2024-04-26T23:34:20.378 INFO:teuthology.orchestra.run.smithi175.stdout:Last metadata expiration check: 0:00:03 ago on Fri 26 Apr 2024 11:34:17 PM UTC. 2024-04-26T23:34:20.492 INFO:teuthology.orchestra.run.smithi175.stdout:Dependencies resolved. 2024-04-26T23:34:20.493 INFO:teuthology.orchestra.run.smithi175.stdout:================================================================================ 2024-04-26T23:34:20.493 INFO:teuthology.orchestra.run.smithi175.stdout: Package Architecture Version Repository Size 2024-04-26T23:34:20.493 INFO:teuthology.orchestra.run.smithi175.stdout:================================================================================ 2024-04-26T23:34:20.493 INFO:teuthology.orchestra.run.smithi175.stdout:Reinstalling: 2024-04-26T23:34:20.493 INFO:teuthology.orchestra.run.smithi175.stdout: kernel x86_64 5.14.0-437.el9 baseos 255 k 2024-04-26T23:34:20.493 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-26T23:34:20.493 INFO:teuthology.orchestra.run.smithi175.stdout:Transaction Summary 2024-04-26T23:34:20.493 INFO:teuthology.orchestra.run.smithi175.stdout:================================================================================ 2024-04-26T23:34:20.493 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-26T23:34:20.494 INFO:teuthology.orchestra.run.smithi175.stdout:Total download size: 255 k 2024-04-26T23:34:20.494 INFO:teuthology.orchestra.run.smithi175.stdout:Installed size: 0 2024-04-26T23:34:20.494 INFO:teuthology.orchestra.run.smithi175.stdout:Downloading Packages: 2024-04-26T23:34:20.508 INFO:teuthology.orchestra.run.smithi088.stdout:Last metadata expiration check: 0:00:03 ago on Fri 26 Apr 2024 11:34:17 PM UTC. 2024-04-26T23:34:20.623 INFO:teuthology.orchestra.run.smithi088.stdout:Dependencies resolved. 2024-04-26T23:34:20.624 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2024-04-26T23:34:20.624 INFO:teuthology.orchestra.run.smithi088.stdout: Package Architecture Version Repository Size 2024-04-26T23:34:20.624 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2024-04-26T23:34:20.624 INFO:teuthology.orchestra.run.smithi088.stdout:Reinstalling: 2024-04-26T23:34:20.624 INFO:teuthology.orchestra.run.smithi088.stdout: kernel x86_64 5.14.0-437.el9 baseos 255 k 2024-04-26T23:34:20.625 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-26T23:34:20.625 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction Summary 2024-04-26T23:34:20.625 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2024-04-26T23:34:20.625 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-26T23:34:20.625 INFO:teuthology.orchestra.run.smithi088.stdout:Total download size: 255 k 2024-04-26T23:34:20.625 INFO:teuthology.orchestra.run.smithi088.stdout:Installed size: 0 2024-04-26T23:34:20.625 INFO:teuthology.orchestra.run.smithi088.stdout:Downloading Packages: 2024-04-26T23:34:21.087 INFO:teuthology.orchestra.run.smithi088.stdout:kernel-5.14.0-437.el9.x86_64.rpm 761 kB/s | 255 kB 00:00 2024-04-26T23:34:21.087 INFO:teuthology.orchestra.run.smithi088.stdout:-------------------------------------------------------------------------------- 2024-04-26T23:34:21.087 INFO:teuthology.orchestra.run.smithi088.stdout:Total 552 kB/s | 255 kB 00:00 2024-04-26T23:34:21.108 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction check 2024-04-26T23:34:21.241 INFO:teuthology.orchestra.run.smithi175.stdout:kernel-5.14.0-437.el9.x86_64.rpm 540 kB/s | 255 kB 00:00 2024-04-26T23:34:21.241 INFO:teuthology.orchestra.run.smithi175.stdout:-------------------------------------------------------------------------------- 2024-04-26T23:34:21.241 INFO:teuthology.orchestra.run.smithi175.stdout:Total 341 kB/s | 255 kB 00:00 2024-04-26T23:34:21.264 INFO:teuthology.orchestra.run.smithi175.stdout:Running transaction check 2024-04-26T23:34:21.314 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction check succeeded. 2024-04-26T23:34:21.314 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction test 2024-04-26T23:34:21.319 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction test succeeded. 2024-04-26T23:34:21.320 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction 2024-04-26T23:34:21.454 INFO:teuthology.orchestra.run.smithi175.stdout:Transaction check succeeded. 2024-04-26T23:34:21.454 INFO:teuthology.orchestra.run.smithi175.stdout:Running transaction test 2024-04-26T23:34:21.458 INFO:teuthology.orchestra.run.smithi088.stdout: Preparing : 1/1 2024-04-26T23:34:21.459 INFO:teuthology.orchestra.run.smithi175.stdout:Transaction test succeeded. 2024-04-26T23:34:21.459 INFO:teuthology.orchestra.run.smithi175.stdout:Running transaction 2024-04-26T23:34:21.554 INFO:teuthology.orchestra.run.smithi088.stdout: Reinstalling : kernel-5.14.0-437.el9.x86_64 1/2 2024-04-26T23:34:21.554 INFO:teuthology.orchestra.run.smithi088.stdout: Cleanup : kernel-5.14.0-437.el9.x86_64 2/2 2024-04-26T23:34:21.605 INFO:teuthology.orchestra.run.smithi175.stdout: Preparing : 1/1 2024-04-26T23:34:21.702 INFO:teuthology.orchestra.run.smithi175.stdout: Reinstalling : kernel-5.14.0-437.el9.x86_64 1/2 2024-04-26T23:34:21.702 INFO:teuthology.orchestra.run.smithi175.stdout: Cleanup : kernel-5.14.0-437.el9.x86_64 2/2 2024-04-26T23:34:22.285 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: kernel-5.14.0-437.el9.x86_64 2/2 2024-04-26T23:34:22.285 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : kernel-5.14.0-437.el9.x86_64 1/2 2024-04-26T23:34:22.317 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: kernel-5.14.0-437.el9.x86_64 2/2 2024-04-26T23:34:22.317 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : kernel-5.14.0-437.el9.x86_64 1/2 2024-04-26T23:34:23.015 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : kernel-5.14.0-437.el9.x86_64 2/2 2024-04-26T23:34:23.015 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-26T23:34:23.015 INFO:teuthology.orchestra.run.smithi088.stdout:Reinstalled: 2024-04-26T23:34:23.015 INFO:teuthology.orchestra.run.smithi088.stdout: kernel-5.14.0-437.el9.x86_64 2024-04-26T23:34:23.015 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-26T23:34:23.015 INFO:teuthology.orchestra.run.smithi088.stdout:Complete! 2024-04-26T23:34:23.055 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : kernel-5.14.0-437.el9.x86_64 2/2 2024-04-26T23:34:23.055 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-26T23:34:23.055 INFO:teuthology.orchestra.run.smithi175.stdout:Reinstalled: 2024-04-26T23:34:23.055 INFO:teuthology.orchestra.run.smithi175.stdout: kernel-5.14.0-437.el9.x86_64 2024-04-26T23:34:23.055 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-26T23:34:23.055 INFO:teuthology.orchestra.run.smithi175.stdout:Complete! 2024-04-26T23:34:23.208 DEBUG:teuthology.orchestra.run.smithi088:> rpm -q kernel | sort -rV | head -n 1 2024-04-26T23:34:23.215 DEBUG:teuthology.orchestra.run.smithi175:> rpm -q kernel | sort -rV | head -n 1 2024-04-26T23:34:23.254 INFO:teuthology.orchestra.run.smithi088.stdout:kernel-5.14.0-437.el9.x86_64 2024-04-26T23:34:23.255 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-437.el9.x86_64 2024-04-26T23:34:23.255 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2024-04-26T23:34:23.255 DEBUG:teuthology.parallel:result is None 2024-04-26T23:34:23.261 INFO:teuthology.orchestra.run.smithi175.stdout:kernel-5.14.0-437.el9.x86_64 2024-04-26T23:34:23.261 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-437.el9.x86_64 2024-04-26T23:34:23.262 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2024-04-26T23:34:23.262 DEBUG:teuthology.parallel:result is None 2024-04-26T23:34:23.262 INFO:teuthology.run_tasks:Running task internal.base... 2024-04-26T23:34:23.270 INFO:teuthology.task.internal:Creating test directory... 2024-04-26T23:34:23.270 DEBUG:teuthology.orchestra.run.smithi088:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-26T23:34:23.272 DEBUG:teuthology.orchestra.run.smithi175:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-26T23:34:23.287 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-04-26T23:34:23.312 INFO:teuthology.run_tasks:Running task internal.archive... 2024-04-26T23:34:23.345 INFO:teuthology.task.internal:Creating archive directory... 2024-04-26T23:34:23.346 DEBUG:teuthology.orchestra.run.smithi088:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-26T23:34:23.348 DEBUG:teuthology.orchestra.run.smithi175:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-26T23:34:23.374 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-04-26T23:34:23.382 INFO:teuthology.task.internal:Enabling coredump saving... 2024-04-26T23:34:23.382 DEBUG:teuthology.orchestra.run.smithi088:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-26T23:34:23.409 DEBUG:teuthology.orchestra.run.smithi175:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-26T23:34:23.436 INFO:teuthology.orchestra.run.smithi088.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-26T23:34:23.438 INFO:teuthology.orchestra.run.smithi175.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-26T23:34:23.457 INFO:teuthology.orchestra.run.smithi088.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-26T23:34:23.462 INFO:teuthology.orchestra.run.smithi175.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-26T23:34:23.463 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-04-26T23:34:23.472 INFO:teuthology.task.internal:Configuring sudo... 2024-04-26T23:34:23.472 DEBUG:teuthology.orchestra.run.smithi088:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-26T23:34:23.500 DEBUG:teuthology.orchestra.run.smithi175:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-26T23:34:23.526 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-04-26T23:34:23.535 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-04-26T23:34:23.535 DEBUG:teuthology.orchestra.run.smithi088:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-26T23:34:23.564 DEBUG:teuthology.orchestra.run.smithi175:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-26T23:34:23.580 DEBUG:teuthology.orchestra.run.smithi088:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-26T23:34:23.655 DEBUG:teuthology.orchestra.run.smithi088:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-26T23:34:23.706 DEBUG:teuthology.orchestra.run.smithi088:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-26T23:34:23.788 DEBUG:teuthology.orchestra.run.smithi088:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-26T23:34:23.824 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-04-26T23:34:23.825 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-26T23:34:23.887 DEBUG:teuthology.orchestra.run.smithi175:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-26T23:34:23.930 DEBUG:teuthology.orchestra.run.smithi175:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-26T23:34:23.982 DEBUG:teuthology.orchestra.run.smithi175:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-26T23:34:24.064 DEBUG:teuthology.orchestra.run.smithi175:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-26T23:34:24.101 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-26T23:34:24.101 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-26T23:34:24.164 DEBUG:teuthology.orchestra.run.smithi088:> sudo service rsyslog restart 2024-04-26T23:34:24.167 DEBUG:teuthology.orchestra.run.smithi175:> sudo service rsyslog restart 2024-04-26T23:34:24.207 INFO:teuthology.orchestra.run.smithi088.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-26T23:34:24.245 INFO:teuthology.orchestra.run.smithi175.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-26T23:34:24.614 INFO:teuthology.run_tasks:Running task internal.timer... 2024-04-26T23:34:24.622 INFO:teuthology.task.internal:Starting timer... 2024-04-26T23:34:24.622 INFO:teuthology.run_tasks:Running task pcp... 2024-04-26T23:34:24.682 INFO:teuthology.run_tasks:Running task selinux... 2024-04-26T23:34:24.714 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:getty_t:s0']} 2024-04-26T23:34:24.715 DEBUG:teuthology.orchestra.run.smithi088:> sudo service auditd rotate 2024-04-26T23:34:24.761 INFO:teuthology.orchestra.run.smithi088.stdout:Rotating logs: 2024-04-26T23:34:24.763 DEBUG:teuthology.orchestra.run.smithi175:> sudo service auditd rotate 2024-04-26T23:34:24.830 INFO:teuthology.orchestra.run.smithi175.stdout:Rotating logs: 2024-04-26T23:34:24.832 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-04-26T23:34:24.832 DEBUG:teuthology.orchestra.run.smithi088:> /usr/sbin/getenforce 2024-04-26T23:34:24.854 INFO:teuthology.orchestra.run.smithi088.stdout:Permissive 2024-04-26T23:34:24.854 DEBUG:teuthology.orchestra.run.smithi175:> /usr/sbin/getenforce 2024-04-26T23:34:24.878 INFO:teuthology.orchestra.run.smithi175.stdout:Permissive 2024-04-26T23:34:24.878 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi088.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi175.front.sepia.ceph.com': 'permissive'} 2024-04-26T23:34:24.879 DEBUG:teuthology.orchestra.run.smithi088:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-26T23:34:24.918 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T23:34:24.919 DEBUG:teuthology.orchestra.run.smithi175:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-26T23:34:24.942 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T23:34:24.943 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-04-26T23:34:24.943 DEBUG:teuthology.orchestra.run.smithi088:> sudo /usr/sbin/setenforce permissive 2024-04-26T23:34:24.989 DEBUG:teuthology.orchestra.run.smithi175:> sudo /usr/sbin/setenforce permissive 2024-04-26T23:34:25.013 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-04-26T23:34:25.023 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-04-26T23:34:25.039 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-04-26T23:34:25.040 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi088.front.sepia.ceph.com,smithi175.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-04-26T23:37:55.513 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi088.front.sepia.ceph.com'), Remote(name='ubuntu@smithi175.front.sepia.ceph.com')] 2024-04-26T23:37:55.514 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi088.front.sepia.ceph.com' 2024-04-26T23:37:55.516 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T23:37:55.592 DEBUG:teuthology.orchestra.run.smithi088:> true 2024-04-26T23:37:55.674 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi088.front.sepia.ceph.com' 2024-04-26T23:37:55.674 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi175.front.sepia.ceph.com' 2024-04-26T23:37:55.675 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T23:37:55.749 DEBUG:teuthology.orchestra.run.smithi175:> true 2024-04-26T23:37:55.825 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi175.front.sepia.ceph.com' 2024-04-26T23:37:55.825 INFO:teuthology.run_tasks:Running task clock... 2024-04-26T23:37:55.855 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-04-26T23:37:55.856 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-26T23:37:55.856 DEBUG:teuthology.orchestra.run.smithi088:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-26T23:37:55.859 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-26T23:37:55.859 DEBUG:teuthology.orchestra.run.smithi175:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-26T23:37:55.884 INFO:teuthology.orchestra.run.smithi088.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-26T23:37:55.892 INFO:teuthology.orchestra.run.smithi175.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-26T23:37:55.898 INFO:teuthology.orchestra.run.smithi088.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-26T23:37:55.905 INFO:teuthology.orchestra.run.smithi175.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-26T23:37:55.921 INFO:teuthology.orchestra.run.smithi088.stderr:sudo: ntpd: command not found 2024-04-26T23:37:55.927 INFO:teuthology.orchestra.run.smithi175.stderr:sudo: ntpd: command not found 2024-04-26T23:37:55.931 INFO:teuthology.orchestra.run.smithi088.stdout:506 Cannot talk to daemon 2024-04-26T23:37:55.938 INFO:teuthology.orchestra.run.smithi175.stdout:506 Cannot talk to daemon 2024-04-26T23:37:55.944 INFO:teuthology.orchestra.run.smithi088.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-26T23:37:55.950 INFO:teuthology.orchestra.run.smithi175.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-26T23:37:55.957 INFO:teuthology.orchestra.run.smithi088.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-26T23:37:55.963 INFO:teuthology.orchestra.run.smithi175.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-26T23:37:56.010 INFO:teuthology.orchestra.run.smithi088.stderr:bash: line 1: ntpq: command not found 2024-04-26T23:37:56.013 INFO:teuthology.orchestra.run.smithi088.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-26T23:37:56.013 INFO:teuthology.orchestra.run.smithi088.stdout:=============================================================================== 2024-04-26T23:37:56.013 INFO:teuthology.orchestra.run.smithi088.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T23:37:56.013 INFO:teuthology.orchestra.run.smithi088.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T23:37:56.013 INFO:teuthology.orchestra.run.smithi088.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T23:37:56.013 INFO:teuthology.orchestra.run.smithi088.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T23:37:56.020 INFO:teuthology.orchestra.run.smithi175.stderr:bash: line 1: ntpq: command not found 2024-04-26T23:37:56.023 INFO:teuthology.orchestra.run.smithi175.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-26T23:37:56.024 INFO:teuthology.orchestra.run.smithi175.stdout:=============================================================================== 2024-04-26T23:37:56.024 INFO:teuthology.orchestra.run.smithi175.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T23:37:56.024 INFO:teuthology.orchestra.run.smithi175.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T23:37:56.024 INFO:teuthology.orchestra.run.smithi175.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T23:37:56.024 INFO:teuthology.orchestra.run.smithi175.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T23:37:56.025 INFO:teuthology.run_tasks:Running task install... 2024-04-26T23:37:56.033 DEBUG:teuthology.task.install:project ceph 2024-04-26T23:37:56.033 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'bc612ffb9c1d5bc27536bc917a705262a36d4387'}} 2024-04-26T23:37:56.033 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'bc612ffb9c1d5bc27536bc917a705262a36d4387'} 2024-04-26T23:37:56.034 INFO:teuthology.task.install:Using flavor: default 2024-04-26T23:37:56.039 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-04-26T23:37:56.039 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-04-26T23:37:56.040 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'bc612ffb9c1d5bc27536bc917a705262a36d4387', 'tag': None, 'wait_for_package': False} 2024-04-26T23:37:56.040 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=bc612ffb9c1d5bc27536bc917a705262a36d4387 2024-04-26T23:37:56.042 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'bc612ffb9c1d5bc27536bc917a705262a36d4387', 'tag': None, 'wait_for_package': False} 2024-04-26T23:37:56.042 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=bc612ffb9c1d5bc27536bc917a705262a36d4387 2024-04-26T23:37:56.185 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/centos/9/flavors/default/ 2024-04-26T23:37:56.185 INFO:teuthology.task.install.rpm:Package version is 19.0.0-3306.gbc612ffb 2024-04-26T23:37:56.251 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/centos/9/flavors/default/ 2024-04-26T23:37:56.251 INFO:teuthology.task.install.rpm:Package version is 19.0.0-3306.gbc612ffb 2024-04-26T23:37:56.295 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-26T23:37:56.296 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-26T23:37:56.296 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-26T23:37:56.321 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-04-26T23:37:56.321 DEBUG:teuthology.orchestra.run.smithi175:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/bc612ffb9c1d5bc27536bc917a705262a36d4387/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-26T23:37:56.362 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-26T23:37:56.362 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-04-26T23:37:56.362 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-26T23:37:56.386 DEBUG:teuthology.orchestra.run.smithi175:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-26T23:37:56.387 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-04-26T23:37:56.388 DEBUG:teuthology.orchestra.run.smithi088:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/bc612ffb9c1d5bc27536bc917a705262a36d4387/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-26T23:37:56.452 DEBUG:teuthology.orchestra.run.smithi088:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-26T23:37:56.460 DEBUG:teuthology.orchestra.run.smithi175:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-26T23:37:56.522 INFO:teuthology.orchestra.run.smithi175.stdout:check_obsoletes = 1 2024-04-26T23:37:56.524 DEBUG:teuthology.orchestra.run.smithi175:> sudo yum clean all 2024-04-26T23:37:56.525 DEBUG:teuthology.orchestra.run.smithi088:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-26T23:37:56.588 INFO:teuthology.orchestra.run.smithi088.stdout:check_obsoletes = 1 2024-04-26T23:37:56.589 DEBUG:teuthology.orchestra.run.smithi088:> sudo yum clean all 2024-04-26T23:37:56.748 INFO:teuthology.orchestra.run.smithi175.stdout:48 files removed 2024-04-26T23:37:56.775 DEBUG:teuthology.orchestra.run.smithi175:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-04-26T23:37:56.814 INFO:teuthology.orchestra.run.smithi088.stdout:48 files removed 2024-04-26T23:37:56.842 DEBUG:teuthology.orchestra.run.smithi088:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-04-26T23:37:57.414 INFO:teuthology.orchestra.run.smithi175.stdout:ceph packages for x86_64 222 kB/s | 84 kB 00:00 2024-04-26T23:37:57.589 INFO:teuthology.orchestra.run.smithi088.stdout:ceph packages for x86_64 172 kB/s | 84 kB 00:00 2024-04-26T23:37:57.840 INFO:teuthology.orchestra.run.smithi175.stdout:ceph noarch packages 30 kB/s | 12 kB 00:00 2024-04-26T23:37:58.015 INFO:teuthology.orchestra.run.smithi088.stdout:ceph noarch packages 30 kB/s | 12 kB 00:00 2024-04-26T23:37:58.190 INFO:teuthology.orchestra.run.smithi175.stdout:ceph source packages 6.0 kB/s | 1.9 kB 00:00 2024-04-26T23:37:58.458 INFO:teuthology.orchestra.run.smithi088.stdout:ceph source packages 4.7 kB/s | 1.9 kB 00:00 2024-04-26T23:37:58.807 INFO:teuthology.orchestra.run.smithi175.stdout:CentOS Stream 9 - BaseOS 14 MB/s | 8.0 MB 00:00 2024-04-26T23:37:59.573 INFO:teuthology.orchestra.run.smithi088.stdout:CentOS Stream 9 - BaseOS 7.5 MB/s | 8.0 MB 00:01 2024-04-26T23:38:00.861 INFO:teuthology.orchestra.run.smithi175.stdout:CentOS Stream 9 - AppStream 19 MB/s | 19 MB 00:00 2024-04-26T23:38:04.991 INFO:teuthology.orchestra.run.smithi088.stdout:CentOS Stream 9 - AppStream 4.4 MB/s | 19 MB 00:04 2024-04-26T23:38:05.050 INFO:teuthology.orchestra.run.smithi175.stdout:CentOS Stream 9 - CRB 10 MB/s | 6.2 MB 00:00 2024-04-26T23:38:06.759 INFO:teuthology.orchestra.run.smithi175.stdout:CentOS Stream 9 - Extras packages 29 kB/s | 16 kB 00:00 2024-04-26T23:38:08.519 INFO:teuthology.orchestra.run.smithi175.stdout:Extra Packages for Enterprise Linux 13 MB/s | 21 MB 00:01 2024-04-26T23:38:09.610 INFO:teuthology.orchestra.run.smithi088.stdout:CentOS Stream 9 - CRB 7.8 MB/s | 6.2 MB 00:00 2024-04-26T23:38:11.533 INFO:teuthology.orchestra.run.smithi088.stdout:CentOS Stream 9 - Extras packages 22 kB/s | 16 kB 00:00 2024-04-26T23:38:12.911 INFO:teuthology.orchestra.run.smithi088.stdout:Extra Packages for Enterprise Linux 17 MB/s | 21 MB 00:01 2024-04-26T23:38:13.568 INFO:teuthology.orchestra.run.smithi175.stdout:lab-extras 13 kB/s | 1.7 kB 00:00 2024-04-26T23:38:15.686 INFO:teuthology.orchestra.run.smithi175.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-26T23:38:15.687 INFO:teuthology.orchestra.run.smithi175.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-26T23:38:15.698 INFO:teuthology.orchestra.run.smithi175.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-04-26T23:38:15.698 INFO:teuthology.orchestra.run.smithi175.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-04-26T23:38:15.699 INFO:teuthology.orchestra.run.smithi175.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-04-26T23:38:15.700 INFO:teuthology.orchestra.run.smithi175.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-04-26T23:38:15.702 INFO:teuthology.orchestra.run.smithi175.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-04-26T23:38:15.704 INFO:teuthology.orchestra.run.smithi175.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-04-26T23:38:15.705 INFO:teuthology.orchestra.run.smithi175.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-04-26T23:38:15.766 INFO:teuthology.orchestra.run.smithi175.stdout:Dependencies resolved. 2024-04-26T23:38:15.775 INFO:teuthology.orchestra.run.smithi175.stdout:======================================================================================= 2024-04-26T23:38:15.775 INFO:teuthology.orchestra.run.smithi175.stdout: Package Arch Version Repository Size 2024-04-26T23:38:15.775 INFO:teuthology.orchestra.run.smithi175.stdout:======================================================================================= 2024-04-26T23:38:15.775 INFO:teuthology.orchestra.run.smithi175.stdout:Installing: 2024-04-26T23:38:15.776 INFO:teuthology.orchestra.run.smithi175.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-04-26T23:38:15.776 INFO:teuthology.orchestra.run.smithi175.stdout: ceph x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 6.6 k 2024-04-26T23:38:15.776 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-base x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 5.4 M 2024-04-26T23:38:15.776 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-fuse x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 889 k 2024-04-26T23:38:15.776 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 145 k 2024-04-26T23:38:15.776 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 1.5 M 2024-04-26T23:38:15.776 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-cephadm noarch 2:19.0.0-3306.gbc612ffb.el9 ceph-noarch 142 k 2024-04-26T23:38:15.776 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-dashboard noarch 2:19.0.0-3306.gbc612ffb.el9 ceph-noarch 3.5 M 2024-04-26T23:38:15.776 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-3306.gbc612ffb.el9 ceph-noarch 7.4 M 2024-04-26T23:38:15.776 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-rook noarch 2:19.0.0-3306.gbc612ffb.el9 ceph-noarch 49 k 2024-04-26T23:38:15.776 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-radosgw x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 11 M 2024-04-26T23:38:15.776 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-test x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 49 M 2024-04-26T23:38:15.776 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-volume noarch 2:19.0.0-3306.gbc612ffb.el9 ceph-noarch 273 k 2024-04-26T23:38:15.777 INFO:teuthology.orchestra.run.smithi175.stdout: cephadm noarch 2:19.0.0-3306.gbc612ffb.el9 ceph-noarch 762 k 2024-04-26T23:38:15.777 INFO:teuthology.orchestra.run.smithi175.stdout: cephfs-mirror x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 225 k 2024-04-26T23:38:15.777 INFO:teuthology.orchestra.run.smithi175.stdout: cephfs-shell x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 27 k 2024-04-26T23:38:15.777 INFO:teuthology.orchestra.run.smithi175.stdout: cephfs-top noarch 2:19.0.0-3306.gbc612ffb.el9 ceph-noarch 18 k 2024-04-26T23:38:15.777 INFO:teuthology.orchestra.run.smithi175.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-04-26T23:38:15.777 INFO:teuthology.orchestra.run.smithi175.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-04-26T23:38:15.777 INFO:teuthology.orchestra.run.smithi175.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-04-26T23:38:15.777 INFO:teuthology.orchestra.run.smithi175.stdout: libcephfs-devel x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 32 k 2024-04-26T23:38:15.777 INFO:teuthology.orchestra.run.smithi175.stdout: libcephfs2 x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 747 k 2024-04-26T23:38:15.777 INFO:teuthology.orchestra.run.smithi175.stdout: librados-devel x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 127 k 2024-04-26T23:38:15.777 INFO:teuthology.orchestra.run.smithi175.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-04-26T23:38:15.777 INFO:teuthology.orchestra.run.smithi175.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-04-26T23:38:15.777 INFO:teuthology.orchestra.run.smithi175.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-04-26T23:38:15.777 INFO:teuthology.orchestra.run.smithi175.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-04-26T23:38:15.777 INFO:teuthology.orchestra.run.smithi175.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-04-26T23:38:15.778 INFO:teuthology.orchestra.run.smithi175.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-04-26T23:38:15.778 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cephfs x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 161 k 2024-04-26T23:38:15.778 INFO:teuthology.orchestra.run.smithi175.stdout: python3-rados x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 321 k 2024-04-26T23:38:15.778 INFO:teuthology.orchestra.run.smithi175.stdout: python3-rbd x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 298 k 2024-04-26T23:38:15.778 INFO:teuthology.orchestra.run.smithi175.stdout: python3-rgw x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 99 k 2024-04-26T23:38:15.778 INFO:teuthology.orchestra.run.smithi175.stdout: rbd-fuse x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 85 k 2024-04-26T23:38:15.778 INFO:teuthology.orchestra.run.smithi175.stdout: rbd-mirror x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 3.1 M 2024-04-26T23:38:15.778 INFO:teuthology.orchestra.run.smithi175.stdout: rbd-nbd x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 171 k 2024-04-26T23:38:15.778 INFO:teuthology.orchestra.run.smithi175.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-04-26T23:38:15.778 INFO:teuthology.orchestra.run.smithi175.stdout:Upgrading: 2024-04-26T23:38:15.778 INFO:teuthology.orchestra.run.smithi175.stdout: librados2 x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 3.4 M 2024-04-26T23:38:15.779 INFO:teuthology.orchestra.run.smithi175.stdout: librbd1 x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 3.1 M 2024-04-26T23:38:15.779 INFO:teuthology.orchestra.run.smithi175.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-04-26T23:38:15.779 INFO:teuthology.orchestra.run.smithi175.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-04-26T23:38:15.779 INFO:teuthology.orchestra.run.smithi175.stdout:Installing dependencies: 2024-04-26T23:38:15.779 INFO:teuthology.orchestra.run.smithi175.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-04-26T23:38:15.779 INFO:teuthology.orchestra.run.smithi175.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-04-26T23:38:15.779 INFO:teuthology.orchestra.run.smithi175.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-04-26T23:38:15.779 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-common x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 21 M 2024-04-26T23:38:15.779 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-grafana-dashboards noarch 2:19.0.0-3306.gbc612ffb.el9 ceph-noarch 34 k 2024-04-26T23:38:15.779 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mds x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 2.4 M 2024-04-26T23:38:15.779 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-modules-core noarch 2:19.0.0-3306.gbc612ffb.el9 ceph-noarch 249 k 2024-04-26T23:38:15.779 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mon x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 4.7 M 2024-04-26T23:38:15.779 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-osd x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 17 M 2024-04-26T23:38:15.779 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-prometheus-alerts noarch 2:19.0.0-3306.gbc612ffb.el9 ceph-noarch 16 k 2024-04-26T23:38:15.780 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-selinux x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 25 k 2024-04-26T23:38:15.780 INFO:teuthology.orchestra.run.smithi175.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-04-26T23:38:15.780 INFO:teuthology.orchestra.run.smithi175.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-04-26T23:38:15.780 INFO:teuthology.orchestra.run.smithi175.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-04-26T23:38:15.780 INFO:teuthology.orchestra.run.smithi175.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-04-26T23:38:15.780 INFO:teuthology.orchestra.run.smithi175.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-04-26T23:38:15.780 INFO:teuthology.orchestra.run.smithi175.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-04-26T23:38:15.780 INFO:teuthology.orchestra.run.smithi175.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-04-26T23:38:15.780 INFO:teuthology.orchestra.run.smithi175.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-04-26T23:38:15.780 INFO:teuthology.orchestra.run.smithi175.stdout: libcephsqlite x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 163 k 2024-04-26T23:38:15.780 INFO:teuthology.orchestra.run.smithi175.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-04-26T23:38:15.781 INFO:teuthology.orchestra.run.smithi175.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-04-26T23:38:15.781 INFO:teuthology.orchestra.run.smithi175.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-04-26T23:38:15.781 INFO:teuthology.orchestra.run.smithi175.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-04-26T23:38:15.781 INFO:teuthology.orchestra.run.smithi175.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-04-26T23:38:15.781 INFO:teuthology.orchestra.run.smithi175.stdout: libradosstriper1 x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 501 k 2024-04-26T23:38:15.781 INFO:teuthology.orchestra.run.smithi175.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-04-26T23:38:15.781 INFO:teuthology.orchestra.run.smithi175.stdout: librgw2 x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 5.4 M 2024-04-26T23:38:15.781 INFO:teuthology.orchestra.run.smithi175.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-04-26T23:38:15.781 INFO:teuthology.orchestra.run.smithi175.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-04-26T23:38:15.781 INFO:teuthology.orchestra.run.smithi175.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-04-26T23:38:15.781 INFO:teuthology.orchestra.run.smithi175.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-04-26T23:38:15.781 INFO:teuthology.orchestra.run.smithi175.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-04-26T23:38:15.782 INFO:teuthology.orchestra.run.smithi175.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-04-26T23:38:15.782 INFO:teuthology.orchestra.run.smithi175.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-04-26T23:38:15.782 INFO:teuthology.orchestra.run.smithi175.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-04-26T23:38:15.782 INFO:teuthology.orchestra.run.smithi175.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-04-26T23:38:15.782 INFO:teuthology.orchestra.run.smithi175.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-04-26T23:38:15.782 INFO:teuthology.orchestra.run.smithi175.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-04-26T23:38:15.782 INFO:teuthology.orchestra.run.smithi175.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-04-26T23:38:15.782 INFO:teuthology.orchestra.run.smithi175.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-04-26T23:38:15.782 INFO:teuthology.orchestra.run.smithi175.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-04-26T23:38:15.782 INFO:teuthology.orchestra.run.smithi175.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-04-26T23:38:15.782 INFO:teuthology.orchestra.run.smithi175.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-04-26T23:38:15.782 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-04-26T23:38:15.783 INFO:teuthology.orchestra.run.smithi175.stdout: python3-ceph-argparse x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 45 k 2024-04-26T23:38:15.783 INFO:teuthology.orchestra.run.smithi175.stdout: python3-ceph-common x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 135 k 2024-04-26T23:38:15.783 INFO:teuthology.orchestra.run.smithi175.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-04-26T23:38:15.783 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-04-26T23:38:15.783 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-04-26T23:38:15.783 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-04-26T23:38:15.783 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-04-26T23:38:15.783 INFO:teuthology.orchestra.run.smithi175.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-04-26T23:38:15.783 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-04-26T23:38:15.783 INFO:teuthology.orchestra.run.smithi175.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-04-26T23:38:15.783 INFO:teuthology.orchestra.run.smithi175.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-04-26T23:38:15.783 INFO:teuthology.orchestra.run.smithi175.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-04-26T23:38:15.783 INFO:teuthology.orchestra.run.smithi175.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-04-26T23:38:15.784 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-04-26T23:38:15.784 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-04-26T23:38:15.784 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-04-26T23:38:15.784 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-04-26T23:38:15.784 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-04-26T23:38:15.784 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-04-26T23:38:15.784 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-04-26T23:38:15.784 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-04-26T23:38:15.784 INFO:teuthology.orchestra.run.smithi175.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-04-26T23:38:15.784 INFO:teuthology.orchestra.run.smithi175.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-04-26T23:38:15.784 INFO:teuthology.orchestra.run.smithi175.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-04-26T23:38:15.784 INFO:teuthology.orchestra.run.smithi175.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-04-26T23:38:15.784 INFO:teuthology.orchestra.run.smithi175.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-04-26T23:38:15.784 INFO:teuthology.orchestra.run.smithi175.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-04-26T23:38:15.785 INFO:teuthology.orchestra.run.smithi175.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-04-26T23:38:15.785 INFO:teuthology.orchestra.run.smithi175.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-04-26T23:38:15.785 INFO:teuthology.orchestra.run.smithi175.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-04-26T23:38:15.785 INFO:teuthology.orchestra.run.smithi175.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-04-26T23:38:15.785 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-04-26T23:38:15.785 INFO:teuthology.orchestra.run.smithi175.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-04-26T23:38:15.785 INFO:teuthology.orchestra.run.smithi175.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-04-26T23:38:15.785 INFO:teuthology.orchestra.run.smithi175.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-04-26T23:38:15.785 INFO:teuthology.orchestra.run.smithi175.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-04-26T23:38:15.785 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-04-26T23:38:15.785 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-04-26T23:38:15.785 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-04-26T23:38:15.785 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-04-26T23:38:15.785 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-04-26T23:38:15.785 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-04-26T23:38:15.785 INFO:teuthology.orchestra.run.smithi175.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-04-26T23:38:15.786 INFO:teuthology.orchestra.run.smithi175.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-04-26T23:38:15.786 INFO:teuthology.orchestra.run.smithi175.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-04-26T23:38:15.786 INFO:teuthology.orchestra.run.smithi175.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-04-26T23:38:15.786 INFO:teuthology.orchestra.run.smithi175.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-04-26T23:38:15.786 INFO:teuthology.orchestra.run.smithi175.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-04-26T23:38:15.786 INFO:teuthology.orchestra.run.smithi175.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-04-26T23:38:15.786 INFO:teuthology.orchestra.run.smithi175.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-04-26T23:38:15.786 INFO:teuthology.orchestra.run.smithi175.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-04-26T23:38:15.786 INFO:teuthology.orchestra.run.smithi175.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-04-26T23:38:15.786 INFO:teuthology.orchestra.run.smithi175.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-04-26T23:38:15.786 INFO:teuthology.orchestra.run.smithi175.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-04-26T23:38:15.786 INFO:teuthology.orchestra.run.smithi175.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-04-26T23:38:15.786 INFO:teuthology.orchestra.run.smithi175.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-04-26T23:38:15.786 INFO:teuthology.orchestra.run.smithi175.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-04-26T23:38:15.787 INFO:teuthology.orchestra.run.smithi175.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-04-26T23:38:15.787 INFO:teuthology.orchestra.run.smithi175.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-04-26T23:38:15.787 INFO:teuthology.orchestra.run.smithi175.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-04-26T23:38:15.787 INFO:teuthology.orchestra.run.smithi175.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-04-26T23:38:15.787 INFO:teuthology.orchestra.run.smithi175.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-04-26T23:38:15.787 INFO:teuthology.orchestra.run.smithi175.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-04-26T23:38:15.787 INFO:teuthology.orchestra.run.smithi175.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-04-26T23:38:15.787 INFO:teuthology.orchestra.run.smithi175.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-04-26T23:38:15.787 INFO:teuthology.orchestra.run.smithi175.stdout:Installing weak dependencies: 2024-04-26T23:38:15.787 INFO:teuthology.orchestra.run.smithi175.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-04-26T23:38:15.787 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-26T23:38:15.787 INFO:teuthology.orchestra.run.smithi175.stdout:Transaction Summary 2024-04-26T23:38:15.787 INFO:teuthology.orchestra.run.smithi175.stdout:======================================================================================= 2024-04-26T23:38:15.787 INFO:teuthology.orchestra.run.smithi175.stdout:Install 148 Packages 2024-04-26T23:38:15.788 INFO:teuthology.orchestra.run.smithi175.stdout:Upgrade 4 Packages 2024-04-26T23:38:15.788 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-26T23:38:15.788 INFO:teuthology.orchestra.run.smithi175.stdout:Total download size: 222 M 2024-04-26T23:38:15.788 INFO:teuthology.orchestra.run.smithi175.stdout:Downloading Packages: 2024-04-26T23:38:16.569 INFO:teuthology.orchestra.run.smithi175.stdout:(1/152): ceph-19.0.0-3306.gbc612ffb.el9.x86_64. 39 kB/s | 6.6 kB 00:00 2024-04-26T23:38:16.878 INFO:teuthology.orchestra.run.smithi175.stdout:(2/152): ceph-fuse-19.0.0-3306.gbc612ffb.el9.x8 2.8 MB/s | 889 kB 00:00 2024-04-26T23:38:16.945 INFO:teuthology.orchestra.run.smithi175.stdout:(3/152): ceph-immutable-object-cache-19.0.0-330 2.1 MB/s | 145 kB 00:00 2024-04-26T23:38:17.304 INFO:teuthology.orchestra.run.smithi175.stdout:(4/152): ceph-mds-19.0.0-3306.gbc612ffb.el9.x86 6.6 MB/s | 2.4 MB 00:00 2024-04-26T23:38:17.379 INFO:teuthology.orchestra.run.smithi175.stdout:(5/152): ceph-base-19.0.0-3306.gbc612ffb.el9.x8 5.5 MB/s | 5.4 MB 00:00 2024-04-26T23:38:17.537 INFO:teuthology.orchestra.run.smithi175.stdout:(6/152): ceph-mgr-19.0.0-3306.gbc612ffb.el9.x86 6.5 MB/s | 1.5 MB 00:00 2024-04-26T23:38:17.779 INFO:teuthology.orchestra.run.smithi175.stdout:(7/152): ceph-mon-19.0.0-3306.gbc612ffb.el9.x86 12 MB/s | 4.7 MB 00:00 2024-04-26T23:38:17.984 INFO:teuthology.orchestra.run.smithi088.stdout:lab-extras 34 kB/s | 1.7 kB 00:00 2024-04-26T23:38:18.680 INFO:teuthology.orchestra.run.smithi175.stdout:(8/152): ceph-radosgw-19.0.0-3306.gbc612ffb.el9 12 MB/s | 11 MB 00:00 2024-04-26T23:38:18.746 INFO:teuthology.orchestra.run.smithi175.stdout:(9/152): ceph-selinux-19.0.0-3306.gbc612ffb.el9 379 kB/s | 25 kB 00:00 2024-04-26T23:38:19.122 INFO:teuthology.orchestra.run.smithi175.stdout:(10/152): ceph-osd-19.0.0-3306.gbc612ffb.el9.x8 11 MB/s | 17 MB 00:01 2024-04-26T23:38:19.180 INFO:teuthology.orchestra.run.smithi175.stdout:(11/152): cephfs-mirror-19.0.0-3306.gbc612ffb.e 3.8 MB/s | 225 kB 00:00 2024-04-26T23:38:19.239 INFO:teuthology.orchestra.run.smithi175.stdout:(12/152): cephfs-shell-19.0.0-3306.gbc612ffb.el 464 kB/s | 27 kB 00:00 2024-04-26T23:38:19.297 INFO:teuthology.orchestra.run.smithi175.stdout:(13/152): libcephfs-devel-19.0.0-3306.gbc612ffb 545 kB/s | 32 kB 00:00 2024-04-26T23:38:19.439 INFO:teuthology.orchestra.run.smithi175.stdout:(14/152): libcephfs2-19.0.0-3306.gbc612ffb.el9. 5.1 MB/s | 747 kB 00:00 2024-04-26T23:38:19.498 INFO:teuthology.orchestra.run.smithi175.stdout:(15/152): libcephsqlite-19.0.0-3306.gbc612ffb.e 2.7 MB/s | 163 kB 00:00 2024-04-26T23:38:19.565 INFO:teuthology.orchestra.run.smithi175.stdout:(16/152): librados-devel-19.0.0-3306.gbc612ffb. 1.9 MB/s | 127 kB 00:00 2024-04-26T23:38:19.690 INFO:teuthology.orchestra.run.smithi175.stdout:(17/152): libradosstriper1-19.0.0-3306.gbc612ff 3.9 MB/s | 501 kB 00:00 2024-04-26T23:38:20.101 INFO:teuthology.orchestra.run.smithi088.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-26T23:38:20.102 INFO:teuthology.orchestra.run.smithi088.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-26T23:38:20.112 INFO:teuthology.orchestra.run.smithi088.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-04-26T23:38:20.113 INFO:teuthology.orchestra.run.smithi088.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-04-26T23:38:20.114 INFO:teuthology.orchestra.run.smithi088.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-04-26T23:38:20.115 INFO:teuthology.orchestra.run.smithi088.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-04-26T23:38:20.116 INFO:teuthology.orchestra.run.smithi088.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-04-26T23:38:20.118 INFO:teuthology.orchestra.run.smithi088.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-04-26T23:38:20.119 INFO:teuthology.orchestra.run.smithi088.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-04-26T23:38:20.181 INFO:teuthology.orchestra.run.smithi088.stdout:Dependencies resolved. 2024-04-26T23:38:20.190 INFO:teuthology.orchestra.run.smithi088.stdout:======================================================================================= 2024-04-26T23:38:20.190 INFO:teuthology.orchestra.run.smithi088.stdout: Package Arch Version Repository Size 2024-04-26T23:38:20.190 INFO:teuthology.orchestra.run.smithi088.stdout:======================================================================================= 2024-04-26T23:38:20.190 INFO:teuthology.orchestra.run.smithi088.stdout:Installing: 2024-04-26T23:38:20.190 INFO:teuthology.orchestra.run.smithi088.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-04-26T23:38:20.190 INFO:teuthology.orchestra.run.smithi088.stdout: ceph x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 6.6 k 2024-04-26T23:38:20.191 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-base x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 5.4 M 2024-04-26T23:38:20.191 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-fuse x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 889 k 2024-04-26T23:38:20.191 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 145 k 2024-04-26T23:38:20.191 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mgr x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 1.5 M 2024-04-26T23:38:20.191 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mgr-cephadm noarch 2:19.0.0-3306.gbc612ffb.el9 ceph-noarch 142 k 2024-04-26T23:38:20.191 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mgr-dashboard noarch 2:19.0.0-3306.gbc612ffb.el9 ceph-noarch 3.5 M 2024-04-26T23:38:20.191 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-3306.gbc612ffb.el9 ceph-noarch 7.4 M 2024-04-26T23:38:20.191 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mgr-rook noarch 2:19.0.0-3306.gbc612ffb.el9 ceph-noarch 49 k 2024-04-26T23:38:20.191 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-radosgw x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 11 M 2024-04-26T23:38:20.191 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-test x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 49 M 2024-04-26T23:38:20.191 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-volume noarch 2:19.0.0-3306.gbc612ffb.el9 ceph-noarch 273 k 2024-04-26T23:38:20.191 INFO:teuthology.orchestra.run.smithi088.stdout: cephadm noarch 2:19.0.0-3306.gbc612ffb.el9 ceph-noarch 762 k 2024-04-26T23:38:20.191 INFO:teuthology.orchestra.run.smithi088.stdout: cephfs-mirror x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 225 k 2024-04-26T23:38:20.191 INFO:teuthology.orchestra.run.smithi088.stdout: cephfs-shell x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 27 k 2024-04-26T23:38:20.192 INFO:teuthology.orchestra.run.smithi088.stdout: cephfs-top noarch 2:19.0.0-3306.gbc612ffb.el9 ceph-noarch 18 k 2024-04-26T23:38:20.192 INFO:teuthology.orchestra.run.smithi088.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-04-26T23:38:20.192 INFO:teuthology.orchestra.run.smithi088.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-04-26T23:38:20.192 INFO:teuthology.orchestra.run.smithi088.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-04-26T23:38:20.192 INFO:teuthology.orchestra.run.smithi088.stdout: libcephfs-devel x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 32 k 2024-04-26T23:38:20.192 INFO:teuthology.orchestra.run.smithi088.stdout: libcephfs2 x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 747 k 2024-04-26T23:38:20.192 INFO:teuthology.orchestra.run.smithi088.stdout: librados-devel x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 127 k 2024-04-26T23:38:20.192 INFO:teuthology.orchestra.run.smithi088.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-04-26T23:38:20.192 INFO:teuthology.orchestra.run.smithi088.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-04-26T23:38:20.192 INFO:teuthology.orchestra.run.smithi088.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-04-26T23:38:20.192 INFO:teuthology.orchestra.run.smithi088.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-04-26T23:38:20.192 INFO:teuthology.orchestra.run.smithi088.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-04-26T23:38:20.192 INFO:teuthology.orchestra.run.smithi088.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-04-26T23:38:20.192 INFO:teuthology.orchestra.run.smithi088.stdout: python3-cephfs x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 161 k 2024-04-26T23:38:20.193 INFO:teuthology.orchestra.run.smithi088.stdout: python3-rados x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 321 k 2024-04-26T23:38:20.193 INFO:teuthology.orchestra.run.smithi088.stdout: python3-rbd x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 298 k 2024-04-26T23:38:20.193 INFO:teuthology.orchestra.run.smithi088.stdout: python3-rgw x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 99 k 2024-04-26T23:38:20.193 INFO:teuthology.orchestra.run.smithi088.stdout: rbd-fuse x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 85 k 2024-04-26T23:38:20.193 INFO:teuthology.orchestra.run.smithi088.stdout: rbd-mirror x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 3.1 M 2024-04-26T23:38:20.193 INFO:teuthology.orchestra.run.smithi088.stdout: rbd-nbd x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 171 k 2024-04-26T23:38:20.193 INFO:teuthology.orchestra.run.smithi088.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-04-26T23:38:20.193 INFO:teuthology.orchestra.run.smithi088.stdout:Upgrading: 2024-04-26T23:38:20.193 INFO:teuthology.orchestra.run.smithi088.stdout: librados2 x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 3.4 M 2024-04-26T23:38:20.193 INFO:teuthology.orchestra.run.smithi088.stdout: librbd1 x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 3.1 M 2024-04-26T23:38:20.193 INFO:teuthology.orchestra.run.smithi088.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-04-26T23:38:20.193 INFO:teuthology.orchestra.run.smithi088.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-04-26T23:38:20.193 INFO:teuthology.orchestra.run.smithi088.stdout:Installing dependencies: 2024-04-26T23:38:20.193 INFO:teuthology.orchestra.run.smithi088.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-04-26T23:38:20.194 INFO:teuthology.orchestra.run.smithi088.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-04-26T23:38:20.194 INFO:teuthology.orchestra.run.smithi088.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-04-26T23:38:20.194 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-common x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 21 M 2024-04-26T23:38:20.194 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-grafana-dashboards noarch 2:19.0.0-3306.gbc612ffb.el9 ceph-noarch 34 k 2024-04-26T23:38:20.194 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mds x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 2.4 M 2024-04-26T23:38:20.194 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mgr-modules-core noarch 2:19.0.0-3306.gbc612ffb.el9 ceph-noarch 249 k 2024-04-26T23:38:20.194 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mon x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 4.7 M 2024-04-26T23:38:20.194 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-osd x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 17 M 2024-04-26T23:38:20.194 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-prometheus-alerts noarch 2:19.0.0-3306.gbc612ffb.el9 ceph-noarch 16 k 2024-04-26T23:38:20.194 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-selinux x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 25 k 2024-04-26T23:38:20.194 INFO:teuthology.orchestra.run.smithi088.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-04-26T23:38:20.194 INFO:teuthology.orchestra.run.smithi088.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-04-26T23:38:20.194 INFO:teuthology.orchestra.run.smithi088.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-04-26T23:38:20.195 INFO:teuthology.orchestra.run.smithi088.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-04-26T23:38:20.195 INFO:teuthology.orchestra.run.smithi088.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-04-26T23:38:20.195 INFO:teuthology.orchestra.run.smithi088.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-04-26T23:38:20.195 INFO:teuthology.orchestra.run.smithi088.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-04-26T23:38:20.195 INFO:teuthology.orchestra.run.smithi088.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-04-26T23:38:20.195 INFO:teuthology.orchestra.run.smithi088.stdout: libcephsqlite x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 163 k 2024-04-26T23:38:20.195 INFO:teuthology.orchestra.run.smithi088.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-04-26T23:38:20.195 INFO:teuthology.orchestra.run.smithi088.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-04-26T23:38:20.195 INFO:teuthology.orchestra.run.smithi088.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-04-26T23:38:20.195 INFO:teuthology.orchestra.run.smithi088.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-04-26T23:38:20.195 INFO:teuthology.orchestra.run.smithi088.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-04-26T23:38:20.195 INFO:teuthology.orchestra.run.smithi088.stdout: libradosstriper1 x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 501 k 2024-04-26T23:38:20.195 INFO:teuthology.orchestra.run.smithi088.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-04-26T23:38:20.195 INFO:teuthology.orchestra.run.smithi088.stdout: librgw2 x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 5.4 M 2024-04-26T23:38:20.196 INFO:teuthology.orchestra.run.smithi088.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-04-26T23:38:20.196 INFO:teuthology.orchestra.run.smithi088.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-04-26T23:38:20.196 INFO:teuthology.orchestra.run.smithi088.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-04-26T23:38:20.196 INFO:teuthology.orchestra.run.smithi088.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-04-26T23:38:20.196 INFO:teuthology.orchestra.run.smithi088.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-04-26T23:38:20.196 INFO:teuthology.orchestra.run.smithi088.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-04-26T23:38:20.196 INFO:teuthology.orchestra.run.smithi088.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-04-26T23:38:20.196 INFO:teuthology.orchestra.run.smithi088.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-04-26T23:38:20.196 INFO:teuthology.orchestra.run.smithi088.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-04-26T23:38:20.196 INFO:teuthology.orchestra.run.smithi088.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-04-26T23:38:20.196 INFO:teuthology.orchestra.run.smithi088.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-04-26T23:38:20.196 INFO:teuthology.orchestra.run.smithi088.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-04-26T23:38:20.196 INFO:teuthology.orchestra.run.smithi088.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-04-26T23:38:20.196 INFO:teuthology.orchestra.run.smithi088.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-04-26T23:38:20.197 INFO:teuthology.orchestra.run.smithi088.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-04-26T23:38:20.197 INFO:teuthology.orchestra.run.smithi088.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-04-26T23:38:20.197 INFO:teuthology.orchestra.run.smithi088.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-04-26T23:38:20.197 INFO:teuthology.orchestra.run.smithi088.stdout: python3-ceph-argparse x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 45 k 2024-04-26T23:38:20.197 INFO:teuthology.orchestra.run.smithi088.stdout: python3-ceph-common x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 135 k 2024-04-26T23:38:20.197 INFO:teuthology.orchestra.run.smithi088.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-04-26T23:38:20.197 INFO:teuthology.orchestra.run.smithi088.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-04-26T23:38:20.197 INFO:teuthology.orchestra.run.smithi088.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-04-26T23:38:20.197 INFO:teuthology.orchestra.run.smithi088.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-04-26T23:38:20.197 INFO:teuthology.orchestra.run.smithi088.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-04-26T23:38:20.197 INFO:teuthology.orchestra.run.smithi088.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-04-26T23:38:20.197 INFO:teuthology.orchestra.run.smithi088.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-04-26T23:38:20.197 INFO:teuthology.orchestra.run.smithi088.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-04-26T23:38:20.197 INFO:teuthology.orchestra.run.smithi088.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-04-26T23:38:20.198 INFO:teuthology.orchestra.run.smithi088.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-04-26T23:38:20.198 INFO:teuthology.orchestra.run.smithi088.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-04-26T23:38:20.198 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-04-26T23:38:20.198 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-04-26T23:38:20.198 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-04-26T23:38:20.198 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-04-26T23:38:20.198 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-04-26T23:38:20.198 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-04-26T23:38:20.198 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-04-26T23:38:20.198 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-04-26T23:38:20.198 INFO:teuthology.orchestra.run.smithi088.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-04-26T23:38:20.198 INFO:teuthology.orchestra.run.smithi088.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-04-26T23:38:20.198 INFO:teuthology.orchestra.run.smithi088.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-04-26T23:38:20.199 INFO:teuthology.orchestra.run.smithi088.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-04-26T23:38:20.199 INFO:teuthology.orchestra.run.smithi088.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-04-26T23:38:20.199 INFO:teuthology.orchestra.run.smithi088.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-04-26T23:38:20.199 INFO:teuthology.orchestra.run.smithi088.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-04-26T23:38:20.199 INFO:teuthology.orchestra.run.smithi088.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-04-26T23:38:20.199 INFO:teuthology.orchestra.run.smithi088.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-04-26T23:38:20.199 INFO:teuthology.orchestra.run.smithi088.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-04-26T23:38:20.199 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-04-26T23:38:20.199 INFO:teuthology.orchestra.run.smithi088.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-04-26T23:38:20.199 INFO:teuthology.orchestra.run.smithi088.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-04-26T23:38:20.199 INFO:teuthology.orchestra.run.smithi088.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-04-26T23:38:20.199 INFO:teuthology.orchestra.run.smithi088.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-04-26T23:38:20.199 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-04-26T23:38:20.200 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-04-26T23:38:20.200 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-04-26T23:38:20.200 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-04-26T23:38:20.200 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-04-26T23:38:20.200 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-04-26T23:38:20.200 INFO:teuthology.orchestra.run.smithi088.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-04-26T23:38:20.200 INFO:teuthology.orchestra.run.smithi088.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-04-26T23:38:20.200 INFO:teuthology.orchestra.run.smithi088.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-04-26T23:38:20.200 INFO:teuthology.orchestra.run.smithi088.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-04-26T23:38:20.200 INFO:teuthology.orchestra.run.smithi088.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-04-26T23:38:20.200 INFO:teuthology.orchestra.run.smithi088.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-04-26T23:38:20.200 INFO:teuthology.orchestra.run.smithi088.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-04-26T23:38:20.200 INFO:teuthology.orchestra.run.smithi088.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-04-26T23:38:20.200 INFO:teuthology.orchestra.run.smithi088.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-04-26T23:38:20.200 INFO:teuthology.orchestra.run.smithi088.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-04-26T23:38:20.201 INFO:teuthology.orchestra.run.smithi088.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-04-26T23:38:20.201 INFO:teuthology.orchestra.run.smithi088.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-04-26T23:38:20.201 INFO:teuthology.orchestra.run.smithi088.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-04-26T23:38:20.201 INFO:teuthology.orchestra.run.smithi088.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-04-26T23:38:20.201 INFO:teuthology.orchestra.run.smithi088.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-04-26T23:38:20.201 INFO:teuthology.orchestra.run.smithi088.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-04-26T23:38:20.201 INFO:teuthology.orchestra.run.smithi088.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-04-26T23:38:20.201 INFO:teuthology.orchestra.run.smithi088.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-04-26T23:38:20.201 INFO:teuthology.orchestra.run.smithi088.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-04-26T23:38:20.201 INFO:teuthology.orchestra.run.smithi088.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-04-26T23:38:20.201 INFO:teuthology.orchestra.run.smithi088.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-04-26T23:38:20.201 INFO:teuthology.orchestra.run.smithi088.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-04-26T23:38:20.201 INFO:teuthology.orchestra.run.smithi088.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-04-26T23:38:20.201 INFO:teuthology.orchestra.run.smithi088.stdout:Installing weak dependencies: 2024-04-26T23:38:20.201 INFO:teuthology.orchestra.run.smithi088.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-04-26T23:38:20.201 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-26T23:38:20.202 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction Summary 2024-04-26T23:38:20.202 INFO:teuthology.orchestra.run.smithi088.stdout:======================================================================================= 2024-04-26T23:38:20.202 INFO:teuthology.orchestra.run.smithi088.stdout:Install 148 Packages 2024-04-26T23:38:20.202 INFO:teuthology.orchestra.run.smithi088.stdout:Upgrade 4 Packages 2024-04-26T23:38:20.202 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-26T23:38:20.202 INFO:teuthology.orchestra.run.smithi088.stdout:Total download size: 222 M 2024-04-26T23:38:20.202 INFO:teuthology.orchestra.run.smithi088.stdout:Downloading Packages: 2024-04-26T23:38:20.473 INFO:teuthology.orchestra.run.smithi175.stdout:(18/152): librgw2-19.0.0-3306.gbc612ffb.el9.x86 6.9 MB/s | 5.4 MB 00:00 2024-04-26T23:38:20.532 INFO:teuthology.orchestra.run.smithi175.stdout:(19/152): python3-ceph-argparse-19.0.0-3306.gbc 769 kB/s | 45 kB 00:00 2024-04-26T23:38:20.741 INFO:teuthology.orchestra.run.smithi175.stdout:(20/152): ceph-common-19.0.0-3306.gbc612ffb.el9 4.9 MB/s | 21 MB 00:04 2024-04-26T23:38:20.766 INFO:teuthology.orchestra.run.smithi175.stdout:(21/152): python3-ceph-common-19.0.0-3306.gbc61 578 kB/s | 135 kB 00:00 2024-04-26T23:38:20.800 INFO:teuthology.orchestra.run.smithi175.stdout:(22/152): python3-cephfs-19.0.0-3306.gbc612ffb. 2.7 MB/s | 161 kB 00:00 2024-04-26T23:38:20.825 INFO:teuthology.orchestra.run.smithi175.stdout:(23/152): python3-rados-19.0.0-3306.gbc612ffb.e 5.3 MB/s | 321 kB 00:00 2024-04-26T23:38:20.884 INFO:teuthology.orchestra.run.smithi175.stdout:(24/152): python3-rbd-19.0.0-3306.gbc612ffb.el9 3.5 MB/s | 298 kB 00:00 2024-04-26T23:38:20.909 INFO:teuthology.orchestra.run.smithi175.stdout:(25/152): python3-rgw-19.0.0-3306.gbc612ffb.el9 1.2 MB/s | 99 kB 00:00 2024-04-26T23:38:20.959 INFO:teuthology.orchestra.run.smithi175.stdout:(26/152): rbd-fuse-19.0.0-3306.gbc612ffb.el9.x8 1.1 MB/s | 85 kB 00:00 2024-04-26T23:38:21.060 INFO:teuthology.orchestra.run.smithi175.stdout:(27/152): rbd-nbd-19.0.0-3306.gbc612ffb.el9.x86 1.7 MB/s | 171 kB 00:00 2024-04-26T23:38:21.152 INFO:teuthology.orchestra.run.smithi175.stdout:(28/152): ceph-grafana-dashboards-19.0.0-3306.g 373 kB/s | 34 kB 00:00 2024-04-26T23:38:21.268 INFO:teuthology.orchestra.run.smithi175.stdout:(29/152): rbd-mirror-19.0.0-3306.gbc612ffb.el9. 8.6 MB/s | 3.1 MB 00:00 2024-04-26T23:38:21.294 INFO:teuthology.orchestra.run.smithi175.stdout:(30/152): ceph-mgr-cephadm-19.0.0-3306.gbc612ff 1.0 MB/s | 142 kB 00:00 2024-04-26T23:38:21.429 INFO:teuthology.orchestra.run.smithi088.stdout:(1/152): ceph-19.0.0-3306.gbc612ffb.el9.x86_64. 17 kB/s | 6.6 kB 00:00 2024-04-26T23:38:21.752 INFO:teuthology.orchestra.run.smithi175.stdout:(31/152): ceph-mgr-dashboard-19.0.0-3306.gbc612 7.3 MB/s | 3.5 MB 00:00 2024-04-26T23:38:21.945 INFO:teuthology.orchestra.run.smithi088.stdout:(2/152): ceph-fuse-19.0.0-3306.gbc612ffb.el9.x8 1.7 MB/s | 889 kB 00:00 2024-04-26T23:38:22.012 INFO:teuthology.orchestra.run.smithi088.stdout:(3/152): ceph-immutable-object-cache-19.0.0-330 2.1 MB/s | 145 kB 00:00 2024-04-26T23:38:22.186 INFO:teuthology.orchestra.run.smithi175.stdout:(32/152): ceph-test-19.0.0-3306.gbc612ffb.el9.x 14 MB/s | 49 MB 00:03 2024-04-26T23:38:22.211 INFO:teuthology.orchestra.run.smithi175.stdout:(33/152): ceph-mgr-modules-core-19.0.0-3306.gbc 543 kB/s | 249 kB 00:00 2024-04-26T23:38:22.245 INFO:teuthology.orchestra.run.smithi175.stdout:(34/152): ceph-mgr-rook-19.0.0-3306.gbc612ffb.e 847 kB/s | 49 kB 00:00 2024-04-26T23:38:22.270 INFO:teuthology.orchestra.run.smithi175.stdout:(35/152): ceph-prometheus-alerts-19.0.0-3306.gb 280 kB/s | 16 kB 00:00 2024-04-26T23:38:22.312 INFO:teuthology.orchestra.run.smithi175.stdout:(36/152): ceph-volume-19.0.0-3306.gbc612ffb.el9 4.0 MB/s | 273 kB 00:00 2024-04-26T23:38:22.379 INFO:teuthology.orchestra.run.smithi175.stdout:(37/152): cephadm-19.0.0-3306.gbc612ffb.el9.noa 6.9 MB/s | 762 kB 00:00 2024-04-26T23:38:22.396 INFO:teuthology.orchestra.run.smithi175.stdout:(38/152): cephfs-top-19.0.0-3306.gbc612ffb.el9. 219 kB/s | 18 kB 00:00 2024-04-26T23:38:22.446 INFO:teuthology.orchestra.run.smithi088.stdout:(4/152): ceph-mds-19.0.0-3306.gbc612ffb.el9.x86 5.5 MB/s | 2.4 MB 00:00 2024-04-26T23:38:22.496 INFO:teuthology.orchestra.run.smithi175.stdout:(39/152): ceph-mgr-diskprediction-local-19.0.0- 6.2 MB/s | 7.4 MB 00:01 2024-04-26T23:38:22.621 INFO:teuthology.orchestra.run.smithi088.stdout:(5/152): ceph-mgr-19.0.0-3306.gbc612ffb.el9.x86 8.7 MB/s | 1.5 MB 00:00 2024-04-26T23:38:22.663 INFO:teuthology.orchestra.run.smithi175.stdout:(40/152): libquadmath-11.4.1-3.el9.x86_64.rpm 1.1 MB/s | 195 kB 00:00 2024-04-26T23:38:22.713 INFO:teuthology.orchestra.run.smithi175.stdout:(41/152): fuse-2.9.9-15.el9.x86_64.rpm 240 kB/s | 80 kB 00:00 2024-04-26T23:38:22.738 INFO:teuthology.orchestra.run.smithi175.stdout:(42/152): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.3 MB/s | 253 kB 00:00 2024-04-26T23:38:22.789 INFO:teuthology.orchestra.run.smithi175.stdout:(43/152): python3-ply-3.11-14.el9.noarch.rpm 2.1 MB/s | 106 kB 00:00 2024-04-26T23:38:22.856 INFO:teuthology.orchestra.run.smithi175.stdout:(44/152): python3-pycparser-2.20-6.el9.noarch.r 2.0 MB/s | 135 kB 00:00 2024-04-26T23:38:22.889 INFO:teuthology.orchestra.run.smithi175.stdout:(45/152): libgfortran-11.4.1-3.el9.x86_64.rpm 1.6 MB/s | 803 kB 00:00 2024-04-26T23:38:22.923 INFO:teuthology.orchestra.run.smithi175.stdout:(46/152): python3-cryptography-36.0.1-4.el9.x86 5.9 MB/s | 1.2 MB 00:00 2024-04-26T23:38:22.948 INFO:teuthology.orchestra.run.smithi175.stdout:(47/152): python3-requests-2.25.1-8.el9.noarch. 1.3 MB/s | 125 kB 00:00 2024-04-26T23:38:22.954 INFO:teuthology.orchestra.run.smithi088.stdout:(6/152): ceph-mon-19.0.0-3306.gbc612ffb.el9.x86 14 MB/s | 4.7 MB 00:00 2024-04-26T23:38:22.990 INFO:teuthology.orchestra.run.smithi175.stdout:(48/152): python3-urllib3-1.26.5-5.el9.noarch.r 2.1 MB/s | 215 kB 00:00 2024-04-26T23:38:23.065 INFO:teuthology.orchestra.run.smithi175.stdout:(49/152): automake-1.16.2-8.el9.noarch.rpm 4.7 MB/s | 689 kB 00:00 2024-04-26T23:38:23.091 INFO:teuthology.orchestra.run.smithi175.stdout:(50/152): boost-program-options-1.75.0-8.el9.x8 1.0 MB/s | 107 kB 00:00 2024-04-26T23:38:23.133 INFO:teuthology.orchestra.run.smithi175.stdout:(51/152): bison-3.7.4-5.el9.x86_64.rpm 5.0 MB/s | 943 kB 00:00 2024-04-26T23:38:23.158 INFO:teuthology.orchestra.run.smithi175.stdout:(52/152): elfutils-libelf-devel-0.190-2.el9.x86 233 kB/s | 21 kB 00:00 2024-04-26T23:38:23.200 INFO:teuthology.orchestra.run.smithi175.stdout:(53/152): flexiblas-3.0.4-8.el9.x86_64.rpm 491 kB/s | 33 kB 00:00 2024-04-26T23:38:23.225 INFO:teuthology.orchestra.run.smithi175.stdout:(54/152): flex-2.6.4-9.el9.x86_64.rpm 2.3 MB/s | 313 kB 00:00 2024-04-26T23:38:23.267 INFO:teuthology.orchestra.run.smithi175.stdout:(55/152): flexiblas-openblas-openmp-3.0.4-8.el9 272 kB/s | 18 kB 00:00 2024-04-26T23:38:23.292 INFO:teuthology.orchestra.run.smithi175.stdout:(56/152): libaio-devel-0.3.111-13.el9.x86_64.rp 167 kB/s | 11 kB 00:00 2024-04-26T23:38:23.351 INFO:teuthology.orchestra.run.smithi175.stdout:(57/152): librabbitmq-0.11.0-7.el9.x86_64.rpm 778 kB/s | 45 kB 00:00 2024-04-26T23:38:23.409 INFO:teuthology.orchestra.run.smithi175.stdout:(58/152): flexiblas-netlib-3.0.4-8.el9.x86_64.r 12 MB/s | 3.0 MB 00:00 2024-04-26T23:38:23.435 INFO:teuthology.orchestra.run.smithi175.stdout:(59/152): libpmemobj-1.12.1-1.el9.x86_64.rpm 958 kB/s | 160 kB 00:00 2024-04-26T23:38:23.485 INFO:teuthology.orchestra.run.smithi175.stdout:(60/152): libuuid-devel-2.37.4-18.el9.x86_64.rp 511 kB/s | 25 kB 00:00 2024-04-26T23:38:23.504 INFO:teuthology.orchestra.run.smithi088.stdout:(7/152): ceph-base-19.0.0-3306.gbc612ffb.el9.x8 2.2 MB/s | 5.4 MB 00:02 2024-04-26T23:38:23.510 INFO:teuthology.orchestra.run.smithi175.stdout:(61/152): librdkafka-1.6.1-102.el9.x86_64.rpm 4.1 MB/s | 662 kB 00:00 2024-04-26T23:38:23.544 INFO:teuthology.orchestra.run.smithi175.stdout:(62/152): libtool-2.4.6-45.el9.x86_64.rpm 4.2 MB/s | 582 kB 00:00 2024-04-26T23:38:23.569 INFO:teuthology.orchestra.run.smithi175.stdout:(63/152): libzstd-devel-1.5.1-2.el9.x86_64.rpm 567 kB/s | 47 kB 00:00 2024-04-26T23:38:23.619 INFO:teuthology.orchestra.run.smithi175.stdout:(64/152): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.6 MB/s | 292 kB 00:00 2024-04-26T23:38:23.644 INFO:teuthology.orchestra.run.smithi175.stdout:(65/152): openblas-0.3.21-2.el9.x86_64.rpm 470 kB/s | 35 kB 00:00 2024-04-26T23:38:23.670 INFO:teuthology.orchestra.run.smithi175.stdout:(66/152): lua-5.4.4-4.el9.x86_64.rpm 1.5 MB/s | 188 kB 00:00 2024-04-26T23:38:23.795 INFO:teuthology.orchestra.run.smithi175.stdout:(67/152): postgresql-13.14-1.el9.x86_64.rpm 13 MB/s | 1.6 MB 00:00 2024-04-26T23:38:23.887 INFO:teuthology.orchestra.run.smithi175.stdout:(68/152): openblas-openmp-0.3.21-2.el9.x86_64.r 18 MB/s | 4.7 MB 00:00 2024-04-26T23:38:23.946 INFO:teuthology.orchestra.run.smithi175.stdout:(69/152): openssl-devel-3.2.1-1.el9.x86_64.rpm 15 MB/s | 4.4 MB 00:00 2024-04-26T23:38:23.988 INFO:teuthology.orchestra.run.smithi088.stdout:(8/152): ceph-osd-19.0.0-3306.gbc612ffb.el9.x86 16 MB/s | 17 MB 00:01 2024-04-26T23:38:23.996 INFO:teuthology.orchestra.run.smithi175.stdout:(70/152): postgresql-contrib-13.14-1.el9.x86_64 4.4 MB/s | 911 kB 00:00 2024-04-26T23:38:24.029 INFO:teuthology.orchestra.run.smithi175.stdout:(71/152): postgresql-private-libs-13.14-1.el9.x 941 kB/s | 133 kB 00:00 2024-04-26T23:38:24.038 INFO:teuthology.orchestra.run.smithi088.stdout:(9/152): ceph-selinux-19.0.0-3306.gbc612ffb.el9 506 kB/s | 25 kB 00:00 2024-04-26T23:38:24.088 INFO:teuthology.orchestra.run.smithi175.stdout:(72/152): python3-attrs-20.3.0-7.el9.noarch.rpm 1.5 MB/s | 87 kB 00:00 2024-04-26T23:38:24.146 INFO:teuthology.orchestra.run.smithi175.stdout:(73/152): protobuf-3.14.0-13.el9.x86_64.rpm 6.7 MB/s | 1.0 MB 00:00 2024-04-26T23:38:24.247 INFO:teuthology.orchestra.run.smithi175.stdout:(74/152): postgresql-server-13.14-1.el9.x86_64. 19 MB/s | 5.8 MB 00:00 2024-04-26T23:38:24.297 INFO:teuthology.orchestra.run.smithi175.stdout:(75/152): python3-devel-3.9.18-3.el9.x86_64.rpm 1.6 MB/s | 244 kB 00:00 2024-04-26T23:38:24.347 INFO:teuthology.orchestra.run.smithi175.stdout:(76/152): python3-jinja2-2.11.3-5.el9.noarch.rp 2.4 MB/s | 248 kB 00:00 2024-04-26T23:38:24.364 INFO:teuthology.orchestra.run.smithi175.stdout:(77/152): python3-jsonpatch-1.21-16.el9.noarch. 385 kB/s | 26 kB 00:00 2024-04-26T23:38:24.406 INFO:teuthology.orchestra.run.smithi175.stdout:(78/152): python3-jsonpointer-2.0-4.el9.noarch. 328 kB/s | 19 kB 00:00 2024-04-26T23:38:24.523 INFO:teuthology.orchestra.run.smithi175.stdout:(79/152): python3-babel-2.9.1-2.el9.noarch.rpm 14 MB/s | 6.0 MB 00:00 2024-04-26T23:38:24.565 INFO:teuthology.orchestra.run.smithi175.stdout:(80/152): python3-mako-1.1.4-6.el9.noarch.rpm 858 kB/s | 172 kB 00:00 2024-04-26T23:38:24.590 INFO:teuthology.orchestra.run.smithi175.stdout:(81/152): python3-markupsafe-1.1.1-12.el9.x86_6 189 kB/s | 35 kB 00:00 2024-04-26T23:38:24.665 INFO:teuthology.orchestra.run.smithi175.stdout:(82/152): python3-oauthlib-3.1.1-5.el9.noarch.r 2.9 MB/s | 222 kB 00:00 2024-04-26T23:38:24.690 INFO:teuthology.orchestra.run.smithi175.stdout:(83/152): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.4 MB/s | 250 kB 00:00 2024-04-26T23:38:24.741 INFO:teuthology.orchestra.run.smithi175.stdout:(84/152): python3-packaging-20.9-5.el9.noarch.r 1.0 MB/s | 77 kB 00:00 2024-04-26T23:38:24.766 INFO:teuthology.orchestra.run.smithi175.stdout:(85/152): python3-prettytable-0.7.2-27.el9.noar 561 kB/s | 42 kB 00:00 2024-04-26T23:38:24.841 INFO:teuthology.orchestra.run.smithi175.stdout:(86/152): python3-numpy-1.20.1-5.el9.x86_64.rpm 16 MB/s | 5.1 MB 00:00 2024-04-26T23:38:24.883 INFO:teuthology.orchestra.run.smithi175.stdout:(87/152): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.3 MB/s | 159 kB 00:00 2024-04-26T23:38:24.908 INFO:teuthology.orchestra.run.smithi175.stdout:(88/152): python3-protobuf-3.14.0-13.el9.noarch 1.6 MB/s | 269 kB 00:00 2024-04-26T23:38:24.958 INFO:teuthology.orchestra.run.smithi175.stdout:(89/152): python3-pyasn1-modules-0.4.8-6.el9.no 2.3 MB/s | 279 kB 00:00 2024-04-26T23:38:24.984 INFO:teuthology.orchestra.run.smithi175.stdout:(90/152): python3-pytz-2021.1-5.el9.noarch.rpm 507 kB/s | 51 kB 00:00 2024-04-26T23:38:25.009 INFO:teuthology.orchestra.run.smithi175.stdout:(91/152): python3-requests-oauthlib-1.3.0-12.el 534 kB/s | 54 kB 00:00 2024-04-26T23:38:25.059 INFO:teuthology.orchestra.run.smithi175.stdout:(92/152): python3-toml-0.10.2-6.el9.noarch.rpm 553 kB/s | 42 kB 00:00 2024-04-26T23:38:25.084 INFO:teuthology.orchestra.run.smithi175.stdout:(93/152): python3-wcwidth-0.2.5-8.el9.noarch.rp 587 kB/s | 44 kB 00:00 2024-04-26T23:38:25.135 INFO:teuthology.orchestra.run.smithi175.stdout:(94/152): qatlib-service-24.02.0-1.el9.x86_64.r 719 kB/s | 36 kB 00:00 2024-04-26T23:38:25.160 INFO:teuthology.orchestra.run.smithi175.stdout:(95/152): qatlib-24.02.0-1.el9.x86_64.rpm 2.1 MB/s | 221 kB 00:00 2024-04-26T23:38:25.210 INFO:teuthology.orchestra.run.smithi175.stdout:(96/152): qatzip-libs-1.2.0-1.el9.x86_64.rpm 629 kB/s | 47 kB 00:00 2024-04-26T23:38:25.261 INFO:teuthology.orchestra.run.smithi175.stdout:(97/152): socat-1.7.4.1-5.el9.x86_64.rpm 3.0 MB/s | 305 kB 00:00 2024-04-26T23:38:25.286 INFO:teuthology.orchestra.run.smithi175.stdout:(98/152): uuid-1.6.2-55.el9.x86_64.rpm 767 kB/s | 58 kB 00:00 2024-04-26T23:38:25.353 INFO:teuthology.orchestra.run.smithi175.stdout:(99/152): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 1.0 MB/s | 94 kB 00:00 2024-04-26T23:38:25.378 INFO:teuthology.orchestra.run.smithi175.stdout:(100/152): xmlstarlet-1.6.1-20.el9.x86_64.rpm 693 kB/s | 64 kB 00:00 2024-04-26T23:38:25.439 INFO:teuthology.orchestra.run.smithi175.stdout:(101/152): zlib-devel-1.2.11-41.el9.x86_64.rpm 523 kB/s | 45 kB 00:00 2024-04-26T23:38:25.598 INFO:teuthology.orchestra.run.smithi175.stdout:(102/152): python3-scipy-1.6.2-8.el9.x86_64.rpm 25 MB/s | 16 MB 00:00 2024-04-26T23:38:25.930 INFO:teuthology.orchestra.run.smithi088.stdout:(10/152): ceph-radosgw-19.0.0-3306.gbc612ffb.el 4.4 MB/s | 11 MB 00:02 2024-04-26T23:38:25.989 INFO:teuthology.orchestra.run.smithi175.stdout:(103/152): abseil-cpp-20211102.0-3.el9.x86_64.r 1.4 MB/s | 548 kB 00:00 2024-04-26T23:38:26.065 INFO:teuthology.orchestra.run.smithi175.stdout:(104/152): lua-devel-5.4.4-4.el9.x86_64.rpm 32 kB/s | 22 kB 00:00 2024-04-26T23:38:26.090 INFO:teuthology.orchestra.run.smithi175.stdout:(105/152): gperftools-libs-2.9.1-2.el9.x86_64.r 3.0 MB/s | 309 kB 00:00 2024-04-26T23:38:26.130 INFO:teuthology.orchestra.run.smithi088.stdout:(11/152): ceph-common-19.0.0-3306.gbc612ffb.el9 4.2 MB/s | 21 MB 00:05 2024-04-26T23:38:26.155 INFO:teuthology.orchestra.run.smithi088.stdout:(12/152): cephfs-mirror-19.0.0-3306.gbc612ffb.e 1.0 MB/s | 225 kB 00:00 2024-04-26T23:38:26.189 INFO:teuthology.orchestra.run.smithi088.stdout:(13/152): cephfs-shell-19.0.0-3306.gbc612ffb.el 463 kB/s | 27 kB 00:00 2024-04-26T23:38:26.214 INFO:teuthology.orchestra.run.smithi088.stdout:(14/152): libcephfs-devel-19.0.0-3306.gbc612ffb 540 kB/s | 32 kB 00:00 2024-04-26T23:38:26.282 INFO:teuthology.orchestra.run.smithi175.stdout:(106/152): libarrow-9.0.0-11.el9.x86_64.rpm 23 MB/s | 4.4 MB 00:00 2024-04-26T23:38:26.307 INFO:teuthology.orchestra.run.smithi175.stdout:(107/152): grpc-data-1.46.7-10.el9.noarch.rpm 80 kB/s | 19 kB 00:00 2024-04-26T23:38:26.356 INFO:teuthology.orchestra.run.smithi088.stdout:(15/152): libcephsqlite-19.0.0-3306.gbc612ffb.e 1.1 MB/s | 163 kB 00:00 2024-04-26T23:38:26.357 INFO:teuthology.orchestra.run.smithi175.stdout:(108/152): libarrow-doc-9.0.0-11.el9.noarch.rpm 346 kB/s | 26 kB 00:00 2024-04-26T23:38:26.390 INFO:teuthology.orchestra.run.smithi088.stdout:(16/152): libcephfs2-19.0.0-3306.gbc612ffb.el9. 3.6 MB/s | 747 kB 00:00 2024-04-26T23:38:26.448 INFO:teuthology.orchestra.run.smithi088.stdout:(17/152): librados-devel-19.0.0-3306.gbc612ffb. 1.4 MB/s | 127 kB 00:00 2024-04-26T23:38:26.449 INFO:teuthology.orchestra.run.smithi175.stdout:(109/152): liboath-2.6.7-2.el9.x86_64.rpm 342 kB/s | 49 kB 00:00 2024-04-26T23:38:26.474 INFO:teuthology.orchestra.run.smithi175.stdout:(110/152): libunwind-1.6.2-1.el9.x86_64.rpm 576 kB/s | 67 kB 00:00 2024-04-26T23:38:26.575 INFO:teuthology.orchestra.run.smithi175.stdout:(111/152): parquet-libs-9.0.0-11.el9.x86_64.rpm 8.2 MB/s | 839 kB 00:00 2024-04-26T23:38:26.600 INFO:teuthology.orchestra.run.smithi175.stdout:(112/152): luarocks-3.9.2-1.el9.noarch.rpm 1.0 MB/s | 151 kB 00:00 2024-04-26T23:38:26.675 INFO:teuthology.orchestra.run.smithi175.stdout:(113/152): python3-bcrypt-3.2.2-1.el9.x86_64.rp 580 kB/s | 43 kB 00:00 2024-04-26T23:38:26.709 INFO:teuthology.orchestra.run.smithi175.stdout:(114/152): python3-asyncssh-2.13.2-5.el9.noarch 4.0 MB/s | 548 kB 00:00 2024-04-26T23:38:26.751 INFO:teuthology.orchestra.run.smithi175.stdout:(115/152): python3-cachetools-4.2.4-1.el9.noarc 428 kB/s | 32 kB 00:00 2024-04-26T23:38:26.793 INFO:teuthology.orchestra.run.smithi175.stdout:(116/152): python3-certifi-2021.10.8-2.el9.noar 179 kB/s | 15 kB 00:00 2024-04-26T23:38:26.818 INFO:teuthology.orchestra.run.smithi175.stdout:(117/152): python3-cheroot-8.6.0-4.el9.noarch.r 2.5 MB/s | 172 kB 00:00 2024-04-26T23:38:26.868 INFO:teuthology.orchestra.run.smithi175.stdout:(118/152): python3-cherrypy-18.6.1-2.el9.noarch 4.7 MB/s | 358 kB 00:00 2024-04-26T23:38:26.924 INFO:teuthology.orchestra.run.smithi088.stdout:(18/152): ceph-test-19.0.0-3306.gbc612ffb.el9.x 17 MB/s | 49 MB 00:02 2024-04-26T23:38:26.935 INFO:teuthology.orchestra.run.smithi175.stdout:(119/152): python3-cmd2-2.4.2-2.el9.noarch.rpm 2.5 MB/s | 303 kB 00:00 2024-04-26T23:38:26.948 INFO:teuthology.orchestra.run.smithi088.stdout:(19/152): libradosstriper1-19.0.0-3306.gbc612ff 896 kB/s | 501 kB 00:00 2024-04-26T23:38:26.969 INFO:teuthology.orchestra.run.smithi175.stdout:(120/152): python3-colorama-0.4.4-12.el9.noarch 352 kB/s | 35 kB 00:00 2024-04-26T23:38:26.974 INFO:teuthology.orchestra.run.smithi088.stdout:(20/152): python3-ceph-argparse-19.0.0-3306.gbc 905 kB/s | 45 kB 00:00 2024-04-26T23:38:27.008 INFO:teuthology.orchestra.run.smithi088.stdout:(21/152): python3-ceph-common-19.0.0-3306.gbc61 2.3 MB/s | 135 kB 00:00 2024-04-26T23:38:27.033 INFO:teuthology.orchestra.run.smithi088.stdout:(22/152): python3-cephfs-19.0.0-3306.gbc612ffb. 2.7 MB/s | 161 kB 00:00 2024-04-26T23:38:27.061 INFO:teuthology.orchestra.run.smithi175.stdout:(121/152): protobuf-compiler-3.14.0-13.el9.x86_ 532 kB/s | 863 kB 00:01 2024-04-26T23:38:27.086 INFO:teuthology.orchestra.run.smithi175.stdout:(122/152): python3-google-auth-2.29.0-1.el9.noa 1.3 MB/s | 206 kB 00:00 2024-04-26T23:38:27.092 INFO:teuthology.orchestra.run.smithi088.stdout:(23/152): python3-rbd-19.0.0-3306.gbc612ffb.el9 5.0 MB/s | 298 kB 00:00 2024-04-26T23:38:27.117 INFO:teuthology.orchestra.run.smithi088.stdout:(24/152): python3-rados-19.0.0-3306.gbc612ffb.e 2.9 MB/s | 321 kB 00:00 2024-04-26T23:38:27.142 INFO:teuthology.orchestra.run.smithi088.stdout:(25/152): python3-rgw-19.0.0-3306.gbc612ffb.el9 1.9 MB/s | 99 kB 00:00 2024-04-26T23:38:27.144 INFO:teuthology.orchestra.run.smithi175.stdout:(123/152): python3-grpcio-1.46.7-10.el9.x86_64. 12 MB/s | 2.0 MB 00:00 2024-04-26T23:38:27.170 INFO:teuthology.orchestra.run.smithi175.stdout:(124/152): python3-jaraco-8.2.1-3.el9.noarch.rp 128 kB/s | 11 kB 00:00 2024-04-26T23:38:27.176 INFO:teuthology.orchestra.run.smithi088.stdout:(26/152): rbd-fuse-19.0.0-3306.gbc612ffb.el9.x8 1.4 MB/s | 85 kB 00:00 2024-04-26T23:38:27.203 INFO:teuthology.orchestra.run.smithi175.stdout:(125/152): python3-jaraco-classes-3.2.1-5.el9.n 303 kB/s | 18 kB 00:00 2024-04-26T23:38:27.229 INFO:teuthology.orchestra.run.smithi175.stdout:(126/152): python3-jaraco-collections-3.0.0-8.e 395 kB/s | 23 kB 00:00 2024-04-26T23:38:27.260 INFO:teuthology.orchestra.run.smithi088.stdout:(27/152): rbd-nbd-19.0.0-3306.gbc612ffb.el9.x86 2.0 MB/s | 171 kB 00:00 2024-04-26T23:38:27.262 INFO:teuthology.orchestra.run.smithi175.stdout:(127/152): python3-jaraco-functools-3.5.0-2.el9 332 kB/s | 19 kB 00:00 2024-04-26T23:38:27.313 INFO:teuthology.orchestra.run.smithi175.stdout:(128/152): python3-jaraco-text-3.2.0-6.el9.noar 235 kB/s | 20 kB 00:00 2024-04-26T23:38:27.337 INFO:teuthology.orchestra.run.smithi175.stdout:(129/152): python3-grpcio-tools-1.46.7-10.el9.x 523 kB/s | 144 kB 00:00 2024-04-26T23:38:27.368 INFO:teuthology.orchestra.run.smithi088.stdout:(28/152): rbd-mirror-19.0.0-3306.gbc612ffb.el9. 14 MB/s | 3.1 MB 00:00 2024-04-26T23:38:27.380 INFO:teuthology.orchestra.run.smithi175.stdout:(130/152): python3-kubernetes-26.1.0-2.el9.noar 8.7 MB/s | 1.0 MB 00:00 2024-04-26T23:38:27.385 INFO:teuthology.orchestra.run.smithi088.stdout:(29/152): ceph-grafana-dashboards-19.0.0-3306.g 273 kB/s | 34 kB 00:00 2024-04-26T23:38:27.405 INFO:teuthology.orchestra.run.smithi175.stdout:(131/152): python3-logutils-0.3.5-21.el9.noarch 503 kB/s | 46 kB 00:00 2024-04-26T23:38:27.430 INFO:teuthology.orchestra.run.smithi175.stdout:(132/152): python3-more-itertools-8.12.0-2.el9. 853 kB/s | 79 kB 00:00 2024-04-26T23:38:27.461 INFO:teuthology.orchestra.run.smithi088.stdout:(30/152): librgw2-19.0.0-3306.gbc612ffb.el9.x86 5.3 MB/s | 5.4 MB 00:01 2024-04-26T23:38:27.478 INFO:teuthology.orchestra.run.smithi088.stdout:(31/152): ceph-mgr-cephadm-19.0.0-3306.gbc612ff 1.3 MB/s | 142 kB 00:00 2024-04-26T23:38:27.489 INFO:teuthology.orchestra.run.smithi175.stdout:(133/152): python3-pecan-1.4.2-3.el9.noarch.rpm 3.2 MB/s | 272 kB 00:00 2024-04-26T23:38:27.514 INFO:teuthology.orchestra.run.smithi175.stdout:(134/152): python3-portend-3.1.0-2.el9.noarch.r 196 kB/s | 16 kB 00:00 2024-04-26T23:38:27.528 INFO:teuthology.orchestra.run.smithi088.stdout:(32/152): ceph-mgr-modules-core-19.0.0-3306.gbc 4.9 MB/s | 249 kB 00:00 2024-04-26T23:38:27.539 INFO:teuthology.orchestra.run.smithi175.stdout:(135/152): python3-natsort-7.1.1-5.el9.noarch.r 362 kB/s | 58 kB 00:00 2024-04-26T23:38:27.570 INFO:teuthology.orchestra.run.smithi088.stdout:(33/152): ceph-mgr-rook-19.0.0-3306.gbc612ffb.e 1.2 MB/s | 49 kB 00:00 2024-04-26T23:38:27.573 INFO:teuthology.orchestra.run.smithi175.stdout:(136/152): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.1 MB/s | 90 kB 00:00 2024-04-26T23:38:27.598 INFO:teuthology.orchestra.run.smithi175.stdout:(137/152): python3-pyperclip-1.8.2-2.el9.noarch 337 kB/s | 28 kB 00:00 2024-04-26T23:38:27.620 INFO:teuthology.orchestra.run.smithi088.stdout:(34/152): ceph-prometheus-alerts-19.0.0-3306.gb 330 kB/s | 16 kB 00:00 2024-04-26T23:38:27.657 INFO:teuthology.orchestra.run.smithi175.stdout:(138/152): python3-repoze-lru-0.7-16.el9.noarch 263 kB/s | 31 kB 00:00 2024-04-26T23:38:27.695 INFO:teuthology.orchestra.run.smithi088.stdout:(35/152): ceph-volume-19.0.0-3306.gbc612ffb.el9 3.6 MB/s | 273 kB 00:00 2024-04-26T23:38:27.707 INFO:teuthology.orchestra.run.smithi175.stdout:(139/152): python3-routes-2.5.1-5.el9.noarch.rp 1.4 MB/s | 188 kB 00:00 2024-04-26T23:38:27.732 INFO:teuthology.orchestra.run.smithi175.stdout:(140/152): python3-rsa-4.9-2.el9.noarch.rpm 442 kB/s | 59 kB 00:00 2024-04-26T23:38:27.758 INFO:teuthology.orchestra.run.smithi175.stdout:(141/152): python3-tempora-5.0.0-2.el9.noarch.r 356 kB/s | 36 kB 00:00 2024-04-26T23:38:27.779 INFO:teuthology.orchestra.run.smithi088.stdout:(36/152): cephadm-19.0.0-3306.gbc612ffb.el9.noa 8.9 MB/s | 762 kB 00:00 2024-04-26T23:38:27.825 INFO:teuthology.orchestra.run.smithi175.stdout:(142/152): python3-typing-extensions-4.4.0-2.el 435 kB/s | 51 kB 00:00 2024-04-26T23:38:27.829 INFO:teuthology.orchestra.run.smithi088.stdout:(37/152): cephfs-top-19.0.0-3306.gbc612ffb.el9. 366 kB/s | 18 kB 00:00 2024-04-26T23:38:27.883 INFO:teuthology.orchestra.run.smithi175.stdout:(143/152): python3-webob-1.8.7-6.el9.noarch.rpm 1.5 MB/s | 230 kB 00:00 2024-04-26T23:38:27.908 INFO:teuthology.orchestra.run.smithi175.stdout:(144/152): python3-websocket-client-1.2.3-2.el9 596 kB/s | 90 kB 00:00 2024-04-26T23:38:27.913 INFO:teuthology.orchestra.run.smithi088.stdout:(38/152): ceph-mgr-dashboard-19.0.0-3306.gbc612 6.7 MB/s | 3.5 MB 00:00 2024-04-26T23:38:27.942 INFO:teuthology.orchestra.run.smithi175.stdout:(145/152): python3-werkzeug-2.0.3-3.el9.1.noarc 3.6 MB/s | 427 kB 00:00 2024-04-26T23:38:27.967 INFO:teuthology.orchestra.run.smithi175.stdout:(146/152): python3-zc-lockfile-2.0-10.el9.noarc 238 kB/s | 20 kB 00:00 2024-04-26T23:38:27.979 INFO:teuthology.orchestra.run.smithi088.stdout:(39/152): fuse-2.9.9-15.el9.x86_64.rpm 535 kB/s | 80 kB 00:00 2024-04-26T23:38:27.992 INFO:teuthology.orchestra.run.smithi175.stdout:(147/152): re2-20211101-3.el9.x86_64.rpm 2.2 MB/s | 192 kB 00:00 2024-04-26T23:38:28.080 INFO:teuthology.orchestra.run.smithi088.stdout:(40/152): libquadmath-11.4.1-3.el9.x86_64.rpm 1.9 MB/s | 195 kB 00:00 2024-04-26T23:38:28.134 INFO:teuthology.orchestra.run.smithi175.stdout:(148/152): thrift-0.15.0-2.el9.x86_64.rpm 8.2 MB/s | 1.6 MB 00:00 2024-04-26T23:38:28.163 INFO:teuthology.orchestra.run.smithi088.stdout:(41/152): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.0 MB/s | 253 kB 00:00 2024-04-26T23:38:28.247 INFO:teuthology.orchestra.run.smithi088.stdout:(42/152): libgfortran-11.4.1-3.el9.x86_64.rpm 2.3 MB/s | 803 kB 00:00 2024-04-26T23:38:28.310 INFO:teuthology.orchestra.run.smithi175.stdout:(149/152): openssl-3.2.1-1.el9.x86_64.rpm 7.7 MB/s | 1.3 MB 00:00 2024-04-26T23:38:28.314 INFO:teuthology.orchestra.run.smithi088.stdout:(43/152): python3-cryptography-36.0.1-4.el9.x86 8.2 MB/s | 1.2 MB 00:00 2024-04-26T23:38:28.339 INFO:teuthology.orchestra.run.smithi088.stdout:(44/152): python3-ply-3.11-14.el9.noarch.rpm 1.1 MB/s | 106 kB 00:00 2024-04-26T23:38:28.373 INFO:teuthology.orchestra.run.smithi088.stdout:(45/152): python3-pycparser-2.20-6.el9.noarch.r 2.3 MB/s | 135 kB 00:00 2024-04-26T23:38:28.376 INFO:teuthology.orchestra.run.smithi175.stdout:(150/152): librados2-19.0.0-3306.gbc612ffb.el9. 8.3 MB/s | 3.4 MB 00:00 2024-04-26T23:38:28.406 INFO:teuthology.orchestra.run.smithi088.stdout:(46/152): python3-requests-2.25.1-8.el9.noarch. 1.8 MB/s | 125 kB 00:00 2024-04-26T23:38:28.427 INFO:teuthology.orchestra.run.smithi175.stdout:(151/152): librbd1-19.0.0-3306.gbc612ffb.el9.x8 7.2 MB/s | 3.1 MB 00:00 2024-04-26T23:38:28.469 INFO:teuthology.orchestra.run.smithi175.stdout:(152/152): openssl-libs-3.2.1-1.el9.x86_64.rpm 15 MB/s | 2.4 MB 00:00 2024-04-26T23:38:28.472 INFO:teuthology.orchestra.run.smithi175.stdout:-------------------------------------------------------------------------------- 2024-04-26T23:38:28.472 INFO:teuthology.orchestra.run.smithi175.stdout:Total 17 MB/s | 222 MB 00:12 2024-04-26T23:38:28.490 INFO:teuthology.orchestra.run.smithi088.stdout:(47/152): ceph-mgr-diskprediction-local-19.0.0- 7.2 MB/s | 7.4 MB 00:01 2024-04-26T23:38:28.515 INFO:teuthology.orchestra.run.smithi088.stdout:(48/152): python3-urllib3-1.26.5-5.el9.noarch.r 1.5 MB/s | 215 kB 00:00 2024-04-26T23:38:28.749 INFO:teuthology.orchestra.run.smithi088.stdout:(49/152): boost-program-options-1.75.0-8.el9.x8 459 kB/s | 107 kB 00:00 2024-04-26T23:38:28.782 INFO:teuthology.orchestra.run.smithi088.stdout:(50/152): automake-1.16.2-8.el9.noarch.rpm 1.8 MB/s | 689 kB 00:00 2024-04-26T23:38:28.824 INFO:teuthology.orchestra.run.smithi088.stdout:(51/152): bison-3.7.4-5.el9.x86_64.rpm 3.0 MB/s | 943 kB 00:00 2024-04-26T23:38:28.849 INFO:teuthology.orchestra.run.smithi088.stdout:(52/152): elfutils-libelf-devel-0.190-2.el9.x86 214 kB/s | 21 kB 00:00 2024-04-26T23:38:28.891 INFO:teuthology.orchestra.run.smithi088.stdout:(53/152): flex-2.6.4-9.el9.x86_64.rpm 2.8 MB/s | 313 kB 00:00 2024-04-26T23:38:28.917 INFO:teuthology.orchestra.run.smithi088.stdout:(54/152): flexiblas-3.0.4-8.el9.x86_64.rpm 355 kB/s | 33 kB 00:00 2024-04-26T23:38:28.967 INFO:teuthology.orchestra.run.smithi088.stdout:(55/152): flexiblas-openblas-openmp-3.0.4-8.el9 242 kB/s | 18 kB 00:00 2024-04-26T23:38:28.992 INFO:teuthology.orchestra.run.smithi088.stdout:(56/152): libaio-devel-0.3.111-13.el9.x86_64.rp 148 kB/s | 11 kB 00:00 2024-04-26T23:38:29.042 INFO:teuthology.orchestra.run.smithi088.stdout:(57/152): flexiblas-netlib-3.0.4-8.el9.x86_64.r 16 MB/s | 3.0 MB 00:00 2024-04-26T23:38:29.067 INFO:teuthology.orchestra.run.smithi088.stdout:(58/152): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.6 MB/s | 160 kB 00:00 2024-04-26T23:38:29.093 INFO:teuthology.orchestra.run.smithi088.stdout:(59/152): librabbitmq-0.11.0-7.el9.x86_64.rpm 451 kB/s | 45 kB 00:00 2024-04-26T23:38:29.135 INFO:teuthology.orchestra.run.smithi088.stdout:(60/152): librdkafka-1.6.1-102.el9.x86_64.rpm 7.0 MB/s | 662 kB 00:00 2024-04-26T23:38:29.177 INFO:teuthology.orchestra.run.smithi088.stdout:(61/152): libtool-2.4.6-45.el9.x86_64.rpm 5.2 MB/s | 582 kB 00:00 2024-04-26T23:38:29.194 INFO:teuthology.orchestra.run.smithi088.stdout:(62/152): libuuid-devel-2.37.4-18.el9.x86_64.rp 252 kB/s | 25 kB 00:00 2024-04-26T23:38:29.211 INFO:teuthology.orchestra.run.smithi088.stdout:(63/152): libzstd-devel-1.5.1-2.el9.x86_64.rpm 626 kB/s | 47 kB 00:00 2024-04-26T23:38:29.244 INFO:teuthology.orchestra.run.smithi088.stdout:(64/152): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.2 MB/s | 292 kB 00:00 2024-04-26T23:38:29.270 INFO:teuthology.orchestra.run.smithi088.stdout:(65/152): lua-5.4.4-4.el9.x86_64.rpm 2.4 MB/s | 188 kB 00:00 2024-04-26T23:38:29.287 INFO:teuthology.orchestra.run.smithi088.stdout:(66/152): openblas-0.3.21-2.el9.x86_64.rpm 466 kB/s | 35 kB 00:00 2024-04-26T23:38:29.420 INFO:teuthology.orchestra.run.smithi088.stdout:(67/152): openblas-openmp-0.3.21-2.el9.x86_64.r 27 MB/s | 4.7 MB 00:00 2024-04-26T23:38:29.504 INFO:teuthology.orchestra.run.smithi088.stdout:(68/152): openssl-devel-3.2.1-1.el9.x86_64.rpm 19 MB/s | 4.4 MB 00:00 2024-04-26T23:38:29.546 INFO:teuthology.orchestra.run.smithi088.stdout:(69/152): postgresql-13.14-1.el9.x86_64.rpm 6.1 MB/s | 1.6 MB 00:00 2024-04-26T23:38:29.576 INFO:teuthology.orchestra.run.smithi175.stdout:Running transaction check 2024-04-26T23:38:29.579 INFO:teuthology.orchestra.run.smithi088.stdout:(70/152): postgresql-contrib-13.14-1.el9.x86_64 5.6 MB/s | 911 kB 00:00 2024-04-26T23:38:29.604 INFO:teuthology.orchestra.run.smithi088.stdout:(71/152): postgresql-private-libs-13.14-1.el9.x 1.3 MB/s | 133 kB 00:00 2024-04-26T23:38:29.680 INFO:teuthology.orchestra.run.smithi088.stdout:(72/152): protobuf-3.14.0-13.el9.x86_64.rpm 10 MB/s | 1.0 MB 00:00 2024-04-26T23:38:29.705 INFO:teuthology.orchestra.run.smithi088.stdout:(73/152): python3-attrs-20.3.0-7.el9.noarch.rpm 872 kB/s | 87 kB 00:00 2024-04-26T23:38:29.718 INFO:teuthology.orchestra.run.smithi175.stdout:Transaction check succeeded. 2024-04-26T23:38:29.718 INFO:teuthology.orchestra.run.smithi175.stdout:Running transaction test 2024-04-26T23:38:29.789 INFO:teuthology.orchestra.run.smithi088.stdout:(74/152): postgresql-server-13.14-1.el9.x86_64. 24 MB/s | 5.8 MB 00:00 2024-04-26T23:38:29.847 INFO:teuthology.orchestra.run.smithi088.stdout:(75/152): python3-devel-3.9.18-3.el9.x86_64.rpm 1.7 MB/s | 244 kB 00:00 2024-04-26T23:38:29.884 INFO:teuthology.orchestra.run.smithi088.stdout:(76/152): python3-jinja2-2.11.3-5.el9.noarch.rp 2.5 MB/s | 248 kB 00:00 2024-04-26T23:38:29.964 INFO:teuthology.orchestra.run.smithi088.stdout:(77/152): python3-babel-2.9.1-2.el9.noarch.rpm 21 MB/s | 6.0 MB 00:00 2024-04-26T23:38:29.990 INFO:teuthology.orchestra.run.smithi088.stdout:(78/152): python3-jsonpatch-1.21-16.el9.noarch. 180 kB/s | 26 kB 00:00 2024-04-26T23:38:30.015 INFO:teuthology.orchestra.run.smithi088.stdout:(79/152): python3-jsonpointer-2.0-4.el9.noarch. 147 kB/s | 19 kB 00:00 2024-04-26T23:38:30.040 INFO:teuthology.orchestra.run.smithi088.stdout:(80/152): python3-mako-1.1.4-6.el9.noarch.rpm 2.2 MB/s | 172 kB 00:00 2024-04-26T23:38:30.066 INFO:teuthology.orchestra.run.smithi088.stdout:(81/152): python3-markupsafe-1.1.1-12.el9.x86_6 460 kB/s | 35 kB 00:00 2024-04-26T23:38:30.133 INFO:teuthology.orchestra.run.smithi088.stdout:(82/152): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.7 MB/s | 250 kB 00:00 2024-04-26T23:38:30.158 INFO:teuthology.orchestra.run.smithi088.stdout:(83/152): python3-oauthlib-3.1.1-5.el9.noarch.r 2.4 MB/s | 222 kB 00:00 2024-04-26T23:38:30.224 INFO:teuthology.orchestra.run.smithi088.stdout:(84/152): python3-numpy-1.20.1-5.el9.x86_64.rpm 24 MB/s | 5.1 MB 00:00 2024-04-26T23:38:30.250 INFO:teuthology.orchestra.run.smithi088.stdout:(85/152): python3-packaging-20.9-5.el9.noarch.r 660 kB/s | 77 kB 00:00 2024-04-26T23:38:30.275 INFO:teuthology.orchestra.run.smithi088.stdout:(86/152): python3-prettytable-0.7.2-27.el9.noar 361 kB/s | 42 kB 00:00 2024-04-26T23:38:30.300 INFO:teuthology.orchestra.run.smithi088.stdout:(87/152): python3-protobuf-3.14.0-13.el9.noarch 3.5 MB/s | 269 kB 00:00 2024-04-26T23:38:30.326 INFO:teuthology.orchestra.run.smithi088.stdout:(88/152): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.1 MB/s | 159 kB 00:00 2024-04-26T23:38:30.351 INFO:teuthology.orchestra.run.smithi088.stdout:(89/152): python3-pyasn1-modules-0.4.8-6.el9.no 3.6 MB/s | 279 kB 00:00 2024-04-26T23:38:30.376 INFO:teuthology.orchestra.run.smithi088.stdout:(90/152): python3-pytz-2021.1-5.el9.noarch.rpm 678 kB/s | 51 kB 00:00 2024-04-26T23:38:30.401 INFO:teuthology.orchestra.run.smithi088.stdout:(91/152): python3-requests-oauthlib-1.3.0-12.el 711 kB/s | 54 kB 00:00 2024-04-26T23:38:30.460 INFO:teuthology.orchestra.run.smithi088.stdout:(92/152): python3-toml-0.10.2-6.el9.noarch.rpm 498 kB/s | 42 kB 00:00 2024-04-26T23:38:30.494 INFO:teuthology.orchestra.run.smithi088.stdout:(93/152): python3-wcwidth-0.2.5-8.el9.noarch.rp 480 kB/s | 44 kB 00:00 2024-04-26T23:38:30.552 INFO:teuthology.orchestra.run.smithi088.stdout:(94/152): qatlib-24.02.0-1.el9.x86_64.rpm 2.3 MB/s | 221 kB 00:00 2024-04-26T23:38:30.586 INFO:teuthology.orchestra.run.smithi088.stdout:(95/152): qatlib-service-24.02.0-1.el9.x86_64.r 390 kB/s | 36 kB 00:00 2024-04-26T23:38:30.628 INFO:teuthology.orchestra.run.smithi088.stdout:(96/152): qatzip-libs-1.2.0-1.el9.x86_64.rpm 628 kB/s | 47 kB 00:00 2024-04-26T23:38:30.787 INFO:teuthology.orchestra.run.smithi088.stdout:(97/152): python3-scipy-1.6.2-8.el9.x86_64.rpm 37 MB/s | 16 MB 00:00 2024-04-26T23:38:30.812 INFO:teuthology.orchestra.run.smithi088.stdout:(98/152): socat-1.7.4.1-5.el9.x86_64.rpm 1.3 MB/s | 305 kB 00:00 2024-04-26T23:38:30.837 INFO:teuthology.orchestra.run.smithi088.stdout:(99/152): uuid-1.6.2-55.el9.x86_64.rpm 277 kB/s | 58 kB 00:00 2024-04-26T23:38:30.854 INFO:teuthology.orchestra.run.smithi088.stdout:(100/152): xfsprogs-devel-6.3.0-1.el9.x86_64.rp 1.4 MB/s | 94 kB 00:00 2024-04-26T23:38:30.879 INFO:teuthology.orchestra.run.smithi088.stdout:(101/152): xmlstarlet-1.6.1-20.el9.x86_64.rpm 950 kB/s | 64 kB 00:00 2024-04-26T23:38:30.904 INFO:teuthology.orchestra.run.smithi088.stdout:(102/152): zlib-devel-1.2.11-41.el9.x86_64.rpm 671 kB/s | 45 kB 00:00 2024-04-26T23:38:30.938 INFO:teuthology.orchestra.run.smithi088.stdout:(103/152): lua-devel-5.4.4-4.el9.x86_64.rpm 266 kB/s | 22 kB 00:00 2024-04-26T23:38:31.122 INFO:teuthology.orchestra.run.smithi088.stdout:(104/152): protobuf-compiler-3.14.0-13.el9.x86_ 3.5 MB/s | 863 kB 00:00 2024-04-26T23:38:31.238 INFO:teuthology.orchestra.run.smithi088.stdout:(105/152): abseil-cpp-20211102.0-3.el9.x86_64.r 1.6 MB/s | 548 kB 00:00 2024-04-26T23:38:31.306 INFO:teuthology.orchestra.run.smithi088.stdout:(106/152): gperftools-libs-2.9.1-2.el9.x86_64.r 903 kB/s | 309 kB 00:00 2024-04-26T23:38:31.323 INFO:teuthology.orchestra.run.smithi088.stdout:(107/152): grpc-data-1.46.7-10.el9.noarch.rpm 97 kB/s | 19 kB 00:00 2024-04-26T23:38:31.356 INFO:teuthology.orchestra.run.smithi088.stdout:(108/152): libarrow-doc-9.0.0-11.el9.noarch.rpm 520 kB/s | 26 kB 00:00 2024-04-26T23:38:31.398 INFO:teuthology.orchestra.run.smithi088.stdout:(109/152): liboath-2.6.7-2.el9.x86_64.rpm 646 kB/s | 49 kB 00:00 2024-04-26T23:38:31.468 INFO:teuthology.orchestra.run.smithi175.stdout:Transaction test succeeded. 2024-04-26T23:38:31.468 INFO:teuthology.orchestra.run.smithi175.stdout:Running transaction 2024-04-26T23:38:31.473 INFO:teuthology.orchestra.run.smithi088.stdout:(110/152): libunwind-1.6.2-1.el9.x86_64.rpm 575 kB/s | 67 kB 00:00 2024-04-26T23:38:31.515 INFO:teuthology.orchestra.run.smithi088.stdout:(111/152): luarocks-3.9.2-1.el9.noarch.rpm 1.3 MB/s | 151 kB 00:00 2024-04-26T23:38:31.573 INFO:teuthology.orchestra.run.smithi088.stdout:(112/152): libarrow-9.0.0-11.el9.x86_64.rpm 13 MB/s | 4.4 MB 00:00 2024-04-26T23:38:31.632 INFO:teuthology.orchestra.run.smithi088.stdout:(113/152): python3-bcrypt-3.2.2-1.el9.x86_64.rp 745 kB/s | 43 kB 00:00 2024-04-26T23:38:31.657 INFO:teuthology.orchestra.run.smithi088.stdout:(114/152): parquet-libs-9.0.0-11.el9.x86_64.rpm 4.5 MB/s | 839 kB 00:00 2024-04-26T23:38:31.691 INFO:teuthology.orchestra.run.smithi088.stdout:(115/152): python3-asyncssh-2.13.2-5.el9.noarch 3.0 MB/s | 548 kB 00:00 2024-04-26T23:38:31.716 INFO:teuthology.orchestra.run.smithi088.stdout:(116/152): python3-certifi-2021.10.8-2.el9.noar 255 kB/s | 15 kB 00:00 2024-04-26T23:38:31.741 INFO:teuthology.orchestra.run.smithi088.stdout:(117/152): python3-cachetools-4.2.4-1.el9.noarc 295 kB/s | 32 kB 00:00 2024-04-26T23:38:31.778 INFO:teuthology.orchestra.run.smithi088.stdout:(118/152): python3-cheroot-8.6.0-4.el9.noarch.r 2.0 MB/s | 172 kB 00:00 2024-04-26T23:38:31.800 INFO:teuthology.orchestra.run.smithi088.stdout:(119/152): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.0 MB/s | 303 kB 00:00 2024-04-26T23:38:31.825 INFO:teuthology.orchestra.run.smithi088.stdout:(120/152): python3-cherrypy-18.6.1-2.el9.noarch 3.2 MB/s | 358 kB 00:00 2024-04-26T23:38:31.851 INFO:teuthology.orchestra.run.smithi088.stdout:(121/152): python3-colorama-0.4.4-12.el9.noarch 469 kB/s | 35 kB 00:00 2024-04-26T23:38:31.876 INFO:teuthology.orchestra.run.smithi088.stdout:(122/152): python3-google-auth-2.29.0-1.el9.noa 2.7 MB/s | 206 kB 00:00 2024-04-26T23:38:31.910 INFO:teuthology.orchestra.run.smithi088.stdout:(123/152): python3-grpcio-tools-1.46.7-10.el9.x 2.4 MB/s | 144 kB 00:00 2024-04-26T23:38:31.935 INFO:teuthology.orchestra.run.smithi088.stdout:(124/152): python3-jaraco-8.2.1-3.el9.noarch.rp 182 kB/s | 11 kB 00:00 2024-04-26T23:38:31.977 INFO:teuthology.orchestra.run.smithi088.stdout:(125/152): python3-jaraco-classes-3.2.1-5.el9.n 262 kB/s | 18 kB 00:00 2024-04-26T23:38:32.002 INFO:teuthology.orchestra.run.smithi088.stdout:(126/152): python3-jaraco-collections-3.0.0-8.e 346 kB/s | 23 kB 00:00 2024-04-26T23:38:32.061 INFO:teuthology.orchestra.run.smithi088.stdout:(127/152): python3-grpcio-1.46.7-10.el9.x86_64. 8.7 MB/s | 2.0 MB 00:00 2024-04-26T23:38:32.086 INFO:teuthology.orchestra.run.smithi088.stdout:(128/152): python3-jaraco-functools-3.5.0-2.el9 179 kB/s | 19 kB 00:00 2024-04-26T23:38:32.111 INFO:teuthology.orchestra.run.smithi088.stdout:(129/152): python3-jaraco-text-3.2.0-6.el9.noar 180 kB/s | 20 kB 00:00 2024-04-26T23:38:32.170 INFO:teuthology.orchestra.run.smithi088.stdout:(130/152): python3-logutils-0.3.5-21.el9.noarch 799 kB/s | 46 kB 00:00 2024-04-26T23:38:32.187 INFO:teuthology.orchestra.run.smithi088.stdout:(131/152): python3-more-itertools-8.12.0-2.el9. 1.0 MB/s | 79 kB 00:00 2024-04-26T23:38:32.221 INFO:teuthology.orchestra.run.smithi088.stdout:(132/152): python3-kubernetes-26.1.0-2.el9.noar 6.4 MB/s | 1.0 MB 00:00 2024-04-26T23:38:32.246 INFO:teuthology.orchestra.run.smithi088.stdout:(133/152): python3-natsort-7.1.1-5.el9.noarch.r 764 kB/s | 58 kB 00:00 2024-04-26T23:38:32.279 INFO:teuthology.orchestra.run.smithi088.stdout:(134/152): python3-pecan-1.4.2-3.el9.noarch.rpm 2.9 MB/s | 272 kB 00:00 2024-04-26T23:38:32.305 INFO:teuthology.orchestra.run.smithi088.stdout:(135/152): python3-portend-3.1.0-2.el9.noarch.r 196 kB/s | 16 kB 00:00 2024-04-26T23:38:32.330 INFO:teuthology.orchestra.run.smithi088.stdout:(136/152): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.0 MB/s | 90 kB 00:00 2024-04-26T23:38:32.355 INFO:teuthology.orchestra.run.smithi088.stdout:(137/152): python3-pyperclip-1.8.2-2.el9.noarch 374 kB/s | 28 kB 00:00 2024-04-26T23:38:32.380 INFO:teuthology.orchestra.run.smithi088.stdout:(138/152): python3-repoze-lru-0.7-16.el9.noarch 408 kB/s | 31 kB 00:00 2024-04-26T23:38:32.405 INFO:teuthology.orchestra.run.smithi088.stdout:(139/152): python3-routes-2.5.1-5.el9.noarch.rp 2.4 MB/s | 188 kB 00:00 2024-04-26T23:38:32.431 INFO:teuthology.orchestra.run.smithi088.stdout:(140/152): python3-rsa-4.9-2.el9.noarch.rpm 784 kB/s | 59 kB 00:00 2024-04-26T23:38:32.456 INFO:teuthology.orchestra.run.smithi088.stdout:(141/152): python3-tempora-5.0.0-2.el9.noarch.r 473 kB/s | 36 kB 00:00 2024-04-26T23:38:32.481 INFO:teuthology.orchestra.run.smithi088.stdout:(142/152): python3-typing-extensions-4.4.0-2.el 675 kB/s | 51 kB 00:00 2024-04-26T23:38:32.507 INFO:teuthology.orchestra.run.smithi088.stdout:(143/152): python3-webob-1.8.7-6.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-04-26T23:38:32.532 INFO:teuthology.orchestra.run.smithi088.stdout:(144/152): python3-websocket-client-1.2.3-2.el9 1.2 MB/s | 90 kB 00:00 2024-04-26T23:38:32.557 INFO:teuthology.orchestra.run.smithi088.stdout:(145/152): python3-werkzeug-2.0.3-3.el9.1.noarc 5.5 MB/s | 427 kB 00:00 2024-04-26T23:38:32.582 INFO:teuthology.orchestra.run.smithi088.stdout:(146/152): python3-zc-lockfile-2.0-10.el9.noarc 265 kB/s | 20 kB 00:00 2024-04-26T23:38:32.608 INFO:teuthology.orchestra.run.smithi088.stdout:(147/152): re2-20211101-3.el9.x86_64.rpm 2.5 MB/s | 192 kB 00:00 2024-04-26T23:38:32.700 INFO:teuthology.orchestra.run.smithi088.stdout:(148/152): thrift-0.15.0-2.el9.x86_64.rpm 11 MB/s | 1.6 MB 00:00 2024-04-26T23:38:32.959 INFO:teuthology.orchestra.run.smithi088.stdout:(149/152): openssl-3.2.1-1.el9.x86_64.rpm 5.2 MB/s | 1.3 MB 00:00 2024-04-26T23:38:33.034 INFO:teuthology.orchestra.run.smithi088.stdout:(150/152): librbd1-19.0.0-3306.gbc612ffb.el9.x8 7.4 MB/s | 3.1 MB 00:00 2024-04-26T23:38:33.167 INFO:teuthology.orchestra.run.smithi088.stdout:(151/152): librados2-19.0.0-3306.gbc612ffb.el9. 5.8 MB/s | 3.4 MB 00:00 2024-04-26T23:38:33.208 INFO:teuthology.orchestra.run.smithi088.stdout:(152/152): openssl-libs-3.2.1-1.el9.x86_64.rpm 9.6 MB/s | 2.4 MB 00:00 2024-04-26T23:38:33.216 INFO:teuthology.orchestra.run.smithi088.stdout:-------------------------------------------------------------------------------- 2024-04-26T23:38:33.216 INFO:teuthology.orchestra.run.smithi088.stdout:Total 17 MB/s | 222 MB 00:13 2024-04-26T23:38:34.309 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction check 2024-04-26T23:38:34.450 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction check succeeded. 2024-04-26T23:38:34.450 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction test 2024-04-26T23:38:36.214 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction test succeeded. 2024-04-26T23:38:36.214 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction 2024-04-26T23:38:37.579 INFO:teuthology.orchestra.run.smithi175.stdout: Preparing : 1/1 2024-04-26T23:38:37.655 INFO:teuthology.orchestra.run.smithi175.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/156 2024-04-26T23:38:37.702 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/156 2024-04-26T23:38:37.755 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/156 2024-04-26T23:38:37.806 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/156 2024-04-26T23:38:37.831 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/156 2024-04-26T23:38:37.873 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/156 2024-04-26T23:38:38.193 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/156 2024-04-26T23:38:38.307 INFO:teuthology.orchestra.run.smithi175.stdout: Upgrading : librados2-2:19.0.0-3306.gbc612ffb.el9.x86_64 8/156 2024-04-26T23:38:38.428 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: librados2-2:19.0.0-3306.gbc612ffb.el9.x86_64 8/156 2024-04-26T23:38:38.458 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libcephfs2-2:19.0.0-3306.gbc612ffb.el9.x86_64 9/156 2024-04-26T23:38:38.550 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: libcephfs2-2:19.0.0-3306.gbc612ffb.el9.x86_64 9/156 2024-04-26T23:38:38.587 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-rados-2:19.0.0-3306.gbc612ffb.el9.x86_64 10/156 2024-04-26T23:38:38.735 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 11/156 2024-04-26T23:38:38.784 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : postgresql-13.14-1.el9.x86_64 12/156 2024-04-26T23:38:38.812 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libcephsqlite-2:19.0.0-3306.gbc612ffb.el9.x86_64 13/156 2024-04-26T23:38:38.916 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: libcephsqlite-2:19.0.0-3306.gbc612ffb.el9.x86_64 13/156 2024-04-26T23:38:38.938 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libradosstriper1-2:19.0.0-3306.gbc612ffb.el9.x86 14/156 2024-04-26T23:38:39.001 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: libradosstriper1-2:19.0.0-3306.gbc612ffb.el9.x86 14/156 2024-04-26T23:38:39.022 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/156 2024-04-26T23:38:39.045 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/156 2024-04-26T23:38:39.222 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/156 2024-04-26T23:38:39.255 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/156 2024-04-26T23:38:39.362 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : re2-1:20211101-3.el9.x86_64 17/156 2024-04-26T23:38:39.450 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 18/156 2024-04-26T23:38:39.479 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 19/156 2024-04-26T23:38:39.513 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : liboath-2.6.7-2.el9.x86_64 20/156 2024-04-26T23:38:39.579 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 21/156 2024-04-26T23:38:39.612 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 22/156 2024-04-26T23:38:39.656 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 23/156 2024-04-26T23:38:39.689 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 24/156 2024-04-26T23:38:39.717 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : lua-5.4.4-4.el9.x86_64 25/156 2024-04-26T23:38:39.776 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 26/156 2024-04-26T23:38:39.839 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 27/156 2024-04-26T23:38:39.869 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 28/156 2024-04-26T23:38:39.904 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 29/156 2024-04-26T23:38:39.980 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 30/156 2024-04-26T23:38:40.015 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-ceph-common-2:19.0.0-3306.gbc612ffb.el9. 31/156 2024-04-26T23:38:40.058 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-ceph-argparse-2:19.0.0-3306.gbc612ffb.el 32/156 2024-04-26T23:38:40.096 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-cephfs-2:19.0.0-3306.gbc612ffb.el9.x86_6 33/156 2024-04-26T23:38:40.167 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 34/156 2024-04-26T23:38:40.227 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : luarocks-3.9.2-1.el9.noarch 35/156 2024-04-26T23:38:40.301 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 36/156 2024-04-26T23:38:40.433 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 37/156 2024-04-26T23:38:40.487 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 38/156 2024-04-26T23:38:41.007 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-rsa-4.9-2.el9.noarch 39/156 2024-04-26T23:38:41.092 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 40/156 2024-04-26T23:38:41.120 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 41/156 2024-04-26T23:38:41.163 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 42/156 2024-04-26T23:38:41.201 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : librados-devel-2:19.0.0-3306.gbc612ffb.el9.x86_6 43/156 2024-04-26T23:38:41.242 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 44/156 2024-04-26T23:38:41.398 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 45/156 2024-04-26T23:38:41.471 INFO:teuthology.orchestra.run.smithi175.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 46/156 2024-04-26T23:38:41.526 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 47/156 2024-04-26T23:38:41.597 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 48/156 2024-04-26T23:38:41.630 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 49/156 2024-04-26T23:38:41.666 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 50/156 2024-04-26T23:38:41.713 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 51/156 2024-04-26T23:38:41.748 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 52/156 2024-04-26T23:38:41.791 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 53/156 2024-04-26T23:38:41.834 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 54/156 2024-04-26T23:38:41.970 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 55/156 2024-04-26T23:38:42.014 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 56/156 2024-04-26T23:38:42.036 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 57/156 2024-04-26T23:38:42.077 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 58/156 2024-04-26T23:38:42.172 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 59/156 2024-04-26T23:38:42.211 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 60/156 2024-04-26T23:38:42.233 INFO:teuthology.orchestra.run.smithi088.stdout: Preparing : 1/1 2024-04-26T23:38:42.251 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 61/156 2024-04-26T23:38:42.276 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 62/156 2024-04-26T23:38:42.301 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 63/156 2024-04-26T23:38:42.329 INFO:teuthology.orchestra.run.smithi088.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/156 2024-04-26T23:38:42.375 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/156 2024-04-26T23:38:42.376 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 64/156 2024-04-26T23:38:42.437 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/156 2024-04-26T23:38:42.471 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/156 2024-04-26T23:38:42.496 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/156 2024-04-26T23:38:42.501 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 65/156 2024-04-26T23:38:42.533 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 66/156 2024-04-26T23:38:42.539 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/156 2024-04-26T23:38:42.561 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 67/156 2024-04-26T23:38:42.595 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 68/156 2024-04-26T23:38:42.634 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : uuid-1.6.2-55.el9.x86_64 69/156 2024-04-26T23:38:42.666 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 70/156 2024-04-26T23:38:42.695 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 71/156 2024-04-26T23:38:42.730 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 72/156 2024-04-26T23:38:42.763 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 73/156 2024-04-26T23:38:42.805 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 74/156 2024-04-26T23:38:42.839 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 75/156 2024-04-26T23:38:42.869 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/156 2024-04-26T23:38:42.955 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 76/156 2024-04-26T23:38:42.980 INFO:teuthology.orchestra.run.smithi088.stdout: Upgrading : librados2-2:19.0.0-3306.gbc612ffb.el9.x86_64 8/156 2024-04-26T23:38:43.103 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: librados2-2:19.0.0-3306.gbc612ffb.el9.x86_64 8/156 2024-04-26T23:38:43.131 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libcephfs2-2:19.0.0-3306.gbc612ffb.el9.x86_64 9/156 2024-04-26T23:38:43.223 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: libcephfs2-2:19.0.0-3306.gbc612ffb.el9.x86_64 9/156 2024-04-26T23:38:43.242 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 77/156 2024-04-26T23:38:43.252 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-rados-2:19.0.0-3306.gbc612ffb.el9.x86_64 10/156 2024-04-26T23:38:43.401 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 11/156 2024-04-26T23:38:43.452 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 78/156 2024-04-26T23:38:43.457 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : postgresql-13.14-1.el9.x86_64 12/156 2024-04-26T23:38:43.485 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libcephsqlite-2:19.0.0-3306.gbc612ffb.el9.x86_64 13/156 2024-04-26T23:38:43.501 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 79/156 2024-04-26T23:38:43.589 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: libcephsqlite-2:19.0.0-3306.gbc612ffb.el9.x86_64 13/156 2024-04-26T23:38:43.611 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libradosstriper1-2:19.0.0-3306.gbc612ffb.el9.x86 14/156 2024-04-26T23:38:43.629 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-packaging-20.9-5.el9.noarch 80/156 2024-04-26T23:38:43.674 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: libradosstriper1-2:19.0.0-3306.gbc612ffb.el9.x86 14/156 2024-04-26T23:38:43.678 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 81/156 2024-04-26T23:38:43.696 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/156 2024-04-26T23:38:43.719 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/156 2024-04-26T23:38:43.904 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/156 2024-04-26T23:38:43.936 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/156 2024-04-26T23:38:44.044 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : re2-1:20211101-3.el9.x86_64 17/156 2024-04-26T23:38:44.140 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 18/156 2024-04-26T23:38:44.177 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 19/156 2024-04-26T23:38:44.213 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : liboath-2.6.7-2.el9.x86_64 20/156 2024-04-26T23:38:44.287 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 21/156 2024-04-26T23:38:44.328 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 22/156 2024-04-26T23:38:44.373 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 23/156 2024-04-26T23:38:44.399 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 82/156 2024-04-26T23:38:44.405 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 24/156 2024-04-26T23:38:44.432 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : lua-5.4.4-4.el9.x86_64 25/156 2024-04-26T23:38:44.449 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 83/156 2024-04-26T23:38:44.491 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 84/156 2024-04-26T23:38:44.503 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 26/156 2024-04-26T23:38:44.560 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 27/156 2024-04-26T23:38:44.589 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 85/156 2024-04-26T23:38:44.593 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 28/156 2024-04-26T23:38:44.643 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 29/156 2024-04-26T23:38:44.649 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 86/156 2024-04-26T23:38:44.713 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 30/156 2024-04-26T23:38:44.736 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 87/156 2024-04-26T23:38:44.747 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-ceph-common-2:19.0.0-3306.gbc612ffb.el9. 31/156 2024-04-26T23:38:44.768 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 88/156 2024-04-26T23:38:44.791 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-ceph-argparse-2:19.0.0-3306.gbc612ffb.el 32/156 2024-04-26T23:38:44.820 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-cephfs-2:19.0.0-3306.gbc612ffb.el9.x86_6 33/156 2024-04-26T23:38:44.889 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 34/156 2024-04-26T23:38:44.934 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : luarocks-3.9.2-1.el9.noarch 35/156 2024-04-26T23:38:44.945 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : openblas-0.3.21-2.el9.x86_64 89/156 2024-04-26T23:38:44.974 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 90/156 2024-04-26T23:38:45.008 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 36/156 2024-04-26T23:38:45.052 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 91/156 2024-04-26T23:38:45.142 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 37/156 2024-04-26T23:38:45.219 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 38/156 2024-04-26T23:38:45.685 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 92/156 2024-04-26T23:38:45.750 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-rsa-4.9-2.el9.noarch 39/156 2024-04-26T23:38:45.797 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 93/156 2024-04-26T23:38:45.831 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 40/156 2024-04-26T23:38:45.861 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 41/156 2024-04-26T23:38:45.895 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 42/156 2024-04-26T23:38:45.933 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : librados-devel-2:19.0.0-3306.gbc612ffb.el9.x86_6 43/156 2024-04-26T23:38:45.983 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 44/156 2024-04-26T23:38:46.140 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 45/156 2024-04-26T23:38:46.194 INFO:teuthology.orchestra.run.smithi088.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 46/156 2024-04-26T23:38:46.248 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 47/156 2024-04-26T23:38:46.322 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 48/156 2024-04-26T23:38:46.353 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 49/156 2024-04-26T23:38:46.389 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 50/156 2024-04-26T23:38:46.436 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 51/156 2024-04-26T23:38:46.472 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 52/156 2024-04-26T23:38:46.514 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 53/156 2024-04-26T23:38:46.558 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 54/156 2024-04-26T23:38:46.694 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 55/156 2024-04-26T23:38:46.804 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 56/156 2024-04-26T23:38:46.834 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 57/156 2024-04-26T23:38:46.875 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 58/156 2024-04-26T23:38:46.969 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 59/156 2024-04-26T23:38:47.001 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 60/156 2024-04-26T23:38:47.016 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 94/156 2024-04-26T23:38:47.041 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 61/156 2024-04-26T23:38:47.075 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 62/156 2024-04-26T23:38:47.099 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 63/156 2024-04-26T23:38:47.102 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 95/156 2024-04-26T23:38:47.130 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 96/156 2024-04-26T23:38:47.163 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 97/156 2024-04-26T23:38:47.174 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 64/156 2024-04-26T23:38:47.299 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 65/156 2024-04-26T23:38:47.332 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 66/156 2024-04-26T23:38:47.359 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 67/156 2024-04-26T23:38:47.394 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 68/156 2024-04-26T23:38:47.433 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : uuid-1.6.2-55.el9.x86_64 69/156 2024-04-26T23:38:47.465 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 70/156 2024-04-26T23:38:47.474 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 98/156 2024-04-26T23:38:47.494 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 71/156 2024-04-26T23:38:47.517 INFO:teuthology.orchestra.run.smithi175.stdout: Upgrading : librbd1-2:19.0.0-3306.gbc612ffb.el9.x86_64 99/156 2024-04-26T23:38:47.520 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 72/156 2024-04-26T23:38:47.545 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 73/156 2024-04-26T23:38:47.587 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 74/156 2024-04-26T23:38:47.591 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: librbd1-2:19.0.0-3306.gbc612ffb.el9.x86_64 99/156 2024-04-26T23:38:47.621 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 75/156 2024-04-26T23:38:47.622 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-rbd-2:19.0.0-3306.gbc612ffb.el9.x86_64 100/156 2024-04-26T23:38:47.658 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 101/156 2024-04-26T23:38:47.708 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 76/156 2024-04-26T23:38:47.751 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 77/156 2024-04-26T23:38:47.783 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 78/156 2024-04-26T23:38:47.973 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 79/156 2024-04-26T23:38:48.098 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-packaging-20.9-5.el9.noarch 80/156 2024-04-26T23:38:48.138 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 102/156 2024-04-26T23:38:48.159 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 81/156 2024-04-26T23:38:48.162 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : librgw2-2:19.0.0-3306.gbc612ffb.el9.x86_64 103/156 2024-04-26T23:38:48.233 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: librgw2-2:19.0.0-3306.gbc612ffb.el9.x86_64 103/156 2024-04-26T23:38:48.263 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-rgw-2:19.0.0-3306.gbc612ffb.el9.x86_64 104/156 2024-04-26T23:38:48.874 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 82/156 2024-04-26T23:38:48.914 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 83/156 2024-04-26T23:38:48.948 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 84/156 2024-04-26T23:38:49.045 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 85/156 2024-04-26T23:38:49.097 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 86/156 2024-04-26T23:38:49.175 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 87/156 2024-04-26T23:38:49.250 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 88/156 2024-04-26T23:38:49.426 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : openblas-0.3.21-2.el9.x86_64 89/156 2024-04-26T23:38:49.481 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 90/156 2024-04-26T23:38:49.558 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 91/156 2024-04-26T23:38:50.194 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 92/156 2024-04-26T23:38:50.311 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 93/156 2024-04-26T23:38:50.665 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-common-2:19.0.0-3306.gbc612ffb.el9.x86_64 105/156 2024-04-26T23:38:50.701 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-common-2:19.0.0-3306.gbc612ffb.el9.x86_64 105/156 2024-04-26T23:38:51.240 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-common-2:19.0.0-3306.gbc612ffb.el9.x86_64 105/156 2024-04-26T23:38:51.288 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-base-2:19.0.0-3306.gbc612ffb.el9.x86_64 106/156 2024-04-26T23:38:51.378 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-base-2:19.0.0-3306.gbc612ffb.el9.x86_64 106/156 2024-04-26T23:38:51.378 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-04-26T23:38:51.379 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-04-26T23:38:51.379 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-26T23:38:51.406 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-selinux-2:19.0.0-3306.gbc612ffb.el9.x86_64 107/156 2024-04-26T23:38:51.522 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 94/156 2024-04-26T23:38:51.609 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 95/156 2024-04-26T23:38:51.637 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 96/156 2024-04-26T23:38:51.670 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 97/156 2024-04-26T23:38:51.981 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 98/156 2024-04-26T23:38:52.025 INFO:teuthology.orchestra.run.smithi088.stdout: Upgrading : librbd1-2:19.0.0-3306.gbc612ffb.el9.x86_64 99/156 2024-04-26T23:38:52.115 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: librbd1-2:19.0.0-3306.gbc612ffb.el9.x86_64 99/156 2024-04-26T23:38:52.147 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-rbd-2:19.0.0-3306.gbc612ffb.el9.x86_64 100/156 2024-04-26T23:38:52.182 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 101/156 2024-04-26T23:38:52.659 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 102/156 2024-04-26T23:38:52.686 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : librgw2-2:19.0.0-3306.gbc612ffb.el9.x86_64 103/156 2024-04-26T23:38:52.757 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: librgw2-2:19.0.0-3306.gbc612ffb.el9.x86_64 103/156 2024-04-26T23:38:52.779 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-rgw-2:19.0.0-3306.gbc612ffb.el9.x86_64 104/156 2024-04-26T23:38:55.069 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-common-2:19.0.0-3306.gbc612ffb.el9.x86_64 105/156 2024-04-26T23:38:55.117 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-common-2:19.0.0-3306.gbc612ffb.el9.x86_64 105/156 2024-04-26T23:38:55.666 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-common-2:19.0.0-3306.gbc612ffb.el9.x86_64 105/156 2024-04-26T23:38:55.713 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-base-2:19.0.0-3306.gbc612ffb.el9.x86_64 106/156 2024-04-26T23:38:55.804 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-base-2:19.0.0-3306.gbc612ffb.el9.x86_64 106/156 2024-04-26T23:38:55.804 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-04-26T23:38:55.804 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-04-26T23:38:55.805 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-26T23:38:55.831 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-selinux-2:19.0.0-3306.gbc612ffb.el9.x86_64 107/156 2024-04-26T23:39:02.837 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-selinux-2:19.0.0-3306.gbc612ffb.el9.x86_64 107/156 2024-04-26T23:39:02.837 INFO:teuthology.orchestra.run.smithi175.stdout:skipping the directory /sys 2024-04-26T23:39:02.837 INFO:teuthology.orchestra.run.smithi175.stdout:skipping the directory /proc 2024-04-26T23:39:02.837 INFO:teuthology.orchestra.run.smithi175.stdout:skipping the directory /mnt 2024-04-26T23:39:02.837 INFO:teuthology.orchestra.run.smithi175.stdout:skipping the directory /var/tmp 2024-04-26T23:39:02.838 INFO:teuthology.orchestra.run.smithi175.stdout:skipping the directory /home 2024-04-26T23:39:02.838 INFO:teuthology.orchestra.run.smithi175.stdout:skipping the directory /root 2024-04-26T23:39:02.838 INFO:teuthology.orchestra.run.smithi175.stdout:skipping the directory /tmp 2024-04-26T23:39:02.838 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-26T23:39:03.008 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-volume-2:19.0.0-3306.gbc612ffb.el9.noarch 108/156 2024-04-26T23:39:03.024 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-volume-2:19.0.0-3306.gbc612ffb.el9.noarch 108/156 2024-04-26T23:39:03.024 INFO:teuthology.orchestra.run.smithi175.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T23:39:03.024 INFO:teuthology.orchestra.run.smithi175.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-04-26T23:39:03.024 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-26T23:39:04.519 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-osd-2:19.0.0-3306.gbc612ffb.el9.x86_64 109/156 2024-04-26T23:39:04.545 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-osd-2:19.0.0-3306.gbc612ffb.el9.x86_64 109/156 2024-04-26T23:39:04.545 INFO:teuthology.orchestra.run.smithi175.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T23:39:04.545 INFO:teuthology.orchestra.run.smithi175.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-04-26T23:39:04.545 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-26T23:39:04.545 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-26T23:39:04.545 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-26T23:39:04.761 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-mds-2:19.0.0-3306.gbc612ffb.el9.x86_64 110/156 2024-04-26T23:39:04.784 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-mds-2:19.0.0-3306.gbc612ffb.el9.x86_64 110/156 2024-04-26T23:39:04.784 INFO:teuthology.orchestra.run.smithi175.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T23:39:04.784 INFO:teuthology.orchestra.run.smithi175.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-04-26T23:39:04.784 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-26T23:39:04.784 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-26T23:39:04.784 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-26T23:39:05.228 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-mon-2:19.0.0-3306.gbc612ffb.el9.x86_64 111/156 2024-04-26T23:39:05.251 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-mon-2:19.0.0-3306.gbc612ffb.el9.x86_64 111/156 2024-04-26T23:39:05.251 INFO:teuthology.orchestra.run.smithi175.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T23:39:05.251 INFO:teuthology.orchestra.run.smithi175.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-04-26T23:39:05.251 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-26T23:39:05.251 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-26T23:39:05.252 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-26T23:39:05.359 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : automake-1.16.2-8.el9.noarch 112/156 2024-04-26T23:39:05.415 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-ply-3.11-14.el9.noarch 113/156 2024-04-26T23:39:05.471 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 114/156 2024-04-26T23:39:05.656 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 115/156 2024-04-26T23:39:05.704 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 116/156 2024-04-26T23:39:05.782 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 117/156 2024-04-26T23:39:05.871 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 118/156 2024-04-26T23:39:06.010 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 119/156 2024-04-26T23:39:06.054 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 120/156 2024-04-26T23:39:06.086 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 121/156 2024-04-26T23:39:06.113 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : fuse-2.9.9-15.el9.x86_64 122/156 2024-04-26T23:39:06.573 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: cephadm-2:19.0.0-3306.gbc612ffb.el9.noarch 123/156 2024-04-26T23:39:06.595 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : cephadm-2:19.0.0-3306.gbc612ffb.el9.noarch 123/156 2024-04-26T23:39:06.627 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-3306.gbc612ffb.e 124/156 2024-04-26T23:39:06.697 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-3306.gbc612ffb. 125/156 2024-04-26T23:39:06.726 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-3306.gbc612ffb.el9.noa 126/156 2024-04-26T23:39:07.318 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-selinux-2:19.0.0-3306.gbc612ffb.el9.x86_64 107/156 2024-04-26T23:39:07.318 INFO:teuthology.orchestra.run.smithi088.stdout:skipping the directory /sys 2024-04-26T23:39:07.318 INFO:teuthology.orchestra.run.smithi088.stdout:skipping the directory /proc 2024-04-26T23:39:07.318 INFO:teuthology.orchestra.run.smithi088.stdout:skipping the directory /mnt 2024-04-26T23:39:07.318 INFO:teuthology.orchestra.run.smithi088.stdout:skipping the directory /var/tmp 2024-04-26T23:39:07.318 INFO:teuthology.orchestra.run.smithi088.stdout:skipping the directory /home 2024-04-26T23:39:07.318 INFO:teuthology.orchestra.run.smithi088.stdout:skipping the directory /root 2024-04-26T23:39:07.318 INFO:teuthology.orchestra.run.smithi088.stdout:skipping the directory /tmp 2024-04-26T23:39:07.318 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-26T23:39:07.508 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-volume-2:19.0.0-3306.gbc612ffb.el9.noarch 108/156 2024-04-26T23:39:07.524 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-volume-2:19.0.0-3306.gbc612ffb.el9.noarch 108/156 2024-04-26T23:39:07.524 INFO:teuthology.orchestra.run.smithi088.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T23:39:07.524 INFO:teuthology.orchestra.run.smithi088.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-04-26T23:39:07.524 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-26T23:39:07.768 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-3306.gbc612ffb.el9.noa 126/156 2024-04-26T23:39:07.803 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-3306.gbc612ffb.el9.n 127/156 2024-04-26T23:39:08.768 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-3306.gbc612ffb.el9.n 127/156 2024-04-26T23:39:08.795 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-3306.gbc6 128/156 2024-04-26T23:39:08.897 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-3306.gbc6 128/156 2024-04-26T23:39:09.019 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-osd-2:19.0.0-3306.gbc612ffb.el9.x86_64 109/156 2024-04-26T23:39:09.044 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-osd-2:19.0.0-3306.gbc612ffb.el9.x86_64 109/156 2024-04-26T23:39:09.045 INFO:teuthology.orchestra.run.smithi088.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T23:39:09.045 INFO:teuthology.orchestra.run.smithi088.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-04-26T23:39:09.045 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-26T23:39:09.045 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-26T23:39:09.045 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-26T23:39:09.058 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-3306.gbc612ffb.el 129/156 2024-04-26T23:39:09.080 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-mgr-2:19.0.0-3306.gbc612ffb.el9.x86_64 130/156 2024-04-26T23:39:09.103 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-mgr-2:19.0.0-3306.gbc612ffb.el9.x86_64 130/156 2024-04-26T23:39:09.103 INFO:teuthology.orchestra.run.smithi175.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T23:39:09.103 INFO:teuthology.orchestra.run.smithi175.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-04-26T23:39:09.103 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-26T23:39:09.103 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-26T23:39:09.103 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-26T23:39:09.147 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-mgr-rook-2:19.0.0-3306.gbc612ffb.el9.noarch 131/156 2024-04-26T23:39:09.159 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-3306.gbc612ffb.el9.noarch 131/156 2024-04-26T23:39:09.256 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-2:19.0.0-3306.gbc612ffb.el9.x86_64 132/156 2024-04-26T23:39:09.270 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-mds-2:19.0.0-3306.gbc612ffb.el9.x86_64 110/156 2024-04-26T23:39:09.291 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-mds-2:19.0.0-3306.gbc612ffb.el9.x86_64 110/156 2024-04-26T23:39:09.291 INFO:teuthology.orchestra.run.smithi088.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T23:39:09.292 INFO:teuthology.orchestra.run.smithi088.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-04-26T23:39:09.292 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-26T23:39:09.292 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-26T23:39:09.292 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-26T23:39:09.305 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-fuse-2:19.0.0-3306.gbc612ffb.el9.x86_64 133/156 2024-04-26T23:39:09.737 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-mon-2:19.0.0-3306.gbc612ffb.el9.x86_64 111/156 2024-04-26T23:39:09.759 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-mon-2:19.0.0-3306.gbc612ffb.el9.x86_64 111/156 2024-04-26T23:39:09.759 INFO:teuthology.orchestra.run.smithi088.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T23:39:09.759 INFO:teuthology.orchestra.run.smithi088.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-04-26T23:39:09.759 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-26T23:39:09.759 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-26T23:39:09.759 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-26T23:39:09.858 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : automake-1.16.2-8.el9.noarch 112/156 2024-04-26T23:39:09.915 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-ply-3.11-14.el9.noarch 113/156 2024-04-26T23:39:09.971 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 114/156 2024-04-26T23:39:10.156 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 115/156 2024-04-26T23:39:10.204 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 116/156 2024-04-26T23:39:10.228 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libtool-2.4.6-45.el9.x86_64 134/156 2024-04-26T23:39:10.258 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-radosgw-2:19.0.0-3306.gbc612ffb.el9.x86_64 135/156 2024-04-26T23:39:10.274 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 117/156 2024-04-26T23:39:10.282 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-3306.gbc612ffb.el9.x86_64 135/156 2024-04-26T23:39:10.282 INFO:teuthology.orchestra.run.smithi175.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T23:39:10.282 INFO:teuthology.orchestra.run.smithi175.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-04-26T23:39:10.282 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-26T23:39:10.282 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-26T23:39:10.282 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-26T23:39:10.326 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-3306.gbc612 136/156 2024-04-26T23:39:10.348 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-3306.gbc612 136/156 2024-04-26T23:39:10.348 INFO:teuthology.orchestra.run.smithi175.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T23:39:10.348 INFO:teuthology.orchestra.run.smithi175.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-04-26T23:39:10.348 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-26T23:39:10.362 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 118/156 2024-04-26T23:39:10.393 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : cephfs-mirror-2:19.0.0-3306.gbc612ffb.el9.x86_64 137/156 2024-04-26T23:39:10.415 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-3306.gbc612ffb.el9.x86_64 137/156 2024-04-26T23:39:10.415 INFO:teuthology.orchestra.run.smithi175.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T23:39:10.415 INFO:teuthology.orchestra.run.smithi175.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-04-26T23:39:10.415 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-26T23:39:10.415 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-26T23:39:10.416 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-26T23:39:10.507 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 119/156 2024-04-26T23:39:10.546 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 120/156 2024-04-26T23:39:10.577 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 121/156 2024-04-26T23:39:10.605 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : fuse-2.9.9-15.el9.x86_64 122/156 2024-04-26T23:39:10.726 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : rbd-mirror-2:19.0.0-3306.gbc612ffb.el9.x86_64 138/156 2024-04-26T23:39:10.749 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: rbd-mirror-2:19.0.0-3306.gbc612ffb.el9.x86_64 138/156 2024-04-26T23:39:10.749 INFO:teuthology.orchestra.run.smithi175.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T23:39:10.749 INFO:teuthology.orchestra.run.smithi175.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-04-26T23:39:10.749 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-26T23:39:10.750 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-26T23:39:10.750 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-26T23:39:11.082 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: cephadm-2:19.0.0-3306.gbc612ffb.el9.noarch 123/156 2024-04-26T23:39:11.112 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : cephadm-2:19.0.0-3306.gbc612ffb.el9.noarch 123/156 2024-04-26T23:39:11.153 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-3306.gbc612ffb.e 124/156 2024-04-26T23:39:11.223 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-3306.gbc612ffb. 125/156 2024-04-26T23:39:11.252 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-3306.gbc612ffb.el9.noa 126/156 2024-04-26T23:39:12.290 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-3306.gbc612ffb.el9.noa 126/156 2024-04-26T23:39:12.329 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-3306.gbc612ffb.el9.n 127/156 2024-04-26T23:39:13.293 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-3306.gbc612ffb.el9.n 127/156 2024-04-26T23:39:13.320 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-3306.gbc6 128/156 2024-04-26T23:39:13.422 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-3306.gbc6 128/156 2024-04-26T23:39:13.600 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-3306.gbc612ffb.el 129/156 2024-04-26T23:39:13.631 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-mgr-2:19.0.0-3306.gbc612ffb.el9.x86_64 130/156 2024-04-26T23:39:13.653 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-mgr-2:19.0.0-3306.gbc612ffb.el9.x86_64 130/156 2024-04-26T23:39:13.654 INFO:teuthology.orchestra.run.smithi088.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T23:39:13.654 INFO:teuthology.orchestra.run.smithi088.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-04-26T23:39:13.654 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-26T23:39:13.654 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-26T23:39:13.654 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-26T23:39:13.698 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-mgr-rook-2:19.0.0-3306.gbc612ffb.el9.noarch 131/156 2024-04-26T23:39:13.709 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-3306.gbc612ffb.el9.noarch 131/156 2024-04-26T23:39:13.798 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-2:19.0.0-3306.gbc612ffb.el9.x86_64 132/156 2024-04-26T23:39:13.855 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-fuse-2:19.0.0-3306.gbc612ffb.el9.x86_64 133/156 2024-04-26T23:39:14.779 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libtool-2.4.6-45.el9.x86_64 134/156 2024-04-26T23:39:14.809 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-radosgw-2:19.0.0-3306.gbc612ffb.el9.x86_64 135/156 2024-04-26T23:39:14.832 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-3306.gbc612ffb.el9.x86_64 135/156 2024-04-26T23:39:14.832 INFO:teuthology.orchestra.run.smithi088.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T23:39:14.832 INFO:teuthology.orchestra.run.smithi088.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-04-26T23:39:14.832 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-26T23:39:14.832 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-26T23:39:14.832 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-26T23:39:14.876 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-3306.gbc612 136/156 2024-04-26T23:39:14.898 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-3306.gbc612 136/156 2024-04-26T23:39:14.898 INFO:teuthology.orchestra.run.smithi088.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T23:39:14.899 INFO:teuthology.orchestra.run.smithi088.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-04-26T23:39:14.899 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-26T23:39:14.943 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : cephfs-mirror-2:19.0.0-3306.gbc612ffb.el9.x86_64 137/156 2024-04-26T23:39:14.965 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-3306.gbc612ffb.el9.x86_64 137/156 2024-04-26T23:39:14.966 INFO:teuthology.orchestra.run.smithi088.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T23:39:14.966 INFO:teuthology.orchestra.run.smithi088.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-04-26T23:39:14.966 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-26T23:39:14.966 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-26T23:39:14.966 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-26T23:39:15.269 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : rbd-mirror-2:19.0.0-3306.gbc612ffb.el9.x86_64 138/156 2024-04-26T23:39:15.291 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: rbd-mirror-2:19.0.0-3306.gbc612ffb.el9.x86_64 138/156 2024-04-26T23:39:15.291 INFO:teuthology.orchestra.run.smithi088.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T23:39:15.291 INFO:teuthology.orchestra.run.smithi088.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-04-26T23:39:15.291 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-26T23:39:15.291 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-26T23:39:15.291 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-26T23:39:15.363 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-test-2:19.0.0-3306.gbc612ffb.el9.x86_64 139/156 2024-04-26T23:39:15.405 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : rbd-fuse-2:19.0.0-3306.gbc612ffb.el9.x86_64 140/156 2024-04-26T23:39:15.446 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : rbd-nbd-2:19.0.0-3306.gbc612ffb.el9.x86_64 141/156 2024-04-26T23:39:15.478 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 142/156 2024-04-26T23:39:15.505 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 143/156 2024-04-26T23:39:15.694 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : cephfs-shell-2:19.0.0-3306.gbc612ffb.el9.x86_64 144/156 2024-04-26T23:39:15.742 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 145/156 2024-04-26T23:39:15.772 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libcephfs-devel-2:19.0.0-3306.gbc612ffb.el9.x86_ 146/156 2024-04-26T23:39:16.337 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-26T23:39:16.378 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-26T23:39:16.398 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-26T23:39:17.234 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : cephfs-top-2:19.0.0-3306.gbc612ffb.el9.noarch 148/156 2024-04-26T23:39:17.339 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 149/156 2024-04-26T23:39:17.381 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 150/156 2024-04-26T23:39:17.463 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : flex-2.6.4-9.el9.x86_64 151/156 2024-04-26T23:39:17.503 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : bison-3.7.4-5.el9.x86_64 152/156 2024-04-26T23:39:17.503 INFO:teuthology.orchestra.run.smithi175.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 153/156 2024-04-26T23:39:17.587 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 153/156 2024-04-26T23:39:17.620 INFO:teuthology.orchestra.run.smithi175.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 154/156 2024-04-26T23:39:17.620 INFO:teuthology.orchestra.run.smithi175.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 155/156 2024-04-26T23:39:17.722 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 155/156 2024-04-26T23:39:17.802 INFO:teuthology.orchestra.run.smithi175.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-26T23:39:19.864 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-test-2:19.0.0-3306.gbc612ffb.el9.x86_64 139/156 2024-04-26T23:39:19.906 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : rbd-fuse-2:19.0.0-3306.gbc612ffb.el9.x86_64 140/156 2024-04-26T23:39:19.946 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : rbd-nbd-2:19.0.0-3306.gbc612ffb.el9.x86_64 141/156 2024-04-26T23:39:19.978 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 142/156 2024-04-26T23:39:20.005 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 143/156 2024-04-26T23:39:20.185 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : cephfs-shell-2:19.0.0-3306.gbc612ffb.el9.x86_64 144/156 2024-04-26T23:39:20.235 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 145/156 2024-04-26T23:39:20.265 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libcephfs-devel-2:19.0.0-3306.gbc612ffb.el9.x86_ 146/156 2024-04-26T23:39:20.894 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-26T23:39:20.937 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-26T23:39:20.956 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-26T23:39:21.778 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : cephfs-top-2:19.0.0-3306.gbc612ffb.el9.noarch 148/156 2024-04-26T23:39:21.866 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 149/156 2024-04-26T23:39:21.907 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 150/156 2024-04-26T23:39:21.989 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : flex-2.6.4-9.el9.x86_64 151/156 2024-04-26T23:39:22.029 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : bison-3.7.4-5.el9.x86_64 152/156 2024-04-26T23:39:22.029 INFO:teuthology.orchestra.run.smithi088.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 153/156 2024-04-26T23:39:22.113 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 153/156 2024-04-26T23:39:22.145 INFO:teuthology.orchestra.run.smithi088.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 154/156 2024-04-26T23:39:22.146 INFO:teuthology.orchestra.run.smithi088.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 155/156 2024-04-26T23:39:22.234 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 155/156 2024-04-26T23:39:22.301 INFO:teuthology.orchestra.run.smithi088.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-26T23:39:23.453 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-26T23:39:23.453 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-2:19.0.0-3306.gbc612ffb.el9.x86_64 1/156 2024-04-26T23:39:23.453 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-base-2:19.0.0-3306.gbc612ffb.el9.x86_64 2/156 2024-04-26T23:39:23.453 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-common-2:19.0.0-3306.gbc612ffb.el9.x86_64 3/156 2024-04-26T23:39:23.454 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-fuse-2:19.0.0-3306.gbc612ffb.el9.x86_64 4/156 2024-04-26T23:39:23.454 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-3306.gbc612 5/156 2024-04-26T23:39:23.454 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-mds-2:19.0.0-3306.gbc612ffb.el9.x86_64 6/156 2024-04-26T23:39:23.454 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-mgr-2:19.0.0-3306.gbc612ffb.el9.x86_64 7/156 2024-04-26T23:39:23.454 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-mon-2:19.0.0-3306.gbc612ffb.el9.x86_64 8/156 2024-04-26T23:39:23.454 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-osd-2:19.0.0-3306.gbc612ffb.el9.x86_64 9/156 2024-04-26T23:39:23.454 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-radosgw-2:19.0.0-3306.gbc612ffb.el9.x86_64 10/156 2024-04-26T23:39:23.454 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-selinux-2:19.0.0-3306.gbc612ffb.el9.x86_64 11/156 2024-04-26T23:39:23.454 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-test-2:19.0.0-3306.gbc612ffb.el9.x86_64 12/156 2024-04-26T23:39:23.454 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : cephfs-mirror-2:19.0.0-3306.gbc612ffb.el9.x86_64 13/156 2024-04-26T23:39:23.454 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : cephfs-shell-2:19.0.0-3306.gbc612ffb.el9.x86_64 14/156 2024-04-26T23:39:23.454 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libcephfs-devel-2:19.0.0-3306.gbc612ffb.el9.x86_ 15/156 2024-04-26T23:39:23.454 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libcephfs2-2:19.0.0-3306.gbc612ffb.el9.x86_64 16/156 2024-04-26T23:39:23.455 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libcephsqlite-2:19.0.0-3306.gbc612ffb.el9.x86_64 17/156 2024-04-26T23:39:23.455 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : librados-devel-2:19.0.0-3306.gbc612ffb.el9.x86_6 18/156 2024-04-26T23:39:23.455 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libradosstriper1-2:19.0.0-3306.gbc612ffb.el9.x86 19/156 2024-04-26T23:39:23.455 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : librgw2-2:19.0.0-3306.gbc612ffb.el9.x86_64 20/156 2024-04-26T23:39:23.455 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-ceph-argparse-2:19.0.0-3306.gbc612ffb.el 21/156 2024-04-26T23:39:23.455 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-ceph-common-2:19.0.0-3306.gbc612ffb.el9. 22/156 2024-04-26T23:39:23.455 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-cephfs-2:19.0.0-3306.gbc612ffb.el9.x86_6 23/156 2024-04-26T23:39:23.455 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-rados-2:19.0.0-3306.gbc612ffb.el9.x86_64 24/156 2024-04-26T23:39:23.455 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-rbd-2:19.0.0-3306.gbc612ffb.el9.x86_64 25/156 2024-04-26T23:39:23.455 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-rgw-2:19.0.0-3306.gbc612ffb.el9.x86_64 26/156 2024-04-26T23:39:23.455 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : rbd-fuse-2:19.0.0-3306.gbc612ffb.el9.x86_64 27/156 2024-04-26T23:39:23.455 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : rbd-mirror-2:19.0.0-3306.gbc612ffb.el9.x86_64 28/156 2024-04-26T23:39:23.455 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : rbd-nbd-2:19.0.0-3306.gbc612ffb.el9.x86_64 29/156 2024-04-26T23:39:23.455 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-3306.gbc612ffb. 30/156 2024-04-26T23:39:23.456 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-3306.gbc612ffb.el9.noa 31/156 2024-04-26T23:39:23.456 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-3306.gbc612ffb.el9.n 32/156 2024-04-26T23:39:23.456 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-3306.gbc6 33/156 2024-04-26T23:39:23.456 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-3306.gbc612ffb.el 34/156 2024-04-26T23:39:23.456 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-mgr-rook-2:19.0.0-3306.gbc612ffb.el9.noarch 35/156 2024-04-26T23:39:23.456 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-3306.gbc612ffb.e 36/156 2024-04-26T23:39:23.456 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-volume-2:19.0.0-3306.gbc612ffb.el9.noarch 37/156 2024-04-26T23:39:23.456 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : cephadm-2:19.0.0-3306.gbc612ffb.el9.noarch 38/156 2024-04-26T23:39:23.456 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : cephfs-top-2:19.0.0-3306.gbc612ffb.el9.noarch 39/156 2024-04-26T23:39:23.456 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/156 2024-04-26T23:39:23.456 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/156 2024-04-26T23:39:23.456 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/156 2024-04-26T23:39:23.456 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/156 2024-04-26T23:39:23.456 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/156 2024-04-26T23:39:23.456 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/156 2024-04-26T23:39:23.456 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/156 2024-04-26T23:39:23.457 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/156 2024-04-26T23:39:23.457 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/156 2024-04-26T23:39:23.457 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/156 2024-04-26T23:39:23.457 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/156 2024-04-26T23:39:23.457 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/156 2024-04-26T23:39:23.457 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 52/156 2024-04-26T23:39:23.457 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/156 2024-04-26T23:39:23.457 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/156 2024-04-26T23:39:23.457 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/156 2024-04-26T23:39:23.457 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/156 2024-04-26T23:39:23.457 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/156 2024-04-26T23:39:23.457 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/156 2024-04-26T23:39:23.457 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/156 2024-04-26T23:39:23.457 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/156 2024-04-26T23:39:23.458 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/156 2024-04-26T23:39:23.458 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/156 2024-04-26T23:39:23.458 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/156 2024-04-26T23:39:23.458 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/156 2024-04-26T23:39:23.458 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/156 2024-04-26T23:39:23.458 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/156 2024-04-26T23:39:23.458 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/156 2024-04-26T23:39:23.458 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 68/156 2024-04-26T23:39:23.458 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/156 2024-04-26T23:39:23.458 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/156 2024-04-26T23:39:23.458 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/156 2024-04-26T23:39:23.458 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/156 2024-04-26T23:39:23.458 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/156 2024-04-26T23:39:23.458 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/156 2024-04-26T23:39:23.459 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/156 2024-04-26T23:39:23.459 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 76/156 2024-04-26T23:39:23.459 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 77/156 2024-04-26T23:39:23.459 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 78/156 2024-04-26T23:39:23.459 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 79/156 2024-04-26T23:39:23.459 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 80/156 2024-04-26T23:39:23.459 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 81/156 2024-04-26T23:39:23.459 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 82/156 2024-04-26T23:39:23.459 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 83/156 2024-04-26T23:39:23.459 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 84/156 2024-04-26T23:39:23.459 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 85/156 2024-04-26T23:39:23.459 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 86/156 2024-04-26T23:39:23.459 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 87/156 2024-04-26T23:39:23.459 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 88/156 2024-04-26T23:39:23.459 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 89/156 2024-04-26T23:39:23.460 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 90/156 2024-04-26T23:39:23.460 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 91/156 2024-04-26T23:39:23.460 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 92/156 2024-04-26T23:39:23.460 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 93/156 2024-04-26T23:39:23.460 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 94/156 2024-04-26T23:39:23.460 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 95/156 2024-04-26T23:39:23.460 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 96/156 2024-04-26T23:39:23.460 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 97/156 2024-04-26T23:39:23.460 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 98/156 2024-04-26T23:39:23.460 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 99/156 2024-04-26T23:39:23.460 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 100/156 2024-04-26T23:39:23.460 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 101/156 2024-04-26T23:39:23.460 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 102/156 2024-04-26T23:39:23.460 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 103/156 2024-04-26T23:39:23.461 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 104/156 2024-04-26T23:39:23.461 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 105/156 2024-04-26T23:39:23.461 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 106/156 2024-04-26T23:39:23.461 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 107/156 2024-04-26T23:39:23.461 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 108/156 2024-04-26T23:39:23.461 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 109/156 2024-04-26T23:39:23.461 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 110/156 2024-04-26T23:39:23.461 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 111/156 2024-04-26T23:39:23.461 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 112/156 2024-04-26T23:39:23.461 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 113/156 2024-04-26T23:39:23.461 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 114/156 2024-04-26T23:39:23.461 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 115/156 2024-04-26T23:39:23.461 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 116/156 2024-04-26T23:39:23.461 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 117/156 2024-04-26T23:39:23.461 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 118/156 2024-04-26T23:39:23.462 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 119/156 2024-04-26T23:39:23.462 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 120/156 2024-04-26T23:39:23.462 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 121/156 2024-04-26T23:39:23.462 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 122/156 2024-04-26T23:39:23.462 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/156 2024-04-26T23:39:23.462 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/156 2024-04-26T23:39:23.462 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/156 2024-04-26T23:39:23.462 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/156 2024-04-26T23:39:23.462 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/156 2024-04-26T23:39:23.462 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/156 2024-04-26T23:39:23.462 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/156 2024-04-26T23:39:23.462 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/156 2024-04-26T23:39:23.462 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/156 2024-04-26T23:39:23.462 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/156 2024-04-26T23:39:23.463 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/156 2024-04-26T23:39:23.463 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/156 2024-04-26T23:39:23.463 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/156 2024-04-26T23:39:23.463 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/156 2024-04-26T23:39:23.463 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/156 2024-04-26T23:39:23.463 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/156 2024-04-26T23:39:23.463 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/156 2024-04-26T23:39:23.463 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/156 2024-04-26T23:39:23.463 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/156 2024-04-26T23:39:23.463 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/156 2024-04-26T23:39:23.463 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/156 2024-04-26T23:39:23.463 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/156 2024-04-26T23:39:23.463 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/156 2024-04-26T23:39:23.463 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/156 2024-04-26T23:39:23.463 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/156 2024-04-26T23:39:23.464 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/156 2024-04-26T23:39:23.464 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : librados2-2:19.0.0-3306.gbc612ffb.el9.x86_64 149/156 2024-04-26T23:39:23.464 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/156 2024-04-26T23:39:23.464 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : librbd1-2:19.0.0-3306.gbc612ffb.el9.x86_64 151/156 2024-04-26T23:39:23.464 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/156 2024-04-26T23:39:23.464 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 153/156 2024-04-26T23:39:23.464 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 154/156 2024-04-26T23:39:23.464 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 155/156 2024-04-26T23:39:25.606 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-26T23:39:25.607 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-26T23:39:25.607 INFO:teuthology.orchestra.run.smithi175.stdout:Upgraded: 2024-04-26T23:39:25.607 INFO:teuthology.orchestra.run.smithi175.stdout: librados2-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T23:39:25.607 INFO:teuthology.orchestra.run.smithi175.stdout: librbd1-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T23:39:25.607 INFO:teuthology.orchestra.run.smithi175.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-04-26T23:39:25.607 INFO:teuthology.orchestra.run.smithi175.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-04-26T23:39:25.607 INFO:teuthology.orchestra.run.smithi175.stdout:Installed: 2024-04-26T23:39:25.607 INFO:teuthology.orchestra.run.smithi175.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-04-26T23:39:25.607 INFO:teuthology.orchestra.run.smithi175.stdout: automake-1.16.2-8.el9.noarch 2024-04-26T23:39:25.607 INFO:teuthology.orchestra.run.smithi175.stdout: bison-3.7.4-5.el9.x86_64 2024-04-26T23:39:25.607 INFO:teuthology.orchestra.run.smithi175.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-04-26T23:39:25.608 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T23:39:25.608 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-base-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T23:39:25.608 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-common-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T23:39:25.608 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-fuse-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T23:39:25.608 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-grafana-dashboards-2:19.0.0-3306.gbc612ffb.el9.noarch 2024-04-26T23:39:25.608 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-immutable-object-cache-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T23:39:25.608 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mds-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T23:39:25.608 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T23:39:25.608 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-cephadm-2:19.0.0-3306.gbc612ffb.el9.noarch 2024-04-26T23:39:25.608 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-dashboard-2:19.0.0-3306.gbc612ffb.el9.noarch 2024-04-26T23:39:25.608 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-diskprediction-local-2:19.0.0-3306.gbc612ffb.el9.noarch 2024-04-26T23:39:25.608 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-modules-core-2:19.0.0-3306.gbc612ffb.el9.noarch 2024-04-26T23:39:25.608 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-rook-2:19.0.0-3306.gbc612ffb.el9.noarch 2024-04-26T23:39:25.608 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mon-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T23:39:25.608 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-osd-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T23:39:25.609 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-prometheus-alerts-2:19.0.0-3306.gbc612ffb.el9.noarch 2024-04-26T23:39:25.609 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-radosgw-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T23:39:25.609 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-selinux-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T23:39:25.609 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-test-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T23:39:25.609 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-volume-2:19.0.0-3306.gbc612ffb.el9.noarch 2024-04-26T23:39:25.609 INFO:teuthology.orchestra.run.smithi175.stdout: cephadm-2:19.0.0-3306.gbc612ffb.el9.noarch 2024-04-26T23:39:25.609 INFO:teuthology.orchestra.run.smithi175.stdout: cephfs-mirror-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T23:39:25.609 INFO:teuthology.orchestra.run.smithi175.stdout: cephfs-shell-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T23:39:25.609 INFO:teuthology.orchestra.run.smithi175.stdout: cephfs-top-2:19.0.0-3306.gbc612ffb.el9.noarch 2024-04-26T23:39:25.609 INFO:teuthology.orchestra.run.smithi175.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-04-26T23:39:25.609 INFO:teuthology.orchestra.run.smithi175.stdout: flex-2.6.4-9.el9.x86_64 2024-04-26T23:39:25.609 INFO:teuthology.orchestra.run.smithi175.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-04-26T23:39:25.609 INFO:teuthology.orchestra.run.smithi175.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-04-26T23:39:25.609 INFO:teuthology.orchestra.run.smithi175.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-04-26T23:39:25.609 INFO:teuthology.orchestra.run.smithi175.stdout: fuse-2.9.9-15.el9.x86_64 2024-04-26T23:39:25.610 INFO:teuthology.orchestra.run.smithi175.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-04-26T23:39:25.610 INFO:teuthology.orchestra.run.smithi175.stdout: grpc-data-1.46.7-10.el9.noarch 2024-04-26T23:39:25.610 INFO:teuthology.orchestra.run.smithi175.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-04-26T23:39:25.610 INFO:teuthology.orchestra.run.smithi175.stdout: libarrow-9.0.0-11.el9.x86_64 2024-04-26T23:39:25.610 INFO:teuthology.orchestra.run.smithi175.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-04-26T23:39:25.610 INFO:teuthology.orchestra.run.smithi175.stdout: libcephfs-devel-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T23:39:25.610 INFO:teuthology.orchestra.run.smithi175.stdout: libcephfs2-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T23:39:25.610 INFO:teuthology.orchestra.run.smithi175.stdout: libcephsqlite-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T23:39:25.610 INFO:teuthology.orchestra.run.smithi175.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-04-26T23:39:25.610 INFO:teuthology.orchestra.run.smithi175.stdout: liboath-2.6.7-2.el9.x86_64 2024-04-26T23:39:25.610 INFO:teuthology.orchestra.run.smithi175.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-04-26T23:39:25.610 INFO:teuthology.orchestra.run.smithi175.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-04-26T23:39:25.610 INFO:teuthology.orchestra.run.smithi175.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-04-26T23:39:25.610 INFO:teuthology.orchestra.run.smithi175.stdout: librados-devel-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T23:39:25.611 INFO:teuthology.orchestra.run.smithi175.stdout: libradosstriper1-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T23:39:25.611 INFO:teuthology.orchestra.run.smithi175.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-04-26T23:39:25.611 INFO:teuthology.orchestra.run.smithi175.stdout: librgw2-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T23:39:25.611 INFO:teuthology.orchestra.run.smithi175.stdout: libtool-2.4.6-45.el9.x86_64 2024-04-26T23:39:25.611 INFO:teuthology.orchestra.run.smithi175.stdout: libunwind-1.6.2-1.el9.x86_64 2024-04-26T23:39:25.611 INFO:teuthology.orchestra.run.smithi175.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-04-26T23:39:25.611 INFO:teuthology.orchestra.run.smithi175.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-04-26T23:39:25.611 INFO:teuthology.orchestra.run.smithi175.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-04-26T23:39:25.611 INFO:teuthology.orchestra.run.smithi175.stdout: lua-5.4.4-4.el9.x86_64 2024-04-26T23:39:25.611 INFO:teuthology.orchestra.run.smithi175.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-04-26T23:39:25.611 INFO:teuthology.orchestra.run.smithi175.stdout: luarocks-3.9.2-1.el9.noarch 2024-04-26T23:39:25.611 INFO:teuthology.orchestra.run.smithi175.stdout: openblas-0.3.21-2.el9.x86_64 2024-04-26T23:39:25.611 INFO:teuthology.orchestra.run.smithi175.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-04-26T23:39:25.611 INFO:teuthology.orchestra.run.smithi175.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-04-26T23:39:25.612 INFO:teuthology.orchestra.run.smithi175.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-04-26T23:39:25.612 INFO:teuthology.orchestra.run.smithi175.stdout: postgresql-13.14-1.el9.x86_64 2024-04-26T23:39:25.612 INFO:teuthology.orchestra.run.smithi175.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-04-26T23:39:25.612 INFO:teuthology.orchestra.run.smithi175.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-04-26T23:39:25.612 INFO:teuthology.orchestra.run.smithi175.stdout: postgresql-server-13.14-1.el9.x86_64 2024-04-26T23:39:25.612 INFO:teuthology.orchestra.run.smithi175.stdout: protobuf-3.14.0-13.el9.x86_64 2024-04-26T23:39:25.612 INFO:teuthology.orchestra.run.smithi175.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-04-26T23:39:25.612 INFO:teuthology.orchestra.run.smithi175.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-04-26T23:39:25.612 INFO:teuthology.orchestra.run.smithi175.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-04-26T23:39:25.612 INFO:teuthology.orchestra.run.smithi175.stdout: python3-babel-2.9.1-2.el9.noarch 2024-04-26T23:39:25.612 INFO:teuthology.orchestra.run.smithi175.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-04-26T23:39:25.612 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-04-26T23:39:25.612 INFO:teuthology.orchestra.run.smithi175.stdout: python3-ceph-argparse-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T23:39:25.612 INFO:teuthology.orchestra.run.smithi175.stdout: python3-ceph-common-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T23:39:25.613 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cephfs-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T23:39:25.613 INFO:teuthology.orchestra.run.smithi175.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-04-26T23:39:25.613 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-04-26T23:39:25.613 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-04-26T23:39:25.613 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-04-26T23:39:25.613 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-04-26T23:39:25.613 INFO:teuthology.orchestra.run.smithi175.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-04-26T23:39:25.613 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-04-26T23:39:25.613 INFO:teuthology.orchestra.run.smithi175.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-04-26T23:39:25.613 INFO:teuthology.orchestra.run.smithi175.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-04-26T23:39:25.613 INFO:teuthology.orchestra.run.smithi175.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-04-26T23:39:25.613 INFO:teuthology.orchestra.run.smithi175.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-04-26T23:39:25.613 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-04-26T23:39:25.613 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-04-26T23:39:25.613 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-04-26T23:39:25.614 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-04-26T23:39:25.614 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-04-26T23:39:25.614 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-04-26T23:39:25.614 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-04-26T23:39:25.614 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-04-26T23:39:25.614 INFO:teuthology.orchestra.run.smithi175.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-04-26T23:39:25.614 INFO:teuthology.orchestra.run.smithi175.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-04-26T23:39:25.614 INFO:teuthology.orchestra.run.smithi175.stdout: python3-mako-1.1.4-6.el9.noarch 2024-04-26T23:39:25.614 INFO:teuthology.orchestra.run.smithi175.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-04-26T23:39:25.614 INFO:teuthology.orchestra.run.smithi175.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-04-26T23:39:25.614 INFO:teuthology.orchestra.run.smithi175.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-04-26T23:39:25.614 INFO:teuthology.orchestra.run.smithi175.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-04-26T23:39:25.614 INFO:teuthology.orchestra.run.smithi175.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-04-26T23:39:25.615 INFO:teuthology.orchestra.run.smithi175.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-04-26T23:39:25.615 INFO:teuthology.orchestra.run.smithi175.stdout: python3-packaging-20.9-5.el9.noarch 2024-04-26T23:39:25.615 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-04-26T23:39:25.615 INFO:teuthology.orchestra.run.smithi175.stdout: python3-ply-3.11-14.el9.noarch 2024-04-26T23:39:25.615 INFO:teuthology.orchestra.run.smithi175.stdout: python3-portend-3.1.0-2.el9.noarch 2024-04-26T23:39:25.615 INFO:teuthology.orchestra.run.smithi175.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-04-26T23:39:25.615 INFO:teuthology.orchestra.run.smithi175.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-04-26T23:39:25.615 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-04-26T23:39:25.615 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-04-26T23:39:25.615 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-04-26T23:39:25.615 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pycparser-2.20-6.el9.noarch 2024-04-26T23:39:25.615 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-04-26T23:39:25.615 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pytz-2021.1-5.el9.noarch 2024-04-26T23:39:25.615 INFO:teuthology.orchestra.run.smithi175.stdout: python3-rados-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T23:39:25.615 INFO:teuthology.orchestra.run.smithi175.stdout: python3-rbd-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T23:39:25.615 INFO:teuthology.orchestra.run.smithi175.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-04-26T23:39:25.615 INFO:teuthology.orchestra.run.smithi175.stdout: python3-requests-2.25.1-8.el9.noarch 2024-04-26T23:39:25.616 INFO:teuthology.orchestra.run.smithi175.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-04-26T23:39:25.616 INFO:teuthology.orchestra.run.smithi175.stdout: python3-rgw-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T23:39:25.616 INFO:teuthology.orchestra.run.smithi175.stdout: python3-routes-2.5.1-5.el9.noarch 2024-04-26T23:39:25.616 INFO:teuthology.orchestra.run.smithi175.stdout: python3-rsa-4.9-2.el9.noarch 2024-04-26T23:39:25.616 INFO:teuthology.orchestra.run.smithi175.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-04-26T23:39:25.616 INFO:teuthology.orchestra.run.smithi175.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-04-26T23:39:25.616 INFO:teuthology.orchestra.run.smithi175.stdout: python3-toml-0.10.2-6.el9.noarch 2024-04-26T23:39:25.616 INFO:teuthology.orchestra.run.smithi175.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-04-26T23:39:25.616 INFO:teuthology.orchestra.run.smithi175.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-04-26T23:39:25.616 INFO:teuthology.orchestra.run.smithi175.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-04-26T23:39:25.616 INFO:teuthology.orchestra.run.smithi175.stdout: python3-webob-1.8.7-6.el9.noarch 2024-04-26T23:39:25.616 INFO:teuthology.orchestra.run.smithi175.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-04-26T23:39:25.616 INFO:teuthology.orchestra.run.smithi175.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-04-26T23:39:25.616 INFO:teuthology.orchestra.run.smithi175.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-04-26T23:39:25.616 INFO:teuthology.orchestra.run.smithi175.stdout: qatlib-24.02.0-1.el9.x86_64 2024-04-26T23:39:25.616 INFO:teuthology.orchestra.run.smithi175.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-04-26T23:39:25.617 INFO:teuthology.orchestra.run.smithi175.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-04-26T23:39:25.617 INFO:teuthology.orchestra.run.smithi175.stdout: rbd-fuse-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T23:39:25.617 INFO:teuthology.orchestra.run.smithi175.stdout: rbd-mirror-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T23:39:25.617 INFO:teuthology.orchestra.run.smithi175.stdout: rbd-nbd-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T23:39:25.617 INFO:teuthology.orchestra.run.smithi175.stdout: re2-1:20211101-3.el9.x86_64 2024-04-26T23:39:25.617 INFO:teuthology.orchestra.run.smithi175.stdout: socat-1.7.4.1-5.el9.x86_64 2024-04-26T23:39:25.617 INFO:teuthology.orchestra.run.smithi175.stdout: thrift-0.15.0-2.el9.x86_64 2024-04-26T23:39:25.617 INFO:teuthology.orchestra.run.smithi175.stdout: uuid-1.6.2-55.el9.x86_64 2024-04-26T23:39:25.617 INFO:teuthology.orchestra.run.smithi175.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-04-26T23:39:25.617 INFO:teuthology.orchestra.run.smithi175.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-04-26T23:39:25.617 INFO:teuthology.orchestra.run.smithi175.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-04-26T23:39:25.617 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-26T23:39:25.618 INFO:teuthology.orchestra.run.smithi175.stdout:Complete! 2024-04-26T23:39:26.021 DEBUG:teuthology.parallel:result is None 2024-04-26T23:39:28.172 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-26T23:39:28.172 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-2:19.0.0-3306.gbc612ffb.el9.x86_64 1/156 2024-04-26T23:39:28.172 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-base-2:19.0.0-3306.gbc612ffb.el9.x86_64 2/156 2024-04-26T23:39:28.173 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-common-2:19.0.0-3306.gbc612ffb.el9.x86_64 3/156 2024-04-26T23:39:28.173 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-fuse-2:19.0.0-3306.gbc612ffb.el9.x86_64 4/156 2024-04-26T23:39:28.173 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-3306.gbc612 5/156 2024-04-26T23:39:28.173 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-mds-2:19.0.0-3306.gbc612ffb.el9.x86_64 6/156 2024-04-26T23:39:28.173 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-mgr-2:19.0.0-3306.gbc612ffb.el9.x86_64 7/156 2024-04-26T23:39:28.173 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-mon-2:19.0.0-3306.gbc612ffb.el9.x86_64 8/156 2024-04-26T23:39:28.173 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-osd-2:19.0.0-3306.gbc612ffb.el9.x86_64 9/156 2024-04-26T23:39:28.173 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-radosgw-2:19.0.0-3306.gbc612ffb.el9.x86_64 10/156 2024-04-26T23:39:28.173 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-selinux-2:19.0.0-3306.gbc612ffb.el9.x86_64 11/156 2024-04-26T23:39:28.173 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-test-2:19.0.0-3306.gbc612ffb.el9.x86_64 12/156 2024-04-26T23:39:28.173 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : cephfs-mirror-2:19.0.0-3306.gbc612ffb.el9.x86_64 13/156 2024-04-26T23:39:28.173 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : cephfs-shell-2:19.0.0-3306.gbc612ffb.el9.x86_64 14/156 2024-04-26T23:39:28.173 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libcephfs-devel-2:19.0.0-3306.gbc612ffb.el9.x86_ 15/156 2024-04-26T23:39:28.173 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libcephfs2-2:19.0.0-3306.gbc612ffb.el9.x86_64 16/156 2024-04-26T23:39:28.174 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libcephsqlite-2:19.0.0-3306.gbc612ffb.el9.x86_64 17/156 2024-04-26T23:39:28.174 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : librados-devel-2:19.0.0-3306.gbc612ffb.el9.x86_6 18/156 2024-04-26T23:39:28.174 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libradosstriper1-2:19.0.0-3306.gbc612ffb.el9.x86 19/156 2024-04-26T23:39:28.174 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : librgw2-2:19.0.0-3306.gbc612ffb.el9.x86_64 20/156 2024-04-26T23:39:28.174 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-ceph-argparse-2:19.0.0-3306.gbc612ffb.el 21/156 2024-04-26T23:39:28.174 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-ceph-common-2:19.0.0-3306.gbc612ffb.el9. 22/156 2024-04-26T23:39:28.174 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-cephfs-2:19.0.0-3306.gbc612ffb.el9.x86_6 23/156 2024-04-26T23:39:28.174 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-rados-2:19.0.0-3306.gbc612ffb.el9.x86_64 24/156 2024-04-26T23:39:28.174 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-rbd-2:19.0.0-3306.gbc612ffb.el9.x86_64 25/156 2024-04-26T23:39:28.174 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-rgw-2:19.0.0-3306.gbc612ffb.el9.x86_64 26/156 2024-04-26T23:39:28.174 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : rbd-fuse-2:19.0.0-3306.gbc612ffb.el9.x86_64 27/156 2024-04-26T23:39:28.174 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : rbd-mirror-2:19.0.0-3306.gbc612ffb.el9.x86_64 28/156 2024-04-26T23:39:28.174 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : rbd-nbd-2:19.0.0-3306.gbc612ffb.el9.x86_64 29/156 2024-04-26T23:39:28.175 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-3306.gbc612ffb. 30/156 2024-04-26T23:39:28.175 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-3306.gbc612ffb.el9.noa 31/156 2024-04-26T23:39:28.175 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-3306.gbc612ffb.el9.n 32/156 2024-04-26T23:39:28.175 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-3306.gbc6 33/156 2024-04-26T23:39:28.175 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-3306.gbc612ffb.el 34/156 2024-04-26T23:39:28.175 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-mgr-rook-2:19.0.0-3306.gbc612ffb.el9.noarch 35/156 2024-04-26T23:39:28.175 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-3306.gbc612ffb.e 36/156 2024-04-26T23:39:28.175 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-volume-2:19.0.0-3306.gbc612ffb.el9.noarch 37/156 2024-04-26T23:39:28.175 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : cephadm-2:19.0.0-3306.gbc612ffb.el9.noarch 38/156 2024-04-26T23:39:28.175 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : cephfs-top-2:19.0.0-3306.gbc612ffb.el9.noarch 39/156 2024-04-26T23:39:28.175 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/156 2024-04-26T23:39:28.175 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/156 2024-04-26T23:39:28.175 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/156 2024-04-26T23:39:28.175 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/156 2024-04-26T23:39:28.176 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/156 2024-04-26T23:39:28.176 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/156 2024-04-26T23:39:28.176 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/156 2024-04-26T23:39:28.176 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/156 2024-04-26T23:39:28.176 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/156 2024-04-26T23:39:28.176 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/156 2024-04-26T23:39:28.176 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/156 2024-04-26T23:39:28.176 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/156 2024-04-26T23:39:28.176 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 52/156 2024-04-26T23:39:28.176 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/156 2024-04-26T23:39:28.176 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/156 2024-04-26T23:39:28.176 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/156 2024-04-26T23:39:28.176 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/156 2024-04-26T23:39:28.176 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/156 2024-04-26T23:39:28.176 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/156 2024-04-26T23:39:28.177 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/156 2024-04-26T23:39:28.177 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/156 2024-04-26T23:39:28.177 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/156 2024-04-26T23:39:28.177 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/156 2024-04-26T23:39:28.177 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/156 2024-04-26T23:39:28.177 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/156 2024-04-26T23:39:28.177 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/156 2024-04-26T23:39:28.177 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/156 2024-04-26T23:39:28.177 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/156 2024-04-26T23:39:28.177 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 68/156 2024-04-26T23:39:28.177 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/156 2024-04-26T23:39:28.177 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/156 2024-04-26T23:39:28.177 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/156 2024-04-26T23:39:28.177 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/156 2024-04-26T23:39:28.178 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/156 2024-04-26T23:39:28.178 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/156 2024-04-26T23:39:28.178 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/156 2024-04-26T23:39:28.178 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 76/156 2024-04-26T23:39:28.178 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 77/156 2024-04-26T23:39:28.178 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 78/156 2024-04-26T23:39:28.178 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 79/156 2024-04-26T23:39:28.178 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 80/156 2024-04-26T23:39:28.178 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 81/156 2024-04-26T23:39:28.178 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 82/156 2024-04-26T23:39:28.178 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 83/156 2024-04-26T23:39:28.178 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 84/156 2024-04-26T23:39:28.178 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 85/156 2024-04-26T23:39:28.179 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 86/156 2024-04-26T23:39:28.179 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 87/156 2024-04-26T23:39:28.179 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 88/156 2024-04-26T23:39:28.179 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 89/156 2024-04-26T23:39:28.179 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 90/156 2024-04-26T23:39:28.179 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 91/156 2024-04-26T23:39:28.179 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 92/156 2024-04-26T23:39:28.179 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 93/156 2024-04-26T23:39:28.179 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 94/156 2024-04-26T23:39:28.179 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 95/156 2024-04-26T23:39:28.179 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 96/156 2024-04-26T23:39:28.179 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 97/156 2024-04-26T23:39:28.179 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 98/156 2024-04-26T23:39:28.179 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 99/156 2024-04-26T23:39:28.179 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 100/156 2024-04-26T23:39:28.180 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 101/156 2024-04-26T23:39:28.180 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 102/156 2024-04-26T23:39:28.180 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 103/156 2024-04-26T23:39:28.180 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 104/156 2024-04-26T23:39:28.180 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 105/156 2024-04-26T23:39:28.180 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 106/156 2024-04-26T23:39:28.180 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 107/156 2024-04-26T23:39:28.180 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 108/156 2024-04-26T23:39:28.180 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 109/156 2024-04-26T23:39:28.180 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 110/156 2024-04-26T23:39:28.180 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 111/156 2024-04-26T23:39:28.180 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 112/156 2024-04-26T23:39:28.180 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 113/156 2024-04-26T23:39:28.180 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 114/156 2024-04-26T23:39:28.181 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 115/156 2024-04-26T23:39:28.181 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 116/156 2024-04-26T23:39:28.181 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 117/156 2024-04-26T23:39:28.181 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 118/156 2024-04-26T23:39:28.181 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 119/156 2024-04-26T23:39:28.181 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 120/156 2024-04-26T23:39:28.181 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 121/156 2024-04-26T23:39:28.181 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 122/156 2024-04-26T23:39:28.181 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/156 2024-04-26T23:39:28.181 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/156 2024-04-26T23:39:28.181 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/156 2024-04-26T23:39:28.181 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/156 2024-04-26T23:39:28.181 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/156 2024-04-26T23:39:28.182 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/156 2024-04-26T23:39:28.182 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/156 2024-04-26T23:39:28.182 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/156 2024-04-26T23:39:28.182 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/156 2024-04-26T23:39:28.182 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/156 2024-04-26T23:39:28.182 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/156 2024-04-26T23:39:28.182 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/156 2024-04-26T23:39:28.182 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/156 2024-04-26T23:39:28.182 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/156 2024-04-26T23:39:28.182 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/156 2024-04-26T23:39:28.182 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/156 2024-04-26T23:39:28.182 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/156 2024-04-26T23:39:28.182 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/156 2024-04-26T23:39:28.183 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/156 2024-04-26T23:39:28.183 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/156 2024-04-26T23:39:28.183 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/156 2024-04-26T23:39:28.183 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/156 2024-04-26T23:39:28.183 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/156 2024-04-26T23:39:28.183 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/156 2024-04-26T23:39:28.183 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/156 2024-04-26T23:39:28.183 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/156 2024-04-26T23:39:28.183 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : librados2-2:19.0.0-3306.gbc612ffb.el9.x86_64 149/156 2024-04-26T23:39:28.183 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/156 2024-04-26T23:39:28.183 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : librbd1-2:19.0.0-3306.gbc612ffb.el9.x86_64 151/156 2024-04-26T23:39:28.183 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/156 2024-04-26T23:39:28.183 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 153/156 2024-04-26T23:39:28.183 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 154/156 2024-04-26T23:39:28.183 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 155/156 2024-04-26T23:39:30.319 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-26T23:39:30.319 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-26T23:39:30.320 INFO:teuthology.orchestra.run.smithi088.stdout:Upgraded: 2024-04-26T23:39:30.320 INFO:teuthology.orchestra.run.smithi088.stdout: librados2-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T23:39:30.320 INFO:teuthology.orchestra.run.smithi088.stdout: librbd1-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T23:39:30.320 INFO:teuthology.orchestra.run.smithi088.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-04-26T23:39:30.320 INFO:teuthology.orchestra.run.smithi088.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-04-26T23:39:30.320 INFO:teuthology.orchestra.run.smithi088.stdout:Installed: 2024-04-26T23:39:30.320 INFO:teuthology.orchestra.run.smithi088.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-04-26T23:39:30.320 INFO:teuthology.orchestra.run.smithi088.stdout: automake-1.16.2-8.el9.noarch 2024-04-26T23:39:30.320 INFO:teuthology.orchestra.run.smithi088.stdout: bison-3.7.4-5.el9.x86_64 2024-04-26T23:39:30.320 INFO:teuthology.orchestra.run.smithi088.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-04-26T23:39:30.320 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T23:39:30.320 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-base-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T23:39:30.320 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-common-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T23:39:30.320 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-fuse-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T23:39:30.321 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-grafana-dashboards-2:19.0.0-3306.gbc612ffb.el9.noarch 2024-04-26T23:39:30.321 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-immutable-object-cache-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T23:39:30.321 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mds-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T23:39:30.321 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mgr-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T23:39:30.321 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mgr-cephadm-2:19.0.0-3306.gbc612ffb.el9.noarch 2024-04-26T23:39:30.321 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mgr-dashboard-2:19.0.0-3306.gbc612ffb.el9.noarch 2024-04-26T23:39:30.321 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mgr-diskprediction-local-2:19.0.0-3306.gbc612ffb.el9.noarch 2024-04-26T23:39:30.321 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mgr-modules-core-2:19.0.0-3306.gbc612ffb.el9.noarch 2024-04-26T23:39:30.321 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mgr-rook-2:19.0.0-3306.gbc612ffb.el9.noarch 2024-04-26T23:39:30.321 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mon-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T23:39:30.321 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-osd-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T23:39:30.321 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-prometheus-alerts-2:19.0.0-3306.gbc612ffb.el9.noarch 2024-04-26T23:39:30.321 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-radosgw-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T23:39:30.321 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-selinux-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T23:39:30.322 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-test-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T23:39:30.322 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-volume-2:19.0.0-3306.gbc612ffb.el9.noarch 2024-04-26T23:39:30.322 INFO:teuthology.orchestra.run.smithi088.stdout: cephadm-2:19.0.0-3306.gbc612ffb.el9.noarch 2024-04-26T23:39:30.322 INFO:teuthology.orchestra.run.smithi088.stdout: cephfs-mirror-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T23:39:30.322 INFO:teuthology.orchestra.run.smithi088.stdout: cephfs-shell-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T23:39:30.322 INFO:teuthology.orchestra.run.smithi088.stdout: cephfs-top-2:19.0.0-3306.gbc612ffb.el9.noarch 2024-04-26T23:39:30.322 INFO:teuthology.orchestra.run.smithi088.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-04-26T23:39:30.322 INFO:teuthology.orchestra.run.smithi088.stdout: flex-2.6.4-9.el9.x86_64 2024-04-26T23:39:30.322 INFO:teuthology.orchestra.run.smithi088.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-04-26T23:39:30.322 INFO:teuthology.orchestra.run.smithi088.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-04-26T23:39:30.322 INFO:teuthology.orchestra.run.smithi088.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-04-26T23:39:30.322 INFO:teuthology.orchestra.run.smithi088.stdout: fuse-2.9.9-15.el9.x86_64 2024-04-26T23:39:30.322 INFO:teuthology.orchestra.run.smithi088.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-04-26T23:39:30.322 INFO:teuthology.orchestra.run.smithi088.stdout: grpc-data-1.46.7-10.el9.noarch 2024-04-26T23:39:30.323 INFO:teuthology.orchestra.run.smithi088.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-04-26T23:39:30.323 INFO:teuthology.orchestra.run.smithi088.stdout: libarrow-9.0.0-11.el9.x86_64 2024-04-26T23:39:30.323 INFO:teuthology.orchestra.run.smithi088.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-04-26T23:39:30.323 INFO:teuthology.orchestra.run.smithi088.stdout: libcephfs-devel-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T23:39:30.323 INFO:teuthology.orchestra.run.smithi088.stdout: libcephfs2-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T23:39:30.323 INFO:teuthology.orchestra.run.smithi088.stdout: libcephsqlite-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T23:39:30.323 INFO:teuthology.orchestra.run.smithi088.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-04-26T23:39:30.323 INFO:teuthology.orchestra.run.smithi088.stdout: liboath-2.6.7-2.el9.x86_64 2024-04-26T23:39:30.323 INFO:teuthology.orchestra.run.smithi088.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-04-26T23:39:30.323 INFO:teuthology.orchestra.run.smithi088.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-04-26T23:39:30.323 INFO:teuthology.orchestra.run.smithi088.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-04-26T23:39:30.323 INFO:teuthology.orchestra.run.smithi088.stdout: librados-devel-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T23:39:30.324 INFO:teuthology.orchestra.run.smithi088.stdout: libradosstriper1-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T23:39:30.324 INFO:teuthology.orchestra.run.smithi088.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-04-26T23:39:30.324 INFO:teuthology.orchestra.run.smithi088.stdout: librgw2-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T23:39:30.324 INFO:teuthology.orchestra.run.smithi088.stdout: libtool-2.4.6-45.el9.x86_64 2024-04-26T23:39:30.324 INFO:teuthology.orchestra.run.smithi088.stdout: libunwind-1.6.2-1.el9.x86_64 2024-04-26T23:39:30.324 INFO:teuthology.orchestra.run.smithi088.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-04-26T23:39:30.324 INFO:teuthology.orchestra.run.smithi088.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-04-26T23:39:30.324 INFO:teuthology.orchestra.run.smithi088.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-04-26T23:39:30.324 INFO:teuthology.orchestra.run.smithi088.stdout: lua-5.4.4-4.el9.x86_64 2024-04-26T23:39:30.324 INFO:teuthology.orchestra.run.smithi088.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-04-26T23:39:30.324 INFO:teuthology.orchestra.run.smithi088.stdout: luarocks-3.9.2-1.el9.noarch 2024-04-26T23:39:30.325 INFO:teuthology.orchestra.run.smithi088.stdout: openblas-0.3.21-2.el9.x86_64 2024-04-26T23:39:30.325 INFO:teuthology.orchestra.run.smithi088.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-04-26T23:39:30.325 INFO:teuthology.orchestra.run.smithi088.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-04-26T23:39:30.325 INFO:teuthology.orchestra.run.smithi088.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-04-26T23:39:30.325 INFO:teuthology.orchestra.run.smithi088.stdout: postgresql-13.14-1.el9.x86_64 2024-04-26T23:39:30.325 INFO:teuthology.orchestra.run.smithi088.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-04-26T23:39:30.325 INFO:teuthology.orchestra.run.smithi088.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-04-26T23:39:30.325 INFO:teuthology.orchestra.run.smithi088.stdout: postgresql-server-13.14-1.el9.x86_64 2024-04-26T23:39:30.325 INFO:teuthology.orchestra.run.smithi088.stdout: protobuf-3.14.0-13.el9.x86_64 2024-04-26T23:39:30.325 INFO:teuthology.orchestra.run.smithi088.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-04-26T23:39:30.325 INFO:teuthology.orchestra.run.smithi088.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-04-26T23:39:30.325 INFO:teuthology.orchestra.run.smithi088.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-04-26T23:39:30.325 INFO:teuthology.orchestra.run.smithi088.stdout: python3-babel-2.9.1-2.el9.noarch 2024-04-26T23:39:30.325 INFO:teuthology.orchestra.run.smithi088.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-04-26T23:39:30.326 INFO:teuthology.orchestra.run.smithi088.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-04-26T23:39:30.326 INFO:teuthology.orchestra.run.smithi088.stdout: python3-ceph-argparse-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T23:39:30.326 INFO:teuthology.orchestra.run.smithi088.stdout: python3-ceph-common-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T23:39:30.326 INFO:teuthology.orchestra.run.smithi088.stdout: python3-cephfs-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T23:39:30.326 INFO:teuthology.orchestra.run.smithi088.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-04-26T23:39:30.326 INFO:teuthology.orchestra.run.smithi088.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-04-26T23:39:30.326 INFO:teuthology.orchestra.run.smithi088.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-04-26T23:39:30.326 INFO:teuthology.orchestra.run.smithi088.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-04-26T23:39:30.326 INFO:teuthology.orchestra.run.smithi088.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-04-26T23:39:30.326 INFO:teuthology.orchestra.run.smithi088.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-04-26T23:39:30.326 INFO:teuthology.orchestra.run.smithi088.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-04-26T23:39:30.326 INFO:teuthology.orchestra.run.smithi088.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-04-26T23:39:30.326 INFO:teuthology.orchestra.run.smithi088.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-04-26T23:39:30.326 INFO:teuthology.orchestra.run.smithi088.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-04-26T23:39:30.327 INFO:teuthology.orchestra.run.smithi088.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-04-26T23:39:30.327 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-04-26T23:39:30.327 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-04-26T23:39:30.327 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-04-26T23:39:30.327 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-04-26T23:39:30.327 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-04-26T23:39:30.327 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-04-26T23:39:30.327 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-04-26T23:39:30.327 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-04-26T23:39:30.327 INFO:teuthology.orchestra.run.smithi088.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-04-26T23:39:30.327 INFO:teuthology.orchestra.run.smithi088.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-04-26T23:39:30.327 INFO:teuthology.orchestra.run.smithi088.stdout: python3-mako-1.1.4-6.el9.noarch 2024-04-26T23:39:30.327 INFO:teuthology.orchestra.run.smithi088.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-04-26T23:39:30.327 INFO:teuthology.orchestra.run.smithi088.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-04-26T23:39:30.327 INFO:teuthology.orchestra.run.smithi088.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-04-26T23:39:30.327 INFO:teuthology.orchestra.run.smithi088.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-04-26T23:39:30.328 INFO:teuthology.orchestra.run.smithi088.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-04-26T23:39:30.328 INFO:teuthology.orchestra.run.smithi088.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-04-26T23:39:30.328 INFO:teuthology.orchestra.run.smithi088.stdout: python3-packaging-20.9-5.el9.noarch 2024-04-26T23:39:30.328 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-04-26T23:39:30.328 INFO:teuthology.orchestra.run.smithi088.stdout: python3-ply-3.11-14.el9.noarch 2024-04-26T23:39:30.328 INFO:teuthology.orchestra.run.smithi088.stdout: python3-portend-3.1.0-2.el9.noarch 2024-04-26T23:39:30.328 INFO:teuthology.orchestra.run.smithi088.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-04-26T23:39:30.328 INFO:teuthology.orchestra.run.smithi088.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-04-26T23:39:30.328 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-04-26T23:39:30.328 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-04-26T23:39:30.328 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-04-26T23:39:30.328 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pycparser-2.20-6.el9.noarch 2024-04-26T23:39:30.328 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-04-26T23:39:30.328 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pytz-2021.1-5.el9.noarch 2024-04-26T23:39:30.328 INFO:teuthology.orchestra.run.smithi088.stdout: python3-rados-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T23:39:30.329 INFO:teuthology.orchestra.run.smithi088.stdout: python3-rbd-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T23:39:30.329 INFO:teuthology.orchestra.run.smithi088.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-04-26T23:39:30.329 INFO:teuthology.orchestra.run.smithi088.stdout: python3-requests-2.25.1-8.el9.noarch 2024-04-26T23:39:30.329 INFO:teuthology.orchestra.run.smithi088.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-04-26T23:39:30.329 INFO:teuthology.orchestra.run.smithi088.stdout: python3-rgw-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T23:39:30.329 INFO:teuthology.orchestra.run.smithi088.stdout: python3-routes-2.5.1-5.el9.noarch 2024-04-26T23:39:30.329 INFO:teuthology.orchestra.run.smithi088.stdout: python3-rsa-4.9-2.el9.noarch 2024-04-26T23:39:30.329 INFO:teuthology.orchestra.run.smithi088.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-04-26T23:39:30.329 INFO:teuthology.orchestra.run.smithi088.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-04-26T23:39:30.329 INFO:teuthology.orchestra.run.smithi088.stdout: python3-toml-0.10.2-6.el9.noarch 2024-04-26T23:39:30.329 INFO:teuthology.orchestra.run.smithi088.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-04-26T23:39:30.329 INFO:teuthology.orchestra.run.smithi088.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-04-26T23:39:30.329 INFO:teuthology.orchestra.run.smithi088.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-04-26T23:39:30.329 INFO:teuthology.orchestra.run.smithi088.stdout: python3-webob-1.8.7-6.el9.noarch 2024-04-26T23:39:30.330 INFO:teuthology.orchestra.run.smithi088.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-04-26T23:39:30.330 INFO:teuthology.orchestra.run.smithi088.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-04-26T23:39:30.330 INFO:teuthology.orchestra.run.smithi088.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-04-26T23:39:30.330 INFO:teuthology.orchestra.run.smithi088.stdout: qatlib-24.02.0-1.el9.x86_64 2024-04-26T23:39:30.330 INFO:teuthology.orchestra.run.smithi088.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-04-26T23:39:30.330 INFO:teuthology.orchestra.run.smithi088.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-04-26T23:39:30.330 INFO:teuthology.orchestra.run.smithi088.stdout: rbd-fuse-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T23:39:30.330 INFO:teuthology.orchestra.run.smithi088.stdout: rbd-mirror-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T23:39:30.330 INFO:teuthology.orchestra.run.smithi088.stdout: rbd-nbd-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T23:39:30.330 INFO:teuthology.orchestra.run.smithi088.stdout: re2-1:20211101-3.el9.x86_64 2024-04-26T23:39:30.330 INFO:teuthology.orchestra.run.smithi088.stdout: socat-1.7.4.1-5.el9.x86_64 2024-04-26T23:39:30.330 INFO:teuthology.orchestra.run.smithi088.stdout: thrift-0.15.0-2.el9.x86_64 2024-04-26T23:39:30.330 INFO:teuthology.orchestra.run.smithi088.stdout: uuid-1.6.2-55.el9.x86_64 2024-04-26T23:39:30.330 INFO:teuthology.orchestra.run.smithi088.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-04-26T23:39:30.330 INFO:teuthology.orchestra.run.smithi088.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-04-26T23:39:30.331 INFO:teuthology.orchestra.run.smithi088.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-04-26T23:39:30.331 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-26T23:39:30.331 INFO:teuthology.orchestra.run.smithi088.stdout:Complete! 2024-04-26T23:39:30.688 DEBUG:teuthology.parallel:result is None 2024-04-26T23:39:30.689 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=bc612ffb9c1d5bc27536bc917a705262a36d4387 2024-04-26T23:39:30.923 DEBUG:teuthology.orchestra.run.smithi088:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-26T23:39:30.944 INFO:teuthology.orchestra.run.smithi088.stdout:19.0.0-3306.gbc612ffb.el9 2024-04-26T23:39:30.945 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3306.gbc612ffb.el9 2024-04-26T23:39:30.945 INFO:teuthology.task.install:The correct ceph version 19.0.0-3306.gbc612ffb is installed. 2024-04-26T23:39:30.947 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=bc612ffb9c1d5bc27536bc917a705262a36d4387 2024-04-26T23:39:31.218 DEBUG:teuthology.orchestra.run.smithi175:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-26T23:39:31.243 INFO:teuthology.orchestra.run.smithi175.stdout:19.0.0-3306.gbc612ffb.el9 2024-04-26T23:39:31.244 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3306.gbc612ffb.el9 2024-04-26T23:39:31.244 INFO:teuthology.task.install:The correct ceph version 19.0.0-3306.gbc612ffb is installed. 2024-04-26T23:39:31.245 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-04-26T23:39:31.246 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-04-26T23:39:31.246 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-26T23:39:31.271 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-26T23:39:31.271 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-26T23:39:31.313 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-04-26T23:39:31.313 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-04-26T23:39:31.313 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd of=/usr/bin/daemon-helper 2024-04-26T23:39:31.337 DEBUG:teuthology.orchestra.run.smithi088:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-26T23:39:31.402 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-26T23:39:31.402 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd of=/usr/bin/daemon-helper 2024-04-26T23:39:31.428 DEBUG:teuthology.orchestra.run.smithi175:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-26T23:39:31.495 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-04-26T23:39:31.495 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-04-26T23:39:31.495 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-26T23:39:31.518 DEBUG:teuthology.orchestra.run.smithi088:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-26T23:39:31.582 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-26T23:39:31.582 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-26T23:39:31.608 DEBUG:teuthology.orchestra.run.smithi175:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-26T23:39:31.672 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-04-26T23:39:31.673 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-04-26T23:39:31.673 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd of=/usr/bin/stdin-killer 2024-04-26T23:39:31.698 DEBUG:teuthology.orchestra.run.smithi088:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-26T23:39:31.761 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-26T23:39:31.761 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd of=/usr/bin/stdin-killer 2024-04-26T23:39:31.786 DEBUG:teuthology.orchestra.run.smithi175:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-26T23:39:31.851 INFO:teuthology.run_tasks:Running task ceph... 2024-04-26T23:39:31.931 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-04-26T23:39:31.931 DEBUG:teuthology.orchestra.run.smithi088:> sudo chmod 777 /var/log/ceph 2024-04-26T23:39:31.933 DEBUG:teuthology.orchestra.run.smithi175:> sudo chmod 777 /var/log/ceph 2024-04-26T23:39:31.957 INFO:tasks.ceph:Disabling ceph logrotate... 2024-04-26T23:39:31.957 DEBUG:teuthology.orchestra.run.smithi088:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-26T23:39:31.998 DEBUG:teuthology.orchestra.run.smithi175:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-26T23:39:32.021 INFO:tasks.ceph:Creating extra log directories... 2024-04-26T23:39:32.021 DEBUG:teuthology.orchestra.run.smithi088:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-26T23:39:32.060 DEBUG:teuthology.orchestra.run.smithi175:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-26T23:39:32.091 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-04-26T23:39:32.092 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-04-26T23:39:32.092 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-04-26T23:39:32.092 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-04-26T23:39:32.092 DEBUG:teuthology.orchestra.run.smithi088:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-04-26T23:39:32.137 DEBUG:teuthology.orchestra.run.smithi088:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-04-26T23:39:32.245 DEBUG:teuthology.orchestra.run.smithi088:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-04-26T23:39:32.270 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-26T23:39:32.271 DEBUG:teuthology.orchestra.run.smithi175:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-04-26T23:39:32.286 DEBUG:teuthology.orchestra.run.smithi175:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-04-26T23:39:32.393 DEBUG:teuthology.orchestra.run.smithi175:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-04-26T23:39:32.439 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-04-26T23:39:32.439 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'client_shutdown_timeout': 120, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'filestore flush min': 0, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'overall HEALTH_', '\\(MON_DOWN\\)', 'SLOW_OPS', 'slow request'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-04-26T23:39:32.439 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675323', 'branch': 'wip-rishabh-testing-20240426.111959', 'description': 'fs/thrash/multifs/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-2c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} msgr-failures/none objectstore/bluestore-bitmap overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down multifs pg_health session_timeout thrashosds-health} tasks/{1-thrash/mon 2-workunit/ffsb}}', 'email': None, 'first_in_suite': False, 'job_id': '7675323', 'kernel': {'client': {'sha1': 'distro'}, 'flavor': 'default', 'kdb': True, 'sha1': '806ec36b21129f113ce356c007dd59694d340b37'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'mgrmodules': {'sequential': [{'print': 'Enabling mgr modules'}]}, 'name': 'rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-rishabh-testing-20240426.111959'}, 'ceph': {'cephfs': {'fs': [{'name': 'a'}, {'name': 'b'}], 'session_timeout': 300}, 'conf': {'client': {'client mount timeout': 600, 'client_shutdown_timeout': 120, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'filestore flush min': 0, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'overall HEALTH_', '\\(MON_DOWN\\)', 'SLOW_OPS', 'slow request'], 'sha1': 'bc612ffb9c1d5bc27536bc917a705262a36d4387'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'ceph-fuse': {'client.0': {'cephfs_name': 'a'}, 'client.1': {'cephfs_name': 'b'}}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'bc612ffb9c1d5bc27536bc917a705262a36d4387'}}, 'kclient': {'client.0': {'cephfs_name': 'a'}, 'client.1': {'cephfs_name': 'b'}, 'syntax': 'v2'}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-rishabh-testing-20240426.111959', 'sha1': 'bc612ffb9c1d5bc27536bc917a705262a36d4387'}}, 'owner': 'scheduled_rishabh@teuthology', 'priority': 50, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1']], 'seed': 816, 'sha1': 'bc612ffb9c1d5bc27536bc917a705262a36d4387', 'sleep_before_teardown': 0, 'subset': '166/512', 'suite': 'fs', 'suite_branch': 'wip-rishabh-testing-20240426.111959', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_bc612ffb9c1d5bc27536bc917a705262a36d4387/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': 'bc612ffb9c1d5bc27536bc917a705262a36d4387', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi088.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPmYMML+KEyJouHdBaKX7ErH7IRDfOFbbAQFXpqmTBRNEQJnWrMFBWAeKwO2oNw3V+BMrptb+6vF9os7fUngBd0=', 'smithi175.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBpuf989vQr0xZ8KOg5DiIN4+bFT8bAH9ODwFUb3qpvthwcyrULyXnmFnS0IVWttXHu2QaFI+bog7v2wNgr7/3E='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'sha1': 'distro'}, 'flavor': 'default', 'kdb': True, 'sha1': '806ec36b21129f113ce356c007dd59694d340b37'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'bc612ffb9c1d5bc27536bc917a705262a36d4387'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'fs': [{'name': 'a'}, {'name': 'b'}], 'session_timeout': 300}, 'conf': {'client': {'client mount timeout': 600, 'client_shutdown_timeout': 120, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'filestore flush min': 0, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'overall HEALTH_', '\\(MON_DOWN\\)', 'SLOW_OPS', 'slow request'], 'sha1': 'bc612ffb9c1d5bc27536bc917a705262a36d4387', 'cluster': 'ceph'}}, {'sequential': ['mgrmodules']}, {'kclient': None}, {'mon_thrash': {'check_mds_failover': True, 'revive_delay': 20, 'thrash_delay': 10}}, {'workunit': {'clients': {'all': ['suites/ffsb.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17', 'timestamp': '2024-04-26_19:30:57', 'tube': 'smithi', 'user': 'rishabh', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-04-26T23:39:32.440 DEBUG:teuthology.orchestra.run.smithi088:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-26T23:39:32.442 DEBUG:teuthology.orchestra.run.smithi175:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-26T23:39:32.489 DEBUG:teuthology.orchestra.run.smithi088:> sudo install -d -m0777 -- /var/run/ceph 2024-04-26T23:39:32.497 DEBUG:teuthology.orchestra.run.smithi175:> sudo install -d -m0777 -- /var/run/ceph 2024-04-26T23:39:32.552 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-04-26T23:39:32.552 DEBUG:teuthology.orchestra.run.smithi088:> dd if=/scratch_devs of=/dev/stdout 2024-04-26T23:39:32.573 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-26T23:39:32.573 DEBUG:teuthology.orchestra.run.smithi088:> stat /dev/vg_nvme/lv_1 2024-04-26T23:39:32.628 INFO:teuthology.orchestra.run.smithi088.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-26T23:39:32.628 INFO:teuthology.orchestra.run.smithi088.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T23:39:32.628 INFO:teuthology.orchestra.run.smithi088.stdout:Device: 5h/5d Inode: 664 Links: 1 2024-04-26T23:39:32.628 INFO:teuthology.orchestra.run.smithi088.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T23:39:32.628 INFO:teuthology.orchestra.run.smithi088.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T23:39:32.628 INFO:teuthology.orchestra.run.smithi088.stdout:Access: 2024-04-26 23:39:22.651479707 +0000 2024-04-26T23:39:32.628 INFO:teuthology.orchestra.run.smithi088.stdout:Modify: 2024-04-26 23:37:33.705577927 +0000 2024-04-26T23:39:32.628 INFO:teuthology.orchestra.run.smithi088.stdout:Change: 2024-04-26 23:37:33.705577927 +0000 2024-04-26T23:39:32.628 INFO:teuthology.orchestra.run.smithi088.stdout: Birth: 2024-04-26 23:37:33.705577927 +0000 2024-04-26T23:39:32.629 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-26T23:39:32.691 INFO:teuthology.orchestra.run.smithi088.stderr:1+0 records in 2024-04-26T23:39:32.691 INFO:teuthology.orchestra.run.smithi088.stderr:1+0 records out 2024-04-26T23:39:32.691 INFO:teuthology.orchestra.run.smithi088.stderr:512 bytes copied, 0.000208635 s, 2.5 MB/s 2024-04-26T23:39:32.692 DEBUG:teuthology.orchestra.run.smithi088:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-26T23:39:32.748 DEBUG:teuthology.orchestra.run.smithi088:> stat /dev/vg_nvme/lv_2 2024-04-26T23:39:32.803 INFO:teuthology.orchestra.run.smithi088.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-26T23:39:32.803 INFO:teuthology.orchestra.run.smithi088.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T23:39:32.803 INFO:teuthology.orchestra.run.smithi088.stdout:Device: 5h/5d Inode: 683 Links: 1 2024-04-26T23:39:32.804 INFO:teuthology.orchestra.run.smithi088.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T23:39:32.804 INFO:teuthology.orchestra.run.smithi088.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T23:39:32.804 INFO:teuthology.orchestra.run.smithi088.stdout:Access: 2024-04-26 23:39:22.651479707 +0000 2024-04-26T23:39:32.804 INFO:teuthology.orchestra.run.smithi088.stdout:Modify: 2024-04-26 23:37:34.053569998 +0000 2024-04-26T23:39:32.804 INFO:teuthology.orchestra.run.smithi088.stdout:Change: 2024-04-26 23:37:34.053569998 +0000 2024-04-26T23:39:32.804 INFO:teuthology.orchestra.run.smithi088.stdout: Birth: 2024-04-26 23:37:34.053569998 +0000 2024-04-26T23:39:32.804 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-26T23:39:32.865 INFO:teuthology.orchestra.run.smithi088.stderr:1+0 records in 2024-04-26T23:39:32.865 INFO:teuthology.orchestra.run.smithi088.stderr:1+0 records out 2024-04-26T23:39:32.865 INFO:teuthology.orchestra.run.smithi088.stderr:512 bytes copied, 0.000185303 s, 2.8 MB/s 2024-04-26T23:39:32.867 DEBUG:teuthology.orchestra.run.smithi088:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-26T23:39:32.922 DEBUG:teuthology.orchestra.run.smithi088:> stat /dev/vg_nvme/lv_3 2024-04-26T23:39:32.977 INFO:teuthology.orchestra.run.smithi088.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-26T23:39:32.977 INFO:teuthology.orchestra.run.smithi088.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T23:39:32.977 INFO:teuthology.orchestra.run.smithi088.stdout:Device: 5h/5d Inode: 705 Links: 1 2024-04-26T23:39:32.977 INFO:teuthology.orchestra.run.smithi088.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T23:39:32.977 INFO:teuthology.orchestra.run.smithi088.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T23:39:32.977 INFO:teuthology.orchestra.run.smithi088.stdout:Access: 2024-04-26 23:39:22.652479687 +0000 2024-04-26T23:39:32.977 INFO:teuthology.orchestra.run.smithi088.stdout:Modify: 2024-04-26 23:37:34.396562183 +0000 2024-04-26T23:39:32.977 INFO:teuthology.orchestra.run.smithi088.stdout:Change: 2024-04-26 23:37:34.396562183 +0000 2024-04-26T23:39:32.977 INFO:teuthology.orchestra.run.smithi088.stdout: Birth: 2024-04-26 23:37:34.396562183 +0000 2024-04-26T23:39:32.978 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-26T23:39:33.038 INFO:teuthology.orchestra.run.smithi088.stderr:1+0 records in 2024-04-26T23:39:33.038 INFO:teuthology.orchestra.run.smithi088.stderr:1+0 records out 2024-04-26T23:39:33.038 INFO:teuthology.orchestra.run.smithi088.stderr:512 bytes copied, 0.000191248 s, 2.7 MB/s 2024-04-26T23:39:33.039 DEBUG:teuthology.orchestra.run.smithi088:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-26T23:39:33.095 DEBUG:teuthology.orchestra.run.smithi088:> stat /dev/vg_nvme/lv_4 2024-04-26T23:39:33.149 INFO:teuthology.orchestra.run.smithi088.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-26T23:39:33.149 INFO:teuthology.orchestra.run.smithi088.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T23:39:33.149 INFO:teuthology.orchestra.run.smithi088.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-04-26T23:39:33.150 INFO:teuthology.orchestra.run.smithi088.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T23:39:33.150 INFO:teuthology.orchestra.run.smithi088.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T23:39:33.150 INFO:teuthology.orchestra.run.smithi088.stdout:Access: 2024-04-26 23:39:22.652479687 +0000 2024-04-26T23:39:33.150 INFO:teuthology.orchestra.run.smithi088.stdout:Modify: 2024-04-26 23:37:34.733554504 +0000 2024-04-26T23:39:33.150 INFO:teuthology.orchestra.run.smithi088.stdout:Change: 2024-04-26 23:37:34.733554504 +0000 2024-04-26T23:39:33.150 INFO:teuthology.orchestra.run.smithi088.stdout: Birth: 2024-04-26 23:37:34.733554504 +0000 2024-04-26T23:39:33.150 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-26T23:39:33.211 INFO:teuthology.orchestra.run.smithi088.stderr:1+0 records in 2024-04-26T23:39:33.211 INFO:teuthology.orchestra.run.smithi088.stderr:1+0 records out 2024-04-26T23:39:33.211 INFO:teuthology.orchestra.run.smithi088.stderr:512 bytes copied, 0.000176894 s, 2.9 MB/s 2024-04-26T23:39:33.213 DEBUG:teuthology.orchestra.run.smithi088:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-26T23:39:33.268 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-26T23:39:33.269 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-26T23:39:33.269 DEBUG:teuthology.orchestra.run.smithi175:> dd if=/scratch_devs of=/dev/stdout 2024-04-26T23:39:33.286 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-26T23:39:33.287 DEBUG:teuthology.orchestra.run.smithi175:> stat /dev/vg_nvme/lv_1 2024-04-26T23:39:33.344 INFO:teuthology.orchestra.run.smithi175.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-26T23:39:33.344 INFO:teuthology.orchestra.run.smithi175.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T23:39:33.344 INFO:teuthology.orchestra.run.smithi175.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-04-26T23:39:33.344 INFO:teuthology.orchestra.run.smithi175.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T23:39:33.344 INFO:teuthology.orchestra.run.smithi175.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T23:39:33.344 INFO:teuthology.orchestra.run.smithi175.stdout:Access: 2024-04-26 23:39:18.165207083 +0000 2024-04-26T23:39:33.344 INFO:teuthology.orchestra.run.smithi175.stdout:Modify: 2024-04-26 23:37:37.465169074 +0000 2024-04-26T23:39:33.344 INFO:teuthology.orchestra.run.smithi175.stdout:Change: 2024-04-26 23:37:37.465169074 +0000 2024-04-26T23:39:33.344 INFO:teuthology.orchestra.run.smithi175.stdout: Birth: 2024-04-26 23:37:37.465169074 +0000 2024-04-26T23:39:33.345 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-26T23:39:33.409 INFO:teuthology.orchestra.run.smithi175.stderr:1+0 records in 2024-04-26T23:39:33.409 INFO:teuthology.orchestra.run.smithi175.stderr:1+0 records out 2024-04-26T23:39:33.409 INFO:teuthology.orchestra.run.smithi175.stderr:512 bytes copied, 0.000250155 s, 2.0 MB/s 2024-04-26T23:39:33.410 DEBUG:teuthology.orchestra.run.smithi175:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-26T23:39:33.468 DEBUG:teuthology.orchestra.run.smithi175:> stat /dev/vg_nvme/lv_2 2024-04-26T23:39:33.524 INFO:teuthology.orchestra.run.smithi175.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-26T23:39:33.524 INFO:teuthology.orchestra.run.smithi175.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T23:39:33.524 INFO:teuthology.orchestra.run.smithi175.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-04-26T23:39:33.524 INFO:teuthology.orchestra.run.smithi175.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T23:39:33.524 INFO:teuthology.orchestra.run.smithi175.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T23:39:33.524 INFO:teuthology.orchestra.run.smithi175.stdout:Access: 2024-04-26 23:39:18.166207068 +0000 2024-04-26T23:39:33.524 INFO:teuthology.orchestra.run.smithi175.stdout:Modify: 2024-04-26 23:37:37.812163158 +0000 2024-04-26T23:39:33.524 INFO:teuthology.orchestra.run.smithi175.stdout:Change: 2024-04-26 23:37:37.812163158 +0000 2024-04-26T23:39:33.524 INFO:teuthology.orchestra.run.smithi175.stdout: Birth: 2024-04-26 23:37:37.812163158 +0000 2024-04-26T23:39:33.524 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-26T23:39:33.587 INFO:teuthology.orchestra.run.smithi175.stderr:1+0 records in 2024-04-26T23:39:33.588 INFO:teuthology.orchestra.run.smithi175.stderr:1+0 records out 2024-04-26T23:39:33.588 INFO:teuthology.orchestra.run.smithi175.stderr:512 bytes copied, 0.000203297 s, 2.5 MB/s 2024-04-26T23:39:33.589 DEBUG:teuthology.orchestra.run.smithi175:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-26T23:39:33.645 DEBUG:teuthology.orchestra.run.smithi175:> stat /dev/vg_nvme/lv_3 2024-04-26T23:39:33.701 INFO:teuthology.orchestra.run.smithi175.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-26T23:39:33.701 INFO:teuthology.orchestra.run.smithi175.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T23:39:33.701 INFO:teuthology.orchestra.run.smithi175.stdout:Device: 5h/5d Inode: 705 Links: 1 2024-04-26T23:39:33.701 INFO:teuthology.orchestra.run.smithi175.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T23:39:33.701 INFO:teuthology.orchestra.run.smithi175.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T23:39:33.701 INFO:teuthology.orchestra.run.smithi175.stdout:Access: 2024-04-26 23:39:18.166207068 +0000 2024-04-26T23:39:33.701 INFO:teuthology.orchestra.run.smithi175.stdout:Modify: 2024-04-26 23:37:38.150157396 +0000 2024-04-26T23:39:33.701 INFO:teuthology.orchestra.run.smithi175.stdout:Change: 2024-04-26 23:37:38.150157396 +0000 2024-04-26T23:39:33.701 INFO:teuthology.orchestra.run.smithi175.stdout: Birth: 2024-04-26 23:37:38.150157396 +0000 2024-04-26T23:39:33.702 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-26T23:39:33.764 INFO:teuthology.orchestra.run.smithi175.stderr:1+0 records in 2024-04-26T23:39:33.764 INFO:teuthology.orchestra.run.smithi175.stderr:1+0 records out 2024-04-26T23:39:33.764 INFO:teuthology.orchestra.run.smithi175.stderr:512 bytes copied, 0.000197757 s, 2.6 MB/s 2024-04-26T23:39:33.765 DEBUG:teuthology.orchestra.run.smithi175:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-26T23:39:33.821 DEBUG:teuthology.orchestra.run.smithi175:> stat /dev/vg_nvme/lv_4 2024-04-26T23:39:33.876 INFO:teuthology.orchestra.run.smithi175.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-26T23:39:33.876 INFO:teuthology.orchestra.run.smithi175.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T23:39:33.876 INFO:teuthology.orchestra.run.smithi175.stdout:Device: 5h/5d Inode: 721 Links: 1 2024-04-26T23:39:33.876 INFO:teuthology.orchestra.run.smithi175.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T23:39:33.876 INFO:teuthology.orchestra.run.smithi175.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T23:39:33.876 INFO:teuthology.orchestra.run.smithi175.stdout:Access: 2024-04-26 23:39:18.166207068 +0000 2024-04-26T23:39:33.876 INFO:teuthology.orchestra.run.smithi175.stdout:Modify: 2024-04-26 23:37:38.497151481 +0000 2024-04-26T23:39:33.876 INFO:teuthology.orchestra.run.smithi175.stdout:Change: 2024-04-26 23:37:38.497151481 +0000 2024-04-26T23:39:33.876 INFO:teuthology.orchestra.run.smithi175.stdout: Birth: 2024-04-26 23:37:38.497151481 +0000 2024-04-26T23:39:33.877 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-26T23:39:33.938 INFO:teuthology.orchestra.run.smithi175.stderr:1+0 records in 2024-04-26T23:39:33.938 INFO:teuthology.orchestra.run.smithi175.stderr:1+0 records out 2024-04-26T23:39:33.938 INFO:teuthology.orchestra.run.smithi175.stderr:512 bytes copied, 0.000235106 s, 2.2 MB/s 2024-04-26T23:39:33.939 DEBUG:teuthology.orchestra.run.smithi175:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-26T23:39:33.994 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-26T23:39:33.994 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi088.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi175.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-04-26T23:39:33.995 INFO:tasks.ceph:Generating config... 2024-04-26T23:39:33.996 INFO:tasks.ceph:[client] client mount timeout = 600 2024-04-26T23:39:33.996 INFO:tasks.ceph:[client] client_shutdown_timeout = 120 2024-04-26T23:39:33.996 INFO:tasks.ceph:[client] debug client = 20 2024-04-26T23:39:33.996 INFO:tasks.ceph:[client] debug ms = 1 2024-04-26T23:39:33.996 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-04-26T23:39:33.996 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-04-26T23:39:33.996 INFO:tasks.ceph:[global] ms die on skipped message = False 2024-04-26T23:39:33.996 INFO:tasks.ceph:[mds] debug mds = 20 2024-04-26T23:39:33.996 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-04-26T23:39:33.996 INFO:tasks.ceph:[mds] debug ms = 1 2024-04-26T23:39:33.997 INFO:tasks.ceph:[mds] mds bal fragment size max = 10000 2024-04-26T23:39:33.997 INFO:tasks.ceph:[mds] mds bal merge size = 5 2024-04-26T23:39:33.997 INFO:tasks.ceph:[mds] mds bal split bits = 3 2024-04-26T23:39:33.997 INFO:tasks.ceph:[mds] mds bal split size = 100 2024-04-26T23:39:33.997 INFO:tasks.ceph:[mds] mds debug frag = True 2024-04-26T23:39:33.997 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-04-26T23:39:33.997 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-04-26T23:39:33.997 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-04-26T23:39:33.997 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-04-26T23:39:33.997 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-04-26T23:39:33.997 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-04-26T23:39:33.997 INFO:tasks.ceph:[mgr] debug client = 20 2024-04-26T23:39:33.997 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-04-26T23:39:33.997 INFO:tasks.ceph:[mgr] debug ms = 1 2024-04-26T23:39:33.997 INFO:tasks.ceph:[mon] debug mon = 20 2024-04-26T23:39:33.998 INFO:tasks.ceph:[mon] debug ms = 1 2024-04-26T23:39:33.998 INFO:tasks.ceph:[mon] debug paxos = 20 2024-04-26T23:39:33.998 INFO:tasks.ceph:[mon] mon down mkfs grace = 300 2024-04-26T23:39:33.998 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-04-26T23:39:33.998 INFO:tasks.ceph:[osd] bdev async discard = True 2024-04-26T23:39:33.998 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-04-26T23:39:33.998 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-04-26T23:39:33.998 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-04-26T23:39:33.998 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-04-26T23:39:33.998 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-04-26T23:39:33.998 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-04-26T23:39:33.998 INFO:tasks.ceph:[osd] debug ms = 1 2024-04-26T23:39:33.998 INFO:tasks.ceph:[osd] debug osd = 20 2024-04-26T23:39:33.998 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-04-26T23:39:33.999 INFO:tasks.ceph:[osd] filestore flush min = 0 2024-04-26T23:39:33.999 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-04-26T23:39:33.999 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-04-26T23:39:33.999 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-04-26T23:39:33.999 INFO:tasks.ceph:[osd] osd blocked scrub grace period = 3600 2024-04-26T23:39:33.999 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-04-26T23:39:33.999 INFO:tasks.ceph:[osd] osd max markdown count = 1000 2024-04-26T23:39:33.999 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-04-26T23:39:33.999 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-04-26T23:39:33.999 INFO:tasks.ceph:Setting up mon.a... 2024-04-26T23:39:33.999 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-04-26T23:39:34.048 INFO:teuthology.orchestra.run.smithi088.stdout:creating /etc/ceph/ceph.keyring 2024-04-26T23:39:34.051 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-04-26T23:39:34.091 DEBUG:teuthology.orchestra.run.smithi088:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-26T23:39:34.153 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.88'), ('mon.b', '172.21.15.175'), ('mon.c', '[v2:172.21.15.175:3301,v1:172.21.15.175:6790]')] 2024-04-26T23:39:34.154 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.88,172.21.15.175,[v2:172.21.15.175:3301,v1:172.21.15.175:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'filestore flush min': 0, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'client_shutdown_timeout': 120, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-04-26T23:39:34.154 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-04-26T23:39:34.154 DEBUG:teuthology.orchestra.run.smithi088:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-04-26T23:39:34.208 DEBUG:teuthology.orchestra.run.smithi088:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.88 --add b 172.21.15.175 --addv c '[v2:172.21.15.175:3301,v1:172.21.15.175:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-04-26T23:39:34.294 INFO:teuthology.orchestra.run.smithi088.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-04-26T23:39:34.294 INFO:teuthology.orchestra.run.smithi088.stdout:monmaptool: generated fsid 555255e9-7ef9-4454-8dc9-35e96b70035c 2024-04-26T23:39:34.294 INFO:teuthology.orchestra.run.smithi088.stdout:setting min_mon_release = quincy 2024-04-26T23:39:34.294 INFO:teuthology.orchestra.run.smithi088.stdout:epoch 0 2024-04-26T23:39:34.294 INFO:teuthology.orchestra.run.smithi088.stdout:fsid 555255e9-7ef9-4454-8dc9-35e96b70035c 2024-04-26T23:39:34.294 INFO:teuthology.orchestra.run.smithi088.stdout:last_changed 2024-04-26T23:39:34.291658+0000 2024-04-26T23:39:34.294 INFO:teuthology.orchestra.run.smithi088.stdout:created 2024-04-26T23:39:34.291658+0000 2024-04-26T23:39:34.294 INFO:teuthology.orchestra.run.smithi088.stdout:min_mon_release 17 (quincy) 2024-04-26T23:39:34.294 INFO:teuthology.orchestra.run.smithi088.stdout:election_strategy: 1 2024-04-26T23:39:34.294 INFO:teuthology.orchestra.run.smithi088.stdout:0: [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] mon.a 2024-04-26T23:39:34.294 INFO:teuthology.orchestra.run.smithi088.stdout:1: [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] mon.b 2024-04-26T23:39:34.295 INFO:teuthology.orchestra.run.smithi088.stdout:2: [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] mon.c 2024-04-26T23:39:34.295 INFO:teuthology.orchestra.run.smithi088.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-04-26T23:39:34.296 DEBUG:teuthology.orchestra.run.smithi088:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-04-26T23:39:34.311 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 555255e9-7ef9-4454-8dc9-35e96b70035c... 2024-04-26T23:39:34.312 DEBUG:teuthology.orchestra.run.smithi088:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-26T23:39:34.354 DEBUG:teuthology.orchestra.run.smithi175:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-26T23:39:34.391 INFO:teuthology.orchestra.run.smithi088.stdout:[global] 2024-04-26T23:39:34.391 INFO:teuthology.orchestra.run.smithi088.stdout: chdir = "" 2024-04-26T23:39:34.391 INFO:teuthology.orchestra.run.smithi088.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-26T23:39:34.391 INFO:teuthology.orchestra.run.smithi088.stdout: auth supported = cephx 2024-04-26T23:39:34.392 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-26T23:39:34.392 INFO:teuthology.orchestra.run.smithi088.stdout: filestore xattr use omap = true 2024-04-26T23:39:34.392 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-26T23:39:34.392 INFO:teuthology.orchestra.run.smithi088.stdout: mon clock drift allowed = 1.000 2024-04-26T23:39:34.392 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-26T23:39:34.392 INFO:teuthology.orchestra.run.smithi088.stdout: osd crush chooseleaf type = 0 2024-04-26T23:39:34.392 INFO:teuthology.orchestra.run.smithi088.stdout: auth debug = true 2024-04-26T23:39:34.392 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-26T23:39:34.392 INFO:teuthology.orchestra.run.smithi088.stdout: ms die on old message = true 2024-04-26T23:39:34.392 INFO:teuthology.orchestra.run.smithi088.stdout: ms die on bug = true 2024-04-26T23:39:34.392 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-26T23:39:34.392 INFO:teuthology.orchestra.run.smithi088.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-26T23:39:34.392 INFO:teuthology.orchestra.run.smithi088.stdout: mon pg warn max object skew = 0 2024-04-26T23:39:34.392 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-26T23:39:34.392 INFO:teuthology.orchestra.run.smithi088.stdout: # disable pg_autoscaler by default for new pools 2024-04-26T23:39:34.392 INFO:teuthology.orchestra.run.smithi088.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-26T23:39:34.393 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-26T23:39:34.393 INFO:teuthology.orchestra.run.smithi088.stdout: osd pool default size = 2 2024-04-26T23:39:34.393 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-26T23:39:34.393 INFO:teuthology.orchestra.run.smithi088.stdout: mon osd allow primary affinity = true 2024-04-26T23:39:34.393 INFO:teuthology.orchestra.run.smithi088.stdout: mon osd allow pg remap = true 2024-04-26T23:39:34.393 INFO:teuthology.orchestra.run.smithi088.stdout: mon warn on legacy crush tunables = false 2024-04-26T23:39:34.393 INFO:teuthology.orchestra.run.smithi088.stdout: mon warn on crush straw calc version zero = false 2024-04-26T23:39:34.393 INFO:teuthology.orchestra.run.smithi088.stdout: mon warn on no sortbitwise = false 2024-04-26T23:39:34.393 INFO:teuthology.orchestra.run.smithi088.stdout: mon warn on osd down out interval zero = false 2024-04-26T23:39:34.393 INFO:teuthology.orchestra.run.smithi088.stdout: mon warn on too few osds = false 2024-04-26T23:39:34.393 INFO:teuthology.orchestra.run.smithi088.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-26T23:39:34.393 INFO:teuthology.orchestra.run.smithi088.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-26T23:39:34.393 INFO:teuthology.orchestra.run.smithi088.stdout: mon_allow_pool_size_one = true 2024-04-26T23:39:34.393 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-26T23:39:34.393 INFO:teuthology.orchestra.run.smithi088.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-26T23:39:34.394 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-26T23:39:34.394 INFO:teuthology.orchestra.run.smithi088.stdout: osd default data pool replay window = 5 2024-04-26T23:39:34.394 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-26T23:39:34.394 INFO:teuthology.orchestra.run.smithi088.stdout: mon allow pool delete = true 2024-04-26T23:39:34.394 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-26T23:39:34.394 INFO:teuthology.orchestra.run.smithi088.stdout: mon cluster log file level = debug 2024-04-26T23:39:34.394 INFO:teuthology.orchestra.run.smithi088.stdout: debug asserts on shutdown = true 2024-04-26T23:39:34.394 INFO:teuthology.orchestra.run.smithi088.stdout: mon health detail to clog = false 2024-04-26T23:39:34.394 INFO:teuthology.orchestra.run.smithi088.stdout: mon host = "172.21.15.88,172.21.15.175,[v2:172.21.15.175:3301,v1:172.21.15.175:6790]" 2024-04-26T23:39:34.394 INFO:teuthology.orchestra.run.smithi088.stdout: ms die on skipped message = False 2024-04-26T23:39:34.394 INFO:teuthology.orchestra.run.smithi088.stdout: fsid = 555255e9-7ef9-4454-8dc9-35e96b70035c 2024-04-26T23:39:34.394 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-26T23:39:34.394 INFO:teuthology.orchestra.run.smithi088.stdout:[osd] 2024-04-26T23:39:34.394 INFO:teuthology.orchestra.run.smithi088.stdout: osd journal size = 100 2024-04-26T23:39:34.394 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-26T23:39:34.394 INFO:teuthology.orchestra.run.smithi088.stdout: osd scrub load threshold = 5.0 2024-04-26T23:39:34.394 INFO:teuthology.orchestra.run.smithi088.stdout: osd scrub max interval = 600 2024-04-26T23:39:34.395 INFO:teuthology.orchestra.run.smithi088.stdout: osd mclock profile = high_recovery_ops 2024-04-26T23:39:34.395 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-26T23:39:34.395 INFO:teuthology.orchestra.run.smithi088.stdout: osd recover clone overlap = true 2024-04-26T23:39:34.395 INFO:teuthology.orchestra.run.smithi088.stdout: osd recovery max chunk = 1048576 2024-04-26T23:39:34.395 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-26T23:39:34.395 INFO:teuthology.orchestra.run.smithi088.stdout: osd debug shutdown = true 2024-04-26T23:39:34.395 INFO:teuthology.orchestra.run.smithi088.stdout: osd debug op order = true 2024-04-26T23:39:34.395 INFO:teuthology.orchestra.run.smithi088.stdout: osd debug verify stray on activate = true 2024-04-26T23:39:34.395 INFO:teuthology.orchestra.run.smithi088.stdout: osd debug trim objects = true 2024-04-26T23:39:34.395 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-26T23:39:34.395 INFO:teuthology.orchestra.run.smithi088.stdout: osd open classes on start = true 2024-04-26T23:39:34.396 INFO:teuthology.orchestra.run.smithi088.stdout: osd debug pg log writeout = true 2024-04-26T23:39:34.396 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-26T23:39:34.396 INFO:teuthology.orchestra.run.smithi088.stdout: osd deep scrub update digest min age = 30 2024-04-26T23:39:34.396 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-26T23:39:34.396 INFO:teuthology.orchestra.run.smithi088.stdout: osd map max advance = 10 2024-04-26T23:39:34.396 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-26T23:39:34.396 INFO:teuthology.orchestra.run.smithi088.stdout: journal zero on create = true 2024-04-26T23:39:34.396 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-26T23:39:34.396 INFO:teuthology.orchestra.run.smithi088.stdout: filestore ondisk finisher threads = 3 2024-04-26T23:39:34.396 INFO:teuthology.orchestra.run.smithi088.stdout: filestore apply finisher threads = 3 2024-04-26T23:39:34.396 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-26T23:39:34.396 INFO:teuthology.orchestra.run.smithi088.stdout: bdev debug aio = true 2024-04-26T23:39:34.396 INFO:teuthology.orchestra.run.smithi088.stdout: osd debug misdirected ops = true 2024-04-26T23:39:34.396 INFO:teuthology.orchestra.run.smithi088.stdout: bdev async discard = True 2024-04-26T23:39:34.396 INFO:teuthology.orchestra.run.smithi088.stdout: bdev enable discard = True 2024-04-26T23:39:34.396 INFO:teuthology.orchestra.run.smithi088.stdout: bluestore allocator = bitmap 2024-04-26T23:39:34.397 INFO:teuthology.orchestra.run.smithi088.stdout: bluestore block size = 96636764160 2024-04-26T23:39:34.397 INFO:teuthology.orchestra.run.smithi088.stdout: bluestore fsck on mount = True 2024-04-26T23:39:34.397 INFO:teuthology.orchestra.run.smithi088.stdout: debug bluefs = 1/20 2024-04-26T23:39:34.397 INFO:teuthology.orchestra.run.smithi088.stdout: debug bluestore = 1/20 2024-04-26T23:39:34.397 INFO:teuthology.orchestra.run.smithi088.stdout: debug ms = 1 2024-04-26T23:39:34.397 INFO:teuthology.orchestra.run.smithi088.stdout: debug osd = 20 2024-04-26T23:39:34.397 INFO:teuthology.orchestra.run.smithi088.stdout: debug rocksdb = 4/10 2024-04-26T23:39:34.397 INFO:teuthology.orchestra.run.smithi088.stdout: filestore flush min = 0 2024-04-26T23:39:34.397 INFO:teuthology.orchestra.run.smithi088.stdout: mon osd backfillfull_ratio = 0.85 2024-04-26T23:39:34.397 INFO:teuthology.orchestra.run.smithi088.stdout: mon osd full ratio = 0.9 2024-04-26T23:39:34.397 INFO:teuthology.orchestra.run.smithi088.stdout: mon osd nearfull ratio = 0.8 2024-04-26T23:39:34.397 INFO:teuthology.orchestra.run.smithi088.stdout: osd blocked scrub grace period = 3600 2024-04-26T23:39:34.397 INFO:teuthology.orchestra.run.smithi088.stdout: osd failsafe full ratio = 0.95 2024-04-26T23:39:34.397 INFO:teuthology.orchestra.run.smithi088.stdout: osd max markdown count = 1000 2024-04-26T23:39:34.397 INFO:teuthology.orchestra.run.smithi088.stdout: osd objectstore = bluestore 2024-04-26T23:39:34.397 INFO:teuthology.orchestra.run.smithi088.stdout: osd op complaint time = 180 2024-04-26T23:39:34.397 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-26T23:39:34.398 INFO:teuthology.orchestra.run.smithi088.stdout:[mgr] 2024-04-26T23:39:34.398 INFO:teuthology.orchestra.run.smithi088.stdout: debug ms = 1 2024-04-26T23:39:34.398 INFO:teuthology.orchestra.run.smithi088.stdout: debug mgr = 20 2024-04-26T23:39:34.398 INFO:teuthology.orchestra.run.smithi088.stdout: debug mon = 20 2024-04-26T23:39:34.398 INFO:teuthology.orchestra.run.smithi088.stdout: debug auth = 20 2024-04-26T23:39:34.398 INFO:teuthology.orchestra.run.smithi088.stdout: mon reweight min pgs per osd = 4 2024-04-26T23:39:34.398 INFO:teuthology.orchestra.run.smithi088.stdout: mon reweight min bytes per osd = 10 2024-04-26T23:39:34.398 INFO:teuthology.orchestra.run.smithi088.stdout: mgr/telemetry/nag = false 2024-04-26T23:39:34.398 INFO:teuthology.orchestra.run.smithi088.stdout: debug client = 20 2024-04-26T23:39:34.398 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-26T23:39:34.398 INFO:teuthology.orchestra.run.smithi088.stdout:[mon] 2024-04-26T23:39:34.398 INFO:teuthology.orchestra.run.smithi088.stdout: debug ms = 1 2024-04-26T23:39:34.398 INFO:teuthology.orchestra.run.smithi088.stdout: debug mon = 20 2024-04-26T23:39:34.398 INFO:teuthology.orchestra.run.smithi088.stdout: debug paxos = 20 2024-04-26T23:39:34.399 INFO:teuthology.orchestra.run.smithi088.stdout: debug auth = 20 2024-04-26T23:39:34.399 INFO:teuthology.orchestra.run.smithi088.stdout: mon data avail warn = 5 2024-04-26T23:39:34.399 INFO:teuthology.orchestra.run.smithi088.stdout: mon mgr mkfs grace = 240 2024-04-26T23:39:34.399 INFO:teuthology.orchestra.run.smithi088.stdout: mon reweight min pgs per osd = 4 2024-04-26T23:39:34.399 INFO:teuthology.orchestra.run.smithi088.stdout: mon osd reporter subtree level = osd 2024-04-26T23:39:34.399 INFO:teuthology.orchestra.run.smithi088.stdout: mon osd prime pg temp = true 2024-04-26T23:39:34.399 INFO:teuthology.orchestra.run.smithi088.stdout: mon reweight min bytes per osd = 10 2024-04-26T23:39:34.399 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-26T23:39:34.399 INFO:teuthology.orchestra.run.smithi088.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-26T23:39:34.399 INFO:teuthology.orchestra.run.smithi088.stdout: auth mon ticket ttl = 660 # 11m 2024-04-26T23:39:34.399 INFO:teuthology.orchestra.run.smithi088.stdout: auth service ticket ttl = 240 # 4m 2024-04-26T23:39:34.399 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-26T23:39:34.399 INFO:teuthology.orchestra.run.smithi088.stdout: # don't complain about insecure global_id in the test suite 2024-04-26T23:39:34.399 INFO:teuthology.orchestra.run.smithi088.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-26T23:39:34.399 INFO:teuthology.orchestra.run.smithi088.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-26T23:39:34.400 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-26T23:39:34.400 INFO:teuthology.orchestra.run.smithi088.stdout: # 1m isn't quite enough 2024-04-26T23:39:34.400 INFO:teuthology.orchestra.run.smithi088.stdout: mon_down_mkfs_grace = 2m 2024-04-26T23:39:34.400 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-26T23:39:34.400 INFO:teuthology.orchestra.run.smithi088.stdout: mon_warn_on_filestore_osds = false 2024-04-26T23:39:34.400 INFO:teuthology.orchestra.run.smithi088.stdout: mon down mkfs grace = 300 2024-04-26T23:39:34.400 INFO:teuthology.orchestra.run.smithi088.stdout: mon op complaint time = 120 2024-04-26T23:39:34.400 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-26T23:39:34.400 INFO:teuthology.orchestra.run.smithi088.stdout:[client] 2024-04-26T23:39:34.400 INFO:teuthology.orchestra.run.smithi088.stdout: rgw cache enabled = true 2024-04-26T23:39:34.400 INFO:teuthology.orchestra.run.smithi088.stdout: rgw enable ops log = true 2024-04-26T23:39:34.400 INFO:teuthology.orchestra.run.smithi088.stdout: rgw enable usage log = true 2024-04-26T23:39:34.400 INFO:teuthology.orchestra.run.smithi088.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-26T23:39:34.400 INFO:teuthology.orchestra.run.smithi088.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-26T23:39:34.400 INFO:teuthology.orchestra.run.smithi088.stdout: client mount timeout = 600 2024-04-26T23:39:34.400 INFO:teuthology.orchestra.run.smithi088.stdout: client_shutdown_timeout = 120 2024-04-26T23:39:34.401 INFO:teuthology.orchestra.run.smithi088.stdout: debug client = 20 2024-04-26T23:39:34.401 INFO:teuthology.orchestra.run.smithi088.stdout: debug ms = 1 2024-04-26T23:39:34.401 INFO:teuthology.orchestra.run.smithi088.stdout: rados mon op timeout = 900 2024-04-26T23:39:34.401 INFO:teuthology.orchestra.run.smithi088.stdout: rados osd op timeout = 900 2024-04-26T23:39:34.401 INFO:teuthology.orchestra.run.smithi088.stdout:[mon.a] 2024-04-26T23:39:34.401 INFO:teuthology.orchestra.run.smithi088.stdout:[mon.b] 2024-04-26T23:39:34.401 INFO:teuthology.orchestra.run.smithi088.stdout:[mon.c] 2024-04-26T23:39:34.401 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.a] 2024-04-26T23:39:34.401 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.c] 2024-04-26T23:39:34.401 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.b] 2024-04-26T23:39:34.401 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.d] 2024-04-26T23:39:34.401 INFO:teuthology.orchestra.run.smithi088.stdout:[mds] 2024-04-26T23:39:34.401 INFO:teuthology.orchestra.run.smithi088.stdout: debug mds = 20 2024-04-26T23:39:34.401 INFO:teuthology.orchestra.run.smithi088.stdout: debug mds balancer = 20 2024-04-26T23:39:34.401 INFO:teuthology.orchestra.run.smithi088.stdout: debug ms = 1 2024-04-26T23:39:34.401 INFO:teuthology.orchestra.run.smithi088.stdout: mds bal fragment size max = 10000 2024-04-26T23:39:34.402 INFO:teuthology.orchestra.run.smithi088.stdout: mds bal merge size = 5 2024-04-26T23:39:34.402 INFO:teuthology.orchestra.run.smithi088.stdout: mds bal split bits = 3 2024-04-26T23:39:34.402 INFO:teuthology.orchestra.run.smithi088.stdout: mds bal split size = 100 2024-04-26T23:39:34.402 INFO:teuthology.orchestra.run.smithi088.stdout: mds debug frag = True 2024-04-26T23:39:34.402 INFO:teuthology.orchestra.run.smithi088.stdout: mds debug scatterstat = True 2024-04-26T23:39:34.402 INFO:teuthology.orchestra.run.smithi088.stdout: mds op complaint time = 180 2024-04-26T23:39:34.402 INFO:teuthology.orchestra.run.smithi088.stdout: mds verify scatter = True 2024-04-26T23:39:34.402 INFO:teuthology.orchestra.run.smithi088.stdout: osd op complaint time = 180 2024-04-26T23:39:34.402 INFO:teuthology.orchestra.run.smithi088.stdout: rados mon op timeout = 900 2024-04-26T23:39:34.402 INFO:teuthology.orchestra.run.smithi088.stdout: rados osd op timeout = 900 2024-04-26T23:39:34.403 INFO:teuthology.orchestra.run.smithi175.stdout:[global] 2024-04-26T23:39:34.403 INFO:teuthology.orchestra.run.smithi175.stdout: chdir = "" 2024-04-26T23:39:34.403 INFO:teuthology.orchestra.run.smithi175.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-26T23:39:34.403 INFO:teuthology.orchestra.run.smithi175.stdout: auth supported = cephx 2024-04-26T23:39:34.403 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-26T23:39:34.403 INFO:teuthology.orchestra.run.smithi175.stdout: filestore xattr use omap = true 2024-04-26T23:39:34.403 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-26T23:39:34.403 INFO:teuthology.orchestra.run.smithi175.stdout: mon clock drift allowed = 1.000 2024-04-26T23:39:34.403 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-26T23:39:34.403 INFO:teuthology.orchestra.run.smithi175.stdout: osd crush chooseleaf type = 0 2024-04-26T23:39:34.403 INFO:teuthology.orchestra.run.smithi175.stdout: auth debug = true 2024-04-26T23:39:34.403 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-26T23:39:34.403 INFO:teuthology.orchestra.run.smithi175.stdout: ms die on old message = true 2024-04-26T23:39:34.404 INFO:teuthology.orchestra.run.smithi175.stdout: ms die on bug = true 2024-04-26T23:39:34.404 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-26T23:39:34.404 INFO:teuthology.orchestra.run.smithi175.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-26T23:39:34.404 INFO:teuthology.orchestra.run.smithi175.stdout: mon pg warn max object skew = 0 2024-04-26T23:39:34.404 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-26T23:39:34.404 INFO:teuthology.orchestra.run.smithi175.stdout: # disable pg_autoscaler by default for new pools 2024-04-26T23:39:34.404 INFO:teuthology.orchestra.run.smithi175.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-26T23:39:34.404 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-26T23:39:34.404 INFO:teuthology.orchestra.run.smithi175.stdout: osd pool default size = 2 2024-04-26T23:39:34.404 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-26T23:39:34.404 INFO:teuthology.orchestra.run.smithi175.stdout: mon osd allow primary affinity = true 2024-04-26T23:39:34.404 INFO:teuthology.orchestra.run.smithi175.stdout: mon osd allow pg remap = true 2024-04-26T23:39:34.404 INFO:teuthology.orchestra.run.smithi175.stdout: mon warn on legacy crush tunables = false 2024-04-26T23:39:34.404 INFO:teuthology.orchestra.run.smithi175.stdout: mon warn on crush straw calc version zero = false 2024-04-26T23:39:34.404 INFO:teuthology.orchestra.run.smithi175.stdout: mon warn on no sortbitwise = false 2024-04-26T23:39:34.405 INFO:teuthology.orchestra.run.smithi175.stdout: mon warn on osd down out interval zero = false 2024-04-26T23:39:34.405 INFO:teuthology.orchestra.run.smithi175.stdout: mon warn on too few osds = false 2024-04-26T23:39:34.405 INFO:teuthology.orchestra.run.smithi175.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-26T23:39:34.405 INFO:teuthology.orchestra.run.smithi175.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-26T23:39:34.405 INFO:teuthology.orchestra.run.smithi175.stdout: mon_allow_pool_size_one = true 2024-04-26T23:39:34.405 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-26T23:39:34.405 INFO:teuthology.orchestra.run.smithi175.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-26T23:39:34.405 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-26T23:39:34.405 INFO:teuthology.orchestra.run.smithi175.stdout: osd default data pool replay window = 5 2024-04-26T23:39:34.405 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-26T23:39:34.405 INFO:teuthology.orchestra.run.smithi175.stdout: mon allow pool delete = true 2024-04-26T23:39:34.405 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-26T23:39:34.405 INFO:teuthology.orchestra.run.smithi175.stdout: mon cluster log file level = debug 2024-04-26T23:39:34.405 INFO:teuthology.orchestra.run.smithi175.stdout: debug asserts on shutdown = true 2024-04-26T23:39:34.406 INFO:teuthology.orchestra.run.smithi175.stdout: mon health detail to clog = false 2024-04-26T23:39:34.406 INFO:teuthology.orchestra.run.smithi175.stdout: mon host = "172.21.15.88,172.21.15.175,[v2:172.21.15.175:3301,v1:172.21.15.175:6790]" 2024-04-26T23:39:34.406 INFO:teuthology.orchestra.run.smithi175.stdout: ms die on skipped message = False 2024-04-26T23:39:34.406 INFO:teuthology.orchestra.run.smithi175.stdout: fsid = 555255e9-7ef9-4454-8dc9-35e96b70035c 2024-04-26T23:39:34.406 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-26T23:39:34.406 INFO:teuthology.orchestra.run.smithi175.stdout:[osd] 2024-04-26T23:39:34.406 INFO:teuthology.orchestra.run.smithi175.stdout: osd journal size = 100 2024-04-26T23:39:34.406 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-26T23:39:34.406 INFO:teuthology.orchestra.run.smithi175.stdout: osd scrub load threshold = 5.0 2024-04-26T23:39:34.406 INFO:teuthology.orchestra.run.smithi175.stdout: osd scrub max interval = 600 2024-04-26T23:39:34.406 INFO:teuthology.orchestra.run.smithi175.stdout: osd mclock profile = high_recovery_ops 2024-04-26T23:39:34.406 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-26T23:39:34.406 INFO:teuthology.orchestra.run.smithi175.stdout: osd recover clone overlap = true 2024-04-26T23:39:34.406 INFO:teuthology.orchestra.run.smithi175.stdout: osd recovery max chunk = 1048576 2024-04-26T23:39:34.406 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-26T23:39:34.407 INFO:teuthology.orchestra.run.smithi175.stdout: osd debug shutdown = true 2024-04-26T23:39:34.407 INFO:teuthology.orchestra.run.smithi175.stdout: osd debug op order = true 2024-04-26T23:39:34.407 INFO:teuthology.orchestra.run.smithi175.stdout: osd debug verify stray on activate = true 2024-04-26T23:39:34.407 INFO:teuthology.orchestra.run.smithi175.stdout: osd debug trim objects = true 2024-04-26T23:39:34.407 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-26T23:39:34.407 INFO:teuthology.orchestra.run.smithi175.stdout: osd open classes on start = true 2024-04-26T23:39:34.407 INFO:teuthology.orchestra.run.smithi175.stdout: osd debug pg log writeout = true 2024-04-26T23:39:34.407 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-26T23:39:34.407 INFO:teuthology.orchestra.run.smithi175.stdout: osd deep scrub update digest min age = 30 2024-04-26T23:39:34.407 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-26T23:39:34.407 INFO:teuthology.orchestra.run.smithi175.stdout: osd map max advance = 10 2024-04-26T23:39:34.407 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-26T23:39:34.407 INFO:teuthology.orchestra.run.smithi175.stdout: journal zero on create = true 2024-04-26T23:39:34.407 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-26T23:39:34.407 INFO:teuthology.orchestra.run.smithi175.stdout: filestore ondisk finisher threads = 3 2024-04-26T23:39:34.408 INFO:teuthology.orchestra.run.smithi175.stdout: filestore apply finisher threads = 3 2024-04-26T23:39:34.408 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-26T23:39:34.408 INFO:teuthology.orchestra.run.smithi175.stdout: bdev debug aio = true 2024-04-26T23:39:34.408 INFO:teuthology.orchestra.run.smithi175.stdout: osd debug misdirected ops = true 2024-04-26T23:39:34.408 INFO:teuthology.orchestra.run.smithi175.stdout: bdev async discard = True 2024-04-26T23:39:34.408 INFO:teuthology.orchestra.run.smithi175.stdout: bdev enable discard = True 2024-04-26T23:39:34.408 INFO:teuthology.orchestra.run.smithi175.stdout: bluestore allocator = bitmap 2024-04-26T23:39:34.408 INFO:teuthology.orchestra.run.smithi175.stdout: bluestore block size = 96636764160 2024-04-26T23:39:34.408 INFO:teuthology.orchestra.run.smithi175.stdout: bluestore fsck on mount = True 2024-04-26T23:39:34.408 INFO:teuthology.orchestra.run.smithi175.stdout: debug bluefs = 1/20 2024-04-26T23:39:34.408 INFO:teuthology.orchestra.run.smithi175.stdout: debug bluestore = 1/20 2024-04-26T23:39:34.408 INFO:teuthology.orchestra.run.smithi175.stdout: debug ms = 1 2024-04-26T23:39:34.408 INFO:teuthology.orchestra.run.smithi175.stdout: debug osd = 20 2024-04-26T23:39:34.408 INFO:teuthology.orchestra.run.smithi175.stdout: debug rocksdb = 4/10 2024-04-26T23:39:34.408 INFO:teuthology.orchestra.run.smithi175.stdout: filestore flush min = 0 2024-04-26T23:39:34.409 INFO:teuthology.orchestra.run.smithi175.stdout: mon osd backfillfull_ratio = 0.85 2024-04-26T23:39:34.409 INFO:teuthology.orchestra.run.smithi175.stdout: mon osd full ratio = 0.9 2024-04-26T23:39:34.409 INFO:teuthology.orchestra.run.smithi175.stdout: mon osd nearfull ratio = 0.8 2024-04-26T23:39:34.409 INFO:teuthology.orchestra.run.smithi175.stdout: osd blocked scrub grace period = 3600 2024-04-26T23:39:34.409 INFO:teuthology.orchestra.run.smithi175.stdout: osd failsafe full ratio = 0.95 2024-04-26T23:39:34.409 INFO:teuthology.orchestra.run.smithi175.stdout: osd max markdown count = 1000 2024-04-26T23:39:34.409 INFO:teuthology.orchestra.run.smithi175.stdout: osd objectstore = bluestore 2024-04-26T23:39:34.409 INFO:teuthology.orchestra.run.smithi175.stdout: osd op complaint time = 180 2024-04-26T23:39:34.409 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-26T23:39:34.409 INFO:teuthology.orchestra.run.smithi175.stdout:[mgr] 2024-04-26T23:39:34.409 INFO:teuthology.orchestra.run.smithi175.stdout: debug ms = 1 2024-04-26T23:39:34.409 INFO:teuthology.orchestra.run.smithi175.stdout: debug mgr = 20 2024-04-26T23:39:34.409 INFO:teuthology.orchestra.run.smithi175.stdout: debug mon = 20 2024-04-26T23:39:34.409 INFO:teuthology.orchestra.run.smithi175.stdout: debug auth = 20 2024-04-26T23:39:34.409 INFO:teuthology.orchestra.run.smithi175.stdout: mon reweight min pgs per osd = 4 2024-04-26T23:39:34.410 INFO:teuthology.orchestra.run.smithi175.stdout: mon reweight min bytes per osd = 10 2024-04-26T23:39:34.410 INFO:teuthology.orchestra.run.smithi175.stdout: mgr/telemetry/nag = false 2024-04-26T23:39:34.410 INFO:teuthology.orchestra.run.smithi175.stdout: debug client = 20 2024-04-26T23:39:34.410 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-26T23:39:34.410 INFO:teuthology.orchestra.run.smithi175.stdout:[mon] 2024-04-26T23:39:34.410 INFO:teuthology.orchestra.run.smithi175.stdout: debug ms = 1 2024-04-26T23:39:34.410 INFO:teuthology.orchestra.run.smithi175.stdout: debug mon = 20 2024-04-26T23:39:34.410 INFO:teuthology.orchestra.run.smithi175.stdout: debug paxos = 20 2024-04-26T23:39:34.410 INFO:teuthology.orchestra.run.smithi175.stdout: debug auth = 20 2024-04-26T23:39:34.410 INFO:teuthology.orchestra.run.smithi175.stdout: mon data avail warn = 5 2024-04-26T23:39:34.410 INFO:teuthology.orchestra.run.smithi175.stdout: mon mgr mkfs grace = 240 2024-04-26T23:39:34.410 INFO:teuthology.orchestra.run.smithi175.stdout: mon reweight min pgs per osd = 4 2024-04-26T23:39:34.410 INFO:teuthology.orchestra.run.smithi175.stdout: mon osd reporter subtree level = osd 2024-04-26T23:39:34.410 INFO:teuthology.orchestra.run.smithi175.stdout: mon osd prime pg temp = true 2024-04-26T23:39:34.410 INFO:teuthology.orchestra.run.smithi175.stdout: mon reweight min bytes per osd = 10 2024-04-26T23:39:34.411 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-26T23:39:34.411 INFO:teuthology.orchestra.run.smithi175.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-26T23:39:34.411 INFO:teuthology.orchestra.run.smithi175.stdout: auth mon ticket ttl = 660 # 11m 2024-04-26T23:39:34.411 INFO:teuthology.orchestra.run.smithi175.stdout: auth service ticket ttl = 240 # 4m 2024-04-26T23:39:34.411 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-26T23:39:34.411 INFO:teuthology.orchestra.run.smithi175.stdout: # don't complain about insecure global_id in the test suite 2024-04-26T23:39:34.411 INFO:teuthology.orchestra.run.smithi175.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-26T23:39:34.411 INFO:teuthology.orchestra.run.smithi175.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-26T23:39:34.411 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-26T23:39:34.411 INFO:teuthology.orchestra.run.smithi175.stdout: # 1m isn't quite enough 2024-04-26T23:39:34.411 INFO:teuthology.orchestra.run.smithi175.stdout: mon_down_mkfs_grace = 2m 2024-04-26T23:39:34.411 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-26T23:39:34.411 INFO:teuthology.orchestra.run.smithi175.stdout: mon_warn_on_filestore_osds = false 2024-04-26T23:39:34.411 INFO:teuthology.orchestra.run.smithi175.stdout: mon down mkfs grace = 300 2024-04-26T23:39:34.411 INFO:teuthology.orchestra.run.smithi175.stdout: mon op complaint time = 120 2024-04-26T23:39:34.412 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-26T23:39:34.412 INFO:teuthology.orchestra.run.smithi175.stdout:[client] 2024-04-26T23:39:34.412 INFO:teuthology.orchestra.run.smithi175.stdout: rgw cache enabled = true 2024-04-26T23:39:34.412 INFO:teuthology.orchestra.run.smithi175.stdout: rgw enable ops log = true 2024-04-26T23:39:34.412 INFO:teuthology.orchestra.run.smithi175.stdout: rgw enable usage log = true 2024-04-26T23:39:34.412 INFO:teuthology.orchestra.run.smithi175.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-26T23:39:34.412 INFO:teuthology.orchestra.run.smithi175.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-26T23:39:34.412 INFO:teuthology.orchestra.run.smithi175.stdout: client mount timeout = 600 2024-04-26T23:39:34.412 INFO:teuthology.orchestra.run.smithi175.stdout: client_shutdown_timeout = 120 2024-04-26T23:39:34.412 INFO:teuthology.orchestra.run.smithi175.stdout: debug client = 20 2024-04-26T23:39:34.412 INFO:teuthology.orchestra.run.smithi175.stdout: debug ms = 1 2024-04-26T23:39:34.412 INFO:teuthology.orchestra.run.smithi175.stdout: rados mon op timeout = 900 2024-04-26T23:39:34.412 INFO:teuthology.orchestra.run.smithi175.stdout: rados osd op timeout = 900 2024-04-26T23:39:34.412 INFO:teuthology.orchestra.run.smithi175.stdout:[mon.a] 2024-04-26T23:39:34.412 INFO:teuthology.orchestra.run.smithi175.stdout:[mon.b] 2024-04-26T23:39:34.413 INFO:teuthology.orchestra.run.smithi175.stdout:[mon.c] 2024-04-26T23:39:34.413 INFO:teuthology.orchestra.run.smithi175.stdout:[mds.a] 2024-04-26T23:39:34.413 INFO:teuthology.orchestra.run.smithi175.stdout:[mds.c] 2024-04-26T23:39:34.413 INFO:teuthology.orchestra.run.smithi175.stdout:[mds.b] 2024-04-26T23:39:34.413 INFO:teuthology.orchestra.run.smithi175.stdout:[mds.d] 2024-04-26T23:39:34.413 INFO:teuthology.orchestra.run.smithi175.stdout:[mds] 2024-04-26T23:39:34.413 INFO:teuthology.orchestra.run.smithi175.stdout: debug mds = 20 2024-04-26T23:39:34.413 INFO:teuthology.orchestra.run.smithi175.stdout: debug mds balancer = 20 2024-04-26T23:39:34.413 INFO:teuthology.orchestra.run.smithi175.stdout: debug ms = 1 2024-04-26T23:39:34.413 INFO:teuthology.orchestra.run.smithi175.stdout: mds bal fragment size max = 10000 2024-04-26T23:39:34.413 INFO:teuthology.orchestra.run.smithi175.stdout: mds bal merge size = 5 2024-04-26T23:39:34.413 INFO:teuthology.orchestra.run.smithi175.stdout: mds bal split bits = 3 2024-04-26T23:39:34.413 INFO:teuthology.orchestra.run.smithi175.stdout: mds bal split size = 100 2024-04-26T23:39:34.413 INFO:teuthology.orchestra.run.smithi175.stdout: mds debug frag = True 2024-04-26T23:39:34.414 INFO:teuthology.orchestra.run.smithi175.stdout: mds debug scatterstat = True 2024-04-26T23:39:34.414 INFO:teuthology.orchestra.run.smithi175.stdout: mds op complaint time = 180 2024-04-26T23:39:34.414 INFO:teuthology.orchestra.run.smithi175.stdout: mds verify scatter = True 2024-04-26T23:39:34.414 INFO:teuthology.orchestra.run.smithi175.stdout: osd op complaint time = 180 2024-04-26T23:39:34.414 INFO:teuthology.orchestra.run.smithi175.stdout: rados mon op timeout = 900 2024-04-26T23:39:34.414 INFO:teuthology.orchestra.run.smithi175.stdout: rados osd op timeout = 900 2024-04-26T23:39:34.415 INFO:tasks.ceph:Creating admin key on mon.a... 2024-04-26T23:39:34.416 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-04-26T23:39:34.508 INFO:tasks.ceph:Copying monmap to all nodes... 2024-04-26T23:39:34.508 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-04-26T23:39:34.508 DEBUG:teuthology.orchestra.run.smithi088:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-04-26T23:39:34.523 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-04-26T23:39:34.523 DEBUG:teuthology.orchestra.run.smithi088:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-04-26T23:39:34.577 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi088.front.sepia.ceph.com 2024-04-26T23:39:34.577 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-04-26T23:39:34.577 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-26T23:39:34.577 DEBUG:teuthology.orchestra.run.smithi088:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-26T23:39:34.650 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-04-26T23:39:34.650 DEBUG:teuthology.orchestra.run.smithi088:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-26T23:39:34.705 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi175.front.sepia.ceph.com 2024-04-26T23:39:34.705 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-26T23:39:34.705 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-26T23:39:34.705 DEBUG:teuthology.orchestra.run.smithi175:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-26T23:39:34.739 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-26T23:39:34.740 DEBUG:teuthology.orchestra.run.smithi175:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-26T23:39:34.794 INFO:tasks.ceph:Setting up mon nodes... 2024-04-26T23:39:34.794 INFO:tasks.ceph:Setting up mgr nodes... 2024-04-26T23:39:34.794 DEBUG:teuthology.orchestra.run.smithi088:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-04-26T23:39:34.841 INFO:teuthology.orchestra.run.smithi088.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-04-26T23:39:34.844 DEBUG:teuthology.orchestra.run.smithi175:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-04-26T23:39:34.901 INFO:teuthology.orchestra.run.smithi175.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-04-26T23:39:34.904 INFO:tasks.ceph:Setting up mds nodes... 2024-04-26T23:39:34.904 DEBUG:teuthology.orchestra.run.smithi088:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-04-26T23:39:34.952 INFO:teuthology.orchestra.run.smithi088.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-04-26T23:39:34.954 DEBUG:teuthology.orchestra.run.smithi088:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-04-26T23:39:34.977 DEBUG:teuthology.orchestra.run.smithi088:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-04-26T23:39:35.064 INFO:teuthology.orchestra.run.smithi088.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-04-26T23:39:35.066 DEBUG:teuthology.orchestra.run.smithi088:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-04-26T23:39:35.089 DEBUG:teuthology.orchestra.run.smithi175:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-04-26T23:39:35.139 INFO:teuthology.orchestra.run.smithi175.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-04-26T23:39:35.141 DEBUG:teuthology.orchestra.run.smithi175:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-04-26T23:39:35.164 DEBUG:teuthology.orchestra.run.smithi175:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-04-26T23:39:35.251 INFO:teuthology.orchestra.run.smithi175.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-04-26T23:39:35.254 DEBUG:teuthology.orchestra.run.smithi175:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-04-26T23:39:35.276 INFO:tasks.ceph_client:Setting up client nodes... 2024-04-26T23:39:35.277 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-04-26T23:39:35.316 INFO:teuthology.orchestra.run.smithi088.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-04-26T23:39:35.327 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-04-26T23:39:35.366 INFO:teuthology.orchestra.run.smithi175.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-04-26T23:39:35.378 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-04-26T23:39:35.378 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi088.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi175.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-04-26T23:39:35.378 DEBUG:teuthology.orchestra.run.smithi088:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-04-26T23:39:35.401 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-26T23:39:35.401 INFO:tasks.ceph:role: osd.0 2024-04-26T23:39:35.401 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi088.front.sepia.ceph.com 2024-04-26T23:39:35.401 DEBUG:teuthology.orchestra.run.smithi088:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-26T23:39:35.472 INFO:teuthology.orchestra.run.smithi088.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-26T23:39:35.472 INFO:teuthology.orchestra.run.smithi088.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-26T23:39:35.472 INFO:teuthology.orchestra.run.smithi088.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-26T23:39:35.472 INFO:teuthology.orchestra.run.smithi088.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-26T23:39:35.472 INFO:teuthology.orchestra.run.smithi088.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-26T23:39:35.472 INFO:teuthology.orchestra.run.smithi088.stdout: = sunit=0 swidth=0 blks 2024-04-26T23:39:35.472 INFO:teuthology.orchestra.run.smithi088.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-26T23:39:35.472 INFO:teuthology.orchestra.run.smithi088.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-26T23:39:35.473 INFO:teuthology.orchestra.run.smithi088.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-26T23:39:35.473 INFO:teuthology.orchestra.run.smithi088.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-26T23:39:35.967 INFO:teuthology.orchestra.run.smithi088.stdout:Discarding blocks...Done. 2024-04-26T23:39:35.968 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi088.front.sepia.ceph.com -o noatime 2024-04-26T23:39:35.969 DEBUG:teuthology.orchestra.run.smithi088:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-04-26T23:39:36.078 DEBUG:teuthology.orchestra.run.smithi088:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-04-26T23:39:36.108 DEBUG:teuthology.orchestra.run.smithi088:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-04-26T23:39:36.172 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-26T23:39:36.172 INFO:tasks.ceph:role: osd.1 2024-04-26T23:39:36.172 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi088.front.sepia.ceph.com 2024-04-26T23:39:36.172 DEBUG:teuthology.orchestra.run.smithi088:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-26T23:39:36.243 INFO:teuthology.orchestra.run.smithi088.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-26T23:39:36.243 INFO:teuthology.orchestra.run.smithi088.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-26T23:39:36.243 INFO:teuthology.orchestra.run.smithi088.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-26T23:39:36.243 INFO:teuthology.orchestra.run.smithi088.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-26T23:39:36.243 INFO:teuthology.orchestra.run.smithi088.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-26T23:39:36.243 INFO:teuthology.orchestra.run.smithi088.stdout: = sunit=0 swidth=0 blks 2024-04-26T23:39:36.243 INFO:teuthology.orchestra.run.smithi088.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-26T23:39:36.243 INFO:teuthology.orchestra.run.smithi088.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-26T23:39:36.243 INFO:teuthology.orchestra.run.smithi088.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-26T23:39:36.243 INFO:teuthology.orchestra.run.smithi088.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-26T23:39:36.697 INFO:teuthology.orchestra.run.smithi088.stdout:Discarding blocks...Done. 2024-04-26T23:39:36.699 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi088.front.sepia.ceph.com -o noatime 2024-04-26T23:39:36.699 DEBUG:teuthology.orchestra.run.smithi088:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-04-26T23:39:36.773 DEBUG:teuthology.orchestra.run.smithi088:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-04-26T23:39:36.841 DEBUG:teuthology.orchestra.run.smithi088:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-04-26T23:39:36.904 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-26T23:39:36.904 INFO:tasks.ceph:role: osd.2 2024-04-26T23:39:36.904 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi088.front.sepia.ceph.com 2024-04-26T23:39:36.904 DEBUG:teuthology.orchestra.run.smithi088:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-04-26T23:39:36.975 INFO:teuthology.orchestra.run.smithi088.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-04-26T23:39:36.975 INFO:teuthology.orchestra.run.smithi088.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-26T23:39:36.975 INFO:teuthology.orchestra.run.smithi088.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-26T23:39:36.975 INFO:teuthology.orchestra.run.smithi088.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-26T23:39:36.975 INFO:teuthology.orchestra.run.smithi088.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-26T23:39:36.975 INFO:teuthology.orchestra.run.smithi088.stdout: = sunit=0 swidth=0 blks 2024-04-26T23:39:36.975 INFO:teuthology.orchestra.run.smithi088.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-26T23:39:36.975 INFO:teuthology.orchestra.run.smithi088.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-26T23:39:36.975 INFO:teuthology.orchestra.run.smithi088.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-26T23:39:36.975 INFO:teuthology.orchestra.run.smithi088.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-26T23:39:37.457 INFO:teuthology.orchestra.run.smithi088.stdout:Discarding blocks...Done. 2024-04-26T23:39:37.458 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi088.front.sepia.ceph.com -o noatime 2024-04-26T23:39:37.459 DEBUG:teuthology.orchestra.run.smithi088:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-04-26T23:39:37.559 DEBUG:teuthology.orchestra.run.smithi088:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-04-26T23:39:37.586 DEBUG:teuthology.orchestra.run.smithi088:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-04-26T23:39:37.651 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-26T23:39:37.651 INFO:tasks.ceph:role: osd.3 2024-04-26T23:39:37.651 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi088.front.sepia.ceph.com 2024-04-26T23:39:37.651 DEBUG:teuthology.orchestra.run.smithi088:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-04-26T23:39:37.723 INFO:teuthology.orchestra.run.smithi088.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-04-26T23:39:37.723 INFO:teuthology.orchestra.run.smithi088.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-26T23:39:37.724 INFO:teuthology.orchestra.run.smithi088.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-26T23:39:37.724 INFO:teuthology.orchestra.run.smithi088.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-26T23:39:37.724 INFO:teuthology.orchestra.run.smithi088.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-26T23:39:37.724 INFO:teuthology.orchestra.run.smithi088.stdout: = sunit=0 swidth=0 blks 2024-04-26T23:39:37.724 INFO:teuthology.orchestra.run.smithi088.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-26T23:39:37.724 INFO:teuthology.orchestra.run.smithi088.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-26T23:39:37.724 INFO:teuthology.orchestra.run.smithi088.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-26T23:39:37.724 INFO:teuthology.orchestra.run.smithi088.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-26T23:39:38.201 INFO:teuthology.orchestra.run.smithi088.stdout:Discarding blocks...Done. 2024-04-26T23:39:38.203 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi088.front.sepia.ceph.com -o noatime 2024-04-26T23:39:38.203 DEBUG:teuthology.orchestra.run.smithi088:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-04-26T23:39:38.313 DEBUG:teuthology.orchestra.run.smithi088:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-04-26T23:39:38.343 DEBUG:teuthology.orchestra.run.smithi088:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-26T23:39:38.433 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:39:38.430+0000 7f539bc10640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-04-26T23:39:38.435 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:39:38.433+0000 7f539bc10640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-04-26T23:39:38.436 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:39:38.433+0000 7f539bc10640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-26T23:39:38.436 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:39:38.433+0000 7f539bc10640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-26T23:39:38.436 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:39:38.433+0000 7f539bc10640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-26T23:39:38.437 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:39:38.435+0000 7f539bc10640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-04-26T23:39:41.286 DEBUG:teuthology.orchestra.run.smithi088:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-04-26T23:39:41.314 DEBUG:teuthology.orchestra.run.smithi088:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-26T23:39:41.401 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:39:41.397+0000 7f7372e10640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-04-26T23:39:41.401 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:39:41.398+0000 7f7372e10640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-04-26T23:39:41.401 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:39:41.398+0000 7f7372e10640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-26T23:39:41.401 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:39:41.398+0000 7f7372e10640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-26T23:39:41.401 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:39:41.398+0000 7f7372e10640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-26T23:39:41.401 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:39:41.398+0000 7f7372e10640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-04-26T23:39:44.254 DEBUG:teuthology.orchestra.run.smithi088:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-04-26T23:39:44.281 DEBUG:teuthology.orchestra.run.smithi088:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-26T23:39:44.377 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:39:44.373+0000 7f9654a9d640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-04-26T23:39:44.377 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:39:44.373+0000 7f9654a9d640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-04-26T23:39:44.377 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:39:44.374+0000 7f9654a9d640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-26T23:39:44.377 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:39:44.374+0000 7f9654a9d640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-26T23:39:44.378 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:39:44.374+0000 7f9654a9d640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-26T23:39:44.378 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:39:44.374+0000 7f9654a9d640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-04-26T23:39:47.229 DEBUG:teuthology.orchestra.run.smithi088:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-04-26T23:39:47.257 DEBUG:teuthology.orchestra.run.smithi088:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-26T23:39:47.344 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:39:47.340+0000 7fd6eb5b1640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-04-26T23:39:47.344 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:39:47.341+0000 7fd6eb5b1640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-04-26T23:39:47.345 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:39:47.341+0000 7fd6eb5b1640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-26T23:39:47.345 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:39:47.341+0000 7fd6eb5b1640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-26T23:39:47.345 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:39:47.341+0000 7fd6eb5b1640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-26T23:39:47.345 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:39:47.341+0000 7fd6eb5b1640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-04-26T23:39:50.202 DEBUG:teuthology.orchestra.run.smithi088:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-04-26T23:39:50.231 DEBUG:teuthology.orchestra.run.smithi175:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-04-26T23:39:50.260 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-26T23:39:50.260 INFO:tasks.ceph:role: osd.4 2024-04-26T23:39:50.260 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi175.front.sepia.ceph.com 2024-04-26T23:39:50.260 DEBUG:teuthology.orchestra.run.smithi175:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-26T23:39:50.335 INFO:teuthology.orchestra.run.smithi175.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-26T23:39:50.335 INFO:teuthology.orchestra.run.smithi175.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-26T23:39:50.335 INFO:teuthology.orchestra.run.smithi175.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-26T23:39:50.335 INFO:teuthology.orchestra.run.smithi175.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-26T23:39:50.335 INFO:teuthology.orchestra.run.smithi175.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-26T23:39:50.336 INFO:teuthology.orchestra.run.smithi175.stdout: = sunit=0 swidth=0 blks 2024-04-26T23:39:50.336 INFO:teuthology.orchestra.run.smithi175.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-26T23:39:50.336 INFO:teuthology.orchestra.run.smithi175.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-26T23:39:50.336 INFO:teuthology.orchestra.run.smithi175.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-26T23:39:50.336 INFO:teuthology.orchestra.run.smithi175.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-26T23:39:50.829 INFO:teuthology.orchestra.run.smithi175.stdout:Discarding blocks...Done. 2024-04-26T23:39:50.832 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi175.front.sepia.ceph.com -o noatime 2024-04-26T23:39:50.832 DEBUG:teuthology.orchestra.run.smithi175:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-04-26T23:39:50.957 DEBUG:teuthology.orchestra.run.smithi175:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-04-26T23:39:50.987 DEBUG:teuthology.orchestra.run.smithi175:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-04-26T23:39:51.051 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-26T23:39:51.051 INFO:tasks.ceph:role: osd.5 2024-04-26T23:39:51.051 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi175.front.sepia.ceph.com 2024-04-26T23:39:51.051 DEBUG:teuthology.orchestra.run.smithi175:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-26T23:39:51.123 INFO:teuthology.orchestra.run.smithi175.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-26T23:39:51.123 INFO:teuthology.orchestra.run.smithi175.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-26T23:39:51.123 INFO:teuthology.orchestra.run.smithi175.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-26T23:39:51.123 INFO:teuthology.orchestra.run.smithi175.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-26T23:39:51.123 INFO:teuthology.orchestra.run.smithi175.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-26T23:39:51.123 INFO:teuthology.orchestra.run.smithi175.stdout: = sunit=0 swidth=0 blks 2024-04-26T23:39:51.123 INFO:teuthology.orchestra.run.smithi175.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-26T23:39:51.123 INFO:teuthology.orchestra.run.smithi175.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-26T23:39:51.123 INFO:teuthology.orchestra.run.smithi175.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-26T23:39:51.123 INFO:teuthology.orchestra.run.smithi175.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-26T23:39:51.585 INFO:teuthology.orchestra.run.smithi175.stdout:Discarding blocks...Done. 2024-04-26T23:39:51.587 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi175.front.sepia.ceph.com -o noatime 2024-04-26T23:39:51.587 DEBUG:teuthology.orchestra.run.smithi175:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-04-26T23:39:51.676 DEBUG:teuthology.orchestra.run.smithi175:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-04-26T23:39:51.702 DEBUG:teuthology.orchestra.run.smithi175:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-04-26T23:39:51.767 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-26T23:39:51.767 INFO:tasks.ceph:role: osd.6 2024-04-26T23:39:51.767 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi175.front.sepia.ceph.com 2024-04-26T23:39:51.767 DEBUG:teuthology.orchestra.run.smithi175:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-04-26T23:39:51.837 INFO:teuthology.orchestra.run.smithi175.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-04-26T23:39:51.837 INFO:teuthology.orchestra.run.smithi175.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-26T23:39:51.837 INFO:teuthology.orchestra.run.smithi175.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-26T23:39:51.837 INFO:teuthology.orchestra.run.smithi175.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-26T23:39:51.838 INFO:teuthology.orchestra.run.smithi175.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-26T23:39:51.838 INFO:teuthology.orchestra.run.smithi175.stdout: = sunit=0 swidth=0 blks 2024-04-26T23:39:51.838 INFO:teuthology.orchestra.run.smithi175.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-26T23:39:51.838 INFO:teuthology.orchestra.run.smithi175.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-26T23:39:51.838 INFO:teuthology.orchestra.run.smithi175.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-26T23:39:51.838 INFO:teuthology.orchestra.run.smithi175.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-26T23:39:52.330 INFO:teuthology.orchestra.run.smithi175.stdout:Discarding blocks...Done. 2024-04-26T23:39:52.331 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi175.front.sepia.ceph.com -o noatime 2024-04-26T23:39:52.332 DEBUG:teuthology.orchestra.run.smithi175:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-04-26T23:39:52.475 DEBUG:teuthology.orchestra.run.smithi175:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-04-26T23:39:52.503 DEBUG:teuthology.orchestra.run.smithi175:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-04-26T23:39:52.568 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-26T23:39:52.568 INFO:tasks.ceph:role: osd.7 2024-04-26T23:39:52.568 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi175.front.sepia.ceph.com 2024-04-26T23:39:52.568 DEBUG:teuthology.orchestra.run.smithi175:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-04-26T23:39:52.639 INFO:teuthology.orchestra.run.smithi175.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-04-26T23:39:52.639 INFO:teuthology.orchestra.run.smithi175.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-26T23:39:52.639 INFO:teuthology.orchestra.run.smithi175.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-26T23:39:52.639 INFO:teuthology.orchestra.run.smithi175.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-26T23:39:52.639 INFO:teuthology.orchestra.run.smithi175.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-26T23:39:52.639 INFO:teuthology.orchestra.run.smithi175.stdout: = sunit=0 swidth=0 blks 2024-04-26T23:39:52.639 INFO:teuthology.orchestra.run.smithi175.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-26T23:39:52.639 INFO:teuthology.orchestra.run.smithi175.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-26T23:39:52.639 INFO:teuthology.orchestra.run.smithi175.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-26T23:39:52.639 INFO:teuthology.orchestra.run.smithi175.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-26T23:39:53.157 INFO:teuthology.orchestra.run.smithi175.stdout:Discarding blocks...Done. 2024-04-26T23:39:53.159 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi175.front.sepia.ceph.com -o noatime 2024-04-26T23:39:53.159 DEBUG:teuthology.orchestra.run.smithi175:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-04-26T23:39:53.297 DEBUG:teuthology.orchestra.run.smithi175:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-04-26T23:39:53.325 DEBUG:teuthology.orchestra.run.smithi175:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-26T23:39:53.414 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:39:53.410+0000 7fefdd54e640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-04-26T23:39:53.414 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:39:53.410+0000 7fefdd54e640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-04-26T23:39:53.414 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:39:53.410+0000 7fefdd54e640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-26T23:39:53.414 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:39:53.410+0000 7fefdd54e640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-26T23:39:53.414 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:39:53.410+0000 7fefdd54e640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-26T23:39:53.414 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:39:53.411+0000 7fefdd54e640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-04-26T23:39:56.260 DEBUG:teuthology.orchestra.run.smithi175:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-04-26T23:39:56.288 DEBUG:teuthology.orchestra.run.smithi175:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-26T23:39:56.378 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:39:56.374+0000 7f721c321640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-04-26T23:39:56.378 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:39:56.375+0000 7f721c321640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-04-26T23:39:56.378 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:39:56.375+0000 7f721c321640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-26T23:39:56.378 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:39:56.375+0000 7f721c321640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-26T23:39:56.378 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:39:56.375+0000 7f721c321640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-26T23:39:56.379 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:39:56.375+0000 7f721c321640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-04-26T23:39:59.225 DEBUG:teuthology.orchestra.run.smithi175:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-04-26T23:39:59.252 DEBUG:teuthology.orchestra.run.smithi175:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-26T23:39:59.339 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:39:59.335+0000 7f4309c20640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-04-26T23:39:59.339 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:39:59.335+0000 7f4309c20640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-04-26T23:39:59.339 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:39:59.335+0000 7f4309c20640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-26T23:39:59.339 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:39:59.335+0000 7f4309c20640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-26T23:39:59.339 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:39:59.335+0000 7f4309c20640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-26T23:39:59.339 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:39:59.335+0000 7f4309c20640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-04-26T23:40:02.185 DEBUG:teuthology.orchestra.run.smithi175:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-04-26T23:40:02.213 DEBUG:teuthology.orchestra.run.smithi175:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-26T23:40:02.301 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:02.297+0000 7efe98211640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-04-26T23:40:02.301 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:02.298+0000 7efe98211640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-04-26T23:40:02.301 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:02.298+0000 7efe98211640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-26T23:40:02.302 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:02.298+0000 7efe98211640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-26T23:40:02.302 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:02.298+0000 7efe98211640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-26T23:40:02.302 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:02.298+0000 7efe98211640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-04-26T23:40:02.441 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:40:02.444 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:40:05.162 DEBUG:teuthology.orchestra.run.smithi175:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-04-26T23:40:05.190 INFO:tasks.ceph:Reading keys from all nodes... 2024-04-26T23:40:05.190 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-04-26T23:40:05.190 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-04-26T23:40:05.219 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-04-26T23:40:05.219 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-04-26T23:40:05.287 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-04-26T23:40:05.287 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-04-26T23:40:05.354 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-04-26T23:40:05.354 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-04-26T23:40:05.421 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-04-26T23:40:05.421 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-04-26T23:40:05.487 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-04-26T23:40:05.487 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-04-26T23:40:05.552 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-04-26T23:40:05.552 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-04-26T23:40:05.617 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-26T23:40:05.617 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-04-26T23:40:05.645 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-26T23:40:05.645 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-04-26T23:40:05.713 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-26T23:40:05.713 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-04-26T23:40:05.779 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-26T23:40:05.780 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-04-26T23:40:05.846 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-26T23:40:05.846 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-04-26T23:40:05.911 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-26T23:40:05.911 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-04-26T23:40:05.976 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-26T23:40:05.976 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-04-26T23:40:06.040 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-04-26T23:40:06.041 DEBUG:teuthology.orchestra.run.smithi088:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-04-26T23:40:06.057 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-26T23:40:06.057 DEBUG:teuthology.orchestra.run.smithi175:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-04-26T23:40:06.095 INFO:tasks.ceph:Adding keys to all mons... 2024-04-26T23:40:06.096 DEBUG:teuthology.orchestra.run.smithi088:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-26T23:40:06.099 DEBUG:teuthology.orchestra.run.smithi175:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-26T23:40:06.139 INFO:teuthology.orchestra.run.smithi088.stdout:[mgr.y] 2024-04-26T23:40:06.139 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQA2OyxmmhsOMhAAbjPXpoZ/2V0caaNt0JM54A== 2024-04-26T23:40:06.139 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.a] 2024-04-26T23:40:06.139 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQA2OyxmR1qfOBAAJOEMHY8Io2WyzPWkEItD3g== 2024-04-26T23:40:06.139 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.c] 2024-04-26T23:40:06.139 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQA3Oyxm6taxAxAAIoZk3Opms79GX6MQeUe6ng== 2024-04-26T23:40:06.139 INFO:teuthology.orchestra.run.smithi088.stdout:[osd.0] 2024-04-26T23:40:06.140 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQA6OyxmWmOvGRAAY4BQhRJMi9mNHszqiqYcxA== 2024-04-26T23:40:06.140 INFO:teuthology.orchestra.run.smithi088.stdout:[osd.1] 2024-04-26T23:40:06.140 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQA9OyxmGz+9FxAAatAnoNgxwDYgBK0i5IGHjA== 2024-04-26T23:40:06.140 INFO:teuthology.orchestra.run.smithi088.stdout:[osd.2] 2024-04-26T23:40:06.140 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQBAOyxmS/5LFhAA5Vla5RUiJS8Z5wduGWQykQ== 2024-04-26T23:40:06.140 INFO:teuthology.orchestra.run.smithi088.stdout:[osd.3] 2024-04-26T23:40:06.140 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQBDOyxmwp9lFBAAG9cNJDPLjbGCOaaq+EURJA== 2024-04-26T23:40:06.140 INFO:teuthology.orchestra.run.smithi088.stdout:[mgr.x] 2024-04-26T23:40:06.140 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQA2OyxmN7ibNRAAKiZMju+d35cGtMcjnXdJgg== 2024-04-26T23:40:06.140 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.b] 2024-04-26T23:40:06.140 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQA3OyxmaDomCBAAmSibETFGYqzecGo5FsZ6YQ== 2024-04-26T23:40:06.140 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.d] 2024-04-26T23:40:06.140 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQA3OyxmU9XhDhAAf3/g92nQ5S9eU23VUzRQ0A== 2024-04-26T23:40:06.140 INFO:teuthology.orchestra.run.smithi088.stdout:[osd.4] 2024-04-26T23:40:06.140 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQBJOyxmAl+FGBAAhbA48kAgdeAG5sODO0jmjg== 2024-04-26T23:40:06.141 INFO:teuthology.orchestra.run.smithi088.stdout:[osd.5] 2024-04-26T23:40:06.141 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQBMOyxmH2xnFhAABKwtYg9Db8JpfJKwNE2h4Q== 2024-04-26T23:40:06.141 INFO:teuthology.orchestra.run.smithi088.stdout:[osd.6] 2024-04-26T23:40:06.141 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQBPOyxm8PEJFBAAvg6d+lf1gENX+2RS54N8bg== 2024-04-26T23:40:06.141 INFO:teuthology.orchestra.run.smithi088.stdout:[osd.7] 2024-04-26T23:40:06.141 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQBSOyxm7mzRERAAyZJyo/6iSYk7KIcT3TGOSQ== 2024-04-26T23:40:06.141 INFO:teuthology.orchestra.run.smithi088.stdout:[client.0] 2024-04-26T23:40:06.141 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQA3Oyxm9tu3EhAAOYRyaJWkzwSv2b+lDH4aPQ== 2024-04-26T23:40:06.141 INFO:teuthology.orchestra.run.smithi088.stdout:[client.1] 2024-04-26T23:40:06.141 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQA3OyxmOcC0FRAAnjEtcpQ4z9mXNZVkgUYRMQ== 2024-04-26T23:40:06.159 INFO:teuthology.orchestra.run.smithi175.stdout:[mgr.y] 2024-04-26T23:40:06.159 INFO:teuthology.orchestra.run.smithi175.stdout: key = AQA2OyxmmhsOMhAAbjPXpoZ/2V0caaNt0JM54A== 2024-04-26T23:40:06.159 INFO:teuthology.orchestra.run.smithi175.stdout:[mds.a] 2024-04-26T23:40:06.159 INFO:teuthology.orchestra.run.smithi175.stdout: key = AQA2OyxmR1qfOBAAJOEMHY8Io2WyzPWkEItD3g== 2024-04-26T23:40:06.159 INFO:teuthology.orchestra.run.smithi175.stdout:[mds.c] 2024-04-26T23:40:06.159 INFO:teuthology.orchestra.run.smithi175.stdout: key = AQA3Oyxm6taxAxAAIoZk3Opms79GX6MQeUe6ng== 2024-04-26T23:40:06.159 INFO:teuthology.orchestra.run.smithi175.stdout:[osd.0] 2024-04-26T23:40:06.159 INFO:teuthology.orchestra.run.smithi175.stdout: key = AQA6OyxmWmOvGRAAY4BQhRJMi9mNHszqiqYcxA== 2024-04-26T23:40:06.159 INFO:teuthology.orchestra.run.smithi175.stdout:[osd.1] 2024-04-26T23:40:06.159 INFO:teuthology.orchestra.run.smithi175.stdout: key = AQA9OyxmGz+9FxAAatAnoNgxwDYgBK0i5IGHjA== 2024-04-26T23:40:06.159 INFO:teuthology.orchestra.run.smithi175.stdout:[osd.2] 2024-04-26T23:40:06.159 INFO:teuthology.orchestra.run.smithi175.stdout: key = AQBAOyxmS/5LFhAA5Vla5RUiJS8Z5wduGWQykQ== 2024-04-26T23:40:06.159 INFO:teuthology.orchestra.run.smithi175.stdout:[osd.3] 2024-04-26T23:40:06.159 INFO:teuthology.orchestra.run.smithi175.stdout: key = AQBDOyxmwp9lFBAAG9cNJDPLjbGCOaaq+EURJA== 2024-04-26T23:40:06.159 INFO:teuthology.orchestra.run.smithi175.stdout:[mgr.x] 2024-04-26T23:40:06.160 INFO:teuthology.orchestra.run.smithi175.stdout: key = AQA2OyxmN7ibNRAAKiZMju+d35cGtMcjnXdJgg== 2024-04-26T23:40:06.160 INFO:teuthology.orchestra.run.smithi175.stdout:[mds.b] 2024-04-26T23:40:06.160 INFO:teuthology.orchestra.run.smithi175.stdout: key = AQA3OyxmaDomCBAAmSibETFGYqzecGo5FsZ6YQ== 2024-04-26T23:40:06.160 INFO:teuthology.orchestra.run.smithi175.stdout:[mds.d] 2024-04-26T23:40:06.160 INFO:teuthology.orchestra.run.smithi175.stdout: key = AQA3OyxmU9XhDhAAf3/g92nQ5S9eU23VUzRQ0A== 2024-04-26T23:40:06.160 INFO:teuthology.orchestra.run.smithi175.stdout:[osd.4] 2024-04-26T23:40:06.160 INFO:teuthology.orchestra.run.smithi175.stdout: key = AQBJOyxmAl+FGBAAhbA48kAgdeAG5sODO0jmjg== 2024-04-26T23:40:06.160 INFO:teuthology.orchestra.run.smithi175.stdout:[osd.5] 2024-04-26T23:40:06.160 INFO:teuthology.orchestra.run.smithi175.stdout: key = AQBMOyxmH2xnFhAABKwtYg9Db8JpfJKwNE2h4Q== 2024-04-26T23:40:06.160 INFO:teuthology.orchestra.run.smithi175.stdout:[osd.6] 2024-04-26T23:40:06.160 INFO:teuthology.orchestra.run.smithi175.stdout: key = AQBPOyxm8PEJFBAAvg6d+lf1gENX+2RS54N8bg== 2024-04-26T23:40:06.160 INFO:teuthology.orchestra.run.smithi175.stdout:[osd.7] 2024-04-26T23:40:06.160 INFO:teuthology.orchestra.run.smithi175.stdout: key = AQBSOyxm7mzRERAAyZJyo/6iSYk7KIcT3TGOSQ== 2024-04-26T23:40:06.160 INFO:teuthology.orchestra.run.smithi175.stdout:[client.0] 2024-04-26T23:40:06.160 INFO:teuthology.orchestra.run.smithi175.stdout: key = AQA3Oyxm9tu3EhAAOYRyaJWkzwSv2b+lDH4aPQ== 2024-04-26T23:40:06.160 INFO:teuthology.orchestra.run.smithi175.stdout:[client.1] 2024-04-26T23:40:06.161 INFO:teuthology.orchestra.run.smithi175.stdout: key = AQA3OyxmOcC0FRAAnjEtcpQ4z9mXNZVkgUYRMQ== 2024-04-26T23:40:06.161 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-26T23:40:06.185 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-26T23:40:06.251 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-26T23:40:06.253 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-26T23:40:06.305 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-26T23:40:06.307 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-26T23:40:06.358 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T23:40:06.361 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T23:40:06.409 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T23:40:06.411 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T23:40:06.459 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T23:40:06.461 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T23:40:06.509 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T23:40:06.511 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T23:40:06.559 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-26T23:40:06.562 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-26T23:40:06.610 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-26T23:40:06.612 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-26T23:40:06.663 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-26T23:40:06.665 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-26T23:40:06.717 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T23:40:06.719 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T23:40:06.767 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T23:40:06.769 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T23:40:06.817 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T23:40:06.819 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T23:40:06.867 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T23:40:06.869 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T23:40:06.918 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-26T23:40:06.920 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-26T23:40:06.972 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-26T23:40:06.974 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-26T23:40:07.025 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-04-26T23:40:07.025 DEBUG:teuthology.orchestra.run.smithi088:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-04-26T23:40:07.048 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-26T23:40:07.142 DEBUG:teuthology.orchestra.run.smithi088:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-04-26T23:40:07.165 DEBUG:teuthology.orchestra.run.smithi175:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-04-26T23:40:07.189 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-26T23:40:07.283 DEBUG:teuthology.orchestra.run.smithi175:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-04-26T23:40:07.306 DEBUG:teuthology.orchestra.run.smithi175:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-04-26T23:40:07.370 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-26T23:40:07.465 DEBUG:teuthology.orchestra.run.smithi175:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-04-26T23:40:07.488 DEBUG:teuthology.orchestra.run.smithi088:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-26T23:40:07.490 DEBUG:teuthology.orchestra.run.smithi175:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-26T23:40:07.542 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-04-26T23:40:07.543 INFO:tasks.ceph.mon.a:Restarting daemon 2024-04-26T23:40:07.543 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-04-26T23:40:07.545 INFO:tasks.ceph.mon.a:Started 2024-04-26T23:40:07.545 INFO:tasks.ceph.mon.b:Restarting daemon 2024-04-26T23:40:07.546 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-04-26T23:40:07.584 INFO:tasks.ceph.mon.b:Started 2024-04-26T23:40:07.584 INFO:tasks.ceph.mon.c:Restarting daemon 2024-04-26T23:40:07.584 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-04-26T23:40:07.586 INFO:tasks.ceph.mon.c:Started 2024-04-26T23:40:07.586 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-04-26T23:40:07.587 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-04-26T23:40:07.587 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-04-26T23:40:07.589 INFO:tasks.ceph.mgr.y:Started 2024-04-26T23:40:07.589 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-04-26T23:40:07.589 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-04-26T23:40:07.591 INFO:tasks.ceph.mgr.x:Started 2024-04-26T23:40:07.591 INFO:tasks.ceph:Setting crush tunables to default 2024-04-26T23:40:07.591 DEBUG:teuthology.orchestra.run.smithi088:> sudo ceph --cluster ceph osd crush tunables default 2024-04-26T23:40:07.689 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:07.685+0000 7fee8435f640 1 Processor -- start 2024-04-26T23:40:07.689 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:07.685+0000 7fee8435f640 1 -- start start 2024-04-26T23:40:07.691 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:07.686+0000 7fee8435f640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fee7c074620 0x7fee7c1582f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:07.691 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:07.686+0000 7fee8435f640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fee7c154920 con 0x7fee7c151e10 2024-04-26T23:40:07.691 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:07.686+0000 7fee8435f640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fee7c0c62c0 con 0x7fee7c158830 2024-04-26T23:40:07.691 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:07.686+0000 7fee8435f640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7fee7c074e90 con 0x7fee7c074620 2024-04-26T23:40:07.691 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:07.686+0000 7fee818fa640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fee7c074620 0x7fee7c1582f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:07.691 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:07.686+0000 7fee818fa640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fee7c074620 0x7fee7c1582f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:36554/0 (socket says 172.21.15.88:36554) 2024-04-26T23:40:07.692 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:07.686+0000 7fee818fa640 1 -- 172.21.15.88:0/4178236250 learned_addr learned my addr 172.21.15.88:0/4178236250 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:40:07.692 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:07.686+0000 7fee820fb640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fee7c151e10 0x7fee7c0ac4f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:46630/0 (socket says 172.21.15.88:46630) 2024-04-26T23:40:07.692 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:07.686+0000 7fee818fa640 1 -- 172.21.15.88:0/4178236250 >> v2:172.21.15.88:3300/0 conn(0x7fee7c074620 msgr2=0x7fee7c1582f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-26T23:40:07.692 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:07.686+0000 7fee818fa640 1 -- 172.21.15.88:0/4178236250 >> v2:172.21.15.88:3300/0 conn(0x7fee7c074620 msgr2=0x7fee7c1582f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T23:40:07.692 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:07.686+0000 7fee818fa640 1 --2- 172.21.15.88:0/4178236250 >> v2:172.21.15.88:3300/0 conn(0x7fee7c074620 0x7fee7c1582f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:40:07.692 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:07.686+0000 7fee818fa640 1 --2- 172.21.15.88:0/4178236250 >> v2:172.21.15.88:3300/0 conn(0x7fee7c074620 0x7fee7c1582f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:40:07.850 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:07.844+0000 7fee810f9640 1 -- 172.21.15.88:0/4178236250 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 516446885 0 0) 0x7fee7c154920 con 0x7fee7c151e10 2024-04-26T23:40:07.850 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:07.844+0000 7fee810f9640 1 -- 172.21.15.88:0/4178236250 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fee68003520 con 0x7fee7c151e10 2024-04-26T23:40:07.850 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:07.844+0000 7fee810f9640 1 -- 172.21.15.88:0/4178236250 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3045369172 0 0) 0x7fee68003520 con 0x7fee7c151e10 2024-04-26T23:40:07.850 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:07.844+0000 7fee810f9640 1 -- 172.21.15.88:0/4178236250 >> v2:172.21.15.88:3300/0 conn(0x7fee7c074620 msgr2=0x7fee7c1582f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T23:40:07.850 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:07.844+0000 7fee810f9640 1 --2- 172.21.15.88:0/4178236250 >> v2:172.21.15.88:3300/0 conn(0x7fee7c074620 0x7fee7c1582f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:07.850 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:07.844+0000 7fee810f9640 1 -- 172.21.15.88:0/4178236250 >> v1:172.21.15.175:6789/0 conn(0x7fee7c158830 legacy=0x7fee7c15f2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:07.850 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:07.844+0000 7fee810f9640 1 -- 172.21.15.88:0/4178236250 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee7c0c65a0 con 0x7fee7c151e10 2024-04-26T23:40:07.850 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:07.844+0000 7fee810f9640 1 -- 172.21.15.88:0/4178236250 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 356324787 0 0) 0x7fee78001670 con 0x7fee7c151e10 2024-04-26T23:40:07.851 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:07.844+0000 7fee810f9640 1 -- 172.21.15.88:0/4178236250 >> v1:172.21.15.88:6789/0 conn(0x7fee7c151e10 legacy=0x7fee7c0ac4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:07.851 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:07.844+0000 7fee810f9640 1 --2- 172.21.15.88:0/4178236250 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fee680039b0 0x7fee68003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:07.851 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:07.844+0000 7fee810f9640 1 --2- 172.21.15.88:0/4178236250 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fee68004800 0x7fee68004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:07.851 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:07.844+0000 7fee810f9640 1 --2- 172.21.15.88:0/4178236250 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fee680052e0 0x7fee6800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:07.851 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:07.844+0000 7fee810f9640 1 -- 172.21.15.88:0/4178236250 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fee6800c180 con 0x7fee680052e0 2024-04-26T23:40:07.851 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:07.844+0000 7fee810f9640 1 -- 172.21.15.88:0/4178236250 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fee6800c330 con 0x7fee68004800 2024-04-26T23:40:07.851 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:07.844+0000 7fee810f9640 1 -- 172.21.15.88:0/4178236250 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fee6800c530 con 0x7fee680039b0 2024-04-26T23:40:07.851 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:07.844+0000 7fee828fc640 1 --2- 172.21.15.88:0/4178236250 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fee680052e0 0x7fee6800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:07.851 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:07.844+0000 7fee820fb640 1 --2- 172.21.15.88:0/4178236250 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fee680039b0 0x7fee68003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:07.851 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:07.844+0000 7fee818fa640 1 --2- 172.21.15.88:0/4178236250 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fee68004800 0x7fee68004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:07.851 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:07.844+0000 7fee828fc640 1 -- 172.21.15.88:0/4178236250 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fee680039b0 msgr2=0x7fee68003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:40:07.851 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:07.844+0000 7fee828fc640 1 --2- 172.21.15.88:0/4178236250 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fee680039b0 0x7fee68003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:07.851 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:07.844+0000 7fee828fc640 1 -- 172.21.15.88:0/4178236250 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fee68004800 msgr2=0x7fee68004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:40:07.851 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:07.844+0000 7fee828fc640 1 --2- 172.21.15.88:0/4178236250 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fee68004800 0x7fee68004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:07.851 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:07.844+0000 7fee828fc640 1 -- 172.21.15.88:0/4178236250 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee68003520 con 0x7fee680052e0 2024-04-26T23:40:07.852 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:07.844+0000 7fee818fa640 1 --2- 172.21.15.88:0/4178236250 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fee68004800 0x7fee68004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:40:07.852 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:07.845+0000 7fee828fc640 1 -- 172.21.15.88:0/4178236250 reap_dead start 2024-04-26T23:40:07.852 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:07.845+0000 7fee828fc640 1 --2- 172.21.15.88:0/4178236250 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fee680052e0 0x7fee6800b9c0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fee74001e20 tx=0x7fee68005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef5142234258cebb server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:07.852 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:07.846+0000 7fee810f9640 1 -- 172.21.15.88:0/4178236250 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee74001a70 con 0x7fee680052e0 2024-04-26T23:40:07.852 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:07.846+0000 7fee810f9640 1 -- 172.21.15.88:0/4178236250 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee7402ae40 con 0x7fee680052e0 2024-04-26T23:40:07.852 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:07.846+0000 7fee810f9640 1 -- 172.21.15.88:0/4178236250 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee74003b90 con 0x7fee680052e0 2024-04-26T23:40:07.855 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:07.847+0000 7fee8435f640 1 -- 172.21.15.88:0/4178236250 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fee680052e0 msgr2=0x7fee6800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:07.855 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:07.847+0000 7fee8435f640 1 --2- 172.21.15.88:0/4178236250 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fee680052e0 0x7fee6800b9c0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fee74001e20 tx=0x7fee68005830 comp rx=0 tx=0).stop 2024-04-26T23:40:07.855 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:07.847+0000 7fee8435f640 1 -- 172.21.15.88:0/4178236250 shutdown_connections 2024-04-26T23:40:07.855 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:07.847+0000 7fee8435f640 1 --2- 172.21.15.88:0/4178236250 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fee680052e0 0x7fee6800b9c0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:07.855 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:07.847+0000 7fee8435f640 1 -- 172.21.15.88:0/4178236250 >> 172.21.15.88:0/4178236250 conn(0x7fee7c0ca2f0 msgr2=0x7fee7c0ca700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:40:07.855 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:07.847+0000 7fee8435f640 1 -- 172.21.15.88:0/4178236250 shutdown_connections 2024-04-26T23:40:07.855 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:07.847+0000 7fee8435f640 1 -- 172.21.15.88:0/4178236250 wait complete. 2024-04-26T23:40:07.855 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:07.848+0000 7fee8435f640 1 Processor -- start 2024-04-26T23:40:07.855 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:07.848+0000 7fee8435f640 1 -- start start 2024-04-26T23:40:07.855 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:07.849+0000 7fee8435f640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fee680052e0 0x7fee7c06d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:07.855 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:07.849+0000 7fee8435f640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fee7c1572d0 0x7fee7c0c3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:07.856 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:07.849+0000 7fee8435f640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fee7c0c8f80 0x7fee7c1ec5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:07.856 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:07.849+0000 7fee8435f640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fee7c0c5f50 con 0x7fee7c1572d0 2024-04-26T23:40:07.856 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:07.849+0000 7fee8435f640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fee7c0c6b60 con 0x7fee680052e0 2024-04-26T23:40:07.856 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:07.849+0000 7fee8435f640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fee7c158ce0 con 0x7fee7c0c8f80 2024-04-26T23:40:07.856 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:07.849+0000 7fee818fa640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fee7c1572d0 0x7fee7c0c3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:07.856 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:07.849+0000 7fee818fa640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fee7c1572d0 0x7fee7c0c3990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:36568/0 (socket says 172.21.15.88:36568) 2024-04-26T23:40:07.856 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:07.849+0000 7fee818fa640 1 -- 172.21.15.88:0/1334449430 learned_addr learned my addr 172.21.15.88:0/1334449430 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:40:07.856 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:07.849+0000 7fee820fb640 1 --2- 172.21.15.88:0/1334449430 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fee680052e0 0x7fee7c06d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:07.856 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:07.849+0000 7fee828fc640 1 --2- 172.21.15.88:0/1334449430 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fee7c0c8f80 0x7fee7c1ec5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:07.856 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:07.849+0000 7fee818fa640 1 -- 172.21.15.88:0/1334449430 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fee7c0c8f80 msgr2=0x7fee7c1ec5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:07.856 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:07.849+0000 7fee818fa640 1 --2- 172.21.15.88:0/1334449430 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fee7c0c8f80 0x7fee7c1ec5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:07.856 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:07.849+0000 7fee818fa640 1 -- 172.21.15.88:0/1334449430 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fee680052e0 msgr2=0x7fee7c06d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:07.856 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:07.849+0000 7fee818fa640 1 --2- 172.21.15.88:0/1334449430 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fee680052e0 0x7fee7c06d1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:07.856 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:07.849+0000 7fee818fa640 1 -- 172.21.15.88:0/1334449430 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee7c0c9850 con 0x7fee7c1572d0 2024-04-26T23:40:07.857 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:07.849+0000 7fee818fa640 1 --2- 172.21.15.88:0/1334449430 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fee7c1572d0 0x7fee7c0c3990 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fee6c0108c0 tx=0x7fee6c010cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:07.857 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:07.850+0000 7fee72ffd640 1 -- 172.21.15.88:0/1334449430 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee6c01a070 con 0x7fee7c1572d0 2024-04-26T23:40:07.857 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:07.850+0000 7fee72ffd640 1 -- 172.21.15.88:0/1334449430 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee6c004220 con 0x7fee7c1572d0 2024-04-26T23:40:07.857 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:07.850+0000 7fee8435f640 1 -- 172.21.15.88:0/1334449430 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee7c0c9b30 con 0x7fee7c1572d0 2024-04-26T23:40:07.857 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:07.850+0000 7fee72ffd640 1 -- 172.21.15.88:0/1334449430 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee6c00f040 con 0x7fee7c1572d0 2024-04-26T23:40:07.857 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:07.850+0000 7fee8435f640 1 -- 172.21.15.88:0/1334449430 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee7c0c3ed0 con 0x7fee7c1572d0 2024-04-26T23:40:07.857 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:07.850+0000 7fee72ffd640 1 -- 172.21.15.88:0/1334449430 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fee6c00c730 con 0x7fee7c1572d0 2024-04-26T23:40:07.857 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:07.850+0000 7fee72ffd640 1 -- 172.21.15.88:0/1334449430 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fee6c003dc0 con 0x7fee7c1572d0 2024-04-26T23:40:07.857 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:07.851+0000 7fee8435f640 1 -- 172.21.15.88:0/1334449430 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fee7c0766c0 con 0x7fee7c1572d0 2024-04-26T23:40:07.857 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:07.853+0000 7fee72ffd640 1 -- 172.21.15.88:0/1334449430 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7fee6c003610 con 0x7fee7c1572d0 2024-04-26T23:40:07.923 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:07.919+0000 7fee8435f640 1 -- 172.21.15.88:0/1334449430 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7fee7c0507a0 con 0x7fee7c1572d0 2024-04-26T23:40:07.924 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:07.920+0000 7fee72ffd640 1 -- 172.21.15.88:0/1334449430 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7fee6c0037f0 con 0x7fee7c1572d0 2024-04-26T23:40:07.924 INFO:teuthology.orchestra.run.smithi088.stderr:adjusted tunables profile to default 2024-04-26T23:40:07.925 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:07.921+0000 7fee8435f640 1 -- 172.21.15.88:0/1334449430 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fee7c1572d0 msgr2=0x7fee7c0c3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:07.925 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:07.921+0000 7fee8435f640 1 --2- 172.21.15.88:0/1334449430 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fee7c1572d0 0x7fee7c0c3990 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fee6c0108c0 tx=0x7fee6c010cc0 comp rx=0 tx=0).stop 2024-04-26T23:40:07.926 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:07.921+0000 7fee8435f640 1 -- 172.21.15.88:0/1334449430 shutdown_connections 2024-04-26T23:40:07.926 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:07.921+0000 7fee8435f640 1 --2- 172.21.15.88:0/1334449430 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fee7c0c8f80 0x7fee7c1ec5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:07.926 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:07.921+0000 7fee8435f640 1 --2- 172.21.15.88:0/1334449430 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fee7c1572d0 0x7fee7c0c3990 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:07.926 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:07.921+0000 7fee8435f640 1 --2- 172.21.15.88:0/1334449430 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fee680052e0 0x7fee7c06d1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:07.926 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:07.921+0000 7fee8435f640 1 -- 172.21.15.88:0/1334449430 >> 172.21.15.88:0/1334449430 conn(0x7fee7c0ca2f0 msgr2=0x7fee7c151130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:40:07.926 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:07.922+0000 7fee8435f640 1 -- 172.21.15.88:0/1334449430 shutdown_connections 2024-04-26T23:40:07.926 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:07.922+0000 7fee8435f640 1 -- 172.21.15.88:0/1334449430 wait complete. 2024-04-26T23:40:07.936 INFO:tasks.ceph:check_enable_crimson: False 2024-04-26T23:40:07.936 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-04-26T23:40:07.936 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-04-26T23:40:07.936 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-04-26T23:40:07.959 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-04-26T23:40:07.959 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-04-26T23:40:07.966 INFO:tasks.ceph.mgr.x.smithi175.stderr:2024-04-26T23:40:07.963+0000 7f32091bc040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-26T23:40:07.970 INFO:tasks.ceph.mgr.y.smithi088.stderr:2024-04-26T23:40:07.966+0000 7f7100920040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-26T23:40:07.993 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-04-26T23:40:07.993 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-04-26T23:40:08.057 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-04-26T23:40:08.057 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-04-26T23:40:08.108 INFO:tasks.ceph.mgr.x.smithi175.stderr:2024-04-26T23:40:08.104+0000 7f32091bc040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-26T23:40:08.118 INFO:tasks.ceph.mgr.y.smithi088.stderr:2024-04-26T23:40:08.114+0000 7f7100920040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-26T23:40:08.120 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-26T23:40:08.120 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-04-26T23:40:08.144 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-26T23:40:08.144 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-04-26T23:40:08.163 INFO:tasks.ceph.mgr.x.smithi175.stderr:2024-04-26T23:40:08.159+0000 7f32091bc040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-26T23:40:08.172 INFO:tasks.ceph.mgr.y.smithi088.stderr:2024-04-26T23:40:08.169+0000 7f7100920040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-26T23:40:08.186 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-26T23:40:08.186 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-04-26T23:40:08.250 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-26T23:40:08.250 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-04-26T23:40:08.314 DEBUG:teuthology.orchestra.run.smithi175:> sudo ceph --cluster ceph osd new 92aecea3-ed62-4a29-87c0-76758a0816a5 0 2024-04-26T23:40:08.413 INFO:tasks.ceph.mgr.y.smithi088.stderr:2024-04-26T23:40:08.409+0000 7f7100920040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-26T23:40:08.419 INFO:tasks.ceph.mgr.x.smithi175.stderr:2024-04-26T23:40:08.416+0000 7f32091bc040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-26T23:40:08.452 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:08.449+0000 7f1d05371640 1 Processor -- start 2024-04-26T23:40:08.453 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:08.449+0000 7f1d05371640 1 -- start start 2024-04-26T23:40:08.454 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:08.450+0000 7f1d05371640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1d00154830 0x7f1d000bed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:08.454 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:08.450+0000 7f1d05371640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f1d000c4730 0x7f1d0006ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:08.454 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:08.450+0000 7f1d05371640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1d000c0190 con 0x7f1d000704d0 2024-04-26T23:40:08.454 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:08.450+0000 7f1d05371640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f1d00074c70 con 0x7f1d000c4730 2024-04-26T23:40:08.454 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:08.450+0000 7f1d05371640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f1d000bff40 con 0x7f1d00154830 2024-04-26T23:40:08.454 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:08.450+0000 7f1cfe7fc640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f1d000c4730 0x7f1d0006ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:08.454 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:08.450+0000 7f1cfeffd640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1d00154830 0x7f1d000bed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:08.454 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:08.450+0000 7f1cfe7fc640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f1d000c4730 0x7f1d0006ff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:48344/0 (socket says 172.21.15.175:48344) 2024-04-26T23:40:08.455 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:08.450+0000 7f1cfe7fc640 1 -- 172.21.15.175:0/223876327 learned_addr learned my addr 172.21.15.175:0/223876327 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-26T23:40:08.455 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:08.450+0000 7f1cfeffd640 1 -- 172.21.15.175:0/223876327 >> v2:172.21.15.175:3300/0 conn(0x7f1d000c4730 msgr2=0x7f1d0006ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:40:08.455 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:08.450+0000 7f1cfeffd640 1 --2- 172.21.15.175:0/223876327 >> v2:172.21.15.175:3300/0 conn(0x7f1d000c4730 0x7f1d0006ff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:08.455 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:08.450+0000 7f1cfeffd640 1 -- 172.21.15.175:0/223876327 >> v1:172.21.15.88:6789/0 conn(0x7f1d000704d0 legacy=0x7f1d000c4c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:08.455 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:08.450+0000 7f1cfeffd640 1 -- 172.21.15.175:0/223876327 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d0006f1d0 con 0x7f1d00154830 2024-04-26T23:40:08.455 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:08.450+0000 7f1cfe7fc640 1 --2- 172.21.15.175:0/223876327 >> v2:172.21.15.175:3300/0 conn(0x7f1d000c4730 0x7f1d0006ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:40:08.456 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:08.451+0000 7f1cfeffd640 1 --2- 172.21.15.175:0/223876327 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1d00154830 0x7f1d000bed60 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f1cf40097a0 tx=0x7f1cf402a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9a798399557a00de server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:08.456 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:08.452+0000 7f1cfdffb640 1 -- 172.21.15.175:0/223876327 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cf4037070 con 0x7f1d00154830 2024-04-26T23:40:08.456 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:08.452+0000 7f1cfdffb640 1 -- 172.21.15.175:0/223876327 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1cf402ae50 con 0x7f1d00154830 2024-04-26T23:40:08.456 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:08.452+0000 7f1cfdffb640 1 -- 172.21.15.175:0/223876327 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cf4032660 con 0x7f1d00154830 2024-04-26T23:40:08.456 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:08.452+0000 7f1d05371640 1 -- 172.21.15.175:0/223876327 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1d00154830 msgr2=0x7f1d000bed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:08.456 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:08.452+0000 7f1d05371640 1 --2- 172.21.15.175:0/223876327 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1d00154830 0x7f1d000bed60 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f1cf40097a0 tx=0x7f1cf402a100 comp rx=0 tx=0).stop 2024-04-26T23:40:08.457 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:08.452+0000 7f1d05371640 1 -- 172.21.15.175:0/223876327 shutdown_connections 2024-04-26T23:40:08.457 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:08.452+0000 7f1d05371640 1 --2- 172.21.15.175:0/223876327 >> v2:172.21.15.175:3300/0 conn(0x7f1d000c4730 0x7f1d0006ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:08.457 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:08.452+0000 7f1d05371640 1 --2- 172.21.15.175:0/223876327 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1d00154830 0x7f1d000bed60 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:08.457 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:08.452+0000 7f1d05371640 1 -- 172.21.15.175:0/223876327 >> 172.21.15.175:0/223876327 conn(0x7f1d000c91e0 msgr2=0x7f1d000c95f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:40:08.457 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:08.452+0000 7f1d05371640 1 -- 172.21.15.175:0/223876327 shutdown_connections 2024-04-26T23:40:08.457 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:08.452+0000 7f1d05371640 1 -- 172.21.15.175:0/223876327 wait complete. 2024-04-26T23:40:08.459 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:08.454+0000 7f1d05371640 1 Processor -- start 2024-04-26T23:40:08.459 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:08.454+0000 7f1d05371640 1 -- start start 2024-04-26T23:40:08.460 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:08.454+0000 7f1d05371640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1d000704d0 0x7f1d00155100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:08.460 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:08.454+0000 7f1d05371640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1d000c4730 0x7f1d0006cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:08.460 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:08.454+0000 7f1d05371640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1d00154830 0x7f1d001ecb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:08.460 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:08.454+0000 7f1d05371640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f1d000c5390 con 0x7f1d000704d0 2024-04-26T23:40:08.460 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:08.454+0000 7f1d05371640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f1d0006f820 con 0x7f1d00154830 2024-04-26T23:40:08.460 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:08.454+0000 7f1d05371640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f1d000c5510 con 0x7f1d000c4730 2024-04-26T23:40:08.460 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:08.454+0000 7f1cfe7fc640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1d000c4730 0x7f1d0006cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:08.460 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:08.454+0000 7f1cff7fe640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1d00154830 0x7f1d001ecb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:08.460 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:08.454+0000 7f1cfe7fc640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1d000c4730 0x7f1d0006cd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.175:33020/0 (socket says 172.21.15.175:33020) 2024-04-26T23:40:08.460 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:08.454+0000 7f1cff7fe640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1d00154830 0x7f1d001ecb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:48354/0 (socket says 172.21.15.175:48354) 2024-04-26T23:40:08.460 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:08.454+0000 7f1cfe7fc640 1 -- 172.21.15.175:0/4140047076 learned_addr learned my addr 172.21.15.175:0/4140047076 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-26T23:40:08.460 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:08.454+0000 7f1cfeffd640 1 --2- 172.21.15.175:0/4140047076 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1d000704d0 0x7f1d00155100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:08.460 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:08.455+0000 7f1cfe7fc640 1 -- 172.21.15.175:0/4140047076 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1d00154830 msgr2=0x7f1d001ecb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:08.460 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:08.455+0000 7f1cfe7fc640 1 --2- 172.21.15.175:0/4140047076 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1d00154830 0x7f1d001ecb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:08.460 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:08.455+0000 7f1cfe7fc640 1 -- 172.21.15.175:0/4140047076 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1d000704d0 msgr2=0x7f1d00155100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:08.461 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:08.455+0000 7f1cfe7fc640 1 --2- 172.21.15.175:0/4140047076 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1d000704d0 0x7f1d00155100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:08.461 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:08.455+0000 7f1cfe7fc640 1 -- 172.21.15.175:0/4140047076 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d00155870 con 0x7f1d000c4730 2024-04-26T23:40:08.461 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:08.455+0000 7f1cff7fe640 1 --2- 172.21.15.175:0/4140047076 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1d00154830 0x7f1d001ecb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:40:08.461 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:08.455+0000 7f1cfe7fc640 1 --2- 172.21.15.175:0/4140047076 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1d000c4730 0x7f1d0006cd40 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f1cf000e9d0 tx=0x7f1cf000ee90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:08.461 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:08.455+0000 7f1ce77fe640 1 -- 172.21.15.175:0/4140047076 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cf0017070 con 0x7f1d000c4730 2024-04-26T23:40:08.461 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:08.455+0000 7f1ce77fe640 1 -- 172.21.15.175:0/4140047076 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1cf000ca60 con 0x7f1d000c4730 2024-04-26T23:40:08.461 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:08.455+0000 7f1d05371640 1 -- 172.21.15.175:0/4140047076 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d001572a0 con 0x7f1d000c4730 2024-04-26T23:40:08.461 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:08.455+0000 7f1ce77fe640 1 -- 172.21.15.175:0/4140047076 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cf000ce10 con 0x7f1d000c4730 2024-04-26T23:40:08.461 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:08.455+0000 7f1d05371640 1 -- 172.21.15.175:0/4140047076 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d0006d280 con 0x7f1d000c4730 2024-04-26T23:40:08.461 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:08.455+0000 7f1ce77fe640 1 -- 172.21.15.175:0/4140047076 <== mon.2 v2:172.21.15.175:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f1cf001a070 con 0x7f1d000c4730 2024-04-26T23:40:08.461 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:08.455+0000 7f1ce77fe640 1 -- 172.21.15.175:0/4140047076 <== mon.2 v2:172.21.15.175:3301/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7f1cf001c820 con 0x7f1d000c4730 2024-04-26T23:40:08.461 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:08.456+0000 7f1d05371640 1 -- 172.21.15.175:0/4140047076 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d00068dc0 con 0x7f1d000c4730 2024-04-26T23:40:08.462 INFO:tasks.ceph.mgr.y.smithi088.stderr:2024-04-26T23:40:08.454+0000 7f7100920040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-26T23:40:08.462 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:08.458+0000 7f1ce77fe640 1 -- 172.21.15.175:0/4140047076 <== mon.2 v2:172.21.15.175:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f1cf0013470 con 0x7f1d000c4730 2024-04-26T23:40:08.468 INFO:tasks.ceph.mgr.x.smithi175.stderr:2024-04-26T23:40:08.465+0000 7f32091bc040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-26T23:40:08.532 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:08.529+0000 7f1d05371640 1 -- 172.21.15.175:0/4140047076 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "osd new", "uuid": "92aecea3-ed62-4a29-87c0-76758a0816a5", "id": 0} v 0) -- 0x7f1d000507a0 con 0x7f1d000c4730 2024-04-26T23:40:08.535 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:08.532+0000 7f1ce77fe640 1 -- 172.21.15.175:0/4140047076 <== mon.2 v2:172.21.15.175:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "92aecea3-ed62-4a29-87c0-76758a0816a5", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7f1cf0005990 con 0x7f1d000c4730 2024-04-26T23:40:08.535 INFO:teuthology.orchestra.run.smithi175.stdout:0 2024-04-26T23:40:08.536 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:08.532+0000 7f1d05371640 1 -- 172.21.15.175:0/4140047076 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1d000c4730 msgr2=0x7f1d0006cd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:08.536 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:08.533+0000 7f1d05371640 1 --2- 172.21.15.175:0/4140047076 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1d000c4730 0x7f1d0006cd40 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f1cf000e9d0 tx=0x7f1cf000ee90 comp rx=0 tx=0).stop 2024-04-26T23:40:08.536 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:08.533+0000 7f1d05371640 1 -- 172.21.15.175:0/4140047076 shutdown_connections 2024-04-26T23:40:08.536 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:08.533+0000 7f1d05371640 1 --2- 172.21.15.175:0/4140047076 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1d000c4730 0x7f1d0006cd40 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:08.537 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:08.533+0000 7f1d05371640 1 --2- 172.21.15.175:0/4140047076 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1d00154830 0x7f1d001ecb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:08.537 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:08.533+0000 7f1d05371640 1 --2- 172.21.15.175:0/4140047076 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1d000704d0 0x7f1d00155100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:08.537 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:08.533+0000 7f1d05371640 1 -- 172.21.15.175:0/4140047076 >> 172.21.15.175:0/4140047076 conn(0x7f1d000c91e0 msgr2=0x7f1d00075f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:40:08.537 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:08.533+0000 7f1d05371640 1 -- 172.21.15.175:0/4140047076 shutdown_connections 2024-04-26T23:40:08.537 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:08.533+0000 7f1d05371640 1 -- 172.21.15.175:0/4140047076 wait complete. 2024-04-26T23:40:08.547 DEBUG:teuthology.orchestra.run.smithi175:> sudo ceph --cluster ceph osd new 7a6f0fa9-23d0-4747-880f-798d45ec5eeb 1 2024-04-26T23:40:08.643 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:08.639+0000 7fd76d919640 1 Processor -- start 2024-04-26T23:40:08.643 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:08.639+0000 7fd76d919640 1 -- start start 2024-04-26T23:40:08.644 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:08.640+0000 7fd76d919640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd76806f8a0 0x7fd7680c3f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:08.644 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:08.640+0000 7fd76d919640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fd768158980 0x7fd76806d320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:08.644 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:08.640+0000 7fd76d919640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd768154a90 con 0x7fd76814eb50 2024-04-26T23:40:08.644 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:08.640+0000 7fd76d919640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7fd7680c5080 con 0x7fd768158980 2024-04-26T23:40:08.644 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:08.640+0000 7fd76d919640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fd768155930 con 0x7fd76806f8a0 2024-04-26T23:40:08.645 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:08.640+0000 7fd7677fe640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fd768158980 0x7fd76806d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:08.645 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:08.640+0000 7fd7667fc640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd76806f8a0 0x7fd7680c3f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:08.645 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:08.640+0000 7fd7677fe640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fd768158980 0x7fd76806d320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:58308/0 (socket says 172.21.15.175:58308) 2024-04-26T23:40:08.645 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:08.640+0000 7fd7667fc640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd76806f8a0 0x7fd7680c3f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.175:46106/0 (socket says 172.21.15.175:46106) 2024-04-26T23:40:08.645 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:08.640+0000 7fd7677fe640 1 -- 172.21.15.175:0/4103907453 learned_addr learned my addr 172.21.15.175:0/4103907453 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-26T23:40:08.645 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:08.641+0000 7fd7677fe640 1 -- 172.21.15.175:0/4103907453 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd76806f8a0 msgr2=0x7fd7680c3f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:40:08.645 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:08.641+0000 7fd7677fe640 1 --2- 172.21.15.175:0/4103907453 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd76806f8a0 0x7fd7680c3f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:08.645 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:08.641+0000 7fd7677fe640 1 -- 172.21.15.175:0/4103907453 >> v1:172.21.15.88:6789/0 conn(0x7fd76814eb50 legacy=0x7fd768155220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:40:08.645 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:08.641+0000 7fd7677fe640 1 -- 172.21.15.175:0/4103907453 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd76806ff90 con 0x7fd768158980 2024-04-26T23:40:08.645 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:08.641+0000 7fd7667fc640 1 --2- 172.21.15.175:0/4103907453 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd76806f8a0 0x7fd7680c3f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:40:08.647 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:08.642+0000 7fd7677fe640 1 --2- 172.21.15.175:0/4103907453 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd768158980 0x7fd76806d320 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fd760009e50 tx=0x7fd76002a710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6cc5b0511a60223b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:08.647 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:08.642+0000 7fd765ffb640 1 -- 172.21.15.175:0/4103907453 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd760036070 con 0x7fd768158980 2024-04-26T23:40:08.647 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:08.642+0000 7fd765ffb640 1 -- 172.21.15.175:0/4103907453 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd760031600 con 0x7fd768158980 2024-04-26T23:40:08.647 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:08.642+0000 7fd765ffb640 1 -- 172.21.15.175:0/4103907453 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7600319d0 con 0x7fd768158980 2024-04-26T23:40:08.647 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:08.642+0000 7fd76d919640 1 -- 172.21.15.175:0/4103907453 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd768158980 msgr2=0x7fd76806d320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:08.647 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:08.642+0000 7fd76d919640 1 --2- 172.21.15.175:0/4103907453 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd768158980 0x7fd76806d320 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fd760009e50 tx=0x7fd76002a710 comp rx=0 tx=0).stop 2024-04-26T23:40:08.647 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:08.642+0000 7fd76d919640 1 -- 172.21.15.175:0/4103907453 shutdown_connections 2024-04-26T23:40:08.647 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:08.642+0000 7fd76d919640 1 --2- 172.21.15.175:0/4103907453 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd768158980 0x7fd76806d320 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:08.647 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:08.642+0000 7fd76d919640 1 --2- 172.21.15.175:0/4103907453 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd76806f8a0 0x7fd7680c3f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:08.647 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:08.642+0000 7fd76d919640 1 -- 172.21.15.175:0/4103907453 >> 172.21.15.175:0/4103907453 conn(0x7fd7680c5d70 msgr2=0x7fd7680c6180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:40:08.647 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:08.643+0000 7fd76d919640 1 -- 172.21.15.175:0/4103907453 shutdown_connections 2024-04-26T23:40:08.647 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:08.643+0000 7fd76d919640 1 -- 172.21.15.175:0/4103907453 wait complete. 2024-04-26T23:40:08.647 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:08.644+0000 7fd76d919640 1 Processor -- start 2024-04-26T23:40:08.650 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:08.644+0000 7fd76d919640 1 -- start start 2024-04-26T23:40:08.650 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:08.644+0000 7fd76d919640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd76806f8a0 0x7fd76806c580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:08.650 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:08.644+0000 7fd76d919640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd76814eb50 0x7fd7680c71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:08.650 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:08.644+0000 7fd76d919640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd768158980 0x7fd7680c76f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:08.650 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:08.644+0000 7fd76d919640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fd768158db0 con 0x7fd76806f8a0 2024-04-26T23:40:08.650 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:08.644+0000 7fd76d919640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fd768154d00 con 0x7fd76814eb50 2024-04-26T23:40:08.650 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:08.644+0000 7fd76d919640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fd768070550 con 0x7fd768158980 2024-04-26T23:40:08.650 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:08.644+0000 7fd7667fc640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd76814eb50 0x7fd7680c71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:08.650 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:08.645+0000 7fd7667fc640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd76814eb50 0x7fd7680c71b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:58310/0 (socket says 172.21.15.175:58310) 2024-04-26T23:40:08.650 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:08.645+0000 7fd7677fe640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd768158980 0x7fd7680c76f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:08.650 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:08.645+0000 7fd7667fc640 1 -- 172.21.15.175:0/4184550877 learned_addr learned my addr 172.21.15.175:0/4184550877 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-26T23:40:08.650 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:08.645+0000 7fd766ffd640 1 --2- 172.21.15.175:0/4184550877 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd76806f8a0 0x7fd76806c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:08.651 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:08.645+0000 7fd7667fc640 1 -- 172.21.15.175:0/4184550877 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd768158980 msgr2=0x7fd7680c76f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:08.651 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:08.645+0000 7fd7667fc640 1 --2- 172.21.15.175:0/4184550877 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd768158980 0x7fd7680c76f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:08.651 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:08.645+0000 7fd7667fc640 1 -- 172.21.15.175:0/4184550877 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd76806f8a0 msgr2=0x7fd76806c580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:08.651 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:08.645+0000 7fd7667fc640 1 --2- 172.21.15.175:0/4184550877 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd76806f8a0 0x7fd76806c580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:08.651 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:08.645+0000 7fd7667fc640 1 -- 172.21.15.175:0/4184550877 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7680c8a70 con 0x7fd76814eb50 2024-04-26T23:40:08.651 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:08.645+0000 7fd7677fe640 1 --2- 172.21.15.175:0/4184550877 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd768158980 0x7fd7680c76f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:40:08.651 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:08.645+0000 7fd7667fc640 1 --2- 172.21.15.175:0/4184550877 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd76814eb50 0x7fd7680c71b0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fd75800e960 tx=0x7fd75800ee20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:08.651 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:08.645+0000 7fd74ffff640 1 -- 172.21.15.175:0/4184550877 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd758017070 con 0x7fd76814eb50 2024-04-26T23:40:08.651 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:08.645+0000 7fd74ffff640 1 -- 172.21.15.175:0/4184550877 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd75800ca00 con 0x7fd76814eb50 2024-04-26T23:40:08.651 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:08.645+0000 7fd76d919640 1 -- 172.21.15.175:0/4184550877 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7680c8d50 con 0x7fd76814eb50 2024-04-26T23:40:08.651 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:08.645+0000 7fd74ffff640 1 -- 172.21.15.175:0/4184550877 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd75800cdd0 con 0x7fd76814eb50 2024-04-26T23:40:08.651 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:08.645+0000 7fd76d919640 1 -- 172.21.15.175:0/4184550877 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd76806cac0 con 0x7fd76814eb50 2024-04-26T23:40:08.651 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:08.645+0000 7fd74ffff640 1 -- 172.21.15.175:0/4184550877 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fd75801a070 con 0x7fd76814eb50 2024-04-26T23:40:08.651 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:08.645+0000 7fd74ffff640 1 -- 172.21.15.175:0/4184550877 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7fd75801c800 con 0x7fd76814eb50 2024-04-26T23:40:08.651 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:08.646+0000 7fd76d919640 1 -- 172.21.15.175:0/4184550877 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd7680c6e70 con 0x7fd76814eb50 2024-04-26T23:40:08.652 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:08.648+0000 7fd74ffff640 1 -- 172.21.15.175:0/4184550877 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7fd75801ca50 con 0x7fd76814eb50 2024-04-26T23:40:08.723 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:08.720+0000 7fd76d919640 1 -- 172.21.15.175:0/4184550877 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd new", "uuid": "7a6f0fa9-23d0-4747-880f-798d45ec5eeb", "id": 1} v 0) -- 0x7fd768074b80 con 0x7fd76814eb50 2024-04-26T23:40:08.728 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:08.725+0000 7fd74ffff640 1 -- 172.21.15.175:0/4184550877 <== mon.1 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "7a6f0fa9-23d0-4747-880f-798d45ec5eeb", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7fd75801cd00 con 0x7fd76814eb50 2024-04-26T23:40:08.728 INFO:teuthology.orchestra.run.smithi175.stdout:1 2024-04-26T23:40:08.729 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:08.726+0000 7fd76d919640 1 -- 172.21.15.175:0/4184550877 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd76814eb50 msgr2=0x7fd7680c71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:08.729 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:08.726+0000 7fd76d919640 1 --2- 172.21.15.175:0/4184550877 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd76814eb50 0x7fd7680c71b0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fd75800e960 tx=0x7fd75800ee20 comp rx=0 tx=0).stop 2024-04-26T23:40:08.729 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:08.726+0000 7fd76d919640 1 -- 172.21.15.175:0/4184550877 shutdown_connections 2024-04-26T23:40:08.730 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:08.726+0000 7fd76d919640 1 --2- 172.21.15.175:0/4184550877 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd768158980 0x7fd7680c76f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:08.730 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:08.726+0000 7fd76d919640 1 --2- 172.21.15.175:0/4184550877 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd76814eb50 0x7fd7680c71b0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:08.730 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:08.726+0000 7fd76d919640 1 --2- 172.21.15.175:0/4184550877 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd76806f8a0 0x7fd76806c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:08.730 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:08.726+0000 7fd76d919640 1 -- 172.21.15.175:0/4184550877 >> 172.21.15.175:0/4184550877 conn(0x7fd7680c5d70 msgr2=0x7fd7680acc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:40:08.730 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:08.726+0000 7fd76d919640 1 -- 172.21.15.175:0/4184550877 shutdown_connections 2024-04-26T23:40:08.730 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:08.726+0000 7fd76d919640 1 -- 172.21.15.175:0/4184550877 wait complete. 2024-04-26T23:40:08.739 DEBUG:teuthology.orchestra.run.smithi175:> sudo ceph --cluster ceph osd new 6be88ea0-e133-4200-a4b5-f92d664b248a 2 2024-04-26T23:40:08.837 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:08.834+0000 7f69084f8640 1 Processor -- start 2024-04-26T23:40:08.838 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:08.834+0000 7f69084f8640 1 -- start start 2024-04-26T23:40:08.839 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:08.835+0000 7f69084f8640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f69000c3c70 0x7f6900074370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:08.839 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:08.835+0000 7f69084f8640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6900070c80 0x7f690006d320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:08.839 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:08.835+0000 7f69084f8640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6900072e60 con 0x7f6900150e90 2024-04-26T23:40:08.839 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:08.835+0000 7f69084f8640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f69000710d0 con 0x7f69000c3c70 2024-04-26T23:40:08.839 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:08.835+0000 7f69084f8640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f690006fc50 con 0x7f6900070c80 2024-04-26T23:40:08.839 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:08.835+0000 7f6906a95640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6900070c80 0x7f690006d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:08.839 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:08.835+0000 7f6905a93640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f69000c3c70 0x7f6900074370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:08.839 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:08.835+0000 7f6906a95640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6900070c80 0x7f690006d320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.175:46130/0 (socket says 172.21.15.175:46130) 2024-04-26T23:40:08.839 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:08.835+0000 7f6905a93640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f69000c3c70 0x7f6900074370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:58326/0 (socket says 172.21.15.175:58326) 2024-04-26T23:40:08.839 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:08.835+0000 7f6906a95640 1 -- 172.21.15.175:0/2155714863 learned_addr learned my addr 172.21.15.175:0/2155714863 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-26T23:40:08.840 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:08.835+0000 7f6905a93640 1 -- 172.21.15.175:0/2155714863 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6900070c80 msgr2=0x7f690006d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:40:08.840 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:08.835+0000 7f6905a93640 1 --2- 172.21.15.175:0/2155714863 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6900070c80 0x7f690006d320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:08.840 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:08.835+0000 7f6905a93640 1 -- 172.21.15.175:0/2155714863 >> v1:172.21.15.88:6789/0 conn(0x7f6900150e90 legacy=0x7f690006f540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:08.840 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:08.835+0000 7f6905a93640 1 -- 172.21.15.175:0/2155714863 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6900154580 con 0x7f69000c3c70 2024-04-26T23:40:08.840 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:08.835+0000 7f6906a95640 1 --2- 172.21.15.175:0/2155714863 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6900070c80 0x7f690006d320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:40:08.846 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:08.836+0000 7f6905a93640 1 --2- 172.21.15.175:0/2155714863 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f69000c3c70 0x7f6900074370 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f68fc0097a0 tx=0x7f68fc02a060 comp rx=0 tx=0).ready entity=mon.1 client_cookie=436dff06474d157f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:08.846 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:08.836+0000 7f6905292640 1 -- 172.21.15.175:0/2155714863 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68fc037070 con 0x7f69000c3c70 2024-04-26T23:40:08.846 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:08.836+0000 7f6905292640 1 -- 172.21.15.175:0/2155714863 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68fc02adb0 con 0x7f69000c3c70 2024-04-26T23:40:08.846 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:08.836+0000 7f6905292640 1 -- 172.21.15.175:0/2155714863 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68fc032660 con 0x7f69000c3c70 2024-04-26T23:40:08.846 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:08.837+0000 7f69084f8640 1 -- 172.21.15.175:0/2155714863 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f69000c3c70 msgr2=0x7f6900074370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:08.846 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:08.837+0000 7f69084f8640 1 --2- 172.21.15.175:0/2155714863 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f69000c3c70 0x7f6900074370 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f68fc0097a0 tx=0x7f68fc02a060 comp rx=0 tx=0).stop 2024-04-26T23:40:08.846 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:08.837+0000 7f69084f8640 1 -- 172.21.15.175:0/2155714863 shutdown_connections 2024-04-26T23:40:08.846 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:08.837+0000 7f69084f8640 1 --2- 172.21.15.175:0/2155714863 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6900070c80 0x7f690006d320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:08.846 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:08.837+0000 7f69084f8640 1 --2- 172.21.15.175:0/2155714863 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f69000c3c70 0x7f6900074370 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:08.846 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:08.837+0000 7f69084f8640 1 -- 172.21.15.175:0/2155714863 >> 172.21.15.175:0/2155714863 conn(0x7f69000c5d70 msgr2=0x7f69000c6180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:40:08.846 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:08.837+0000 7f69084f8640 1 -- 172.21.15.175:0/2155714863 shutdown_connections 2024-04-26T23:40:08.846 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:08.837+0000 7f69084f8640 1 -- 172.21.15.175:0/2155714863 wait complete. 2024-04-26T23:40:08.847 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:08.838+0000 7f69084f8640 1 Processor -- start 2024-04-26T23:40:08.847 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:08.838+0000 7f69084f8640 1 -- start start 2024-04-26T23:40:08.847 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:08.839+0000 7f69084f8640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6900070c80 0x7f69000c7ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:08.847 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:08.839+0000 7f69084f8640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f69000c3c70 0x7f6900156970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:08.847 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:08.839+0000 7f69084f8640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6900150e90 0x7f690014dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:08.847 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:08.839+0000 7f69084f8640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f6900154230 con 0x7f6900150e90 2024-04-26T23:40:08.847 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:08.839+0000 7f69084f8640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f6900072af0 con 0x7f69000c3c70 2024-04-26T23:40:08.847 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:08.839+0000 7f69084f8640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f6900151270 con 0x7f6900070c80 2024-04-26T23:40:08.847 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:08.839+0000 7f6906294640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6900070c80 0x7f69000c7ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:08.847 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:08.839+0000 7f6905a93640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f69000c3c70 0x7f6900156970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:08.847 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:08.839+0000 7f6906294640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6900070c80 0x7f69000c7ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.175:46146/0 (socket says 172.21.15.175:46146) 2024-04-26T23:40:08.847 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:08.839+0000 7f6906294640 1 -- 172.21.15.175:0/2852931291 learned_addr learned my addr 172.21.15.175:0/2852931291 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-26T23:40:08.847 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:08.839+0000 7f6906a95640 1 --2- 172.21.15.175:0/2852931291 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6900150e90 0x7f690014dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:08.848 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:08.839+0000 7f6905a93640 1 -- 172.21.15.175:0/2852931291 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6900070c80 msgr2=0x7f69000c7ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:08.848 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:08.839+0000 7f6905a93640 1 --2- 172.21.15.175:0/2852931291 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6900070c80 0x7f69000c7ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:08.848 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:08.839+0000 7f6905a93640 1 -- 172.21.15.175:0/2852931291 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6900150e90 msgr2=0x7f690014dcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:08.848 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:08.839+0000 7f6905a93640 1 --2- 172.21.15.175:0/2852931291 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6900150e90 0x7f690014dcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:08.848 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:08.839+0000 7f6905a93640 1 -- 172.21.15.175:0/2852931291 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69001eea60 con 0x7f69000c3c70 2024-04-26T23:40:08.848 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:08.839+0000 7f6906294640 1 --2- 172.21.15.175:0/2852931291 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6900070c80 0x7f69000c7ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:40:08.848 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:08.839+0000 7f6905a93640 1 --2- 172.21.15.175:0/2852931291 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f69000c3c70 0x7f6900156970 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f68fc031000 tx=0x7f68fc0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:08.848 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:08.839+0000 7f68f6ffd640 1 -- 172.21.15.175:0/2852931291 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68fc041070 con 0x7f69000c3c70 2024-04-26T23:40:08.848 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:08.840+0000 7f68f6ffd640 1 -- 172.21.15.175:0/2852931291 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68fc032e20 con 0x7f69000c3c70 2024-04-26T23:40:08.848 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:08.840+0000 7f69084f8640 1 -- 172.21.15.175:0/2852931291 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69001edca0 con 0x7f69000c3c70 2024-04-26T23:40:08.848 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:08.840+0000 7f68f6ffd640 1 -- 172.21.15.175:0/2852931291 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68fc037040 con 0x7f69000c3c70 2024-04-26T23:40:08.849 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:08.840+0000 7f69084f8640 1 -- 172.21.15.175:0/2852931291 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69001ee260 con 0x7f69000c3c70 2024-04-26T23:40:08.849 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:08.840+0000 7f68f6ffd640 1 -- 172.21.15.175:0/2852931291 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f68fc03a070 con 0x7f69000c3c70 2024-04-26T23:40:08.849 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:08.840+0000 7f68f6ffd640 1 -- 172.21.15.175:0/2852931291 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7f68fc0459b0 con 0x7f69000c3c70 2024-04-26T23:40:08.849 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:08.841+0000 7f69084f8640 1 -- 172.21.15.175:0/2852931291 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f69000aed50 con 0x7f69000c3c70 2024-04-26T23:40:08.849 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:08.843+0000 7f68f6ffd640 1 -- 172.21.15.175:0/2852931291 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f68fc045c50 con 0x7f69000c3c70 2024-04-26T23:40:08.933 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:08.930+0000 7f69084f8640 1 -- 172.21.15.175:0/2852931291 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd new", "uuid": "6be88ea0-e133-4200-a4b5-f92d664b248a", "id": 2} v 0) -- 0x7f69000507a0 con 0x7f69000c3c70 2024-04-26T23:40:08.939 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:08.936+0000 7f68f6ffd640 1 -- 172.21.15.175:0/2852931291 <== mon.1 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "6be88ea0-e133-4200-a4b5-f92d664b248a", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7f68fc045590 con 0x7f69000c3c70 2024-04-26T23:40:08.939 INFO:teuthology.orchestra.run.smithi175.stdout:2 2024-04-26T23:40:08.940 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:08.937+0000 7f69084f8640 1 -- 172.21.15.175:0/2852931291 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f69000c3c70 msgr2=0x7f6900156970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:08.940 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:08.937+0000 7f69084f8640 1 --2- 172.21.15.175:0/2852931291 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f69000c3c70 0x7f6900156970 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f68fc031000 tx=0x7f68fc0046c0 comp rx=0 tx=0).stop 2024-04-26T23:40:08.941 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:08.937+0000 7f69084f8640 1 -- 172.21.15.175:0/2852931291 shutdown_connections 2024-04-26T23:40:08.941 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:08.937+0000 7f69084f8640 1 --2- 172.21.15.175:0/2852931291 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6900150e90 0x7f690014dcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:08.941 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:08.937+0000 7f69084f8640 1 --2- 172.21.15.175:0/2852931291 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f69000c3c70 0x7f6900156970 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:08.941 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:08.937+0000 7f69084f8640 1 --2- 172.21.15.175:0/2852931291 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6900070c80 0x7f69000c7ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:08.941 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:08.937+0000 7f69084f8640 1 -- 172.21.15.175:0/2852931291 >> 172.21.15.175:0/2852931291 conn(0x7f69000c5d70 msgr2=0x7f690015d740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:40:08.941 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:08.937+0000 7f69084f8640 1 -- 172.21.15.175:0/2852931291 shutdown_connections 2024-04-26T23:40:08.941 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:08.937+0000 7f69084f8640 1 -- 172.21.15.175:0/2852931291 wait complete. 2024-04-26T23:40:08.951 DEBUG:teuthology.orchestra.run.smithi175:> sudo ceph --cluster ceph osd new dcb0746b-7b3d-4ecf-8089-2493a5d1857c 3 2024-04-26T23:40:09.048 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.044+0000 7f001d571640 1 Processor -- start 2024-04-26T23:40:09.048 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.044+0000 7f001d571640 1 -- start start 2024-04-26T23:40:09.049 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.045+0000 7f001d571640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f0018073780 0x7f001815a550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:09.049 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.045+0000 7f001d571640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f00180c56c0 con 0x7f00180ab8a0 2024-04-26T23:40:09.049 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.045+0000 7f001d571640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0018156fd0 con 0x7f00181541b0 2024-04-26T23:40:09.049 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.045+0000 7f001d571640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f0018157b50 con 0x7f0018073780 2024-04-26T23:40:09.049 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.045+0000 7f00167fc640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f0018073780 0x7f001815a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:09.049 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.045+0000 7f0016ffd640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f00181541b0 0x7f00180705f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:55416/0 (socket says 172.21.15.175:55416) 2024-04-26T23:40:09.050 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.045+0000 7f0016ffd640 1 -- 172.21.15.175:0/4040773890 learned_addr learned my addr 172.21.15.175:0/4040773890 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-26T23:40:09.050 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.046+0000 7f00167fc640 1 -- 172.21.15.175:0/4040773890 >> v1:172.21.15.175:6789/0 conn(0x7f00181541b0 legacy=0x7f00180705f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:09.050 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.046+0000 7f00167fc640 1 -- 172.21.15.175:0/4040773890 >> v1:172.21.15.88:6789/0 conn(0x7f00180ab8a0 legacy=0x7f001815aa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:09.050 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.046+0000 7f00167fc640 1 -- 172.21.15.175:0/4040773890 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00181572b0 con 0x7f0018073780 2024-04-26T23:40:09.051 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.046+0000 7f00167fc640 1 --2- 172.21.15.175:0/4040773890 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0018073780 0x7f001815a550 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f00080097a0 tx=0x7f000802a1a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e94addfbbf3f9ea2 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:09.051 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.046+0000 7f0015ffb640 1 -- 172.21.15.175:0/4040773890 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0008037070 con 0x7f0018073780 2024-04-26T23:40:09.051 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.046+0000 7f0015ffb640 1 -- 172.21.15.175:0/4040773890 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0008032440 con 0x7f0018073780 2024-04-26T23:40:09.051 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.046+0000 7f0015ffb640 1 -- 172.21.15.175:0/4040773890 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0008032810 con 0x7f0018073780 2024-04-26T23:40:09.051 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.047+0000 7f001d571640 1 -- 172.21.15.175:0/4040773890 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0018073780 msgr2=0x7f001815a550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:09.051 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.047+0000 7f001d571640 1 --2- 172.21.15.175:0/4040773890 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0018073780 0x7f001815a550 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f00080097a0 tx=0x7f000802a1a0 comp rx=0 tx=0).stop 2024-04-26T23:40:09.051 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.047+0000 7f001d571640 1 -- 172.21.15.175:0/4040773890 shutdown_connections 2024-04-26T23:40:09.051 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.047+0000 7f001d571640 1 --2- 172.21.15.175:0/4040773890 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0018073780 0x7f001815a550 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:09.052 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.047+0000 7f001d571640 1 -- 172.21.15.175:0/4040773890 >> 172.21.15.175:0/4040773890 conn(0x7f00180ca3d0 msgr2=0x7f00180ca7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:40:09.052 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.047+0000 7f001d571640 1 -- 172.21.15.175:0/4040773890 shutdown_connections 2024-04-26T23:40:09.052 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.047+0000 7f001d571640 1 -- 172.21.15.175:0/4040773890 wait complete. 2024-04-26T23:40:09.054 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.048+0000 7f001d571640 1 Processor -- start 2024-04-26T23:40:09.054 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.048+0000 7f001d571640 1 -- start start 2024-04-26T23:40:09.054 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.049+0000 7f001d571640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0018073780 0x7f00181500d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:09.054 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.049+0000 7f001d571640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f00180ab8a0 0x7f001814e220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:09.054 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.049+0000 7f001d571640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f00181541b0 0x7f00181f00f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:09.054 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.049+0000 7f001d571640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f00180acd00 con 0x7f00180ab8a0 2024-04-26T23:40:09.055 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.049+0000 7f001d571640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f0018154590 con 0x7f00181541b0 2024-04-26T23:40:09.055 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.049+0000 7f001d571640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f0018157870 con 0x7f0018073780 2024-04-26T23:40:09.055 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.049+0000 7f0016ffd640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0018073780 0x7f00181500d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:09.055 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.049+0000 7f00177fe640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f00181541b0 0x7f00181f00f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:09.055 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.049+0000 7f0016ffd640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0018073780 0x7f00181500d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.175:46156/0 (socket says 172.21.15.175:46156) 2024-04-26T23:40:09.055 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.049+0000 7f00177fe640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f00181541b0 0x7f00181f00f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:58362/0 (socket says 172.21.15.175:58362) 2024-04-26T23:40:09.055 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.049+0000 7f0016ffd640 1 -- 172.21.15.175:0/3729423010 learned_addr learned my addr 172.21.15.175:0/3729423010 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-26T23:40:09.055 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.049+0000 7f00167fc640 1 --2- 172.21.15.175:0/3729423010 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f00180ab8a0 0x7f001814e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:09.055 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.050+0000 7f00177fe640 1 -- 172.21.15.175:0/3729423010 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0018073780 msgr2=0x7f00181500d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:09.055 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.050+0000 7f00177fe640 1 --2- 172.21.15.175:0/3729423010 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0018073780 0x7f00181500d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:09.055 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.050+0000 7f00177fe640 1 -- 172.21.15.175:0/3729423010 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f00180ab8a0 msgr2=0x7f001814e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:09.055 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.050+0000 7f00177fe640 1 --2- 172.21.15.175:0/3729423010 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f00180ab8a0 0x7f001814e220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:09.055 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.050+0000 7f00177fe640 1 -- 172.21.15.175:0/3729423010 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f001814b520 con 0x7f00181541b0 2024-04-26T23:40:09.055 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.050+0000 7f0016ffd640 1 --2- 172.21.15.175:0/3729423010 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0018073780 0x7f00181500d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:40:09.055 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.050+0000 7f00177fe640 1 --2- 172.21.15.175:0/3729423010 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f00181541b0 0x7f00181f00f0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f001000c690 tx=0x7f001000cb50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:09.056 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.050+0000 7effff7fe640 1 -- 172.21.15.175:0/3729423010 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0010003b70 con 0x7f00181541b0 2024-04-26T23:40:09.056 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.050+0000 7effff7fe640 1 -- 172.21.15.175:0/3729423010 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0010003d10 con 0x7f00181541b0 2024-04-26T23:40:09.056 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.050+0000 7f001d571640 1 -- 172.21.15.175:0/3729423010 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f001814b800 con 0x7f00181541b0 2024-04-26T23:40:09.056 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.050+0000 7effff7fe640 1 -- 172.21.15.175:0/3729423010 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0010005310 con 0x7f00181541b0 2024-04-26T23:40:09.056 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.050+0000 7f001d571640 1 -- 172.21.15.175:0/3729423010 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f001814bdc0 con 0x7f00181541b0 2024-04-26T23:40:09.056 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.050+0000 7effff7fe640 1 -- 172.21.15.175:0/3729423010 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f00100054b0 con 0x7f00181541b0 2024-04-26T23:40:09.056 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.050+0000 7effff7fe640 1 -- 172.21.15.175:0/3729423010 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7f0010012900 con 0x7f00181541b0 2024-04-26T23:40:09.056 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.051+0000 7f001d571640 1 -- 172.21.15.175:0/3729423010 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f001814dd40 con 0x7f00181541b0 2024-04-26T23:40:09.056 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.053+0000 7effff7fe640 1 -- 172.21.15.175:0/3729423010 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f001814dd40 con 0x7f00181541b0 2024-04-26T23:40:09.129 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.126+0000 7f001d571640 1 -- 172.21.15.175:0/3729423010 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd new", "uuid": "dcb0746b-7b3d-4ecf-8089-2493a5d1857c", "id": 3} v 0) -- 0x7f001814c000 con 0x7f00181541b0 2024-04-26T23:40:09.134 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.131+0000 7effff7fe640 1 -- 172.21.15.175:0/3729423010 <== mon.1 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "dcb0746b-7b3d-4ecf-8089-2493a5d1857c", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7f0010012be0 con 0x7f00181541b0 2024-04-26T23:40:09.134 INFO:teuthology.orchestra.run.smithi175.stdout:3 2024-04-26T23:40:09.136 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.132+0000 7f001d571640 1 -- 172.21.15.175:0/3729423010 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f00181541b0 msgr2=0x7f00181f00f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:09.136 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.132+0000 7f001d571640 1 --2- 172.21.15.175:0/3729423010 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f00181541b0 0x7f00181f00f0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f001000c690 tx=0x7f001000cb50 comp rx=0 tx=0).stop 2024-04-26T23:40:09.136 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.132+0000 7f001d571640 1 -- 172.21.15.175:0/3729423010 shutdown_connections 2024-04-26T23:40:09.136 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.132+0000 7f001d571640 1 --2- 172.21.15.175:0/3729423010 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f00181541b0 0x7f00181f00f0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:09.136 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.132+0000 7f001d571640 1 --2- 172.21.15.175:0/3729423010 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f00180ab8a0 0x7f001814e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:09.136 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.132+0000 7f001d571640 1 --2- 172.21.15.175:0/3729423010 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0018073780 0x7f00181500d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:09.136 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.132+0000 7f001d571640 1 -- 172.21.15.175:0/3729423010 >> 172.21.15.175:0/3729423010 conn(0x7f00180ca3d0 msgr2=0x7f001815a4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:40:09.136 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.132+0000 7f001d571640 1 -- 172.21.15.175:0/3729423010 shutdown_connections 2024-04-26T23:40:09.136 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.132+0000 7f001d571640 1 -- 172.21.15.175:0/3729423010 wait complete. 2024-04-26T23:40:09.146 DEBUG:teuthology.orchestra.run.smithi175:> sudo ceph --cluster ceph osd new c483de66-c44f-450e-a4ce-b132d50882c3 4 2024-04-26T23:40:09.164 INFO:tasks.ceph.mgr.y.smithi088.stderr:2024-04-26T23:40:09.161+0000 7f7100920040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-26T23:40:09.243 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.239+0000 7f9d49a37640 1 Processor -- start 2024-04-26T23:40:09.243 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.239+0000 7f9d49a37640 1 -- start start 2024-04-26T23:40:09.245 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.240+0000 7f9d49a37640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f9d4413fe20 0x7f9d440c5430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:09.245 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.240+0000 7f9d49a37640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9d44157010 0x7f9d44157480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:09.245 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.240+0000 7f9d49a37640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9d4415a230 con 0x7f9d440c3c70 2024-04-26T23:40:09.245 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.240+0000 7f9d49a37640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f9d440c39b0 con 0x7f9d4413fe20 2024-04-26T23:40:09.245 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.240+0000 7f9d49a37640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f9d4415b120 con 0x7f9d44157010 2024-04-26T23:40:09.245 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.240+0000 7f9d42ffd640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f9d4413fe20 0x7f9d440c5430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:09.245 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.240+0000 7f9d42ffd640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f9d4413fe20 0x7f9d440c5430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:58364/0 (socket says 172.21.15.175:58364) 2024-04-26T23:40:09.245 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.240+0000 7f9d42ffd640 1 -- 172.21.15.175:0/367244228 learned_addr learned my addr 172.21.15.175:0/367244228 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-26T23:40:09.245 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.240+0000 7f9d437fe640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9d44157010 0x7f9d44157480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:09.245 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.241+0000 7f9d42ffd640 1 -- 172.21.15.175:0/367244228 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9d44157010 msgr2=0x7f9d44157480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:40:09.246 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.241+0000 7f9d42ffd640 1 --2- 172.21.15.175:0/367244228 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9d44157010 0x7f9d44157480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:09.246 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.241+0000 7f9d42ffd640 1 -- 172.21.15.175:0/367244228 >> v1:172.21.15.88:6789/0 conn(0x7f9d440c3c70 legacy=0x7f9d4406d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:09.246 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.241+0000 7f9d42ffd640 1 -- 172.21.15.175:0/367244228 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d4415a510 con 0x7f9d4413fe20 2024-04-26T23:40:09.246 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.241+0000 7f9d42ffd640 1 --2- 172.21.15.175:0/367244228 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9d4413fe20 0x7f9d440c5430 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f9d38009870 tx=0x7f9d3802a270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2b70649811f78bcb server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:09.246 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.241+0000 7f9d41ffb640 1 -- 172.21.15.175:0/367244228 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d38037070 con 0x7f9d4413fe20 2024-04-26T23:40:09.246 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.241+0000 7f9d41ffb640 1 -- 172.21.15.175:0/367244228 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d38032440 con 0x7f9d4413fe20 2024-04-26T23:40:09.246 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.241+0000 7f9d41ffb640 1 -- 172.21.15.175:0/367244228 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d38032810 con 0x7f9d4413fe20 2024-04-26T23:40:09.247 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.242+0000 7f9d49a37640 1 -- 172.21.15.175:0/367244228 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9d4413fe20 msgr2=0x7f9d440c5430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:09.247 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.242+0000 7f9d49a37640 1 --2- 172.21.15.175:0/367244228 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9d4413fe20 0x7f9d440c5430 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f9d38009870 tx=0x7f9d3802a270 comp rx=0 tx=0).stop 2024-04-26T23:40:09.247 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.242+0000 7f9d49a37640 1 -- 172.21.15.175:0/367244228 shutdown_connections 2024-04-26T23:40:09.247 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.242+0000 7f9d49a37640 1 --2- 172.21.15.175:0/367244228 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9d44157010 0x7f9d44157480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:09.247 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.242+0000 7f9d49a37640 1 --2- 172.21.15.175:0/367244228 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9d4413fe20 0x7f9d440c5430 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:09.247 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.242+0000 7f9d49a37640 1 -- 172.21.15.175:0/367244228 >> 172.21.15.175:0/367244228 conn(0x7f9d440c5d70 msgr2=0x7f9d440c6180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:40:09.248 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.242+0000 7f9d49a37640 1 -- 172.21.15.175:0/367244228 shutdown_connections 2024-04-26T23:40:09.248 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.242+0000 7f9d49a37640 1 -- 172.21.15.175:0/367244228 wait complete. 2024-04-26T23:40:09.248 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.244+0000 7f9d49a37640 1 Processor -- start 2024-04-26T23:40:09.248 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.244+0000 7f9d49a37640 1 -- start start 2024-04-26T23:40:09.250 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.245+0000 7f9d49a37640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9d440c3c70 0x7f9d44154c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:09.250 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.245+0000 7f9d49a37640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9d4413fe20 0x7f9d441e31b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:09.251 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.245+0000 7f9d49a37640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9d44157010 0x7f9d441e36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:09.251 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.245+0000 7f9d49a37640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f9d4415adb0 con 0x7f9d440c3c70 2024-04-26T23:40:09.251 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.245+0000 7f9d49a37640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f9d4415aad0 con 0x7f9d4413fe20 2024-04-26T23:40:09.251 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.245+0000 7f9d49a37640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f9d44140200 con 0x7f9d44157010 2024-04-26T23:40:09.251 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.245+0000 7f9d427fc640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9d4413fe20 0x7f9d441e31b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:09.251 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.245+0000 7f9d427fc640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9d4413fe20 0x7f9d441e31b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:58372/0 (socket says 172.21.15.175:58372) 2024-04-26T23:40:09.251 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.245+0000 7f9d437fe640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9d44157010 0x7f9d441e36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:09.251 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.245+0000 7f9d427fc640 1 -- 172.21.15.175:0/2895631479 learned_addr learned my addr 172.21.15.175:0/2895631479 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-26T23:40:09.251 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.245+0000 7f9d42ffd640 1 --2- 172.21.15.175:0/2895631479 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9d440c3c70 0x7f9d44154c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:09.251 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.246+0000 7f9d427fc640 1 -- 172.21.15.175:0/2895631479 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9d44157010 msgr2=0x7f9d441e36f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:09.251 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.246+0000 7f9d427fc640 1 --2- 172.21.15.175:0/2895631479 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9d44157010 0x7f9d441e36f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:09.251 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.246+0000 7f9d427fc640 1 -- 172.21.15.175:0/2895631479 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9d440c3c70 msgr2=0x7f9d44154c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:09.251 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.246+0000 7f9d427fc640 1 --2- 172.21.15.175:0/2895631479 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9d440c3c70 0x7f9d44154c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:09.251 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.246+0000 7f9d427fc640 1 -- 172.21.15.175:0/2895631479 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d44155470 con 0x7f9d4413fe20 2024-04-26T23:40:09.252 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.246+0000 7f9d427fc640 1 --2- 172.21.15.175:0/2895631479 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9d4413fe20 0x7f9d441e31b0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f9d3400c430 tx=0x7f9d3400c8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:09.252 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.246+0000 7f9d2bfff640 1 -- 172.21.15.175:0/2895631479 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d340052d0 con 0x7f9d4413fe20 2024-04-26T23:40:09.252 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.246+0000 7f9d2bfff640 1 -- 172.21.15.175:0/2895631479 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d34005490 con 0x7f9d4413fe20 2024-04-26T23:40:09.252 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.246+0000 7f9d49a37640 1 -- 172.21.15.175:0/2895631479 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d441561d0 con 0x7f9d4413fe20 2024-04-26T23:40:09.252 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.246+0000 7f9d2bfff640 1 -- 172.21.15.175:0/2895631479 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d34007260 con 0x7f9d4413fe20 2024-04-26T23:40:09.252 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.246+0000 7f9d49a37640 1 -- 172.21.15.175:0/2895631479 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d441556f0 con 0x7f9d4413fe20 2024-04-26T23:40:09.252 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.246+0000 7f9d2bfff640 1 -- 172.21.15.175:0/2895631479 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f9d34007400 con 0x7f9d4413fe20 2024-04-26T23:40:09.252 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.246+0000 7f9d2bfff640 1 -- 172.21.15.175:0/2895631479 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7f9d34011590 con 0x7f9d4413fe20 2024-04-26T23:40:09.252 INFO:tasks.ceph.mgr.x.smithi175.stderr:2024-04-26T23:40:09.246+0000 7f32091bc040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-26T23:40:09.253 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.247+0000 7f9d49a37640 1 -- 172.21.15.175:0/2895631479 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9d440507a0 con 0x7f9d4413fe20 2024-04-26T23:40:09.253 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.249+0000 7f9d2bfff640 1 -- 172.21.15.175:0/2895631479 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f9d44155470 con 0x7f9d4413fe20 2024-04-26T23:40:09.253 INFO:tasks.ceph.mgr.y.smithi088.stderr:2024-04-26T23:40:09.248+0000 7f7100920040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-26T23:40:09.293 INFO:tasks.ceph.mgr.y.smithi088.stderr:2024-04-26T23:40:09.289+0000 7f7100920040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-26T23:40:09.334 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.330+0000 7f9d49a37640 1 -- 172.21.15.175:0/2895631479 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd new", "uuid": "c483de66-c44f-450e-a4ce-b132d50882c3", "id": 4} v 0) -- 0x7f9d44159ff0 con 0x7f9d4413fe20 2024-04-26T23:40:09.339 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.335+0000 7f9d2bfff640 1 -- 172.21.15.175:0/2895631479 <== mon.1 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c483de66-c44f-450e-a4ce-b132d50882c3", "id": 4}]=0 v7) ==== 112+0+2 (secure 0 0 0) 0x7f9d34003a50 con 0x7f9d4413fe20 2024-04-26T23:40:09.339 INFO:teuthology.orchestra.run.smithi175.stdout:4 2024-04-26T23:40:09.340 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.336+0000 7f9d49a37640 1 -- 172.21.15.175:0/2895631479 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9d4413fe20 msgr2=0x7f9d441e31b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:09.340 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.336+0000 7f9d49a37640 1 --2- 172.21.15.175:0/2895631479 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9d4413fe20 0x7f9d441e31b0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f9d3400c430 tx=0x7f9d3400c8f0 comp rx=0 tx=0).stop 2024-04-26T23:40:09.340 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.336+0000 7f9d49a37640 1 -- 172.21.15.175:0/2895631479 shutdown_connections 2024-04-26T23:40:09.340 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.336+0000 7f9d49a37640 1 --2- 172.21.15.175:0/2895631479 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9d44157010 0x7f9d441e36f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:09.340 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.336+0000 7f9d49a37640 1 --2- 172.21.15.175:0/2895631479 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9d4413fe20 0x7f9d441e31b0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:09.340 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.336+0000 7f9d49a37640 1 --2- 172.21.15.175:0/2895631479 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9d440c3c70 0x7f9d44154c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:09.340 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.336+0000 7f9d49a37640 1 -- 172.21.15.175:0/2895631479 >> 172.21.15.175:0/2895631479 conn(0x7f9d440c5d70 msgr2=0x7f9d44072690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:40:09.340 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.336+0000 7f9d49a37640 1 -- 172.21.15.175:0/2895631479 shutdown_connections 2024-04-26T23:40:09.341 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.336+0000 7f9d49a37640 1 -- 172.21.15.175:0/2895631479 wait complete. 2024-04-26T23:40:09.347 INFO:tasks.ceph.mgr.x.smithi175.stderr:2024-04-26T23:40:09.344+0000 7f32091bc040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-26T23:40:09.350 DEBUG:teuthology.orchestra.run.smithi175:> sudo ceph --cluster ceph osd new ac3b1669-d228-40dd-9f9a-cb46aa73dd6d 5 2024-04-26T23:40:09.393 INFO:tasks.ceph.mgr.x.smithi175.stderr:2024-04-26T23:40:09.390+0000 7f32091bc040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-26T23:40:09.447 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.444+0000 7fe4d767b640 1 Processor -- start 2024-04-26T23:40:09.447 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.444+0000 7fe4d767b640 1 -- start start 2024-04-26T23:40:09.449 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.445+0000 7fe4d767b640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe4d006d590 0x7fe4d01539a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:09.449 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.445+0000 7fe4d767b640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fe4d0157be0 0x7fe4d0150cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:09.450 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.445+0000 7fe4d767b640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe4d0153ff0 con 0x7fe4d00c5560 2024-04-26T23:40:09.450 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.445+0000 7fe4d767b640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7fe4d01542d0 con 0x7fe4d0157be0 2024-04-26T23:40:09.450 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.445+0000 7fe4d767b640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fe4d01545b0 con 0x7fe4d006d590 2024-04-26T23:40:09.450 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.445+0000 7fe4d5417640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe4d006d590 0x7fe4d01539a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:09.450 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.445+0000 7fe4d5417640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe4d006d590 0x7fe4d01539a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.175:46174/0 (socket says 172.21.15.175:46174) 2024-04-26T23:40:09.450 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.445+0000 7fe4d5417640 1 -- 172.21.15.175:0/1654719426 learned_addr learned my addr 172.21.15.175:0/1654719426 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-26T23:40:09.450 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.445+0000 7fe4d5c18640 1 --2- 172.21.15.175:0/1654719426 >> v2:172.21.15.88:3300/0 conn(0x7fe4d0157be0 0x7fe4d0150cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:09.450 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.445+0000 7fe4d5417640 1 -- 172.21.15.175:0/1654719426 >> v2:172.21.15.88:3300/0 conn(0x7fe4d0157be0 msgr2=0x7fe4d0150cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:40:09.450 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.445+0000 7fe4d5417640 1 --2- 172.21.15.175:0/1654719426 >> v2:172.21.15.88:3300/0 conn(0x7fe4d0157be0 0x7fe4d0150cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:09.450 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.445+0000 7fe4d5417640 1 -- 172.21.15.175:0/1654719426 >> v1:172.21.15.88:6789/0 conn(0x7fe4d00c5560 legacy=0x7fe4d01574d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:09.450 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.445+0000 7fe4d5417640 1 -- 172.21.15.175:0/1654719426 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4d0154890 con 0x7fe4d006d590 2024-04-26T23:40:09.450 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.446+0000 7fe4d5417640 1 --2- 172.21.15.175:0/1654719426 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe4d006d590 0x7fe4d01539a0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fe4cc009870 tx=0x7fe4cc02a1c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f421e5566a2b5b0f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:09.451 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.446+0000 7fe4c7fff640 1 -- 172.21.15.175:0/1654719426 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4cc037070 con 0x7fe4d006d590 2024-04-26T23:40:09.451 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.446+0000 7fe4c7fff640 1 -- 172.21.15.175:0/1654719426 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4cc032440 con 0x7fe4d006d590 2024-04-26T23:40:09.451 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.446+0000 7fe4c7fff640 1 -- 172.21.15.175:0/1654719426 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4cc032810 con 0x7fe4d006d590 2024-04-26T23:40:09.454 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.447+0000 7fe4d767b640 1 -- 172.21.15.175:0/1654719426 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe4d006d590 msgr2=0x7fe4d01539a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:09.454 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.447+0000 7fe4d767b640 1 --2- 172.21.15.175:0/1654719426 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe4d006d590 0x7fe4d01539a0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fe4cc009870 tx=0x7fe4cc02a1c0 comp rx=0 tx=0).stop 2024-04-26T23:40:09.454 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.447+0000 7fe4d767b640 1 -- 172.21.15.175:0/1654719426 shutdown_connections 2024-04-26T23:40:09.454 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.447+0000 7fe4d767b640 1 --2- 172.21.15.175:0/1654719426 >> v2:172.21.15.88:3300/0 conn(0x7fe4d0157be0 0x7fe4d0150cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:09.454 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.447+0000 7fe4d767b640 1 --2- 172.21.15.175:0/1654719426 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe4d006d590 0x7fe4d01539a0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:09.454 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.447+0000 7fe4d767b640 1 -- 172.21.15.175:0/1654719426 >> 172.21.15.175:0/1654719426 conn(0x7fe4d00c5ce0 msgr2=0x7fe4d00c60c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:40:09.454 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.447+0000 7fe4d767b640 1 -- 172.21.15.175:0/1654719426 shutdown_connections 2024-04-26T23:40:09.455 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.447+0000 7fe4d767b640 1 -- 172.21.15.175:0/1654719426 wait complete. 2024-04-26T23:40:09.455 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.448+0000 7fe4d767b640 1 Processor -- start 2024-04-26T23:40:09.455 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.448+0000 7fe4d767b640 1 -- start start 2024-04-26T23:40:09.455 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.448+0000 7fe4d767b640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe4d006d590 0x7fe4d0153580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:09.455 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.449+0000 7fe4d767b640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe4d00c5560 0x7fe4d01e15c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:09.455 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.449+0000 7fe4d767b640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe4d0157be0 0x7fe4d00ac5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:09.455 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.449+0000 7fe4d767b640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fe4d00c3c70 con 0x7fe4d006d590 2024-04-26T23:40:09.455 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.449+0000 7fe4d767b640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fe4d0074b30 con 0x7fe4d0157be0 2024-04-26T23:40:09.455 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.449+0000 7fe4d767b640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fe4d00c3df0 con 0x7fe4d00c5560 2024-04-26T23:40:09.455 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.449+0000 7fe4d4c16640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe4d00c5560 0x7fe4d01e15c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:09.455 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.449+0000 7fe4d5c18640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe4d0157be0 0x7fe4d00ac5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:09.455 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.449+0000 7fe4d4c16640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe4d00c5560 0x7fe4d01e15c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.175:46178/0 (socket says 172.21.15.175:46178) 2024-04-26T23:40:09.455 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.449+0000 7fe4d4c16640 1 -- 172.21.15.175:0/2629942789 learned_addr learned my addr 172.21.15.175:0/2629942789 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-26T23:40:09.455 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.449+0000 7fe4d5c18640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe4d0157be0 0x7fe4d00ac5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:58384/0 (socket says 172.21.15.175:58384) 2024-04-26T23:40:09.455 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.449+0000 7fe4d5417640 1 --2- 172.21.15.175:0/2629942789 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe4d006d590 0x7fe4d0153580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:09.456 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.449+0000 7fe4d5417640 1 -- 172.21.15.175:0/2629942789 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe4d00c5560 msgr2=0x7fe4d01e15c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:09.456 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.449+0000 7fe4d5417640 1 --2- 172.21.15.175:0/2629942789 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe4d00c5560 0x7fe4d01e15c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:09.456 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.449+0000 7fe4d5417640 1 -- 172.21.15.175:0/2629942789 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe4d0157be0 msgr2=0x7fe4d00ac5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:09.456 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.449+0000 7fe4d5417640 1 --2- 172.21.15.175:0/2629942789 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe4d0157be0 0x7fe4d00ac5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:09.456 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.449+0000 7fe4d5417640 1 -- 172.21.15.175:0/2629942789 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4d0070b00 con 0x7fe4d006d590 2024-04-26T23:40:09.456 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.449+0000 7fe4d4c16640 1 --2- 172.21.15.175:0/2629942789 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe4d00c5560 0x7fe4d01e15c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:40:09.456 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.449+0000 7fe4d5c18640 1 --2- 172.21.15.175:0/2629942789 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe4d0157be0 0x7fe4d00ac5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:40:09.456 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.449+0000 7fe4d5417640 1 --2- 172.21.15.175:0/2629942789 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe4d006d590 0x7fe4d0153580 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fe4cc031000 tx=0x7fe4cc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:09.456 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.449+0000 7fe4c5ffb640 1 -- 172.21.15.175:0/2629942789 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4cc041020 con 0x7fe4d006d590 2024-04-26T23:40:09.456 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.449+0000 7fe4c5ffb640 1 -- 172.21.15.175:0/2629942789 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4cc030660 con 0x7fe4d006d590 2024-04-26T23:40:09.456 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.449+0000 7fe4d767b640 1 -- 172.21.15.175:0/2629942789 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4d0070de0 con 0x7fe4d006d590 2024-04-26T23:40:09.456 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.449+0000 7fe4c5ffb640 1 -- 172.21.15.175:0/2629942789 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4cc037040 con 0x7fe4d006d590 2024-04-26T23:40:09.456 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.450+0000 7fe4d767b640 1 -- 172.21.15.175:0/2629942789 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4d0152d80 con 0x7fe4d006d590 2024-04-26T23:40:09.456 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.450+0000 7fe4c5ffb640 1 -- 172.21.15.175:0/2629942789 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fe4cc044020 con 0x7fe4d006d590 2024-04-26T23:40:09.457 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.450+0000 7fe4c5ffb640 1 -- 172.21.15.175:0/2629942789 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(7..7 src has 1..7) ==== 1300+0+0 (secure 0 0 0) 0x7fe4cc03db50 con 0x7fe4d006d590 2024-04-26T23:40:09.457 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.450+0000 7fe4d767b640 1 -- 172.21.15.175:0/2629942789 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe4d00696c0 con 0x7fe4d006d590 2024-04-26T23:40:09.457 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.453+0000 7fe4c5ffb640 1 -- 172.21.15.175:0/2629942789 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7fe4cc04b030 con 0x7fe4d006d590 2024-04-26T23:40:09.458 INFO:tasks.ceph.mgr.y.smithi088.stderr:2024-04-26T23:40:09.454+0000 7f7100920040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-26T23:40:09.504 INFO:tasks.ceph.mgr.y.smithi088.stderr:2024-04-26T23:40:09.501+0000 7f7100920040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-26T23:40:09.528 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.525+0000 7fe4d767b640 1 -- 172.21.15.175:0/2629942789 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd new", "uuid": "ac3b1669-d228-40dd-9f9a-cb46aa73dd6d", "id": 5} v 0) -- 0x7fe4d01e1b00 con 0x7fe4d006d590 2024-04-26T23:40:09.532 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.528+0000 7fe4c5ffb640 1 -- 172.21.15.175:0/2629942789 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "ac3b1669-d228-40dd-9f9a-cb46aa73dd6d", "id": 5}]=0 v8) ==== 112+0+2 (secure 0 0 0) 0x7fe4cc03ddf0 con 0x7fe4d006d590 2024-04-26T23:40:09.532 INFO:teuthology.orchestra.run.smithi175.stdout:5 2024-04-26T23:40:09.534 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.530+0000 7fe4d767b640 1 -- 172.21.15.175:0/2629942789 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe4d006d590 msgr2=0x7fe4d0153580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:09.534 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.530+0000 7fe4d767b640 1 --2- 172.21.15.175:0/2629942789 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe4d006d590 0x7fe4d0153580 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fe4cc031000 tx=0x7fe4cc0046c0 comp rx=0 tx=0).stop 2024-04-26T23:40:09.534 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.530+0000 7fe4d767b640 1 -- 172.21.15.175:0/2629942789 shutdown_connections 2024-04-26T23:40:09.534 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.530+0000 7fe4d767b640 1 --2- 172.21.15.175:0/2629942789 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe4d00c5560 0x7fe4d01e15c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:09.534 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.530+0000 7fe4d767b640 1 --2- 172.21.15.175:0/2629942789 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe4d0157be0 0x7fe4d00ac5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:09.534 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.530+0000 7fe4d767b640 1 --2- 172.21.15.175:0/2629942789 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe4d006d590 0x7fe4d0153580 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:09.534 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.530+0000 7fe4d767b640 1 -- 172.21.15.175:0/2629942789 >> 172.21.15.175:0/2629942789 conn(0x7fe4d00c5ce0 msgr2=0x7fe4d0150a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:40:09.534 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.530+0000 7fe4d767b640 1 -- 172.21.15.175:0/2629942789 shutdown_connections 2024-04-26T23:40:09.534 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.530+0000 7fe4d767b640 1 -- 172.21.15.175:0/2629942789 wait complete. 2024-04-26T23:40:09.547 DEBUG:teuthology.orchestra.run.smithi175:> sudo ceph --cluster ceph osd new 7bef4896-857e-4c11-b3b2-c2e9a8548338 6 2024-04-26T23:40:09.556 INFO:tasks.ceph.mgr.y.smithi088.stderr:2024-04-26T23:40:09.553+0000 7f7100920040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-26T23:40:09.572 INFO:tasks.ceph.mgr.x.smithi175.stderr:2024-04-26T23:40:09.569+0000 7f32091bc040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-26T23:40:09.640 INFO:tasks.ceph.mgr.x.smithi175.stderr:2024-04-26T23:40:09.636+0000 7f32091bc040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-26T23:40:09.667 INFO:tasks.ceph.mgr.y.smithi088.stderr:2024-04-26T23:40:09.663+0000 7f7100920040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-26T23:40:09.668 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.665+0000 7fd0c5fda640 1 Processor -- start 2024-04-26T23:40:09.669 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.665+0000 7fd0c5fda640 1 -- start start 2024-04-26T23:40:09.670 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.666+0000 7fd0c5fda640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fd0c014eb50 0x7fd0c00c3f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:09.670 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.666+0000 7fd0c5fda640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fd0c0158980 0x7fd0c006d320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:09.670 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.666+0000 7fd0c5fda640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd0c0154a90 con 0x7fd0c006f8a0 2024-04-26T23:40:09.670 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.666+0000 7fd0c5fda640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7fd0c00c5080 con 0x7fd0c014eb50 2024-04-26T23:40:09.670 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.666+0000 7fd0c5fda640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7fd0c0155930 con 0x7fd0c0158980 2024-04-26T23:40:09.670 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.666+0000 7fd0bffff640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fd0c0158980 0x7fd0c006d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:09.670 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.666+0000 7fd0b7fff640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7fd0c006f8a0 0x7fd0c0155220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:55432/0 (socket says 172.21.15.175:55432) 2024-04-26T23:40:09.671 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.666+0000 7fd0b7fff640 1 -- 172.21.15.175:0/905344009 learned_addr learned my addr 172.21.15.175:0/905344009 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-26T23:40:09.671 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.666+0000 7fd0bf7fe640 1 --2- 172.21.15.175:0/905344009 >> v2:172.21.15.88:3300/0 conn(0x7fd0c014eb50 0x7fd0c00c3f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:09.671 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.666+0000 7fd0bffff640 1 -- 172.21.15.175:0/905344009 >> v2:172.21.15.88:3300/0 conn(0x7fd0c014eb50 msgr2=0x7fd0c00c3f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:40:09.671 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.666+0000 7fd0bffff640 1 --2- 172.21.15.175:0/905344009 >> v2:172.21.15.88:3300/0 conn(0x7fd0c014eb50 0x7fd0c00c3f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:09.671 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.666+0000 7fd0bffff640 1 -- 172.21.15.175:0/905344009 >> v1:172.21.15.175:6789/0 conn(0x7fd0c006f8a0 legacy=0x7fd0c0155220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:09.671 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.666+0000 7fd0beffd640 1 -- 172.21.15.175:0/905344009 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2864626020 0 0) 0x7fd0c0154a90 con 0x7fd0c006f8a0 2024-04-26T23:40:09.671 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.666+0000 7fd0bffff640 1 -- 172.21.15.175:0/905344009 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0c006ff90 con 0x7fd0c0158980 2024-04-26T23:40:09.672 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.667+0000 7fd0bffff640 1 --2- 172.21.15.175:0/905344009 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd0c0158980 0x7fd0c006d320 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fd0c00c6bd0 tx=0x7fd0b802a680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=52ba06da1b48e478 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:09.672 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.668+0000 7fd0beffd640 1 -- 172.21.15.175:0/905344009 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0b8007740 con 0x7fd0c0158980 2024-04-26T23:40:09.672 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.668+0000 7fd0beffd640 1 -- 172.21.15.175:0/905344009 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0b80078e0 con 0x7fd0c0158980 2024-04-26T23:40:09.672 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.668+0000 7fd0beffd640 1 -- 172.21.15.175:0/905344009 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0b8007cb0 con 0x7fd0c0158980 2024-04-26T23:40:09.673 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.668+0000 7fd0c5fda640 1 -- 172.21.15.175:0/905344009 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd0c0158980 msgr2=0x7fd0c006d320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:09.673 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.668+0000 7fd0c5fda640 1 --2- 172.21.15.175:0/905344009 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd0c0158980 0x7fd0c006d320 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fd0c00c6bd0 tx=0x7fd0b802a680 comp rx=0 tx=0).stop 2024-04-26T23:40:09.673 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.668+0000 7fd0c5fda640 1 -- 172.21.15.175:0/905344009 shutdown_connections 2024-04-26T23:40:09.673 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.668+0000 7fd0c5fda640 1 --2- 172.21.15.175:0/905344009 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd0c0158980 0x7fd0c006d320 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:09.673 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.668+0000 7fd0c5fda640 1 --2- 172.21.15.175:0/905344009 >> v2:172.21.15.88:3300/0 conn(0x7fd0c014eb50 0x7fd0c00c3f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:09.673 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.669+0000 7fd0c5fda640 1 -- 172.21.15.175:0/905344009 >> 172.21.15.175:0/905344009 conn(0x7fd0c00c5d70 msgr2=0x7fd0c00c6180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:40:09.673 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.669+0000 7fd0c5fda640 1 -- 172.21.15.175:0/905344009 shutdown_connections 2024-04-26T23:40:09.673 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.669+0000 7fd0c5fda640 1 -- 172.21.15.175:0/905344009 wait complete. 2024-04-26T23:40:09.673 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.670+0000 7fd0c5fda640 1 Processor -- start 2024-04-26T23:40:09.674 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.670+0000 7fd0c5fda640 1 -- start start 2024-04-26T23:40:09.676 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.671+0000 7fd0c5fda640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd0c006f8a0 0x7fd0c014f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:09.676 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.671+0000 7fd0c5fda640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd0c014eb50 0x7fd0c01e1400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:09.676 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.671+0000 7fd0c5fda640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd0c0158980 0x7fd0c01e1940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:09.676 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.671+0000 7fd0c5fda640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fd0c0158db0 con 0x7fd0c0158980 2024-04-26T23:40:09.676 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.671+0000 7fd0c5fda640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fd0c0154d00 con 0x7fd0c014eb50 2024-04-26T23:40:09.677 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.671+0000 7fd0c5fda640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fd0c0070550 con 0x7fd0c006f8a0 2024-04-26T23:40:09.677 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.672+0000 7fd0bf7fe640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd0c006f8a0 0x7fd0c014f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:09.677 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.672+0000 7fd0b7fff640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd0c014eb50 0x7fd0c01e1400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:09.677 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.672+0000 7fd0bf7fe640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd0c006f8a0 0x7fd0c014f1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.175:46190/0 (socket says 172.21.15.175:46190) 2024-04-26T23:40:09.677 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.672+0000 7fd0bf7fe640 1 -- 172.21.15.175:0/3999006992 learned_addr learned my addr 172.21.15.175:0/3999006992 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-26T23:40:09.677 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.672+0000 7fd0bffff640 1 --2- 172.21.15.175:0/3999006992 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd0c0158980 0x7fd0c01e1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:09.677 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.672+0000 7fd0bf7fe640 1 -- 172.21.15.175:0/3999006992 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd0c014eb50 msgr2=0x7fd0c01e1400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:09.677 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.672+0000 7fd0bf7fe640 1 --2- 172.21.15.175:0/3999006992 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd0c014eb50 0x7fd0c01e1400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:09.677 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.672+0000 7fd0bf7fe640 1 -- 172.21.15.175:0/3999006992 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd0c0158980 msgr2=0x7fd0c01e1940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:09.677 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.672+0000 7fd0bf7fe640 1 --2- 172.21.15.175:0/3999006992 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd0c0158980 0x7fd0c01e1940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:09.677 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.672+0000 7fd0bf7fe640 1 -- 172.21.15.175:0/3999006992 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0c0157c40 con 0x7fd0c006f8a0 2024-04-26T23:40:09.677 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.672+0000 7fd0b7fff640 1 --2- 172.21.15.175:0/3999006992 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd0c014eb50 0x7fd0c01e1400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:40:09.677 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.672+0000 7fd0bf7fe640 1 --2- 172.21.15.175:0/3999006992 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd0c006f8a0 0x7fd0c014f1a0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fd0b000e8a0 tx=0x7fd0b000ed60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:09.677 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.672+0000 7fd0bcff9640 1 -- 172.21.15.175:0/3999006992 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0b0020070 con 0x7fd0c006f8a0 2024-04-26T23:40:09.677 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.672+0000 7fd0bcff9640 1 -- 172.21.15.175:0/3999006992 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0b000c940 con 0x7fd0c006f8a0 2024-04-26T23:40:09.678 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.672+0000 7fd0c5fda640 1 -- 172.21.15.175:0/3999006992 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0c01eaff0 con 0x7fd0c006f8a0 2024-04-26T23:40:09.678 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.672+0000 7fd0bcff9640 1 -- 172.21.15.175:0/3999006992 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0b000cd10 con 0x7fd0c006f8a0 2024-04-26T23:40:09.678 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.672+0000 7fd0c5fda640 1 -- 172.21.15.175:0/3999006992 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0c00c7270 con 0x7fd0c006f8a0 2024-04-26T23:40:09.678 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.672+0000 7fd0bcff9640 1 -- 172.21.15.175:0/3999006992 <== mon.2 v2:172.21.15.175:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fd0b0023070 con 0x7fd0c006f8a0 2024-04-26T23:40:09.678 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.672+0000 7fd0bcff9640 1 -- 172.21.15.175:0/3999006992 <== mon.2 v2:172.21.15.175:3301/0 5 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (secure 0 0 0) 0x7fd0b0025b00 con 0x7fd0c006f8a0 2024-04-26T23:40:09.678 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.673+0000 7fd0c5fda640 1 -- 172.21.15.175:0/3999006992 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd0c0074b80 con 0x7fd0c006f8a0 2024-04-26T23:40:09.679 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.675+0000 7fd0bcff9640 1 -- 172.21.15.175:0/3999006992 <== mon.2 v2:172.21.15.175:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7fd0b0025490 con 0x7fd0c006f8a0 2024-04-26T23:40:09.697 INFO:tasks.ceph.mgr.x.smithi175.stderr:2024-04-26T23:40:09.694+0000 7f32091bc040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-26T23:40:09.751 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.748+0000 7fd0c5fda640 1 -- 172.21.15.175:0/3999006992 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "osd new", "uuid": "7bef4896-857e-4c11-b3b2-c2e9a8548338", "id": 6} v 0) -- 0x7fd0c00507a0 con 0x7fd0c006f8a0 2024-04-26T23:40:09.756 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.753+0000 7fd0bcff9640 1 -- 172.21.15.175:0/3999006992 <== mon.2 v2:172.21.15.175:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "7bef4896-857e-4c11-b3b2-c2e9a8548338", "id": 6}]=0 v9) ==== 112+0+2 (secure 0 0 0) 0x7fd0b0025670 con 0x7fd0c006f8a0 2024-04-26T23:40:09.756 INFO:teuthology.orchestra.run.smithi175.stdout:6 2024-04-26T23:40:09.757 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.754+0000 7fd0c5fda640 1 -- 172.21.15.175:0/3999006992 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd0c006f8a0 msgr2=0x7fd0c014f1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:09.758 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.754+0000 7fd0c5fda640 1 --2- 172.21.15.175:0/3999006992 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd0c006f8a0 0x7fd0c014f1a0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fd0b000e8a0 tx=0x7fd0b000ed60 comp rx=0 tx=0).stop 2024-04-26T23:40:09.758 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.754+0000 7fd0c5fda640 1 -- 172.21.15.175:0/3999006992 shutdown_connections 2024-04-26T23:40:09.758 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.754+0000 7fd0c5fda640 1 --2- 172.21.15.175:0/3999006992 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd0c0158980 0x7fd0c01e1940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:09.758 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.754+0000 7fd0c5fda640 1 --2- 172.21.15.175:0/3999006992 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd0c014eb50 0x7fd0c01e1400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:09.758 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.754+0000 7fd0c5fda640 1 --2- 172.21.15.175:0/3999006992 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd0c006f8a0 0x7fd0c014f1a0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:09.758 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.754+0000 7fd0c5fda640 1 -- 172.21.15.175:0/3999006992 >> 172.21.15.175:0/3999006992 conn(0x7fd0c00c5d70 msgr2=0x7fd0c00c3b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:40:09.758 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.754+0000 7fd0c5fda640 1 -- 172.21.15.175:0/3999006992 shutdown_connections 2024-04-26T23:40:09.758 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.754+0000 7fd0c5fda640 1 -- 172.21.15.175:0/3999006992 wait complete. 2024-04-26T23:40:09.768 DEBUG:teuthology.orchestra.run.smithi175:> sudo ceph --cluster ceph osd new e18d9e09-8673-470d-b9dc-280a409b63f8 7 2024-04-26T23:40:09.815 INFO:tasks.ceph.mgr.x.smithi175.stderr:2024-04-26T23:40:09.812+0000 7f32091bc040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-26T23:40:09.866 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.862+0000 7f69c24ea640 1 Processor -- start 2024-04-26T23:40:09.867 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.862+0000 7f69c24ea640 1 -- start start 2024-04-26T23:40:09.867 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.862+0000 7f69c24ea640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f69bc0c4b80 0x7f69bc15a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:09.867 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.862+0000 7f69c24ea640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f69bc154780 con 0x7f69bc06ede0 2024-04-26T23:40:09.867 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.862+0000 7f69c24ea640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f69bc0c7430 con 0x7f69bc1543a0 2024-04-26T23:40:09.867 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.862+0000 7f69c24ea640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f69bc0c5480 con 0x7f69bc0c4b80 2024-04-26T23:40:09.867 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.863+0000 7f69c0a87640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f69bc0c4b80 0x7f69bc15a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:09.867 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.863+0000 7f69c0a87640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f69bc0c4b80 0x7f69bc15a980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.175:46192/0 (socket says 172.21.15.175:46192) 2024-04-26T23:40:09.867 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.863+0000 7f69bbfff640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f69bc1543a0 0x7f69bc06f2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:55442/0 (socket says 172.21.15.175:55442) 2024-04-26T23:40:09.867 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.863+0000 7f69c0a87640 1 -- 172.21.15.175:0/3205340281 learned_addr learned my addr 172.21.15.175:0/3205340281 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-26T23:40:09.867 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.863+0000 7f69c0a87640 1 -- 172.21.15.175:0/3205340281 >> v1:172.21.15.175:6789/0 conn(0x7f69bc1543a0 legacy=0x7f69bc06f2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:09.867 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.863+0000 7f69c0a87640 1 -- 172.21.15.175:0/3205340281 >> v1:172.21.15.88:6789/0 conn(0x7f69bc06ede0 legacy=0x7f69bc15a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:09.868 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.863+0000 7f69baffd640 1 -- 172.21.15.175:0/3205340281 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1045437604 0 0) 0x7f69bc0c7430 con 0x7f69bc1543a0 2024-04-26T23:40:09.868 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.863+0000 7f69c0a87640 1 -- 172.21.15.175:0/3205340281 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69bc0c7710 con 0x7f69bc0c4b80 2024-04-26T23:40:09.869 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.864+0000 7f69c0a87640 1 --2- 172.21.15.175:0/3205340281 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f69bc0c4b80 0x7f69bc15a980 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f69b4009e80 tx=0x7f69b402a680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=83e999f72b523940 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:09.869 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.864+0000 7f69baffd640 1 -- 172.21.15.175:0/3205340281 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69b4036070 con 0x7f69bc0c4b80 2024-04-26T23:40:09.869 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.864+0000 7f69baffd640 1 -- 172.21.15.175:0/3205340281 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69b4031600 con 0x7f69bc0c4b80 2024-04-26T23:40:09.869 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.864+0000 7f69baffd640 1 -- 172.21.15.175:0/3205340281 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69b40319d0 con 0x7f69bc0c4b80 2024-04-26T23:40:09.869 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.864+0000 7f69c24ea640 1 -- 172.21.15.175:0/3205340281 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f69bc0c4b80 msgr2=0x7f69bc15a980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:09.869 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.864+0000 7f69c24ea640 1 --2- 172.21.15.175:0/3205340281 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f69bc0c4b80 0x7f69bc15a980 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f69b4009e80 tx=0x7f69b402a680 comp rx=0 tx=0).stop 2024-04-26T23:40:09.869 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.864+0000 7f69c24ea640 1 -- 172.21.15.175:0/3205340281 shutdown_connections 2024-04-26T23:40:09.870 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.864+0000 7f69c24ea640 1 --2- 172.21.15.175:0/3205340281 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f69bc0c4b80 0x7f69bc15a980 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:09.870 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.864+0000 7f69c24ea640 1 -- 172.21.15.175:0/3205340281 >> 172.21.15.175:0/3205340281 conn(0x7f69bc0c89f0 msgr2=0x7f69bc0c8dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:40:09.870 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.864+0000 7f69c24ea640 1 -- 172.21.15.175:0/3205340281 shutdown_connections 2024-04-26T23:40:09.870 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.864+0000 7f69c24ea640 1 -- 172.21.15.175:0/3205340281 wait complete. 2024-04-26T23:40:09.870 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.865+0000 7f69c24ea640 1 Processor -- start 2024-04-26T23:40:09.870 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.866+0000 7f69c24ea640 1 -- start start 2024-04-26T23:40:09.872 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.866+0000 7f69c24ea640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f69bc06ede0 0x7f69bc14e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:09.872 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.866+0000 7f69c24ea640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f69bc0c4b80 0x7f69bc074440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:09.873 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.866+0000 7f69c24ea640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f69bc1543a0 0x7f69bc150610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:09.873 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.866+0000 7f69c24ea640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f69bc15aec0 con 0x7f69bc06ede0 2024-04-26T23:40:09.873 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.866+0000 7f69c24ea640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f69bc0c5a40 con 0x7f69bc0c4b80 2024-04-26T23:40:09.873 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.866+0000 7f69c24ea640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f69bc0c70e0 con 0x7f69bc1543a0 2024-04-26T23:40:09.873 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.866+0000 7f69bb7fe640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f69bc0c4b80 0x7f69bc074440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:09.873 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.866+0000 7f69c0a87640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f69bc1543a0 0x7f69bc150610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:09.873 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.866+0000 7f69bb7fe640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f69bc0c4b80 0x7f69bc074440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:58398/0 (socket says 172.21.15.175:58398) 2024-04-26T23:40:09.873 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.866+0000 7f69bb7fe640 1 -- 172.21.15.175:0/507002439 learned_addr learned my addr 172.21.15.175:0/507002439 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-26T23:40:09.873 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.866+0000 7f69bbfff640 1 --2- 172.21.15.175:0/507002439 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f69bc06ede0 0x7f69bc14e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:09.873 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.867+0000 7f69c0a87640 1 -- 172.21.15.175:0/507002439 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f69bc0c4b80 msgr2=0x7f69bc074440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:09.873 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.867+0000 7f69c0a87640 1 --2- 172.21.15.175:0/507002439 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f69bc0c4b80 0x7f69bc074440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:09.873 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.867+0000 7f69c0a87640 1 -- 172.21.15.175:0/507002439 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f69bc06ede0 msgr2=0x7f69bc14e4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:09.873 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.867+0000 7f69c0a87640 1 --2- 172.21.15.175:0/507002439 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f69bc06ede0 0x7f69bc14e4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:09.873 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.867+0000 7f69c0a87640 1 -- 172.21.15.175:0/507002439 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69bc157be0 con 0x7f69bc1543a0 2024-04-26T23:40:09.874 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.867+0000 7f69bb7fe640 1 --2- 172.21.15.175:0/507002439 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f69bc0c4b80 0x7f69bc074440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:40:09.874 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.867+0000 7f69c0a87640 1 --2- 172.21.15.175:0/507002439 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f69bc1543a0 0x7f69bc150610 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f69b4030000 tx=0x7f69b4004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:09.874 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.867+0000 7f69b8ff9640 1 -- 172.21.15.175:0/507002439 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69b4036050 con 0x7f69bc1543a0 2024-04-26T23:40:09.874 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.867+0000 7f69b8ff9640 1 -- 172.21.15.175:0/507002439 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69b4042070 con 0x7f69bc1543a0 2024-04-26T23:40:09.874 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.867+0000 7f69c24ea640 1 -- 172.21.15.175:0/507002439 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69bc0726b0 con 0x7f69bc1543a0 2024-04-26T23:40:09.874 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.867+0000 7f69b8ff9640 1 -- 172.21.15.175:0/507002439 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69b4009510 con 0x7f69bc1543a0 2024-04-26T23:40:09.874 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.867+0000 7f69c24ea640 1 -- 172.21.15.175:0/507002439 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f69bc157620 con 0x7f69bc1543a0 2024-04-26T23:40:09.874 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.867+0000 7f69b8ff9640 1 -- 172.21.15.175:0/507002439 <== mon.2 v2:172.21.15.175:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f69b4007bf0 con 0x7f69bc1543a0 2024-04-26T23:40:09.874 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.867+0000 7f69b8ff9640 1 -- 172.21.15.175:0/507002439 <== mon.2 v2:172.21.15.175:3301/0 5 ==== osd_map(9..9 src has 1..9) ==== 1530+0+0 (secure 0 0 0) 0x7f69b4047bd0 con 0x7f69bc1543a0 2024-04-26T23:40:09.874 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.868+0000 7f69c24ea640 1 -- 172.21.15.175:0/507002439 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f69bc0765e0 con 0x7f69bc1543a0 2024-04-26T23:40:09.875 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.870+0000 7f69b8ff9640 1 -- 172.21.15.175:0/507002439 <== mon.2 v2:172.21.15.175:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f69b4047e20 con 0x7f69bc1543a0 2024-04-26T23:40:09.946 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.942+0000 7f69c24ea640 1 -- 172.21.15.175:0/507002439 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "osd new", "uuid": "e18d9e09-8673-470d-b9dc-280a409b63f8", "id": 7} v 0) -- 0x7f69bc0507a0 con 0x7f69bc1543a0 2024-04-26T23:40:09.953 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.949+0000 7f69b8ff9640 1 -- 172.21.15.175:0/507002439 <== mon.2 v2:172.21.15.175:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "e18d9e09-8673-470d-b9dc-280a409b63f8", "id": 7}]=0 v10) ==== 112+0+2 (secure 0 0 0) 0x7f69b4047460 con 0x7f69bc1543a0 2024-04-26T23:40:09.953 INFO:teuthology.orchestra.run.smithi175.stdout:7 2024-04-26T23:40:09.954 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.950+0000 7f69c24ea640 1 -- 172.21.15.175:0/507002439 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f69bc1543a0 msgr2=0x7f69bc150610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:09.954 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.950+0000 7f69c24ea640 1 --2- 172.21.15.175:0/507002439 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f69bc1543a0 0x7f69bc150610 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f69b4030000 tx=0x7f69b4004a40 comp rx=0 tx=0).stop 2024-04-26T23:40:09.954 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.950+0000 7f69c24ea640 1 -- 172.21.15.175:0/507002439 shutdown_connections 2024-04-26T23:40:09.954 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.950+0000 7f69c24ea640 1 --2- 172.21.15.175:0/507002439 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f69bc1543a0 0x7f69bc150610 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:09.954 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.950+0000 7f69c24ea640 1 --2- 172.21.15.175:0/507002439 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f69bc0c4b80 0x7f69bc074440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:09.954 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.950+0000 7f69c24ea640 1 --2- 172.21.15.175:0/507002439 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f69bc06ede0 0x7f69bc14e4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:09.955 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.950+0000 7f69c24ea640 1 -- 172.21.15.175:0/507002439 >> 172.21.15.175:0/507002439 conn(0x7f69bc0c89f0 msgr2=0x7f69bc0a8b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:40:09.955 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.951+0000 7f69c24ea640 1 -- 172.21.15.175:0/507002439 shutdown_connections 2024-04-26T23:40:09.955 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:40:09.951+0000 7f69c24ea640 1 -- 172.21.15.175:0/507002439 wait complete. 2024-04-26T23:40:09.964 INFO:tasks.ceph.osd.0:Restarting daemon 2024-04-26T23:40:09.965 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-04-26T23:40:09.967 INFO:tasks.ceph.osd.0:Started 2024-04-26T23:40:09.967 INFO:tasks.ceph.osd.1:Restarting daemon 2024-04-26T23:40:09.967 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-04-26T23:40:09.971 INFO:tasks.ceph.osd.1:Started 2024-04-26T23:40:09.971 INFO:tasks.ceph.osd.2:Restarting daemon 2024-04-26T23:40:09.971 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-04-26T23:40:09.973 INFO:tasks.ceph.osd.2:Started 2024-04-26T23:40:09.973 INFO:tasks.ceph.osd.3:Restarting daemon 2024-04-26T23:40:09.974 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-04-26T23:40:09.976 INFO:tasks.ceph.osd.3:Started 2024-04-26T23:40:09.976 INFO:tasks.ceph.osd.4:Restarting daemon 2024-04-26T23:40:09.976 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-04-26T23:40:09.978 INFO:tasks.ceph.osd.4:Started 2024-04-26T23:40:09.978 INFO:tasks.ceph.osd.5:Restarting daemon 2024-04-26T23:40:09.978 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-04-26T23:40:09.980 INFO:tasks.ceph.osd.5:Started 2024-04-26T23:40:09.980 INFO:tasks.ceph.osd.6:Restarting daemon 2024-04-26T23:40:09.981 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-04-26T23:40:09.982 INFO:tasks.ceph.osd.6:Started 2024-04-26T23:40:09.983 INFO:tasks.ceph.osd.7:Restarting daemon 2024-04-26T23:40:09.983 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-04-26T23:40:09.985 INFO:tasks.ceph.osd.7:Started 2024-04-26T23:40:09.985 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T23:40:10.089 INFO:tasks.ceph.mgr.y.smithi088.stderr:2024-04-26T23:40:10.085+0000 7f7100920040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-26T23:40:10.095 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:10.091+0000 7f0825807640 1 Processor -- start 2024-04-26T23:40:10.095 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:10.091+0000 7f0825807640 1 -- start start 2024-04-26T23:40:10.096 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:10.091+0000 7f0825807640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f0820071cc0 0x7f0820073700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:10.096 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:10.091+0000 7f0825807640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0820073c40 0x7f0820070f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:10.096 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:10.092+0000 7f0825807640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f08200707e0 con 0x7f082013ddd0 2024-04-26T23:40:10.096 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:10.092+0000 7f0825807640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f0820155210 con 0x7f0820071cc0 2024-04-26T23:40:10.096 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:10.092+0000 7f0825807640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f0820155450 con 0x7f0820073c40 2024-04-26T23:40:10.096 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:10.092+0000 7f081f7fe640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0820073c40 0x7f0820070f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:10.096 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:10.092+0000 7f081effd640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f082013ddd0 0x7f0820154b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.88:42110/0 (socket says 172.21.15.88:42110) 2024-04-26T23:40:10.096 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:10.092+0000 7f081effd640 1 -- 172.21.15.88:0/3758828802 learned_addr learned my addr 172.21.15.88:0/3758828802 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-26T23:40:10.096 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:10.092+0000 7f081e7fc640 1 --2- 172.21.15.88:0/3758828802 >> v2:172.21.15.175:3300/0 conn(0x7f0820071cc0 0x7f0820073700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:10.097 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:10.092+0000 7f081dffb640 1 -- 172.21.15.88:0/3758828802 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2144313401 0 0) 0x7f08200707e0 con 0x7f082013ddd0 2024-04-26T23:40:10.097 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:10.092+0000 7f081dffb640 1 -- 172.21.15.88:0/3758828802 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0808003520 con 0x7f082013ddd0 2024-04-26T23:40:10.097 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:10.092+0000 7f081f7fe640 1 -- 172.21.15.88:0/3758828802 >> v2:172.21.15.175:3300/0 conn(0x7f0820071cc0 msgr2=0x7f0820073700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:40:10.097 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:10.092+0000 7f081f7fe640 1 --2- 172.21.15.88:0/3758828802 >> v2:172.21.15.175:3300/0 conn(0x7f0820071cc0 0x7f0820073700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:10.097 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:10.092+0000 7f081f7fe640 1 -- 172.21.15.88:0/3758828802 >> v1:172.21.15.175:6789/0 conn(0x7f082013ddd0 legacy=0x7f0820154b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:10.097 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:10.092+0000 7f081f7fe640 1 -- 172.21.15.88:0/3758828802 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0820155730 con 0x7f0820073c40 2024-04-26T23:40:10.098 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:10.093+0000 7f081f7fe640 1 --2- 172.21.15.88:0/3758828802 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0820073c40 0x7f0820070f70 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f0818009d90 tx=0x7f081802a5d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a043028e9db05a45 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:10.098 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:10.093+0000 7f081dffb640 1 -- 172.21.15.88:0/3758828802 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0818031600 con 0x7f0820073c40 2024-04-26T23:40:10.099 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:10.093+0000 7f081dffb640 1 -- 172.21.15.88:0/3758828802 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08180317a0 con 0x7f0820073c40 2024-04-26T23:40:10.099 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:10.093+0000 7f081dffb640 1 -- 172.21.15.88:0/3758828802 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0818031b50 con 0x7f0820073c40 2024-04-26T23:40:10.099 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:10.093+0000 7f0825807640 1 -- 172.21.15.88:0/3758828802 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0820073c40 msgr2=0x7f0820070f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:10.099 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:10.093+0000 7f0825807640 1 --2- 172.21.15.88:0/3758828802 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0820073c40 0x7f0820070f70 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f0818009d90 tx=0x7f081802a5d0 comp rx=0 tx=0).stop 2024-04-26T23:40:10.099 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:10.094+0000 7f0825807640 1 -- 172.21.15.88:0/3758828802 shutdown_connections 2024-04-26T23:40:10.099 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:10.094+0000 7f0825807640 1 --2- 172.21.15.88:0/3758828802 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0820073c40 0x7f0820070f70 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:10.099 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:10.094+0000 7f0825807640 1 --2- 172.21.15.88:0/3758828802 >> v2:172.21.15.175:3300/0 conn(0x7f0820071cc0 0x7f0820073700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:10.099 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:10.094+0000 7f0825807640 1 -- 172.21.15.88:0/3758828802 >> 172.21.15.88:0/3758828802 conn(0x7f08200ca2f0 msgr2=0x7f08200ca6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:40:10.099 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:10.094+0000 7f0825807640 1 -- 172.21.15.88:0/3758828802 shutdown_connections 2024-04-26T23:40:10.099 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:10.094+0000 7f0825807640 1 -- 172.21.15.88:0/3758828802 wait complete. 2024-04-26T23:40:10.099 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:10.095+0000 7f0825807640 1 Processor -- start 2024-04-26T23:40:10.099 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:10.095+0000 7f0825807640 1 -- start start 2024-04-26T23:40:10.102 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:10.095+0000 7f0825807640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0820071cc0 0x7f0820157b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:10.102 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:10.095+0000 7f0825807640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0820073c40 0x7f0820153d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:10.102 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:10.095+0000 7f0825807640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f082013ddd0 0x7f08201dee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:10.102 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:10.095+0000 7f0825807640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f082013e330 con 0x7f0820073c40 2024-04-26T23:40:10.102 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:10.095+0000 7f0825807640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f082013e1b0 con 0x7f0820071cc0 2024-04-26T23:40:10.102 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:10.095+0000 7f0825807640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f08200ab470 con 0x7f082013ddd0 2024-04-26T23:40:10.102 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:10.096+0000 7f081e7fc640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0820073c40 0x7f0820153d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:10.102 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:10.096+0000 7f081e7fc640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0820073c40 0x7f0820153d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:53254/0 (socket says 172.21.15.88:53254) 2024-04-26T23:40:10.102 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:10.096+0000 7f081e7fc640 1 -- 172.21.15.88:0/3649696165 learned_addr learned my addr 172.21.15.88:0/3649696165 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:40:10.102 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:10.096+0000 7f081f7fe640 1 --2- 172.21.15.88:0/3649696165 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f082013ddd0 0x7f08201dee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:10.102 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:10.096+0000 7f081effd640 1 --2- 172.21.15.88:0/3649696165 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0820071cc0 0x7f0820157b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:10.103 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:10.096+0000 7f081f7fe640 1 -- 172.21.15.88:0/3649696165 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0820071cc0 msgr2=0x7f0820157b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:10.103 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:10.096+0000 7f081f7fe640 1 --2- 172.21.15.88:0/3649696165 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0820071cc0 0x7f0820157b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:10.103 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:10.096+0000 7f081f7fe640 1 -- 172.21.15.88:0/3649696165 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0820073c40 msgr2=0x7f0820153d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:10.103 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:10.096+0000 7f081f7fe640 1 --2- 172.21.15.88:0/3649696165 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0820073c40 0x7f0820153d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:10.103 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:10.096+0000 7f081f7fe640 1 -- 172.21.15.88:0/3649696165 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08201de3b0 con 0x7f082013ddd0 2024-04-26T23:40:10.103 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:10.096+0000 7f081e7fc640 1 --2- 172.21.15.88:0/3649696165 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0820073c40 0x7f0820153d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:40:10.103 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:10.096+0000 7f081f7fe640 1 --2- 172.21.15.88:0/3649696165 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f082013ddd0 0x7f08201dee10 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f08201555d0 tx=0x7f0818004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:10.103 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:10.096+0000 7f0807fff640 1 -- 172.21.15.88:0/3649696165 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0818040070 con 0x7f082013ddd0 2024-04-26T23:40:10.103 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:10.096+0000 7f0807fff640 1 -- 172.21.15.88:0/3649696165 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f081803c850 con 0x7f082013ddd0 2024-04-26T23:40:10.103 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:10.096+0000 7f0807fff640 1 -- 172.21.15.88:0/3649696165 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f081803cc40 con 0x7f082013ddd0 2024-04-26T23:40:10.103 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:10.096+0000 7f0825807640 1 -- 172.21.15.88:0/3649696165 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0820158c30 con 0x7f082013ddd0 2024-04-26T23:40:10.103 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:10.096+0000 7f0825807640 1 -- 172.21.15.88:0/3649696165 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f08201df350 con 0x7f082013ddd0 2024-04-26T23:40:10.103 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:10.097+0000 7f0807fff640 1 -- 172.21.15.88:0/3649696165 <== mon.2 v2:172.21.15.175:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f0818039040 con 0x7f082013ddd0 2024-04-26T23:40:10.103 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:10.097+0000 7f0807fff640 1 -- 172.21.15.88:0/3649696165 <== mon.2 v2:172.21.15.175:3301/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f081803cde0 con 0x7f082013ddd0 2024-04-26T23:40:10.103 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:10.097+0000 7f0825807640 1 -- 172.21.15.88:0/3649696165 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f08200ac940 con 0x7f082013ddd0 2024-04-26T23:40:10.105 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:10.101+0000 7f0807fff640 1 -- 172.21.15.88:0/3649696165 <== mon.2 v2:172.21.15.175:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f0818031730 con 0x7f082013ddd0 2024-04-26T23:40:10.166 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:10.163+0000 7f0825807640 1 -- 172.21.15.88:0/3649696165 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f08200507a0 con 0x7f082013ddd0 2024-04-26T23:40:10.167 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:10.164+0000 7f0807fff640 1 -- 172.21.15.88:0/3649696165 <== mon.2 v2:172.21.15.175:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f0818045c30 con 0x7f082013ddd0 2024-04-26T23:40:10.168 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-26T23:40:10.168 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":10,"fsid":"555255e9-7ef9-4454-8dc9-35e96b70035c","created":"2024-04-26T23:40:07.836009+0000","modified":"2024-04-26T23:40:09.944777+0000","last_up_change":"0.000000","last_in_change":"2024-04-26T23:40:09.944777+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"92aecea3-ed62-4a29-87c0-76758a0816a5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"7a6f0fa9-23d0-4747-880f-798d45ec5eeb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"6be88ea0-e133-4200-a4b5-f92d664b248a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"dcb0746b-7b3d-4ecf-8089-2493a5d1857c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"c483de66-c44f-450e-a4ce-b132d50882c3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"ac3b1669-d228-40dd-9f9a-cb46aa73dd6d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"7bef4896-857e-4c11-b3b2-c2e9a8548338","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"e18d9e09-8673-470d-b9dc-280a409b63f8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:40:10.168 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:10.165+0000 7f0825807640 1 -- 172.21.15.88:0/3649696165 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f082013ddd0 msgr2=0x7f08201dee10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:10.169 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:10.165+0000 7f0825807640 1 --2- 172.21.15.88:0/3649696165 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f082013ddd0 0x7f08201dee10 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f08201555d0 tx=0x7f0818004a40 comp rx=0 tx=0).stop 2024-04-26T23:40:10.169 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:10.165+0000 7f0825807640 1 -- 172.21.15.88:0/3649696165 shutdown_connections 2024-04-26T23:40:10.169 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:10.165+0000 7f0825807640 1 --2- 172.21.15.88:0/3649696165 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f082013ddd0 0x7f08201dee10 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:10.169 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:10.165+0000 7f0825807640 1 --2- 172.21.15.88:0/3649696165 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0820073c40 0x7f0820153d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:10.169 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:10.165+0000 7f0825807640 1 --2- 172.21.15.88:0/3649696165 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0820071cc0 0x7f0820157b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:10.169 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:10.165+0000 7f0825807640 1 -- 172.21.15.88:0/3649696165 >> 172.21.15.88:0/3649696165 conn(0x7f08200ca2f0 msgr2=0x7f08200af1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:40:10.169 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:10.165+0000 7f0825807640 1 -- 172.21.15.88:0/3649696165 shutdown_connections 2024-04-26T23:40:10.169 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:10.165+0000 7f0825807640 1 -- 172.21.15.88:0/3649696165 wait complete. 2024-04-26T23:40:10.179 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-04-26T23:40:10.179 INFO:tasks.ceph:Waiting for OSDs to come up 2024-04-26T23:40:10.219 INFO:tasks.ceph.mgr.x.smithi175.stderr:2024-04-26T23:40:10.216+0000 7f32091bc040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-26T23:40:10.353 INFO:tasks.ceph.mgr.y.smithi088.stderr:2024-04-26T23:40:10.349+0000 7f7100920040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-26T23:40:10.405 INFO:tasks.ceph.mgr.y.smithi088.stderr:2024-04-26T23:40:10.401+0000 7f7100920040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-26T23:40:10.476 INFO:tasks.ceph.mgr.x.smithi175.stderr:2024-04-26T23:40:10.473+0000 7f32091bc040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-26T23:40:10.520 INFO:tasks.ceph.mgr.y.smithi088.stderr:2024-04-26T23:40:10.516+0000 7f7100920040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-26T23:40:10.527 INFO:tasks.ceph.mgr.x.smithi175.stderr:2024-04-26T23:40:10.524+0000 7f32091bc040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-26T23:40:10.574 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-04-26T23:40:10.570+0000 7f9b48b68640 -1 Falling back to public interface 2024-04-26T23:40:10.582 INFO:tasks.ceph.osd.2.smithi088.stderr:2024-04-26T23:40:10.578+0000 7fe04061a640 -1 Falling back to public interface 2024-04-26T23:40:10.586 INFO:tasks.ceph.osd.1.smithi088.stderr:2024-04-26T23:40:10.582+0000 7f2eaf957640 -1 Falling back to public interface 2024-04-26T23:40:10.587 INFO:tasks.ceph.osd.5.smithi175.stderr:2024-04-26T23:40:10.583+0000 7fa12dc0d640 -1 Falling back to public interface 2024-04-26T23:40:10.587 INFO:tasks.ceph.osd.4.smithi175.stderr:2024-04-26T23:40:10.584+0000 7fbb40b50640 -1 Falling back to public interface 2024-04-26T23:40:10.593 INFO:tasks.ceph.osd.6.smithi175.stderr:2024-04-26T23:40:10.590+0000 7f6c2a5cb640 -1 Falling back to public interface 2024-04-26T23:40:10.594 INFO:tasks.ceph.osd.7.smithi175.stderr:2024-04-26T23:40:10.590+0000 7fb141d01640 -1 Falling back to public interface 2024-04-26T23:40:10.598 INFO:tasks.ceph.osd.3.smithi088.stderr:2024-04-26T23:40:10.595+0000 7fd2b8bcb640 -1 Falling back to public interface 2024-04-26T23:40:10.647 INFO:tasks.ceph.mgr.x.smithi175.stderr:2024-04-26T23:40:10.644+0000 7f32091bc040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-26T23:40:10.803 INFO:tasks.ceph.mgr.y.smithi088.stderr:2024-04-26T23:40:10.800+0000 7f7100920040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-26T23:40:10.852 INFO:tasks.ceph.mgr.y.smithi088.stderr:2024-04-26T23:40:10.848+0000 7f7100920040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-26T23:40:10.927 INFO:tasks.ceph.mgr.x.smithi175.stderr:2024-04-26T23:40:10.924+0000 7f32091bc040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-26T23:40:10.975 INFO:tasks.ceph.mgr.x.smithi175.stderr:2024-04-26T23:40:10.971+0000 7f32091bc040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-26T23:40:10.985 DEBUG:teuthology.orchestra.run.smithi088:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-26T23:40:11.011 INFO:tasks.ceph.mgr.y.smithi088.stderr:2024-04-26T23:40:11.008+0000 7f7100920040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-26T23:40:11.075 INFO:teuthology.misc.health.smithi088.stderr:2024-04-26T23:40:11.071+0000 7f136915f640 1 Processor -- start 2024-04-26T23:40:11.075 INFO:teuthology.misc.health.smithi088.stderr:2024-04-26T23:40:11.071+0000 7f136915f640 1 -- start start 2024-04-26T23:40:11.078 INFO:teuthology.misc.health.smithi088.stderr:2024-04-26T23:40:11.071+0000 7f136915f640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f13640c3ab0 0x7f13640702f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:11.078 INFO:teuthology.misc.health.smithi088.stderr:2024-04-26T23:40:11.072+0000 7f136915f640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1364156dd0 con 0x7f1364157870 2024-04-26T23:40:11.078 INFO:teuthology.misc.health.smithi088.stderr:2024-04-26T23:40:11.072+0000 7f136915f640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f13640ab780 con 0x7f13640743a0 2024-04-26T23:40:11.078 INFO:teuthology.misc.health.smithi088.stderr:2024-04-26T23:40:11.072+0000 7f136915f640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f1364157070 con 0x7f13640c3ab0 2024-04-26T23:40:11.078 INFO:teuthology.misc.health.smithi088.stderr:2024-04-26T23:40:11.072+0000 7f136359e640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f1364157870 0x7f1364070830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:44302/0 (socket says 172.21.15.88:44302) 2024-04-26T23:40:11.078 INFO:teuthology.misc.health.smithi088.stderr:2024-04-26T23:40:11.072+0000 7f136359e640 1 -- 172.21.15.88:0/4230129585 learned_addr learned my addr 172.21.15.88:0/4230129585 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-26T23:40:11.078 INFO:teuthology.misc.health.smithi088.stderr:2024-04-26T23:40:11.072+0000 7f136259c640 1 --2- 172.21.15.88:0/4230129585 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f13640c3ab0 0x7f13640702f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:11.078 INFO:teuthology.misc.health.smithi088.stderr:2024-04-26T23:40:11.072+0000 7f1361d9b640 1 -- 172.21.15.88:0/4230129585 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 97207096 0 0) 0x7f1364156dd0 con 0x7f1364157870 2024-04-26T23:40:11.078 INFO:teuthology.misc.health.smithi088.stderr:2024-04-26T23:40:11.072+0000 7f1361d9b640 1 -- 172.21.15.88:0/4230129585 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f134c003520 con 0x7f1364157870 2024-04-26T23:40:11.078 INFO:teuthology.misc.health.smithi088.stderr:2024-04-26T23:40:11.072+0000 7f1361d9b640 1 -- 172.21.15.88:0/4230129585 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1965071463 0 0) 0x7f13640ab780 con 0x7f13640743a0 2024-04-26T23:40:11.078 INFO:teuthology.misc.health.smithi088.stderr:2024-04-26T23:40:11.072+0000 7f1361d9b640 1 -- 172.21.15.88:0/4230129585 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1364156dd0 con 0x7f13640743a0 2024-04-26T23:40:11.079 INFO:teuthology.misc.health.smithi088.stderr:2024-04-26T23:40:11.072+0000 7f136259c640 1 -- 172.21.15.88:0/4230129585 >> v1:172.21.15.175:6789/0 conn(0x7f13640743a0 legacy=0x7f1364073270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:11.079 INFO:teuthology.misc.health.smithi088.stderr:2024-04-26T23:40:11.072+0000 7f136259c640 1 -- 172.21.15.88:0/4230129585 >> v1:172.21.15.88:6789/0 conn(0x7f1364157870 legacy=0x7f1364070830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:11.079 INFO:teuthology.misc.health.smithi088.stderr:2024-04-26T23:40:11.072+0000 7f136259c640 1 -- 172.21.15.88:0/4230129585 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1364157350 con 0x7f13640c3ab0 2024-04-26T23:40:11.079 INFO:teuthology.misc.health.smithi088.stderr:2024-04-26T23:40:11.073+0000 7f136259c640 1 --2- 172.21.15.88:0/4230129585 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f13640c3ab0 0x7f13640702f0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f13580097d0 tx=0x7f135802a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=877d051b23c2a153 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:11.079 INFO:teuthology.misc.health.smithi088.stderr:2024-04-26T23:40:11.073+0000 7f1361d9b640 1 -- 172.21.15.88:0/4230129585 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1358037070 con 0x7f13640c3ab0 2024-04-26T23:40:11.079 INFO:teuthology.misc.health.smithi088.stderr:2024-04-26T23:40:11.073+0000 7f1361d9b640 1 -- 172.21.15.88:0/4230129585 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1358032440 con 0x7f13640c3ab0 2024-04-26T23:40:11.079 INFO:teuthology.misc.health.smithi088.stderr:2024-04-26T23:40:11.073+0000 7f1361d9b640 1 -- 172.21.15.88:0/4230129585 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1358032810 con 0x7f13640c3ab0 2024-04-26T23:40:11.079 INFO:teuthology.misc.health.smithi088.stderr:2024-04-26T23:40:11.073+0000 7f136915f640 1 -- 172.21.15.88:0/4230129585 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f13640c3ab0 msgr2=0x7f13640702f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:11.079 INFO:teuthology.misc.health.smithi088.stderr:2024-04-26T23:40:11.074+0000 7f136915f640 1 --2- 172.21.15.88:0/4230129585 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f13640c3ab0 0x7f13640702f0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f13580097d0 tx=0x7f135802a180 comp rx=0 tx=0).stop 2024-04-26T23:40:11.079 INFO:teuthology.misc.health.smithi088.stderr:2024-04-26T23:40:11.074+0000 7f136915f640 1 -- 172.21.15.88:0/4230129585 shutdown_connections 2024-04-26T23:40:11.079 INFO:teuthology.misc.health.smithi088.stderr:2024-04-26T23:40:11.074+0000 7f136915f640 1 --2- 172.21.15.88:0/4230129585 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f13640c3ab0 0x7f13640702f0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:11.079 INFO:teuthology.misc.health.smithi088.stderr:2024-04-26T23:40:11.074+0000 7f136915f640 1 -- 172.21.15.88:0/4230129585 >> 172.21.15.88:0/4230129585 conn(0x7f136406fa50 msgr2=0x7f1364075700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:40:11.079 INFO:teuthology.misc.health.smithi088.stderr:2024-04-26T23:40:11.074+0000 7f136915f640 1 -- 172.21.15.88:0/4230129585 shutdown_connections 2024-04-26T23:40:11.079 INFO:teuthology.misc.health.smithi088.stderr:2024-04-26T23:40:11.074+0000 7f136915f640 1 -- 172.21.15.88:0/4230129585 wait complete. 2024-04-26T23:40:11.082 INFO:teuthology.misc.health.smithi088.stderr:2024-04-26T23:40:11.075+0000 7f136915f640 1 Processor -- start 2024-04-26T23:40:11.082 INFO:teuthology.misc.health.smithi088.stderr:2024-04-26T23:40:11.075+0000 7f136915f640 1 -- start start 2024-04-26T23:40:11.082 INFO:teuthology.misc.health.smithi088.stderr:2024-04-26T23:40:11.076+0000 7f136915f640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f13640743a0 0x7f13640af3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:11.082 INFO:teuthology.misc.health.smithi088.stderr:2024-04-26T23:40:11.076+0000 7f136915f640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f13640c3ab0 0x7f13640ad000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:11.082 INFO:teuthology.misc.health.smithi088.stderr:2024-04-26T23:40:11.076+0000 7f136915f640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1364157870 0x7f136415a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:11.082 INFO:teuthology.misc.health.smithi088.stderr:2024-04-26T23:40:11.076+0000 7f136915f640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f13640aba60 con 0x7f1364157870 2024-04-26T23:40:11.082 INFO:teuthology.misc.health.smithi088.stderr:2024-04-26T23:40:11.076+0000 7f136915f640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f1364074780 con 0x7f13640743a0 2024-04-26T23:40:11.083 INFO:teuthology.misc.health.smithi088.stderr:2024-04-26T23:40:11.076+0000 7f136915f640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f1364070f40 con 0x7f13640c3ab0 2024-04-26T23:40:11.083 INFO:teuthology.misc.health.smithi088.stderr:2024-04-26T23:40:11.076+0000 7f136359e640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1364157870 0x7f136415a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:11.083 INFO:teuthology.misc.health.smithi088.stderr:2024-04-26T23:40:11.076+0000 7f136359e640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1364157870 0x7f136415a1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:53266/0 (socket says 172.21.15.88:53266) 2024-04-26T23:40:11.083 INFO:teuthology.misc.health.smithi088.stderr:2024-04-26T23:40:11.076+0000 7f136359e640 1 -- 172.21.15.88:0/3578969121 learned_addr learned my addr 172.21.15.88:0/3578969121 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:40:11.083 INFO:teuthology.misc.health.smithi088.stderr:2024-04-26T23:40:11.076+0000 7f136259c640 1 --2- 172.21.15.88:0/3578969121 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f13640c3ab0 0x7f13640ad000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:11.083 INFO:teuthology.misc.health.smithi088.stderr:2024-04-26T23:40:11.076+0000 7f1362d9d640 1 --2- 172.21.15.88:0/3578969121 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f13640743a0 0x7f13640af3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:11.083 INFO:teuthology.misc.health.smithi088.stderr:2024-04-26T23:40:11.076+0000 7f136359e640 1 -- 172.21.15.88:0/3578969121 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f13640c3ab0 msgr2=0x7f13640ad000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:11.083 INFO:teuthology.misc.health.smithi088.stderr:2024-04-26T23:40:11.076+0000 7f136359e640 1 --2- 172.21.15.88:0/3578969121 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f13640c3ab0 0x7f13640ad000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:11.083 INFO:teuthology.misc.health.smithi088.stderr:2024-04-26T23:40:11.076+0000 7f136359e640 1 -- 172.21.15.88:0/3578969121 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f13640743a0 msgr2=0x7f13640af3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:11.083 INFO:teuthology.misc.health.smithi088.stderr:2024-04-26T23:40:11.076+0000 7f136359e640 1 --2- 172.21.15.88:0/3578969121 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f13640743a0 0x7f13640af3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:11.083 INFO:teuthology.misc.health.smithi088.stderr:2024-04-26T23:40:11.076+0000 7f136359e640 1 -- 172.21.15.88:0/3578969121 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13641f0900 con 0x7f1364157870 2024-04-26T23:40:11.083 INFO:teuthology.misc.health.smithi088.stderr:2024-04-26T23:40:11.076+0000 7f136259c640 1 --2- 172.21.15.88:0/3578969121 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f13640c3ab0 0x7f13640ad000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:40:11.083 INFO:teuthology.misc.health.smithi088.stderr:2024-04-26T23:40:11.076+0000 7f1362d9d640 1 --2- 172.21.15.88:0/3578969121 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f13640743a0 0x7f13640af3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:40:11.083 INFO:teuthology.misc.health.smithi088.stderr:2024-04-26T23:40:11.076+0000 7f136359e640 1 --2- 172.21.15.88:0/3578969121 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1364157870 0x7f136415a1f0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f135c00ca20 tx=0x7f135c00cee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:11.083 INFO:teuthology.misc.health.smithi088.stderr:2024-04-26T23:40:11.076+0000 7f134b7fe640 1 -- 172.21.15.88:0/3578969121 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f135c017070 con 0x7f1364157870 2024-04-26T23:40:11.084 INFO:teuthology.misc.health.smithi088.stderr:2024-04-26T23:40:11.076+0000 7f134b7fe640 1 -- 172.21.15.88:0/3578969121 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f135c00abf0 con 0x7f1364157870 2024-04-26T23:40:11.084 INFO:teuthology.misc.health.smithi088.stderr:2024-04-26T23:40:11.076+0000 7f136915f640 1 -- 172.21.15.88:0/3578969121 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13641f0620 con 0x7f1364157870 2024-04-26T23:40:11.084 INFO:teuthology.misc.health.smithi088.stderr:2024-04-26T23:40:11.076+0000 7f134b7fe640 1 -- 172.21.15.88:0/3578969121 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f135c012400 con 0x7f1364157870 2024-04-26T23:40:11.084 INFO:teuthology.misc.health.smithi088.stderr:2024-04-26T23:40:11.077+0000 7f136915f640 1 -- 172.21.15.88:0/3578969121 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1364158e30 con 0x7f1364157870 2024-04-26T23:40:11.084 INFO:teuthology.misc.health.smithi088.stderr:2024-04-26T23:40:11.077+0000 7f134b7fe640 1 -- 172.21.15.88:0/3578969121 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f135c01a070 con 0x7f1364157870 2024-04-26T23:40:11.084 INFO:teuthology.misc.health.smithi088.stderr:2024-04-26T23:40:11.077+0000 7f134b7fe640 1 -- 172.21.15.88:0/3578969121 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f135c007740 con 0x7f1364157870 2024-04-26T23:40:11.084 INFO:teuthology.misc.health.smithi088.stderr:2024-04-26T23:40:11.077+0000 7f136915f640 1 -- 172.21.15.88:0/3578969121 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f13640506c0 con 0x7f1364157870 2024-04-26T23:40:11.084 INFO:teuthology.misc.health.smithi088.stderr:2024-04-26T23:40:11.079+0000 7f134b7fe640 1 -- 172.21.15.88:0/3578969121 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f135c021070 con 0x7f1364157870 2024-04-26T23:40:11.130 INFO:tasks.ceph.mgr.x.smithi175.stderr:2024-04-26T23:40:11.127+0000 7f32091bc040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-26T23:40:11.145 INFO:teuthology.misc.health.smithi088.stderr:2024-04-26T23:40:11.141+0000 7f136915f640 1 -- 172.21.15.88:0/3578969121 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f13640abfd0 con 0x7f1364157870 2024-04-26T23:40:11.145 INFO:teuthology.misc.health.smithi088.stderr:2024-04-26T23:40:11.142+0000 7f134b7fe640 1 -- 172.21.15.88:0/3578969121 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f135c0079f0 con 0x7f1364157870 2024-04-26T23:40:11.146 INFO:teuthology.misc.health.smithi088.stdout: 2024-04-26T23:40:11.146 INFO:teuthology.misc.health.smithi088.stdout:{"epoch":10,"fsid":"555255e9-7ef9-4454-8dc9-35e96b70035c","created":"2024-04-26T23:40:07.836009+0000","modified":"2024-04-26T23:40:09.944777+0000","last_up_change":"0.000000","last_in_change":"2024-04-26T23:40:09.944777+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"92aecea3-ed62-4a29-87c0-76758a0816a5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"7a6f0fa9-23d0-4747-880f-798d45ec5eeb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"6be88ea0-e133-4200-a4b5-f92d664b248a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"dcb0746b-7b3d-4ecf-8089-2493a5d1857c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"c483de66-c44f-450e-a4ce-b132d50882c3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"ac3b1669-d228-40dd-9f9a-cb46aa73dd6d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"7bef4896-857e-4c11-b3b2-c2e9a8548338","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"e18d9e09-8673-470d-b9dc-280a409b63f8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:40:11.147 INFO:teuthology.misc.health.smithi088.stderr:2024-04-26T23:40:11.143+0000 7f136915f640 1 -- 172.21.15.88:0/3578969121 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1364157870 msgr2=0x7f136415a1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:11.147 INFO:teuthology.misc.health.smithi088.stderr:2024-04-26T23:40:11.143+0000 7f136915f640 1 --2- 172.21.15.88:0/3578969121 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1364157870 0x7f136415a1f0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f135c00ca20 tx=0x7f135c00cee0 comp rx=0 tx=0).stop 2024-04-26T23:40:11.147 INFO:teuthology.misc.health.smithi088.stderr:2024-04-26T23:40:11.143+0000 7f136915f640 1 -- 172.21.15.88:0/3578969121 shutdown_connections 2024-04-26T23:40:11.147 INFO:teuthology.misc.health.smithi088.stderr:2024-04-26T23:40:11.143+0000 7f136915f640 1 --2- 172.21.15.88:0/3578969121 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f13640c3ab0 0x7f13640ad000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:11.147 INFO:teuthology.misc.health.smithi088.stderr:2024-04-26T23:40:11.143+0000 7f136915f640 1 --2- 172.21.15.88:0/3578969121 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1364157870 0x7f136415a1f0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:11.147 INFO:teuthology.misc.health.smithi088.stderr:2024-04-26T23:40:11.143+0000 7f136915f640 1 --2- 172.21.15.88:0/3578969121 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f13640743a0 0x7f13640af3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:11.147 INFO:teuthology.misc.health.smithi088.stderr:2024-04-26T23:40:11.143+0000 7f136915f640 1 -- 172.21.15.88:0/3578969121 >> 172.21.15.88:0/3578969121 conn(0x7f136406fa50 msgr2=0x7f13640c82d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:40:11.147 INFO:teuthology.misc.health.smithi088.stderr:2024-04-26T23:40:11.143+0000 7f136915f640 1 -- 172.21.15.88:0/3578969121 shutdown_connections 2024-04-26T23:40:11.147 INFO:teuthology.misc.health.smithi088.stderr:2024-04-26T23:40:11.143+0000 7f136915f640 1 -- 172.21.15.88:0/3578969121 wait complete. 2024-04-26T23:40:11.155 INFO:tasks.ceph.mgr.y.smithi088.stderr:2024-04-26T23:40:11.151+0000 7f7100920040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-26T23:40:11.156 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-04-26T23:40:11.205 INFO:tasks.ceph.mgr.y.smithi088.stderr:2024-04-26T23:40:11.201+0000 7f7100920040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-26T23:40:11.268 INFO:tasks.ceph.mgr.x.smithi175.stderr:2024-04-26T23:40:11.264+0000 7f32091bc040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-26T23:40:11.275 INFO:tasks.ceph.mgr.y.smithi088.stderr:2024-04-26T23:40:11.272+0000 7f7100920040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-26T23:40:11.317 INFO:tasks.ceph.mgr.x.smithi175.stderr:2024-04-26T23:40:11.313+0000 7f32091bc040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-26T23:40:11.320 INFO:tasks.ceph.mgr.y.smithi088.stderr:2024-04-26T23:40:11.316+0000 7f7100920040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-26T23:40:11.386 INFO:tasks.ceph.mgr.x.smithi175.stderr:2024-04-26T23:40:11.383+0000 7f32091bc040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-26T23:40:11.432 INFO:tasks.ceph.mgr.x.smithi175.stderr:2024-04-26T23:40:11.429+0000 7f32091bc040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-26T23:40:11.799 INFO:tasks.ceph.mgr.y.smithi088.stderr:2024-04-26T23:40:11.795+0000 7f7100920040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-26T23:40:11.910 INFO:tasks.ceph.mgr.x.smithi175.stderr:2024-04-26T23:40:11.907+0000 7f32091bc040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-26T23:40:11.915 INFO:tasks.ceph.mgr.y.smithi088.stderr:2024-04-26T23:40:11.912+0000 7f7100920040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-26T23:40:12.029 INFO:tasks.ceph.mgr.x.smithi175.stderr:2024-04-26T23:40:12.026+0000 7f32091bc040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-26T23:40:12.929 INFO:tasks.ceph.mgr.y.smithi088.stderr:2024-04-26T23:40:12.925+0000 7f70a0bee640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-04-26T23:40:12.929 INFO:tasks.ceph.mgr.y.smithi088.stderr:2024-04-26T23:40:12.926+0000 7f70a0bee640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-04-26T23:40:14.037 INFO:tasks.ceph.osd.2.smithi088.stderr:2024-04-26T23:40:14.034+0000 7fe04061a640 -1 osd.2 0 log_to_monitors true 2024-04-26T23:40:14.092 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-04-26T23:40:14.088+0000 7f9b48b68640 -1 osd.0 0 log_to_monitors true 2024-04-26T23:40:14.093 INFO:tasks.ceph.osd.1.smithi088.stderr:2024-04-26T23:40:14.089+0000 7f2eaf957640 -1 osd.1 0 log_to_monitors true 2024-04-26T23:40:14.106 INFO:tasks.ceph.osd.3.smithi088.stderr:2024-04-26T23:40:14.103+0000 7fd2b8bcb640 -1 osd.3 0 log_to_monitors true 2024-04-26T23:40:14.110 INFO:tasks.ceph.osd.5.smithi175.stderr:2024-04-26T23:40:14.107+0000 7fa12dc0d640 -1 osd.5 0 log_to_monitors true 2024-04-26T23:40:14.116 INFO:tasks.ceph.osd.4.smithi175.stderr:2024-04-26T23:40:14.113+0000 7fbb40b50640 -1 osd.4 0 log_to_monitors true 2024-04-26T23:40:14.125 INFO:tasks.ceph.osd.7.smithi175.stderr:2024-04-26T23:40:14.121+0000 7fb141d01640 -1 osd.7 0 log_to_monitors true 2024-04-26T23:40:14.129 INFO:tasks.ceph.osd.6.smithi175.stderr:2024-04-26T23:40:14.126+0000 7f6c2a5cb640 -1 osd.6 0 log_to_monitors true 2024-04-26T23:40:17.830 INFO:tasks.ceph.osd.2.smithi088.stderr:2024-04-26T23:40:17.827+0000 7fe03bfe7640 -1 osd.2 0 waiting for initial osdmap 2024-04-26T23:40:17.844 INFO:tasks.ceph.osd.2.smithi088.stderr:2024-04-26T23:40:17.842+0000 7fe033e07640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T23:40:17.922 INFO:tasks.ceph.osd.5.smithi175.stderr:2024-04-26T23:40:17.919+0000 7fa1294f3640 -1 osd.5 0 waiting for initial osdmap 2024-04-26T23:40:17.924 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-04-26T23:40:17.922+0000 7f9b44afe640 -1 osd.0 0 waiting for initial osdmap 2024-04-26T23:40:17.936 INFO:tasks.ceph.osd.5.smithi175.stderr:2024-04-26T23:40:17.933+0000 7fa121313640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T23:40:17.937 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-04-26T23:40:17.935+0000 7f9b3c91e640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T23:40:17.941 INFO:tasks.ceph.osd.1.smithi088.stderr:2024-04-26T23:40:17.939+0000 7f2eac101640 -1 osd.1 0 waiting for initial osdmap 2024-04-26T23:40:17.953 INFO:tasks.ceph.osd.1.smithi088.stderr:2024-04-26T23:40:17.951+0000 7f2ea370d640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T23:40:17.963 DEBUG:teuthology.orchestra.run.smithi088:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-26T23:40:17.987 INFO:tasks.ceph.osd.7.smithi175.stderr:2024-04-26T23:40:17.984+0000 7fb13e4ab640 -1 osd.7 0 waiting for initial osdmap 2024-04-26T23:40:17.998 INFO:tasks.ceph.osd.3.smithi088.stderr:2024-04-26T23:40:17.996+0000 7fd2b4b61640 -1 osd.3 0 waiting for initial osdmap 2024-04-26T23:40:18.002 INFO:tasks.ceph.osd.7.smithi175.stderr:2024-04-26T23:40:17.999+0000 7fb135ab7640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T23:40:18.016 INFO:tasks.ceph.osd.3.smithi088.stderr:2024-04-26T23:40:18.014+0000 7fd2ac981640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T23:40:18.031 INFO:tasks.ceph.osd.4.smithi175.stderr:2024-04-26T23:40:18.028+0000 7fbb3cae6640 -1 osd.4 0 waiting for initial osdmap 2024-04-26T23:40:18.047 INFO:tasks.ceph.osd.4.smithi175.stderr:2024-04-26T23:40:18.044+0000 7fbb34906640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T23:40:18.053 INFO:tasks.ceph.osd.6.smithi175.stderr:2024-04-26T23:40:18.050+0000 7f6c26561640 -1 osd.6 0 waiting for initial osdmap 2024-04-26T23:40:18.056 INFO:teuthology.misc.health.smithi088.stderr:2024-04-26T23:40:18.053+0000 7f6d1f371640 1 Processor -- start 2024-04-26T23:40:18.056 INFO:teuthology.misc.health.smithi088.stderr:2024-04-26T23:40:18.053+0000 7f6d1f371640 1 -- start start 2024-04-26T23:40:18.057 INFO:teuthology.misc.health.smithi088.stderr:2024-04-26T23:40:18.054+0000 7f6d1f371640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f6d18154f70 0x7f6d18155350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:18.057 INFO:teuthology.misc.health.smithi088.stderr:2024-04-26T23:40:18.054+0000 7f6d1f371640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f6d18073270 0x7f6d181585a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:18.057 INFO:teuthology.misc.health.smithi088.stderr:2024-04-26T23:40:18.054+0000 7f6d1f371640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6d18155890 con 0x7f6d180ab430 2024-04-26T23:40:18.057 INFO:teuthology.misc.health.smithi088.stderr:2024-04-26T23:40:18.054+0000 7f6d1f371640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f6d1814b860 con 0x7f6d18154f70 2024-04-26T23:40:18.057 INFO:teuthology.misc.health.smithi088.stderr:2024-04-26T23:40:18.054+0000 7f6d1f371640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f6d18158110 con 0x7f6d18073270 2024-04-26T23:40:18.058 INFO:teuthology.misc.health.smithi088.stderr:2024-04-26T23:40:18.054+0000 7f6d1d10d640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f6d18154f70 0x7f6d18155350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:18.058 INFO:teuthology.misc.health.smithi088.stderr:2024-04-26T23:40:18.054+0000 7f6d1d10d640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f6d18154f70 0x7f6d18155350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:53376/0 (socket says 172.21.15.88:53376) 2024-04-26T23:40:18.058 INFO:teuthology.misc.health.smithi088.stderr:2024-04-26T23:40:18.054+0000 7f6d1d10d640 1 -- 172.21.15.88:0/1409140351 learned_addr learned my addr 172.21.15.88:0/1409140351 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:40:18.058 INFO:teuthology.misc.health.smithi088.stderr:2024-04-26T23:40:18.054+0000 7f6d1c90c640 1 --2- 172.21.15.88:0/1409140351 >> v2:172.21.15.175:3300/0 conn(0x7f6d18073270 0x7f6d181585a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:18.058 INFO:teuthology.misc.health.smithi088.stderr:2024-04-26T23:40:18.054+0000 7f6d1d10d640 1 -- 172.21.15.88:0/1409140351 >> v2:172.21.15.175:3300/0 conn(0x7f6d18073270 msgr2=0x7f6d181585a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:40:18.058 INFO:teuthology.misc.health.smithi088.stderr:2024-04-26T23:40:18.054+0000 7f6d1d10d640 1 --2- 172.21.15.88:0/1409140351 >> v2:172.21.15.175:3300/0 conn(0x7f6d18073270 0x7f6d181585a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:18.058 INFO:teuthology.misc.health.smithi088.stderr:2024-04-26T23:40:18.054+0000 7f6d1d10d640 1 -- 172.21.15.88:0/1409140351 >> v1:172.21.15.175:6789/0 conn(0x7f6d180ab430 legacy=0x7f6d180c6b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:18.058 INFO:teuthology.misc.health.smithi088.stderr:2024-04-26T23:40:18.054+0000 7f6d1d10d640 1 -- 172.21.15.88:0/1409140351 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d180c5fd0 con 0x7f6d18154f70 2024-04-26T23:40:18.060 INFO:teuthology.misc.health.smithi088.stderr:2024-04-26T23:40:18.055+0000 7f6d1d10d640 1 --2- 172.21.15.88:0/1409140351 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6d18154f70 0x7f6d18155350 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f6d180c4b00 tx=0x7f6d1002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=578724a2f4d1607f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:18.060 INFO:teuthology.misc.health.smithi088.stderr:2024-04-26T23:40:18.055+0000 7f6d0ffff640 1 -- 172.21.15.88:0/1409140351 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d10037070 con 0x7f6d18154f70 2024-04-26T23:40:18.060 INFO:teuthology.misc.health.smithi088.stderr:2024-04-26T23:40:18.055+0000 7f6d0ffff640 1 -- 172.21.15.88:0/1409140351 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d10032440 con 0x7f6d18154f70 2024-04-26T23:40:18.060 INFO:teuthology.misc.health.smithi088.stderr:2024-04-26T23:40:18.055+0000 7f6d0ffff640 1 -- 172.21.15.88:0/1409140351 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d10032810 con 0x7f6d18154f70 2024-04-26T23:40:18.060 INFO:teuthology.misc.health.smithi088.stderr:2024-04-26T23:40:18.056+0000 7f6d1f371640 1 -- 172.21.15.88:0/1409140351 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6d18154f70 msgr2=0x7f6d18155350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:18.060 INFO:teuthology.misc.health.smithi088.stderr:2024-04-26T23:40:18.056+0000 7f6d1f371640 1 --2- 172.21.15.88:0/1409140351 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6d18154f70 0x7f6d18155350 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f6d180c4b00 tx=0x7f6d1002a1e0 comp rx=0 tx=0).stop 2024-04-26T23:40:18.060 INFO:teuthology.misc.health.smithi088.stderr:2024-04-26T23:40:18.056+0000 7f6d1f371640 1 -- 172.21.15.88:0/1409140351 shutdown_connections 2024-04-26T23:40:18.060 INFO:teuthology.misc.health.smithi088.stderr:2024-04-26T23:40:18.056+0000 7f6d1f371640 1 --2- 172.21.15.88:0/1409140351 >> v2:172.21.15.175:3300/0 conn(0x7f6d18073270 0x7f6d181585a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:18.060 INFO:teuthology.misc.health.smithi088.stderr:2024-04-26T23:40:18.056+0000 7f6d1f371640 1 --2- 172.21.15.88:0/1409140351 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6d18154f70 0x7f6d18155350 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:18.060 INFO:teuthology.misc.health.smithi088.stderr:2024-04-26T23:40:18.056+0000 7f6d1f371640 1 -- 172.21.15.88:0/1409140351 >> 172.21.15.88:0/1409140351 conn(0x7f6d1806fa50 msgr2=0x7f6d18075700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:40:18.060 INFO:teuthology.misc.health.smithi088.stderr:2024-04-26T23:40:18.056+0000 7f6d1f371640 1 -- 172.21.15.88:0/1409140351 shutdown_connections 2024-04-26T23:40:18.060 INFO:teuthology.misc.health.smithi088.stderr:2024-04-26T23:40:18.056+0000 7f6d1f371640 1 -- 172.21.15.88:0/1409140351 wait complete. 2024-04-26T23:40:18.060 INFO:teuthology.misc.health.smithi088.stderr:2024-04-26T23:40:18.057+0000 7f6d1f371640 1 Processor -- start 2024-04-26T23:40:18.061 INFO:teuthology.misc.health.smithi088.stderr:2024-04-26T23:40:18.057+0000 7f6d1f371640 1 -- start start 2024-04-26T23:40:18.063 INFO:teuthology.misc.health.smithi088.stderr:2024-04-26T23:40:18.058+0000 7f6d1f371640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6d180ab430 0x7f6d181de6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:18.063 INFO:teuthology.misc.health.smithi088.stderr:2024-04-26T23:40:18.058+0000 7f6d1f371640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6d18154f70 0x7f6d181e0740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:18.063 INFO:teuthology.misc.health.smithi088.stderr:2024-04-26T23:40:18.058+0000 7f6d1f371640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6d181ea8d0 0x7f6d181e0c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:18.063 INFO:teuthology.misc.health.smithi088.stderr:2024-04-26T23:40:18.058+0000 7f6d1f371640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f6d180c6850 con 0x7f6d181ea8d0 2024-04-26T23:40:18.063 INFO:teuthology.misc.health.smithi088.stderr:2024-04-26T23:40:18.058+0000 7f6d1f371640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f6d180c6570 con 0x7f6d18154f70 2024-04-26T23:40:18.063 INFO:teuthology.misc.health.smithi088.stderr:2024-04-26T23:40:18.058+0000 7f6d1f371640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f6d18158ae0 con 0x7f6d180ab430 2024-04-26T23:40:18.063 INFO:teuthology.misc.health.smithi088.stderr:2024-04-26T23:40:18.058+0000 7f6d1d90e640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6d181ea8d0 0x7f6d181e0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:18.063 INFO:teuthology.misc.health.smithi088.stderr:2024-04-26T23:40:18.058+0000 7f6d1d90e640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6d181ea8d0 0x7f6d181e0c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:53384/0 (socket says 172.21.15.88:53384) 2024-04-26T23:40:18.063 INFO:teuthology.misc.health.smithi088.stderr:2024-04-26T23:40:18.058+0000 7f6d1d90e640 1 -- 172.21.15.88:0/643111292 learned_addr learned my addr 172.21.15.88:0/643111292 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:40:18.064 INFO:teuthology.misc.health.smithi088.stderr:2024-04-26T23:40:18.058+0000 7f6d1c90c640 1 --2- 172.21.15.88:0/643111292 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6d18154f70 0x7f6d181e0740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:18.064 INFO:teuthology.misc.health.smithi088.stderr:2024-04-26T23:40:18.058+0000 7f6d1d10d640 1 --2- 172.21.15.88:0/643111292 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6d180ab430 0x7f6d181de6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:18.064 INFO:teuthology.misc.health.smithi088.stderr:2024-04-26T23:40:18.058+0000 7f6d1d90e640 1 -- 172.21.15.88:0/643111292 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6d180ab430 msgr2=0x7f6d181de6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:18.064 INFO:teuthology.misc.health.smithi088.stderr:2024-04-26T23:40:18.058+0000 7f6d1d90e640 1 --2- 172.21.15.88:0/643111292 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6d180ab430 0x7f6d181de6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:18.064 INFO:teuthology.misc.health.smithi088.stderr:2024-04-26T23:40:18.058+0000 7f6d1d90e640 1 -- 172.21.15.88:0/643111292 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6d18154f70 msgr2=0x7f6d181e0740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:18.064 INFO:teuthology.misc.health.smithi088.stderr:2024-04-26T23:40:18.058+0000 7f6d1d90e640 1 --2- 172.21.15.88:0/643111292 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6d18154f70 0x7f6d181e0740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:18.064 INFO:teuthology.misc.health.smithi088.stderr:2024-04-26T23:40:18.058+0000 7f6d1d90e640 1 -- 172.21.15.88:0/643111292 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d181e0220 con 0x7f6d181ea8d0 2024-04-26T23:40:18.064 INFO:teuthology.misc.health.smithi088.stderr:2024-04-26T23:40:18.058+0000 7f6d1d90e640 1 --2- 172.21.15.88:0/643111292 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6d181ea8d0 0x7f6d181e0c80 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f6d1400c730 tx=0x7f6d1400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:18.064 INFO:teuthology.misc.health.smithi088.stderr:2024-04-26T23:40:18.058+0000 7f6d0dffb640 1 -- 172.21.15.88:0/643111292 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d14003b70 con 0x7f6d181ea8d0 2024-04-26T23:40:18.064 INFO:teuthology.misc.health.smithi088.stderr:2024-04-26T23:40:18.058+0000 7f6d0dffb640 1 -- 172.21.15.88:0/643111292 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d14003d30 con 0x7f6d181ea8d0 2024-04-26T23:40:18.064 INFO:teuthology.misc.health.smithi088.stderr:2024-04-26T23:40:18.058+0000 7f6d0dffb640 1 -- 172.21.15.88:0/643111292 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d14005310 con 0x7f6d181ea8d0 2024-04-26T23:40:18.064 INFO:teuthology.misc.health.smithi088.stderr:2024-04-26T23:40:18.058+0000 7f6d1f371640 1 -- 172.21.15.88:0/643111292 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d181eadd0 con 0x7f6d181ea8d0 2024-04-26T23:40:18.064 INFO:teuthology.misc.health.smithi088.stderr:2024-04-26T23:40:18.058+0000 7f6d1f371640 1 -- 172.21.15.88:0/643111292 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d181eb390 con 0x7f6d181ea8d0 2024-04-26T23:40:18.064 INFO:teuthology.misc.health.smithi088.stderr:2024-04-26T23:40:18.059+0000 7f6d1f371640 1 -- 172.21.15.88:0/643111292 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d180506c0 con 0x7f6d181ea8d0 2024-04-26T23:40:18.064 INFO:teuthology.misc.health.smithi088.stderr:2024-04-26T23:40:18.060+0000 7f6d0dffb640 1 -- 172.21.15.88:0/643111292 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 4) ==== 90984+0+0 (secure 0 0 0) 0x7f6d140056c0 con 0x7f6d181ea8d0 2024-04-26T23:40:18.064 INFO:teuthology.misc.health.smithi088.stderr:2024-04-26T23:40:18.060+0000 7f6d0dffb640 1 --2- 172.21.15.88:0/643111292 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f6cfc06c860 0x7f6cfc06ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:18.064 INFO:teuthology.misc.health.smithi088.stderr:2024-04-26T23:40:18.060+0000 7f6d0dffb640 1 -- 172.21.15.88:0/643111292 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 2231+0+0 (secure 0 0 0) 0x7f6d1408ad50 con 0x7f6d181ea8d0 2024-04-26T23:40:18.065 INFO:teuthology.misc.health.smithi088.stderr:2024-04-26T23:40:18.060+0000 7f6d1d10d640 1 --2- 172.21.15.88:0/643111292 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f6cfc06c860 0x7f6cfc06ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:18.065 INFO:teuthology.misc.health.smithi088.stderr:2024-04-26T23:40:18.060+0000 7f6d1d10d640 1 --2- 172.21.15.88:0/643111292 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f6cfc06c860 0x7f6cfc06ed20 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f6d10034000 tx=0x7f6d1002e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:18.067 INFO:teuthology.misc.health.smithi088.stderr:2024-04-26T23:40:18.065+0000 7f6d0dffb640 1 -- 172.21.15.88:0/643111292 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f6d14059ff0 con 0x7f6d181ea8d0 2024-04-26T23:40:18.073 INFO:tasks.ceph.osd.6.smithi175.stderr:2024-04-26T23:40:18.070+0000 7f6c1e381640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T23:40:18.245 INFO:teuthology.misc.health.smithi088.stderr:2024-04-26T23:40:18.242+0000 7f6d1f371640 1 -- 172.21.15.88:0/643111292 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6d180af840 con 0x7f6d181ea8d0 2024-04-26T23:40:18.245 INFO:teuthology.misc.health.smithi088.stderr:2024-04-26T23:40:18.242+0000 7f6d0dffb640 1 -- 172.21.15.88:0/643111292 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) ==== 74+0+7058 (secure 0 0 0) 0x7f6d140598f0 con 0x7f6d181ea8d0 2024-04-26T23:40:18.245 INFO:teuthology.misc.health.smithi088.stdout: 2024-04-26T23:40:18.245 INFO:teuthology.misc.health.smithi088.stdout:{"epoch":12,"fsid":"555255e9-7ef9-4454-8dc9-35e96b70035c","created":"2024-04-26T23:40:07.836009+0000","modified":"2024-04-26T23:40:15.931267+0000","last_up_change":"0.000000","last_in_change":"2024-04-26T23:40:09.944777+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"92aecea3-ed62-4a29-87c0-76758a0816a5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"7a6f0fa9-23d0-4747-880f-798d45ec5eeb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"6be88ea0-e133-4200-a4b5-f92d664b248a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"dcb0746b-7b3d-4ecf-8089-2493a5d1857c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"c483de66-c44f-450e-a4ce-b132d50882c3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"ac3b1669-d228-40dd-9f9a-cb46aa73dd6d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"7bef4896-857e-4c11-b3b2-c2e9a8548338","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"e18d9e09-8673-470d-b9dc-280a409b63f8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:40:18.247 INFO:teuthology.misc.health.smithi088.stderr:2024-04-26T23:40:18.244+0000 7f6d1f371640 1 -- 172.21.15.88:0/643111292 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f6cfc06c860 msgr2=0x7f6cfc06ed20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:18.248 INFO:teuthology.misc.health.smithi088.stderr:2024-04-26T23:40:18.244+0000 7f6d1f371640 1 --2- 172.21.15.88:0/643111292 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f6cfc06c860 0x7f6cfc06ed20 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f6d10034000 tx=0x7f6d1002e000 comp rx=0 tx=0).stop 2024-04-26T23:40:18.248 INFO:teuthology.misc.health.smithi088.stderr:2024-04-26T23:40:18.244+0000 7f6d1f371640 1 -- 172.21.15.88:0/643111292 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6d181ea8d0 msgr2=0x7f6d181e0c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:18.248 INFO:teuthology.misc.health.smithi088.stderr:2024-04-26T23:40:18.244+0000 7f6d1f371640 1 --2- 172.21.15.88:0/643111292 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6d181ea8d0 0x7f6d181e0c80 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f6d1400c730 tx=0x7f6d1400cbf0 comp rx=0 tx=0).stop 2024-04-26T23:40:18.248 INFO:teuthology.misc.health.smithi088.stderr:2024-04-26T23:40:18.244+0000 7f6d1f371640 1 -- 172.21.15.88:0/643111292 shutdown_connections 2024-04-26T23:40:18.248 INFO:teuthology.misc.health.smithi088.stderr:2024-04-26T23:40:18.244+0000 7f6d1f371640 1 --2- 172.21.15.88:0/643111292 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f6cfc06c860 0x7f6cfc06ed20 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:18.248 INFO:teuthology.misc.health.smithi088.stderr:2024-04-26T23:40:18.244+0000 7f6d1f371640 1 --2- 172.21.15.88:0/643111292 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6d181ea8d0 0x7f6d181e0c80 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:18.248 INFO:teuthology.misc.health.smithi088.stderr:2024-04-26T23:40:18.244+0000 7f6d1f371640 1 --2- 172.21.15.88:0/643111292 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6d18154f70 0x7f6d181e0740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:18.248 INFO:teuthology.misc.health.smithi088.stderr:2024-04-26T23:40:18.244+0000 7f6d1f371640 1 --2- 172.21.15.88:0/643111292 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6d180ab430 0x7f6d181de6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:18.248 INFO:teuthology.misc.health.smithi088.stderr:2024-04-26T23:40:18.244+0000 7f6d1f371640 1 -- 172.21.15.88:0/643111292 >> 172.21.15.88:0/643111292 conn(0x7f6d1806fa50 msgr2=0x7f6d18153980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:40:18.248 INFO:teuthology.misc.health.smithi088.stderr:2024-04-26T23:40:18.244+0000 7f6d1f371640 1 -- 172.21.15.88:0/643111292 shutdown_connections 2024-04-26T23:40:18.248 INFO:teuthology.misc.health.smithi088.stderr:2024-04-26T23:40:18.244+0000 7f6d1f371640 1 -- 172.21.15.88:0/643111292 wait complete. 2024-04-26T23:40:18.257 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-04-26T23:40:25.063 DEBUG:teuthology.orchestra.run.smithi088:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-26T23:40:25.163 INFO:teuthology.misc.health.smithi088.stderr:2024-04-26T23:40:25.160+0000 7fa5e36f8640 1 Processor -- start 2024-04-26T23:40:25.163 INFO:teuthology.misc.health.smithi088.stderr:2024-04-26T23:40:25.160+0000 7fa5e36f8640 1 -- start start 2024-04-26T23:40:25.165 INFO:teuthology.misc.health.smithi088.stderr:2024-04-26T23:40:25.161+0000 7fa5e36f8640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa5dc150bd0 0x7fa5dc157600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:25.165 INFO:teuthology.misc.health.smithi088.stderr:2024-04-26T23:40:25.161+0000 7fa5e36f8640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fa5dc06c7e0 0x7fa5dc06cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:25.165 INFO:teuthology.misc.health.smithi088.stderr:2024-04-26T23:40:25.161+0000 7fa5e36f8640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa5dc0c6f00 con 0x7fa5dc0ca2e0 2024-04-26T23:40:25.165 INFO:teuthology.misc.health.smithi088.stderr:2024-04-26T23:40:25.161+0000 7fa5e36f8640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7fa5dc06c350 con 0x7fa5dc150bd0 2024-04-26T23:40:25.165 INFO:teuthology.misc.health.smithi088.stderr:2024-04-26T23:40:25.161+0000 7fa5e36f8640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7fa5dc0c71e0 con 0x7fa5dc06c7e0 2024-04-26T23:40:25.165 INFO:teuthology.misc.health.smithi088.stderr:2024-04-26T23:40:25.161+0000 7fa5e1494640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa5dc150bd0 0x7fa5dc157600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:25.166 INFO:teuthology.misc.health.smithi088.stderr:2024-04-26T23:40:25.161+0000 7fa5e0c93640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fa5dc0ca2e0 0x7fa5dc0c8df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:35060/0 (socket says 172.21.15.88:35060) 2024-04-26T23:40:25.166 INFO:teuthology.misc.health.smithi088.stderr:2024-04-26T23:40:25.161+0000 7fa5e0c93640 1 -- 172.21.15.88:0/3270534764 learned_addr learned my addr 172.21.15.88:0/3270534764 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-26T23:40:25.166 INFO:teuthology.misc.health.smithi088.stderr:2024-04-26T23:40:25.161+0000 7fa5e1494640 1 -- 172.21.15.88:0/3270534764 >> v2:172.21.15.175:3300/0 conn(0x7fa5dc06c7e0 msgr2=0x7fa5dc06cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:40:25.166 INFO:teuthology.misc.health.smithi088.stderr:2024-04-26T23:40:25.161+0000 7fa5e1c95640 1 --2- 172.21.15.88:0/3270534764 >> v2:172.21.15.175:3300/0 conn(0x7fa5dc06c7e0 0x7fa5dc06cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:25.166 INFO:teuthology.misc.health.smithi088.stderr:2024-04-26T23:40:25.161+0000 7fa5e1494640 1 --2- 172.21.15.88:0/3270534764 >> v2:172.21.15.175:3300/0 conn(0x7fa5dc06c7e0 0x7fa5dc06cbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:25.166 INFO:teuthology.misc.health.smithi088.stderr:2024-04-26T23:40:25.161+0000 7fa5d3fff640 1 -- 172.21.15.88:0/3270534764 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1584103624 0 0) 0x7fa5dc0c6f00 con 0x7fa5dc0ca2e0 2024-04-26T23:40:25.166 INFO:teuthology.misc.health.smithi088.stderr:2024-04-26T23:40:25.162+0000 7fa5e1494640 1 -- 172.21.15.88:0/3270534764 >> v1:172.21.15.88:6789/0 conn(0x7fa5dc0ca2e0 legacy=0x7fa5dc0c8df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:25.166 INFO:teuthology.misc.health.smithi088.stderr:2024-04-26T23:40:25.162+0000 7fa5e1494640 1 -- 172.21.15.88:0/3270534764 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5dc0c74c0 con 0x7fa5dc150bd0 2024-04-26T23:40:25.166 INFO:teuthology.misc.health.smithi088.stderr:2024-04-26T23:40:25.162+0000 7fa5e1c95640 1 --2- 172.21.15.88:0/3270534764 >> v2:172.21.15.175:3300/0 conn(0x7fa5dc06c7e0 0x7fa5dc06cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:40:25.166 INFO:teuthology.misc.health.smithi088.stderr:2024-04-26T23:40:25.162+0000 7fa5e1494640 1 --2- 172.21.15.88:0/3270534764 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa5dc150bd0 0x7fa5dc157600 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fa5dc0b2530 tx=0x7fa5d802a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac4e2f7fd0eaf8ef server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:25.166 INFO:teuthology.misc.health.smithi088.stderr:2024-04-26T23:40:25.162+0000 7fa5d3fff640 1 -- 172.21.15.88:0/3270534764 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5d8007740 con 0x7fa5dc150bd0 2024-04-26T23:40:25.166 INFO:teuthology.misc.health.smithi088.stderr:2024-04-26T23:40:25.162+0000 7fa5d3fff640 1 -- 172.21.15.88:0/3270534764 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5d80078e0 con 0x7fa5dc150bd0 2024-04-26T23:40:25.166 INFO:teuthology.misc.health.smithi088.stderr:2024-04-26T23:40:25.162+0000 7fa5d3fff640 1 -- 172.21.15.88:0/3270534764 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5d8007cb0 con 0x7fa5dc150bd0 2024-04-26T23:40:25.170 INFO:teuthology.misc.health.smithi088.stderr:2024-04-26T23:40:25.163+0000 7fa5e36f8640 1 -- 172.21.15.88:0/3270534764 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa5dc150bd0 msgr2=0x7fa5dc157600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:25.170 INFO:teuthology.misc.health.smithi088.stderr:2024-04-26T23:40:25.163+0000 7fa5e36f8640 1 --2- 172.21.15.88:0/3270534764 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa5dc150bd0 0x7fa5dc157600 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fa5dc0b2530 tx=0x7fa5d802a5f0 comp rx=0 tx=0).stop 2024-04-26T23:40:25.170 INFO:teuthology.misc.health.smithi088.stderr:2024-04-26T23:40:25.163+0000 7fa5e36f8640 1 -- 172.21.15.88:0/3270534764 shutdown_connections 2024-04-26T23:40:25.170 INFO:teuthology.misc.health.smithi088.stderr:2024-04-26T23:40:25.163+0000 7fa5e36f8640 1 --2- 172.21.15.88:0/3270534764 >> v2:172.21.15.175:3300/0 conn(0x7fa5dc06c7e0 0x7fa5dc06cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:25.170 INFO:teuthology.misc.health.smithi088.stderr:2024-04-26T23:40:25.163+0000 7fa5e36f8640 1 --2- 172.21.15.88:0/3270534764 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa5dc150bd0 0x7fa5dc157600 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:25.170 INFO:teuthology.misc.health.smithi088.stderr:2024-04-26T23:40:25.163+0000 7fa5e36f8640 1 -- 172.21.15.88:0/3270534764 >> 172.21.15.88:0/3270534764 conn(0x7fa5dc0adf70 msgr2=0x7fa5dc0ae350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:40:25.170 INFO:teuthology.misc.health.smithi088.stderr:2024-04-26T23:40:25.163+0000 7fa5e36f8640 1 -- 172.21.15.88:0/3270534764 shutdown_connections 2024-04-26T23:40:25.170 INFO:teuthology.misc.health.smithi088.stderr:2024-04-26T23:40:25.163+0000 7fa5e36f8640 1 -- 172.21.15.88:0/3270534764 wait complete. 2024-04-26T23:40:25.170 INFO:teuthology.misc.health.smithi088.stderr:2024-04-26T23:40:25.164+0000 7fa5e36f8640 1 Processor -- start 2024-04-26T23:40:25.170 INFO:teuthology.misc.health.smithi088.stderr:2024-04-26T23:40:25.164+0000 7fa5e36f8640 1 -- start start 2024-04-26T23:40:25.171 INFO:teuthology.misc.health.smithi088.stderr:2024-04-26T23:40:25.165+0000 7fa5e36f8640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa5dc06c7e0 0x7fa5dc14b570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:25.171 INFO:teuthology.misc.health.smithi088.stderr:2024-04-26T23:40:25.165+0000 7fa5e36f8640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa5dc0ca2e0 0x7fa5dc14bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:25.171 INFO:teuthology.misc.health.smithi088.stderr:2024-04-26T23:40:25.165+0000 7fa5e36f8640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa5dc150bd0 0x7fa5dc159a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:25.171 INFO:teuthology.misc.health.smithi088.stderr:2024-04-26T23:40:25.165+0000 7fa5e36f8640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fa5dc0c9680 con 0x7fa5dc0ca2e0 2024-04-26T23:40:25.171 INFO:teuthology.misc.health.smithi088.stderr:2024-04-26T23:40:25.165+0000 7fa5e36f8640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fa5dc0c9500 con 0x7fa5dc06c7e0 2024-04-26T23:40:25.171 INFO:teuthology.misc.health.smithi088.stderr:2024-04-26T23:40:25.165+0000 7fa5e36f8640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fa5dc0bfbe0 con 0x7fa5dc150bd0 2024-04-26T23:40:25.171 INFO:teuthology.misc.health.smithi088.stderr:2024-04-26T23:40:25.165+0000 7fa5e0c93640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa5dc0ca2e0 0x7fa5dc14bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:25.171 INFO:teuthology.misc.health.smithi088.stderr:2024-04-26T23:40:25.165+0000 7fa5e0c93640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa5dc0ca2e0 0x7fa5dc14bab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:38592/0 (socket says 172.21.15.88:38592) 2024-04-26T23:40:25.171 INFO:teuthology.misc.health.smithi088.stderr:2024-04-26T23:40:25.165+0000 7fa5e0c93640 1 -- 172.21.15.88:0/1697840129 learned_addr learned my addr 172.21.15.88:0/1697840129 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:40:25.171 INFO:teuthology.misc.health.smithi088.stderr:2024-04-26T23:40:25.165+0000 7fa5e1494640 1 --2- 172.21.15.88:0/1697840129 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa5dc06c7e0 0x7fa5dc14b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:25.171 INFO:teuthology.misc.health.smithi088.stderr:2024-04-26T23:40:25.165+0000 7fa5e1c95640 1 --2- 172.21.15.88:0/1697840129 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa5dc150bd0 0x7fa5dc159a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:25.171 INFO:teuthology.misc.health.smithi088.stderr:2024-04-26T23:40:25.165+0000 7fa5e0c93640 1 -- 172.21.15.88:0/1697840129 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa5dc150bd0 msgr2=0x7fa5dc159a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:25.171 INFO:teuthology.misc.health.smithi088.stderr:2024-04-26T23:40:25.165+0000 7fa5e0c93640 1 --2- 172.21.15.88:0/1697840129 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa5dc150bd0 0x7fa5dc159a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:25.171 INFO:teuthology.misc.health.smithi088.stderr:2024-04-26T23:40:25.165+0000 7fa5e0c93640 1 -- 172.21.15.88:0/1697840129 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa5dc06c7e0 msgr2=0x7fa5dc14b570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:25.171 INFO:teuthology.misc.health.smithi088.stderr:2024-04-26T23:40:25.165+0000 7fa5e0c93640 1 --2- 172.21.15.88:0/1697840129 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa5dc06c7e0 0x7fa5dc14b570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:25.172 INFO:teuthology.misc.health.smithi088.stderr:2024-04-26T23:40:25.165+0000 7fa5e0c93640 1 -- 172.21.15.88:0/1697840129 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5dc14bff0 con 0x7fa5dc0ca2e0 2024-04-26T23:40:25.172 INFO:teuthology.misc.health.smithi088.stderr:2024-04-26T23:40:25.165+0000 7fa5e1494640 1 --2- 172.21.15.88:0/1697840129 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa5dc06c7e0 0x7fa5dc14b570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:40:25.172 INFO:teuthology.misc.health.smithi088.stderr:2024-04-26T23:40:25.165+0000 7fa5e1c95640 1 --2- 172.21.15.88:0/1697840129 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa5dc150bd0 0x7fa5dc159a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:40:25.172 INFO:teuthology.misc.health.smithi088.stderr:2024-04-26T23:40:25.165+0000 7fa5e0c93640 1 --2- 172.21.15.88:0/1697840129 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa5dc0ca2e0 0x7fa5dc14bab0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fa5cc00c3c0 tx=0x7fa5cc00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:25.172 INFO:teuthology.misc.health.smithi088.stderr:2024-04-26T23:40:25.166+0000 7fa5d1ffb640 1 -- 172.21.15.88:0/1697840129 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5cc0074e0 con 0x7fa5dc0ca2e0 2024-04-26T23:40:25.172 INFO:teuthology.misc.health.smithi088.stderr:2024-04-26T23:40:25.166+0000 7fa5d1ffb640 1 -- 172.21.15.88:0/1697840129 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5cc0047e0 con 0x7fa5dc0ca2e0 2024-04-26T23:40:25.172 INFO:teuthology.misc.health.smithi088.stderr:2024-04-26T23:40:25.166+0000 7fa5e36f8640 1 -- 172.21.15.88:0/1697840129 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5dc151b30 con 0x7fa5dc0ca2e0 2024-04-26T23:40:25.172 INFO:teuthology.misc.health.smithi088.stderr:2024-04-26T23:40:25.166+0000 7fa5d1ffb640 1 -- 172.21.15.88:0/1697840129 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5cc004bd0 con 0x7fa5dc0ca2e0 2024-04-26T23:40:25.172 INFO:teuthology.misc.health.smithi088.stderr:2024-04-26T23:40:25.166+0000 7fa5e36f8640 1 -- 172.21.15.88:0/1697840129 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5dc159210 con 0x7fa5dc0ca2e0 2024-04-26T23:40:25.172 INFO:teuthology.misc.health.smithi088.stderr:2024-04-26T23:40:25.167+0000 7fa5e36f8640 1 -- 172.21.15.88:0/1697840129 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa5dc0506c0 con 0x7fa5dc0ca2e0 2024-04-26T23:40:25.172 INFO:teuthology.misc.health.smithi088.stderr:2024-04-26T23:40:25.167+0000 7fa5d1ffb640 1 -- 172.21.15.88:0/1697840129 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa5cc011070 con 0x7fa5dc0ca2e0 2024-04-26T23:40:25.173 INFO:teuthology.misc.health.smithi088.stderr:2024-04-26T23:40:25.168+0000 7fa5d1ffb640 1 --2- 172.21.15.88:0/1697840129 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fa5c006c8f0 0x7fa5c006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:25.173 INFO:teuthology.misc.health.smithi088.stderr:2024-04-26T23:40:25.168+0000 7fa5d1ffb640 1 -- 172.21.15.88:0/1697840129 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7fa5cc08b340 con 0x7fa5dc0ca2e0 2024-04-26T23:40:25.173 INFO:teuthology.misc.health.smithi088.stderr:2024-04-26T23:40:25.168+0000 7fa5e1494640 1 --2- 172.21.15.88:0/1697840129 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fa5c006c8f0 0x7fa5c006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:25.173 INFO:teuthology.misc.health.smithi088.stderr:2024-04-26T23:40:25.168+0000 7fa5e1494640 1 --2- 172.21.15.88:0/1697840129 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fa5c006c8f0 0x7fa5c006edb0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fa5d8034000 tx=0x7fa5d802f000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:25.175 INFO:teuthology.misc.health.smithi088.stderr:2024-04-26T23:40:25.172+0000 7fa5d1ffb640 1 -- 172.21.15.88:0/1697840129 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fa5cc059b50 con 0x7fa5dc0ca2e0 2024-04-26T23:40:25.348 INFO:teuthology.misc.health.smithi088.stderr:2024-04-26T23:40:25.346+0000 7fa5e36f8640 1 -- 172.21.15.88:0/1697840129 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa5dc14e0c0 con 0x7fa5dc0ca2e0 2024-04-26T23:40:25.349 INFO:teuthology.misc.health.smithi088.stderr:2024-04-26T23:40:25.347+0000 7fa5d1ffb640 1 -- 172.21.15.88:0/1697840129 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) ==== 74+0+12884 (secure 0 0 0) 0x7fa5cc059450 con 0x7fa5dc0ca2e0 2024-04-26T23:40:25.350 INFO:teuthology.misc.health.smithi088.stdout: 2024-04-26T23:40:25.350 INFO:teuthology.misc.health.smithi088.stdout:{"epoch":16,"fsid":"555255e9-7ef9-4454-8dc9-35e96b70035c","created":"2024-04-26T23:40:07.836009+0000","modified":"2024-04-26T23:40:21.953254+0000","last_up_change":"2024-04-26T23:40:18.831369+0000","last_in_change":"2024-04-26T23:40:09.944777+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T23:40:19.936127+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"92aecea3-ed62-4a29-87c0-76758a0816a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":2803186054},{"type":"v1","addr":"172.21.15.88:6801","nonce":2803186054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":2803186054},{"type":"v1","addr":"172.21.15.88:6803","nonce":2803186054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":2803186054},{"type":"v1","addr":"172.21.15.88:6807","nonce":2803186054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":2803186054},{"type":"v1","addr":"172.21.15.88:6805","nonce":2803186054}]},"public_addr":"172.21.15.88:6801/2803186054","cluster_addr":"172.21.15.88:6803/2803186054","heartbeat_back_addr":"172.21.15.88:6807/2803186054","heartbeat_front_addr":"172.21.15.88:6805/2803186054","state":["exists","up"]},{"osd":1,"uuid":"7a6f0fa9-23d0-4747-880f-798d45ec5eeb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":1897380484},{"type":"v1","addr":"172.21.15.88:6817","nonce":1897380484}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":1897380484},{"type":"v1","addr":"172.21.15.88:6819","nonce":1897380484}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1897380484},{"type":"v1","addr":"172.21.15.88:6823","nonce":1897380484}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":1897380484},{"type":"v1","addr":"172.21.15.88:6821","nonce":1897380484}]},"public_addr":"172.21.15.88:6817/1897380484","cluster_addr":"172.21.15.88:6819/1897380484","heartbeat_back_addr":"172.21.15.88:6823/1897380484","heartbeat_front_addr":"172.21.15.88:6821/1897380484","state":["exists","up"]},{"osd":2,"uuid":"6be88ea0-e133-4200-a4b5-f92d664b248a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":648396269},{"type":"v1","addr":"172.21.15.88:6809","nonce":648396269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":648396269},{"type":"v1","addr":"172.21.15.88:6811","nonce":648396269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":648396269},{"type":"v1","addr":"172.21.15.88:6815","nonce":648396269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":648396269},{"type":"v1","addr":"172.21.15.88:6813","nonce":648396269}]},"public_addr":"172.21.15.88:6809/648396269","cluster_addr":"172.21.15.88:6811/648396269","heartbeat_back_addr":"172.21.15.88:6815/648396269","heartbeat_front_addr":"172.21.15.88:6813/648396269","state":["exists","up"]},{"osd":3,"uuid":"dcb0746b-7b3d-4ecf-8089-2493a5d1857c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":2328028922},{"type":"v1","addr":"172.21.15.88:6825","nonce":2328028922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":2328028922},{"type":"v1","addr":"172.21.15.88:6827","nonce":2328028922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":2328028922},{"type":"v1","addr":"172.21.15.88:6831","nonce":2328028922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":2328028922},{"type":"v1","addr":"172.21.15.88:6829","nonce":2328028922}]},"public_addr":"172.21.15.88:6825/2328028922","cluster_addr":"172.21.15.88:6827/2328028922","heartbeat_back_addr":"172.21.15.88:6831/2328028922","heartbeat_front_addr":"172.21.15.88:6829/2328028922","state":["exists","up"]},{"osd":4,"uuid":"c483de66-c44f-450e-a4ce-b132d50882c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":3929617402},{"type":"v1","addr":"172.21.15.175:6809","nonce":3929617402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":3929617402},{"type":"v1","addr":"172.21.15.175:6811","nonce":3929617402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":3929617402},{"type":"v1","addr":"172.21.15.175:6815","nonce":3929617402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":3929617402},{"type":"v1","addr":"172.21.15.175:6813","nonce":3929617402}]},"public_addr":"172.21.15.175:6809/3929617402","cluster_addr":"172.21.15.175:6811/3929617402","heartbeat_back_addr":"172.21.15.175:6815/3929617402","heartbeat_front_addr":"172.21.15.175:6813/3929617402","state":["exists","up"]},{"osd":5,"uuid":"ac3b1669-d228-40dd-9f9a-cb46aa73dd6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":2476644457},{"type":"v1","addr":"172.21.15.175:6801","nonce":2476644457}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":2476644457},{"type":"v1","addr":"172.21.15.175:6803","nonce":2476644457}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":2476644457},{"type":"v1","addr":"172.21.15.175:6807","nonce":2476644457}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":2476644457},{"type":"v1","addr":"172.21.15.175:6805","nonce":2476644457}]},"public_addr":"172.21.15.175:6801/2476644457","cluster_addr":"172.21.15.175:6803/2476644457","heartbeat_back_addr":"172.21.15.175:6807/2476644457","heartbeat_front_addr":"172.21.15.175:6805/2476644457","state":["exists","up"]},{"osd":6,"uuid":"7bef4896-857e-4c11-b3b2-c2e9a8548338","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":3824112919},{"type":"v1","addr":"172.21.15.175:6819","nonce":3824112919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6821","nonce":3824112919},{"type":"v1","addr":"172.21.15.175:6824","nonce":3824112919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":3824112919},{"type":"v1","addr":"172.21.15.175:6831","nonce":3824112919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":3824112919},{"type":"v1","addr":"172.21.15.175:6829","nonce":3824112919}]},"public_addr":"172.21.15.175:6819/3824112919","cluster_addr":"172.21.15.175:6824/3824112919","heartbeat_back_addr":"172.21.15.175:6831/3824112919","heartbeat_front_addr":"172.21.15.175:6829/3824112919","state":["exists","up"]},{"osd":7,"uuid":"e18d9e09-8673-470d-b9dc-280a409b63f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6817","nonce":3319361162},{"type":"v1","addr":"172.21.15.175:6818","nonce":3319361162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":3319361162},{"type":"v1","addr":"172.21.15.175:6822","nonce":3319361162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6827","nonce":3319361162},{"type":"v1","addr":"172.21.15.175:6828","nonce":3319361162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6823","nonce":3319361162},{"type":"v1","addr":"172.21.15.175:6825","nonce":3319361162}]},"public_addr":"172.21.15.175:6818/3319361162","cluster_addr":"172.21.15.175:6822/3319361162","heartbeat_back_addr":"172.21.15.175:6828/3319361162","heartbeat_front_addr":"172.21.15.175:6825/3319361162","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:40:15.126268+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:40:15.050614+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:40:14.995164+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:40:15.078112+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:40:15.159637+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:40:15.091226+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:40:15.140316+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:40:15.089431+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:40:25.352 INFO:teuthology.misc.health.smithi088.stderr:2024-04-26T23:40:25.349+0000 7fa5e36f8640 1 -- 172.21.15.88:0/1697840129 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fa5c006c8f0 msgr2=0x7fa5c006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:25.352 INFO:teuthology.misc.health.smithi088.stderr:2024-04-26T23:40:25.349+0000 7fa5e36f8640 1 --2- 172.21.15.88:0/1697840129 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fa5c006c8f0 0x7fa5c006edb0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fa5d8034000 tx=0x7fa5d802f000 comp rx=0 tx=0).stop 2024-04-26T23:40:25.352 INFO:teuthology.misc.health.smithi088.stderr:2024-04-26T23:40:25.349+0000 7fa5e36f8640 1 -- 172.21.15.88:0/1697840129 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa5dc0ca2e0 msgr2=0x7fa5dc14bab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:25.352 INFO:teuthology.misc.health.smithi088.stderr:2024-04-26T23:40:25.349+0000 7fa5e36f8640 1 --2- 172.21.15.88:0/1697840129 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa5dc0ca2e0 0x7fa5dc14bab0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fa5cc00c3c0 tx=0x7fa5cc00c880 comp rx=0 tx=0).stop 2024-04-26T23:40:25.352 INFO:teuthology.misc.health.smithi088.stderr:2024-04-26T23:40:25.349+0000 7fa5e36f8640 1 -- 172.21.15.88:0/1697840129 shutdown_connections 2024-04-26T23:40:25.352 INFO:teuthology.misc.health.smithi088.stderr:2024-04-26T23:40:25.349+0000 7fa5e36f8640 1 --2- 172.21.15.88:0/1697840129 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fa5c006c8f0 0x7fa5c006edb0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:25.352 INFO:teuthology.misc.health.smithi088.stderr:2024-04-26T23:40:25.349+0000 7fa5e36f8640 1 --2- 172.21.15.88:0/1697840129 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa5dc150bd0 0x7fa5dc159a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:25.352 INFO:teuthology.misc.health.smithi088.stderr:2024-04-26T23:40:25.349+0000 7fa5e36f8640 1 --2- 172.21.15.88:0/1697840129 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa5dc0ca2e0 0x7fa5dc14bab0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:25.352 INFO:teuthology.misc.health.smithi088.stderr:2024-04-26T23:40:25.349+0000 7fa5e36f8640 1 --2- 172.21.15.88:0/1697840129 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa5dc06c7e0 0x7fa5dc14b570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:25.353 INFO:teuthology.misc.health.smithi088.stderr:2024-04-26T23:40:25.349+0000 7fa5e36f8640 1 -- 172.21.15.88:0/1697840129 >> 172.21.15.88:0/1697840129 conn(0x7fa5dc0adf70 msgr2=0x7fa5dc0c8df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:40:25.353 INFO:teuthology.misc.health.smithi088.stderr:2024-04-26T23:40:25.349+0000 7fa5e36f8640 1 -- 172.21.15.88:0/1697840129 shutdown_connections 2024-04-26T23:40:25.353 INFO:teuthology.misc.health.smithi088.stderr:2024-04-26T23:40:25.349+0000 7fa5e36f8640 1 -- 172.21.15.88:0/1697840129 wait complete. 2024-04-26T23:40:25.361 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-04-26T23:40:25.362 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-04-26T23:40:25.362 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-26T23:40:25.362 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-26T23:40:25.364 INFO:tasks.ceph.mds.a:Started 2024-04-26T23:40:25.364 INFO:tasks.ceph.mds.c:Restarting daemon 2024-04-26T23:40:25.365 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-04-26T23:40:25.367 INFO:tasks.ceph.mds.c:Started 2024-04-26T23:40:25.367 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-26T23:40:25.367 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-26T23:40:25.370 INFO:tasks.ceph.mds.b:Started 2024-04-26T23:40:25.370 INFO:tasks.ceph.mds.d:Restarting daemon 2024-04-26T23:40:25.370 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-04-26T23:40:25.372 INFO:tasks.ceph.mds.d:Started 2024-04-26T23:40:25.372 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-04-26T23:40:25.373 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T23:40:25.436 INFO:tasks.ceph.mds.c.smithi088.stdout:starting mds.c at 2024-04-26T23:40:25.437 INFO:tasks.ceph.mds.a.smithi088.stdout:starting mds.a at 2024-04-26T23:40:25.453 INFO:tasks.ceph.mds.d.smithi175.stdout:starting mds.d at 2024-04-26T23:40:25.453 INFO:tasks.ceph.mds.b.smithi175.stdout:starting mds.b at 2024-04-26T23:40:25.473 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:25.470+0000 7effc44b8640 1 Processor -- start 2024-04-26T23:40:25.473 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:25.470+0000 7effc44b8640 1 -- start start 2024-04-26T23:40:25.475 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:25.471+0000 7effc44b8640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7effbc0c4730 0x7effbc06d700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:25.475 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:25.471+0000 7effc44b8640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7effbc0c5710 0x7effbc15f280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:25.475 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:25.471+0000 7effc44b8640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7effbc06f1d0 con 0x7effbc06d320 2024-04-26T23:40:25.475 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:25.471+0000 7effc44b8640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7effbc0c4c80 con 0x7effbc0c4730 2024-04-26T23:40:25.475 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:25.471+0000 7effc44b8640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7effbc15f7c0 con 0x7effbc0c5710 2024-04-26T23:40:25.475 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:25.471+0000 7effc1a53640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7effbc0c4730 0x7effbc06d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:25.475 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:25.471+0000 7effc2254640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7effbc06d320 0x7effbc15eb70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:35076/0 (socket says 172.21.15.88:35076) 2024-04-26T23:40:25.475 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:25.471+0000 7effc2254640 1 -- 172.21.15.88:0/4100494620 learned_addr learned my addr 172.21.15.88:0/4100494620 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-26T23:40:25.475 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:25.471+0000 7effc2a55640 1 --2- 172.21.15.88:0/4100494620 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7effbc0c5710 0x7effbc15f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:25.476 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:25.471+0000 7effc1a53640 1 -- 172.21.15.88:0/4100494620 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7effbc0c5710 msgr2=0x7effbc15f280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:40:25.476 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:25.471+0000 7effc1a53640 1 --2- 172.21.15.88:0/4100494620 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7effbc0c5710 0x7effbc15f280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:25.476 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:25.471+0000 7effc1a53640 1 -- 172.21.15.88:0/4100494620 >> v1:172.21.15.88:6789/0 conn(0x7effbc06d320 legacy=0x7effbc15eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:25.476 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:25.471+0000 7effc1252640 1 -- 172.21.15.88:0/4100494620 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 127585054 0 0) 0x7effbc06f1d0 con 0x7effbc06d320 2024-04-26T23:40:25.476 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:25.471+0000 7effc1a53640 1 -- 172.21.15.88:0/4100494620 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effbc06f4b0 con 0x7effbc0c4730 2024-04-26T23:40:25.476 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:25.471+0000 7effc2a55640 1 --2- 172.21.15.88:0/4100494620 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7effbc0c5710 0x7effbc15f280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:40:25.476 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:25.472+0000 7effc1a53640 1 --2- 172.21.15.88:0/4100494620 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7effbc0c4730 0x7effbc06d700 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7effac0097a0 tx=0x7effac02a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dce0bfa75b0d8ff9 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:25.476 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:25.472+0000 7effc1252640 1 -- 172.21.15.88:0/4100494620 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effac037070 con 0x7effbc0c4730 2024-04-26T23:40:25.476 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:25.472+0000 7effc1252640 1 -- 172.21.15.88:0/4100494620 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7effac02adb0 con 0x7effbc0c4730 2024-04-26T23:40:25.476 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:25.472+0000 7effc1252640 1 -- 172.21.15.88:0/4100494620 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effac032660 con 0x7effbc0c4730 2024-04-26T23:40:25.479 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:25.473+0000 7effc44b8640 1 -- 172.21.15.88:0/4100494620 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7effbc0c4730 msgr2=0x7effbc06d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:25.479 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:25.473+0000 7effc44b8640 1 --2- 172.21.15.88:0/4100494620 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7effbc0c4730 0x7effbc06d700 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7effac0097a0 tx=0x7effac02a060 comp rx=0 tx=0).stop 2024-04-26T23:40:25.479 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:25.473+0000 7effc44b8640 1 -- 172.21.15.88:0/4100494620 shutdown_connections 2024-04-26T23:40:25.479 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:25.473+0000 7effc44b8640 1 --2- 172.21.15.88:0/4100494620 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7effbc0c5710 0x7effbc15f280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:25.479 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:25.473+0000 7effc44b8640 1 --2- 172.21.15.88:0/4100494620 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7effbc0c4730 0x7effbc06d700 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:25.480 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:25.473+0000 7effc44b8640 1 -- 172.21.15.88:0/4100494620 >> 172.21.15.88:0/4100494620 conn(0x7effbc0c91e0 msgr2=0x7effbc0c95f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:40:25.480 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:25.473+0000 7effc44b8640 1 -- 172.21.15.88:0/4100494620 shutdown_connections 2024-04-26T23:40:25.480 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:25.473+0000 7effc44b8640 1 -- 172.21.15.88:0/4100494620 wait complete. 2024-04-26T23:40:25.480 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:25.474+0000 7effc44b8640 1 Processor -- start 2024-04-26T23:40:25.480 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:25.474+0000 7effc44b8640 1 -- start start 2024-04-26T23:40:25.480 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:25.474+0000 7effc44b8640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7effbc06d320 0x7effbc1f1960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:25.480 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:25.475+0000 7effc44b8640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7effbc0c4730 0x7effbc15a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:25.480 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:25.475+0000 7effc44b8640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7effbc0c5710 0x7effbc0c8090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:25.480 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:25.475+0000 7effc44b8640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7effbc06f9c0 con 0x7effbc06d320 2024-04-26T23:40:25.480 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:25.475+0000 7effc44b8640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7effbc06f840 con 0x7effbc0c5710 2024-04-26T23:40:25.480 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:25.475+0000 7effc44b8640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7effbc158ed0 con 0x7effbc0c4730 2024-04-26T23:40:25.480 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:25.475+0000 7effc2254640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7effbc06d320 0x7effbc1f1960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:25.480 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:25.475+0000 7effc2254640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7effbc06d320 0x7effbc1f1960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:38618/0 (socket says 172.21.15.88:38618) 2024-04-26T23:40:25.480 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:25.475+0000 7effc2254640 1 -- 172.21.15.88:0/986248538 learned_addr learned my addr 172.21.15.88:0/986248538 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:40:25.480 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:25.475+0000 7effc2254640 1 -- 172.21.15.88:0/986248538 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7effbc0c4730 msgr2=0x7effbc15a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:25.480 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:25.475+0000 7effc2254640 1 --2- 172.21.15.88:0/986248538 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7effbc0c4730 0x7effbc15a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:25.481 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:25.475+0000 7effc2254640 1 -- 172.21.15.88:0/986248538 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7effbc0c5710 msgr2=0x7effbc0c8090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:25.481 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:25.475+0000 7effc2254640 1 --2- 172.21.15.88:0/986248538 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7effbc0c5710 0x7effbc0c8090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:25.481 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:25.475+0000 7effc2254640 1 -- 172.21.15.88:0/986248538 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effbc1f1ea0 con 0x7effbc06d320 2024-04-26T23:40:25.481 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:25.475+0000 7effc2254640 1 --2- 172.21.15.88:0/986248538 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7effbc06d320 0x7effbc1f1960 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7effb800c4d0 tx=0x7effb800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:25.481 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:25.475+0000 7effb2ffd640 1 -- 172.21.15.88:0/986248538 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effb8018070 con 0x7effbc06d320 2024-04-26T23:40:25.481 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:25.475+0000 7effb2ffd640 1 -- 172.21.15.88:0/986248538 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7effb8007500 con 0x7effbc06d320 2024-04-26T23:40:25.481 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:25.475+0000 7effc44b8640 1 -- 172.21.15.88:0/986248538 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7effbc15ae40 con 0x7effbc06d320 2024-04-26T23:40:25.481 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:25.475+0000 7effb2ffd640 1 -- 172.21.15.88:0/986248538 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effb8004a20 con 0x7effbc06d320 2024-04-26T23:40:25.481 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:25.475+0000 7effc44b8640 1 -- 172.21.15.88:0/986248538 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7effbc0ada90 con 0x7effbc06d320 2024-04-26T23:40:25.481 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:25.476+0000 7effc44b8640 1 -- 172.21.15.88:0/986248538 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7effbc068dc0 con 0x7effbc06d320 2024-04-26T23:40:25.481 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:25.477+0000 7effb2ffd640 1 -- 172.21.15.88:0/986248538 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7effb801b070 con 0x7effbc06d320 2024-04-26T23:40:25.482 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:25.477+0000 7effb2ffd640 1 --2- 172.21.15.88:0/986248538 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7effa006c920 0x7effa006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:25.482 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:25.477+0000 7effb2ffd640 1 -- 172.21.15.88:0/986248538 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7effb808ab80 con 0x7effbc06d320 2024-04-26T23:40:25.482 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:25.477+0000 7effc1a53640 1 --2- 172.21.15.88:0/986248538 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7effa006c920 0x7effa006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:25.482 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:25.477+0000 7effc1a53640 1 --2- 172.21.15.88:0/986248538 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7effa006c920 0x7effa006ede0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7effac034000 tx=0x7effac02c000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:25.484 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:25.481+0000 7effb2ffd640 1 -- 172.21.15.88:0/986248538 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7effb8059270 con 0x7effbc06d320 2024-04-26T23:40:25.658 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:25.656+0000 7effc44b8640 1 -- 172.21.15.88:0/986248538 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7effbc0507a0 con 0x7effbc06d320 2024-04-26T23:40:25.659 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:25.656+0000 7effb2ffd640 1 -- 172.21.15.88:0/986248538 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) ==== 74+0+12884 (secure 0 0 0) 0x7effb8058b70 con 0x7effbc06d320 2024-04-26T23:40:25.660 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-26T23:40:25.660 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":16,"fsid":"555255e9-7ef9-4454-8dc9-35e96b70035c","created":"2024-04-26T23:40:07.836009+0000","modified":"2024-04-26T23:40:21.953254+0000","last_up_change":"2024-04-26T23:40:18.831369+0000","last_in_change":"2024-04-26T23:40:09.944777+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T23:40:19.936127+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"92aecea3-ed62-4a29-87c0-76758a0816a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":2803186054},{"type":"v1","addr":"172.21.15.88:6801","nonce":2803186054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":2803186054},{"type":"v1","addr":"172.21.15.88:6803","nonce":2803186054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":2803186054},{"type":"v1","addr":"172.21.15.88:6807","nonce":2803186054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":2803186054},{"type":"v1","addr":"172.21.15.88:6805","nonce":2803186054}]},"public_addr":"172.21.15.88:6801/2803186054","cluster_addr":"172.21.15.88:6803/2803186054","heartbeat_back_addr":"172.21.15.88:6807/2803186054","heartbeat_front_addr":"172.21.15.88:6805/2803186054","state":["exists","up"]},{"osd":1,"uuid":"7a6f0fa9-23d0-4747-880f-798d45ec5eeb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":1897380484},{"type":"v1","addr":"172.21.15.88:6817","nonce":1897380484}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":1897380484},{"type":"v1","addr":"172.21.15.88:6819","nonce":1897380484}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1897380484},{"type":"v1","addr":"172.21.15.88:6823","nonce":1897380484}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":1897380484},{"type":"v1","addr":"172.21.15.88:6821","nonce":1897380484}]},"public_addr":"172.21.15.88:6817/1897380484","cluster_addr":"172.21.15.88:6819/1897380484","heartbeat_back_addr":"172.21.15.88:6823/1897380484","heartbeat_front_addr":"172.21.15.88:6821/1897380484","state":["exists","up"]},{"osd":2,"uuid":"6be88ea0-e133-4200-a4b5-f92d664b248a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":648396269},{"type":"v1","addr":"172.21.15.88:6809","nonce":648396269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":648396269},{"type":"v1","addr":"172.21.15.88:6811","nonce":648396269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":648396269},{"type":"v1","addr":"172.21.15.88:6815","nonce":648396269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":648396269},{"type":"v1","addr":"172.21.15.88:6813","nonce":648396269}]},"public_addr":"172.21.15.88:6809/648396269","cluster_addr":"172.21.15.88:6811/648396269","heartbeat_back_addr":"172.21.15.88:6815/648396269","heartbeat_front_addr":"172.21.15.88:6813/648396269","state":["exists","up"]},{"osd":3,"uuid":"dcb0746b-7b3d-4ecf-8089-2493a5d1857c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":2328028922},{"type":"v1","addr":"172.21.15.88:6825","nonce":2328028922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":2328028922},{"type":"v1","addr":"172.21.15.88:6827","nonce":2328028922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":2328028922},{"type":"v1","addr":"172.21.15.88:6831","nonce":2328028922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":2328028922},{"type":"v1","addr":"172.21.15.88:6829","nonce":2328028922}]},"public_addr":"172.21.15.88:6825/2328028922","cluster_addr":"172.21.15.88:6827/2328028922","heartbeat_back_addr":"172.21.15.88:6831/2328028922","heartbeat_front_addr":"172.21.15.88:6829/2328028922","state":["exists","up"]},{"osd":4,"uuid":"c483de66-c44f-450e-a4ce-b132d50882c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":3929617402},{"type":"v1","addr":"172.21.15.175:6809","nonce":3929617402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":3929617402},{"type":"v1","addr":"172.21.15.175:6811","nonce":3929617402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":3929617402},{"type":"v1","addr":"172.21.15.175:6815","nonce":3929617402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":3929617402},{"type":"v1","addr":"172.21.15.175:6813","nonce":3929617402}]},"public_addr":"172.21.15.175:6809/3929617402","cluster_addr":"172.21.15.175:6811/3929617402","heartbeat_back_addr":"172.21.15.175:6815/3929617402","heartbeat_front_addr":"172.21.15.175:6813/3929617402","state":["exists","up"]},{"osd":5,"uuid":"ac3b1669-d228-40dd-9f9a-cb46aa73dd6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":2476644457},{"type":"v1","addr":"172.21.15.175:6801","nonce":2476644457}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":2476644457},{"type":"v1","addr":"172.21.15.175:6803","nonce":2476644457}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":2476644457},{"type":"v1","addr":"172.21.15.175:6807","nonce":2476644457}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":2476644457},{"type":"v1","addr":"172.21.15.175:6805","nonce":2476644457}]},"public_addr":"172.21.15.175:6801/2476644457","cluster_addr":"172.21.15.175:6803/2476644457","heartbeat_back_addr":"172.21.15.175:6807/2476644457","heartbeat_front_addr":"172.21.15.175:6805/2476644457","state":["exists","up"]},{"osd":6,"uuid":"7bef4896-857e-4c11-b3b2-c2e9a8548338","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":3824112919},{"type":"v1","addr":"172.21.15.175:6819","nonce":3824112919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6821","nonce":3824112919},{"type":"v1","addr":"172.21.15.175:6824","nonce":3824112919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":3824112919},{"type":"v1","addr":"172.21.15.175:6831","nonce":3824112919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":3824112919},{"type":"v1","addr":"172.21.15.175:6829","nonce":3824112919}]},"public_addr":"172.21.15.175:6819/3824112919","cluster_addr":"172.21.15.175:6824/3824112919","heartbeat_back_addr":"172.21.15.175:6831/3824112919","heartbeat_front_addr":"172.21.15.175:6829/3824112919","state":["exists","up"]},{"osd":7,"uuid":"e18d9e09-8673-470d-b9dc-280a409b63f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6817","nonce":3319361162},{"type":"v1","addr":"172.21.15.175:6818","nonce":3319361162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":3319361162},{"type":"v1","addr":"172.21.15.175:6822","nonce":3319361162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6827","nonce":3319361162},{"type":"v1","addr":"172.21.15.175:6828","nonce":3319361162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6823","nonce":3319361162},{"type":"v1","addr":"172.21.15.175:6825","nonce":3319361162}]},"public_addr":"172.21.15.175:6818/3319361162","cluster_addr":"172.21.15.175:6822/3319361162","heartbeat_back_addr":"172.21.15.175:6828/3319361162","heartbeat_front_addr":"172.21.15.175:6825/3319361162","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:40:15.126268+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:40:15.050614+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:40:14.995164+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:40:15.078112+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:40:15.159637+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:40:15.091226+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:40:15.140316+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:40:15.089431+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:40:25.661 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:25.658+0000 7effc44b8640 1 -- 172.21.15.88:0/986248538 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7effa006c920 msgr2=0x7effa006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:25.661 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:25.658+0000 7effc44b8640 1 --2- 172.21.15.88:0/986248538 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7effa006c920 0x7effa006ede0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7effac034000 tx=0x7effac02c000 comp rx=0 tx=0).stop 2024-04-26T23:40:25.661 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:25.658+0000 7effc44b8640 1 -- 172.21.15.88:0/986248538 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7effbc06d320 msgr2=0x7effbc1f1960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:25.662 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:25.658+0000 7effc44b8640 1 --2- 172.21.15.88:0/986248538 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7effbc06d320 0x7effbc1f1960 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7effb800c4d0 tx=0x7effb800c990 comp rx=0 tx=0).stop 2024-04-26T23:40:25.662 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:25.658+0000 7effc44b8640 1 -- 172.21.15.88:0/986248538 shutdown_connections 2024-04-26T23:40:25.662 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:25.658+0000 7effc44b8640 1 --2- 172.21.15.88:0/986248538 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7effa006c920 0x7effa006ede0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:25.662 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:25.658+0000 7effc44b8640 1 --2- 172.21.15.88:0/986248538 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7effbc0c4730 0x7effbc15a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:25.662 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:25.658+0000 7effc44b8640 1 --2- 172.21.15.88:0/986248538 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7effbc0c5710 0x7effbc0c8090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:25.662 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:25.658+0000 7effc44b8640 1 --2- 172.21.15.88:0/986248538 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7effbc06d320 0x7effbc1f1960 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:25.662 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:25.658+0000 7effc44b8640 1 -- 172.21.15.88:0/986248538 >> 172.21.15.88:0/986248538 conn(0x7effbc0c91e0 msgr2=0x7effbc06d700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:40:25.662 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:25.658+0000 7effc44b8640 1 -- 172.21.15.88:0/986248538 shutdown_connections 2024-04-26T23:40:25.662 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:25.658+0000 7effc44b8640 1 -- 172.21.15.88:0/986248538 wait complete. 2024-04-26T23:40:25.672 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T23:40:19.936127+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T23:40:25.672 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T23:40:25.772 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:25.769+0000 7f28e4462640 1 Processor -- start 2024-04-26T23:40:25.772 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:25.769+0000 7f28e4462640 1 -- start start 2024-04-26T23:40:25.773 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:25.770+0000 7f28e4462640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f28dc0ab3f0 0x7f28dc0c4d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:25.773 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:25.770+0000 7f28e4462640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f28dc0c3810 con 0x7f28dc1570d0 2024-04-26T23:40:25.773 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:25.770+0000 7f28e4462640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f28dc0c3ab0 con 0x7f28dc0c52c0 2024-04-26T23:40:25.774 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:25.770+0000 7f28e4462640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f28dc0c4330 con 0x7f28dc0ab3f0 2024-04-26T23:40:25.774 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:25.770+0000 7f28e19fd640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f28dc0ab3f0 0x7f28dc0c4d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:25.774 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:25.770+0000 7f28e21fe640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f28dc1570d0 0x7f28dc150a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:35084/0 (socket says 172.21.15.88:35084) 2024-04-26T23:40:25.774 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:25.770+0000 7f28e21fe640 1 -- 172.21.15.88:0/3512510307 learned_addr learned my addr 172.21.15.88:0/3512510307 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-26T23:40:25.774 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:25.770+0000 7f28e19fd640 1 -- 172.21.15.88:0/3512510307 >> v1:172.21.15.175:6789/0 conn(0x7f28dc0c52c0 legacy=0x7f28dc1574b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:40:25.774 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:25.770+0000 7f28e19fd640 1 -- 172.21.15.88:0/3512510307 >> v1:172.21.15.88:6789/0 conn(0x7f28dc1570d0 legacy=0x7f28dc150a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:25.774 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:25.770+0000 7f28e19fd640 1 -- 172.21.15.88:0/3512510307 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28dc0c4580 con 0x7f28dc0ab3f0 2024-04-26T23:40:25.774 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:25.770+0000 7f28e11fc640 1 -- 172.21.15.88:0/3512510307 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3500477799 0 0) 0x7f28dc0c3810 con 0x7f28dc1570d0 2024-04-26T23:40:25.777 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:25.771+0000 7f28e19fd640 1 --2- 172.21.15.88:0/3512510307 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f28dc0ab3f0 0x7f28dc0c4d80 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f28cc0097a0 tx=0x7f28cc02a0b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5149af1a341c95d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:25.777 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:25.771+0000 7f28e11fc640 1 -- 172.21.15.88:0/3512510307 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28cc037070 con 0x7f28dc0ab3f0 2024-04-26T23:40:25.778 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:25.771+0000 7f28e11fc640 1 -- 172.21.15.88:0/3512510307 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28cc02adc0 con 0x7f28dc0ab3f0 2024-04-26T23:40:25.778 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:25.771+0000 7f28e11fc640 1 -- 172.21.15.88:0/3512510307 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28cc032660 con 0x7f28dc0ab3f0 2024-04-26T23:40:25.778 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:25.772+0000 7f28e4462640 1 -- 172.21.15.88:0/3512510307 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f28dc0ab3f0 msgr2=0x7f28dc0c4d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:25.778 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:25.772+0000 7f28e4462640 1 --2- 172.21.15.88:0/3512510307 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f28dc0ab3f0 0x7f28dc0c4d80 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f28cc0097a0 tx=0x7f28cc02a0b0 comp rx=0 tx=0).stop 2024-04-26T23:40:25.778 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:25.772+0000 7f28e4462640 1 -- 172.21.15.88:0/3512510307 shutdown_connections 2024-04-26T23:40:25.778 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:25.772+0000 7f28e4462640 1 --2- 172.21.15.88:0/3512510307 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f28dc0ab3f0 0x7f28dc0c4d80 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:25.778 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:25.772+0000 7f28e4462640 1 -- 172.21.15.88:0/3512510307 >> 172.21.15.88:0/3512510307 conn(0x7f28dc06c310 msgr2=0x7f28dc06c6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:40:25.778 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:25.772+0000 7f28e4462640 1 -- 172.21.15.88:0/3512510307 shutdown_connections 2024-04-26T23:40:25.778 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:25.772+0000 7f28e4462640 1 -- 172.21.15.88:0/3512510307 wait complete. 2024-04-26T23:40:25.779 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:25.773+0000 7f28e4462640 1 Processor -- start 2024-04-26T23:40:25.779 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:25.773+0000 7f28e4462640 1 -- start start 2024-04-26T23:40:25.779 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:25.774+0000 7f28e4462640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f28dc0ab3f0 0x7f28dc0ac7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:25.779 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:25.774+0000 7f28e4462640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f28dc0c52c0 0x7f28dc1e8080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:25.779 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:25.774+0000 7f28e4462640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f28dc1570d0 0x7f28dc1e85c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:25.779 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:25.774+0000 7f28e4462640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f28dc1512e0 con 0x7f28dc0ab3f0 2024-04-26T23:40:25.779 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:25.774+0000 7f28e4462640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f28dc151160 con 0x7f28dc0c52c0 2024-04-26T23:40:25.779 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:25.774+0000 7f28e4462640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f28dc0aba60 con 0x7f28dc1570d0 2024-04-26T23:40:25.779 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:25.774+0000 7f28e21fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f28dc0ab3f0 0x7f28dc0ac7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:25.779 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:25.774+0000 7f28e21fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f28dc0ab3f0 0x7f28dc0ac7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:38630/0 (socket says 172.21.15.88:38630) 2024-04-26T23:40:25.779 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:25.774+0000 7f28e21fe640 1 -- 172.21.15.88:0/1932800237 learned_addr learned my addr 172.21.15.88:0/1932800237 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:40:25.779 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:25.774+0000 7f28e21fe640 1 -- 172.21.15.88:0/1932800237 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f28dc1570d0 msgr2=0x7f28dc1e85c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:25.779 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:25.774+0000 7f28e21fe640 1 --2- 172.21.15.88:0/1932800237 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f28dc1570d0 0x7f28dc1e85c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:25.780 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:25.774+0000 7f28e21fe640 1 -- 172.21.15.88:0/1932800237 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f28dc0c52c0 msgr2=0x7f28dc1e8080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:25.780 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:25.774+0000 7f28e21fe640 1 --2- 172.21.15.88:0/1932800237 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f28dc0c52c0 0x7f28dc1e8080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:25.780 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:25.774+0000 7f28e21fe640 1 -- 172.21.15.88:0/1932800237 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28dc073d50 con 0x7f28dc0ab3f0 2024-04-26T23:40:25.780 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:25.774+0000 7f28e21fe640 1 --2- 172.21.15.88:0/1932800237 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f28dc0ab3f0 0x7f28dc0ac7b0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f28d800c430 tx=0x7f28d800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:25.780 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:25.774+0000 7f28d2ffd640 1 -- 172.21.15.88:0/1932800237 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28d80074e0 con 0x7f28dc0ab3f0 2024-04-26T23:40:25.780 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:25.774+0000 7f28e4462640 1 -- 172.21.15.88:0/1932800237 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28dc1ec370 con 0x7f28dc0ab3f0 2024-04-26T23:40:25.780 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:25.774+0000 7f28e4462640 1 -- 172.21.15.88:0/1932800237 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28dc155190 con 0x7f28dc0ab3f0 2024-04-26T23:40:25.780 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:25.774+0000 7f28d2ffd640 1 -- 172.21.15.88:0/1932800237 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28d80047e0 con 0x7f28dc0ab3f0 2024-04-26T23:40:25.780 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:25.774+0000 7f28d2ffd640 1 -- 172.21.15.88:0/1932800237 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28d8004bd0 con 0x7f28dc0ab3f0 2024-04-26T23:40:25.781 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:25.775+0000 7f28e4462640 1 -- 172.21.15.88:0/1932800237 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f28dc1574b0 con 0x7f28dc0ab3f0 2024-04-26T23:40:25.781 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:25.776+0000 7f28d2ffd640 1 -- 172.21.15.88:0/1932800237 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f28d8011070 con 0x7f28dc0ab3f0 2024-04-26T23:40:25.781 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:25.776+0000 7f28d2ffd640 1 --2- 172.21.15.88:0/1932800237 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f28c006c8f0 0x7f28c006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:25.782 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:25.776+0000 7f28d2ffd640 1 -- 172.21.15.88:0/1932800237 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f28d808b250 con 0x7f28dc0ab3f0 2024-04-26T23:40:25.782 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:25.776+0000 7f28e19fd640 1 --2- 172.21.15.88:0/1932800237 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f28c006c8f0 0x7f28c006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:25.782 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:25.776+0000 7f28e19fd640 1 --2- 172.21.15.88:0/1932800237 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f28c006c8f0 0x7f28c006edb0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f28cc034000 tx=0x7f28cc02c000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:25.783 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:25.781+0000 7f28d2ffd640 1 -- 172.21.15.88:0/1932800237 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f28d80599e0 con 0x7f28dc0ab3f0 2024-04-26T23:40:25.961 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:25.958+0000 7f28e4462640 1 -- 172.21.15.88:0/1932800237 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f28dc0c4110 con 0x7f28dc0ab3f0 2024-04-26T23:40:25.961 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:25.958+0000 7f28d2ffd640 1 -- 172.21.15.88:0/1932800237 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) ==== 93+0+10 (secure 0 0 0) 0x7f28d80592e0 con 0x7f28dc0ab3f0 2024-04-26T23:40:25.962 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 1 2024-04-26T23:40:25.964 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:25.960+0000 7f28e4462640 1 -- 172.21.15.88:0/1932800237 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f28c006c8f0 msgr2=0x7f28c006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:25.964 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:25.960+0000 7f28e4462640 1 --2- 172.21.15.88:0/1932800237 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f28c006c8f0 0x7f28c006edb0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f28cc034000 tx=0x7f28cc02c000 comp rx=0 tx=0).stop 2024-04-26T23:40:25.964 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:25.960+0000 7f28e4462640 1 -- 172.21.15.88:0/1932800237 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f28dc0ab3f0 msgr2=0x7f28dc0ac7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:25.964 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:25.960+0000 7f28e4462640 1 --2- 172.21.15.88:0/1932800237 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f28dc0ab3f0 0x7f28dc0ac7b0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f28d800c430 tx=0x7f28d800c8f0 comp rx=0 tx=0).stop 2024-04-26T23:40:25.964 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:25.960+0000 7f28e4462640 1 -- 172.21.15.88:0/1932800237 shutdown_connections 2024-04-26T23:40:25.964 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:25.960+0000 7f28e4462640 1 --2- 172.21.15.88:0/1932800237 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f28c006c8f0 0x7f28c006edb0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:25.964 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:25.960+0000 7f28e4462640 1 --2- 172.21.15.88:0/1932800237 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f28dc1570d0 0x7f28dc1e85c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:25.964 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:25.960+0000 7f28e4462640 1 --2- 172.21.15.88:0/1932800237 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f28dc0c52c0 0x7f28dc1e8080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:25.964 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:25.960+0000 7f28e4462640 1 --2- 172.21.15.88:0/1932800237 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f28dc0ab3f0 0x7f28dc0ac7b0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:25.964 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:25.960+0000 7f28e4462640 1 -- 172.21.15.88:0/1932800237 >> 172.21.15.88:0/1932800237 conn(0x7f28dc06c310 msgr2=0x7f28dc06f100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:40:25.965 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:25.960+0000 7f28e4462640 1 -- 172.21.15.88:0/1932800237 shutdown_connections 2024-04-26T23:40:25.965 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:25.960+0000 7f28e4462640 1 -- 172.21.15.88:0/1932800237 wait complete. 2024-04-26T23:40:25.974 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T23:40:26.070 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:26.067+0000 7fb157a59640 1 Processor -- start 2024-04-26T23:40:26.070 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:26.067+0000 7fb157a59640 1 -- start start 2024-04-26T23:40:26.072 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:26.068+0000 7fb157a59640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb15013ffb0 0x7fb1500c82a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:26.072 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:26.068+0000 7fb157a59640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fb15015a280 0x7fb150072ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:26.072 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:26.068+0000 7fb157a59640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fb150073530 0x7fb150158180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:26.072 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:26.068+0000 7fb157a59640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7fb150072be0 con 0x7fb15015a280 2024-04-26T23:40:26.072 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:26.068+0000 7fb157a59640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7fb1500c9640 con 0x7fb150073530 2024-04-26T23:40:26.072 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:26.068+0000 7fb157a59640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fb1500c87e0 con 0x7fb15013ffb0 2024-04-26T23:40:26.073 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:26.068+0000 7fb154ff4640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fb15015a280 0x7fb150072ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:26.073 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:26.068+0000 7fb154ff4640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fb15015a280 0x7fb150072ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:38644/0 (socket says 172.21.15.88:38644) 2024-04-26T23:40:26.073 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:26.068+0000 7fb154ff4640 1 -- 172.21.15.88:0/3707728660 learned_addr learned my addr 172.21.15.88:0/3707728660 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:40:26.073 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:26.068+0000 7fb154ff4640 1 -- 172.21.15.88:0/3707728660 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb15013ffb0 msgr2=0x7fb1500c82a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:40:26.073 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:26.068+0000 7fb1557f5640 1 --2- 172.21.15.88:0/3707728660 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb15013ffb0 0x7fb1500c82a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:26.073 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:26.068+0000 7fb154ff4640 1 --2- 172.21.15.88:0/3707728660 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb15013ffb0 0x7fb1500c82a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:26.073 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:26.068+0000 7fb154ff4640 1 -- 172.21.15.88:0/3707728660 >> v2:172.21.15.175:3300/0 conn(0x7fb150073530 msgr2=0x7fb150158180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:40:26.073 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:26.068+0000 7fb155ff6640 1 --2- 172.21.15.88:0/3707728660 >> v2:172.21.15.175:3300/0 conn(0x7fb150073530 0x7fb150158180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:26.073 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:26.068+0000 7fb154ff4640 1 --2- 172.21.15.88:0/3707728660 >> v2:172.21.15.175:3300/0 conn(0x7fb150073530 0x7fb150158180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:26.073 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:26.068+0000 7fb154ff4640 1 -- 172.21.15.88:0/3707728660 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1500c8a30 con 0x7fb15015a280 2024-04-26T23:40:26.073 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:26.069+0000 7fb154ff4640 1 --2- 172.21.15.88:0/3707728660 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb15015a280 0x7fb150072ff0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fb150068c70 tx=0x7fb14002a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4944c3355dc61fb8 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:26.073 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:26.069+0000 7fb147fff640 1 -- 172.21.15.88:0/3707728660 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb140037070 con 0x7fb15015a280 2024-04-26T23:40:26.073 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:26.069+0000 7fb147fff640 1 -- 172.21.15.88:0/3707728660 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb140032440 con 0x7fb15015a280 2024-04-26T23:40:26.074 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:26.069+0000 7fb147fff640 1 -- 172.21.15.88:0/3707728660 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb140032810 con 0x7fb15015a280 2024-04-26T23:40:26.077 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:26.070+0000 7fb157a59640 1 -- 172.21.15.88:0/3707728660 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb15015a280 msgr2=0x7fb150072ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:26.077 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:26.070+0000 7fb157a59640 1 --2- 172.21.15.88:0/3707728660 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb15015a280 0x7fb150072ff0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fb150068c70 tx=0x7fb14002a140 comp rx=0 tx=0).stop 2024-04-26T23:40:26.077 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:26.070+0000 7fb157a59640 1 -- 172.21.15.88:0/3707728660 shutdown_connections 2024-04-26T23:40:26.077 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:26.070+0000 7fb157a59640 1 --2- 172.21.15.88:0/3707728660 >> v2:172.21.15.175:3300/0 conn(0x7fb150073530 0x7fb150158180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:26.077 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:26.070+0000 7fb157a59640 1 --2- 172.21.15.88:0/3707728660 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb15015a280 0x7fb150072ff0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:26.078 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:26.070+0000 7fb157a59640 1 --2- 172.21.15.88:0/3707728660 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb15013ffb0 0x7fb1500c82a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:26.078 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:26.070+0000 7fb157a59640 1 -- 172.21.15.88:0/3707728660 >> 172.21.15.88:0/3707728660 conn(0x7fb15006dc10 msgr2=0x7fb15006c310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:40:26.078 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:26.070+0000 7fb157a59640 1 -- 172.21.15.88:0/3707728660 shutdown_connections 2024-04-26T23:40:26.078 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:26.070+0000 7fb157a59640 1 -- 172.21.15.88:0/3707728660 wait complete. 2024-04-26T23:40:26.078 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:26.071+0000 7fb157a59640 1 Processor -- start 2024-04-26T23:40:26.078 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:26.071+0000 7fb157a59640 1 -- start start 2024-04-26T23:40:26.078 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:26.072+0000 7fb157a59640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb150073530 0x7fb1500adee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:26.078 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:26.072+0000 7fb157a59640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb15013ffb0 0x7fb150153fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:26.078 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:26.072+0000 7fb157a59640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb15015a280 0x7fb1501efd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:26.078 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:26.072+0000 7fb157a59640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fb1500c92d0 con 0x7fb150073530 2024-04-26T23:40:26.078 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:26.072+0000 7fb157a59640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fb1500c8ff0 con 0x7fb15015a280 2024-04-26T23:40:26.079 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:26.072+0000 7fb157a59640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fb150140390 con 0x7fb15013ffb0 2024-04-26T23:40:26.079 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:26.072+0000 7fb1557f5640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb150073530 0x7fb1500adee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:26.079 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:26.072+0000 7fb1557f5640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb150073530 0x7fb1500adee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:38654/0 (socket says 172.21.15.88:38654) 2024-04-26T23:40:26.079 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:26.072+0000 7fb1557f5640 1 -- 172.21.15.88:0/3615922101 learned_addr learned my addr 172.21.15.88:0/3615922101 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:40:26.079 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:26.072+0000 7fb154ff4640 1 --2- 172.21.15.88:0/3615922101 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb15013ffb0 0x7fb150153fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:26.079 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:26.072+0000 7fb155ff6640 1 --2- 172.21.15.88:0/3615922101 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb15015a280 0x7fb1501efd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:26.079 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:26.072+0000 7fb1557f5640 1 -- 172.21.15.88:0/3615922101 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb15013ffb0 msgr2=0x7fb150153fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:26.079 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:26.072+0000 7fb1557f5640 1 --2- 172.21.15.88:0/3615922101 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb15013ffb0 0x7fb150153fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:26.079 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:26.072+0000 7fb1557f5640 1 -- 172.21.15.88:0/3615922101 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb15015a280 msgr2=0x7fb1501efd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:26.079 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:26.072+0000 7fb1557f5640 1 --2- 172.21.15.88:0/3615922101 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb15015a280 0x7fb1501efd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:26.079 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:26.072+0000 7fb1557f5640 1 -- 172.21.15.88:0/3615922101 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1500c6600 con 0x7fb150073530 2024-04-26T23:40:26.079 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:26.072+0000 7fb1557f5640 1 --2- 172.21.15.88:0/3615922101 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb150073530 0x7fb1500adee0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fb14c00ce10 tx=0x7fb14c00a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:26.079 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:26.072+0000 7fb145ffb640 1 -- 172.21.15.88:0/3615922101 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb14c003b90 con 0x7fb150073530 2024-04-26T23:40:26.080 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:26.072+0000 7fb145ffb640 1 -- 172.21.15.88:0/3615922101 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb14c003d30 con 0x7fb150073530 2024-04-26T23:40:26.080 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:26.072+0000 7fb157a59640 1 -- 172.21.15.88:0/3615922101 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1500c68e0 con 0x7fb150073530 2024-04-26T23:40:26.080 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:26.072+0000 7fb145ffb640 1 -- 172.21.15.88:0/3615922101 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb14c004260 con 0x7fb150073530 2024-04-26T23:40:26.080 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:26.073+0000 7fb157a59640 1 -- 172.21.15.88:0/3615922101 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1500ae420 con 0x7fb150073530 2024-04-26T23:40:26.080 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:26.073+0000 7fb157a59640 1 -- 172.21.15.88:0/3615922101 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb150076650 con 0x7fb150073530 2024-04-26T23:40:26.080 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:26.074+0000 7fb145ffb640 1 -- 172.21.15.88:0/3615922101 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb14c004400 con 0x7fb150073530 2024-04-26T23:40:26.080 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:26.074+0000 7fb145ffb640 1 --2- 172.21.15.88:0/3615922101 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fb13406c8f0 0x7fb13406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:26.080 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:26.074+0000 7fb154ff4640 1 --2- 172.21.15.88:0/3615922101 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fb13406c8f0 0x7fb13406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:26.080 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:26.074+0000 7fb145ffb640 1 -- 172.21.15.88:0/3615922101 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7fb14c08c260 con 0x7fb150073530 2024-04-26T23:40:26.080 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:26.075+0000 7fb154ff4640 1 --2- 172.21.15.88:0/3615922101 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fb13406c8f0 0x7fb13406edb0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fb140034000 tx=0x7fb14002e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:26.081 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:26.079+0000 7fb145ffb640 1 -- 172.21.15.88:0/3615922101 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fb14c05aa70 con 0x7fb150073530 2024-04-26T23:40:26.292 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:26.289+0000 7fb157a59640 1 -- 172.21.15.88:0/3615922101 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb1500507a0 con 0x7fb150073530 2024-04-26T23:40:26.292 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:26.289+0000 7fb145ffb640 1 -- 172.21.15.88:0/3615922101 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1392 (secure 0 0 0) 0x7fb14c08c080 con 0x7fb150073530 2024-04-26T23:40:26.292 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-26T23:40:26.293 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4272,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6836/4159390276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6834","nonce":4159390276},{"type":"v1","addr":"172.21.15.88:6836","nonce":4159390276}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-04-26T23:40:26.293 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 2 2024-04-26T23:40:26.295 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:26.291+0000 7fb157a59640 1 -- 172.21.15.88:0/3615922101 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fb13406c8f0 msgr2=0x7fb13406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:26.295 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:26.291+0000 7fb157a59640 1 --2- 172.21.15.88:0/3615922101 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fb13406c8f0 0x7fb13406edb0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fb140034000 tx=0x7fb14002e000 comp rx=0 tx=0).stop 2024-04-26T23:40:26.295 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:26.291+0000 7fb157a59640 1 -- 172.21.15.88:0/3615922101 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb150073530 msgr2=0x7fb1500adee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:26.295 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:26.291+0000 7fb157a59640 1 --2- 172.21.15.88:0/3615922101 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb150073530 0x7fb1500adee0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fb14c00ce10 tx=0x7fb14c00a660 comp rx=0 tx=0).stop 2024-04-26T23:40:26.295 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:26.291+0000 7fb157a59640 1 -- 172.21.15.88:0/3615922101 shutdown_connections 2024-04-26T23:40:26.295 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:26.291+0000 7fb157a59640 1 --2- 172.21.15.88:0/3615922101 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fb13406c8f0 0x7fb13406edb0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:26.295 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:26.291+0000 7fb157a59640 1 --2- 172.21.15.88:0/3615922101 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb15013ffb0 0x7fb150153fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:26.295 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:26.291+0000 7fb157a59640 1 --2- 172.21.15.88:0/3615922101 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb15015a280 0x7fb1501efd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:26.295 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:26.291+0000 7fb157a59640 1 --2- 172.21.15.88:0/3615922101 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb150073530 0x7fb1500adee0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:26.295 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:26.291+0000 7fb157a59640 1 -- 172.21.15.88:0/3615922101 >> 172.21.15.88:0/3615922101 conn(0x7fb15006dc10 msgr2=0x7fb1500cb0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:40:26.295 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:26.292+0000 7fb157a59640 1 -- 172.21.15.88:0/3615922101 shutdown_connections 2024-04-26T23:40:26.295 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:26.292+0000 7fb157a59640 1 -- 172.21.15.88:0/3615922101 wait complete. 2024-04-26T23:40:28.306 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T23:40:28.414 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:28.411+0000 7f60b8d96640 1 Processor -- start 2024-04-26T23:40:28.414 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:28.411+0000 7f60b8d96640 1 -- start start 2024-04-26T23:40:28.418 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:28.412+0000 7f60b8d96640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f60b4154040 0x7f60b40744b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:28.418 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:28.412+0000 7f60b8d96640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f60b40c47f0 0x7f60b4071100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:28.418 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:28.412+0000 7f60b8d96640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f60b4070a20 con 0x7f60b4073740 2024-04-26T23:40:28.418 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:28.412+0000 7f60b8d96640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f60b4074e00 con 0x7f60b4154040 2024-04-26T23:40:28.418 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:28.412+0000 7f60b8d96640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f60b4070cc0 con 0x7f60b40c47f0 2024-04-26T23:40:28.418 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:28.412+0000 7f60b2d9d640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f60b4073740 0x7f60b40ca760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:35096/0 (socket says 172.21.15.88:35096) 2024-04-26T23:40:28.419 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:28.412+0000 7f60b2d9d640 1 -- 172.21.15.88:0/2553112425 learned_addr learned my addr 172.21.15.88:0/2553112425 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-26T23:40:28.419 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:28.413+0000 7f60b1d9b640 1 --2- 172.21.15.88:0/2553112425 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f60b40c47f0 0x7f60b4071100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:28.419 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:28.413+0000 7f60b259c640 1 --2- 172.21.15.88:0/2553112425 >> v2:172.21.15.175:3300/0 conn(0x7f60b4154040 0x7f60b40744b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:28.419 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:28.413+0000 7f60b159a640 1 -- 172.21.15.88:0/2553112425 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 968334829 0 0) 0x7f60b4070a20 con 0x7f60b4073740 2024-04-26T23:40:28.419 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:28.413+0000 7f60b159a640 1 -- 172.21.15.88:0/2553112425 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f609c003520 con 0x7f60b4073740 2024-04-26T23:40:28.419 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:28.413+0000 7f60b159a640 1 -- 172.21.15.88:0/2553112425 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3687974735 0 0) 0x7f609c003520 con 0x7f60b4073740 2024-04-26T23:40:28.419 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:28.413+0000 7f60b159a640 1 -- 172.21.15.88:0/2553112425 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f60b40c47f0 msgr2=0x7f60b4071100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:40:28.419 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:28.413+0000 7f60b159a640 1 --2- 172.21.15.88:0/2553112425 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f60b40c47f0 0x7f60b4071100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:28.419 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:28.413+0000 7f60b159a640 1 -- 172.21.15.88:0/2553112425 >> v2:172.21.15.175:3300/0 conn(0x7f60b4154040 msgr2=0x7f60b40744b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:40:28.419 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:28.413+0000 7f60b159a640 1 --2- 172.21.15.88:0/2553112425 >> v2:172.21.15.175:3300/0 conn(0x7f60b4154040 0x7f60b40744b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:28.419 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:28.413+0000 7f60b159a640 1 -- 172.21.15.88:0/2553112425 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60b415ac40 con 0x7f60b4073740 2024-04-26T23:40:28.419 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:28.413+0000 7f60b159a640 1 -- 172.21.15.88:0/2553112425 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 356324787 0 0) 0x7f60ac001690 con 0x7f60b4073740 2024-04-26T23:40:28.419 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:28.413+0000 7f60b159a640 1 -- 172.21.15.88:0/2553112425 >> v1:172.21.15.88:6789/0 conn(0x7f60b4073740 legacy=0x7f60b40ca760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:28.419 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:28.413+0000 7f60b159a640 1 --2- 172.21.15.88:0/2553112425 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f609c0039b0 0x7f609c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:28.419 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:28.413+0000 7f60b159a640 1 --2- 172.21.15.88:0/2553112425 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f60b40c47f0 0x7f609c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:28.420 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:28.413+0000 7f60b159a640 1 --2- 172.21.15.88:0/2553112425 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f609c004d40 0x7f609c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:28.420 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:28.413+0000 7f60b159a640 1 -- 172.21.15.88:0/2553112425 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f60b4074e00 con 0x7f609c004d40 2024-04-26T23:40:28.420 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:28.413+0000 7f60b159a640 1 -- 172.21.15.88:0/2553112425 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f60b4070cc0 con 0x7f609c0039b0 2024-04-26T23:40:28.420 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:28.413+0000 7f60b159a640 1 -- 172.21.15.88:0/2553112425 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f609c00ba70 con 0x7f60b40c47f0 2024-04-26T23:40:28.420 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:28.413+0000 7f60b2d9d640 1 --2- 172.21.15.88:0/2553112425 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f609c004d40 0x7f609c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:28.420 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:28.413+0000 7f60b259c640 1 --2- 172.21.15.88:0/2553112425 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f609c0039b0 0x7f609c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:28.420 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:28.413+0000 7f60b1d9b640 1 --2- 172.21.15.88:0/2553112425 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f60b40c47f0 0x7f609c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:28.420 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:28.413+0000 7f60b2d9d640 1 -- 172.21.15.88:0/2553112425 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f60b40c47f0 msgr2=0x7f609c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:40:28.420 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:28.413+0000 7f60b2d9d640 1 --2- 172.21.15.88:0/2553112425 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f60b40c47f0 0x7f609c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:28.420 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:28.413+0000 7f60b2d9d640 1 -- 172.21.15.88:0/2553112425 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f609c0039b0 msgr2=0x7f609c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:40:28.420 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:28.413+0000 7f60b2d9d640 1 --2- 172.21.15.88:0/2553112425 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f609c0039b0 0x7f609c003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:28.420 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:28.413+0000 7f60b2d9d640 1 -- 172.21.15.88:0/2553112425 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f609c003520 con 0x7f609c004d40 2024-04-26T23:40:28.420 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:28.414+0000 7f60b2d9d640 1 --2- 172.21.15.88:0/2553112425 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f609c004d40 0x7f609c0051c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f60ac007fd0 tx=0x7f609c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e6a7843a653aba3 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:28.420 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:28.414+0000 7f60b159a640 1 -- 172.21.15.88:0/2553112425 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60ac007d50 con 0x7f609c004d40 2024-04-26T23:40:28.421 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:28.414+0000 7f60b159a640 1 -- 172.21.15.88:0/2553112425 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f60ac005af0 con 0x7f609c004d40 2024-04-26T23:40:28.421 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:28.414+0000 7f60b159a640 1 -- 172.21.15.88:0/2553112425 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60ac007070 con 0x7f609c004d40 2024-04-26T23:40:28.421 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:28.415+0000 7f60b8d96640 1 -- 172.21.15.88:0/2553112425 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f609c004d40 msgr2=0x7f609c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:28.421 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:28.415+0000 7f60b8d96640 1 --2- 172.21.15.88:0/2553112425 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f609c004d40 0x7f609c0051c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f60ac007fd0 tx=0x7f609c005830 comp rx=0 tx=0).stop 2024-04-26T23:40:28.421 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:28.415+0000 7f60b2d9d640 1 -- 172.21.15.88:0/2553112425 reap_dead start 2024-04-26T23:40:28.421 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:28.415+0000 7f60b8d96640 1 -- 172.21.15.88:0/2553112425 shutdown_connections 2024-04-26T23:40:28.421 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:28.415+0000 7f60b8d96640 1 -- 172.21.15.88:0/2553112425 >> 172.21.15.88:0/2553112425 conn(0x7f60b406e700 msgr2=0x7f60b406eae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:40:28.421 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:28.415+0000 7f60b8d96640 1 -- 172.21.15.88:0/2553112425 shutdown_connections 2024-04-26T23:40:28.421 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:28.415+0000 7f60b8d96640 1 -- 172.21.15.88:0/2553112425 wait complete. 2024-04-26T23:40:28.424 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:28.416+0000 7f60b8d96640 1 Processor -- start 2024-04-26T23:40:28.424 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:28.416+0000 7f60b8d96640 1 -- start start 2024-04-26T23:40:28.424 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:28.417+0000 7f60b8d96640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f609c004d40 0x7f60b41effa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:28.424 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:28.417+0000 7f60b8d96640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f60b415a310 0x7f60b41e3440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:28.424 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:28.417+0000 7f60b8d96640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f60b414d340 0x7f60b41e3980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:28.424 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:28.417+0000 7f60b8d96640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f60b40cae70 con 0x7f60b414d340 2024-04-26T23:40:28.424 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:28.417+0000 7f60b8d96640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f60b415af20 con 0x7f609c004d40 2024-04-26T23:40:28.424 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:28.417+0000 7f60b8d96640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f60b40caff0 con 0x7f60b415a310 2024-04-26T23:40:28.424 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:28.417+0000 7f60b2d9d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f60b414d340 0x7f60b41e3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:28.424 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:28.417+0000 7f60b2d9d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f60b414d340 0x7f60b41e3980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:38672/0 (socket says 172.21.15.88:38672) 2024-04-26T23:40:28.424 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:28.417+0000 7f60b2d9d640 1 -- 172.21.15.88:0/2631637369 learned_addr learned my addr 172.21.15.88:0/2631637369 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:40:28.424 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:28.417+0000 7f60b1d9b640 1 --2- 172.21.15.88:0/2631637369 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f60b415a310 0x7f60b41e3440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:28.425 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:28.417+0000 7f60b259c640 1 --2- 172.21.15.88:0/2631637369 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f609c004d40 0x7f60b41effa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:28.425 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:28.417+0000 7f60b2d9d640 1 -- 172.21.15.88:0/2631637369 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f60b415a310 msgr2=0x7f60b41e3440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:28.425 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:28.417+0000 7f60b2d9d640 1 --2- 172.21.15.88:0/2631637369 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f60b415a310 0x7f60b41e3440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:28.425 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:28.417+0000 7f60b2d9d640 1 -- 172.21.15.88:0/2631637369 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f609c004d40 msgr2=0x7f60b41effa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:28.425 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:28.417+0000 7f60b2d9d640 1 --2- 172.21.15.88:0/2631637369 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f609c004d40 0x7f60b41effa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:28.425 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:28.417+0000 7f60b2d9d640 1 -- 172.21.15.88:0/2631637369 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60b414e6f0 con 0x7f60b414d340 2024-04-26T23:40:28.425 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:28.417+0000 7f60b2d9d640 1 --2- 172.21.15.88:0/2631637369 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f60b414d340 0x7f60b41e3980 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f60ac02ae20 tx=0x7f60b415ae10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:28.425 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:28.418+0000 7f60a2ffd640 1 -- 172.21.15.88:0/2631637369 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60ac007d50 con 0x7f60b414d340 2024-04-26T23:40:28.425 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:28.418+0000 7f60a2ffd640 1 -- 172.21.15.88:0/2631637369 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f60ac004d20 con 0x7f60b414d340 2024-04-26T23:40:28.425 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:28.418+0000 7f60a2ffd640 1 -- 172.21.15.88:0/2631637369 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60ac001c90 con 0x7f60b414d340 2024-04-26T23:40:28.425 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:28.418+0000 7f60b8d96640 1 -- 172.21.15.88:0/2631637369 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60b414e410 con 0x7f60b414d340 2024-04-26T23:40:28.425 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:28.418+0000 7f60b8d96640 1 -- 172.21.15.88:0/2631637369 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60b41f0b30 con 0x7f60b414d340 2024-04-26T23:40:28.425 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:28.419+0000 7f60b8d96640 1 -- 172.21.15.88:0/2631637369 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f60b406f530 con 0x7f60b414d340 2024-04-26T23:40:28.426 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:28.419+0000 7f60a2ffd640 1 -- 172.21.15.88:0/2631637369 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f60ac046020 con 0x7f60b414d340 2024-04-26T23:40:28.426 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:28.419+0000 7f60a2ffd640 1 --2- 172.21.15.88:0/2631637369 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f609406c920 0x7f609406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:28.426 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:28.420+0000 7f60b259c640 1 --2- 172.21.15.88:0/2631637369 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f609406c920 0x7f609406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:28.426 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:28.420+0000 7f60a2ffd640 1 -- 172.21.15.88:0/2631637369 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f60ac0ab1b0 con 0x7f60b414d340 2024-04-26T23:40:28.426 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:28.420+0000 7f60b259c640 1 --2- 172.21.15.88:0/2631637369 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f609406c920 0x7f609406ede0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f60a4009fd0 tx=0x7f60a400b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:28.427 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:28.424+0000 7f60a2ffd640 1 -- 172.21.15.88:0/2631637369 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f60ac04d020 con 0x7f60b414d340 2024-04-26T23:40:28.642 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:28.639+0000 7f60b8d96640 1 -- 172.21.15.88:0/2631637369 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f60b40507a0 con 0x7f60b414d340 2024-04-26T23:40:28.643 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:28.640+0000 7f60a2ffd640 1 -- 172.21.15.88:0/2631637369 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+3870 (secure 0 0 0) 0x7f60ac000e80 con 0x7f60b414d340 2024-04-26T23:40:28.643 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-26T23:40:28.643 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6834/3199540397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":3199540397},{"type":"v1","addr":"172.21.15.175:6834","nonce":3199540397}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4270,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6837/2790134952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6835","nonce":2790134952},{"type":"v1","addr":"172.21.15.88:6837","nonce":2790134952}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4272,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6836/4159390276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6834","nonce":4159390276},{"type":"v1","addr":"172.21.15.88:6836","nonce":4159390276}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4279,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/3932058274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6833","nonce":3932058274},{"type":"v1","addr":"172.21.15.175:6835","nonce":3932058274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-04-26T23:40:28.643 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 3 2024-04-26T23:40:28.645 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:28.642+0000 7f60b8d96640 1 -- 172.21.15.88:0/2631637369 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f609406c920 msgr2=0x7f609406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:28.645 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:28.642+0000 7f60b8d96640 1 --2- 172.21.15.88:0/2631637369 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f609406c920 0x7f609406ede0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f60a4009fd0 tx=0x7f60a400b040 comp rx=0 tx=0).stop 2024-04-26T23:40:28.645 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:28.642+0000 7f60b8d96640 1 -- 172.21.15.88:0/2631637369 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f60b414d340 msgr2=0x7f60b41e3980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:28.645 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:28.642+0000 7f60b8d96640 1 --2- 172.21.15.88:0/2631637369 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f60b414d340 0x7f60b41e3980 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f60ac02ae20 tx=0x7f60b415ae10 comp rx=0 tx=0).stop 2024-04-26T23:40:28.645 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:28.642+0000 7f60b8d96640 1 -- 172.21.15.88:0/2631637369 shutdown_connections 2024-04-26T23:40:28.645 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:28.642+0000 7f60b8d96640 1 --2- 172.21.15.88:0/2631637369 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f609406c920 0x7f609406ede0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:28.645 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:28.642+0000 7f60b8d96640 1 --2- 172.21.15.88:0/2631637369 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f60b415a310 0x7f60b41e3440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:28.645 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:28.642+0000 7f60b8d96640 1 --2- 172.21.15.88:0/2631637369 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f60b414d340 0x7f60b41e3980 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:28.646 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:28.642+0000 7f60b8d96640 1 --2- 172.21.15.88:0/2631637369 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f609c004d40 0x7f60b41effa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:28.646 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:28.642+0000 7f60b8d96640 1 -- 172.21.15.88:0/2631637369 >> 172.21.15.88:0/2631637369 conn(0x7f60b406e700 msgr2=0x7f60b40c3a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:40:28.646 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:28.642+0000 7f60b8d96640 1 -- 172.21.15.88:0/2631637369 shutdown_connections 2024-04-26T23:40:28.646 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:28.642+0000 7f60b8d96640 1 -- 172.21.15.88:0/2631637369 wait complete. 2024-04-26T23:40:28.656 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T23:40:28.752 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:28.749+0000 7fe0b462c640 1 Processor -- start 2024-04-26T23:40:28.752 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:28.749+0000 7fe0b462c640 1 -- start start 2024-04-26T23:40:28.755 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:28.750+0000 7fe0b462c640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fe0ac1541d0 0x7fe0ac0c8400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:28.756 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:28.750+0000 7fe0b462c640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe0ac15a3c0 0x7fe0ac15a830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:28.756 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:28.750+0000 7fe0b462c640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe0ac0c3fc0 con 0x7fe0ac070490 2024-04-26T23:40:28.756 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:28.750+0000 7fe0b462c640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7fe0ac0c3500 con 0x7fe0ac1541d0 2024-04-26T23:40:28.756 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:28.750+0000 7fe0b462c640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fe0ac0c37e0 con 0x7fe0ac15a3c0 2024-04-26T23:40:28.756 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:28.750+0000 7fe0b1bc7640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fe0ac070490 0x7fe0ac0c7420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:39748/0 (socket says 172.21.15.88:39748) 2024-04-26T23:40:28.756 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:28.750+0000 7fe0b1bc7640 1 -- 172.21.15.88:0/327699536 learned_addr learned my addr 172.21.15.88:0/327699536 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-26T23:40:28.756 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:28.750+0000 7fe0b13c6640 1 -- 172.21.15.88:0/327699536 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1769590673 0 0) 0x7fe0ac0c3fc0 con 0x7fe0ac070490 2024-04-26T23:40:28.756 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:28.750+0000 7fe0b13c6640 1 -- 172.21.15.88:0/327699536 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe098003520 con 0x7fe0ac070490 2024-04-26T23:40:28.756 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:28.750+0000 7fe0b23c8640 1 --2- 172.21.15.88:0/327699536 >> v2:172.21.15.175:3300/0 conn(0x7fe0ac1541d0 0x7fe0ac0c8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:28.756 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:28.750+0000 7fe0b2bc9640 1 --2- 172.21.15.88:0/327699536 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe0ac15a3c0 0x7fe0ac15a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:28.756 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:28.750+0000 7fe0b13c6640 1 -- 172.21.15.88:0/327699536 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2978972684 0 0) 0x7fe098003520 con 0x7fe0ac070490 2024-04-26T23:40:28.756 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:28.750+0000 7fe0b13c6640 1 -- 172.21.15.88:0/327699536 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe0ac15a3c0 msgr2=0x7fe0ac15a830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:40:28.756 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:28.750+0000 7fe0b13c6640 1 --2- 172.21.15.88:0/327699536 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe0ac15a3c0 0x7fe0ac15a830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:28.756 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:28.750+0000 7fe0b13c6640 1 -- 172.21.15.88:0/327699536 >> v2:172.21.15.175:3300/0 conn(0x7fe0ac1541d0 msgr2=0x7fe0ac0c8400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:40:28.756 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:28.750+0000 7fe0b13c6640 1 --2- 172.21.15.88:0/327699536 >> v2:172.21.15.175:3300/0 conn(0x7fe0ac1541d0 0x7fe0ac0c8400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:28.756 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:28.750+0000 7fe0b13c6640 1 -- 172.21.15.88:0/327699536 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0ac0c3ac0 con 0x7fe0ac070490 2024-04-26T23:40:28.757 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:28.750+0000 7fe0b13c6640 1 -- 172.21.15.88:0/327699536 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 356324787 0 0) 0x7fe09c001690 con 0x7fe0ac070490 2024-04-26T23:40:28.757 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:28.750+0000 7fe0b13c6640 1 -- 172.21.15.88:0/327699536 >> v1:172.21.15.88:6789/0 conn(0x7fe0ac070490 legacy=0x7fe0ac0c7420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:28.757 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:28.750+0000 7fe0b13c6640 1 --2- 172.21.15.88:0/327699536 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe0980039b0 0x7fe098003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:28.757 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:28.750+0000 7fe0b13c6640 1 --2- 172.21.15.88:0/327699536 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe098004800 0x7fe098004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:28.757 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:28.751+0000 7fe0b13c6640 1 --2- 172.21.15.88:0/327699536 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe0ac15a3c0 0x7fe0980051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:28.757 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:28.751+0000 7fe0b13c6640 1 -- 172.21.15.88:0/327699536 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fe0ac0c3500 con 0x7fe0980039b0 2024-04-26T23:40:28.757 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:28.751+0000 7fe0b13c6640 1 -- 172.21.15.88:0/327699536 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fe0ac0c37e0 con 0x7fe098004800 2024-04-26T23:40:28.757 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:28.751+0000 7fe0b13c6640 1 -- 172.21.15.88:0/327699536 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fe09800ba70 con 0x7fe0ac15a3c0 2024-04-26T23:40:28.757 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:28.751+0000 7fe0b23c8640 1 --2- 172.21.15.88:0/327699536 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe0980039b0 0x7fe098003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:28.757 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:28.751+0000 7fe0b2bc9640 1 --2- 172.21.15.88:0/327699536 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe0ac15a3c0 0x7fe0980051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:28.757 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:28.751+0000 7fe0b1bc7640 1 --2- 172.21.15.88:0/327699536 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe098004800 0x7fe098004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:28.757 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:28.751+0000 7fe0b23c8640 1 -- 172.21.15.88:0/327699536 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe0ac15a3c0 msgr2=0x7fe0980051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:40:28.757 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:28.751+0000 7fe0b23c8640 1 --2- 172.21.15.88:0/327699536 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe0ac15a3c0 0x7fe0980051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:28.757 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:28.751+0000 7fe0b23c8640 1 -- 172.21.15.88:0/327699536 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe098004800 msgr2=0x7fe098004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:40:28.757 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:28.751+0000 7fe0b23c8640 1 --2- 172.21.15.88:0/327699536 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe098004800 0x7fe098004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:28.757 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:28.751+0000 7fe0b23c8640 1 -- 172.21.15.88:0/327699536 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe098003520 con 0x7fe0980039b0 2024-04-26T23:40:28.758 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:28.751+0000 7fe0b23c8640 1 --2- 172.21.15.88:0/327699536 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe0980039b0 0x7fe098003dd0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fe0a8009a90 tx=0x7fe098005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90316f7efa5a9729 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:28.758 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:28.752+0000 7fe0b13c6640 1 -- 172.21.15.88:0/327699536 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0a8036070 con 0x7fe0980039b0 2024-04-26T23:40:28.758 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:28.752+0000 7fe0b13c6640 1 -- 172.21.15.88:0/327699536 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0a8031400 con 0x7fe0980039b0 2024-04-26T23:40:28.758 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:28.752+0000 7fe0b13c6640 1 -- 172.21.15.88:0/327699536 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0a8009690 con 0x7fe0980039b0 2024-04-26T23:40:28.758 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:28.752+0000 7fe0b462c640 1 -- 172.21.15.88:0/327699536 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe0980039b0 msgr2=0x7fe098003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:28.758 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:28.752+0000 7fe0b462c640 1 --2- 172.21.15.88:0/327699536 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe0980039b0 0x7fe098003dd0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fe0a8009a90 tx=0x7fe098005830 comp rx=0 tx=0).stop 2024-04-26T23:40:28.758 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:28.752+0000 7fe0b2bc9640 1 -- 172.21.15.88:0/327699536 reap_dead start 2024-04-26T23:40:28.758 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:28.752+0000 7fe0b462c640 1 -- 172.21.15.88:0/327699536 shutdown_connections 2024-04-26T23:40:28.758 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:28.752+0000 7fe0b462c640 1 -- 172.21.15.88:0/327699536 >> 172.21.15.88:0/327699536 conn(0x7fe0ac0c8c40 msgr2=0x7fe0ac0c9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:40:28.758 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:28.752+0000 7fe0b462c640 1 -- 172.21.15.88:0/327699536 shutdown_connections 2024-04-26T23:40:28.758 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:28.752+0000 7fe0b462c640 1 -- 172.21.15.88:0/327699536 wait complete. 2024-04-26T23:40:28.761 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:28.753+0000 7fe0b462c640 1 Processor -- start 2024-04-26T23:40:28.761 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:28.753+0000 7fe0b462c640 1 -- start start 2024-04-26T23:40:28.761 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:28.754+0000 7fe0b462c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe0980039b0 0x7fe0ac150e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:28.761 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:28.754+0000 7fe0b462c640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe0ac0aa290 0x7fe0ac0ad320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:28.761 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:28.754+0000 7fe0b462c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe0ac074150 0x7fe0ac0745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:28.761 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:28.754+0000 7fe0b462c640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fe0ac0c7cb0 con 0x7fe0980039b0 2024-04-26T23:40:28.761 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:28.754+0000 7fe0b462c640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fe0ac0c7b30 con 0x7fe0ac074150 2024-04-26T23:40:28.761 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:28.754+0000 7fe0b462c640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fe0ac0c42a0 con 0x7fe0ac0aa290 2024-04-26T23:40:28.761 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:28.754+0000 7fe0b23c8640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe0980039b0 0x7fe0ac150e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:28.761 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:28.754+0000 7fe0b23c8640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe0980039b0 0x7fe0ac150e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:57190/0 (socket says 172.21.15.88:57190) 2024-04-26T23:40:28.761 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:28.754+0000 7fe0b23c8640 1 -- 172.21.15.88:0/1464573095 learned_addr learned my addr 172.21.15.88:0/1464573095 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:40:28.761 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:28.754+0000 7fe0b2bc9640 1 --2- 172.21.15.88:0/1464573095 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe0ac074150 0x7fe0ac0745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:28.761 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:28.754+0000 7fe0b1bc7640 1 --2- 172.21.15.88:0/1464573095 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe0ac0aa290 0x7fe0ac0ad320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:28.761 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:28.754+0000 7fe0b23c8640 1 -- 172.21.15.88:0/1464573095 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe0ac0aa290 msgr2=0x7fe0ac0ad320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:28.762 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:28.754+0000 7fe0b23c8640 1 --2- 172.21.15.88:0/1464573095 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe0ac0aa290 0x7fe0ac0ad320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:28.762 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:28.754+0000 7fe0b23c8640 1 -- 172.21.15.88:0/1464573095 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe0ac074150 msgr2=0x7fe0ac0745e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:28.762 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:28.754+0000 7fe0b23c8640 1 --2- 172.21.15.88:0/1464573095 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe0ac074150 0x7fe0ac0745e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:28.762 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:28.754+0000 7fe0b23c8640 1 -- 172.21.15.88:0/1464573095 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0ac1ed5c0 con 0x7fe0980039b0 2024-04-26T23:40:28.762 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:28.754+0000 7fe0b2bc9640 1 --2- 172.21.15.88:0/1464573095 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe0ac074150 0x7fe0ac0745e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:40:28.762 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:28.754+0000 7fe0b1bc7640 1 --2- 172.21.15.88:0/1464573095 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe0ac0aa290 0x7fe0ac0ad320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:40:28.762 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:28.755+0000 7fe0b23c8640 1 --2- 172.21.15.88:0/1464573095 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe0980039b0 0x7fe0ac150e30 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fe0a8034040 tx=0x7fe0a8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:28.762 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:28.755+0000 7fe0a2ffd640 1 -- 172.21.15.88:0/1464573095 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0a8040020 con 0x7fe0980039b0 2024-04-26T23:40:28.762 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:28.755+0000 7fe0a2ffd640 1 -- 172.21.15.88:0/1464573095 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0a8003950 con 0x7fe0980039b0 2024-04-26T23:40:28.762 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:28.755+0000 7fe0b462c640 1 -- 172.21.15.88:0/1464573095 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0ac150b50 con 0x7fe0980039b0 2024-04-26T23:40:28.762 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:28.755+0000 7fe0a2ffd640 1 -- 172.21.15.88:0/1464573095 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0a8036040 con 0x7fe0980039b0 2024-04-26T23:40:28.762 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:28.755+0000 7fe0b462c640 1 -- 172.21.15.88:0/1464573095 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0ac0ad860 con 0x7fe0980039b0 2024-04-26T23:40:28.762 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:28.756+0000 7fe0b462c640 1 -- 172.21.15.88:0/1464573095 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe0ac1ed0d0 con 0x7fe0980039b0 2024-04-26T23:40:28.763 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:28.756+0000 7fe0a2ffd640 1 -- 172.21.15.88:0/1464573095 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe0a8043020 con 0x7fe0980039b0 2024-04-26T23:40:28.763 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:28.756+0000 7fe0a2ffd640 1 --2- 172.21.15.88:0/1464573095 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fe09006c8f0 0x7fe09006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:28.763 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:28.756+0000 7fe0a2ffd640 1 -- 172.21.15.88:0/1464573095 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7fe0a80ab8f0 con 0x7fe0980039b0 2024-04-26T23:40:28.763 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:28.756+0000 7fe0b1bc7640 1 --2- 172.21.15.88:0/1464573095 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fe09006c8f0 0x7fe09006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:28.763 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:28.757+0000 7fe0b1bc7640 1 --2- 172.21.15.88:0/1464573095 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fe09006c8f0 0x7fe09006edb0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fe09c001d30 tx=0x7fe09c001cc0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:28.764 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:28.761+0000 7fe0a2ffd640 1 -- 172.21.15.88:0/1464573095 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fe0a804a070 con 0x7fe0980039b0 2024-04-26T23:40:28.940 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:28.937+0000 7fe0b462c640 1 -- 172.21.15.88:0/1464573095 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe0ac076690 con 0x7fe0980039b0 2024-04-26T23:40:28.941 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:28.938+0000 7fe0a2ffd640 1 -- 172.21.15.88:0/1464573095 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) ==== 74+0+12884 (secure 0 0 0) 0x7fe0a80392d0 con 0x7fe0980039b0 2024-04-26T23:40:28.941 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-26T23:40:28.941 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":16,"fsid":"555255e9-7ef9-4454-8dc9-35e96b70035c","created":"2024-04-26T23:40:07.836009+0000","modified":"2024-04-26T23:40:21.953254+0000","last_up_change":"2024-04-26T23:40:18.831369+0000","last_in_change":"2024-04-26T23:40:09.944777+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T23:40:19.936127+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"92aecea3-ed62-4a29-87c0-76758a0816a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":2803186054},{"type":"v1","addr":"172.21.15.88:6801","nonce":2803186054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":2803186054},{"type":"v1","addr":"172.21.15.88:6803","nonce":2803186054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":2803186054},{"type":"v1","addr":"172.21.15.88:6807","nonce":2803186054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":2803186054},{"type":"v1","addr":"172.21.15.88:6805","nonce":2803186054}]},"public_addr":"172.21.15.88:6801/2803186054","cluster_addr":"172.21.15.88:6803/2803186054","heartbeat_back_addr":"172.21.15.88:6807/2803186054","heartbeat_front_addr":"172.21.15.88:6805/2803186054","state":["exists","up"]},{"osd":1,"uuid":"7a6f0fa9-23d0-4747-880f-798d45ec5eeb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":1897380484},{"type":"v1","addr":"172.21.15.88:6817","nonce":1897380484}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":1897380484},{"type":"v1","addr":"172.21.15.88:6819","nonce":1897380484}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1897380484},{"type":"v1","addr":"172.21.15.88:6823","nonce":1897380484}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":1897380484},{"type":"v1","addr":"172.21.15.88:6821","nonce":1897380484}]},"public_addr":"172.21.15.88:6817/1897380484","cluster_addr":"172.21.15.88:6819/1897380484","heartbeat_back_addr":"172.21.15.88:6823/1897380484","heartbeat_front_addr":"172.21.15.88:6821/1897380484","state":["exists","up"]},{"osd":2,"uuid":"6be88ea0-e133-4200-a4b5-f92d664b248a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":648396269},{"type":"v1","addr":"172.21.15.88:6809","nonce":648396269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":648396269},{"type":"v1","addr":"172.21.15.88:6811","nonce":648396269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":648396269},{"type":"v1","addr":"172.21.15.88:6815","nonce":648396269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":648396269},{"type":"v1","addr":"172.21.15.88:6813","nonce":648396269}]},"public_addr":"172.21.15.88:6809/648396269","cluster_addr":"172.21.15.88:6811/648396269","heartbeat_back_addr":"172.21.15.88:6815/648396269","heartbeat_front_addr":"172.21.15.88:6813/648396269","state":["exists","up"]},{"osd":3,"uuid":"dcb0746b-7b3d-4ecf-8089-2493a5d1857c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":2328028922},{"type":"v1","addr":"172.21.15.88:6825","nonce":2328028922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":2328028922},{"type":"v1","addr":"172.21.15.88:6827","nonce":2328028922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":2328028922},{"type":"v1","addr":"172.21.15.88:6831","nonce":2328028922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":2328028922},{"type":"v1","addr":"172.21.15.88:6829","nonce":2328028922}]},"public_addr":"172.21.15.88:6825/2328028922","cluster_addr":"172.21.15.88:6827/2328028922","heartbeat_back_addr":"172.21.15.88:6831/2328028922","heartbeat_front_addr":"172.21.15.88:6829/2328028922","state":["exists","up"]},{"osd":4,"uuid":"c483de66-c44f-450e-a4ce-b132d50882c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":3929617402},{"type":"v1","addr":"172.21.15.175:6809","nonce":3929617402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":3929617402},{"type":"v1","addr":"172.21.15.175:6811","nonce":3929617402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":3929617402},{"type":"v1","addr":"172.21.15.175:6815","nonce":3929617402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":3929617402},{"type":"v1","addr":"172.21.15.175:6813","nonce":3929617402}]},"public_addr":"172.21.15.175:6809/3929617402","cluster_addr":"172.21.15.175:6811/3929617402","heartbeat_back_addr":"172.21.15.175:6815/3929617402","heartbeat_front_addr":"172.21.15.175:6813/3929617402","state":["exists","up"]},{"osd":5,"uuid":"ac3b1669-d228-40dd-9f9a-cb46aa73dd6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":2476644457},{"type":"v1","addr":"172.21.15.175:6801","nonce":2476644457}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":2476644457},{"type":"v1","addr":"172.21.15.175:6803","nonce":2476644457}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":2476644457},{"type":"v1","addr":"172.21.15.175:6807","nonce":2476644457}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":2476644457},{"type":"v1","addr":"172.21.15.175:6805","nonce":2476644457}]},"public_addr":"172.21.15.175:6801/2476644457","cluster_addr":"172.21.15.175:6803/2476644457","heartbeat_back_addr":"172.21.15.175:6807/2476644457","heartbeat_front_addr":"172.21.15.175:6805/2476644457","state":["exists","up"]},{"osd":6,"uuid":"7bef4896-857e-4c11-b3b2-c2e9a8548338","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":3824112919},{"type":"v1","addr":"172.21.15.175:6819","nonce":3824112919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6821","nonce":3824112919},{"type":"v1","addr":"172.21.15.175:6824","nonce":3824112919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":3824112919},{"type":"v1","addr":"172.21.15.175:6831","nonce":3824112919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":3824112919},{"type":"v1","addr":"172.21.15.175:6829","nonce":3824112919}]},"public_addr":"172.21.15.175:6819/3824112919","cluster_addr":"172.21.15.175:6824/3824112919","heartbeat_back_addr":"172.21.15.175:6831/3824112919","heartbeat_front_addr":"172.21.15.175:6829/3824112919","state":["exists","up"]},{"osd":7,"uuid":"e18d9e09-8673-470d-b9dc-280a409b63f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6817","nonce":3319361162},{"type":"v1","addr":"172.21.15.175:6818","nonce":3319361162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":3319361162},{"type":"v1","addr":"172.21.15.175:6822","nonce":3319361162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6827","nonce":3319361162},{"type":"v1","addr":"172.21.15.175:6828","nonce":3319361162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6823","nonce":3319361162},{"type":"v1","addr":"172.21.15.175:6825","nonce":3319361162}]},"public_addr":"172.21.15.175:6818/3319361162","cluster_addr":"172.21.15.175:6822/3319361162","heartbeat_back_addr":"172.21.15.175:6828/3319361162","heartbeat_front_addr":"172.21.15.175:6825/3319361162","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:40:15.126268+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:40:15.050614+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:40:14.995164+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:40:15.078112+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:40:15.159637+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:40:15.091226+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:40:15.140316+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:40:15.089431+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:40:28.943 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:28.940+0000 7fe0b462c640 1 -- 172.21.15.88:0/1464573095 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fe09006c8f0 msgr2=0x7fe09006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:28.943 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:28.940+0000 7fe0b462c640 1 --2- 172.21.15.88:0/1464573095 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fe09006c8f0 0x7fe09006edb0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fe09c001d30 tx=0x7fe09c001cc0 comp rx=0 tx=0).stop 2024-04-26T23:40:28.943 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:28.940+0000 7fe0b462c640 1 -- 172.21.15.88:0/1464573095 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe0980039b0 msgr2=0x7fe0ac150e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:28.943 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:28.940+0000 7fe0b462c640 1 --2- 172.21.15.88:0/1464573095 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe0980039b0 0x7fe0ac150e30 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fe0a8034040 tx=0x7fe0a8004730 comp rx=0 tx=0).stop 2024-04-26T23:40:28.943 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:28.940+0000 7fe0b462c640 1 -- 172.21.15.88:0/1464573095 shutdown_connections 2024-04-26T23:40:28.943 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:28.940+0000 7fe0b462c640 1 --2- 172.21.15.88:0/1464573095 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fe09006c8f0 0x7fe09006edb0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:28.943 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:28.940+0000 7fe0b462c640 1 --2- 172.21.15.88:0/1464573095 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe0ac0aa290 0x7fe0ac0ad320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:28.943 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:28.940+0000 7fe0b462c640 1 --2- 172.21.15.88:0/1464573095 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe0ac074150 0x7fe0ac0745e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:28.943 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:28.940+0000 7fe0b462c640 1 --2- 172.21.15.88:0/1464573095 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe0980039b0 0x7fe0ac150e30 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:28.944 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:28.940+0000 7fe0b462c640 1 -- 172.21.15.88:0/1464573095 >> 172.21.15.88:0/1464573095 conn(0x7fe0ac0c8c40 msgr2=0x7fe0ac1525c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:40:28.944 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:28.940+0000 7fe0b462c640 1 -- 172.21.15.88:0/1464573095 shutdown_connections 2024-04-26T23:40:28.944 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:28.940+0000 7fe0b462c640 1 -- 172.21.15.88:0/1464573095 wait complete. 2024-04-26T23:40:28.954 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T23:40:19.936127+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T23:40:28.954 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T23:40:29.054 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:29.051+0000 7ff84fa47640 1 Processor -- start 2024-04-26T23:40:29.054 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:29.051+0000 7ff84fa47640 1 -- start start 2024-04-26T23:40:29.055 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:29.052+0000 7ff84fa47640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7ff848073aa0 0x7ff8481554c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:29.055 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:29.052+0000 7ff84fa47640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff84806f920 0x7ff848151cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:29.055 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:29.052+0000 7ff84fa47640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff848070670 con 0x7ff848152210 2024-04-26T23:40:29.055 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:29.052+0000 7ff84fa47640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7ff8481526a0 con 0x7ff848073aa0 2024-04-26T23:40:29.055 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:29.052+0000 7ff84fa47640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7ff8480ab8f0 con 0x7ff84806f920 2024-04-26T23:40:29.055 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:29.052+0000 7ff84cfe2640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff84806f920 0x7ff848151cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:29.055 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:29.052+0000 7ff84d7e3640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7ff848073aa0 0x7ff8481554c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:29.055 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:29.052+0000 7ff84dfe4640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7ff848152210 0x7ff8480abd80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.88:58932/0 (socket says 172.21.15.88:58932) 2024-04-26T23:40:29.055 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:29.052+0000 7ff84dfe4640 1 -- 172.21.15.88:0/1865929690 learned_addr learned my addr 172.21.15.88:0/1865929690 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-26T23:40:29.056 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:29.052+0000 7ff84d7e3640 1 -- 172.21.15.88:0/1865929690 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff84806f920 msgr2=0x7ff848151cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:40:29.056 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:29.052+0000 7ff84d7e3640 1 --2- 172.21.15.88:0/1865929690 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff84806f920 0x7ff848151cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:29.056 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:29.052+0000 7ff84d7e3640 1 -- 172.21.15.88:0/1865929690 >> v1:172.21.15.175:6789/0 conn(0x7ff848152210 legacy=0x7ff8480abd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:29.056 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:29.052+0000 7ff84d7e3640 1 -- 172.21.15.88:0/1865929690 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8480700b0 con 0x7ff848073aa0 2024-04-26T23:40:29.056 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:29.053+0000 7ff84d7e3640 1 --2- 172.21.15.88:0/1865929690 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff848073aa0 0x7ff8481554c0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7ff8440097a0 tx=0x7ff84402a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=12f25a4f7e451ea server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:29.056 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:29.053+0000 7ff83ffff640 1 -- 172.21.15.88:0/1865929690 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff844037070 con 0x7ff848073aa0 2024-04-26T23:40:29.056 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:29.053+0000 7ff83ffff640 1 -- 172.21.15.88:0/1865929690 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff844032440 con 0x7ff848073aa0 2024-04-26T23:40:29.056 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:29.053+0000 7ff83ffff640 1 -- 172.21.15.88:0/1865929690 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff844032810 con 0x7ff848073aa0 2024-04-26T23:40:29.057 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:29.054+0000 7ff84fa47640 1 -- 172.21.15.88:0/1865929690 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff848073aa0 msgr2=0x7ff8481554c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:29.057 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:29.054+0000 7ff84fa47640 1 --2- 172.21.15.88:0/1865929690 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff848073aa0 0x7ff8481554c0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7ff8440097a0 tx=0x7ff84402a180 comp rx=0 tx=0).stop 2024-04-26T23:40:29.057 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:29.054+0000 7ff84fa47640 1 -- 172.21.15.88:0/1865929690 shutdown_connections 2024-04-26T23:40:29.057 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:29.054+0000 7ff84fa47640 1 --2- 172.21.15.88:0/1865929690 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff84806f920 0x7ff848151cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:29.057 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:29.054+0000 7ff84fa47640 1 --2- 172.21.15.88:0/1865929690 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff848073aa0 0x7ff8481554c0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:29.058 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:29.054+0000 7ff84fa47640 1 -- 172.21.15.88:0/1865929690 >> 172.21.15.88:0/1865929690 conn(0x7ff8480c6ed0 msgr2=0x7ff8480c72b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:40:29.058 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:29.054+0000 7ff84fa47640 1 -- 172.21.15.88:0/1865929690 shutdown_connections 2024-04-26T23:40:29.058 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:29.054+0000 7ff84fa47640 1 -- 172.21.15.88:0/1865929690 wait complete. 2024-04-26T23:40:29.060 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:29.055+0000 7ff84fa47640 1 Processor -- start 2024-04-26T23:40:29.060 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:29.055+0000 7ff84fa47640 1 -- start start 2024-04-26T23:40:29.060 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:29.056+0000 7ff84fa47640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff84806f920 0x7ff84814d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:29.060 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:29.056+0000 7ff84fa47640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff848073aa0 0x7ff8481eb540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:29.060 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:29.056+0000 7ff84fa47640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff848152210 0x7ff8481eba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:29.060 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:29.056+0000 7ff84fa47640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7ff84806fd80 con 0x7ff848073aa0 2024-04-26T23:40:29.060 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:29.056+0000 7ff84fa47640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff8480ab580 con 0x7ff84806f920 2024-04-26T23:40:29.060 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:29.056+0000 7ff84fa47640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7ff848073e80 con 0x7ff848152210 2024-04-26T23:40:29.060 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:29.056+0000 7ff84cfe2640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff848073aa0 0x7ff8481eb540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:29.060 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:29.056+0000 7ff84cfe2640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff848073aa0 0x7ff8481eb540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:57202/0 (socket says 172.21.15.88:57202) 2024-04-26T23:40:29.060 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:29.056+0000 7ff84cfe2640 1 -- 172.21.15.88:0/2730844654 learned_addr learned my addr 172.21.15.88:0/2730844654 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:40:29.060 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:29.056+0000 7ff84dfe4640 1 --2- 172.21.15.88:0/2730844654 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff848152210 0x7ff8481eba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:29.060 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:29.056+0000 7ff84d7e3640 1 --2- 172.21.15.88:0/2730844654 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff84806f920 0x7ff84814d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:29.061 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:29.056+0000 7ff84cfe2640 1 -- 172.21.15.88:0/2730844654 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff848152210 msgr2=0x7ff8481eba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:29.061 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:29.056+0000 7ff84cfe2640 1 --2- 172.21.15.88:0/2730844654 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff848152210 0x7ff8481eba80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:29.061 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:29.056+0000 7ff84cfe2640 1 -- 172.21.15.88:0/2730844654 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff84806f920 msgr2=0x7ff84814d0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:29.061 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:29.056+0000 7ff84cfe2640 1 --2- 172.21.15.88:0/2730844654 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff84806f920 0x7ff84814d0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:29.061 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:29.056+0000 7ff84cfe2640 1 -- 172.21.15.88:0/2730844654 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8481467f0 con 0x7ff848073aa0 2024-04-26T23:40:29.061 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:29.056+0000 7ff84cfe2640 1 --2- 172.21.15.88:0/2730844654 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff848073aa0 0x7ff8481eb540 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ff838012fc0 tx=0x7ff838010490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:29.061 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:29.056+0000 7ff83dffb640 1 -- 172.21.15.88:0/2730844654 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff838010da0 con 0x7ff848073aa0 2024-04-26T23:40:29.061 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:29.056+0000 7ff83dffb640 1 -- 172.21.15.88:0/2730844654 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff83801d070 con 0x7ff848073aa0 2024-04-26T23:40:29.061 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:29.057+0000 7ff84fa47640 1 -- 172.21.15.88:0/2730844654 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8480c9150 con 0x7ff848073aa0 2024-04-26T23:40:29.061 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:29.057+0000 7ff83dffb640 1 -- 172.21.15.88:0/2730844654 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8380186c0 con 0x7ff848073aa0 2024-04-26T23:40:29.061 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:29.057+0000 7ff84fa47640 1 -- 172.21.15.88:0/2730844654 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff84814d5e0 con 0x7ff848073aa0 2024-04-26T23:40:29.062 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:29.058+0000 7ff84fa47640 1 -- 172.21.15.88:0/2730844654 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff8480507a0 con 0x7ff848073aa0 2024-04-26T23:40:29.062 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:29.058+0000 7ff83dffb640 1 -- 172.21.15.88:0/2730844654 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff838016050 con 0x7ff848073aa0 2024-04-26T23:40:29.062 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:29.058+0000 7ff83dffb640 1 --2- 172.21.15.88:0/2730844654 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7ff82c06c8f0 0x7ff82c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:29.062 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:29.059+0000 7ff83dffb640 1 -- 172.21.15.88:0/2730844654 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7ff83808f5b0 con 0x7ff848073aa0 2024-04-26T23:40:29.062 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:29.059+0000 7ff84d7e3640 1 --2- 172.21.15.88:0/2730844654 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7ff82c06c8f0 0x7ff82c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:29.062 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:29.059+0000 7ff84d7e3640 1 --2- 172.21.15.88:0/2730844654 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7ff82c06c8f0 0x7ff82c06edb0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7ff844034000 tx=0x7ff84402e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:29.065 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:29.063+0000 7ff83dffb640 1 -- 172.21.15.88:0/2730844654 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7ff838026020 con 0x7ff848073aa0 2024-04-26T23:40:29.239 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:29.236+0000 7ff84fa47640 1 -- 172.21.15.88:0/2730844654 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7ff8480c6a30 con 0x7ff848073aa0 2024-04-26T23:40:29.240 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:29.237+0000 7ff83dffb640 1 -- 172.21.15.88:0/2730844654 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) ==== 93+0+10 (secure 0 0 0) 0x7ff838014040 con 0x7ff848073aa0 2024-04-26T23:40:29.240 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 1 2024-04-26T23:40:29.242 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:29.239+0000 7ff84fa47640 1 -- 172.21.15.88:0/2730844654 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7ff82c06c8f0 msgr2=0x7ff82c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:29.242 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:29.239+0000 7ff84fa47640 1 --2- 172.21.15.88:0/2730844654 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7ff82c06c8f0 0x7ff82c06edb0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7ff844034000 tx=0x7ff84402e000 comp rx=0 tx=0).stop 2024-04-26T23:40:29.242 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:29.239+0000 7ff84fa47640 1 -- 172.21.15.88:0/2730844654 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff848073aa0 msgr2=0x7ff8481eb540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:29.242 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:29.239+0000 7ff84fa47640 1 --2- 172.21.15.88:0/2730844654 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff848073aa0 0x7ff8481eb540 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ff838012fc0 tx=0x7ff838010490 comp rx=0 tx=0).stop 2024-04-26T23:40:29.242 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:29.239+0000 7ff84fa47640 1 -- 172.21.15.88:0/2730844654 shutdown_connections 2024-04-26T23:40:29.242 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:29.239+0000 7ff84fa47640 1 --2- 172.21.15.88:0/2730844654 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7ff82c06c8f0 0x7ff82c06edb0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:29.242 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:29.239+0000 7ff84fa47640 1 --2- 172.21.15.88:0/2730844654 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff848152210 0x7ff8481eba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:29.242 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:29.239+0000 7ff84fa47640 1 --2- 172.21.15.88:0/2730844654 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff848073aa0 0x7ff8481eb540 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:29.242 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:29.239+0000 7ff84fa47640 1 --2- 172.21.15.88:0/2730844654 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff84806f920 0x7ff84814d0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:29.242 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:29.239+0000 7ff84fa47640 1 -- 172.21.15.88:0/2730844654 >> 172.21.15.88:0/2730844654 conn(0x7ff8480c6ed0 msgr2=0x7ff8480c5d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:40:29.243 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:29.239+0000 7ff84fa47640 1 -- 172.21.15.88:0/2730844654 shutdown_connections 2024-04-26T23:40:29.243 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:29.239+0000 7ff84fa47640 1 -- 172.21.15.88:0/2730844654 wait complete. 2024-04-26T23:40:29.252 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-26T23:40:29.349 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:29.346+0000 7f8c894c8640 1 Processor -- start 2024-04-26T23:40:29.349 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:29.346+0000 7f8c894c8640 1 -- start start 2024-04-26T23:40:29.352 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:29.347+0000 7f8c894c8640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f8c84154160 0x7f8c84156bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:29.352 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:29.347+0000 7f8c894c8640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8c840c8df0 con 0x7f8c8415a1a0 2024-04-26T23:40:29.352 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:29.347+0000 7f8c894c8640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8c84154540 con 0x7f8c840ca5a0 2024-04-26T23:40:29.353 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:29.347+0000 7f8c894c8640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f8c840c9100 con 0x7f8c84154160 2024-04-26T23:40:29.353 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:29.347+0000 7f8c837fe640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f8c8415a1a0 0x7f8c840c9590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:39762/0 (socket says 172.21.15.88:39762) 2024-04-26T23:40:29.353 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:29.347+0000 7f8c837fe640 1 -- 172.21.15.88:0/369553213 learned_addr learned my addr 172.21.15.88:0/369553213 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-26T23:40:29.353 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:29.347+0000 7f8c81ffb640 1 -- 172.21.15.88:0/369553213 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 214735945 0 0) 0x7f8c7c001490 con 0x7f8c8415a1a0 2024-04-26T23:40:29.353 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:29.347+0000 7f8c81ffb640 1 -- 172.21.15.88:0/369553213 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8c6c003520 con 0x7f8c8415a1a0 2024-04-26T23:40:29.353 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:29.347+0000 7f8c82ffd640 1 --2- 172.21.15.88:0/369553213 >> v2:172.21.15.175:3300/0 conn(0x7f8c84154160 0x7f8c84156bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:29.353 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:29.347+0000 7f8c81ffb640 1 -- 172.21.15.88:0/369553213 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3301439060 0 0) 0x7f8c6c003520 con 0x7f8c8415a1a0 2024-04-26T23:40:29.353 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:29.347+0000 7f8c81ffb640 1 -- 172.21.15.88:0/369553213 >> v2:172.21.15.175:3300/0 conn(0x7f8c84154160 msgr2=0x7f8c84156bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:40:29.353 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:29.347+0000 7f8c81ffb640 1 --2- 172.21.15.88:0/369553213 >> v2:172.21.15.175:3300/0 conn(0x7f8c84154160 0x7f8c84156bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:29.353 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:29.347+0000 7f8c81ffb640 1 -- 172.21.15.88:0/369553213 >> v1:172.21.15.175:6789/0 conn(0x7f8c840ca5a0 legacy=0x7f8c840c6e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:29.353 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:29.347+0000 7f8c81ffb640 1 -- 172.21.15.88:0/369553213 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c8415a910 con 0x7f8c8415a1a0 2024-04-26T23:40:29.353 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:29.347+0000 7f8c81ffb640 1 -- 172.21.15.88:0/369553213 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 356324787 0 0) 0x7f8c7c001bc0 con 0x7f8c8415a1a0 2024-04-26T23:40:29.353 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:29.347+0000 7f8c81ffb640 1 -- 172.21.15.88:0/369553213 >> v1:172.21.15.88:6789/0 conn(0x7f8c8415a1a0 legacy=0x7f8c840c9590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:29.353 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:29.347+0000 7f8c81ffb640 1 --2- 172.21.15.88:0/369553213 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8c6c0039b0 0x7f8c6c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:29.353 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:29.347+0000 7f8c81ffb640 1 --2- 172.21.15.88:0/369553213 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8c6c004800 0x7f8c6c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:29.353 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:29.348+0000 7f8c81ffb640 1 --2- 172.21.15.88:0/369553213 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8c6c0051c0 0x7f8c6c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:29.354 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:29.348+0000 7f8c81ffb640 1 -- 172.21.15.88:0/369553213 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f8c840c9100 con 0x7f8c6c004800 2024-04-26T23:40:29.354 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:29.348+0000 7f8c81ffb640 1 -- 172.21.15.88:0/369553213 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f8c6c00c110 con 0x7f8c6c0039b0 2024-04-26T23:40:29.354 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:29.348+0000 7f8c81ffb640 1 -- 172.21.15.88:0/369553213 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f8c6c00c310 con 0x7f8c6c0051c0 2024-04-26T23:40:29.354 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:29.348+0000 7f8c827fc640 1 --2- 172.21.15.88:0/369553213 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8c6c004800 0x7f8c6c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:29.354 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:29.348+0000 7f8c82ffd640 1 --2- 172.21.15.88:0/369553213 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8c6c0039b0 0x7f8c6c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:29.354 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:29.348+0000 7f8c837fe640 1 --2- 172.21.15.88:0/369553213 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8c6c0051c0 0x7f8c6c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:29.354 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:29.348+0000 7f8c827fc640 1 -- 172.21.15.88:0/369553213 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8c6c0051c0 msgr2=0x7f8c6c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:40:29.354 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:29.348+0000 7f8c827fc640 1 --2- 172.21.15.88:0/369553213 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8c6c0051c0 0x7f8c6c00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:29.354 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:29.348+0000 7f8c827fc640 1 -- 172.21.15.88:0/369553213 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8c6c0039b0 msgr2=0x7f8c6c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:40:29.354 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:29.348+0000 7f8c827fc640 1 --2- 172.21.15.88:0/369553213 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8c6c0039b0 0x7f8c6c003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:29.354 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:29.348+0000 7f8c837fe640 1 -- 172.21.15.88:0/369553213 reap_dead start 2024-04-26T23:40:29.354 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:29.348+0000 7f8c827fc640 1 -- 172.21.15.88:0/369553213 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c6c003520 con 0x7f8c6c004800 2024-04-26T23:40:29.354 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:29.349+0000 7f8c827fc640 1 --2- 172.21.15.88:0/369553213 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8c6c004800 0x7f8c6c004c80 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f8c78001720 tx=0x7f8c6c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=427a157a3048ee0d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:29.354 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:29.349+0000 7f8c81ffb640 1 -- 172.21.15.88:0/369553213 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c78001370 con 0x7f8c6c004800 2024-04-26T23:40:29.354 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:29.349+0000 7f8c81ffb640 1 -- 172.21.15.88:0/369553213 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c780052d0 con 0x7f8c6c004800 2024-04-26T23:40:29.354 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:29.349+0000 7f8c81ffb640 1 -- 172.21.15.88:0/369553213 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c7802ab90 con 0x7f8c6c004800 2024-04-26T23:40:29.355 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:29.349+0000 7f8c894c8640 1 -- 172.21.15.88:0/369553213 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8c6c004800 msgr2=0x7f8c6c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:29.355 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:29.349+0000 7f8c894c8640 1 --2- 172.21.15.88:0/369553213 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8c6c004800 0x7f8c6c004c80 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f8c78001720 tx=0x7f8c6c005830 comp rx=0 tx=0).stop 2024-04-26T23:40:29.355 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:29.349+0000 7f8c894c8640 1 -- 172.21.15.88:0/369553213 shutdown_connections 2024-04-26T23:40:29.355 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:29.349+0000 7f8c894c8640 1 --2- 172.21.15.88:0/369553213 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8c6c004800 0x7f8c6c004c80 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:29.355 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:29.349+0000 7f8c894c8640 1 -- 172.21.15.88:0/369553213 >> 172.21.15.88:0/369553213 conn(0x7f8c840ae010 msgr2=0x7f8c840ae3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:40:29.355 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:29.349+0000 7f8c894c8640 1 -- 172.21.15.88:0/369553213 shutdown_connections 2024-04-26T23:40:29.355 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:29.349+0000 7f8c894c8640 1 -- 172.21.15.88:0/369553213 wait complete. 2024-04-26T23:40:29.357 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:29.350+0000 7f8c894c8640 1 Processor -- start 2024-04-26T23:40:29.357 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:29.351+0000 7f8c894c8640 1 -- start start 2024-04-26T23:40:29.358 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:29.351+0000 7f8c894c8640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8c6c004800 0x7f8c84151920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:29.358 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:29.351+0000 7f8c894c8640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8c841f0090 0x7f8c840c6000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:29.358 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:29.351+0000 7f8c894c8640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8c8414b750 0x7f8c84149210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:29.358 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:29.351+0000 7f8c894c8640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f8c8415a5b0 con 0x7f8c6c004800 2024-04-26T23:40:29.358 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:29.351+0000 7f8c894c8640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f8c8415aed0 con 0x7f8c8414b750 2024-04-26T23:40:29.358 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:29.351+0000 7f8c894c8640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f8c84156bb0 con 0x7f8c841f0090 2024-04-26T23:40:29.358 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:29.351+0000 7f8c82ffd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8c6c004800 0x7f8c84151920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:29.358 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:29.351+0000 7f8c82ffd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8c6c004800 0x7f8c84151920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:57222/0 (socket says 172.21.15.88:57222) 2024-04-26T23:40:29.358 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:29.351+0000 7f8c82ffd640 1 -- 172.21.15.88:0/2240776383 learned_addr learned my addr 172.21.15.88:0/2240776383 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:40:29.358 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:29.351+0000 7f8c837fe640 1 --2- 172.21.15.88:0/2240776383 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8c8414b750 0x7f8c84149210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:29.358 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:29.351+0000 7f8c827fc640 1 --2- 172.21.15.88:0/2240776383 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8c841f0090 0x7f8c840c6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:29.358 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:29.351+0000 7f8c82ffd640 1 -- 172.21.15.88:0/2240776383 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8c841f0090 msgr2=0x7f8c840c6000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:29.358 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:29.351+0000 7f8c82ffd640 1 --2- 172.21.15.88:0/2240776383 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8c841f0090 0x7f8c840c6000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:29.358 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:29.351+0000 7f8c82ffd640 1 -- 172.21.15.88:0/2240776383 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8c8414b750 msgr2=0x7f8c84149210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:29.358 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:29.351+0000 7f8c82ffd640 1 --2- 172.21.15.88:0/2240776383 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8c8414b750 0x7f8c84149210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:29.358 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:29.351+0000 7f8c82ffd640 1 -- 172.21.15.88:0/2240776383 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c84153cb0 con 0x7f8c6c004800 2024-04-26T23:40:29.359 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:29.351+0000 7f8c837fe640 1 --2- 172.21.15.88:0/2240776383 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8c8414b750 0x7f8c84149210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:40:29.359 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:29.352+0000 7f8c82ffd640 1 --2- 172.21.15.88:0/2240776383 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8c6c004800 0x7f8c84151920 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f8c7400b820 tx=0x7f8c7400bce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:29.359 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:29.352+0000 7f8c6b7fe640 1 -- 172.21.15.88:0/2240776383 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c74018070 con 0x7f8c6c004800 2024-04-26T23:40:29.359 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:29.352+0000 7f8c6b7fe640 1 -- 172.21.15.88:0/2240776383 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c7400be10 con 0x7f8c6c004800 2024-04-26T23:40:29.359 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:29.352+0000 7f8c894c8640 1 -- 172.21.15.88:0/2240776383 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c840cabc0 con 0x7f8c6c004800 2024-04-26T23:40:29.359 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:29.352+0000 7f8c6b7fe640 1 -- 172.21.15.88:0/2240776383 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c74010c80 con 0x7f8c6c004800 2024-04-26T23:40:29.359 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:29.352+0000 7f8c894c8640 1 -- 172.21.15.88:0/2240776383 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c84159f00 con 0x7f8c6c004800 2024-04-26T23:40:29.359 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:29.353+0000 7f8c894c8640 1 -- 172.21.15.88:0/2240776383 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c840bfcf0 con 0x7f8c6c004800 2024-04-26T23:40:29.359 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:29.353+0000 7f8c6b7fe640 1 -- 172.21.15.88:0/2240776383 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8c7401b070 con 0x7f8c6c004800 2024-04-26T23:40:29.359 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:29.354+0000 7f8c6b7fe640 1 --2- 172.21.15.88:0/2240776383 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f8c7006c920 0x7f8c7006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:29.359 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:29.354+0000 7f8c827fc640 1 --2- 172.21.15.88:0/2240776383 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f8c7006c920 0x7f8c7006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:29.359 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:29.354+0000 7f8c6b7fe640 1 -- 172.21.15.88:0/2240776383 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f8c7408bad0 con 0x7f8c6c004800 2024-04-26T23:40:29.359 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:29.354+0000 7f8c827fc640 1 --2- 172.21.15.88:0/2240776383 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f8c7006c920 0x7f8c7006ede0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f8c78032000 tx=0x7f8c7802e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:29.361 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:29.358+0000 7f8c6b7fe640 1 -- 172.21.15.88:0/2240776383 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f8c840bfcf0 con 0x7f8c6c004800 2024-04-26T23:40:29.538 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:29.535+0000 7f8c894c8640 1 -- 172.21.15.88:0/2240776383 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f8c84159a10 con 0x7f8c6c004800 2024-04-26T23:40:29.538 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:29.535+0000 7f8c6b7fe640 1 -- 172.21.15.88:0/2240776383 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v16) ==== 84+0+65 (secure 0 0 0) 0x7f8c7405a2e0 con 0x7f8c6c004800 2024-04-26T23:40:29.538 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-26T23:40:29.539 INFO:teuthology.orchestra.run.smithi088.stdout:[ 2024-04-26T23:40:29.539 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:40:29.539 INFO:teuthology.orchestra.run.smithi088.stdout: "poolnum": 1, 2024-04-26T23:40:29.539 INFO:teuthology.orchestra.run.smithi088.stdout: "poolname": ".mgr" 2024-04-26T23:40:29.539 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:40:29.539 INFO:teuthology.orchestra.run.smithi088.stdout:] 2024-04-26T23:40:29.540 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:29.537+0000 7f8c894c8640 1 -- 172.21.15.88:0/2240776383 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f8c7006c920 msgr2=0x7f8c7006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:29.540 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:29.537+0000 7f8c894c8640 1 --2- 172.21.15.88:0/2240776383 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f8c7006c920 0x7f8c7006ede0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f8c78032000 tx=0x7f8c7802e000 comp rx=0 tx=0).stop 2024-04-26T23:40:29.540 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:29.537+0000 7f8c894c8640 1 -- 172.21.15.88:0/2240776383 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8c6c004800 msgr2=0x7f8c84151920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:29.540 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:29.537+0000 7f8c894c8640 1 --2- 172.21.15.88:0/2240776383 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8c6c004800 0x7f8c84151920 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f8c7400b820 tx=0x7f8c7400bce0 comp rx=0 tx=0).stop 2024-04-26T23:40:29.541 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:29.537+0000 7f8c894c8640 1 -- 172.21.15.88:0/2240776383 shutdown_connections 2024-04-26T23:40:29.541 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:29.537+0000 7f8c894c8640 1 --2- 172.21.15.88:0/2240776383 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f8c7006c920 0x7f8c7006ede0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:29.541 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:29.537+0000 7f8c894c8640 1 --2- 172.21.15.88:0/2240776383 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8c841f0090 0x7f8c840c6000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:29.541 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:29.537+0000 7f8c894c8640 1 --2- 172.21.15.88:0/2240776383 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8c8414b750 0x7f8c84149210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:29.541 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:29.537+0000 7f8c894c8640 1 --2- 172.21.15.88:0/2240776383 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8c6c004800 0x7f8c84151920 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:29.541 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:29.537+0000 7f8c894c8640 1 -- 172.21.15.88:0/2240776383 >> 172.21.15.88:0/2240776383 conn(0x7f8c840ae010 msgr2=0x7f8c840c6d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:40:29.541 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:29.537+0000 7f8c894c8640 1 -- 172.21.15.88:0/2240776383 shutdown_connections 2024-04-26T23:40:29.541 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:29.537+0000 7f8c894c8640 1 -- 172.21.15.88:0/2240776383 wait complete. 2024-04-26T23:40:29.551 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'a' 2024-04-26T23:40:29.551 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create a_metadata --pg_num_min 64 2024-04-26T23:40:29.651 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:29.648+0000 7f1c2a7af640 1 Processor -- start 2024-04-26T23:40:29.651 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:29.648+0000 7f1c2a7af640 1 -- start start 2024-04-26T23:40:29.653 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:29.649+0000 7f1c2a7af640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1c24070490 0x7f1c2406c530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:29.653 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:29.649+0000 7f1c2a7af640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f1c240c3f90 0x7f1c24075ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:29.653 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:29.649+0000 7f1c2a7af640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1c2406d920 con 0x7f1c240756f0 2024-04-26T23:40:29.653 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:29.649+0000 7f1c2a7af640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f1c2415ace0 con 0x7f1c240c3f90 2024-04-26T23:40:29.653 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:29.649+0000 7f1c2a7af640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f1c2415b260 con 0x7f1c24070490 2024-04-26T23:40:29.653 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:29.649+0000 7f1c28d4c640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f1c240c3f90 0x7f1c24075ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:29.653 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:29.649+0000 7f1c28d4c640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f1c240c3f90 0x7f1c24075ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:57224/0 (socket says 172.21.15.88:57224) 2024-04-26T23:40:29.654 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:29.649+0000 7f1c28d4c640 1 -- 172.21.15.88:0/38801381 learned_addr learned my addr 172.21.15.88:0/38801381 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:40:29.654 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:29.649+0000 7f1c237fe640 1 --2- 172.21.15.88:0/38801381 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1c24070490 0x7f1c2406c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:29.654 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:29.649+0000 7f1c28d4c640 1 -- 172.21.15.88:0/38801381 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1c24070490 msgr2=0x7f1c2406c530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:40:29.654 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:29.649+0000 7f1c28d4c640 1 --2- 172.21.15.88:0/38801381 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1c24070490 0x7f1c2406c530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:29.654 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:29.649+0000 7f1c28d4c640 1 -- 172.21.15.88:0/38801381 >> v1:172.21.15.175:6789/0 conn(0x7f1c240756f0 legacy=0x7f1c24156d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:40:29.654 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:29.649+0000 7f1c28d4c640 1 -- 172.21.15.88:0/38801381 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c2406db90 con 0x7f1c240c3f90 2024-04-26T23:40:29.654 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:29.650+0000 7f1c28d4c640 1 --2- 172.21.15.88:0/38801381 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1c240c3f90 0x7f1c24075ad0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f1c1c009e50 tx=0x7f1c1c02a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aadbcaf15c64fac2 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:29.654 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:29.650+0000 7f1c22ffd640 1 -- 172.21.15.88:0/38801381 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c1c036070 con 0x7f1c240c3f90 2024-04-26T23:40:29.654 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:29.650+0000 7f1c22ffd640 1 -- 172.21.15.88:0/38801381 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c1c031600 con 0x7f1c240c3f90 2024-04-26T23:40:29.654 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:29.650+0000 7f1c22ffd640 1 -- 172.21.15.88:0/38801381 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c1c0319d0 con 0x7f1c240c3f90 2024-04-26T23:40:29.657 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:29.651+0000 7f1c2a7af640 1 -- 172.21.15.88:0/38801381 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1c240c3f90 msgr2=0x7f1c24075ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:29.657 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:29.651+0000 7f1c2a7af640 1 --2- 172.21.15.88:0/38801381 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1c240c3f90 0x7f1c24075ad0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f1c1c009e50 tx=0x7f1c1c02a6c0 comp rx=0 tx=0).stop 2024-04-26T23:40:29.657 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:29.651+0000 7f1c2a7af640 1 -- 172.21.15.88:0/38801381 shutdown_connections 2024-04-26T23:40:29.657 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:29.651+0000 7f1c2a7af640 1 --2- 172.21.15.88:0/38801381 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1c240c3f90 0x7f1c24075ad0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:29.657 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:29.651+0000 7f1c2a7af640 1 --2- 172.21.15.88:0/38801381 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1c24070490 0x7f1c2406c530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:29.657 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:29.651+0000 7f1c2a7af640 1 -- 172.21.15.88:0/38801381 >> 172.21.15.88:0/38801381 conn(0x7f1c240c5ce0 msgr2=0x7f1c240c60f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:40:29.657 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:29.651+0000 7f1c2a7af640 1 -- 172.21.15.88:0/38801381 shutdown_connections 2024-04-26T23:40:29.658 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:29.651+0000 7f1c2a7af640 1 -- 172.21.15.88:0/38801381 wait complete. 2024-04-26T23:40:29.658 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:29.652+0000 7f1c2a7af640 1 Processor -- start 2024-04-26T23:40:29.658 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:29.652+0000 7f1c2a7af640 1 -- start start 2024-04-26T23:40:29.658 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:29.653+0000 7f1c2a7af640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1c24070490 0x7f1c24073f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:29.658 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:29.653+0000 7f1c2a7af640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1c240756f0 0x7f1c240c7210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:29.658 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:29.653+0000 7f1c2a7af640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1c240c3f90 0x7f1c240c7750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:29.658 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:29.653+0000 7f1c2a7af640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f1c24154640 con 0x7f1c24070490 2024-04-26T23:40:29.658 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:29.653+0000 7f1c2a7af640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f1c240c4680 con 0x7f1c240756f0 2024-04-26T23:40:29.658 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:29.653+0000 7f1c2a7af640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f1c241547c0 con 0x7f1c240c3f90 2024-04-26T23:40:29.658 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:29.653+0000 7f1c23fff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1c24070490 0x7f1c24073f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:29.658 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:29.653+0000 7f1c23fff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1c24070490 0x7f1c24073f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:57240/0 (socket says 172.21.15.88:57240) 2024-04-26T23:40:29.658 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:29.653+0000 7f1c23fff640 1 -- 172.21.15.88:0/1032739066 learned_addr learned my addr 172.21.15.88:0/1032739066 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:40:29.658 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:29.653+0000 7f1c28d4c640 1 --2- 172.21.15.88:0/1032739066 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1c240c3f90 0x7f1c240c7750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:29.658 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:29.653+0000 7f1c237fe640 1 --2- 172.21.15.88:0/1032739066 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1c240756f0 0x7f1c240c7210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:29.659 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:29.653+0000 7f1c23fff640 1 -- 172.21.15.88:0/1032739066 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1c240c3f90 msgr2=0x7f1c240c7750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:29.659 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:29.653+0000 7f1c23fff640 1 --2- 172.21.15.88:0/1032739066 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1c240c3f90 0x7f1c240c7750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:29.659 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:29.653+0000 7f1c23fff640 1 -- 172.21.15.88:0/1032739066 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1c240756f0 msgr2=0x7f1c240c7210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:29.659 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:29.653+0000 7f1c23fff640 1 --2- 172.21.15.88:0/1032739066 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1c240756f0 0x7f1c240c7210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:29.659 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:29.653+0000 7f1c23fff640 1 -- 172.21.15.88:0/1032739066 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c24073300 con 0x7f1c24070490 2024-04-26T23:40:29.659 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:29.653+0000 7f1c237fe640 1 --2- 172.21.15.88:0/1032739066 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1c240756f0 0x7f1c240c7210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:40:29.659 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:29.653+0000 7f1c23fff640 1 --2- 172.21.15.88:0/1032739066 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1c24070490 0x7f1c24073f40 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f1c1400c460 tx=0x7f1c1400c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:29.659 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:29.653+0000 7f1c20ff9640 1 -- 172.21.15.88:0/1032739066 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c14016020 con 0x7f1c24070490 2024-04-26T23:40:29.659 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:29.653+0000 7f1c20ff9640 1 -- 172.21.15.88:0/1032739066 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c14012870 con 0x7f1c24070490 2024-04-26T23:40:29.659 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:29.653+0000 7f1c20ff9640 1 -- 172.21.15.88:0/1032739066 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c14012c60 con 0x7f1c24070490 2024-04-26T23:40:29.659 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:29.653+0000 7f1c2a7af640 1 -- 172.21.15.88:0/1032739066 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c240c8b70 con 0x7f1c24070490 2024-04-26T23:40:29.659 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:29.653+0000 7f1c2a7af640 1 -- 172.21.15.88:0/1032739066 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c24074480 con 0x7f1c24070490 2024-04-26T23:40:29.659 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:29.654+0000 7f1c2a7af640 1 -- 172.21.15.88:0/1032739066 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c240694b0 con 0x7f1c24070490 2024-04-26T23:40:29.660 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:29.655+0000 7f1c20ff9640 1 -- 172.21.15.88:0/1032739066 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f1c14019020 con 0x7f1c24070490 2024-04-26T23:40:29.660 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:29.655+0000 7f1c20ff9640 1 --2- 172.21.15.88:0/1032739066 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f1c1006c920 0x7f1c1006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:29.660 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:29.655+0000 7f1c237fe640 1 --2- 172.21.15.88:0/1032739066 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f1c1006c920 0x7f1c1006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:29.660 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:29.656+0000 7f1c20ff9640 1 -- 172.21.15.88:0/1032739066 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f1c1408b1f0 con 0x7f1c24070490 2024-04-26T23:40:29.660 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:29.656+0000 7f1c237fe640 1 --2- 172.21.15.88:0/1032739066 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f1c1006c920 0x7f1c1006ede0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f1c24074e10 tx=0x7f1c18008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:29.662 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:29.660+0000 7f1c20ff9640 1 -- 172.21.15.88:0/1032739066 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f1c14020070 con 0x7f1c24070490 2024-04-26T23:40:29.836 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:29.834+0000 7f1c2a7af640 1 -- 172.21.15.88:0/1032739066 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "a_metadata", "pg_num_min": 64} v 0) -- 0x7f1c240c8ee0 con 0x7f1c24070490 2024-04-26T23:40:30.555 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:30.552+0000 7f1c20ff9640 1 -- 172.21.15.88:0/1032739066 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "a_metadata", "pg_num_min": 64}]=0 pool 'a_metadata' created v17) ==== 128+0+0 (secure 0 0 0) 0x7f1c14059a00 con 0x7f1c24070490 2024-04-26T23:40:30.555 INFO:teuthology.orchestra.run.smithi088.stderr:pool 'a_metadata' created 2024-04-26T23:40:30.558 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:30.555+0000 7f1c2a7af640 1 -- 172.21.15.88:0/1032739066 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f1c1006c920 msgr2=0x7f1c1006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:30.559 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:30.555+0000 7f1c2a7af640 1 --2- 172.21.15.88:0/1032739066 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f1c1006c920 0x7f1c1006ede0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f1c24074e10 tx=0x7f1c18008040 comp rx=0 tx=0).stop 2024-04-26T23:40:30.559 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:30.555+0000 7f1c2a7af640 1 -- 172.21.15.88:0/1032739066 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1c24070490 msgr2=0x7f1c24073f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:30.559 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:30.555+0000 7f1c2a7af640 1 --2- 172.21.15.88:0/1032739066 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1c24070490 0x7f1c24073f40 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f1c1400c460 tx=0x7f1c1400c920 comp rx=0 tx=0).stop 2024-04-26T23:40:30.559 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:30.555+0000 7f1c2a7af640 1 -- 172.21.15.88:0/1032739066 shutdown_connections 2024-04-26T23:40:30.559 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:30.555+0000 7f1c2a7af640 1 --2- 172.21.15.88:0/1032739066 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f1c1006c920 0x7f1c1006ede0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:30.559 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:30.555+0000 7f1c2a7af640 1 --2- 172.21.15.88:0/1032739066 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1c240c3f90 0x7f1c240c7750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:30.559 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:30.555+0000 7f1c2a7af640 1 --2- 172.21.15.88:0/1032739066 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1c240756f0 0x7f1c240c7210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:30.559 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:30.555+0000 7f1c2a7af640 1 --2- 172.21.15.88:0/1032739066 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1c24070490 0x7f1c24073f40 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:30.559 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:30.555+0000 7f1c2a7af640 1 -- 172.21.15.88:0/1032739066 >> 172.21.15.88:0/1032739066 conn(0x7f1c240c5ce0 msgr2=0x7f1c2406c530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:40:30.559 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:30.556+0000 7f1c2a7af640 1 -- 172.21.15.88:0/1032739066 shutdown_connections 2024-04-26T23:40:30.559 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:30.556+0000 7f1c2a7af640 1 -- 172.21.15.88:0/1032739066 wait complete. 2024-04-26T23:40:30.573 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create a_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-04-26T23:40:30.678 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:30.675+0000 7f238c14e640 1 Processor -- start 2024-04-26T23:40:30.678 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:30.676+0000 7f238c14e640 1 -- start start 2024-04-26T23:40:30.680 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:30.676+0000 7f238c14e640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f238414ecd0 0x7f23841555a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:30.680 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:30.676+0000 7f238c14e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f23840ac710 0x7f23840ab470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:30.680 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:30.676+0000 7f238c14e640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f238414f0b0 con 0x7f2384073690 2024-04-26T23:40:30.680 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:30.676+0000 7f238c14e640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f2384074c90 con 0x7f238414ecd0 2024-04-26T23:40:30.680 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:30.676+0000 7f238c14e640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f23840c6400 con 0x7f23840ac710 2024-04-26T23:40:30.680 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:30.677+0000 7f23896e9640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f23840ac710 0x7f23840ab470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:30.680 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:30.677+0000 7f2389eea640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f238414ecd0 0x7f23841555a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:30.680 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:30.677+0000 7f23896e9640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f23840ac710 0x7f23840ab470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.88:53388/0 (socket says 172.21.15.88:53388) 2024-04-26T23:40:30.680 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:30.677+0000 7f2389eea640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f238414ecd0 0x7f23841555a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.88:59114/0 (socket says 172.21.15.88:59114) 2024-04-26T23:40:30.680 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:30.677+0000 7f238a6eb640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f2384073690 0x7f2384157fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.88:58956/0 (socket says 172.21.15.88:58956) 2024-04-26T23:40:30.681 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:30.677+0000 7f23896e9640 1 -- 172.21.15.88:0/1538297934 learned_addr learned my addr 172.21.15.88:0/1538297934 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:40:30.681 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:30.677+0000 7f23896e9640 1 -- 172.21.15.88:0/1538297934 >> v2:172.21.15.175:3300/0 conn(0x7f238414ecd0 msgr2=0x7f23841555a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:40:30.681 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:30.677+0000 7f23896e9640 1 --2- 172.21.15.88:0/1538297934 >> v2:172.21.15.175:3300/0 conn(0x7f238414ecd0 0x7f23841555a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:30.681 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:30.677+0000 7f23896e9640 1 -- 172.21.15.88:0/1538297934 >> v1:172.21.15.175:6789/0 conn(0x7f2384073690 legacy=0x7f2384157fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:30.681 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:30.677+0000 7f23896e9640 1 -- 172.21.15.88:0/1538297934 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23840c66e0 con 0x7f23840ac710 2024-04-26T23:40:30.681 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:30.677+0000 7f2389eea640 1 --2- 172.21.15.88:0/1538297934 >> v2:172.21.15.175:3300/0 conn(0x7f238414ecd0 0x7f23841555a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:40:30.682 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:30.678+0000 7f23896e9640 1 --2- 172.21.15.88:0/1538297934 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f23840ac710 0x7f23840ab470 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f2374009870 tx=0x7f237402a130 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6816f912d81a29dc server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:30.682 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:30.678+0000 7f2388ee8640 1 -- 172.21.15.88:0/1538297934 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2374037070 con 0x7f23840ac710 2024-04-26T23:40:30.682 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:30.678+0000 7f2388ee8640 1 -- 172.21.15.88:0/1538297934 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2374032440 con 0x7f23840ac710 2024-04-26T23:40:30.682 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:30.678+0000 7f2388ee8640 1 -- 172.21.15.88:0/1538297934 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2374032810 con 0x7f23840ac710 2024-04-26T23:40:30.682 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:30.678+0000 7f238c14e640 1 -- 172.21.15.88:0/1538297934 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f23840ac710 msgr2=0x7f23840ab470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:30.682 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:30.678+0000 7f238c14e640 1 --2- 172.21.15.88:0/1538297934 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f23840ac710 0x7f23840ab470 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f2374009870 tx=0x7f237402a130 comp rx=0 tx=0).stop 2024-04-26T23:40:30.683 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:30.679+0000 7f238c14e640 1 -- 172.21.15.88:0/1538297934 shutdown_connections 2024-04-26T23:40:30.683 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:30.679+0000 7f238c14e640 1 --2- 172.21.15.88:0/1538297934 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f23840ac710 0x7f23840ab470 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:30.683 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:30.679+0000 7f238c14e640 1 --2- 172.21.15.88:0/1538297934 >> v2:172.21.15.175:3300/0 conn(0x7f238414ecd0 0x7f23841555a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:30.683 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:30.679+0000 7f238c14e640 1 -- 172.21.15.88:0/1538297934 >> 172.21.15.88:0/1538297934 conn(0x7f23840c6d80 msgr2=0x7f23840c7160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:40:30.683 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:30.679+0000 7f238c14e640 1 -- 172.21.15.88:0/1538297934 shutdown_connections 2024-04-26T23:40:30.683 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:30.679+0000 7f238c14e640 1 -- 172.21.15.88:0/1538297934 wait complete. 2024-04-26T23:40:30.686 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:30.680+0000 7f238c14e640 1 Processor -- start 2024-04-26T23:40:30.686 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:30.680+0000 7f238c14e640 1 -- start start 2024-04-26T23:40:30.686 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:30.680+0000 7f238c14e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2384073690 0x7f2384157ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:30.686 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:30.680+0000 7f238c14e640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f23840ac710 0x7f23840c8280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:30.686 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:30.680+0000 7f238c14e640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f238414ecd0 0x7f23840ad4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:30.686 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:30.680+0000 7f238c14e640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f2384155080 con 0x7f23840ac710 2024-04-26T23:40:30.686 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:30.680+0000 7f238c14e640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f2384154da0 con 0x7f238414ecd0 2024-04-26T23:40:30.686 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:30.680+0000 7f238c14e640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f23840c69c0 con 0x7f2384073690 2024-04-26T23:40:30.686 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:30.680+0000 7f23896e9640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f23840ac710 0x7f23840c8280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:30.686 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:30.680+0000 7f23896e9640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f23840ac710 0x7f23840c8280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:57248/0 (socket says 172.21.15.88:57248) 2024-04-26T23:40:30.686 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:30.680+0000 7f238a6eb640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f238414ecd0 0x7f23840ad4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:30.687 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:30.680+0000 7f2389eea640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2384073690 0x7f2384157ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:30.687 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:30.680+0000 7f23896e9640 1 -- 172.21.15.88:0/2480957998 learned_addr learned my addr 172.21.15.88:0/2480957998 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:40:30.687 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:30.681+0000 7f23896e9640 1 -- 172.21.15.88:0/2480957998 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2384073690 msgr2=0x7f2384157ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:30.687 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:30.681+0000 7f23896e9640 1 --2- 172.21.15.88:0/2480957998 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2384073690 0x7f2384157ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:30.687 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:30.681+0000 7f23896e9640 1 -- 172.21.15.88:0/2480957998 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f238414ecd0 msgr2=0x7f23840ad4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:30.687 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:30.681+0000 7f23896e9640 1 --2- 172.21.15.88:0/2480957998 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f238414ecd0 0x7f23840ad4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:30.687 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:30.681+0000 7f23896e9640 1 -- 172.21.15.88:0/2480957998 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f238414c3f0 con 0x7f23840ac710 2024-04-26T23:40:30.687 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:30.681+0000 7f238a6eb640 1 --2- 172.21.15.88:0/2480957998 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f238414ecd0 0x7f23840ad4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:40:30.687 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:30.681+0000 7f23896e9640 1 --2- 172.21.15.88:0/2480957998 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f23840ac710 0x7f23840c8280 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f2374000c00 tx=0x7f23740046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:30.687 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:30.681+0000 7f237a7fc640 1 -- 172.21.15.88:0/2480957998 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2374037040 con 0x7f23840ac710 2024-04-26T23:40:30.687 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:30.681+0000 7f237a7fc640 1 -- 172.21.15.88:0/2480957998 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2374042070 con 0x7f23840ac710 2024-04-26T23:40:30.687 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:30.681+0000 7f238c14e640 1 -- 172.21.15.88:0/2480957998 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f238414ab30 con 0x7f23840ac710 2024-04-26T23:40:30.688 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:30.681+0000 7f237a7fc640 1 -- 172.21.15.88:0/2480957998 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2374030860 con 0x7f23840ac710 2024-04-26T23:40:30.688 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:30.681+0000 7f238c14e640 1 -- 172.21.15.88:0/2480957998 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23841531e0 con 0x7f23840ac710 2024-04-26T23:40:30.688 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:30.682+0000 7f238c14e640 1 -- 172.21.15.88:0/2480957998 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f238414ad00 con 0x7f23840ac710 2024-04-26T23:40:30.688 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:30.683+0000 7f237a7fc640 1 -- 172.21.15.88:0/2480957998 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2374030a00 con 0x7f23840ac710 2024-04-26T23:40:30.688 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:30.683+0000 7f237a7fc640 1 --2- 172.21.15.88:0/2480957998 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f236806c8f0 0x7f236806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:30.688 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:30.683+0000 7f237a7fc640 1 -- 172.21.15.88:0/2480957998 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 5222+0+0 (secure 0 0 0) 0x7f23740ac020 con 0x7f23840ac710 2024-04-26T23:40:30.688 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:30.683+0000 7f2389eea640 1 --2- 172.21.15.88:0/2480957998 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f236806c8f0 0x7f236806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:30.688 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:30.684+0000 7f2389eea640 1 --2- 172.21.15.88:0/2480957998 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f236806c8f0 0x7f236806edb0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f2380009560 tx=0x7f2380009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:30.690 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:30.688+0000 7f237a7fc640 1 -- 172.21.15.88:0/2480957998 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f237407a070 con 0x7f23840ac710 2024-04-26T23:40:30.868 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:30.865+0000 7f238c14e640 1 -- 172.21.15.88:0/2480957998 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "a_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f23840507a0 con 0x7f23840ac710 2024-04-26T23:40:31.557 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:31.554+0000 7f237a7fc640 1 -- 172.21.15.88:0/2480957998 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "a_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'a_data' created v18) ==== 160+0+0 (secure 0 0 0) 0x7f237407e370 con 0x7f23840ac710 2024-04-26T23:40:31.557 INFO:teuthology.orchestra.run.smithi088.stderr:pool 'a_data' created 2024-04-26T23:40:31.560 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:31.557+0000 7f238c14e640 1 -- 172.21.15.88:0/2480957998 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f236806c8f0 msgr2=0x7f236806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:31.560 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:31.557+0000 7f238c14e640 1 --2- 172.21.15.88:0/2480957998 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f236806c8f0 0x7f236806edb0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f2380009560 tx=0x7f2380009190 comp rx=0 tx=0).stop 2024-04-26T23:40:31.560 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:31.557+0000 7f238c14e640 1 -- 172.21.15.88:0/2480957998 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f23840ac710 msgr2=0x7f23840c8280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:31.560 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:31.557+0000 7f238c14e640 1 --2- 172.21.15.88:0/2480957998 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f23840ac710 0x7f23840c8280 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f2374000c00 tx=0x7f23740046c0 comp rx=0 tx=0).stop 2024-04-26T23:40:31.560 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:31.557+0000 7f238c14e640 1 -- 172.21.15.88:0/2480957998 shutdown_connections 2024-04-26T23:40:31.560 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:31.557+0000 7f238c14e640 1 --2- 172.21.15.88:0/2480957998 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f236806c8f0 0x7f236806edb0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:31.560 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:31.557+0000 7f238c14e640 1 --2- 172.21.15.88:0/2480957998 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f238414ecd0 0x7f23840ad4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:31.560 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:31.557+0000 7f238c14e640 1 --2- 172.21.15.88:0/2480957998 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f23840ac710 0x7f23840c8280 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:31.561 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:31.557+0000 7f238c14e640 1 --2- 172.21.15.88:0/2480957998 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2384073690 0x7f2384157ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:31.561 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:31.557+0000 7f238c14e640 1 -- 172.21.15.88:0/2480957998 >> 172.21.15.88:0/2480957998 conn(0x7f23840c6d80 msgr2=0x7f23840740a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:40:31.561 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:31.557+0000 7f238c14e640 1 -- 172.21.15.88:0/2480957998 shutdown_connections 2024-04-26T23:40:31.561 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:31.557+0000 7f238c14e640 1 -- 172.21.15.88:0/2480957998 wait complete. 2024-04-26T23:40:31.581 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new a a_metadata a_data 2024-04-26T23:40:31.683 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:31.680+0000 7f39f8e45640 1 Processor -- start 2024-04-26T23:40:31.683 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:31.680+0000 7f39f8e45640 1 -- start start 2024-04-26T23:40:31.685 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:31.681+0000 7f39f8e45640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f39f40c6e20 0x7f39f40c7200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:31.685 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:31.681+0000 7f39f8e45640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f39f40740e0 0x7f39f4156f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:31.685 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:31.681+0000 7f39f8e45640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f39f40ca3a0 0x7f39f4157460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:31.686 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:31.681+0000 7f39f8e45640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f39f4072930 con 0x7f39f40c6e20 2024-04-26T23:40:31.686 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:31.681+0000 7f39f8e45640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f39f415a530 con 0x7f39f40ca3a0 2024-04-26T23:40:31.686 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:31.681+0000 7f39f8e45640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f39f415a810 con 0x7f39f40740e0 2024-04-26T23:40:31.686 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:31.681+0000 7f39f259c640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f39f40c6e20 0x7f39f40c7200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:31.686 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:31.681+0000 7f39f259c640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f39f40c6e20 0x7f39f40c7200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:57250/0 (socket says 172.21.15.88:57250) 2024-04-26T23:40:31.686 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:31.681+0000 7f39f259c640 1 -- 172.21.15.88:0/4140067046 learned_addr learned my addr 172.21.15.88:0/4140067046 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:40:31.686 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:31.681+0000 7f39ebfff640 1 --2- 172.21.15.88:0/4140067046 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f39f40740e0 0x7f39f4156f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:31.686 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:31.681+0000 7f39f2d9d640 1 --2- 172.21.15.88:0/4140067046 >> v2:172.21.15.175:3300/0 conn(0x7f39f40ca3a0 0x7f39f4157460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:31.686 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:31.681+0000 7f39f259c640 1 -- 172.21.15.88:0/4140067046 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f39f40740e0 msgr2=0x7f39f4156f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:40:31.686 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:31.681+0000 7f39f259c640 1 --2- 172.21.15.88:0/4140067046 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f39f40740e0 0x7f39f4156f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:31.686 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:31.681+0000 7f39f259c640 1 -- 172.21.15.88:0/4140067046 >> v2:172.21.15.175:3300/0 conn(0x7f39f40ca3a0 msgr2=0x7f39f4157460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:40:31.686 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:31.681+0000 7f39f259c640 1 --2- 172.21.15.88:0/4140067046 >> v2:172.21.15.175:3300/0 conn(0x7f39f40ca3a0 0x7f39f4157460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:31.686 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:31.681+0000 7f39f259c640 1 -- 172.21.15.88:0/4140067046 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39f415aaf0 con 0x7f39f40c6e20 2024-04-26T23:40:31.686 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:31.682+0000 7f39f259c640 1 --2- 172.21.15.88:0/4140067046 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f39f40c6e20 0x7f39f40c7200 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f39f4073b60 tx=0x7f39e402a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fe02edecece992 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:31.687 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:31.682+0000 7f39f1d9b640 1 -- 172.21.15.88:0/4140067046 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39e4037070 con 0x7f39f40c6e20 2024-04-26T23:40:31.687 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:31.682+0000 7f39f1d9b640 1 -- 172.21.15.88:0/4140067046 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39e4032440 con 0x7f39f40c6e20 2024-04-26T23:40:31.687 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:31.682+0000 7f39f1d9b640 1 -- 172.21.15.88:0/4140067046 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39e4032810 con 0x7f39f40c6e20 2024-04-26T23:40:31.687 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:31.682+0000 7f39f8e45640 1 -- 172.21.15.88:0/4140067046 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f39f40c6e20 msgr2=0x7f39f40c7200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:31.687 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:31.682+0000 7f39f8e45640 1 --2- 172.21.15.88:0/4140067046 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f39f40c6e20 0x7f39f40c7200 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f39f4073b60 tx=0x7f39e402a140 comp rx=0 tx=0).stop 2024-04-26T23:40:31.687 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:31.682+0000 7f39f8e45640 1 -- 172.21.15.88:0/4140067046 shutdown_connections 2024-04-26T23:40:31.687 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:31.682+0000 7f39f8e45640 1 --2- 172.21.15.88:0/4140067046 >> v2:172.21.15.175:3300/0 conn(0x7f39f40ca3a0 0x7f39f4157460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:31.687 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:31.682+0000 7f39f8e45640 1 --2- 172.21.15.88:0/4140067046 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f39f40740e0 0x7f39f4156f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:31.687 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:31.682+0000 7f39f8e45640 1 --2- 172.21.15.88:0/4140067046 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f39f40c6e20 0x7f39f40c7200 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:31.687 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:31.682+0000 7f39f8e45640 1 -- 172.21.15.88:0/4140067046 >> 172.21.15.88:0/4140067046 conn(0x7f39f40ae0b0 msgr2=0x7f39f40ae490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:40:31.687 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:31.682+0000 7f39f8e45640 1 -- 172.21.15.88:0/4140067046 shutdown_connections 2024-04-26T23:40:31.687 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:31.682+0000 7f39f8e45640 1 -- 172.21.15.88:0/4140067046 wait complete. 2024-04-26T23:40:31.690 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:31.684+0000 7f39f8e45640 1 Processor -- start 2024-04-26T23:40:31.690 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:31.684+0000 7f39f8e45640 1 -- start start 2024-04-26T23:40:31.690 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:31.684+0000 7f39f8e45640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f39f40740e0 0x7f39f40c9120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:31.690 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:31.684+0000 7f39f8e45640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f39f40c6e20 0x7f39f4157ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:31.690 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:31.684+0000 7f39f8e45640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f39f40ca3a0 0x7f39f4149af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:31.690 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:31.684+0000 7f39f8e45640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f39f41543c0 con 0x7f39f40740e0 2024-04-26T23:40:31.690 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:31.684+0000 7f39f8e45640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f39f41579a0 con 0x7f39f40ca3a0 2024-04-26T23:40:31.690 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:31.684+0000 7f39f8e45640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f39f4154540 con 0x7f39f40c6e20 2024-04-26T23:40:31.690 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:31.684+0000 7f39f259c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f39f40740e0 0x7f39f40c9120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:31.690 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:31.684+0000 7f39f259c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f39f40740e0 0x7f39f40c9120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:57264/0 (socket says 172.21.15.88:57264) 2024-04-26T23:40:31.691 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:31.684+0000 7f39f259c640 1 -- 172.21.15.88:0/289063296 learned_addr learned my addr 172.21.15.88:0/289063296 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:40:31.691 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:31.685+0000 7f39ebfff640 1 --2- 172.21.15.88:0/289063296 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f39f40c6e20 0x7f39f4157ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:31.691 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:31.685+0000 7f39f2d9d640 1 --2- 172.21.15.88:0/289063296 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f39f40ca3a0 0x7f39f4149af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:31.691 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:31.685+0000 7f39f259c640 1 -- 172.21.15.88:0/289063296 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f39f40c6e20 msgr2=0x7f39f4157ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:31.691 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:31.685+0000 7f39f259c640 1 --2- 172.21.15.88:0/289063296 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f39f40c6e20 0x7f39f4157ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:31.691 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:31.685+0000 7f39f259c640 1 -- 172.21.15.88:0/289063296 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f39f40ca3a0 msgr2=0x7f39f4149af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:31.691 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:31.685+0000 7f39f259c640 1 --2- 172.21.15.88:0/289063296 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f39f40ca3a0 0x7f39f4149af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:31.691 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:31.685+0000 7f39f259c640 1 -- 172.21.15.88:0/289063296 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39f4159fa0 con 0x7f39f40740e0 2024-04-26T23:40:31.691 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:31.685+0000 7f39ebfff640 1 --2- 172.21.15.88:0/289063296 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f39f40c6e20 0x7f39f4157ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:40:31.691 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:31.685+0000 7f39f2d9d640 1 --2- 172.21.15.88:0/289063296 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f39f40ca3a0 0x7f39f4149af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:40:31.691 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:31.685+0000 7f39f259c640 1 --2- 172.21.15.88:0/289063296 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f39f40740e0 0x7f39f40c9120 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f39e402a180 tx=0x7f39e40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:31.691 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:31.685+0000 7f39eaffd640 1 -- 172.21.15.88:0/289063296 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39e4041020 con 0x7f39f40740e0 2024-04-26T23:40:31.691 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:31.685+0000 7f39eaffd640 1 -- 172.21.15.88:0/289063296 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39e40306c0 con 0x7f39f40740e0 2024-04-26T23:40:31.691 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:31.685+0000 7f39eaffd640 1 -- 172.21.15.88:0/289063296 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39e4037040 con 0x7f39f40740e0 2024-04-26T23:40:31.691 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:31.685+0000 7f39f8e45640 1 -- 172.21.15.88:0/289063296 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39f41f0850 con 0x7f39f40740e0 2024-04-26T23:40:31.692 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:31.685+0000 7f39f8e45640 1 -- 172.21.15.88:0/289063296 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39f40c9660 con 0x7f39f40740e0 2024-04-26T23:40:31.692 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:31.686+0000 7f39f8e45640 1 -- 172.21.15.88:0/289063296 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39f40766c0 con 0x7f39f40740e0 2024-04-26T23:40:31.692 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:31.687+0000 7f39eaffd640 1 -- 172.21.15.88:0/289063296 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f39e4044020 con 0x7f39f40740e0 2024-04-26T23:40:31.692 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:31.687+0000 7f39eaffd640 1 --2- 172.21.15.88:0/289063296 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f39d406c8f0 0x7f39d406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:31.692 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:31.687+0000 7f39ebfff640 1 --2- 172.21.15.88:0/289063296 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f39d406c8f0 0x7f39d406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:31.692 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:31.687+0000 7f39eaffd640 1 -- 172.21.15.88:0/289063296 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 5599+0+0 (secure 0 0 0) 0x7f39e40ac360 con 0x7f39f40740e0 2024-04-26T23:40:31.692 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:31.688+0000 7f39ebfff640 1 --2- 172.21.15.88:0/289063296 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f39d406c8f0 0x7f39d406edb0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f39f4150d60 tx=0x7f39dc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:31.694 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:31.692+0000 7f39eaffd640 1 -- 172.21.15.88:0/289063296 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f39e404b030 con 0x7f39f40740e0 2024-04-26T23:40:31.911 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:31.908+0000 7f39f8e45640 1 -- 172.21.15.88:0/289063296 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "a", "metadata": "a_metadata", "data": "a_data"} v 0) -- 0x7f39f40507a0 con 0x7f39f40740e0 2024-04-26T23:40:32.507 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:40:32.510 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:40:32.577 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:32.575+0000 7f39eaffd640 1 -- 172.21.15.88:0/289063296 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "a", "metadata": "a_metadata", "data": "a_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) ==== 157+0+0 (secure 0 0 0) 0x7f39e407a800 con 0x7f39f40740e0 2024-04-26T23:40:32.579 INFO:teuthology.orchestra.run.smithi088.stderr:new fs with metadata pool 2 and data pool 3 2024-04-26T23:40:32.584 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:32.580+0000 7f39f8e45640 1 -- 172.21.15.88:0/289063296 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f39d406c8f0 msgr2=0x7f39d406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:32.584 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:32.580+0000 7f39f8e45640 1 --2- 172.21.15.88:0/289063296 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f39d406c8f0 0x7f39d406edb0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f39f4150d60 tx=0x7f39dc008040 comp rx=0 tx=0).stop 2024-04-26T23:40:32.584 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:32.581+0000 7f39f8e45640 1 -- 172.21.15.88:0/289063296 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f39f40740e0 msgr2=0x7f39f40c9120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:32.584 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:32.581+0000 7f39f8e45640 1 --2- 172.21.15.88:0/289063296 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f39f40740e0 0x7f39f40c9120 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f39e402a180 tx=0x7f39e40046c0 comp rx=0 tx=0).stop 2024-04-26T23:40:32.584 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:32.581+0000 7f39f8e45640 1 -- 172.21.15.88:0/289063296 shutdown_connections 2024-04-26T23:40:32.584 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:32.581+0000 7f39f8e45640 1 --2- 172.21.15.88:0/289063296 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f39d406c8f0 0x7f39d406edb0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:32.584 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:32.581+0000 7f39f8e45640 1 --2- 172.21.15.88:0/289063296 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f39f40c6e20 0x7f39f4157ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:32.584 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:32.581+0000 7f39f8e45640 1 --2- 172.21.15.88:0/289063296 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f39f40ca3a0 0x7f39f4149af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:32.584 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:32.581+0000 7f39f8e45640 1 --2- 172.21.15.88:0/289063296 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f39f40740e0 0x7f39f40c9120 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:32.584 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:32.581+0000 7f39f8e45640 1 -- 172.21.15.88:0/289063296 >> 172.21.15.88:0/289063296 conn(0x7f39f40ae0b0 msgr2=0x7f39f4151be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:40:32.585 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:32.582+0000 7f39f8e45640 1 -- 172.21.15.88:0/289063296 shutdown_connections 2024-04-26T23:40:32.585 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:32.582+0000 7f39f8e45640 1 -- 172.21.15.88:0/289063296 wait complete. 2024-04-26T23:40:32.605 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T23:40:32.702 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:32.700+0000 7f12d401d640 1 Processor -- start 2024-04-26T23:40:32.703 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:32.700+0000 7f12d401d640 1 -- start start 2024-04-26T23:40:32.706 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:32.700+0000 7f12d401d640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f12cc0aecf0 0x7f12cc0c3800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:32.706 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:32.701+0000 7f12d401d640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f12cc156f60 con 0x7f12cc0c4820 2024-04-26T23:40:32.706 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:32.701+0000 7f12d401d640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f12cc157240 con 0x7f12cc0c3d40 2024-04-26T23:40:32.706 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:32.701+0000 7f12d401d640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f12cc157520 con 0x7f12cc0aecf0 2024-04-26T23:40:32.706 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:32.701+0000 7f12d15b8640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f12cc0c4820 0x7f12cc073a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:39778/0 (socket says 172.21.15.88:39778) 2024-04-26T23:40:32.706 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:32.701+0000 7f12d15b8640 1 -- 172.21.15.88:0/2783744648 learned_addr learned my addr 172.21.15.88:0/2783744648 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-26T23:40:32.707 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:32.701+0000 7f12d0db7640 1 -- 172.21.15.88:0/2783744648 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3292664194 0 0) 0x7f12cc156f60 con 0x7f12cc0c4820 2024-04-26T23:40:32.707 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:32.701+0000 7f12d0db7640 1 -- 172.21.15.88:0/2783744648 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f12b8003520 con 0x7f12cc0c4820 2024-04-26T23:40:32.707 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:32.701+0000 7f12d1db9640 1 --2- 172.21.15.88:0/2783744648 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f12cc0aecf0 0x7f12cc0c3800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:32.707 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:32.701+0000 7f12d0db7640 1 -- 172.21.15.88:0/2783744648 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3434910475 0 0) 0x7f12b8003520 con 0x7f12cc0c4820 2024-04-26T23:40:32.707 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:32.701+0000 7f12d0db7640 1 -- 172.21.15.88:0/2783744648 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f12cc0aecf0 msgr2=0x7f12cc0c3800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:40:32.707 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:32.701+0000 7f12d0db7640 1 --2- 172.21.15.88:0/2783744648 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f12cc0aecf0 0x7f12cc0c3800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:32.707 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:32.701+0000 7f12d0db7640 1 -- 172.21.15.88:0/2783744648 >> v1:172.21.15.175:6789/0 conn(0x7f12cc0c3d40 legacy=0x7f12cc074180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:32.707 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:32.701+0000 7f12d0db7640 1 -- 172.21.15.88:0/2783744648 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12cc157800 con 0x7f12cc0c4820 2024-04-26T23:40:32.707 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:32.701+0000 7f12d0db7640 1 -- 172.21.15.88:0/2783744648 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 356324787 0 0) 0x7f12bc001670 con 0x7f12cc0c4820 2024-04-26T23:40:32.707 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:32.701+0000 7f12d1db9640 1 --2- 172.21.15.88:0/2783744648 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f12cc0aecf0 0x7f12cc0c3800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:40:32.707 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:32.701+0000 7f12d0db7640 1 -- 172.21.15.88:0/2783744648 >> v1:172.21.15.88:6789/0 conn(0x7f12cc0c4820 legacy=0x7f12cc073a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:32.707 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:32.701+0000 7f12d0db7640 1 --2- 172.21.15.88:0/2783744648 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f12b80039e0 0x7f12b8003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:32.707 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:32.701+0000 7f12d0db7640 1 --2- 172.21.15.88:0/2783744648 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f12b8004800 0x7f12b8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:32.707 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:32.701+0000 7f12d0db7640 1 --2- 172.21.15.88:0/2783744648 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f12cc0aecf0 0x7f12b800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:32.708 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:32.701+0000 7f12d0db7640 1 -- 172.21.15.88:0/2783744648 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f12cc157520 con 0x7f12b80039e0 2024-04-26T23:40:32.708 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:32.701+0000 7f12d0db7640 1 -- 172.21.15.88:0/2783744648 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f12b8005500 con 0x7f12b8004800 2024-04-26T23:40:32.708 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:32.701+0000 7f12d0db7640 1 -- 172.21.15.88:0/2783744648 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f12b800bf00 con 0x7f12cc0aecf0 2024-04-26T23:40:32.708 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:32.701+0000 7f12d1db9640 1 --2- 172.21.15.88:0/2783744648 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f12b80039e0 0x7f12b8003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:32.708 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:32.701+0000 7f12d15b8640 1 --2- 172.21.15.88:0/2783744648 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f12b8004800 0x7f12b8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:32.708 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:32.701+0000 7f12d25ba640 1 --2- 172.21.15.88:0/2783744648 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f12cc0aecf0 0x7f12b800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:32.708 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:32.702+0000 7f12d1db9640 1 -- 172.21.15.88:0/2783744648 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f12cc0aecf0 msgr2=0x7f12b800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:40:32.708 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:32.702+0000 7f12d1db9640 1 --2- 172.21.15.88:0/2783744648 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f12cc0aecf0 0x7f12b800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:32.708 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:32.702+0000 7f12d1db9640 1 -- 172.21.15.88:0/2783744648 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f12b8004800 msgr2=0x7f12b8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:40:32.708 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:32.702+0000 7f12d1db9640 1 --2- 172.21.15.88:0/2783744648 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f12b8004800 0x7f12b8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:32.708 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:32.702+0000 7f12d1db9640 1 -- 172.21.15.88:0/2783744648 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12b8003520 con 0x7f12b80039e0 2024-04-26T23:40:32.708 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:32.702+0000 7f12d1db9640 1 --2- 172.21.15.88:0/2783744648 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f12b80039e0 0x7f12b8003e00 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f12c80098a0 tx=0x7f12b8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe53ff38ffe5c87d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:32.708 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:32.702+0000 7f12d0db7640 1 -- 172.21.15.88:0/2783744648 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12c800f040 con 0x7f12b80039e0 2024-04-26T23:40:32.708 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:32.702+0000 7f12d0db7640 1 -- 172.21.15.88:0/2783744648 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12c802ace0 con 0x7f12b80039e0 2024-04-26T23:40:32.708 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:32.702+0000 7f12d0db7640 1 -- 172.21.15.88:0/2783744648 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12c8004250 con 0x7f12b80039e0 2024-04-26T23:40:32.708 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:32.703+0000 7f12d401d640 1 -- 172.21.15.88:0/2783744648 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f12b80039e0 msgr2=0x7f12b8003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:32.709 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:32.703+0000 7f12d401d640 1 --2- 172.21.15.88:0/2783744648 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f12b80039e0 0x7f12b8003e00 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f12c80098a0 tx=0x7f12b8005830 comp rx=0 tx=0).stop 2024-04-26T23:40:32.709 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:32.703+0000 7f12d25ba640 1 -- 172.21.15.88:0/2783744648 reap_dead start 2024-04-26T23:40:32.709 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:32.703+0000 7f12d401d640 1 -- 172.21.15.88:0/2783744648 shutdown_connections 2024-04-26T23:40:32.709 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:32.703+0000 7f12d401d640 1 -- 172.21.15.88:0/2783744648 >> 172.21.15.88:0/2783744648 conn(0x7f12cc0c6ed0 msgr2=0x7f12cc0c72b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:40:32.709 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:32.703+0000 7f12d401d640 1 -- 172.21.15.88:0/2783744648 shutdown_connections 2024-04-26T23:40:32.709 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:32.703+0000 7f12d401d640 1 -- 172.21.15.88:0/2783744648 wait complete. 2024-04-26T23:40:32.712 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:32.704+0000 7f12d401d640 1 Processor -- start 2024-04-26T23:40:32.712 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:32.704+0000 7f12d401d640 1 -- start start 2024-04-26T23:40:32.712 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:32.705+0000 7f12d401d640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f12b80039e0 0x7f12cc152ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:32.712 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:32.705+0000 7f12d401d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f12cc1f0200 0x7f12cc159240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:32.712 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:32.705+0000 7f12d401d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f12cc0c9c30 0x7f12cc159780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:32.712 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:32.705+0000 7f12d401d640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f12cc0af0d0 con 0x7f12cc0c9c30 2024-04-26T23:40:32.712 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:32.705+0000 7f12d401d640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f12cc156c10 con 0x7f12cc1f0200 2024-04-26T23:40:32.712 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:32.705+0000 7f12d401d640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f12cc0af250 con 0x7f12b80039e0 2024-04-26T23:40:32.712 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:32.705+0000 7f12d25ba640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f12cc0c9c30 0x7f12cc159780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:32.712 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:32.705+0000 7f12d25ba640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f12cc0c9c30 0x7f12cc159780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:57282/0 (socket says 172.21.15.88:57282) 2024-04-26T23:40:32.712 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:32.705+0000 7f12d25ba640 1 -- 172.21.15.88:0/2468594121 learned_addr learned my addr 172.21.15.88:0/2468594121 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:40:32.712 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:32.705+0000 7f12d1db9640 1 --2- 172.21.15.88:0/2468594121 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f12b80039e0 0x7f12cc152ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:32.712 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:32.705+0000 7f12d15b8640 1 --2- 172.21.15.88:0/2468594121 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f12cc1f0200 0x7f12cc159240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:32.712 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:32.705+0000 7f12d25ba640 1 -- 172.21.15.88:0/2468594121 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f12b80039e0 msgr2=0x7f12cc152ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:32.712 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:32.705+0000 7f12d25ba640 1 --2- 172.21.15.88:0/2468594121 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f12b80039e0 0x7f12cc152ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:32.713 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:32.705+0000 7f12d25ba640 1 -- 172.21.15.88:0/2468594121 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f12cc1f0200 msgr2=0x7f12cc159240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:32.713 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:32.705+0000 7f12d25ba640 1 --2- 172.21.15.88:0/2468594121 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f12cc1f0200 0x7f12cc159240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:32.713 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:32.705+0000 7f12d25ba640 1 -- 172.21.15.88:0/2468594121 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12cc153000 con 0x7f12cc0c9c30 2024-04-26T23:40:32.713 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:32.705+0000 7f12d25ba640 1 --2- 172.21.15.88:0/2468594121 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f12cc0c9c30 0x7f12cc159780 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f12cc154820 tx=0x7f12c400fd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:32.713 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:32.705+0000 7f12c27fc640 1 -- 172.21.15.88:0/2468594121 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12c401a070 con 0x7f12cc0c9c30 2024-04-26T23:40:32.713 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:32.705+0000 7f12c27fc640 1 -- 172.21.15.88:0/2468594121 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12c4006d60 con 0x7f12cc0c9c30 2024-04-26T23:40:32.713 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:32.705+0000 7f12c27fc640 1 -- 172.21.15.88:0/2468594121 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12c4003b90 con 0x7f12cc0c9c30 2024-04-26T23:40:32.713 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:32.705+0000 7f12d401d640 1 -- 172.21.15.88:0/2468594121 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12cc159cc0 con 0x7f12cc0c9c30 2024-04-26T23:40:32.713 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:32.705+0000 7f12d401d640 1 -- 172.21.15.88:0/2468594121 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12cc1f0a50 con 0x7f12cc0c9c30 2024-04-26T23:40:32.713 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:32.706+0000 7f12d401d640 1 -- 172.21.15.88:0/2468594121 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f12cc0507a0 con 0x7f12cc0c9c30 2024-04-26T23:40:32.713 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:32.707+0000 7f12c27fc640 1 -- 172.21.15.88:0/2468594121 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f12c401d070 con 0x7f12cc0c9c30 2024-04-26T23:40:32.713 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:32.707+0000 7f12c27fc640 1 --2- 172.21.15.88:0/2468594121 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f12b006c920 0x7f12b006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:32.713 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:32.707+0000 7f12c27fc640 1 -- 172.21.15.88:0/2468594121 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 5689+0+0 (secure 0 0 0) 0x7f12c408b0c0 con 0x7f12cc0c9c30 2024-04-26T23:40:32.713 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:32.707+0000 7f12d1db9640 1 --2- 172.21.15.88:0/2468594121 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f12b006c920 0x7f12b006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:32.713 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:32.708+0000 7f12d1db9640 1 --2- 172.21.15.88:0/2468594121 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f12b006c920 0x7f12b006ede0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f12c8033000 tx=0x7f12c802e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:32.714 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:32.712+0000 7f12c27fc640 1 -- 172.21.15.88:0/2468594121 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f12c4058f40 con 0x7f12cc0c9c30 2024-04-26T23:40:32.890 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:32.887+0000 7f12d401d640 1 -- 172.21.15.88:0/2468594121 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f12cc0c4600 con 0x7f12cc0c9c30 2024-04-26T23:40:32.891 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:32.888+0000 7f12c27fc640 1 -- 172.21.15.88:0/2468594121 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) ==== 74+0+16598 (secure 0 0 0) 0x7f12c405d240 con 0x7f12cc0c9c30 2024-04-26T23:40:32.892 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-26T23:40:32.892 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":19,"fsid":"555255e9-7ef9-4454-8dc9-35e96b70035c","created":"2024-04-26T23:40:07.836009+0000","modified":"2024-04-26T23:40:31.909541+0000","last_up_change":"2024-04-26T23:40:18.831369+0000","last_in_change":"2024-04-26T23:40:09.944777+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T23:40:19.936127+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"a_metadata","create_time":"2024-04-26T23:40:29.837465+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"a_data","create_time":"2024-04-26T23:40:30.868651+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"92aecea3-ed62-4a29-87c0-76758a0816a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":2803186054},{"type":"v1","addr":"172.21.15.88:6801","nonce":2803186054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":2803186054},{"type":"v1","addr":"172.21.15.88:6803","nonce":2803186054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":2803186054},{"type":"v1","addr":"172.21.15.88:6807","nonce":2803186054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":2803186054},{"type":"v1","addr":"172.21.15.88:6805","nonce":2803186054}]},"public_addr":"172.21.15.88:6801/2803186054","cluster_addr":"172.21.15.88:6803/2803186054","heartbeat_back_addr":"172.21.15.88:6807/2803186054","heartbeat_front_addr":"172.21.15.88:6805/2803186054","state":["exists","up"]},{"osd":1,"uuid":"7a6f0fa9-23d0-4747-880f-798d45ec5eeb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":1897380484},{"type":"v1","addr":"172.21.15.88:6817","nonce":1897380484}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":1897380484},{"type":"v1","addr":"172.21.15.88:6819","nonce":1897380484}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1897380484},{"type":"v1","addr":"172.21.15.88:6823","nonce":1897380484}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":1897380484},{"type":"v1","addr":"172.21.15.88:6821","nonce":1897380484}]},"public_addr":"172.21.15.88:6817/1897380484","cluster_addr":"172.21.15.88:6819/1897380484","heartbeat_back_addr":"172.21.15.88:6823/1897380484","heartbeat_front_addr":"172.21.15.88:6821/1897380484","state":["exists","up"]},{"osd":2,"uuid":"6be88ea0-e133-4200-a4b5-f92d664b248a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":648396269},{"type":"v1","addr":"172.21.15.88:6809","nonce":648396269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":648396269},{"type":"v1","addr":"172.21.15.88:6811","nonce":648396269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":648396269},{"type":"v1","addr":"172.21.15.88:6815","nonce":648396269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":648396269},{"type":"v1","addr":"172.21.15.88:6813","nonce":648396269}]},"public_addr":"172.21.15.88:6809/648396269","cluster_addr":"172.21.15.88:6811/648396269","heartbeat_back_addr":"172.21.15.88:6815/648396269","heartbeat_front_addr":"172.21.15.88:6813/648396269","state":["exists","up"]},{"osd":3,"uuid":"dcb0746b-7b3d-4ecf-8089-2493a5d1857c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":2328028922},{"type":"v1","addr":"172.21.15.88:6825","nonce":2328028922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":2328028922},{"type":"v1","addr":"172.21.15.88:6827","nonce":2328028922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":2328028922},{"type":"v1","addr":"172.21.15.88:6831","nonce":2328028922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":2328028922},{"type":"v1","addr":"172.21.15.88:6829","nonce":2328028922}]},"public_addr":"172.21.15.88:6825/2328028922","cluster_addr":"172.21.15.88:6827/2328028922","heartbeat_back_addr":"172.21.15.88:6831/2328028922","heartbeat_front_addr":"172.21.15.88:6829/2328028922","state":["exists","up"]},{"osd":4,"uuid":"c483de66-c44f-450e-a4ce-b132d50882c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":3929617402},{"type":"v1","addr":"172.21.15.175:6809","nonce":3929617402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":3929617402},{"type":"v1","addr":"172.21.15.175:6811","nonce":3929617402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":3929617402},{"type":"v1","addr":"172.21.15.175:6815","nonce":3929617402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":3929617402},{"type":"v1","addr":"172.21.15.175:6813","nonce":3929617402}]},"public_addr":"172.21.15.175:6809/3929617402","cluster_addr":"172.21.15.175:6811/3929617402","heartbeat_back_addr":"172.21.15.175:6815/3929617402","heartbeat_front_addr":"172.21.15.175:6813/3929617402","state":["exists","up"]},{"osd":5,"uuid":"ac3b1669-d228-40dd-9f9a-cb46aa73dd6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":2476644457},{"type":"v1","addr":"172.21.15.175:6801","nonce":2476644457}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":2476644457},{"type":"v1","addr":"172.21.15.175:6803","nonce":2476644457}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":2476644457},{"type":"v1","addr":"172.21.15.175:6807","nonce":2476644457}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":2476644457},{"type":"v1","addr":"172.21.15.175:6805","nonce":2476644457}]},"public_addr":"172.21.15.175:6801/2476644457","cluster_addr":"172.21.15.175:6803/2476644457","heartbeat_back_addr":"172.21.15.175:6807/2476644457","heartbeat_front_addr":"172.21.15.175:6805/2476644457","state":["exists","up"]},{"osd":6,"uuid":"7bef4896-857e-4c11-b3b2-c2e9a8548338","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":3824112919},{"type":"v1","addr":"172.21.15.175:6819","nonce":3824112919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6821","nonce":3824112919},{"type":"v1","addr":"172.21.15.175:6824","nonce":3824112919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":3824112919},{"type":"v1","addr":"172.21.15.175:6831","nonce":3824112919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":3824112919},{"type":"v1","addr":"172.21.15.175:6829","nonce":3824112919}]},"public_addr":"172.21.15.175:6819/3824112919","cluster_addr":"172.21.15.175:6824/3824112919","heartbeat_back_addr":"172.21.15.175:6831/3824112919","heartbeat_front_addr":"172.21.15.175:6829/3824112919","state":["exists","up"]},{"osd":7,"uuid":"e18d9e09-8673-470d-b9dc-280a409b63f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6817","nonce":3319361162},{"type":"v1","addr":"172.21.15.175:6818","nonce":3319361162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":3319361162},{"type":"v1","addr":"172.21.15.175:6822","nonce":3319361162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6827","nonce":3319361162},{"type":"v1","addr":"172.21.15.175:6828","nonce":3319361162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6823","nonce":3319361162},{"type":"v1","addr":"172.21.15.175:6825","nonce":3319361162}]},"public_addr":"172.21.15.175:6818/3319361162","cluster_addr":"172.21.15.175:6822/3319361162","heartbeat_back_addr":"172.21.15.175:6828/3319361162","heartbeat_front_addr":"172.21.15.175:6825/3319361162","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:40:15.126268+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:40:15.050614+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:40:14.995164+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:40:15.078112+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:40:15.159637+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:40:15.091226+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:40:15.140316+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:40:15.089431+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:40:32.894 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:32.890+0000 7f12d401d640 1 -- 172.21.15.88:0/2468594121 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f12b006c920 msgr2=0x7f12b006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:32.894 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:32.890+0000 7f12d401d640 1 --2- 172.21.15.88:0/2468594121 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f12b006c920 0x7f12b006ede0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f12c8033000 tx=0x7f12c802e000 comp rx=0 tx=0).stop 2024-04-26T23:40:32.894 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:32.890+0000 7f12d401d640 1 -- 172.21.15.88:0/2468594121 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f12cc0c9c30 msgr2=0x7f12cc159780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:32.894 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:32.890+0000 7f12d401d640 1 --2- 172.21.15.88:0/2468594121 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f12cc0c9c30 0x7f12cc159780 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f12cc154820 tx=0x7f12c400fd40 comp rx=0 tx=0).stop 2024-04-26T23:40:32.894 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:32.890+0000 7f12d401d640 1 -- 172.21.15.88:0/2468594121 shutdown_connections 2024-04-26T23:40:32.894 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:32.890+0000 7f12d401d640 1 --2- 172.21.15.88:0/2468594121 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f12b006c920 0x7f12b006ede0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:32.894 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:32.890+0000 7f12d401d640 1 --2- 172.21.15.88:0/2468594121 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f12cc0c9c30 0x7f12cc159780 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:32.894 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:32.890+0000 7f12d401d640 1 --2- 172.21.15.88:0/2468594121 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f12cc1f0200 0x7f12cc159240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:32.894 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:32.890+0000 7f12d401d640 1 --2- 172.21.15.88:0/2468594121 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f12b80039e0 0x7f12cc152ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:32.894 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:32.890+0000 7f12d401d640 1 -- 172.21.15.88:0/2468594121 >> 172.21.15.88:0/2468594121 conn(0x7f12cc0c6ed0 msgr2=0x7f12cc0c4cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:40:32.894 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:32.890+0000 7f12d401d640 1 -- 172.21.15.88:0/2468594121 shutdown_connections 2024-04-26T23:40:32.894 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:32.890+0000 7f12d401d640 1 -- 172.21.15.88:0/2468594121 wait complete. 2024-04-26T23:40:32.904 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T23:40:33.001 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:32.998+0000 7f1d2cd6a640 1 Processor -- start 2024-04-26T23:40:33.001 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:32.998+0000 7f1d2cd6a640 1 -- start start 2024-04-26T23:40:33.002 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:32.999+0000 7f1d2cd6a640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f1d280740e0 0x7f1d28157630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:33.002 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:32.999+0000 7f1d2cd6a640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f1d280ca3a0 0x7f1d280c7200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:33.002 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:32.999+0000 7f1d2cd6a640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1d2815a530 con 0x7f1d280c6e20 2024-04-26T23:40:33.002 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:32.999+0000 7f1d2cd6a640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f1d28072930 con 0x7f1d280740e0 2024-04-26T23:40:33.002 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:32.999+0000 7f1d2cd6a640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f1d2815a810 con 0x7f1d280ca3a0 2024-04-26T23:40:33.002 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:32.999+0000 7f1d1ffff640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f1d280740e0 0x7f1d28157630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:33.002 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:32.999+0000 7f1d2659c640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f1d280c6e20 0x7f1d28156f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:39786/0 (socket says 172.21.15.88:39786) 2024-04-26T23:40:33.002 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:32.999+0000 7f1d2659c640 1 -- 172.21.15.88:0/1743273369 learned_addr learned my addr 172.21.15.88:0/1743273369 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-26T23:40:33.002 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:32.999+0000 7f1d1ffff640 1 -- 172.21.15.88:0/1743273369 >> v2:172.21.15.175:3300/0 conn(0x7f1d280ca3a0 msgr2=0x7f1d280c7200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:40:33.003 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:32.999+0000 7f1d1ffff640 1 --2- 172.21.15.88:0/1743273369 >> v2:172.21.15.175:3300/0 conn(0x7f1d280ca3a0 0x7f1d280c7200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:33.003 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:32.999+0000 7f1d1ffff640 1 -- 172.21.15.88:0/1743273369 >> v1:172.21.15.88:6789/0 conn(0x7f1d280c6e20 legacy=0x7f1d28156f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:33.003 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:32.999+0000 7f1d1ffff640 1 -- 172.21.15.88:0/1743273369 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d2815aaf0 con 0x7f1d280740e0 2024-04-26T23:40:33.004 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:33.000+0000 7f1d1ffff640 1 --2- 172.21.15.88:0/1743273369 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1d280740e0 0x7f1d28157630 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f1d280af150 tx=0x7f1d1002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4baa5275076f0908 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:33.004 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:33.000+0000 7f1d25d9b640 1 -- 172.21.15.88:0/1743273369 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d10037070 con 0x7f1d280740e0 2024-04-26T23:40:33.004 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:33.000+0000 7f1d25d9b640 1 -- 172.21.15.88:0/1743273369 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d10032440 con 0x7f1d280740e0 2024-04-26T23:40:33.004 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:33.000+0000 7f1d25d9b640 1 -- 172.21.15.88:0/1743273369 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d1002ae60 con 0x7f1d280740e0 2024-04-26T23:40:33.004 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:33.000+0000 7f1d2cd6a640 1 -- 172.21.15.88:0/1743273369 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1d280740e0 msgr2=0x7f1d28157630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:33.004 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:33.000+0000 7f1d2cd6a640 1 --2- 172.21.15.88:0/1743273369 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1d280740e0 0x7f1d28157630 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f1d280af150 tx=0x7f1d1002a110 comp rx=0 tx=0).stop 2024-04-26T23:40:33.004 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:33.000+0000 7f1d2cd6a640 1 -- 172.21.15.88:0/1743273369 shutdown_connections 2024-04-26T23:40:33.005 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:33.000+0000 7f1d2cd6a640 1 --2- 172.21.15.88:0/1743273369 >> v2:172.21.15.175:3300/0 conn(0x7f1d280ca3a0 0x7f1d280c7200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:33.005 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:33.000+0000 7f1d2cd6a640 1 --2- 172.21.15.88:0/1743273369 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1d280740e0 0x7f1d28157630 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:33.005 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:33.000+0000 7f1d2cd6a640 1 -- 172.21.15.88:0/1743273369 >> 172.21.15.88:0/1743273369 conn(0x7f1d280ae0b0 msgr2=0x7f1d280ae490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:40:33.005 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:33.000+0000 7f1d2cd6a640 1 -- 172.21.15.88:0/1743273369 shutdown_connections 2024-04-26T23:40:33.005 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:33.000+0000 7f1d2cd6a640 1 -- 172.21.15.88:0/1743273369 wait complete. 2024-04-26T23:40:33.005 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:33.002+0000 7f1d2cd6a640 1 Processor -- start 2024-04-26T23:40:33.005 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:33.002+0000 7f1d2cd6a640 1 -- start start 2024-04-26T23:40:33.007 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:33.002+0000 7f1d2cd6a640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1d280740e0 0x7f1d28155f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:33.008 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:33.002+0000 7f1d2cd6a640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1d280c6e20 0x7f1d280c20a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:33.008 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:33.002+0000 7f1d2cd6a640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1d280ca3a0 0x7f1d280c25e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:33.008 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:33.002+0000 7f1d2cd6a640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f1d28154540 con 0x7f1d280c6e20 2024-04-26T23:40:33.008 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:33.002+0000 7f1d2cd6a640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f1d281543c0 con 0x7f1d280ca3a0 2024-04-26T23:40:33.008 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:33.002+0000 7f1d2cd6a640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f1d2815a0c0 con 0x7f1d280740e0 2024-04-26T23:40:33.008 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:33.002+0000 7f1d1ffff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1d280c6e20 0x7f1d280c20a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:33.008 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:33.002+0000 7f1d1ffff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1d280c6e20 0x7f1d280c20a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:57290/0 (socket says 172.21.15.88:57290) 2024-04-26T23:40:33.008 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:33.002+0000 7f1d1ffff640 1 -- 172.21.15.88:0/2327976392 learned_addr learned my addr 172.21.15.88:0/2327976392 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:40:33.008 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:33.002+0000 7f1d26d9d640 1 --2- 172.21.15.88:0/2327976392 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1d280ca3a0 0x7f1d280c25e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:33.008 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:33.002+0000 7f1d2659c640 1 --2- 172.21.15.88:0/2327976392 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1d280740e0 0x7f1d28155f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:33.008 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:33.003+0000 7f1d1ffff640 1 -- 172.21.15.88:0/2327976392 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1d280740e0 msgr2=0x7f1d28155f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:33.008 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:33.003+0000 7f1d1ffff640 1 --2- 172.21.15.88:0/2327976392 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1d280740e0 0x7f1d28155f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:33.008 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:33.003+0000 7f1d1ffff640 1 -- 172.21.15.88:0/2327976392 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1d280ca3a0 msgr2=0x7f1d280c25e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:33.008 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:33.003+0000 7f1d1ffff640 1 --2- 172.21.15.88:0/2327976392 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1d280ca3a0 0x7f1d280c25e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:33.009 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:33.003+0000 7f1d1ffff640 1 -- 172.21.15.88:0/2327976392 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d280c1530 con 0x7f1d280c6e20 2024-04-26T23:40:33.009 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:33.003+0000 7f1d2659c640 1 --2- 172.21.15.88:0/2327976392 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1d280740e0 0x7f1d28155f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:40:33.009 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:33.003+0000 7f1d1ffff640 1 --2- 172.21.15.88:0/2327976392 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1d280c6e20 0x7f1d280c20a0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f1d10000c00 tx=0x7f1d100046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:33.009 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:33.003+0000 7f1d1effd640 1 -- 172.21.15.88:0/2327976392 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d10037040 con 0x7f1d280c6e20 2024-04-26T23:40:33.009 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:33.003+0000 7f1d1effd640 1 -- 172.21.15.88:0/2327976392 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d10042070 con 0x7f1d280c6e20 2024-04-26T23:40:33.009 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:33.003+0000 7f1d1effd640 1 -- 172.21.15.88:0/2327976392 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d10030bd0 con 0x7f1d280c6e20 2024-04-26T23:40:33.009 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:33.003+0000 7f1d2cd6a640 1 -- 172.21.15.88:0/2327976392 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d28154940 con 0x7f1d280c6e20 2024-04-26T23:40:33.009 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:33.003+0000 7f1d2cd6a640 1 -- 172.21.15.88:0/2327976392 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d28154f00 con 0x7f1d280c6e20 2024-04-26T23:40:33.009 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:33.004+0000 7f1d2cd6a640 1 -- 172.21.15.88:0/2327976392 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d280766c0 con 0x7f1d280c6e20 2024-04-26T23:40:33.009 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:33.004+0000 7f1d1effd640 1 -- 172.21.15.88:0/2327976392 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f1d10047460 con 0x7f1d280c6e20 2024-04-26T23:40:33.009 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:33.005+0000 7f1d1effd640 1 --2- 172.21.15.88:0/2327976392 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f1d0806c8f0 0x7f1d0806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:33.009 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:33.005+0000 7f1d1effd640 1 -- 172.21.15.88:0/2327976392 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 5689+0+0 (secure 0 0 0) 0x7f1d100ac720 con 0x7f1d280c6e20 2024-04-26T23:40:33.009 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:33.005+0000 7f1d2659c640 1 --2- 172.21.15.88:0/2327976392 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f1d0806c8f0 0x7f1d0806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:33.010 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:33.005+0000 7f1d2659c640 1 --2- 172.21.15.88:0/2327976392 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f1d0806c8f0 0x7f1d0806edb0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f1d280b2770 tx=0x7f1d18009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:33.012 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:33.009+0000 7f1d1effd640 1 -- 172.21.15.88:0/2327976392 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f1d10032e20 con 0x7f1d280c6e20 2024-04-26T23:40:33.186 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:33.183+0000 7f1d2cd6a640 1 -- 172.21.15.88:0/2327976392 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1d280507a0 con 0x7f1d280c6e20 2024-04-26T23:40:33.187 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:33.185+0000 7f1d1effd640 1 -- 172.21.15.88:0/2327976392 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) ==== 74+0+16598 (secure 0 0 0) 0x7f1d1007abf0 con 0x7f1d280c6e20 2024-04-26T23:40:33.188 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-26T23:40:33.188 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":19,"fsid":"555255e9-7ef9-4454-8dc9-35e96b70035c","created":"2024-04-26T23:40:07.836009+0000","modified":"2024-04-26T23:40:31.909541+0000","last_up_change":"2024-04-26T23:40:18.831369+0000","last_in_change":"2024-04-26T23:40:09.944777+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T23:40:19.936127+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"a_metadata","create_time":"2024-04-26T23:40:29.837465+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"a_data","create_time":"2024-04-26T23:40:30.868651+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"92aecea3-ed62-4a29-87c0-76758a0816a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":2803186054},{"type":"v1","addr":"172.21.15.88:6801","nonce":2803186054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":2803186054},{"type":"v1","addr":"172.21.15.88:6803","nonce":2803186054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":2803186054},{"type":"v1","addr":"172.21.15.88:6807","nonce":2803186054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":2803186054},{"type":"v1","addr":"172.21.15.88:6805","nonce":2803186054}]},"public_addr":"172.21.15.88:6801/2803186054","cluster_addr":"172.21.15.88:6803/2803186054","heartbeat_back_addr":"172.21.15.88:6807/2803186054","heartbeat_front_addr":"172.21.15.88:6805/2803186054","state":["exists","up"]},{"osd":1,"uuid":"7a6f0fa9-23d0-4747-880f-798d45ec5eeb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":1897380484},{"type":"v1","addr":"172.21.15.88:6817","nonce":1897380484}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":1897380484},{"type":"v1","addr":"172.21.15.88:6819","nonce":1897380484}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1897380484},{"type":"v1","addr":"172.21.15.88:6823","nonce":1897380484}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":1897380484},{"type":"v1","addr":"172.21.15.88:6821","nonce":1897380484}]},"public_addr":"172.21.15.88:6817/1897380484","cluster_addr":"172.21.15.88:6819/1897380484","heartbeat_back_addr":"172.21.15.88:6823/1897380484","heartbeat_front_addr":"172.21.15.88:6821/1897380484","state":["exists","up"]},{"osd":2,"uuid":"6be88ea0-e133-4200-a4b5-f92d664b248a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":648396269},{"type":"v1","addr":"172.21.15.88:6809","nonce":648396269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":648396269},{"type":"v1","addr":"172.21.15.88:6811","nonce":648396269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":648396269},{"type":"v1","addr":"172.21.15.88:6815","nonce":648396269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":648396269},{"type":"v1","addr":"172.21.15.88:6813","nonce":648396269}]},"public_addr":"172.21.15.88:6809/648396269","cluster_addr":"172.21.15.88:6811/648396269","heartbeat_back_addr":"172.21.15.88:6815/648396269","heartbeat_front_addr":"172.21.15.88:6813/648396269","state":["exists","up"]},{"osd":3,"uuid":"dcb0746b-7b3d-4ecf-8089-2493a5d1857c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":2328028922},{"type":"v1","addr":"172.21.15.88:6825","nonce":2328028922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":2328028922},{"type":"v1","addr":"172.21.15.88:6827","nonce":2328028922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":2328028922},{"type":"v1","addr":"172.21.15.88:6831","nonce":2328028922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":2328028922},{"type":"v1","addr":"172.21.15.88:6829","nonce":2328028922}]},"public_addr":"172.21.15.88:6825/2328028922","cluster_addr":"172.21.15.88:6827/2328028922","heartbeat_back_addr":"172.21.15.88:6831/2328028922","heartbeat_front_addr":"172.21.15.88:6829/2328028922","state":["exists","up"]},{"osd":4,"uuid":"c483de66-c44f-450e-a4ce-b132d50882c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":3929617402},{"type":"v1","addr":"172.21.15.175:6809","nonce":3929617402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":3929617402},{"type":"v1","addr":"172.21.15.175:6811","nonce":3929617402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":3929617402},{"type":"v1","addr":"172.21.15.175:6815","nonce":3929617402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":3929617402},{"type":"v1","addr":"172.21.15.175:6813","nonce":3929617402}]},"public_addr":"172.21.15.175:6809/3929617402","cluster_addr":"172.21.15.175:6811/3929617402","heartbeat_back_addr":"172.21.15.175:6815/3929617402","heartbeat_front_addr":"172.21.15.175:6813/3929617402","state":["exists","up"]},{"osd":5,"uuid":"ac3b1669-d228-40dd-9f9a-cb46aa73dd6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":2476644457},{"type":"v1","addr":"172.21.15.175:6801","nonce":2476644457}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":2476644457},{"type":"v1","addr":"172.21.15.175:6803","nonce":2476644457}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":2476644457},{"type":"v1","addr":"172.21.15.175:6807","nonce":2476644457}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":2476644457},{"type":"v1","addr":"172.21.15.175:6805","nonce":2476644457}]},"public_addr":"172.21.15.175:6801/2476644457","cluster_addr":"172.21.15.175:6803/2476644457","heartbeat_back_addr":"172.21.15.175:6807/2476644457","heartbeat_front_addr":"172.21.15.175:6805/2476644457","state":["exists","up"]},{"osd":6,"uuid":"7bef4896-857e-4c11-b3b2-c2e9a8548338","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":3824112919},{"type":"v1","addr":"172.21.15.175:6819","nonce":3824112919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6821","nonce":3824112919},{"type":"v1","addr":"172.21.15.175:6824","nonce":3824112919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":3824112919},{"type":"v1","addr":"172.21.15.175:6831","nonce":3824112919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":3824112919},{"type":"v1","addr":"172.21.15.175:6829","nonce":3824112919}]},"public_addr":"172.21.15.175:6819/3824112919","cluster_addr":"172.21.15.175:6824/3824112919","heartbeat_back_addr":"172.21.15.175:6831/3824112919","heartbeat_front_addr":"172.21.15.175:6829/3824112919","state":["exists","up"]},{"osd":7,"uuid":"e18d9e09-8673-470d-b9dc-280a409b63f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6817","nonce":3319361162},{"type":"v1","addr":"172.21.15.175:6818","nonce":3319361162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":3319361162},{"type":"v1","addr":"172.21.15.175:6822","nonce":3319361162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6827","nonce":3319361162},{"type":"v1","addr":"172.21.15.175:6828","nonce":3319361162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6823","nonce":3319361162},{"type":"v1","addr":"172.21.15.175:6825","nonce":3319361162}]},"public_addr":"172.21.15.175:6818/3319361162","cluster_addr":"172.21.15.175:6822/3319361162","heartbeat_back_addr":"172.21.15.175:6828/3319361162","heartbeat_front_addr":"172.21.15.175:6825/3319361162","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:40:15.126268+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:40:15.050614+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:40:14.995164+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:40:15.078112+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:40:15.159637+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:40:15.091226+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:40:15.140316+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:40:15.089431+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:40:33.190 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:33.186+0000 7f1d2cd6a640 1 -- 172.21.15.88:0/2327976392 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f1d0806c8f0 msgr2=0x7f1d0806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:33.190 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:33.186+0000 7f1d2cd6a640 1 --2- 172.21.15.88:0/2327976392 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f1d0806c8f0 0x7f1d0806edb0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f1d280b2770 tx=0x7f1d18009040 comp rx=0 tx=0).stop 2024-04-26T23:40:33.190 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:33.186+0000 7f1d2cd6a640 1 -- 172.21.15.88:0/2327976392 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1d280c6e20 msgr2=0x7f1d280c20a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:33.190 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:33.186+0000 7f1d2cd6a640 1 --2- 172.21.15.88:0/2327976392 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1d280c6e20 0x7f1d280c20a0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f1d10000c00 tx=0x7f1d100046c0 comp rx=0 tx=0).stop 2024-04-26T23:40:33.190 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:33.186+0000 7f1d2cd6a640 1 -- 172.21.15.88:0/2327976392 shutdown_connections 2024-04-26T23:40:33.190 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:33.186+0000 7f1d2cd6a640 1 --2- 172.21.15.88:0/2327976392 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f1d0806c8f0 0x7f1d0806edb0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:33.190 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:33.186+0000 7f1d2cd6a640 1 --2- 172.21.15.88:0/2327976392 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1d280ca3a0 0x7f1d280c25e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:33.190 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:33.186+0000 7f1d2cd6a640 1 --2- 172.21.15.88:0/2327976392 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1d280c6e20 0x7f1d280c20a0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:33.190 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:33.186+0000 7f1d2cd6a640 1 --2- 172.21.15.88:0/2327976392 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1d280740e0 0x7f1d28155f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:33.190 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:33.187+0000 7f1d2cd6a640 1 -- 172.21.15.88:0/2327976392 >> 172.21.15.88:0/2327976392 conn(0x7f1d280ae0b0 msgr2=0x7f1d28072ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:40:33.190 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:33.187+0000 7f1d2cd6a640 1 -- 172.21.15.88:0/2327976392 shutdown_connections 2024-04-26T23:40:33.191 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:33.187+0000 7f1d2cd6a640 1 -- 172.21.15.88:0/2327976392 wait complete. 2024-04-26T23:40:33.201 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set a standby_count_wanted 0 2024-04-26T23:40:33.300 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:33.297+0000 7fc140eb0640 1 Processor -- start 2024-04-26T23:40:33.300 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:33.297+0000 7fc140eb0640 1 -- start start 2024-04-26T23:40:33.301 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:33.298+0000 7fc140eb0640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc13c1570d0 0x7fc13c150a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:33.302 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:33.298+0000 7fc140eb0640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fc13c150f90 0x7fc13c1574b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:33.302 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:33.298+0000 7fc140eb0640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc13c0c3810 con 0x7fc13c0ab3f0 2024-04-26T23:40:33.302 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:33.298+0000 7fc140eb0640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7fc13c0c4330 con 0x7fc13c1570d0 2024-04-26T23:40:33.302 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:33.298+0000 7fc140eb0640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7fc13c0c3ab0 con 0x7fc13c150f90 2024-04-26T23:40:33.302 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:33.298+0000 7fc13a59c640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc13c1570d0 0x7fc13c150a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:33.302 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:33.298+0000 7fc133fff640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fc13c0ab3f0 0x7fc13c0c4d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:39800/0 (socket says 172.21.15.88:39800) 2024-04-26T23:40:33.302 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:33.298+0000 7fc133fff640 1 -- 172.21.15.88:0/861551592 learned_addr learned my addr 172.21.15.88:0/861551592 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-26T23:40:33.302 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:33.298+0000 7fc13ad9d640 1 --2- 172.21.15.88:0/861551592 >> v2:172.21.15.175:3300/0 conn(0x7fc13c150f90 0x7fc13c1574b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:33.302 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:33.298+0000 7fc13a59c640 1 -- 172.21.15.88:0/861551592 >> v2:172.21.15.175:3300/0 conn(0x7fc13c150f90 msgr2=0x7fc13c1574b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:40:33.302 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:33.298+0000 7fc13a59c640 1 --2- 172.21.15.88:0/861551592 >> v2:172.21.15.175:3300/0 conn(0x7fc13c150f90 0x7fc13c1574b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:33.302 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:33.298+0000 7fc13a59c640 1 -- 172.21.15.88:0/861551592 >> v1:172.21.15.88:6789/0 conn(0x7fc13c0ab3f0 legacy=0x7fc13c0c4d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:33.303 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:33.298+0000 7fc139d9b640 1 -- 172.21.15.88:0/861551592 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3778393919 0 0) 0x7fc13c0c3810 con 0x7fc13c0ab3f0 2024-04-26T23:40:33.303 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:33.298+0000 7fc13a59c640 1 -- 172.21.15.88:0/861551592 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc13c0c4580 con 0x7fc13c1570d0 2024-04-26T23:40:33.303 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:33.299+0000 7fc13a59c640 1 --2- 172.21.15.88:0/861551592 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc13c1570d0 0x7fc13c150a50 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fc13c0c44b0 tx=0x7fc12c02a080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=157b2e333e400d13 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:33.303 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:33.299+0000 7fc139d9b640 1 -- 172.21.15.88:0/861551592 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc12c037070 con 0x7fc13c1570d0 2024-04-26T23:40:33.303 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:33.299+0000 7fc139d9b640 1 -- 172.21.15.88:0/861551592 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc12c02add0 con 0x7fc13c1570d0 2024-04-26T23:40:33.303 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:33.299+0000 7fc139d9b640 1 -- 172.21.15.88:0/861551592 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc12c032660 con 0x7fc13c1570d0 2024-04-26T23:40:33.306 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:33.299+0000 7fc140eb0640 1 -- 172.21.15.88:0/861551592 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc13c1570d0 msgr2=0x7fc13c150a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:33.306 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:33.299+0000 7fc140eb0640 1 --2- 172.21.15.88:0/861551592 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc13c1570d0 0x7fc13c150a50 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fc13c0c44b0 tx=0x7fc12c02a080 comp rx=0 tx=0).stop 2024-04-26T23:40:33.306 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:33.299+0000 7fc140eb0640 1 -- 172.21.15.88:0/861551592 shutdown_connections 2024-04-26T23:40:33.306 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:33.299+0000 7fc140eb0640 1 --2- 172.21.15.88:0/861551592 >> v2:172.21.15.175:3300/0 conn(0x7fc13c150f90 0x7fc13c1574b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:33.306 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:33.299+0000 7fc140eb0640 1 --2- 172.21.15.88:0/861551592 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc13c1570d0 0x7fc13c150a50 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:33.306 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:33.299+0000 7fc140eb0640 1 -- 172.21.15.88:0/861551592 >> 172.21.15.88:0/861551592 conn(0x7fc13c06c310 msgr2=0x7fc13c06c6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:40:33.306 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:33.299+0000 7fc140eb0640 1 -- 172.21.15.88:0/861551592 shutdown_connections 2024-04-26T23:40:33.306 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:33.299+0000 7fc140eb0640 1 -- 172.21.15.88:0/861551592 wait complete. 2024-04-26T23:40:33.306 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:33.301+0000 7fc140eb0640 1 Processor -- start 2024-04-26T23:40:33.307 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:33.301+0000 7fc140eb0640 1 -- start start 2024-04-26T23:40:33.307 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:33.301+0000 7fc140eb0640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc13c0ab3f0 0x7fc13c073d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:33.307 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:33.301+0000 7fc140eb0640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc13c150f90 0x7fc13c147ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:33.307 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:33.301+0000 7fc140eb0640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc13c1570d0 0x7fc13c1483e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:33.307 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:33.301+0000 7fc140eb0640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fc13c0abbe0 con 0x7fc13c0ab3f0 2024-04-26T23:40:33.307 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:33.301+0000 7fc140eb0640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc13c0aba60 con 0x7fc13c1570d0 2024-04-26T23:40:33.307 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:33.301+0000 7fc140eb0640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fc13c0c5490 con 0x7fc13c150f90 2024-04-26T23:40:33.307 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:33.301+0000 7fc13a59c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc13c0ab3f0 0x7fc13c073d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:33.307 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:33.301+0000 7fc13a59c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc13c0ab3f0 0x7fc13c073d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:57304/0 (socket says 172.21.15.88:57304) 2024-04-26T23:40:33.307 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:33.301+0000 7fc13a59c640 1 -- 172.21.15.88:0/1513440369 learned_addr learned my addr 172.21.15.88:0/1513440369 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:40:33.307 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:33.301+0000 7fc133fff640 1 --2- 172.21.15.88:0/1513440369 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc13c150f90 0x7fc13c147ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:33.307 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:33.301+0000 7fc13ad9d640 1 --2- 172.21.15.88:0/1513440369 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc13c1570d0 0x7fc13c1483e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:33.307 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:33.302+0000 7fc13a59c640 1 -- 172.21.15.88:0/1513440369 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc13c150f90 msgr2=0x7fc13c147ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:33.307 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:33.302+0000 7fc13a59c640 1 --2- 172.21.15.88:0/1513440369 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc13c150f90 0x7fc13c147ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:33.307 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:33.302+0000 7fc13a59c640 1 -- 172.21.15.88:0/1513440369 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc13c1570d0 msgr2=0x7fc13c1483e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:33.308 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:33.302+0000 7fc13a59c640 1 --2- 172.21.15.88:0/1513440369 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc13c1570d0 0x7fc13c1483e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:33.308 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:33.302+0000 7fc13a59c640 1 -- 172.21.15.88:0/1513440369 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc13c074770 con 0x7fc13c0ab3f0 2024-04-26T23:40:33.308 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:33.302+0000 7fc13a59c640 1 --2- 172.21.15.88:0/1513440369 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc13c0ab3f0 0x7fc13c073d70 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fc12c009860 tx=0x7fc12c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:33.308 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:33.302+0000 7fc132ffd640 1 -- 172.21.15.88:0/1513440369 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc12c037040 con 0x7fc13c0ab3f0 2024-04-26T23:40:33.308 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:33.302+0000 7fc132ffd640 1 -- 172.21.15.88:0/1513440369 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc12c042070 con 0x7fc13c0ab3f0 2024-04-26T23:40:33.308 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:33.302+0000 7fc132ffd640 1 -- 172.21.15.88:0/1513440369 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc12c03b890 con 0x7fc13c0ab3f0 2024-04-26T23:40:33.308 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:33.302+0000 7fc140eb0640 1 -- 172.21.15.88:0/1513440369 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc13c1500e0 con 0x7fc13c0ab3f0 2024-04-26T23:40:33.308 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:33.302+0000 7fc140eb0640 1 -- 172.21.15.88:0/1513440369 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc13c149b70 con 0x7fc13c0ab3f0 2024-04-26T23:40:33.308 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:33.303+0000 7fc140eb0640 1 -- 172.21.15.88:0/1513440369 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc13c0507a0 con 0x7fc13c0ab3f0 2024-04-26T23:40:33.308 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:33.303+0000 7fc132ffd640 1 -- 172.21.15.88:0/1513440369 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc12c02ac90 con 0x7fc13c0ab3f0 2024-04-26T23:40:33.309 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:33.304+0000 7fc132ffd640 1 --2- 172.21.15.88:0/1513440369 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fc11c06c920 0x7fc11c06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:33.309 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:33.304+0000 7fc133fff640 1 --2- 172.21.15.88:0/1513440369 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fc11c06c920 0x7fc11c06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:33.309 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:33.304+0000 7fc132ffd640 1 -- 172.21.15.88:0/1513440369 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 5689+0+0 (secure 0 0 0) 0x7fc12c0abef0 con 0x7fc13c0ab3f0 2024-04-26T23:40:33.309 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:33.304+0000 7fc133fff640 1 --2- 172.21.15.88:0/1513440369 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fc11c06c920 0x7fc11c06ede0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fc13c06f380 tx=0x7fc124007d50 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:33.311 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:33.308+0000 7fc132ffd640 1 -- 172.21.15.88:0/1513440369 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fc13c074770 con 0x7fc13c0ab3f0 2024-04-26T23:40:33.524 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:33.522+0000 7fc140eb0640 1 -- 172.21.15.88:0/1513440369 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "a", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fc13c0c4110 con 0x7fc13c0ab3f0 2024-04-26T23:40:33.630 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:33.627+0000 7fc132ffd640 1 -- 172.21.15.88:0/1513440369 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "a", "var": "standby_count_wanted", "val": "0"}]=0 v6) ==== 113+0+0 (secure 0 0 0) 0x7fc12c079ce0 con 0x7fc13c0ab3f0 2024-04-26T23:40:33.632 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:33.629+0000 7fc140eb0640 1 -- 172.21.15.88:0/1513440369 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fc11c06c920 msgr2=0x7fc11c06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:33.632 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:33.629+0000 7fc140eb0640 1 --2- 172.21.15.88:0/1513440369 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fc11c06c920 0x7fc11c06ede0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fc13c06f380 tx=0x7fc124007d50 comp rx=0 tx=0).stop 2024-04-26T23:40:33.632 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:33.629+0000 7fc140eb0640 1 -- 172.21.15.88:0/1513440369 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc13c0ab3f0 msgr2=0x7fc13c073d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:33.632 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:33.629+0000 7fc140eb0640 1 --2- 172.21.15.88:0/1513440369 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc13c0ab3f0 0x7fc13c073d70 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fc12c009860 tx=0x7fc12c0046c0 comp rx=0 tx=0).stop 2024-04-26T23:40:33.632 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:33.629+0000 7fc140eb0640 1 -- 172.21.15.88:0/1513440369 shutdown_connections 2024-04-26T23:40:33.632 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:33.629+0000 7fc140eb0640 1 --2- 172.21.15.88:0/1513440369 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fc11c06c920 0x7fc11c06ede0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:33.632 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:33.629+0000 7fc140eb0640 1 --2- 172.21.15.88:0/1513440369 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc13c150f90 0x7fc13c147ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:33.633 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:33.629+0000 7fc140eb0640 1 --2- 172.21.15.88:0/1513440369 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc13c1570d0 0x7fc13c1483e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:33.633 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:33.629+0000 7fc140eb0640 1 --2- 172.21.15.88:0/1513440369 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc13c0ab3f0 0x7fc13c073d70 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:33.633 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:33.629+0000 7fc140eb0640 1 -- 172.21.15.88:0/1513440369 >> 172.21.15.88:0/1513440369 conn(0x7fc13c06c310 msgr2=0x7fc13c14ceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:40:33.633 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:33.629+0000 7fc140eb0640 1 -- 172.21.15.88:0/1513440369 shutdown_connections 2024-04-26T23:40:33.633 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:33.629+0000 7fc140eb0640 1 -- 172.21.15.88:0/1513440369 wait complete. 2024-04-26T23:40:33.643 DEBUG:tasks.cephfs.filesystem:fs_config: {'session_timeout': 300} 2024-04-26T23:40:33.643 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set a allow_standby_replay false 2024-04-26T23:40:33.741 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:33.738+0000 7f508f425640 1 Processor -- start 2024-04-26T23:40:33.741 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:33.738+0000 7f508f425640 1 -- start start 2024-04-26T23:40:33.742 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:33.739+0000 7f508f425640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5088154160 0x7f5088156bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:33.742 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:33.739+0000 7f508f425640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f508815a1a0 0x7f50880c9590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:33.742 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:33.739+0000 7f508f425640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f50880c8df0 con 0x7f50880ca5a0 2024-04-26T23:40:33.742 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:33.739+0000 7f508f425640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f50880c9100 con 0x7f508815a1a0 2024-04-26T23:40:33.743 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:33.739+0000 7f508f425640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f5088154540 con 0x7f5088154160 2024-04-26T23:40:33.743 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:33.739+0000 7f508d9c2640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f508815a1a0 0x7f50880c9590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:33.743 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:33.739+0000 7f508c9c0640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f50880ca5a0 0x7f50880c6e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:39804/0 (socket says 172.21.15.88:39804) 2024-04-26T23:40:33.743 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:33.739+0000 7f508c9c0640 1 -- 172.21.15.88:0/1699784343 learned_addr learned my addr 172.21.15.88:0/1699784343 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-26T23:40:33.743 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:33.739+0000 7f508d9c2640 1 -- 172.21.15.88:0/1699784343 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5088154160 msgr2=0x7f5088156bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:40:33.743 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:33.739+0000 7f508d9c2640 1 --2- 172.21.15.88:0/1699784343 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5088154160 0x7f5088156bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:33.743 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:33.739+0000 7f508d9c2640 1 -- 172.21.15.88:0/1699784343 >> v1:172.21.15.88:6789/0 conn(0x7f50880ca5a0 legacy=0x7f50880c6e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:33.743 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:33.739+0000 7f507ffff640 1 -- 172.21.15.88:0/1699784343 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2846632140 0 0) 0x7f5078001110 con 0x7f50880ca5a0 2024-04-26T23:40:33.743 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:33.740+0000 7f508d9c2640 1 -- 172.21.15.88:0/1699784343 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f508815a910 con 0x7f508815a1a0 2024-04-26T23:40:33.744 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:33.740+0000 7f508d9c2640 1 --2- 172.21.15.88:0/1699784343 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f508815a1a0 0x7f50880c9590 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f5080009d90 tx=0x7f508002a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5499a28692952bc1 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:33.744 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:33.740+0000 7f507ffff640 1 -- 172.21.15.88:0/1699784343 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5080007740 con 0x7f508815a1a0 2024-04-26T23:40:33.744 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:33.740+0000 7f507ffff640 1 -- 172.21.15.88:0/1699784343 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50800078e0 con 0x7f508815a1a0 2024-04-26T23:40:33.744 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:33.740+0000 7f507ffff640 1 -- 172.21.15.88:0/1699784343 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5080007cb0 con 0x7f508815a1a0 2024-04-26T23:40:33.744 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:33.741+0000 7f508f425640 1 -- 172.21.15.88:0/1699784343 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f508815a1a0 msgr2=0x7f50880c9590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:33.745 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:33.741+0000 7f508f425640 1 --2- 172.21.15.88:0/1699784343 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f508815a1a0 0x7f50880c9590 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f5080009d90 tx=0x7f508002a660 comp rx=0 tx=0).stop 2024-04-26T23:40:33.745 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:33.741+0000 7f508f425640 1 -- 172.21.15.88:0/1699784343 shutdown_connections 2024-04-26T23:40:33.745 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:33.741+0000 7f508f425640 1 --2- 172.21.15.88:0/1699784343 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f508815a1a0 0x7f50880c9590 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:33.745 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:33.741+0000 7f508f425640 1 --2- 172.21.15.88:0/1699784343 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5088154160 0x7f5088156bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:33.745 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:33.741+0000 7f508f425640 1 -- 172.21.15.88:0/1699784343 >> 172.21.15.88:0/1699784343 conn(0x7f50880ae010 msgr2=0x7f50880ae3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:40:33.745 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:33.741+0000 7f508f425640 1 -- 172.21.15.88:0/1699784343 shutdown_connections 2024-04-26T23:40:33.745 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:33.741+0000 7f508f425640 1 -- 172.21.15.88:0/1699784343 wait complete. 2024-04-26T23:40:33.747 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:33.742+0000 7f508f425640 1 Processor -- start 2024-04-26T23:40:33.747 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:33.742+0000 7f508f425640 1 -- start start 2024-04-26T23:40:33.748 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:33.743+0000 7f508f425640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f50880ca5a0 0x7f50880ad250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:33.748 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:33.743+0000 7f508f425640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5088154160 0x7f50880ad790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:33.748 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:33.743+0000 7f508f425640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f508815a1a0 0x7f5088149200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:33.748 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:33.743+0000 7f508f425640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f508815a630 con 0x7f50880ca5a0 2024-04-26T23:40:33.748 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:33.743+0000 7f508f425640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f508815aed0 con 0x7f508815a1a0 2024-04-26T23:40:33.748 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:33.743+0000 7f508f425640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f50880c7510 con 0x7f5088154160 2024-04-26T23:40:33.748 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:33.743+0000 7f508d1c1640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f50880ca5a0 0x7f50880ad250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:33.748 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:33.743+0000 7f508d1c1640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f50880ca5a0 0x7f50880ad250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:57322/0 (socket says 172.21.15.88:57322) 2024-04-26T23:40:33.748 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:33.743+0000 7f508d1c1640 1 -- 172.21.15.88:0/2486416177 learned_addr learned my addr 172.21.15.88:0/2486416177 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:40:33.748 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:33.743+0000 7f508d1c1640 1 -- 172.21.15.88:0/2486416177 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5088154160 msgr2=0x7f50880ad790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:33.748 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:33.743+0000 7f508d1c1640 1 --2- 172.21.15.88:0/2486416177 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5088154160 0x7f50880ad790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:33.748 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:33.743+0000 7f508d1c1640 1 -- 172.21.15.88:0/2486416177 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f508815a1a0 msgr2=0x7f5088149200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:33.748 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:33.743+0000 7f508d1c1640 1 --2- 172.21.15.88:0/2486416177 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f508815a1a0 0x7f5088149200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:33.748 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:33.743+0000 7f508d1c1640 1 -- 172.21.15.88:0/2486416177 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50880cd180 con 0x7f50880ca5a0 2024-04-26T23:40:33.748 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:33.743+0000 7f508d1c1640 1 --2- 172.21.15.88:0/2486416177 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f50880ca5a0 0x7f50880ad250 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f508400b4a0 tx=0x7f508400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:33.748 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:33.743+0000 7f507dffb640 1 -- 172.21.15.88:0/2486416177 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5084014070 con 0x7f50880ca5a0 2024-04-26T23:40:33.749 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:33.743+0000 7f507dffb640 1 -- 172.21.15.88:0/2486416177 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5084010610 con 0x7f50880ca5a0 2024-04-26T23:40:33.749 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:33.743+0000 7f508f425640 1 -- 172.21.15.88:0/2486416177 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5088152310 con 0x7f50880ca5a0 2024-04-26T23:40:33.749 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:33.743+0000 7f507dffb640 1 -- 172.21.15.88:0/2486416177 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5084010a00 con 0x7f50880ca5a0 2024-04-26T23:40:33.749 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:33.744+0000 7f508f425640 1 -- 172.21.15.88:0/2486416177 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50881528d0 con 0x7f50880ca5a0 2024-04-26T23:40:33.749 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:33.744+0000 7f508f425640 1 -- 172.21.15.88:0/2486416177 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f508814fbb0 con 0x7f50880ca5a0 2024-04-26T23:40:33.749 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:33.745+0000 7f507dffb640 1 -- 172.21.15.88:0/2486416177 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f5084017070 con 0x7f50880ca5a0 2024-04-26T23:40:33.749 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:33.745+0000 7f507dffb640 1 --2- 172.21.15.88:0/2486416177 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f506c06c8f0 0x7f506c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:33.750 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:33.745+0000 7f508c9c0640 1 --2- 172.21.15.88:0/2486416177 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f506c06c8f0 0x7f506c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:33.750 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:33.745+0000 7f507dffb640 1 -- 172.21.15.88:0/2486416177 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5689+0+0 (secure 0 0 0) 0x7f508408b5c0 con 0x7f50880ca5a0 2024-04-26T23:40:33.750 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:33.746+0000 7f508c9c0640 1 --2- 172.21.15.88:0/2486416177 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f506c06c8f0 0x7f506c06edb0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f50880c7ce0 tx=0x7f5078001310 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:33.752 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:33.749+0000 7f507dffb640 1 -- 172.21.15.88:0/2486416177 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f508814fbb0 con 0x7f50880ca5a0 2024-04-26T23:40:33.968 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:33.964+0000 7f508f425640 1 -- 172.21.15.88:0/2486416177 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "a", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f5088076650 con 0x7f50880ca5a0 2024-04-26T23:40:34.631 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:34.627+0000 7f507dffb640 1 -- 172.21.15.88:0/2486416177 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "a", "var": "allow_standby_replay", "val": "false"}]=0 v7) ==== 117+0+0 (secure 0 0 0) 0x7f5084059a00 con 0x7f50880ca5a0 2024-04-26T23:40:34.634 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:34.630+0000 7f508f425640 1 -- 172.21.15.88:0/2486416177 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f506c06c8f0 msgr2=0x7f506c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:34.634 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:34.630+0000 7f508f425640 1 --2- 172.21.15.88:0/2486416177 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f506c06c8f0 0x7f506c06edb0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f50880c7ce0 tx=0x7f5078001310 comp rx=0 tx=0).stop 2024-04-26T23:40:34.634 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:34.630+0000 7f508f425640 1 -- 172.21.15.88:0/2486416177 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f50880ca5a0 msgr2=0x7f50880ad250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:34.634 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:34.630+0000 7f508f425640 1 --2- 172.21.15.88:0/2486416177 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f50880ca5a0 0x7f50880ad250 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f508400b4a0 tx=0x7f508400b960 comp rx=0 tx=0).stop 2024-04-26T23:40:34.635 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:34.630+0000 7f508f425640 1 -- 172.21.15.88:0/2486416177 shutdown_connections 2024-04-26T23:40:34.635 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:34.630+0000 7f508f425640 1 --2- 172.21.15.88:0/2486416177 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f506c06c8f0 0x7f506c06edb0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:34.635 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:34.630+0000 7f508f425640 1 --2- 172.21.15.88:0/2486416177 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5088154160 0x7f50880ad790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:34.635 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:34.630+0000 7f508f425640 1 --2- 172.21.15.88:0/2486416177 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f508815a1a0 0x7f5088149200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:34.635 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:34.630+0000 7f508f425640 1 --2- 172.21.15.88:0/2486416177 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f50880ca5a0 0x7f50880ad250 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:34.635 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:34.630+0000 7f508f425640 1 -- 172.21.15.88:0/2486416177 >> 172.21.15.88:0/2486416177 conn(0x7f50880ae010 msgr2=0x7f508814eab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:40:34.635 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:34.630+0000 7f508f425640 1 -- 172.21.15.88:0/2486416177 shutdown_connections 2024-04-26T23:40:34.635 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:34.630+0000 7f508f425640 1 -- 172.21.15.88:0/2486416177 wait complete. 2024-04-26T23:40:34.647 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set a session_timeout 300 2024-04-26T23:40:34.752 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:34.748+0000 7f61237bf640 1 Processor -- start 2024-04-26T23:40:34.752 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:34.749+0000 7f61237bf640 1 -- start start 2024-04-26T23:40:34.756 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:34.749+0000 7f61237bf640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f611c071cc0 0x7f611c073700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:34.756 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:34.749+0000 7f61237bf640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f611c0707e0 con 0x7f611c13ddd0 2024-04-26T23:40:34.756 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:34.749+0000 7f61237bf640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f611c155450 con 0x7f611c073c40 2024-04-26T23:40:34.756 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:34.749+0000 7f61237bf640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f611c155210 con 0x7f611c071cc0 2024-04-26T23:40:34.756 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:34.749+0000 7f612155b640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f611c13ddd0 0x7f611c154b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:39818/0 (socket says 172.21.15.88:39818) 2024-04-26T23:40:34.757 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:34.749+0000 7f612155b640 1 -- 172.21.15.88:0/2115732986 learned_addr learned my addr 172.21.15.88:0/2115732986 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-26T23:40:34.757 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:34.750+0000 7f6113fff640 1 -- 172.21.15.88:0/2115732986 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1554982600 0 0) 0x7f611c0707e0 con 0x7f611c13ddd0 2024-04-26T23:40:34.757 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:34.750+0000 7f6113fff640 1 -- 172.21.15.88:0/2115732986 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6108003520 con 0x7f611c13ddd0 2024-04-26T23:40:34.757 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:34.750+0000 7f6120d5a640 1 --2- 172.21.15.88:0/2115732986 >> v2:172.21.15.175:3300/0 conn(0x7f611c071cc0 0x7f611c073700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:34.757 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:34.750+0000 7f6113fff640 1 -- 172.21.15.88:0/2115732986 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2532116230 0 0) 0x7f6108003520 con 0x7f611c13ddd0 2024-04-26T23:40:34.757 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:34.750+0000 7f6113fff640 1 -- 172.21.15.88:0/2115732986 >> v2:172.21.15.175:3300/0 conn(0x7f611c071cc0 msgr2=0x7f611c073700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:40:34.757 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:34.750+0000 7f6113fff640 1 --2- 172.21.15.88:0/2115732986 >> v2:172.21.15.175:3300/0 conn(0x7f611c071cc0 0x7f611c073700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:34.757 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:34.750+0000 7f6113fff640 1 -- 172.21.15.88:0/2115732986 >> v1:172.21.15.175:6789/0 conn(0x7f611c073c40 legacy=0x7f611c070f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:34.757 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:34.750+0000 7f6113fff640 1 -- 172.21.15.88:0/2115732986 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f611c155730 con 0x7f611c13ddd0 2024-04-26T23:40:34.757 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:34.750+0000 7f6113fff640 1 -- 172.21.15.88:0/2115732986 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 356324787 0 0) 0x7f61180019f0 con 0x7f611c13ddd0 2024-04-26T23:40:34.757 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:34.750+0000 7f6113fff640 1 -- 172.21.15.88:0/2115732986 >> v1:172.21.15.88:6789/0 conn(0x7f611c13ddd0 legacy=0x7f611c154b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:34.757 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:34.750+0000 7f6113fff640 1 --2- 172.21.15.88:0/2115732986 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f61080039b0 0x7f6108003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:34.757 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:34.750+0000 7f6113fff640 1 --2- 172.21.15.88:0/2115732986 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6108004800 0x7f6108004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:34.758 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:34.750+0000 7f6113fff640 1 --2- 172.21.15.88:0/2115732986 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f61080051c0 0x7f610800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:34.758 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:34.750+0000 7f6113fff640 1 -- 172.21.15.88:0/2115732986 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f611c155210 con 0x7f6108004800 2024-04-26T23:40:34.758 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:34.750+0000 7f6113fff640 1 -- 172.21.15.88:0/2115732986 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f610800c160 con 0x7f61080039b0 2024-04-26T23:40:34.758 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:34.750+0000 7f6113fff640 1 -- 172.21.15.88:0/2115732986 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f610800c360 con 0x7f61080051c0 2024-04-26T23:40:34.758 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:34.750+0000 7f6120d5a640 1 --2- 172.21.15.88:0/2115732986 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6108004800 0x7f6108004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:34.758 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:34.750+0000 7f612155b640 1 --2- 172.21.15.88:0/2115732986 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f61080039b0 0x7f6108003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:34.758 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:34.750+0000 7f6121d5c640 1 --2- 172.21.15.88:0/2115732986 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f61080051c0 0x7f610800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:34.758 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:34.750+0000 7f6120d5a640 1 -- 172.21.15.88:0/2115732986 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f61080051c0 msgr2=0x7f610800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:40:34.758 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:34.750+0000 7f6120d5a640 1 --2- 172.21.15.88:0/2115732986 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f61080051c0 0x7f610800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:34.758 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:34.750+0000 7f6120d5a640 1 -- 172.21.15.88:0/2115732986 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f61080039b0 msgr2=0x7f6108003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:40:34.758 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:34.750+0000 7f6120d5a640 1 --2- 172.21.15.88:0/2115732986 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f61080039b0 0x7f6108003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:34.758 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:34.750+0000 7f6121d5c640 1 -- 172.21.15.88:0/2115732986 reap_dead start 2024-04-26T23:40:34.758 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:34.750+0000 7f6120d5a640 1 -- 172.21.15.88:0/2115732986 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6108003520 con 0x7f6108004800 2024-04-26T23:40:34.758 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:34.751+0000 7f6120d5a640 1 --2- 172.21.15.88:0/2115732986 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6108004800 0x7f6108004c80 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f610c009ac0 tx=0x7f6108005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e7735a10ee8ef27 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:34.759 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:34.751+0000 7f6113fff640 1 -- 172.21.15.88:0/2115732986 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f610c036070 con 0x7f6108004800 2024-04-26T23:40:34.759 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:34.751+0000 7f6113fff640 1 -- 172.21.15.88:0/2115732986 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f610c031400 con 0x7f6108004800 2024-04-26T23:40:34.759 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:34.751+0000 7f6113fff640 1 -- 172.21.15.88:0/2115732986 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f610c009690 con 0x7f6108004800 2024-04-26T23:40:34.759 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:34.752+0000 7f61237bf640 1 -- 172.21.15.88:0/2115732986 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6108004800 msgr2=0x7f6108004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:34.759 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:34.752+0000 7f61237bf640 1 --2- 172.21.15.88:0/2115732986 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6108004800 0x7f6108004c80 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f610c009ac0 tx=0x7f6108005830 comp rx=0 tx=0).stop 2024-04-26T23:40:34.759 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:34.752+0000 7f61237bf640 1 -- 172.21.15.88:0/2115732986 shutdown_connections 2024-04-26T23:40:34.759 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:34.752+0000 7f61237bf640 1 --2- 172.21.15.88:0/2115732986 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6108004800 0x7f6108004c80 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:34.759 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:34.752+0000 7f61237bf640 1 -- 172.21.15.88:0/2115732986 >> 172.21.15.88:0/2115732986 conn(0x7f611c0ca2f0 msgr2=0x7f611c0ca6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:40:34.759 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:34.752+0000 7f61237bf640 1 -- 172.21.15.88:0/2115732986 shutdown_connections 2024-04-26T23:40:34.759 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:34.752+0000 7f61237bf640 1 -- 172.21.15.88:0/2115732986 wait complete. 2024-04-26T23:40:34.762 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:34.753+0000 7f61237bf640 1 Processor -- start 2024-04-26T23:40:34.762 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:34.753+0000 7f61237bf640 1 -- start start 2024-04-26T23:40:34.762 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:34.753+0000 7f61237bf640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6108004800 0x7f611c136e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:34.762 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:34.753+0000 7f61237bf640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f611c153580 0x7f611c153a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:34.762 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:34.753+0000 7f61237bf640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f611c1ecc60 0x7f611c1ed0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:34.762 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:34.754+0000 7f61237bf640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f611c13e330 con 0x7f611c153580 2024-04-26T23:40:34.762 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:34.754+0000 7f61237bf640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f611c13e1b0 con 0x7f611c1ecc60 2024-04-26T23:40:34.762 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:34.754+0000 7f61237bf640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f611c0ab470 con 0x7f6108004800 2024-04-26T23:40:34.762 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:34.754+0000 7f6120d5a640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f611c153580 0x7f611c153a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:34.763 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:34.754+0000 7f6120d5a640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f611c153580 0x7f611c153a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:57340/0 (socket says 172.21.15.88:57340) 2024-04-26T23:40:34.763 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:34.754+0000 7f6120d5a640 1 -- 172.21.15.88:0/4266438435 learned_addr learned my addr 172.21.15.88:0/4266438435 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:40:34.763 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:34.754+0000 7f612155b640 1 --2- 172.21.15.88:0/4266438435 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6108004800 0x7f611c136e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:34.763 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:34.754+0000 7f6120d5a640 1 -- 172.21.15.88:0/4266438435 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6108004800 msgr2=0x7f611c136e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:34.763 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:34.754+0000 7f6120d5a640 1 --2- 172.21.15.88:0/4266438435 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6108004800 0x7f611c136e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:34.763 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:34.754+0000 7f6120d5a640 1 -- 172.21.15.88:0/4266438435 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f611c1ecc60 msgr2=0x7f611c1ed0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:34.763 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:34.754+0000 7f6120d5a640 1 --2- 172.21.15.88:0/4266438435 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f611c1ecc60 0x7f611c1ed0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:34.763 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:34.754+0000 7f6120d5a640 1 -- 172.21.15.88:0/4266438435 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f611c06c310 con 0x7f611c153580 2024-04-26T23:40:34.763 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:34.754+0000 7f6120d5a640 1 --2- 172.21.15.88:0/4266438435 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f611c153580 0x7f611c153a00 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f610c034040 tx=0x7f610c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:34.763 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:34.754+0000 7f6111ffb640 1 -- 172.21.15.88:0/4266438435 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f610c03f020 con 0x7f611c153580 2024-04-26T23:40:34.763 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:34.754+0000 7f6111ffb640 1 -- 172.21.15.88:0/4266438435 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f610c037040 con 0x7f611c153580 2024-04-26T23:40:34.763 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:34.754+0000 7f61237bf640 1 -- 172.21.15.88:0/4266438435 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f611c1373d0 con 0x7f611c153580 2024-04-26T23:40:34.764 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:34.754+0000 7f6111ffb640 1 -- 172.21.15.88:0/4266438435 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f610c036070 con 0x7f611c153580 2024-04-26T23:40:34.764 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:34.754+0000 7f61237bf640 1 -- 172.21.15.88:0/4266438435 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f611c1f0ad0 con 0x7f611c153580 2024-04-26T23:40:34.764 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:34.755+0000 7f61237bf640 1 -- 172.21.15.88:0/4266438435 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f611c074d50 con 0x7f611c153580 2024-04-26T23:40:34.764 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:34.756+0000 7f6111ffb640 1 -- 172.21.15.88:0/4266438435 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f610c042020 con 0x7f611c153580 2024-04-26T23:40:34.764 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:34.756+0000 7f6111ffb640 1 --2- 172.21.15.88:0/4266438435 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f610006c8f0 0x7f610006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:34.764 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:34.756+0000 7f6111ffb640 1 -- 172.21.15.88:0/4266438435 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5689+0+0 (secure 0 0 0) 0x7f610c0abb60 con 0x7f611c153580 2024-04-26T23:40:34.764 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:34.756+0000 7f612155b640 1 --2- 172.21.15.88:0/4266438435 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f610006c8f0 0x7f610006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:34.764 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:34.757+0000 7f612155b640 1 --2- 172.21.15.88:0/4266438435 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f610006c8f0 0x7f610006edb0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f611c1590f0 tx=0x7f6118006040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:34.764 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:34.761+0000 7f6111ffb640 1 -- 172.21.15.88:0/4266438435 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f610c049030 con 0x7f611c153580 2024-04-26T23:40:34.976 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:34.972+0000 7f61237bf640 1 -- 172.21.15.88:0/4266438435 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "a", "var": "session_timeout", "val": "300"} v 0) -- 0x7f611c076650 con 0x7f611c153580 2024-04-26T23:40:35.635 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:35.632+0000 7f6111ffb640 1 -- 172.21.15.88:0/4266438435 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "a", "var": "session_timeout", "val": "300"}]=0 v8) ==== 110+0+0 (secure 0 0 0) 0x7f611c1373d0 con 0x7f611c153580 2024-04-26T23:40:35.638 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:35.634+0000 7f61237bf640 1 -- 172.21.15.88:0/4266438435 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f610006c8f0 msgr2=0x7f610006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:35.638 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:35.634+0000 7f61237bf640 1 --2- 172.21.15.88:0/4266438435 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f610006c8f0 0x7f610006edb0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f611c1590f0 tx=0x7f6118006040 comp rx=0 tx=0).stop 2024-04-26T23:40:35.639 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:35.634+0000 7f61237bf640 1 -- 172.21.15.88:0/4266438435 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f611c153580 msgr2=0x7f611c153a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:35.639 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:35.634+0000 7f61237bf640 1 --2- 172.21.15.88:0/4266438435 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f611c153580 0x7f611c153a00 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f610c034040 tx=0x7f610c004730 comp rx=0 tx=0).stop 2024-04-26T23:40:35.639 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:35.634+0000 7f61237bf640 1 -- 172.21.15.88:0/4266438435 shutdown_connections 2024-04-26T23:40:35.639 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:35.634+0000 7f61237bf640 1 --2- 172.21.15.88:0/4266438435 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f610006c8f0 0x7f610006edb0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:35.639 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:35.634+0000 7f61237bf640 1 --2- 172.21.15.88:0/4266438435 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f611c1ecc60 0x7f611c1ed0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:35.639 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:35.634+0000 7f61237bf640 1 --2- 172.21.15.88:0/4266438435 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f611c153580 0x7f611c153a00 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:35.639 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:35.634+0000 7f61237bf640 1 --2- 172.21.15.88:0/4266438435 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6108004800 0x7f611c136e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:35.639 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:35.634+0000 7f61237bf640 1 -- 172.21.15.88:0/4266438435 >> 172.21.15.88:0/4266438435 conn(0x7f611c0ca2f0 msgr2=0x7f611c0ca6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:40:35.639 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:35.634+0000 7f61237bf640 1 -- 172.21.15.88:0/4266438435 shutdown_connections 2024-04-26T23:40:35.639 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:35.634+0000 7f61237bf640 1 -- 172.21.15.88:0/4266438435 wait complete. 2024-04-26T23:40:35.650 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'a' 2024-04-26T23:40:35.650 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T23:40:35.750 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:35.746+0000 7f866b3b7640 1 Processor -- start 2024-04-26T23:40:35.750 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:35.746+0000 7f866b3b7640 1 -- start start 2024-04-26T23:40:35.752 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:35.747+0000 7f866b3b7640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f86640c6e20 0x7f86640c7200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:35.752 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:35.747+0000 7f866b3b7640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f86640740e0 0x7f8664156f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:35.752 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:35.747+0000 7f866b3b7640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f86640ca3a0 0x7f8664157460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:35.752 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:35.747+0000 7f866b3b7640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f8664072930 con 0x7f86640740e0 2024-04-26T23:40:35.752 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:35.747+0000 7f866b3b7640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f866415a530 con 0x7f86640c6e20 2024-04-26T23:40:35.752 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:35.747+0000 7f866b3b7640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f866415a810 con 0x7f86640ca3a0 2024-04-26T23:40:35.752 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:35.747+0000 7f8668952640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f86640740e0 0x7f8664156f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:35.752 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:35.747+0000 7f8668952640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f86640740e0 0x7f8664156f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:57350/0 (socket says 172.21.15.88:57350) 2024-04-26T23:40:35.753 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:35.747+0000 7f8668952640 1 -- 172.21.15.88:0/469071535 learned_addr learned my addr 172.21.15.88:0/469071535 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:40:35.753 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:35.747+0000 7f8669954640 1 --2- 172.21.15.88:0/469071535 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f86640ca3a0 0x7f8664157460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:35.753 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:35.747+0000 7f8669153640 1 --2- 172.21.15.88:0/469071535 >> v2:172.21.15.175:3300/0 conn(0x7f86640c6e20 0x7f86640c7200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:35.753 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:35.747+0000 7f8668952640 1 -- 172.21.15.88:0/469071535 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f86640ca3a0 msgr2=0x7f8664157460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:40:35.753 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:35.747+0000 7f8668952640 1 --2- 172.21.15.88:0/469071535 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f86640ca3a0 0x7f8664157460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:35.753 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:35.747+0000 7f8668952640 1 -- 172.21.15.88:0/469071535 >> v2:172.21.15.175:3300/0 conn(0x7f86640c6e20 msgr2=0x7f86640c7200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:40:35.753 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:35.747+0000 7f8668952640 1 --2- 172.21.15.88:0/469071535 >> v2:172.21.15.175:3300/0 conn(0x7f86640c6e20 0x7f86640c7200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:35.753 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:35.747+0000 7f8668952640 1 -- 172.21.15.88:0/469071535 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f866415aaf0 con 0x7f86640740e0 2024-04-26T23:40:35.753 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:35.747+0000 7f8669153640 1 --2- 172.21.15.88:0/469071535 >> v2:172.21.15.175:3300/0 conn(0x7f86640c6e20 0x7f86640c7200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:40:35.753 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:35.748+0000 7f8668952640 1 --2- 172.21.15.88:0/469071535 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f86640740e0 0x7f8664156f20 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f86640af0b0 tx=0x7f865402a0b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de4913a3a6300de8 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:35.753 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:35.748+0000 7f865bfff640 1 -- 172.21.15.88:0/469071535 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8654037070 con 0x7f86640740e0 2024-04-26T23:40:35.753 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:35.748+0000 7f865bfff640 1 -- 172.21.15.88:0/469071535 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f865402ae00 con 0x7f86640740e0 2024-04-26T23:40:35.754 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:35.748+0000 7f865bfff640 1 -- 172.21.15.88:0/469071535 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8654032660 con 0x7f86640740e0 2024-04-26T23:40:35.758 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:35.749+0000 7f866b3b7640 1 -- 172.21.15.88:0/469071535 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f86640740e0 msgr2=0x7f8664156f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:35.758 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:35.749+0000 7f866b3b7640 1 --2- 172.21.15.88:0/469071535 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f86640740e0 0x7f8664156f20 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f86640af0b0 tx=0x7f865402a0b0 comp rx=0 tx=0).stop 2024-04-26T23:40:35.758 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:35.749+0000 7f866b3b7640 1 -- 172.21.15.88:0/469071535 shutdown_connections 2024-04-26T23:40:35.758 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:35.749+0000 7f866b3b7640 1 --2- 172.21.15.88:0/469071535 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f86640ca3a0 0x7f8664157460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:35.758 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:35.749+0000 7f866b3b7640 1 --2- 172.21.15.88:0/469071535 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f86640740e0 0x7f8664156f20 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:35.758 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:35.749+0000 7f866b3b7640 1 --2- 172.21.15.88:0/469071535 >> v2:172.21.15.175:3300/0 conn(0x7f86640c6e20 0x7f86640c7200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:35.758 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:35.749+0000 7f866b3b7640 1 -- 172.21.15.88:0/469071535 >> 172.21.15.88:0/469071535 conn(0x7f86640ae0b0 msgr2=0x7f86640ae490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:40:35.758 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:35.749+0000 7f866b3b7640 1 -- 172.21.15.88:0/469071535 shutdown_connections 2024-04-26T23:40:35.758 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:35.749+0000 7f866b3b7640 1 -- 172.21.15.88:0/469071535 wait complete. 2024-04-26T23:40:35.758 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:35.750+0000 7f866b3b7640 1 Processor -- start 2024-04-26T23:40:35.759 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:35.750+0000 7f866b3b7640 1 -- start start 2024-04-26T23:40:35.759 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:35.750+0000 7f866b3b7640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f86640740e0 0x7f8664158350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:35.759 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:35.750+0000 7f866b3b7640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f86640c6e20 0x7f86641e35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:35.759 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:35.750+0000 7f866b3b7640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f86640ca3a0 0x7f8664146de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:35.759 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:35.750+0000 7f866b3b7640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f86641543c0 con 0x7f86640740e0 2024-04-26T23:40:35.759 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:35.750+0000 7f866b3b7640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f86641579a0 con 0x7f86640ca3a0 2024-04-26T23:40:35.759 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:35.750+0000 7f866b3b7640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f8664154540 con 0x7f86640c6e20 2024-04-26T23:40:35.759 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:35.750+0000 7f8669153640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f86640740e0 0x7f8664158350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:35.759 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:35.750+0000 7f8669153640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f86640740e0 0x7f8664158350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:57364/0 (socket says 172.21.15.88:57364) 2024-04-26T23:40:35.759 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:35.750+0000 7f8669153640 1 -- 172.21.15.88:0/3870972147 learned_addr learned my addr 172.21.15.88:0/3870972147 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:40:35.759 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:35.751+0000 7f8668952640 1 --2- 172.21.15.88:0/3870972147 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f86640c6e20 0x7f86641e35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:35.759 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:35.751+0000 7f8669954640 1 --2- 172.21.15.88:0/3870972147 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f86640ca3a0 0x7f8664146de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:35.760 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:35.751+0000 7f8669153640 1 -- 172.21.15.88:0/3870972147 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f86640c6e20 msgr2=0x7f86641e35e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:35.760 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:35.751+0000 7f8669153640 1 --2- 172.21.15.88:0/3870972147 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f86640c6e20 0x7f86641e35e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:35.760 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:35.751+0000 7f8669153640 1 -- 172.21.15.88:0/3870972147 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f86640ca3a0 msgr2=0x7f8664146de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:35.760 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:35.751+0000 7f8669153640 1 --2- 172.21.15.88:0/3870972147 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f86640ca3a0 0x7f8664146de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:35.760 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:35.751+0000 7f8669153640 1 -- 172.21.15.88:0/3870972147 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8664158890 con 0x7f86640740e0 2024-04-26T23:40:35.760 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:35.751+0000 7f8669954640 1 --2- 172.21.15.88:0/3870972147 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f86640ca3a0 0x7f8664146de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:40:35.760 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:35.751+0000 7f8669153640 1 --2- 172.21.15.88:0/3870972147 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f86640740e0 0x7f8664158350 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f866000d800 tx=0x7f866000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:35.760 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:35.751+0000 7f8659ffb640 1 -- 172.21.15.88:0/3870972147 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8660018070 con 0x7f86640740e0 2024-04-26T23:40:35.760 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:35.751+0000 7f8659ffb640 1 -- 172.21.15.88:0/3870972147 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8660004030 con 0x7f86640740e0 2024-04-26T23:40:35.760 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:35.751+0000 7f866b3b7640 1 -- 172.21.15.88:0/3870972147 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86641f0880 con 0x7f86640740e0 2024-04-26T23:40:35.760 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:35.751+0000 7f8659ffb640 1 -- 172.21.15.88:0/3870972147 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8660004400 con 0x7f86640740e0 2024-04-26T23:40:35.760 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:35.751+0000 7f866b3b7640 1 -- 172.21.15.88:0/3870972147 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8664159180 con 0x7f86640740e0 2024-04-26T23:40:35.760 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:35.752+0000 7f866b3b7640 1 -- 172.21.15.88:0/3870972147 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f86640766c0 con 0x7f86640740e0 2024-04-26T23:40:35.761 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:35.753+0000 7f8659ffb640 1 -- 172.21.15.88:0/3870972147 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f86600096a0 con 0x7f86640740e0 2024-04-26T23:40:35.761 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:35.753+0000 7f8659ffb640 1 --2- 172.21.15.88:0/3870972147 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f864806c8f0 0x7f864806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:35.761 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:35.753+0000 7f8659ffb640 1 -- 172.21.15.88:0/3870972147 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5689+0+0 (secure 0 0 0) 0x7f866008be10 con 0x7f86640740e0 2024-04-26T23:40:35.761 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:35.753+0000 7f8668952640 1 --2- 172.21.15.88:0/3870972147 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f864806c8f0 0x7f864806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:35.761 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:35.753+0000 7f8668952640 1 --2- 172.21.15.88:0/3870972147 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f864806c8f0 0x7f864806edb0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f8654034000 tx=0x7f865402e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:35.761 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:35.757+0000 7f8659ffb640 1 -- 172.21.15.88:0/3870972147 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f866005a2e0 con 0x7f86640740e0 2024-04-26T23:40:35.974 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:35.970+0000 7f866b3b7640 1 -- 172.21.15.88:0/3870972147 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f86640c6750 con 0x7f86640740e0 2024-04-26T23:40:35.975 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:35.971+0000 7f8659ffb640 1 -- 172.21.15.88:0/3870972147 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5177 (secure 0 0 0) 0x7f8660059be0 con 0x7f86640740e0 2024-04-26T23:40:35.975 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-26T23:40:35.975 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6834/3199540397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":3199540397},{"type":"v1","addr":"172.21.15.175:6834","nonce":3199540397}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4270,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6837/2790134952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6835","nonce":2790134952},{"type":"v1","addr":"172.21.15.88:6837","nonce":2790134952}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4272,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6836/4159390276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6834","nonce":4159390276},{"type":"v1","addr":"172.21.15.88:6836","nonce":4159390276}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T23:40:31.909505+0000","modified":"2024-04-26T23:40:34.974455+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4279},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4279":{"gid":4279,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.175:6835/3932058274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6833","nonce":3932058274},{"type":"v1","addr":"172.21.15.175:6835","nonce":3932058274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4279,"qdb_cluster":[4279]},"id":1}]} 2024-04-26T23:40:35.975 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 8 2024-04-26T23:40:35.977 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:35.973+0000 7f866b3b7640 1 -- 172.21.15.88:0/3870972147 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f864806c8f0 msgr2=0x7f864806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:35.977 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:35.973+0000 7f866b3b7640 1 --2- 172.21.15.88:0/3870972147 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f864806c8f0 0x7f864806edb0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f8654034000 tx=0x7f865402e000 comp rx=0 tx=0).stop 2024-04-26T23:40:35.977 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:35.973+0000 7f866b3b7640 1 -- 172.21.15.88:0/3870972147 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f86640740e0 msgr2=0x7f8664158350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:35.977 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:35.973+0000 7f866b3b7640 1 --2- 172.21.15.88:0/3870972147 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f86640740e0 0x7f8664158350 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f866000d800 tx=0x7f866000dcc0 comp rx=0 tx=0).stop 2024-04-26T23:40:35.977 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:35.973+0000 7f866b3b7640 1 -- 172.21.15.88:0/3870972147 shutdown_connections 2024-04-26T23:40:35.977 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:35.973+0000 7f866b3b7640 1 --2- 172.21.15.88:0/3870972147 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f864806c8f0 0x7f864806edb0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:35.977 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:35.973+0000 7f866b3b7640 1 --2- 172.21.15.88:0/3870972147 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f86640c6e20 0x7f86641e35e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:35.977 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:35.973+0000 7f866b3b7640 1 --2- 172.21.15.88:0/3870972147 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f86640ca3a0 0x7f8664146de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:35.977 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:35.973+0000 7f866b3b7640 1 --2- 172.21.15.88:0/3870972147 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f86640740e0 0x7f8664158350 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:35.977 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:35.973+0000 7f866b3b7640 1 -- 172.21.15.88:0/3870972147 >> 172.21.15.88:0/3870972147 conn(0x7f86640ae0b0 msgr2=0x7f8664072ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:40:35.977 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:35.973+0000 7f866b3b7640 1 -- 172.21.15.88:0/3870972147 shutdown_connections 2024-04-26T23:40:35.977 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:35.973+0000 7f866b3b7640 1 -- 172.21.15.88:0/3870972147 wait complete. 2024-04-26T23:40:35.987 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T23:40:36.084 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:36.080+0000 7fcff4e99640 1 Processor -- start 2024-04-26T23:40:36.084 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:36.080+0000 7fcff4e99640 1 -- start start 2024-04-26T23:40:36.086 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:36.080+0000 7fcff4e99640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fcff00aecf0 0x7fcff00c3800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:36.086 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:36.080+0000 7fcff4e99640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcff00c4820 0x7fcff0073a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:36.087 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:36.081+0000 7fcff4e99640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcff0156f60 con 0x7fcff00c3d40 2024-04-26T23:40:36.087 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:36.081+0000 7fcff4e99640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7fcff0157240 con 0x7fcff00aecf0 2024-04-26T23:40:36.087 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:36.081+0000 7fcff4e99640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fcff0157520 con 0x7fcff00c4820 2024-04-26T23:40:36.087 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:36.081+0000 7fcfee59c640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fcff00aecf0 0x7fcff00c3800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:36.087 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:36.081+0000 7fcfee59c640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fcff00aecf0 0x7fcff00c3800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:57376/0 (socket says 172.21.15.88:57376) 2024-04-26T23:40:36.087 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:36.081+0000 7fcfee59c640 1 -- 172.21.15.88:0/446369676 learned_addr learned my addr 172.21.15.88:0/446369676 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:40:36.087 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:36.081+0000 7fcfe7fff640 1 --2- 172.21.15.88:0/446369676 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcff00c4820 0x7fcff0073a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:36.087 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:36.081+0000 7fcfee59c640 1 -- 172.21.15.88:0/446369676 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcff00c4820 msgr2=0x7fcff0073a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:40:36.087 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:36.081+0000 7fcfee59c640 1 --2- 172.21.15.88:0/446369676 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcff00c4820 0x7fcff0073a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:36.087 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:36.081+0000 7fcfee59c640 1 -- 172.21.15.88:0/446369676 >> v1:172.21.15.175:6789/0 conn(0x7fcff00c3d40 legacy=0x7fcff0073fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:40:36.087 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:36.081+0000 7fcfee59c640 1 -- 172.21.15.88:0/446369676 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcff0157800 con 0x7fcff00aecf0 2024-04-26T23:40:36.087 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:36.082+0000 7fcfee59c640 1 --2- 172.21.15.88:0/446369676 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcff00aecf0 0x7fcff00c3800 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fcfe0009870 tx=0x7fcfe002a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af287f615ae6778b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:36.087 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:36.082+0000 7fcfedd9b640 1 -- 172.21.15.88:0/446369676 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfe0037070 con 0x7fcff00aecf0 2024-04-26T23:40:36.087 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:36.082+0000 7fcfedd9b640 1 -- 172.21.15.88:0/446369676 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcfe0032440 con 0x7fcff00aecf0 2024-04-26T23:40:36.088 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:36.082+0000 7fcfedd9b640 1 -- 172.21.15.88:0/446369676 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfe0032810 con 0x7fcff00aecf0 2024-04-26T23:40:36.088 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:36.082+0000 7fcff4e99640 1 -- 172.21.15.88:0/446369676 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcff00aecf0 msgr2=0x7fcff00c3800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:36.088 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:36.082+0000 7fcff4e99640 1 --2- 172.21.15.88:0/446369676 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcff00aecf0 0x7fcff00c3800 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fcfe0009870 tx=0x7fcfe002a180 comp rx=0 tx=0).stop 2024-04-26T23:40:36.088 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:36.082+0000 7fcff4e99640 1 -- 172.21.15.88:0/446369676 shutdown_connections 2024-04-26T23:40:36.088 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:36.082+0000 7fcff4e99640 1 --2- 172.21.15.88:0/446369676 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcff00c4820 0x7fcff0073a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:36.088 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:36.082+0000 7fcff4e99640 1 --2- 172.21.15.88:0/446369676 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcff00aecf0 0x7fcff00c3800 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:36.088 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:36.082+0000 7fcff4e99640 1 -- 172.21.15.88:0/446369676 >> 172.21.15.88:0/446369676 conn(0x7fcff00c6ed0 msgr2=0x7fcff00c72b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:40:36.088 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:36.082+0000 7fcff4e99640 1 -- 172.21.15.88:0/446369676 shutdown_connections 2024-04-26T23:40:36.088 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:36.082+0000 7fcff4e99640 1 -- 172.21.15.88:0/446369676 wait complete. 2024-04-26T23:40:36.091 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:36.083+0000 7fcff4e99640 1 Processor -- start 2024-04-26T23:40:36.091 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:36.083+0000 7fcff4e99640 1 -- start start 2024-04-26T23:40:36.091 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:36.084+0000 7fcff4e99640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcff00aecf0 0x7fcff014ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:36.091 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:36.084+0000 7fcff4e99640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcff00c3d40 0x7fcff0159920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:36.091 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:36.084+0000 7fcff4e99640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcff00c4820 0x7fcff00c4cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:36.091 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:36.084+0000 7fcff4e99640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fcff0156c10 con 0x7fcff00c4820 2024-04-26T23:40:36.091 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:36.084+0000 7fcff4e99640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fcff00746c0 con 0x7fcff00c3d40 2024-04-26T23:40:36.091 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:36.084+0000 7fcff4e99640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fcff00af0d0 con 0x7fcff00aecf0 2024-04-26T23:40:36.092 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:36.084+0000 7fcfeed9d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcff00c4820 0x7fcff00c4cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:36.092 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:36.084+0000 7fcfeed9d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcff00c4820 0x7fcff00c4cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:57380/0 (socket says 172.21.15.88:57380) 2024-04-26T23:40:36.092 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:36.084+0000 7fcfeed9d640 1 -- 172.21.15.88:0/2210197482 learned_addr learned my addr 172.21.15.88:0/2210197482 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:40:36.092 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:36.084+0000 7fcfee59c640 1 --2- 172.21.15.88:0/2210197482 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcff00aecf0 0x7fcff014ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:36.092 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:36.084+0000 7fcfe7fff640 1 --2- 172.21.15.88:0/2210197482 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcff00c3d40 0x7fcff0159920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:36.092 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:36.084+0000 7fcfeed9d640 1 -- 172.21.15.88:0/2210197482 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcff00aecf0 msgr2=0x7fcff014ee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:36.092 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:36.084+0000 7fcfeed9d640 1 --2- 172.21.15.88:0/2210197482 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcff00aecf0 0x7fcff014ee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:36.092 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:36.084+0000 7fcfeed9d640 1 -- 172.21.15.88:0/2210197482 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcff00c3d40 msgr2=0x7fcff0159920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:36.092 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:36.085+0000 7fcfeed9d640 1 --2- 172.21.15.88:0/2210197482 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcff00c3d40 0x7fcff0159920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:36.092 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:36.085+0000 7fcfeed9d640 1 -- 172.21.15.88:0/2210197482 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcff01ec6b0 con 0x7fcff00c4820 2024-04-26T23:40:36.092 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:36.085+0000 7fcfee59c640 1 --2- 172.21.15.88:0/2210197482 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcff00aecf0 0x7fcff014ee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:40:36.092 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:36.085+0000 7fcfe7fff640 1 --2- 172.21.15.88:0/2210197482 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcff00c3d40 0x7fcff0159920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:40:36.092 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:36.085+0000 7fcfeed9d640 1 --2- 172.21.15.88:0/2210197482 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcff00c4820 0x7fcff00c4cd0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fcfe800c780 tx=0x7fcfe800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:36.093 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:36.085+0000 7fcfe6ffd640 1 -- 172.21.15.88:0/2210197482 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfe8004b60 con 0x7fcff00c4820 2024-04-26T23:40:36.093 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:36.085+0000 7fcfe6ffd640 1 -- 172.21.15.88:0/2210197482 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcfe8004d00 con 0x7fcff00c4820 2024-04-26T23:40:36.093 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:36.085+0000 7fcff4e99640 1 -- 172.21.15.88:0/2210197482 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcff0071130 con 0x7fcff00c4820 2024-04-26T23:40:36.093 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:36.085+0000 7fcfe6ffd640 1 -- 172.21.15.88:0/2210197482 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfe800aa90 con 0x7fcff00c4820 2024-04-26T23:40:36.093 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:36.085+0000 7fcff4e99640 1 -- 172.21.15.88:0/2210197482 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcff01e3f60 con 0x7fcff00c4820 2024-04-26T23:40:36.093 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:36.086+0000 7fcff4e99640 1 -- 172.21.15.88:0/2210197482 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcff01e3a70 con 0x7fcff00c4820 2024-04-26T23:40:36.093 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:36.086+0000 7fcfe6ffd640 1 -- 172.21.15.88:0/2210197482 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fcfe800ac30 con 0x7fcff00c4820 2024-04-26T23:40:36.093 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:36.087+0000 7fcfe6ffd640 1 --2- 172.21.15.88:0/2210197482 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fcfd006c8f0 0x7fcfd006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:36.093 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:36.087+0000 7fcfee59c640 1 --2- 172.21.15.88:0/2210197482 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fcfd006c8f0 0x7fcfd006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:36.093 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:36.087+0000 7fcfe6ffd640 1 -- 172.21.15.88:0/2210197482 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5689+0+0 (secure 0 0 0) 0x7fcfe808bd50 con 0x7fcff00c4820 2024-04-26T23:40:36.094 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:36.087+0000 7fcfee59c640 1 --2- 172.21.15.88:0/2210197482 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fcfd006c8f0 0x7fcfd006edb0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fcfe0034000 tx=0x7fcfe002e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:36.095 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:36.091+0000 7fcfe6ffd640 1 -- 172.21.15.88:0/2210197482 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fcfe808f030 con 0x7fcff00c4820 2024-04-26T23:40:36.273 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:36.270+0000 7fcff4e99640 1 -- 172.21.15.88:0/2210197482 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fcff00507a0 con 0x7fcff00c4820 2024-04-26T23:40:36.274 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:36.271+0000 7fcfe6ffd640 1 -- 172.21.15.88:0/2210197482 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16585 (secure 0 0 0) 0x7fcfe8020070 con 0x7fcff00c4820 2024-04-26T23:40:36.275 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-26T23:40:36.275 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":20,"fsid":"555255e9-7ef9-4454-8dc9-35e96b70035c","created":"2024-04-26T23:40:07.836009+0000","modified":"2024-04-26T23:40:33.574507+0000","last_up_change":"2024-04-26T23:40:18.831369+0000","last_in_change":"2024-04-26T23:40:09.944777+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T23:40:19.936127+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"a_metadata","create_time":"2024-04-26T23:40:29.837465+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"a_data","create_time":"2024-04-26T23:40:30.868651+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"92aecea3-ed62-4a29-87c0-76758a0816a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":2803186054},{"type":"v1","addr":"172.21.15.88:6801","nonce":2803186054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":2803186054},{"type":"v1","addr":"172.21.15.88:6803","nonce":2803186054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":2803186054},{"type":"v1","addr":"172.21.15.88:6807","nonce":2803186054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":2803186054},{"type":"v1","addr":"172.21.15.88:6805","nonce":2803186054}]},"public_addr":"172.21.15.88:6801/2803186054","cluster_addr":"172.21.15.88:6803/2803186054","heartbeat_back_addr":"172.21.15.88:6807/2803186054","heartbeat_front_addr":"172.21.15.88:6805/2803186054","state":["exists","up"]},{"osd":1,"uuid":"7a6f0fa9-23d0-4747-880f-798d45ec5eeb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":1897380484},{"type":"v1","addr":"172.21.15.88:6817","nonce":1897380484}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":1897380484},{"type":"v1","addr":"172.21.15.88:6819","nonce":1897380484}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1897380484},{"type":"v1","addr":"172.21.15.88:6823","nonce":1897380484}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":1897380484},{"type":"v1","addr":"172.21.15.88:6821","nonce":1897380484}]},"public_addr":"172.21.15.88:6817/1897380484","cluster_addr":"172.21.15.88:6819/1897380484","heartbeat_back_addr":"172.21.15.88:6823/1897380484","heartbeat_front_addr":"172.21.15.88:6821/1897380484","state":["exists","up"]},{"osd":2,"uuid":"6be88ea0-e133-4200-a4b5-f92d664b248a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":648396269},{"type":"v1","addr":"172.21.15.88:6809","nonce":648396269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":648396269},{"type":"v1","addr":"172.21.15.88:6811","nonce":648396269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":648396269},{"type":"v1","addr":"172.21.15.88:6815","nonce":648396269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":648396269},{"type":"v1","addr":"172.21.15.88:6813","nonce":648396269}]},"public_addr":"172.21.15.88:6809/648396269","cluster_addr":"172.21.15.88:6811/648396269","heartbeat_back_addr":"172.21.15.88:6815/648396269","heartbeat_front_addr":"172.21.15.88:6813/648396269","state":["exists","up"]},{"osd":3,"uuid":"dcb0746b-7b3d-4ecf-8089-2493a5d1857c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":2328028922},{"type":"v1","addr":"172.21.15.88:6825","nonce":2328028922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":2328028922},{"type":"v1","addr":"172.21.15.88:6827","nonce":2328028922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":2328028922},{"type":"v1","addr":"172.21.15.88:6831","nonce":2328028922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":2328028922},{"type":"v1","addr":"172.21.15.88:6829","nonce":2328028922}]},"public_addr":"172.21.15.88:6825/2328028922","cluster_addr":"172.21.15.88:6827/2328028922","heartbeat_back_addr":"172.21.15.88:6831/2328028922","heartbeat_front_addr":"172.21.15.88:6829/2328028922","state":["exists","up"]},{"osd":4,"uuid":"c483de66-c44f-450e-a4ce-b132d50882c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":3929617402},{"type":"v1","addr":"172.21.15.175:6809","nonce":3929617402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":3929617402},{"type":"v1","addr":"172.21.15.175:6811","nonce":3929617402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":3929617402},{"type":"v1","addr":"172.21.15.175:6815","nonce":3929617402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":3929617402},{"type":"v1","addr":"172.21.15.175:6813","nonce":3929617402}]},"public_addr":"172.21.15.175:6809/3929617402","cluster_addr":"172.21.15.175:6811/3929617402","heartbeat_back_addr":"172.21.15.175:6815/3929617402","heartbeat_front_addr":"172.21.15.175:6813/3929617402","state":["exists","up"]},{"osd":5,"uuid":"ac3b1669-d228-40dd-9f9a-cb46aa73dd6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":2476644457},{"type":"v1","addr":"172.21.15.175:6801","nonce":2476644457}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":2476644457},{"type":"v1","addr":"172.21.15.175:6803","nonce":2476644457}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":2476644457},{"type":"v1","addr":"172.21.15.175:6807","nonce":2476644457}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":2476644457},{"type":"v1","addr":"172.21.15.175:6805","nonce":2476644457}]},"public_addr":"172.21.15.175:6801/2476644457","cluster_addr":"172.21.15.175:6803/2476644457","heartbeat_back_addr":"172.21.15.175:6807/2476644457","heartbeat_front_addr":"172.21.15.175:6805/2476644457","state":["exists","up"]},{"osd":6,"uuid":"7bef4896-857e-4c11-b3b2-c2e9a8548338","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":3824112919},{"type":"v1","addr":"172.21.15.175:6819","nonce":3824112919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6821","nonce":3824112919},{"type":"v1","addr":"172.21.15.175:6824","nonce":3824112919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":3824112919},{"type":"v1","addr":"172.21.15.175:6831","nonce":3824112919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":3824112919},{"type":"v1","addr":"172.21.15.175:6829","nonce":3824112919}]},"public_addr":"172.21.15.175:6819/3824112919","cluster_addr":"172.21.15.175:6824/3824112919","heartbeat_back_addr":"172.21.15.175:6831/3824112919","heartbeat_front_addr":"172.21.15.175:6829/3824112919","state":["exists","up"]},{"osd":7,"uuid":"e18d9e09-8673-470d-b9dc-280a409b63f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6817","nonce":3319361162},{"type":"v1","addr":"172.21.15.175:6818","nonce":3319361162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":3319361162},{"type":"v1","addr":"172.21.15.175:6822","nonce":3319361162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6827","nonce":3319361162},{"type":"v1","addr":"172.21.15.175:6828","nonce":3319361162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6823","nonce":3319361162},{"type":"v1","addr":"172.21.15.175:6825","nonce":3319361162}]},"public_addr":"172.21.15.175:6818/3319361162","cluster_addr":"172.21.15.175:6822/3319361162","heartbeat_back_addr":"172.21.15.175:6828/3319361162","heartbeat_front_addr":"172.21.15.175:6825/3319361162","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:40:15.126268+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:40:15.050614+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:40:14.995164+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:40:15.078112+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:40:15.159637+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:40:15.091226+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:40:15.140316+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:40:15.089431+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:40:36.277 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:36.273+0000 7fcff4e99640 1 -- 172.21.15.88:0/2210197482 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fcfd006c8f0 msgr2=0x7fcfd006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:36.277 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:36.273+0000 7fcff4e99640 1 --2- 172.21.15.88:0/2210197482 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fcfd006c8f0 0x7fcfd006edb0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fcfe0034000 tx=0x7fcfe002e000 comp rx=0 tx=0).stop 2024-04-26T23:40:36.277 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:36.273+0000 7fcff4e99640 1 -- 172.21.15.88:0/2210197482 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcff00c4820 msgr2=0x7fcff00c4cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:36.277 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:36.273+0000 7fcff4e99640 1 --2- 172.21.15.88:0/2210197482 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcff00c4820 0x7fcff00c4cd0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fcfe800c780 tx=0x7fcfe800cc40 comp rx=0 tx=0).stop 2024-04-26T23:40:36.277 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:36.273+0000 7fcff4e99640 1 -- 172.21.15.88:0/2210197482 shutdown_connections 2024-04-26T23:40:36.277 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:36.273+0000 7fcff4e99640 1 --2- 172.21.15.88:0/2210197482 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fcfd006c8f0 0x7fcfd006edb0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:36.278 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:36.273+0000 7fcff4e99640 1 --2- 172.21.15.88:0/2210197482 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcff00c4820 0x7fcff00c4cd0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:36.278 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:36.273+0000 7fcff4e99640 1 --2- 172.21.15.88:0/2210197482 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcff00c3d40 0x7fcff0159920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:36.278 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:36.273+0000 7fcff4e99640 1 --2- 172.21.15.88:0/2210197482 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcff00aecf0 0x7fcff014ee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:36.278 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:36.273+0000 7fcff4e99640 1 -- 172.21.15.88:0/2210197482 >> 172.21.15.88:0/2210197482 conn(0x7fcff00c6ed0 msgr2=0x7fcff00af470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:40:36.278 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:36.273+0000 7fcff4e99640 1 -- 172.21.15.88:0/2210197482 shutdown_connections 2024-04-26T23:40:36.278 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:36.273+0000 7fcff4e99640 1 -- 172.21.15.88:0/2210197482 wait complete. 2024-04-26T23:40:36.288 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-26T23:40:36.288 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T23:40:36.384 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:36.380+0000 7f71aa899640 1 Processor -- start 2024-04-26T23:40:36.384 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:36.380+0000 7f71aa899640 1 -- start start 2024-04-26T23:40:36.386 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:36.381+0000 7f71aa899640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f71a40c7000 0x7f71a40ca460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:36.386 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:36.381+0000 7f71aa899640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f71a41543f0 0x7f71a4072930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:36.386 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:36.381+0000 7f71aa899640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f71a4156de0 con 0x7f71a40c9830 2024-04-26T23:40:36.386 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:36.381+0000 7f71aa899640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f71a4157b60 con 0x7f71a40c7000 2024-04-26T23:40:36.386 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:36.381+0000 7f71aa899640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f71a40cad40 con 0x7f71a41543f0 2024-04-26T23:40:36.386 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:36.381+0000 7f71a3fff640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f71a40c7000 0x7f71a40ca460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:36.386 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:36.381+0000 7f71a3fff640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f71a40c7000 0x7f71a40ca460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:57390/0 (socket says 172.21.15.88:57390) 2024-04-26T23:40:36.386 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:36.381+0000 7f71a3fff640 1 -- 172.21.15.88:0/166171765 learned_addr learned my addr 172.21.15.88:0/166171765 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:40:36.387 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:36.381+0000 7f71a8e36640 1 --2- 172.21.15.88:0/166171765 >> v2:172.21.15.175:3300/0 conn(0x7f71a41543f0 0x7f71a4072930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:36.387 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:36.381+0000 7f71a3fff640 1 -- 172.21.15.88:0/166171765 >> v2:172.21.15.175:3300/0 conn(0x7f71a41543f0 msgr2=0x7f71a4072930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:40:36.387 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:36.381+0000 7f71a3fff640 1 --2- 172.21.15.88:0/166171765 >> v2:172.21.15.175:3300/0 conn(0x7f71a41543f0 0x7f71a4072930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:36.387 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:36.381+0000 7f71a3fff640 1 -- 172.21.15.88:0/166171765 >> v1:172.21.15.175:6789/0 conn(0x7f71a40c9830 legacy=0x7f71a4153ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:36.387 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:36.381+0000 7f71a3fff640 1 -- 172.21.15.88:0/166171765 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71a4157080 con 0x7f71a40c7000 2024-04-26T23:40:36.387 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:36.382+0000 7f71a3fff640 1 --2- 172.21.15.88:0/166171765 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f71a40c7000 0x7f71a40ca460 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f71a40c83d0 tx=0x7f719402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7853bddaa25db5fa server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:36.387 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:36.382+0000 7f71a2ffd640 1 -- 172.21.15.88:0/166171765 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7194037070 con 0x7f71a40c7000 2024-04-26T23:40:36.387 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:36.382+0000 7f71a2ffd640 1 -- 172.21.15.88:0/166171765 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7194032440 con 0x7f71a40c7000 2024-04-26T23:40:36.387 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:36.382+0000 7f71a2ffd640 1 -- 172.21.15.88:0/166171765 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7194032810 con 0x7f71a40c7000 2024-04-26T23:40:36.390 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:36.383+0000 7f71aa899640 1 -- 172.21.15.88:0/166171765 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f71a40c7000 msgr2=0x7f71a40ca460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:36.391 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:36.383+0000 7f71aa899640 1 --2- 172.21.15.88:0/166171765 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f71a40c7000 0x7f71a40ca460 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f71a40c83d0 tx=0x7f719402a270 comp rx=0 tx=0).stop 2024-04-26T23:40:36.391 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:36.383+0000 7f71aa899640 1 -- 172.21.15.88:0/166171765 shutdown_connections 2024-04-26T23:40:36.391 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:36.383+0000 7f71aa899640 1 --2- 172.21.15.88:0/166171765 >> v2:172.21.15.175:3300/0 conn(0x7f71a41543f0 0x7f71a4072930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:36.391 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:36.383+0000 7f71aa899640 1 --2- 172.21.15.88:0/166171765 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f71a40c7000 0x7f71a40ca460 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:36.391 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:36.383+0000 7f71aa899640 1 -- 172.21.15.88:0/166171765 >> 172.21.15.88:0/166171765 conn(0x7f71a40adf20 msgr2=0x7f71a40ae330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:40:36.391 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:36.383+0000 7f71aa899640 1 -- 172.21.15.88:0/166171765 shutdown_connections 2024-04-26T23:40:36.391 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:36.383+0000 7f71aa899640 1 -- 172.21.15.88:0/166171765 wait complete. 2024-04-26T23:40:36.391 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:36.384+0000 7f71aa899640 1 Processor -- start 2024-04-26T23:40:36.391 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:36.384+0000 7f71aa899640 1 -- start start 2024-04-26T23:40:36.391 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:36.385+0000 7f71aa899640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f71a40c7000 0x7f71a414b710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:36.391 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:36.385+0000 7f71aa899640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f71a40c9830 0x7f71a414bc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:36.391 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:36.385+0000 7f71aa899640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f71a41543f0 0x7f71a414fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:36.392 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:36.385+0000 7f71aa899640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f71a40ca9a0 con 0x7f71a41543f0 2024-04-26T23:40:36.392 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:36.385+0000 7f71aa899640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f71a4157640 con 0x7f71a40c7000 2024-04-26T23:40:36.392 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:36.385+0000 7f71aa899640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f71a40cab20 con 0x7f71a40c9830 2024-04-26T23:40:36.392 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:36.385+0000 7f71a8e36640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f71a41543f0 0x7f71a414fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:36.392 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:36.385+0000 7f71a8e36640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f71a41543f0 0x7f71a414fd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:57400/0 (socket says 172.21.15.88:57400) 2024-04-26T23:40:36.392 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:36.385+0000 7f71a8e36640 1 -- 172.21.15.88:0/2742201387 learned_addr learned my addr 172.21.15.88:0/2742201387 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:40:36.392 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:36.385+0000 7f71a8e36640 1 -- 172.21.15.88:0/2742201387 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f71a40c9830 msgr2=0x7f71a414bc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:36.392 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:36.385+0000 7f71a3fff640 1 --2- 172.21.15.88:0/2742201387 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f71a40c7000 0x7f71a414b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:36.392 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:36.385+0000 7f71a37fe640 1 --2- 172.21.15.88:0/2742201387 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f71a40c9830 0x7f71a414bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:36.392 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:36.385+0000 7f71a8e36640 1 --2- 172.21.15.88:0/2742201387 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f71a40c9830 0x7f71a414bc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:36.392 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:36.385+0000 7f71a8e36640 1 -- 172.21.15.88:0/2742201387 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f71a40c7000 msgr2=0x7f71a414b710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:36.392 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:36.385+0000 7f71a8e36640 1 --2- 172.21.15.88:0/2742201387 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f71a40c7000 0x7f71a414b710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:36.392 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:36.385+0000 7f71a8e36640 1 -- 172.21.15.88:0/2742201387 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71a4158850 con 0x7f71a41543f0 2024-04-26T23:40:36.393 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:36.385+0000 7f71a3fff640 1 --2- 172.21.15.88:0/2742201387 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f71a40c7000 0x7f71a414b710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:40:36.393 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:36.385+0000 7f71a8e36640 1 --2- 172.21.15.88:0/2742201387 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f71a41543f0 0x7f71a414fd20 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f719c007d40 tx=0x7f719c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:36.393 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:36.385+0000 7f71a0ff9640 1 -- 172.21.15.88:0/2742201387 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f719c014420 con 0x7f71a41543f0 2024-04-26T23:40:36.393 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:36.385+0000 7f71a0ff9640 1 -- 172.21.15.88:0/2742201387 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f719c019070 con 0x7f71a41543f0 2024-04-26T23:40:36.393 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:36.385+0000 7f71a0ff9640 1 -- 172.21.15.88:0/2742201387 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f719c014820 con 0x7f71a41543f0 2024-04-26T23:40:36.393 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:36.385+0000 7f71aa899640 1 -- 172.21.15.88:0/2742201387 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71a4150c00 con 0x7f71a41543f0 2024-04-26T23:40:36.393 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:36.385+0000 7f71aa899640 1 -- 172.21.15.88:0/2742201387 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71a41511c0 con 0x7f71a41543f0 2024-04-26T23:40:36.393 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:36.386+0000 7f71aa899640 1 -- 172.21.15.88:0/2742201387 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f71a40766c0 con 0x7f71a41543f0 2024-04-26T23:40:36.393 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:36.387+0000 7f71a0ff9640 1 -- 172.21.15.88:0/2742201387 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f719c0149c0 con 0x7f71a41543f0 2024-04-26T23:40:36.394 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:36.387+0000 7f71a0ff9640 1 --2- 172.21.15.88:0/2742201387 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f719006c920 0x7f719006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:36.394 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:36.387+0000 7f71a0ff9640 1 -- 172.21.15.88:0/2742201387 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5689+0+0 (secure 0 0 0) 0x7f719c08c340 con 0x7f71a41543f0 2024-04-26T23:40:36.394 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:36.387+0000 7f71a3fff640 1 --2- 172.21.15.88:0/2742201387 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f719006c920 0x7f719006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:36.394 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:36.388+0000 7f71a3fff640 1 --2- 172.21.15.88:0/2742201387 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f719006c920 0x7f719006ede0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f7194034000 tx=0x7f719402e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:36.395 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:36.392+0000 7f71a0ff9640 1 -- 172.21.15.88:0/2742201387 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f719c05a780 con 0x7f71a41543f0 2024-04-26T23:40:36.450 INFO:tasks.ceph.mds.b.smithi175.stderr:2024-04-26T23:40:36.447+0000 7f069a72a640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-26T23:40:36.568 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:36.564+0000 7f71aa899640 1 -- 172.21.15.88:0/2742201387 --> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f71a40507a0 con 0x7f719006c920 2024-04-26T23:40:36.574 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:36.570+0000 7f71a0ff9640 1 -- 172.21.15.88:0/2742201387 <== mgr.4104 v2:172.21.15.88:6832/651674297 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251901 (secure 0 0 0) 0x7f71a40507a0 con 0x7f719006c920 2024-04-26T23:40:36.578 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-26T23:40:36.580 INFO:teuthology.orchestra.run.smithi088.stderr:dumped all 2024-04-26T23:40:36.582 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:36.574+0000 7f71aa899640 1 -- 172.21.15.88:0/2742201387 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f719006c920 msgr2=0x7f719006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:36.583 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:36.574+0000 7f71aa899640 1 --2- 172.21.15.88:0/2742201387 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f719006c920 0x7f719006ede0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f7194034000 tx=0x7f719402e000 comp rx=0 tx=0).stop 2024-04-26T23:40:36.583 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:36.574+0000 7f71aa899640 1 -- 172.21.15.88:0/2742201387 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f71a41543f0 msgr2=0x7f71a414fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:36.583 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:36.574+0000 7f71aa899640 1 --2- 172.21.15.88:0/2742201387 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f71a41543f0 0x7f71a414fd20 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f719c007d40 tx=0x7f719c00e4b0 comp rx=0 tx=0).stop 2024-04-26T23:40:36.583 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:36.574+0000 7f71aa899640 1 -- 172.21.15.88:0/2742201387 shutdown_connections 2024-04-26T23:40:36.583 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:36.574+0000 7f71aa899640 1 --2- 172.21.15.88:0/2742201387 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f719006c920 0x7f719006ede0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:36.583 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:36.574+0000 7f71aa899640 1 --2- 172.21.15.88:0/2742201387 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f71a40c9830 0x7f71a414bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:36.583 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:36.574+0000 7f71aa899640 1 --2- 172.21.15.88:0/2742201387 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f71a41543f0 0x7f71a414fd20 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:36.583 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:36.574+0000 7f71aa899640 1 --2- 172.21.15.88:0/2742201387 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f71a40c7000 0x7f71a414b710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:36.584 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:36.574+0000 7f71aa899640 1 -- 172.21.15.88:0/2742201387 >> 172.21.15.88:0/2742201387 conn(0x7f71a40adf20 msgr2=0x7f71a40ae300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:40:36.584 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:36.574+0000 7f71aa899640 1 -- 172.21.15.88:0/2742201387 shutdown_connections 2024-04-26T23:40:36.584 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:36.574+0000 7f71aa899640 1 -- 172.21.15.88:0/2742201387 wait complete. 2024-04-26T23:40:36.588 INFO:teuthology.orchestra.run.smithi088.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2024-04-26T23:40:35.922884+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":108,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218892,"kb_used_data":2728,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755828,"statfs":{"total":773094113280,"available":772869967872,"internally_reserved":0,"allocated":2793472,"data_stored":1702188,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":36,"apply_latency_ms":36,"commit_latency_ns":36000000,"apply_latency_ns":36000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.369781"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T23:40:32.599966+0000","last_change":"2024-04-26T23:40:32.596351+0000","last_active":"2024-04-26T23:40:32.599966+0000","last_peered":"2024-04-26T23:40:32.599966+0000","last_clean":"2024-04-26T23:40:32.599966+0000","last_became_active":"2024-04-26T23:40:32.596050+0000","last_became_peered":"2024-04-26T23:40:32.596050+0000","last_unstale":"2024-04-26T23:40:32.599966+0000","last_undegraded":"2024-04-26T23:40:32.599966+0000","last_fullsized":"2024-04-26T23:40:32.599966+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:18:09.706875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:40:33.580264+0000","last_change":"2024-04-26T23:40:32.583944+0000","last_active":"2024-04-26T23:40:33.580264+0000","last_peered":"2024-04-26T23:40:33.580264+0000","last_clean":"2024-04-26T23:40:33.580264+0000","last_became_active":"2024-04-26T23:40:32.583655+0000","last_became_peered":"2024-04-26T23:40:32.583655+0000","last_unstale":"2024-04-26T23:40:33.580264+0000","last_undegraded":"2024-04-26T23:40:33.580264+0000","last_fullsized":"2024-04-26T23:40:33.580264+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:40:17.167353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T23:40:32.583602+0000","last_change":"2024-04-26T23:40:32.579870+0000","last_active":"2024-04-26T23:40:32.583602+0000","last_peered":"2024-04-26T23:40:32.583602+0000","last_clean":"2024-04-26T23:40:32.583602+0000","last_became_active":"2024-04-26T23:40:32.579569+0000","last_became_peered":"2024-04-26T23:40:32.579569+0000","last_unstale":"2024-04-26T23:40:32.583602+0000","last_undegraded":"2024-04-26T23:40:32.583602+0000","last_fullsized":"2024-04-26T23:40:32.583602+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:50:22.335206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T23:40:32.589442+0000","last_change":"2024-04-26T23:40:32.581875+0000","last_active":"2024-04-26T23:40:32.589442+0000","last_peered":"2024-04-26T23:40:32.589442+0000","last_clean":"2024-04-26T23:40:32.589442+0000","last_became_active":"2024-04-26T23:40:32.580987+0000","last_became_peered":"2024-04-26T23:40:32.580987+0000","last_unstale":"2024-04-26T23:40:32.589442+0000","last_undegraded":"2024-04-26T23:40:32.589442+0000","last_fullsized":"2024-04-26T23:40:32.589442+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:15:52.942160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T23:40:32.590967+0000","last_change":"2024-04-26T23:40:32.588894+0000","last_active":"2024-04-26T23:40:32.590967+0000","last_peered":"2024-04-26T23:40:32.590967+0000","last_clean":"2024-04-26T23:40:32.590967+0000","last_became_active":"2024-04-26T23:40:32.588409+0000","last_became_peered":"2024-04-26T23:40:32.588409+0000","last_unstale":"2024-04-26T23:40:32.590967+0000","last_undegraded":"2024-04-26T23:40:32.590967+0000","last_fullsized":"2024-04-26T23:40:32.590967+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:14:04.372681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T23:40:32.587582+0000","last_change":"2024-04-26T23:40:32.584619+0000","last_active":"2024-04-26T23:40:32.587582+0000","last_peered":"2024-04-26T23:40:32.587582+0000","last_clean":"2024-04-26T23:40:32.587582+0000","last_became_active":"2024-04-26T23:40:32.584293+0000","last_became_peered":"2024-04-26T23:40:32.584293+0000","last_unstale":"2024-04-26T23:40:32.587582+0000","last_undegraded":"2024-04-26T23:40:32.587582+0000","last_fullsized":"2024-04-26T23:40:32.587582+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:25:30.040358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T23:40:32.591266+0000","last_change":"2024-04-26T23:40:32.587562+0000","last_active":"2024-04-26T23:40:32.591266+0000","last_peered":"2024-04-26T23:40:32.591266+0000","last_clean":"2024-04-26T23:40:32.591266+0000","last_became_active":"2024-04-26T23:40:32.587249+0000","last_became_peered":"2024-04-26T23:40:32.587249+0000","last_unstale":"2024-04-26T23:40:32.591266+0000","last_undegraded":"2024-04-26T23:40:32.591266+0000","last_fullsized":"2024-04-26T23:40:32.591266+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:10:42.603833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T23:40:32.598538+0000","last_change":"2024-04-26T23:40:32.592543+0000","last_active":"2024-04-26T23:40:32.598538+0000","last_peered":"2024-04-26T23:40:32.598538+0000","last_clean":"2024-04-26T23:40:32.598538+0000","last_became_active":"2024-04-26T23:40:32.592282+0000","last_became_peered":"2024-04-26T23:40:32.592282+0000","last_unstale":"2024-04-26T23:40:32.598538+0000","last_undegraded":"2024-04-26T23:40:32.598538+0000","last_fullsized":"2024-04-26T23:40:32.598538+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:30:11.401955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T23:40:32.597139+0000","last_change":"2024-04-26T23:40:32.591487+0000","last_active":"2024-04-26T23:40:32.597139+0000","last_peered":"2024-04-26T23:40:32.597139+0000","last_clean":"2024-04-26T23:40:32.597139+0000","last_became_active":"2024-04-26T23:40:32.591209+0000","last_became_peered":"2024-04-26T23:40:32.591209+0000","last_unstale":"2024-04-26T23:40:32.597139+0000","last_undegraded":"2024-04-26T23:40:32.597139+0000","last_fullsized":"2024-04-26T23:40:32.597139+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:15:01.970308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:40:33.581065+0000","last_change":"2024-04-26T23:40:32.578155+0000","last_active":"2024-04-26T23:40:33.581065+0000","last_peered":"2024-04-26T23:40:33.581065+0000","last_clean":"2024-04-26T23:40:33.581065+0000","last_became_active":"2024-04-26T23:40:32.577865+0000","last_became_peered":"2024-04-26T23:40:32.577865+0000","last_unstale":"2024-04-26T23:40:33.581065+0000","last_undegraded":"2024-04-26T23:40:33.581065+0000","last_fullsized":"2024-04-26T23:40:33.581065+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:40:17.167353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:40:33.580856+0000","last_change":"2024-04-26T23:40:32.578819+0000","last_active":"2024-04-26T23:40:33.580856+0000","last_peered":"2024-04-26T23:40:33.580856+0000","last_clean":"2024-04-26T23:40:33.580856+0000","last_became_active":"2024-04-26T23:40:32.578556+0000","last_became_peered":"2024-04-26T23:40:32.578556+0000","last_unstale":"2024-04-26T23:40:33.580856+0000","last_undegraded":"2024-04-26T23:40:33.580856+0000","last_fullsized":"2024-04-26T23:40:33.580856+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:17:46.135806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:40:33.579917+0000","last_change":"2024-04-26T23:40:32.595129+0000","last_active":"2024-04-26T23:40:33.579917+0000","last_peered":"2024-04-26T23:40:33.579917+0000","last_clean":"2024-04-26T23:40:33.579917+0000","last_became_active":"2024-04-26T23:40:32.594802+0000","last_became_peered":"2024-04-26T23:40:32.594802+0000","last_unstale":"2024-04-26T23:40:33.579917+0000","last_undegraded":"2024-04-26T23:40:33.579917+0000","last_fullsized":"2024-04-26T23:40:33.579917+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:48:33.020039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T23:40:32.598623+0000","last_change":"2024-04-26T23:40:32.592988+0000","last_active":"2024-04-26T23:40:32.598623+0000","last_peered":"2024-04-26T23:40:32.598623+0000","last_clean":"2024-04-26T23:40:32.598623+0000","last_became_active":"2024-04-26T23:40:32.592717+0000","last_became_peered":"2024-04-26T23:40:32.592717+0000","last_unstale":"2024-04-26T23:40:32.598623+0000","last_undegraded":"2024-04-26T23:40:32.598623+0000","last_fullsized":"2024-04-26T23:40:32.598623+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:47:51.559918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T23:40:32.594908+0000","last_change":"2024-04-26T23:40:32.586436+0000","last_active":"2024-04-26T23:40:32.594908+0000","last_peered":"2024-04-26T23:40:32.594908+0000","last_clean":"2024-04-26T23:40:32.594908+0000","last_became_active":"2024-04-26T23:40:32.585995+0000","last_became_peered":"2024-04-26T23:40:32.585995+0000","last_unstale":"2024-04-26T23:40:32.594908+0000","last_undegraded":"2024-04-26T23:40:32.594908+0000","last_fullsized":"2024-04-26T23:40:32.594908+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:43:14.744600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:40:33.580102+0000","last_change":"2024-04-26T23:40:32.590452+0000","last_active":"2024-04-26T23:40:33.580102+0000","last_peered":"2024-04-26T23:40:33.580102+0000","last_clean":"2024-04-26T23:40:33.580102+0000","last_became_active":"2024-04-26T23:40:32.590162+0000","last_became_peered":"2024-04-26T23:40:32.590162+0000","last_unstale":"2024-04-26T23:40:33.580102+0000","last_undegraded":"2024-04-26T23:40:33.580102+0000","last_fullsized":"2024-04-26T23:40:33.580102+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:51:30.677247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T23:40:32.588238+0000","last_change":"2024-04-26T23:40:32.585137+0000","last_active":"2024-04-26T23:40:32.588238+0000","last_peered":"2024-04-26T23:40:32.588238+0000","last_clean":"2024-04-26T23:40:32.588238+0000","last_became_active":"2024-04-26T23:40:32.584678+0000","last_became_peered":"2024-04-26T23:40:32.584678+0000","last_unstale":"2024-04-26T23:40:32.588238+0000","last_undegraded":"2024-04-26T23:40:32.588238+0000","last_fullsized":"2024-04-26T23:40:32.588238+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:14:04.372681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T23:40:32.599665+0000","last_change":"2024-04-26T23:40:32.593432+0000","last_active":"2024-04-26T23:40:32.599665+0000","last_peered":"2024-04-26T23:40:32.599665+0000","last_clean":"2024-04-26T23:40:32.599665+0000","last_became_active":"2024-04-26T23:40:32.593169+0000","last_became_peered":"2024-04-26T23:40:32.593169+0000","last_unstale":"2024-04-26T23:40:32.599665+0000","last_undegraded":"2024-04-26T23:40:32.599665+0000","last_fullsized":"2024-04-26T23:40:32.599665+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:38:10.884592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:40:33.640578+0000","last_change":"2024-04-26T23:40:32.574795+0000","last_active":"2024-04-26T23:40:33.640578+0000","last_peered":"2024-04-26T23:40:33.640578+0000","last_clean":"2024-04-26T23:40:33.640578+0000","last_became_active":"2024-04-26T23:40:32.574503+0000","last_became_peered":"2024-04-26T23:40:32.574503+0000","last_unstale":"2024-04-26T23:40:33.640578+0000","last_undegraded":"2024-04-26T23:40:33.640578+0000","last_fullsized":"2024-04-26T23:40:33.640578+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:30:11.401955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T23:40:32.591794+0000","last_change":"2024-04-26T23:40:32.588445+0000","last_active":"2024-04-26T23:40:32.591794+0000","last_peered":"2024-04-26T23:40:32.591794+0000","last_clean":"2024-04-26T23:40:32.591794+0000","last_became_active":"2024-04-26T23:40:32.588063+0000","last_became_peered":"2024-04-26T23:40:32.588063+0000","last_unstale":"2024-04-26T23:40:32.591794+0000","last_undegraded":"2024-04-26T23:40:32.591794+0000","last_fullsized":"2024-04-26T23:40:32.591794+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:25:30.040358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:40:33.581025+0000","last_change":"2024-04-26T23:40:32.590538+0000","last_active":"2024-04-26T23:40:33.581025+0000","last_peered":"2024-04-26T23:40:33.581025+0000","last_clean":"2024-04-26T23:40:33.581025+0000","last_became_active":"2024-04-26T23:40:32.590241+0000","last_became_peered":"2024-04-26T23:40:32.590241+0000","last_unstale":"2024-04-26T23:40:33.581025+0000","last_undegraded":"2024-04-26T23:40:33.581025+0000","last_fullsized":"2024-04-26T23:40:33.581025+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:38:10.884592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T23:40:32.598032+0000","last_change":"2024-04-26T23:40:32.590443+0000","last_active":"2024-04-26T23:40:32.598032+0000","last_peered":"2024-04-26T23:40:32.598032+0000","last_clean":"2024-04-26T23:40:32.598032+0000","last_became_active":"2024-04-26T23:40:32.590193+0000","last_became_peered":"2024-04-26T23:40:32.590193+0000","last_unstale":"2024-04-26T23:40:32.598032+0000","last_undegraded":"2024-04-26T23:40:32.598032+0000","last_fullsized":"2024-04-26T23:40:32.598032+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:25:02.319783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T23:40:32.596882+0000","last_change":"2024-04-26T23:40:32.591700+0000","last_active":"2024-04-26T23:40:32.596882+0000","last_peered":"2024-04-26T23:40:32.596882+0000","last_clean":"2024-04-26T23:40:32.596882+0000","last_became_active":"2024-04-26T23:40:32.591366+0000","last_became_peered":"2024-04-26T23:40:32.591366+0000","last_unstale":"2024-04-26T23:40:32.596882+0000","last_undegraded":"2024-04-26T23:40:32.596882+0000","last_fullsized":"2024-04-26T23:40:32.596882+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:17:46.135806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T23:40:32.601723+0000","last_change":"2024-04-26T23:40:32.593958+0000","last_active":"2024-04-26T23:40:32.601723+0000","last_peered":"2024-04-26T23:40:32.601723+0000","last_clean":"2024-04-26T23:40:32.601723+0000","last_became_active":"2024-04-26T23:40:32.593639+0000","last_became_peered":"2024-04-26T23:40:32.593639+0000","last_unstale":"2024-04-26T23:40:32.601723+0000","last_undegraded":"2024-04-26T23:40:32.601723+0000","last_fullsized":"2024-04-26T23:40:32.601723+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:25:30.040358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T23:40:32.588214+0000","last_change":"2024-04-26T23:40:32.582959+0000","last_active":"2024-04-26T23:40:32.588214+0000","last_peered":"2024-04-26T23:40:32.588214+0000","last_clean":"2024-04-26T23:40:32.588214+0000","last_became_active":"2024-04-26T23:40:32.582100+0000","last_became_peered":"2024-04-26T23:40:32.582100+0000","last_unstale":"2024-04-26T23:40:32.588214+0000","last_undegraded":"2024-04-26T23:40:32.588214+0000","last_fullsized":"2024-04-26T23:40:32.588214+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:30:11.401955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T23:40:32.598505+0000","last_change":"2024-04-26T23:40:32.588177+0000","last_active":"2024-04-26T23:40:32.598505+0000","last_peered":"2024-04-26T23:40:32.598505+0000","last_clean":"2024-04-26T23:40:32.598505+0000","last_became_active":"2024-04-26T23:40:32.586926+0000","last_became_peered":"2024-04-26T23:40:32.586926+0000","last_unstale":"2024-04-26T23:40:32.598505+0000","last_undegraded":"2024-04-26T23:40:32.598505+0000","last_fullsized":"2024-04-26T23:40:32.598505+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:15:52.942160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:40:33.581087+0000","last_change":"2024-04-26T23:40:32.589080+0000","last_active":"2024-04-26T23:40:33.581087+0000","last_peered":"2024-04-26T23:40:33.581087+0000","last_clean":"2024-04-26T23:40:33.581087+0000","last_became_active":"2024-04-26T23:40:32.588793+0000","last_became_peered":"2024-04-26T23:40:32.588793+0000","last_unstale":"2024-04-26T23:40:33.581087+0000","last_undegraded":"2024-04-26T23:40:33.581087+0000","last_fullsized":"2024-04-26T23:40:33.581087+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:18:09.706875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:40:33.580158+0000","last_change":"2024-04-26T23:40:32.583376+0000","last_active":"2024-04-26T23:40:33.580158+0000","last_peered":"2024-04-26T23:40:33.580158+0000","last_clean":"2024-04-26T23:40:33.580158+0000","last_became_active":"2024-04-26T23:40:32.583089+0000","last_became_peered":"2024-04-26T23:40:32.583089+0000","last_unstale":"2024-04-26T23:40:33.580158+0000","last_undegraded":"2024-04-26T23:40:33.580158+0000","last_fullsized":"2024-04-26T23:40:33.580158+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:17:46.135806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T23:40:32.598513+0000","last_change":"2024-04-26T23:40:32.587921+0000","last_active":"2024-04-26T23:40:32.598513+0000","last_peered":"2024-04-26T23:40:32.598513+0000","last_clean":"2024-04-26T23:40:32.598513+0000","last_became_active":"2024-04-26T23:40:32.587630+0000","last_became_peered":"2024-04-26T23:40:32.587630+0000","last_unstale":"2024-04-26T23:40:32.598513+0000","last_undegraded":"2024-04-26T23:40:32.598513+0000","last_fullsized":"2024-04-26T23:40:32.598513+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:25:02.319783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T23:40:32.594605+0000","last_change":"2024-04-26T23:40:32.584323+0000","last_active":"2024-04-26T23:40:32.594605+0000","last_peered":"2024-04-26T23:40:32.594605+0000","last_clean":"2024-04-26T23:40:32.594605+0000","last_became_active":"2024-04-26T23:40:32.584010+0000","last_became_peered":"2024-04-26T23:40:32.584010+0000","last_unstale":"2024-04-26T23:40:32.594605+0000","last_undegraded":"2024-04-26T23:40:32.594605+0000","last_fullsized":"2024-04-26T23:40:32.594605+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:35:55.443782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T23:40:32.585718+0000","last_change":"2024-04-26T23:40:32.580453+0000","last_active":"2024-04-26T23:40:32.585718+0000","last_peered":"2024-04-26T23:40:32.585718+0000","last_clean":"2024-04-26T23:40:32.585718+0000","last_became_active":"2024-04-26T23:40:32.580196+0000","last_became_peered":"2024-04-26T23:40:32.580196+0000","last_unstale":"2024-04-26T23:40:32.585718+0000","last_undegraded":"2024-04-26T23:40:32.585718+0000","last_fullsized":"2024-04-26T23:40:32.585718+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:25:02.319783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:40:33.640433+0000","last_change":"2024-04-26T23:40:32.584590+0000","last_active":"2024-04-26T23:40:33.640433+0000","last_peered":"2024-04-26T23:40:33.640433+0000","last_clean":"2024-04-26T23:40:33.640433+0000","last_became_active":"2024-04-26T23:40:32.584234+0000","last_became_peered":"2024-04-26T23:40:32.584234+0000","last_unstale":"2024-04-26T23:40:33.640433+0000","last_undegraded":"2024-04-26T23:40:33.640433+0000","last_fullsized":"2024-04-26T23:40:33.640433+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:15:52.942160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:40:33.580581+0000","last_change":"2024-04-26T23:40:32.586672+0000","last_active":"2024-04-26T23:40:33.580581+0000","last_peered":"2024-04-26T23:40:33.580581+0000","last_clean":"2024-04-26T23:40:33.580581+0000","last_became_active":"2024-04-26T23:40:32.586399+0000","last_became_peered":"2024-04-26T23:40:32.586399+0000","last_unstale":"2024-04-26T23:40:33.580581+0000","last_undegraded":"2024-04-26T23:40:33.580581+0000","last_fullsized":"2024-04-26T23:40:33.580581+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:15:01.970308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:40:33.579610+0000","last_change":"2024-04-26T23:40:32.589208+0000","last_active":"2024-04-26T23:40:33.579610+0000","last_peered":"2024-04-26T23:40:33.579610+0000","last_clean":"2024-04-26T23:40:33.579610+0000","last_became_active":"2024-04-26T23:40:32.588927+0000","last_became_peered":"2024-04-26T23:40:32.588927+0000","last_unstale":"2024-04-26T23:40:33.579610+0000","last_undegraded":"2024-04-26T23:40:33.579610+0000","last_fullsized":"2024-04-26T23:40:33.579610+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:45:50.299583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T23:40:32.598571+0000","last_change":"2024-04-26T23:40:31.576749+0000","last_active":"2024-04-26T23:40:32.598571+0000","last_peered":"2024-04-26T23:40:32.598571+0000","last_clean":"2024-04-26T23:40:32.598571+0000","last_became_active":"2024-04-26T23:40:31.576178+0000","last_became_peered":"2024-04-26T23:40:31.576178+0000","last_unstale":"2024-04-26T23:40:32.598571+0000","last_undegraded":"2024-04-26T23:40:32.598571+0000","last_fullsized":"2024-04-26T23:40:32.598571+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:15:30.884135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T23:40:32.601675+0000","last_change":"2024-04-26T23:40:32.594689+0000","last_active":"2024-04-26T23:40:32.601675+0000","last_peered":"2024-04-26T23:40:32.601675+0000","last_clean":"2024-04-26T23:40:32.601675+0000","last_became_active":"2024-04-26T23:40:32.592365+0000","last_became_peered":"2024-04-26T23:40:32.592365+0000","last_unstale":"2024-04-26T23:40:32.601675+0000","last_undegraded":"2024-04-26T23:40:32.601675+0000","last_fullsized":"2024-04-26T23:40:32.601675+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:30:11.401955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:40:33.580705+0000","last_change":"2024-04-26T23:40:31.567755+0000","last_active":"2024-04-26T23:40:33.580705+0000","last_peered":"2024-04-26T23:40:33.580705+0000","last_clean":"2024-04-26T23:40:33.580705+0000","last_became_active":"2024-04-26T23:40:31.567484+0000","last_became_peered":"2024-04-26T23:40:31.567484+0000","last_unstale":"2024-04-26T23:40:33.580705+0000","last_undegraded":"2024-04-26T23:40:33.580705+0000","last_fullsized":"2024-04-26T23:40:33.580705+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:43:13.740214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T23:40:32.571544+0000","last_change":"2024-04-26T23:40:31.578929+0000","last_active":"2024-04-26T23:40:32.571544+0000","last_peered":"2024-04-26T23:40:32.571544+0000","last_clean":"2024-04-26T23:40:32.571544+0000","last_became_active":"2024-04-26T23:40:31.578623+0000","last_became_peered":"2024-04-26T23:40:31.578623+0000","last_unstale":"2024-04-26T23:40:32.571544+0000","last_undegraded":"2024-04-26T23:40:32.571544+0000","last_fullsized":"2024-04-26T23:40:32.571544+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:50:21.330821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T23:40:32.598497+0000","last_change":"2024-04-26T23:40:32.586204+0000","last_active":"2024-04-26T23:40:32.598497+0000","last_peered":"2024-04-26T23:40:32.598497+0000","last_clean":"2024-04-26T23:40:32.598497+0000","last_became_active":"2024-04-26T23:40:32.585725+0000","last_became_peered":"2024-04-26T23:40:32.585725+0000","last_unstale":"2024-04-26T23:40:32.598497+0000","last_undegraded":"2024-04-26T23:40:32.598497+0000","last_fullsized":"2024-04-26T23:40:32.598497+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:20:29.107798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T23:40:32.571116+0000","last_change":"2024-04-26T23:40:31.572402+0000","last_active":"2024-04-26T23:40:32.571116+0000","last_peered":"2024-04-26T23:40:32.571116+0000","last_clean":"2024-04-26T23:40:32.571116+0000","last_became_active":"2024-04-26T23:40:31.572111+0000","last_became_peered":"2024-04-26T23:40:31.572111+0000","last_unstale":"2024-04-26T23:40:32.571116+0000","last_undegraded":"2024-04-26T23:40:32.571116+0000","last_fullsized":"2024-04-26T23:40:32.571116+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:20:28.103413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:40:33.580185+0000","last_change":"2024-04-26T23:40:32.583014+0000","last_active":"2024-04-26T23:40:33.580185+0000","last_peered":"2024-04-26T23:40:33.580185+0000","last_clean":"2024-04-26T23:40:33.580185+0000","last_became_active":"2024-04-26T23:40:32.582751+0000","last_became_peered":"2024-04-26T23:40:32.582751+0000","last_unstale":"2024-04-26T23:40:33.580185+0000","last_undegraded":"2024-04-26T23:40:33.580185+0000","last_fullsized":"2024-04-26T23:40:33.580185+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:38:10.884592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:40:33.580804+0000","last_change":"2024-04-26T23:40:31.573794+0000","last_active":"2024-04-26T23:40:33.580804+0000","last_peered":"2024-04-26T23:40:33.580804+0000","last_clean":"2024-04-26T23:40:33.580804+0000","last_became_active":"2024-04-26T23:40:31.573164+0000","last_became_peered":"2024-04-26T23:40:31.573164+0000","last_unstale":"2024-04-26T23:40:33.580804+0000","last_undegraded":"2024-04-26T23:40:33.580804+0000","last_fullsized":"2024-04-26T23:40:33.580804+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:15:30.884135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T23:40:32.596805+0000","last_change":"2024-04-26T23:40:32.589793+0000","last_active":"2024-04-26T23:40:32.596805+0000","last_peered":"2024-04-26T23:40:32.596805+0000","last_clean":"2024-04-26T23:40:32.596805+0000","last_became_active":"2024-04-26T23:40:32.589478+0000","last_became_peered":"2024-04-26T23:40:32.589478+0000","last_unstale":"2024-04-26T23:40:32.596805+0000","last_undegraded":"2024-04-26T23:40:32.596805+0000","last_fullsized":"2024-04-26T23:40:32.596805+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:16:46.547536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T23:40:32.571098+0000","last_change":"2024-04-26T23:40:31.575616+0000","last_active":"2024-04-26T23:40:32.571098+0000","last_peered":"2024-04-26T23:40:32.571098+0000","last_clean":"2024-04-26T23:40:32.571098+0000","last_became_active":"2024-04-26T23:40:31.575211+0000","last_became_peered":"2024-04-26T23:40:31.575211+0000","last_unstale":"2024-04-26T23:40:32.571098+0000","last_undegraded":"2024-04-26T23:40:32.571098+0000","last_fullsized":"2024-04-26T23:40:32.571098+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:48:32.015654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T23:40:32.598034+0000","last_change":"2024-04-26T23:40:32.589146+0000","last_active":"2024-04-26T23:40:32.598034+0000","last_peered":"2024-04-26T23:40:32.598034+0000","last_clean":"2024-04-26T23:40:32.598034+0000","last_became_active":"2024-04-26T23:40:32.588881+0000","last_became_peered":"2024-04-26T23:40:32.588881+0000","last_unstale":"2024-04-26T23:40:32.598034+0000","last_undegraded":"2024-04-26T23:40:32.598034+0000","last_fullsized":"2024-04-26T23:40:32.598034+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:45:50.299583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:40:33.580226+0000","last_change":"2024-04-26T23:40:31.574234+0000","last_active":"2024-04-26T23:40:33.580226+0000","last_peered":"2024-04-26T23:40:33.580226+0000","last_clean":"2024-04-26T23:40:33.580226+0000","last_became_active":"2024-04-26T23:40:31.572218+0000","last_became_peered":"2024-04-26T23:40:31.572218+0000","last_unstale":"2024-04-26T23:40:33.580226+0000","last_undegraded":"2024-04-26T23:40:33.580226+0000","last_fullsized":"2024-04-26T23:40:33.580226+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:25:01.315397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:40:33.580001+0000","last_change":"2024-04-26T23:40:32.593298+0000","last_active":"2024-04-26T23:40:33.580001+0000","last_peered":"2024-04-26T23:40:33.580001+0000","last_clean":"2024-04-26T23:40:33.580001+0000","last_became_active":"2024-04-26T23:40:32.593030+0000","last_became_peered":"2024-04-26T23:40:32.593030+0000","last_unstale":"2024-04-26T23:40:33.580001+0000","last_undegraded":"2024-04-26T23:40:33.580001+0000","last_fullsized":"2024-04-26T23:40:33.580001+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:20:29.107798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:40:33.580998+0000","last_change":"2024-04-26T23:40:31.572331+0000","last_active":"2024-04-26T23:40:33.580998+0000","last_peered":"2024-04-26T23:40:33.580998+0000","last_clean":"2024-04-26T23:40:33.580998+0000","last_became_active":"2024-04-26T23:40:31.572074+0000","last_became_peered":"2024-04-26T23:40:31.572074+0000","last_unstale":"2024-04-26T23:40:33.580998+0000","last_undegraded":"2024-04-26T23:40:33.580998+0000","last_fullsized":"2024-04-26T23:40:33.580998+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:45:49.295198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T23:40:32.591774+0000","last_change":"2024-04-26T23:40:32.587513+0000","last_active":"2024-04-26T23:40:32.591774+0000","last_peered":"2024-04-26T23:40:32.591774+0000","last_clean":"2024-04-26T23:40:32.591774+0000","last_became_active":"2024-04-26T23:40:32.587200+0000","last_became_peered":"2024-04-26T23:40:32.587200+0000","last_unstale":"2024-04-26T23:40:32.591774+0000","last_undegraded":"2024-04-26T23:40:32.591774+0000","last_fullsized":"2024-04-26T23:40:32.591774+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:47:51.559918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T23:40:32.601766+0000","last_change":"2024-04-26T23:40:31.573941+0000","last_active":"2024-04-26T23:40:32.601766+0000","last_peered":"2024-04-26T23:40:32.601766+0000","last_clean":"2024-04-26T23:40:32.601766+0000","last_became_active":"2024-04-26T23:40:31.573668+0000","last_became_peered":"2024-04-26T23:40:31.573668+0000","last_unstale":"2024-04-26T23:40:32.601766+0000","last_undegraded":"2024-04-26T23:40:32.601766+0000","last_fullsized":"2024-04-26T23:40:32.601766+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:58:06.477730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T23:40:32.598039+0000","last_change":"2024-04-26T23:40:32.589706+0000","last_active":"2024-04-26T23:40:32.598039+0000","last_peered":"2024-04-26T23:40:32.598039+0000","last_clean":"2024-04-26T23:40:32.598039+0000","last_became_active":"2024-04-26T23:40:32.589452+0000","last_became_peered":"2024-04-26T23:40:32.589452+0000","last_unstale":"2024-04-26T23:40:32.598039+0000","last_undegraded":"2024-04-26T23:40:32.598039+0000","last_fullsized":"2024-04-26T23:40:32.598039+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:48:33.020039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T23:40:32.569624+0000","last_change":"2024-04-26T23:40:31.575493+0000","last_active":"2024-04-26T23:40:32.569624+0000","last_peered":"2024-04-26T23:40:32.569624+0000","last_clean":"2024-04-26T23:40:32.569624+0000","last_became_active":"2024-04-26T23:40:31.575039+0000","last_became_peered":"2024-04-26T23:40:31.575039+0000","last_unstale":"2024-04-26T23:40:32.569624+0000","last_undegraded":"2024-04-26T23:40:32.569624+0000","last_fullsized":"2024-04-26T23:40:32.569624+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:43:13.740214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T23:40:32.599852+0000","last_change":"2024-04-26T23:40:32.595377+0000","last_active":"2024-04-26T23:40:32.599852+0000","last_peered":"2024-04-26T23:40:32.599852+0000","last_clean":"2024-04-26T23:40:32.599852+0000","last_became_active":"2024-04-26T23:40:32.595032+0000","last_became_peered":"2024-04-26T23:40:32.595032+0000","last_unstale":"2024-04-26T23:40:32.599852+0000","last_undegraded":"2024-04-26T23:40:32.599852+0000","last_fullsized":"2024-04-26T23:40:32.599852+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:38:10.884592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:40:33.580707+0000","last_change":"2024-04-26T23:40:31.569512+0000","last_active":"2024-04-26T23:40:33.580707+0000","last_peered":"2024-04-26T23:40:33.580707+0000","last_clean":"2024-04-26T23:40:33.580707+0000","last_became_active":"2024-04-26T23:40:31.568598+0000","last_became_peered":"2024-04-26T23:40:31.568598+0000","last_unstale":"2024-04-26T23:40:33.580707+0000","last_undegraded":"2024-04-26T23:40:33.580707+0000","last_fullsized":"2024-04-26T23:40:33.580707+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:48:32.015654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:40:33.580693+0000","last_change":"2024-04-26T23:40:32.586832+0000","last_active":"2024-04-26T23:40:33.580693+0000","last_peered":"2024-04-26T23:40:33.580693+0000","last_clean":"2024-04-26T23:40:33.580693+0000","last_became_active":"2024-04-26T23:40:32.585809+0000","last_became_peered":"2024-04-26T23:40:32.585809+0000","last_unstale":"2024-04-26T23:40:33.580693+0000","last_undegraded":"2024-04-26T23:40:33.580693+0000","last_fullsized":"2024-04-26T23:40:33.580693+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:51:30.677247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:40:33.640362+0000","last_change":"2024-04-26T23:40:31.572685+0000","last_active":"2024-04-26T23:40:33.640362+0000","last_peered":"2024-04-26T23:40:33.640362+0000","last_clean":"2024-04-26T23:40:33.640362+0000","last_became_active":"2024-04-26T23:40:31.572169+0000","last_became_peered":"2024-04-26T23:40:31.572169+0000","last_unstale":"2024-04-26T23:40:33.640362+0000","last_undegraded":"2024-04-26T23:40:33.640362+0000","last_fullsized":"2024-04-26T23:40:33.640362+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:15:30.884135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T23:40:32.599785+0000","last_change":"2024-04-26T23:40:32.593528+0000","last_active":"2024-04-26T23:40:32.599785+0000","last_peered":"2024-04-26T23:40:32.599785+0000","last_clean":"2024-04-26T23:40:32.599785+0000","last_became_active":"2024-04-26T23:40:32.593220+0000","last_became_peered":"2024-04-26T23:40:32.593220+0000","last_unstale":"2024-04-26T23:40:32.599785+0000","last_undegraded":"2024-04-26T23:40:32.599785+0000","last_fullsized":"2024-04-26T23:40:32.599785+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:17:46.135806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:40:33.579946+0000","last_change":"2024-04-26T23:40:31.575943+0000","last_active":"2024-04-26T23:40:33.579946+0000","last_peered":"2024-04-26T23:40:33.579946+0000","last_clean":"2024-04-26T23:40:33.579946+0000","last_became_active":"2024-04-26T23:40:31.575632+0000","last_became_peered":"2024-04-26T23:40:31.575632+0000","last_unstale":"2024-04-26T23:40:33.579946+0000","last_undegraded":"2024-04-26T23:40:33.579946+0000","last_fullsized":"2024-04-26T23:40:33.579946+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:11:08.189634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T23:40:32.599820+0000","last_change":"2024-04-26T23:40:32.593577+0000","last_active":"2024-04-26T23:40:32.599820+0000","last_peered":"2024-04-26T23:40:32.599820+0000","last_clean":"2024-04-26T23:40:32.599820+0000","last_became_active":"2024-04-26T23:40:32.593235+0000","last_became_peered":"2024-04-26T23:40:32.593235+0000","last_unstale":"2024-04-26T23:40:32.599820+0000","last_undegraded":"2024-04-26T23:40:32.599820+0000","last_fullsized":"2024-04-26T23:40:32.599820+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:51:30.677247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:40:33.640608+0000","last_change":"2024-04-26T23:40:31.570870+0000","last_active":"2024-04-26T23:40:33.640608+0000","last_peered":"2024-04-26T23:40:33.640608+0000","last_clean":"2024-04-26T23:40:33.640608+0000","last_became_active":"2024-04-26T23:40:31.570592+0000","last_became_peered":"2024-04-26T23:40:31.570592+0000","last_unstale":"2024-04-26T23:40:33.640608+0000","last_undegraded":"2024-04-26T23:40:33.640608+0000","last_fullsized":"2024-04-26T23:40:33.640608+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:43:13.740214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T23:40:32.599939+0000","last_change":"2024-04-26T23:40:32.596306+0000","last_active":"2024-04-26T23:40:32.599939+0000","last_peered":"2024-04-26T23:40:32.599939+0000","last_clean":"2024-04-26T23:40:32.599939+0000","last_became_active":"2024-04-26T23:40:32.595625+0000","last_became_peered":"2024-04-26T23:40:32.595625+0000","last_unstale":"2024-04-26T23:40:32.599939+0000","last_undegraded":"2024-04-26T23:40:32.599939+0000","last_fullsized":"2024-04-26T23:40:32.599939+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:40:17.167353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:40:33.580261+0000","last_change":"2024-04-26T23:40:31.571749+0000","last_active":"2024-04-26T23:40:33.580261+0000","last_peered":"2024-04-26T23:40:33.580261+0000","last_clean":"2024-04-26T23:40:33.580261+0000","last_became_active":"2024-04-26T23:40:31.571427+0000","last_became_peered":"2024-04-26T23:40:31.571427+0000","last_unstale":"2024-04-26T23:40:33.580261+0000","last_undegraded":"2024-04-26T23:40:33.580261+0000","last_fullsized":"2024-04-26T23:40:33.580261+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:20:28.103413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T23:40:32.589465+0000","last_change":"2024-04-26T23:40:32.583469+0000","last_active":"2024-04-26T23:40:32.589465+0000","last_peered":"2024-04-26T23:40:32.589465+0000","last_clean":"2024-04-26T23:40:32.589465+0000","last_became_active":"2024-04-26T23:40:32.583174+0000","last_became_peered":"2024-04-26T23:40:32.583174+0000","last_unstale":"2024-04-26T23:40:32.589465+0000","last_undegraded":"2024-04-26T23:40:32.589465+0000","last_fullsized":"2024-04-26T23:40:32.589465+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:47:51.559918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:40:33.640493+0000","last_change":"2024-04-26T23:40:31.572391+0000","last_active":"2024-04-26T23:40:33.640493+0000","last_peered":"2024-04-26T23:40:33.640493+0000","last_clean":"2024-04-26T23:40:33.640493+0000","last_became_active":"2024-04-26T23:40:31.571849+0000","last_became_peered":"2024-04-26T23:40:31.571849+0000","last_unstale":"2024-04-26T23:40:33.640493+0000","last_undegraded":"2024-04-26T23:40:33.640493+0000","last_fullsized":"2024-04-26T23:40:33.640493+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:35:54.439397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T23:40:32.597097+0000","last_change":"2024-04-26T23:40:32.591906+0000","last_active":"2024-04-26T23:40:32.597097+0000","last_peered":"2024-04-26T23:40:32.597097+0000","last_clean":"2024-04-26T23:40:32.597097+0000","last_became_active":"2024-04-26T23:40:32.590867+0000","last_became_peered":"2024-04-26T23:40:32.590867+0000","last_unstale":"2024-04-26T23:40:32.597097+0000","last_undegraded":"2024-04-26T23:40:32.597097+0000","last_fullsized":"2024-04-26T23:40:32.597097+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:16:46.547536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":168,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T23:40:32.574098+0000","last_change":"2024-04-26T23:40:20.966672+0000","last_active":"2024-04-26T23:40:32.574098+0000","last_peered":"2024-04-26T23:40:32.574098+0000","last_clean":"2024-04-26T23:40:32.574098+0000","last_became_active":"2024-04-26T23:40:20.963937+0000","last_became_peered":"2024-04-26T23:40:20.963937+0000","last_unstale":"2024-04-26T23:40:32.574098+0000","last_undegraded":"2024-04-26T23:40:32.574098+0000","last_fullsized":"2024-04-26T23:40:32.574098+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:19.950137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:19.950137+0000","last_clean_scrub_stamp":"2024-04-26T23:40:19.950137+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:23:39.166579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T23:40:32.568395+0000","last_change":"2024-04-26T23:40:31.570118+0000","last_active":"2024-04-26T23:40:32.568395+0000","last_peered":"2024-04-26T23:40:32.568395+0000","last_clean":"2024-04-26T23:40:32.568395+0000","last_became_active":"2024-04-26T23:40:31.569764+0000","last_became_peered":"2024-04-26T23:40:31.569764+0000","last_unstale":"2024-04-26T23:40:32.568395+0000","last_undegraded":"2024-04-26T23:40:32.568395+0000","last_fullsized":"2024-04-26T23:40:32.568395+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:15:30.884135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T23:40:32.598541+0000","last_change":"2024-04-26T23:40:32.593216+0000","last_active":"2024-04-26T23:40:32.598541+0000","last_peered":"2024-04-26T23:40:32.598541+0000","last_clean":"2024-04-26T23:40:32.598541+0000","last_became_active":"2024-04-26T23:40:32.592929+0000","last_became_peered":"2024-04-26T23:40:32.592929+0000","last_unstale":"2024-04-26T23:40:32.598541+0000","last_undegraded":"2024-04-26T23:40:32.598541+0000","last_fullsized":"2024-04-26T23:40:32.598541+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:10:42.603833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T23:40:32.574221+0000","last_change":"2024-04-26T23:40:31.573864+0000","last_active":"2024-04-26T23:40:32.574221+0000","last_peered":"2024-04-26T23:40:32.574221+0000","last_clean":"2024-04-26T23:40:32.574221+0000","last_became_active":"2024-04-26T23:40:31.573594+0000","last_became_peered":"2024-04-26T23:40:31.573594+0000","last_unstale":"2024-04-26T23:40:32.574221+0000","last_undegraded":"2024-04-26T23:40:32.574221+0000","last_fullsized":"2024-04-26T23:40:32.574221+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:48:32.015654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T23:40:32.598337+0000","last_change":"2024-04-26T23:40:32.593262+0000","last_active":"2024-04-26T23:40:32.598337+0000","last_peered":"2024-04-26T23:40:32.598337+0000","last_clean":"2024-04-26T23:40:32.598337+0000","last_became_active":"2024-04-26T23:40:32.593003+0000","last_became_peered":"2024-04-26T23:40:32.593003+0000","last_unstale":"2024-04-26T23:40:32.598337+0000","last_undegraded":"2024-04-26T23:40:32.598337+0000","last_fullsized":"2024-04-26T23:40:32.598337+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:15:52.942160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:40:33.640465+0000","last_change":"2024-04-26T23:40:31.570775+0000","last_active":"2024-04-26T23:40:33.640465+0000","last_peered":"2024-04-26T23:40:33.640465+0000","last_clean":"2024-04-26T23:40:33.640465+0000","last_became_active":"2024-04-26T23:40:31.570493+0000","last_became_peered":"2024-04-26T23:40:31.570493+0000","last_unstale":"2024-04-26T23:40:33.640465+0000","last_undegraded":"2024-04-26T23:40:33.640465+0000","last_fullsized":"2024-04-26T23:40:33.640465+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:45:49.295198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:40:33.580101+0000","last_change":"2024-04-26T23:40:32.576783+0000","last_active":"2024-04-26T23:40:33.580101+0000","last_peered":"2024-04-26T23:40:33.580101+0000","last_clean":"2024-04-26T23:40:33.580101+0000","last_became_active":"2024-04-26T23:40:32.576481+0000","last_became_peered":"2024-04-26T23:40:32.576481+0000","last_unstale":"2024-04-26T23:40:33.580101+0000","last_undegraded":"2024-04-26T23:40:33.580101+0000","last_fullsized":"2024-04-26T23:40:33.580101+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:16:46.547536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T23:40:32.569803+0000","last_change":"2024-04-26T23:40:31.572432+0000","last_active":"2024-04-26T23:40:32.569803+0000","last_peered":"2024-04-26T23:40:32.569803+0000","last_clean":"2024-04-26T23:40:32.569803+0000","last_became_active":"2024-04-26T23:40:31.572121+0000","last_became_peered":"2024-04-26T23:40:31.572121+0000","last_unstale":"2024-04-26T23:40:32.569803+0000","last_undegraded":"2024-04-26T23:40:32.569803+0000","last_fullsized":"2024-04-26T23:40:32.569803+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:45:49.295198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:40:33.580225+0000","last_change":"2024-04-26T23:40:32.590069+0000","last_active":"2024-04-26T23:40:33.580225+0000","last_peered":"2024-04-26T23:40:33.580225+0000","last_clean":"2024-04-26T23:40:33.580225+0000","last_became_active":"2024-04-26T23:40:32.589790+0000","last_became_peered":"2024-04-26T23:40:32.589790+0000","last_unstale":"2024-04-26T23:40:33.580225+0000","last_undegraded":"2024-04-26T23:40:33.580225+0000","last_fullsized":"2024-04-26T23:40:33.580225+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:15:52.942160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:40:33.580320+0000","last_change":"2024-04-26T23:40:31.576711+0000","last_active":"2024-04-26T23:40:33.580320+0000","last_peered":"2024-04-26T23:40:33.580320+0000","last_clean":"2024-04-26T23:40:33.580320+0000","last_became_active":"2024-04-26T23:40:31.576404+0000","last_became_peered":"2024-04-26T23:40:31.576404+0000","last_unstale":"2024-04-26T23:40:33.580320+0000","last_undegraded":"2024-04-26T23:40:33.580320+0000","last_fullsized":"2024-04-26T23:40:33.580320+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:45:49.295198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T23:40:32.587670+0000","last_change":"2024-04-26T23:40:32.584363+0000","last_active":"2024-04-26T23:40:32.587670+0000","last_peered":"2024-04-26T23:40:32.587670+0000","last_clean":"2024-04-26T23:40:32.587670+0000","last_became_active":"2024-04-26T23:40:32.584082+0000","last_became_peered":"2024-04-26T23:40:32.584082+0000","last_unstale":"2024-04-26T23:40:32.587670+0000","last_undegraded":"2024-04-26T23:40:32.587670+0000","last_fullsized":"2024-04-26T23:40:32.587670+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:10:42.603833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T23:40:32.578509+0000","last_change":"2024-04-26T23:40:31.576565+0000","last_active":"2024-04-26T23:40:32.578509+0000","last_peered":"2024-04-26T23:40:32.578509+0000","last_clean":"2024-04-26T23:40:32.578509+0000","last_became_active":"2024-04-26T23:40:31.576313+0000","last_became_peered":"2024-04-26T23:40:31.576313+0000","last_unstale":"2024-04-26T23:40:32.578509+0000","last_undegraded":"2024-04-26T23:40:32.578509+0000","last_fullsized":"2024-04-26T23:40:32.578509+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:25:01.315397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:40:33.580396+0000","last_change":"2024-04-26T23:40:32.582442+0000","last_active":"2024-04-26T23:40:33.580396+0000","last_peered":"2024-04-26T23:40:33.580396+0000","last_clean":"2024-04-26T23:40:33.580396+0000","last_became_active":"2024-04-26T23:40:32.582140+0000","last_became_peered":"2024-04-26T23:40:32.582140+0000","last_unstale":"2024-04-26T23:40:33.580396+0000","last_undegraded":"2024-04-26T23:40:33.580396+0000","last_fullsized":"2024-04-26T23:40:33.580396+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:18:09.706875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:40:33.584637+0000","last_change":"2024-04-26T23:40:31.576299+0000","last_active":"2024-04-26T23:40:33.584637+0000","last_peered":"2024-04-26T23:40:33.584637+0000","last_clean":"2024-04-26T23:40:33.584637+0000","last_became_active":"2024-04-26T23:40:31.576006+0000","last_became_peered":"2024-04-26T23:40:31.576006+0000","last_unstale":"2024-04-26T23:40:33.584637+0000","last_undegraded":"2024-04-26T23:40:33.584637+0000","last_fullsized":"2024-04-26T23:40:33.584637+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:15:51.937774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T23:40:32.601751+0000","last_change":"2024-04-26T23:40:32.594913+0000","last_active":"2024-04-26T23:40:32.601751+0000","last_peered":"2024-04-26T23:40:32.601751+0000","last_clean":"2024-04-26T23:40:32.601751+0000","last_became_active":"2024-04-26T23:40:32.594616+0000","last_became_peered":"2024-04-26T23:40:32.594616+0000","last_unstale":"2024-04-26T23:40:32.601751+0000","last_undegraded":"2024-04-26T23:40:32.601751+0000","last_fullsized":"2024-04-26T23:40:32.601751+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:14:04.372681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:40:33.580955+0000","last_change":"2024-04-26T23:40:31.573721+0000","last_active":"2024-04-26T23:40:33.580955+0000","last_peered":"2024-04-26T23:40:33.580955+0000","last_clean":"2024-04-26T23:40:33.580955+0000","last_became_active":"2024-04-26T23:40:31.573434+0000","last_became_peered":"2024-04-26T23:40:31.573434+0000","last_unstale":"2024-04-26T23:40:33.580955+0000","last_undegraded":"2024-04-26T23:40:33.580955+0000","last_fullsized":"2024-04-26T23:40:33.580955+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:20:28.103413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T23:40:32.594502+0000","last_change":"2024-04-26T23:40:32.584988+0000","last_active":"2024-04-26T23:40:32.594502+0000","last_peered":"2024-04-26T23:40:32.594502+0000","last_clean":"2024-04-26T23:40:32.594502+0000","last_became_active":"2024-04-26T23:40:32.584467+0000","last_became_peered":"2024-04-26T23:40:32.584467+0000","last_unstale":"2024-04-26T23:40:32.594502+0000","last_undegraded":"2024-04-26T23:40:32.594502+0000","last_fullsized":"2024-04-26T23:40:32.594502+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:15:31.888521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T23:40:32.574009+0000","last_change":"2024-04-26T23:40:31.576866+0000","last_active":"2024-04-26T23:40:32.574009+0000","last_peered":"2024-04-26T23:40:32.574009+0000","last_clean":"2024-04-26T23:40:32.574009+0000","last_became_active":"2024-04-26T23:40:31.576419+0000","last_became_peered":"2024-04-26T23:40:31.576419+0000","last_unstale":"2024-04-26T23:40:32.574009+0000","last_undegraded":"2024-04-26T23:40:32.574009+0000","last_fullsized":"2024-04-26T23:40:32.574009+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:45:49.295198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:40:33.580187+0000","last_change":"2024-04-26T23:40:32.583019+0000","last_active":"2024-04-26T23:40:33.580187+0000","last_peered":"2024-04-26T23:40:33.580187+0000","last_clean":"2024-04-26T23:40:33.580187+0000","last_became_active":"2024-04-26T23:40:32.582719+0000","last_became_peered":"2024-04-26T23:40:32.582719+0000","last_unstale":"2024-04-26T23:40:33.580187+0000","last_undegraded":"2024-04-26T23:40:33.580187+0000","last_fullsized":"2024-04-26T23:40:33.580187+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:25:02.319783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:40:33.580199+0000","last_change":"2024-04-26T23:40:31.575508+0000","last_active":"2024-04-26T23:40:33.580199+0000","last_peered":"2024-04-26T23:40:33.580199+0000","last_clean":"2024-04-26T23:40:33.580199+0000","last_became_active":"2024-04-26T23:40:31.575242+0000","last_became_peered":"2024-04-26T23:40:31.575242+0000","last_unstale":"2024-04-26T23:40:33.580199+0000","last_undegraded":"2024-04-26T23:40:33.580199+0000","last_fullsized":"2024-04-26T23:40:33.580199+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:48:32.015654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T23:40:32.594121+0000","last_change":"2024-04-26T23:40:32.582721+0000","last_active":"2024-04-26T23:40:32.594121+0000","last_peered":"2024-04-26T23:40:32.594121+0000","last_clean":"2024-04-26T23:40:32.594121+0000","last_became_active":"2024-04-26T23:40:32.582438+0000","last_became_peered":"2024-04-26T23:40:32.582438+0000","last_unstale":"2024-04-26T23:40:32.594121+0000","last_undegraded":"2024-04-26T23:40:32.594121+0000","last_fullsized":"2024-04-26T23:40:32.594121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:45:50.299583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:40:33.580136+0000","last_change":"2024-04-26T23:40:31.575121+0000","last_active":"2024-04-26T23:40:33.580136+0000","last_peered":"2024-04-26T23:40:33.580136+0000","last_clean":"2024-04-26T23:40:33.580136+0000","last_became_active":"2024-04-26T23:40:31.574827+0000","last_became_peered":"2024-04-26T23:40:31.574827+0000","last_unstale":"2024-04-26T23:40:33.580136+0000","last_undegraded":"2024-04-26T23:40:33.580136+0000","last_fullsized":"2024-04-26T23:40:33.580136+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:43:13.740214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T23:40:32.598545+0000","last_change":"2024-04-26T23:40:32.585827+0000","last_active":"2024-04-26T23:40:32.598545+0000","last_peered":"2024-04-26T23:40:32.598545+0000","last_clean":"2024-04-26T23:40:32.598545+0000","last_became_active":"2024-04-26T23:40:32.585522+0000","last_became_peered":"2024-04-26T23:40:32.585522+0000","last_unstale":"2024-04-26T23:40:32.598545+0000","last_undegraded":"2024-04-26T23:40:32.598545+0000","last_fullsized":"2024-04-26T23:40:32.598545+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:48:33.020039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T23:40:32.598212+0000","last_change":"2024-04-26T23:40:31.578524+0000","last_active":"2024-04-26T23:40:32.598212+0000","last_peered":"2024-04-26T23:40:32.598212+0000","last_clean":"2024-04-26T23:40:32.598212+0000","last_became_active":"2024-04-26T23:40:31.578230+0000","last_became_peered":"2024-04-26T23:40:31.578230+0000","last_unstale":"2024-04-26T23:40:32.598212+0000","last_undegraded":"2024-04-26T23:40:32.598212+0000","last_fullsized":"2024-04-26T23:40:32.598212+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:15:51.937774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:40:33.580591+0000","last_change":"2024-04-26T23:40:32.590053+0000","last_active":"2024-04-26T23:40:33.580591+0000","last_peered":"2024-04-26T23:40:33.580591+0000","last_clean":"2024-04-26T23:40:33.580591+0000","last_became_active":"2024-04-26T23:40:32.589802+0000","last_became_peered":"2024-04-26T23:40:32.589802+0000","last_unstale":"2024-04-26T23:40:33.580591+0000","last_undegraded":"2024-04-26T23:40:33.580591+0000","last_fullsized":"2024-04-26T23:40:33.580591+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:16:46.547536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T23:40:32.592510+0000","last_change":"2024-04-26T23:40:32.588309+0000","last_active":"2024-04-26T23:40:32.592510+0000","last_peered":"2024-04-26T23:40:32.592510+0000","last_clean":"2024-04-26T23:40:32.592510+0000","last_became_active":"2024-04-26T23:40:32.588007+0000","last_became_peered":"2024-04-26T23:40:32.588007+0000","last_unstale":"2024-04-26T23:40:32.592510+0000","last_undegraded":"2024-04-26T23:40:32.592510+0000","last_fullsized":"2024-04-26T23:40:32.592510+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:15:01.970308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T23:40:32.597515+0000","last_change":"2024-04-26T23:40:31.573648+0000","last_active":"2024-04-26T23:40:32.597515+0000","last_peered":"2024-04-26T23:40:32.597515+0000","last_clean":"2024-04-26T23:40:32.597515+0000","last_became_active":"2024-04-26T23:40:31.573347+0000","last_became_peered":"2024-04-26T23:40:31.573347+0000","last_unstale":"2024-04-26T23:40:32.597515+0000","last_undegraded":"2024-04-26T23:40:32.597515+0000","last_fullsized":"2024-04-26T23:40:32.597515+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:20:28.103413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T23:40:32.596980+0000","last_change":"2024-04-26T23:40:32.590624+0000","last_active":"2024-04-26T23:40:32.596980+0000","last_peered":"2024-04-26T23:40:32.596980+0000","last_clean":"2024-04-26T23:40:32.596980+0000","last_became_active":"2024-04-26T23:40:32.589687+0000","last_became_peered":"2024-04-26T23:40:32.589687+0000","last_unstale":"2024-04-26T23:40:32.596980+0000","last_undegraded":"2024-04-26T23:40:32.596980+0000","last_fullsized":"2024-04-26T23:40:32.596980+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:51:30.677247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T23:40:32.595206+0000","last_change":"2024-04-26T23:40:31.578735+0000","last_active":"2024-04-26T23:40:32.595206+0000","last_peered":"2024-04-26T23:40:32.595206+0000","last_clean":"2024-04-26T23:40:32.595206+0000","last_became_active":"2024-04-26T23:40:31.578438+0000","last_became_peered":"2024-04-26T23:40:31.578438+0000","last_unstale":"2024-04-26T23:40:32.595206+0000","last_undegraded":"2024-04-26T23:40:32.595206+0000","last_fullsized":"2024-04-26T23:40:32.595206+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:30:10.397569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T23:40:32.598058+0000","last_change":"2024-04-26T23:40:32.589769+0000","last_active":"2024-04-26T23:40:32.598058+0000","last_peered":"2024-04-26T23:40:32.598058+0000","last_clean":"2024-04-26T23:40:32.598058+0000","last_became_active":"2024-04-26T23:40:32.589489+0000","last_became_peered":"2024-04-26T23:40:32.589489+0000","last_unstale":"2024-04-26T23:40:32.598058+0000","last_undegraded":"2024-04-26T23:40:32.598058+0000","last_fullsized":"2024-04-26T23:40:32.598058+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:20:29.107798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T23:40:32.598460+0000","last_change":"2024-04-26T23:40:31.576867+0000","last_active":"2024-04-26T23:40:32.598460+0000","last_peered":"2024-04-26T23:40:32.598460+0000","last_clean":"2024-04-26T23:40:32.598460+0000","last_became_active":"2024-04-26T23:40:31.576342+0000","last_became_peered":"2024-04-26T23:40:31.576342+0000","last_unstale":"2024-04-26T23:40:32.598460+0000","last_undegraded":"2024-04-26T23:40:32.598460+0000","last_fullsized":"2024-04-26T23:40:32.598460+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:35:54.439397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T23:40:32.582703+0000","last_change":"2024-04-26T23:40:32.578489+0000","last_active":"2024-04-26T23:40:32.582703+0000","last_peered":"2024-04-26T23:40:32.582703+0000","last_clean":"2024-04-26T23:40:32.582703+0000","last_became_active":"2024-04-26T23:40:32.578205+0000","last_became_peered":"2024-04-26T23:40:32.578205+0000","last_unstale":"2024-04-26T23:40:32.582703+0000","last_undegraded":"2024-04-26T23:40:32.582703+0000","last_fullsized":"2024-04-26T23:40:32.582703+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:43:14.744600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T23:40:32.600506+0000","last_change":"2024-04-26T23:40:31.576688+0000","last_active":"2024-04-26T23:40:32.600506+0000","last_peered":"2024-04-26T23:40:32.600506+0000","last_clean":"2024-04-26T23:40:32.600506+0000","last_became_active":"2024-04-26T23:40:31.576429+0000","last_became_peered":"2024-04-26T23:40:31.576429+0000","last_unstale":"2024-04-26T23:40:32.600506+0000","last_undegraded":"2024-04-26T23:40:32.600506+0000","last_fullsized":"2024-04-26T23:40:32.600506+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:47:42.681376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27796,"kb_used_data":772,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344044,"statfs":{"total":96636764160,"available":96608301056,"internally_reserved":0,"allocated":790528,"data_stored":655529,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":204800,"data_stored":66191,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":196608,"data_stored":64669,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":204800,"data_stored":64705,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":204800,"data_stored":66191,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27208,"kb_used_data":188,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344632,"statfs":{"total":96636764160,"available":96608903168,"internally_reserved":0,"allocated":192512,"data_stored":64579,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27216,"kb_used_data":196,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344624,"statfs":{"total":96636764160,"available":96608894976,"internally_reserved":0,"allocated":200704,"data_stored":64739,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27800,"kb_used_data":780,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344040,"statfs":{"total":96636764160,"available":96608296960,"internally_reserved":0,"allocated":798720,"data_stored":655585,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T23:40:36.592 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T23:40:36.725 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:36.721+0000 7ff2ced96640 1 Processor -- start 2024-04-26T23:40:36.725 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:36.721+0000 7ff2ced96640 1 -- start start 2024-04-26T23:40:36.727 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:36.722+0000 7ff2ced96640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ff2c81521f0 0x7ff2c806d320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:36.727 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:36.722+0000 7ff2ced96640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff2c806d860 0x7ff2c8158a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:36.727 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:36.722+0000 7ff2ced96640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff2c8070410 con 0x7ff2c80c6960 2024-04-26T23:40:36.727 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:36.722+0000 7ff2ced96640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7ff2c806f660 con 0x7ff2c81521f0 2024-04-26T23:40:36.727 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:36.722+0000 7ff2ced96640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7ff2c806f8b0 con 0x7ff2c806d860 2024-04-26T23:40:36.727 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:36.722+0000 7ff2ccb32640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ff2c81521f0 0x7ff2c806d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:36.727 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:36.722+0000 7ff2c7fff640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7ff2c80c6960 0x7ff2c8158370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:39826/0 (socket says 172.21.15.88:39826) 2024-04-26T23:40:36.727 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:36.722+0000 7ff2c7fff640 1 -- 172.21.15.88:0/2724780448 learned_addr learned my addr 172.21.15.88:0/2724780448 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-26T23:40:36.727 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:36.722+0000 7ff2ccb32640 1 -- 172.21.15.88:0/2724780448 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff2c806d860 msgr2=0x7ff2c8158a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:40:36.727 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:36.722+0000 7ff2ccb32640 1 --2- 172.21.15.88:0/2724780448 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff2c806d860 0x7ff2c8158a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:36.727 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:36.722+0000 7ff2ccb32640 1 -- 172.21.15.88:0/2724780448 >> v1:172.21.15.88:6789/0 conn(0x7ff2c80c6960 legacy=0x7ff2c8158370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:36.728 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:36.722+0000 7ff2ccb32640 1 -- 172.21.15.88:0/2724780448 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2c806fb90 con 0x7ff2c81521f0 2024-04-26T23:40:36.728 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:36.723+0000 7ff2ccb32640 1 --2- 172.21.15.88:0/2724780448 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff2c81521f0 0x7ff2c806d320 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ff2b80097a0 tx=0x7ff2b802a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bfa78b7622d7bf4 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:36.728 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:36.723+0000 7ff2c77fe640 1 -- 172.21.15.88:0/2724780448 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2b8037070 con 0x7ff2c81521f0 2024-04-26T23:40:36.728 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:36.723+0000 7ff2c77fe640 1 -- 172.21.15.88:0/2724780448 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2b802ae50 con 0x7ff2c81521f0 2024-04-26T23:40:36.728 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:36.723+0000 7ff2c77fe640 1 -- 172.21.15.88:0/2724780448 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2b8032660 con 0x7ff2c81521f0 2024-04-26T23:40:36.731 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:36.724+0000 7ff2ced96640 1 -- 172.21.15.88:0/2724780448 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff2c81521f0 msgr2=0x7ff2c806d320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:36.731 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:36.724+0000 7ff2ced96640 1 --2- 172.21.15.88:0/2724780448 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff2c81521f0 0x7ff2c806d320 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ff2b80097a0 tx=0x7ff2b802a100 comp rx=0 tx=0).stop 2024-04-26T23:40:36.731 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:36.724+0000 7ff2ced96640 1 -- 172.21.15.88:0/2724780448 shutdown_connections 2024-04-26T23:40:36.731 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:36.724+0000 7ff2ced96640 1 --2- 172.21.15.88:0/2724780448 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff2c806d860 0x7ff2c8158a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:36.731 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:36.724+0000 7ff2ced96640 1 --2- 172.21.15.88:0/2724780448 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff2c81521f0 0x7ff2c806d320 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:36.731 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:36.724+0000 7ff2ced96640 1 -- 172.21.15.88:0/2724780448 >> 172.21.15.88:0/2724780448 conn(0x7ff2c80c5ce0 msgr2=0x7ff2c80c60c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:40:36.731 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:36.724+0000 7ff2ced96640 1 -- 172.21.15.88:0/2724780448 shutdown_connections 2024-04-26T23:40:36.731 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:36.724+0000 7ff2ced96640 1 -- 172.21.15.88:0/2724780448 wait complete. 2024-04-26T23:40:36.732 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:36.725+0000 7ff2ced96640 1 Processor -- start 2024-04-26T23:40:36.732 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:36.725+0000 7ff2ced96640 1 -- start start 2024-04-26T23:40:36.732 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:36.725+0000 7ff2ced96640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff2c806d860 0x7ff2c80c7d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:36.732 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:36.725+0000 7ff2ced96640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff2c80c6960 0x7ff2c8149170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:36.732 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:36.725+0000 7ff2ced96640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff2c81521f0 0x7ff2c8145f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:36.732 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:36.725+0000 7ff2ced96640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7ff2c80701b0 con 0x7ff2c806d860 2024-04-26T23:40:36.732 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:36.725+0000 7ff2ced96640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff2c8070030 con 0x7ff2c80c6960 2024-04-26T23:40:36.732 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:36.725+0000 7ff2ced96640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7ff2c8070c20 con 0x7ff2c81521f0 2024-04-26T23:40:36.732 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:36.726+0000 7ff2ccb32640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff2c806d860 0x7ff2c80c7d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:36.732 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:36.726+0000 7ff2ccb32640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff2c806d860 0x7ff2c80c7d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:57410/0 (socket says 172.21.15.88:57410) 2024-04-26T23:40:36.732 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:36.726+0000 7ff2ccb32640 1 -- 172.21.15.88:0/1812785979 learned_addr learned my addr 172.21.15.88:0/1812785979 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:40:36.732 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:36.726+0000 7ff2ccb32640 1 -- 172.21.15.88:0/1812785979 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff2c81521f0 msgr2=0x7ff2c8145f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:36.732 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:36.726+0000 7ff2cd333640 1 --2- 172.21.15.88:0/1812785979 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff2c81521f0 0x7ff2c8145f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:36.732 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:36.726+0000 7ff2ccb32640 1 --2- 172.21.15.88:0/1812785979 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff2c81521f0 0x7ff2c8145f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:36.732 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:36.726+0000 7ff2ccb32640 1 -- 172.21.15.88:0/1812785979 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff2c80c6960 msgr2=0x7ff2c8149170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:36.732 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:36.726+0000 7ff2c7fff640 1 --2- 172.21.15.88:0/1812785979 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff2c80c6960 0x7ff2c8149170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:36.733 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:36.726+0000 7ff2ccb32640 1 --2- 172.21.15.88:0/1812785979 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff2c80c6960 0x7ff2c8149170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:36.733 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:36.726+0000 7ff2ccb32640 1 -- 172.21.15.88:0/1812785979 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2c8145810 con 0x7ff2c806d860 2024-04-26T23:40:36.733 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:36.726+0000 7ff2ccb32640 1 --2- 172.21.15.88:0/1812785979 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff2c806d860 0x7ff2c80c7d80 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7ff2b80098c0 tx=0x7ff2b80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:36.733 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:36.726+0000 7ff2c57fa640 1 -- 172.21.15.88:0/1812785979 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2b8041020 con 0x7ff2c806d860 2024-04-26T23:40:36.733 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:36.726+0000 7ff2c57fa640 1 -- 172.21.15.88:0/1812785979 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2b803c870 con 0x7ff2c806d860 2024-04-26T23:40:36.733 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:36.726+0000 7ff2c57fa640 1 -- 172.21.15.88:0/1812785979 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2b8037040 con 0x7ff2c806d860 2024-04-26T23:40:36.733 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:36.726+0000 7ff2ced96640 1 -- 172.21.15.88:0/1812785979 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2c814c650 con 0x7ff2c806d860 2024-04-26T23:40:36.733 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:36.726+0000 7ff2ced96640 1 -- 172.21.15.88:0/1812785979 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2c8146870 con 0x7ff2c806d860 2024-04-26T23:40:36.733 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:36.727+0000 7ff2ced96640 1 -- 172.21.15.88:0/1812785979 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff2c80507a0 con 0x7ff2c806d860 2024-04-26T23:40:36.734 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:36.728+0000 7ff2c57fa640 1 -- 172.21.15.88:0/1812785979 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff2b8044020 con 0x7ff2c806d860 2024-04-26T23:40:36.734 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:36.728+0000 7ff2c57fa640 1 --2- 172.21.15.88:0/1812785979 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7ff2b406c8f0 0x7ff2b406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:36.734 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:36.728+0000 7ff2c7fff640 1 --2- 172.21.15.88:0/1812785979 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7ff2b406c8f0 0x7ff2b406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:36.734 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:36.728+0000 7ff2c57fa640 1 -- 172.21.15.88:0/1812785979 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5689+0+0 (secure 0 0 0) 0x7ff2b80ac2f0 con 0x7ff2c806d860 2024-04-26T23:40:36.734 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:36.729+0000 7ff2c7fff640 1 --2- 172.21.15.88:0/1812785979 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7ff2b406c8f0 0x7ff2b406edb0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ff2c8144bf0 tx=0x7ff2bc009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:36.736 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:36.732+0000 7ff2c57fa640 1 -- 172.21.15.88:0/1812785979 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7ff2b804b030 con 0x7ff2c806d860 2024-04-26T23:40:36.909 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:36.905+0000 7ff2ced96640 1 -- 172.21.15.88:0/1812785979 --> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff2c80ae770 con 0x7ff2b406c8f0 2024-04-26T23:40:36.915 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:36.911+0000 7ff2c57fa640 1 -- 172.21.15.88:0/1812785979 <== mgr.4104 v2:172.21.15.88:6832/651674297 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251901 (secure 0 0 0) 0x7ff2c80ae770 con 0x7ff2b406c8f0 2024-04-26T23:40:36.918 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-26T23:40:36.919 INFO:teuthology.orchestra.run.smithi088.stderr:dumped all 2024-04-26T23:40:36.920 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:36.914+0000 7ff2ced96640 1 -- 172.21.15.88:0/1812785979 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7ff2b406c8f0 msgr2=0x7ff2b406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:36.920 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:36.914+0000 7ff2ced96640 1 --2- 172.21.15.88:0/1812785979 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7ff2b406c8f0 0x7ff2b406edb0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ff2c8144bf0 tx=0x7ff2bc009040 comp rx=0 tx=0).stop 2024-04-26T23:40:36.920 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:36.914+0000 7ff2ced96640 1 -- 172.21.15.88:0/1812785979 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff2c806d860 msgr2=0x7ff2c80c7d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:36.920 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:36.914+0000 7ff2ced96640 1 --2- 172.21.15.88:0/1812785979 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff2c806d860 0x7ff2c80c7d80 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7ff2b80098c0 tx=0x7ff2b80046c0 comp rx=0 tx=0).stop 2024-04-26T23:40:36.921 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:36.914+0000 7ff2ced96640 1 -- 172.21.15.88:0/1812785979 shutdown_connections 2024-04-26T23:40:36.921 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:36.914+0000 7ff2ced96640 1 --2- 172.21.15.88:0/1812785979 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7ff2b406c8f0 0x7ff2b406edb0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:36.921 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:36.914+0000 7ff2ced96640 1 --2- 172.21.15.88:0/1812785979 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff2c81521f0 0x7ff2c8145f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:36.921 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:36.914+0000 7ff2ced96640 1 --2- 172.21.15.88:0/1812785979 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff2c80c6960 0x7ff2c8149170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:36.921 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:36.914+0000 7ff2ced96640 1 --2- 172.21.15.88:0/1812785979 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff2c806d860 0x7ff2c80c7d80 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:36.921 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:36.914+0000 7ff2ced96640 1 -- 172.21.15.88:0/1812785979 >> 172.21.15.88:0/1812785979 conn(0x7ff2c80c5ce0 msgr2=0x7ff2c81537f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:40:36.921 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:36.914+0000 7ff2ced96640 1 -- 172.21.15.88:0/1812785979 shutdown_connections 2024-04-26T23:40:36.921 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:36.914+0000 7ff2ced96640 1 -- 172.21.15.88:0/1812785979 wait complete. 2024-04-26T23:40:36.928 INFO:teuthology.orchestra.run.smithi088.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2024-04-26T23:40:35.922884+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":108,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218892,"kb_used_data":2728,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755828,"statfs":{"total":773094113280,"available":772869967872,"internally_reserved":0,"allocated":2793472,"data_stored":1702188,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":36,"apply_latency_ms":36,"commit_latency_ns":36000000,"apply_latency_ns":36000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.369781"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T23:40:32.599966+0000","last_change":"2024-04-26T23:40:32.596351+0000","last_active":"2024-04-26T23:40:32.599966+0000","last_peered":"2024-04-26T23:40:32.599966+0000","last_clean":"2024-04-26T23:40:32.599966+0000","last_became_active":"2024-04-26T23:40:32.596050+0000","last_became_peered":"2024-04-26T23:40:32.596050+0000","last_unstale":"2024-04-26T23:40:32.599966+0000","last_undegraded":"2024-04-26T23:40:32.599966+0000","last_fullsized":"2024-04-26T23:40:32.599966+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:18:09.706875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:40:33.580264+0000","last_change":"2024-04-26T23:40:32.583944+0000","last_active":"2024-04-26T23:40:33.580264+0000","last_peered":"2024-04-26T23:40:33.580264+0000","last_clean":"2024-04-26T23:40:33.580264+0000","last_became_active":"2024-04-26T23:40:32.583655+0000","last_became_peered":"2024-04-26T23:40:32.583655+0000","last_unstale":"2024-04-26T23:40:33.580264+0000","last_undegraded":"2024-04-26T23:40:33.580264+0000","last_fullsized":"2024-04-26T23:40:33.580264+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:40:17.167353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T23:40:32.583602+0000","last_change":"2024-04-26T23:40:32.579870+0000","last_active":"2024-04-26T23:40:32.583602+0000","last_peered":"2024-04-26T23:40:32.583602+0000","last_clean":"2024-04-26T23:40:32.583602+0000","last_became_active":"2024-04-26T23:40:32.579569+0000","last_became_peered":"2024-04-26T23:40:32.579569+0000","last_unstale":"2024-04-26T23:40:32.583602+0000","last_undegraded":"2024-04-26T23:40:32.583602+0000","last_fullsized":"2024-04-26T23:40:32.583602+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:50:22.335206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T23:40:32.589442+0000","last_change":"2024-04-26T23:40:32.581875+0000","last_active":"2024-04-26T23:40:32.589442+0000","last_peered":"2024-04-26T23:40:32.589442+0000","last_clean":"2024-04-26T23:40:32.589442+0000","last_became_active":"2024-04-26T23:40:32.580987+0000","last_became_peered":"2024-04-26T23:40:32.580987+0000","last_unstale":"2024-04-26T23:40:32.589442+0000","last_undegraded":"2024-04-26T23:40:32.589442+0000","last_fullsized":"2024-04-26T23:40:32.589442+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:15:52.942160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T23:40:32.590967+0000","last_change":"2024-04-26T23:40:32.588894+0000","last_active":"2024-04-26T23:40:32.590967+0000","last_peered":"2024-04-26T23:40:32.590967+0000","last_clean":"2024-04-26T23:40:32.590967+0000","last_became_active":"2024-04-26T23:40:32.588409+0000","last_became_peered":"2024-04-26T23:40:32.588409+0000","last_unstale":"2024-04-26T23:40:32.590967+0000","last_undegraded":"2024-04-26T23:40:32.590967+0000","last_fullsized":"2024-04-26T23:40:32.590967+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:14:04.372681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T23:40:32.587582+0000","last_change":"2024-04-26T23:40:32.584619+0000","last_active":"2024-04-26T23:40:32.587582+0000","last_peered":"2024-04-26T23:40:32.587582+0000","last_clean":"2024-04-26T23:40:32.587582+0000","last_became_active":"2024-04-26T23:40:32.584293+0000","last_became_peered":"2024-04-26T23:40:32.584293+0000","last_unstale":"2024-04-26T23:40:32.587582+0000","last_undegraded":"2024-04-26T23:40:32.587582+0000","last_fullsized":"2024-04-26T23:40:32.587582+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:25:30.040358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T23:40:32.591266+0000","last_change":"2024-04-26T23:40:32.587562+0000","last_active":"2024-04-26T23:40:32.591266+0000","last_peered":"2024-04-26T23:40:32.591266+0000","last_clean":"2024-04-26T23:40:32.591266+0000","last_became_active":"2024-04-26T23:40:32.587249+0000","last_became_peered":"2024-04-26T23:40:32.587249+0000","last_unstale":"2024-04-26T23:40:32.591266+0000","last_undegraded":"2024-04-26T23:40:32.591266+0000","last_fullsized":"2024-04-26T23:40:32.591266+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:10:42.603833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T23:40:32.598538+0000","last_change":"2024-04-26T23:40:32.592543+0000","last_active":"2024-04-26T23:40:32.598538+0000","last_peered":"2024-04-26T23:40:32.598538+0000","last_clean":"2024-04-26T23:40:32.598538+0000","last_became_active":"2024-04-26T23:40:32.592282+0000","last_became_peered":"2024-04-26T23:40:32.592282+0000","last_unstale":"2024-04-26T23:40:32.598538+0000","last_undegraded":"2024-04-26T23:40:32.598538+0000","last_fullsized":"2024-04-26T23:40:32.598538+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:30:11.401955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T23:40:32.597139+0000","last_change":"2024-04-26T23:40:32.591487+0000","last_active":"2024-04-26T23:40:32.597139+0000","last_peered":"2024-04-26T23:40:32.597139+0000","last_clean":"2024-04-26T23:40:32.597139+0000","last_became_active":"2024-04-26T23:40:32.591209+0000","last_became_peered":"2024-04-26T23:40:32.591209+0000","last_unstale":"2024-04-26T23:40:32.597139+0000","last_undegraded":"2024-04-26T23:40:32.597139+0000","last_fullsized":"2024-04-26T23:40:32.597139+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:15:01.970308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:40:33.581065+0000","last_change":"2024-04-26T23:40:32.578155+0000","last_active":"2024-04-26T23:40:33.581065+0000","last_peered":"2024-04-26T23:40:33.581065+0000","last_clean":"2024-04-26T23:40:33.581065+0000","last_became_active":"2024-04-26T23:40:32.577865+0000","last_became_peered":"2024-04-26T23:40:32.577865+0000","last_unstale":"2024-04-26T23:40:33.581065+0000","last_undegraded":"2024-04-26T23:40:33.581065+0000","last_fullsized":"2024-04-26T23:40:33.581065+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:40:17.167353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:40:33.580856+0000","last_change":"2024-04-26T23:40:32.578819+0000","last_active":"2024-04-26T23:40:33.580856+0000","last_peered":"2024-04-26T23:40:33.580856+0000","last_clean":"2024-04-26T23:40:33.580856+0000","last_became_active":"2024-04-26T23:40:32.578556+0000","last_became_peered":"2024-04-26T23:40:32.578556+0000","last_unstale":"2024-04-26T23:40:33.580856+0000","last_undegraded":"2024-04-26T23:40:33.580856+0000","last_fullsized":"2024-04-26T23:40:33.580856+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:17:46.135806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:40:33.579917+0000","last_change":"2024-04-26T23:40:32.595129+0000","last_active":"2024-04-26T23:40:33.579917+0000","last_peered":"2024-04-26T23:40:33.579917+0000","last_clean":"2024-04-26T23:40:33.579917+0000","last_became_active":"2024-04-26T23:40:32.594802+0000","last_became_peered":"2024-04-26T23:40:32.594802+0000","last_unstale":"2024-04-26T23:40:33.579917+0000","last_undegraded":"2024-04-26T23:40:33.579917+0000","last_fullsized":"2024-04-26T23:40:33.579917+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:48:33.020039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T23:40:32.598623+0000","last_change":"2024-04-26T23:40:32.592988+0000","last_active":"2024-04-26T23:40:32.598623+0000","last_peered":"2024-04-26T23:40:32.598623+0000","last_clean":"2024-04-26T23:40:32.598623+0000","last_became_active":"2024-04-26T23:40:32.592717+0000","last_became_peered":"2024-04-26T23:40:32.592717+0000","last_unstale":"2024-04-26T23:40:32.598623+0000","last_undegraded":"2024-04-26T23:40:32.598623+0000","last_fullsized":"2024-04-26T23:40:32.598623+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:47:51.559918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T23:40:32.594908+0000","last_change":"2024-04-26T23:40:32.586436+0000","last_active":"2024-04-26T23:40:32.594908+0000","last_peered":"2024-04-26T23:40:32.594908+0000","last_clean":"2024-04-26T23:40:32.594908+0000","last_became_active":"2024-04-26T23:40:32.585995+0000","last_became_peered":"2024-04-26T23:40:32.585995+0000","last_unstale":"2024-04-26T23:40:32.594908+0000","last_undegraded":"2024-04-26T23:40:32.594908+0000","last_fullsized":"2024-04-26T23:40:32.594908+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:43:14.744600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:40:33.580102+0000","last_change":"2024-04-26T23:40:32.590452+0000","last_active":"2024-04-26T23:40:33.580102+0000","last_peered":"2024-04-26T23:40:33.580102+0000","last_clean":"2024-04-26T23:40:33.580102+0000","last_became_active":"2024-04-26T23:40:32.590162+0000","last_became_peered":"2024-04-26T23:40:32.590162+0000","last_unstale":"2024-04-26T23:40:33.580102+0000","last_undegraded":"2024-04-26T23:40:33.580102+0000","last_fullsized":"2024-04-26T23:40:33.580102+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:51:30.677247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T23:40:32.588238+0000","last_change":"2024-04-26T23:40:32.585137+0000","last_active":"2024-04-26T23:40:32.588238+0000","last_peered":"2024-04-26T23:40:32.588238+0000","last_clean":"2024-04-26T23:40:32.588238+0000","last_became_active":"2024-04-26T23:40:32.584678+0000","last_became_peered":"2024-04-26T23:40:32.584678+0000","last_unstale":"2024-04-26T23:40:32.588238+0000","last_undegraded":"2024-04-26T23:40:32.588238+0000","last_fullsized":"2024-04-26T23:40:32.588238+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:14:04.372681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T23:40:32.599665+0000","last_change":"2024-04-26T23:40:32.593432+0000","last_active":"2024-04-26T23:40:32.599665+0000","last_peered":"2024-04-26T23:40:32.599665+0000","last_clean":"2024-04-26T23:40:32.599665+0000","last_became_active":"2024-04-26T23:40:32.593169+0000","last_became_peered":"2024-04-26T23:40:32.593169+0000","last_unstale":"2024-04-26T23:40:32.599665+0000","last_undegraded":"2024-04-26T23:40:32.599665+0000","last_fullsized":"2024-04-26T23:40:32.599665+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:38:10.884592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:40:33.640578+0000","last_change":"2024-04-26T23:40:32.574795+0000","last_active":"2024-04-26T23:40:33.640578+0000","last_peered":"2024-04-26T23:40:33.640578+0000","last_clean":"2024-04-26T23:40:33.640578+0000","last_became_active":"2024-04-26T23:40:32.574503+0000","last_became_peered":"2024-04-26T23:40:32.574503+0000","last_unstale":"2024-04-26T23:40:33.640578+0000","last_undegraded":"2024-04-26T23:40:33.640578+0000","last_fullsized":"2024-04-26T23:40:33.640578+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:30:11.401955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T23:40:32.591794+0000","last_change":"2024-04-26T23:40:32.588445+0000","last_active":"2024-04-26T23:40:32.591794+0000","last_peered":"2024-04-26T23:40:32.591794+0000","last_clean":"2024-04-26T23:40:32.591794+0000","last_became_active":"2024-04-26T23:40:32.588063+0000","last_became_peered":"2024-04-26T23:40:32.588063+0000","last_unstale":"2024-04-26T23:40:32.591794+0000","last_undegraded":"2024-04-26T23:40:32.591794+0000","last_fullsized":"2024-04-26T23:40:32.591794+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:25:30.040358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:40:33.581025+0000","last_change":"2024-04-26T23:40:32.590538+0000","last_active":"2024-04-26T23:40:33.581025+0000","last_peered":"2024-04-26T23:40:33.581025+0000","last_clean":"2024-04-26T23:40:33.581025+0000","last_became_active":"2024-04-26T23:40:32.590241+0000","last_became_peered":"2024-04-26T23:40:32.590241+0000","last_unstale":"2024-04-26T23:40:33.581025+0000","last_undegraded":"2024-04-26T23:40:33.581025+0000","last_fullsized":"2024-04-26T23:40:33.581025+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:38:10.884592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T23:40:32.598032+0000","last_change":"2024-04-26T23:40:32.590443+0000","last_active":"2024-04-26T23:40:32.598032+0000","last_peered":"2024-04-26T23:40:32.598032+0000","last_clean":"2024-04-26T23:40:32.598032+0000","last_became_active":"2024-04-26T23:40:32.590193+0000","last_became_peered":"2024-04-26T23:40:32.590193+0000","last_unstale":"2024-04-26T23:40:32.598032+0000","last_undegraded":"2024-04-26T23:40:32.598032+0000","last_fullsized":"2024-04-26T23:40:32.598032+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:25:02.319783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T23:40:32.596882+0000","last_change":"2024-04-26T23:40:32.591700+0000","last_active":"2024-04-26T23:40:32.596882+0000","last_peered":"2024-04-26T23:40:32.596882+0000","last_clean":"2024-04-26T23:40:32.596882+0000","last_became_active":"2024-04-26T23:40:32.591366+0000","last_became_peered":"2024-04-26T23:40:32.591366+0000","last_unstale":"2024-04-26T23:40:32.596882+0000","last_undegraded":"2024-04-26T23:40:32.596882+0000","last_fullsized":"2024-04-26T23:40:32.596882+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:17:46.135806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T23:40:32.601723+0000","last_change":"2024-04-26T23:40:32.593958+0000","last_active":"2024-04-26T23:40:32.601723+0000","last_peered":"2024-04-26T23:40:32.601723+0000","last_clean":"2024-04-26T23:40:32.601723+0000","last_became_active":"2024-04-26T23:40:32.593639+0000","last_became_peered":"2024-04-26T23:40:32.593639+0000","last_unstale":"2024-04-26T23:40:32.601723+0000","last_undegraded":"2024-04-26T23:40:32.601723+0000","last_fullsized":"2024-04-26T23:40:32.601723+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:25:30.040358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T23:40:32.588214+0000","last_change":"2024-04-26T23:40:32.582959+0000","last_active":"2024-04-26T23:40:32.588214+0000","last_peered":"2024-04-26T23:40:32.588214+0000","last_clean":"2024-04-26T23:40:32.588214+0000","last_became_active":"2024-04-26T23:40:32.582100+0000","last_became_peered":"2024-04-26T23:40:32.582100+0000","last_unstale":"2024-04-26T23:40:32.588214+0000","last_undegraded":"2024-04-26T23:40:32.588214+0000","last_fullsized":"2024-04-26T23:40:32.588214+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:30:11.401955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T23:40:32.598505+0000","last_change":"2024-04-26T23:40:32.588177+0000","last_active":"2024-04-26T23:40:32.598505+0000","last_peered":"2024-04-26T23:40:32.598505+0000","last_clean":"2024-04-26T23:40:32.598505+0000","last_became_active":"2024-04-26T23:40:32.586926+0000","last_became_peered":"2024-04-26T23:40:32.586926+0000","last_unstale":"2024-04-26T23:40:32.598505+0000","last_undegraded":"2024-04-26T23:40:32.598505+0000","last_fullsized":"2024-04-26T23:40:32.598505+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:15:52.942160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:40:33.581087+0000","last_change":"2024-04-26T23:40:32.589080+0000","last_active":"2024-04-26T23:40:33.581087+0000","last_peered":"2024-04-26T23:40:33.581087+0000","last_clean":"2024-04-26T23:40:33.581087+0000","last_became_active":"2024-04-26T23:40:32.588793+0000","last_became_peered":"2024-04-26T23:40:32.588793+0000","last_unstale":"2024-04-26T23:40:33.581087+0000","last_undegraded":"2024-04-26T23:40:33.581087+0000","last_fullsized":"2024-04-26T23:40:33.581087+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:18:09.706875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:40:33.580158+0000","last_change":"2024-04-26T23:40:32.583376+0000","last_active":"2024-04-26T23:40:33.580158+0000","last_peered":"2024-04-26T23:40:33.580158+0000","last_clean":"2024-04-26T23:40:33.580158+0000","last_became_active":"2024-04-26T23:40:32.583089+0000","last_became_peered":"2024-04-26T23:40:32.583089+0000","last_unstale":"2024-04-26T23:40:33.580158+0000","last_undegraded":"2024-04-26T23:40:33.580158+0000","last_fullsized":"2024-04-26T23:40:33.580158+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:17:46.135806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T23:40:32.598513+0000","last_change":"2024-04-26T23:40:32.587921+0000","last_active":"2024-04-26T23:40:32.598513+0000","last_peered":"2024-04-26T23:40:32.598513+0000","last_clean":"2024-04-26T23:40:32.598513+0000","last_became_active":"2024-04-26T23:40:32.587630+0000","last_became_peered":"2024-04-26T23:40:32.587630+0000","last_unstale":"2024-04-26T23:40:32.598513+0000","last_undegraded":"2024-04-26T23:40:32.598513+0000","last_fullsized":"2024-04-26T23:40:32.598513+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:25:02.319783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T23:40:32.594605+0000","last_change":"2024-04-26T23:40:32.584323+0000","last_active":"2024-04-26T23:40:32.594605+0000","last_peered":"2024-04-26T23:40:32.594605+0000","last_clean":"2024-04-26T23:40:32.594605+0000","last_became_active":"2024-04-26T23:40:32.584010+0000","last_became_peered":"2024-04-26T23:40:32.584010+0000","last_unstale":"2024-04-26T23:40:32.594605+0000","last_undegraded":"2024-04-26T23:40:32.594605+0000","last_fullsized":"2024-04-26T23:40:32.594605+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:35:55.443782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T23:40:32.585718+0000","last_change":"2024-04-26T23:40:32.580453+0000","last_active":"2024-04-26T23:40:32.585718+0000","last_peered":"2024-04-26T23:40:32.585718+0000","last_clean":"2024-04-26T23:40:32.585718+0000","last_became_active":"2024-04-26T23:40:32.580196+0000","last_became_peered":"2024-04-26T23:40:32.580196+0000","last_unstale":"2024-04-26T23:40:32.585718+0000","last_undegraded":"2024-04-26T23:40:32.585718+0000","last_fullsized":"2024-04-26T23:40:32.585718+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:25:02.319783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:40:33.640433+0000","last_change":"2024-04-26T23:40:32.584590+0000","last_active":"2024-04-26T23:40:33.640433+0000","last_peered":"2024-04-26T23:40:33.640433+0000","last_clean":"2024-04-26T23:40:33.640433+0000","last_became_active":"2024-04-26T23:40:32.584234+0000","last_became_peered":"2024-04-26T23:40:32.584234+0000","last_unstale":"2024-04-26T23:40:33.640433+0000","last_undegraded":"2024-04-26T23:40:33.640433+0000","last_fullsized":"2024-04-26T23:40:33.640433+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:15:52.942160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:40:33.580581+0000","last_change":"2024-04-26T23:40:32.586672+0000","last_active":"2024-04-26T23:40:33.580581+0000","last_peered":"2024-04-26T23:40:33.580581+0000","last_clean":"2024-04-26T23:40:33.580581+0000","last_became_active":"2024-04-26T23:40:32.586399+0000","last_became_peered":"2024-04-26T23:40:32.586399+0000","last_unstale":"2024-04-26T23:40:33.580581+0000","last_undegraded":"2024-04-26T23:40:33.580581+0000","last_fullsized":"2024-04-26T23:40:33.580581+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:15:01.970308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:40:33.579610+0000","last_change":"2024-04-26T23:40:32.589208+0000","last_active":"2024-04-26T23:40:33.579610+0000","last_peered":"2024-04-26T23:40:33.579610+0000","last_clean":"2024-04-26T23:40:33.579610+0000","last_became_active":"2024-04-26T23:40:32.588927+0000","last_became_peered":"2024-04-26T23:40:32.588927+0000","last_unstale":"2024-04-26T23:40:33.579610+0000","last_undegraded":"2024-04-26T23:40:33.579610+0000","last_fullsized":"2024-04-26T23:40:33.579610+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:45:50.299583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T23:40:32.598571+0000","last_change":"2024-04-26T23:40:31.576749+0000","last_active":"2024-04-26T23:40:32.598571+0000","last_peered":"2024-04-26T23:40:32.598571+0000","last_clean":"2024-04-26T23:40:32.598571+0000","last_became_active":"2024-04-26T23:40:31.576178+0000","last_became_peered":"2024-04-26T23:40:31.576178+0000","last_unstale":"2024-04-26T23:40:32.598571+0000","last_undegraded":"2024-04-26T23:40:32.598571+0000","last_fullsized":"2024-04-26T23:40:32.598571+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:15:30.884135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T23:40:32.601675+0000","last_change":"2024-04-26T23:40:32.594689+0000","last_active":"2024-04-26T23:40:32.601675+0000","last_peered":"2024-04-26T23:40:32.601675+0000","last_clean":"2024-04-26T23:40:32.601675+0000","last_became_active":"2024-04-26T23:40:32.592365+0000","last_became_peered":"2024-04-26T23:40:32.592365+0000","last_unstale":"2024-04-26T23:40:32.601675+0000","last_undegraded":"2024-04-26T23:40:32.601675+0000","last_fullsized":"2024-04-26T23:40:32.601675+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:30:11.401955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:40:33.580705+0000","last_change":"2024-04-26T23:40:31.567755+0000","last_active":"2024-04-26T23:40:33.580705+0000","last_peered":"2024-04-26T23:40:33.580705+0000","last_clean":"2024-04-26T23:40:33.580705+0000","last_became_active":"2024-04-26T23:40:31.567484+0000","last_became_peered":"2024-04-26T23:40:31.567484+0000","last_unstale":"2024-04-26T23:40:33.580705+0000","last_undegraded":"2024-04-26T23:40:33.580705+0000","last_fullsized":"2024-04-26T23:40:33.580705+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:43:13.740214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T23:40:32.571544+0000","last_change":"2024-04-26T23:40:31.578929+0000","last_active":"2024-04-26T23:40:32.571544+0000","last_peered":"2024-04-26T23:40:32.571544+0000","last_clean":"2024-04-26T23:40:32.571544+0000","last_became_active":"2024-04-26T23:40:31.578623+0000","last_became_peered":"2024-04-26T23:40:31.578623+0000","last_unstale":"2024-04-26T23:40:32.571544+0000","last_undegraded":"2024-04-26T23:40:32.571544+0000","last_fullsized":"2024-04-26T23:40:32.571544+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:50:21.330821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T23:40:32.598497+0000","last_change":"2024-04-26T23:40:32.586204+0000","last_active":"2024-04-26T23:40:32.598497+0000","last_peered":"2024-04-26T23:40:32.598497+0000","last_clean":"2024-04-26T23:40:32.598497+0000","last_became_active":"2024-04-26T23:40:32.585725+0000","last_became_peered":"2024-04-26T23:40:32.585725+0000","last_unstale":"2024-04-26T23:40:32.598497+0000","last_undegraded":"2024-04-26T23:40:32.598497+0000","last_fullsized":"2024-04-26T23:40:32.598497+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:20:29.107798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T23:40:32.571116+0000","last_change":"2024-04-26T23:40:31.572402+0000","last_active":"2024-04-26T23:40:32.571116+0000","last_peered":"2024-04-26T23:40:32.571116+0000","last_clean":"2024-04-26T23:40:32.571116+0000","last_became_active":"2024-04-26T23:40:31.572111+0000","last_became_peered":"2024-04-26T23:40:31.572111+0000","last_unstale":"2024-04-26T23:40:32.571116+0000","last_undegraded":"2024-04-26T23:40:32.571116+0000","last_fullsized":"2024-04-26T23:40:32.571116+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:20:28.103413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:40:33.580185+0000","last_change":"2024-04-26T23:40:32.583014+0000","last_active":"2024-04-26T23:40:33.580185+0000","last_peered":"2024-04-26T23:40:33.580185+0000","last_clean":"2024-04-26T23:40:33.580185+0000","last_became_active":"2024-04-26T23:40:32.582751+0000","last_became_peered":"2024-04-26T23:40:32.582751+0000","last_unstale":"2024-04-26T23:40:33.580185+0000","last_undegraded":"2024-04-26T23:40:33.580185+0000","last_fullsized":"2024-04-26T23:40:33.580185+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:38:10.884592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:40:33.580804+0000","last_change":"2024-04-26T23:40:31.573794+0000","last_active":"2024-04-26T23:40:33.580804+0000","last_peered":"2024-04-26T23:40:33.580804+0000","last_clean":"2024-04-26T23:40:33.580804+0000","last_became_active":"2024-04-26T23:40:31.573164+0000","last_became_peered":"2024-04-26T23:40:31.573164+0000","last_unstale":"2024-04-26T23:40:33.580804+0000","last_undegraded":"2024-04-26T23:40:33.580804+0000","last_fullsized":"2024-04-26T23:40:33.580804+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:15:30.884135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T23:40:32.596805+0000","last_change":"2024-04-26T23:40:32.589793+0000","last_active":"2024-04-26T23:40:32.596805+0000","last_peered":"2024-04-26T23:40:32.596805+0000","last_clean":"2024-04-26T23:40:32.596805+0000","last_became_active":"2024-04-26T23:40:32.589478+0000","last_became_peered":"2024-04-26T23:40:32.589478+0000","last_unstale":"2024-04-26T23:40:32.596805+0000","last_undegraded":"2024-04-26T23:40:32.596805+0000","last_fullsized":"2024-04-26T23:40:32.596805+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:16:46.547536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T23:40:32.571098+0000","last_change":"2024-04-26T23:40:31.575616+0000","last_active":"2024-04-26T23:40:32.571098+0000","last_peered":"2024-04-26T23:40:32.571098+0000","last_clean":"2024-04-26T23:40:32.571098+0000","last_became_active":"2024-04-26T23:40:31.575211+0000","last_became_peered":"2024-04-26T23:40:31.575211+0000","last_unstale":"2024-04-26T23:40:32.571098+0000","last_undegraded":"2024-04-26T23:40:32.571098+0000","last_fullsized":"2024-04-26T23:40:32.571098+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:48:32.015654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T23:40:32.598034+0000","last_change":"2024-04-26T23:40:32.589146+0000","last_active":"2024-04-26T23:40:32.598034+0000","last_peered":"2024-04-26T23:40:32.598034+0000","last_clean":"2024-04-26T23:40:32.598034+0000","last_became_active":"2024-04-26T23:40:32.588881+0000","last_became_peered":"2024-04-26T23:40:32.588881+0000","last_unstale":"2024-04-26T23:40:32.598034+0000","last_undegraded":"2024-04-26T23:40:32.598034+0000","last_fullsized":"2024-04-26T23:40:32.598034+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:45:50.299583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:40:33.580226+0000","last_change":"2024-04-26T23:40:31.574234+0000","last_active":"2024-04-26T23:40:33.580226+0000","last_peered":"2024-04-26T23:40:33.580226+0000","last_clean":"2024-04-26T23:40:33.580226+0000","last_became_active":"2024-04-26T23:40:31.572218+0000","last_became_peered":"2024-04-26T23:40:31.572218+0000","last_unstale":"2024-04-26T23:40:33.580226+0000","last_undegraded":"2024-04-26T23:40:33.580226+0000","last_fullsized":"2024-04-26T23:40:33.580226+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:25:01.315397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:40:33.580001+0000","last_change":"2024-04-26T23:40:32.593298+0000","last_active":"2024-04-26T23:40:33.580001+0000","last_peered":"2024-04-26T23:40:33.580001+0000","last_clean":"2024-04-26T23:40:33.580001+0000","last_became_active":"2024-04-26T23:40:32.593030+0000","last_became_peered":"2024-04-26T23:40:32.593030+0000","last_unstale":"2024-04-26T23:40:33.580001+0000","last_undegraded":"2024-04-26T23:40:33.580001+0000","last_fullsized":"2024-04-26T23:40:33.580001+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:20:29.107798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:40:33.580998+0000","last_change":"2024-04-26T23:40:31.572331+0000","last_active":"2024-04-26T23:40:33.580998+0000","last_peered":"2024-04-26T23:40:33.580998+0000","last_clean":"2024-04-26T23:40:33.580998+0000","last_became_active":"2024-04-26T23:40:31.572074+0000","last_became_peered":"2024-04-26T23:40:31.572074+0000","last_unstale":"2024-04-26T23:40:33.580998+0000","last_undegraded":"2024-04-26T23:40:33.580998+0000","last_fullsized":"2024-04-26T23:40:33.580998+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:45:49.295198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T23:40:32.591774+0000","last_change":"2024-04-26T23:40:32.587513+0000","last_active":"2024-04-26T23:40:32.591774+0000","last_peered":"2024-04-26T23:40:32.591774+0000","last_clean":"2024-04-26T23:40:32.591774+0000","last_became_active":"2024-04-26T23:40:32.587200+0000","last_became_peered":"2024-04-26T23:40:32.587200+0000","last_unstale":"2024-04-26T23:40:32.591774+0000","last_undegraded":"2024-04-26T23:40:32.591774+0000","last_fullsized":"2024-04-26T23:40:32.591774+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:47:51.559918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T23:40:32.601766+0000","last_change":"2024-04-26T23:40:31.573941+0000","last_active":"2024-04-26T23:40:32.601766+0000","last_peered":"2024-04-26T23:40:32.601766+0000","last_clean":"2024-04-26T23:40:32.601766+0000","last_became_active":"2024-04-26T23:40:31.573668+0000","last_became_peered":"2024-04-26T23:40:31.573668+0000","last_unstale":"2024-04-26T23:40:32.601766+0000","last_undegraded":"2024-04-26T23:40:32.601766+0000","last_fullsized":"2024-04-26T23:40:32.601766+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:58:06.477730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T23:40:32.598039+0000","last_change":"2024-04-26T23:40:32.589706+0000","last_active":"2024-04-26T23:40:32.598039+0000","last_peered":"2024-04-26T23:40:32.598039+0000","last_clean":"2024-04-26T23:40:32.598039+0000","last_became_active":"2024-04-26T23:40:32.589452+0000","last_became_peered":"2024-04-26T23:40:32.589452+0000","last_unstale":"2024-04-26T23:40:32.598039+0000","last_undegraded":"2024-04-26T23:40:32.598039+0000","last_fullsized":"2024-04-26T23:40:32.598039+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:48:33.020039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T23:40:32.569624+0000","last_change":"2024-04-26T23:40:31.575493+0000","last_active":"2024-04-26T23:40:32.569624+0000","last_peered":"2024-04-26T23:40:32.569624+0000","last_clean":"2024-04-26T23:40:32.569624+0000","last_became_active":"2024-04-26T23:40:31.575039+0000","last_became_peered":"2024-04-26T23:40:31.575039+0000","last_unstale":"2024-04-26T23:40:32.569624+0000","last_undegraded":"2024-04-26T23:40:32.569624+0000","last_fullsized":"2024-04-26T23:40:32.569624+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:43:13.740214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T23:40:32.599852+0000","last_change":"2024-04-26T23:40:32.595377+0000","last_active":"2024-04-26T23:40:32.599852+0000","last_peered":"2024-04-26T23:40:32.599852+0000","last_clean":"2024-04-26T23:40:32.599852+0000","last_became_active":"2024-04-26T23:40:32.595032+0000","last_became_peered":"2024-04-26T23:40:32.595032+0000","last_unstale":"2024-04-26T23:40:32.599852+0000","last_undegraded":"2024-04-26T23:40:32.599852+0000","last_fullsized":"2024-04-26T23:40:32.599852+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:38:10.884592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:40:33.580707+0000","last_change":"2024-04-26T23:40:31.569512+0000","last_active":"2024-04-26T23:40:33.580707+0000","last_peered":"2024-04-26T23:40:33.580707+0000","last_clean":"2024-04-26T23:40:33.580707+0000","last_became_active":"2024-04-26T23:40:31.568598+0000","last_became_peered":"2024-04-26T23:40:31.568598+0000","last_unstale":"2024-04-26T23:40:33.580707+0000","last_undegraded":"2024-04-26T23:40:33.580707+0000","last_fullsized":"2024-04-26T23:40:33.580707+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:48:32.015654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:40:33.580693+0000","last_change":"2024-04-26T23:40:32.586832+0000","last_active":"2024-04-26T23:40:33.580693+0000","last_peered":"2024-04-26T23:40:33.580693+0000","last_clean":"2024-04-26T23:40:33.580693+0000","last_became_active":"2024-04-26T23:40:32.585809+0000","last_became_peered":"2024-04-26T23:40:32.585809+0000","last_unstale":"2024-04-26T23:40:33.580693+0000","last_undegraded":"2024-04-26T23:40:33.580693+0000","last_fullsized":"2024-04-26T23:40:33.580693+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:51:30.677247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:40:33.640362+0000","last_change":"2024-04-26T23:40:31.572685+0000","last_active":"2024-04-26T23:40:33.640362+0000","last_peered":"2024-04-26T23:40:33.640362+0000","last_clean":"2024-04-26T23:40:33.640362+0000","last_became_active":"2024-04-26T23:40:31.572169+0000","last_became_peered":"2024-04-26T23:40:31.572169+0000","last_unstale":"2024-04-26T23:40:33.640362+0000","last_undegraded":"2024-04-26T23:40:33.640362+0000","last_fullsized":"2024-04-26T23:40:33.640362+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:15:30.884135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T23:40:32.599785+0000","last_change":"2024-04-26T23:40:32.593528+0000","last_active":"2024-04-26T23:40:32.599785+0000","last_peered":"2024-04-26T23:40:32.599785+0000","last_clean":"2024-04-26T23:40:32.599785+0000","last_became_active":"2024-04-26T23:40:32.593220+0000","last_became_peered":"2024-04-26T23:40:32.593220+0000","last_unstale":"2024-04-26T23:40:32.599785+0000","last_undegraded":"2024-04-26T23:40:32.599785+0000","last_fullsized":"2024-04-26T23:40:32.599785+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:17:46.135806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:40:33.579946+0000","last_change":"2024-04-26T23:40:31.575943+0000","last_active":"2024-04-26T23:40:33.579946+0000","last_peered":"2024-04-26T23:40:33.579946+0000","last_clean":"2024-04-26T23:40:33.579946+0000","last_became_active":"2024-04-26T23:40:31.575632+0000","last_became_peered":"2024-04-26T23:40:31.575632+0000","last_unstale":"2024-04-26T23:40:33.579946+0000","last_undegraded":"2024-04-26T23:40:33.579946+0000","last_fullsized":"2024-04-26T23:40:33.579946+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:11:08.189634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T23:40:32.599820+0000","last_change":"2024-04-26T23:40:32.593577+0000","last_active":"2024-04-26T23:40:32.599820+0000","last_peered":"2024-04-26T23:40:32.599820+0000","last_clean":"2024-04-26T23:40:32.599820+0000","last_became_active":"2024-04-26T23:40:32.593235+0000","last_became_peered":"2024-04-26T23:40:32.593235+0000","last_unstale":"2024-04-26T23:40:32.599820+0000","last_undegraded":"2024-04-26T23:40:32.599820+0000","last_fullsized":"2024-04-26T23:40:32.599820+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:51:30.677247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:40:33.640608+0000","last_change":"2024-04-26T23:40:31.570870+0000","last_active":"2024-04-26T23:40:33.640608+0000","last_peered":"2024-04-26T23:40:33.640608+0000","last_clean":"2024-04-26T23:40:33.640608+0000","last_became_active":"2024-04-26T23:40:31.570592+0000","last_became_peered":"2024-04-26T23:40:31.570592+0000","last_unstale":"2024-04-26T23:40:33.640608+0000","last_undegraded":"2024-04-26T23:40:33.640608+0000","last_fullsized":"2024-04-26T23:40:33.640608+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:43:13.740214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T23:40:32.599939+0000","last_change":"2024-04-26T23:40:32.596306+0000","last_active":"2024-04-26T23:40:32.599939+0000","last_peered":"2024-04-26T23:40:32.599939+0000","last_clean":"2024-04-26T23:40:32.599939+0000","last_became_active":"2024-04-26T23:40:32.595625+0000","last_became_peered":"2024-04-26T23:40:32.595625+0000","last_unstale":"2024-04-26T23:40:32.599939+0000","last_undegraded":"2024-04-26T23:40:32.599939+0000","last_fullsized":"2024-04-26T23:40:32.599939+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:40:17.167353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:40:33.580261+0000","last_change":"2024-04-26T23:40:31.571749+0000","last_active":"2024-04-26T23:40:33.580261+0000","last_peered":"2024-04-26T23:40:33.580261+0000","last_clean":"2024-04-26T23:40:33.580261+0000","last_became_active":"2024-04-26T23:40:31.571427+0000","last_became_peered":"2024-04-26T23:40:31.571427+0000","last_unstale":"2024-04-26T23:40:33.580261+0000","last_undegraded":"2024-04-26T23:40:33.580261+0000","last_fullsized":"2024-04-26T23:40:33.580261+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:20:28.103413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T23:40:32.589465+0000","last_change":"2024-04-26T23:40:32.583469+0000","last_active":"2024-04-26T23:40:32.589465+0000","last_peered":"2024-04-26T23:40:32.589465+0000","last_clean":"2024-04-26T23:40:32.589465+0000","last_became_active":"2024-04-26T23:40:32.583174+0000","last_became_peered":"2024-04-26T23:40:32.583174+0000","last_unstale":"2024-04-26T23:40:32.589465+0000","last_undegraded":"2024-04-26T23:40:32.589465+0000","last_fullsized":"2024-04-26T23:40:32.589465+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:47:51.559918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:40:33.640493+0000","last_change":"2024-04-26T23:40:31.572391+0000","last_active":"2024-04-26T23:40:33.640493+0000","last_peered":"2024-04-26T23:40:33.640493+0000","last_clean":"2024-04-26T23:40:33.640493+0000","last_became_active":"2024-04-26T23:40:31.571849+0000","last_became_peered":"2024-04-26T23:40:31.571849+0000","last_unstale":"2024-04-26T23:40:33.640493+0000","last_undegraded":"2024-04-26T23:40:33.640493+0000","last_fullsized":"2024-04-26T23:40:33.640493+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:35:54.439397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T23:40:32.597097+0000","last_change":"2024-04-26T23:40:32.591906+0000","last_active":"2024-04-26T23:40:32.597097+0000","last_peered":"2024-04-26T23:40:32.597097+0000","last_clean":"2024-04-26T23:40:32.597097+0000","last_became_active":"2024-04-26T23:40:32.590867+0000","last_became_peered":"2024-04-26T23:40:32.590867+0000","last_unstale":"2024-04-26T23:40:32.597097+0000","last_undegraded":"2024-04-26T23:40:32.597097+0000","last_fullsized":"2024-04-26T23:40:32.597097+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:16:46.547536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":168,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T23:40:32.574098+0000","last_change":"2024-04-26T23:40:20.966672+0000","last_active":"2024-04-26T23:40:32.574098+0000","last_peered":"2024-04-26T23:40:32.574098+0000","last_clean":"2024-04-26T23:40:32.574098+0000","last_became_active":"2024-04-26T23:40:20.963937+0000","last_became_peered":"2024-04-26T23:40:20.963937+0000","last_unstale":"2024-04-26T23:40:32.574098+0000","last_undegraded":"2024-04-26T23:40:32.574098+0000","last_fullsized":"2024-04-26T23:40:32.574098+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:19.950137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:19.950137+0000","last_clean_scrub_stamp":"2024-04-26T23:40:19.950137+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:23:39.166579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T23:40:32.568395+0000","last_change":"2024-04-26T23:40:31.570118+0000","last_active":"2024-04-26T23:40:32.568395+0000","last_peered":"2024-04-26T23:40:32.568395+0000","last_clean":"2024-04-26T23:40:32.568395+0000","last_became_active":"2024-04-26T23:40:31.569764+0000","last_became_peered":"2024-04-26T23:40:31.569764+0000","last_unstale":"2024-04-26T23:40:32.568395+0000","last_undegraded":"2024-04-26T23:40:32.568395+0000","last_fullsized":"2024-04-26T23:40:32.568395+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:15:30.884135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T23:40:32.598541+0000","last_change":"2024-04-26T23:40:32.593216+0000","last_active":"2024-04-26T23:40:32.598541+0000","last_peered":"2024-04-26T23:40:32.598541+0000","last_clean":"2024-04-26T23:40:32.598541+0000","last_became_active":"2024-04-26T23:40:32.592929+0000","last_became_peered":"2024-04-26T23:40:32.592929+0000","last_unstale":"2024-04-26T23:40:32.598541+0000","last_undegraded":"2024-04-26T23:40:32.598541+0000","last_fullsized":"2024-04-26T23:40:32.598541+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:10:42.603833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T23:40:32.574221+0000","last_change":"2024-04-26T23:40:31.573864+0000","last_active":"2024-04-26T23:40:32.574221+0000","last_peered":"2024-04-26T23:40:32.574221+0000","last_clean":"2024-04-26T23:40:32.574221+0000","last_became_active":"2024-04-26T23:40:31.573594+0000","last_became_peered":"2024-04-26T23:40:31.573594+0000","last_unstale":"2024-04-26T23:40:32.574221+0000","last_undegraded":"2024-04-26T23:40:32.574221+0000","last_fullsized":"2024-04-26T23:40:32.574221+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:48:32.015654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T23:40:32.598337+0000","last_change":"2024-04-26T23:40:32.593262+0000","last_active":"2024-04-26T23:40:32.598337+0000","last_peered":"2024-04-26T23:40:32.598337+0000","last_clean":"2024-04-26T23:40:32.598337+0000","last_became_active":"2024-04-26T23:40:32.593003+0000","last_became_peered":"2024-04-26T23:40:32.593003+0000","last_unstale":"2024-04-26T23:40:32.598337+0000","last_undegraded":"2024-04-26T23:40:32.598337+0000","last_fullsized":"2024-04-26T23:40:32.598337+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:15:52.942160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:40:33.640465+0000","last_change":"2024-04-26T23:40:31.570775+0000","last_active":"2024-04-26T23:40:33.640465+0000","last_peered":"2024-04-26T23:40:33.640465+0000","last_clean":"2024-04-26T23:40:33.640465+0000","last_became_active":"2024-04-26T23:40:31.570493+0000","last_became_peered":"2024-04-26T23:40:31.570493+0000","last_unstale":"2024-04-26T23:40:33.640465+0000","last_undegraded":"2024-04-26T23:40:33.640465+0000","last_fullsized":"2024-04-26T23:40:33.640465+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:45:49.295198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:40:33.580101+0000","last_change":"2024-04-26T23:40:32.576783+0000","last_active":"2024-04-26T23:40:33.580101+0000","last_peered":"2024-04-26T23:40:33.580101+0000","last_clean":"2024-04-26T23:40:33.580101+0000","last_became_active":"2024-04-26T23:40:32.576481+0000","last_became_peered":"2024-04-26T23:40:32.576481+0000","last_unstale":"2024-04-26T23:40:33.580101+0000","last_undegraded":"2024-04-26T23:40:33.580101+0000","last_fullsized":"2024-04-26T23:40:33.580101+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:16:46.547536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T23:40:32.569803+0000","last_change":"2024-04-26T23:40:31.572432+0000","last_active":"2024-04-26T23:40:32.569803+0000","last_peered":"2024-04-26T23:40:32.569803+0000","last_clean":"2024-04-26T23:40:32.569803+0000","last_became_active":"2024-04-26T23:40:31.572121+0000","last_became_peered":"2024-04-26T23:40:31.572121+0000","last_unstale":"2024-04-26T23:40:32.569803+0000","last_undegraded":"2024-04-26T23:40:32.569803+0000","last_fullsized":"2024-04-26T23:40:32.569803+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:45:49.295198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:40:33.580225+0000","last_change":"2024-04-26T23:40:32.590069+0000","last_active":"2024-04-26T23:40:33.580225+0000","last_peered":"2024-04-26T23:40:33.580225+0000","last_clean":"2024-04-26T23:40:33.580225+0000","last_became_active":"2024-04-26T23:40:32.589790+0000","last_became_peered":"2024-04-26T23:40:32.589790+0000","last_unstale":"2024-04-26T23:40:33.580225+0000","last_undegraded":"2024-04-26T23:40:33.580225+0000","last_fullsized":"2024-04-26T23:40:33.580225+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:15:52.942160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:40:33.580320+0000","last_change":"2024-04-26T23:40:31.576711+0000","last_active":"2024-04-26T23:40:33.580320+0000","last_peered":"2024-04-26T23:40:33.580320+0000","last_clean":"2024-04-26T23:40:33.580320+0000","last_became_active":"2024-04-26T23:40:31.576404+0000","last_became_peered":"2024-04-26T23:40:31.576404+0000","last_unstale":"2024-04-26T23:40:33.580320+0000","last_undegraded":"2024-04-26T23:40:33.580320+0000","last_fullsized":"2024-04-26T23:40:33.580320+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:45:49.295198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T23:40:32.587670+0000","last_change":"2024-04-26T23:40:32.584363+0000","last_active":"2024-04-26T23:40:32.587670+0000","last_peered":"2024-04-26T23:40:32.587670+0000","last_clean":"2024-04-26T23:40:32.587670+0000","last_became_active":"2024-04-26T23:40:32.584082+0000","last_became_peered":"2024-04-26T23:40:32.584082+0000","last_unstale":"2024-04-26T23:40:32.587670+0000","last_undegraded":"2024-04-26T23:40:32.587670+0000","last_fullsized":"2024-04-26T23:40:32.587670+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:10:42.603833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T23:40:32.578509+0000","last_change":"2024-04-26T23:40:31.576565+0000","last_active":"2024-04-26T23:40:32.578509+0000","last_peered":"2024-04-26T23:40:32.578509+0000","last_clean":"2024-04-26T23:40:32.578509+0000","last_became_active":"2024-04-26T23:40:31.576313+0000","last_became_peered":"2024-04-26T23:40:31.576313+0000","last_unstale":"2024-04-26T23:40:32.578509+0000","last_undegraded":"2024-04-26T23:40:32.578509+0000","last_fullsized":"2024-04-26T23:40:32.578509+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:25:01.315397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:40:33.580396+0000","last_change":"2024-04-26T23:40:32.582442+0000","last_active":"2024-04-26T23:40:33.580396+0000","last_peered":"2024-04-26T23:40:33.580396+0000","last_clean":"2024-04-26T23:40:33.580396+0000","last_became_active":"2024-04-26T23:40:32.582140+0000","last_became_peered":"2024-04-26T23:40:32.582140+0000","last_unstale":"2024-04-26T23:40:33.580396+0000","last_undegraded":"2024-04-26T23:40:33.580396+0000","last_fullsized":"2024-04-26T23:40:33.580396+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:18:09.706875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:40:33.584637+0000","last_change":"2024-04-26T23:40:31.576299+0000","last_active":"2024-04-26T23:40:33.584637+0000","last_peered":"2024-04-26T23:40:33.584637+0000","last_clean":"2024-04-26T23:40:33.584637+0000","last_became_active":"2024-04-26T23:40:31.576006+0000","last_became_peered":"2024-04-26T23:40:31.576006+0000","last_unstale":"2024-04-26T23:40:33.584637+0000","last_undegraded":"2024-04-26T23:40:33.584637+0000","last_fullsized":"2024-04-26T23:40:33.584637+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:15:51.937774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T23:40:32.601751+0000","last_change":"2024-04-26T23:40:32.594913+0000","last_active":"2024-04-26T23:40:32.601751+0000","last_peered":"2024-04-26T23:40:32.601751+0000","last_clean":"2024-04-26T23:40:32.601751+0000","last_became_active":"2024-04-26T23:40:32.594616+0000","last_became_peered":"2024-04-26T23:40:32.594616+0000","last_unstale":"2024-04-26T23:40:32.601751+0000","last_undegraded":"2024-04-26T23:40:32.601751+0000","last_fullsized":"2024-04-26T23:40:32.601751+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:14:04.372681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:40:33.580955+0000","last_change":"2024-04-26T23:40:31.573721+0000","last_active":"2024-04-26T23:40:33.580955+0000","last_peered":"2024-04-26T23:40:33.580955+0000","last_clean":"2024-04-26T23:40:33.580955+0000","last_became_active":"2024-04-26T23:40:31.573434+0000","last_became_peered":"2024-04-26T23:40:31.573434+0000","last_unstale":"2024-04-26T23:40:33.580955+0000","last_undegraded":"2024-04-26T23:40:33.580955+0000","last_fullsized":"2024-04-26T23:40:33.580955+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:20:28.103413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T23:40:32.594502+0000","last_change":"2024-04-26T23:40:32.584988+0000","last_active":"2024-04-26T23:40:32.594502+0000","last_peered":"2024-04-26T23:40:32.594502+0000","last_clean":"2024-04-26T23:40:32.594502+0000","last_became_active":"2024-04-26T23:40:32.584467+0000","last_became_peered":"2024-04-26T23:40:32.584467+0000","last_unstale":"2024-04-26T23:40:32.594502+0000","last_undegraded":"2024-04-26T23:40:32.594502+0000","last_fullsized":"2024-04-26T23:40:32.594502+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:15:31.888521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T23:40:32.574009+0000","last_change":"2024-04-26T23:40:31.576866+0000","last_active":"2024-04-26T23:40:32.574009+0000","last_peered":"2024-04-26T23:40:32.574009+0000","last_clean":"2024-04-26T23:40:32.574009+0000","last_became_active":"2024-04-26T23:40:31.576419+0000","last_became_peered":"2024-04-26T23:40:31.576419+0000","last_unstale":"2024-04-26T23:40:32.574009+0000","last_undegraded":"2024-04-26T23:40:32.574009+0000","last_fullsized":"2024-04-26T23:40:32.574009+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:45:49.295198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:40:33.580187+0000","last_change":"2024-04-26T23:40:32.583019+0000","last_active":"2024-04-26T23:40:33.580187+0000","last_peered":"2024-04-26T23:40:33.580187+0000","last_clean":"2024-04-26T23:40:33.580187+0000","last_became_active":"2024-04-26T23:40:32.582719+0000","last_became_peered":"2024-04-26T23:40:32.582719+0000","last_unstale":"2024-04-26T23:40:33.580187+0000","last_undegraded":"2024-04-26T23:40:33.580187+0000","last_fullsized":"2024-04-26T23:40:33.580187+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:25:02.319783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:40:33.580199+0000","last_change":"2024-04-26T23:40:31.575508+0000","last_active":"2024-04-26T23:40:33.580199+0000","last_peered":"2024-04-26T23:40:33.580199+0000","last_clean":"2024-04-26T23:40:33.580199+0000","last_became_active":"2024-04-26T23:40:31.575242+0000","last_became_peered":"2024-04-26T23:40:31.575242+0000","last_unstale":"2024-04-26T23:40:33.580199+0000","last_undegraded":"2024-04-26T23:40:33.580199+0000","last_fullsized":"2024-04-26T23:40:33.580199+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:48:32.015654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T23:40:32.594121+0000","last_change":"2024-04-26T23:40:32.582721+0000","last_active":"2024-04-26T23:40:32.594121+0000","last_peered":"2024-04-26T23:40:32.594121+0000","last_clean":"2024-04-26T23:40:32.594121+0000","last_became_active":"2024-04-26T23:40:32.582438+0000","last_became_peered":"2024-04-26T23:40:32.582438+0000","last_unstale":"2024-04-26T23:40:32.594121+0000","last_undegraded":"2024-04-26T23:40:32.594121+0000","last_fullsized":"2024-04-26T23:40:32.594121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:45:50.299583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:40:33.580136+0000","last_change":"2024-04-26T23:40:31.575121+0000","last_active":"2024-04-26T23:40:33.580136+0000","last_peered":"2024-04-26T23:40:33.580136+0000","last_clean":"2024-04-26T23:40:33.580136+0000","last_became_active":"2024-04-26T23:40:31.574827+0000","last_became_peered":"2024-04-26T23:40:31.574827+0000","last_unstale":"2024-04-26T23:40:33.580136+0000","last_undegraded":"2024-04-26T23:40:33.580136+0000","last_fullsized":"2024-04-26T23:40:33.580136+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:43:13.740214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T23:40:32.598545+0000","last_change":"2024-04-26T23:40:32.585827+0000","last_active":"2024-04-26T23:40:32.598545+0000","last_peered":"2024-04-26T23:40:32.598545+0000","last_clean":"2024-04-26T23:40:32.598545+0000","last_became_active":"2024-04-26T23:40:32.585522+0000","last_became_peered":"2024-04-26T23:40:32.585522+0000","last_unstale":"2024-04-26T23:40:32.598545+0000","last_undegraded":"2024-04-26T23:40:32.598545+0000","last_fullsized":"2024-04-26T23:40:32.598545+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:48:33.020039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T23:40:32.598212+0000","last_change":"2024-04-26T23:40:31.578524+0000","last_active":"2024-04-26T23:40:32.598212+0000","last_peered":"2024-04-26T23:40:32.598212+0000","last_clean":"2024-04-26T23:40:32.598212+0000","last_became_active":"2024-04-26T23:40:31.578230+0000","last_became_peered":"2024-04-26T23:40:31.578230+0000","last_unstale":"2024-04-26T23:40:32.598212+0000","last_undegraded":"2024-04-26T23:40:32.598212+0000","last_fullsized":"2024-04-26T23:40:32.598212+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:15:51.937774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:40:33.580591+0000","last_change":"2024-04-26T23:40:32.590053+0000","last_active":"2024-04-26T23:40:33.580591+0000","last_peered":"2024-04-26T23:40:33.580591+0000","last_clean":"2024-04-26T23:40:33.580591+0000","last_became_active":"2024-04-26T23:40:32.589802+0000","last_became_peered":"2024-04-26T23:40:32.589802+0000","last_unstale":"2024-04-26T23:40:33.580591+0000","last_undegraded":"2024-04-26T23:40:33.580591+0000","last_fullsized":"2024-04-26T23:40:33.580591+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:16:46.547536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T23:40:32.592510+0000","last_change":"2024-04-26T23:40:32.588309+0000","last_active":"2024-04-26T23:40:32.592510+0000","last_peered":"2024-04-26T23:40:32.592510+0000","last_clean":"2024-04-26T23:40:32.592510+0000","last_became_active":"2024-04-26T23:40:32.588007+0000","last_became_peered":"2024-04-26T23:40:32.588007+0000","last_unstale":"2024-04-26T23:40:32.592510+0000","last_undegraded":"2024-04-26T23:40:32.592510+0000","last_fullsized":"2024-04-26T23:40:32.592510+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:15:01.970308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T23:40:32.597515+0000","last_change":"2024-04-26T23:40:31.573648+0000","last_active":"2024-04-26T23:40:32.597515+0000","last_peered":"2024-04-26T23:40:32.597515+0000","last_clean":"2024-04-26T23:40:32.597515+0000","last_became_active":"2024-04-26T23:40:31.573347+0000","last_became_peered":"2024-04-26T23:40:31.573347+0000","last_unstale":"2024-04-26T23:40:32.597515+0000","last_undegraded":"2024-04-26T23:40:32.597515+0000","last_fullsized":"2024-04-26T23:40:32.597515+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:20:28.103413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T23:40:32.596980+0000","last_change":"2024-04-26T23:40:32.590624+0000","last_active":"2024-04-26T23:40:32.596980+0000","last_peered":"2024-04-26T23:40:32.596980+0000","last_clean":"2024-04-26T23:40:32.596980+0000","last_became_active":"2024-04-26T23:40:32.589687+0000","last_became_peered":"2024-04-26T23:40:32.589687+0000","last_unstale":"2024-04-26T23:40:32.596980+0000","last_undegraded":"2024-04-26T23:40:32.596980+0000","last_fullsized":"2024-04-26T23:40:32.596980+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:51:30.677247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T23:40:32.595206+0000","last_change":"2024-04-26T23:40:31.578735+0000","last_active":"2024-04-26T23:40:32.595206+0000","last_peered":"2024-04-26T23:40:32.595206+0000","last_clean":"2024-04-26T23:40:32.595206+0000","last_became_active":"2024-04-26T23:40:31.578438+0000","last_became_peered":"2024-04-26T23:40:31.578438+0000","last_unstale":"2024-04-26T23:40:32.595206+0000","last_undegraded":"2024-04-26T23:40:32.595206+0000","last_fullsized":"2024-04-26T23:40:32.595206+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:30:10.397569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T23:40:32.598058+0000","last_change":"2024-04-26T23:40:32.589769+0000","last_active":"2024-04-26T23:40:32.598058+0000","last_peered":"2024-04-26T23:40:32.598058+0000","last_clean":"2024-04-26T23:40:32.598058+0000","last_became_active":"2024-04-26T23:40:32.589489+0000","last_became_peered":"2024-04-26T23:40:32.589489+0000","last_unstale":"2024-04-26T23:40:32.598058+0000","last_undegraded":"2024-04-26T23:40:32.598058+0000","last_fullsized":"2024-04-26T23:40:32.598058+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:20:29.107798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T23:40:32.598460+0000","last_change":"2024-04-26T23:40:31.576867+0000","last_active":"2024-04-26T23:40:32.598460+0000","last_peered":"2024-04-26T23:40:32.598460+0000","last_clean":"2024-04-26T23:40:32.598460+0000","last_became_active":"2024-04-26T23:40:31.576342+0000","last_became_peered":"2024-04-26T23:40:31.576342+0000","last_unstale":"2024-04-26T23:40:32.598460+0000","last_undegraded":"2024-04-26T23:40:32.598460+0000","last_fullsized":"2024-04-26T23:40:32.598460+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:35:54.439397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T23:40:32.582703+0000","last_change":"2024-04-26T23:40:32.578489+0000","last_active":"2024-04-26T23:40:32.582703+0000","last_peered":"2024-04-26T23:40:32.582703+0000","last_clean":"2024-04-26T23:40:32.582703+0000","last_became_active":"2024-04-26T23:40:32.578205+0000","last_became_peered":"2024-04-26T23:40:32.578205+0000","last_unstale":"2024-04-26T23:40:32.582703+0000","last_undegraded":"2024-04-26T23:40:32.582703+0000","last_fullsized":"2024-04-26T23:40:32.582703+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:43:14.744600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-26T23:40:32.600506+0000","last_change":"2024-04-26T23:40:31.576688+0000","last_active":"2024-04-26T23:40:32.600506+0000","last_peered":"2024-04-26T23:40:32.600506+0000","last_clean":"2024-04-26T23:40:32.600506+0000","last_became_active":"2024-04-26T23:40:31.576429+0000","last_became_peered":"2024-04-26T23:40:31.576429+0000","last_unstale":"2024-04-26T23:40:32.600506+0000","last_undegraded":"2024-04-26T23:40:32.600506+0000","last_fullsized":"2024-04-26T23:40:32.600506+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:47:42.681376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27796,"kb_used_data":772,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344044,"statfs":{"total":96636764160,"available":96608301056,"internally_reserved":0,"allocated":790528,"data_stored":655529,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":204800,"data_stored":66191,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":196608,"data_stored":64669,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":204800,"data_stored":64705,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":204800,"data_stored":66191,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27208,"kb_used_data":188,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344632,"statfs":{"total":96636764160,"available":96608903168,"internally_reserved":0,"allocated":192512,"data_stored":64579,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27216,"kb_used_data":196,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344624,"statfs":{"total":96636764160,"available":96608894976,"internally_reserved":0,"allocated":200704,"data_stored":64739,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27800,"kb_used_data":780,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344040,"statfs":{"total":96636764160,"available":96608296960,"internally_reserved":0,"allocated":798720,"data_stored":655585,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T23:40:36.932 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-26T23:40:36.932 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T23:40:37.065 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.061+0000 7f99ac79d640 1 Processor -- start 2024-04-26T23:40:37.065 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.061+0000 7f99ac79d640 1 -- start start 2024-04-26T23:40:37.066 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.062+0000 7f99ac79d640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f99a40c7000 0x7f99a40ca460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:37.066 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.062+0000 7f99ac79d640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f99a40c9830 0x7f99a4153ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:37.067 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.062+0000 7f99ac79d640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f99a4156de0 con 0x7f99a4154220 2024-04-26T23:40:37.067 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.062+0000 7f99ac79d640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f99a4157b60 con 0x7f99a40c7000 2024-04-26T23:40:37.067 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.062+0000 7f99ac79d640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f99a40cad40 con 0x7f99a40c9830 2024-04-26T23:40:37.067 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.062+0000 7f99aa539640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f99a40c7000 0x7f99a40ca460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:37.067 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.062+0000 7f99aa539640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f99a40c7000 0x7f99a40ca460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:57420/0 (socket says 172.21.15.88:57420) 2024-04-26T23:40:37.067 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.062+0000 7f99aa539640 1 -- 172.21.15.88:0/749095630 learned_addr learned my addr 172.21.15.88:0/749095630 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:40:37.067 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.062+0000 7f99a9d38640 1 --2- 172.21.15.88:0/749095630 >> v2:172.21.15.175:3300/0 conn(0x7f99a40c9830 0x7f99a4153ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:37.067 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.062+0000 7f99aa539640 1 -- 172.21.15.88:0/749095630 >> v2:172.21.15.175:3300/0 conn(0x7f99a40c9830 msgr2=0x7f99a4153ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:40:37.067 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.062+0000 7f99aa539640 1 --2- 172.21.15.88:0/749095630 >> v2:172.21.15.175:3300/0 conn(0x7f99a40c9830 0x7f99a4153ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:37.067 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.062+0000 7f99aa539640 1 -- 172.21.15.88:0/749095630 >> v1:172.21.15.175:6789/0 conn(0x7f99a4154220 legacy=0x7f99a4072930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:37.067 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.062+0000 7f99aa539640 1 -- 172.21.15.88:0/749095630 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99a4157080 con 0x7f99a40c7000 2024-04-26T23:40:37.069 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.063+0000 7f99aa539640 1 --2- 172.21.15.88:0/749095630 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f99a40c7000 0x7f99a40ca460 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f99a40c8df0 tx=0x7f99a002a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f3ee3a736ace69f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:37.069 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.063+0000 7f99a9537640 1 -- 172.21.15.88:0/749095630 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99a0036070 con 0x7f99a40c7000 2024-04-26T23:40:37.069 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.063+0000 7f99a9537640 1 -- 172.21.15.88:0/749095630 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99a0031600 con 0x7f99a40c7000 2024-04-26T23:40:37.069 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.063+0000 7f99a9537640 1 -- 172.21.15.88:0/749095630 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99a00319d0 con 0x7f99a40c7000 2024-04-26T23:40:37.069 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.064+0000 7f99ac79d640 1 -- 172.21.15.88:0/749095630 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f99a40c7000 msgr2=0x7f99a40ca460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:37.069 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.064+0000 7f99ac79d640 1 --2- 172.21.15.88:0/749095630 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f99a40c7000 0x7f99a40ca460 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f99a40c8df0 tx=0x7f99a002a730 comp rx=0 tx=0).stop 2024-04-26T23:40:37.069 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.064+0000 7f99ac79d640 1 -- 172.21.15.88:0/749095630 shutdown_connections 2024-04-26T23:40:37.069 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.064+0000 7f99ac79d640 1 --2- 172.21.15.88:0/749095630 >> v2:172.21.15.175:3300/0 conn(0x7f99a40c9830 0x7f99a4153ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:37.069 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.064+0000 7f99ac79d640 1 --2- 172.21.15.88:0/749095630 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f99a40c7000 0x7f99a40ca460 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:37.069 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.064+0000 7f99ac79d640 1 -- 172.21.15.88:0/749095630 >> 172.21.15.88:0/749095630 conn(0x7f99a40adf20 msgr2=0x7f99a40ae330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:40:37.070 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.064+0000 7f99ac79d640 1 -- 172.21.15.88:0/749095630 shutdown_connections 2024-04-26T23:40:37.070 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.064+0000 7f99ac79d640 1 -- 172.21.15.88:0/749095630 wait complete. 2024-04-26T23:40:37.070 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.065+0000 7f99ac79d640 1 Processor -- start 2024-04-26T23:40:37.070 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.065+0000 7f99ac79d640 1 -- start start 2024-04-26T23:40:37.073 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.066+0000 7f99ac79d640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f99a40c7000 0x7f99a41efd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:37.073 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.066+0000 7f99ac79d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f99a40c9830 0x7f99a40c44b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:37.073 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.066+0000 7f99ac79d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f99a4154220 0x7f99a40c49f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:37.073 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.066+0000 7f99ac79d640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f99a40ca9a0 con 0x7f99a4154220 2024-04-26T23:40:37.073 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.066+0000 7f99ac79d640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f99a4157640 con 0x7f99a40c9830 2024-04-26T23:40:37.073 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.066+0000 7f99ac79d640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f99a40cab20 con 0x7f99a40c7000 2024-04-26T23:40:37.073 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.066+0000 7f99aad3a640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f99a4154220 0x7f99a40c49f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:37.073 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.066+0000 7f99aad3a640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f99a4154220 0x7f99a40c49f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:57432/0 (socket says 172.21.15.88:57432) 2024-04-26T23:40:37.073 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.066+0000 7f99aad3a640 1 -- 172.21.15.88:0/3327274344 learned_addr learned my addr 172.21.15.88:0/3327274344 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:40:37.073 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.066+0000 7f99aa539640 1 --2- 172.21.15.88:0/3327274344 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f99a40c7000 0x7f99a41efd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:37.073 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.066+0000 7f99a9d38640 1 --2- 172.21.15.88:0/3327274344 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f99a40c9830 0x7f99a40c44b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:37.073 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.066+0000 7f99aad3a640 1 -- 172.21.15.88:0/3327274344 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f99a40c7000 msgr2=0x7f99a41efd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:37.073 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.066+0000 7f99aad3a640 1 --2- 172.21.15.88:0/3327274344 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f99a40c7000 0x7f99a41efd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:37.074 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.066+0000 7f99aad3a640 1 -- 172.21.15.88:0/3327274344 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f99a40c9830 msgr2=0x7f99a40c44b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:37.074 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.066+0000 7f99aad3a640 1 --2- 172.21.15.88:0/3327274344 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f99a40c9830 0x7f99a40c44b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:37.074 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.066+0000 7f99aad3a640 1 -- 172.21.15.88:0/3327274344 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99a40c60f0 con 0x7f99a4154220 2024-04-26T23:40:37.074 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.066+0000 7f99aad3a640 1 --2- 172.21.15.88:0/3327274344 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f99a4154220 0x7f99a40c49f0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f999c00c3f0 tx=0x7f999c00c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:37.074 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.066+0000 7f999affd640 1 -- 172.21.15.88:0/3327274344 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f999c0052d0 con 0x7f99a4154220 2024-04-26T23:40:37.074 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.066+0000 7f999affd640 1 -- 172.21.15.88:0/3327274344 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f999c005490 con 0x7f99a4154220 2024-04-26T23:40:37.074 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.066+0000 7f99ac79d640 1 -- 172.21.15.88:0/3327274344 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99a40c6390 con 0x7f99a4154220 2024-04-26T23:40:37.074 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.066+0000 7f999affd640 1 -- 172.21.15.88:0/3327274344 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f999c007260 con 0x7f99a4154220 2024-04-26T23:40:37.074 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.066+0000 7f99ac79d640 1 -- 172.21.15.88:0/3327274344 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99a41f0620 con 0x7f99a4154220 2024-04-26T23:40:37.074 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.067+0000 7f99ac79d640 1 -- 172.21.15.88:0/3327274344 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f99a40766c0 con 0x7f99a4154220 2024-04-26T23:40:37.074 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.068+0000 7f999affd640 1 -- 172.21.15.88:0/3327274344 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f999c007400 con 0x7f99a4154220 2024-04-26T23:40:37.074 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.068+0000 7f999affd640 1 --2- 172.21.15.88:0/3327274344 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f998806c8f0 0x7f998806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:37.074 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.068+0000 7f999affd640 1 -- 172.21.15.88:0/3327274344 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5689+0+0 (secure 0 0 0) 0x7f999c08afa0 con 0x7f99a4154220 2024-04-26T23:40:37.074 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.068+0000 7f99aa539640 1 --2- 172.21.15.88:0/3327274344 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f998806c8f0 0x7f998806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:37.075 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.068+0000 7f99aa539640 1 --2- 172.21.15.88:0/3327274344 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f998806c8f0 0x7f998806edb0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f99a0033000 tx=0x7f99a0009000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:37.076 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.072+0000 7f999affd640 1 -- 172.21.15.88:0/3327274344 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f999c059470 con 0x7f99a4154220 2024-04-26T23:40:37.251 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.247+0000 7f99ac79d640 1 -- 172.21.15.88:0/3327274344 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f99a40507a0 con 0x7f99a4154220 2024-04-26T23:40:37.252 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.249+0000 7f999affd640 1 -- 172.21.15.88:0/3327274344 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16585 (secure 0 0 0) 0x7f999c058d70 con 0x7f99a4154220 2024-04-26T23:40:37.253 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-26T23:40:37.253 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":20,"fsid":"555255e9-7ef9-4454-8dc9-35e96b70035c","created":"2024-04-26T23:40:07.836009+0000","modified":"2024-04-26T23:40:33.574507+0000","last_up_change":"2024-04-26T23:40:18.831369+0000","last_in_change":"2024-04-26T23:40:09.944777+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T23:40:19.936127+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"a_metadata","create_time":"2024-04-26T23:40:29.837465+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"a_data","create_time":"2024-04-26T23:40:30.868651+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"92aecea3-ed62-4a29-87c0-76758a0816a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":2803186054},{"type":"v1","addr":"172.21.15.88:6801","nonce":2803186054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":2803186054},{"type":"v1","addr":"172.21.15.88:6803","nonce":2803186054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":2803186054},{"type":"v1","addr":"172.21.15.88:6807","nonce":2803186054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":2803186054},{"type":"v1","addr":"172.21.15.88:6805","nonce":2803186054}]},"public_addr":"172.21.15.88:6801/2803186054","cluster_addr":"172.21.15.88:6803/2803186054","heartbeat_back_addr":"172.21.15.88:6807/2803186054","heartbeat_front_addr":"172.21.15.88:6805/2803186054","state":["exists","up"]},{"osd":1,"uuid":"7a6f0fa9-23d0-4747-880f-798d45ec5eeb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":1897380484},{"type":"v1","addr":"172.21.15.88:6817","nonce":1897380484}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":1897380484},{"type":"v1","addr":"172.21.15.88:6819","nonce":1897380484}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1897380484},{"type":"v1","addr":"172.21.15.88:6823","nonce":1897380484}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":1897380484},{"type":"v1","addr":"172.21.15.88:6821","nonce":1897380484}]},"public_addr":"172.21.15.88:6817/1897380484","cluster_addr":"172.21.15.88:6819/1897380484","heartbeat_back_addr":"172.21.15.88:6823/1897380484","heartbeat_front_addr":"172.21.15.88:6821/1897380484","state":["exists","up"]},{"osd":2,"uuid":"6be88ea0-e133-4200-a4b5-f92d664b248a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":648396269},{"type":"v1","addr":"172.21.15.88:6809","nonce":648396269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":648396269},{"type":"v1","addr":"172.21.15.88:6811","nonce":648396269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":648396269},{"type":"v1","addr":"172.21.15.88:6815","nonce":648396269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":648396269},{"type":"v1","addr":"172.21.15.88:6813","nonce":648396269}]},"public_addr":"172.21.15.88:6809/648396269","cluster_addr":"172.21.15.88:6811/648396269","heartbeat_back_addr":"172.21.15.88:6815/648396269","heartbeat_front_addr":"172.21.15.88:6813/648396269","state":["exists","up"]},{"osd":3,"uuid":"dcb0746b-7b3d-4ecf-8089-2493a5d1857c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":2328028922},{"type":"v1","addr":"172.21.15.88:6825","nonce":2328028922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":2328028922},{"type":"v1","addr":"172.21.15.88:6827","nonce":2328028922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":2328028922},{"type":"v1","addr":"172.21.15.88:6831","nonce":2328028922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":2328028922},{"type":"v1","addr":"172.21.15.88:6829","nonce":2328028922}]},"public_addr":"172.21.15.88:6825/2328028922","cluster_addr":"172.21.15.88:6827/2328028922","heartbeat_back_addr":"172.21.15.88:6831/2328028922","heartbeat_front_addr":"172.21.15.88:6829/2328028922","state":["exists","up"]},{"osd":4,"uuid":"c483de66-c44f-450e-a4ce-b132d50882c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":3929617402},{"type":"v1","addr":"172.21.15.175:6809","nonce":3929617402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":3929617402},{"type":"v1","addr":"172.21.15.175:6811","nonce":3929617402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":3929617402},{"type":"v1","addr":"172.21.15.175:6815","nonce":3929617402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":3929617402},{"type":"v1","addr":"172.21.15.175:6813","nonce":3929617402}]},"public_addr":"172.21.15.175:6809/3929617402","cluster_addr":"172.21.15.175:6811/3929617402","heartbeat_back_addr":"172.21.15.175:6815/3929617402","heartbeat_front_addr":"172.21.15.175:6813/3929617402","state":["exists","up"]},{"osd":5,"uuid":"ac3b1669-d228-40dd-9f9a-cb46aa73dd6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":2476644457},{"type":"v1","addr":"172.21.15.175:6801","nonce":2476644457}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":2476644457},{"type":"v1","addr":"172.21.15.175:6803","nonce":2476644457}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":2476644457},{"type":"v1","addr":"172.21.15.175:6807","nonce":2476644457}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":2476644457},{"type":"v1","addr":"172.21.15.175:6805","nonce":2476644457}]},"public_addr":"172.21.15.175:6801/2476644457","cluster_addr":"172.21.15.175:6803/2476644457","heartbeat_back_addr":"172.21.15.175:6807/2476644457","heartbeat_front_addr":"172.21.15.175:6805/2476644457","state":["exists","up"]},{"osd":6,"uuid":"7bef4896-857e-4c11-b3b2-c2e9a8548338","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":3824112919},{"type":"v1","addr":"172.21.15.175:6819","nonce":3824112919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6821","nonce":3824112919},{"type":"v1","addr":"172.21.15.175:6824","nonce":3824112919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":3824112919},{"type":"v1","addr":"172.21.15.175:6831","nonce":3824112919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":3824112919},{"type":"v1","addr":"172.21.15.175:6829","nonce":3824112919}]},"public_addr":"172.21.15.175:6819/3824112919","cluster_addr":"172.21.15.175:6824/3824112919","heartbeat_back_addr":"172.21.15.175:6831/3824112919","heartbeat_front_addr":"172.21.15.175:6829/3824112919","state":["exists","up"]},{"osd":7,"uuid":"e18d9e09-8673-470d-b9dc-280a409b63f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6817","nonce":3319361162},{"type":"v1","addr":"172.21.15.175:6818","nonce":3319361162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":3319361162},{"type":"v1","addr":"172.21.15.175:6822","nonce":3319361162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6827","nonce":3319361162},{"type":"v1","addr":"172.21.15.175:6828","nonce":3319361162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6823","nonce":3319361162},{"type":"v1","addr":"172.21.15.175:6825","nonce":3319361162}]},"public_addr":"172.21.15.175:6818/3319361162","cluster_addr":"172.21.15.175:6822/3319361162","heartbeat_back_addr":"172.21.15.175:6828/3319361162","heartbeat_front_addr":"172.21.15.175:6825/3319361162","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:40:15.126268+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:40:15.050614+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:40:14.995164+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:40:15.078112+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:40:15.159637+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:40:15.091226+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:40:15.140316+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:40:15.089431+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:40:37.255 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.250+0000 7f99ac79d640 1 -- 172.21.15.88:0/3327274344 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f998806c8f0 msgr2=0x7f998806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:37.255 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.250+0000 7f99ac79d640 1 --2- 172.21.15.88:0/3327274344 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f998806c8f0 0x7f998806edb0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f99a0033000 tx=0x7f99a0009000 comp rx=0 tx=0).stop 2024-04-26T23:40:37.255 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.250+0000 7f99ac79d640 1 -- 172.21.15.88:0/3327274344 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f99a4154220 msgr2=0x7f99a40c49f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:37.255 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.250+0000 7f99ac79d640 1 --2- 172.21.15.88:0/3327274344 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f99a4154220 0x7f99a40c49f0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f999c00c3f0 tx=0x7f999c00c8b0 comp rx=0 tx=0).stop 2024-04-26T23:40:37.255 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.251+0000 7f99ac79d640 1 -- 172.21.15.88:0/3327274344 shutdown_connections 2024-04-26T23:40:37.255 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.251+0000 7f99ac79d640 1 --2- 172.21.15.88:0/3327274344 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f998806c8f0 0x7f998806edb0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:37.255 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.251+0000 7f99ac79d640 1 --2- 172.21.15.88:0/3327274344 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f99a4154220 0x7f99a40c49f0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:37.255 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.251+0000 7f99ac79d640 1 --2- 172.21.15.88:0/3327274344 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f99a40c9830 0x7f99a40c44b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:37.255 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.251+0000 7f99ac79d640 1 --2- 172.21.15.88:0/3327274344 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f99a40c7000 0x7f99a41efd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:37.255 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.251+0000 7f99ac79d640 1 -- 172.21.15.88:0/3327274344 >> 172.21.15.88:0/3327274344 conn(0x7f99a40adf20 msgr2=0x7f99a40ad3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:40:37.255 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.251+0000 7f99ac79d640 1 -- 172.21.15.88:0/3327274344 shutdown_connections 2024-04-26T23:40:37.255 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.251+0000 7f99ac79d640 1 -- 172.21.15.88:0/3327274344 wait complete. 2024-04-26T23:40:37.265 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T23:40:19.936127+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'a_metadata', 'create_time': '2024-04-26T23:40:29.837465+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'a'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'a_data', 'create_time': '2024-04-26T23:40:30.868651+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'a'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T23:40:37.266 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T23:40:37.366 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.360+0000 7f0389820640 1 Processor -- start 2024-04-26T23:40:37.366 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.360+0000 7f0389820640 1 -- start start 2024-04-26T23:40:37.366 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.361+0000 7f0389820640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f038415a280 0x7f03840c82a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:37.366 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.361+0000 7f0389820640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f0384158180 0x7f03841585f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:37.366 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.361+0000 7f0389820640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f03840c8a30 con 0x7f038413ffb0 2024-04-26T23:40:37.366 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.361+0000 7f0389820640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f0384072be0 con 0x7f0384158180 2024-04-26T23:40:37.366 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.361+0000 7f0389820640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f03840c9640 con 0x7f038415a280 2024-04-26T23:40:37.367 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.361+0000 7f03827fc640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f038415a280 0x7f03840c82a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:37.367 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.361+0000 7f03837fe640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f0384158180 0x7f03841585f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:37.367 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.361+0000 7f03827fc640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f038415a280 0x7f03840c82a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.88:53552/0 (socket says 172.21.15.88:53552) 2024-04-26T23:40:37.367 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.361+0000 7f0382ffd640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f038413ffb0 0x7f0384072ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.88:59022/0 (socket says 172.21.15.88:59022) 2024-04-26T23:40:37.367 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.361+0000 7f03827fc640 1 -- 172.21.15.88:0/1766794820 learned_addr learned my addr 172.21.15.88:0/1766794820 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:40:37.367 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.362+0000 7f0381ffb640 1 -- 172.21.15.88:0/1766794820 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1603671841 0 0) 0x7f03840c8a30 con 0x7f038413ffb0 2024-04-26T23:40:37.367 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.362+0000 7f0381ffb640 1 -- 172.21.15.88:0/1766794820 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f036c003520 con 0x7f038413ffb0 2024-04-26T23:40:37.367 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.362+0000 7f03827fc640 1 -- 172.21.15.88:0/1766794820 >> v2:172.21.15.175:3300/0 conn(0x7f0384158180 msgr2=0x7f03841585f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:40:37.367 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.362+0000 7f03827fc640 1 --2- 172.21.15.88:0/1766794820 >> v2:172.21.15.175:3300/0 conn(0x7f0384158180 0x7f03841585f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:37.367 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.362+0000 7f03827fc640 1 -- 172.21.15.88:0/1766794820 >> v1:172.21.15.175:6789/0 conn(0x7f038413ffb0 legacy=0x7f0384072ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:37.367 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.362+0000 7f03827fc640 1 -- 172.21.15.88:0/1766794820 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03840c8d10 con 0x7f038415a280 2024-04-26T23:40:37.367 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.362+0000 7f03837fe640 1 --2- 172.21.15.88:0/1766794820 >> v2:172.21.15.175:3300/0 conn(0x7f0384158180 0x7f03841585f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:40:37.371 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.362+0000 7f03827fc640 1 --2- 172.21.15.88:0/1766794820 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f038415a280 0x7f03840c82a0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f0378009870 tx=0x7f037802a1c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e0789b2e9a4b6c9 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:37.371 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.363+0000 7f0381ffb640 1 -- 172.21.15.88:0/1766794820 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0378037070 con 0x7f038415a280 2024-04-26T23:40:37.371 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.363+0000 7f0381ffb640 1 -- 172.21.15.88:0/1766794820 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0378032440 con 0x7f038415a280 2024-04-26T23:40:37.371 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.363+0000 7f0381ffb640 1 -- 172.21.15.88:0/1766794820 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03780327f0 con 0x7f038415a280 2024-04-26T23:40:37.371 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.363+0000 7f0389820640 1 -- 172.21.15.88:0/1766794820 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f038415a280 msgr2=0x7f03840c82a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:37.371 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.363+0000 7f0389820640 1 --2- 172.21.15.88:0/1766794820 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f038415a280 0x7f03840c82a0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f0378009870 tx=0x7f037802a1c0 comp rx=0 tx=0).stop 2024-04-26T23:40:37.372 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.363+0000 7f0389820640 1 -- 172.21.15.88:0/1766794820 shutdown_connections 2024-04-26T23:40:37.372 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.363+0000 7f0389820640 1 --2- 172.21.15.88:0/1766794820 >> v2:172.21.15.175:3300/0 conn(0x7f0384158180 0x7f03841585f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:37.372 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.363+0000 7f0389820640 1 --2- 172.21.15.88:0/1766794820 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f038415a280 0x7f03840c82a0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:37.372 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.363+0000 7f0389820640 1 -- 172.21.15.88:0/1766794820 >> 172.21.15.88:0/1766794820 conn(0x7f038406dc10 msgr2=0x7f038406c310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:40:37.372 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.363+0000 7f0389820640 1 -- 172.21.15.88:0/1766794820 shutdown_connections 2024-04-26T23:40:37.372 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.363+0000 7f0389820640 1 -- 172.21.15.88:0/1766794820 wait complete. 2024-04-26T23:40:37.372 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.364+0000 7f0389820640 1 Processor -- start 2024-04-26T23:40:37.372 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.365+0000 7f0389820640 1 -- start start 2024-04-26T23:40:37.372 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.365+0000 7f0389820640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f038413ffb0 0x7f0384134cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:37.372 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.365+0000 7f0389820640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0384158180 0x7f03841ec4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:37.372 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.365+0000 7f0389820640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f038415a280 0x7f03841539a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:37.372 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.365+0000 7f0389820640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f03840c92d0 con 0x7f0384158180 2024-04-26T23:40:37.372 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.365+0000 7f0389820640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f03840c87e0 con 0x7f038415a280 2024-04-26T23:40:37.372 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.365+0000 7f0389820640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f0384073700 con 0x7f038413ffb0 2024-04-26T23:40:37.372 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.365+0000 7f03827fc640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0384158180 0x7f03841ec4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:37.373 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.365+0000 7f03827fc640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0384158180 0x7f03841ec4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:57440/0 (socket says 172.21.15.88:57440) 2024-04-26T23:40:37.373 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.365+0000 7f03827fc640 1 -- 172.21.15.88:0/558337831 learned_addr learned my addr 172.21.15.88:0/558337831 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:40:37.373 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.365+0000 7f03837fe640 1 --2- 172.21.15.88:0/558337831 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f038415a280 0x7f03841539a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:37.373 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.365+0000 7f0382ffd640 1 --2- 172.21.15.88:0/558337831 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f038413ffb0 0x7f0384134cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:37.373 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.366+0000 7f03827fc640 1 -- 172.21.15.88:0/558337831 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f038413ffb0 msgr2=0x7f0384134cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:37.373 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.366+0000 7f03827fc640 1 --2- 172.21.15.88:0/558337831 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f038413ffb0 0x7f0384134cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:37.373 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.366+0000 7f03827fc640 1 -- 172.21.15.88:0/558337831 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f038415a280 msgr2=0x7f03841539a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:37.373 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.366+0000 7f03827fc640 1 --2- 172.21.15.88:0/558337831 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f038415a280 0x7f03841539a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:37.373 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.366+0000 7f03827fc640 1 -- 172.21.15.88:0/558337831 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03840ad420 con 0x7f0384158180 2024-04-26T23:40:37.373 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.366+0000 7f03827fc640 1 --2- 172.21.15.88:0/558337831 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0384158180 0x7f03841ec4f0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f037802a200 tx=0x7f03780046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:37.373 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.366+0000 7f036bfff640 1 -- 172.21.15.88:0/558337831 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0378037040 con 0x7f0384158180 2024-04-26T23:40:37.373 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.366+0000 7f036bfff640 1 -- 172.21.15.88:0/558337831 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0378003bc0 con 0x7f0384158180 2024-04-26T23:40:37.373 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.366+0000 7f0389820640 1 -- 172.21.15.88:0/558337831 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03841ecda0 con 0x7f0384158180 2024-04-26T23:40:37.373 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.366+0000 7f036bfff640 1 -- 172.21.15.88:0/558337831 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03780325f0 con 0x7f0384158180 2024-04-26T23:40:37.373 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.366+0000 7f0389820640 1 -- 172.21.15.88:0/558337831 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0384155090 con 0x7f0384158180 2024-04-26T23:40:37.374 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.367+0000 7f0389820640 1 -- 172.21.15.88:0/558337831 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0384076650 con 0x7f0384158180 2024-04-26T23:40:37.374 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.367+0000 7f036bfff640 1 -- 172.21.15.88:0/558337831 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f037802ad10 con 0x7f0384158180 2024-04-26T23:40:37.374 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.368+0000 7f036bfff640 1 --2- 172.21.15.88:0/558337831 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f037006c8f0 0x7f037006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:37.374 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.368+0000 7f036bfff640 1 -- 172.21.15.88:0/558337831 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5689+0+0 (secure 0 0 0) 0x7f03780abc90 con 0x7f0384158180 2024-04-26T23:40:37.374 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.368+0000 7f0382ffd640 1 --2- 172.21.15.88:0/558337831 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f037006c8f0 0x7f037006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:37.374 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.368+0000 7f0382ffd640 1 --2- 172.21.15.88:0/558337831 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f037006c8f0 0x7f037006edb0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f03740012e0 tx=0x7f03740016d0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:37.376 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.372+0000 7f036bfff640 1 -- 172.21.15.88:0/558337831 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f03840ad420 con 0x7f0384158180 2024-04-26T23:40:37.553 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.549+0000 7f0389820640 1 -- 172.21.15.88:0/558337831 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f0384072dd0 con 0x7f0384158180 2024-04-26T23:40:37.553 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.550+0000 7f036bfff640 1 -- 172.21.15.88:0/558337831 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) ==== 93+0+10 (secure 0 0 0) 0x7f037807a160 con 0x7f0384158180 2024-04-26T23:40:37.554 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 1 2024-04-26T23:40:37.556 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.551+0000 7f0389820640 1 -- 172.21.15.88:0/558337831 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f037006c8f0 msgr2=0x7f037006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:37.556 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.551+0000 7f0389820640 1 --2- 172.21.15.88:0/558337831 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f037006c8f0 0x7f037006edb0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f03740012e0 tx=0x7f03740016d0 comp rx=0 tx=0).stop 2024-04-26T23:40:37.556 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.551+0000 7f0389820640 1 -- 172.21.15.88:0/558337831 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0384158180 msgr2=0x7f03841ec4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:37.556 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.551+0000 7f0389820640 1 --2- 172.21.15.88:0/558337831 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0384158180 0x7f03841ec4f0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f037802a200 tx=0x7f03780046c0 comp rx=0 tx=0).stop 2024-04-26T23:40:37.556 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.552+0000 7f0389820640 1 -- 172.21.15.88:0/558337831 shutdown_connections 2024-04-26T23:40:37.556 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.552+0000 7f0389820640 1 --2- 172.21.15.88:0/558337831 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f037006c8f0 0x7f037006edb0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:37.556 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.552+0000 7f0389820640 1 --2- 172.21.15.88:0/558337831 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f038415a280 0x7f03841539a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:37.556 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.552+0000 7f0389820640 1 --2- 172.21.15.88:0/558337831 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0384158180 0x7f03841ec4f0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:37.556 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.552+0000 7f0389820640 1 --2- 172.21.15.88:0/558337831 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f038413ffb0 0x7f0384134cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:37.556 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.552+0000 7f0389820640 1 -- 172.21.15.88:0/558337831 >> 172.21.15.88:0/558337831 conn(0x7f038406dc10 msgr2=0x7f03840cc3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:40:37.556 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.552+0000 7f0389820640 1 -- 172.21.15.88:0/558337831 shutdown_connections 2024-04-26T23:40:37.556 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.552+0000 7f0389820640 1 -- 172.21.15.88:0/558337831 wait complete. 2024-04-26T23:40:37.566 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get a_metadata pg_num 2024-04-26T23:40:37.667 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.663+0000 7ffb1035f640 1 Processor -- start 2024-04-26T23:40:37.667 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.663+0000 7ffb1035f640 1 -- start start 2024-04-26T23:40:37.669 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.664+0000 7ffb1035f640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ffb0813fe20 0x7ffb080c5430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:37.669 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.664+0000 7ffb1035f640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7ffb080c3c70 0x7ffb0806d320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:37.669 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.664+0000 7ffb1035f640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffb0815a230 con 0x7ffb0806d860 2024-04-26T23:40:37.669 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.664+0000 7ffb1035f640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7ffb080c39b0 con 0x7ffb080c3c70 2024-04-26T23:40:37.669 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.664+0000 7ffb1035f640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7ffb0815b120 con 0x7ffb0813fe20 2024-04-26T23:40:37.669 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.664+0000 7ffb0e0fb640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ffb0813fe20 0x7ffb080c5430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:37.669 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.664+0000 7ffb0d8fa640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7ffb080c3c70 0x7ffb0806d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:37.669 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.664+0000 7ffb0e8fc640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7ffb0806d860 0x7ffb08157010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.88:59032/0 (socket says 172.21.15.88:59032) 2024-04-26T23:40:37.669 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.664+0000 7ffb0e0fb640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ffb0813fe20 0x7ffb080c5430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.88:53576/0 (socket says 172.21.15.88:53576) 2024-04-26T23:40:37.669 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.664+0000 7ffb0e8fc640 1 -- 172.21.15.88:0/1699501069 learned_addr learned my addr 172.21.15.88:0/1699501069 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-26T23:40:37.670 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.665+0000 7ffb0d8fa640 1 -- 172.21.15.88:0/1699501069 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ffb0813fe20 msgr2=0x7ffb080c5430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:40:37.670 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.665+0000 7ffb0d8fa640 1 --2- 172.21.15.88:0/1699501069 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ffb0813fe20 0x7ffb080c5430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:37.670 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.665+0000 7ffb0d8fa640 1 -- 172.21.15.88:0/1699501069 >> v1:172.21.15.175:6789/0 conn(0x7ffb0806d860 legacy=0x7ffb08157010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:37.670 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.665+0000 7ffb0d8fa640 1 -- 172.21.15.88:0/1699501069 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb0815a510 con 0x7ffb080c3c70 2024-04-26T23:40:37.670 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.665+0000 7ffb0e0fb640 1 --2- 172.21.15.88:0/1699501069 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ffb0813fe20 0x7ffb080c5430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:40:37.673 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.666+0000 7ffb0d8fa640 1 --2- 172.21.15.88:0/1699501069 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffb080c3c70 0x7ffb0806d320 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7ffaf80097a0 tx=0x7ffaf802a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5985b62ccce1126f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:37.673 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.666+0000 7ffb0d0f9640 1 -- 172.21.15.88:0/1699501069 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaf8037070 con 0x7ffb080c3c70 2024-04-26T23:40:37.673 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.666+0000 7ffb0d0f9640 1 -- 172.21.15.88:0/1699501069 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffaf8032440 con 0x7ffb080c3c70 2024-04-26T23:40:37.673 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.666+0000 7ffb0d0f9640 1 -- 172.21.15.88:0/1699501069 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaf8032810 con 0x7ffb080c3c70 2024-04-26T23:40:37.673 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.666+0000 7ffb1035f640 1 -- 172.21.15.88:0/1699501069 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffb080c3c70 msgr2=0x7ffb0806d320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:37.673 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.666+0000 7ffb1035f640 1 --2- 172.21.15.88:0/1699501069 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffb080c3c70 0x7ffb0806d320 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7ffaf80097a0 tx=0x7ffaf802a180 comp rx=0 tx=0).stop 2024-04-26T23:40:37.673 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.666+0000 7ffb1035f640 1 -- 172.21.15.88:0/1699501069 shutdown_connections 2024-04-26T23:40:37.673 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.666+0000 7ffb1035f640 1 --2- 172.21.15.88:0/1699501069 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffb080c3c70 0x7ffb0806d320 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:37.673 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.666+0000 7ffb1035f640 1 --2- 172.21.15.88:0/1699501069 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ffb0813fe20 0x7ffb080c5430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:37.674 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.666+0000 7ffb1035f640 1 -- 172.21.15.88:0/1699501069 >> 172.21.15.88:0/1699501069 conn(0x7ffb080c5d70 msgr2=0x7ffb080c6180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:40:37.674 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.666+0000 7ffb1035f640 1 -- 172.21.15.88:0/1699501069 shutdown_connections 2024-04-26T23:40:37.674 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.666+0000 7ffb1035f640 1 -- 172.21.15.88:0/1699501069 wait complete. 2024-04-26T23:40:37.674 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.667+0000 7ffb1035f640 1 Processor -- start 2024-04-26T23:40:37.674 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.667+0000 7ffb1035f640 1 -- start start 2024-04-26T23:40:37.674 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.668+0000 7ffb1035f640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffb0806d860 0x7ffb08072690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:37.674 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.668+0000 7ffb1035f640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ffb080c3c70 0x7ffb081f00a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:37.674 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.668+0000 7ffb1035f640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffb0813fe20 0x7ffb080ad1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:37.674 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.668+0000 7ffb1035f640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7ffb0815adb0 con 0x7ffb0806d860 2024-04-26T23:40:37.674 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.668+0000 7ffb1035f640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ffb0815aad0 con 0x7ffb0813fe20 2024-04-26T23:40:37.674 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.668+0000 7ffb1035f640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7ffb08140200 con 0x7ffb080c3c70 2024-04-26T23:40:37.674 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.668+0000 7ffb0e0fb640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffb0806d860 0x7ffb08072690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:37.674 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.668+0000 7ffb0e0fb640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffb0806d860 0x7ffb08072690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:57442/0 (socket says 172.21.15.88:57442) 2024-04-26T23:40:37.675 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.668+0000 7ffb0e0fb640 1 -- 172.21.15.88:0/1171951475 learned_addr learned my addr 172.21.15.88:0/1171951475 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:40:37.675 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.668+0000 7ffb0d8fa640 1 --2- 172.21.15.88:0/1171951475 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ffb080c3c70 0x7ffb081f00a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:37.675 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.668+0000 7ffb0e8fc640 1 --2- 172.21.15.88:0/1171951475 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffb0813fe20 0x7ffb080ad1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:37.675 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.668+0000 7ffb0e0fb640 1 -- 172.21.15.88:0/1171951475 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ffb080c3c70 msgr2=0x7ffb081f00a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:37.675 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.668+0000 7ffb0e0fb640 1 --2- 172.21.15.88:0/1171951475 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ffb080c3c70 0x7ffb081f00a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:37.675 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.668+0000 7ffb0e0fb640 1 -- 172.21.15.88:0/1171951475 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffb0813fe20 msgr2=0x7ffb080ad1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:37.675 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.668+0000 7ffb0e0fb640 1 --2- 172.21.15.88:0/1171951475 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffb0813fe20 0x7ffb080ad1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:37.675 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.668+0000 7ffb0e0fb640 1 -- 172.21.15.88:0/1171951475 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb080c8120 con 0x7ffb0806d860 2024-04-26T23:40:37.675 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.669+0000 7ffb0e0fb640 1 --2- 172.21.15.88:0/1171951475 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffb0806d860 0x7ffb08072690 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7ffb0400efc0 tx=0x7ffb0400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:37.675 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.669+0000 7ffafeffd640 1 -- 172.21.15.88:0/1171951475 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb04018020 con 0x7ffb0806d860 2024-04-26T23:40:37.675 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.669+0000 7ffafeffd640 1 -- 172.21.15.88:0/1171951475 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb04014680 con 0x7ffb0806d860 2024-04-26T23:40:37.675 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.669+0000 7ffb1035f640 1 -- 172.21.15.88:0/1171951475 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb080c8400 con 0x7ffb0806d860 2024-04-26T23:40:37.675 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.669+0000 7ffafeffd640 1 -- 172.21.15.88:0/1171951475 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb04014a50 con 0x7ffb0806d860 2024-04-26T23:40:37.675 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.669+0000 7ffb1035f640 1 -- 172.21.15.88:0/1171951475 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb081efb80 con 0x7ffb0806d860 2024-04-26T23:40:37.676 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.670+0000 7ffb1035f640 1 -- 172.21.15.88:0/1171951475 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffb080507a0 con 0x7ffb0806d860 2024-04-26T23:40:37.676 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.670+0000 7ffafeffd640 1 -- 172.21.15.88:0/1171951475 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ffb04005d10 con 0x7ffb0806d860 2024-04-26T23:40:37.677 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.671+0000 7ffafeffd640 1 --2- 172.21.15.88:0/1171951475 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7ffaec06c8f0 0x7ffaec06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:37.677 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.671+0000 7ffafeffd640 1 -- 172.21.15.88:0/1171951475 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5689+0+0 (secure 0 0 0) 0x7ffb0408c7f0 con 0x7ffb0806d860 2024-04-26T23:40:37.677 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.671+0000 7ffb0d8fa640 1 --2- 172.21.15.88:0/1171951475 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7ffaec06c8f0 0x7ffaec06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:37.677 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.671+0000 7ffb0d8fa640 1 --2- 172.21.15.88:0/1171951475 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7ffaec06c8f0 0x7ffaec06edb0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ffaf8034000 tx=0x7ffaf802e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:37.679 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.675+0000 7ffafeffd640 1 -- 172.21.15.88:0/1171951475 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7ffb04022030 con 0x7ffb0806d860 2024-04-26T23:40:37.852 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.849+0000 7ffb1035f640 1 -- 172.21.15.88:0/1171951475 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "a_metadata", "var": "pg_num"} v 0) -- 0x7ffb080c2bf0 con 0x7ffb0806d860 2024-04-26T23:40:37.853 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.849+0000 7ffafeffd640 1 -- 172.21.15.88:0/1171951475 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "a_metadata", "var": "pg_num"}]=0 v20) ==== 99+0+11 (secure 0 0 0) 0x7ffb04010040 con 0x7ffb0806d860 2024-04-26T23:40:37.853 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 32 2024-04-26T23:40:37.855 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.851+0000 7ffb1035f640 1 -- 172.21.15.88:0/1171951475 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7ffaec06c8f0 msgr2=0x7ffaec06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:37.855 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.851+0000 7ffb1035f640 1 --2- 172.21.15.88:0/1171951475 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7ffaec06c8f0 0x7ffaec06edb0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ffaf8034000 tx=0x7ffaf802e000 comp rx=0 tx=0).stop 2024-04-26T23:40:37.855 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.851+0000 7ffb1035f640 1 -- 172.21.15.88:0/1171951475 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffb0806d860 msgr2=0x7ffb08072690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:37.855 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.851+0000 7ffb1035f640 1 --2- 172.21.15.88:0/1171951475 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffb0806d860 0x7ffb08072690 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7ffb0400efc0 tx=0x7ffb0400c490 comp rx=0 tx=0).stop 2024-04-26T23:40:37.855 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.851+0000 7ffb1035f640 1 -- 172.21.15.88:0/1171951475 shutdown_connections 2024-04-26T23:40:37.855 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.851+0000 7ffb1035f640 1 --2- 172.21.15.88:0/1171951475 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7ffaec06c8f0 0x7ffaec06edb0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:37.855 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.851+0000 7ffb1035f640 1 --2- 172.21.15.88:0/1171951475 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ffb080c3c70 0x7ffb081f00a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:37.855 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.851+0000 7ffb1035f640 1 --2- 172.21.15.88:0/1171951475 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffb0813fe20 0x7ffb080ad1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:37.855 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.851+0000 7ffb1035f640 1 --2- 172.21.15.88:0/1171951475 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffb0806d860 0x7ffb08072690 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:37.856 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.851+0000 7ffb1035f640 1 -- 172.21.15.88:0/1171951475 >> 172.21.15.88:0/1171951475 conn(0x7ffb080c5d70 msgr2=0x7ffb08070570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:40:37.856 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.851+0000 7ffb1035f640 1 -- 172.21.15.88:0/1171951475 shutdown_connections 2024-04-26T23:40:37.856 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.851+0000 7ffb1035f640 1 -- 172.21.15.88:0/1171951475 wait complete. 2024-04-26T23:40:37.865 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get a_data pg_num 2024-04-26T23:40:37.965 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.961+0000 7f8a6ccda640 1 Processor -- start 2024-04-26T23:40:37.965 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.961+0000 7f8a6ccda640 1 -- start start 2024-04-26T23:40:37.967 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.962+0000 7f8a6ccda640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8a680c3c70 0x7f8a680c5430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:37.967 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.962+0000 7f8a6ccda640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f8a68157010 0x7f8a681574a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:37.967 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.962+0000 7f8a6ccda640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8a6815a230 con 0x7f8a6813fe20 2024-04-26T23:40:37.967 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.962+0000 7f8a6ccda640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f8a680c39b0 con 0x7f8a68157010 2024-04-26T23:40:37.967 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.962+0000 7f8a6ccda640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f8a6815b120 con 0x7f8a680c3c70 2024-04-26T23:40:37.968 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.962+0000 7f8a66d9d640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f8a68157010 0x7f8a681574a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:37.968 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.962+0000 7f8a66d9d640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f8a68157010 0x7f8a681574a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:57452/0 (socket says 172.21.15.88:57452) 2024-04-26T23:40:37.968 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.962+0000 7f8a66d9d640 1 -- 172.21.15.88:0/242766792 learned_addr learned my addr 172.21.15.88:0/242766792 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:40:37.968 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.962+0000 7f8a65d9b640 1 --2- 172.21.15.88:0/242766792 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8a680c3c70 0x7f8a680c5430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:37.968 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.963+0000 7f8a66d9d640 1 -- 172.21.15.88:0/242766792 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8a680c3c70 msgr2=0x7f8a680c5430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:40:37.968 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.963+0000 7f8a66d9d640 1 --2- 172.21.15.88:0/242766792 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8a680c3c70 0x7f8a680c5430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:37.968 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.963+0000 7f8a66d9d640 1 -- 172.21.15.88:0/242766792 >> v1:172.21.15.175:6789/0 conn(0x7f8a6813fe20 legacy=0x7f8a6806d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:40:37.968 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.963+0000 7f8a66d9d640 1 -- 172.21.15.88:0/242766792 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a6815a510 con 0x7f8a68157010 2024-04-26T23:40:37.968 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.963+0000 7f8a66d9d640 1 --2- 172.21.15.88:0/242766792 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8a68157010 0x7f8a681574a0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f8a60009870 tx=0x7f8a6002a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdeef629af0d7628 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:37.968 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.963+0000 7f8a6559a640 1 -- 172.21.15.88:0/242766792 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a60037070 con 0x7f8a68157010 2024-04-26T23:40:37.968 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.963+0000 7f8a6559a640 1 -- 172.21.15.88:0/242766792 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a60032440 con 0x7f8a68157010 2024-04-26T23:40:37.968 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.963+0000 7f8a6559a640 1 -- 172.21.15.88:0/242766792 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a60032810 con 0x7f8a68157010 2024-04-26T23:40:37.972 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.964+0000 7f8a6ccda640 1 -- 172.21.15.88:0/242766792 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8a68157010 msgr2=0x7f8a681574a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:37.972 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.964+0000 7f8a6ccda640 1 --2- 172.21.15.88:0/242766792 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8a68157010 0x7f8a681574a0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f8a60009870 tx=0x7f8a6002a210 comp rx=0 tx=0).stop 2024-04-26T23:40:37.972 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.964+0000 7f8a6ccda640 1 -- 172.21.15.88:0/242766792 shutdown_connections 2024-04-26T23:40:37.972 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.964+0000 7f8a6ccda640 1 --2- 172.21.15.88:0/242766792 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8a68157010 0x7f8a681574a0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:37.972 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.964+0000 7f8a6ccda640 1 --2- 172.21.15.88:0/242766792 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8a680c3c70 0x7f8a680c5430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:37.973 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.964+0000 7f8a6ccda640 1 -- 172.21.15.88:0/242766792 >> 172.21.15.88:0/242766792 conn(0x7f8a680c5d70 msgr2=0x7f8a680c6180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:40:37.973 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.964+0000 7f8a6ccda640 1 -- 172.21.15.88:0/242766792 shutdown_connections 2024-04-26T23:40:37.973 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.964+0000 7f8a6ccda640 1 -- 172.21.15.88:0/242766792 wait complete. 2024-04-26T23:40:37.973 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.965+0000 7f8a6ccda640 1 Processor -- start 2024-04-26T23:40:37.973 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.965+0000 7f8a6ccda640 1 -- start start 2024-04-26T23:40:37.973 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.966+0000 7f8a6ccda640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8a680c3c70 0x7f8a68072900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:37.973 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.966+0000 7f8a6ccda640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8a6813fe20 0x7f8a681efa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:37.973 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.966+0000 7f8a6ccda640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8a68157010 0x7f8a681effc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:37.973 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.966+0000 7f8a6ccda640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f8a6815adb0 con 0x7f8a680c3c70 2024-04-26T23:40:37.973 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.966+0000 7f8a6ccda640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f8a6815aad0 con 0x7f8a68157010 2024-04-26T23:40:37.973 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.966+0000 7f8a6ccda640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f8a68140200 con 0x7f8a6813fe20 2024-04-26T23:40:37.973 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.966+0000 7f8a6659c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8a680c3c70 0x7f8a68072900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:37.973 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.966+0000 7f8a6659c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8a680c3c70 0x7f8a68072900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:57466/0 (socket says 172.21.15.88:57466) 2024-04-26T23:40:37.973 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.966+0000 7f8a6659c640 1 -- 172.21.15.88:0/1092940562 learned_addr learned my addr 172.21.15.88:0/1092940562 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:40:37.974 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.966+0000 7f8a65d9b640 1 --2- 172.21.15.88:0/1092940562 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8a6813fe20 0x7f8a681efa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:37.974 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.966+0000 7f8a66d9d640 1 --2- 172.21.15.88:0/1092940562 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8a68157010 0x7f8a681effc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:37.974 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.966+0000 7f8a6659c640 1 -- 172.21.15.88:0/1092940562 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8a6813fe20 msgr2=0x7f8a681efa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:37.974 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.966+0000 7f8a6659c640 1 --2- 172.21.15.88:0/1092940562 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8a6813fe20 0x7f8a681efa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:37.974 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.966+0000 7f8a6659c640 1 -- 172.21.15.88:0/1092940562 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8a68157010 msgr2=0x7f8a681effc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:37.974 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.966+0000 7f8a6659c640 1 --2- 172.21.15.88:0/1092940562 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8a68157010 0x7f8a681effc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:37.974 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.966+0000 7f8a6659c640 1 -- 172.21.15.88:0/1092940562 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a68074c10 con 0x7f8a680c3c70 2024-04-26T23:40:37.974 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.966+0000 7f8a65d9b640 1 --2- 172.21.15.88:0/1092940562 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8a6813fe20 0x7f8a681efa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:40:37.974 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.966+0000 7f8a66d9d640 1 --2- 172.21.15.88:0/1092940562 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8a68157010 0x7f8a681effc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:40:37.974 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.966+0000 7f8a6659c640 1 --2- 172.21.15.88:0/1092940562 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8a680c3c70 0x7f8a68072900 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f8a5800c7c0 tx=0x7f8a5800cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:37.974 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.967+0000 7f8a56ffd640 1 -- 172.21.15.88:0/1092940562 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a58016020 con 0x7f8a680c3c70 2024-04-26T23:40:37.974 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.967+0000 7f8a56ffd640 1 -- 172.21.15.88:0/1092940562 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a5800aa50 con 0x7f8a680c3c70 2024-04-26T23:40:37.974 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.967+0000 7f8a6ccda640 1 -- 172.21.15.88:0/1092940562 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a68074450 con 0x7f8a680c3c70 2024-04-26T23:40:37.974 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.967+0000 7f8a56ffd640 1 -- 172.21.15.88:0/1092940562 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a58012420 con 0x7f8a680c3c70 2024-04-26T23:40:37.975 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.967+0000 7f8a6ccda640 1 -- 172.21.15.88:0/1092940562 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a6813a8c0 con 0x7f8a680c3c70 2024-04-26T23:40:37.975 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.968+0000 7f8a6ccda640 1 -- 172.21.15.88:0/1092940562 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a680507a0 con 0x7f8a680c3c70 2024-04-26T23:40:37.975 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.968+0000 7f8a56ffd640 1 -- 172.21.15.88:0/1092940562 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8a58019020 con 0x7f8a680c3c70 2024-04-26T23:40:37.975 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.968+0000 7f8a56ffd640 1 --2- 172.21.15.88:0/1092940562 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f8a4806c8f0 0x7f8a4806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:37.975 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.968+0000 7f8a56ffd640 1 -- 172.21.15.88:0/1092940562 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5689+0+0 (secure 0 0 0) 0x7f8a5808b820 con 0x7f8a680c3c70 2024-04-26T23:40:37.975 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.968+0000 7f8a65d9b640 1 --2- 172.21.15.88:0/1092940562 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f8a4806c8f0 0x7f8a4806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:37.975 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.969+0000 7f8a65d9b640 1 --2- 172.21.15.88:0/1092940562 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f8a4806c8f0 0x7f8a4806edb0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f8a68070c00 tx=0x7f8a5c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:37.976 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:37.973+0000 7f8a56ffd640 1 -- 172.21.15.88:0/1092940562 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f8a58020070 con 0x7f8a680c3c70 2024-04-26T23:40:38.151 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:38.147+0000 7f8a6ccda640 1 -- 172.21.15.88:0/1092940562 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "a_data", "var": "pg_num"} v 0) -- 0x7f8a680c2bf0 con 0x7f8a680c3c70 2024-04-26T23:40:38.151 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:38.148+0000 7f8a56ffd640 1 -- 172.21.15.88:0/1092940562 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "a_data", "var": "pg_num"}]=0 v20) ==== 95+0+11 (secure 0 0 0) 0x7f8a58059cf0 con 0x7f8a680c3c70 2024-04-26T23:40:38.152 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 64 2024-04-26T23:40:38.153 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:38.149+0000 7f8a6ccda640 1 -- 172.21.15.88:0/1092940562 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f8a4806c8f0 msgr2=0x7f8a4806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:38.154 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:38.149+0000 7f8a6ccda640 1 --2- 172.21.15.88:0/1092940562 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f8a4806c8f0 0x7f8a4806edb0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f8a68070c00 tx=0x7f8a5c008040 comp rx=0 tx=0).stop 2024-04-26T23:40:38.154 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:38.149+0000 7f8a6ccda640 1 -- 172.21.15.88:0/1092940562 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8a680c3c70 msgr2=0x7f8a68072900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:38.154 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:38.149+0000 7f8a6ccda640 1 --2- 172.21.15.88:0/1092940562 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8a680c3c70 0x7f8a68072900 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f8a5800c7c0 tx=0x7f8a5800cc80 comp rx=0 tx=0).stop 2024-04-26T23:40:38.154 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:38.149+0000 7f8a6ccda640 1 -- 172.21.15.88:0/1092940562 shutdown_connections 2024-04-26T23:40:38.154 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:38.149+0000 7f8a6ccda640 1 --2- 172.21.15.88:0/1092940562 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f8a4806c8f0 0x7f8a4806edb0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:38.154 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:38.149+0000 7f8a6ccda640 1 --2- 172.21.15.88:0/1092940562 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8a6813fe20 0x7f8a681efa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:38.154 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:38.149+0000 7f8a6ccda640 1 --2- 172.21.15.88:0/1092940562 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8a68157010 0x7f8a681effc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:38.154 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:38.149+0000 7f8a6ccda640 1 --2- 172.21.15.88:0/1092940562 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8a680c3c70 0x7f8a68072900 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:38.154 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:38.149+0000 7f8a6ccda640 1 -- 172.21.15.88:0/1092940562 >> 172.21.15.88:0/1092940562 conn(0x7f8a680c5d70 msgr2=0x7f8a680c2e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:40:38.154 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:38.149+0000 7f8a6ccda640 1 -- 172.21.15.88:0/1092940562 shutdown_connections 2024-04-26T23:40:38.154 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:38.150+0000 7f8a6ccda640 1 -- 172.21.15.88:0/1092940562 wait complete. 2024-04-26T23:40:38.164 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-26T23:40:38.261 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:38.257+0000 7f23f5ebd640 1 Processor -- start 2024-04-26T23:40:38.261 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:38.257+0000 7f23f5ebd640 1 -- start start 2024-04-26T23:40:38.263 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:38.258+0000 7f23f5ebd640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f23f0157860 0x7f23f00c3ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:38.263 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:38.258+0000 7f23f5ebd640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f23f00c4220 0x7f23f00c6960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:38.263 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:38.258+0000 7f23f5ebd640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f23f00c84c0 con 0x7f23f00adbf0 2024-04-26T23:40:38.263 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:38.258+0000 7f23f5ebd640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f23f00c87a0 con 0x7f23f0157860 2024-04-26T23:40:38.263 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:38.258+0000 7f23f5ebd640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f23f00c31b0 con 0x7f23f00c4220 2024-04-26T23:40:38.263 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:38.258+0000 7f23eeffd640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f23f0157860 0x7f23f00c3ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:38.263 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:38.258+0000 7f23ef7fe640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f23f00adbf0 0x7f23f00c2aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:39830/0 (socket says 172.21.15.88:39830) 2024-04-26T23:40:38.264 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:38.258+0000 7f23ef7fe640 1 -- 172.21.15.88:0/211678119 learned_addr learned my addr 172.21.15.88:0/211678119 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-26T23:40:38.264 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:38.258+0000 7f23effff640 1 --2- 172.21.15.88:0/211678119 >> v2:172.21.15.175:3300/0 conn(0x7f23f00c4220 0x7f23f00c6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:38.264 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:38.258+0000 7f23eeffd640 1 -- 172.21.15.88:0/211678119 >> v2:172.21.15.175:3300/0 conn(0x7f23f00c4220 msgr2=0x7f23f00c6960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:40:38.264 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:38.259+0000 7f23eeffd640 1 --2- 172.21.15.88:0/211678119 >> v2:172.21.15.175:3300/0 conn(0x7f23f00c4220 0x7f23f00c6960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:38.264 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:38.259+0000 7f23eeffd640 1 -- 172.21.15.88:0/211678119 >> v1:172.21.15.88:6789/0 conn(0x7f23f00adbf0 legacy=0x7f23f00c2aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:38.264 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:38.259+0000 7f23eeffd640 1 -- 172.21.15.88:0/211678119 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23f00c1fc0 con 0x7f23f0157860 2024-04-26T23:40:38.264 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:38.259+0000 7f23ee7fc640 1 -- 172.21.15.88:0/211678119 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3175945755 0 0) 0x7f23f00c84c0 con 0x7f23f00adbf0 2024-04-26T23:40:38.264 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:38.259+0000 7f23effff640 1 --2- 172.21.15.88:0/211678119 >> v2:172.21.15.175:3300/0 conn(0x7f23f00c4220 0x7f23f00c6960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:40:38.264 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:38.259+0000 7f23eeffd640 1 --2- 172.21.15.88:0/211678119 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f23f0157860 0x7f23f00c3ce0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f23f00705b0 tx=0x7f23e402a080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df360a64acf425a5 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:38.264 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:38.259+0000 7f23ee7fc640 1 -- 172.21.15.88:0/211678119 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23e4037070 con 0x7f23f0157860 2024-04-26T23:40:38.264 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:38.259+0000 7f23ee7fc640 1 -- 172.21.15.88:0/211678119 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23e402add0 con 0x7f23f0157860 2024-04-26T23:40:38.264 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:38.259+0000 7f23ee7fc640 1 -- 172.21.15.88:0/211678119 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23e4032660 con 0x7f23f0157860 2024-04-26T23:40:38.267 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:38.260+0000 7f23f5ebd640 1 -- 172.21.15.88:0/211678119 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f23f0157860 msgr2=0x7f23f00c3ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:38.268 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:38.260+0000 7f23f5ebd640 1 --2- 172.21.15.88:0/211678119 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f23f0157860 0x7f23f00c3ce0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f23f00705b0 tx=0x7f23e402a080 comp rx=0 tx=0).stop 2024-04-26T23:40:38.268 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:38.260+0000 7f23f5ebd640 1 -- 172.21.15.88:0/211678119 shutdown_connections 2024-04-26T23:40:38.268 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:38.260+0000 7f23f5ebd640 1 --2- 172.21.15.88:0/211678119 >> v2:172.21.15.175:3300/0 conn(0x7f23f00c4220 0x7f23f00c6960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:38.268 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:38.260+0000 7f23f5ebd640 1 --2- 172.21.15.88:0/211678119 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f23f0157860 0x7f23f00c3ce0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:38.268 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:38.260+0000 7f23f5ebd640 1 -- 172.21.15.88:0/211678119 >> 172.21.15.88:0/211678119 conn(0x7f23f00aa810 msgr2=0x7f23f00aac20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:40:38.268 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:38.260+0000 7f23f5ebd640 1 -- 172.21.15.88:0/211678119 shutdown_connections 2024-04-26T23:40:38.268 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:38.260+0000 7f23f5ebd640 1 -- 172.21.15.88:0/211678119 wait complete. 2024-04-26T23:40:38.268 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:38.261+0000 7f23f5ebd640 1 Processor -- start 2024-04-26T23:40:38.268 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:38.261+0000 7f23f5ebd640 1 -- start start 2024-04-26T23:40:38.268 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:38.262+0000 7f23f5ebd640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f23f00adbf0 0x7f23f01efcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:38.268 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:38.262+0000 7f23f5ebd640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f23f00c4220 0x7f23f0072d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:38.268 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:38.262+0000 7f23f5ebd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f23f0157860 0x7f23f00732b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:38.268 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:38.262+0000 7f23f5ebd640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f23f00c2580 con 0x7f23f0157860 2024-04-26T23:40:38.269 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:38.262+0000 7f23f5ebd640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f23f00adfd0 con 0x7f23f00c4220 2024-04-26T23:40:38.269 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:38.262+0000 7f23f5ebd640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f23f0070700 con 0x7f23f00adbf0 2024-04-26T23:40:38.269 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:38.262+0000 7f23effff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f23f0157860 0x7f23f00732b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:38.269 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:38.262+0000 7f23effff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f23f0157860 0x7f23f00732b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:57490/0 (socket says 172.21.15.88:57490) 2024-04-26T23:40:38.269 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:38.262+0000 7f23effff640 1 -- 172.21.15.88:0/1091320450 learned_addr learned my addr 172.21.15.88:0/1091320450 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:40:38.269 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:38.262+0000 7f23eeffd640 1 --2- 172.21.15.88:0/1091320450 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f23f00c4220 0x7f23f0072d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:38.269 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:38.262+0000 7f23ef7fe640 1 --2- 172.21.15.88:0/1091320450 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f23f00adbf0 0x7f23f01efcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:38.269 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:38.262+0000 7f23effff640 1 -- 172.21.15.88:0/1091320450 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f23f00adbf0 msgr2=0x7f23f01efcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:38.269 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:38.262+0000 7f23effff640 1 --2- 172.21.15.88:0/1091320450 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f23f00adbf0 0x7f23f01efcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:38.269 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:38.262+0000 7f23effff640 1 -- 172.21.15.88:0/1091320450 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f23f00c4220 msgr2=0x7f23f0072d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:38.269 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:38.262+0000 7f23effff640 1 --2- 172.21.15.88:0/1091320450 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f23f00c4220 0x7f23f0072d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:38.269 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:38.262+0000 7f23effff640 1 -- 172.21.15.88:0/1091320450 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23f0074030 con 0x7f23f0157860 2024-04-26T23:40:38.269 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:38.262+0000 7f23effff640 1 --2- 172.21.15.88:0/1091320450 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f23f0157860 0x7f23f00732b0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f23e800cd80 tx=0x7f23e800a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:38.269 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:38.262+0000 7f23d7fff640 1 -- 172.21.15.88:0/1091320450 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23e800f680 con 0x7f23f0157860 2024-04-26T23:40:38.270 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:38.262+0000 7f23d7fff640 1 -- 172.21.15.88:0/1091320450 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23e800f840 con 0x7f23f0157860 2024-04-26T23:40:38.270 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:38.262+0000 7f23f5ebd640 1 -- 172.21.15.88:0/1091320450 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23f0074310 con 0x7f23f0157860 2024-04-26T23:40:38.270 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:38.262+0000 7f23d7fff640 1 -- 172.21.15.88:0/1091320450 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23e800fc30 con 0x7f23f0157860 2024-04-26T23:40:38.270 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:38.262+0000 7f23f5ebd640 1 -- 172.21.15.88:0/1091320450 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23f01ea000 con 0x7f23f0157860 2024-04-26T23:40:38.270 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:38.263+0000 7f23f5ebd640 1 -- 172.21.15.88:0/1091320450 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f23f00765e0 con 0x7f23f0157860 2024-04-26T23:40:38.270 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:38.264+0000 7f23d7fff640 1 -- 172.21.15.88:0/1091320450 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f23e80213f0 con 0x7f23f0157860 2024-04-26T23:40:38.271 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:38.264+0000 7f23d7fff640 1 --2- 172.21.15.88:0/1091320450 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f23dc06c8f0 0x7f23dc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:38.271 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:38.264+0000 7f23d7fff640 1 -- 172.21.15.88:0/1091320450 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5689+0+0 (secure 0 0 0) 0x7f23e808c910 con 0x7f23f0157860 2024-04-26T23:40:38.271 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:38.264+0000 7f23ef7fe640 1 --2- 172.21.15.88:0/1091320450 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f23dc06c8f0 0x7f23dc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:38.271 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:38.265+0000 7f23ef7fe640 1 --2- 172.21.15.88:0/1091320450 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f23dc06c8f0 0x7f23dc06edb0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f23e0000f60 tx=0x7f23e0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:38.272 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:38.268+0000 7f23d7fff640 1 -- 172.21.15.88:0/1091320450 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f23e8014030 con 0x7f23f0157860 2024-04-26T23:40:38.450 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:38.446+0000 7f23f5ebd640 1 -- 172.21.15.88:0/1091320450 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f23f00507a0 con 0x7f23f0157860 2024-04-26T23:40:38.450 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:38.446+0000 7f23d7fff640 1 -- 172.21.15.88:0/1091320450 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v20) ==== 84+0+197 (secure 0 0 0) 0x7f23e805ad50 con 0x7f23f0157860 2024-04-26T23:40:38.450 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-26T23:40:38.450 INFO:teuthology.orchestra.run.smithi088.stdout:[ 2024-04-26T23:40:38.450 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:40:38.450 INFO:teuthology.orchestra.run.smithi088.stdout: "poolnum": 1, 2024-04-26T23:40:38.450 INFO:teuthology.orchestra.run.smithi088.stdout: "poolname": ".mgr" 2024-04-26T23:40:38.450 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:40:38.450 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:40:38.451 INFO:teuthology.orchestra.run.smithi088.stdout: "poolnum": 2, 2024-04-26T23:40:38.451 INFO:teuthology.orchestra.run.smithi088.stdout: "poolname": "a_metadata" 2024-04-26T23:40:38.451 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:40:38.451 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:40:38.451 INFO:teuthology.orchestra.run.smithi088.stdout: "poolnum": 3, 2024-04-26T23:40:38.451 INFO:teuthology.orchestra.run.smithi088.stdout: "poolname": "a_data" 2024-04-26T23:40:38.451 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:40:38.451 INFO:teuthology.orchestra.run.smithi088.stdout:] 2024-04-26T23:40:38.452 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:38.448+0000 7f23f5ebd640 1 -- 172.21.15.88:0/1091320450 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f23dc06c8f0 msgr2=0x7f23dc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:38.452 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:38.448+0000 7f23f5ebd640 1 --2- 172.21.15.88:0/1091320450 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f23dc06c8f0 0x7f23dc06edb0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f23e0000f60 tx=0x7f23e0009040 comp rx=0 tx=0).stop 2024-04-26T23:40:38.452 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:38.448+0000 7f23f5ebd640 1 -- 172.21.15.88:0/1091320450 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f23f0157860 msgr2=0x7f23f00732b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:38.452 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:38.448+0000 7f23f5ebd640 1 --2- 172.21.15.88:0/1091320450 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f23f0157860 0x7f23f00732b0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f23e800cd80 tx=0x7f23e800a650 comp rx=0 tx=0).stop 2024-04-26T23:40:38.452 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:38.448+0000 7f23f5ebd640 1 -- 172.21.15.88:0/1091320450 shutdown_connections 2024-04-26T23:40:38.452 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:38.448+0000 7f23f5ebd640 1 --2- 172.21.15.88:0/1091320450 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f23dc06c8f0 0x7f23dc06edb0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:38.453 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:38.448+0000 7f23f5ebd640 1 --2- 172.21.15.88:0/1091320450 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f23f0157860 0x7f23f00732b0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:38.453 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:38.448+0000 7f23f5ebd640 1 --2- 172.21.15.88:0/1091320450 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f23f00c4220 0x7f23f0072d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:38.453 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:38.448+0000 7f23f5ebd640 1 --2- 172.21.15.88:0/1091320450 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f23f00adbf0 0x7f23f01efcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:38.453 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:38.448+0000 7f23f5ebd640 1 -- 172.21.15.88:0/1091320450 >> 172.21.15.88:0/1091320450 conn(0x7f23f00aa810 msgr2=0x7f23f00c2aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:40:38.453 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:38.448+0000 7f23f5ebd640 1 -- 172.21.15.88:0/1091320450 shutdown_connections 2024-04-26T23:40:38.453 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:38.448+0000 7f23f5ebd640 1 -- 172.21.15.88:0/1091320450 wait complete. 2024-04-26T23:40:38.462 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'b' 2024-04-26T23:40:38.462 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create b_metadata --pg_num_min 64 2024-04-26T23:40:38.563 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:38.559+0000 7f55dd272640 1 Processor -- start 2024-04-26T23:40:38.563 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:38.559+0000 7f55dd272640 1 -- start start 2024-04-26T23:40:38.567 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:38.560+0000 7f55dd272640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f55d8150e30 0x7f55d80c8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:38.567 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:38.560+0000 7f55dd272640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f55d80ca400 0x7f55d80c8ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:38.567 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:38.560+0000 7f55dd272640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f55d80c9780 con 0x7f55d8073730 2024-04-26T23:40:38.567 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:38.560+0000 7f55dd272640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f55d81577b0 con 0x7f55d80ca400 2024-04-26T23:40:38.567 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:38.560+0000 7f55dd272640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f55d80c6f20 con 0x7f55d8150e30 2024-04-26T23:40:38.567 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:38.560+0000 7f55d77fe640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f55d8073730 0x7f55d815a460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:39434/0 (socket says 172.21.15.88:39434) 2024-04-26T23:40:38.567 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:38.560+0000 7f55d77fe640 1 -- 172.21.15.88:0/1360838613 learned_addr learned my addr 172.21.15.88:0/1360838613 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-26T23:40:38.567 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:38.560+0000 7f55d67fc640 1 -- 172.21.15.88:0/1360838613 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3617671336 0 0) 0x7f55d80c9780 con 0x7f55d8073730 2024-04-26T23:40:38.567 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:38.560+0000 7f55d67fc640 1 -- 172.21.15.88:0/1360838613 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f55c4003520 con 0x7f55d8073730 2024-04-26T23:40:38.567 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:38.560+0000 7f55cffff640 1 --2- 172.21.15.88:0/1360838613 >> v2:172.21.15.175:3300/0 conn(0x7f55d80ca400 0x7f55d80c8ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:38.568 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:38.560+0000 7f55d6ffd640 1 --2- 172.21.15.88:0/1360838613 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f55d8150e30 0x7f55d80c8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:38.568 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:38.561+0000 7f55d67fc640 1 -- 172.21.15.88:0/1360838613 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3617513332 0 0) 0x7f55c4003520 con 0x7f55d8073730 2024-04-26T23:40:38.568 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:38.561+0000 7f55d67fc640 1 -- 172.21.15.88:0/1360838613 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f55d8150e30 msgr2=0x7f55d80c8ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:40:38.568 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:38.561+0000 7f55d67fc640 1 --2- 172.21.15.88:0/1360838613 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f55d8150e30 0x7f55d80c8ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:38.568 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:38.561+0000 7f55d67fc640 1 -- 172.21.15.88:0/1360838613 >> v2:172.21.15.175:3300/0 conn(0x7f55d80ca400 msgr2=0x7f55d80c8ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:40:38.568 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:38.561+0000 7f55d67fc640 1 --2- 172.21.15.88:0/1360838613 >> v2:172.21.15.175:3300/0 conn(0x7f55d80ca400 0x7f55d80c8ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:38.568 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:38.561+0000 7f55d67fc640 1 -- 172.21.15.88:0/1360838613 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55d80c7200 con 0x7f55d8073730 2024-04-26T23:40:38.568 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:38.561+0000 7f55d67fc640 1 -- 172.21.15.88:0/1360838613 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 356324787 0 0) 0x7f55d00019f0 con 0x7f55d8073730 2024-04-26T23:40:38.568 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:38.561+0000 7f55d67fc640 1 -- 172.21.15.88:0/1360838613 >> v1:172.21.15.88:6789/0 conn(0x7f55d8073730 legacy=0x7f55d815a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:38.568 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:38.561+0000 7f55d67fc640 1 --2- 172.21.15.88:0/1360838613 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f55c40039b0 0x7f55c4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:38.568 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:38.561+0000 7f55d67fc640 1 --2- 172.21.15.88:0/1360838613 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f55d8150e30 0x7f55c4004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:38.568 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:38.561+0000 7f55d67fc640 1 --2- 172.21.15.88:0/1360838613 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f55c4004d40 0x7f55c40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:38.568 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:38.561+0000 7f55d67fc640 1 -- 172.21.15.88:0/1360838613 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f55d81577b0 con 0x7f55c4004d40 2024-04-26T23:40:38.569 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:38.561+0000 7f55d67fc640 1 -- 172.21.15.88:0/1360838613 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f55d80c6f20 con 0x7f55c40039b0 2024-04-26T23:40:38.569 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:38.561+0000 7f55d67fc640 1 -- 172.21.15.88:0/1360838613 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f55c400bb20 con 0x7f55d8150e30 2024-04-26T23:40:38.569 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:38.561+0000 7f55d77fe640 1 --2- 172.21.15.88:0/1360838613 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f55c4004d40 0x7f55c40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:38.569 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:38.561+0000 7f55d6ffd640 1 --2- 172.21.15.88:0/1360838613 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f55c40039b0 0x7f55c4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:38.569 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:38.561+0000 7f55cffff640 1 --2- 172.21.15.88:0/1360838613 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f55d8150e30 0x7f55c4004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:38.569 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:38.561+0000 7f55d77fe640 1 -- 172.21.15.88:0/1360838613 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f55d8150e30 msgr2=0x7f55c4004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:40:38.569 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:38.561+0000 7f55d77fe640 1 --2- 172.21.15.88:0/1360838613 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f55d8150e30 0x7f55c4004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:38.569 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:38.561+0000 7f55d77fe640 1 -- 172.21.15.88:0/1360838613 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f55c40039b0 msgr2=0x7f55c4003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:40:38.569 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:38.561+0000 7f55d77fe640 1 --2- 172.21.15.88:0/1360838613 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f55c40039b0 0x7f55c4003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:38.569 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:38.561+0000 7f55d77fe640 1 -- 172.21.15.88:0/1360838613 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55c4003520 con 0x7f55c4004d40 2024-04-26T23:40:38.569 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:38.562+0000 7f55d77fe640 1 --2- 172.21.15.88:0/1360838613 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f55c4004d40 0x7f55c40051c0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f55d00013d0 tx=0x7f55c4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50d1f909cf237464 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:38.569 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:38.562+0000 7f55d67fc640 1 -- 172.21.15.88:0/1360838613 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55d000a4e0 con 0x7f55c4004d40 2024-04-26T23:40:38.569 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:38.562+0000 7f55d67fc640 1 -- 172.21.15.88:0/1360838613 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55d002f070 con 0x7f55c4004d40 2024-04-26T23:40:38.569 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:38.562+0000 7f55d67fc640 1 -- 172.21.15.88:0/1360838613 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55d002bcb0 con 0x7f55c4004d40 2024-04-26T23:40:38.570 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:38.562+0000 7f55dd272640 1 -- 172.21.15.88:0/1360838613 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f55c4004d40 msgr2=0x7f55c40051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:38.570 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:38.562+0000 7f55dd272640 1 --2- 172.21.15.88:0/1360838613 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f55c4004d40 0x7f55c40051c0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f55d00013d0 tx=0x7f55c4005830 comp rx=0 tx=0).stop 2024-04-26T23:40:38.570 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:38.562+0000 7f55d77fe640 1 -- 172.21.15.88:0/1360838613 reap_dead start 2024-04-26T23:40:38.570 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:38.562+0000 7f55dd272640 1 -- 172.21.15.88:0/1360838613 shutdown_connections 2024-04-26T23:40:38.570 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:38.562+0000 7f55dd272640 1 -- 172.21.15.88:0/1360838613 >> 172.21.15.88:0/1360838613 conn(0x7f55d806c310 msgr2=0x7f55d806c720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:40:38.570 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:38.563+0000 7f55dd272640 1 -- 172.21.15.88:0/1360838613 shutdown_connections 2024-04-26T23:40:38.570 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:38.563+0000 7f55dd272640 1 -- 172.21.15.88:0/1360838613 wait complete. 2024-04-26T23:40:38.573 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:38.564+0000 7f55dd272640 1 Processor -- start 2024-04-26T23:40:38.573 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:38.564+0000 7f55dd272640 1 -- start start 2024-04-26T23:40:38.573 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:38.564+0000 7f55dd272640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f55c4004d40 0x7f55d80cadb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:38.574 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:38.564+0000 7f55dd272640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f55d80aecd0 0x7f55d814f980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:38.574 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:38.564+0000 7f55dd272640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f55d80cb2f0 0x7f55d814fec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:38.574 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:38.564+0000 7f55dd272640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f55d80c8ab0 con 0x7f55c4004d40 2024-04-26T23:40:38.574 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:38.564+0000 7f55dd272640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f55d8157a90 con 0x7f55d80aecd0 2024-04-26T23:40:38.574 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:38.564+0000 7f55dd272640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f55d80c8c30 con 0x7f55d80cb2f0 2024-04-26T23:40:38.574 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:38.564+0000 7f55d6ffd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f55c4004d40 0x7f55d80cadb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:38.574 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:38.564+0000 7f55d6ffd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f55c4004d40 0x7f55d80cadb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:41726/0 (socket says 172.21.15.88:41726) 2024-04-26T23:40:38.574 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:38.564+0000 7f55d6ffd640 1 -- 172.21.15.88:0/2260940853 learned_addr learned my addr 172.21.15.88:0/2260940853 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:40:38.574 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:38.564+0000 7f55cffff640 1 --2- 172.21.15.88:0/2260940853 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f55d80aecd0 0x7f55d814f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:38.574 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:38.564+0000 7f55d77fe640 1 --2- 172.21.15.88:0/2260940853 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f55d80cb2f0 0x7f55d814fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:38.574 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:38.565+0000 7f55d6ffd640 1 -- 172.21.15.88:0/2260940853 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f55d80cb2f0 msgr2=0x7f55d814fec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:38.574 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:38.565+0000 7f55d6ffd640 1 --2- 172.21.15.88:0/2260940853 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f55d80cb2f0 0x7f55d814fec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:38.574 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:38.565+0000 7f55d6ffd640 1 -- 172.21.15.88:0/2260940853 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f55d80aecd0 msgr2=0x7f55d814f980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:38.575 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:38.565+0000 7f55d6ffd640 1 --2- 172.21.15.88:0/2260940853 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f55d80aecd0 0x7f55d814f980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:38.575 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:38.565+0000 7f55d6ffd640 1 -- 172.21.15.88:0/2260940853 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55d80c62a0 con 0x7f55c4004d40 2024-04-26T23:40:38.575 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:38.565+0000 7f55cffff640 1 --2- 172.21.15.88:0/2260940853 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f55d80aecd0 0x7f55d814f980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:40:38.575 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:38.565+0000 7f55d77fe640 1 --2- 172.21.15.88:0/2260940853 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f55d80cb2f0 0x7f55d814fec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:40:38.575 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:38.565+0000 7f55d6ffd640 1 --2- 172.21.15.88:0/2260940853 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f55c4004d40 0x7f55d80cadb0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f55c800b7c0 tx=0x7f55c800bc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:38.575 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:38.565+0000 7f55cf7fe640 1 -- 172.21.15.88:0/2260940853 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55c8018070 con 0x7f55c4004d40 2024-04-26T23:40:38.575 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:38.565+0000 7f55cf7fe640 1 -- 172.21.15.88:0/2260940853 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55c8010830 con 0x7f55c4004d40 2024-04-26T23:40:38.575 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:38.565+0000 7f55dd272640 1 -- 172.21.15.88:0/2260940853 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55d81ebfc0 con 0x7f55c4004d40 2024-04-26T23:40:38.575 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:38.565+0000 7f55cf7fe640 1 -- 172.21.15.88:0/2260940853 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55c8010c00 con 0x7f55c4004d40 2024-04-26T23:40:38.575 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:38.565+0000 7f55dd272640 1 -- 172.21.15.88:0/2260940853 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55d80b25a0 con 0x7f55c4004d40 2024-04-26T23:40:38.575 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:38.566+0000 7f55dd272640 1 -- 172.21.15.88:0/2260940853 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f55d80694b0 con 0x7f55c4004d40 2024-04-26T23:40:38.575 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:38.566+0000 7f55cf7fe640 1 -- 172.21.15.88:0/2260940853 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f55c801b070 con 0x7f55c4004d40 2024-04-26T23:40:38.575 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:38.567+0000 7f55cf7fe640 1 --2- 172.21.15.88:0/2260940853 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f55b806c8f0 0x7f55b806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:38.575 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:38.567+0000 7f55cffff640 1 --2- 172.21.15.88:0/2260940853 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f55b806c8f0 0x7f55b806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:38.576 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:38.567+0000 7f55cf7fe640 1 -- 172.21.15.88:0/2260940853 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5689+0+0 (secure 0 0 0) 0x7f55c808bf30 con 0x7f55c4004d40 2024-04-26T23:40:38.576 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:38.567+0000 7f55cffff640 1 --2- 172.21.15.88:0/2260940853 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f55b806c8f0 0x7f55b806edb0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f55d8158830 tx=0x7f55c0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:38.576 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:38.571+0000 7f55cf7fe640 1 -- 172.21.15.88:0/2260940853 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f55d81ebfc0 con 0x7f55c4004d40 2024-04-26T23:40:38.753 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:38.749+0000 7f55dd272640 1 -- 172.21.15.88:0/2260940853 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "b_metadata", "pg_num_min": 64} v 0) -- 0x7f55d8073510 con 0x7f55c4004d40 2024-04-26T23:40:39.654 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:39.650+0000 7f55cf7fe640 1 -- 172.21.15.88:0/2260940853 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "b_metadata", "pg_num_min": 64}]=0 pool 'b_metadata' created v21) ==== 128+0+0 (secure 0 0 0) 0x7f55c805a400 con 0x7f55c4004d40 2024-04-26T23:40:39.654 INFO:teuthology.orchestra.run.smithi088.stderr:pool 'b_metadata' created 2024-04-26T23:40:39.657 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:39.653+0000 7f55dd272640 1 -- 172.21.15.88:0/2260940853 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f55b806c8f0 msgr2=0x7f55b806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:39.657 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:39.653+0000 7f55dd272640 1 --2- 172.21.15.88:0/2260940853 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f55b806c8f0 0x7f55b806edb0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f55d8158830 tx=0x7f55c0008040 comp rx=0 tx=0).stop 2024-04-26T23:40:39.657 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:39.653+0000 7f55dd272640 1 -- 172.21.15.88:0/2260940853 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f55c4004d40 msgr2=0x7f55d80cadb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:39.657 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:39.653+0000 7f55dd272640 1 --2- 172.21.15.88:0/2260940853 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f55c4004d40 0x7f55d80cadb0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f55c800b7c0 tx=0x7f55c800bc80 comp rx=0 tx=0).stop 2024-04-26T23:40:39.658 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:39.654+0000 7f55dd272640 1 -- 172.21.15.88:0/2260940853 shutdown_connections 2024-04-26T23:40:39.658 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:39.654+0000 7f55dd272640 1 --2- 172.21.15.88:0/2260940853 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f55b806c8f0 0x7f55b806edb0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:39.658 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:39.654+0000 7f55dd272640 1 --2- 172.21.15.88:0/2260940853 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f55d80cb2f0 0x7f55d814fec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:39.658 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:39.654+0000 7f55dd272640 1 --2- 172.21.15.88:0/2260940853 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f55d80aecd0 0x7f55d814f980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:39.658 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:39.654+0000 7f55dd272640 1 --2- 172.21.15.88:0/2260940853 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f55c4004d40 0x7f55d80cadb0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:39.658 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:39.654+0000 7f55dd272640 1 -- 172.21.15.88:0/2260940853 >> 172.21.15.88:0/2260940853 conn(0x7f55d806c310 msgr2=0x7f55d806c720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:40:39.658 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:39.654+0000 7f55dd272640 1 -- 172.21.15.88:0/2260940853 shutdown_connections 2024-04-26T23:40:39.659 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:39.654+0000 7f55dd272640 1 -- 172.21.15.88:0/2260940853 wait complete. 2024-04-26T23:40:39.674 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create b_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-04-26T23:40:39.783 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:39.779+0000 7f7cebf9d640 1 Processor -- start 2024-04-26T23:40:39.783 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:39.779+0000 7f7cebf9d640 1 -- start start 2024-04-26T23:40:39.785 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:39.780+0000 7f7cebf9d640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f7ce41523e0 0x7f7ce41554c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:39.785 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:39.780+0000 7f7cebf9d640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f7ce406f920 0x7f7ce40abd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:39.785 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:39.780+0000 7f7cebf9d640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ce4070670 con 0x7f7ce4073aa0 2024-04-26T23:40:39.786 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:39.780+0000 7f7cebf9d640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f7ce40ab8f0 con 0x7f7ce41523e0 2024-04-26T23:40:39.786 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:39.780+0000 7f7cebf9d640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f7ce40700b0 con 0x7f7ce406f920 2024-04-26T23:40:39.786 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:39.780+0000 7f7ce9538640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f7ce41523e0 0x7f7ce41554c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:39.786 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:39.780+0000 7f7ce9538640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f7ce41523e0 0x7f7ce41554c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:41732/0 (socket says 172.21.15.88:41732) 2024-04-26T23:40:39.786 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:39.780+0000 7f7ce9538640 1 -- 172.21.15.88:0/2064618378 learned_addr learned my addr 172.21.15.88:0/2064618378 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:40:39.786 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:39.780+0000 7f7cea53a640 1 --2- 172.21.15.88:0/2064618378 >> v2:172.21.15.175:3300/0 conn(0x7f7ce406f920 0x7f7ce40abd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:39.786 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:39.780+0000 7f7ce9538640 1 -- 172.21.15.88:0/2064618378 >> v2:172.21.15.175:3300/0 conn(0x7f7ce406f920 msgr2=0x7f7ce40abd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:40:39.786 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:39.780+0000 7f7ce9538640 1 --2- 172.21.15.88:0/2064618378 >> v2:172.21.15.175:3300/0 conn(0x7f7ce406f920 0x7f7ce40abd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:39.786 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:39.780+0000 7f7ce9538640 1 -- 172.21.15.88:0/2064618378 >> v1:172.21.15.175:6789/0 conn(0x7f7ce4073aa0 legacy=0x7f7ce4151cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:40:39.786 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:39.780+0000 7f7ce9538640 1 -- 172.21.15.88:0/2064618378 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ce4070390 con 0x7f7ce41523e0 2024-04-26T23:40:39.786 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:39.780+0000 7f7cea53a640 1 --2- 172.21.15.88:0/2064618378 >> v2:172.21.15.175:3300/0 conn(0x7f7ce406f920 0x7f7ce40abd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:40:39.787 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:39.781+0000 7f7ce9538640 1 --2- 172.21.15.88:0/2064618378 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7ce41523e0 0x7f7ce41554c0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f7ce4076850 tx=0x7f7cd402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=686de3c1eb51cf71 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:39.787 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:39.781+0000 7f7ce8d37640 1 -- 172.21.15.88:0/2064618378 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cd4037070 con 0x7f7ce41523e0 2024-04-26T23:40:39.787 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:39.781+0000 7f7ce8d37640 1 -- 172.21.15.88:0/2064618378 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7cd4032440 con 0x7f7ce41523e0 2024-04-26T23:40:39.787 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:39.781+0000 7f7ce8d37640 1 -- 172.21.15.88:0/2064618378 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cd4032810 con 0x7f7ce41523e0 2024-04-26T23:40:39.787 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:39.781+0000 7f7cebf9d640 1 -- 172.21.15.88:0/2064618378 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7ce41523e0 msgr2=0x7f7ce41554c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:39.787 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:39.781+0000 7f7cebf9d640 1 --2- 172.21.15.88:0/2064618378 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7ce41523e0 0x7f7ce41554c0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f7ce4076850 tx=0x7f7cd402a230 comp rx=0 tx=0).stop 2024-04-26T23:40:39.787 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:39.781+0000 7f7cebf9d640 1 -- 172.21.15.88:0/2064618378 shutdown_connections 2024-04-26T23:40:39.787 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:39.781+0000 7f7cebf9d640 1 --2- 172.21.15.88:0/2064618378 >> v2:172.21.15.175:3300/0 conn(0x7f7ce406f920 0x7f7ce40abd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:39.787 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:39.781+0000 7f7cebf9d640 1 --2- 172.21.15.88:0/2064618378 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7ce41523e0 0x7f7ce41554c0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:39.787 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:39.781+0000 7f7cebf9d640 1 -- 172.21.15.88:0/2064618378 >> 172.21.15.88:0/2064618378 conn(0x7f7ce40c6ed0 msgr2=0x7f7ce40c72b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:40:39.787 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:39.782+0000 7f7cebf9d640 1 -- 172.21.15.88:0/2064618378 shutdown_connections 2024-04-26T23:40:39.787 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:39.782+0000 7f7cebf9d640 1 -- 172.21.15.88:0/2064618378 wait complete. 2024-04-26T23:40:39.790 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:39.783+0000 7f7cebf9d640 1 Processor -- start 2024-04-26T23:40:39.790 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:39.783+0000 7f7cebf9d640 1 -- start start 2024-04-26T23:40:39.791 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:39.783+0000 7f7cebf9d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7ce406f920 0x7f7ce40ae740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:39.791 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:39.783+0000 7f7cebf9d640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7ce4073aa0 0x7f7ce4146c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:39.791 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:39.783+0000 7f7cebf9d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7ce41523e0 0x7f7ce4147180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:39.791 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:39.783+0000 7f7cebf9d640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f7ce4073e80 con 0x7f7ce406f920 2024-04-26T23:40:39.791 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:39.783+0000 7f7cebf9d640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f7ce406fdb0 con 0x7f7ce41523e0 2024-04-26T23:40:39.791 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:39.783+0000 7f7cebf9d640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f7ce4074000 con 0x7f7ce4073aa0 2024-04-26T23:40:39.791 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:39.783+0000 7f7ce9d39640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7ce406f920 0x7f7ce40ae740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:39.791 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:39.783+0000 7f7ce9d39640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7ce406f920 0x7f7ce40ae740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:41744/0 (socket says 172.21.15.88:41744) 2024-04-26T23:40:39.791 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:39.783+0000 7f7ce9d39640 1 -- 172.21.15.88:0/3117418121 learned_addr learned my addr 172.21.15.88:0/3117418121 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:40:39.791 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:39.783+0000 7f7cea53a640 1 --2- 172.21.15.88:0/3117418121 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7ce41523e0 0x7f7ce4147180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:39.791 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:39.783+0000 7f7ce9538640 1 --2- 172.21.15.88:0/3117418121 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7ce4073aa0 0x7f7ce4146c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:39.791 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:39.784+0000 7f7ce9d39640 1 -- 172.21.15.88:0/3117418121 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7ce4073aa0 msgr2=0x7f7ce4146c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:39.791 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:39.784+0000 7f7ce9d39640 1 --2- 172.21.15.88:0/3117418121 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7ce4073aa0 0x7f7ce4146c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:39.791 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:39.784+0000 7f7ce9d39640 1 -- 172.21.15.88:0/3117418121 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7ce41523e0 msgr2=0x7f7ce4147180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:39.791 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:39.784+0000 7f7ce9d39640 1 --2- 172.21.15.88:0/3117418121 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7ce41523e0 0x7f7ce4147180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:39.792 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:39.784+0000 7f7ce9d39640 1 -- 172.21.15.88:0/3117418121 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ce414ee40 con 0x7f7ce406f920 2024-04-26T23:40:39.792 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:39.784+0000 7f7ce9d39640 1 --2- 172.21.15.88:0/3117418121 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7ce406f920 0x7f7ce40ae740 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f7ce000c460 tx=0x7f7ce000c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:39.792 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:39.784+0000 7f7cda7fc640 1 -- 172.21.15.88:0/3117418121 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ce0016020 con 0x7f7ce406f920 2024-04-26T23:40:39.792 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:39.784+0000 7f7cda7fc640 1 -- 172.21.15.88:0/3117418121 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ce0012870 con 0x7f7ce406f920 2024-04-26T23:40:39.792 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:39.784+0000 7f7cda7fc640 1 -- 172.21.15.88:0/3117418121 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ce0012c60 con 0x7f7ce406f920 2024-04-26T23:40:39.792 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:39.784+0000 7f7cebf9d640 1 -- 172.21.15.88:0/3117418121 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ce414f120 con 0x7f7ce406f920 2024-04-26T23:40:39.792 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:39.784+0000 7f7cebf9d640 1 -- 172.21.15.88:0/3117418121 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ce40bf6d0 con 0x7f7ce406f920 2024-04-26T23:40:39.792 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:39.785+0000 7f7cebf9d640 1 -- 172.21.15.88:0/3117418121 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ce40507a0 con 0x7f7ce406f920 2024-04-26T23:40:39.792 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:39.785+0000 7f7cda7fc640 1 -- 172.21.15.88:0/3117418121 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f7ce0019020 con 0x7f7ce406f920 2024-04-26T23:40:39.792 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:39.786+0000 7f7cda7fc640 1 --2- 172.21.15.88:0/3117418121 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f7cc806c8f0 0x7f7cc806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:39.792 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:39.786+0000 7f7ce9538640 1 --2- 172.21.15.88:0/3117418121 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f7cc806c8f0 0x7f7cc806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:39.792 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:39.786+0000 7f7cda7fc640 1 -- 172.21.15.88:0/3117418121 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 6054+0+0 (secure 0 0 0) 0x7f7ce008b890 con 0x7f7ce406f920 2024-04-26T23:40:39.792 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:39.786+0000 7f7ce9538640 1 --2- 172.21.15.88:0/3117418121 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f7cc806c8f0 0x7f7cc806edb0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f7cd4034000 tx=0x7f7cd402e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:39.794 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:39.791+0000 7f7cda7fc640 1 -- 172.21.15.88:0/3117418121 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f7ce0020030 con 0x7f7ce406f920 2024-04-26T23:40:39.974 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:39.970+0000 7f7cebf9d640 1 -- 172.21.15.88:0/3117418121 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "b_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f7ce4150990 con 0x7f7ce406f920 2024-04-26T23:40:40.660 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:40.655+0000 7f7cda7fc640 1 -- 172.21.15.88:0/3117418121 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "b_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'b_data' created v22) ==== 160+0+0 (secure 0 0 0) 0x7f7ce0059510 con 0x7f7ce406f920 2024-04-26T23:40:40.660 INFO:teuthology.orchestra.run.smithi088.stderr:pool 'b_data' created 2024-04-26T23:40:40.662 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:40.658+0000 7f7cebf9d640 1 -- 172.21.15.88:0/3117418121 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f7cc806c8f0 msgr2=0x7f7cc806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:40.662 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:40.658+0000 7f7cebf9d640 1 --2- 172.21.15.88:0/3117418121 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f7cc806c8f0 0x7f7cc806edb0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f7cd4034000 tx=0x7f7cd402e000 comp rx=0 tx=0).stop 2024-04-26T23:40:40.662 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:40.658+0000 7f7cebf9d640 1 -- 172.21.15.88:0/3117418121 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7ce406f920 msgr2=0x7f7ce40ae740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:40.662 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:40.658+0000 7f7cebf9d640 1 --2- 172.21.15.88:0/3117418121 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7ce406f920 0x7f7ce40ae740 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f7ce000c460 tx=0x7f7ce000c920 comp rx=0 tx=0).stop 2024-04-26T23:40:40.662 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:40.658+0000 7f7cebf9d640 1 -- 172.21.15.88:0/3117418121 shutdown_connections 2024-04-26T23:40:40.663 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:40.658+0000 7f7cebf9d640 1 --2- 172.21.15.88:0/3117418121 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f7cc806c8f0 0x7f7cc806edb0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:40.663 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:40.658+0000 7f7cebf9d640 1 --2- 172.21.15.88:0/3117418121 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7ce4073aa0 0x7f7ce4146c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:40.663 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:40.658+0000 7f7cebf9d640 1 --2- 172.21.15.88:0/3117418121 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7ce41523e0 0x7f7ce4147180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:40.663 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:40.658+0000 7f7cebf9d640 1 --2- 172.21.15.88:0/3117418121 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7ce406f920 0x7f7ce40ae740 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:40.663 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:40.658+0000 7f7cebf9d640 1 -- 172.21.15.88:0/3117418121 >> 172.21.15.88:0/3117418121 conn(0x7f7ce40c6ed0 msgr2=0x7f7ce414f6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:40:40.663 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:40.658+0000 7f7cebf9d640 1 -- 172.21.15.88:0/3117418121 shutdown_connections 2024-04-26T23:40:40.663 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:40.659+0000 7f7cebf9d640 1 -- 172.21.15.88:0/3117418121 wait complete. 2024-04-26T23:40:40.687 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new b b_metadata b_data 2024-04-26T23:40:40.786 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:40.782+0000 7f1224c37640 1 Processor -- start 2024-04-26T23:40:40.786 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:40.782+0000 7f1224c37640 1 -- start start 2024-04-26T23:40:40.787 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:40.783+0000 7f1224c37640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f1220150d20 0x7f122015a360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:40.787 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:40.783+0000 7f1224c37640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f122006f790 0x7f12200c32e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:40.788 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:40.783+0000 7f1224c37640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f12200c3d10 con 0x7f1220157680 2024-04-26T23:40:40.788 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:40.783+0000 7f1224c37640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f12200c4290 con 0x7f122006f790 2024-04-26T23:40:40.788 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:40.783+0000 7f1224c37640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f12200c3fb0 con 0x7f1220150d20 2024-04-26T23:40:40.788 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:40.783+0000 7f121dd9b640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f122006f790 0x7f12200c32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:40.788 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:40.783+0000 7f121ed9d640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f1220157680 0x7f122006d320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:39446/0 (socket says 172.21.15.88:39446) 2024-04-26T23:40:40.788 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:40.783+0000 7f121ed9d640 1 -- 172.21.15.88:0/3700049230 learned_addr learned my addr 172.21.15.88:0/3700049230 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-26T23:40:40.788 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:40.784+0000 7f121dd9b640 1 -- 172.21.15.88:0/3700049230 >> v2:172.21.15.175:3300/0 conn(0x7f1220150d20 msgr2=0x7f122015a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:40:40.788 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:40.784+0000 7f121dd9b640 1 --2- 172.21.15.88:0/3700049230 >> v2:172.21.15.175:3300/0 conn(0x7f1220150d20 0x7f122015a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:40.788 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:40.784+0000 7f121dd9b640 1 -- 172.21.15.88:0/3700049230 >> v1:172.21.15.88:6789/0 conn(0x7f1220157680 legacy=0x7f122006d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:40.788 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:40.784+0000 7f121dd9b640 1 -- 172.21.15.88:0/3700049230 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1220156e80 con 0x7f122006f790 2024-04-26T23:40:40.789 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:40.784+0000 7f121dd9b640 1 --2- 172.21.15.88:0/3700049230 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f122006f790 0x7f12200c32e0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f12200c3ab0 tx=0x7f121402a010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47a54c9acbfc843f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:40.790 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:40.784+0000 7f121d59a640 1 -- 172.21.15.88:0/3700049230 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1214037070 con 0x7f122006f790 2024-04-26T23:40:40.790 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:40.784+0000 7f121d59a640 1 -- 172.21.15.88:0/3700049230 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f121402aca0 con 0x7f122006f790 2024-04-26T23:40:40.790 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:40.784+0000 7f121d59a640 1 -- 172.21.15.88:0/3700049230 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1214032660 con 0x7f122006f790 2024-04-26T23:40:40.790 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:40.785+0000 7f1224c37640 1 -- 172.21.15.88:0/3700049230 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f122006f790 msgr2=0x7f12200c32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:40.790 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:40.785+0000 7f1224c37640 1 --2- 172.21.15.88:0/3700049230 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f122006f790 0x7f12200c32e0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f12200c3ab0 tx=0x7f121402a010 comp rx=0 tx=0).stop 2024-04-26T23:40:40.790 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:40.785+0000 7f1224c37640 1 -- 172.21.15.88:0/3700049230 shutdown_connections 2024-04-26T23:40:40.790 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:40.785+0000 7f1224c37640 1 --2- 172.21.15.88:0/3700049230 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f122006f790 0x7f12200c32e0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:40.790 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:40.785+0000 7f1224c37640 1 --2- 172.21.15.88:0/3700049230 >> v2:172.21.15.175:3300/0 conn(0x7f1220150d20 0x7f122015a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:40.790 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:40.785+0000 7f1224c37640 1 -- 172.21.15.88:0/3700049230 >> 172.21.15.88:0/3700049230 conn(0x7f12200c5ce0 msgr2=0x7f12200c60f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:40:40.790 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:40.785+0000 7f1224c37640 1 -- 172.21.15.88:0/3700049230 shutdown_connections 2024-04-26T23:40:40.790 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:40.785+0000 7f1224c37640 1 -- 172.21.15.88:0/3700049230 wait complete. 2024-04-26T23:40:40.792 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:40.786+0000 7f1224c37640 1 Processor -- start 2024-04-26T23:40:40.793 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:40.786+0000 7f1224c37640 1 -- start start 2024-04-26T23:40:40.793 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:40.787+0000 7f1224c37640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f122006f790 0x7f12200aeee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:40.793 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:40.787+0000 7f1224c37640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1220150d20 0x7f122014d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:40.793 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:40.787+0000 7f1224c37640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1220157680 0x7f12201f0270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:40.793 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:40.787+0000 7f1224c37640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f122006da30 con 0x7f1220157680 2024-04-26T23:40:40.793 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:40.787+0000 7f1224c37640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f12200c3820 con 0x7f122006f790 2024-04-26T23:40:40.793 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:40.787+0000 7f1224c37640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f122006dbb0 con 0x7f1220150d20 2024-04-26T23:40:40.793 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:40.787+0000 7f121ed9d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1220157680 0x7f12201f0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:40.793 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:40.787+0000 7f121ed9d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1220157680 0x7f12201f0270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:41750/0 (socket says 172.21.15.88:41750) 2024-04-26T23:40:40.793 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:40.787+0000 7f121ed9d640 1 -- 172.21.15.88:0/68393320 learned_addr learned my addr 172.21.15.88:0/68393320 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:40:40.793 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:40.787+0000 7f121ed9d640 1 -- 172.21.15.88:0/68393320 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1220150d20 msgr2=0x7f122014d5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:40.793 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:40.787+0000 7f121ed9d640 1 --2- 172.21.15.88:0/68393320 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1220150d20 0x7f122014d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:40.793 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:40.787+0000 7f121ed9d640 1 -- 172.21.15.88:0/68393320 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f122006f790 msgr2=0x7f12200aeee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:40.794 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:40.787+0000 7f121ed9d640 1 --2- 172.21.15.88:0/68393320 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f122006f790 0x7f12200aeee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:40.794 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:40.787+0000 7f121ed9d640 1 -- 172.21.15.88:0/68393320 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12200ae8a0 con 0x7f1220157680 2024-04-26T23:40:40.794 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:40.787+0000 7f121ed9d640 1 --2- 172.21.15.88:0/68393320 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1220157680 0x7f12201f0270 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f121800c560 tx=0x7f121800ca20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:40.794 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:40.788+0000 7f120effd640 1 -- 172.21.15.88:0/68393320 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1218018070 con 0x7f1220157680 2024-04-26T23:40:40.794 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:40.788+0000 7f120effd640 1 -- 172.21.15.88:0/68393320 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12180074e0 con 0x7f1220157680 2024-04-26T23:40:40.794 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:40.788+0000 7f1224c37640 1 -- 172.21.15.88:0/68393320 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12200aeb40 con 0x7f1220157680 2024-04-26T23:40:40.794 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:40.788+0000 7f120effd640 1 -- 172.21.15.88:0/68393320 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1218007690 con 0x7f1220157680 2024-04-26T23:40:40.794 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:40.788+0000 7f1224c37640 1 -- 172.21.15.88:0/68393320 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12200adc50 con 0x7f1220157680 2024-04-26T23:40:40.794 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:40.789+0000 7f1224c37640 1 -- 172.21.15.88:0/68393320 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f12200507a0 con 0x7f1220157680 2024-04-26T23:40:40.794 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:40.789+0000 7f120effd640 1 -- 172.21.15.88:0/68393320 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f121801b070 con 0x7f1220157680 2024-04-26T23:40:40.795 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:40.790+0000 7f120effd640 1 --2- 172.21.15.88:0/68393320 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f120006c920 0x7f120006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:40.795 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:40.790+0000 7f121e59c640 1 --2- 172.21.15.88:0/68393320 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f120006c920 0x7f120006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:40.795 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:40.790+0000 7f120effd640 1 -- 172.21.15.88:0/68393320 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 6431+0+0 (secure 0 0 0) 0x7f121808b0d0 con 0x7f1220157680 2024-04-26T23:40:40.795 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:40.790+0000 7f121e59c640 1 --2- 172.21.15.88:0/68393320 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f120006c920 0x7f120006ede0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f1220074480 tx=0x7f1210009250 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:40.798 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:40.794+0000 7f120effd640 1 -- 172.21.15.88:0/68393320 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f12180592c0 con 0x7f1220157680 2024-04-26T23:40:41.010 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:41.006+0000 7f1224c37640 1 -- 172.21.15.88:0/68393320 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "b", "metadata": "b_metadata", "data": "b_data"} v 0) -- 0x7f122006f500 con 0x7f1220157680 2024-04-26T23:40:41.661 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:41.657+0000 7f120effd640 1 -- 172.21.15.88:0/68393320 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "b", "metadata": "b_metadata", "data": "b_data"}]=0 new fs with metadata pool 4 and data pool 5 v9) ==== 157+0+0 (secure 0 0 0) 0x7f1218058bc0 con 0x7f1220157680 2024-04-26T23:40:41.661 INFO:teuthology.orchestra.run.smithi088.stderr:new fs with metadata pool 4 and data pool 5 2024-04-26T23:40:41.665 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:41.661+0000 7f1224c37640 1 -- 172.21.15.88:0/68393320 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f120006c920 msgr2=0x7f120006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:41.665 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:41.661+0000 7f1224c37640 1 --2- 172.21.15.88:0/68393320 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f120006c920 0x7f120006ede0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f1220074480 tx=0x7f1210009250 comp rx=0 tx=0).stop 2024-04-26T23:40:41.665 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:41.661+0000 7f1224c37640 1 -- 172.21.15.88:0/68393320 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1220157680 msgr2=0x7f12201f0270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:41.665 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:41.661+0000 7f1224c37640 1 --2- 172.21.15.88:0/68393320 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1220157680 0x7f12201f0270 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f121800c560 tx=0x7f121800ca20 comp rx=0 tx=0).stop 2024-04-26T23:40:41.665 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:41.661+0000 7f1224c37640 1 -- 172.21.15.88:0/68393320 shutdown_connections 2024-04-26T23:40:41.666 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:41.661+0000 7f1224c37640 1 --2- 172.21.15.88:0/68393320 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f120006c920 0x7f120006ede0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:41.666 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:41.661+0000 7f1224c37640 1 --2- 172.21.15.88:0/68393320 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1220150d20 0x7f122014d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:41.666 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:41.661+0000 7f1224c37640 1 --2- 172.21.15.88:0/68393320 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1220157680 0x7f12201f0270 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:41.666 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:41.661+0000 7f1224c37640 1 --2- 172.21.15.88:0/68393320 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f122006f790 0x7f12200aeee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:41.666 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:41.661+0000 7f1224c37640 1 -- 172.21.15.88:0/68393320 >> 172.21.15.88:0/68393320 conn(0x7f12200c5ce0 msgr2=0x7f12200c6d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:40:41.666 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:41.662+0000 7f1224c37640 1 -- 172.21.15.88:0/68393320 shutdown_connections 2024-04-26T23:40:41.666 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:41.662+0000 7f1224c37640 1 -- 172.21.15.88:0/68393320 wait complete. 2024-04-26T23:40:41.689 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T23:40:41.792 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:41.788+0000 7f8ab4228640 1 Processor -- start 2024-04-26T23:40:41.792 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:41.788+0000 7f8ab4228640 1 -- start start 2024-04-26T23:40:41.793 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:41.789+0000 7f8ab4228640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f8aac0c7000 0x7f8aac0ca460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:41.794 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:41.789+0000 7f8ab4228640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8aac1543f0 0x7f8aac072930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:41.794 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:41.789+0000 7f8ab4228640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8aac156de0 con 0x7f8aac0c9830 2024-04-26T23:40:41.794 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:41.789+0000 7f8ab4228640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f8aac157b60 con 0x7f8aac0c7000 2024-04-26T23:40:41.794 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:41.789+0000 7f8ab4228640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f8aac0cad40 con 0x7f8aac1543f0 2024-04-26T23:40:41.794 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:41.789+0000 7f8ab1fc4640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f8aac0c7000 0x7f8aac0ca460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:41.794 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:41.789+0000 7f8ab17c3640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f8aac0c9830 0x7f8aac153ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:39460/0 (socket says 172.21.15.88:39460) 2024-04-26T23:40:41.794 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:41.789+0000 7f8ab17c3640 1 -- 172.21.15.88:0/497604499 learned_addr learned my addr 172.21.15.88:0/497604499 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-26T23:40:41.794 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:41.789+0000 7f8ab1fc4640 1 -- 172.21.15.88:0/497604499 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8aac1543f0 msgr2=0x7f8aac072930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:40:41.794 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:41.789+0000 7f8ab27c5640 1 --2- 172.21.15.88:0/497604499 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8aac1543f0 0x7f8aac072930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:41.794 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:41.789+0000 7f8ab1fc4640 1 --2- 172.21.15.88:0/497604499 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8aac1543f0 0x7f8aac072930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:41.794 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:41.789+0000 7f8ab0fc2640 1 -- 172.21.15.88:0/497604499 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4141727472 0 0) 0x7f8aac156de0 con 0x7f8aac0c9830 2024-04-26T23:40:41.794 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:41.789+0000 7f8ab1fc4640 1 -- 172.21.15.88:0/497604499 >> v1:172.21.15.88:6789/0 conn(0x7f8aac0c9830 legacy=0x7f8aac153ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:41.794 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:41.789+0000 7f8ab1fc4640 1 -- 172.21.15.88:0/497604499 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8aac157080 con 0x7f8aac0c7000 2024-04-26T23:40:41.794 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:41.790+0000 7f8ab1fc4640 1 --2- 172.21.15.88:0/497604499 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8aac0c7000 0x7f8aac0ca460 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f8aac156fb0 tx=0x7f8aa802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=703cd2b21167b8d3 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:41.795 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:41.790+0000 7f8ab0fc2640 1 -- 172.21.15.88:0/497604499 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8aa8037070 con 0x7f8aac0c7000 2024-04-26T23:40:41.795 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:41.790+0000 7f8ab0fc2640 1 -- 172.21.15.88:0/497604499 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8aa8032440 con 0x7f8aac0c7000 2024-04-26T23:40:41.795 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:41.790+0000 7f8ab0fc2640 1 -- 172.21.15.88:0/497604499 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8aa8032810 con 0x7f8aac0c7000 2024-04-26T23:40:41.798 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:41.790+0000 7f8ab4228640 1 -- 172.21.15.88:0/497604499 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8aac0c7000 msgr2=0x7f8aac0ca460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:41.798 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:41.790+0000 7f8ab4228640 1 --2- 172.21.15.88:0/497604499 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8aac0c7000 0x7f8aac0ca460 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f8aac156fb0 tx=0x7f8aa802a180 comp rx=0 tx=0).stop 2024-04-26T23:40:41.798 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:41.790+0000 7f8ab4228640 1 -- 172.21.15.88:0/497604499 shutdown_connections 2024-04-26T23:40:41.798 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:41.790+0000 7f8ab4228640 1 --2- 172.21.15.88:0/497604499 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8aac1543f0 0x7f8aac072930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:41.798 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:41.790+0000 7f8ab4228640 1 --2- 172.21.15.88:0/497604499 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8aac0c7000 0x7f8aac0ca460 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:41.798 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:41.790+0000 7f8ab4228640 1 -- 172.21.15.88:0/497604499 >> 172.21.15.88:0/497604499 conn(0x7f8aac0adf20 msgr2=0x7f8aac0ae330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:40:41.798 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:41.790+0000 7f8ab4228640 1 -- 172.21.15.88:0/497604499 shutdown_connections 2024-04-26T23:40:41.798 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:41.790+0000 7f8ab4228640 1 -- 172.21.15.88:0/497604499 wait complete. 2024-04-26T23:40:41.798 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:41.791+0000 7f8ab4228640 1 Processor -- start 2024-04-26T23:40:41.799 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:41.792+0000 7f8ab4228640 1 -- start start 2024-04-26T23:40:41.799 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:41.792+0000 7f8ab4228640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8aac0c7000 0x7f8aac0b1d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:41.799 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:41.792+0000 7f8ab4228640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8aac0c9830 0x7f8aac0afb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:41.799 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:41.792+0000 7f8ab4228640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8aac1543f0 0x7f8aac1ed680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:41.799 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:41.792+0000 7f8ab4228640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f8aac0ca9a0 con 0x7f8aac0c7000 2024-04-26T23:40:41.799 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:41.792+0000 7f8ab4228640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f8aac157640 con 0x7f8aac1543f0 2024-04-26T23:40:41.799 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:41.792+0000 7f8ab4228640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f8aac0cab20 con 0x7f8aac0c9830 2024-04-26T23:40:41.799 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:41.792+0000 7f8ab1fc4640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8aac0c7000 0x7f8aac0b1d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:41.799 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:41.792+0000 7f8ab1fc4640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8aac0c7000 0x7f8aac0b1d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:41782/0 (socket says 172.21.15.88:41782) 2024-04-26T23:40:41.799 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:41.792+0000 7f8ab1fc4640 1 -- 172.21.15.88:0/2751747861 learned_addr learned my addr 172.21.15.88:0/2751747861 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:40:41.799 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:41.792+0000 7f8ab17c3640 1 --2- 172.21.15.88:0/2751747861 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8aac0c9830 0x7f8aac0afb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:41.799 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:41.792+0000 7f8ab27c5640 1 --2- 172.21.15.88:0/2751747861 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8aac1543f0 0x7f8aac1ed680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:41.799 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:41.792+0000 7f8ab1fc4640 1 -- 172.21.15.88:0/2751747861 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8aac0c9830 msgr2=0x7f8aac0afb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:41.799 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:41.792+0000 7f8ab1fc4640 1 --2- 172.21.15.88:0/2751747861 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8aac0c9830 0x7f8aac0afb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:41.800 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:41.792+0000 7f8ab1fc4640 1 -- 172.21.15.88:0/2751747861 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8aac1543f0 msgr2=0x7f8aac1ed680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:41.800 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:41.792+0000 7f8ab1fc4640 1 --2- 172.21.15.88:0/2751747861 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8aac1543f0 0x7f8aac1ed680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:41.800 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:41.792+0000 7f8ab1fc4640 1 -- 172.21.15.88:0/2751747861 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8aac0c6020 con 0x7f8aac0c7000 2024-04-26T23:40:41.800 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:41.792+0000 7f8ab27c5640 1 --2- 172.21.15.88:0/2751747861 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8aac1543f0 0x7f8aac1ed680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:40:41.800 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:41.793+0000 7f8ab1fc4640 1 --2- 172.21.15.88:0/2751747861 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8aac0c7000 0x7f8aac0b1d70 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f8aa8009890 tx=0x7f8aa80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:41.800 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:41.793+0000 7f8aa27fc640 1 -- 172.21.15.88:0/2751747861 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8aa8037040 con 0x7f8aac0c7000 2024-04-26T23:40:41.800 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:41.793+0000 7f8aa27fc640 1 -- 172.21.15.88:0/2751747861 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8aa8042070 con 0x7f8aac0c7000 2024-04-26T23:40:41.800 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:41.793+0000 7f8aa27fc640 1 -- 172.21.15.88:0/2751747861 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8aa8030bd0 con 0x7f8aac0c7000 2024-04-26T23:40:41.800 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:41.793+0000 7f8ab4228640 1 -- 172.21.15.88:0/2751747861 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8aac0ac220 con 0x7f8aac0c7000 2024-04-26T23:40:41.800 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:41.793+0000 7f8ab4228640 1 -- 172.21.15.88:0/2751747861 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8aac0c5d40 con 0x7f8aac0c7000 2024-04-26T23:40:41.800 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:41.794+0000 7f8ab4228640 1 -- 172.21.15.88:0/2751747861 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8aac0766c0 con 0x7f8aac0c7000 2024-04-26T23:40:41.800 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:41.794+0000 7f8aa27fc640 1 -- 172.21.15.88:0/2751747861 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8aa8047460 con 0x7f8aac0c7000 2024-04-26T23:40:41.800 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:41.794+0000 7f8aa27fc640 1 --2- 172.21.15.88:0/2751747861 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f8a9006c8f0 0x7f8a9006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:41.801 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:41.795+0000 7f8aa27fc640 1 -- 172.21.15.88:0/2751747861 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 6521+0+0 (secure 0 0 0) 0x7f8aa80aca60 con 0x7f8aac0c7000 2024-04-26T23:40:41.801 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:41.795+0000 7f8ab17c3640 1 --2- 172.21.15.88:0/2751747861 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f8a9006c8f0 0x7f8a9006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:41.801 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:41.795+0000 7f8ab17c3640 1 --2- 172.21.15.88:0/2751747861 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f8a9006c8f0 0x7f8a9006edb0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f8aac14d550 tx=0x7f8a9c007b50 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:41.802 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:41.799+0000 7f8aa27fc640 1 -- 172.21.15.88:0/2751747861 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f8aa8032e20 con 0x7f8aac0c7000 2024-04-26T23:40:41.980 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:41.977+0000 7f8ab4228640 1 -- 172.21.15.88:0/2751747861 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8aac0c5710 con 0x7f8aac0c7000 2024-04-26T23:40:41.982 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:41.978+0000 7f8aa27fc640 1 -- 172.21.15.88:0/2751747861 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) ==== 74+0+20356 (secure 0 0 0) 0x7f8aa8045360 con 0x7f8aac0c7000 2024-04-26T23:40:41.982 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-26T23:40:41.982 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":23,"fsid":"555255e9-7ef9-4454-8dc9-35e96b70035c","created":"2024-04-26T23:40:07.836009+0000","modified":"2024-04-26T23:40:41.008401+0000","last_up_change":"2024-04-26T23:40:18.831369+0000","last_in_change":"2024-04-26T23:40:09.944777+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T23:40:19.936127+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"a_metadata","create_time":"2024-04-26T23:40:29.837465+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"a_data","create_time":"2024-04-26T23:40:30.868651+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"b_metadata","create_time":"2024-04-26T23:40:38.753441+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"b_data","create_time":"2024-04-26T23:40:39.974557+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"92aecea3-ed62-4a29-87c0-76758a0816a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":2803186054},{"type":"v1","addr":"172.21.15.88:6801","nonce":2803186054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":2803186054},{"type":"v1","addr":"172.21.15.88:6803","nonce":2803186054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":2803186054},{"type":"v1","addr":"172.21.15.88:6807","nonce":2803186054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":2803186054},{"type":"v1","addr":"172.21.15.88:6805","nonce":2803186054}]},"public_addr":"172.21.15.88:6801/2803186054","cluster_addr":"172.21.15.88:6803/2803186054","heartbeat_back_addr":"172.21.15.88:6807/2803186054","heartbeat_front_addr":"172.21.15.88:6805/2803186054","state":["exists","up"]},{"osd":1,"uuid":"7a6f0fa9-23d0-4747-880f-798d45ec5eeb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":1897380484},{"type":"v1","addr":"172.21.15.88:6817","nonce":1897380484}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":1897380484},{"type":"v1","addr":"172.21.15.88:6819","nonce":1897380484}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1897380484},{"type":"v1","addr":"172.21.15.88:6823","nonce":1897380484}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":1897380484},{"type":"v1","addr":"172.21.15.88:6821","nonce":1897380484}]},"public_addr":"172.21.15.88:6817/1897380484","cluster_addr":"172.21.15.88:6819/1897380484","heartbeat_back_addr":"172.21.15.88:6823/1897380484","heartbeat_front_addr":"172.21.15.88:6821/1897380484","state":["exists","up"]},{"osd":2,"uuid":"6be88ea0-e133-4200-a4b5-f92d664b248a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":648396269},{"type":"v1","addr":"172.21.15.88:6809","nonce":648396269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":648396269},{"type":"v1","addr":"172.21.15.88:6811","nonce":648396269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":648396269},{"type":"v1","addr":"172.21.15.88:6815","nonce":648396269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":648396269},{"type":"v1","addr":"172.21.15.88:6813","nonce":648396269}]},"public_addr":"172.21.15.88:6809/648396269","cluster_addr":"172.21.15.88:6811/648396269","heartbeat_back_addr":"172.21.15.88:6815/648396269","heartbeat_front_addr":"172.21.15.88:6813/648396269","state":["exists","up"]},{"osd":3,"uuid":"dcb0746b-7b3d-4ecf-8089-2493a5d1857c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":2328028922},{"type":"v1","addr":"172.21.15.88:6825","nonce":2328028922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":2328028922},{"type":"v1","addr":"172.21.15.88:6827","nonce":2328028922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":2328028922},{"type":"v1","addr":"172.21.15.88:6831","nonce":2328028922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":2328028922},{"type":"v1","addr":"172.21.15.88:6829","nonce":2328028922}]},"public_addr":"172.21.15.88:6825/2328028922","cluster_addr":"172.21.15.88:6827/2328028922","heartbeat_back_addr":"172.21.15.88:6831/2328028922","heartbeat_front_addr":"172.21.15.88:6829/2328028922","state":["exists","up"]},{"osd":4,"uuid":"c483de66-c44f-450e-a4ce-b132d50882c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":3929617402},{"type":"v1","addr":"172.21.15.175:6809","nonce":3929617402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":3929617402},{"type":"v1","addr":"172.21.15.175:6811","nonce":3929617402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":3929617402},{"type":"v1","addr":"172.21.15.175:6815","nonce":3929617402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":3929617402},{"type":"v1","addr":"172.21.15.175:6813","nonce":3929617402}]},"public_addr":"172.21.15.175:6809/3929617402","cluster_addr":"172.21.15.175:6811/3929617402","heartbeat_back_addr":"172.21.15.175:6815/3929617402","heartbeat_front_addr":"172.21.15.175:6813/3929617402","state":["exists","up"]},{"osd":5,"uuid":"ac3b1669-d228-40dd-9f9a-cb46aa73dd6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":2476644457},{"type":"v1","addr":"172.21.15.175:6801","nonce":2476644457}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":2476644457},{"type":"v1","addr":"172.21.15.175:6803","nonce":2476644457}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":2476644457},{"type":"v1","addr":"172.21.15.175:6807","nonce":2476644457}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":2476644457},{"type":"v1","addr":"172.21.15.175:6805","nonce":2476644457}]},"public_addr":"172.21.15.175:6801/2476644457","cluster_addr":"172.21.15.175:6803/2476644457","heartbeat_back_addr":"172.21.15.175:6807/2476644457","heartbeat_front_addr":"172.21.15.175:6805/2476644457","state":["exists","up"]},{"osd":6,"uuid":"7bef4896-857e-4c11-b3b2-c2e9a8548338","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":3824112919},{"type":"v1","addr":"172.21.15.175:6819","nonce":3824112919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6821","nonce":3824112919},{"type":"v1","addr":"172.21.15.175:6824","nonce":3824112919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":3824112919},{"type":"v1","addr":"172.21.15.175:6831","nonce":3824112919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":3824112919},{"type":"v1","addr":"172.21.15.175:6829","nonce":3824112919}]},"public_addr":"172.21.15.175:6819/3824112919","cluster_addr":"172.21.15.175:6824/3824112919","heartbeat_back_addr":"172.21.15.175:6831/3824112919","heartbeat_front_addr":"172.21.15.175:6829/3824112919","state":["exists","up"]},{"osd":7,"uuid":"e18d9e09-8673-470d-b9dc-280a409b63f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6817","nonce":3319361162},{"type":"v1","addr":"172.21.15.175:6818","nonce":3319361162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":3319361162},{"type":"v1","addr":"172.21.15.175:6822","nonce":3319361162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6827","nonce":3319361162},{"type":"v1","addr":"172.21.15.175:6828","nonce":3319361162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6823","nonce":3319361162},{"type":"v1","addr":"172.21.15.175:6825","nonce":3319361162}]},"public_addr":"172.21.15.175:6818/3319361162","cluster_addr":"172.21.15.175:6822/3319361162","heartbeat_back_addr":"172.21.15.175:6828/3319361162","heartbeat_front_addr":"172.21.15.175:6825/3319361162","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:40:15.126268+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:40:15.050614+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:40:14.995164+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:40:15.078112+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:40:15.159637+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:40:15.091226+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:40:15.140316+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:40:15.089431+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:40:41.984 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:41.980+0000 7f8ab4228640 1 -- 172.21.15.88:0/2751747861 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f8a9006c8f0 msgr2=0x7f8a9006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:41.984 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:41.980+0000 7f8ab4228640 1 --2- 172.21.15.88:0/2751747861 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f8a9006c8f0 0x7f8a9006edb0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f8aac14d550 tx=0x7f8a9c007b50 comp rx=0 tx=0).stop 2024-04-26T23:40:41.984 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:41.980+0000 7f8ab4228640 1 -- 172.21.15.88:0/2751747861 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8aac0c7000 msgr2=0x7f8aac0b1d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:41.984 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:41.980+0000 7f8ab4228640 1 --2- 172.21.15.88:0/2751747861 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8aac0c7000 0x7f8aac0b1d70 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f8aa8009890 tx=0x7f8aa80046c0 comp rx=0 tx=0).stop 2024-04-26T23:40:41.984 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:41.980+0000 7f8ab4228640 1 -- 172.21.15.88:0/2751747861 shutdown_connections 2024-04-26T23:40:41.984 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:41.980+0000 7f8ab4228640 1 --2- 172.21.15.88:0/2751747861 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f8a9006c8f0 0x7f8a9006edb0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:41.985 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:41.980+0000 7f8ab4228640 1 --2- 172.21.15.88:0/2751747861 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8aac0c9830 0x7f8aac0afb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:41.985 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:41.980+0000 7f8ab4228640 1 --2- 172.21.15.88:0/2751747861 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8aac1543f0 0x7f8aac1ed680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:41.985 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:41.980+0000 7f8ab4228640 1 --2- 172.21.15.88:0/2751747861 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8aac0c7000 0x7f8aac0b1d70 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:41.985 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:41.980+0000 7f8ab4228640 1 -- 172.21.15.88:0/2751747861 >> 172.21.15.88:0/2751747861 conn(0x7f8aac0adf20 msgr2=0x7f8aac0cb430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:40:41.985 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:41.980+0000 7f8ab4228640 1 -- 172.21.15.88:0/2751747861 shutdown_connections 2024-04-26T23:40:41.985 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:41.980+0000 7f8ab4228640 1 -- 172.21.15.88:0/2751747861 wait complete. 2024-04-26T23:40:41.995 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T23:40:42.091 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:42.087+0000 7f81ccab0640 1 Processor -- start 2024-04-26T23:40:42.091 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:42.087+0000 7f81ccab0640 1 -- start start 2024-04-26T23:40:42.092 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:42.088+0000 7f81ccab0640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f81c80c4820 0x7f81c8073a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:42.092 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:42.088+0000 7f81ccab0640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f81c80ab630 0x7f81c8073fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:42.092 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:42.088+0000 7f81ccab0640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f81c8156f60 con 0x7f81c80aecf0 2024-04-26T23:40:42.092 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:42.088+0000 7f81ccab0640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f81c8157240 con 0x7f81c80ab630 2024-04-26T23:40:42.092 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:42.088+0000 7f81ccab0640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f81c8157520 con 0x7f81c80c4820 2024-04-26T23:40:42.092 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:42.088+0000 7f81c6d9d640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f81c80ab630 0x7f81c8073fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:42.092 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:42.088+0000 7f81c5d9b640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f81c80c4820 0x7f81c8073a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:42.093 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:42.088+0000 7f81c659c640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f81c80aecf0 0x7f81c80c3800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.88:36562/0 (socket says 172.21.15.88:36562) 2024-04-26T23:40:42.093 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:42.088+0000 7f81c6d9d640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f81c80ab630 0x7f81c8073fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.88:33934/0 (socket says 172.21.15.88:33934) 2024-04-26T23:40:42.093 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:42.088+0000 7f81c659c640 1 -- 172.21.15.88:0/2554646791 learned_addr learned my addr 172.21.15.88:0/2554646791 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-26T23:40:42.093 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:42.088+0000 7f81c5d9b640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f81c80c4820 0x7f81c8073a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.88:45926/0 (socket says 172.21.15.88:45926) 2024-04-26T23:40:42.094 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:42.089+0000 7f81c5d9b640 1 -- 172.21.15.88:0/2554646791 >> v2:172.21.15.175:3300/0 conn(0x7f81c80ab630 msgr2=0x7f81c8073fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:40:42.094 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:42.089+0000 7f81c5d9b640 1 --2- 172.21.15.88:0/2554646791 >> v2:172.21.15.175:3300/0 conn(0x7f81c80ab630 0x7f81c8073fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:42.094 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:42.089+0000 7f81c5d9b640 1 -- 172.21.15.88:0/2554646791 >> v1:172.21.15.175:6789/0 conn(0x7f81c80aecf0 legacy=0x7f81c80c3800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:42.094 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:42.089+0000 7f81c5d9b640 1 -- 172.21.15.88:0/2554646791 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81c8157800 con 0x7f81c80c4820 2024-04-26T23:40:42.094 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:42.089+0000 7f81c6d9d640 1 --2- 172.21.15.88:0/2554646791 >> v2:172.21.15.175:3300/0 conn(0x7f81c80ab630 0x7f81c8073fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:40:42.095 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:42.090+0000 7f81c5d9b640 1 --2- 172.21.15.88:0/2554646791 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f81c80c4820 0x7f81c8073a70 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f81bc0097a0 tx=0x7f81bc02a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d386b98695e4ddd7 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:42.095 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:42.090+0000 7f81c559a640 1 -- 172.21.15.88:0/2554646791 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81bc037070 con 0x7f81c80c4820 2024-04-26T23:40:42.095 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:42.090+0000 7f81c559a640 1 -- 172.21.15.88:0/2554646791 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81bc02ae50 con 0x7f81c80c4820 2024-04-26T23:40:42.095 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:42.090+0000 7f81c559a640 1 -- 172.21.15.88:0/2554646791 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81bc032660 con 0x7f81c80c4820 2024-04-26T23:40:42.095 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:42.090+0000 7f81ccab0640 1 -- 172.21.15.88:0/2554646791 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f81c80c4820 msgr2=0x7f81c8073a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:42.095 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:42.090+0000 7f81ccab0640 1 --2- 172.21.15.88:0/2554646791 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f81c80c4820 0x7f81c8073a70 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f81bc0097a0 tx=0x7f81bc02a100 comp rx=0 tx=0).stop 2024-04-26T23:40:42.095 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:42.090+0000 7f81ccab0640 1 -- 172.21.15.88:0/2554646791 shutdown_connections 2024-04-26T23:40:42.095 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:42.090+0000 7f81ccab0640 1 --2- 172.21.15.88:0/2554646791 >> v2:172.21.15.175:3300/0 conn(0x7f81c80ab630 0x7f81c8073fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:42.095 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:42.090+0000 7f81ccab0640 1 --2- 172.21.15.88:0/2554646791 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f81c80c4820 0x7f81c8073a70 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:42.095 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:42.090+0000 7f81ccab0640 1 -- 172.21.15.88:0/2554646791 >> 172.21.15.88:0/2554646791 conn(0x7f81c80c6ed0 msgr2=0x7f81c80c72b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:40:42.095 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:42.090+0000 7f81ccab0640 1 -- 172.21.15.88:0/2554646791 shutdown_connections 2024-04-26T23:40:42.095 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:42.090+0000 7f81ccab0640 1 -- 172.21.15.88:0/2554646791 wait complete. 2024-04-26T23:40:42.098 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:42.092+0000 7f81ccab0640 1 Processor -- start 2024-04-26T23:40:42.098 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:42.092+0000 7f81ccab0640 1 -- start start 2024-04-26T23:40:42.098 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:42.092+0000 7f81ccab0640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f81c80ab630 0x7f81c81ec550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:42.098 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:42.092+0000 7f81ccab0640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f81c80aecf0 0x7f81c8159480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:42.098 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:42.092+0000 7f81ccab0640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f81c80c4820 0x7f81c81499c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:42.098 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:42.092+0000 7f81ccab0640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f81c80c3f10 con 0x7f81c80aecf0 2024-04-26T23:40:42.098 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:42.092+0000 7f81ccab0640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f81c8156c10 con 0x7f81c80c4820 2024-04-26T23:40:42.098 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:42.092+0000 7f81ccab0640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f81c80c4090 con 0x7f81c80ab630 2024-04-26T23:40:42.098 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:42.092+0000 7f81c5d9b640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f81c80aecf0 0x7f81c8159480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:42.098 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:42.092+0000 7f81c5d9b640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f81c80aecf0 0x7f81c8159480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:41798/0 (socket says 172.21.15.88:41798) 2024-04-26T23:40:42.098 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:42.092+0000 7f81c5d9b640 1 -- 172.21.15.88:0/1209506039 learned_addr learned my addr 172.21.15.88:0/1209506039 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:40:42.098 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:42.092+0000 7f81c659c640 1 --2- 172.21.15.88:0/1209506039 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f81c80ab630 0x7f81c81ec550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:42.098 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:42.092+0000 7f81c6d9d640 1 --2- 172.21.15.88:0/1209506039 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f81c80c4820 0x7f81c81499c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:42.099 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:42.093+0000 7f81c5d9b640 1 -- 172.21.15.88:0/1209506039 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f81c80ab630 msgr2=0x7f81c81ec550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:42.099 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:42.093+0000 7f81c5d9b640 1 --2- 172.21.15.88:0/1209506039 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f81c80ab630 0x7f81c81ec550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:42.099 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:42.093+0000 7f81c5d9b640 1 -- 172.21.15.88:0/1209506039 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f81c80c4820 msgr2=0x7f81c81499c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:42.099 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:42.093+0000 7f81c5d9b640 1 --2- 172.21.15.88:0/1209506039 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f81c80c4820 0x7f81c81499c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:42.099 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:42.093+0000 7f81c5d9b640 1 -- 172.21.15.88:0/1209506039 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81c81583e0 con 0x7f81c80aecf0 2024-04-26T23:40:42.099 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:42.093+0000 7f81c5d9b640 1 --2- 172.21.15.88:0/1209506039 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f81c80aecf0 0x7f81c8159480 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f81bc02a140 tx=0x7f81bc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:42.099 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:42.093+0000 7f81b6ffd640 1 -- 172.21.15.88:0/1209506039 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81bc041070 con 0x7f81c80aecf0 2024-04-26T23:40:42.099 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:42.093+0000 7f81b6ffd640 1 -- 172.21.15.88:0/1209506039 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81bc03c670 con 0x7f81c80aecf0 2024-04-26T23:40:42.099 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:42.093+0000 7f81ccab0640 1 -- 172.21.15.88:0/1209506039 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81c81586c0 con 0x7f81c80aecf0 2024-04-26T23:40:42.099 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:42.093+0000 7f81b6ffd640 1 -- 172.21.15.88:0/1209506039 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81bc037040 con 0x7f81c80aecf0 2024-04-26T23:40:42.099 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:42.093+0000 7f81ccab0640 1 -- 172.21.15.88:0/1209506039 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81c8158c80 con 0x7f81c80aecf0 2024-04-26T23:40:42.099 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:42.094+0000 7f81ccab0640 1 -- 172.21.15.88:0/1209506039 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f81c81537f0 con 0x7f81c80aecf0 2024-04-26T23:40:42.100 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:42.094+0000 7f81b6ffd640 1 -- 172.21.15.88:0/1209506039 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f81bc044070 con 0x7f81c80aecf0 2024-04-26T23:40:42.100 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:42.095+0000 7f81b6ffd640 1 --2- 172.21.15.88:0/1209506039 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f81a806c8f0 0x7f81a806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:42.100 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:42.095+0000 7f81c659c640 1 --2- 172.21.15.88:0/1209506039 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f81a806c8f0 0x7f81a806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:42.100 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:42.095+0000 7f81b6ffd640 1 -- 172.21.15.88:0/1209506039 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 6521+0+0 (secure 0 0 0) 0x7f81bc0ac400 con 0x7f81c80aecf0 2024-04-26T23:40:42.100 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:42.095+0000 7f81c659c640 1 --2- 172.21.15.88:0/1209506039 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f81a806c8f0 0x7f81a806edb0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f81b80012e0 tx=0x7f81b8001a30 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:42.103 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:42.099+0000 7f81b6ffd640 1 -- 172.21.15.88:0/1209506039 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f81bc07a060 con 0x7f81c80aecf0 2024-04-26T23:40:42.279 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:42.275+0000 7f81ccab0640 1 -- 172.21.15.88:0/1209506039 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f81c80c4600 con 0x7f81c80aecf0 2024-04-26T23:40:42.280 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:42.276+0000 7f81b6ffd640 1 -- 172.21.15.88:0/1209506039 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) ==== 74+0+20356 (secure 0 0 0) 0x7f81bc07e360 con 0x7f81c80aecf0 2024-04-26T23:40:42.281 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-26T23:40:42.281 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":23,"fsid":"555255e9-7ef9-4454-8dc9-35e96b70035c","created":"2024-04-26T23:40:07.836009+0000","modified":"2024-04-26T23:40:41.008401+0000","last_up_change":"2024-04-26T23:40:18.831369+0000","last_in_change":"2024-04-26T23:40:09.944777+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T23:40:19.936127+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"a_metadata","create_time":"2024-04-26T23:40:29.837465+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"a_data","create_time":"2024-04-26T23:40:30.868651+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"b_metadata","create_time":"2024-04-26T23:40:38.753441+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"b_data","create_time":"2024-04-26T23:40:39.974557+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"92aecea3-ed62-4a29-87c0-76758a0816a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":2803186054},{"type":"v1","addr":"172.21.15.88:6801","nonce":2803186054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":2803186054},{"type":"v1","addr":"172.21.15.88:6803","nonce":2803186054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":2803186054},{"type":"v1","addr":"172.21.15.88:6807","nonce":2803186054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":2803186054},{"type":"v1","addr":"172.21.15.88:6805","nonce":2803186054}]},"public_addr":"172.21.15.88:6801/2803186054","cluster_addr":"172.21.15.88:6803/2803186054","heartbeat_back_addr":"172.21.15.88:6807/2803186054","heartbeat_front_addr":"172.21.15.88:6805/2803186054","state":["exists","up"]},{"osd":1,"uuid":"7a6f0fa9-23d0-4747-880f-798d45ec5eeb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":1897380484},{"type":"v1","addr":"172.21.15.88:6817","nonce":1897380484}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":1897380484},{"type":"v1","addr":"172.21.15.88:6819","nonce":1897380484}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1897380484},{"type":"v1","addr":"172.21.15.88:6823","nonce":1897380484}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":1897380484},{"type":"v1","addr":"172.21.15.88:6821","nonce":1897380484}]},"public_addr":"172.21.15.88:6817/1897380484","cluster_addr":"172.21.15.88:6819/1897380484","heartbeat_back_addr":"172.21.15.88:6823/1897380484","heartbeat_front_addr":"172.21.15.88:6821/1897380484","state":["exists","up"]},{"osd":2,"uuid":"6be88ea0-e133-4200-a4b5-f92d664b248a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":648396269},{"type":"v1","addr":"172.21.15.88:6809","nonce":648396269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":648396269},{"type":"v1","addr":"172.21.15.88:6811","nonce":648396269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":648396269},{"type":"v1","addr":"172.21.15.88:6815","nonce":648396269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":648396269},{"type":"v1","addr":"172.21.15.88:6813","nonce":648396269}]},"public_addr":"172.21.15.88:6809/648396269","cluster_addr":"172.21.15.88:6811/648396269","heartbeat_back_addr":"172.21.15.88:6815/648396269","heartbeat_front_addr":"172.21.15.88:6813/648396269","state":["exists","up"]},{"osd":3,"uuid":"dcb0746b-7b3d-4ecf-8089-2493a5d1857c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":2328028922},{"type":"v1","addr":"172.21.15.88:6825","nonce":2328028922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":2328028922},{"type":"v1","addr":"172.21.15.88:6827","nonce":2328028922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":2328028922},{"type":"v1","addr":"172.21.15.88:6831","nonce":2328028922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":2328028922},{"type":"v1","addr":"172.21.15.88:6829","nonce":2328028922}]},"public_addr":"172.21.15.88:6825/2328028922","cluster_addr":"172.21.15.88:6827/2328028922","heartbeat_back_addr":"172.21.15.88:6831/2328028922","heartbeat_front_addr":"172.21.15.88:6829/2328028922","state":["exists","up"]},{"osd":4,"uuid":"c483de66-c44f-450e-a4ce-b132d50882c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":3929617402},{"type":"v1","addr":"172.21.15.175:6809","nonce":3929617402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":3929617402},{"type":"v1","addr":"172.21.15.175:6811","nonce":3929617402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":3929617402},{"type":"v1","addr":"172.21.15.175:6815","nonce":3929617402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":3929617402},{"type":"v1","addr":"172.21.15.175:6813","nonce":3929617402}]},"public_addr":"172.21.15.175:6809/3929617402","cluster_addr":"172.21.15.175:6811/3929617402","heartbeat_back_addr":"172.21.15.175:6815/3929617402","heartbeat_front_addr":"172.21.15.175:6813/3929617402","state":["exists","up"]},{"osd":5,"uuid":"ac3b1669-d228-40dd-9f9a-cb46aa73dd6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":2476644457},{"type":"v1","addr":"172.21.15.175:6801","nonce":2476644457}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":2476644457},{"type":"v1","addr":"172.21.15.175:6803","nonce":2476644457}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":2476644457},{"type":"v1","addr":"172.21.15.175:6807","nonce":2476644457}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":2476644457},{"type":"v1","addr":"172.21.15.175:6805","nonce":2476644457}]},"public_addr":"172.21.15.175:6801/2476644457","cluster_addr":"172.21.15.175:6803/2476644457","heartbeat_back_addr":"172.21.15.175:6807/2476644457","heartbeat_front_addr":"172.21.15.175:6805/2476644457","state":["exists","up"]},{"osd":6,"uuid":"7bef4896-857e-4c11-b3b2-c2e9a8548338","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":3824112919},{"type":"v1","addr":"172.21.15.175:6819","nonce":3824112919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6821","nonce":3824112919},{"type":"v1","addr":"172.21.15.175:6824","nonce":3824112919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":3824112919},{"type":"v1","addr":"172.21.15.175:6831","nonce":3824112919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":3824112919},{"type":"v1","addr":"172.21.15.175:6829","nonce":3824112919}]},"public_addr":"172.21.15.175:6819/3824112919","cluster_addr":"172.21.15.175:6824/3824112919","heartbeat_back_addr":"172.21.15.175:6831/3824112919","heartbeat_front_addr":"172.21.15.175:6829/3824112919","state":["exists","up"]},{"osd":7,"uuid":"e18d9e09-8673-470d-b9dc-280a409b63f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6817","nonce":3319361162},{"type":"v1","addr":"172.21.15.175:6818","nonce":3319361162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":3319361162},{"type":"v1","addr":"172.21.15.175:6822","nonce":3319361162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6827","nonce":3319361162},{"type":"v1","addr":"172.21.15.175:6828","nonce":3319361162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6823","nonce":3319361162},{"type":"v1","addr":"172.21.15.175:6825","nonce":3319361162}]},"public_addr":"172.21.15.175:6818/3319361162","cluster_addr":"172.21.15.175:6822/3319361162","heartbeat_back_addr":"172.21.15.175:6828/3319361162","heartbeat_front_addr":"172.21.15.175:6825/3319361162","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:40:15.126268+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:40:15.050614+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:40:14.995164+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:40:15.078112+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:40:15.159637+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:40:15.091226+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:40:15.140316+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:40:15.089431+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:40:42.283 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:42.278+0000 7f81ccab0640 1 -- 172.21.15.88:0/1209506039 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f81a806c8f0 msgr2=0x7f81a806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:42.283 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:42.278+0000 7f81ccab0640 1 --2- 172.21.15.88:0/1209506039 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f81a806c8f0 0x7f81a806edb0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f81b80012e0 tx=0x7f81b8001a30 comp rx=0 tx=0).stop 2024-04-26T23:40:42.283 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:42.278+0000 7f81ccab0640 1 -- 172.21.15.88:0/1209506039 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f81c80aecf0 msgr2=0x7f81c8159480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:42.283 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:42.278+0000 7f81ccab0640 1 --2- 172.21.15.88:0/1209506039 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f81c80aecf0 0x7f81c8159480 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f81bc02a140 tx=0x7f81bc0046c0 comp rx=0 tx=0).stop 2024-04-26T23:40:42.283 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:42.278+0000 7f81ccab0640 1 -- 172.21.15.88:0/1209506039 shutdown_connections 2024-04-26T23:40:42.283 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:42.278+0000 7f81ccab0640 1 --2- 172.21.15.88:0/1209506039 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f81a806c8f0 0x7f81a806edb0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:42.283 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:42.278+0000 7f81ccab0640 1 --2- 172.21.15.88:0/1209506039 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f81c80c4820 0x7f81c81499c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:42.283 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:42.278+0000 7f81ccab0640 1 --2- 172.21.15.88:0/1209506039 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f81c80aecf0 0x7f81c8159480 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:42.283 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:42.278+0000 7f81ccab0640 1 --2- 172.21.15.88:0/1209506039 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f81c80ab630 0x7f81c81ec550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:42.284 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:42.278+0000 7f81ccab0640 1 -- 172.21.15.88:0/1209506039 >> 172.21.15.88:0/1209506039 conn(0x7f81c80c6ed0 msgr2=0x7f81c80c4cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:40:42.284 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:42.278+0000 7f81ccab0640 1 -- 172.21.15.88:0/1209506039 shutdown_connections 2024-04-26T23:40:42.284 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:42.278+0000 7f81ccab0640 1 -- 172.21.15.88:0/1209506039 wait complete. 2024-04-26T23:40:42.293 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set b standby_count_wanted 0 2024-04-26T23:40:42.393 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:42.389+0000 7fa55aec8640 1 Processor -- start 2024-04-26T23:40:42.393 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:42.389+0000 7fa55aec8640 1 -- start start 2024-04-26T23:40:42.397 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:42.390+0000 7fa55aec8640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fa5540740e0 0x7fa554157630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:42.397 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:42.390+0000 7fa55aec8640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa55415a530 con 0x7fa5540c6e20 2024-04-26T23:40:42.397 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:42.390+0000 7fa55aec8640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa55415a810 con 0x7fa5540ca3a0 2024-04-26T23:40:42.397 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:42.390+0000 7fa55aec8640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7fa554072930 con 0x7fa5540740e0 2024-04-26T23:40:42.397 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:42.390+0000 7fa558c64640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fa5540c6e20 0x7fa554156f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:39476/0 (socket says 172.21.15.88:39476) 2024-04-26T23:40:42.397 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:42.390+0000 7fa558c64640 1 -- 172.21.15.88:0/1865643365 learned_addr learned my addr 172.21.15.88:0/1865643365 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-26T23:40:42.397 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:42.390+0000 7fa553fff640 1 --2- 172.21.15.88:0/1865643365 >> v2:172.21.15.175:3300/0 conn(0x7fa5540740e0 0x7fa554157630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:42.397 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:42.390+0000 7fa5537fe640 1 -- 172.21.15.88:0/1865643365 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1839987278 0 0) 0x7fa55415a530 con 0x7fa5540c6e20 2024-04-26T23:40:42.397 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:42.390+0000 7fa5537fe640 1 -- 172.21.15.88:0/1865643365 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa544003520 con 0x7fa5540c6e20 2024-04-26T23:40:42.397 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:42.390+0000 7fa5537fe640 1 -- 172.21.15.88:0/1865643365 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 161906738 0 0) 0x7fa544003520 con 0x7fa5540c6e20 2024-04-26T23:40:42.397 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:42.390+0000 7fa5537fe640 1 -- 172.21.15.88:0/1865643365 >> v2:172.21.15.175:3300/0 conn(0x7fa5540740e0 msgr2=0x7fa554157630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:40:42.398 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:42.390+0000 7fa5537fe640 1 --2- 172.21.15.88:0/1865643365 >> v2:172.21.15.175:3300/0 conn(0x7fa5540740e0 0x7fa554157630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:42.398 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:42.390+0000 7fa5537fe640 1 -- 172.21.15.88:0/1865643365 >> v1:172.21.15.175:6789/0 conn(0x7fa5540ca3a0 legacy=0x7fa554161450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:42.398 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:42.390+0000 7fa5537fe640 1 -- 172.21.15.88:0/1865643365 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa55415aaf0 con 0x7fa5540c6e20 2024-04-26T23:40:42.398 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:42.390+0000 7fa5537fe640 1 -- 172.21.15.88:0/1865643365 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 356324787 0 0) 0x7fa548001670 con 0x7fa5540c6e20 2024-04-26T23:40:42.398 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:42.390+0000 7fa5537fe640 1 -- 172.21.15.88:0/1865643365 >> v1:172.21.15.88:6789/0 conn(0x7fa5540c6e20 legacy=0x7fa554156f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:42.398 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:42.390+0000 7fa5537fe640 1 --2- 172.21.15.88:0/1865643365 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa5440039b0 0x7fa544003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:42.398 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:42.390+0000 7fa5537fe640 1 --2- 172.21.15.88:0/1865643365 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa544004800 0x7fa544004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:42.398 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:42.390+0000 7fa5537fe640 1 --2- 172.21.15.88:0/1865643365 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa5440051c0 0x7fa54400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:42.398 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:42.390+0000 7fa5537fe640 1 -- 172.21.15.88:0/1865643365 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fa54400c130 con 0x7fa5440051c0 2024-04-26T23:40:42.398 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:42.390+0000 7fa5537fe640 1 -- 172.21.15.88:0/1865643365 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fa54400c2e0 con 0x7fa544004800 2024-04-26T23:40:42.398 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:42.390+0000 7fa5537fe640 1 -- 172.21.15.88:0/1865643365 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fa54400c4e0 con 0x7fa5440039b0 2024-04-26T23:40:42.398 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:42.390+0000 7fa559465640 1 --2- 172.21.15.88:0/1865643365 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa5440051c0 0x7fa54400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:42.398 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:42.390+0000 7fa558c64640 1 --2- 172.21.15.88:0/1865643365 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa5440039b0 0x7fa544003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:42.398 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:42.390+0000 7fa553fff640 1 --2- 172.21.15.88:0/1865643365 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa544004800 0x7fa544004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:42.399 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:42.391+0000 7fa559465640 1 -- 172.21.15.88:0/1865643365 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa5440039b0 msgr2=0x7fa544003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:40:42.399 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:42.391+0000 7fa559465640 1 --2- 172.21.15.88:0/1865643365 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa5440039b0 0x7fa544003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:42.399 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:42.391+0000 7fa559465640 1 -- 172.21.15.88:0/1865643365 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa544004800 msgr2=0x7fa544004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:40:42.399 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:42.391+0000 7fa559465640 1 --2- 172.21.15.88:0/1865643365 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa544004800 0x7fa544004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:42.399 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:42.391+0000 7fa559465640 1 -- 172.21.15.88:0/1865643365 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa544003520 con 0x7fa5440051c0 2024-04-26T23:40:42.399 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:42.391+0000 7fa558c64640 1 --2- 172.21.15.88:0/1865643365 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa5440039b0 0x7fa544003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:40:42.399 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:42.391+0000 7fa559465640 1 -- 172.21.15.88:0/1865643365 reap_dead start 2024-04-26T23:40:42.399 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:42.391+0000 7fa559465640 1 --2- 172.21.15.88:0/1865643365 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa5440051c0 0x7fa54400b9c0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fa54c001e50 tx=0x7fa544005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66a8b146ff7c4512 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:42.399 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:42.391+0000 7fa5537fe640 1 -- 172.21.15.88:0/1865643365 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa54c001a70 con 0x7fa5440051c0 2024-04-26T23:40:42.399 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:42.391+0000 7fa5537fe640 1 -- 172.21.15.88:0/1865643365 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa54c003970 con 0x7fa5440051c0 2024-04-26T23:40:42.399 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:42.391+0000 7fa5537fe640 1 -- 172.21.15.88:0/1865643365 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa54c003d60 con 0x7fa5440051c0 2024-04-26T23:40:42.399 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:42.392+0000 7fa55aec8640 1 -- 172.21.15.88:0/1865643365 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa5440051c0 msgr2=0x7fa54400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:42.399 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:42.392+0000 7fa55aec8640 1 --2- 172.21.15.88:0/1865643365 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa5440051c0 0x7fa54400b9c0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fa54c001e50 tx=0x7fa544005830 comp rx=0 tx=0).stop 2024-04-26T23:40:42.399 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:42.392+0000 7fa55aec8640 1 -- 172.21.15.88:0/1865643365 shutdown_connections 2024-04-26T23:40:42.399 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:42.392+0000 7fa55aec8640 1 --2- 172.21.15.88:0/1865643365 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa5440051c0 0x7fa54400b9c0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:42.400 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:42.392+0000 7fa55aec8640 1 -- 172.21.15.88:0/1865643365 >> 172.21.15.88:0/1865643365 conn(0x7fa5540ae0b0 msgr2=0x7fa5540ae490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:40:42.400 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:42.392+0000 7fa55aec8640 1 -- 172.21.15.88:0/1865643365 shutdown_connections 2024-04-26T23:40:42.400 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:42.392+0000 7fa55aec8640 1 -- 172.21.15.88:0/1865643365 wait complete. 2024-04-26T23:40:42.400 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:42.393+0000 7fa55aec8640 1 Processor -- start 2024-04-26T23:40:42.400 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:42.393+0000 7fa55aec8640 1 -- start start 2024-04-26T23:40:42.402 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:42.394+0000 7fa55aec8640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa5440051c0 0x7fa554149c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:42.402 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:42.394+0000 7fa55aec8640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa5540c41c0 0x7fa5541efb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:42.402 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:42.394+0000 7fa55aec8640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa55414a1a0 0x7fa5541f00b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:42.402 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:42.394+0000 7fa55aec8640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fa554154540 con 0x7fa5540c41c0 2024-04-26T23:40:42.402 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:42.394+0000 7fa55aec8640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fa5541543c0 con 0x7fa55414a1a0 2024-04-26T23:40:42.402 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:42.394+0000 7fa55aec8640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fa55415a0c0 con 0x7fa5440051c0 2024-04-26T23:40:42.403 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:42.394+0000 7fa553fff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa5540c41c0 0x7fa5541efb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:42.403 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:42.394+0000 7fa553fff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa5540c41c0 0x7fa5541efb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:41810/0 (socket says 172.21.15.88:41810) 2024-04-26T23:40:42.403 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:42.394+0000 7fa553fff640 1 -- 172.21.15.88:0/2863404159 learned_addr learned my addr 172.21.15.88:0/2863404159 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:40:42.403 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:42.394+0000 7fa559465640 1 --2- 172.21.15.88:0/2863404159 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa55414a1a0 0x7fa5541f00b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:42.403 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:42.394+0000 7fa558c64640 1 --2- 172.21.15.88:0/2863404159 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa5440051c0 0x7fa554149c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:42.403 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:42.394+0000 7fa553fff640 1 -- 172.21.15.88:0/2863404159 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa5440051c0 msgr2=0x7fa554149c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:42.403 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:42.394+0000 7fa553fff640 1 --2- 172.21.15.88:0/2863404159 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa5440051c0 0x7fa554149c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:42.403 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:42.394+0000 7fa553fff640 1 -- 172.21.15.88:0/2863404159 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa55414a1a0 msgr2=0x7fa5541f00b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:42.403 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:42.394+0000 7fa553fff640 1 --2- 172.21.15.88:0/2863404159 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa55414a1a0 0x7fa5541f00b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:42.403 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:42.394+0000 7fa553fff640 1 -- 172.21.15.88:0/2863404159 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5540c38b0 con 0x7fa5540c41c0 2024-04-26T23:40:42.403 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:42.394+0000 7fa553fff640 1 --2- 172.21.15.88:0/2863404159 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa5540c41c0 0x7fa5541efb70 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fa540011990 tx=0x7fa540011e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:42.403 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:42.394+0000 7fa5517fa640 1 -- 172.21.15.88:0/2863404159 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa540019070 con 0x7fa5540c41c0 2024-04-26T23:40:42.403 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:42.394+0000 7fa5517fa640 1 -- 172.21.15.88:0/2863404159 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa540004240 con 0x7fa5540c41c0 2024-04-26T23:40:42.404 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:42.394+0000 7fa5517fa640 1 -- 172.21.15.88:0/2863404159 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa54000f800 con 0x7fa5540c41c0 2024-04-26T23:40:42.404 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:42.394+0000 7fa55aec8640 1 -- 172.21.15.88:0/2863404159 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5540c3b90 con 0x7fa5540c41c0 2024-04-26T23:40:42.404 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:42.394+0000 7fa55aec8640 1 -- 172.21.15.88:0/2863404159 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa554150090 con 0x7fa5540c41c0 2024-04-26T23:40:42.404 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:42.395+0000 7fa55aec8640 1 -- 172.21.15.88:0/2863404159 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa5540766c0 con 0x7fa5540c41c0 2024-04-26T23:40:42.404 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:42.396+0000 7fa5517fa640 1 -- 172.21.15.88:0/2863404159 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa54001c070 con 0x7fa5540c41c0 2024-04-26T23:40:42.404 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:42.396+0000 7fa5517fa640 1 --2- 172.21.15.88:0/2863404159 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fa53806c920 0x7fa53806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:42.404 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:42.396+0000 7fa5517fa640 1 -- 172.21.15.88:0/2863404159 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 6521+0+0 (secure 0 0 0) 0x7fa54008c230 con 0x7fa5540c41c0 2024-04-26T23:40:42.404 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:42.396+0000 7fa558c64640 1 --2- 172.21.15.88:0/2863404159 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fa53806c920 0x7fa53806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:42.404 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:42.397+0000 7fa558c64640 1 --2- 172.21.15.88:0/2863404159 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fa53806c920 0x7fa53806ede0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fa548000f60 tx=0x7fa548009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:42.404 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:42.400+0000 7fa5517fa640 1 -- 172.21.15.88:0/2863404159 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fa54005a330 con 0x7fa5540c41c0 2024-04-26T23:40:42.617 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:42.613+0000 7fa55aec8640 1 -- 172.21.15.88:0/2863404159 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "b", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fa5540c3690 con 0x7fa5540c41c0 2024-04-26T23:40:42.682 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:42.679+0000 7fa5517fa640 1 -- 172.21.15.88:0/2863404159 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "b", "var": "standby_count_wanted", "val": "0"}]=0 v10) ==== 113+0+0 (secure 0 0 0) 0x7fa540059c30 con 0x7fa5540c41c0 2024-04-26T23:40:42.685 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:42.680+0000 7fa55aec8640 1 -- 172.21.15.88:0/2863404159 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fa53806c920 msgr2=0x7fa53806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:42.685 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:42.680+0000 7fa55aec8640 1 --2- 172.21.15.88:0/2863404159 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fa53806c920 0x7fa53806ede0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fa548000f60 tx=0x7fa548009040 comp rx=0 tx=0).stop 2024-04-26T23:40:42.685 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:42.681+0000 7fa55aec8640 1 -- 172.21.15.88:0/2863404159 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa5540c41c0 msgr2=0x7fa5541efb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:42.685 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:42.681+0000 7fa55aec8640 1 --2- 172.21.15.88:0/2863404159 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa5540c41c0 0x7fa5541efb70 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fa540011990 tx=0x7fa540011e50 comp rx=0 tx=0).stop 2024-04-26T23:40:42.685 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:42.681+0000 7fa55aec8640 1 -- 172.21.15.88:0/2863404159 shutdown_connections 2024-04-26T23:40:42.685 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:42.681+0000 7fa55aec8640 1 --2- 172.21.15.88:0/2863404159 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fa53806c920 0x7fa53806ede0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:42.685 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:42.681+0000 7fa55aec8640 1 --2- 172.21.15.88:0/2863404159 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa55414a1a0 0x7fa5541f00b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:42.685 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:42.681+0000 7fa55aec8640 1 --2- 172.21.15.88:0/2863404159 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa5540c41c0 0x7fa5541efb70 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:42.685 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:42.681+0000 7fa55aec8640 1 --2- 172.21.15.88:0/2863404159 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa5440051c0 0x7fa554149c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:42.685 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:42.681+0000 7fa55aec8640 1 -- 172.21.15.88:0/2863404159 >> 172.21.15.88:0/2863404159 conn(0x7fa5540ae0b0 msgr2=0x7fa5540ae490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:40:42.685 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:42.681+0000 7fa55aec8640 1 -- 172.21.15.88:0/2863404159 shutdown_connections 2024-04-26T23:40:42.686 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:42.681+0000 7fa55aec8640 1 -- 172.21.15.88:0/2863404159 wait complete. 2024-04-26T23:40:42.696 DEBUG:tasks.cephfs.filesystem:fs_config: {'session_timeout': 300} 2024-04-26T23:40:42.696 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set b allow_standby_replay false 2024-04-26T23:40:42.795 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:42.791+0000 7f29e33c9640 1 Processor -- start 2024-04-26T23:40:42.795 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:42.791+0000 7f29e33c9640 1 -- start start 2024-04-26T23:40:42.797 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:42.792+0000 7f29e33c9640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f29dc0aecf0 0x7f29dc0c3800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:42.797 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:42.792+0000 7f29e33c9640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f29dc0c3d40 0x7f29dc074180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:42.797 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:42.792+0000 7f29e33c9640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f29dc156f60 con 0x7f29dc0c4820 2024-04-26T23:40:42.797 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:42.792+0000 7f29e33c9640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f29dc157240 con 0x7f29dc0c3d40 2024-04-26T23:40:42.797 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:42.792+0000 7f29e33c9640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f29dc157520 con 0x7f29dc0aecf0 2024-04-26T23:40:42.797 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:42.792+0000 7f29e1966640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f29dc0c3d40 0x7f29dc074180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:42.797 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:42.792+0000 7f29e1966640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f29dc0c3d40 0x7f29dc074180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:41820/0 (socket says 172.21.15.88:41820) 2024-04-26T23:40:42.797 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:42.792+0000 7f29e1966640 1 -- 172.21.15.88:0/2413152450 learned_addr learned my addr 172.21.15.88:0/2413152450 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:40:42.797 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:42.792+0000 7f29e1165640 1 --2- 172.21.15.88:0/2413152450 >> v2:172.21.15.175:3300/0 conn(0x7f29dc0aecf0 0x7f29dc0c3800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:42.797 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:42.792+0000 7f29e1966640 1 -- 172.21.15.88:0/2413152450 >> v2:172.21.15.175:3300/0 conn(0x7f29dc0aecf0 msgr2=0x7f29dc0c3800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:40:42.797 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:42.792+0000 7f29e1966640 1 --2- 172.21.15.88:0/2413152450 >> v2:172.21.15.175:3300/0 conn(0x7f29dc0aecf0 0x7f29dc0c3800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:42.797 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:42.792+0000 7f29e1966640 1 -- 172.21.15.88:0/2413152450 >> v1:172.21.15.175:6789/0 conn(0x7f29dc0c4820 legacy=0x7f29dc073a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:42.797 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:42.792+0000 7f29e1966640 1 -- 172.21.15.88:0/2413152450 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29dc157800 con 0x7f29dc0c3d40 2024-04-26T23:40:42.798 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:42.793+0000 7f29e1966640 1 --2- 172.21.15.88:0/2413152450 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f29dc0c3d40 0x7f29dc074180 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f29dc0cb340 tx=0x7f29d402a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a97409105c30cb47 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:42.798 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:42.793+0000 7f29d3fff640 1 -- 172.21.15.88:0/2413152450 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29d4036070 con 0x7f29dc0c3d40 2024-04-26T23:40:42.798 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:42.793+0000 7f29d3fff640 1 -- 172.21.15.88:0/2413152450 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29d4031600 con 0x7f29dc0c3d40 2024-04-26T23:40:42.798 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:42.793+0000 7f29d3fff640 1 -- 172.21.15.88:0/2413152450 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29d40319d0 con 0x7f29dc0c3d40 2024-04-26T23:40:42.800 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:42.793+0000 7f29e33c9640 1 -- 172.21.15.88:0/2413152450 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f29dc0c3d40 msgr2=0x7f29dc074180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:42.800 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:42.793+0000 7f29e33c9640 1 --2- 172.21.15.88:0/2413152450 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f29dc0c3d40 0x7f29dc074180 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f29dc0cb340 tx=0x7f29d402a6a0 comp rx=0 tx=0).stop 2024-04-26T23:40:42.801 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:42.794+0000 7f29e33c9640 1 -- 172.21.15.88:0/2413152450 shutdown_connections 2024-04-26T23:40:42.801 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:42.794+0000 7f29e33c9640 1 --2- 172.21.15.88:0/2413152450 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f29dc0c3d40 0x7f29dc074180 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:42.801 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:42.794+0000 7f29e33c9640 1 --2- 172.21.15.88:0/2413152450 >> v2:172.21.15.175:3300/0 conn(0x7f29dc0aecf0 0x7f29dc0c3800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:42.801 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:42.794+0000 7f29e33c9640 1 -- 172.21.15.88:0/2413152450 >> 172.21.15.88:0/2413152450 conn(0x7f29dc0c6ed0 msgr2=0x7f29dc0c72b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:40:42.801 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:42.794+0000 7f29e33c9640 1 -- 172.21.15.88:0/2413152450 shutdown_connections 2024-04-26T23:40:42.801 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:42.794+0000 7f29e33c9640 1 -- 172.21.15.88:0/2413152450 wait complete. 2024-04-26T23:40:42.801 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:42.795+0000 7f29e33c9640 1 Processor -- start 2024-04-26T23:40:42.801 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:42.795+0000 7f29e33c9640 1 -- start start 2024-04-26T23:40:42.801 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:42.795+0000 7f29e33c9640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f29dc0aecf0 0x7f29dc1efc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:42.801 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:42.795+0000 7f29e33c9640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f29dc0c3d40 0x7f29dc158240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:42.801 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:42.795+0000 7f29e33c9640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f29dc0c4820 0x7f29dc158780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:42.801 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:42.795+0000 7f29e33c9640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f29dc156c10 con 0x7f29dc0aecf0 2024-04-26T23:40:42.801 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:42.795+0000 7f29e33c9640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f29dc0746c0 con 0x7f29dc0c4820 2024-04-26T23:40:42.801 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:42.795+0000 7f29e33c9640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f29dc0af0d0 con 0x7f29dc0c3d40 2024-04-26T23:40:42.802 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:42.795+0000 7f29e1165640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f29dc0aecf0 0x7f29dc1efc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:42.802 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:42.795+0000 7f29e1165640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f29dc0aecf0 0x7f29dc1efc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:41830/0 (socket says 172.21.15.88:41830) 2024-04-26T23:40:42.802 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:42.795+0000 7f29e1165640 1 -- 172.21.15.88:0/4100640006 learned_addr learned my addr 172.21.15.88:0/4100640006 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:40:42.802 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:42.796+0000 7f29e0964640 1 --2- 172.21.15.88:0/4100640006 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f29dc0c3d40 0x7f29dc158240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:42.802 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:42.796+0000 7f29e1966640 1 --2- 172.21.15.88:0/4100640006 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f29dc0c4820 0x7f29dc158780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:42.802 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:42.796+0000 7f29e1165640 1 -- 172.21.15.88:0/4100640006 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f29dc0c3d40 msgr2=0x7f29dc158240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:42.802 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:42.796+0000 7f29e1165640 1 --2- 172.21.15.88:0/4100640006 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f29dc0c3d40 0x7f29dc158240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:42.802 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:42.796+0000 7f29e1165640 1 -- 172.21.15.88:0/4100640006 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f29dc0c4820 msgr2=0x7f29dc158780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:42.802 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:42.796+0000 7f29e1165640 1 --2- 172.21.15.88:0/4100640006 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f29dc0c4820 0x7f29dc158780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:42.802 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:42.796+0000 7f29e1165640 1 -- 172.21.15.88:0/4100640006 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29dc1f0630 con 0x7f29dc0aecf0 2024-04-26T23:40:42.802 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:42.796+0000 7f29e1165640 1 --2- 172.21.15.88:0/4100640006 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f29dc0aecf0 0x7f29dc1efc40 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f29d800d800 tx=0x7f29d800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:42.802 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:42.796+0000 7f29d1ffb640 1 -- 172.21.15.88:0/4100640006 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29d800b6c0 con 0x7f29dc0aecf0 2024-04-26T23:40:42.802 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:42.796+0000 7f29d1ffb640 1 -- 172.21.15.88:0/4100640006 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29d8019070 con 0x7f29dc0aecf0 2024-04-26T23:40:42.802 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:42.796+0000 7f29e33c9640 1 -- 172.21.15.88:0/4100640006 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29dc0c8f20 con 0x7f29dc0aecf0 2024-04-26T23:40:42.803 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:42.796+0000 7f29d1ffb640 1 -- 172.21.15.88:0/4100640006 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29d800bac0 con 0x7f29dc0aecf0 2024-04-26T23:40:42.803 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:42.796+0000 7f29e33c9640 1 -- 172.21.15.88:0/4100640006 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29dc0c81f0 con 0x7f29dc0aecf0 2024-04-26T23:40:42.803 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:42.797+0000 7f29e33c9640 1 -- 172.21.15.88:0/4100640006 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f29dc0507a0 con 0x7f29dc0aecf0 2024-04-26T23:40:42.804 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:42.797+0000 7f29d1ffb640 1 -- 172.21.15.88:0/4100640006 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f29d800bc60 con 0x7f29dc0aecf0 2024-04-26T23:40:42.804 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:42.798+0000 7f29d1ffb640 1 --2- 172.21.15.88:0/4100640006 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f29c006c8f0 0x7f29c006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:42.804 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:42.798+0000 7f29d1ffb640 1 -- 172.21.15.88:0/4100640006 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7f29d808c2f0 con 0x7f29dc0aecf0 2024-04-26T23:40:42.804 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:42.798+0000 7f29e0964640 1 --2- 172.21.15.88:0/4100640006 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f29c006c8f0 0x7f29c006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:42.804 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:42.798+0000 7f29e0964640 1 --2- 172.21.15.88:0/4100640006 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f29c006c8f0 0x7f29c006edb0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f29cc007fd0 tx=0x7f29cc009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:42.806 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:42.802+0000 7f29d1ffb640 1 -- 172.21.15.88:0/4100640006 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f29d805a480 con 0x7f29dc0aecf0 2024-04-26T23:40:43.019 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:43.015+0000 7f29e33c9640 1 -- 172.21.15.88:0/4100640006 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "b", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f29dc0c4600 con 0x7f29dc0aecf0 2024-04-26T23:40:43.684 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:43.680+0000 7f29d1ffb640 1 -- 172.21.15.88:0/4100640006 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "b", "var": "allow_standby_replay", "val": "false"}]=0 v11) ==== 117+0+0 (secure 0 0 0) 0x7f29d8059d80 con 0x7f29dc0aecf0 2024-04-26T23:40:43.687 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:43.682+0000 7f29e33c9640 1 -- 172.21.15.88:0/4100640006 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f29c006c8f0 msgr2=0x7f29c006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:43.687 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:43.682+0000 7f29e33c9640 1 --2- 172.21.15.88:0/4100640006 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f29c006c8f0 0x7f29c006edb0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f29cc007fd0 tx=0x7f29cc009040 comp rx=0 tx=0).stop 2024-04-26T23:40:43.687 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:43.682+0000 7f29e33c9640 1 -- 172.21.15.88:0/4100640006 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f29dc0aecf0 msgr2=0x7f29dc1efc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:43.687 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:43.682+0000 7f29e33c9640 1 --2- 172.21.15.88:0/4100640006 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f29dc0aecf0 0x7f29dc1efc40 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f29d800d800 tx=0x7f29d800dcc0 comp rx=0 tx=0).stop 2024-04-26T23:40:43.687 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:43.683+0000 7f29e33c9640 1 -- 172.21.15.88:0/4100640006 shutdown_connections 2024-04-26T23:40:43.687 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:43.683+0000 7f29e33c9640 1 --2- 172.21.15.88:0/4100640006 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f29c006c8f0 0x7f29c006edb0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:43.687 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:43.683+0000 7f29e33c9640 1 --2- 172.21.15.88:0/4100640006 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f29dc0c3d40 0x7f29dc158240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:43.687 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:43.683+0000 7f29e33c9640 1 --2- 172.21.15.88:0/4100640006 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f29dc0c4820 0x7f29dc158780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:43.687 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:43.683+0000 7f29e33c9640 1 --2- 172.21.15.88:0/4100640006 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f29dc0aecf0 0x7f29dc1efc40 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:43.687 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:43.683+0000 7f29e33c9640 1 -- 172.21.15.88:0/4100640006 >> 172.21.15.88:0/4100640006 conn(0x7f29dc0c6ed0 msgr2=0x7f29dc0ac140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:40:43.687 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:43.683+0000 7f29e33c9640 1 -- 172.21.15.88:0/4100640006 shutdown_connections 2024-04-26T23:40:43.687 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:43.683+0000 7f29e33c9640 1 -- 172.21.15.88:0/4100640006 wait complete. 2024-04-26T23:40:43.699 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set b session_timeout 300 2024-04-26T23:40:43.802 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:43.799+0000 7f1a6046b640 1 Processor -- start 2024-04-26T23:40:43.803 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:43.799+0000 7f1a6046b640 1 -- start start 2024-04-26T23:40:43.804 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:43.800+0000 7f1a6046b640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f1a580c6e20 0x7f1a580c7200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:43.804 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:43.800+0000 7f1a6046b640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f1a580740e0 0x7f1a58156f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:43.805 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:43.800+0000 7f1a6046b640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1a5815a530 con 0x7f1a580ca3a0 2024-04-26T23:40:43.805 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:43.800+0000 7f1a6046b640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f1a58072930 con 0x7f1a580c6e20 2024-04-26T23:40:43.805 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:43.800+0000 7f1a6046b640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f1a5815a810 con 0x7f1a580740e0 2024-04-26T23:40:43.805 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:43.800+0000 7f1a5e207640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f1a580c6e20 0x7f1a580c7200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:43.805 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:43.800+0000 7f1a5e207640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f1a580c6e20 0x7f1a580c7200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:41840/0 (socket says 172.21.15.88:41840) 2024-04-26T23:40:43.805 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:43.800+0000 7f1a5ea08640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f1a580ca3a0 0x7f1a58157460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:39482/0 (socket says 172.21.15.88:39482) 2024-04-26T23:40:43.805 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:43.800+0000 7f1a5e207640 1 -- 172.21.15.88:0/1986070308 learned_addr learned my addr 172.21.15.88:0/1986070308 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:40:43.805 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:43.800+0000 7f1a5da06640 1 --2- 172.21.15.88:0/1986070308 >> v2:172.21.15.175:3300/0 conn(0x7f1a580740e0 0x7f1a58156f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:43.805 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:43.800+0000 7f1a5e207640 1 -- 172.21.15.88:0/1986070308 >> v2:172.21.15.175:3300/0 conn(0x7f1a580740e0 msgr2=0x7f1a58156f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:40:43.805 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:43.800+0000 7f1a5e207640 1 --2- 172.21.15.88:0/1986070308 >> v2:172.21.15.175:3300/0 conn(0x7f1a580740e0 0x7f1a58156f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:43.805 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:43.800+0000 7f1a5e207640 1 -- 172.21.15.88:0/1986070308 >> v1:172.21.15.88:6789/0 conn(0x7f1a580ca3a0 legacy=0x7f1a58157460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:43.805 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:43.800+0000 7f1a5e207640 1 -- 172.21.15.88:0/1986070308 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a5815aaf0 con 0x7f1a580c6e20 2024-04-26T23:40:43.805 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:43.800+0000 7f1a5d205640 1 -- 172.21.15.88:0/1986070308 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3914137760 0 0) 0x7f1a5815a530 con 0x7f1a580ca3a0 2024-04-26T23:40:43.805 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:43.801+0000 7f1a5e207640 1 --2- 172.21.15.88:0/1986070308 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1a580c6e20 0x7f1a580c7200 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f1a580abfd0 tx=0x7f1a5402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8573b882cae071a7 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:43.805 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:43.801+0000 7f1a5d205640 1 -- 172.21.15.88:0/1986070308 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a54037070 con 0x7f1a580c6e20 2024-04-26T23:40:43.806 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:43.801+0000 7f1a5d205640 1 -- 172.21.15.88:0/1986070308 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a54032440 con 0x7f1a580c6e20 2024-04-26T23:40:43.806 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:43.801+0000 7f1a5d205640 1 -- 172.21.15.88:0/1986070308 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a54032810 con 0x7f1a580c6e20 2024-04-26T23:40:43.809 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:43.801+0000 7f1a6046b640 1 -- 172.21.15.88:0/1986070308 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1a580c6e20 msgr2=0x7f1a580c7200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:43.809 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:43.801+0000 7f1a6046b640 1 --2- 172.21.15.88:0/1986070308 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1a580c6e20 0x7f1a580c7200 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f1a580abfd0 tx=0x7f1a5402a1e0 comp rx=0 tx=0).stop 2024-04-26T23:40:43.809 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:43.801+0000 7f1a6046b640 1 -- 172.21.15.88:0/1986070308 shutdown_connections 2024-04-26T23:40:43.809 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:43.801+0000 7f1a6046b640 1 --2- 172.21.15.88:0/1986070308 >> v2:172.21.15.175:3300/0 conn(0x7f1a580740e0 0x7f1a58156f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:43.809 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:43.801+0000 7f1a6046b640 1 --2- 172.21.15.88:0/1986070308 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1a580c6e20 0x7f1a580c7200 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:43.809 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:43.801+0000 7f1a6046b640 1 -- 172.21.15.88:0/1986070308 >> 172.21.15.88:0/1986070308 conn(0x7f1a580ae0b0 msgr2=0x7f1a580ae490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:40:43.809 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:43.801+0000 7f1a6046b640 1 -- 172.21.15.88:0/1986070308 shutdown_connections 2024-04-26T23:40:43.809 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:43.801+0000 7f1a6046b640 1 -- 172.21.15.88:0/1986070308 wait complete. 2024-04-26T23:40:43.809 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:43.802+0000 7f1a6046b640 1 Processor -- start 2024-04-26T23:40:43.810 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:43.803+0000 7f1a6046b640 1 -- start start 2024-04-26T23:40:43.810 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:43.803+0000 7f1a6046b640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1a580740e0 0x7f1a581ed350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:43.810 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:43.803+0000 7f1a6046b640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1a580c6e20 0x7f1a580c25e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:43.810 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:43.803+0000 7f1a6046b640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1a580ca3a0 0x7f1a58154940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:43.810 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:43.803+0000 7f1a6046b640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f1a58154540 con 0x7f1a580ca3a0 2024-04-26T23:40:43.810 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:43.803+0000 7f1a6046b640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f1a581543c0 con 0x7f1a580740e0 2024-04-26T23:40:43.810 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:43.803+0000 7f1a6046b640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f1a5815a0c0 con 0x7f1a580c6e20 2024-04-26T23:40:43.810 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:43.803+0000 7f1a5ea08640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1a580ca3a0 0x7f1a58154940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:43.810 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:43.803+0000 7f1a5ea08640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1a580ca3a0 0x7f1a58154940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:41856/0 (socket says 172.21.15.88:41856) 2024-04-26T23:40:43.810 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:43.803+0000 7f1a5ea08640 1 -- 172.21.15.88:0/1431663650 learned_addr learned my addr 172.21.15.88:0/1431663650 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:40:43.810 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:43.803+0000 7f1a5e207640 1 --2- 172.21.15.88:0/1431663650 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1a580740e0 0x7f1a581ed350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:43.810 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:43.804+0000 7f1a5da06640 1 --2- 172.21.15.88:0/1431663650 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1a580c6e20 0x7f1a580c25e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:43.810 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:43.804+0000 7f1a5ea08640 1 -- 172.21.15.88:0/1431663650 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1a580c6e20 msgr2=0x7f1a580c25e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:43.810 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:43.804+0000 7f1a5ea08640 1 --2- 172.21.15.88:0/1431663650 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1a580c6e20 0x7f1a580c25e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:43.811 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:43.804+0000 7f1a5ea08640 1 -- 172.21.15.88:0/1431663650 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1a580740e0 msgr2=0x7f1a581ed350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:43.811 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:43.804+0000 7f1a5ea08640 1 --2- 172.21.15.88:0/1431663650 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1a580740e0 0x7f1a581ed350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:43.811 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:43.804+0000 7f1a5ea08640 1 -- 172.21.15.88:0/1431663650 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a581e0380 con 0x7f1a580ca3a0 2024-04-26T23:40:43.811 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:43.804+0000 7f1a5da06640 1 --2- 172.21.15.88:0/1431663650 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1a580c6e20 0x7f1a580c25e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:40:43.811 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:43.804+0000 7f1a5ea08640 1 --2- 172.21.15.88:0/1431663650 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1a580ca3a0 0x7f1a58154940 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f1a5000c730 tx=0x7f1a5000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:43.811 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:43.804+0000 7f1a4effd640 1 -- 172.21.15.88:0/1431663650 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a50018070 con 0x7f1a580ca3a0 2024-04-26T23:40:43.811 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:43.804+0000 7f1a4effd640 1 -- 172.21.15.88:0/1431663650 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a5000ce40 con 0x7f1a580ca3a0 2024-04-26T23:40:43.811 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:43.804+0000 7f1a6046b640 1 -- 172.21.15.88:0/1431663650 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a581e0660 con 0x7f1a580ca3a0 2024-04-26T23:40:43.812 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:43.804+0000 7f1a4effd640 1 -- 172.21.15.88:0/1431663650 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a5000a860 con 0x7f1a580ca3a0 2024-04-26T23:40:43.812 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:43.804+0000 7f1a6046b640 1 -- 172.21.15.88:0/1431663650 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a581ecb50 con 0x7f1a580ca3a0 2024-04-26T23:40:43.812 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:43.805+0000 7f1a6046b640 1 -- 172.21.15.88:0/1431663650 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a580766c0 con 0x7f1a580ca3a0 2024-04-26T23:40:43.812 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:43.805+0000 7f1a4effd640 1 -- 172.21.15.88:0/1431663650 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f1a5001b070 con 0x7f1a580ca3a0 2024-04-26T23:40:43.813 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:43.806+0000 7f1a4effd640 1 --2- 172.21.15.88:0/1431663650 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f1a3c06c8f0 0x7f1a3c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:43.813 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:43.806+0000 7f1a5e207640 1 --2- 172.21.15.88:0/1431663650 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f1a3c06c8f0 0x7f1a3c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:43.813 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:43.806+0000 7f1a4effd640 1 -- 172.21.15.88:0/1431663650 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7f1a5008b3f0 con 0x7f1a580ca3a0 2024-04-26T23:40:43.813 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:43.806+0000 7f1a5e207640 1 --2- 172.21.15.88:0/1431663650 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f1a3c06c8f0 0x7f1a3c06edb0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f1a54034000 tx=0x7f1a5402e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:43.813 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:43.810+0000 7f1a4effd640 1 -- 172.21.15.88:0/1431663650 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f1a50059580 con 0x7f1a580ca3a0 2024-04-26T23:40:44.029 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:44.025+0000 7f1a6046b640 1 -- 172.21.15.88:0/1431663650 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "b", "var": "session_timeout", "val": "300"} v 0) -- 0x7f1a580ae590 con 0x7f1a580ca3a0 2024-04-26T23:40:44.696 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:44.693+0000 7f1a4effd640 1 -- 172.21.15.88:0/1431663650 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "b", "var": "session_timeout", "val": "300"}]=0 v12) ==== 110+0+0 (secure 0 0 0) 0x7f1a50058e80 con 0x7f1a580ca3a0 2024-04-26T23:40:44.699 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:44.695+0000 7f1a6046b640 1 -- 172.21.15.88:0/1431663650 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f1a3c06c8f0 msgr2=0x7f1a3c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:44.699 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:44.695+0000 7f1a6046b640 1 --2- 172.21.15.88:0/1431663650 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f1a3c06c8f0 0x7f1a3c06edb0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f1a54034000 tx=0x7f1a5402e000 comp rx=0 tx=0).stop 2024-04-26T23:40:44.700 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:44.695+0000 7f1a6046b640 1 -- 172.21.15.88:0/1431663650 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1a580ca3a0 msgr2=0x7f1a58154940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:44.700 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:44.695+0000 7f1a6046b640 1 --2- 172.21.15.88:0/1431663650 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1a580ca3a0 0x7f1a58154940 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f1a5000c730 tx=0x7f1a5000cbf0 comp rx=0 tx=0).stop 2024-04-26T23:40:44.700 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:44.695+0000 7f1a6046b640 1 -- 172.21.15.88:0/1431663650 shutdown_connections 2024-04-26T23:40:44.700 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:44.695+0000 7f1a6046b640 1 --2- 172.21.15.88:0/1431663650 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f1a3c06c8f0 0x7f1a3c06edb0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:44.700 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:44.695+0000 7f1a6046b640 1 --2- 172.21.15.88:0/1431663650 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1a580c6e20 0x7f1a580c25e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:44.700 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:44.695+0000 7f1a6046b640 1 --2- 172.21.15.88:0/1431663650 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1a580ca3a0 0x7f1a58154940 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:44.700 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:44.695+0000 7f1a6046b640 1 --2- 172.21.15.88:0/1431663650 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1a580740e0 0x7f1a581ed350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:44.700 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:44.695+0000 7f1a6046b640 1 -- 172.21.15.88:0/1431663650 >> 172.21.15.88:0/1431663650 conn(0x7f1a580ae0b0 msgr2=0x7f1a580c8eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:40:44.700 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:44.695+0000 7f1a6046b640 1 -- 172.21.15.88:0/1431663650 shutdown_connections 2024-04-26T23:40:44.700 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:44.695+0000 7f1a6046b640 1 -- 172.21.15.88:0/1431663650 wait complete. 2024-04-26T23:40:44.712 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'b' 2024-04-26T23:40:44.712 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T23:40:44.815 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:44.810+0000 7f0019cf8640 1 Processor -- start 2024-04-26T23:40:44.816 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:44.810+0000 7f0019cf8640 1 -- start start 2024-04-26T23:40:44.816 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:44.811+0000 7f0019cf8640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f00140c4250 0x7f00140c3790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:44.816 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:44.811+0000 7f0019cf8640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f00140c3cd0 0x7f00141572e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:44.816 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:44.811+0000 7f0019cf8640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f00140ad010 con 0x7f00140acc30 2024-04-26T23:40:44.816 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:44.811+0000 7f0019cf8640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f00140c8ba0 con 0x7f00140c3cd0 2024-04-26T23:40:44.816 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:44.811+0000 7f0019cf8640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f0014156e50 con 0x7f00140c4250 2024-04-26T23:40:44.816 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:44.811+0000 7f0013fff640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f00140c3cd0 0x7f00141572e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:44.816 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:44.811+0000 7f0013fff640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f00140c3cd0 0x7f00141572e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:41870/0 (socket says 172.21.15.88:41870) 2024-04-26T23:40:44.816 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:44.811+0000 7f0013fff640 1 -- 172.21.15.88:0/1011587570 learned_addr learned my addr 172.21.15.88:0/1011587570 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:40:44.816 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:44.811+0000 7f0013fff640 1 -- 172.21.15.88:0/1011587570 >> v2:172.21.15.175:3300/0 conn(0x7f00140c4250 msgr2=0x7f00140c3790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:40:44.816 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:44.811+0000 7f0013fff640 1 --2- 172.21.15.88:0/1011587570 >> v2:172.21.15.175:3300/0 conn(0x7f00140c4250 0x7f00140c3790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:44.816 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:44.811+0000 7f0013fff640 1 -- 172.21.15.88:0/1011587570 >> v1:172.21.15.175:6789/0 conn(0x7f00140acc30 legacy=0x7f001415abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:40:44.816 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:44.811+0000 7f0013fff640 1 -- 172.21.15.88:0/1011587570 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00140c8300 con 0x7f00140c3cd0 2024-04-26T23:40:44.820 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:44.812+0000 7f0013fff640 1 --2- 172.21.15.88:0/1011587570 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f00140c3cd0 0x7f00141572e0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f0014071a50 tx=0x7f000c02a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2ee0b02c87520b8 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:44.820 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:44.812+0000 7f00127fc640 1 -- 172.21.15.88:0/1011587570 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f000c036070 con 0x7f00140c3cd0 2024-04-26T23:40:44.820 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:44.812+0000 7f00127fc640 1 -- 172.21.15.88:0/1011587570 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f000c031600 con 0x7f00140c3cd0 2024-04-26T23:40:44.821 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:44.812+0000 7f00127fc640 1 -- 172.21.15.88:0/1011587570 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f000c0319d0 con 0x7f00140c3cd0 2024-04-26T23:40:44.821 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:44.812+0000 7f0019cf8640 1 -- 172.21.15.88:0/1011587570 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f00140c3cd0 msgr2=0x7f00141572e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:44.821 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:44.812+0000 7f0019cf8640 1 --2- 172.21.15.88:0/1011587570 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f00140c3cd0 0x7f00141572e0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f0014071a50 tx=0x7f000c02a660 comp rx=0 tx=0).stop 2024-04-26T23:40:44.821 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:44.812+0000 7f0019cf8640 1 -- 172.21.15.88:0/1011587570 shutdown_connections 2024-04-26T23:40:44.821 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:44.812+0000 7f0019cf8640 1 --2- 172.21.15.88:0/1011587570 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f00140c3cd0 0x7f00141572e0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:44.821 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:44.812+0000 7f0019cf8640 1 --2- 172.21.15.88:0/1011587570 >> v2:172.21.15.175:3300/0 conn(0x7f00140c4250 0x7f00140c3790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:44.821 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:44.812+0000 7f0019cf8640 1 -- 172.21.15.88:0/1011587570 >> 172.21.15.88:0/1011587570 conn(0x7f00140c6e60 msgr2=0x7f00140c7270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:40:44.821 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:44.812+0000 7f0019cf8640 1 -- 172.21.15.88:0/1011587570 shutdown_connections 2024-04-26T23:40:44.821 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:44.812+0000 7f0019cf8640 1 -- 172.21.15.88:0/1011587570 wait complete. 2024-04-26T23:40:44.821 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:44.813+0000 7f0019cf8640 1 Processor -- start 2024-04-26T23:40:44.821 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:44.814+0000 7f0019cf8640 1 -- start start 2024-04-26T23:40:44.821 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:44.814+0000 7f0019cf8640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f00140acc30 0x7f00141e04c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:44.821 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:44.814+0000 7f0019cf8640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f00140c3cd0 0x7f00140c5a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:44.822 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:44.814+0000 7f0019cf8640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f00140c4250 0x7f001414ae60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:44.822 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:44.814+0000 7f0019cf8640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f00140abec0 con 0x7f00140c3cd0 2024-04-26T23:40:44.822 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:44.814+0000 7f0019cf8640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f00140c88c0 con 0x7f00140acc30 2024-04-26T23:40:44.822 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:44.814+0000 7f0019cf8640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f00140ac040 con 0x7f00140c4250 2024-04-26T23:40:44.822 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:44.814+0000 7f0012ffd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f00140c3cd0 0x7f00140c5a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:44.822 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:44.814+0000 7f0012ffd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f00140c3cd0 0x7f00140c5a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:41886/0 (socket says 172.21.15.88:41886) 2024-04-26T23:40:44.822 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:44.814+0000 7f0012ffd640 1 -- 172.21.15.88:0/2533743414 learned_addr learned my addr 172.21.15.88:0/2533743414 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:40:44.822 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:44.815+0000 7f00137fe640 1 --2- 172.21.15.88:0/2533743414 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f00140acc30 0x7f00141e04c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:44.822 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:44.815+0000 7f0013fff640 1 --2- 172.21.15.88:0/2533743414 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f00140c4250 0x7f001414ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:44.822 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:44.815+0000 7f0012ffd640 1 -- 172.21.15.88:0/2533743414 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f00140c4250 msgr2=0x7f001414ae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:44.822 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:44.815+0000 7f0012ffd640 1 --2- 172.21.15.88:0/2533743414 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f00140c4250 0x7f001414ae60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:44.822 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:44.815+0000 7f0012ffd640 1 -- 172.21.15.88:0/2533743414 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f00140acc30 msgr2=0x7f00141e04c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:44.822 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:44.815+0000 7f0012ffd640 1 --2- 172.21.15.88:0/2533743414 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f00140acc30 0x7f00141e04c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:44.822 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:44.815+0000 7f0012ffd640 1 -- 172.21.15.88:0/2533743414 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f001414bb00 con 0x7f00140c3cd0 2024-04-26T23:40:44.823 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:44.815+0000 7f0013fff640 1 --2- 172.21.15.88:0/2533743414 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f00140c4250 0x7f001414ae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:40:44.823 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:44.815+0000 7f00137fe640 1 --2- 172.21.15.88:0/2533743414 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f00140acc30 0x7f00141e04c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:40:44.823 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:44.815+0000 7f0012ffd640 1 --2- 172.21.15.88:0/2533743414 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f00140c3cd0 0x7f00140c5a50 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f000800b440 tx=0x7f000800b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:44.823 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:44.815+0000 7efffbfff640 1 -- 172.21.15.88:0/2533743414 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0008015020 con 0x7f00140c3cd0 2024-04-26T23:40:44.823 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:44.815+0000 7efffbfff640 1 -- 172.21.15.88:0/2533743414 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0008011890 con 0x7f00140c3cd0 2024-04-26T23:40:44.823 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:44.815+0000 7f0019cf8640 1 -- 172.21.15.88:0/2533743414 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0014159de0 con 0x7f00140c3cd0 2024-04-26T23:40:44.823 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:44.815+0000 7efffbfff640 1 -- 172.21.15.88:0/2533743414 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0008011c80 con 0x7f00140c3cd0 2024-04-26T23:40:44.823 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:44.815+0000 7f0019cf8640 1 -- 172.21.15.88:0/2533743414 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00141f0570 con 0x7f00140c3cd0 2024-04-26T23:40:44.823 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:44.816+0000 7f0019cf8640 1 -- 172.21.15.88:0/2533743414 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0014159bd0 con 0x7f00140c3cd0 2024-04-26T23:40:44.823 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:44.817+0000 7efffbfff640 1 -- 172.21.15.88:0/2533743414 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f0008018020 con 0x7f00140c3cd0 2024-04-26T23:40:44.824 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:44.817+0000 7efffbfff640 1 --2- 172.21.15.88:0/2533743414 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f000006c8f0 0x7f000006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:44.824 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:44.817+0000 7efffbfff640 1 -- 172.21.15.88:0/2533743414 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7f000808bf90 con 0x7f00140c3cd0 2024-04-26T23:40:44.824 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:44.817+0000 7f00137fe640 1 --2- 172.21.15.88:0/2533743414 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f000006c8f0 0x7f000006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:44.824 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:44.818+0000 7f00137fe640 1 --2- 172.21.15.88:0/2533743414 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f000006c8f0 0x7f000006edb0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f00140c6400 tx=0x7f0004009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:44.825 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:44.821+0000 7efffbfff640 1 -- 172.21.15.88:0/2533743414 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f000801f020 con 0x7f00140c3cd0 2024-04-26T23:40:45.036 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.032+0000 7f0019cf8640 1 -- 172.21.15.88:0/2533743414 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f00141e4110 con 0x7f00140c3cd0 2024-04-26T23:40:45.037 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.033+0000 7efffbfff640 1 -- 172.21.15.88:0/2533743414 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+6488 (secure 0 0 0) 0x7f000800d040 con 0x7f00140c3cd0 2024-04-26T23:40:45.037 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-26T23:40:45.037 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":12,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6834/3199540397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":3199540397},{"type":"v1","addr":"172.21.15.175:6834","nonce":3199540397}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4270,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6837/2790134952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6835","nonce":2790134952},{"type":"v1","addr":"172.21.15.88:6837","nonce":2790134952}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T23:40:31.909505+0000","modified":"2024-04-26T23:40:34.974455+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4279},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4279":{"gid":4279,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.175:6835/3932058274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6833","nonce":3932058274},{"type":"v1","addr":"172.21.15.175:6835","nonce":3932058274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4279,"qdb_cluster":[4279]},"id":1},{"mdsmap":{"epoch":12,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T23:40:41.008364+0000","modified":"2024-04-26T23:40:44.027288+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4272":{"gid":4272,"name":"c","rank":0,"incarnation":9,"state":"up:active","state_seq":6,"addr":"172.21.15.88:6836/4159390276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6834","nonce":4159390276},{"type":"v1","addr":"172.21.15.88:6836","nonce":4159390276}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4272,"qdb_cluster":[4272]},"id":2}]} 2024-04-26T23:40:45.038 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 12 2024-04-26T23:40:45.039 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.035+0000 7f0019cf8640 1 -- 172.21.15.88:0/2533743414 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f000006c8f0 msgr2=0x7f000006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:45.039 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.035+0000 7f0019cf8640 1 --2- 172.21.15.88:0/2533743414 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f000006c8f0 0x7f000006edb0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f00140c6400 tx=0x7f0004009040 comp rx=0 tx=0).stop 2024-04-26T23:40:45.039 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.035+0000 7f0019cf8640 1 -- 172.21.15.88:0/2533743414 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f00140c3cd0 msgr2=0x7f00140c5a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:45.039 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.035+0000 7f0019cf8640 1 --2- 172.21.15.88:0/2533743414 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f00140c3cd0 0x7f00140c5a50 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f000800b440 tx=0x7f000800b900 comp rx=0 tx=0).stop 2024-04-26T23:40:45.039 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.035+0000 7f0019cf8640 1 -- 172.21.15.88:0/2533743414 shutdown_connections 2024-04-26T23:40:45.040 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.035+0000 7f0019cf8640 1 --2- 172.21.15.88:0/2533743414 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f000006c8f0 0x7f000006edb0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:45.040 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.035+0000 7f0019cf8640 1 --2- 172.21.15.88:0/2533743414 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f00140c4250 0x7f001414ae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:45.040 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.035+0000 7f0019cf8640 1 --2- 172.21.15.88:0/2533743414 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f00140c3cd0 0x7f00140c5a50 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:45.040 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.035+0000 7f0019cf8640 1 --2- 172.21.15.88:0/2533743414 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f00140acc30 0x7f00141e04c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:45.040 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.035+0000 7f0019cf8640 1 -- 172.21.15.88:0/2533743414 >> 172.21.15.88:0/2533743414 conn(0x7f00140c6e60 msgr2=0x7f00141572e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:40:45.040 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.035+0000 7f0019cf8640 1 -- 172.21.15.88:0/2533743414 shutdown_connections 2024-04-26T23:40:45.040 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.035+0000 7f0019cf8640 1 -- 172.21.15.88:0/2533743414 wait complete. 2024-04-26T23:40:45.050 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T23:40:45.146 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.142+0000 7fad9c586640 1 Processor -- start 2024-04-26T23:40:45.146 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.142+0000 7fad9c586640 1 -- start start 2024-04-26T23:40:45.148 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.143+0000 7fad9c586640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fad94071450 0x7fad941589c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:45.148 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.143+0000 7fad9c586640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fad94155060 0x7fad941554b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:45.148 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.143+0000 7fad9c586640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fad94071060 con 0x7fad94151ff0 2024-04-26T23:40:45.148 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.143+0000 7fad9c586640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7fad941559f0 con 0x7fad94071450 2024-04-26T23:40:45.148 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.143+0000 7fad9c586640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7fad94154bd0 con 0x7fad94155060 2024-04-26T23:40:45.148 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.143+0000 7fad99b21640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fad94071450 0x7fad941589c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:45.149 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.143+0000 7fad99b21640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fad94071450 0x7fad941589c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:41902/0 (socket says 172.21.15.88:41902) 2024-04-26T23:40:45.149 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.143+0000 7fad99b21640 1 -- 172.21.15.88:0/674163257 learned_addr learned my addr 172.21.15.88:0/674163257 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:40:45.149 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.143+0000 7fad9ab23640 1 --2- 172.21.15.88:0/674163257 >> v2:172.21.15.175:3300/0 conn(0x7fad94155060 0x7fad941554b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:45.149 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.144+0000 7fad99b21640 1 -- 172.21.15.88:0/674163257 >> v2:172.21.15.175:3300/0 conn(0x7fad94155060 msgr2=0x7fad941554b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:40:45.149 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.144+0000 7fad99b21640 1 --2- 172.21.15.88:0/674163257 >> v2:172.21.15.175:3300/0 conn(0x7fad94155060 0x7fad941554b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:45.149 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.144+0000 7fad99b21640 1 -- 172.21.15.88:0/674163257 >> v1:172.21.15.175:6789/0 conn(0x7fad94151ff0 legacy=0x7fad940c4dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:45.149 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.144+0000 7fad99b21640 1 -- 172.21.15.88:0/674163257 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad941523d0 con 0x7fad94071450 2024-04-26T23:40:45.149 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.144+0000 7fad99b21640 1 --2- 172.21.15.88:0/674163257 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fad94071450 0x7fad941589c0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fad84009870 tx=0x7fad8402a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab0d5a39c70a3dc4 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:45.149 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.144+0000 7fad99320640 1 -- 172.21.15.88:0/674163257 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad84037070 con 0x7fad94071450 2024-04-26T23:40:45.149 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.144+0000 7fad99320640 1 -- 172.21.15.88:0/674163257 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad84032440 con 0x7fad94071450 2024-04-26T23:40:45.149 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.144+0000 7fad99320640 1 -- 172.21.15.88:0/674163257 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad84032810 con 0x7fad94071450 2024-04-26T23:40:45.152 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.145+0000 7fad9c586640 1 -- 172.21.15.88:0/674163257 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fad94071450 msgr2=0x7fad941589c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:45.152 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.145+0000 7fad9c586640 1 --2- 172.21.15.88:0/674163257 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fad94071450 0x7fad941589c0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fad84009870 tx=0x7fad8402a210 comp rx=0 tx=0).stop 2024-04-26T23:40:45.152 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.145+0000 7fad9c586640 1 -- 172.21.15.88:0/674163257 shutdown_connections 2024-04-26T23:40:45.153 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.145+0000 7fad9c586640 1 --2- 172.21.15.88:0/674163257 >> v2:172.21.15.175:3300/0 conn(0x7fad94155060 0x7fad941554b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:45.153 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.145+0000 7fad9c586640 1 --2- 172.21.15.88:0/674163257 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fad94071450 0x7fad941589c0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:45.153 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.145+0000 7fad9c586640 1 -- 172.21.15.88:0/674163257 >> 172.21.15.88:0/674163257 conn(0x7fad940ca3d0 msgr2=0x7fad940ca7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:40:45.153 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.145+0000 7fad9c586640 1 -- 172.21.15.88:0/674163257 shutdown_connections 2024-04-26T23:40:45.153 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.145+0000 7fad9c586640 1 -- 172.21.15.88:0/674163257 wait complete. 2024-04-26T23:40:45.153 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.146+0000 7fad9c586640 1 Processor -- start 2024-04-26T23:40:45.153 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.146+0000 7fad9c586640 1 -- start start 2024-04-26T23:40:45.153 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.147+0000 7fad9c586640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fad94071450 0x7fad9414d530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:45.153 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.147+0000 7fad9c586640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fad94151ff0 0x7fad9414da70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:45.153 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.147+0000 7fad9c586640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fad94155060 0x7fad94143980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:45.153 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.147+0000 7fad9c586640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fad94070d80 con 0x7fad94071450 2024-04-26T23:40:45.153 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.147+0000 7fad9c586640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fad94070aa0 con 0x7fad94151ff0 2024-04-26T23:40:45.153 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.147+0000 7fad9c586640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fad940c54e0 con 0x7fad94155060 2024-04-26T23:40:45.154 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.147+0000 7fad9a322640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fad94071450 0x7fad9414d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:45.154 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.147+0000 7fad9a322640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fad94071450 0x7fad9414d530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:41910/0 (socket says 172.21.15.88:41910) 2024-04-26T23:40:45.154 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.147+0000 7fad9a322640 1 -- 172.21.15.88:0/418048080 learned_addr learned my addr 172.21.15.88:0/418048080 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:40:45.154 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.147+0000 7fad9ab23640 1 --2- 172.21.15.88:0/418048080 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fad94155060 0x7fad94143980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:45.154 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.147+0000 7fad99b21640 1 --2- 172.21.15.88:0/418048080 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fad94151ff0 0x7fad9414da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:45.154 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.147+0000 7fad9a322640 1 -- 172.21.15.88:0/418048080 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fad94155060 msgr2=0x7fad94143980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:45.154 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.147+0000 7fad9a322640 1 --2- 172.21.15.88:0/418048080 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fad94155060 0x7fad94143980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:45.154 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.147+0000 7fad9a322640 1 -- 172.21.15.88:0/418048080 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fad94151ff0 msgr2=0x7fad9414da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:45.154 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.147+0000 7fad9a322640 1 --2- 172.21.15.88:0/418048080 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fad94151ff0 0x7fad9414da70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:45.154 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.147+0000 7fad9a322640 1 -- 172.21.15.88:0/418048080 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad9414bd60 con 0x7fad94071450 2024-04-26T23:40:45.154 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.147+0000 7fad9a322640 1 --2- 172.21.15.88:0/418048080 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fad94071450 0x7fad9414d530 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fad9000c7c0 tx=0x7fad9000cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:45.154 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.147+0000 7fad8affd640 1 -- 172.21.15.88:0/418048080 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad90016020 con 0x7fad94071450 2024-04-26T23:40:45.154 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.147+0000 7fad8affd640 1 -- 172.21.15.88:0/418048080 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad90006d50 con 0x7fad94071450 2024-04-26T23:40:45.154 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.147+0000 7fad9c586640 1 -- 172.21.15.88:0/418048080 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad9414ba80 con 0x7fad94071450 2024-04-26T23:40:45.155 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.147+0000 7fad8affd640 1 -- 172.21.15.88:0/418048080 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad90003bb0 con 0x7fad94071450 2024-04-26T23:40:45.155 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.148+0000 7fad9c586640 1 -- 172.21.15.88:0/418048080 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad940c4860 con 0x7fad94071450 2024-04-26T23:40:45.155 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.148+0000 7fad9c586640 1 -- 172.21.15.88:0/418048080 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad940507a0 con 0x7fad94071450 2024-04-26T23:40:45.155 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.149+0000 7fad8affd640 1 -- 172.21.15.88:0/418048080 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fad9000a850 con 0x7fad94071450 2024-04-26T23:40:45.155 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.149+0000 7fad8affd640 1 --2- 172.21.15.88:0/418048080 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fad7806c8f0 0x7fad7806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:45.155 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.149+0000 7fad99b21640 1 --2- 172.21.15.88:0/418048080 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fad7806c8f0 0x7fad7806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:45.155 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.149+0000 7fad8affd640 1 -- 172.21.15.88:0/418048080 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7fad9008bbc0 con 0x7fad94071450 2024-04-26T23:40:45.156 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.150+0000 7fad99b21640 1 --2- 172.21.15.88:0/418048080 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fad7806c8f0 0x7fad7806edb0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fad84034000 tx=0x7fad8402e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:45.157 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.154+0000 7fad8affd640 1 -- 172.21.15.88:0/418048080 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fad90020020 con 0x7fad94071450 2024-04-26T23:40:45.335 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.331+0000 7fad9c586640 1 -- 172.21.15.88:0/418048080 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fad94071230 con 0x7fad94071450 2024-04-26T23:40:45.336 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.332+0000 7fad8affd640 1 -- 172.21.15.88:0/418048080 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+20343 (secure 0 0 0) 0x7fad9414bd60 con 0x7fad94071450 2024-04-26T23:40:45.336 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-26T23:40:45.337 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":24,"fsid":"555255e9-7ef9-4454-8dc9-35e96b70035c","created":"2024-04-26T23:40:07.836009+0000","modified":"2024-04-26T23:40:42.673801+0000","last_up_change":"2024-04-26T23:40:18.831369+0000","last_in_change":"2024-04-26T23:40:09.944777+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T23:40:19.936127+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"a_metadata","create_time":"2024-04-26T23:40:29.837465+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"a_data","create_time":"2024-04-26T23:40:30.868651+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"b_metadata","create_time":"2024-04-26T23:40:38.753441+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"b_data","create_time":"2024-04-26T23:40:39.974557+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"92aecea3-ed62-4a29-87c0-76758a0816a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":2803186054},{"type":"v1","addr":"172.21.15.88:6801","nonce":2803186054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":2803186054},{"type":"v1","addr":"172.21.15.88:6803","nonce":2803186054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":2803186054},{"type":"v1","addr":"172.21.15.88:6807","nonce":2803186054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":2803186054},{"type":"v1","addr":"172.21.15.88:6805","nonce":2803186054}]},"public_addr":"172.21.15.88:6801/2803186054","cluster_addr":"172.21.15.88:6803/2803186054","heartbeat_back_addr":"172.21.15.88:6807/2803186054","heartbeat_front_addr":"172.21.15.88:6805/2803186054","state":["exists","up"]},{"osd":1,"uuid":"7a6f0fa9-23d0-4747-880f-798d45ec5eeb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":1897380484},{"type":"v1","addr":"172.21.15.88:6817","nonce":1897380484}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":1897380484},{"type":"v1","addr":"172.21.15.88:6819","nonce":1897380484}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1897380484},{"type":"v1","addr":"172.21.15.88:6823","nonce":1897380484}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":1897380484},{"type":"v1","addr":"172.21.15.88:6821","nonce":1897380484}]},"public_addr":"172.21.15.88:6817/1897380484","cluster_addr":"172.21.15.88:6819/1897380484","heartbeat_back_addr":"172.21.15.88:6823/1897380484","heartbeat_front_addr":"172.21.15.88:6821/1897380484","state":["exists","up"]},{"osd":2,"uuid":"6be88ea0-e133-4200-a4b5-f92d664b248a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":648396269},{"type":"v1","addr":"172.21.15.88:6809","nonce":648396269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":648396269},{"type":"v1","addr":"172.21.15.88:6811","nonce":648396269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":648396269},{"type":"v1","addr":"172.21.15.88:6815","nonce":648396269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":648396269},{"type":"v1","addr":"172.21.15.88:6813","nonce":648396269}]},"public_addr":"172.21.15.88:6809/648396269","cluster_addr":"172.21.15.88:6811/648396269","heartbeat_back_addr":"172.21.15.88:6815/648396269","heartbeat_front_addr":"172.21.15.88:6813/648396269","state":["exists","up"]},{"osd":3,"uuid":"dcb0746b-7b3d-4ecf-8089-2493a5d1857c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":2328028922},{"type":"v1","addr":"172.21.15.88:6825","nonce":2328028922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":2328028922},{"type":"v1","addr":"172.21.15.88:6827","nonce":2328028922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":2328028922},{"type":"v1","addr":"172.21.15.88:6831","nonce":2328028922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":2328028922},{"type":"v1","addr":"172.21.15.88:6829","nonce":2328028922}]},"public_addr":"172.21.15.88:6825/2328028922","cluster_addr":"172.21.15.88:6827/2328028922","heartbeat_back_addr":"172.21.15.88:6831/2328028922","heartbeat_front_addr":"172.21.15.88:6829/2328028922","state":["exists","up"]},{"osd":4,"uuid":"c483de66-c44f-450e-a4ce-b132d50882c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":3929617402},{"type":"v1","addr":"172.21.15.175:6809","nonce":3929617402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":3929617402},{"type":"v1","addr":"172.21.15.175:6811","nonce":3929617402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":3929617402},{"type":"v1","addr":"172.21.15.175:6815","nonce":3929617402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":3929617402},{"type":"v1","addr":"172.21.15.175:6813","nonce":3929617402}]},"public_addr":"172.21.15.175:6809/3929617402","cluster_addr":"172.21.15.175:6811/3929617402","heartbeat_back_addr":"172.21.15.175:6815/3929617402","heartbeat_front_addr":"172.21.15.175:6813/3929617402","state":["exists","up"]},{"osd":5,"uuid":"ac3b1669-d228-40dd-9f9a-cb46aa73dd6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":2476644457},{"type":"v1","addr":"172.21.15.175:6801","nonce":2476644457}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":2476644457},{"type":"v1","addr":"172.21.15.175:6803","nonce":2476644457}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":2476644457},{"type":"v1","addr":"172.21.15.175:6807","nonce":2476644457}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":2476644457},{"type":"v1","addr":"172.21.15.175:6805","nonce":2476644457}]},"public_addr":"172.21.15.175:6801/2476644457","cluster_addr":"172.21.15.175:6803/2476644457","heartbeat_back_addr":"172.21.15.175:6807/2476644457","heartbeat_front_addr":"172.21.15.175:6805/2476644457","state":["exists","up"]},{"osd":6,"uuid":"7bef4896-857e-4c11-b3b2-c2e9a8548338","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":3824112919},{"type":"v1","addr":"172.21.15.175:6819","nonce":3824112919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6821","nonce":3824112919},{"type":"v1","addr":"172.21.15.175:6824","nonce":3824112919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":3824112919},{"type":"v1","addr":"172.21.15.175:6831","nonce":3824112919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":3824112919},{"type":"v1","addr":"172.21.15.175:6829","nonce":3824112919}]},"public_addr":"172.21.15.175:6819/3824112919","cluster_addr":"172.21.15.175:6824/3824112919","heartbeat_back_addr":"172.21.15.175:6831/3824112919","heartbeat_front_addr":"172.21.15.175:6829/3824112919","state":["exists","up"]},{"osd":7,"uuid":"e18d9e09-8673-470d-b9dc-280a409b63f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6817","nonce":3319361162},{"type":"v1","addr":"172.21.15.175:6818","nonce":3319361162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":3319361162},{"type":"v1","addr":"172.21.15.175:6822","nonce":3319361162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6827","nonce":3319361162},{"type":"v1","addr":"172.21.15.175:6828","nonce":3319361162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6823","nonce":3319361162},{"type":"v1","addr":"172.21.15.175:6825","nonce":3319361162}]},"public_addr":"172.21.15.175:6818/3319361162","cluster_addr":"172.21.15.175:6822/3319361162","heartbeat_back_addr":"172.21.15.175:6828/3319361162","heartbeat_front_addr":"172.21.15.175:6825/3319361162","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:40:15.126268+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:40:15.050614+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:40:14.995164+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:40:15.078112+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:40:15.159637+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:40:15.091226+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:40:15.140316+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:40:15.089431+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:40:45.339 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.334+0000 7fad9c586640 1 -- 172.21.15.88:0/418048080 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fad7806c8f0 msgr2=0x7fad7806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:45.339 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.334+0000 7fad9c586640 1 --2- 172.21.15.88:0/418048080 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fad7806c8f0 0x7fad7806edb0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fad84034000 tx=0x7fad8402e000 comp rx=0 tx=0).stop 2024-04-26T23:40:45.339 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.334+0000 7fad9c586640 1 -- 172.21.15.88:0/418048080 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fad94071450 msgr2=0x7fad9414d530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:45.339 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.334+0000 7fad9c586640 1 --2- 172.21.15.88:0/418048080 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fad94071450 0x7fad9414d530 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fad9000c7c0 tx=0x7fad9000cc80 comp rx=0 tx=0).stop 2024-04-26T23:40:45.339 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.334+0000 7fad9c586640 1 -- 172.21.15.88:0/418048080 shutdown_connections 2024-04-26T23:40:45.339 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.334+0000 7fad9c586640 1 --2- 172.21.15.88:0/418048080 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fad7806c8f0 0x7fad7806edb0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:45.339 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.334+0000 7fad9c586640 1 --2- 172.21.15.88:0/418048080 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fad94155060 0x7fad94143980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:45.339 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.334+0000 7fad9c586640 1 --2- 172.21.15.88:0/418048080 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fad94151ff0 0x7fad9414da70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:45.339 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.334+0000 7fad9c586640 1 --2- 172.21.15.88:0/418048080 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fad94071450 0x7fad9414d530 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:45.339 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.334+0000 7fad9c586640 1 -- 172.21.15.88:0/418048080 >> 172.21.15.88:0/418048080 conn(0x7fad940ca3d0 msgr2=0x7fad94152830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:40:45.339 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.334+0000 7fad9c586640 1 -- 172.21.15.88:0/418048080 shutdown_connections 2024-04-26T23:40:45.340 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.334+0000 7fad9c586640 1 -- 172.21.15.88:0/418048080 wait complete. 2024-04-26T23:40:45.349 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-26T23:40:45.349 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T23:40:45.447 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.443+0000 7f6a08f89640 1 Processor -- start 2024-04-26T23:40:45.447 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.443+0000 7f6a08f89640 1 -- start start 2024-04-26T23:40:45.447 INFO:tasks.ceph.mds.c.smithi088.stderr:2024-04-26T23:40:45.443+0000 7f670b4d1640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-26T23:40:45.449 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.444+0000 7f6a08f89640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f6a041570d0 0x7f6a04150a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:45.449 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.444+0000 7f6a08f89640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6a040ab3f0 0x7f6a04150f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:45.449 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.444+0000 7f6a08f89640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6a040c3810 con 0x7f6a040c4d80 2024-04-26T23:40:45.449 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.444+0000 7f6a08f89640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f6a040c4330 con 0x7f6a041570d0 2024-04-26T23:40:45.449 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.444+0000 7f6a08f89640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f6a040c3ab0 con 0x7f6a040ab3f0 2024-04-26T23:40:45.449 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.444+0000 7f6a0259c640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f6a041570d0 0x7f6a04150a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:45.449 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.444+0000 7f69fbfff640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6a040ab3f0 0x7f6a04150f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:45.449 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.444+0000 7f69fbfff640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6a040ab3f0 0x7f6a04150f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.88:46006/0 (socket says 172.21.15.88:46006) 2024-04-26T23:40:45.449 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.444+0000 7f69fbfff640 1 -- 172.21.15.88:0/1818745235 learned_addr learned my addr 172.21.15.88:0/1818745235 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:40:45.449 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.444+0000 7f6a0259c640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f6a041570d0 0x7f6a04150a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.88:34064/0 (socket says 172.21.15.88:34064) 2024-04-26T23:40:45.450 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.444+0000 7f6a02d9d640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f6a040c4d80 0x7f6a041574b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.88:36598/0 (socket says 172.21.15.88:36598) 2024-04-26T23:40:45.450 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.444+0000 7f6a0259c640 1 -- 172.21.15.88:0/1818745235 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6a040ab3f0 msgr2=0x7f6a04150f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:40:45.450 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.444+0000 7f6a0259c640 1 --2- 172.21.15.88:0/1818745235 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6a040ab3f0 0x7f6a04150f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:45.450 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.444+0000 7f6a0259c640 1 -- 172.21.15.88:0/1818745235 >> v1:172.21.15.175:6789/0 conn(0x7f6a040c4d80 legacy=0x7f6a041574b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:45.450 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.444+0000 7f6a0259c640 1 -- 172.21.15.88:0/1818745235 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a040c4580 con 0x7f6a041570d0 2024-04-26T23:40:45.450 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.444+0000 7f69fbfff640 1 --2- 172.21.15.88:0/1818745235 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6a040ab3f0 0x7f6a04150f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:40:45.450 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.445+0000 7f6a0259c640 1 --2- 172.21.15.88:0/1818745235 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6a041570d0 0x7f6a04150a50 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f6a040c44b0 tx=0x7f69f402a060 comp rx=0 tx=0).ready entity=mon.1 client_cookie=39f7c01a88ebd5eb server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:45.450 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.445+0000 7f6a01d9b640 1 -- 172.21.15.88:0/1818745235 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69f4037070 con 0x7f6a041570d0 2024-04-26T23:40:45.450 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.445+0000 7f6a01d9b640 1 -- 172.21.15.88:0/1818745235 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69f402adb0 con 0x7f6a041570d0 2024-04-26T23:40:45.450 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.445+0000 7f6a01d9b640 1 -- 172.21.15.88:0/1818745235 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69f4032660 con 0x7f6a041570d0 2024-04-26T23:40:45.453 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.446+0000 7f6a08f89640 1 -- 172.21.15.88:0/1818745235 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6a041570d0 msgr2=0x7f6a04150a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:45.453 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.446+0000 7f6a08f89640 1 --2- 172.21.15.88:0/1818745235 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6a041570d0 0x7f6a04150a50 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f6a040c44b0 tx=0x7f69f402a060 comp rx=0 tx=0).stop 2024-04-26T23:40:45.453 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.446+0000 7f6a08f89640 1 -- 172.21.15.88:0/1818745235 shutdown_connections 2024-04-26T23:40:45.453 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.446+0000 7f6a08f89640 1 --2- 172.21.15.88:0/1818745235 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6a040ab3f0 0x7f6a04150f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:45.453 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.446+0000 7f6a08f89640 1 --2- 172.21.15.88:0/1818745235 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6a041570d0 0x7f6a04150a50 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:45.453 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.446+0000 7f6a08f89640 1 -- 172.21.15.88:0/1818745235 >> 172.21.15.88:0/1818745235 conn(0x7f6a0406c310 msgr2=0x7f6a0406c6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:40:45.453 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.446+0000 7f6a08f89640 1 -- 172.21.15.88:0/1818745235 shutdown_connections 2024-04-26T23:40:45.454 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.446+0000 7f6a08f89640 1 -- 172.21.15.88:0/1818745235 wait complete. 2024-04-26T23:40:45.454 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.447+0000 7f6a08f89640 1 Processor -- start 2024-04-26T23:40:45.454 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.447+0000 7f6a08f89640 1 -- start start 2024-04-26T23:40:45.454 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.448+0000 7f6a08f89640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6a040ab3f0 0x7f6a0414a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:45.454 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.448+0000 7f6a08f89640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6a040c4d80 0x7f6a04147ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:45.454 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.448+0000 7f6a08f89640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6a041570d0 0x7f6a04148220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:45.454 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.448+0000 7f6a08f89640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f6a040abbe0 con 0x7f6a041570d0 2024-04-26T23:40:45.454 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.448+0000 7f6a08f89640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f6a040aba60 con 0x7f6a040c4d80 2024-04-26T23:40:45.454 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.448+0000 7f6a08f89640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f6a04157bc0 con 0x7f6a040ab3f0 2024-04-26T23:40:45.454 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.448+0000 7f6a02d9d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6a041570d0 0x7f6a04148220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:45.454 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.448+0000 7f6a02d9d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6a041570d0 0x7f6a04148220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:41926/0 (socket says 172.21.15.88:41926) 2024-04-26T23:40:45.454 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.448+0000 7f6a02d9d640 1 -- 172.21.15.88:0/3756431001 learned_addr learned my addr 172.21.15.88:0/3756431001 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:40:45.454 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.448+0000 7f69fbfff640 1 --2- 172.21.15.88:0/3756431001 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6a040c4d80 0x7f6a04147ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:45.455 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.448+0000 7f6a0259c640 1 --2- 172.21.15.88:0/3756431001 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6a040ab3f0 0x7f6a0414a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:45.455 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.448+0000 7f6a02d9d640 1 -- 172.21.15.88:0/3756431001 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6a040ab3f0 msgr2=0x7f6a0414a3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:45.455 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.448+0000 7f6a02d9d640 1 --2- 172.21.15.88:0/3756431001 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6a040ab3f0 0x7f6a0414a3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:45.455 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.448+0000 7f6a02d9d640 1 -- 172.21.15.88:0/3756431001 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6a040c4d80 msgr2=0x7f6a04147ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:45.455 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.448+0000 7f6a02d9d640 1 --2- 172.21.15.88:0/3756431001 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6a040c4d80 0x7f6a04147ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:45.455 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.448+0000 7f6a02d9d640 1 -- 172.21.15.88:0/3756431001 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a040c7e40 con 0x7f6a041570d0 2024-04-26T23:40:45.455 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.448+0000 7f6a0259c640 1 --2- 172.21.15.88:0/3756431001 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6a040ab3f0 0x7f6a0414a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:40:45.455 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.448+0000 7f69fbfff640 1 --2- 172.21.15.88:0/3756431001 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6a040c4d80 0x7f6a04147ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:40:45.455 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.448+0000 7f6a02d9d640 1 --2- 172.21.15.88:0/3756431001 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6a041570d0 0x7f6a04148220 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f69fc00c780 tx=0x7f69fc00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:45.455 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.448+0000 7f69faffd640 1 -- 172.21.15.88:0/3756431001 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69fc017070 con 0x7f6a041570d0 2024-04-26T23:40:45.455 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.448+0000 7f69faffd640 1 -- 172.21.15.88:0/3756431001 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69fc00a640 con 0x7f6a041570d0 2024-04-26T23:40:45.455 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.448+0000 7f69faffd640 1 -- 172.21.15.88:0/3756431001 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69fc00a9f0 con 0x7f6a041570d0 2024-04-26T23:40:45.455 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.448+0000 7f6a08f89640 1 -- 172.21.15.88:0/3756431001 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a040c62c0 con 0x7f6a041570d0 2024-04-26T23:40:45.455 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.448+0000 7f6a08f89640 1 -- 172.21.15.88:0/3756431001 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a0414a900 con 0x7f6a041570d0 2024-04-26T23:40:45.455 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.449+0000 7f6a08f89640 1 -- 172.21.15.88:0/3756431001 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a04154810 con 0x7f6a041570d0 2024-04-26T23:40:45.456 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.450+0000 7f69faffd640 1 -- 172.21.15.88:0/3756431001 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f69fc01a070 con 0x7f6a041570d0 2024-04-26T23:40:45.456 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.450+0000 7f69faffd640 1 --2- 172.21.15.88:0/3756431001 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f69e406c8f0 0x7f69e406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:45.456 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.450+0000 7f69faffd640 1 -- 172.21.15.88:0/3756431001 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7f69fc08b310 con 0x7f6a041570d0 2024-04-26T23:40:45.456 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.450+0000 7f6a0259c640 1 --2- 172.21.15.88:0/3756431001 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f69e406c8f0 0x7f69e406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:45.456 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.451+0000 7f6a0259c640 1 --2- 172.21.15.88:0/3756431001 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f69e406c8f0 0x7f69e406edb0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f69f4034000 tx=0x7f69f402e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:45.458 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.454+0000 7f69faffd640 1 -- 172.21.15.88:0/3756431001 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f69fc058e50 con 0x7f6a041570d0 2024-04-26T23:40:45.631 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.627+0000 7f6a08f89640 1 -- 172.21.15.88:0/3756431001 --> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f6a040507a0 con 0x7f69e406c8f0 2024-04-26T23:40:45.642 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.638+0000 7f69faffd640 1 -- 172.21.15.88:0/3756431001 <== mgr.4104 v2:172.21.15.88:6832/651674297 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+475565 (secure 0 0 0) 0x7f6a040507a0 con 0x7f69e406c8f0 2024-04-26T23:40:45.648 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-26T23:40:45.651 INFO:teuthology.orchestra.run.smithi088.stderr:dumped all 2024-04-26T23:40:45.653 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.642+0000 7f6a08f89640 1 -- 172.21.15.88:0/3756431001 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f69e406c8f0 msgr2=0x7f69e406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:45.653 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.642+0000 7f6a08f89640 1 --2- 172.21.15.88:0/3756431001 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f69e406c8f0 0x7f69e406edb0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f69f4034000 tx=0x7f69f402e000 comp rx=0 tx=0).stop 2024-04-26T23:40:45.653 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.642+0000 7f6a08f89640 1 -- 172.21.15.88:0/3756431001 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6a041570d0 msgr2=0x7f6a04148220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:45.653 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.642+0000 7f6a08f89640 1 --2- 172.21.15.88:0/3756431001 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6a041570d0 0x7f6a04148220 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f69fc00c780 tx=0x7f69fc00cc40 comp rx=0 tx=0).stop 2024-04-26T23:40:45.653 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.642+0000 7f6a08f89640 1 -- 172.21.15.88:0/3756431001 shutdown_connections 2024-04-26T23:40:45.653 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.642+0000 7f6a08f89640 1 --2- 172.21.15.88:0/3756431001 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f69e406c8f0 0x7f69e406edb0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:45.653 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.642+0000 7f6a08f89640 1 --2- 172.21.15.88:0/3756431001 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6a041570d0 0x7f6a04148220 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:45.653 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.642+0000 7f6a08f89640 1 --2- 172.21.15.88:0/3756431001 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6a040c4d80 0x7f6a04147ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:45.653 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.642+0000 7f6a08f89640 1 --2- 172.21.15.88:0/3756431001 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6a040ab3f0 0x7f6a0414a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:45.653 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.642+0000 7f6a08f89640 1 -- 172.21.15.88:0/3756431001 >> 172.21.15.88:0/3756431001 conn(0x7f6a0406c310 msgr2=0x7f6a0406f170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:40:45.653 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.642+0000 7f6a08f89640 1 -- 172.21.15.88:0/3756431001 shutdown_connections 2024-04-26T23:40:45.653 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.642+0000 7f6a08f89640 1 -- 172.21.15.88:0/3756431001 wait complete. 2024-04-26T23:40:45.657 INFO:teuthology.orchestra.run.smithi088.stdout:{"pg_ready":true,"pg_map":{"version":30,"stamp":"2024-04-26T23:40:43.924242+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219012,"kb_used_data":2824,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755708,"statfs":{"total":773094113280,"available":772869844992,"internally_reserved":0,"allocated":2891776,"data_stored":1752388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.272280"},"pg_stats":[{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:40:40.651867+0000","last_change":"2024-04-26T23:40:40.651867+0000","last_active":"2024-04-26T23:40:40.651867+0000","last_peered":"2024-04-26T23:40:40.651867+0000","last_clean":"2024-04-26T23:40:40.651867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:40:40.651867+0000","last_undegraded":"2024-04-26T23:40:40.651867+0000","last_fullsized":"2024-04-26T23:40:40.651867+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:40:34.333720+0000","last_change":"2024-04-26T23:40:31.576688+0000","last_active":"2024-04-26T23:40:34.333720+0000","last_peered":"2024-04-26T23:40:34.333720+0000","last_clean":"2024-04-26T23:40:34.333720+0000","last_became_active":"2024-04-26T23:40:31.576429+0000","last_became_peered":"2024-04-26T23:40:31.576429+0000","last_unstale":"2024-04-26T23:40:34.333720+0000","last_undegraded":"2024-04-26T23:40:34.333720+0000","last_fullsized":"2024-04-26T23:40:34.333720+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:47:42.681376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:40:34.310432+0000","last_change":"2024-04-26T23:40:32.578489+0000","last_active":"2024-04-26T23:40:34.310432+0000","last_peered":"2024-04-26T23:40:34.310432+0000","last_clean":"2024-04-26T23:40:34.310432+0000","last_became_active":"2024-04-26T23:40:32.578205+0000","last_became_peered":"2024-04-26T23:40:32.578205+0000","last_unstale":"2024-04-26T23:40:34.310432+0000","last_undegraded":"2024-04-26T23:40:34.310432+0000","last_fullsized":"2024-04-26T23:40:34.310432+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:56:04.309611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:40:39.646413+0000","last_change":"2024-04-26T23:40:39.646413+0000","last_active":"2024-04-26T23:40:39.646413+0000","last_peered":"2024-04-26T23:40:39.646413+0000","last_clean":"2024-04-26T23:40:39.646413+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:40:39.646413+0000","last_undegraded":"2024-04-26T23:40:39.646413+0000","last_fullsized":"2024-04-26T23:40:39.646413+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:40:40.651867+0000","last_change":"2024-04-26T23:40:40.651867+0000","last_active":"2024-04-26T23:40:40.651867+0000","last_peered":"2024-04-26T23:40:40.651867+0000","last_clean":"2024-04-26T23:40:40.651867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:40:40.651867+0000","last_undegraded":"2024-04-26T23:40:40.651867+0000","last_fullsized":"2024-04-26T23:40:40.651867+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:40:34.310479+0000","last_change":"2024-04-26T23:40:31.576867+0000","last_active":"2024-04-26T23:40:34.310479+0000","last_peered":"2024-04-26T23:40:34.310479+0000","last_clean":"2024-04-26T23:40:34.310479+0000","last_became_active":"2024-04-26T23:40:31.576342+0000","last_became_peered":"2024-04-26T23:40:31.576342+0000","last_unstale":"2024-04-26T23:40:34.310479+0000","last_undegraded":"2024-04-26T23:40:34.310479+0000","last_fullsized":"2024-04-26T23:40:34.310479+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:35:54.439397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:40:34.333671+0000","last_change":"2024-04-26T23:40:32.589769+0000","last_active":"2024-04-26T23:40:34.333671+0000","last_peered":"2024-04-26T23:40:34.333671+0000","last_clean":"2024-04-26T23:40:34.333671+0000","last_became_active":"2024-04-26T23:40:32.589489+0000","last_became_peered":"2024-04-26T23:40:32.589489+0000","last_unstale":"2024-04-26T23:40:34.333671+0000","last_undegraded":"2024-04-26T23:40:34.333671+0000","last_fullsized":"2024-04-26T23:40:34.333671+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:40:17.167353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:40:39.646413+0000","last_change":"2024-04-26T23:40:39.646413+0000","last_active":"2024-04-26T23:40:39.646413+0000","last_peered":"2024-04-26T23:40:39.646413+0000","last_clean":"2024-04-26T23:40:39.646413+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:40:39.646413+0000","last_undegraded":"2024-04-26T23:40:39.646413+0000","last_fullsized":"2024-04-26T23:40:39.646413+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:40:40.651867+0000","last_change":"2024-04-26T23:40:40.651867+0000","last_active":"2024-04-26T23:40:40.651867+0000","last_peered":"2024-04-26T23:40:40.651867+0000","last_clean":"2024-04-26T23:40:40.651867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:40:40.651867+0000","last_undegraded":"2024-04-26T23:40:40.651867+0000","last_fullsized":"2024-04-26T23:40:40.651867+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:40:34.333637+0000","last_change":"2024-04-26T23:40:31.578735+0000","last_active":"2024-04-26T23:40:34.333637+0000","last_peered":"2024-04-26T23:40:34.333637+0000","last_clean":"2024-04-26T23:40:34.333637+0000","last_became_active":"2024-04-26T23:40:31.578438+0000","last_became_peered":"2024-04-26T23:40:31.578438+0000","last_unstale":"2024-04-26T23:40:34.333637+0000","last_undegraded":"2024-04-26T23:40:34.333637+0000","last_fullsized":"2024-04-26T23:40:34.333637+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:30:10.397569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:40:34.333965+0000","last_change":"2024-04-26T23:40:32.590624+0000","last_active":"2024-04-26T23:40:34.333965+0000","last_peered":"2024-04-26T23:40:34.333965+0000","last_clean":"2024-04-26T23:40:34.333965+0000","last_became_active":"2024-04-26T23:40:32.589687+0000","last_became_peered":"2024-04-26T23:40:32.589687+0000","last_unstale":"2024-04-26T23:40:34.333965+0000","last_undegraded":"2024-04-26T23:40:34.333965+0000","last_fullsized":"2024-04-26T23:40:34.333965+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:01:02.741964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:40:39.646413+0000","last_change":"2024-04-26T23:40:39.646413+0000","last_active":"2024-04-26T23:40:39.646413+0000","last_peered":"2024-04-26T23:40:39.646413+0000","last_clean":"2024-04-26T23:40:39.646413+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:40:39.646413+0000","last_undegraded":"2024-04-26T23:40:39.646413+0000","last_fullsized":"2024-04-26T23:40:39.646413+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:40:40.651867+0000","last_change":"2024-04-26T23:40:40.651867+0000","last_active":"2024-04-26T23:40:40.651867+0000","last_peered":"2024-04-26T23:40:40.651867+0000","last_clean":"2024-04-26T23:40:40.651867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:40:40.651867+0000","last_undegraded":"2024-04-26T23:40:40.651867+0000","last_fullsized":"2024-04-26T23:40:40.651867+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:40:34.333253+0000","last_change":"2024-04-26T23:40:31.573648+0000","last_active":"2024-04-26T23:40:34.333253+0000","last_peered":"2024-04-26T23:40:34.333253+0000","last_clean":"2024-04-26T23:40:34.333253+0000","last_became_active":"2024-04-26T23:40:31.573347+0000","last_became_peered":"2024-04-26T23:40:31.573347+0000","last_unstale":"2024-04-26T23:40:34.333253+0000","last_undegraded":"2024-04-26T23:40:34.333253+0000","last_fullsized":"2024-04-26T23:40:34.333253+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:20:28.103413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:40:34.334384+0000","last_change":"2024-04-26T23:40:32.588309+0000","last_active":"2024-04-26T23:40:34.334384+0000","last_peered":"2024-04-26T23:40:34.334384+0000","last_clean":"2024-04-26T23:40:34.334384+0000","last_became_active":"2024-04-26T23:40:32.588007+0000","last_became_peered":"2024-04-26T23:40:32.588007+0000","last_unstale":"2024-04-26T23:40:34.334384+0000","last_undegraded":"2024-04-26T23:40:34.334384+0000","last_fullsized":"2024-04-26T23:40:34.334384+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:52:26.699790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:40:39.646413+0000","last_change":"2024-04-26T23:40:39.646413+0000","last_active":"2024-04-26T23:40:39.646413+0000","last_peered":"2024-04-26T23:40:39.646413+0000","last_clean":"2024-04-26T23:40:39.646413+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:40:39.646413+0000","last_undegraded":"2024-04-26T23:40:39.646413+0000","last_fullsized":"2024-04-26T23:40:39.646413+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:40:40.651867+0000","last_change":"2024-04-26T23:40:40.651867+0000","last_active":"2024-04-26T23:40:40.651867+0000","last_peered":"2024-04-26T23:40:40.651867+0000","last_clean":"2024-04-26T23:40:40.651867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:40:40.651867+0000","last_undegraded":"2024-04-26T23:40:40.651867+0000","last_fullsized":"2024-04-26T23:40:40.651867+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:40:33.580591+0000","last_change":"2024-04-26T23:40:32.590053+0000","last_active":"2024-04-26T23:40:33.580591+0000","last_peered":"2024-04-26T23:40:33.580591+0000","last_clean":"2024-04-26T23:40:33.580591+0000","last_became_active":"2024-04-26T23:40:32.589802+0000","last_became_peered":"2024-04-26T23:40:32.589802+0000","last_unstale":"2024-04-26T23:40:33.580591+0000","last_undegraded":"2024-04-26T23:40:33.580591+0000","last_fullsized":"2024-04-26T23:40:33.580591+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:16:46.547536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:40:34.333812+0000","last_change":"2024-04-26T23:40:31.578524+0000","last_active":"2024-04-26T23:40:34.333812+0000","last_peered":"2024-04-26T23:40:34.333812+0000","last_clean":"2024-04-26T23:40:34.333812+0000","last_became_active":"2024-04-26T23:40:31.578230+0000","last_became_peered":"2024-04-26T23:40:31.578230+0000","last_unstale":"2024-04-26T23:40:34.333812+0000","last_undegraded":"2024-04-26T23:40:34.333812+0000","last_fullsized":"2024-04-26T23:40:34.333812+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:15:51.937774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:40:39.646413+0000","last_change":"2024-04-26T23:40:39.646413+0000","last_active":"2024-04-26T23:40:39.646413+0000","last_peered":"2024-04-26T23:40:39.646413+0000","last_clean":"2024-04-26T23:40:39.646413+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:40:39.646413+0000","last_undegraded":"2024-04-26T23:40:39.646413+0000","last_fullsized":"2024-04-26T23:40:39.646413+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:40:40.651867+0000","last_change":"2024-04-26T23:40:40.651867+0000","last_active":"2024-04-26T23:40:40.651867+0000","last_peered":"2024-04-26T23:40:40.651867+0000","last_clean":"2024-04-26T23:40:40.651867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:40:40.651867+0000","last_undegraded":"2024-04-26T23:40:40.651867+0000","last_fullsized":"2024-04-26T23:40:40.651867+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:40:34.310198+0000","last_change":"2024-04-26T23:40:32.585827+0000","last_active":"2024-04-26T23:40:34.310198+0000","last_peered":"2024-04-26T23:40:34.310198+0000","last_clean":"2024-04-26T23:40:34.310198+0000","last_became_active":"2024-04-26T23:40:32.585522+0000","last_became_peered":"2024-04-26T23:40:32.585522+0000","last_unstale":"2024-04-26T23:40:34.310198+0000","last_undegraded":"2024-04-26T23:40:34.310198+0000","last_fullsized":"2024-04-26T23:40:34.310198+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:40:17.167353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:40:33.580136+0000","last_change":"2024-04-26T23:40:31.575121+0000","last_active":"2024-04-26T23:40:33.580136+0000","last_peered":"2024-04-26T23:40:33.580136+0000","last_clean":"2024-04-26T23:40:33.580136+0000","last_became_active":"2024-04-26T23:40:31.574827+0000","last_became_peered":"2024-04-26T23:40:31.574827+0000","last_unstale":"2024-04-26T23:40:33.580136+0000","last_undegraded":"2024-04-26T23:40:33.580136+0000","last_fullsized":"2024-04-26T23:40:33.580136+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:43:13.740214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:40:39.646413+0000","last_change":"2024-04-26T23:40:39.646413+0000","last_active":"2024-04-26T23:40:39.646413+0000","last_peered":"2024-04-26T23:40:39.646413+0000","last_clean":"2024-04-26T23:40:39.646413+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:40:39.646413+0000","last_undegraded":"2024-04-26T23:40:39.646413+0000","last_fullsized":"2024-04-26T23:40:39.646413+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:40:40.651867+0000","last_change":"2024-04-26T23:40:40.651867+0000","last_active":"2024-04-26T23:40:40.651867+0000","last_peered":"2024-04-26T23:40:40.651867+0000","last_clean":"2024-04-26T23:40:40.651867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:40:40.651867+0000","last_undegraded":"2024-04-26T23:40:40.651867+0000","last_fullsized":"2024-04-26T23:40:40.651867+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:40:34.310151+0000","last_change":"2024-04-26T23:40:32.582721+0000","last_active":"2024-04-26T23:40:34.310151+0000","last_peered":"2024-04-26T23:40:34.310151+0000","last_clean":"2024-04-26T23:40:34.310151+0000","last_became_active":"2024-04-26T23:40:32.582438+0000","last_became_peered":"2024-04-26T23:40:32.582438+0000","last_unstale":"2024-04-26T23:40:34.310151+0000","last_undegraded":"2024-04-26T23:40:34.310151+0000","last_fullsized":"2024-04-26T23:40:34.310151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:38:10.884592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:40:33.580199+0000","last_change":"2024-04-26T23:40:31.575508+0000","last_active":"2024-04-26T23:40:33.580199+0000","last_peered":"2024-04-26T23:40:33.580199+0000","last_clean":"2024-04-26T23:40:33.580199+0000","last_became_active":"2024-04-26T23:40:31.575242+0000","last_became_peered":"2024-04-26T23:40:31.575242+0000","last_unstale":"2024-04-26T23:40:33.580199+0000","last_undegraded":"2024-04-26T23:40:33.580199+0000","last_fullsized":"2024-04-26T23:40:33.580199+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:48:32.015654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:40:39.646413+0000","last_change":"2024-04-26T23:40:39.646413+0000","last_active":"2024-04-26T23:40:39.646413+0000","last_peered":"2024-04-26T23:40:39.646413+0000","last_clean":"2024-04-26T23:40:39.646413+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:40:39.646413+0000","last_undegraded":"2024-04-26T23:40:39.646413+0000","last_fullsized":"2024-04-26T23:40:39.646413+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:40:40.651867+0000","last_change":"2024-04-26T23:40:40.651867+0000","last_active":"2024-04-26T23:40:40.651867+0000","last_peered":"2024-04-26T23:40:40.651867+0000","last_clean":"2024-04-26T23:40:40.651867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:40:40.651867+0000","last_undegraded":"2024-04-26T23:40:40.651867+0000","last_fullsized":"2024-04-26T23:40:40.651867+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:40:33.580187+0000","last_change":"2024-04-26T23:40:32.583019+0000","last_active":"2024-04-26T23:40:33.580187+0000","last_peered":"2024-04-26T23:40:33.580187+0000","last_clean":"2024-04-26T23:40:33.580187+0000","last_became_active":"2024-04-26T23:40:32.582719+0000","last_became_peered":"2024-04-26T23:40:32.582719+0000","last_unstale":"2024-04-26T23:40:33.580187+0000","last_undegraded":"2024-04-26T23:40:33.580187+0000","last_fullsized":"2024-04-26T23:40:33.580187+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:25:02.319783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:40:34.333006+0000","last_change":"2024-04-26T23:40:31.576866+0000","last_active":"2024-04-26T23:40:34.333006+0000","last_peered":"2024-04-26T23:40:34.333006+0000","last_clean":"2024-04-26T23:40:34.333006+0000","last_became_active":"2024-04-26T23:40:31.576419+0000","last_became_peered":"2024-04-26T23:40:31.576419+0000","last_unstale":"2024-04-26T23:40:34.333006+0000","last_undegraded":"2024-04-26T23:40:34.333006+0000","last_fullsized":"2024-04-26T23:40:34.333006+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:45:49.295198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:40:39.646413+0000","last_change":"2024-04-26T23:40:39.646413+0000","last_active":"2024-04-26T23:40:39.646413+0000","last_peered":"2024-04-26T23:40:39.646413+0000","last_clean":"2024-04-26T23:40:39.646413+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:40:39.646413+0000","last_undegraded":"2024-04-26T23:40:39.646413+0000","last_fullsized":"2024-04-26T23:40:39.646413+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:40:40.651867+0000","last_change":"2024-04-26T23:40:40.651867+0000","last_active":"2024-04-26T23:40:40.651867+0000","last_peered":"2024-04-26T23:40:40.651867+0000","last_clean":"2024-04-26T23:40:40.651867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:40:40.651867+0000","last_undegraded":"2024-04-26T23:40:40.651867+0000","last_fullsized":"2024-04-26T23:40:40.651867+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:40:34.333552+0000","last_change":"2024-04-26T23:40:32.584988+0000","last_active":"2024-04-26T23:40:34.333552+0000","last_peered":"2024-04-26T23:40:34.333552+0000","last_clean":"2024-04-26T23:40:34.333552+0000","last_became_active":"2024-04-26T23:40:32.584467+0000","last_became_peered":"2024-04-26T23:40:32.584467+0000","last_unstale":"2024-04-26T23:40:34.333552+0000","last_undegraded":"2024-04-26T23:40:34.333552+0000","last_fullsized":"2024-04-26T23:40:34.333552+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:51:30.677247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:40:33.580955+0000","last_change":"2024-04-26T23:40:31.573721+0000","last_active":"2024-04-26T23:40:33.580955+0000","last_peered":"2024-04-26T23:40:33.580955+0000","last_clean":"2024-04-26T23:40:33.580955+0000","last_became_active":"2024-04-26T23:40:31.573434+0000","last_became_peered":"2024-04-26T23:40:31.573434+0000","last_unstale":"2024-04-26T23:40:33.580955+0000","last_undegraded":"2024-04-26T23:40:33.580955+0000","last_fullsized":"2024-04-26T23:40:33.580955+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:20:28.103413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:40:39.646413+0000","last_change":"2024-04-26T23:40:39.646413+0000","last_active":"2024-04-26T23:40:39.646413+0000","last_peered":"2024-04-26T23:40:39.646413+0000","last_clean":"2024-04-26T23:40:39.646413+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:40:39.646413+0000","last_undegraded":"2024-04-26T23:40:39.646413+0000","last_fullsized":"2024-04-26T23:40:39.646413+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:40:40.651867+0000","last_change":"2024-04-26T23:40:40.651867+0000","last_active":"2024-04-26T23:40:40.651867+0000","last_peered":"2024-04-26T23:40:40.651867+0000","last_clean":"2024-04-26T23:40:40.651867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:40:40.651867+0000","last_undegraded":"2024-04-26T23:40:40.651867+0000","last_fullsized":"2024-04-26T23:40:40.651867+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:40:34.310515+0000","last_change":"2024-04-26T23:40:32.594913+0000","last_active":"2024-04-26T23:40:34.310515+0000","last_peered":"2024-04-26T23:40:34.310515+0000","last_clean":"2024-04-26T23:40:34.310515+0000","last_became_active":"2024-04-26T23:40:32.594616+0000","last_became_peered":"2024-04-26T23:40:32.594616+0000","last_unstale":"2024-04-26T23:40:34.310515+0000","last_undegraded":"2024-04-26T23:40:34.310515+0000","last_fullsized":"2024-04-26T23:40:34.310515+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:04:30.553552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:40:33.584637+0000","last_change":"2024-04-26T23:40:31.576299+0000","last_active":"2024-04-26T23:40:33.584637+0000","last_peered":"2024-04-26T23:40:33.584637+0000","last_clean":"2024-04-26T23:40:33.584637+0000","last_became_active":"2024-04-26T23:40:31.576006+0000","last_became_peered":"2024-04-26T23:40:31.576006+0000","last_unstale":"2024-04-26T23:40:33.584637+0000","last_undegraded":"2024-04-26T23:40:33.584637+0000","last_fullsized":"2024-04-26T23:40:33.584637+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:15:51.937774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:40:39.646413+0000","last_change":"2024-04-26T23:40:39.646413+0000","last_active":"2024-04-26T23:40:39.646413+0000","last_peered":"2024-04-26T23:40:39.646413+0000","last_clean":"2024-04-26T23:40:39.646413+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:40:39.646413+0000","last_undegraded":"2024-04-26T23:40:39.646413+0000","last_fullsized":"2024-04-26T23:40:39.646413+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:40:40.651867+0000","last_change":"2024-04-26T23:40:40.651867+0000","last_active":"2024-04-26T23:40:40.651867+0000","last_peered":"2024-04-26T23:40:40.651867+0000","last_clean":"2024-04-26T23:40:40.651867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:40:40.651867+0000","last_undegraded":"2024-04-26T23:40:40.651867+0000","last_fullsized":"2024-04-26T23:40:40.651867+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:40:33.580396+0000","last_change":"2024-04-26T23:40:32.582442+0000","last_active":"2024-04-26T23:40:33.580396+0000","last_peered":"2024-04-26T23:40:33.580396+0000","last_clean":"2024-04-26T23:40:33.580396+0000","last_became_active":"2024-04-26T23:40:32.582140+0000","last_became_peered":"2024-04-26T23:40:32.582140+0000","last_unstale":"2024-04-26T23:40:33.580396+0000","last_undegraded":"2024-04-26T23:40:33.580396+0000","last_fullsized":"2024-04-26T23:40:33.580396+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:18:09.706875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:40:34.333737+0000","last_change":"2024-04-26T23:40:31.576565+0000","last_active":"2024-04-26T23:40:34.333737+0000","last_peered":"2024-04-26T23:40:34.333737+0000","last_clean":"2024-04-26T23:40:34.333737+0000","last_became_active":"2024-04-26T23:40:31.576313+0000","last_became_peered":"2024-04-26T23:40:31.576313+0000","last_unstale":"2024-04-26T23:40:34.333737+0000","last_undegraded":"2024-04-26T23:40:34.333737+0000","last_fullsized":"2024-04-26T23:40:34.333737+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:25:01.315397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:40:39.646413+0000","last_change":"2024-04-26T23:40:39.646413+0000","last_active":"2024-04-26T23:40:39.646413+0000","last_peered":"2024-04-26T23:40:39.646413+0000","last_clean":"2024-04-26T23:40:39.646413+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:40:39.646413+0000","last_undegraded":"2024-04-26T23:40:39.646413+0000","last_fullsized":"2024-04-26T23:40:39.646413+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:40:40.651867+0000","last_change":"2024-04-26T23:40:40.651867+0000","last_active":"2024-04-26T23:40:40.651867+0000","last_peered":"2024-04-26T23:40:40.651867+0000","last_clean":"2024-04-26T23:40:40.651867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:40:40.651867+0000","last_undegraded":"2024-04-26T23:40:40.651867+0000","last_fullsized":"2024-04-26T23:40:40.651867+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:40:34.334461+0000","last_change":"2024-04-26T23:40:32.584363+0000","last_active":"2024-04-26T23:40:34.334461+0000","last_peered":"2024-04-26T23:40:34.334461+0000","last_clean":"2024-04-26T23:40:34.334461+0000","last_became_active":"2024-04-26T23:40:32.584082+0000","last_became_peered":"2024-04-26T23:40:32.584082+0000","last_unstale":"2024-04-26T23:40:34.334461+0000","last_undegraded":"2024-04-26T23:40:34.334461+0000","last_fullsized":"2024-04-26T23:40:34.334461+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:35:08.194865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:40:33.580320+0000","last_change":"2024-04-26T23:40:31.576711+0000","last_active":"2024-04-26T23:40:33.580320+0000","last_peered":"2024-04-26T23:40:33.580320+0000","last_clean":"2024-04-26T23:40:33.580320+0000","last_became_active":"2024-04-26T23:40:31.576404+0000","last_became_peered":"2024-04-26T23:40:31.576404+0000","last_unstale":"2024-04-26T23:40:33.580320+0000","last_undegraded":"2024-04-26T23:40:33.580320+0000","last_fullsized":"2024-04-26T23:40:33.580320+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:45:49.295198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:40:39.646413+0000","last_change":"2024-04-26T23:40:39.646413+0000","last_active":"2024-04-26T23:40:39.646413+0000","last_peered":"2024-04-26T23:40:39.646413+0000","last_clean":"2024-04-26T23:40:39.646413+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:40:39.646413+0000","last_undegraded":"2024-04-26T23:40:39.646413+0000","last_fullsized":"2024-04-26T23:40:39.646413+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:40:40.651867+0000","last_change":"2024-04-26T23:40:40.651867+0000","last_active":"2024-04-26T23:40:40.651867+0000","last_peered":"2024-04-26T23:40:40.651867+0000","last_clean":"2024-04-26T23:40:40.651867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:40:40.651867+0000","last_undegraded":"2024-04-26T23:40:40.651867+0000","last_fullsized":"2024-04-26T23:40:40.651867+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:40:33.580225+0000","last_change":"2024-04-26T23:40:32.590069+0000","last_active":"2024-04-26T23:40:33.580225+0000","last_peered":"2024-04-26T23:40:33.580225+0000","last_clean":"2024-04-26T23:40:33.580225+0000","last_became_active":"2024-04-26T23:40:32.589790+0000","last_became_peered":"2024-04-26T23:40:32.589790+0000","last_unstale":"2024-04-26T23:40:33.580225+0000","last_undegraded":"2024-04-26T23:40:33.580225+0000","last_fullsized":"2024-04-26T23:40:33.580225+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:15:52.942160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:40:34.334567+0000","last_change":"2024-04-26T23:40:31.572432+0000","last_active":"2024-04-26T23:40:34.334567+0000","last_peered":"2024-04-26T23:40:34.334567+0000","last_clean":"2024-04-26T23:40:34.334567+0000","last_became_active":"2024-04-26T23:40:31.572121+0000","last_became_peered":"2024-04-26T23:40:31.572121+0000","last_unstale":"2024-04-26T23:40:34.334567+0000","last_undegraded":"2024-04-26T23:40:34.334567+0000","last_fullsized":"2024-04-26T23:40:34.334567+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:45:49.295198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:40:39.646413+0000","last_change":"2024-04-26T23:40:39.646413+0000","last_active":"2024-04-26T23:40:39.646413+0000","last_peered":"2024-04-26T23:40:39.646413+0000","last_clean":"2024-04-26T23:40:39.646413+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:40:39.646413+0000","last_undegraded":"2024-04-26T23:40:39.646413+0000","last_fullsized":"2024-04-26T23:40:39.646413+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:40:40.651867+0000","last_change":"2024-04-26T23:40:40.651867+0000","last_active":"2024-04-26T23:40:40.651867+0000","last_peered":"2024-04-26T23:40:40.651867+0000","last_clean":"2024-04-26T23:40:40.651867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:40:40.651867+0000","last_undegraded":"2024-04-26T23:40:40.651867+0000","last_fullsized":"2024-04-26T23:40:40.651867+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:40:33.580101+0000","last_change":"2024-04-26T23:40:32.576783+0000","last_active":"2024-04-26T23:40:33.580101+0000","last_peered":"2024-04-26T23:40:33.580101+0000","last_clean":"2024-04-26T23:40:33.580101+0000","last_became_active":"2024-04-26T23:40:32.576481+0000","last_became_peered":"2024-04-26T23:40:32.576481+0000","last_unstale":"2024-04-26T23:40:33.580101+0000","last_undegraded":"2024-04-26T23:40:33.580101+0000","last_fullsized":"2024-04-26T23:40:33.580101+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:16:46.547536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:40:33.640465+0000","last_change":"2024-04-26T23:40:31.570775+0000","last_active":"2024-04-26T23:40:33.640465+0000","last_peered":"2024-04-26T23:40:33.640465+0000","last_clean":"2024-04-26T23:40:33.640465+0000","last_became_active":"2024-04-26T23:40:31.570493+0000","last_became_peered":"2024-04-26T23:40:31.570493+0000","last_unstale":"2024-04-26T23:40:33.640465+0000","last_undegraded":"2024-04-26T23:40:33.640465+0000","last_fullsized":"2024-04-26T23:40:33.640465+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:45:49.295198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:40:39.646413+0000","last_change":"2024-04-26T23:40:39.646413+0000","last_active":"2024-04-26T23:40:39.646413+0000","last_peered":"2024-04-26T23:40:39.646413+0000","last_clean":"2024-04-26T23:40:39.646413+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:40:39.646413+0000","last_undegraded":"2024-04-26T23:40:39.646413+0000","last_fullsized":"2024-04-26T23:40:39.646413+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:40:40.651867+0000","last_change":"2024-04-26T23:40:40.651867+0000","last_active":"2024-04-26T23:40:40.651867+0000","last_peered":"2024-04-26T23:40:40.651867+0000","last_clean":"2024-04-26T23:40:40.651867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:40:40.651867+0000","last_undegraded":"2024-04-26T23:40:40.651867+0000","last_fullsized":"2024-04-26T23:40:40.651867+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:40:34.333268+0000","last_change":"2024-04-26T23:40:32.593262+0000","last_active":"2024-04-26T23:40:34.333268+0000","last_peered":"2024-04-26T23:40:34.333268+0000","last_clean":"2024-04-26T23:40:34.333268+0000","last_became_active":"2024-04-26T23:40:32.593003+0000","last_became_peered":"2024-04-26T23:40:32.593003+0000","last_unstale":"2024-04-26T23:40:34.333268+0000","last_undegraded":"2024-04-26T23:40:34.333268+0000","last_fullsized":"2024-04-26T23:40:34.333268+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:47:51.559918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:40:34.333006+0000","last_change":"2024-04-26T23:40:31.573864+0000","last_active":"2024-04-26T23:40:34.333006+0000","last_peered":"2024-04-26T23:40:34.333006+0000","last_clean":"2024-04-26T23:40:34.333006+0000","last_became_active":"2024-04-26T23:40:31.573594+0000","last_became_peered":"2024-04-26T23:40:31.573594+0000","last_unstale":"2024-04-26T23:40:34.333006+0000","last_undegraded":"2024-04-26T23:40:34.333006+0000","last_fullsized":"2024-04-26T23:40:34.333006+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:48:32.015654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:40:39.646413+0000","last_change":"2024-04-26T23:40:39.646413+0000","last_active":"2024-04-26T23:40:39.646413+0000","last_peered":"2024-04-26T23:40:39.646413+0000","last_clean":"2024-04-26T23:40:39.646413+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:40:39.646413+0000","last_undegraded":"2024-04-26T23:40:39.646413+0000","last_fullsized":"2024-04-26T23:40:39.646413+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:40:40.651867+0000","last_change":"2024-04-26T23:40:40.651867+0000","last_active":"2024-04-26T23:40:40.651867+0000","last_peered":"2024-04-26T23:40:40.651867+0000","last_clean":"2024-04-26T23:40:40.651867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:40:40.651867+0000","last_undegraded":"2024-04-26T23:40:40.651867+0000","last_fullsized":"2024-04-26T23:40:40.651867+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:40:34.310209+0000","last_change":"2024-04-26T23:40:32.593216+0000","last_active":"2024-04-26T23:40:34.310209+0000","last_peered":"2024-04-26T23:40:34.310209+0000","last_clean":"2024-04-26T23:40:34.310209+0000","last_became_active":"2024-04-26T23:40:32.592929+0000","last_became_peered":"2024-04-26T23:40:32.592929+0000","last_unstale":"2024-04-26T23:40:34.310209+0000","last_undegraded":"2024-04-26T23:40:34.310209+0000","last_fullsized":"2024-04-26T23:40:34.310209+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:12:45.093169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:40:34.333749+0000","last_change":"2024-04-26T23:40:31.570118+0000","last_active":"2024-04-26T23:40:34.333749+0000","last_peered":"2024-04-26T23:40:34.333749+0000","last_clean":"2024-04-26T23:40:34.333749+0000","last_became_active":"2024-04-26T23:40:31.569764+0000","last_became_peered":"2024-04-26T23:40:31.569764+0000","last_unstale":"2024-04-26T23:40:34.333749+0000","last_undegraded":"2024-04-26T23:40:34.333749+0000","last_fullsized":"2024-04-26T23:40:34.333749+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:15:30.884135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":170,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:40:34.333409+0000","last_change":"2024-04-26T23:40:20.966672+0000","last_active":"2024-04-26T23:40:34.333409+0000","last_peered":"2024-04-26T23:40:34.333409+0000","last_clean":"2024-04-26T23:40:34.333409+0000","last_became_active":"2024-04-26T23:40:20.963937+0000","last_became_peered":"2024-04-26T23:40:20.963937+0000","last_unstale":"2024-04-26T23:40:34.333409+0000","last_undegraded":"2024-04-26T23:40:34.333409+0000","last_fullsized":"2024-04-26T23:40:34.333409+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:19.950137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:19.950137+0000","last_clean_scrub_stamp":"2024-04-26T23:40:19.950137+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:23:39.166579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:40:39.646413+0000","last_change":"2024-04-26T23:40:39.646413+0000","last_active":"2024-04-26T23:40:39.646413+0000","last_peered":"2024-04-26T23:40:39.646413+0000","last_clean":"2024-04-26T23:40:39.646413+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:40:39.646413+0000","last_undegraded":"2024-04-26T23:40:39.646413+0000","last_fullsized":"2024-04-26T23:40:39.646413+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:40:40.651867+0000","last_change":"2024-04-26T23:40:40.651867+0000","last_active":"2024-04-26T23:40:40.651867+0000","last_peered":"2024-04-26T23:40:40.651867+0000","last_clean":"2024-04-26T23:40:40.651867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:40:40.651867+0000","last_undegraded":"2024-04-26T23:40:40.651867+0000","last_fullsized":"2024-04-26T23:40:40.651867+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:40:34.333479+0000","last_change":"2024-04-26T23:40:32.591906+0000","last_active":"2024-04-26T23:40:34.333479+0000","last_peered":"2024-04-26T23:40:34.333479+0000","last_clean":"2024-04-26T23:40:34.333479+0000","last_became_active":"2024-04-26T23:40:32.590867+0000","last_became_peered":"2024-04-26T23:40:32.590867+0000","last_unstale":"2024-04-26T23:40:34.333479+0000","last_undegraded":"2024-04-26T23:40:34.333479+0000","last_fullsized":"2024-04-26T23:40:34.333479+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:56:04.309611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:40:33.640493+0000","last_change":"2024-04-26T23:40:31.572391+0000","last_active":"2024-04-26T23:40:33.640493+0000","last_peered":"2024-04-26T23:40:33.640493+0000","last_clean":"2024-04-26T23:40:33.640493+0000","last_became_active":"2024-04-26T23:40:31.571849+0000","last_became_peered":"2024-04-26T23:40:31.571849+0000","last_unstale":"2024-04-26T23:40:33.640493+0000","last_undegraded":"2024-04-26T23:40:33.640493+0000","last_fullsized":"2024-04-26T23:40:33.640493+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:35:54.439397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:40:39.646413+0000","last_change":"2024-04-26T23:40:39.646413+0000","last_active":"2024-04-26T23:40:39.646413+0000","last_peered":"2024-04-26T23:40:39.646413+0000","last_clean":"2024-04-26T23:40:39.646413+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:40:39.646413+0000","last_undegraded":"2024-04-26T23:40:39.646413+0000","last_fullsized":"2024-04-26T23:40:39.646413+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:40:40.651867+0000","last_change":"2024-04-26T23:40:40.651867+0000","last_active":"2024-04-26T23:40:40.651867+0000","last_peered":"2024-04-26T23:40:40.651867+0000","last_clean":"2024-04-26T23:40:40.651867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:40:40.651867+0000","last_undegraded":"2024-04-26T23:40:40.651867+0000","last_fullsized":"2024-04-26T23:40:40.651867+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:40:34.334016+0000","last_change":"2024-04-26T23:40:32.583469+0000","last_active":"2024-04-26T23:40:34.334016+0000","last_peered":"2024-04-26T23:40:34.334016+0000","last_clean":"2024-04-26T23:40:34.334016+0000","last_became_active":"2024-04-26T23:40:32.583174+0000","last_became_peered":"2024-04-26T23:40:32.583174+0000","last_unstale":"2024-04-26T23:40:34.334016+0000","last_undegraded":"2024-04-26T23:40:34.334016+0000","last_fullsized":"2024-04-26T23:40:34.334016+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:34:14.811917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:40:33.580261+0000","last_change":"2024-04-26T23:40:31.571749+0000","last_active":"2024-04-26T23:40:33.580261+0000","last_peered":"2024-04-26T23:40:33.580261+0000","last_clean":"2024-04-26T23:40:33.580261+0000","last_became_active":"2024-04-26T23:40:31.571427+0000","last_became_peered":"2024-04-26T23:40:31.571427+0000","last_unstale":"2024-04-26T23:40:33.580261+0000","last_undegraded":"2024-04-26T23:40:33.580261+0000","last_fullsized":"2024-04-26T23:40:33.580261+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:20:28.103413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:40:39.646413+0000","last_change":"2024-04-26T23:40:39.646413+0000","last_active":"2024-04-26T23:40:39.646413+0000","last_peered":"2024-04-26T23:40:39.646413+0000","last_clean":"2024-04-26T23:40:39.646413+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:40:39.646413+0000","last_undegraded":"2024-04-26T23:40:39.646413+0000","last_fullsized":"2024-04-26T23:40:39.646413+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:40:40.651867+0000","last_change":"2024-04-26T23:40:40.651867+0000","last_active":"2024-04-26T23:40:40.651867+0000","last_peered":"2024-04-26T23:40:40.651867+0000","last_clean":"2024-04-26T23:40:40.651867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:40:40.651867+0000","last_undegraded":"2024-04-26T23:40:40.651867+0000","last_fullsized":"2024-04-26T23:40:40.651867+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:40:34.333816+0000","last_change":"2024-04-26T23:40:32.596306+0000","last_active":"2024-04-26T23:40:34.333816+0000","last_peered":"2024-04-26T23:40:34.333816+0000","last_clean":"2024-04-26T23:40:34.333816+0000","last_became_active":"2024-04-26T23:40:32.595625+0000","last_became_peered":"2024-04-26T23:40:32.595625+0000","last_unstale":"2024-04-26T23:40:34.333816+0000","last_undegraded":"2024-04-26T23:40:34.333816+0000","last_fullsized":"2024-04-26T23:40:34.333816+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:10:02.629199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:40:33.640608+0000","last_change":"2024-04-26T23:40:31.570870+0000","last_active":"2024-04-26T23:40:33.640608+0000","last_peered":"2024-04-26T23:40:33.640608+0000","last_clean":"2024-04-26T23:40:33.640608+0000","last_became_active":"2024-04-26T23:40:31.570592+0000","last_became_peered":"2024-04-26T23:40:31.570592+0000","last_unstale":"2024-04-26T23:40:33.640608+0000","last_undegraded":"2024-04-26T23:40:33.640608+0000","last_fullsized":"2024-04-26T23:40:33.640608+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:43:13.740214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:40:39.646413+0000","last_change":"2024-04-26T23:40:39.646413+0000","last_active":"2024-04-26T23:40:39.646413+0000","last_peered":"2024-04-26T23:40:39.646413+0000","last_clean":"2024-04-26T23:40:39.646413+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:40:39.646413+0000","last_undegraded":"2024-04-26T23:40:39.646413+0000","last_fullsized":"2024-04-26T23:40:39.646413+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:40:40.651867+0000","last_change":"2024-04-26T23:40:40.651867+0000","last_active":"2024-04-26T23:40:40.651867+0000","last_peered":"2024-04-26T23:40:40.651867+0000","last_clean":"2024-04-26T23:40:40.651867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:40:40.651867+0000","last_undegraded":"2024-04-26T23:40:40.651867+0000","last_fullsized":"2024-04-26T23:40:40.651867+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:40:34.333381+0000","last_change":"2024-04-26T23:40:32.593577+0000","last_active":"2024-04-26T23:40:34.333381+0000","last_peered":"2024-04-26T23:40:34.333381+0000","last_clean":"2024-04-26T23:40:34.333381+0000","last_became_active":"2024-04-26T23:40:32.593235+0000","last_became_peered":"2024-04-26T23:40:32.593235+0000","last_unstale":"2024-04-26T23:40:34.333381+0000","last_undegraded":"2024-04-26T23:40:34.333381+0000","last_fullsized":"2024-04-26T23:40:34.333381+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:01:02.741964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:40:33.579946+0000","last_change":"2024-04-26T23:40:31.575943+0000","last_active":"2024-04-26T23:40:33.579946+0000","last_peered":"2024-04-26T23:40:33.579946+0000","last_clean":"2024-04-26T23:40:33.579946+0000","last_became_active":"2024-04-26T23:40:31.575632+0000","last_became_peered":"2024-04-26T23:40:31.575632+0000","last_unstale":"2024-04-26T23:40:33.579946+0000","last_undegraded":"2024-04-26T23:40:33.579946+0000","last_fullsized":"2024-04-26T23:40:33.579946+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:11:08.189634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:40:39.646413+0000","last_change":"2024-04-26T23:40:39.646413+0000","last_active":"2024-04-26T23:40:39.646413+0000","last_peered":"2024-04-26T23:40:39.646413+0000","last_clean":"2024-04-26T23:40:39.646413+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:40:39.646413+0000","last_undegraded":"2024-04-26T23:40:39.646413+0000","last_fullsized":"2024-04-26T23:40:39.646413+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:40:40.651867+0000","last_change":"2024-04-26T23:40:40.651867+0000","last_active":"2024-04-26T23:40:40.651867+0000","last_peered":"2024-04-26T23:40:40.651867+0000","last_clean":"2024-04-26T23:40:40.651867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:40:40.651867+0000","last_undegraded":"2024-04-26T23:40:40.651867+0000","last_fullsized":"2024-04-26T23:40:40.651867+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:40:34.333527+0000","last_change":"2024-04-26T23:40:32.593528+0000","last_active":"2024-04-26T23:40:34.333527+0000","last_peered":"2024-04-26T23:40:34.333527+0000","last_clean":"2024-04-26T23:40:34.333527+0000","last_became_active":"2024-04-26T23:40:32.593220+0000","last_became_peered":"2024-04-26T23:40:32.593220+0000","last_unstale":"2024-04-26T23:40:34.333527+0000","last_undegraded":"2024-04-26T23:40:34.333527+0000","last_fullsized":"2024-04-26T23:40:34.333527+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:04:30.553552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:40:33.640362+0000","last_change":"2024-04-26T23:40:31.572685+0000","last_active":"2024-04-26T23:40:33.640362+0000","last_peered":"2024-04-26T23:40:33.640362+0000","last_clean":"2024-04-26T23:40:33.640362+0000","last_became_active":"2024-04-26T23:40:31.572169+0000","last_became_peered":"2024-04-26T23:40:31.572169+0000","last_unstale":"2024-04-26T23:40:33.640362+0000","last_undegraded":"2024-04-26T23:40:33.640362+0000","last_fullsized":"2024-04-26T23:40:33.640362+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:15:30.884135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:40:39.646413+0000","last_change":"2024-04-26T23:40:39.646413+0000","last_active":"2024-04-26T23:40:39.646413+0000","last_peered":"2024-04-26T23:40:39.646413+0000","last_clean":"2024-04-26T23:40:39.646413+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:40:39.646413+0000","last_undegraded":"2024-04-26T23:40:39.646413+0000","last_fullsized":"2024-04-26T23:40:39.646413+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:40:40.651867+0000","last_change":"2024-04-26T23:40:40.651867+0000","last_active":"2024-04-26T23:40:40.651867+0000","last_peered":"2024-04-26T23:40:40.651867+0000","last_clean":"2024-04-26T23:40:40.651867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:40:40.651867+0000","last_undegraded":"2024-04-26T23:40:40.651867+0000","last_fullsized":"2024-04-26T23:40:40.651867+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:40:33.580693+0000","last_change":"2024-04-26T23:40:32.586832+0000","last_active":"2024-04-26T23:40:33.580693+0000","last_peered":"2024-04-26T23:40:33.580693+0000","last_clean":"2024-04-26T23:40:33.580693+0000","last_became_active":"2024-04-26T23:40:32.585809+0000","last_became_peered":"2024-04-26T23:40:32.585809+0000","last_unstale":"2024-04-26T23:40:33.580693+0000","last_undegraded":"2024-04-26T23:40:33.580693+0000","last_fullsized":"2024-04-26T23:40:33.580693+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:51:30.677247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:40:33.580707+0000","last_change":"2024-04-26T23:40:31.569512+0000","last_active":"2024-04-26T23:40:33.580707+0000","last_peered":"2024-04-26T23:40:33.580707+0000","last_clean":"2024-04-26T23:40:33.580707+0000","last_became_active":"2024-04-26T23:40:31.568598+0000","last_became_peered":"2024-04-26T23:40:31.568598+0000","last_unstale":"2024-04-26T23:40:33.580707+0000","last_undegraded":"2024-04-26T23:40:33.580707+0000","last_fullsized":"2024-04-26T23:40:33.580707+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:48:32.015654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:40:39.646413+0000","last_change":"2024-04-26T23:40:39.646413+0000","last_active":"2024-04-26T23:40:39.646413+0000","last_peered":"2024-04-26T23:40:39.646413+0000","last_clean":"2024-04-26T23:40:39.646413+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:40:39.646413+0000","last_undegraded":"2024-04-26T23:40:39.646413+0000","last_fullsized":"2024-04-26T23:40:39.646413+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:40:40.651867+0000","last_change":"2024-04-26T23:40:40.651867+0000","last_active":"2024-04-26T23:40:40.651867+0000","last_peered":"2024-04-26T23:40:40.651867+0000","last_clean":"2024-04-26T23:40:40.651867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:40:40.651867+0000","last_undegraded":"2024-04-26T23:40:40.651867+0000","last_fullsized":"2024-04-26T23:40:40.651867+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:40:34.333716+0000","last_change":"2024-04-26T23:40:32.595377+0000","last_active":"2024-04-26T23:40:34.333716+0000","last_peered":"2024-04-26T23:40:34.333716+0000","last_clean":"2024-04-26T23:40:34.333716+0000","last_became_active":"2024-04-26T23:40:32.595032+0000","last_became_peered":"2024-04-26T23:40:32.595032+0000","last_unstale":"2024-04-26T23:40:34.333716+0000","last_undegraded":"2024-04-26T23:40:34.333716+0000","last_fullsized":"2024-04-26T23:40:34.333716+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:44:42.494850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:40:34.334480+0000","last_change":"2024-04-26T23:40:31.575493+0000","last_active":"2024-04-26T23:40:34.334480+0000","last_peered":"2024-04-26T23:40:34.334480+0000","last_clean":"2024-04-26T23:40:34.334480+0000","last_became_active":"2024-04-26T23:40:31.575039+0000","last_became_peered":"2024-04-26T23:40:31.575039+0000","last_unstale":"2024-04-26T23:40:34.334480+0000","last_undegraded":"2024-04-26T23:40:34.334480+0000","last_fullsized":"2024-04-26T23:40:34.334480+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:43:13.740214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:40:39.646413+0000","last_change":"2024-04-26T23:40:39.646413+0000","last_active":"2024-04-26T23:40:39.646413+0000","last_peered":"2024-04-26T23:40:39.646413+0000","last_clean":"2024-04-26T23:40:39.646413+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:40:39.646413+0000","last_undegraded":"2024-04-26T23:40:39.646413+0000","last_fullsized":"2024-04-26T23:40:39.646413+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:40:40.651867+0000","last_change":"2024-04-26T23:40:40.651867+0000","last_active":"2024-04-26T23:40:40.651867+0000","last_peered":"2024-04-26T23:40:40.651867+0000","last_clean":"2024-04-26T23:40:40.651867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:40:40.651867+0000","last_undegraded":"2024-04-26T23:40:40.651867+0000","last_fullsized":"2024-04-26T23:40:40.651867+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:40:34.333450+0000","last_change":"2024-04-26T23:40:32.589706+0000","last_active":"2024-04-26T23:40:34.333450+0000","last_peered":"2024-04-26T23:40:34.333450+0000","last_clean":"2024-04-26T23:40:34.333450+0000","last_became_active":"2024-04-26T23:40:32.589452+0000","last_became_peered":"2024-04-26T23:40:32.589452+0000","last_unstale":"2024-04-26T23:40:34.333450+0000","last_undegraded":"2024-04-26T23:40:34.333450+0000","last_fullsized":"2024-04-26T23:40:34.333450+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:15:01.970308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:40:34.333643+0000","last_change":"2024-04-26T23:40:31.573941+0000","last_active":"2024-04-26T23:40:34.333643+0000","last_peered":"2024-04-26T23:40:34.333643+0000","last_clean":"2024-04-26T23:40:34.333643+0000","last_became_active":"2024-04-26T23:40:31.573668+0000","last_became_peered":"2024-04-26T23:40:31.573668+0000","last_unstale":"2024-04-26T23:40:34.333643+0000","last_undegraded":"2024-04-26T23:40:34.333643+0000","last_fullsized":"2024-04-26T23:40:34.333643+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:58:06.477730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:40:39.646413+0000","last_change":"2024-04-26T23:40:39.646413+0000","last_active":"2024-04-26T23:40:39.646413+0000","last_peered":"2024-04-26T23:40:39.646413+0000","last_clean":"2024-04-26T23:40:39.646413+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:40:39.646413+0000","last_undegraded":"2024-04-26T23:40:39.646413+0000","last_fullsized":"2024-04-26T23:40:39.646413+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:40:40.651867+0000","last_change":"2024-04-26T23:40:40.651867+0000","last_active":"2024-04-26T23:40:40.651867+0000","last_peered":"2024-04-26T23:40:40.651867+0000","last_clean":"2024-04-26T23:40:40.651867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:40:40.651867+0000","last_undegraded":"2024-04-26T23:40:40.651867+0000","last_fullsized":"2024-04-26T23:40:40.651867+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:40:34.333604+0000","last_change":"2024-04-26T23:40:32.587513+0000","last_active":"2024-04-26T23:40:34.333604+0000","last_peered":"2024-04-26T23:40:34.333604+0000","last_clean":"2024-04-26T23:40:34.333604+0000","last_became_active":"2024-04-26T23:40:32.587200+0000","last_became_peered":"2024-04-26T23:40:32.587200+0000","last_unstale":"2024-04-26T23:40:34.333604+0000","last_undegraded":"2024-04-26T23:40:34.333604+0000","last_fullsized":"2024-04-26T23:40:34.333604+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:37:30.361795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:40:33.580998+0000","last_change":"2024-04-26T23:40:31.572331+0000","last_active":"2024-04-26T23:40:33.580998+0000","last_peered":"2024-04-26T23:40:33.580998+0000","last_clean":"2024-04-26T23:40:33.580998+0000","last_became_active":"2024-04-26T23:40:31.572074+0000","last_became_peered":"2024-04-26T23:40:31.572074+0000","last_unstale":"2024-04-26T23:40:33.580998+0000","last_undegraded":"2024-04-26T23:40:33.580998+0000","last_fullsized":"2024-04-26T23:40:33.580998+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:45:49.295198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:40:39.646413+0000","last_change":"2024-04-26T23:40:39.646413+0000","last_active":"2024-04-26T23:40:39.646413+0000","last_peered":"2024-04-26T23:40:39.646413+0000","last_clean":"2024-04-26T23:40:39.646413+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:40:39.646413+0000","last_undegraded":"2024-04-26T23:40:39.646413+0000","last_fullsized":"2024-04-26T23:40:39.646413+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:40:40.651867+0000","last_change":"2024-04-26T23:40:40.651867+0000","last_active":"2024-04-26T23:40:40.651867+0000","last_peered":"2024-04-26T23:40:40.651867+0000","last_clean":"2024-04-26T23:40:40.651867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:40:40.651867+0000","last_undegraded":"2024-04-26T23:40:40.651867+0000","last_fullsized":"2024-04-26T23:40:40.651867+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:40:33.580001+0000","last_change":"2024-04-26T23:40:32.593298+0000","last_active":"2024-04-26T23:40:33.580001+0000","last_peered":"2024-04-26T23:40:33.580001+0000","last_clean":"2024-04-26T23:40:33.580001+0000","last_became_active":"2024-04-26T23:40:32.593030+0000","last_became_peered":"2024-04-26T23:40:32.593030+0000","last_unstale":"2024-04-26T23:40:33.580001+0000","last_undegraded":"2024-04-26T23:40:33.580001+0000","last_fullsized":"2024-04-26T23:40:33.580001+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:20:29.107798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:40:33.580226+0000","last_change":"2024-04-26T23:40:31.574234+0000","last_active":"2024-04-26T23:40:33.580226+0000","last_peered":"2024-04-26T23:40:33.580226+0000","last_clean":"2024-04-26T23:40:33.580226+0000","last_became_active":"2024-04-26T23:40:31.572218+0000","last_became_peered":"2024-04-26T23:40:31.572218+0000","last_unstale":"2024-04-26T23:40:33.580226+0000","last_undegraded":"2024-04-26T23:40:33.580226+0000","last_fullsized":"2024-04-26T23:40:33.580226+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:25:01.315397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:40:39.646413+0000","last_change":"2024-04-26T23:40:39.646413+0000","last_active":"2024-04-26T23:40:39.646413+0000","last_peered":"2024-04-26T23:40:39.646413+0000","last_clean":"2024-04-26T23:40:39.646413+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:40:39.646413+0000","last_undegraded":"2024-04-26T23:40:39.646413+0000","last_fullsized":"2024-04-26T23:40:39.646413+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:40:40.651867+0000","last_change":"2024-04-26T23:40:40.651867+0000","last_active":"2024-04-26T23:40:40.651867+0000","last_peered":"2024-04-26T23:40:40.651867+0000","last_clean":"2024-04-26T23:40:40.651867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:40:40.651867+0000","last_undegraded":"2024-04-26T23:40:40.651867+0000","last_fullsized":"2024-04-26T23:40:40.651867+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:40:34.333627+0000","last_change":"2024-04-26T23:40:32.589146+0000","last_active":"2024-04-26T23:40:34.333627+0000","last_peered":"2024-04-26T23:40:34.333627+0000","last_clean":"2024-04-26T23:40:34.333627+0000","last_became_active":"2024-04-26T23:40:32.588881+0000","last_became_peered":"2024-04-26T23:40:32.588881+0000","last_unstale":"2024-04-26T23:40:34.333627+0000","last_undegraded":"2024-04-26T23:40:34.333627+0000","last_fullsized":"2024-04-26T23:40:34.333627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:38:10.884592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:40:34.334061+0000","last_change":"2024-04-26T23:40:31.575616+0000","last_active":"2024-04-26T23:40:34.334061+0000","last_peered":"2024-04-26T23:40:34.334061+0000","last_clean":"2024-04-26T23:40:34.334061+0000","last_became_active":"2024-04-26T23:40:31.575211+0000","last_became_peered":"2024-04-26T23:40:31.575211+0000","last_unstale":"2024-04-26T23:40:34.334061+0000","last_undegraded":"2024-04-26T23:40:34.334061+0000","last_fullsized":"2024-04-26T23:40:34.334061+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:48:32.015654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:40:39.646413+0000","last_change":"2024-04-26T23:40:39.646413+0000","last_active":"2024-04-26T23:40:39.646413+0000","last_peered":"2024-04-26T23:40:39.646413+0000","last_clean":"2024-04-26T23:40:39.646413+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:40:39.646413+0000","last_undegraded":"2024-04-26T23:40:39.646413+0000","last_fullsized":"2024-04-26T23:40:39.646413+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:40:40.651867+0000","last_change":"2024-04-26T23:40:40.651867+0000","last_active":"2024-04-26T23:40:40.651867+0000","last_peered":"2024-04-26T23:40:40.651867+0000","last_clean":"2024-04-26T23:40:40.651867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:40:40.651867+0000","last_undegraded":"2024-04-26T23:40:40.651867+0000","last_fullsized":"2024-04-26T23:40:40.651867+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:40:34.334154+0000","last_change":"2024-04-26T23:40:32.589793+0000","last_active":"2024-04-26T23:40:34.334154+0000","last_peered":"2024-04-26T23:40:34.334154+0000","last_clean":"2024-04-26T23:40:34.334154+0000","last_became_active":"2024-04-26T23:40:32.589478+0000","last_became_peered":"2024-04-26T23:40:32.589478+0000","last_unstale":"2024-04-26T23:40:34.334154+0000","last_undegraded":"2024-04-26T23:40:34.334154+0000","last_fullsized":"2024-04-26T23:40:34.334154+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:56:04.309611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:40:33.580804+0000","last_change":"2024-04-26T23:40:31.573794+0000","last_active":"2024-04-26T23:40:33.580804+0000","last_peered":"2024-04-26T23:40:33.580804+0000","last_clean":"2024-04-26T23:40:33.580804+0000","last_became_active":"2024-04-26T23:40:31.573164+0000","last_became_peered":"2024-04-26T23:40:31.573164+0000","last_unstale":"2024-04-26T23:40:33.580804+0000","last_undegraded":"2024-04-26T23:40:33.580804+0000","last_fullsized":"2024-04-26T23:40:33.580804+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:15:30.884135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:40:39.646413+0000","last_change":"2024-04-26T23:40:39.646413+0000","last_active":"2024-04-26T23:40:39.646413+0000","last_peered":"2024-04-26T23:40:39.646413+0000","last_clean":"2024-04-26T23:40:39.646413+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:40:39.646413+0000","last_undegraded":"2024-04-26T23:40:39.646413+0000","last_fullsized":"2024-04-26T23:40:39.646413+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:40:40.651867+0000","last_change":"2024-04-26T23:40:40.651867+0000","last_active":"2024-04-26T23:40:40.651867+0000","last_peered":"2024-04-26T23:40:40.651867+0000","last_clean":"2024-04-26T23:40:40.651867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:40:40.651867+0000","last_undegraded":"2024-04-26T23:40:40.651867+0000","last_fullsized":"2024-04-26T23:40:40.651867+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:40:39.646413+0000","last_change":"2024-04-26T23:40:39.646413+0000","last_active":"2024-04-26T23:40:39.646413+0000","last_peered":"2024-04-26T23:40:39.646413+0000","last_clean":"2024-04-26T23:40:39.646413+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:40:39.646413+0000","last_undegraded":"2024-04-26T23:40:39.646413+0000","last_fullsized":"2024-04-26T23:40:39.646413+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:40:33.580185+0000","last_change":"2024-04-26T23:40:32.583014+0000","last_active":"2024-04-26T23:40:33.580185+0000","last_peered":"2024-04-26T23:40:33.580185+0000","last_clean":"2024-04-26T23:40:33.580185+0000","last_became_active":"2024-04-26T23:40:32.582751+0000","last_became_peered":"2024-04-26T23:40:32.582751+0000","last_unstale":"2024-04-26T23:40:33.580185+0000","last_undegraded":"2024-04-26T23:40:33.580185+0000","last_fullsized":"2024-04-26T23:40:33.580185+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:38:10.884592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:40:34.334331+0000","last_change":"2024-04-26T23:40:31.572402+0000","last_active":"2024-04-26T23:40:34.334331+0000","last_peered":"2024-04-26T23:40:34.334331+0000","last_clean":"2024-04-26T23:40:34.334331+0000","last_became_active":"2024-04-26T23:40:31.572111+0000","last_became_peered":"2024-04-26T23:40:31.572111+0000","last_unstale":"2024-04-26T23:40:34.334331+0000","last_undegraded":"2024-04-26T23:40:34.334331+0000","last_fullsized":"2024-04-26T23:40:34.334331+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:20:28.103413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:40:40.651867+0000","last_change":"2024-04-26T23:40:40.651867+0000","last_active":"2024-04-26T23:40:40.651867+0000","last_peered":"2024-04-26T23:40:40.651867+0000","last_clean":"2024-04-26T23:40:40.651867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:40:40.651867+0000","last_undegraded":"2024-04-26T23:40:40.651867+0000","last_fullsized":"2024-04-26T23:40:40.651867+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:40:39.646413+0000","last_change":"2024-04-26T23:40:39.646413+0000","last_active":"2024-04-26T23:40:39.646413+0000","last_peered":"2024-04-26T23:40:39.646413+0000","last_clean":"2024-04-26T23:40:39.646413+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:40:39.646413+0000","last_undegraded":"2024-04-26T23:40:39.646413+0000","last_fullsized":"2024-04-26T23:40:39.646413+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:40:34.310006+0000","last_change":"2024-04-26T23:40:32.586204+0000","last_active":"2024-04-26T23:40:34.310006+0000","last_peered":"2024-04-26T23:40:34.310006+0000","last_clean":"2024-04-26T23:40:34.310006+0000","last_became_active":"2024-04-26T23:40:32.585725+0000","last_became_peered":"2024-04-26T23:40:32.585725+0000","last_unstale":"2024-04-26T23:40:34.310006+0000","last_undegraded":"2024-04-26T23:40:34.310006+0000","last_fullsized":"2024-04-26T23:40:34.310006+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:51:30.677247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:40:34.310058+0000","last_change":"2024-04-26T23:40:31.578929+0000","last_active":"2024-04-26T23:40:34.310058+0000","last_peered":"2024-04-26T23:40:34.310058+0000","last_clean":"2024-04-26T23:40:34.310058+0000","last_became_active":"2024-04-26T23:40:31.578623+0000","last_became_peered":"2024-04-26T23:40:31.578623+0000","last_unstale":"2024-04-26T23:40:34.310058+0000","last_undegraded":"2024-04-26T23:40:34.310058+0000","last_fullsized":"2024-04-26T23:40:34.310058+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:50:21.330821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:40:40.651867+0000","last_change":"2024-04-26T23:40:40.651867+0000","last_active":"2024-04-26T23:40:40.651867+0000","last_peered":"2024-04-26T23:40:40.651867+0000","last_clean":"2024-04-26T23:40:40.651867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:40:40.651867+0000","last_undegraded":"2024-04-26T23:40:40.651867+0000","last_fullsized":"2024-04-26T23:40:40.651867+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:40:33.580705+0000","last_change":"2024-04-26T23:40:31.567755+0000","last_active":"2024-04-26T23:40:33.580705+0000","last_peered":"2024-04-26T23:40:33.580705+0000","last_clean":"2024-04-26T23:40:33.580705+0000","last_became_active":"2024-04-26T23:40:31.567484+0000","last_became_peered":"2024-04-26T23:40:31.567484+0000","last_unstale":"2024-04-26T23:40:33.580705+0000","last_undegraded":"2024-04-26T23:40:33.580705+0000","last_fullsized":"2024-04-26T23:40:33.580705+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:43:13.740214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:40:34.333578+0000","last_change":"2024-04-26T23:40:32.594689+0000","last_active":"2024-04-26T23:40:34.333578+0000","last_peered":"2024-04-26T23:40:34.333578+0000","last_clean":"2024-04-26T23:40:34.333578+0000","last_became_active":"2024-04-26T23:40:32.592365+0000","last_became_peered":"2024-04-26T23:40:32.592365+0000","last_unstale":"2024-04-26T23:40:34.333578+0000","last_undegraded":"2024-04-26T23:40:34.333578+0000","last_fullsized":"2024-04-26T23:40:34.333578+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:17:46.135806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:40:39.646413+0000","last_change":"2024-04-26T23:40:39.646413+0000","last_active":"2024-04-26T23:40:39.646413+0000","last_peered":"2024-04-26T23:40:39.646413+0000","last_clean":"2024-04-26T23:40:39.646413+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:40:39.646413+0000","last_undegraded":"2024-04-26T23:40:39.646413+0000","last_fullsized":"2024-04-26T23:40:39.646413+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:40:40.651867+0000","last_change":"2024-04-26T23:40:40.651867+0000","last_active":"2024-04-26T23:40:40.651867+0000","last_peered":"2024-04-26T23:40:40.651867+0000","last_clean":"2024-04-26T23:40:40.651867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:40:40.651867+0000","last_undegraded":"2024-04-26T23:40:40.651867+0000","last_fullsized":"2024-04-26T23:40:40.651867+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:40:34.310324+0000","last_change":"2024-04-26T23:40:31.576749+0000","last_active":"2024-04-26T23:40:34.310324+0000","last_peered":"2024-04-26T23:40:34.310324+0000","last_clean":"2024-04-26T23:40:34.310324+0000","last_became_active":"2024-04-26T23:40:31.576178+0000","last_became_peered":"2024-04-26T23:40:31.576178+0000","last_unstale":"2024-04-26T23:40:34.310324+0000","last_undegraded":"2024-04-26T23:40:34.310324+0000","last_fullsized":"2024-04-26T23:40:34.310324+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:15:30.884135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:40:33.579610+0000","last_change":"2024-04-26T23:40:32.589208+0000","last_active":"2024-04-26T23:40:33.579610+0000","last_peered":"2024-04-26T23:40:33.579610+0000","last_clean":"2024-04-26T23:40:33.579610+0000","last_became_active":"2024-04-26T23:40:32.588927+0000","last_became_peered":"2024-04-26T23:40:32.588927+0000","last_unstale":"2024-04-26T23:40:33.579610+0000","last_undegraded":"2024-04-26T23:40:33.579610+0000","last_fullsized":"2024-04-26T23:40:33.579610+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:45:50.299583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:40:39.646413+0000","last_change":"2024-04-26T23:40:39.646413+0000","last_active":"2024-04-26T23:40:39.646413+0000","last_peered":"2024-04-26T23:40:39.646413+0000","last_clean":"2024-04-26T23:40:39.646413+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:40:39.646413+0000","last_undegraded":"2024-04-26T23:40:39.646413+0000","last_fullsized":"2024-04-26T23:40:39.646413+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:40:40.651867+0000","last_change":"2024-04-26T23:40:40.651867+0000","last_active":"2024-04-26T23:40:40.651867+0000","last_peered":"2024-04-26T23:40:40.651867+0000","last_clean":"2024-04-26T23:40:40.651867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:40:40.651867+0000","last_undegraded":"2024-04-26T23:40:40.651867+0000","last_fullsized":"2024-04-26T23:40:40.651867+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:40:33.580581+0000","last_change":"2024-04-26T23:40:32.586672+0000","last_active":"2024-04-26T23:40:33.580581+0000","last_peered":"2024-04-26T23:40:33.580581+0000","last_clean":"2024-04-26T23:40:33.580581+0000","last_became_active":"2024-04-26T23:40:32.586399+0000","last_became_peered":"2024-04-26T23:40:32.586399+0000","last_unstale":"2024-04-26T23:40:33.580581+0000","last_undegraded":"2024-04-26T23:40:33.580581+0000","last_fullsized":"2024-04-26T23:40:33.580581+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:15:01.970308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:40:40.651867+0000","last_change":"2024-04-26T23:40:40.651867+0000","last_active":"2024-04-26T23:40:40.651867+0000","last_peered":"2024-04-26T23:40:40.651867+0000","last_clean":"2024-04-26T23:40:40.651867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:40:40.651867+0000","last_undegraded":"2024-04-26T23:40:40.651867+0000","last_fullsized":"2024-04-26T23:40:40.651867+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:40:33.640433+0000","last_change":"2024-04-26T23:40:32.584590+0000","last_active":"2024-04-26T23:40:33.640433+0000","last_peered":"2024-04-26T23:40:33.640433+0000","last_clean":"2024-04-26T23:40:33.640433+0000","last_became_active":"2024-04-26T23:40:32.584234+0000","last_became_peered":"2024-04-26T23:40:32.584234+0000","last_unstale":"2024-04-26T23:40:33.640433+0000","last_undegraded":"2024-04-26T23:40:33.640433+0000","last_fullsized":"2024-04-26T23:40:33.640433+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:15:52.942160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:40:40.651867+0000","last_change":"2024-04-26T23:40:40.651867+0000","last_active":"2024-04-26T23:40:40.651867+0000","last_peered":"2024-04-26T23:40:40.651867+0000","last_clean":"2024-04-26T23:40:40.651867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:40:40.651867+0000","last_undegraded":"2024-04-26T23:40:40.651867+0000","last_fullsized":"2024-04-26T23:40:40.651867+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:40:34.333699+0000","last_change":"2024-04-26T23:40:32.580453+0000","last_active":"2024-04-26T23:40:34.333699+0000","last_peered":"2024-04-26T23:40:34.333699+0000","last_clean":"2024-04-26T23:40:34.333699+0000","last_became_active":"2024-04-26T23:40:32.580196+0000","last_became_peered":"2024-04-26T23:40:32.580196+0000","last_unstale":"2024-04-26T23:40:34.333699+0000","last_undegraded":"2024-04-26T23:40:34.333699+0000","last_fullsized":"2024-04-26T23:40:34.333699+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:18:09.706875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:40:40.651867+0000","last_change":"2024-04-26T23:40:40.651867+0000","last_active":"2024-04-26T23:40:40.651867+0000","last_peered":"2024-04-26T23:40:40.651867+0000","last_clean":"2024-04-26T23:40:40.651867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:40:40.651867+0000","last_undegraded":"2024-04-26T23:40:40.651867+0000","last_fullsized":"2024-04-26T23:40:40.651867+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:40:34.333540+0000","last_change":"2024-04-26T23:40:32.584323+0000","last_active":"2024-04-26T23:40:34.333540+0000","last_peered":"2024-04-26T23:40:34.333540+0000","last_clean":"2024-04-26T23:40:34.333540+0000","last_became_active":"2024-04-26T23:40:32.584010+0000","last_became_peered":"2024-04-26T23:40:32.584010+0000","last_unstale":"2024-04-26T23:40:34.333540+0000","last_undegraded":"2024-04-26T23:40:34.333540+0000","last_fullsized":"2024-04-26T23:40:34.333540+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:16:46.547536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:40:40.651867+0000","last_change":"2024-04-26T23:40:40.651867+0000","last_active":"2024-04-26T23:40:40.651867+0000","last_peered":"2024-04-26T23:40:40.651867+0000","last_clean":"2024-04-26T23:40:40.651867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:40:40.651867+0000","last_undegraded":"2024-04-26T23:40:40.651867+0000","last_fullsized":"2024-04-26T23:40:40.651867+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:40:34.310282+0000","last_change":"2024-04-26T23:40:32.587921+0000","last_active":"2024-04-26T23:40:34.310282+0000","last_peered":"2024-04-26T23:40:34.310282+0000","last_clean":"2024-04-26T23:40:34.310282+0000","last_became_active":"2024-04-26T23:40:32.587630+0000","last_became_peered":"2024-04-26T23:40:32.587630+0000","last_unstale":"2024-04-26T23:40:34.310282+0000","last_undegraded":"2024-04-26T23:40:34.310282+0000","last_fullsized":"2024-04-26T23:40:34.310282+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:01:02.741964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:40:40.651867+0000","last_change":"2024-04-26T23:40:40.651867+0000","last_active":"2024-04-26T23:40:40.651867+0000","last_peered":"2024-04-26T23:40:40.651867+0000","last_clean":"2024-04-26T23:40:40.651867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:40:40.651867+0000","last_undegraded":"2024-04-26T23:40:40.651867+0000","last_fullsized":"2024-04-26T23:40:40.651867+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:40:33.580158+0000","last_change":"2024-04-26T23:40:32.583376+0000","last_active":"2024-04-26T23:40:33.580158+0000","last_peered":"2024-04-26T23:40:33.580158+0000","last_clean":"2024-04-26T23:40:33.580158+0000","last_became_active":"2024-04-26T23:40:32.583089+0000","last_became_peered":"2024-04-26T23:40:32.583089+0000","last_unstale":"2024-04-26T23:40:33.580158+0000","last_undegraded":"2024-04-26T23:40:33.580158+0000","last_fullsized":"2024-04-26T23:40:33.580158+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:17:46.135806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:40:40.651867+0000","last_change":"2024-04-26T23:40:40.651867+0000","last_active":"2024-04-26T23:40:40.651867+0000","last_peered":"2024-04-26T23:40:40.651867+0000","last_clean":"2024-04-26T23:40:40.651867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:40:40.651867+0000","last_undegraded":"2024-04-26T23:40:40.651867+0000","last_fullsized":"2024-04-26T23:40:40.651867+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:40:33.581087+0000","last_change":"2024-04-26T23:40:32.589080+0000","last_active":"2024-04-26T23:40:33.581087+0000","last_peered":"2024-04-26T23:40:33.581087+0000","last_clean":"2024-04-26T23:40:33.581087+0000","last_became_active":"2024-04-26T23:40:32.588793+0000","last_became_peered":"2024-04-26T23:40:32.588793+0000","last_unstale":"2024-04-26T23:40:33.581087+0000","last_undegraded":"2024-04-26T23:40:33.581087+0000","last_fullsized":"2024-04-26T23:40:33.581087+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:18:09.706875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:40:40.651867+0000","last_change":"2024-04-26T23:40:40.651867+0000","last_active":"2024-04-26T23:40:40.651867+0000","last_peered":"2024-04-26T23:40:40.651867+0000","last_clean":"2024-04-26T23:40:40.651867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:40:40.651867+0000","last_undegraded":"2024-04-26T23:40:40.651867+0000","last_fullsized":"2024-04-26T23:40:40.651867+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:40:34.310431+0000","last_change":"2024-04-26T23:40:32.588177+0000","last_active":"2024-04-26T23:40:34.310431+0000","last_peered":"2024-04-26T23:40:34.310431+0000","last_clean":"2024-04-26T23:40:34.310431+0000","last_became_active":"2024-04-26T23:40:32.586926+0000","last_became_peered":"2024-04-26T23:40:32.586926+0000","last_unstale":"2024-04-26T23:40:34.310431+0000","last_undegraded":"2024-04-26T23:40:34.310431+0000","last_fullsized":"2024-04-26T23:40:34.310431+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:34:14.811917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:40:40.651867+0000","last_change":"2024-04-26T23:40:40.651867+0000","last_active":"2024-04-26T23:40:40.651867+0000","last_peered":"2024-04-26T23:40:40.651867+0000","last_clean":"2024-04-26T23:40:40.651867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:40:40.651867+0000","last_undegraded":"2024-04-26T23:40:40.651867+0000","last_fullsized":"2024-04-26T23:40:40.651867+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:40:34.334238+0000","last_change":"2024-04-26T23:40:32.582959+0000","last_active":"2024-04-26T23:40:34.334238+0000","last_peered":"2024-04-26T23:40:34.334238+0000","last_clean":"2024-04-26T23:40:34.334238+0000","last_became_active":"2024-04-26T23:40:32.582100+0000","last_became_peered":"2024-04-26T23:40:32.582100+0000","last_unstale":"2024-04-26T23:40:34.334238+0000","last_undegraded":"2024-04-26T23:40:34.334238+0000","last_fullsized":"2024-04-26T23:40:34.334238+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:37:30.361795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:40:40.651867+0000","last_change":"2024-04-26T23:40:40.651867+0000","last_active":"2024-04-26T23:40:40.651867+0000","last_peered":"2024-04-26T23:40:40.651867+0000","last_clean":"2024-04-26T23:40:40.651867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:40:40.651867+0000","last_undegraded":"2024-04-26T23:40:40.651867+0000","last_fullsized":"2024-04-26T23:40:40.651867+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:40:34.310028+0000","last_change":"2024-04-26T23:40:32.593958+0000","last_active":"2024-04-26T23:40:34.310028+0000","last_peered":"2024-04-26T23:40:34.310028+0000","last_clean":"2024-04-26T23:40:34.310028+0000","last_became_active":"2024-04-26T23:40:32.593639+0000","last_became_peered":"2024-04-26T23:40:32.593639+0000","last_unstale":"2024-04-26T23:40:34.310028+0000","last_undegraded":"2024-04-26T23:40:34.310028+0000","last_fullsized":"2024-04-26T23:40:34.310028+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:17:46.135806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:40:40.651867+0000","last_change":"2024-04-26T23:40:40.651867+0000","last_active":"2024-04-26T23:40:40.651867+0000","last_peered":"2024-04-26T23:40:40.651867+0000","last_clean":"2024-04-26T23:40:40.651867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:40:40.651867+0000","last_undegraded":"2024-04-26T23:40:40.651867+0000","last_fullsized":"2024-04-26T23:40:40.651867+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:40:34.334548+0000","last_change":"2024-04-26T23:40:32.591700+0000","last_active":"2024-04-26T23:40:34.334548+0000","last_peered":"2024-04-26T23:40:34.334548+0000","last_clean":"2024-04-26T23:40:34.334548+0000","last_became_active":"2024-04-26T23:40:32.591366+0000","last_became_peered":"2024-04-26T23:40:32.591366+0000","last_unstale":"2024-04-26T23:40:34.334548+0000","last_undegraded":"2024-04-26T23:40:34.334548+0000","last_fullsized":"2024-04-26T23:40:34.334548+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:10:02.629199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:40:40.651867+0000","last_change":"2024-04-26T23:40:40.651867+0000","last_active":"2024-04-26T23:40:40.651867+0000","last_peered":"2024-04-26T23:40:40.651867+0000","last_clean":"2024-04-26T23:40:40.651867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:40:40.651867+0000","last_undegraded":"2024-04-26T23:40:40.651867+0000","last_fullsized":"2024-04-26T23:40:40.651867+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:40:34.333444+0000","last_change":"2024-04-26T23:40:32.590443+0000","last_active":"2024-04-26T23:40:34.333444+0000","last_peered":"2024-04-26T23:40:34.333444+0000","last_clean":"2024-04-26T23:40:34.333444+0000","last_became_active":"2024-04-26T23:40:32.590193+0000","last_became_peered":"2024-04-26T23:40:32.590193+0000","last_unstale":"2024-04-26T23:40:34.333444+0000","last_undegraded":"2024-04-26T23:40:34.333444+0000","last_fullsized":"2024-04-26T23:40:34.333444+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:14:04.372681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:40:40.651867+0000","last_change":"2024-04-26T23:40:40.651867+0000","last_active":"2024-04-26T23:40:40.651867+0000","last_peered":"2024-04-26T23:40:40.651867+0000","last_clean":"2024-04-26T23:40:40.651867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:40:40.651867+0000","last_undegraded":"2024-04-26T23:40:40.651867+0000","last_fullsized":"2024-04-26T23:40:40.651867+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:40:33.581025+0000","last_change":"2024-04-26T23:40:32.590538+0000","last_active":"2024-04-26T23:40:33.581025+0000","last_peered":"2024-04-26T23:40:33.581025+0000","last_clean":"2024-04-26T23:40:33.581025+0000","last_became_active":"2024-04-26T23:40:32.590241+0000","last_became_peered":"2024-04-26T23:40:32.590241+0000","last_unstale":"2024-04-26T23:40:33.581025+0000","last_undegraded":"2024-04-26T23:40:33.581025+0000","last_fullsized":"2024-04-26T23:40:33.581025+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:38:10.884592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:40:40.651867+0000","last_change":"2024-04-26T23:40:40.651867+0000","last_active":"2024-04-26T23:40:40.651867+0000","last_peered":"2024-04-26T23:40:40.651867+0000","last_clean":"2024-04-26T23:40:40.651867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:40:40.651867+0000","last_undegraded":"2024-04-26T23:40:40.651867+0000","last_fullsized":"2024-04-26T23:40:40.651867+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:40:34.333835+0000","last_change":"2024-04-26T23:40:32.588445+0000","last_active":"2024-04-26T23:40:34.333835+0000","last_peered":"2024-04-26T23:40:34.333835+0000","last_clean":"2024-04-26T23:40:34.333835+0000","last_became_active":"2024-04-26T23:40:32.588063+0000","last_became_peered":"2024-04-26T23:40:32.588063+0000","last_unstale":"2024-04-26T23:40:34.333835+0000","last_undegraded":"2024-04-26T23:40:34.333835+0000","last_fullsized":"2024-04-26T23:40:34.333835+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:44:58.977344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:40:40.651867+0000","last_change":"2024-04-26T23:40:40.651867+0000","last_active":"2024-04-26T23:40:40.651867+0000","last_peered":"2024-04-26T23:40:40.651867+0000","last_clean":"2024-04-26T23:40:40.651867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:40:40.651867+0000","last_undegraded":"2024-04-26T23:40:40.651867+0000","last_fullsized":"2024-04-26T23:40:40.651867+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:40:33.640578+0000","last_change":"2024-04-26T23:40:32.574795+0000","last_active":"2024-04-26T23:40:33.640578+0000","last_peered":"2024-04-26T23:40:33.640578+0000","last_clean":"2024-04-26T23:40:33.640578+0000","last_became_active":"2024-04-26T23:40:32.574503+0000","last_became_peered":"2024-04-26T23:40:32.574503+0000","last_unstale":"2024-04-26T23:40:33.640578+0000","last_undegraded":"2024-04-26T23:40:33.640578+0000","last_fullsized":"2024-04-26T23:40:33.640578+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:30:11.401955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:40:40.651867+0000","last_change":"2024-04-26T23:40:40.651867+0000","last_active":"2024-04-26T23:40:40.651867+0000","last_peered":"2024-04-26T23:40:40.651867+0000","last_clean":"2024-04-26T23:40:40.651867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:40:40.651867+0000","last_undegraded":"2024-04-26T23:40:40.651867+0000","last_fullsized":"2024-04-26T23:40:40.651867+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:40:34.334513+0000","last_change":"2024-04-26T23:40:32.593432+0000","last_active":"2024-04-26T23:40:34.334513+0000","last_peered":"2024-04-26T23:40:34.334513+0000","last_clean":"2024-04-26T23:40:34.334513+0000","last_became_active":"2024-04-26T23:40:32.593169+0000","last_became_peered":"2024-04-26T23:40:32.593169+0000","last_unstale":"2024-04-26T23:40:34.334513+0000","last_undegraded":"2024-04-26T23:40:34.334513+0000","last_fullsized":"2024-04-26T23:40:34.334513+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:44:42.494850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:40:40.651867+0000","last_change":"2024-04-26T23:40:40.651867+0000","last_active":"2024-04-26T23:40:40.651867+0000","last_peered":"2024-04-26T23:40:40.651867+0000","last_clean":"2024-04-26T23:40:40.651867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:40:40.651867+0000","last_undegraded":"2024-04-26T23:40:40.651867+0000","last_fullsized":"2024-04-26T23:40:40.651867+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:40:34.334225+0000","last_change":"2024-04-26T23:40:32.585137+0000","last_active":"2024-04-26T23:40:34.334225+0000","last_peered":"2024-04-26T23:40:34.334225+0000","last_clean":"2024-04-26T23:40:34.334225+0000","last_became_active":"2024-04-26T23:40:32.584678+0000","last_became_peered":"2024-04-26T23:40:32.584678+0000","last_unstale":"2024-04-26T23:40:34.334225+0000","last_undegraded":"2024-04-26T23:40:34.334225+0000","last_fullsized":"2024-04-26T23:40:34.334225+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:04:30.553552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:40:40.651867+0000","last_change":"2024-04-26T23:40:40.651867+0000","last_active":"2024-04-26T23:40:40.651867+0000","last_peered":"2024-04-26T23:40:40.651867+0000","last_clean":"2024-04-26T23:40:40.651867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:40:40.651867+0000","last_undegraded":"2024-04-26T23:40:40.651867+0000","last_fullsized":"2024-04-26T23:40:40.651867+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:40:33.580102+0000","last_change":"2024-04-26T23:40:32.590452+0000","last_active":"2024-04-26T23:40:33.580102+0000","last_peered":"2024-04-26T23:40:33.580102+0000","last_clean":"2024-04-26T23:40:33.580102+0000","last_became_active":"2024-04-26T23:40:32.590162+0000","last_became_peered":"2024-04-26T23:40:32.590162+0000","last_unstale":"2024-04-26T23:40:33.580102+0000","last_undegraded":"2024-04-26T23:40:33.580102+0000","last_fullsized":"2024-04-26T23:40:33.580102+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:51:30.677247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:40:40.651867+0000","last_change":"2024-04-26T23:40:40.651867+0000","last_active":"2024-04-26T23:40:40.651867+0000","last_peered":"2024-04-26T23:40:40.651867+0000","last_clean":"2024-04-26T23:40:40.651867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:40:40.651867+0000","last_undegraded":"2024-04-26T23:40:40.651867+0000","last_fullsized":"2024-04-26T23:40:40.651867+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:40:34.333287+0000","last_change":"2024-04-26T23:40:32.586436+0000","last_active":"2024-04-26T23:40:34.333287+0000","last_peered":"2024-04-26T23:40:34.333287+0000","last_clean":"2024-04-26T23:40:34.333287+0000","last_became_active":"2024-04-26T23:40:32.585995+0000","last_became_peered":"2024-04-26T23:40:32.585995+0000","last_unstale":"2024-04-26T23:40:34.333287+0000","last_undegraded":"2024-04-26T23:40:34.333287+0000","last_fullsized":"2024-04-26T23:40:34.333287+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:10:42.603833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:40:40.651867+0000","last_change":"2024-04-26T23:40:40.651867+0000","last_active":"2024-04-26T23:40:40.651867+0000","last_peered":"2024-04-26T23:40:40.651867+0000","last_clean":"2024-04-26T23:40:40.651867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:40:40.651867+0000","last_undegraded":"2024-04-26T23:40:40.651867+0000","last_fullsized":"2024-04-26T23:40:40.651867+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:40:34.310207+0000","last_change":"2024-04-26T23:40:32.592988+0000","last_active":"2024-04-26T23:40:34.310207+0000","last_peered":"2024-04-26T23:40:34.310207+0000","last_clean":"2024-04-26T23:40:34.310207+0000","last_became_active":"2024-04-26T23:40:32.592717+0000","last_became_peered":"2024-04-26T23:40:32.592717+0000","last_unstale":"2024-04-26T23:40:34.310207+0000","last_undegraded":"2024-04-26T23:40:34.310207+0000","last_fullsized":"2024-04-26T23:40:34.310207+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:18:09.706875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:40:40.651867+0000","last_change":"2024-04-26T23:40:40.651867+0000","last_active":"2024-04-26T23:40:40.651867+0000","last_peered":"2024-04-26T23:40:40.651867+0000","last_clean":"2024-04-26T23:40:40.651867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:40:40.651867+0000","last_undegraded":"2024-04-26T23:40:40.651867+0000","last_fullsized":"2024-04-26T23:40:40.651867+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:40:33.579917+0000","last_change":"2024-04-26T23:40:32.595129+0000","last_active":"2024-04-26T23:40:33.579917+0000","last_peered":"2024-04-26T23:40:33.579917+0000","last_clean":"2024-04-26T23:40:33.579917+0000","last_became_active":"2024-04-26T23:40:32.594802+0000","last_became_peered":"2024-04-26T23:40:32.594802+0000","last_unstale":"2024-04-26T23:40:33.579917+0000","last_undegraded":"2024-04-26T23:40:33.579917+0000","last_fullsized":"2024-04-26T23:40:33.579917+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:48:33.020039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:40:40.651867+0000","last_change":"2024-04-26T23:40:40.651867+0000","last_active":"2024-04-26T23:40:40.651867+0000","last_peered":"2024-04-26T23:40:40.651867+0000","last_clean":"2024-04-26T23:40:40.651867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:40:40.651867+0000","last_undegraded":"2024-04-26T23:40:40.651867+0000","last_fullsized":"2024-04-26T23:40:40.651867+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:40:33.580856+0000","last_change":"2024-04-26T23:40:32.578819+0000","last_active":"2024-04-26T23:40:33.580856+0000","last_peered":"2024-04-26T23:40:33.580856+0000","last_clean":"2024-04-26T23:40:33.580856+0000","last_became_active":"2024-04-26T23:40:32.578556+0000","last_became_peered":"2024-04-26T23:40:32.578556+0000","last_unstale":"2024-04-26T23:40:33.580856+0000","last_undegraded":"2024-04-26T23:40:33.580856+0000","last_fullsized":"2024-04-26T23:40:33.580856+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:17:46.135806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:40:40.651867+0000","last_change":"2024-04-26T23:40:40.651867+0000","last_active":"2024-04-26T23:40:40.651867+0000","last_peered":"2024-04-26T23:40:40.651867+0000","last_clean":"2024-04-26T23:40:40.651867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:40:40.651867+0000","last_undegraded":"2024-04-26T23:40:40.651867+0000","last_fullsized":"2024-04-26T23:40:40.651867+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:40:33.581065+0000","last_change":"2024-04-26T23:40:32.578155+0000","last_active":"2024-04-26T23:40:33.581065+0000","last_peered":"2024-04-26T23:40:33.581065+0000","last_clean":"2024-04-26T23:40:33.581065+0000","last_became_active":"2024-04-26T23:40:32.577865+0000","last_became_peered":"2024-04-26T23:40:32.577865+0000","last_unstale":"2024-04-26T23:40:33.581065+0000","last_undegraded":"2024-04-26T23:40:33.581065+0000","last_fullsized":"2024-04-26T23:40:33.581065+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:40:17.167353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:40:40.651867+0000","last_change":"2024-04-26T23:40:40.651867+0000","last_active":"2024-04-26T23:40:40.651867+0000","last_peered":"2024-04-26T23:40:40.651867+0000","last_clean":"2024-04-26T23:40:40.651867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:40:40.651867+0000","last_undegraded":"2024-04-26T23:40:40.651867+0000","last_fullsized":"2024-04-26T23:40:40.651867+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:40:34.333606+0000","last_change":"2024-04-26T23:40:32.591487+0000","last_active":"2024-04-26T23:40:34.333606+0000","last_peered":"2024-04-26T23:40:34.333606+0000","last_clean":"2024-04-26T23:40:34.333606+0000","last_became_active":"2024-04-26T23:40:32.591209+0000","last_became_peered":"2024-04-26T23:40:32.591209+0000","last_unstale":"2024-04-26T23:40:34.333606+0000","last_undegraded":"2024-04-26T23:40:34.333606+0000","last_fullsized":"2024-04-26T23:40:34.333606+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:52:26.699790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:40:40.651867+0000","last_change":"2024-04-26T23:40:40.651867+0000","last_active":"2024-04-26T23:40:40.651867+0000","last_peered":"2024-04-26T23:40:40.651867+0000","last_clean":"2024-04-26T23:40:40.651867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:40:40.651867+0000","last_undegraded":"2024-04-26T23:40:40.651867+0000","last_fullsized":"2024-04-26T23:40:40.651867+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:40:34.309981+0000","last_change":"2024-04-26T23:40:32.592543+0000","last_active":"2024-04-26T23:40:34.309981+0000","last_peered":"2024-04-26T23:40:34.309981+0000","last_clean":"2024-04-26T23:40:34.309981+0000","last_became_active":"2024-04-26T23:40:32.592282+0000","last_became_peered":"2024-04-26T23:40:32.592282+0000","last_unstale":"2024-04-26T23:40:34.309981+0000","last_undegraded":"2024-04-26T23:40:34.309981+0000","last_fullsized":"2024-04-26T23:40:34.309981+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:16:46.547536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:40:40.651867+0000","last_change":"2024-04-26T23:40:40.651867+0000","last_active":"2024-04-26T23:40:40.651867+0000","last_peered":"2024-04-26T23:40:40.651867+0000","last_clean":"2024-04-26T23:40:40.651867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:40:40.651867+0000","last_undegraded":"2024-04-26T23:40:40.651867+0000","last_fullsized":"2024-04-26T23:40:40.651867+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:40:34.333122+0000","last_change":"2024-04-26T23:40:32.587562+0000","last_active":"2024-04-26T23:40:34.333122+0000","last_peered":"2024-04-26T23:40:34.333122+0000","last_clean":"2024-04-26T23:40:34.333122+0000","last_became_active":"2024-04-26T23:40:32.587249+0000","last_became_peered":"2024-04-26T23:40:32.587249+0000","last_unstale":"2024-04-26T23:40:34.333122+0000","last_undegraded":"2024-04-26T23:40:34.333122+0000","last_fullsized":"2024-04-26T23:40:34.333122+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:12:45.093169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:40:40.651867+0000","last_change":"2024-04-26T23:40:40.651867+0000","last_active":"2024-04-26T23:40:40.651867+0000","last_peered":"2024-04-26T23:40:40.651867+0000","last_clean":"2024-04-26T23:40:40.651867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:40:40.651867+0000","last_undegraded":"2024-04-26T23:40:40.651867+0000","last_fullsized":"2024-04-26T23:40:40.651867+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:40:34.333319+0000","last_change":"2024-04-26T23:40:32.584619+0000","last_active":"2024-04-26T23:40:34.333319+0000","last_peered":"2024-04-26T23:40:34.333319+0000","last_clean":"2024-04-26T23:40:34.333319+0000","last_became_active":"2024-04-26T23:40:32.584293+0000","last_became_peered":"2024-04-26T23:40:32.584293+0000","last_unstale":"2024-04-26T23:40:34.333319+0000","last_undegraded":"2024-04-26T23:40:34.333319+0000","last_fullsized":"2024-04-26T23:40:34.333319+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:40:17.167353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:40:40.651867+0000","last_change":"2024-04-26T23:40:40.651867+0000","last_active":"2024-04-26T23:40:40.651867+0000","last_peered":"2024-04-26T23:40:40.651867+0000","last_clean":"2024-04-26T23:40:40.651867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:40:40.651867+0000","last_undegraded":"2024-04-26T23:40:40.651867+0000","last_fullsized":"2024-04-26T23:40:40.651867+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:40:34.333570+0000","last_change":"2024-04-26T23:40:32.588894+0000","last_active":"2024-04-26T23:40:34.333570+0000","last_peered":"2024-04-26T23:40:34.333570+0000","last_clean":"2024-04-26T23:40:34.333570+0000","last_became_active":"2024-04-26T23:40:32.588409+0000","last_became_peered":"2024-04-26T23:40:32.588409+0000","last_unstale":"2024-04-26T23:40:34.333570+0000","last_undegraded":"2024-04-26T23:40:34.333570+0000","last_fullsized":"2024-04-26T23:40:34.333570+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:35:08.194865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:40:40.651867+0000","last_change":"2024-04-26T23:40:40.651867+0000","last_active":"2024-04-26T23:40:40.651867+0000","last_peered":"2024-04-26T23:40:40.651867+0000","last_clean":"2024-04-26T23:40:40.651867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:40:40.651867+0000","last_undegraded":"2024-04-26T23:40:40.651867+0000","last_fullsized":"2024-04-26T23:40:40.651867+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:40:34.333843+0000","last_change":"2024-04-26T23:40:32.581875+0000","last_active":"2024-04-26T23:40:34.333843+0000","last_peered":"2024-04-26T23:40:34.333843+0000","last_clean":"2024-04-26T23:40:34.333843+0000","last_became_active":"2024-04-26T23:40:32.580987+0000","last_became_peered":"2024-04-26T23:40:32.580987+0000","last_unstale":"2024-04-26T23:40:34.333843+0000","last_undegraded":"2024-04-26T23:40:34.333843+0000","last_fullsized":"2024-04-26T23:40:34.333843+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:12:45.093169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:40:40.651867+0000","last_change":"2024-04-26T23:40:40.651867+0000","last_active":"2024-04-26T23:40:40.651867+0000","last_peered":"2024-04-26T23:40:40.651867+0000","last_clean":"2024-04-26T23:40:40.651867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:40:40.651867+0000","last_undegraded":"2024-04-26T23:40:40.651867+0000","last_fullsized":"2024-04-26T23:40:40.651867+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:40:34.333450+0000","last_change":"2024-04-26T23:40:32.579870+0000","last_active":"2024-04-26T23:40:34.333450+0000","last_peered":"2024-04-26T23:40:34.333450+0000","last_clean":"2024-04-26T23:40:34.333450+0000","last_became_active":"2024-04-26T23:40:32.579569+0000","last_became_peered":"2024-04-26T23:40:32.579569+0000","last_unstale":"2024-04-26T23:40:34.333450+0000","last_undegraded":"2024-04-26T23:40:34.333450+0000","last_fullsized":"2024-04-26T23:40:34.333450+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:25:30.040358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:40:40.651867+0000","last_change":"2024-04-26T23:40:40.651867+0000","last_active":"2024-04-26T23:40:40.651867+0000","last_peered":"2024-04-26T23:40:40.651867+0000","last_clean":"2024-04-26T23:40:40.651867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:40:40.651867+0000","last_undegraded":"2024-04-26T23:40:40.651867+0000","last_fullsized":"2024-04-26T23:40:40.651867+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:40:33.580264+0000","last_change":"2024-04-26T23:40:32.583944+0000","last_active":"2024-04-26T23:40:33.580264+0000","last_peered":"2024-04-26T23:40:33.580264+0000","last_clean":"2024-04-26T23:40:33.580264+0000","last_became_active":"2024-04-26T23:40:32.583655+0000","last_became_peered":"2024-04-26T23:40:32.583655+0000","last_unstale":"2024-04-26T23:40:33.580264+0000","last_undegraded":"2024-04-26T23:40:33.580264+0000","last_fullsized":"2024-04-26T23:40:33.580264+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:40:17.167353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:40:40.651867+0000","last_change":"2024-04-26T23:40:40.651867+0000","last_active":"2024-04-26T23:40:40.651867+0000","last_peered":"2024-04-26T23:40:40.651867+0000","last_clean":"2024-04-26T23:40:40.651867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:40:40.651867+0000","last_undegraded":"2024-04-26T23:40:40.651867+0000","last_fullsized":"2024-04-26T23:40:40.651867+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T23:40:34.333436+0000","last_change":"2024-04-26T23:40:32.596351+0000","last_active":"2024-04-26T23:40:34.333436+0000","last_peered":"2024-04-26T23:40:34.333436+0000","last_clean":"2024-04-26T23:40:34.333436+0000","last_became_active":"2024-04-26T23:40:32.596050+0000","last_became_peered":"2024-04-26T23:40:32.596050+0000","last_unstale":"2024-04-26T23:40:34.333436+0000","last_undegraded":"2024-04-26T23:40:34.333436+0000","last_fullsized":"2024-04-26T23:40:34.333436+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:34:14.811917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27804,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344036,"statfs":{"total":96636764160,"available":96608292864,"internally_reserved":0,"allocated":802816,"data_stored":661804,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72466,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":208896,"data_stored":70944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574856,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":70980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72466,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":204800,"data_stored":70854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":212992,"data_stored":71014,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574856,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":811008,"data_stored":661860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T23:40:45.664 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T23:40:45.792 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.788+0000 7f0d3a864640 1 Processor -- start 2024-04-26T23:40:45.793 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.788+0000 7f0d3a864640 1 -- start start 2024-04-26T23:40:45.795 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.789+0000 7f0d3a864640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0d340c7000 0x7f0d340ca460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:45.795 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.789+0000 7f0d3a864640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f0d341543f0 0x7f0d34072930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:45.796 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.789+0000 7f0d3a864640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0d34156de0 con 0x7f0d340c9830 2024-04-26T23:40:45.796 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.789+0000 7f0d3a864640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f0d34157b60 con 0x7f0d341543f0 2024-04-26T23:40:45.796 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.789+0000 7f0d3a864640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f0d340cad40 con 0x7f0d340c7000 2024-04-26T23:40:45.796 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.789+0000 7f0d33fff640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0d340c7000 0x7f0d340ca460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:45.796 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.789+0000 7f0d337fe640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f0d340c9830 0x7f0d34153ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.88:36600/0 (socket says 172.21.15.88:36600) 2024-04-26T23:40:45.796 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.789+0000 7f0d337fe640 1 -- 172.21.15.88:0/1399750111 learned_addr learned my addr 172.21.15.88:0/1399750111 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-26T23:40:45.796 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.790+0000 7f0d38e01640 1 --2- 172.21.15.88:0/1399750111 >> v2:172.21.15.175:3300/0 conn(0x7f0d341543f0 0x7f0d34072930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:45.796 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.790+0000 7f0d32ffd640 1 -- 172.21.15.88:0/1399750111 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3706227584 0 0) 0x7f0d34156de0 con 0x7f0d340c9830 2024-04-26T23:40:45.796 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.790+0000 7f0d33fff640 1 -- 172.21.15.88:0/1399750111 >> v2:172.21.15.175:3300/0 conn(0x7f0d341543f0 msgr2=0x7f0d34072930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:40:45.796 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.790+0000 7f0d33fff640 1 --2- 172.21.15.88:0/1399750111 >> v2:172.21.15.175:3300/0 conn(0x7f0d341543f0 0x7f0d34072930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:45.796 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.790+0000 7f0d33fff640 1 -- 172.21.15.88:0/1399750111 >> v1:172.21.15.175:6789/0 conn(0x7f0d340c9830 legacy=0x7f0d34153ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:45.797 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.790+0000 7f0d33fff640 1 -- 172.21.15.88:0/1399750111 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d34157080 con 0x7f0d340c7000 2024-04-26T23:40:45.797 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.791+0000 7f0d33fff640 1 --2- 172.21.15.88:0/1399750111 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0d340c7000 0x7f0d340ca460 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f0d240097a0 tx=0x7f0d2402a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1ad5cb14a8b8d040 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:45.797 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.791+0000 7f0d32ffd640 1 -- 172.21.15.88:0/1399750111 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d24037070 con 0x7f0d340c7000 2024-04-26T23:40:45.797 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.791+0000 7f0d32ffd640 1 -- 172.21.15.88:0/1399750111 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d24032440 con 0x7f0d340c7000 2024-04-26T23:40:45.797 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.791+0000 7f0d32ffd640 1 -- 172.21.15.88:0/1399750111 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d24032810 con 0x7f0d340c7000 2024-04-26T23:40:45.797 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.791+0000 7f0d3a864640 1 -- 172.21.15.88:0/1399750111 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0d340c7000 msgr2=0x7f0d340ca460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:45.797 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.791+0000 7f0d3a864640 1 --2- 172.21.15.88:0/1399750111 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0d340c7000 0x7f0d340ca460 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f0d240097a0 tx=0x7f0d2402a180 comp rx=0 tx=0).stop 2024-04-26T23:40:45.797 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.791+0000 7f0d3a864640 1 -- 172.21.15.88:0/1399750111 shutdown_connections 2024-04-26T23:40:45.797 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.791+0000 7f0d3a864640 1 --2- 172.21.15.88:0/1399750111 >> v2:172.21.15.175:3300/0 conn(0x7f0d341543f0 0x7f0d34072930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:45.797 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.791+0000 7f0d3a864640 1 --2- 172.21.15.88:0/1399750111 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0d340c7000 0x7f0d340ca460 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:45.797 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.791+0000 7f0d3a864640 1 -- 172.21.15.88:0/1399750111 >> 172.21.15.88:0/1399750111 conn(0x7f0d340adf20 msgr2=0x7f0d340ae330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:40:45.797 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.791+0000 7f0d3a864640 1 -- 172.21.15.88:0/1399750111 shutdown_connections 2024-04-26T23:40:45.798 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.791+0000 7f0d3a864640 1 -- 172.21.15.88:0/1399750111 wait complete. 2024-04-26T23:40:45.801 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.792+0000 7f0d3a864640 1 Processor -- start 2024-04-26T23:40:45.801 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.793+0000 7f0d3a864640 1 -- start start 2024-04-26T23:40:45.801 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.793+0000 7f0d3a864640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0d340c7000 0x7f0d340c4870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:45.801 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.793+0000 7f0d3a864640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0d340c9830 0x7f0d3414eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:45.801 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.793+0000 7f0d3a864640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0d341543f0 0x7f0d341e95d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:45.801 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.793+0000 7f0d3a864640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f0d340ca9a0 con 0x7f0d341543f0 2024-04-26T23:40:45.801 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.793+0000 7f0d3a864640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f0d34157640 con 0x7f0d340c7000 2024-04-26T23:40:45.801 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.793+0000 7f0d3a864640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f0d340cab20 con 0x7f0d340c9830 2024-04-26T23:40:45.801 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.793+0000 7f0d38e01640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0d341543f0 0x7f0d341e95d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:45.801 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.793+0000 7f0d38e01640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0d341543f0 0x7f0d341e95d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:41938/0 (socket says 172.21.15.88:41938) 2024-04-26T23:40:45.801 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.793+0000 7f0d38e01640 1 -- 172.21.15.88:0/1844867136 learned_addr learned my addr 172.21.15.88:0/1844867136 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:40:45.801 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.793+0000 7f0d33fff640 1 --2- 172.21.15.88:0/1844867136 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0d340c7000 0x7f0d340c4870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:45.801 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.794+0000 7f0d337fe640 1 --2- 172.21.15.88:0/1844867136 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0d340c9830 0x7f0d3414eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:45.801 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.794+0000 7f0d38e01640 1 -- 172.21.15.88:0/1844867136 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0d340c9830 msgr2=0x7f0d3414eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:45.802 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.794+0000 7f0d38e01640 1 --2- 172.21.15.88:0/1844867136 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0d340c9830 0x7f0d3414eb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:45.802 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.794+0000 7f0d38e01640 1 -- 172.21.15.88:0/1844867136 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0d340c7000 msgr2=0x7f0d340c4870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:45.802 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.794+0000 7f0d38e01640 1 --2- 172.21.15.88:0/1844867136 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0d340c7000 0x7f0d340c4870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:45.802 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.794+0000 7f0d38e01640 1 -- 172.21.15.88:0/1844867136 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d340c5d40 con 0x7f0d341543f0 2024-04-26T23:40:45.802 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.794+0000 7f0d38e01640 1 --2- 172.21.15.88:0/1844867136 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0d341543f0 0x7f0d341e95d0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f0d2c00efc0 tx=0x7f0d2c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:45.802 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.794+0000 7f0d30ff9640 1 -- 172.21.15.88:0/1844867136 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d2c018020 con 0x7f0d341543f0 2024-04-26T23:40:45.802 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.794+0000 7f0d30ff9640 1 -- 172.21.15.88:0/1844867136 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d2c014480 con 0x7f0d341543f0 2024-04-26T23:40:45.802 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.794+0000 7f0d3a864640 1 -- 172.21.15.88:0/1844867136 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d340c5ff0 con 0x7f0d341543f0 2024-04-26T23:40:45.802 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.794+0000 7f0d30ff9640 1 -- 172.21.15.88:0/1844867136 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d2c009e60 con 0x7f0d341543f0 2024-04-26T23:40:45.802 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.794+0000 7f0d3a864640 1 -- 172.21.15.88:0/1844867136 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d340c4070 con 0x7f0d341543f0 2024-04-26T23:40:45.802 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.795+0000 7f0d3a864640 1 -- 172.21.15.88:0/1844867136 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d340c6510 con 0x7f0d341543f0 2024-04-26T23:40:45.802 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.795+0000 7f0d30ff9640 1 -- 172.21.15.88:0/1844867136 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f0d2c005d10 con 0x7f0d341543f0 2024-04-26T23:40:45.802 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.796+0000 7f0d30ff9640 1 --2- 172.21.15.88:0/1844867136 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f0d2006c8f0 0x7f0d2006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:45.802 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.796+0000 7f0d30ff9640 1 -- 172.21.15.88:0/1844867136 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7f0d2c08c9e0 con 0x7f0d341543f0 2024-04-26T23:40:45.803 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.796+0000 7f0d33fff640 1 --2- 172.21.15.88:0/1844867136 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f0d2006c8f0 0x7f0d2006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:45.803 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.796+0000 7f0d33fff640 1 --2- 172.21.15.88:0/1844867136 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f0d2006c8f0 0x7f0d2006edb0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f0d24034000 tx=0x7f0d2402e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:45.804 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.800+0000 7f0d30ff9640 1 -- 172.21.15.88:0/1844867136 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f0d2c022030 con 0x7f0d341543f0 2024-04-26T23:40:45.977 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.973+0000 7f0d3a864640 1 -- 172.21.15.88:0/1844867136 --> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f0d340766c0 con 0x7f0d2006c8f0 2024-04-26T23:40:45.988 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.984+0000 7f0d30ff9640 1 -- 172.21.15.88:0/1844867136 <== mgr.4104 v2:172.21.15.88:6832/651674297 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+490416 (secure 0 0 0) 0x7f0d340766c0 con 0x7f0d2006c8f0 2024-04-26T23:40:45.994 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-26T23:40:45.997 INFO:teuthology.orchestra.run.smithi088.stderr:dumped all 2024-04-26T23:40:45.999 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.988+0000 7f0d3a864640 1 -- 172.21.15.88:0/1844867136 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f0d2006c8f0 msgr2=0x7f0d2006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:45.999 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.988+0000 7f0d3a864640 1 --2- 172.21.15.88:0/1844867136 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f0d2006c8f0 0x7f0d2006edb0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f0d24034000 tx=0x7f0d2402e000 comp rx=0 tx=0).stop 2024-04-26T23:40:45.999 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.988+0000 7f0d3a864640 1 -- 172.21.15.88:0/1844867136 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0d341543f0 msgr2=0x7f0d341e95d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:45.999 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.988+0000 7f0d3a864640 1 --2- 172.21.15.88:0/1844867136 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0d341543f0 0x7f0d341e95d0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f0d2c00efc0 tx=0x7f0d2c00c490 comp rx=0 tx=0).stop 2024-04-26T23:40:45.999 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.988+0000 7f0d3a864640 1 -- 172.21.15.88:0/1844867136 shutdown_connections 2024-04-26T23:40:46.000 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.988+0000 7f0d3a864640 1 --2- 172.21.15.88:0/1844867136 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f0d2006c8f0 0x7f0d2006edb0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:46.000 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.988+0000 7f0d3a864640 1 --2- 172.21.15.88:0/1844867136 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0d340c9830 0x7f0d3414eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:46.000 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.988+0000 7f0d3a864640 1 --2- 172.21.15.88:0/1844867136 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0d341543f0 0x7f0d341e95d0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:46.000 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.988+0000 7f0d3a864640 1 --2- 172.21.15.88:0/1844867136 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0d340c7000 0x7f0d340c4870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:46.000 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.988+0000 7f0d3a864640 1 -- 172.21.15.88:0/1844867136 >> 172.21.15.88:0/1844867136 conn(0x7f0d340adf20 msgr2=0x7f0d34153ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:40:46.000 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.988+0000 7f0d3a864640 1 -- 172.21.15.88:0/1844867136 shutdown_connections 2024-04-26T23:40:46.000 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:45.988+0000 7f0d3a864640 1 -- 172.21.15.88:0/1844867136 wait complete. 2024-04-26T23:40:46.003 INFO:teuthology.orchestra.run.smithi088.stdout:{"pg_ready":true,"pg_map":{"version":31,"stamp":"2024-04-26T23:40:45.924540+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595188,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":249,"num_write_kb":2444,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":195,"ondisk_log_size":195,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":315,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219404,"kb_used_data":3224,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755316,"statfs":{"total":773094113280,"available":772869443584,"internally_reserved":0,"allocated":3301376,"data_stored":1956036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.000959"},"pg_stats":[{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636272+0000","last_change":"2024-04-26T23:40:41.683801+0000","last_active":"2024-04-26T23:40:43.636272+0000","last_peered":"2024-04-26T23:40:43.636272+0000","last_clean":"2024-04-26T23:40:43.636272+0000","last_became_active":"2024-04-26T23:40:41.683484+0000","last_became_peered":"2024-04-26T23:40:41.683484+0000","last_unstale":"2024-04-26T23:40:43.636272+0000","last_undegraded":"2024-04-26T23:40:43.636272+0000","last_fullsized":"2024-04-26T23:40:43.636272+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:02:27.160408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":26,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.686904+0000","last_change":"2024-04-26T23:40:31.576688+0000","last_active":"2024-04-26T23:40:42.686904+0000","last_peered":"2024-04-26T23:40:42.686904+0000","last_clean":"2024-04-26T23:40:42.686904+0000","last_became_active":"2024-04-26T23:40:31.576429+0000","last_became_peered":"2024-04-26T23:40:31.576429+0000","last_unstale":"2024-04-26T23:40:42.686904+0000","last_undegraded":"2024-04-26T23:40:42.686904+0000","last_fullsized":"2024-04-26T23:40:42.686904+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:47:42.681376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.637858+0000","last_change":"2024-04-26T23:40:32.578489+0000","last_active":"2024-04-26T23:40:43.637858+0000","last_peered":"2024-04-26T23:40:43.637858+0000","last_clean":"2024-04-26T23:40:43.637858+0000","last_became_active":"2024-04-26T23:40:32.578205+0000","last_became_peered":"2024-04-26T23:40:32.578205+0000","last_unstale":"2024-04-26T23:40:43.637858+0000","last_undegraded":"2024-04-26T23:40:43.637858+0000","last_fullsized":"2024-04-26T23:40:43.637858+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:56:04.309611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636964+0000","last_change":"2024-04-26T23:40:40.666861+0000","last_active":"2024-04-26T23:40:43.636964+0000","last_peered":"2024-04-26T23:40:43.636964+0000","last_clean":"2024-04-26T23:40:43.636964+0000","last_became_active":"2024-04-26T23:40:40.666547+0000","last_became_peered":"2024-04-26T23:40:40.666547+0000","last_unstale":"2024-04-26T23:40:43.636964+0000","last_undegraded":"2024-04-26T23:40:43.636964+0000","last_fullsized":"2024-04-26T23:40:43.636964+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:27:47.818055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.635388+0000","last_change":"2024-04-26T23:40:41.689530+0000","last_active":"2024-04-26T23:40:43.635388+0000","last_peered":"2024-04-26T23:40:43.635388+0000","last_clean":"2024-04-26T23:40:43.635388+0000","last_became_active":"2024-04-26T23:40:41.687652+0000","last_became_peered":"2024-04-26T23:40:41.687652+0000","last_unstale":"2024-04-26T23:40:43.635388+0000","last_undegraded":"2024-04-26T23:40:43.635388+0000","last_fullsized":"2024-04-26T23:40:43.635388+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:58:45.972045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.637959+0000","last_change":"2024-04-26T23:40:31.576867+0000","last_active":"2024-04-26T23:40:43.637959+0000","last_peered":"2024-04-26T23:40:43.637959+0000","last_clean":"2024-04-26T23:40:43.637959+0000","last_became_active":"2024-04-26T23:40:31.576342+0000","last_became_peered":"2024-04-26T23:40:31.576342+0000","last_unstale":"2024-04-26T23:40:43.637959+0000","last_undegraded":"2024-04-26T23:40:43.637959+0000","last_fullsized":"2024-04-26T23:40:43.637959+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:35:54.439397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.686802+0000","last_change":"2024-04-26T23:40:32.589769+0000","last_active":"2024-04-26T23:40:42.686802+0000","last_peered":"2024-04-26T23:40:42.686802+0000","last_clean":"2024-04-26T23:40:42.686802+0000","last_became_active":"2024-04-26T23:40:32.589489+0000","last_became_peered":"2024-04-26T23:40:32.589489+0000","last_unstale":"2024-04-26T23:40:42.686802+0000","last_undegraded":"2024-04-26T23:40:42.686802+0000","last_fullsized":"2024-04-26T23:40:42.686802+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:40:17.167353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636746+0000","last_change":"2024-04-26T23:40:40.672310+0000","last_active":"2024-04-26T23:40:43.636746+0000","last_peered":"2024-04-26T23:40:43.636746+0000","last_clean":"2024-04-26T23:40:43.636746+0000","last_became_active":"2024-04-26T23:40:40.672018+0000","last_became_peered":"2024-04-26T23:40:40.672018+0000","last_unstale":"2024-04-26T23:40:43.636746+0000","last_undegraded":"2024-04-26T23:40:43.636746+0000","last_fullsized":"2024-04-26T23:40:43.636746+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:01:10.835670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636004+0000","last_change":"2024-04-26T23:40:41.686743+0000","last_active":"2024-04-26T23:40:43.636004+0000","last_peered":"2024-04-26T23:40:43.636004+0000","last_clean":"2024-04-26T23:40:43.636004+0000","last_became_active":"2024-04-26T23:40:41.686419+0000","last_became_peered":"2024-04-26T23:40:41.686419+0000","last_unstale":"2024-04-26T23:40:43.636004+0000","last_undegraded":"2024-04-26T23:40:43.636004+0000","last_fullsized":"2024-04-26T23:40:43.636004+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:08:35.027584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.637221+0000","last_change":"2024-04-26T23:40:31.578735+0000","last_active":"2024-04-26T23:40:43.637221+0000","last_peered":"2024-04-26T23:40:43.637221+0000","last_clean":"2024-04-26T23:40:43.637221+0000","last_became_active":"2024-04-26T23:40:31.578438+0000","last_became_peered":"2024-04-26T23:40:31.578438+0000","last_unstale":"2024-04-26T23:40:43.637221+0000","last_undegraded":"2024-04-26T23:40:43.637221+0000","last_fullsized":"2024-04-26T23:40:43.637221+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:30:10.397569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.685239+0000","last_change":"2024-04-26T23:40:32.590624+0000","last_active":"2024-04-26T23:40:42.685239+0000","last_peered":"2024-04-26T23:40:42.685239+0000","last_clean":"2024-04-26T23:40:42.685239+0000","last_became_active":"2024-04-26T23:40:32.589687+0000","last_became_peered":"2024-04-26T23:40:32.589687+0000","last_unstale":"2024-04-26T23:40:42.685239+0000","last_undegraded":"2024-04-26T23:40:42.685239+0000","last_fullsized":"2024-04-26T23:40:42.685239+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:01:02.741964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"23'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.637058+0000","last_change":"2024-04-26T23:40:40.677899+0000","last_active":"2024-04-26T23:40:43.637058+0000","last_peered":"2024-04-26T23:40:43.637058+0000","last_clean":"2024-04-26T23:40:43.637058+0000","last_became_active":"2024-04-26T23:40:40.677388+0000","last_became_peered":"2024-04-26T23:40:40.677388+0000","last_unstale":"2024-04-26T23:40:43.637058+0000","last_undegraded":"2024-04-26T23:40:43.637058+0000","last_fullsized":"2024-04-26T23:40:43.637058+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:52:34.793496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.684740+0000","last_change":"2024-04-26T23:40:41.680097+0000","last_active":"2024-04-26T23:40:42.684740+0000","last_peered":"2024-04-26T23:40:42.684740+0000","last_clean":"2024-04-26T23:40:42.684740+0000","last_became_active":"2024-04-26T23:40:41.679815+0000","last_became_peered":"2024-04-26T23:40:41.679815+0000","last_unstale":"2024-04-26T23:40:42.684740+0000","last_undegraded":"2024-04-26T23:40:42.684740+0000","last_fullsized":"2024-04-26T23:40:42.684740+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:10:30.972726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636837+0000","last_change":"2024-04-26T23:40:31.573648+0000","last_active":"2024-04-26T23:40:43.636837+0000","last_peered":"2024-04-26T23:40:43.636837+0000","last_clean":"2024-04-26T23:40:43.636837+0000","last_became_active":"2024-04-26T23:40:31.573347+0000","last_became_peered":"2024-04-26T23:40:31.573347+0000","last_unstale":"2024-04-26T23:40:43.636837+0000","last_undegraded":"2024-04-26T23:40:43.636837+0000","last_fullsized":"2024-04-26T23:40:43.636837+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:20:28.103413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.685588+0000","last_change":"2024-04-26T23:40:32.588309+0000","last_active":"2024-04-26T23:40:42.685588+0000","last_peered":"2024-04-26T23:40:42.685588+0000","last_clean":"2024-04-26T23:40:42.685588+0000","last_became_active":"2024-04-26T23:40:32.588007+0000","last_became_peered":"2024-04-26T23:40:32.588007+0000","last_unstale":"2024-04-26T23:40:42.685588+0000","last_undegraded":"2024-04-26T23:40:42.685588+0000","last_fullsized":"2024-04-26T23:40:42.685588+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:52:26.699790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"23'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636105+0000","last_change":"2024-04-26T23:40:40.678547+0000","last_active":"2024-04-26T23:40:43.636105+0000","last_peered":"2024-04-26T23:40:43.636105+0000","last_clean":"2024-04-26T23:40:43.636105+0000","last_became_active":"2024-04-26T23:40:40.677668+0000","last_became_peered":"2024-04-26T23:40:40.677668+0000","last_unstale":"2024-04-26T23:40:43.636105+0000","last_undegraded":"2024-04-26T23:40:43.636105+0000","last_fullsized":"2024-04-26T23:40:43.636105+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:34:22.905623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636105+0000","last_change":"2024-04-26T23:40:41.689525+0000","last_active":"2024-04-26T23:40:43.636105+0000","last_peered":"2024-04-26T23:40:43.636105+0000","last_clean":"2024-04-26T23:40:43.636105+0000","last_became_active":"2024-04-26T23:40:41.687433+0000","last_became_peered":"2024-04-26T23:40:41.687433+0000","last_unstale":"2024-04-26T23:40:43.636105+0000","last_undegraded":"2024-04-26T23:40:43.636105+0000","last_fullsized":"2024-04-26T23:40:43.636105+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:38:42.155257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.684004+0000","last_change":"2024-04-26T23:40:32.590053+0000","last_active":"2024-04-26T23:40:42.684004+0000","last_peered":"2024-04-26T23:40:42.684004+0000","last_clean":"2024-04-26T23:40:42.684004+0000","last_became_active":"2024-04-26T23:40:32.589802+0000","last_became_peered":"2024-04-26T23:40:32.589802+0000","last_unstale":"2024-04-26T23:40:42.684004+0000","last_undegraded":"2024-04-26T23:40:42.684004+0000","last_fullsized":"2024-04-26T23:40:42.684004+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:16:46.547536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636775+0000","last_change":"2024-04-26T23:40:31.578524+0000","last_active":"2024-04-26T23:40:43.636775+0000","last_peered":"2024-04-26T23:40:43.636775+0000","last_clean":"2024-04-26T23:40:43.636775+0000","last_became_active":"2024-04-26T23:40:31.578230+0000","last_became_peered":"2024-04-26T23:40:31.578230+0000","last_unstale":"2024-04-26T23:40:43.636775+0000","last_undegraded":"2024-04-26T23:40:43.636775+0000","last_fullsized":"2024-04-26T23:40:43.636775+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:15:51.937774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"23'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636197+0000","last_change":"2024-04-26T23:40:40.676459+0000","last_active":"2024-04-26T23:40:43.636197+0000","last_peered":"2024-04-26T23:40:43.636197+0000","last_clean":"2024-04-26T23:40:43.636197+0000","last_became_active":"2024-04-26T23:40:40.675997+0000","last_became_peered":"2024-04-26T23:40:40.675997+0000","last_unstale":"2024-04-26T23:40:43.636197+0000","last_undegraded":"2024-04-26T23:40:43.636197+0000","last_fullsized":"2024-04-26T23:40:43.636197+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:37:38.455501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.635973+0000","last_change":"2024-04-26T23:40:41.679334+0000","last_active":"2024-04-26T23:40:43.635973+0000","last_peered":"2024-04-26T23:40:43.635973+0000","last_clean":"2024-04-26T23:40:43.635973+0000","last_became_active":"2024-04-26T23:40:41.679098+0000","last_became_peered":"2024-04-26T23:40:41.679098+0000","last_unstale":"2024-04-26T23:40:43.635973+0000","last_undegraded":"2024-04-26T23:40:43.635973+0000","last_fullsized":"2024-04-26T23:40:43.635973+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:52:35.798951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.637449+0000","last_change":"2024-04-26T23:40:32.585827+0000","last_active":"2024-04-26T23:40:43.637449+0000","last_peered":"2024-04-26T23:40:43.637449+0000","last_clean":"2024-04-26T23:40:43.637449+0000","last_became_active":"2024-04-26T23:40:32.585522+0000","last_became_peered":"2024-04-26T23:40:32.585522+0000","last_unstale":"2024-04-26T23:40:43.637449+0000","last_undegraded":"2024-04-26T23:40:43.637449+0000","last_fullsized":"2024-04-26T23:40:43.637449+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:40:17.167353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.635887+0000","last_change":"2024-04-26T23:40:31.575121+0000","last_active":"2024-04-26T23:40:43.635887+0000","last_peered":"2024-04-26T23:40:43.635887+0000","last_clean":"2024-04-26T23:40:43.635887+0000","last_became_active":"2024-04-26T23:40:31.574827+0000","last_became_peered":"2024-04-26T23:40:31.574827+0000","last_unstale":"2024-04-26T23:40:43.635887+0000","last_undegraded":"2024-04-26T23:40:43.635887+0000","last_fullsized":"2024-04-26T23:40:43.635887+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:43:13.740214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636996+0000","last_change":"2024-04-26T23:40:40.678613+0000","last_active":"2024-04-26T23:40:43.636996+0000","last_peered":"2024-04-26T23:40:43.636996+0000","last_clean":"2024-04-26T23:40:43.636996+0000","last_became_active":"2024-04-26T23:40:40.677867+0000","last_became_peered":"2024-04-26T23:40:40.677867+0000","last_unstale":"2024-04-26T23:40:43.636996+0000","last_undegraded":"2024-04-26T23:40:43.636996+0000","last_fullsized":"2024-04-26T23:40:43.636996+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:35:16.288571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636503+0000","last_change":"2024-04-26T23:40:41.685042+0000","last_active":"2024-04-26T23:40:43.636503+0000","last_peered":"2024-04-26T23:40:43.636503+0000","last_clean":"2024-04-26T23:40:43.636503+0000","last_became_active":"2024-04-26T23:40:41.684699+0000","last_became_peered":"2024-04-26T23:40:41.684699+0000","last_unstale":"2024-04-26T23:40:43.636503+0000","last_undegraded":"2024-04-26T23:40:43.636503+0000","last_fullsized":"2024-04-26T23:40:43.636503+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:10:57.826183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636873+0000","last_change":"2024-04-26T23:40:32.582721+0000","last_active":"2024-04-26T23:40:43.636873+0000","last_peered":"2024-04-26T23:40:43.636873+0000","last_clean":"2024-04-26T23:40:43.636873+0000","last_became_active":"2024-04-26T23:40:32.582438+0000","last_became_peered":"2024-04-26T23:40:32.582438+0000","last_unstale":"2024-04-26T23:40:43.636873+0000","last_undegraded":"2024-04-26T23:40:43.636873+0000","last_fullsized":"2024-04-26T23:40:43.636873+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:38:10.884592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.635560+0000","last_change":"2024-04-26T23:40:31.575508+0000","last_active":"2024-04-26T23:40:43.635560+0000","last_peered":"2024-04-26T23:40:43.635560+0000","last_clean":"2024-04-26T23:40:43.635560+0000","last_became_active":"2024-04-26T23:40:31.575242+0000","last_became_peered":"2024-04-26T23:40:31.575242+0000","last_unstale":"2024-04-26T23:40:43.635560+0000","last_undegraded":"2024-04-26T23:40:43.635560+0000","last_fullsized":"2024-04-26T23:40:43.635560+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:48:32.015654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"23'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636104+0000","last_change":"2024-04-26T23:40:40.679196+0000","last_active":"2024-04-26T23:40:43.636104+0000","last_peered":"2024-04-26T23:40:43.636104+0000","last_clean":"2024-04-26T23:40:43.636104+0000","last_became_active":"2024-04-26T23:40:40.678740+0000","last_became_peered":"2024-04-26T23:40:40.678740+0000","last_unstale":"2024-04-26T23:40:43.636104+0000","last_undegraded":"2024-04-26T23:40:43.636104+0000","last_fullsized":"2024-04-26T23:40:43.636104+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:40:14.479631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.685673+0000","last_change":"2024-04-26T23:40:41.686638+0000","last_active":"2024-04-26T23:40:42.685673+0000","last_peered":"2024-04-26T23:40:42.685673+0000","last_clean":"2024-04-26T23:40:42.685673+0000","last_became_active":"2024-04-26T23:40:41.686354+0000","last_became_peered":"2024-04-26T23:40:41.686354+0000","last_unstale":"2024-04-26T23:40:42.685673+0000","last_undegraded":"2024-04-26T23:40:42.685673+0000","last_fullsized":"2024-04-26T23:40:42.685673+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:06:12.755431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.637002+0000","last_change":"2024-04-26T23:40:32.583019+0000","last_active":"2024-04-26T23:40:43.637002+0000","last_peered":"2024-04-26T23:40:43.637002+0000","last_clean":"2024-04-26T23:40:43.637002+0000","last_became_active":"2024-04-26T23:40:32.582719+0000","last_became_peered":"2024-04-26T23:40:32.582719+0000","last_unstale":"2024-04-26T23:40:43.637002+0000","last_undegraded":"2024-04-26T23:40:43.637002+0000","last_fullsized":"2024-04-26T23:40:43.637002+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:25:02.319783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.635607+0000","last_change":"2024-04-26T23:40:31.576866+0000","last_active":"2024-04-26T23:40:43.635607+0000","last_peered":"2024-04-26T23:40:43.635607+0000","last_clean":"2024-04-26T23:40:43.635607+0000","last_became_active":"2024-04-26T23:40:31.576419+0000","last_became_peered":"2024-04-26T23:40:31.576419+0000","last_unstale":"2024-04-26T23:40:43.635607+0000","last_undegraded":"2024-04-26T23:40:43.635607+0000","last_fullsized":"2024-04-26T23:40:43.635607+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:45:49.295198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"23'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636623+0000","last_change":"2024-04-26T23:40:40.675262+0000","last_active":"2024-04-26T23:40:43.636623+0000","last_peered":"2024-04-26T23:40:43.636623+0000","last_clean":"2024-04-26T23:40:43.636623+0000","last_became_active":"2024-04-26T23:40:40.674721+0000","last_became_peered":"2024-04-26T23:40:40.674721+0000","last_unstale":"2024-04-26T23:40:43.636623+0000","last_undegraded":"2024-04-26T23:40:43.636623+0000","last_fullsized":"2024-04-26T23:40:43.636623+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:56:12.403317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.635271+0000","last_change":"2024-04-26T23:40:41.691494+0000","last_active":"2024-04-26T23:40:43.635271+0000","last_peered":"2024-04-26T23:40:43.635271+0000","last_clean":"2024-04-26T23:40:43.635271+0000","last_became_active":"2024-04-26T23:40:41.691241+0000","last_became_peered":"2024-04-26T23:40:41.691241+0000","last_unstale":"2024-04-26T23:40:43.635271+0000","last_undegraded":"2024-04-26T23:40:43.635271+0000","last_fullsized":"2024-04-26T23:40:43.635271+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:08:35.027584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.687075+0000","last_change":"2024-04-26T23:40:32.584988+0000","last_active":"2024-04-26T23:40:42.687075+0000","last_peered":"2024-04-26T23:40:42.687075+0000","last_clean":"2024-04-26T23:40:42.687075+0000","last_became_active":"2024-04-26T23:40:32.584467+0000","last_became_peered":"2024-04-26T23:40:32.584467+0000","last_unstale":"2024-04-26T23:40:42.687075+0000","last_undegraded":"2024-04-26T23:40:42.687075+0000","last_fullsized":"2024-04-26T23:40:42.687075+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:51:30.677247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.684365+0000","last_change":"2024-04-26T23:40:31.573721+0000","last_active":"2024-04-26T23:40:42.684365+0000","last_peered":"2024-04-26T23:40:42.684365+0000","last_clean":"2024-04-26T23:40:42.684365+0000","last_became_active":"2024-04-26T23:40:31.573434+0000","last_became_peered":"2024-04-26T23:40:31.573434+0000","last_unstale":"2024-04-26T23:40:42.684365+0000","last_undegraded":"2024-04-26T23:40:42.684365+0000","last_fullsized":"2024-04-26T23:40:42.684365+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:20:28.103413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636650+0000","last_change":"2024-04-26T23:40:40.678020+0000","last_active":"2024-04-26T23:40:43.636650+0000","last_peered":"2024-04-26T23:40:43.636650+0000","last_clean":"2024-04-26T23:40:43.636650+0000","last_became_active":"2024-04-26T23:40:40.677410+0000","last_became_peered":"2024-04-26T23:40:40.677410+0000","last_unstale":"2024-04-26T23:40:43.636650+0000","last_undegraded":"2024-04-26T23:40:43.636650+0000","last_fullsized":"2024-04-26T23:40:43.636650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:44:50.588556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.635487+0000","last_change":"2024-04-26T23:40:41.689839+0000","last_active":"2024-04-26T23:40:43.635487+0000","last_peered":"2024-04-26T23:40:43.635487+0000","last_clean":"2024-04-26T23:40:43.635487+0000","last_became_active":"2024-04-26T23:40:41.689508+0000","last_became_peered":"2024-04-26T23:40:41.689508+0000","last_unstale":"2024-04-26T23:40:43.635487+0000","last_undegraded":"2024-04-26T23:40:43.635487+0000","last_fullsized":"2024-04-26T23:40:43.635487+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:17:28.672777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.637978+0000","last_change":"2024-04-26T23:40:32.594913+0000","last_active":"2024-04-26T23:40:43.637978+0000","last_peered":"2024-04-26T23:40:43.637978+0000","last_clean":"2024-04-26T23:40:43.637978+0000","last_became_active":"2024-04-26T23:40:32.594616+0000","last_became_peered":"2024-04-26T23:40:32.594616+0000","last_unstale":"2024-04-26T23:40:43.637978+0000","last_undegraded":"2024-04-26T23:40:43.637978+0000","last_fullsized":"2024-04-26T23:40:43.637978+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:04:30.553552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636386+0000","last_change":"2024-04-26T23:40:31.576299+0000","last_active":"2024-04-26T23:40:43.636386+0000","last_peered":"2024-04-26T23:40:43.636386+0000","last_clean":"2024-04-26T23:40:43.636386+0000","last_became_active":"2024-04-26T23:40:31.576006+0000","last_became_peered":"2024-04-26T23:40:31.576006+0000","last_unstale":"2024-04-26T23:40:43.636386+0000","last_undegraded":"2024-04-26T23:40:43.636386+0000","last_fullsized":"2024-04-26T23:40:43.636386+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:15:51.937774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.635376+0000","last_change":"2024-04-26T23:40:40.674806+0000","last_active":"2024-04-26T23:40:43.635376+0000","last_peered":"2024-04-26T23:40:43.635376+0000","last_clean":"2024-04-26T23:40:43.635376+0000","last_became_active":"2024-04-26T23:40:40.674557+0000","last_became_peered":"2024-04-26T23:40:40.674557+0000","last_unstale":"2024-04-26T23:40:43.635376+0000","last_undegraded":"2024-04-26T23:40:43.635376+0000","last_fullsized":"2024-04-26T23:40:43.635376+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:45:33.226487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.683778+0000","last_change":"2024-04-26T23:40:41.688941+0000","last_active":"2024-04-26T23:40:42.683778+0000","last_peered":"2024-04-26T23:40:42.683778+0000","last_clean":"2024-04-26T23:40:42.683778+0000","last_became_active":"2024-04-26T23:40:41.688653+0000","last_became_peered":"2024-04-26T23:40:41.688653+0000","last_unstale":"2024-04-26T23:40:42.683778+0000","last_undegraded":"2024-04-26T23:40:42.683778+0000","last_fullsized":"2024-04-26T23:40:42.683778+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:53:13.531466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636366+0000","last_change":"2024-04-26T23:40:32.582442+0000","last_active":"2024-04-26T23:40:43.636366+0000","last_peered":"2024-04-26T23:40:43.636366+0000","last_clean":"2024-04-26T23:40:43.636366+0000","last_became_active":"2024-04-26T23:40:32.582140+0000","last_became_peered":"2024-04-26T23:40:32.582140+0000","last_unstale":"2024-04-26T23:40:43.636366+0000","last_undegraded":"2024-04-26T23:40:43.636366+0000","last_fullsized":"2024-04-26T23:40:43.636366+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:18:09.706875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.637335+0000","last_change":"2024-04-26T23:40:31.576565+0000","last_active":"2024-04-26T23:40:43.637335+0000","last_peered":"2024-04-26T23:40:43.637335+0000","last_clean":"2024-04-26T23:40:43.637335+0000","last_became_active":"2024-04-26T23:40:31.576313+0000","last_became_peered":"2024-04-26T23:40:31.576313+0000","last_unstale":"2024-04-26T23:40:43.637335+0000","last_undegraded":"2024-04-26T23:40:43.637335+0000","last_fullsized":"2024-04-26T23:40:43.637335+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:25:01.315397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.686609+0000","last_change":"2024-04-26T23:40:40.671047+0000","last_active":"2024-04-26T23:40:42.686609+0000","last_peered":"2024-04-26T23:40:42.686609+0000","last_clean":"2024-04-26T23:40:42.686609+0000","last_became_active":"2024-04-26T23:40:40.670630+0000","last_became_peered":"2024-04-26T23:40:40.670630+0000","last_unstale":"2024-04-26T23:40:42.686609+0000","last_undegraded":"2024-04-26T23:40:42.686609+0000","last_fullsized":"2024-04-26T23:40:42.686609+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:45:07.071050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.686921+0000","last_change":"2024-04-26T23:40:41.686221+0000","last_active":"2024-04-26T23:40:42.686921+0000","last_peered":"2024-04-26T23:40:42.686921+0000","last_clean":"2024-04-26T23:40:42.686921+0000","last_became_active":"2024-04-26T23:40:41.685961+0000","last_became_peered":"2024-04-26T23:40:41.685961+0000","last_unstale":"2024-04-26T23:40:42.686921+0000","last_undegraded":"2024-04-26T23:40:42.686921+0000","last_fullsized":"2024-04-26T23:40:42.686921+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:28:34.920939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.685609+0000","last_change":"2024-04-26T23:40:32.584363+0000","last_active":"2024-04-26T23:40:42.685609+0000","last_peered":"2024-04-26T23:40:42.685609+0000","last_clean":"2024-04-26T23:40:42.685609+0000","last_became_active":"2024-04-26T23:40:32.584082+0000","last_became_peered":"2024-04-26T23:40:32.584082+0000","last_unstale":"2024-04-26T23:40:42.685609+0000","last_undegraded":"2024-04-26T23:40:42.685609+0000","last_fullsized":"2024-04-26T23:40:42.685609+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:35:08.194865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636458+0000","last_change":"2024-04-26T23:40:31.576711+0000","last_active":"2024-04-26T23:40:43.636458+0000","last_peered":"2024-04-26T23:40:43.636458+0000","last_clean":"2024-04-26T23:40:43.636458+0000","last_became_active":"2024-04-26T23:40:31.576404+0000","last_became_peered":"2024-04-26T23:40:31.576404+0000","last_unstale":"2024-04-26T23:40:43.636458+0000","last_undegraded":"2024-04-26T23:40:43.636458+0000","last_fullsized":"2024-04-26T23:40:43.636458+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:45:49.295198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.635616+0000","last_change":"2024-04-26T23:40:40.675296+0000","last_active":"2024-04-26T23:40:43.635616+0000","last_peered":"2024-04-26T23:40:43.635616+0000","last_clean":"2024-04-26T23:40:43.635616+0000","last_became_active":"2024-04-26T23:40:40.674935+0000","last_became_peered":"2024-04-26T23:40:40.674935+0000","last_unstale":"2024-04-26T23:40:43.635616+0000","last_undegraded":"2024-04-26T23:40:43.635616+0000","last_fullsized":"2024-04-26T23:40:43.635616+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:10:10.722905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.686589+0000","last_change":"2024-04-26T23:40:41.691510+0000","last_active":"2024-04-26T23:40:42.686589+0000","last_peered":"2024-04-26T23:40:42.686589+0000","last_clean":"2024-04-26T23:40:42.686589+0000","last_became_active":"2024-04-26T23:40:41.691242+0000","last_became_peered":"2024-04-26T23:40:41.691242+0000","last_unstale":"2024-04-26T23:40:42.686589+0000","last_undegraded":"2024-04-26T23:40:42.686589+0000","last_fullsized":"2024-04-26T23:40:42.686589+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:27:48.823509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.637394+0000","last_change":"2024-04-26T23:40:32.590069+0000","last_active":"2024-04-26T23:40:43.637394+0000","last_peered":"2024-04-26T23:40:43.637394+0000","last_clean":"2024-04-26T23:40:43.637394+0000","last_became_active":"2024-04-26T23:40:32.589790+0000","last_became_peered":"2024-04-26T23:40:32.589790+0000","last_unstale":"2024-04-26T23:40:43.637394+0000","last_undegraded":"2024-04-26T23:40:43.637394+0000","last_fullsized":"2024-04-26T23:40:43.637394+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:15:52.942160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.684776+0000","last_change":"2024-04-26T23:40:31.572432+0000","last_active":"2024-04-26T23:40:42.684776+0000","last_peered":"2024-04-26T23:40:42.684776+0000","last_clean":"2024-04-26T23:40:42.684776+0000","last_became_active":"2024-04-26T23:40:31.572121+0000","last_became_peered":"2024-04-26T23:40:31.572121+0000","last_unstale":"2024-04-26T23:40:42.684776+0000","last_undegraded":"2024-04-26T23:40:42.684776+0000","last_fullsized":"2024-04-26T23:40:42.684776+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:45:49.295198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636314+0000","last_change":"2024-04-26T23:40:40.678404+0000","last_active":"2024-04-26T23:40:43.636314+0000","last_peered":"2024-04-26T23:40:43.636314+0000","last_clean":"2024-04-26T23:40:43.636314+0000","last_became_active":"2024-04-26T23:40:40.678136+0000","last_became_peered":"2024-04-26T23:40:40.678136+0000","last_unstale":"2024-04-26T23:40:43.636314+0000","last_undegraded":"2024-04-26T23:40:43.636314+0000","last_fullsized":"2024-04-26T23:40:43.636314+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:45:11.058699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636232+0000","last_change":"2024-04-26T23:40:41.673542+0000","last_active":"2024-04-26T23:40:43.636232+0000","last_peered":"2024-04-26T23:40:43.636232+0000","last_clean":"2024-04-26T23:40:43.636232+0000","last_became_active":"2024-04-26T23:40:41.673254+0000","last_became_peered":"2024-04-26T23:40:41.673254+0000","last_unstale":"2024-04-26T23:40:43.636232+0000","last_undegraded":"2024-04-26T23:40:43.636232+0000","last_fullsized":"2024-04-26T23:40:43.636232+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:10:11.728359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.635254+0000","last_change":"2024-04-26T23:40:32.576783+0000","last_active":"2024-04-26T23:40:43.635254+0000","last_peered":"2024-04-26T23:40:43.635254+0000","last_clean":"2024-04-26T23:40:43.635254+0000","last_became_active":"2024-04-26T23:40:32.576481+0000","last_became_peered":"2024-04-26T23:40:32.576481+0000","last_unstale":"2024-04-26T23:40:43.635254+0000","last_undegraded":"2024-04-26T23:40:43.635254+0000","last_fullsized":"2024-04-26T23:40:43.635254+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:16:46.547536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.635776+0000","last_change":"2024-04-26T23:40:31.570775+0000","last_active":"2024-04-26T23:40:43.635776+0000","last_peered":"2024-04-26T23:40:43.635776+0000","last_clean":"2024-04-26T23:40:43.635776+0000","last_became_active":"2024-04-26T23:40:31.570493+0000","last_became_peered":"2024-04-26T23:40:31.570493+0000","last_unstale":"2024-04-26T23:40:43.635776+0000","last_undegraded":"2024-04-26T23:40:43.635776+0000","last_fullsized":"2024-04-26T23:40:43.635776+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:45:49.295198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"23'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636208+0000","last_change":"2024-04-26T23:40:40.675115+0000","last_active":"2024-04-26T23:40:43.636208+0000","last_peered":"2024-04-26T23:40:43.636208+0000","last_clean":"2024-04-26T23:40:43.636208+0000","last_became_active":"2024-04-26T23:40:40.674828+0000","last_became_peered":"2024-04-26T23:40:40.674828+0000","last_unstale":"2024-04-26T23:40:43.636208+0000","last_undegraded":"2024-04-26T23:40:43.636208+0000","last_fullsized":"2024-04-26T23:40:43.636208+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:45:07.071050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.685711+0000","last_change":"2024-04-26T23:40:41.691098+0000","last_active":"2024-04-26T23:40:42.685711+0000","last_peered":"2024-04-26T23:40:42.685711+0000","last_clean":"2024-04-26T23:40:42.685711+0000","last_became_active":"2024-04-26T23:40:41.690803+0000","last_became_peered":"2024-04-26T23:40:41.690803+0000","last_unstale":"2024-04-26T23:40:42.685711+0000","last_undegraded":"2024-04-26T23:40:42.685711+0000","last_fullsized":"2024-04-26T23:40:42.685711+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:38:51.195172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.686290+0000","last_change":"2024-04-26T23:40:32.593262+0000","last_active":"2024-04-26T23:40:42.686290+0000","last_peered":"2024-04-26T23:40:42.686290+0000","last_clean":"2024-04-26T23:40:42.686290+0000","last_became_active":"2024-04-26T23:40:32.593003+0000","last_became_peered":"2024-04-26T23:40:32.593003+0000","last_unstale":"2024-04-26T23:40:42.686290+0000","last_undegraded":"2024-04-26T23:40:42.686290+0000","last_fullsized":"2024-04-26T23:40:42.686290+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:47:51.559918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.635660+0000","last_change":"2024-04-26T23:40:31.573864+0000","last_active":"2024-04-26T23:40:43.635660+0000","last_peered":"2024-04-26T23:40:43.635660+0000","last_clean":"2024-04-26T23:40:43.635660+0000","last_became_active":"2024-04-26T23:40:31.573594+0000","last_became_peered":"2024-04-26T23:40:31.573594+0000","last_unstale":"2024-04-26T23:40:43.635660+0000","last_undegraded":"2024-04-26T23:40:43.635660+0000","last_fullsized":"2024-04-26T23:40:43.635660+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:48:32.015654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"24'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.664374+0000","last_change":"2024-04-26T23:40:40.677258+0000","last_active":"2024-04-26T23:40:43.664374+0000","last_peered":"2024-04-26T23:40:43.664374+0000","last_clean":"2024-04-26T23:40:43.664374+0000","last_became_active":"2024-04-26T23:40:40.676937+0000","last_became_peered":"2024-04-26T23:40:40.676937+0000","last_unstale":"2024-04-26T23:40:43.664374+0000","last_undegraded":"2024-04-26T23:40:43.664374+0000","last_fullsized":"2024-04-26T23:40:43.664374+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:44:50.588556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636633+0000","last_change":"2024-04-26T23:40:41.684731+0000","last_active":"2024-04-26T23:40:43.636633+0000","last_peered":"2024-04-26T23:40:43.636633+0000","last_clean":"2024-04-26T23:40:43.636633+0000","last_became_active":"2024-04-26T23:40:41.684459+0000","last_became_peered":"2024-04-26T23:40:41.684459+0000","last_unstale":"2024-04-26T23:40:43.636633+0000","last_undegraded":"2024-04-26T23:40:43.636633+0000","last_fullsized":"2024-04-26T23:40:43.636633+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:24:07.784468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.637233+0000","last_change":"2024-04-26T23:40:32.593216+0000","last_active":"2024-04-26T23:40:43.637233+0000","last_peered":"2024-04-26T23:40:43.637233+0000","last_clean":"2024-04-26T23:40:43.637233+0000","last_became_active":"2024-04-26T23:40:32.592929+0000","last_became_peered":"2024-04-26T23:40:32.592929+0000","last_unstale":"2024-04-26T23:40:43.637233+0000","last_undegraded":"2024-04-26T23:40:43.637233+0000","last_fullsized":"2024-04-26T23:40:43.637233+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:12:45.093169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.684832+0000","last_change":"2024-04-26T23:40:31.570118+0000","last_active":"2024-04-26T23:40:42.684832+0000","last_peered":"2024-04-26T23:40:42.684832+0000","last_clean":"2024-04-26T23:40:42.684832+0000","last_became_active":"2024-04-26T23:40:31.569764+0000","last_became_peered":"2024-04-26T23:40:31.569764+0000","last_unstale":"2024-04-26T23:40:42.684832+0000","last_undegraded":"2024-04-26T23:40:42.684832+0000","last_fullsized":"2024-04-26T23:40:42.684832+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:15:30.884135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":178,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.635784+0000","last_change":"2024-04-26T23:40:20.966672+0000","last_active":"2024-04-26T23:40:43.635784+0000","last_peered":"2024-04-26T23:40:43.635784+0000","last_clean":"2024-04-26T23:40:43.635784+0000","last_became_active":"2024-04-26T23:40:20.963937+0000","last_became_peered":"2024-04-26T23:40:20.963937+0000","last_unstale":"2024-04-26T23:40:43.635784+0000","last_undegraded":"2024-04-26T23:40:43.635784+0000","last_fullsized":"2024-04-26T23:40:43.635784+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:19.950137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:19.950137+0000","last_clean_scrub_stamp":"2024-04-26T23:40:19.950137+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:23:39.166579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.683613+0000","last_change":"2024-04-26T23:40:40.671995+0000","last_active":"2024-04-26T23:40:42.683613+0000","last_peered":"2024-04-26T23:40:42.683613+0000","last_clean":"2024-04-26T23:40:42.683613+0000","last_became_active":"2024-04-26T23:40:40.671642+0000","last_became_peered":"2024-04-26T23:40:40.671642+0000","last_unstale":"2024-04-26T23:40:42.683613+0000","last_undegraded":"2024-04-26T23:40:42.683613+0000","last_fullsized":"2024-04-26T23:40:42.683613+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:35:16.288571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636479+0000","last_change":"2024-04-26T23:40:41.680852+0000","last_active":"2024-04-26T23:40:43.636479+0000","last_peered":"2024-04-26T23:40:43.636479+0000","last_clean":"2024-04-26T23:40:43.636479+0000","last_became_active":"2024-04-26T23:40:41.680567+0000","last_became_peered":"2024-04-26T23:40:41.680567+0000","last_unstale":"2024-04-26T23:40:43.636479+0000","last_undegraded":"2024-04-26T23:40:43.636479+0000","last_fullsized":"2024-04-26T23:40:43.636479+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:40:15.485085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.637223+0000","last_change":"2024-04-26T23:40:32.591906+0000","last_active":"2024-04-26T23:40:43.637223+0000","last_peered":"2024-04-26T23:40:43.637223+0000","last_clean":"2024-04-26T23:40:43.637223+0000","last_became_active":"2024-04-26T23:40:32.590867+0000","last_became_peered":"2024-04-26T23:40:32.590867+0000","last_unstale":"2024-04-26T23:40:43.637223+0000","last_undegraded":"2024-04-26T23:40:43.637223+0000","last_fullsized":"2024-04-26T23:40:43.637223+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:56:04.309611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636141+0000","last_change":"2024-04-26T23:40:31.572391+0000","last_active":"2024-04-26T23:40:43.636141+0000","last_peered":"2024-04-26T23:40:43.636141+0000","last_clean":"2024-04-26T23:40:43.636141+0000","last_became_active":"2024-04-26T23:40:31.571849+0000","last_became_peered":"2024-04-26T23:40:31.571849+0000","last_unstale":"2024-04-26T23:40:43.636141+0000","last_undegraded":"2024-04-26T23:40:43.636141+0000","last_fullsized":"2024-04-26T23:40:43.636141+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:35:54.439397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.683873+0000","last_change":"2024-04-26T23:40:40.676464+0000","last_active":"2024-04-26T23:40:42.683873+0000","last_peered":"2024-04-26T23:40:42.683873+0000","last_clean":"2024-04-26T23:40:42.683873+0000","last_became_active":"2024-04-26T23:40:40.676154+0000","last_became_peered":"2024-04-26T23:40:40.676154+0000","last_unstale":"2024-04-26T23:40:42.683873+0000","last_undegraded":"2024-04-26T23:40:42.683873+0000","last_fullsized":"2024-04-26T23:40:42.683873+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:52:34.793496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636055+0000","last_change":"2024-04-26T23:40:41.688065+0000","last_active":"2024-04-26T23:40:43.636055+0000","last_peered":"2024-04-26T23:40:43.636055+0000","last_clean":"2024-04-26T23:40:43.636055+0000","last_became_active":"2024-04-26T23:40:41.687693+0000","last_became_peered":"2024-04-26T23:40:41.687693+0000","last_unstale":"2024-04-26T23:40:43.636055+0000","last_undegraded":"2024-04-26T23:40:43.636055+0000","last_fullsized":"2024-04-26T23:40:43.636055+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:35:17.294025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.685453+0000","last_change":"2024-04-26T23:40:32.583469+0000","last_active":"2024-04-26T23:40:42.685453+0000","last_peered":"2024-04-26T23:40:42.685453+0000","last_clean":"2024-04-26T23:40:42.685453+0000","last_became_active":"2024-04-26T23:40:32.583174+0000","last_became_peered":"2024-04-26T23:40:32.583174+0000","last_unstale":"2024-04-26T23:40:42.685453+0000","last_undegraded":"2024-04-26T23:40:42.685453+0000","last_fullsized":"2024-04-26T23:40:42.685453+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:34:14.811917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.637058+0000","last_change":"2024-04-26T23:40:31.571749+0000","last_active":"2024-04-26T23:40:43.637058+0000","last_peered":"2024-04-26T23:40:43.637058+0000","last_clean":"2024-04-26T23:40:43.637058+0000","last_became_active":"2024-04-26T23:40:31.571427+0000","last_became_peered":"2024-04-26T23:40:31.571427+0000","last_unstale":"2024-04-26T23:40:43.637058+0000","last_undegraded":"2024-04-26T23:40:43.637058+0000","last_fullsized":"2024-04-26T23:40:43.637058+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:20:28.103413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"23'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.686472+0000","last_change":"2024-04-26T23:40:40.675987+0000","last_active":"2024-04-26T23:40:42.686472+0000","last_peered":"2024-04-26T23:40:42.686472+0000","last_clean":"2024-04-26T23:40:42.686472+0000","last_became_active":"2024-04-26T23:40:40.675682+0000","last_became_peered":"2024-04-26T23:40:40.675682+0000","last_unstale":"2024-04-26T23:40:42.686472+0000","last_undegraded":"2024-04-26T23:40:42.686472+0000","last_fullsized":"2024-04-26T23:40:42.686472+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:10:10.722905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.635569+0000","last_change":"2024-04-26T23:40:41.681408+0000","last_active":"2024-04-26T23:40:43.635569+0000","last_peered":"2024-04-26T23:40:43.635569+0000","last_clean":"2024-04-26T23:40:43.635569+0000","last_became_active":"2024-04-26T23:40:41.681069+0000","last_became_peered":"2024-04-26T23:40:41.681069+0000","last_unstale":"2024-04-26T23:40:43.635569+0000","last_undegraded":"2024-04-26T23:40:43.635569+0000","last_fullsized":"2024-04-26T23:40:43.635569+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:10:30.972726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636555+0000","last_change":"2024-04-26T23:40:32.596306+0000","last_active":"2024-04-26T23:40:43.636555+0000","last_peered":"2024-04-26T23:40:43.636555+0000","last_clean":"2024-04-26T23:40:43.636555+0000","last_became_active":"2024-04-26T23:40:32.595625+0000","last_became_peered":"2024-04-26T23:40:32.595625+0000","last_unstale":"2024-04-26T23:40:43.636555+0000","last_undegraded":"2024-04-26T23:40:43.636555+0000","last_fullsized":"2024-04-26T23:40:43.636555+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:10:02.629199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636280+0000","last_change":"2024-04-26T23:40:31.570870+0000","last_active":"2024-04-26T23:40:43.636280+0000","last_peered":"2024-04-26T23:40:43.636280+0000","last_clean":"2024-04-26T23:40:43.636280+0000","last_became_active":"2024-04-26T23:40:31.570592+0000","last_became_peered":"2024-04-26T23:40:31.570592+0000","last_unstale":"2024-04-26T23:40:43.636280+0000","last_undegraded":"2024-04-26T23:40:43.636280+0000","last_fullsized":"2024-04-26T23:40:43.636280+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:43:13.740214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.685417+0000","last_change":"2024-04-26T23:40:40.673142+0000","last_active":"2024-04-26T23:40:42.685417+0000","last_peered":"2024-04-26T23:40:42.685417+0000","last_clean":"2024-04-26T23:40:42.685417+0000","last_became_active":"2024-04-26T23:40:40.672816+0000","last_became_peered":"2024-04-26T23:40:40.672816+0000","last_unstale":"2024-04-26T23:40:42.685417+0000","last_undegraded":"2024-04-26T23:40:42.685417+0000","last_fullsized":"2024-04-26T23:40:42.685417+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:53:12.526011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.635564+0000","last_change":"2024-04-26T23:40:41.678588+0000","last_active":"2024-04-26T23:40:43.635564+0000","last_peered":"2024-04-26T23:40:43.635564+0000","last_clean":"2024-04-26T23:40:43.635564+0000","last_became_active":"2024-04-26T23:40:41.678039+0000","last_became_peered":"2024-04-26T23:40:41.678039+0000","last_unstale":"2024-04-26T23:40:43.635564+0000","last_undegraded":"2024-04-26T23:40:43.635564+0000","last_fullsized":"2024-04-26T23:40:43.635564+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:04:39.652713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636462+0000","last_change":"2024-04-26T23:40:32.593577+0000","last_active":"2024-04-26T23:40:43.636462+0000","last_peered":"2024-04-26T23:40:43.636462+0000","last_clean":"2024-04-26T23:40:43.636462+0000","last_became_active":"2024-04-26T23:40:32.593235+0000","last_became_peered":"2024-04-26T23:40:32.593235+0000","last_unstale":"2024-04-26T23:40:43.636462+0000","last_undegraded":"2024-04-26T23:40:43.636462+0000","last_fullsized":"2024-04-26T23:40:43.636462+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:01:02.741964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636418+0000","last_change":"2024-04-26T23:40:31.575943+0000","last_active":"2024-04-26T23:40:43.636418+0000","last_peered":"2024-04-26T23:40:43.636418+0000","last_clean":"2024-04-26T23:40:43.636418+0000","last_became_active":"2024-04-26T23:40:31.575632+0000","last_became_peered":"2024-04-26T23:40:31.575632+0000","last_unstale":"2024-04-26T23:40:43.636418+0000","last_undegraded":"2024-04-26T23:40:43.636418+0000","last_fullsized":"2024-04-26T23:40:43.636418+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:11:08.189634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636540+0000","last_change":"2024-04-26T23:40:40.676297+0000","last_active":"2024-04-26T23:40:43.636540+0000","last_peered":"2024-04-26T23:40:43.636540+0000","last_clean":"2024-04-26T23:40:43.636540+0000","last_became_active":"2024-04-26T23:40:40.675888+0000","last_became_peered":"2024-04-26T23:40:40.675888+0000","last_unstale":"2024-04-26T23:40:43.636540+0000","last_undegraded":"2024-04-26T23:40:43.636540+0000","last_fullsized":"2024-04-26T23:40:43.636540+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:04:38.647258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.637873+0000","last_change":"2024-04-26T23:40:41.688506+0000","last_active":"2024-04-26T23:40:43.637873+0000","last_peered":"2024-04-26T23:40:43.637873+0000","last_clean":"2024-04-26T23:40:43.637873+0000","last_became_active":"2024-04-26T23:40:41.688224+0000","last_became_peered":"2024-04-26T23:40:41.688224+0000","last_unstale":"2024-04-26T23:40:43.637873+0000","last_undegraded":"2024-04-26T23:40:43.637873+0000","last_fullsized":"2024-04-26T23:40:43.637873+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:05:34.008024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.637217+0000","last_change":"2024-04-26T23:40:32.593528+0000","last_active":"2024-04-26T23:40:43.637217+0000","last_peered":"2024-04-26T23:40:43.637217+0000","last_clean":"2024-04-26T23:40:43.637217+0000","last_became_active":"2024-04-26T23:40:32.593220+0000","last_became_peered":"2024-04-26T23:40:32.593220+0000","last_unstale":"2024-04-26T23:40:43.637217+0000","last_undegraded":"2024-04-26T23:40:43.637217+0000","last_fullsized":"2024-04-26T23:40:43.637217+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:04:30.553552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":30,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.635390+0000","last_change":"2024-04-26T23:40:31.572685+0000","last_active":"2024-04-26T23:40:43.635390+0000","last_peered":"2024-04-26T23:40:43.635390+0000","last_clean":"2024-04-26T23:40:43.635390+0000","last_became_active":"2024-04-26T23:40:31.572169+0000","last_became_peered":"2024-04-26T23:40:31.572169+0000","last_unstale":"2024-04-26T23:40:43.635390+0000","last_undegraded":"2024-04-26T23:40:43.635390+0000","last_fullsized":"2024-04-26T23:40:43.635390+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:15:30.884135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.687059+0000","last_change":"2024-04-26T23:40:40.672160+0000","last_active":"2024-04-26T23:40:42.687059+0000","last_peered":"2024-04-26T23:40:42.687059+0000","last_clean":"2024-04-26T23:40:42.687059+0000","last_became_active":"2024-04-26T23:40:40.671875+0000","last_became_peered":"2024-04-26T23:40:40.671875+0000","last_unstale":"2024-04-26T23:40:42.687059+0000","last_undegraded":"2024-04-26T23:40:42.687059+0000","last_fullsized":"2024-04-26T23:40:42.687059+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:35:16.288571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.685105+0000","last_change":"2024-04-26T23:40:41.688445+0000","last_active":"2024-04-26T23:40:42.685105+0000","last_peered":"2024-04-26T23:40:42.685105+0000","last_clean":"2024-04-26T23:40:42.685105+0000","last_became_active":"2024-04-26T23:40:41.688053+0000","last_became_peered":"2024-04-26T23:40:41.688053+0000","last_unstale":"2024-04-26T23:40:42.685105+0000","last_undegraded":"2024-04-26T23:40:42.685105+0000","last_fullsized":"2024-04-26T23:40:42.685105+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:08:35.027584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.683320+0000","last_change":"2024-04-26T23:40:32.586832+0000","last_active":"2024-04-26T23:40:42.683320+0000","last_peered":"2024-04-26T23:40:42.683320+0000","last_clean":"2024-04-26T23:40:42.683320+0000","last_became_active":"2024-04-26T23:40:32.585809+0000","last_became_peered":"2024-04-26T23:40:32.585809+0000","last_unstale":"2024-04-26T23:40:42.683320+0000","last_undegraded":"2024-04-26T23:40:42.683320+0000","last_fullsized":"2024-04-26T23:40:42.683320+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:51:30.677247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.683971+0000","last_change":"2024-04-26T23:40:31.569512+0000","last_active":"2024-04-26T23:40:42.683971+0000","last_peered":"2024-04-26T23:40:42.683971+0000","last_clean":"2024-04-26T23:40:42.683971+0000","last_became_active":"2024-04-26T23:40:31.568598+0000","last_became_peered":"2024-04-26T23:40:31.568598+0000","last_unstale":"2024-04-26T23:40:42.683971+0000","last_undegraded":"2024-04-26T23:40:42.683971+0000","last_fullsized":"2024-04-26T23:40:42.683971+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:48:32.015654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.637928+0000","last_change":"2024-04-26T23:40:40.673986+0000","last_active":"2024-04-26T23:40:43.637928+0000","last_peered":"2024-04-26T23:40:43.637928+0000","last_clean":"2024-04-26T23:40:43.637928+0000","last_became_active":"2024-04-26T23:40:40.673704+0000","last_became_peered":"2024-04-26T23:40:40.673704+0000","last_unstale":"2024-04-26T23:40:43.637928+0000","last_undegraded":"2024-04-26T23:40:43.637928+0000","last_fullsized":"2024-04-26T23:40:43.637928+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:37:24.000775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.685367+0000","last_change":"2024-04-26T23:40:41.691441+0000","last_active":"2024-04-26T23:40:42.685367+0000","last_peered":"2024-04-26T23:40:42.685367+0000","last_clean":"2024-04-26T23:40:42.685367+0000","last_became_active":"2024-04-26T23:40:41.691160+0000","last_became_peered":"2024-04-26T23:40:41.691160+0000","last_unstale":"2024-04-26T23:40:42.685367+0000","last_undegraded":"2024-04-26T23:40:42.685367+0000","last_fullsized":"2024-04-26T23:40:42.685367+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:41:52.386084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636667+0000","last_change":"2024-04-26T23:40:32.595377+0000","last_active":"2024-04-26T23:40:43.636667+0000","last_peered":"2024-04-26T23:40:43.636667+0000","last_clean":"2024-04-26T23:40:43.636667+0000","last_became_active":"2024-04-26T23:40:32.595032+0000","last_became_peered":"2024-04-26T23:40:32.595032+0000","last_unstale":"2024-04-26T23:40:43.636667+0000","last_undegraded":"2024-04-26T23:40:43.636667+0000","last_fullsized":"2024-04-26T23:40:43.636667+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:44:42.494850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.684685+0000","last_change":"2024-04-26T23:40:31.575493+0000","last_active":"2024-04-26T23:40:42.684685+0000","last_peered":"2024-04-26T23:40:42.684685+0000","last_clean":"2024-04-26T23:40:42.684685+0000","last_became_active":"2024-04-26T23:40:31.575039+0000","last_became_peered":"2024-04-26T23:40:31.575039+0000","last_unstale":"2024-04-26T23:40:42.684685+0000","last_undegraded":"2024-04-26T23:40:42.684685+0000","last_fullsized":"2024-04-26T23:40:42.684685+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:43:13.740214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"23'6","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.637618+0000","last_change":"2024-04-26T23:40:40.676493+0000","last_active":"2024-04-26T23:40:43.637618+0000","last_peered":"2024-04-26T23:40:43.637618+0000","last_clean":"2024-04-26T23:40:43.637618+0000","last_became_active":"2024-04-26T23:40:40.676124+0000","last_became_peered":"2024-04-26T23:40:40.676124+0000","last_unstale":"2024-04-26T23:40:43.637618+0000","last_undegraded":"2024-04-26T23:40:43.637618+0000","last_fullsized":"2024-04-26T23:40:43.637618+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:28:33.915485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.637568+0000","last_change":"2024-04-26T23:40:41.680735+0000","last_active":"2024-04-26T23:40:43.637568+0000","last_peered":"2024-04-26T23:40:43.637568+0000","last_clean":"2024-04-26T23:40:43.637568+0000","last_became_active":"2024-04-26T23:40:41.680485+0000","last_became_peered":"2024-04-26T23:40:41.680485+0000","last_unstale":"2024-04-26T23:40:43.637568+0000","last_undegraded":"2024-04-26T23:40:43.637568+0000","last_fullsized":"2024-04-26T23:40:43.637568+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:38:51.195172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.686381+0000","last_change":"2024-04-26T23:40:32.589706+0000","last_active":"2024-04-26T23:40:42.686381+0000","last_peered":"2024-04-26T23:40:42.686381+0000","last_clean":"2024-04-26T23:40:42.686381+0000","last_became_active":"2024-04-26T23:40:32.589452+0000","last_became_peered":"2024-04-26T23:40:32.589452+0000","last_unstale":"2024-04-26T23:40:42.686381+0000","last_undegraded":"2024-04-26T23:40:42.686381+0000","last_fullsized":"2024-04-26T23:40:42.686381+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:15:01.970308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.686999+0000","last_change":"2024-04-26T23:40:31.573941+0000","last_active":"2024-04-26T23:40:42.686999+0000","last_peered":"2024-04-26T23:40:42.686999+0000","last_clean":"2024-04-26T23:40:42.686999+0000","last_became_active":"2024-04-26T23:40:31.573668+0000","last_became_peered":"2024-04-26T23:40:31.573668+0000","last_unstale":"2024-04-26T23:40:42.686999+0000","last_undegraded":"2024-04-26T23:40:42.686999+0000","last_fullsized":"2024-04-26T23:40:42.686999+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:58:06.477730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"23'3","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.685527+0000","last_change":"2024-04-26T23:40:40.676408+0000","last_active":"2024-04-26T23:40:42.685527+0000","last_peered":"2024-04-26T23:40:42.685527+0000","last_clean":"2024-04-26T23:40:42.685527+0000","last_became_active":"2024-04-26T23:40:40.676147+0000","last_became_peered":"2024-04-26T23:40:40.676147+0000","last_unstale":"2024-04-26T23:40:42.685527+0000","last_undegraded":"2024-04-26T23:40:42.685527+0000","last_fullsized":"2024-04-26T23:40:42.685527+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:27:47.818055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.637455+0000","last_change":"2024-04-26T23:40:41.685829+0000","last_active":"2024-04-26T23:40:43.637455+0000","last_peered":"2024-04-26T23:40:43.637455+0000","last_clean":"2024-04-26T23:40:43.637455+0000","last_became_active":"2024-04-26T23:40:41.685403+0000","last_became_peered":"2024-04-26T23:40:41.685403+0000","last_unstale":"2024-04-26T23:40:43.637455+0000","last_undegraded":"2024-04-26T23:40:43.637455+0000","last_fullsized":"2024-04-26T23:40:43.637455+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:24:07.784468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.637089+0000","last_change":"2024-04-26T23:40:32.587513+0000","last_active":"2024-04-26T23:40:43.637089+0000","last_peered":"2024-04-26T23:40:43.637089+0000","last_clean":"2024-04-26T23:40:43.637089+0000","last_became_active":"2024-04-26T23:40:32.587200+0000","last_became_peered":"2024-04-26T23:40:32.587200+0000","last_unstale":"2024-04-26T23:40:43.637089+0000","last_undegraded":"2024-04-26T23:40:43.637089+0000","last_fullsized":"2024-04-26T23:40:43.637089+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:37:30.361795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":28,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.683606+0000","last_change":"2024-04-26T23:40:31.572331+0000","last_active":"2024-04-26T23:40:42.683606+0000","last_peered":"2024-04-26T23:40:42.683606+0000","last_clean":"2024-04-26T23:40:42.683606+0000","last_became_active":"2024-04-26T23:40:31.572074+0000","last_became_peered":"2024-04-26T23:40:31.572074+0000","last_unstale":"2024-04-26T23:40:42.683606+0000","last_undegraded":"2024-04-26T23:40:42.683606+0000","last_fullsized":"2024-04-26T23:40:42.683606+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:45:49.295198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.635520+0000","last_change":"2024-04-26T23:40:40.677978+0000","last_active":"2024-04-26T23:40:43.635520+0000","last_peered":"2024-04-26T23:40:43.635520+0000","last_clean":"2024-04-26T23:40:43.635520+0000","last_became_active":"2024-04-26T23:40:40.677714+0000","last_became_peered":"2024-04-26T23:40:40.677714+0000","last_unstale":"2024-04-26T23:40:43.635520+0000","last_undegraded":"2024-04-26T23:40:43.635520+0000","last_fullsized":"2024-04-26T23:40:43.635520+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:44:50.588556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636093+0000","last_change":"2024-04-26T23:40:41.685431+0000","last_active":"2024-04-26T23:40:43.636093+0000","last_peered":"2024-04-26T23:40:43.636093+0000","last_clean":"2024-04-26T23:40:43.636093+0000","last_became_active":"2024-04-26T23:40:41.685147+0000","last_became_peered":"2024-04-26T23:40:41.685147+0000","last_unstale":"2024-04-26T23:40:43.636093+0000","last_undegraded":"2024-04-26T23:40:43.636093+0000","last_fullsized":"2024-04-26T23:40:43.636093+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:33:16.389626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636824+0000","last_change":"2024-04-26T23:40:32.593298+0000","last_active":"2024-04-26T23:40:43.636824+0000","last_peered":"2024-04-26T23:40:43.636824+0000","last_clean":"2024-04-26T23:40:43.636824+0000","last_became_active":"2024-04-26T23:40:32.593030+0000","last_became_peered":"2024-04-26T23:40:32.593030+0000","last_unstale":"2024-04-26T23:40:43.636824+0000","last_undegraded":"2024-04-26T23:40:43.636824+0000","last_fullsized":"2024-04-26T23:40:43.636824+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:20:29.107798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636957+0000","last_change":"2024-04-26T23:40:31.574234+0000","last_active":"2024-04-26T23:40:43.636957+0000","last_peered":"2024-04-26T23:40:43.636957+0000","last_clean":"2024-04-26T23:40:43.636957+0000","last_became_active":"2024-04-26T23:40:31.572218+0000","last_became_peered":"2024-04-26T23:40:31.572218+0000","last_unstale":"2024-04-26T23:40:43.636957+0000","last_undegraded":"2024-04-26T23:40:43.636957+0000","last_fullsized":"2024-04-26T23:40:43.636957+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:25:01.315397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"23'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.637149+0000","last_change":"2024-04-26T23:40:40.674778+0000","last_active":"2024-04-26T23:40:43.637149+0000","last_peered":"2024-04-26T23:40:43.637149+0000","last_clean":"2024-04-26T23:40:43.637149+0000","last_became_active":"2024-04-26T23:40:40.674487+0000","last_became_peered":"2024-04-26T23:40:40.674487+0000","last_unstale":"2024-04-26T23:40:43.637149+0000","last_undegraded":"2024-04-26T23:40:43.637149+0000","last_fullsized":"2024-04-26T23:40:43.637149+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:10:10.722905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.683588+0000","last_change":"2024-04-26T23:40:41.686531+0000","last_active":"2024-04-26T23:40:42.683588+0000","last_peered":"2024-04-26T23:40:42.683588+0000","last_clean":"2024-04-26T23:40:42.683588+0000","last_became_active":"2024-04-26T23:40:41.686259+0000","last_became_peered":"2024-04-26T23:40:41.686259+0000","last_unstale":"2024-04-26T23:40:42.683588+0000","last_undegraded":"2024-04-26T23:40:42.683588+0000","last_fullsized":"2024-04-26T23:40:42.683588+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:45:34.231942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.686899+0000","last_change":"2024-04-26T23:40:32.589146+0000","last_active":"2024-04-26T23:40:42.686899+0000","last_peered":"2024-04-26T23:40:42.686899+0000","last_clean":"2024-04-26T23:40:42.686899+0000","last_became_active":"2024-04-26T23:40:32.588881+0000","last_became_peered":"2024-04-26T23:40:32.588881+0000","last_unstale":"2024-04-26T23:40:42.686899+0000","last_undegraded":"2024-04-26T23:40:42.686899+0000","last_fullsized":"2024-04-26T23:40:42.686899+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:38:10.884592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.685165+0000","last_change":"2024-04-26T23:40:31.575616+0000","last_active":"2024-04-26T23:40:42.685165+0000","last_peered":"2024-04-26T23:40:42.685165+0000","last_clean":"2024-04-26T23:40:42.685165+0000","last_became_active":"2024-04-26T23:40:31.575211+0000","last_became_peered":"2024-04-26T23:40:31.575211+0000","last_unstale":"2024-04-26T23:40:42.685165+0000","last_undegraded":"2024-04-26T23:40:42.685165+0000","last_fullsized":"2024-04-26T23:40:42.685165+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:48:32.015654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"23'8","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636684+0000","last_change":"2024-04-26T23:40:40.675694+0000","last_active":"2024-04-26T23:40:43.636684+0000","last_peered":"2024-04-26T23:40:43.636684+0000","last_clean":"2024-04-26T23:40:43.636684+0000","last_became_active":"2024-04-26T23:40:40.675459+0000","last_became_peered":"2024-04-26T23:40:40.675459+0000","last_unstale":"2024-04-26T23:40:43.636684+0000","last_undegraded":"2024-04-26T23:40:43.636684+0000","last_fullsized":"2024-04-26T23:40:43.636684+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:30:03.993564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.635596+0000","last_change":"2024-04-26T23:40:41.687488+0000","last_active":"2024-04-26T23:40:43.635596+0000","last_peered":"2024-04-26T23:40:43.635596+0000","last_clean":"2024-04-26T23:40:43.635596+0000","last_became_active":"2024-04-26T23:40:41.687210+0000","last_became_peered":"2024-04-26T23:40:41.687210+0000","last_unstale":"2024-04-26T23:40:43.635596+0000","last_undegraded":"2024-04-26T23:40:43.635596+0000","last_fullsized":"2024-04-26T23:40:43.635596+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:36:21.487122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.685110+0000","last_change":"2024-04-26T23:40:32.589793+0000","last_active":"2024-04-26T23:40:42.685110+0000","last_peered":"2024-04-26T23:40:42.685110+0000","last_clean":"2024-04-26T23:40:42.685110+0000","last_became_active":"2024-04-26T23:40:32.589478+0000","last_became_peered":"2024-04-26T23:40:32.589478+0000","last_unstale":"2024-04-26T23:40:42.685110+0000","last_undegraded":"2024-04-26T23:40:42.685110+0000","last_fullsized":"2024-04-26T23:40:42.685110+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:56:04.309611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.684275+0000","last_change":"2024-04-26T23:40:31.573794+0000","last_active":"2024-04-26T23:40:42.684275+0000","last_peered":"2024-04-26T23:40:42.684275+0000","last_clean":"2024-04-26T23:40:42.684275+0000","last_became_active":"2024-04-26T23:40:31.573164+0000","last_became_peered":"2024-04-26T23:40:31.573164+0000","last_unstale":"2024-04-26T23:40:42.684275+0000","last_undegraded":"2024-04-26T23:40:42.684275+0000","last_fullsized":"2024-04-26T23:40:42.684275+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:15:30.884135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636808+0000","last_change":"2024-04-26T23:40:40.674127+0000","last_active":"2024-04-26T23:40:43.636808+0000","last_peered":"2024-04-26T23:40:43.636808+0000","last_clean":"2024-04-26T23:40:43.636808+0000","last_became_active":"2024-04-26T23:40:40.673793+0000","last_became_peered":"2024-04-26T23:40:40.673793+0000","last_unstale":"2024-04-26T23:40:43.636808+0000","last_undegraded":"2024-04-26T23:40:43.636808+0000","last_fullsized":"2024-04-26T23:40:43.636808+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:53:12.526011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.684571+0000","last_change":"2024-04-26T23:40:41.686867+0000","last_active":"2024-04-26T23:40:42.684571+0000","last_peered":"2024-04-26T23:40:42.684571+0000","last_clean":"2024-04-26T23:40:42.684571+0000","last_became_active":"2024-04-26T23:40:41.686536+0000","last_became_peered":"2024-04-26T23:40:41.686536+0000","last_unstale":"2024-04-26T23:40:42.684571+0000","last_undegraded":"2024-04-26T23:40:42.684571+0000","last_fullsized":"2024-04-26T23:40:42.684571+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:28:34.920939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"23'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.686809+0000","last_change":"2024-04-26T23:40:40.674915+0000","last_active":"2024-04-26T23:40:42.686809+0000","last_peered":"2024-04-26T23:40:42.686809+0000","last_clean":"2024-04-26T23:40:42.686809+0000","last_became_active":"2024-04-26T23:40:40.674639+0000","last_became_peered":"2024-04-26T23:40:40.674639+0000","last_unstale":"2024-04-26T23:40:42.686809+0000","last_undegraded":"2024-04-26T23:40:42.686809+0000","last_fullsized":"2024-04-26T23:40:42.686809+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:52:34.793496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.635465+0000","last_change":"2024-04-26T23:40:32.583014+0000","last_active":"2024-04-26T23:40:43.635465+0000","last_peered":"2024-04-26T23:40:43.635465+0000","last_clean":"2024-04-26T23:40:43.635465+0000","last_became_active":"2024-04-26T23:40:32.582751+0000","last_became_peered":"2024-04-26T23:40:32.582751+0000","last_unstale":"2024-04-26T23:40:43.635465+0000","last_undegraded":"2024-04-26T23:40:43.635465+0000","last_fullsized":"2024-04-26T23:40:43.635465+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:38:10.884592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.685541+0000","last_change":"2024-04-26T23:40:31.572402+0000","last_active":"2024-04-26T23:40:42.685541+0000","last_peered":"2024-04-26T23:40:42.685541+0000","last_clean":"2024-04-26T23:40:42.685541+0000","last_became_active":"2024-04-26T23:40:31.572111+0000","last_became_peered":"2024-04-26T23:40:31.572111+0000","last_unstale":"2024-04-26T23:40:42.685541+0000","last_undegraded":"2024-04-26T23:40:42.685541+0000","last_fullsized":"2024-04-26T23:40:42.685541+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:20:28.103413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.686752+0000","last_change":"2024-04-26T23:40:41.684524+0000","last_active":"2024-04-26T23:40:42.686752+0000","last_peered":"2024-04-26T23:40:42.686752+0000","last_clean":"2024-04-26T23:40:42.686752+0000","last_became_active":"2024-04-26T23:40:41.684207+0000","last_became_peered":"2024-04-26T23:40:41.684207+0000","last_unstale":"2024-04-26T23:40:42.686752+0000","last_undegraded":"2024-04-26T23:40:42.686752+0000","last_fullsized":"2024-04-26T23:40:42.686752+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:30:04.999018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"23'4","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.684153+0000","last_change":"2024-04-26T23:40:40.674934+0000","last_active":"2024-04-26T23:40:42.684153+0000","last_peered":"2024-04-26T23:40:42.684153+0000","last_clean":"2024-04-26T23:40:42.684153+0000","last_became_active":"2024-04-26T23:40:40.674628+0000","last_became_peered":"2024-04-26T23:40:40.674628+0000","last_unstale":"2024-04-26T23:40:42.684153+0000","last_undegraded":"2024-04-26T23:40:42.684153+0000","last_fullsized":"2024-04-26T23:40:42.684153+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:44:50.588556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636777+0000","last_change":"2024-04-26T23:40:32.586204+0000","last_active":"2024-04-26T23:40:43.636777+0000","last_peered":"2024-04-26T23:40:43.636777+0000","last_clean":"2024-04-26T23:40:43.636777+0000","last_became_active":"2024-04-26T23:40:32.585725+0000","last_became_peered":"2024-04-26T23:40:32.585725+0000","last_unstale":"2024-04-26T23:40:43.636777+0000","last_undegraded":"2024-04-26T23:40:43.636777+0000","last_fullsized":"2024-04-26T23:40:43.636777+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:51:30.677247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.637081+0000","last_change":"2024-04-26T23:40:31.578929+0000","last_active":"2024-04-26T23:40:43.637081+0000","last_peered":"2024-04-26T23:40:43.637081+0000","last_clean":"2024-04-26T23:40:43.637081+0000","last_became_active":"2024-04-26T23:40:31.578623+0000","last_became_peered":"2024-04-26T23:40:31.578623+0000","last_unstale":"2024-04-26T23:40:43.637081+0000","last_undegraded":"2024-04-26T23:40:43.637081+0000","last_fullsized":"2024-04-26T23:40:43.637081+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:50:21.330821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.637097+0000","last_change":"2024-04-26T23:40:41.689697+0000","last_active":"2024-04-26T23:40:43.637097+0000","last_peered":"2024-04-26T23:40:43.637097+0000","last_clean":"2024-04-26T23:40:43.637097+0000","last_became_active":"2024-04-26T23:40:41.688428+0000","last_became_peered":"2024-04-26T23:40:41.688428+0000","last_unstale":"2024-04-26T23:40:43.637097+0000","last_undegraded":"2024-04-26T23:40:43.637097+0000","last_fullsized":"2024-04-26T23:40:43.637097+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:36:21.487122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.684234+0000","last_change":"2024-04-26T23:40:31.567755+0000","last_active":"2024-04-26T23:40:42.684234+0000","last_peered":"2024-04-26T23:40:42.684234+0000","last_clean":"2024-04-26T23:40:42.684234+0000","last_became_active":"2024-04-26T23:40:31.567484+0000","last_became_peered":"2024-04-26T23:40:31.567484+0000","last_unstale":"2024-04-26T23:40:42.684234+0000","last_undegraded":"2024-04-26T23:40:42.684234+0000","last_fullsized":"2024-04-26T23:40:42.684234+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:43:13.740214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.686881+0000","last_change":"2024-04-26T23:40:32.594689+0000","last_active":"2024-04-26T23:40:42.686881+0000","last_peered":"2024-04-26T23:40:42.686881+0000","last_clean":"2024-04-26T23:40:42.686881+0000","last_became_active":"2024-04-26T23:40:32.592365+0000","last_became_peered":"2024-04-26T23:40:32.592365+0000","last_unstale":"2024-04-26T23:40:42.686881+0000","last_undegraded":"2024-04-26T23:40:42.686881+0000","last_fullsized":"2024-04-26T23:40:42.686881+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:17:46.135806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"23'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.635940+0000","last_change":"2024-04-26T23:40:40.676028+0000","last_active":"2024-04-26T23:40:43.635940+0000","last_peered":"2024-04-26T23:40:43.635940+0000","last_clean":"2024-04-26T23:40:43.635940+0000","last_became_active":"2024-04-26T23:40:40.675736+0000","last_became_peered":"2024-04-26T23:40:40.675736+0000","last_unstale":"2024-04-26T23:40:43.635940+0000","last_undegraded":"2024-04-26T23:40:43.635940+0000","last_fullsized":"2024-04-26T23:40:43.635940+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:51:38.770953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636545+0000","last_change":"2024-04-26T23:40:41.690148+0000","last_active":"2024-04-26T23:40:43.636545+0000","last_peered":"2024-04-26T23:40:43.636545+0000","last_clean":"2024-04-26T23:40:43.636545+0000","last_became_active":"2024-04-26T23:40:41.689765+0000","last_became_peered":"2024-04-26T23:40:41.689765+0000","last_unstale":"2024-04-26T23:40:43.636545+0000","last_undegraded":"2024-04-26T23:40:43.636545+0000","last_fullsized":"2024-04-26T23:40:43.636545+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:33:16.389626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.637574+0000","last_change":"2024-04-26T23:40:31.576749+0000","last_active":"2024-04-26T23:40:43.637574+0000","last_peered":"2024-04-26T23:40:43.637574+0000","last_clean":"2024-04-26T23:40:43.637574+0000","last_became_active":"2024-04-26T23:40:31.576178+0000","last_became_peered":"2024-04-26T23:40:31.576178+0000","last_unstale":"2024-04-26T23:40:43.637574+0000","last_undegraded":"2024-04-26T23:40:43.637574+0000","last_fullsized":"2024-04-26T23:40:43.637574+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:15:30.884135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636389+0000","last_change":"2024-04-26T23:40:32.589208+0000","last_active":"2024-04-26T23:40:43.636389+0000","last_peered":"2024-04-26T23:40:43.636389+0000","last_clean":"2024-04-26T23:40:43.636389+0000","last_became_active":"2024-04-26T23:40:32.588927+0000","last_became_peered":"2024-04-26T23:40:32.588927+0000","last_unstale":"2024-04-26T23:40:43.636389+0000","last_undegraded":"2024-04-26T23:40:43.636389+0000","last_fullsized":"2024-04-26T23:40:43.636389+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:45:50.299583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"23'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.637675+0000","last_change":"2024-04-26T23:40:40.676809+0000","last_active":"2024-04-26T23:40:43.637675+0000","last_peered":"2024-04-26T23:40:43.637675+0000","last_clean":"2024-04-26T23:40:43.637675+0000","last_became_active":"2024-04-26T23:40:40.676070+0000","last_became_peered":"2024-04-26T23:40:40.676070+0000","last_unstale":"2024-04-26T23:40:43.637675+0000","last_undegraded":"2024-04-26T23:40:43.637675+0000","last_fullsized":"2024-04-26T23:40:43.637675+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:17:27.667323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.637854+0000","last_change":"2024-04-26T23:40:41.679796+0000","last_active":"2024-04-26T23:40:43.637854+0000","last_peered":"2024-04-26T23:40:43.637854+0000","last_clean":"2024-04-26T23:40:43.637854+0000","last_became_active":"2024-04-26T23:40:41.679523+0000","last_became_peered":"2024-04-26T23:40:41.679523+0000","last_unstale":"2024-04-26T23:40:43.637854+0000","last_undegraded":"2024-04-26T23:40:43.637854+0000","last_fullsized":"2024-04-26T23:40:43.637854+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:43:02.137315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.683465+0000","last_change":"2024-04-26T23:40:32.586672+0000","last_active":"2024-04-26T23:40:42.683465+0000","last_peered":"2024-04-26T23:40:42.683465+0000","last_clean":"2024-04-26T23:40:42.683465+0000","last_became_active":"2024-04-26T23:40:32.586399+0000","last_became_peered":"2024-04-26T23:40:32.586399+0000","last_unstale":"2024-04-26T23:40:42.683465+0000","last_undegraded":"2024-04-26T23:40:42.683465+0000","last_fullsized":"2024-04-26T23:40:42.683465+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:15:01.970308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636388+0000","last_change":"2024-04-26T23:40:41.687529+0000","last_active":"2024-04-26T23:40:43.636388+0000","last_peered":"2024-04-26T23:40:43.636388+0000","last_clean":"2024-04-26T23:40:43.636388+0000","last_became_active":"2024-04-26T23:40:41.686974+0000","last_became_peered":"2024-04-26T23:40:41.686974+0000","last_unstale":"2024-04-26T23:40:43.636388+0000","last_undegraded":"2024-04-26T23:40:43.636388+0000","last_fullsized":"2024-04-26T23:40:43.636388+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:21:56.950703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.635606+0000","last_change":"2024-04-26T23:40:32.584590+0000","last_active":"2024-04-26T23:40:43.635606+0000","last_peered":"2024-04-26T23:40:43.635606+0000","last_clean":"2024-04-26T23:40:43.635606+0000","last_became_active":"2024-04-26T23:40:32.584234+0000","last_became_peered":"2024-04-26T23:40:32.584234+0000","last_unstale":"2024-04-26T23:40:43.635606+0000","last_undegraded":"2024-04-26T23:40:43.635606+0000","last_fullsized":"2024-04-26T23:40:43.635606+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:15:52.942160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.685091+0000","last_change":"2024-04-26T23:40:41.679549+0000","last_active":"2024-04-26T23:40:42.685091+0000","last_peered":"2024-04-26T23:40:42.685091+0000","last_clean":"2024-04-26T23:40:42.685091+0000","last_became_active":"2024-04-26T23:40:41.679254+0000","last_became_peered":"2024-04-26T23:40:41.679254+0000","last_unstale":"2024-04-26T23:40:42.685091+0000","last_undegraded":"2024-04-26T23:40:42.685091+0000","last_fullsized":"2024-04-26T23:40:42.685091+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:48:09.126894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.684675+0000","last_change":"2024-04-26T23:40:32.580453+0000","last_active":"2024-04-26T23:40:42.684675+0000","last_peered":"2024-04-26T23:40:42.684675+0000","last_clean":"2024-04-26T23:40:42.684675+0000","last_became_active":"2024-04-26T23:40:32.580196+0000","last_became_peered":"2024-04-26T23:40:32.580196+0000","last_unstale":"2024-04-26T23:40:42.684675+0000","last_undegraded":"2024-04-26T23:40:42.684675+0000","last_fullsized":"2024-04-26T23:40:42.684675+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:18:09.706875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636745+0000","last_change":"2024-04-26T23:40:41.690579+0000","last_active":"2024-04-26T23:40:43.636745+0000","last_peered":"2024-04-26T23:40:43.636745+0000","last_clean":"2024-04-26T23:40:43.636745+0000","last_became_active":"2024-04-26T23:40:41.690262+0000","last_became_peered":"2024-04-26T23:40:41.690262+0000","last_unstale":"2024-04-26T23:40:43.636745+0000","last_undegraded":"2024-04-26T23:40:43.636745+0000","last_fullsized":"2024-04-26T23:40:43.636745+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:10:30.972726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.686790+0000","last_change":"2024-04-26T23:40:32.584323+0000","last_active":"2024-04-26T23:40:42.686790+0000","last_peered":"2024-04-26T23:40:42.686790+0000","last_clean":"2024-04-26T23:40:42.686790+0000","last_became_active":"2024-04-26T23:40:32.584010+0000","last_became_peered":"2024-04-26T23:40:32.584010+0000","last_unstale":"2024-04-26T23:40:42.686790+0000","last_undegraded":"2024-04-26T23:40:42.686790+0000","last_fullsized":"2024-04-26T23:40:42.686790+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:16:46.547536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636036+0000","last_change":"2024-04-26T23:40:41.677679+0000","last_active":"2024-04-26T23:40:43.636036+0000","last_peered":"2024-04-26T23:40:43.636036+0000","last_clean":"2024-04-26T23:40:43.636036+0000","last_became_active":"2024-04-26T23:40:41.677398+0000","last_became_peered":"2024-04-26T23:40:41.677398+0000","last_unstale":"2024-04-26T23:40:43.636036+0000","last_undegraded":"2024-04-26T23:40:43.636036+0000","last_fullsized":"2024-04-26T23:40:43.636036+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:42:13.754586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.637704+0000","last_change":"2024-04-26T23:40:32.587921+0000","last_active":"2024-04-26T23:40:43.637704+0000","last_peered":"2024-04-26T23:40:43.637704+0000","last_clean":"2024-04-26T23:40:43.637704+0000","last_became_active":"2024-04-26T23:40:32.587630+0000","last_became_peered":"2024-04-26T23:40:32.587630+0000","last_unstale":"2024-04-26T23:40:43.637704+0000","last_undegraded":"2024-04-26T23:40:43.637704+0000","last_fullsized":"2024-04-26T23:40:43.637704+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:01:02.741964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.637255+0000","last_change":"2024-04-26T23:40:41.690235+0000","last_active":"2024-04-26T23:40:43.637255+0000","last_peered":"2024-04-26T23:40:43.637255+0000","last_clean":"2024-04-26T23:40:43.637255+0000","last_became_active":"2024-04-26T23:40:41.689911+0000","last_became_peered":"2024-04-26T23:40:41.689911+0000","last_unstale":"2024-04-26T23:40:43.637255+0000","last_undegraded":"2024-04-26T23:40:43.637255+0000","last_fullsized":"2024-04-26T23:40:43.637255+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:21:56.950703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636863+0000","last_change":"2024-04-26T23:40:32.583376+0000","last_active":"2024-04-26T23:40:43.636863+0000","last_peered":"2024-04-26T23:40:43.636863+0000","last_clean":"2024-04-26T23:40:43.636863+0000","last_became_active":"2024-04-26T23:40:32.583089+0000","last_became_peered":"2024-04-26T23:40:32.583089+0000","last_unstale":"2024-04-26T23:40:43.636863+0000","last_undegraded":"2024-04-26T23:40:43.636863+0000","last_fullsized":"2024-04-26T23:40:43.636863+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:17:46.135806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.635479+0000","last_change":"2024-04-26T23:40:41.688464+0000","last_active":"2024-04-26T23:40:43.635479+0000","last_peered":"2024-04-26T23:40:43.635479+0000","last_clean":"2024-04-26T23:40:43.635479+0000","last_became_active":"2024-04-26T23:40:41.688028+0000","last_became_peered":"2024-04-26T23:40:41.688028+0000","last_unstale":"2024-04-26T23:40:43.635479+0000","last_undegraded":"2024-04-26T23:40:43.635479+0000","last_fullsized":"2024-04-26T23:40:43.635479+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:21:56.950703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.684171+0000","last_change":"2024-04-26T23:40:32.589080+0000","last_active":"2024-04-26T23:40:42.684171+0000","last_peered":"2024-04-26T23:40:42.684171+0000","last_clean":"2024-04-26T23:40:42.684171+0000","last_became_active":"2024-04-26T23:40:32.588793+0000","last_became_peered":"2024-04-26T23:40:32.588793+0000","last_unstale":"2024-04-26T23:40:42.684171+0000","last_undegraded":"2024-04-26T23:40:42.684171+0000","last_fullsized":"2024-04-26T23:40:42.684171+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:18:09.706875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.684432+0000","last_change":"2024-04-26T23:40:41.688445+0000","last_active":"2024-04-26T23:40:42.684432+0000","last_peered":"2024-04-26T23:40:42.684432+0000","last_clean":"2024-04-26T23:40:42.684432+0000","last_became_active":"2024-04-26T23:40:41.688163+0000","last_became_peered":"2024-04-26T23:40:41.688163+0000","last_unstale":"2024-04-26T23:40:42.684432+0000","last_undegraded":"2024-04-26T23:40:42.684432+0000","last_fullsized":"2024-04-26T23:40:42.684432+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:30:04.999018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.637912+0000","last_change":"2024-04-26T23:40:32.588177+0000","last_active":"2024-04-26T23:40:43.637912+0000","last_peered":"2024-04-26T23:40:43.637912+0000","last_clean":"2024-04-26T23:40:43.637912+0000","last_became_active":"2024-04-26T23:40:32.586926+0000","last_became_peered":"2024-04-26T23:40:32.586926+0000","last_unstale":"2024-04-26T23:40:43.637912+0000","last_undegraded":"2024-04-26T23:40:43.637912+0000","last_fullsized":"2024-04-26T23:40:43.637912+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:34:14.811917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.637801+0000","last_change":"2024-04-26T23:40:41.688396+0000","last_active":"2024-04-26T23:40:43.637801+0000","last_peered":"2024-04-26T23:40:43.637801+0000","last_clean":"2024-04-26T23:40:43.637801+0000","last_became_active":"2024-04-26T23:40:41.688087+0000","last_became_peered":"2024-04-26T23:40:41.688087+0000","last_unstale":"2024-04-26T23:40:43.637801+0000","last_undegraded":"2024-04-26T23:40:43.637801+0000","last_fullsized":"2024-04-26T23:40:43.637801+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:00:49.397610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.685486+0000","last_change":"2024-04-26T23:40:32.582959+0000","last_active":"2024-04-26T23:40:42.685486+0000","last_peered":"2024-04-26T23:40:42.685486+0000","last_clean":"2024-04-26T23:40:42.685486+0000","last_became_active":"2024-04-26T23:40:32.582100+0000","last_became_peered":"2024-04-26T23:40:32.582100+0000","last_unstale":"2024-04-26T23:40:42.685486+0000","last_undegraded":"2024-04-26T23:40:42.685486+0000","last_fullsized":"2024-04-26T23:40:42.685486+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:37:30.361795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636150+0000","last_change":"2024-04-26T23:40:41.681088+0000","last_active":"2024-04-26T23:40:43.636150+0000","last_peered":"2024-04-26T23:40:43.636150+0000","last_clean":"2024-04-26T23:40:43.636150+0000","last_became_active":"2024-04-26T23:40:41.680581+0000","last_became_peered":"2024-04-26T23:40:41.680581+0000","last_unstale":"2024-04-26T23:40:43.636150+0000","last_undegraded":"2024-04-26T23:40:43.636150+0000","last_fullsized":"2024-04-26T23:40:43.636150+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:41:52.386084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636996+0000","last_change":"2024-04-26T23:40:32.593958+0000","last_active":"2024-04-26T23:40:43.636996+0000","last_peered":"2024-04-26T23:40:43.636996+0000","last_clean":"2024-04-26T23:40:43.636996+0000","last_became_active":"2024-04-26T23:40:32.593639+0000","last_became_peered":"2024-04-26T23:40:32.593639+0000","last_unstale":"2024-04-26T23:40:43.636996+0000","last_undegraded":"2024-04-26T23:40:43.636996+0000","last_fullsized":"2024-04-26T23:40:43.636996+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:17:46.135806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.635826+0000","last_change":"2024-04-26T23:40:41.674573+0000","last_active":"2024-04-26T23:40:43.635826+0000","last_peered":"2024-04-26T23:40:43.635826+0000","last_clean":"2024-04-26T23:40:43.635826+0000","last_became_active":"2024-04-26T23:40:41.674274+0000","last_became_peered":"2024-04-26T23:40:41.674274+0000","last_unstale":"2024-04-26T23:40:43.635826+0000","last_undegraded":"2024-04-26T23:40:43.635826+0000","last_fullsized":"2024-04-26T23:40:43.635826+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:37:39.460955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.684563+0000","last_change":"2024-04-26T23:40:32.591700+0000","last_active":"2024-04-26T23:40:42.684563+0000","last_peered":"2024-04-26T23:40:42.684563+0000","last_clean":"2024-04-26T23:40:42.684563+0000","last_became_active":"2024-04-26T23:40:32.591366+0000","last_became_peered":"2024-04-26T23:40:32.591366+0000","last_unstale":"2024-04-26T23:40:42.684563+0000","last_undegraded":"2024-04-26T23:40:42.684563+0000","last_fullsized":"2024-04-26T23:40:42.684563+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:10:02.629199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.637569+0000","last_change":"2024-04-26T23:40:41.692402+0000","last_active":"2024-04-26T23:40:43.637569+0000","last_peered":"2024-04-26T23:40:43.637569+0000","last_clean":"2024-04-26T23:40:43.637569+0000","last_became_active":"2024-04-26T23:40:41.692122+0000","last_became_peered":"2024-04-26T23:40:41.692122+0000","last_unstale":"2024-04-26T23:40:43.637569+0000","last_undegraded":"2024-04-26T23:40:43.637569+0000","last_fullsized":"2024-04-26T23:40:43.637569+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:06:12.755431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.686711+0000","last_change":"2024-04-26T23:40:32.590443+0000","last_active":"2024-04-26T23:40:42.686711+0000","last_peered":"2024-04-26T23:40:42.686711+0000","last_clean":"2024-04-26T23:40:42.686711+0000","last_became_active":"2024-04-26T23:40:32.590193+0000","last_became_peered":"2024-04-26T23:40:32.590193+0000","last_unstale":"2024-04-26T23:40:42.686711+0000","last_undegraded":"2024-04-26T23:40:42.686711+0000","last_fullsized":"2024-04-26T23:40:42.686711+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:14:04.372681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636077+0000","last_change":"2024-04-26T23:40:41.692194+0000","last_active":"2024-04-26T23:40:43.636077+0000","last_peered":"2024-04-26T23:40:43.636077+0000","last_clean":"2024-04-26T23:40:43.636077+0000","last_became_active":"2024-04-26T23:40:41.691837+0000","last_became_peered":"2024-04-26T23:40:41.691837+0000","last_unstale":"2024-04-26T23:40:43.636077+0000","last_undegraded":"2024-04-26T23:40:43.636077+0000","last_fullsized":"2024-04-26T23:40:43.636077+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:58:45.972045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.683546+0000","last_change":"2024-04-26T23:40:32.590538+0000","last_active":"2024-04-26T23:40:42.683546+0000","last_peered":"2024-04-26T23:40:42.683546+0000","last_clean":"2024-04-26T23:40:42.683546+0000","last_became_active":"2024-04-26T23:40:32.590241+0000","last_became_peered":"2024-04-26T23:40:32.590241+0000","last_unstale":"2024-04-26T23:40:42.683546+0000","last_undegraded":"2024-04-26T23:40:42.683546+0000","last_fullsized":"2024-04-26T23:40:42.683546+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:38:10.884592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636930+0000","last_change":"2024-04-26T23:40:41.689529+0000","last_active":"2024-04-26T23:40:43.636930+0000","last_peered":"2024-04-26T23:40:43.636930+0000","last_clean":"2024-04-26T23:40:43.636930+0000","last_became_active":"2024-04-26T23:40:41.689215+0000","last_became_peered":"2024-04-26T23:40:41.689215+0000","last_unstale":"2024-04-26T23:40:43.636930+0000","last_undegraded":"2024-04-26T23:40:43.636930+0000","last_fullsized":"2024-04-26T23:40:43.636930+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:38:42.155257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.637293+0000","last_change":"2024-04-26T23:40:32.588445+0000","last_active":"2024-04-26T23:40:43.637293+0000","last_peered":"2024-04-26T23:40:43.637293+0000","last_clean":"2024-04-26T23:40:43.637293+0000","last_became_active":"2024-04-26T23:40:32.588063+0000","last_became_peered":"2024-04-26T23:40:32.588063+0000","last_unstale":"2024-04-26T23:40:43.637293+0000","last_undegraded":"2024-04-26T23:40:43.637293+0000","last_fullsized":"2024-04-26T23:40:43.637293+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:44:58.977344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.684980+0000","last_change":"2024-04-26T23:40:41.674893+0000","last_active":"2024-04-26T23:40:42.684980+0000","last_peered":"2024-04-26T23:40:42.684980+0000","last_clean":"2024-04-26T23:40:42.684980+0000","last_became_active":"2024-04-26T23:40:41.674573+0000","last_became_peered":"2024-04-26T23:40:41.674573+0000","last_unstale":"2024-04-26T23:40:42.684980+0000","last_undegraded":"2024-04-26T23:40:42.684980+0000","last_fullsized":"2024-04-26T23:40:42.684980+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:36:21.487122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636258+0000","last_change":"2024-04-26T23:40:32.574795+0000","last_active":"2024-04-26T23:40:43.636258+0000","last_peered":"2024-04-26T23:40:43.636258+0000","last_clean":"2024-04-26T23:40:43.636258+0000","last_became_active":"2024-04-26T23:40:32.574503+0000","last_became_peered":"2024-04-26T23:40:32.574503+0000","last_unstale":"2024-04-26T23:40:43.636258+0000","last_undegraded":"2024-04-26T23:40:43.636258+0000","last_fullsized":"2024-04-26T23:40:43.636258+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:30:11.401955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.686330+0000","last_change":"2024-04-26T23:40:41.680247+0000","last_active":"2024-04-26T23:40:42.686330+0000","last_peered":"2024-04-26T23:40:42.686330+0000","last_clean":"2024-04-26T23:40:42.686330+0000","last_became_active":"2024-04-26T23:40:41.679920+0000","last_became_peered":"2024-04-26T23:40:41.679920+0000","last_unstale":"2024-04-26T23:40:42.686330+0000","last_undegraded":"2024-04-26T23:40:42.686330+0000","last_fullsized":"2024-04-26T23:40:42.686330+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:53:13.531466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.685801+0000","last_change":"2024-04-26T23:40:32.593432+0000","last_active":"2024-04-26T23:40:42.685801+0000","last_peered":"2024-04-26T23:40:42.685801+0000","last_clean":"2024-04-26T23:40:42.685801+0000","last_became_active":"2024-04-26T23:40:32.593169+0000","last_became_peered":"2024-04-26T23:40:32.593169+0000","last_unstale":"2024-04-26T23:40:42.685801+0000","last_undegraded":"2024-04-26T23:40:42.685801+0000","last_fullsized":"2024-04-26T23:40:42.685801+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:44:42.494850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.635935+0000","last_change":"2024-04-26T23:40:41.694551+0000","last_active":"2024-04-26T23:40:43.635935+0000","last_peered":"2024-04-26T23:40:43.635935+0000","last_clean":"2024-04-26T23:40:43.635935+0000","last_became_active":"2024-04-26T23:40:41.694297+0000","last_became_peered":"2024-04-26T23:40:41.694297+0000","last_unstale":"2024-04-26T23:40:43.635935+0000","last_undegraded":"2024-04-26T23:40:43.635935+0000","last_fullsized":"2024-04-26T23:40:43.635935+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:02:27.160408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.685388+0000","last_change":"2024-04-26T23:40:32.585137+0000","last_active":"2024-04-26T23:40:42.685388+0000","last_peered":"2024-04-26T23:40:42.685388+0000","last_clean":"2024-04-26T23:40:42.685388+0000","last_became_active":"2024-04-26T23:40:32.584678+0000","last_became_peered":"2024-04-26T23:40:32.584678+0000","last_unstale":"2024-04-26T23:40:42.685388+0000","last_undegraded":"2024-04-26T23:40:42.685388+0000","last_fullsized":"2024-04-26T23:40:42.685388+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:04:30.553552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636071+0000","last_change":"2024-04-26T23:40:41.692433+0000","last_active":"2024-04-26T23:40:43.636071+0000","last_peered":"2024-04-26T23:40:43.636071+0000","last_clean":"2024-04-26T23:40:43.636071+0000","last_became_active":"2024-04-26T23:40:41.692090+0000","last_became_peered":"2024-04-26T23:40:41.692090+0000","last_unstale":"2024-04-26T23:40:43.636071+0000","last_undegraded":"2024-04-26T23:40:43.636071+0000","last_fullsized":"2024-04-26T23:40:43.636071+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:37:25.006229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.635522+0000","last_change":"2024-04-26T23:40:32.590452+0000","last_active":"2024-04-26T23:40:43.635522+0000","last_peered":"2024-04-26T23:40:43.635522+0000","last_clean":"2024-04-26T23:40:43.635522+0000","last_became_active":"2024-04-26T23:40:32.590162+0000","last_became_peered":"2024-04-26T23:40:32.590162+0000","last_unstale":"2024-04-26T23:40:43.635522+0000","last_undegraded":"2024-04-26T23:40:43.635522+0000","last_fullsized":"2024-04-26T23:40:43.635522+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:51:30.677247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.685014+0000","last_change":"2024-04-26T23:40:41.687270+0000","last_active":"2024-04-26T23:40:42.685014+0000","last_peered":"2024-04-26T23:40:42.685014+0000","last_clean":"2024-04-26T23:40:42.685014+0000","last_became_active":"2024-04-26T23:40:41.686999+0000","last_became_peered":"2024-04-26T23:40:41.686999+0000","last_unstale":"2024-04-26T23:40:42.685014+0000","last_undegraded":"2024-04-26T23:40:42.685014+0000","last_fullsized":"2024-04-26T23:40:42.685014+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:21:42.565349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.686378+0000","last_change":"2024-04-26T23:40:32.586436+0000","last_active":"2024-04-26T23:40:42.686378+0000","last_peered":"2024-04-26T23:40:42.686378+0000","last_clean":"2024-04-26T23:40:42.686378+0000","last_became_active":"2024-04-26T23:40:32.585995+0000","last_became_peered":"2024-04-26T23:40:32.585995+0000","last_unstale":"2024-04-26T23:40:42.686378+0000","last_undegraded":"2024-04-26T23:40:42.686378+0000","last_fullsized":"2024-04-26T23:40:42.686378+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:10:42.603833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.637180+0000","last_change":"2024-04-26T23:40:41.691693+0000","last_active":"2024-04-26T23:40:43.637180+0000","last_peered":"2024-04-26T23:40:43.637180+0000","last_clean":"2024-04-26T23:40:43.637180+0000","last_became_active":"2024-04-26T23:40:41.691437+0000","last_became_peered":"2024-04-26T23:40:41.691437+0000","last_unstale":"2024-04-26T23:40:43.637180+0000","last_undegraded":"2024-04-26T23:40:43.637180+0000","last_fullsized":"2024-04-26T23:40:43.637180+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:06:12.755431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.637343+0000","last_change":"2024-04-26T23:40:32.592988+0000","last_active":"2024-04-26T23:40:43.637343+0000","last_peered":"2024-04-26T23:40:43.637343+0000","last_clean":"2024-04-26T23:40:43.637343+0000","last_became_active":"2024-04-26T23:40:32.592717+0000","last_became_peered":"2024-04-26T23:40:32.592717+0000","last_unstale":"2024-04-26T23:40:43.637343+0000","last_undegraded":"2024-04-26T23:40:43.637343+0000","last_fullsized":"2024-04-26T23:40:43.637343+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:18:09.706875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.637029+0000","last_change":"2024-04-26T23:40:41.675335+0000","last_active":"2024-04-26T23:40:43.637029+0000","last_peered":"2024-04-26T23:40:43.637029+0000","last_clean":"2024-04-26T23:40:43.637029+0000","last_became_active":"2024-04-26T23:40:41.675042+0000","last_became_peered":"2024-04-26T23:40:41.675042+0000","last_unstale":"2024-04-26T23:40:43.637029+0000","last_undegraded":"2024-04-26T23:40:43.637029+0000","last_fullsized":"2024-04-26T23:40:43.637029+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:41:52.386084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636813+0000","last_change":"2024-04-26T23:40:32.595129+0000","last_active":"2024-04-26T23:40:43.636813+0000","last_peered":"2024-04-26T23:40:43.636813+0000","last_clean":"2024-04-26T23:40:43.636813+0000","last_became_active":"2024-04-26T23:40:32.594802+0000","last_became_peered":"2024-04-26T23:40:32.594802+0000","last_unstale":"2024-04-26T23:40:43.636813+0000","last_undegraded":"2024-04-26T23:40:43.636813+0000","last_fullsized":"2024-04-26T23:40:43.636813+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:48:33.020039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636362+0000","last_change":"2024-04-26T23:40:41.691159+0000","last_active":"2024-04-26T23:40:43.636362+0000","last_peered":"2024-04-26T23:40:43.636362+0000","last_clean":"2024-04-26T23:40:43.636362+0000","last_became_active":"2024-04-26T23:40:41.690846+0000","last_became_peered":"2024-04-26T23:40:41.690846+0000","last_unstale":"2024-04-26T23:40:43.636362+0000","last_undegraded":"2024-04-26T23:40:43.636362+0000","last_fullsized":"2024-04-26T23:40:43.636362+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:45:08.076505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.683726+0000","last_change":"2024-04-26T23:40:32.578819+0000","last_active":"2024-04-26T23:40:42.683726+0000","last_peered":"2024-04-26T23:40:42.683726+0000","last_clean":"2024-04-26T23:40:42.683726+0000","last_became_active":"2024-04-26T23:40:32.578556+0000","last_became_peered":"2024-04-26T23:40:32.578556+0000","last_unstale":"2024-04-26T23:40:42.683726+0000","last_undegraded":"2024-04-26T23:40:42.683726+0000","last_fullsized":"2024-04-26T23:40:42.683726+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:17:46.135806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.635820+0000","last_change":"2024-04-26T23:40:41.689812+0000","last_active":"2024-04-26T23:40:43.635820+0000","last_peered":"2024-04-26T23:40:43.635820+0000","last_clean":"2024-04-26T23:40:43.635820+0000","last_became_active":"2024-04-26T23:40:41.689267+0000","last_became_peered":"2024-04-26T23:40:41.689267+0000","last_unstale":"2024-04-26T23:40:43.635820+0000","last_undegraded":"2024-04-26T23:40:43.635820+0000","last_fullsized":"2024-04-26T23:40:43.635820+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:21:42.565349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.684116+0000","last_change":"2024-04-26T23:40:32.578155+0000","last_active":"2024-04-26T23:40:42.684116+0000","last_peered":"2024-04-26T23:40:42.684116+0000","last_clean":"2024-04-26T23:40:42.684116+0000","last_became_active":"2024-04-26T23:40:32.577865+0000","last_became_peered":"2024-04-26T23:40:32.577865+0000","last_unstale":"2024-04-26T23:40:42.684116+0000","last_undegraded":"2024-04-26T23:40:42.684116+0000","last_fullsized":"2024-04-26T23:40:42.684116+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:40:17.167353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.685252+0000","last_change":"2024-04-26T23:40:41.680962+0000","last_active":"2024-04-26T23:40:42.685252+0000","last_peered":"2024-04-26T23:40:42.685252+0000","last_clean":"2024-04-26T23:40:42.685252+0000","last_became_active":"2024-04-26T23:40:41.680676+0000","last_became_peered":"2024-04-26T23:40:41.680676+0000","last_unstale":"2024-04-26T23:40:42.685252+0000","last_undegraded":"2024-04-26T23:40:42.685252+0000","last_fullsized":"2024-04-26T23:40:42.685252+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:42:13.754586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636455+0000","last_change":"2024-04-26T23:40:32.591487+0000","last_active":"2024-04-26T23:40:43.636455+0000","last_peered":"2024-04-26T23:40:43.636455+0000","last_clean":"2024-04-26T23:40:43.636455+0000","last_became_active":"2024-04-26T23:40:32.591209+0000","last_became_peered":"2024-04-26T23:40:32.591209+0000","last_unstale":"2024-04-26T23:40:43.636455+0000","last_undegraded":"2024-04-26T23:40:43.636455+0000","last_fullsized":"2024-04-26T23:40:43.636455+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:52:26.699790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.637724+0000","last_change":"2024-04-26T23:40:41.686089+0000","last_active":"2024-04-26T23:40:43.637724+0000","last_peered":"2024-04-26T23:40:43.637724+0000","last_clean":"2024-04-26T23:40:43.637724+0000","last_became_active":"2024-04-26T23:40:41.685786+0000","last_became_peered":"2024-04-26T23:40:41.685786+0000","last_unstale":"2024-04-26T23:40:43.637724+0000","last_undegraded":"2024-04-26T23:40:43.637724+0000","last_fullsized":"2024-04-26T23:40:43.637724+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:36:02.931532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636676+0000","last_change":"2024-04-26T23:40:32.592543+0000","last_active":"2024-04-26T23:40:43.636676+0000","last_peered":"2024-04-26T23:40:43.636676+0000","last_clean":"2024-04-26T23:40:43.636676+0000","last_became_active":"2024-04-26T23:40:32.592282+0000","last_became_peered":"2024-04-26T23:40:32.592282+0000","last_unstale":"2024-04-26T23:40:43.636676+0000","last_undegraded":"2024-04-26T23:40:43.636676+0000","last_fullsized":"2024-04-26T23:40:43.636676+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:16:46.547536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3f","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.684024+0000","last_change":"2024-04-26T23:40:41.679306+0000","last_active":"2024-04-26T23:40:42.684024+0000","last_peered":"2024-04-26T23:40:42.684024+0000","last_clean":"2024-04-26T23:40:42.684024+0000","last_became_active":"2024-04-26T23:40:41.678926+0000","last_became_peered":"2024-04-26T23:40:41.678926+0000","last_unstale":"2024-04-26T23:40:42.684024+0000","last_undegraded":"2024-04-26T23:40:42.684024+0000","last_fullsized":"2024-04-26T23:40:42.684024+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:27:48.823509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.637039+0000","last_change":"2024-04-26T23:40:32.587562+0000","last_active":"2024-04-26T23:40:43.637039+0000","last_peered":"2024-04-26T23:40:43.637039+0000","last_clean":"2024-04-26T23:40:43.637039+0000","last_became_active":"2024-04-26T23:40:32.587249+0000","last_became_peered":"2024-04-26T23:40:32.587249+0000","last_unstale":"2024-04-26T23:40:43.637039+0000","last_undegraded":"2024-04-26T23:40:43.637039+0000","last_fullsized":"2024-04-26T23:40:43.637039+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:12:45.093169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.635956+0000","last_change":"2024-04-26T23:40:41.689567+0000","last_active":"2024-04-26T23:40:43.635956+0000","last_peered":"2024-04-26T23:40:43.635956+0000","last_clean":"2024-04-26T23:40:43.635956+0000","last_became_active":"2024-04-26T23:40:41.688585+0000","last_became_peered":"2024-04-26T23:40:41.688585+0000","last_unstale":"2024-04-26T23:40:43.635956+0000","last_undegraded":"2024-04-26T23:40:43.635956+0000","last_fullsized":"2024-04-26T23:40:43.635956+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:10:57.826183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.684566+0000","last_change":"2024-04-26T23:40:32.584619+0000","last_active":"2024-04-26T23:40:42.684566+0000","last_peered":"2024-04-26T23:40:42.684566+0000","last_clean":"2024-04-26T23:40:42.684566+0000","last_became_active":"2024-04-26T23:40:32.584293+0000","last_became_peered":"2024-04-26T23:40:32.584293+0000","last_unstale":"2024-04-26T23:40:42.684566+0000","last_undegraded":"2024-04-26T23:40:42.684566+0000","last_fullsized":"2024-04-26T23:40:42.684566+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:40:17.167353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.685557+0000","last_change":"2024-04-26T23:40:41.691614+0000","last_active":"2024-04-26T23:40:42.685557+0000","last_peered":"2024-04-26T23:40:42.685557+0000","last_clean":"2024-04-26T23:40:42.685557+0000","last_became_active":"2024-04-26T23:40:41.691081+0000","last_became_peered":"2024-04-26T23:40:41.691081+0000","last_unstale":"2024-04-26T23:40:42.685557+0000","last_undegraded":"2024-04-26T23:40:42.685557+0000","last_fullsized":"2024-04-26T23:40:42.685557+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:24:07.784468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636557+0000","last_change":"2024-04-26T23:40:32.588894+0000","last_active":"2024-04-26T23:40:43.636557+0000","last_peered":"2024-04-26T23:40:43.636557+0000","last_clean":"2024-04-26T23:40:43.636557+0000","last_became_active":"2024-04-26T23:40:32.588409+0000","last_became_peered":"2024-04-26T23:40:32.588409+0000","last_unstale":"2024-04-26T23:40:43.636557+0000","last_undegraded":"2024-04-26T23:40:43.636557+0000","last_fullsized":"2024-04-26T23:40:43.636557+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:35:08.194865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636899+0000","last_change":"2024-04-26T23:40:41.678639+0000","last_active":"2024-04-26T23:40:43.636899+0000","last_peered":"2024-04-26T23:40:43.636899+0000","last_clean":"2024-04-26T23:40:43.636899+0000","last_became_active":"2024-04-26T23:40:41.678333+0000","last_became_peered":"2024-04-26T23:40:41.678333+0000","last_unstale":"2024-04-26T23:40:43.636899+0000","last_undegraded":"2024-04-26T23:40:43.636899+0000","last_fullsized":"2024-04-26T23:40:43.636899+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:42:13.754586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.685161+0000","last_change":"2024-04-26T23:40:32.581875+0000","last_active":"2024-04-26T23:40:42.685161+0000","last_peered":"2024-04-26T23:40:42.685161+0000","last_clean":"2024-04-26T23:40:42.685161+0000","last_became_active":"2024-04-26T23:40:32.580987+0000","last_became_peered":"2024-04-26T23:40:32.580987+0000","last_unstale":"2024-04-26T23:40:42.685161+0000","last_undegraded":"2024-04-26T23:40:42.685161+0000","last_fullsized":"2024-04-26T23:40:42.685161+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:12:45.093169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636219+0000","last_change":"2024-04-26T23:40:41.678366+0000","last_active":"2024-04-26T23:40:43.636219+0000","last_peered":"2024-04-26T23:40:43.636219+0000","last_clean":"2024-04-26T23:40:43.636219+0000","last_became_active":"2024-04-26T23:40:41.678067+0000","last_became_peered":"2024-04-26T23:40:41.678067+0000","last_unstale":"2024-04-26T23:40:43.636219+0000","last_undegraded":"2024-04-26T23:40:43.636219+0000","last_fullsized":"2024-04-26T23:40:43.636219+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:44:51.594010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.686634+0000","last_change":"2024-04-26T23:40:32.579870+0000","last_active":"2024-04-26T23:40:42.686634+0000","last_peered":"2024-04-26T23:40:42.686634+0000","last_clean":"2024-04-26T23:40:42.686634+0000","last_became_active":"2024-04-26T23:40:32.579569+0000","last_became_peered":"2024-04-26T23:40:32.579569+0000","last_unstale":"2024-04-26T23:40:42.686634+0000","last_undegraded":"2024-04-26T23:40:42.686634+0000","last_fullsized":"2024-04-26T23:40:42.686634+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:25:30.040358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.635430+0000","last_change":"2024-04-26T23:40:41.684020+0000","last_active":"2024-04-26T23:40:43.635430+0000","last_peered":"2024-04-26T23:40:43.635430+0000","last_clean":"2024-04-26T23:40:43.635430+0000","last_became_active":"2024-04-26T23:40:41.683734+0000","last_became_peered":"2024-04-26T23:40:41.683734+0000","last_unstale":"2024-04-26T23:40:43.635430+0000","last_undegraded":"2024-04-26T23:40:43.635430+0000","last_fullsized":"2024-04-26T23:40:43.635430+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:38:42.155257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636264+0000","last_change":"2024-04-26T23:40:32.583944+0000","last_active":"2024-04-26T23:40:43.636264+0000","last_peered":"2024-04-26T23:40:43.636264+0000","last_clean":"2024-04-26T23:40:43.636264+0000","last_became_active":"2024-04-26T23:40:32.583655+0000","last_became_peered":"2024-04-26T23:40:32.583655+0000","last_unstale":"2024-04-26T23:40:43.636264+0000","last_undegraded":"2024-04-26T23:40:43.636264+0000","last_fullsized":"2024-04-26T23:40:43.636264+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:40:17.167353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.635858+0000","last_change":"2024-04-26T23:40:41.681412+0000","last_active":"2024-04-26T23:40:43.635858+0000","last_peered":"2024-04-26T23:40:43.635858+0000","last_clean":"2024-04-26T23:40:43.635858+0000","last_became_active":"2024-04-26T23:40:41.681092+0000","last_became_peered":"2024-04-26T23:40:41.681092+0000","last_unstale":"2024-04-26T23:40:43.635858+0000","last_undegraded":"2024-04-26T23:40:43.635858+0000","last_fullsized":"2024-04-26T23:40:43.635858+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:48:09.126894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636358+0000","last_change":"2024-04-26T23:40:32.596351+0000","last_active":"2024-04-26T23:40:43.636358+0000","last_peered":"2024-04-26T23:40:43.636358+0000","last_clean":"2024-04-26T23:40:43.636358+0000","last_became_active":"2024-04-26T23:40:32.596050+0000","last_became_peered":"2024-04-26T23:40:32.596050+0000","last_unstale":"2024-04-26T23:40:43.636358+0000","last_undegraded":"2024-04-26T23:40:43.636358+0000","last_fullsized":"2024-04-26T23:40:43.636358+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:34:14.811917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27848,"kb_used_data":824,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343992,"statfs":{"total":96636764160,"available":96608247808,"internally_reserved":0,"allocated":843776,"data_stored":683194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574856,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":274432,"data_stored":101489,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574856,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":266240,"data_stored":100023,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574857,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":262144,"data_stored":92384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":270336,"data_stored":95400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":245760,"data_stored":92224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":278528,"data_stored":101055,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574857,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27864,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343976,"statfs":{"total":96636764160,"available":96608231424,"internally_reserved":0,"allocated":860160,"data_stored":690267,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T23:40:46.010 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-26T23:40:46.010 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-04-26T23:40:46.010 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-04-26T23:40:46.010 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-04-26T23:40:46.011 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-04-26T23:40:46.140 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.136+0000 7f64b575f640 1 Processor -- start 2024-04-26T23:40:46.140 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.136+0000 7f64b575f640 1 -- start start 2024-04-26T23:40:46.143 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.137+0000 7f64b575f640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f64b0154160 0x7f64b0156bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:46.143 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.137+0000 7f64b575f640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f64b00ca5a0 0x7f64b015a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:46.143 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.137+0000 7f64b575f640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f64b00c8df0 con 0x7f64b00c6e00 2024-04-26T23:40:46.143 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.137+0000 7f64b575f640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f64b015a6e0 con 0x7f64b0154160 2024-04-26T23:40:46.143 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.137+0000 7f64b575f640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f64b00c9100 con 0x7f64b00ca5a0 2024-04-26T23:40:46.143 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.137+0000 7f64aeffd640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f64b0154160 0x7f64b0156bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:46.143 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.137+0000 7f64af7fe640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f64b00c6e00 0x7f64b00c9590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:39488/0 (socket says 172.21.15.88:39488) 2024-04-26T23:40:46.143 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.137+0000 7f64af7fe640 1 -- 172.21.15.88:0/904214165 learned_addr learned my addr 172.21.15.88:0/904214165 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-26T23:40:46.143 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.137+0000 7f64ae7fc640 1 --2- 172.21.15.88:0/904214165 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f64b00ca5a0 0x7f64b015a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:46.144 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.137+0000 7f64aeffd640 1 -- 172.21.15.88:0/904214165 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f64b00ca5a0 msgr2=0x7f64b015a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:40:46.144 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.137+0000 7f64aeffd640 1 --2- 172.21.15.88:0/904214165 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f64b00ca5a0 0x7f64b015a1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:46.144 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.137+0000 7f64aeffd640 1 -- 172.21.15.88:0/904214165 >> v1:172.21.15.88:6789/0 conn(0x7f64b00c6e00 legacy=0x7f64b00c9590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:46.144 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.137+0000 7f64adffb640 1 -- 172.21.15.88:0/904214165 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3391902252 0 0) 0x7f64a8001110 con 0x7f64b00c6e00 2024-04-26T23:40:46.144 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.137+0000 7f64aeffd640 1 -- 172.21.15.88:0/904214165 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64b0154540 con 0x7f64b0154160 2024-04-26T23:40:46.144 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.138+0000 7f64aeffd640 1 --2- 172.21.15.88:0/904214165 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f64b0154160 0x7f64b0156bb0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f64a0009d90 tx=0x7f64a002a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcc20f40dde97a99 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:46.144 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.138+0000 7f64adffb640 1 -- 172.21.15.88:0/904214165 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64a0007740 con 0x7f64b0154160 2024-04-26T23:40:46.144 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.138+0000 7f64adffb640 1 -- 172.21.15.88:0/904214165 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64a00078e0 con 0x7f64b0154160 2024-04-26T23:40:46.144 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.138+0000 7f64adffb640 1 -- 172.21.15.88:0/904214165 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64a0007cb0 con 0x7f64b0154160 2024-04-26T23:40:46.144 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.138+0000 7f64b575f640 1 -- 172.21.15.88:0/904214165 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f64b0154160 msgr2=0x7f64b0156bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:46.144 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.138+0000 7f64b575f640 1 --2- 172.21.15.88:0/904214165 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f64b0154160 0x7f64b0156bb0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f64a0009d90 tx=0x7f64a002a660 comp rx=0 tx=0).stop 2024-04-26T23:40:46.144 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.138+0000 7f64b575f640 1 -- 172.21.15.88:0/904214165 shutdown_connections 2024-04-26T23:40:46.145 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.138+0000 7f64b575f640 1 --2- 172.21.15.88:0/904214165 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f64b00ca5a0 0x7f64b015a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:46.145 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.138+0000 7f64b575f640 1 --2- 172.21.15.88:0/904214165 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f64b0154160 0x7f64b0156bb0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:46.145 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.138+0000 7f64b575f640 1 -- 172.21.15.88:0/904214165 >> 172.21.15.88:0/904214165 conn(0x7f64b00ae010 msgr2=0x7f64b00ae3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:40:46.145 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.138+0000 7f64b575f640 1 -- 172.21.15.88:0/904214165 shutdown_connections 2024-04-26T23:40:46.145 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.138+0000 7f64b575f640 1 -- 172.21.15.88:0/904214165 wait complete. 2024-04-26T23:40:46.148 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.140+0000 7f64b575f640 1 Processor -- start 2024-04-26T23:40:46.148 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.140+0000 7f64b575f640 1 -- start start 2024-04-26T23:40:46.148 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.140+0000 7f64b575f640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f64b00c6e00 0x7f64b014af40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:46.149 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.140+0000 7f64b575f640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f64b00ca5a0 0x7f64b014c050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:46.149 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.140+0000 7f64b575f640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f64b0154160 0x7f64b0158e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:46.149 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.140+0000 7f64b575f640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f64b015aed0 con 0x7f64b0154160 2024-04-26T23:40:46.149 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.140+0000 7f64b575f640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f64b015abf0 con 0x7f64b00c6e00 2024-04-26T23:40:46.149 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.140+0000 7f64b575f640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f64b00c9ca0 con 0x7f64b00ca5a0 2024-04-26T23:40:46.149 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.141+0000 7f64af7fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f64b0154160 0x7f64b0158e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:46.149 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.141+0000 7f64af7fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f64b0154160 0x7f64b0158e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:41958/0 (socket says 172.21.15.88:41958) 2024-04-26T23:40:46.149 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.141+0000 7f64af7fe640 1 -- 172.21.15.88:0/1551626985 learned_addr learned my addr 172.21.15.88:0/1551626985 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:40:46.149 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.141+0000 7f64ae7fc640 1 --2- 172.21.15.88:0/1551626985 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f64b00ca5a0 0x7f64b014c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:46.149 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.141+0000 7f64aeffd640 1 --2- 172.21.15.88:0/1551626985 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f64b00c6e00 0x7f64b014af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:46.149 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.141+0000 7f64af7fe640 1 -- 172.21.15.88:0/1551626985 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f64b00ca5a0 msgr2=0x7f64b014c050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:46.149 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.141+0000 7f64af7fe640 1 --2- 172.21.15.88:0/1551626985 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f64b00ca5a0 0x7f64b014c050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:46.150 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.141+0000 7f64af7fe640 1 -- 172.21.15.88:0/1551626985 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f64b00c6e00 msgr2=0x7f64b014af40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:46.150 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.141+0000 7f64af7fe640 1 --2- 172.21.15.88:0/1551626985 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f64b00c6e00 0x7f64b014af40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:46.150 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.141+0000 7f64af7fe640 1 -- 172.21.15.88:0/1551626985 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64b0152bc0 con 0x7f64b0154160 2024-04-26T23:40:46.150 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.141+0000 7f64aeffd640 1 --2- 172.21.15.88:0/1551626985 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f64b00c6e00 0x7f64b014af40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:40:46.150 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.141+0000 7f64af7fe640 1 --2- 172.21.15.88:0/1551626985 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f64b0154160 0x7f64b0158e50 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f64a800c440 tx=0x7f64a800c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:46.150 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.141+0000 7f64977fe640 1 -- 172.21.15.88:0/1551626985 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64a80074e0 con 0x7f64b0154160 2024-04-26T23:40:46.150 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.141+0000 7f64977fe640 1 -- 172.21.15.88:0/1551626985 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64a80047e0 con 0x7f64b0154160 2024-04-26T23:40:46.150 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.141+0000 7f64b575f640 1 -- 172.21.15.88:0/1551626985 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64b0152ea0 con 0x7f64b0154160 2024-04-26T23:40:46.150 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.141+0000 7f64977fe640 1 -- 172.21.15.88:0/1551626985 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64a8004bd0 con 0x7f64b0154160 2024-04-26T23:40:46.150 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.141+0000 7f64b575f640 1 -- 172.21.15.88:0/1551626985 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64b014b480 con 0x7f64b0154160 2024-04-26T23:40:46.150 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.142+0000 7f64b575f640 1 -- 172.21.15.88:0/1551626985 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f64b0076650 con 0x7f64b0154160 2024-04-26T23:40:46.150 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.143+0000 7f64977fe640 1 -- 172.21.15.88:0/1551626985 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f64a8011070 con 0x7f64b0154160 2024-04-26T23:40:46.150 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.143+0000 7f64977fe640 1 --2- 172.21.15.88:0/1551626985 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f649c06c8f0 0x7f649c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:46.151 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.143+0000 7f64977fe640 1 -- 172.21.15.88:0/1551626985 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7f64a808b960 con 0x7f64b0154160 2024-04-26T23:40:46.151 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.143+0000 7f64aeffd640 1 --2- 172.21.15.88:0/1551626985 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f649c06c8f0 0x7f649c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:46.151 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.143+0000 7f64aeffd640 1 --2- 172.21.15.88:0/1551626985 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f649c06c8f0 0x7f649c06edb0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f64a0034000 tx=0x7f64a002f000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:46.151 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.147+0000 7f64977fe640 1 -- 172.21.15.88:0/1551626985 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f64b00c8df0 con 0x7f64b0154160 2024-04-26T23:40:46.375 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.371+0000 7f64b575f640 1 -- 172.21.15.88:0/1551626985 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f64b014d940 con 0x7f64b0154160 2024-04-26T23:40:46.378 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.374+0000 7f64977fe640 1 -- 172.21.15.88:0/1551626985 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+174133 (secure 0 0 0) 0x7f64a8059a70 con 0x7f64b0154160 2024-04-26T23:40:46.380 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-26T23:40:46.382 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.377+0000 7f64b575f640 1 -- 172.21.15.88:0/1551626985 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f649c06c8f0 msgr2=0x7f649c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:46.382 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.377+0000 7f64b575f640 1 --2- 172.21.15.88:0/1551626985 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f649c06c8f0 0x7f649c06edb0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f64a0034000 tx=0x7f64a002f000 comp rx=0 tx=0).stop 2024-04-26T23:40:46.382 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.377+0000 7f64b575f640 1 -- 172.21.15.88:0/1551626985 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f64b0154160 msgr2=0x7f64b0158e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:46.382 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.377+0000 7f64b575f640 1 --2- 172.21.15.88:0/1551626985 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f64b0154160 0x7f64b0158e50 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f64a800c440 tx=0x7f64a800c900 comp rx=0 tx=0).stop 2024-04-26T23:40:46.382 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.377+0000 7f64b575f640 1 -- 172.21.15.88:0/1551626985 shutdown_connections 2024-04-26T23:40:46.382 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.377+0000 7f64b575f640 1 --2- 172.21.15.88:0/1551626985 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f649c06c8f0 0x7f649c06edb0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:46.382 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.377+0000 7f64b575f640 1 --2- 172.21.15.88:0/1551626985 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f64b00ca5a0 0x7f64b014c050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:46.382 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.377+0000 7f64b575f640 1 --2- 172.21.15.88:0/1551626985 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f64b0154160 0x7f64b0158e50 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:46.383 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.377+0000 7f64b575f640 1 --2- 172.21.15.88:0/1551626985 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f64b00c6e00 0x7f64b014af40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:46.383 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.377+0000 7f64b575f640 1 -- 172.21.15.88:0/1551626985 >> 172.21.15.88:0/1551626985 conn(0x7f64b00ae010 msgr2=0x7f64b00cc480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:40:46.383 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.377+0000 7f64b575f640 1 -- 172.21.15.88:0/1551626985 shutdown_connections 2024-04-26T23:40:46.383 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.377+0000 7f64b575f640 1 -- 172.21.15.88:0/1551626985 wait complete. 2024-04-26T23:40:46.391 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":5,"flags":0,"active_gid":4104,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6832","nonce":651674297},{"type":"v1","addr":"172.21.15.88:6833","nonce":651674297}]},"active_addr":"172.21.15.88:6833/651674297","active_change":"2024-04-26T23:40:11.914542+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4106,"name":"x","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.88:0","nonce":2422302060}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.88:0","nonce":354705751}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.88:0","nonce":3693829526}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.88:0","nonce":2027844482}]}]} 2024-04-26T23:40:46.395 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-04-26T23:40:46.395 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-04-26T23:40:46.395 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T23:40:46.491 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.487+0000 7f7cd71f0640 1 Processor -- start 2024-04-26T23:40:46.491 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.487+0000 7f7cd71f0640 1 -- start start 2024-04-26T23:40:46.497 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.488+0000 7f7cd71f0640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f7cd00c4160 0x7f7cd006d320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:46.498 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.488+0000 7f7cd71f0640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7cd006d860 0x7f7cd015e400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:46.498 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.488+0000 7f7cd71f0640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7cd00c4b50 con 0x7f7cd01510c0 2024-04-26T23:40:46.498 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.488+0000 7f7cd71f0640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f7cd00c50d0 con 0x7f7cd00c4160 2024-04-26T23:40:46.498 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.488+0000 7f7cd71f0640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f7cd01514a0 con 0x7f7cd006d860 2024-04-26T23:40:46.498 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.488+0000 7f7cd4f8c640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f7cd01510c0 0x7f7cd0072f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:39502/0 (socket says 172.21.15.88:39502) 2024-04-26T23:40:46.498 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.488+0000 7f7cd4f8c640 1 -- 172.21.15.88:0/2731865315 learned_addr learned my addr 172.21.15.88:0/2731865315 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-26T23:40:46.498 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.488+0000 7f7ccffff640 1 --2- 172.21.15.88:0/2731865315 >> v2:172.21.15.175:3300/0 conn(0x7f7cd00c4160 0x7f7cd006d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:46.498 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.488+0000 7f7cd578d640 1 --2- 172.21.15.88:0/2731865315 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7cd006d860 0x7f7cd015e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:46.498 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.488+0000 7f7ccf7fe640 1 -- 172.21.15.88:0/2731865315 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3611621254 0 0) 0x7f7cd00c4b50 con 0x7f7cd01510c0 2024-04-26T23:40:46.498 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.488+0000 7f7ccf7fe640 1 -- 172.21.15.88:0/2731865315 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7cb8003520 con 0x7f7cd01510c0 2024-04-26T23:40:46.498 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.489+0000 7f7ccf7fe640 1 -- 172.21.15.88:0/2731865315 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3511897103 0 0) 0x7f7cb8003520 con 0x7f7cd01510c0 2024-04-26T23:40:46.498 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.489+0000 7f7ccf7fe640 1 -- 172.21.15.88:0/2731865315 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7cd006d860 msgr2=0x7f7cd015e400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:40:46.498 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.489+0000 7f7ccf7fe640 1 --2- 172.21.15.88:0/2731865315 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7cd006d860 0x7f7cd015e400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:46.498 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.489+0000 7f7ccf7fe640 1 -- 172.21.15.88:0/2731865315 >> v2:172.21.15.175:3300/0 conn(0x7f7cd00c4160 msgr2=0x7f7cd006d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:40:46.499 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.489+0000 7f7ccf7fe640 1 --2- 172.21.15.88:0/2731865315 >> v2:172.21.15.175:3300/0 conn(0x7f7cd00c4160 0x7f7cd006d320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:46.499 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.489+0000 7f7ccf7fe640 1 -- 172.21.15.88:0/2731865315 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cd00736a0 con 0x7f7cd01510c0 2024-04-26T23:40:46.499 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.489+0000 7f7ccf7fe640 1 -- 172.21.15.88:0/2731865315 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 356324787 0 0) 0x7f7cc0001670 con 0x7f7cd01510c0 2024-04-26T23:40:46.499 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.489+0000 7f7ccf7fe640 1 -- 172.21.15.88:0/2731865315 >> v1:172.21.15.88:6789/0 conn(0x7f7cd01510c0 legacy=0x7f7cd0072f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:46.499 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.489+0000 7f7ccf7fe640 1 --2- 172.21.15.88:0/2731865315 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7cb80039b0 0x7f7cb8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:46.499 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.489+0000 7f7ccf7fe640 1 --2- 172.21.15.88:0/2731865315 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7cb8004800 0x7f7cb8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:46.499 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.489+0000 7f7ccf7fe640 1 --2- 172.21.15.88:0/2731865315 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7cd006d860 0x7f7cb80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:46.499 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.489+0000 7f7ccf7fe640 1 -- 172.21.15.88:0/2731865315 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f7cd00c50d0 con 0x7f7cb80039b0 2024-04-26T23:40:46.499 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.489+0000 7f7ccf7fe640 1 -- 172.21.15.88:0/2731865315 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f7cd01514a0 con 0x7f7cb8004800 2024-04-26T23:40:46.499 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.489+0000 7f7cd4f8c640 1 --2- 172.21.15.88:0/2731865315 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7cb80039b0 0x7f7cb8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:46.500 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.489+0000 7f7ccf7fe640 1 -- 172.21.15.88:0/2731865315 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f7cb800ba40 con 0x7f7cd006d860 2024-04-26T23:40:46.500 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.489+0000 7f7ccffff640 1 --2- 172.21.15.88:0/2731865315 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7cb8004800 0x7f7cb8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:46.500 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.489+0000 7f7cd578d640 1 --2- 172.21.15.88:0/2731865315 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7cd006d860 0x7f7cb80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:46.500 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.489+0000 7f7cd4f8c640 1 -- 172.21.15.88:0/2731865315 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7cd006d860 msgr2=0x7f7cb80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:40:46.500 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.489+0000 7f7cd4f8c640 1 --2- 172.21.15.88:0/2731865315 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7cd006d860 0x7f7cb80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:46.500 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.489+0000 7f7cd4f8c640 1 -- 172.21.15.88:0/2731865315 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7cb8004800 msgr2=0x7f7cb8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:40:46.500 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.489+0000 7f7cd4f8c640 1 --2- 172.21.15.88:0/2731865315 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7cb8004800 0x7f7cb8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:46.500 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.489+0000 7f7cd4f8c640 1 -- 172.21.15.88:0/2731865315 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cb8003520 con 0x7f7cb80039b0 2024-04-26T23:40:46.500 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.489+0000 7f7ccffff640 1 --2- 172.21.15.88:0/2731865315 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7cb8004800 0x7f7cb8004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:40:46.500 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.490+0000 7f7cd4f8c640 1 --2- 172.21.15.88:0/2731865315 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7cb80039b0 0x7f7cb8003dd0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f7cc0007cf0 tx=0x7f7cb8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26a0b7d4e887cd7e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:46.500 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.490+0000 7f7ccf7fe640 1 -- 172.21.15.88:0/2731865315 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cc0034020 con 0x7f7cb80039b0 2024-04-26T23:40:46.500 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.490+0000 7f7ccf7fe640 1 -- 172.21.15.88:0/2731865315 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7cc0005af0 con 0x7f7cb80039b0 2024-04-26T23:40:46.500 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.490+0000 7f7ccf7fe640 1 -- 172.21.15.88:0/2731865315 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cc0007d30 con 0x7f7cb80039b0 2024-04-26T23:40:46.500 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.490+0000 7f7cd71f0640 1 -- 172.21.15.88:0/2731865315 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7cb80039b0 msgr2=0x7f7cb8003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:46.501 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.490+0000 7f7cd71f0640 1 --2- 172.21.15.88:0/2731865315 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7cb80039b0 0x7f7cb8003dd0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f7cc0007cf0 tx=0x7f7cb8005830 comp rx=0 tx=0).stop 2024-04-26T23:40:46.501 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.490+0000 7f7cd578d640 1 -- 172.21.15.88:0/2731865315 reap_dead start 2024-04-26T23:40:46.501 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.490+0000 7f7cd71f0640 1 -- 172.21.15.88:0/2731865315 shutdown_connections 2024-04-26T23:40:46.501 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.490+0000 7f7cd71f0640 1 -- 172.21.15.88:0/2731865315 >> 172.21.15.88:0/2731865315 conn(0x7f7cd00c5ce0 msgr2=0x7f7cd00c60f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:40:46.501 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.490+0000 7f7cd71f0640 1 -- 172.21.15.88:0/2731865315 shutdown_connections 2024-04-26T23:40:46.501 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.490+0000 7f7cd71f0640 1 -- 172.21.15.88:0/2731865315 wait complete. 2024-04-26T23:40:46.501 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.492+0000 7f7cd71f0640 1 Processor -- start 2024-04-26T23:40:46.501 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.492+0000 7f7cd71f0640 1 -- start start 2024-04-26T23:40:46.501 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.492+0000 7f7cd71f0640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7cb80039b0 0x7f7cd01ec390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:46.501 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.492+0000 7f7cd71f0640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7cd00c8360 0x7f7cd014fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:46.501 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.492+0000 7f7cd71f0640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7cd01e9090 0x7f7cd01e9880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:46.501 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.492+0000 7f7cd71f0640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f7cd00c5400 con 0x7f7cb80039b0 2024-04-26T23:40:46.501 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.492+0000 7f7cd71f0640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f7cd00c4df0 con 0x7f7cd00c8360 2024-04-26T23:40:46.501 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.492+0000 7f7cd71f0640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f7cd00c5920 con 0x7f7cd01e9090 2024-04-26T23:40:46.501 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.492+0000 7f7cd4f8c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7cb80039b0 0x7f7cd01ec390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:46.502 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.492+0000 7f7cd4f8c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7cb80039b0 0x7f7cd01ec390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:41976/0 (socket says 172.21.15.88:41976) 2024-04-26T23:40:46.502 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.492+0000 7f7cd4f8c640 1 -- 172.21.15.88:0/1694667347 learned_addr learned my addr 172.21.15.88:0/1694667347 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:40:46.502 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.493+0000 7f7ccffff640 1 --2- 172.21.15.88:0/1694667347 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7cd00c8360 0x7f7cd014fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:46.502 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.493+0000 7f7cd578d640 1 --2- 172.21.15.88:0/1694667347 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7cd01e9090 0x7f7cd01e9880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:46.502 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.493+0000 7f7cd4f8c640 1 -- 172.21.15.88:0/1694667347 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7cd01e9090 msgr2=0x7f7cd01e9880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:46.502 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.493+0000 7f7cd4f8c640 1 --2- 172.21.15.88:0/1694667347 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7cd01e9090 0x7f7cd01e9880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:46.502 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.493+0000 7f7cd4f8c640 1 -- 172.21.15.88:0/1694667347 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7cd00c8360 msgr2=0x7f7cd014fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:46.502 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.493+0000 7f7cd4f8c640 1 --2- 172.21.15.88:0/1694667347 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7cd00c8360 0x7f7cd014fb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:46.502 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.493+0000 7f7cd4f8c640 1 -- 172.21.15.88:0/1694667347 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cd00c8820 con 0x7f7cb80039b0 2024-04-26T23:40:46.502 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.493+0000 7f7cd4f8c640 1 --2- 172.21.15.88:0/1694667347 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7cb80039b0 0x7f7cd01ec390 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f7cc0001970 tx=0x7f7cd0153a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:46.502 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.493+0000 7f7ccd7fa640 1 -- 172.21.15.88:0/1694667347 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cc0007d30 con 0x7f7cb80039b0 2024-04-26T23:40:46.502 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.493+0000 7f7ccd7fa640 1 -- 172.21.15.88:0/1694667347 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7cc0001640 con 0x7f7cb80039b0 2024-04-26T23:40:46.502 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.493+0000 7f7cd71f0640 1 -- 172.21.15.88:0/1694667347 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7cd01e85b0 con 0x7f7cb80039b0 2024-04-26T23:40:46.502 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.493+0000 7f7ccd7fa640 1 -- 172.21.15.88:0/1694667347 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cc0001c70 con 0x7f7cb80039b0 2024-04-26T23:40:46.502 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.493+0000 7f7cd71f0640 1 -- 172.21.15.88:0/1694667347 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7cd0150060 con 0x7f7cb80039b0 2024-04-26T23:40:46.503 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.494+0000 7f7cd71f0640 1 -- 172.21.15.88:0/1694667347 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7cd006cc10 con 0x7f7cb80039b0 2024-04-26T23:40:46.503 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.494+0000 7f7ccd7fa640 1 -- 172.21.15.88:0/1694667347 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f7cc0037020 con 0x7f7cb80039b0 2024-04-26T23:40:46.504 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.495+0000 7f7ccd7fa640 1 --2- 172.21.15.88:0/1694667347 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f7cbc06c8f0 0x7f7cbc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:46.504 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.495+0000 7f7ccffff640 1 --2- 172.21.15.88:0/1694667347 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f7cbc06c8f0 0x7f7cbc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:46.504 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.495+0000 7f7ccd7fa640 1 -- 172.21.15.88:0/1694667347 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7f7cc00adc60 con 0x7f7cb80039b0 2024-04-26T23:40:46.504 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.495+0000 7f7ccffff640 1 --2- 172.21.15.88:0/1694667347 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f7cbc06c8f0 0x7f7cbc06edb0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f7cd00c34e0 tx=0x7f7cc4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:46.504 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.499+0000 7f7ccd7fa640 1 -- 172.21.15.88:0/1694667347 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f7cc0005ac0 con 0x7f7cb80039b0 2024-04-26T23:40:46.677 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.673+0000 7f7cd71f0640 1 -- 172.21.15.88:0/1694667347 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7cd00507a0 con 0x7f7cb80039b0 2024-04-26T23:40:46.678 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.674+0000 7f7ccd7fa640 1 -- 172.21.15.88:0/1694667347 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+20343 (secure 0 0 0) 0x7f7cc007b710 con 0x7f7cb80039b0 2024-04-26T23:40:46.678 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-26T23:40:46.679 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":24,"fsid":"555255e9-7ef9-4454-8dc9-35e96b70035c","created":"2024-04-26T23:40:07.836009+0000","modified":"2024-04-26T23:40:42.673801+0000","last_up_change":"2024-04-26T23:40:18.831369+0000","last_in_change":"2024-04-26T23:40:09.944777+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T23:40:19.936127+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"a_metadata","create_time":"2024-04-26T23:40:29.837465+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"a_data","create_time":"2024-04-26T23:40:30.868651+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"b_metadata","create_time":"2024-04-26T23:40:38.753441+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"b_data","create_time":"2024-04-26T23:40:39.974557+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"92aecea3-ed62-4a29-87c0-76758a0816a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":2803186054},{"type":"v1","addr":"172.21.15.88:6801","nonce":2803186054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":2803186054},{"type":"v1","addr":"172.21.15.88:6803","nonce":2803186054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":2803186054},{"type":"v1","addr":"172.21.15.88:6807","nonce":2803186054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":2803186054},{"type":"v1","addr":"172.21.15.88:6805","nonce":2803186054}]},"public_addr":"172.21.15.88:6801/2803186054","cluster_addr":"172.21.15.88:6803/2803186054","heartbeat_back_addr":"172.21.15.88:6807/2803186054","heartbeat_front_addr":"172.21.15.88:6805/2803186054","state":["exists","up"]},{"osd":1,"uuid":"7a6f0fa9-23d0-4747-880f-798d45ec5eeb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":1897380484},{"type":"v1","addr":"172.21.15.88:6817","nonce":1897380484}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":1897380484},{"type":"v1","addr":"172.21.15.88:6819","nonce":1897380484}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1897380484},{"type":"v1","addr":"172.21.15.88:6823","nonce":1897380484}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":1897380484},{"type":"v1","addr":"172.21.15.88:6821","nonce":1897380484}]},"public_addr":"172.21.15.88:6817/1897380484","cluster_addr":"172.21.15.88:6819/1897380484","heartbeat_back_addr":"172.21.15.88:6823/1897380484","heartbeat_front_addr":"172.21.15.88:6821/1897380484","state":["exists","up"]},{"osd":2,"uuid":"6be88ea0-e133-4200-a4b5-f92d664b248a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":648396269},{"type":"v1","addr":"172.21.15.88:6809","nonce":648396269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":648396269},{"type":"v1","addr":"172.21.15.88:6811","nonce":648396269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":648396269},{"type":"v1","addr":"172.21.15.88:6815","nonce":648396269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":648396269},{"type":"v1","addr":"172.21.15.88:6813","nonce":648396269}]},"public_addr":"172.21.15.88:6809/648396269","cluster_addr":"172.21.15.88:6811/648396269","heartbeat_back_addr":"172.21.15.88:6815/648396269","heartbeat_front_addr":"172.21.15.88:6813/648396269","state":["exists","up"]},{"osd":3,"uuid":"dcb0746b-7b3d-4ecf-8089-2493a5d1857c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":2328028922},{"type":"v1","addr":"172.21.15.88:6825","nonce":2328028922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":2328028922},{"type":"v1","addr":"172.21.15.88:6827","nonce":2328028922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":2328028922},{"type":"v1","addr":"172.21.15.88:6831","nonce":2328028922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":2328028922},{"type":"v1","addr":"172.21.15.88:6829","nonce":2328028922}]},"public_addr":"172.21.15.88:6825/2328028922","cluster_addr":"172.21.15.88:6827/2328028922","heartbeat_back_addr":"172.21.15.88:6831/2328028922","heartbeat_front_addr":"172.21.15.88:6829/2328028922","state":["exists","up"]},{"osd":4,"uuid":"c483de66-c44f-450e-a4ce-b132d50882c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":3929617402},{"type":"v1","addr":"172.21.15.175:6809","nonce":3929617402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":3929617402},{"type":"v1","addr":"172.21.15.175:6811","nonce":3929617402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":3929617402},{"type":"v1","addr":"172.21.15.175:6815","nonce":3929617402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":3929617402},{"type":"v1","addr":"172.21.15.175:6813","nonce":3929617402}]},"public_addr":"172.21.15.175:6809/3929617402","cluster_addr":"172.21.15.175:6811/3929617402","heartbeat_back_addr":"172.21.15.175:6815/3929617402","heartbeat_front_addr":"172.21.15.175:6813/3929617402","state":["exists","up"]},{"osd":5,"uuid":"ac3b1669-d228-40dd-9f9a-cb46aa73dd6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":2476644457},{"type":"v1","addr":"172.21.15.175:6801","nonce":2476644457}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":2476644457},{"type":"v1","addr":"172.21.15.175:6803","nonce":2476644457}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":2476644457},{"type":"v1","addr":"172.21.15.175:6807","nonce":2476644457}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":2476644457},{"type":"v1","addr":"172.21.15.175:6805","nonce":2476644457}]},"public_addr":"172.21.15.175:6801/2476644457","cluster_addr":"172.21.15.175:6803/2476644457","heartbeat_back_addr":"172.21.15.175:6807/2476644457","heartbeat_front_addr":"172.21.15.175:6805/2476644457","state":["exists","up"]},{"osd":6,"uuid":"7bef4896-857e-4c11-b3b2-c2e9a8548338","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":3824112919},{"type":"v1","addr":"172.21.15.175:6819","nonce":3824112919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6821","nonce":3824112919},{"type":"v1","addr":"172.21.15.175:6824","nonce":3824112919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":3824112919},{"type":"v1","addr":"172.21.15.175:6831","nonce":3824112919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":3824112919},{"type":"v1","addr":"172.21.15.175:6829","nonce":3824112919}]},"public_addr":"172.21.15.175:6819/3824112919","cluster_addr":"172.21.15.175:6824/3824112919","heartbeat_back_addr":"172.21.15.175:6831/3824112919","heartbeat_front_addr":"172.21.15.175:6829/3824112919","state":["exists","up"]},{"osd":7,"uuid":"e18d9e09-8673-470d-b9dc-280a409b63f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6817","nonce":3319361162},{"type":"v1","addr":"172.21.15.175:6818","nonce":3319361162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":3319361162},{"type":"v1","addr":"172.21.15.175:6822","nonce":3319361162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6827","nonce":3319361162},{"type":"v1","addr":"172.21.15.175:6828","nonce":3319361162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6823","nonce":3319361162},{"type":"v1","addr":"172.21.15.175:6825","nonce":3319361162}]},"public_addr":"172.21.15.175:6818/3319361162","cluster_addr":"172.21.15.175:6822/3319361162","heartbeat_back_addr":"172.21.15.175:6828/3319361162","heartbeat_front_addr":"172.21.15.175:6825/3319361162","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:40:15.126268+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:40:15.050614+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:40:14.995164+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:40:15.078112+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:40:15.159637+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:40:15.091226+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:40:15.140316+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:40:15.089431+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:40:46.680 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.676+0000 7f7cd71f0640 1 -- 172.21.15.88:0/1694667347 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f7cbc06c8f0 msgr2=0x7f7cbc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:46.680 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.676+0000 7f7cd71f0640 1 --2- 172.21.15.88:0/1694667347 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f7cbc06c8f0 0x7f7cbc06edb0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f7cd00c34e0 tx=0x7f7cc4008040 comp rx=0 tx=0).stop 2024-04-26T23:40:46.680 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.676+0000 7f7cd71f0640 1 -- 172.21.15.88:0/1694667347 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7cb80039b0 msgr2=0x7f7cd01ec390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:46.680 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.676+0000 7f7cd71f0640 1 --2- 172.21.15.88:0/1694667347 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7cb80039b0 0x7f7cd01ec390 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f7cc0001970 tx=0x7f7cd0153a80 comp rx=0 tx=0).stop 2024-04-26T23:40:46.681 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.676+0000 7f7cd71f0640 1 -- 172.21.15.88:0/1694667347 shutdown_connections 2024-04-26T23:40:46.681 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.676+0000 7f7cd71f0640 1 --2- 172.21.15.88:0/1694667347 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f7cbc06c8f0 0x7f7cbc06edb0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:46.681 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.676+0000 7f7cd71f0640 1 --2- 172.21.15.88:0/1694667347 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7cd01e9090 0x7f7cd01e9880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:46.681 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.676+0000 7f7cd71f0640 1 --2- 172.21.15.88:0/1694667347 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7cd00c8360 0x7f7cd014fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:46.681 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.676+0000 7f7cd71f0640 1 --2- 172.21.15.88:0/1694667347 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7cb80039b0 0x7f7cd01ec390 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:46.681 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.676+0000 7f7cd71f0640 1 -- 172.21.15.88:0/1694667347 >> 172.21.15.88:0/1694667347 conn(0x7f7cd00c5ce0 msgr2=0x7f7cd006c4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:40:46.681 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.676+0000 7f7cd71f0640 1 -- 172.21.15.88:0/1694667347 shutdown_connections 2024-04-26T23:40:46.681 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.676+0000 7f7cd71f0640 1 -- 172.21.15.88:0/1694667347 wait complete. 2024-04-26T23:40:46.691 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-04-26T23:40:46.691 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T23:40:46.787 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.783+0000 7f7e34493640 1 Processor -- start 2024-04-26T23:40:46.787 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.783+0000 7f7e34493640 1 -- start start 2024-04-26T23:40:46.789 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.784+0000 7f7e34493640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f7e2c0740e0 0x7f7e2c157630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:46.789 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.784+0000 7f7e34493640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f7e2c0ca3a0 0x7f7e2c0c7200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:46.789 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.784+0000 7f7e34493640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7e2c15a530 con 0x7f7e2c0c6e20 2024-04-26T23:40:46.789 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.784+0000 7f7e34493640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f7e2c072930 con 0x7f7e2c0740e0 2024-04-26T23:40:46.789 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.784+0000 7f7e34493640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f7e2c15a810 con 0x7f7e2c0ca3a0 2024-04-26T23:40:46.790 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.785+0000 7f7e31a2e640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f7e2c0740e0 0x7f7e2c157630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:46.790 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.785+0000 7f7e3222f640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f7e2c0c6e20 0x7f7e2c156f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:39518/0 (socket says 172.21.15.88:39518) 2024-04-26T23:40:46.790 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.785+0000 7f7e3222f640 1 -- 172.21.15.88:0/4199202673 learned_addr learned my addr 172.21.15.88:0/4199202673 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-26T23:40:46.790 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.785+0000 7f7e32a30640 1 --2- 172.21.15.88:0/4199202673 >> v2:172.21.15.175:3300/0 conn(0x7f7e2c0ca3a0 0x7f7e2c0c7200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:46.790 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.785+0000 7f7e31a2e640 1 -- 172.21.15.88:0/4199202673 >> v2:172.21.15.175:3300/0 conn(0x7f7e2c0ca3a0 msgr2=0x7f7e2c0c7200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:40:46.790 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.785+0000 7f7e31a2e640 1 --2- 172.21.15.88:0/4199202673 >> v2:172.21.15.175:3300/0 conn(0x7f7e2c0ca3a0 0x7f7e2c0c7200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:46.790 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.785+0000 7f7e31a2e640 1 -- 172.21.15.88:0/4199202673 >> v1:172.21.15.88:6789/0 conn(0x7f7e2c0c6e20 legacy=0x7f7e2c156f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:46.790 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.785+0000 7f7e31a2e640 1 -- 172.21.15.88:0/4199202673 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e2c15aaf0 con 0x7f7e2c0740e0 2024-04-26T23:40:46.790 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.785+0000 7f7e3122d640 1 -- 172.21.15.88:0/4199202673 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4076840417 0 0) 0x7f7e2c15a530 con 0x7f7e2c0c6e20 2024-04-26T23:40:46.790 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.785+0000 7f7e31a2e640 1 --2- 172.21.15.88:0/4199202673 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7e2c0740e0 0x7f7e2c157630 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f7e2c0af150 tx=0x7f7e2802a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49d95720906a233e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:46.790 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.786+0000 7f7e3122d640 1 -- 172.21.15.88:0/4199202673 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e28037070 con 0x7f7e2c0740e0 2024-04-26T23:40:46.790 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.786+0000 7f7e3122d640 1 -- 172.21.15.88:0/4199202673 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e28032440 con 0x7f7e2c0740e0 2024-04-26T23:40:46.790 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.786+0000 7f7e3122d640 1 -- 172.21.15.88:0/4199202673 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e2802ae60 con 0x7f7e2c0740e0 2024-04-26T23:40:46.793 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.786+0000 7f7e34493640 1 -- 172.21.15.88:0/4199202673 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7e2c0740e0 msgr2=0x7f7e2c157630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:46.794 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.786+0000 7f7e34493640 1 --2- 172.21.15.88:0/4199202673 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7e2c0740e0 0x7f7e2c157630 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f7e2c0af150 tx=0x7f7e2802a110 comp rx=0 tx=0).stop 2024-04-26T23:40:46.794 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.786+0000 7f7e34493640 1 -- 172.21.15.88:0/4199202673 shutdown_connections 2024-04-26T23:40:46.794 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.786+0000 7f7e34493640 1 --2- 172.21.15.88:0/4199202673 >> v2:172.21.15.175:3300/0 conn(0x7f7e2c0ca3a0 0x7f7e2c0c7200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:46.794 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.786+0000 7f7e34493640 1 --2- 172.21.15.88:0/4199202673 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7e2c0740e0 0x7f7e2c157630 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:46.794 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.786+0000 7f7e34493640 1 -- 172.21.15.88:0/4199202673 >> 172.21.15.88:0/4199202673 conn(0x7f7e2c0ae0b0 msgr2=0x7f7e2c0ae490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:40:46.794 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.786+0000 7f7e34493640 1 -- 172.21.15.88:0/4199202673 shutdown_connections 2024-04-26T23:40:46.794 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.786+0000 7f7e34493640 1 -- 172.21.15.88:0/4199202673 wait complete. 2024-04-26T23:40:46.794 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.787+0000 7f7e34493640 1 Processor -- start 2024-04-26T23:40:46.794 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.787+0000 7f7e34493640 1 -- start start 2024-04-26T23:40:46.794 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.788+0000 7f7e34493640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7e2c0740e0 0x7f7e2c148790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:46.794 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.788+0000 7f7e34493640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7e2c0c6e20 0x7f7e2c155ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:46.794 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.788+0000 7f7e34493640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7e2c0ca3a0 0x7f7e2c156010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:46.795 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.788+0000 7f7e34493640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f7e2c154540 con 0x7f7e2c0740e0 2024-04-26T23:40:46.795 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.788+0000 7f7e34493640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f7e2c1543c0 con 0x7f7e2c0c6e20 2024-04-26T23:40:46.795 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.788+0000 7f7e34493640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f7e2c15a0c0 con 0x7f7e2c0ca3a0 2024-04-26T23:40:46.795 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.788+0000 7f7e3222f640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7e2c0740e0 0x7f7e2c148790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:46.795 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.788+0000 7f7e3222f640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7e2c0740e0 0x7f7e2c148790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:41986/0 (socket says 172.21.15.88:41986) 2024-04-26T23:40:46.795 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.788+0000 7f7e3222f640 1 -- 172.21.15.88:0/2969435628 learned_addr learned my addr 172.21.15.88:0/2969435628 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:40:46.795 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.788+0000 7f7e31a2e640 1 --2- 172.21.15.88:0/2969435628 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7e2c0c6e20 0x7f7e2c155ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:46.795 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.788+0000 7f7e32a30640 1 --2- 172.21.15.88:0/2969435628 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7e2c0ca3a0 0x7f7e2c156010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:46.795 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.788+0000 7f7e3222f640 1 -- 172.21.15.88:0/2969435628 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7e2c0ca3a0 msgr2=0x7f7e2c156010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:46.795 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.788+0000 7f7e3222f640 1 --2- 172.21.15.88:0/2969435628 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7e2c0ca3a0 0x7f7e2c156010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:46.795 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.788+0000 7f7e3222f640 1 -- 172.21.15.88:0/2969435628 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7e2c0c6e20 msgr2=0x7f7e2c155ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:46.795 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.788+0000 7f7e3222f640 1 --2- 172.21.15.88:0/2969435628 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7e2c0c6e20 0x7f7e2c155ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:46.796 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.788+0000 7f7e3222f640 1 -- 172.21.15.88:0/2969435628 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e2c0c21b0 con 0x7f7e2c0740e0 2024-04-26T23:40:46.796 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.788+0000 7f7e3222f640 1 --2- 172.21.15.88:0/2969435628 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7e2c0740e0 0x7f7e2c148790 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f7e1c00c500 tx=0x7f7e1c00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:46.796 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.789+0000 7f7e22ffd640 1 -- 172.21.15.88:0/2969435628 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e1c018070 con 0x7f7e2c0740e0 2024-04-26T23:40:46.796 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.789+0000 7f7e22ffd640 1 -- 172.21.15.88:0/2969435628 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e1c007580 con 0x7f7e2c0740e0 2024-04-26T23:40:46.796 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.789+0000 7f7e34493640 1 -- 172.21.15.88:0/2969435628 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e2c0c2790 con 0x7f7e2c0740e0 2024-04-26T23:40:46.796 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.789+0000 7f7e22ffd640 1 -- 172.21.15.88:0/2969435628 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e1c004a20 con 0x7f7e2c0740e0 2024-04-26T23:40:46.796 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.789+0000 7f7e34493640 1 -- 172.21.15.88:0/2969435628 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e2c148cd0 con 0x7f7e2c0740e0 2024-04-26T23:40:46.796 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.790+0000 7f7e34493640 1 -- 172.21.15.88:0/2969435628 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e2c0c2580 con 0x7f7e2c0740e0 2024-04-26T23:40:46.796 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.790+0000 7f7e22ffd640 1 -- 172.21.15.88:0/2969435628 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f7e1c01b070 con 0x7f7e2c0740e0 2024-04-26T23:40:46.797 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.790+0000 7f7e22ffd640 1 --2- 172.21.15.88:0/2969435628 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f7e1006c8f0 0x7f7e1006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:46.797 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.790+0000 7f7e22ffd640 1 -- 172.21.15.88:0/2969435628 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7f7e1c08b150 con 0x7f7e2c0740e0 2024-04-26T23:40:46.797 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.791+0000 7f7e31a2e640 1 --2- 172.21.15.88:0/2969435628 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f7e1006c8f0 0x7f7e1006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:46.797 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.791+0000 7f7e31a2e640 1 --2- 172.21.15.88:0/2969435628 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f7e1006c8f0 0x7f7e1006edb0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f7e28034000 tx=0x7f7e2802e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:46.798 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.795+0000 7f7e22ffd640 1 -- 172.21.15.88:0/2969435628 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f7e1c0592e0 con 0x7f7e2c0740e0 2024-04-26T23:40:46.973 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.969+0000 7f7e34493640 1 -- 172.21.15.88:0/2969435628 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7e2c0766c0 con 0x7f7e2c0740e0 2024-04-26T23:40:46.975 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.971+0000 7f7e22ffd640 1 -- 172.21.15.88:0/2969435628 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+20343 (secure 0 0 0) 0x7f7e1c058be0 con 0x7f7e2c0740e0 2024-04-26T23:40:46.975 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-26T23:40:46.975 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":24,"fsid":"555255e9-7ef9-4454-8dc9-35e96b70035c","created":"2024-04-26T23:40:07.836009+0000","modified":"2024-04-26T23:40:42.673801+0000","last_up_change":"2024-04-26T23:40:18.831369+0000","last_in_change":"2024-04-26T23:40:09.944777+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T23:40:19.936127+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"a_metadata","create_time":"2024-04-26T23:40:29.837465+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"a_data","create_time":"2024-04-26T23:40:30.868651+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"b_metadata","create_time":"2024-04-26T23:40:38.753441+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"b_data","create_time":"2024-04-26T23:40:39.974557+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"92aecea3-ed62-4a29-87c0-76758a0816a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":2803186054},{"type":"v1","addr":"172.21.15.88:6801","nonce":2803186054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":2803186054},{"type":"v1","addr":"172.21.15.88:6803","nonce":2803186054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":2803186054},{"type":"v1","addr":"172.21.15.88:6807","nonce":2803186054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":2803186054},{"type":"v1","addr":"172.21.15.88:6805","nonce":2803186054}]},"public_addr":"172.21.15.88:6801/2803186054","cluster_addr":"172.21.15.88:6803/2803186054","heartbeat_back_addr":"172.21.15.88:6807/2803186054","heartbeat_front_addr":"172.21.15.88:6805/2803186054","state":["exists","up"]},{"osd":1,"uuid":"7a6f0fa9-23d0-4747-880f-798d45ec5eeb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":1897380484},{"type":"v1","addr":"172.21.15.88:6817","nonce":1897380484}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":1897380484},{"type":"v1","addr":"172.21.15.88:6819","nonce":1897380484}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1897380484},{"type":"v1","addr":"172.21.15.88:6823","nonce":1897380484}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":1897380484},{"type":"v1","addr":"172.21.15.88:6821","nonce":1897380484}]},"public_addr":"172.21.15.88:6817/1897380484","cluster_addr":"172.21.15.88:6819/1897380484","heartbeat_back_addr":"172.21.15.88:6823/1897380484","heartbeat_front_addr":"172.21.15.88:6821/1897380484","state":["exists","up"]},{"osd":2,"uuid":"6be88ea0-e133-4200-a4b5-f92d664b248a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":648396269},{"type":"v1","addr":"172.21.15.88:6809","nonce":648396269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":648396269},{"type":"v1","addr":"172.21.15.88:6811","nonce":648396269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":648396269},{"type":"v1","addr":"172.21.15.88:6815","nonce":648396269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":648396269},{"type":"v1","addr":"172.21.15.88:6813","nonce":648396269}]},"public_addr":"172.21.15.88:6809/648396269","cluster_addr":"172.21.15.88:6811/648396269","heartbeat_back_addr":"172.21.15.88:6815/648396269","heartbeat_front_addr":"172.21.15.88:6813/648396269","state":["exists","up"]},{"osd":3,"uuid":"dcb0746b-7b3d-4ecf-8089-2493a5d1857c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":2328028922},{"type":"v1","addr":"172.21.15.88:6825","nonce":2328028922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":2328028922},{"type":"v1","addr":"172.21.15.88:6827","nonce":2328028922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":2328028922},{"type":"v1","addr":"172.21.15.88:6831","nonce":2328028922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":2328028922},{"type":"v1","addr":"172.21.15.88:6829","nonce":2328028922}]},"public_addr":"172.21.15.88:6825/2328028922","cluster_addr":"172.21.15.88:6827/2328028922","heartbeat_back_addr":"172.21.15.88:6831/2328028922","heartbeat_front_addr":"172.21.15.88:6829/2328028922","state":["exists","up"]},{"osd":4,"uuid":"c483de66-c44f-450e-a4ce-b132d50882c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":3929617402},{"type":"v1","addr":"172.21.15.175:6809","nonce":3929617402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":3929617402},{"type":"v1","addr":"172.21.15.175:6811","nonce":3929617402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":3929617402},{"type":"v1","addr":"172.21.15.175:6815","nonce":3929617402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":3929617402},{"type":"v1","addr":"172.21.15.175:6813","nonce":3929617402}]},"public_addr":"172.21.15.175:6809/3929617402","cluster_addr":"172.21.15.175:6811/3929617402","heartbeat_back_addr":"172.21.15.175:6815/3929617402","heartbeat_front_addr":"172.21.15.175:6813/3929617402","state":["exists","up"]},{"osd":5,"uuid":"ac3b1669-d228-40dd-9f9a-cb46aa73dd6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":2476644457},{"type":"v1","addr":"172.21.15.175:6801","nonce":2476644457}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":2476644457},{"type":"v1","addr":"172.21.15.175:6803","nonce":2476644457}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":2476644457},{"type":"v1","addr":"172.21.15.175:6807","nonce":2476644457}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":2476644457},{"type":"v1","addr":"172.21.15.175:6805","nonce":2476644457}]},"public_addr":"172.21.15.175:6801/2476644457","cluster_addr":"172.21.15.175:6803/2476644457","heartbeat_back_addr":"172.21.15.175:6807/2476644457","heartbeat_front_addr":"172.21.15.175:6805/2476644457","state":["exists","up"]},{"osd":6,"uuid":"7bef4896-857e-4c11-b3b2-c2e9a8548338","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":3824112919},{"type":"v1","addr":"172.21.15.175:6819","nonce":3824112919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6821","nonce":3824112919},{"type":"v1","addr":"172.21.15.175:6824","nonce":3824112919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":3824112919},{"type":"v1","addr":"172.21.15.175:6831","nonce":3824112919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":3824112919},{"type":"v1","addr":"172.21.15.175:6829","nonce":3824112919}]},"public_addr":"172.21.15.175:6819/3824112919","cluster_addr":"172.21.15.175:6824/3824112919","heartbeat_back_addr":"172.21.15.175:6831/3824112919","heartbeat_front_addr":"172.21.15.175:6829/3824112919","state":["exists","up"]},{"osd":7,"uuid":"e18d9e09-8673-470d-b9dc-280a409b63f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6817","nonce":3319361162},{"type":"v1","addr":"172.21.15.175:6818","nonce":3319361162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":3319361162},{"type":"v1","addr":"172.21.15.175:6822","nonce":3319361162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6827","nonce":3319361162},{"type":"v1","addr":"172.21.15.175:6828","nonce":3319361162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6823","nonce":3319361162},{"type":"v1","addr":"172.21.15.175:6825","nonce":3319361162}]},"public_addr":"172.21.15.175:6818/3319361162","cluster_addr":"172.21.15.175:6822/3319361162","heartbeat_back_addr":"172.21.15.175:6828/3319361162","heartbeat_front_addr":"172.21.15.175:6825/3319361162","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:40:15.126268+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:40:15.050614+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:40:14.995164+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:40:15.078112+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:40:15.159637+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:40:15.091226+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:40:15.140316+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:40:15.089431+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:40:46.977 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.973+0000 7f7e34493640 1 -- 172.21.15.88:0/2969435628 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f7e1006c8f0 msgr2=0x7f7e1006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:46.977 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.973+0000 7f7e34493640 1 --2- 172.21.15.88:0/2969435628 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f7e1006c8f0 0x7f7e1006edb0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f7e28034000 tx=0x7f7e2802e000 comp rx=0 tx=0).stop 2024-04-26T23:40:46.977 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.973+0000 7f7e34493640 1 -- 172.21.15.88:0/2969435628 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7e2c0740e0 msgr2=0x7f7e2c148790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:46.977 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.973+0000 7f7e34493640 1 --2- 172.21.15.88:0/2969435628 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7e2c0740e0 0x7f7e2c148790 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f7e1c00c500 tx=0x7f7e1c00c9c0 comp rx=0 tx=0).stop 2024-04-26T23:40:46.978 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.973+0000 7f7e34493640 1 -- 172.21.15.88:0/2969435628 shutdown_connections 2024-04-26T23:40:46.978 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.973+0000 7f7e34493640 1 --2- 172.21.15.88:0/2969435628 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f7e1006c8f0 0x7f7e1006edb0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:46.978 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.973+0000 7f7e34493640 1 --2- 172.21.15.88:0/2969435628 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7e2c0ca3a0 0x7f7e2c156010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:46.978 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.973+0000 7f7e34493640 1 --2- 172.21.15.88:0/2969435628 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7e2c0c6e20 0x7f7e2c155ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:46.978 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.973+0000 7f7e34493640 1 --2- 172.21.15.88:0/2969435628 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7e2c0740e0 0x7f7e2c148790 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:46.978 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.973+0000 7f7e34493640 1 -- 172.21.15.88:0/2969435628 >> 172.21.15.88:0/2969435628 conn(0x7f7e2c0ae0b0 msgr2=0x7f7e2c0ae490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:40:46.978 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.973+0000 7f7e34493640 1 -- 172.21.15.88:0/2969435628 shutdown_connections 2024-04-26T23:40:46.978 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:46.973+0000 7f7e34493640 1 -- 172.21.15.88:0/2969435628 wait complete. 2024-04-26T23:40:46.988 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-04-26T23:40:46.989 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-04-26T23:40:46.989 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-04-26T23:40:46.989 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-04-26T23:40:46.990 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-04-26T23:40:46.990 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-04-26T23:40:46.990 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-04-26T23:40:46.991 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-04-26T23:40:47.157 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.153+0000 7f8c57122640 1 Processor -- start 2024-04-26T23:40:47.157 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.153+0000 7f8c57122640 1 -- start start 2024-04-26T23:40:47.157 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.153+0000 7f80aa18e640 1 Processor -- start 2024-04-26T23:40:47.158 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.153+0000 7fcfa61af640 1 Processor -- start 2024-04-26T23:40:47.158 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.153+0000 7f170ceda640 1 Processor -- start 2024-04-26T23:40:47.158 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.153+0000 7f170ceda640 1 -- start start 2024-04-26T23:40:47.158 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.153+0000 7f80e90f9640 1 Processor -- start 2024-04-26T23:40:47.158 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.153+0000 7f80e90f9640 1 -- start start 2024-04-26T23:40:47.159 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.153+0000 7f5e98a25640 1 Processor -- start 2024-04-26T23:40:47.159 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.153+0000 7f5e98a25640 1 -- start start 2024-04-26T23:40:47.159 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.153+0000 7f80aa18e640 1 -- start start 2024-04-26T23:40:47.160 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.153+0000 7fd033fff640 1 Processor -- start 2024-04-26T23:40:47.160 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.153+0000 7fd033fff640 1 -- start start 2024-04-26T23:40:47.160 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.154+0000 7f3eb8f46640 1 Processor -- start 2024-04-26T23:40:47.160 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.153+0000 7fcfa61af640 1 -- start start 2024-04-26T23:40:47.161 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.154+0000 7f8c57122640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8c5006f750 0x7f8c500c1600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:47.161 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.154+0000 7f3eb8f46640 1 -- start start 2024-04-26T23:40:47.161 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.154+0000 7f80aa18e640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f80a40acc50 0x7f80a4074530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:47.161 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.154+0000 7f170ceda640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f170000b2e0 0x7f17000d5500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:47.162 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.154+0000 7f170ceda640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f17000d8fd0 con 0x7f170003f6c0 2024-04-26T23:40:47.162 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.154+0000 7f170ceda640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f17000d8210 con 0x7f170002eea0 2024-04-26T23:40:47.162 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.154+0000 7f170ceda640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f17000484d0 con 0x7f170000b2e0 2024-04-26T23:40:47.162 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.154+0000 7f80e90f9640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f80dc0d5850 0x7f80dc048190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:47.162 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.154+0000 7f80e90f9640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f80dc04a010 0x7f80dc04a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:47.162 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.154+0000 7f80e90f9640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f80dc0327d0 con 0x7f80dc006c60 2024-04-26T23:40:47.162 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.154+0000 7f80e90f9640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f80dc0473d0 con 0x7f80dc04a010 2024-04-26T23:40:47.162 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.154+0000 7f80e90f9640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f80dc0476b0 con 0x7f80dc0d5850 2024-04-26T23:40:47.163 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.154+0000 7f8c57122640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f8c500c43e0 0x7f8c500c2bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:47.163 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.155+0000 7f8c57122640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8c500adcd0 con 0x7f8c500ad250 2024-04-26T23:40:47.163 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.155+0000 7fd033fff640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fd02c0d3b40 0x7fd02c046b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:47.163 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.155+0000 7fd033fff640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fd02c04b110 0x7fd02c006ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:47.164 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.155+0000 7f8c57122640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f8c500c4880 con 0x7f8c500c43e0 2024-04-26T23:40:47.164 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.155+0000 7f80e359e640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f80dc006c60 0x7f80dc031a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:39550/0 (socket says 172.21.15.88:39550) 2024-04-26T23:40:47.164 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.155+0000 7f80e359e640 1 -- 172.21.15.88:0/334822378 learned_addr learned my addr 172.21.15.88:0/334822378 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-26T23:40:47.164 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.155+0000 7f8c57122640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f8c50156d60 con 0x7f8c5006f750 2024-04-26T23:40:47.165 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.154+0000 7f5e98a25640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f5e940c82b0 0x7f5e9415aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:47.165 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.154+0000 7f5e98a25640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5e94070000 con 0x7f5e9406ec20 2024-04-26T23:40:47.165 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.154+0000 7f5e98a25640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5e940702e0 con 0x7f5e940c4aa0 2024-04-26T23:40:47.165 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.155+0000 7f170659c640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f170000b2e0 0x7f17000d5500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:47.165 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.154+0000 7f5e98a25640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f5e940c4e80 con 0x7f5e940c82b0 2024-04-26T23:40:47.165 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.155+0000 7f5e9259c640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f5e940c4aa0 0x7f5e94157360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.88:36608/0 (socket says 172.21.15.88:36608) 2024-04-26T23:40:47.165 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.155+0000 7f5e9259c640 1 -- 172.21.15.88:0/2681413558 learned_addr learned my addr 172.21.15.88:0/2681413558 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-26T23:40:47.166 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.155+0000 7f1706d9d640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f170002eea0 0x7f17000e29a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.88:36612/0 (socket says 172.21.15.88:36612) 2024-04-26T23:40:47.166 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.155+0000 7f1706d9d640 1 -- 172.21.15.88:0/2459871329 learned_addr learned my addr 172.21.15.88:0/2459871329 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-26T23:40:47.166 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.155+0000 7f80aa18e640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f80a415b180 con 0x7f80a40c66b0 2024-04-26T23:40:47.166 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.155+0000 7f80aa18e640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f80a415b460 con 0x7f80a4074150 2024-04-26T23:40:47.167 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.155+0000 7f5e9159a640 1 -- 172.21.15.88:0/2681413558 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 833969915 0 0) 0x7f5e940702e0 con 0x7f5e940c4aa0 2024-04-26T23:40:47.167 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.155+0000 7f8c54ebe640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8c5006f750 0x7f8c500c1600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:47.167 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.155+0000 7f80aa18e640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f80a40af510 con 0x7f80a40acc50 2024-04-26T23:40:47.168 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.155+0000 7f80a898b640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f80a40acc50 0x7f80a4074530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:47.168 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.155+0000 7f80a898b640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f80a40acc50 0x7f80a4074530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:41998/0 (socket says 172.21.15.88:41998) 2024-04-26T23:40:47.168 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.155+0000 7f80a898b640 1 -- 172.21.15.88:0/4227902137 learned_addr learned my addr 172.21.15.88:0/4227902137 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:40:47.168 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.155+0000 7f5e9159a640 1 -- 172.21.15.88:0/2681413558 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5e7c003520 con 0x7f5e940c4aa0 2024-04-26T23:40:47.168 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.155+0000 7f5e91d9b640 1 --2- 172.21.15.88:0/2681413558 >> v2:172.21.15.175:3300/0 conn(0x7f5e940c82b0 0x7f5e9415aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:47.168 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.155+0000 7f80e259c640 1 --2- 172.21.15.88:0/334822378 >> v2:172.21.15.175:3300/0 conn(0x7f80dc04a010 0x7f80dc04a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:47.169 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.155+0000 7f170559a640 1 -- 172.21.15.88:0/2459871329 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 301412525 0 0) 0x7f17000d8210 con 0x7f170002eea0 2024-04-26T23:40:47.169 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.155+0000 7f8c556bf640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f8c500ad250 0x7f8c5015a020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:39556/0 (socket says 172.21.15.88:39556) 2024-04-26T23:40:47.169 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.155+0000 7f170559a640 1 -- 172.21.15.88:0/2459871329 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f16f0003520 con 0x7f170002eea0 2024-04-26T23:40:47.170 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.155+0000 7f80e2d9d640 1 --2- 172.21.15.88:0/334822378 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f80dc0d5850 0x7f80dc048190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:47.170 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.155+0000 7f80e1d9b640 1 -- 172.21.15.88:0/334822378 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1294719888 0 0) 0x7f80dc0327d0 con 0x7f80dc006c60 2024-04-26T23:40:47.170 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.155+0000 7f170659c640 1 -- 172.21.15.88:0/2459871329 >> v1:172.21.15.175:6789/0 conn(0x7f170002eea0 legacy=0x7f17000e29a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:47.170 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.155+0000 7f80e1d9b640 1 -- 172.21.15.88:0/334822378 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f80d0003520 con 0x7f80dc006c60 2024-04-26T23:40:47.171 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.155+0000 7f170659c640 1 -- 172.21.15.88:0/2459871329 >> v1:172.21.15.88:6789/0 conn(0x7f170003f6c0 legacy=0x7f1700049f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:40:47.171 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.155+0000 7fcfa61af640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fcf98007640 0x7fcf9800e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:47.171 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.155+0000 7fcf9f7fe640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fcf980351c0 0x7fcf9804dab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:39526/0 (socket says 172.21.15.88:39526) 2024-04-26T23:40:47.171 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.155+0000 7fcf9f7fe640 1 -- 172.21.15.88:0/3806692783 learned_addr learned my addr 172.21.15.88:0/3806692783 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-26T23:40:47.171 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.155+0000 7f170659c640 1 -- 172.21.15.88:0/2459871329 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17000d84f0 con 0x7f170000b2e0 2024-04-26T23:40:47.172 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.156+0000 7f5e9159a640 1 -- 172.21.15.88:0/2681413558 <== mon.1 v1:172.21.15.175:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 471470877 0 0) 0x7f5e7c003520 con 0x7f5e940c4aa0 2024-04-26T23:40:47.172 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.156+0000 7f5e9159a640 1 -- 172.21.15.88:0/2681413558 >> v2:172.21.15.175:3300/0 conn(0x7f5e940c82b0 msgr2=0x7f5e9415aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:40:47.172 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.156+0000 7f5e9159a640 1 --2- 172.21.15.88:0/2681413558 >> v2:172.21.15.175:3300/0 conn(0x7f5e940c82b0 0x7f5e9415aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:47.172 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.156+0000 7f5e9159a640 1 -- 172.21.15.88:0/2681413558 >> v1:172.21.15.88:6789/0 conn(0x7f5e9406ec20 legacy=0x7f5e940c1bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:40:47.172 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.156+0000 7f5e9159a640 1 -- 172.21.15.88:0/2681413558 --> v1:172.21.15.175:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e940705c0 con 0x7f5e940c4aa0 2024-04-26T23:40:47.173 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.155+0000 7fd033fff640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd02c047050 con 0x7fd02c0073e0 2024-04-26T23:40:47.173 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.155+0000 7fd033fff640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7fd02c0d9c60 con 0x7fd02c0d3b40 2024-04-26T23:40:47.173 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.155+0000 7fd033fff640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7fd02c0d9f40 con 0x7fd02c04b110 2024-04-26T23:40:47.173 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.156+0000 7f5e9159a640 1 -- 172.21.15.88:0/2681413558 <== mon.1 v1:172.21.15.175:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 356324787 0 0) 0x7f5e8c0019f0 con 0x7f5e940c4aa0 2024-04-26T23:40:47.173 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.156+0000 7f5e9159a640 1 -- 172.21.15.88:0/2681413558 >> v1:172.21.15.175:6789/0 conn(0x7f5e940c4aa0 legacy=0x7f5e94157360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:47.174 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.155+0000 7f8c556bf640 1 -- 172.21.15.88:0/3682048070 learned_addr learned my addr 172.21.15.88:0/3682048070 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-26T23:40:47.174 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.155+0000 7f8c4ffff640 1 --2- 172.21.15.88:0/3682048070 >> v2:172.21.15.88:3300/0 conn(0x7f8c500c43e0 0x7f8c500c2bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:47.174 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.155+0000 7fd0327fc640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fd02c04b110 0x7fd02c006ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:47.174 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.155+0000 7fd0337fe640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fd02c0073e0 0x7fd02c0d6710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:39582/0 (socket says 172.21.15.88:39582) 2024-04-26T23:40:47.174 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.155+0000 7fd0337fe640 1 -- 172.21.15.88:0/4286218503 learned_addr learned my addr 172.21.15.88:0/4286218503 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-26T23:40:47.175 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.156+0000 7f80e1d9b640 1 -- 172.21.15.88:0/334822378 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1289251649 0 0) 0x7f80d0003520 con 0x7f80dc006c60 2024-04-26T23:40:47.175 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.156+0000 7f80e1d9b640 1 -- 172.21.15.88:0/334822378 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f80dc0d5850 msgr2=0x7f80dc048190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:40:47.175 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.156+0000 7f3eb8f46640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f3eac0d6740 0x7f3eac0d6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:47.175 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.156+0000 7f5e9159a640 1 --2- 172.21.15.88:0/2681413558 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5e7c003a00 0x7f5e7c003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:47.175 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.156+0000 7f5e9159a640 1 --2- 172.21.15.88:0/2681413558 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5e7c004800 0x7f5e7c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:47.175 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.156+0000 7f5e9159a640 1 --2- 172.21.15.88:0/2681413558 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5e7c0051c0 0x7f5e7c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:47.176 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.156+0000 7f80a898b640 1 -- 172.21.15.88:0/4227902137 >> v1:172.21.15.175:6789/0 conn(0x7f80a4074150 legacy=0x7f80a415e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:47.176 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.156+0000 7f80a898b640 1 -- 172.21.15.88:0/4227902137 >> v1:172.21.15.88:6789/0 conn(0x7f80a40c66b0 legacy=0x7f80a415ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:47.176 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.156+0000 7f80a898b640 1 -- 172.21.15.88:0/4227902137 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80a415b740 con 0x7f80a40acc50 2024-04-26T23:40:47.176 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.156+0000 7f5e9159a640 1 -- 172.21.15.88:0/2681413558 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f5e940c4e80 con 0x7f5e7c003a00 2024-04-26T23:40:47.176 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.156+0000 7f5e9159a640 1 -- 172.21.15.88:0/2681413558 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f5e7c00c090 con 0x7f5e7c004800 2024-04-26T23:40:47.176 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.156+0000 7f5e9159a640 1 -- 172.21.15.88:0/2681413558 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f5e7c00c290 con 0x7f5e7c0051c0 2024-04-26T23:40:47.177 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.156+0000 7f3eb8f46640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3eac0d9c90 con 0x7f3eac0d3b70 2024-04-26T23:40:47.177 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.156+0000 7fd032ffd640 1 --2- 172.21.15.88:0/4286218503 >> v2:172.21.15.88:3300/0 conn(0x7fd02c0d3b40 0x7fd02c046b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:47.177 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.156+0000 7fd0327fc640 1 -- 172.21.15.88:0/4286218503 >> v2:172.21.15.88:3300/0 conn(0x7fd02c0d3b40 msgr2=0x7fd02c046b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:40:47.177 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.156+0000 7fd0327fc640 1 --2- 172.21.15.88:0/4286218503 >> v2:172.21.15.88:3300/0 conn(0x7fd02c0d3b40 0x7fd02c046b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:47.177 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.156+0000 7fd0327fc640 1 -- 172.21.15.88:0/4286218503 >> v1:172.21.15.88:6789/0 conn(0x7fd02c0073e0 legacy=0x7fd02c0d6710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:40:47.177 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.156+0000 7f80e1d9b640 1 --2- 172.21.15.88:0/334822378 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f80dc0d5850 0x7f80dc048190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:47.177 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.156+0000 7f80e1d9b640 1 -- 172.21.15.88:0/334822378 >> v2:172.21.15.175:3300/0 conn(0x7f80dc04a010 msgr2=0x7f80dc04a7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:40:47.178 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.156+0000 7f80e1d9b640 1 --2- 172.21.15.88:0/334822378 >> v2:172.21.15.175:3300/0 conn(0x7f80dc04a010 0x7f80dc04a7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:47.178 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.156+0000 7f80e1d9b640 1 -- 172.21.15.88:0/334822378 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80dc047990 con 0x7f80dc006c60 2024-04-26T23:40:47.178 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.156+0000 7f3eb8f46640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3eac0d9f70 con 0x7f3eac04b140 2024-04-26T23:40:47.178 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.156+0000 7f3eb8f46640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f3eac0da250 con 0x7f3eac0d6740 2024-04-26T23:40:47.178 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.156+0000 7f80e259c640 1 --2- 172.21.15.88:0/334822378 >> v2:172.21.15.175:3300/0 conn(0x7f80dc04a010 0x7f80dc04a7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:40:47.179 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.156+0000 7fd0327fc640 1 -- 172.21.15.88:0/4286218503 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd02c0da220 con 0x7fd02c04b110 2024-04-26T23:40:47.179 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.156+0000 7fcfa61af640 1 -- 172.21.15.88:0/3806692783 --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcf9804e1c0 con 0x7fcf980351c0 2024-04-26T23:40:47.179 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.156+0000 7fcfa61af640 1 -- 172.21.15.88:0/3806692783 --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcf980da530 con 0x7fcf98007200 2024-04-26T23:40:47.179 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.156+0000 7fcfa61af640 1 -- 172.21.15.88:0/3806692783 --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7fcf98007a70 con 0x7fcf98007640 2024-04-26T23:40:47.179 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.156+0000 7f5e92d9d640 1 --2- 172.21.15.88:0/2681413558 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5e7c0051c0 0x7f5e7c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:47.180 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.156+0000 7fcf9e7fc640 1 -- 172.21.15.88:0/3806692783 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 687317576 0 0) 0x7fcf980da530 con 0x7fcf98007200 2024-04-26T23:40:47.180 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.156+0000 7f5e91d9b640 1 --2- 172.21.15.88:0/2681413558 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5e7c004800 0x7f5e7c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:47.180 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.156+0000 7fcf9e7fc640 1 -- 172.21.15.88:0/3806692783 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcf90003520 con 0x7fcf98007200 2024-04-26T23:40:47.181 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.156+0000 7f3eb1d9b640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f3eac04b140 0x7f3eac006ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.88:36636/0 (socket says 172.21.15.88:36636) 2024-04-26T23:40:47.181 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.156+0000 7f3eb1d9b640 1 -- 172.21.15.88:0/4260255903 learned_addr learned my addr 172.21.15.88:0/4260255903 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-26T23:40:47.181 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.156+0000 7fd032ffd640 1 --2- 172.21.15.88:0/4286218503 >> v2:172.21.15.88:3300/0 conn(0x7fd02c0d3b40 0x7fd02c046b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:40:47.181 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.157+0000 7f80e1d9b640 1 -- 172.21.15.88:0/334822378 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 356324787 0 0) 0x7f80e4050be0 con 0x7f80dc006c60 2024-04-26T23:40:47.181 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.157+0000 7f80e1d9b640 1 -- 172.21.15.88:0/334822378 >> v1:172.21.15.88:6789/0 conn(0x7f80dc006c60 legacy=0x7f80dc031a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:47.181 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.157+0000 7f80e1d9b640 1 --2- 172.21.15.88:0/334822378 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f80d00039b0 0x7f80d0003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:47.181 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.157+0000 7f80e1d9b640 1 --2- 172.21.15.88:0/334822378 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f80dc0d5850 0x7f80d0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:47.182 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.157+0000 7f80e1d9b640 1 --2- 172.21.15.88:0/334822378 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f80d0004d40 0x7f80d00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:47.182 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.157+0000 7f80e259c640 1 --2- 172.21.15.88:0/334822378 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f80dc0d5850 0x7f80d0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:47.182 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.157+0000 7f3eb2d9d640 1 --2- 172.21.15.88:0/4260255903 >> v2:172.21.15.88:3300/0 conn(0x7f3eac0d6740 0x7f3eac0d6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:47.182 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.157+0000 7f8c4ffff640 1 -- 172.21.15.88:0/3682048070 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8c5006f750 msgr2=0x7f8c500c1600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:40:47.182 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.157+0000 7f8c4ffff640 1 --2- 172.21.15.88:0/3682048070 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8c5006f750 0x7f8c500c1600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:47.182 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.157+0000 7f8c4ffff640 1 -- 172.21.15.88:0/3682048070 >> v1:172.21.15.88:6789/0 conn(0x7f8c500ad250 legacy=0x7f8c5015a020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:47.182 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.157+0000 7f8c4ffff640 1 -- 172.21.15.88:0/3682048070 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c50157040 con 0x7f8c500c43e0 2024-04-26T23:40:47.183 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.157+0000 7fcf9ffff640 1 --2- 172.21.15.88:0/3806692783 >> v2:172.21.15.88:3300/0 conn(0x7fcf98007640 0x7fcf9800e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:47.183 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.157+0000 7fcf9e7fc640 1 -- 172.21.15.88:0/3806692783 <== mon.1 v1:172.21.15.175:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 796514838 0 0) 0x7fcf90003520 con 0x7fcf98007200 2024-04-26T23:40:47.183 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.157+0000 7fcf9e7fc640 1 -- 172.21.15.88:0/3806692783 >> v2:172.21.15.88:3300/0 conn(0x7fcf98007640 msgr2=0x7fcf9800e9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:40:47.183 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.157+0000 7fcf9e7fc640 1 --2- 172.21.15.88:0/3806692783 >> v2:172.21.15.88:3300/0 conn(0x7fcf98007640 0x7fcf9800e9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:47.183 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.157+0000 7fcf9e7fc640 1 -- 172.21.15.88:0/3806692783 >> v1:172.21.15.88:6789/0 conn(0x7fcf980351c0 legacy=0x7fcf9804dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:47.183 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.157+0000 7fcf9e7fc640 1 -- 172.21.15.88:0/3806692783 --> v1:172.21.15.175:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf980da810 con 0x7fcf98007200 2024-04-26T23:40:47.183 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.157+0000 7fcf9e7fc640 1 -- 172.21.15.88:0/3806692783 <== mon.1 v1:172.21.15.175:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 356324787 0 0) 0x7fcf8c001670 con 0x7fcf98007200 2024-04-26T23:40:47.183 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.157+0000 7fcf9e7fc640 1 -- 172.21.15.88:0/3806692783 >> v1:172.21.15.175:6789/0 conn(0x7fcf98007200 legacy=0x7fcf9800e2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:47.183 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.157+0000 7fcf9e7fc640 1 --2- 172.21.15.88:0/3806692783 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcf900039b0 0x7fcf90003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:47.183 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.157+0000 7fcf9e7fc640 1 --2- 172.21.15.88:0/3806692783 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcf90004800 0x7fcf90004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:47.183 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.157+0000 7fcf9e7fc640 1 --2- 172.21.15.88:0/3806692783 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcf900053c0 0x7fcf900141d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:47.184 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.157+0000 7fcf9e7fc640 1 -- 172.21.15.88:0/3806692783 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fcf98007a70 con 0x7fcf900053c0 2024-04-26T23:40:47.184 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.157+0000 7fcf9e7fc640 1 -- 172.21.15.88:0/3806692783 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fcf90014a60 con 0x7fcf900039b0 2024-04-26T23:40:47.184 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.157+0000 7fcf9e7fc640 1 -- 172.21.15.88:0/3806692783 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fcf90014c60 con 0x7fcf90004800 2024-04-26T23:40:47.184 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.157+0000 7f170659c640 1 --2- 172.21.15.88:0/2459871329 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f170000b2e0 0x7f17000d5500 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f170806acf0 tx=0x7f17080a71f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4c365e5859ffe3db server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:47.184 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.157+0000 7f5e92d9d640 1 -- 172.21.15.88:0/2681413558 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5e7c004800 msgr2=0x7f5e7c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:40:47.184 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.157+0000 7f5e92d9d640 1 --2- 172.21.15.88:0/2681413558 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5e7c004800 0x7f5e7c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:47.184 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.157+0000 7f5e92d9d640 1 -- 172.21.15.88:0/2681413558 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5e7c003a00 msgr2=0x7f5e7c003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:40:47.185 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.157+0000 7f5e92d9d640 1 --2- 172.21.15.88:0/2681413558 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5e7c003a00 0x7f5e7c003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:47.185 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.157+0000 7f5e92d9d640 1 -- 172.21.15.88:0/2681413558 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e7c003520 con 0x7f5e7c0051c0 2024-04-26T23:40:47.185 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.157+0000 7f5e91d9b640 1 --2- 172.21.15.88:0/2681413558 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5e7c004800 0x7f5e7c004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:40:47.185 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.157+0000 7f80e1d9b640 1 -- 172.21.15.88:0/334822378 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f80dc0473d0 con 0x7f80d00039b0 2024-04-26T23:40:47.185 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.157+0000 7f80e359e640 1 --2- 172.21.15.88:0/334822378 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f80d0004d40 0x7f80d00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:47.185 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.157+0000 7f8c54ebe640 1 --2- 172.21.15.88:0/3682048070 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8c5006f750 0x7f8c500c1600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:40:47.186 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.157+0000 7f80e1d9b640 1 -- 172.21.15.88:0/334822378 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f80dc0476b0 con 0x7f80d0004d40 2024-04-26T23:40:47.186 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.157+0000 7f170559a640 1 -- 172.21.15.88:0/2459871329 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17080b4070 con 0x7f170000b2e0 2024-04-26T23:40:47.186 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.157+0000 7f80e1d9b640 1 -- 172.21.15.88:0/334822378 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f80d000b9c0 con 0x7f80dc0d5850 2024-04-26T23:40:47.187 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.157+0000 7fcf9f7fe640 1 --2- 172.21.15.88:0/3806692783 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcf900039b0 0x7fcf90003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:47.187 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.157+0000 7f170559a640 1 -- 172.21.15.88:0/2459871329 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17080af440 con 0x7f170000b2e0 2024-04-26T23:40:47.187 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.157+0000 7fcf9effd640 1 --2- 172.21.15.88:0/3806692783 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcf90004800 0x7fcf90004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:47.187 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.157+0000 7fd0327fc640 1 --2- 172.21.15.88:0/4286218503 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd02c04b110 0x7fd02c006ea0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fd02c045d80 tx=0x7fd02402a130 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8ddf50dec8f1da88 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:47.188 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.158+0000 7fcf9ffff640 1 --2- 172.21.15.88:0/3806692783 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcf900053c0 0x7fcf900141d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:47.188 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.157+0000 7f80e2d9d640 1 --2- 172.21.15.88:0/334822378 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f80d00039b0 0x7f80d0003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:47.188 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.158+0000 7f5e92d9d640 1 -- 172.21.15.88:0/2681413558 reap_dead start 2024-04-26T23:40:47.189 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.158+0000 7fcf9f7fe640 1 -- 172.21.15.88:0/3806692783 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcf90004800 msgr2=0x7fcf90004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:40:47.189 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.158+0000 7fcf9f7fe640 1 --2- 172.21.15.88:0/3806692783 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcf90004800 0x7fcf90004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:47.189 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.158+0000 7fcf9f7fe640 1 -- 172.21.15.88:0/3806692783 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcf900053c0 msgr2=0x7fcf900141d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:40:47.189 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.158+0000 7fcf9f7fe640 1 --2- 172.21.15.88:0/3806692783 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcf900053c0 0x7fcf900141d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:47.189 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.158+0000 7fcf9f7fe640 1 -- 172.21.15.88:0/3806692783 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf90003520 con 0x7fcf900039b0 2024-04-26T23:40:47.189 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.158+0000 7fcf9ffff640 1 -- 172.21.15.88:0/3806692783 reap_dead start 2024-04-26T23:40:47.189 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.157+0000 7f3eb2d9d640 1 -- 172.21.15.88:0/4260255903 >> v1:172.21.15.175:6789/0 conn(0x7f3eac04b140 legacy=0x7f3eac006ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:47.189 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.157+0000 7f3eb2d9d640 1 -- 172.21.15.88:0/4260255903 >> v1:172.21.15.88:6789/0 conn(0x7f3eac0d3b70 legacy=0x7f3eac046b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:40:47.190 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.157+0000 7f3eb2d9d640 1 -- 172.21.15.88:0/4260255903 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3eac0da530 con 0x7f3eac0d6740 2024-04-26T23:40:47.190 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.158+0000 7f5e92d9d640 1 --2- 172.21.15.88:0/2681413558 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5e7c0051c0 0x7f5e7c00b9c0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f5e84003db0 tx=0x7f5e7c005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d242893353746b8d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:47.190 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.158+0000 7f5e9159a640 1 -- 172.21.15.88:0/2681413558 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e84003980 con 0x7f5e7c0051c0 2024-04-26T23:40:47.190 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.158+0000 7f5e9159a640 1 -- 172.21.15.88:0/2681413558 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e84007240 con 0x7f5e7c0051c0 2024-04-26T23:40:47.190 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.158+0000 7f5e9159a640 1 -- 172.21.15.88:0/2681413558 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e84007630 con 0x7f5e7c0051c0 2024-04-26T23:40:47.191 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.158+0000 7f3eb2d9d640 1 --2- 172.21.15.88:0/4260255903 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3eac0d6740 0x7f3eac0d6bf0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f3eb406bac0 tx=0x7f3eb40a8f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5521126287f915e4 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:47.191 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.158+0000 7f8c4ffff640 1 --2- 172.21.15.88:0/3682048070 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8c500c43e0 0x7f8c500c2bd0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f8c48009dc0 tx=0x7f8c4802a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75ddecbb224be033 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:47.191 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.158+0000 7f8c4f7fe640 1 -- 172.21.15.88:0/3682048070 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c48007740 con 0x7f8c500c43e0 2024-04-26T23:40:47.191 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.159+0000 7f8c4f7fe640 1 -- 172.21.15.88:0/3682048070 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c480078e0 con 0x7f8c500c43e0 2024-04-26T23:40:47.191 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.159+0000 7f8c4f7fe640 1 -- 172.21.15.88:0/3682048070 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c48007cb0 con 0x7f8c500c43e0 2024-04-26T23:40:47.191 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.158+0000 7f170559a640 1 -- 172.21.15.88:0/2459871329 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17080af8b0 con 0x7f170000b2e0 2024-04-26T23:40:47.192 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.158+0000 7f170ceda640 1 -- 172.21.15.88:0/2459871329 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f170000b2e0 msgr2=0x7f17000d5500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:47.192 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.158+0000 7f170ceda640 1 --2- 172.21.15.88:0/2459871329 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f170000b2e0 0x7f17000d5500 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f170806acf0 tx=0x7f17080a71f0 comp rx=0 tx=0).stop 2024-04-26T23:40:47.192 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.158+0000 7f170ceda640 1 -- 172.21.15.88:0/2459871329 shutdown_connections 2024-04-26T23:40:47.192 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.158+0000 7f170ceda640 1 --2- 172.21.15.88:0/2459871329 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f170000b2e0 0x7f17000d5500 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:47.192 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.158+0000 7f80e359e640 1 -- 172.21.15.88:0/334822378 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f80dc0d5850 msgr2=0x7f80d0004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:40:47.192 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.158+0000 7f80e359e640 1 --2- 172.21.15.88:0/334822378 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f80dc0d5850 0x7f80d0004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:47.192 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.158+0000 7f80e359e640 1 -- 172.21.15.88:0/334822378 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f80d00039b0 msgr2=0x7f80d0003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:40:47.192 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.158+0000 7f80e359e640 1 --2- 172.21.15.88:0/334822378 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f80d00039b0 0x7f80d0003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:47.192 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.159+0000 7fd031ffb640 1 -- 172.21.15.88:0/4286218503 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd024037070 con 0x7fd02c04b110 2024-04-26T23:40:47.193 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.158+0000 7f170ceda640 1 -- 172.21.15.88:0/2459871329 >> 172.21.15.88:0/2459871329 conn(0x7f1700048ab0 msgr2=0x7f1700048ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:40:47.193 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.158+0000 7f80e359e640 1 -- 172.21.15.88:0/334822378 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80d0003520 con 0x7f80d0004d40 2024-04-26T23:40:47.193 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.159+0000 7fd031ffb640 1 -- 172.21.15.88:0/4286218503 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd024032440 con 0x7fd02c04b110 2024-04-26T23:40:47.194 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.159+0000 7f3eb159a640 1 -- 172.21.15.88:0/4260255903 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3eb40af070 con 0x7f3eac0d6740 2024-04-26T23:40:47.194 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.159+0000 7f80a898b640 1 --2- 172.21.15.88:0/4227902137 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f80a40acc50 0x7f80a4074530 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f80a0009870 tx=0x7f80a002a280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddb6bb6698bb54b0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:47.194 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.159+0000 7f3eb159a640 1 -- 172.21.15.88:0/4260255903 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3eb40a9d80 con 0x7f3eac0d6740 2024-04-26T23:40:47.194 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.159+0000 7fd031ffb640 1 -- 172.21.15.88:0/4286218503 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd024032850 con 0x7fd02c04b110 2024-04-26T23:40:47.195 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.159+0000 7f80e359e640 1 --2- 172.21.15.88:0/334822378 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f80d0004d40 0x7f80d00051c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f80dc0329a0 tx=0x7f80d0005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c999f30d0de3480a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:47.195 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.159+0000 7f3eb159a640 1 -- 172.21.15.88:0/4260255903 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3eb40b3600 con 0x7f3eac0d6740 2024-04-26T23:40:47.195 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.159+0000 7f170ceda640 1 -- 172.21.15.88:0/2459871329 shutdown_connections 2024-04-26T23:40:47.196 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.159+0000 7f809bfff640 1 -- 172.21.15.88:0/4227902137 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80a0037070 con 0x7f80a40acc50 2024-04-26T23:40:47.196 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.159+0000 7f809bfff640 1 -- 172.21.15.88:0/4227902137 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80a0032440 con 0x7f80a40acc50 2024-04-26T23:40:47.196 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.159+0000 7f809bfff640 1 -- 172.21.15.88:0/4227902137 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80a0032810 con 0x7f80a40acc50 2024-04-26T23:40:47.196 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.159+0000 7f5e98a25640 1 -- 172.21.15.88:0/2681413558 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5e7c0051c0 msgr2=0x7f5e7c00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:47.196 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.159+0000 7f5e98a25640 1 --2- 172.21.15.88:0/2681413558 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5e7c0051c0 0x7f5e7c00b9c0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f5e84003db0 tx=0x7f5e7c005830 comp rx=0 tx=0).stop 2024-04-26T23:40:47.196 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.159+0000 7fcf9f7fe640 1 --2- 172.21.15.88:0/3806692783 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcf900039b0 0x7fcf90003dd0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fcfa0051fc0 tx=0x7fcf90005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=487e4ed896dce50a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:47.197 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.159+0000 7f170ceda640 1 -- 172.21.15.88:0/2459871329 wait complete. 2024-04-26T23:40:47.197 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.159+0000 7f80e1d9b640 1 -- 172.21.15.88:0/334822378 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80e40b8070 con 0x7f80d0004d40 2024-04-26T23:40:47.197 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.159+0000 7f80e1d9b640 1 -- 172.21.15.88:0/334822378 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80e406e650 con 0x7f80d0004d40 2024-04-26T23:40:47.197 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.159+0000 7f80e1d9b640 1 -- 172.21.15.88:0/334822378 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80e4069750 con 0x7f80d0004d40 2024-04-26T23:40:47.197 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.159+0000 7f5e98a25640 1 -- 172.21.15.88:0/2681413558 shutdown_connections 2024-04-26T23:40:47.197 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.159+0000 7f5e98a25640 1 --2- 172.21.15.88:0/2681413558 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5e7c0051c0 0x7f5e7c00b9c0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:47.197 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.159+0000 7f5e98a25640 1 -- 172.21.15.88:0/2681413558 >> 172.21.15.88:0/2681413558 conn(0x7f5e940c52a0 msgr2=0x7f5e940c56b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:40:47.198 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.159+0000 7fcf9e7fc640 1 -- 172.21.15.88:0/3806692783 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfa00515b0 con 0x7fcf900039b0 2024-04-26T23:40:47.198 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.159+0000 7fcf9e7fc640 1 -- 172.21.15.88:0/3806692783 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcfa00a7d50 con 0x7fcf900039b0 2024-04-26T23:40:47.198 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.159+0000 7fcf9e7fc640 1 -- 172.21.15.88:0/3806692783 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfa00af640 con 0x7fcf900039b0 2024-04-26T23:40:47.198 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.159+0000 7f5e98a25640 1 -- 172.21.15.88:0/2681413558 shutdown_connections 2024-04-26T23:40:47.198 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.160+0000 7f8c57122640 1 -- 172.21.15.88:0/3682048070 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8c500c43e0 msgr2=0x7f8c500c2bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:47.199 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.160+0000 7f8c57122640 1 --2- 172.21.15.88:0/3682048070 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8c500c43e0 0x7f8c500c2bd0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f8c48009dc0 tx=0x7f8c4802a5f0 comp rx=0 tx=0).stop 2024-04-26T23:40:47.199 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.160+0000 7fd033fff640 1 -- 172.21.15.88:0/4286218503 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd02c04b110 msgr2=0x7fd02c006ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:47.199 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.160+0000 7fd033fff640 1 --2- 172.21.15.88:0/4286218503 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd02c04b110 0x7fd02c006ea0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fd02c045d80 tx=0x7fd02402a130 comp rx=0 tx=0).stop 2024-04-26T23:40:47.199 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.160+0000 7f8c57122640 1 -- 172.21.15.88:0/3682048070 shutdown_connections 2024-04-26T23:40:47.199 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.160+0000 7f8c57122640 1 --2- 172.21.15.88:0/3682048070 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8c500c43e0 0x7f8c500c2bd0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:47.199 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.160+0000 7f8c57122640 1 --2- 172.21.15.88:0/3682048070 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8c5006f750 0x7f8c500c1600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:47.199 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.160+0000 7f8c57122640 1 -- 172.21.15.88:0/3682048070 >> 172.21.15.88:0/3682048070 conn(0x7f8c500c81d0 msgr2=0x7f8c500c85b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:40:47.200 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.160+0000 7f3eb8f46640 1 -- 172.21.15.88:0/4260255903 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3eac0d6740 msgr2=0x7f3eac0d6bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:47.200 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.160+0000 7f3eb8f46640 1 --2- 172.21.15.88:0/4260255903 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3eac0d6740 0x7f3eac0d6bf0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f3eb406bac0 tx=0x7f3eb40a8f30 comp rx=0 tx=0).stop 2024-04-26T23:40:47.200 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.160+0000 7f80aa18e640 1 -- 172.21.15.88:0/4227902137 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f80a40acc50 msgr2=0x7f80a4074530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:47.200 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.160+0000 7f80aa18e640 1 --2- 172.21.15.88:0/4227902137 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f80a40acc50 0x7f80a4074530 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f80a0009870 tx=0x7f80a002a280 comp rx=0 tx=0).stop 2024-04-26T23:40:47.201 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.160+0000 7f3eb8f46640 1 -- 172.21.15.88:0/4260255903 shutdown_connections 2024-04-26T23:40:47.201 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.160+0000 7f3eb8f46640 1 --2- 172.21.15.88:0/4260255903 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3eac0d6740 0x7f3eac0d6bf0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:47.201 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.160+0000 7f3eb8f46640 1 -- 172.21.15.88:0/4260255903 >> 172.21.15.88:0/4260255903 conn(0x7f3eac048280 msgr2=0x7f3eac048690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:40:47.201 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.159+0000 7f5e98a25640 1 -- 172.21.15.88:0/2681413558 wait complete. 2024-04-26T23:40:47.202 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.160+0000 7fd033fff640 1 -- 172.21.15.88:0/4286218503 shutdown_connections 2024-04-26T23:40:47.202 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.160+0000 7f80aa18e640 1 -- 172.21.15.88:0/4227902137 shutdown_connections 2024-04-26T23:40:47.202 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.160+0000 7f80aa18e640 1 --2- 172.21.15.88:0/4227902137 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f80a40acc50 0x7f80a4074530 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:47.202 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.160+0000 7f80aa18e640 1 -- 172.21.15.88:0/4227902137 >> 172.21.15.88:0/4227902137 conn(0x7f80a4073630 msgr2=0x7f80a4073a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:40:47.202 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.160+0000 7fd033fff640 1 --2- 172.21.15.88:0/4286218503 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd02c04b110 0x7fd02c006ea0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:47.202 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.160+0000 7fd033fff640 1 --2- 172.21.15.88:0/4286218503 >> v2:172.21.15.88:3300/0 conn(0x7fd02c0d3b40 0x7fd02c046b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:47.202 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.160+0000 7fd033fff640 1 -- 172.21.15.88:0/4286218503 >> 172.21.15.88:0/4286218503 conn(0x7fd02c048250 msgr2=0x7fd02c048660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:40:47.203 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.160+0000 7f80e90f9640 1 -- 172.21.15.88:0/334822378 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f80d0004d40 msgr2=0x7f80d00051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:47.203 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.160+0000 7f80e90f9640 1 --2- 172.21.15.88:0/334822378 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f80d0004d40 0x7f80d00051c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f80dc0329a0 tx=0x7f80d0005830 comp rx=0 tx=0).stop 2024-04-26T23:40:47.203 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.160+0000 7fcfa61af640 1 -- 172.21.15.88:0/3806692783 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcf900039b0 msgr2=0x7fcf90003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:47.203 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.160+0000 7fcfa61af640 1 --2- 172.21.15.88:0/3806692783 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcf900039b0 0x7fcf90003dd0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fcfa0051fc0 tx=0x7fcf90005830 comp rx=0 tx=0).stop 2024-04-26T23:40:47.203 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.160+0000 7f80e359e640 1 -- 172.21.15.88:0/334822378 reap_dead start 2024-04-26T23:40:47.204 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.160+0000 7f8c57122640 1 -- 172.21.15.88:0/3682048070 shutdown_connections 2024-04-26T23:40:47.204 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.160+0000 7f80aa18e640 1 -- 172.21.15.88:0/4227902137 shutdown_connections 2024-04-26T23:40:47.204 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.160+0000 7fd033fff640 1 -- 172.21.15.88:0/4286218503 shutdown_connections 2024-04-26T23:40:47.204 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.160+0000 7fd033fff640 1 -- 172.21.15.88:0/4286218503 wait complete. 2024-04-26T23:40:47.205 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.160+0000 7f8c57122640 1 -- 172.21.15.88:0/3682048070 wait complete. 2024-04-26T23:40:47.205 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.160+0000 7f80e90f9640 1 -- 172.21.15.88:0/334822378 shutdown_connections 2024-04-26T23:40:47.205 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.160+0000 7f80e90f9640 1 -- 172.21.15.88:0/334822378 >> 172.21.15.88:0/334822378 conn(0x7f80dc049330 msgr2=0x7f80dc049740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:40:47.205 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.160+0000 7f80aa18e640 1 -- 172.21.15.88:0/4227902137 wait complete. 2024-04-26T23:40:47.205 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.161+0000 7fcfa61af640 1 -- 172.21.15.88:0/3806692783 shutdown_connections 2024-04-26T23:40:47.206 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.161+0000 7f3eb8f46640 1 -- 172.21.15.88:0/4260255903 shutdown_connections 2024-04-26T23:40:47.206 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.161+0000 7f3eb8f46640 1 -- 172.21.15.88:0/4260255903 wait complete. 2024-04-26T23:40:47.206 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.161+0000 7fcfa61af640 1 --2- 172.21.15.88:0/3806692783 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcf900039b0 0x7fcf90003dd0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:47.206 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.161+0000 7fcfa61af640 1 -- 172.21.15.88:0/3806692783 >> 172.21.15.88:0/3806692783 conn(0x7fcf98031720 msgr2=0x7fcf98031b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:40:47.207 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.161+0000 7f80e90f9640 1 -- 172.21.15.88:0/334822378 shutdown_connections 2024-04-26T23:40:47.207 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.161+0000 7f170ceda640 1 Processor -- start 2024-04-26T23:40:47.207 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.161+0000 7f170ceda640 1 -- start start 2024-04-26T23:40:47.207 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.161+0000 7f5e98a25640 1 Processor -- start 2024-04-26T23:40:47.208 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.161+0000 7f80e90f9640 1 -- 172.21.15.88:0/334822378 wait complete. 2024-04-26T23:40:47.208 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.162+0000 7fcfa61af640 1 -- 172.21.15.88:0/3806692783 shutdown_connections 2024-04-26T23:40:47.208 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.162+0000 7f80aa18e640 1 Processor -- start 2024-04-26T23:40:47.208 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.162+0000 7fd033fff640 1 Processor -- start 2024-04-26T23:40:47.209 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.162+0000 7f170ceda640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f170000b2e0 0x7f1700173f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:47.210 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.162+0000 7f170ceda640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f170002eea0 0x7f17000d5540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:47.210 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.162+0000 7f170ceda640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f170003f6c0 0x7f17000448e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:47.210 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.162+0000 7f170ceda640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f170004b340 con 0x7f170002eea0 2024-04-26T23:40:47.210 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.162+0000 7f170ceda640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f17000d8b40 con 0x7f170003f6c0 2024-04-26T23:40:47.210 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.162+0000 7f170ceda640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f17000481a0 con 0x7f170000b2e0 2024-04-26T23:40:47.210 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.162+0000 7f1705d9b640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f170002eea0 0x7f17000d5540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:47.210 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.162+0000 7f8c57122640 1 Processor -- start 2024-04-26T23:40:47.211 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.162+0000 7f1705d9b640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f170002eea0 0x7f17000d5540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:42052/0 (socket says 172.21.15.88:42052) 2024-04-26T23:40:47.211 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.162+0000 7f1705d9b640 1 -- 172.21.15.88:0/1280241584 learned_addr learned my addr 172.21.15.88:0/1280241584 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:40:47.211 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.163+0000 7f8c57122640 1 -- start start 2024-04-26T23:40:47.211 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.162+0000 7f1706d9d640 1 --2- 172.21.15.88:0/1280241584 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f170003f6c0 0x7f17000448e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:47.212 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.161+0000 7f5e98a25640 1 -- start start 2024-04-26T23:40:47.212 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.162+0000 7fd033fff640 1 -- start start 2024-04-26T23:40:47.212 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.163+0000 7f5e98a25640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5e7c0051c0 0x7f5e940a7660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:47.212 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.163+0000 7f5e98a25640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5e940747b0 0x7f5e941f0990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:47.213 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.163+0000 7f3eb8f46640 1 Processor -- start 2024-04-26T23:40:47.213 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.163+0000 7f1706d9d640 1 -- 172.21.15.88:0/1280241584 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f170000b2e0 msgr2=0x7f1700173f00 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-26T23:40:47.213 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.163+0000 7f1706d9d640 1 --2- 172.21.15.88:0/1280241584 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f170000b2e0 0x7f1700173f00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:47.213 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.163+0000 7f1706d9d640 1 -- 172.21.15.88:0/1280241584 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f170002eea0 msgr2=0x7f17000d5540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:47.213 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.163+0000 7f1706d9d640 1 --2- 172.21.15.88:0/1280241584 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f170002eea0 0x7f17000d5540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:47.213 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.163+0000 7f1706d9d640 1 -- 172.21.15.88:0/1280241584 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1700045ce0 con 0x7f170003f6c0 2024-04-26T23:40:47.214 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.163+0000 7f5e98a25640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5e941f0ed0 0x7f5e94071b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:47.214 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.163+0000 7f3eb8f46640 1 -- start start 2024-04-26T23:40:47.214 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.163+0000 7f80e90f9640 1 Processor -- start 2024-04-26T23:40:47.215 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.163+0000 7f5e98a25640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f5e9406f090 con 0x7f5e941f0ed0 2024-04-26T23:40:47.215 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.162+0000 7f80aa18e640 1 -- start start 2024-04-26T23:40:47.215 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.163+0000 7f80aa18e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f80a4074150 0x7f80a414e670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:47.215 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.163+0000 7f80e90f9640 1 -- start start 2024-04-26T23:40:47.216 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.163+0000 7f1706d9d640 1 --2- 172.21.15.88:0/1280241584 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f170003f6c0 0x7f17000448e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f16fc00c390 tx=0x7f16fc00c850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:47.216 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.163+0000 7f5e98a25640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f5e94156e40 con 0x7f5e7c0051c0 2024-04-26T23:40:47.216 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.163+0000 7f80aa18e640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f80a40acc50 0x7f80a40c9a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:47.217 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.163+0000 7f5e98a25640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f5e9415aa50 con 0x7f5e940747b0 2024-04-26T23:40:47.217 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.163+0000 7f5e9259c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5e7c0051c0 0x7f5e940a7660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:47.217 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.163+0000 7f16f6ffd640 1 -- 172.21.15.88:0/1280241584 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16fc017070 con 0x7f170003f6c0 2024-04-26T23:40:47.217 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.163+0000 7f5e9259c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5e7c0051c0 0x7f5e940a7660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.88:34212/0 (socket says 172.21.15.88:34212) 2024-04-26T23:40:47.217 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.163+0000 7f5e9259c640 1 -- 172.21.15.88:0/2355017728 learned_addr learned my addr 172.21.15.88:0/2355017728 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:40:47.218 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.163+0000 7fd033fff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd02c0073e0 0x7fd02c0d8be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:47.218 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.163+0000 7f80aa18e640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f80a40c66b0 0x7f80a41f0ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:47.218 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.163+0000 7f80a918c640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f80a4074150 0x7f80a414e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:47.218 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.163+0000 7f80a918c640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f80a4074150 0x7f80a414e670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.88:46184/0 (socket says 172.21.15.88:46184) 2024-04-26T23:40:47.218 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.164+0000 7f80a898b640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f80a40acc50 0x7f80a40c9a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:47.218 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.164+0000 7f80a898b640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f80a40acc50 0x7f80a40c9a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.88:34218/0 (socket says 172.21.15.88:34218) 2024-04-26T23:40:47.219 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.164+0000 7f80a918c640 1 -- 172.21.15.88:0/842053977 learned_addr learned my addr 172.21.15.88:0/842053977 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:40:47.219 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.164+0000 7fd033fff640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd02c04b110 0x7fd02c170620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:47.219 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.163+0000 7f16f6ffd640 1 -- 172.21.15.88:0/1280241584 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16fc005ce0 con 0x7f170003f6c0 2024-04-26T23:40:47.219 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.163+0000 7f16f6ffd640 1 -- 172.21.15.88:0/1280241584 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16fc0072d0 con 0x7f170003f6c0 2024-04-26T23:40:47.219 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.164+0000 7f170ceda640 1 -- 172.21.15.88:0/1280241584 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1700045fc0 con 0x7f170003f6c0 2024-04-26T23:40:47.219 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.164+0000 7f170ceda640 1 -- 172.21.15.88:0/1280241584 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1700173700 con 0x7f170003f6c0 2024-04-26T23:40:47.220 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.164+0000 7f80aa18e640 1 -- 172.21.15.88:0/842053977 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f80a415ae30 con 0x7f80a40c66b0 2024-04-26T23:40:47.220 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.164+0000 7fd033fff640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd02c0d3b40 0x7fd02c17d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:47.220 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.164+0000 7fd032ffd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd02c0073e0 0x7fd02c0d8be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:47.220 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.164+0000 7fd0327fc640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd02c04b110 0x7fd02c170620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:47.221 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.164+0000 7f80aa18e640 1 -- 172.21.15.88:0/842053977 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f80a40c5fd0 con 0x7f80a40acc50 2024-04-26T23:40:47.221 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.164+0000 7f80aa18e640 1 -- 172.21.15.88:0/842053977 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f80a415bd00 con 0x7f80a4074150 2024-04-26T23:40:47.221 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.164+0000 7f8c57122640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8c5006f750 0x7f8c501e1230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:47.221 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.164+0000 7f80a998d640 1 --2- 172.21.15.88:0/842053977 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f80a40c66b0 0x7f80a41f0ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:47.222 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.164+0000 7f8c57122640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8c500ad250 0x7f8c501edca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:47.222 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.164+0000 7f8c57122640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8c500c43e0 0x7f8c501e22a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:47.222 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.164+0000 7fd0327fc640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd02c04b110 0x7fd02c170620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.88:46200/0 (socket says 172.21.15.88:46200) 2024-04-26T23:40:47.222 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.164+0000 7fd032ffd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd02c0073e0 0x7fd02c0d8be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:42092/0 (socket says 172.21.15.88:42092) 2024-04-26T23:40:47.223 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.164+0000 7f8c57122640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f8c50157840 con 0x7f8c5006f750 2024-04-26T23:40:47.223 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.164+0000 7f8c57122640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f8c50156a30 con 0x7f8c500ad250 2024-04-26T23:40:47.223 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.164+0000 7f8c57122640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f8c501579c0 con 0x7f8c500c43e0 2024-04-26T23:40:47.223 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.164+0000 7f80a898b640 1 -- 172.21.15.88:0/842053977 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f80a4074150 msgr2=0x7f80a414e670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:47.223 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.164+0000 7f8c556bf640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8c500c43e0 0x7f8c501e22a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:47.224 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.164+0000 7f8c556bf640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8c500c43e0 0x7f8c501e22a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.88:46212/0 (socket says 172.21.15.88:46212) 2024-04-26T23:40:47.224 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.164+0000 7f8c556bf640 1 -- 172.21.15.88:0/2106065146 learned_addr learned my addr 172.21.15.88:0/2106065146 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:40:47.224 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.164+0000 7f80a898b640 1 --2- 172.21.15.88:0/842053977 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f80a4074150 0x7f80a414e670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:47.224 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.164+0000 7fd0327fc640 1 -- 172.21.15.88:0/1960191763 learned_addr learned my addr 172.21.15.88:0/1960191763 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:40:47.224 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.164+0000 7f80a898b640 1 -- 172.21.15.88:0/842053977 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f80a40c66b0 msgr2=0x7f80a41f0ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:47.225 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.164+0000 7fd033fff640 1 -- 172.21.15.88:0/1960191763 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fd02c0d9930 con 0x7fd02c0073e0 2024-04-26T23:40:47.225 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.164+0000 7fd033fff640 1 -- 172.21.15.88:0/1960191763 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fd02c0da7e0 con 0x7fd02c0d3b40 2024-04-26T23:40:47.225 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.164+0000 7fd033fff640 1 -- 172.21.15.88:0/1960191763 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fd02c0d3f20 con 0x7fd02c04b110 2024-04-26T23:40:47.225 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.164+0000 7f5e9259c640 1 -- 172.21.15.88:0/2355017728 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5e940747b0 msgr2=0x7f5e941f0990 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-26T23:40:47.225 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.164+0000 7f5e9259c640 1 --2- 172.21.15.88:0/2355017728 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5e940747b0 0x7f5e941f0990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:47.226 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.165+0000 7f80e90f9640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f80d0004d40 0x7f80dc02f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:47.226 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.165+0000 7f3eb8f46640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3eac04b140 0x7f3eac16c420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:47.226 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.164+0000 7f5e9259c640 1 -- 172.21.15.88:0/2355017728 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5e941f0ed0 msgr2=0x7f5e94071b40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T23:40:47.226 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.164+0000 7f5e92d9d640 1 --2- 172.21.15.88:0/2355017728 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5e941f0ed0 0x7f5e94071b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:47.226 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.164+0000 7f5e9259c640 1 --2- 172.21.15.88:0/2355017728 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5e941f0ed0 0x7f5e94071b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:47.226 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.164+0000 7f5e9259c640 1 -- 172.21.15.88:0/2355017728 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e941f4860 con 0x7f5e7c0051c0 2024-04-26T23:40:47.227 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.164+0000 7f5e92d9d640 1 --2- 172.21.15.88:0/2355017728 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5e941f0ed0 0x7f5e94071b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:40:47.227 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.164+0000 7f5e9259c640 1 --2- 172.21.15.88:0/2355017728 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5e7c0051c0 0x7f5e940a7660 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f5e8c00cad0 tx=0x7f5e8c00cf90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:47.227 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.165+0000 7f8c4ffff640 1 --2- 172.21.15.88:0/2106065146 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8c500ad250 0x7f8c501edca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:47.227 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.165+0000 7f80a898b640 1 --2- 172.21.15.88:0/842053977 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f80a40c66b0 0x7f80a41f0ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:47.227 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.165+0000 7f80e90f9640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f80dc031010 0x7f80dc04a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:47.228 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.165+0000 7f80a898b640 1 -- 172.21.15.88:0/842053977 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80a40ac7e0 con 0x7f80a40acc50 2024-04-26T23:40:47.228 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.165+0000 7f80a998d640 1 --2- 172.21.15.88:0/842053977 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f80a40c66b0 0x7f80a41f0ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:40:47.228 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.165+0000 7f80e2d9d640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f80d0004d40 0x7f80dc02f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:47.228 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.165+0000 7f80e2d9d640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f80d0004d40 0x7f80dc02f4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.88:46222/0 (socket says 172.21.15.88:46222) 2024-04-26T23:40:47.229 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.165+0000 7fd0337fe640 1 --2- 172.21.15.88:0/1960191763 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd02c0d3b40 0x7fd02c17d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:47.229 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.165+0000 7f5e82ffd640 1 -- 172.21.15.88:0/2355017728 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e8c018070 con 0x7f5e7c0051c0 2024-04-26T23:40:47.229 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.165+0000 7f5e82ffd640 1 -- 172.21.15.88:0/2355017728 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e8c00a7c0 con 0x7f5e7c0051c0 2024-04-26T23:40:47.230 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.165+0000 7f80e2d9d640 1 -- 172.21.15.88:0/586617963 learned_addr learned my addr 172.21.15.88:0/586617963 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:40:47.230 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.165+0000 7f80e90f9640 1 --2- 172.21.15.88:0/586617963 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f80dc04c280 0x7f80dc174dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:47.230 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.165+0000 7f80e259c640 1 --2- 172.21.15.88:0/586617963 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f80dc031010 0x7f80dc04a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:47.230 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.165+0000 7f170ceda640 1 -- 172.21.15.88:0/1280241584 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f16ec001030 con 0x7f170003f6c0 2024-04-26T23:40:47.230 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.165+0000 7f80a898b640 1 --2- 172.21.15.88:0/842053977 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f80a40acc50 0x7f80a40c9a10 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f80a4073170 tx=0x7f80a00046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:47.231 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.165+0000 7f80e90f9640 1 -- 172.21.15.88:0/586617963 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f80dc032140 con 0x7f80dc04c280 2024-04-26T23:40:47.231 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.165+0000 7f80e90f9640 1 -- 172.21.15.88:0/586617963 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f80dc0db650 con 0x7f80dc031010 2024-04-26T23:40:47.231 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.165+0000 7f80e90f9640 1 -- 172.21.15.88:0/586617963 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f80dc0322c0 con 0x7f80d0004d40 2024-04-26T23:40:47.231 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.165+0000 7fcfa61af640 1 -- 172.21.15.88:0/3806692783 wait complete. 2024-04-26T23:40:47.232 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.165+0000 7f80e359e640 1 --2- 172.21.15.88:0/586617963 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f80dc04c280 0x7f80dc174dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:47.232 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.165+0000 7fd0327fc640 1 -- 172.21.15.88:0/1960191763 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd02c0d3b40 msgr2=0x7fd02c17d390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:47.232 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.165+0000 7fd0327fc640 1 --2- 172.21.15.88:0/1960191763 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd02c0d3b40 0x7fd02c17d390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:47.232 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.165+0000 7fd0327fc640 1 -- 172.21.15.88:0/1960191763 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd02c0073e0 msgr2=0x7fd02c0d8be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:47.232 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.165+0000 7f8c54ebe640 1 --2- 172.21.15.88:0/2106065146 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8c5006f750 0x7f8c501e1230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:47.233 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.165+0000 7f8c556bf640 1 -- 172.21.15.88:0/2106065146 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8c500ad250 msgr2=0x7f8c501edca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:47.233 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.165+0000 7f8c556bf640 1 --2- 172.21.15.88:0/2106065146 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8c500ad250 0x7f8c501edca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:47.233 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.165+0000 7f8c556bf640 1 -- 172.21.15.88:0/2106065146 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8c5006f750 msgr2=0x7f8c501e1230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:47.233 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.165+0000 7f8c556bf640 1 --2- 172.21.15.88:0/2106065146 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8c5006f750 0x7f8c501e1230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:47.233 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.165+0000 7f8c556bf640 1 -- 172.21.15.88:0/2106065146 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c501e1770 con 0x7f8c500c43e0 2024-04-26T23:40:47.233 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.165+0000 7f8099ffb640 1 -- 172.21.15.88:0/842053977 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80a0041020 con 0x7f80a40acc50 2024-04-26T23:40:47.233 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.165+0000 7fd0327fc640 1 --2- 172.21.15.88:0/1960191763 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd02c0073e0 0x7fd02c0d8be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:47.233 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.165+0000 7fd0327fc640 1 -- 172.21.15.88:0/1960191763 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd02c172fe0 con 0x7fd02c04b110 2024-04-26T23:40:47.234 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.165+0000 7fd032ffd640 1 --2- 172.21.15.88:0/1960191763 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd02c0073e0 0x7fd02c0d8be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:40:47.234 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.165+0000 7f8099ffb640 1 -- 172.21.15.88:0/842053977 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80a0030970 con 0x7f80a40acc50 2024-04-26T23:40:47.234 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.165+0000 7f80aa18e640 1 -- 172.21.15.88:0/842053977 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80a414e390 con 0x7f80a40acc50 2024-04-26T23:40:47.234 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.165+0000 7f8c556bf640 1 --2- 172.21.15.88:0/2106065146 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8c500c43e0 0x7f8c501e22a0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f8c3c00c3c0 tx=0x7f8c3c00c880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:47.234 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.166+0000 7f8099ffb640 1 -- 172.21.15.88:0/842053977 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80a0037040 con 0x7f80a40acc50 2024-04-26T23:40:47.235 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.166+0000 7fd0327fc640 1 --2- 172.21.15.88:0/1960191763 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd02c04b110 0x7fd02c170620 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fd02402a720 tx=0x7fd0240046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:47.235 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.166+0000 7f5e82ffd640 1 -- 172.21.15.88:0/2355017728 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e8c00ab90 con 0x7f5e7c0051c0 2024-04-26T23:40:47.235 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.166+0000 7f16f6ffd640 1 -- 172.21.15.88:0/1280241584 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f16fc01a070 con 0x7f170003f6c0 2024-04-26T23:40:47.236 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.166+0000 7f5e98a25640 1 -- 172.21.15.88:0/2355017728 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e941f4b40 con 0x7f5e7c0051c0 2024-04-26T23:40:47.236 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.166+0000 7f8c4d7fa640 1 -- 172.21.15.88:0/2106065146 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c3c017070 con 0x7f8c500c43e0 2024-04-26T23:40:47.236 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.166+0000 7f8c4d7fa640 1 -- 172.21.15.88:0/2106065146 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c3c005ce0 con 0x7f8c500c43e0 2024-04-26T23:40:47.236 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.166+0000 7f8c4d7fa640 1 -- 172.21.15.88:0/2106065146 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c3c0072f0 con 0x7f8c500c43e0 2024-04-26T23:40:47.236 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.166+0000 7fd01bfff640 1 -- 172.21.15.88:0/1960191763 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd024037050 con 0x7fd02c04b110 2024-04-26T23:40:47.237 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.166+0000 7fd01bfff640 1 -- 172.21.15.88:0/1960191763 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd024043070 con 0x7fd02c04b110 2024-04-26T23:40:47.237 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.166+0000 7fd033fff640 1 -- 172.21.15.88:0/1960191763 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd02c0d7730 con 0x7fd02c04b110 2024-04-26T23:40:47.237 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.166+0000 7f16f6ffd640 1 --2- 172.21.15.88:0/1280241584 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f16e806c920 0x7f16e806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:47.237 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.166+0000 7fd033fff640 1 -- 172.21.15.88:0/1960191763 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fd02c17ce70 con 0x7fd02c04b110 2024-04-26T23:40:47.238 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.166+0000 7f8c57122640 1 -- 172.21.15.88:0/2106065146 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c501e0190 con 0x7f8c500c43e0 2024-04-26T23:40:47.238 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.167+0000 7f8c57122640 1 -- 172.21.15.88:0/2106065146 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c501e0750 con 0x7f8c500c43e0 2024-04-26T23:40:47.238 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.166+0000 7f16f6ffd640 1 -- 172.21.15.88:0/1280241584 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7f16fc08b000 con 0x7f170003f6c0 2024-04-26T23:40:47.239 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.167+0000 7f170659c640 1 --2- 172.21.15.88:0/1280241584 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f16e806c920 0x7f16e806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:47.239 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.167+0000 7f16f6ffd640 1 --2- 172.21.15.88:0/1280241584 >> [v2:172.21.15.175:6816/3824112919,v1:172.21.15.175:6819/3824112919] conn(0x7f16e80771b0 0x7f16e80795d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:47.239 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.167+0000 7f16f6ffd640 1 -- 172.21.15.88:0/1280241584 --> [v2:172.21.15.175:6816/3824112919,v1:172.21.15.175:6819/3824112919] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f16fc013e50 con 0x7f16e80771b0 2024-04-26T23:40:47.239 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.167+0000 7f16f6ffd640 1 -- 172.21.15.88:0/1280241584 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f16fc08d600 con 0x7f170003f6c0 2024-04-26T23:40:47.239 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.167+0000 7f80aa18e640 1 -- 172.21.15.88:0/842053977 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80a41e6950 con 0x7f80a40acc50 2024-04-26T23:40:47.239 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.167+0000 7f1705d9b640 1 --2- 172.21.15.88:0/1280241584 >> [v2:172.21.15.175:6816/3824112919,v1:172.21.15.175:6819/3824112919] conn(0x7f16e80771b0 0x7f16e80795d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:47.240 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.166+0000 7f5e98a25640 1 -- 172.21.15.88:0/2355017728 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e940738c0 con 0x7f5e7c0051c0 2024-04-26T23:40:47.240 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.167+0000 7fcfa61af640 1 Processor -- start 2024-04-26T23:40:47.240 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.166+0000 7f80e359e640 1 -- 172.21.15.88:0/586617963 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f80d0004d40 msgr2=0x7f80dc02f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:47.240 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.166+0000 7f80e359e640 1 --2- 172.21.15.88:0/586617963 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f80d0004d40 0x7f80dc02f4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:47.240 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.166+0000 7f80e359e640 1 -- 172.21.15.88:0/586617963 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f80dc031010 msgr2=0x7f80dc04a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:47.240 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.166+0000 7f80e359e640 1 --2- 172.21.15.88:0/586617963 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f80dc031010 0x7f80dc04a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:47.240 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.166+0000 7f80e359e640 1 -- 172.21.15.88:0/586617963 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80dc009390 con 0x7f80dc04c280 2024-04-26T23:40:47.241 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.166+0000 7f80e359e640 1 --2- 172.21.15.88:0/586617963 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f80dc04c280 0x7f80dc174dc0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f80e4076d60 tx=0x7f80e40661d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:47.241 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.168+0000 7fd01bfff640 1 -- 172.21.15.88:0/1960191763 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd024030d40 con 0x7fd02c04b110 2024-04-26T23:40:47.241 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.168+0000 7fcfa61af640 1 -- start start 2024-04-26T23:40:47.241 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.168+0000 7f170659c640 1 --2- 172.21.15.88:0/1280241584 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f16e806c920 0x7f16e806ede0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f1700049a50 tx=0x7f17080ab000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:47.242 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.168+0000 7f80db7fe640 1 -- 172.21.15.88:0/586617963 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80e40b8070 con 0x7f80dc04c280 2024-04-26T23:40:47.242 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.168+0000 7f80db7fe640 1 -- 172.21.15.88:0/586617963 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80e4050be0 con 0x7f80dc04c280 2024-04-26T23:40:47.242 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.168+0000 7f8c57122640 1 -- 172.21.15.88:0/2106065146 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f8c500506c0 con 0x7f8c500c43e0 2024-04-26T23:40:47.242 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.168+0000 7f5e98a25640 1 -- 172.21.15.88:0/2355017728 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f5e940506c0 con 0x7f5e7c0051c0 2024-04-26T23:40:47.243 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.168+0000 7f8099ffb640 1 -- 172.21.15.88:0/842053977 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f80a0044020 con 0x7f80a40acc50 2024-04-26T23:40:47.243 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.168+0000 7f80aa18e640 1 -- 172.21.15.88:0/842053977 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f80a40506c0 con 0x7f80a40acc50 2024-04-26T23:40:47.243 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.168+0000 7fd033fff640 1 -- 172.21.15.88:0/1960191763 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd02c005390 con 0x7fd02c04b110 2024-04-26T23:40:47.243 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.168+0000 7f5e82ffd640 1 -- 172.21.15.88:0/2355017728 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f5e8c01b070 con 0x7f5e7c0051c0 2024-04-26T23:40:47.244 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.169+0000 7fcfa61af640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcf900039b0 0x7fcf9817d740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:47.244 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.169+0000 7f80db7fe640 1 -- 172.21.15.88:0/586617963 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80e40694b0 con 0x7f80dc04c280 2024-04-26T23:40:47.244 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.169+0000 7fcfa61af640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcf980491c0 0x7fcf98049640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:47.244 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.169+0000 7f5e82ffd640 1 --2- 172.21.15.88:0/2355017728 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f5e7406c940 0x7f5e7406ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:47.245 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.169+0000 7f80e90f9640 1 -- 172.21.15.88:0/586617963 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80dc0d9660 con 0x7f80dc04c280 2024-04-26T23:40:47.245 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.169+0000 7fcfa61af640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcf98047140 0x7fcf980475c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:47.245 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.169+0000 7fcf9f7fe640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcf900039b0 0x7fcf9817d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:47.245 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.169+0000 7fcf9f7fe640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcf900039b0 0x7fcf9817d740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.88:46230/0 (socket says 172.21.15.88:46230) 2024-04-26T23:40:47.245 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.169+0000 7fcf9effd640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcf980491c0 0x7fcf98049640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:47.245 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.169+0000 7fcf9effd640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcf980491c0 0x7fcf98049640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.88:34276/0 (socket says 172.21.15.88:34276) 2024-04-26T23:40:47.246 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.169+0000 7f5e82ffd640 1 -- 172.21.15.88:0/2355017728 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7f5e8c08b730 con 0x7f5e7c0051c0 2024-04-26T23:40:47.246 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.169+0000 7f5e91d9b640 1 --2- 172.21.15.88:0/2355017728 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f5e7406c940 0x7f5e7406ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:47.246 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.169+0000 7fcf9f7fe640 1 -- 172.21.15.88:0/3139927920 learned_addr learned my addr 172.21.15.88:0/3139927920 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:40:47.246 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.169+0000 7fcfa61af640 1 -- 172.21.15.88:0/3139927920 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fcf980db0b0 con 0x7fcf98047140 2024-04-26T23:40:47.247 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.169+0000 7fcfa61af640 1 -- 172.21.15.88:0/3139927920 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fcf980dadd0 con 0x7fcf980491c0 2024-04-26T23:40:47.247 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.169+0000 7fcfa61af640 1 -- 172.21.15.88:0/3139927920 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fcf98032360 con 0x7fcf900039b0 2024-04-26T23:40:47.247 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.169+0000 7f5e82ffd640 1 --2- 172.21.15.88:0/2355017728 >> [v2:172.21.15.175:6817/3319361162,v1:172.21.15.175:6818/3319361162] conn(0x7f5e740771d0 0x7f5e740795f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:47.247 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.169+0000 7f5e82ffd640 1 -- 172.21.15.88:0/2355017728 --> [v2:172.21.15.175:6817/3319361162,v1:172.21.15.175:6818/3319361162] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5e8c021e50 con 0x7f5e740771d0 2024-04-26T23:40:47.247 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.169+0000 7f5e82ffd640 1 -- 172.21.15.88:0/2355017728 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f5e8c092050 con 0x7f5e7c0051c0 2024-04-26T23:40:47.247 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.168+0000 7f3eb8f46640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3eac0d3b70 0x7f3eac030290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:47.248 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.169+0000 7fcf9ffff640 1 --2- 172.21.15.88:0/3139927920 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcf98047140 0x7fcf980475c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:47.248 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.168+0000 7f3eb8f46640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3eac0d6740 0x7f3eac03f330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:47.248 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.168+0000 7f3eb8f46640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f3eac0075e0 con 0x7f3eac04b140 2024-04-26T23:40:47.248 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.168+0000 7f3eb8f46640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f3eac0d9960 con 0x7f3eac0d3b70 2024-04-26T23:40:47.249 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.168+0000 7f3eb8f46640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f3eac007760 con 0x7f3eac0d6740 2024-04-26T23:40:47.249 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.168+0000 7f3eb259c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3eac04b140 0x7f3eac16c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:47.249 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.168+0000 7f3eb1d9b640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3eac0d3b70 0x7f3eac030290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:47.249 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.168+0000 7f3eb1d9b640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3eac0d3b70 0x7f3eac030290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.88:34266/0 (socket says 172.21.15.88:34266) 2024-04-26T23:40:47.249 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.168+0000 7f3eb1d9b640 1 -- 172.21.15.88:0/2474638527 learned_addr learned my addr 172.21.15.88:0/2474638527 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:40:47.249 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.169+0000 7f3eb1d9b640 1 -- 172.21.15.88:0/2474638527 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3eac0d6740 msgr2=0x7f3eac03f330 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T23:40:47.249 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.169+0000 7f3eb1d9b640 1 --2- 172.21.15.88:0/2474638527 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3eac0d6740 0x7f3eac03f330 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:47.249 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.169+0000 7f3eb1d9b640 1 -- 172.21.15.88:0/2474638527 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3eac04b140 msgr2=0x7f3eac16c420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:47.249 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.169+0000 7f3eb1d9b640 1 --2- 172.21.15.88:0/2474638527 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3eac04b140 0x7f3eac16c420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:47.249 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.169+0000 7f3eb1d9b640 1 -- 172.21.15.88:0/2474638527 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3eac16c960 con 0x7f3eac0d3b70 2024-04-26T23:40:47.249 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.169+0000 7f3eb1d9b640 1 --2- 172.21.15.88:0/2474638527 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3eac0d3b70 0x7f3eac030290 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f3ea8012fc0 tx=0x7f3ea8014420 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:47.249 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.169+0000 7f3ea2ffd640 1 -- 172.21.15.88:0/2474638527 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ea8001d30 con 0x7f3eac0d3b70 2024-04-26T23:40:47.249 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.170+0000 7f3ea2ffd640 1 -- 172.21.15.88:0/2474638527 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ea8014d40 con 0x7f3eac0d3b70 2024-04-26T23:40:47.250 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.169+0000 7f8099ffb640 1 --2- 172.21.15.88:0/842053977 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f808806c9c0 0x7f808806ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:47.250 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.169+0000 7f80a918c640 1 --2- 172.21.15.88:0/842053977 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f808806c9c0 0x7f808806ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:47.250 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.170+0000 7fcf9ffff640 1 -- 172.21.15.88:0/3139927920 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcf900039b0 msgr2=0x7fcf9817d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:47.251 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.170+0000 7fcf9ffff640 1 --2- 172.21.15.88:0/3139927920 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcf900039b0 0x7fcf9817d740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:47.251 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.170+0000 7fcf9ffff640 1 -- 172.21.15.88:0/3139927920 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcf980491c0 msgr2=0x7fcf98049640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:47.251 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.170+0000 7fcf9ffff640 1 --2- 172.21.15.88:0/3139927920 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcf980491c0 0x7fcf98049640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:47.251 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.170+0000 7fcf9ffff640 1 -- 172.21.15.88:0/3139927920 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf9800d880 con 0x7fcf98047140 2024-04-26T23:40:47.251 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.170+0000 7fcf9ffff640 1 --2- 172.21.15.88:0/3139927920 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcf98047140 0x7fcf980475c0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fcf9800ff70 tx=0x7fcf9400f8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:47.251 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.170+0000 7fd01bfff640 1 -- 172.21.15.88:0/1960191763 <== mon.2 v2:172.21.15.175:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd024065690 con 0x7fd02c04b110 2024-04-26T23:40:47.251 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.169+0000 7f1705d9b640 1 --2- 172.21.15.88:0/1280241584 >> [v2:172.21.15.175:6816/3824112919,v1:172.21.15.175:6819/3824112919] conn(0x7f16e80771b0 0x7f16e80795d0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:47.252 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.169+0000 7f8c4d7fa640 1 -- 172.21.15.88:0/2106065146 <== mon.2 v2:172.21.15.175:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8c3c01a070 con 0x7f8c500c43e0 2024-04-26T23:40:47.252 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.170+0000 7f8c4d7fa640 1 --2- 172.21.15.88:0/2106065146 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f8c3406c940 0x7f8c3406ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:47.252 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.170+0000 7f8c4d7fa640 1 -- 172.21.15.88:0/2106065146 <== mon.2 v2:172.21.15.175:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7f8c3c08b220 con 0x7f8c500c43e0 2024-04-26T23:40:47.252 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.170+0000 7f8c4d7fa640 1 --2- 172.21.15.88:0/2106065146 >> [v2:172.21.15.88:6808/648396269,v1:172.21.15.88:6809/648396269] conn(0x7f8c340771d0 0x7f8c340795f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:47.252 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.170+0000 7f8c4d7fa640 1 -- 172.21.15.88:0/2106065146 --> [v2:172.21.15.88:6808/648396269,v1:172.21.15.88:6809/648396269] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8c34079ca0 con 0x7f8c340771d0 2024-04-26T23:40:47.252 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.170+0000 7f8c4d7fa640 1 -- 172.21.15.88:0/2106065146 <== mon.2 v2:172.21.15.175:3301/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f8c3c08b700 con 0x7f8c500c43e0 2024-04-26T23:40:47.252 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.170+0000 7f8c4ffff640 1 --2- 172.21.15.88:0/2106065146 >> [v2:172.21.15.88:6808/648396269,v1:172.21.15.88:6809/648396269] conn(0x7f8c340771d0 0x7f8c340795f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:47.253 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.170+0000 7f8099ffb640 1 -- 172.21.15.88:0/842053977 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7f80a00abf90 con 0x7f80a40acc50 2024-04-26T23:40:47.253 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.171+0000 7f8099ffb640 1 --2- 172.21.15.88:0/842053977 >> [v2:172.21.15.88:6824/2328028922,v1:172.21.15.88:6825/2328028922] conn(0x7f80880771e0 0x7f8088079600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:47.253 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.171+0000 7f8c54ebe640 1 --2- 172.21.15.88:0/2106065146 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f8c3406c940 0x7f8c3406ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:47.253 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.171+0000 7f8099ffb640 1 -- 172.21.15.88:0/842053977 --> [v2:172.21.15.88:6824/2328028922,v1:172.21.15.88:6825/2328028922] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f80a0032440 con 0x7f80880771e0 2024-04-26T23:40:47.253 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.171+0000 7f8099ffb640 1 -- 172.21.15.88:0/842053977 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f80a0075d50 con 0x7f80a40acc50 2024-04-26T23:40:47.254 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.170+0000 7f5e92d9d640 1 --2- 172.21.15.88:0/2355017728 >> [v2:172.21.15.175:6817/3319361162,v1:172.21.15.175:6818/3319361162] conn(0x7f5e740771d0 0x7f5e740795f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:47.254 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.170+0000 7f5e91d9b640 1 --2- 172.21.15.88:0/2355017728 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f5e7406c940 0x7f5e7406ee00 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f5e94074bb0 tx=0x7f5e88008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:47.254 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.170+0000 7f5e92d9d640 1 --2- 172.21.15.88:0/2355017728 >> [v2:172.21.15.175:6817/3319361162,v1:172.21.15.175:6818/3319361162] conn(0x7f5e740771d0 0x7f5e740795f0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:47.254 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.170+0000 7f3ea2ffd640 1 -- 172.21.15.88:0/2474638527 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ea8012340 con 0x7f3eac0d3b70 2024-04-26T23:40:47.254 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.170+0000 7f3eb8f46640 1 -- 172.21.15.88:0/2474638527 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3eac041e90 con 0x7f3eac0d3b70 2024-04-26T23:40:47.254 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.170+0000 7f3eb8f46640 1 -- 172.21.15.88:0/2474638527 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3eac0430b0 con 0x7f3eac0d3b70 2024-04-26T23:40:47.255 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.171+0000 7fd01bfff640 1 --2- 172.21.15.88:0/1960191763 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fd02006c940 0x7fd02006ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:47.255 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.171+0000 7fd01bfff640 1 -- 172.21.15.88:0/1960191763 <== mon.2 v2:172.21.15.175:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7fd0240acda0 con 0x7fd02c04b110 2024-04-26T23:40:47.255 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.171+0000 7fd01bfff640 1 --2- 172.21.15.88:0/1960191763 >> [v2:172.21.15.175:6808/3929617402,v1:172.21.15.175:6809/3929617402] conn(0x7fd0200771d0 0x7fd0200795f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:47.255 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.171+0000 7fd01bfff640 1 -- 172.21.15.88:0/1960191763 --> [v2:172.21.15.175:6808/3929617402,v1:172.21.15.175:6809/3929617402] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd024032440 con 0x7fd0200771d0 2024-04-26T23:40:47.255 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.171+0000 7fd01bfff640 1 -- 172.21.15.88:0/1960191763 <== mon.2 v2:172.21.15.175:3301/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fd0240ad200 con 0x7fd02c04b110 2024-04-26T23:40:47.255 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.171+0000 7f80a998d640 1 --2- 172.21.15.88:0/842053977 >> [v2:172.21.15.88:6824/2328028922,v1:172.21.15.88:6825/2328028922] conn(0x7f80880771e0 0x7f8088079600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:47.255 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.171+0000 7f5e82ffd640 1 -- 172.21.15.88:0/2355017728 <== osd.7 v2:172.21.15.175:6817/3319361162 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f5e8c021e50 con 0x7f5e740771d0 2024-04-26T23:40:47.256 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.169+0000 7f80e90f9640 1 -- 172.21.15.88:0/586617963 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80dc1748a0 con 0x7f80dc04c280 2024-04-26T23:40:47.256 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.171+0000 7f80d97fa640 1 -- 172.21.15.88:0/586617963 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f80dc0d9410 con 0x7f80dc04c280 2024-04-26T23:40:47.256 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.171+0000 7f80a918c640 1 --2- 172.21.15.88:0/842053977 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f808806c9c0 0x7f808806ee80 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f809c007fd0 tx=0x7f809c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:47.256 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.171+0000 7fd032ffd640 1 --2- 172.21.15.88:0/1960191763 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fd02006c940 0x7fd02006ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:47.257 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.171+0000 7f8c4ffff640 1 --2- 172.21.15.88:0/2106065146 >> [v2:172.21.15.88:6808/648396269,v1:172.21.15.88:6809/648396269] conn(0x7f8c340771d0 0x7f8c340795f0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:47.257 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.170+0000 7fcf8bfff640 1 -- 172.21.15.88:0/3139927920 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf94004440 con 0x7fcf98047140 2024-04-26T23:40:47.257 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.170+0000 7fcf8bfff640 1 -- 172.21.15.88:0/3139927920 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf94019070 con 0x7fcf98047140 2024-04-26T23:40:47.257 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.172+0000 7fd0337fe640 1 --2- 172.21.15.88:0/1960191763 >> [v2:172.21.15.175:6808/3929617402,v1:172.21.15.175:6809/3929617402] conn(0x7fd0200771d0 0x7fd0200795f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:47.258 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.172+0000 7f16f6ffd640 1 -- 172.21.15.88:0/1280241584 <== osd.6 v2:172.21.15.175:6816/3824112919 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f16fc013e50 con 0x7f16e80771b0 2024-04-26T23:40:47.258 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.172+0000 7fcf9effd640 1 --2- 172.21.15.88:0/3139927920 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcf980491c0 0x7fcf98049640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:40:47.258 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.172+0000 7fd032ffd640 1 --2- 172.21.15.88:0/1960191763 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fd02006c940 0x7fd02006ee00 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fd02800ae90 tx=0x7fd028008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:47.259 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.172+0000 7fcf8bfff640 1 -- 172.21.15.88:0/3139927920 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf94003830 con 0x7fcf98047140 2024-04-26T23:40:47.259 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.172+0000 7f80db7fe640 1 -- 172.21.15.88:0/586617963 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f80e40c3060 con 0x7f80dc04c280 2024-04-26T23:40:47.259 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.172+0000 7fcfa61af640 1 -- 172.21.15.88:0/3139927920 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf9800db60 con 0x7fcf98047140 2024-04-26T23:40:47.259 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.172+0000 7fcfa61af640 1 -- 172.21.15.88:0/3139927920 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf98046700 con 0x7fcf98047140 2024-04-26T23:40:47.259 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.173+0000 7f80db7fe640 1 --2- 172.21.15.88:0/586617963 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f80c406c9c0 0x7f80c406ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:47.260 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.172+0000 7f8c4d7fa640 1 -- 172.21.15.88:0/2106065146 <== osd.2 v2:172.21.15.88:6808/648396269 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f8c34079ca0 con 0x7f8c340771d0 2024-04-26T23:40:47.260 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.173+0000 7f8c54ebe640 1 --2- 172.21.15.88:0/2106065146 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f8c3406c940 0x7f8c3406ee00 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f8c44006fd0 tx=0x7f8c44008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:47.260 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.173+0000 7fd0337fe640 1 --2- 172.21.15.88:0/1960191763 >> [v2:172.21.15.175:6808/3929617402,v1:172.21.15.175:6809/3929617402] conn(0x7fd0200771d0 0x7fd0200795f0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:47.260 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.173+0000 7f80e2d9d640 1 --2- 172.21.15.88:0/586617963 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f80c406c9c0 0x7f80c406ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:47.261 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.173+0000 7f80db7fe640 1 -- 172.21.15.88:0/586617963 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7f80e40515b0 con 0x7f80dc04c280 2024-04-26T23:40:47.261 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.171+0000 7f3eb8f46640 1 -- 172.21.15.88:0/2474638527 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f3eac0053c0 con 0x7f3eac0d3b70 2024-04-26T23:40:47.261 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.171+0000 7f80a998d640 1 --2- 172.21.15.88:0/842053977 >> [v2:172.21.15.88:6824/2328028922,v1:172.21.15.88:6825/2328028922] conn(0x7f80880771e0 0x7f8088079600 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:47.261 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.173+0000 7f8099ffb640 1 -- 172.21.15.88:0/842053977 <== osd.3 v2:172.21.15.88:6824/2328028922 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f80a0032440 con 0x7f80880771e0 2024-04-26T23:40:47.262 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.173+0000 7f80db7fe640 1 --2- 172.21.15.88:0/586617963 >> [v2:172.21.15.88:6800/2803186054,v1:172.21.15.88:6801/2803186054] conn(0x7f80c4077260 0x7f80c4079680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:47.262 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.173+0000 7f80e259c640 1 --2- 172.21.15.88:0/586617963 >> [v2:172.21.15.88:6800/2803186054,v1:172.21.15.88:6801/2803186054] conn(0x7f80c4077260 0x7f80c4079680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:47.262 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.173+0000 7f80db7fe640 1 -- 172.21.15.88:0/586617963 --> [v2:172.21.15.88:6800/2803186054,v1:172.21.15.88:6801/2803186054] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f80e4076550 con 0x7f80c4077260 2024-04-26T23:40:47.262 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.173+0000 7f80db7fe640 1 -- 172.21.15.88:0/586617963 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f80e412d2a0 con 0x7f80dc04c280 2024-04-26T23:40:47.262 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.173+0000 7fd01bfff640 1 -- 172.21.15.88:0/1960191763 <== osd.4 v2:172.21.15.175:6808/3929617402 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd024032440 con 0x7fd0200771d0 2024-04-26T23:40:47.263 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.174+0000 7f80e2d9d640 1 --2- 172.21.15.88:0/586617963 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f80c406c9c0 0x7f80c406ee80 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f80cc003660 tx=0x7f80cc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:47.263 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.174+0000 7fcf8bfff640 1 -- 172.21.15.88:0/3139927920 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fcf94012070 con 0x7fcf98047140 2024-04-26T23:40:47.263 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.174+0000 7f80e259c640 1 --2- 172.21.15.88:0/586617963 >> [v2:172.21.15.88:6800/2803186054,v1:172.21.15.88:6801/2803186054] conn(0x7f80c4077260 0x7f80c4079680 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:47.263 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.174+0000 7f3ea2ffd640 1 -- 172.21.15.88:0/2474638527 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f3ea80124e0 con 0x7f3eac0d3b70 2024-04-26T23:40:47.264 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.174+0000 7fcf8bfff640 1 --2- 172.21.15.88:0/3139927920 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fcf8406c940 0x7fcf8406ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:47.264 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.175+0000 7f3ea2ffd640 1 --2- 172.21.15.88:0/2474638527 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f3e9406cb60 0x7f3e9406f020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:47.264 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.175+0000 7f3eb259c640 1 --2- 172.21.15.88:0/2474638527 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f3e9406cb60 0x7f3e9406f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:47.264 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.175+0000 7f3ea2ffd640 1 -- 172.21.15.88:0/2474638527 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7f3ea809c350 con 0x7f3eac0d3b70 2024-04-26T23:40:47.264 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.175+0000 7fcf9f7fe640 1 --2- 172.21.15.88:0/3139927920 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fcf8406c940 0x7fcf8406ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:47.264 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.175+0000 7fcfa61af640 1 -- 172.21.15.88:0/3139927920 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fcf98005e50 con 0x7fcf98047140 2024-04-26T23:40:47.265 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.175+0000 7fcf8bfff640 1 -- 172.21.15.88:0/3139927920 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7fcf9408b550 con 0x7fcf98047140 2024-04-26T23:40:47.265 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.176+0000 7f80db7fe640 1 -- 172.21.15.88:0/586617963 <== osd.0 v2:172.21.15.88:6800/2803186054 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f80e4076550 con 0x7f80c4077260 2024-04-26T23:40:47.265 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.175+0000 7f3ea2ffd640 1 --2- 172.21.15.88:0/2474638527 >> [v2:172.21.15.88:6816/1897380484,v1:172.21.15.88:6817/1897380484] conn(0x7f3e940773f0 0x7f3e94079810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:47.265 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.176+0000 7fcf8bfff640 1 --2- 172.21.15.88:0/3139927920 >> [v2:172.21.15.175:6800/2476644457,v1:172.21.15.175:6801/2476644457] conn(0x7fcf84077150 0x7fcf84079570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:47.266 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.176+0000 7fcf8bfff640 1 -- 172.21.15.88:0/3139927920 --> [v2:172.21.15.175:6800/2476644457,v1:172.21.15.175:6801/2476644457] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fcf94009e50 con 0x7fcf84077150 2024-04-26T23:40:47.266 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.176+0000 7fcf8bfff640 1 -- 172.21.15.88:0/3139927920 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fcf94058e90 con 0x7fcf98047140 2024-04-26T23:40:47.266 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.176+0000 7f3eb2d9d640 1 --2- 172.21.15.88:0/2474638527 >> [v2:172.21.15.88:6816/1897380484,v1:172.21.15.88:6817/1897380484] conn(0x7f3e940773f0 0x7f3e94079810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:47.266 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.176+0000 7f3eb259c640 1 --2- 172.21.15.88:0/2474638527 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f3e9406cb60 0x7f3e9406f020 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f3ea40017f0 tx=0x7f3ea4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:47.267 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.176+0000 7fcf9f7fe640 1 --2- 172.21.15.88:0/3139927920 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fcf8406c940 0x7fcf8406ee00 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fcfa006b030 tx=0x7fcfa00ab000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:47.267 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.176+0000 7f3eb2d9d640 1 --2- 172.21.15.88:0/2474638527 >> [v2:172.21.15.88:6816/1897380484,v1:172.21.15.88:6817/1897380484] conn(0x7f3e940773f0 0x7f3e94079810 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:47.267 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.176+0000 7f3ea2ffd640 1 -- 172.21.15.88:0/2474638527 --> [v2:172.21.15.88:6816/1897380484,v1:172.21.15.88:6817/1897380484] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3ea8001d30 con 0x7f3e940773f0 2024-04-26T23:40:47.267 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.176+0000 7f3ea2ffd640 1 -- 172.21.15.88:0/2474638527 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f3ea809c740 con 0x7f3eac0d3b70 2024-04-26T23:40:47.268 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.177+0000 7fcf9effd640 1 --2- 172.21.15.88:0/3139927920 >> [v2:172.21.15.175:6800/2476644457,v1:172.21.15.175:6801/2476644457] conn(0x7fcf84077150 0x7fcf84079570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:47.268 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.178+0000 7f3ea2ffd640 1 -- 172.21.15.88:0/2474638527 <== osd.1 v2:172.21.15.88:6816/1897380484 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f3ea8001d30 con 0x7f3e940773f0 2024-04-26T23:40:47.268 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.178+0000 7fcf9effd640 1 --2- 172.21.15.88:0/3139927920 >> [v2:172.21.15.175:6800/2476644457,v1:172.21.15.175:6801/2476644457] conn(0x7fcf84077150 0x7fcf84079570 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:47.268 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.179+0000 7fcf8bfff640 1 -- 172.21.15.88:0/3139927920 <== osd.5 v2:172.21.15.175:6800/2476644457 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fcf94009e50 con 0x7fcf84077150 2024-04-26T23:40:47.269 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.201+0000 7f8c57122640 1 -- 172.21.15.88:0/2106065146 --> [v2:172.21.15.88:6808/648396269,v1:172.21.15.88:6809/648396269] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f8c500c41c0 con 0x7f8c340771d0 2024-04-26T23:40:47.269 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.203+0000 7f8c4d7fa640 1 -- 172.21.15.88:0/2106065146 <== osd.2 v2:172.21.15.88:6808/648396269 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f8c500c41c0 con 0x7f8c340771d0 2024-04-26T23:40:47.269 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.203+0000 7f170ceda640 1 -- 172.21.15.88:0/1280241584 --> [v2:172.21.15.175:6816/3824112919,v1:172.21.15.175:6819/3824112919] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f16ec002dd0 con 0x7f16e80771b0 2024-04-26T23:40:47.270 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.203+0000 7f8c3affd640 1 -- 172.21.15.88:0/2106065146 >> [v2:172.21.15.88:6808/648396269,v1:172.21.15.88:6809/648396269] conn(0x7f8c340771d0 msgr2=0x7f8c340795f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:47.270 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.203+0000 7f8c3affd640 1 --2- 172.21.15.88:0/2106065146 >> [v2:172.21.15.88:6808/648396269,v1:172.21.15.88:6809/648396269] conn(0x7f8c340771d0 0x7f8c340795f0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:47.270 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.203+0000 7f8c3affd640 1 -- 172.21.15.88:0/2106065146 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f8c3406c940 msgr2=0x7f8c3406ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:47.270 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.203+0000 7f8c3affd640 1 --2- 172.21.15.88:0/2106065146 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f8c3406c940 0x7f8c3406ee00 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f8c44006fd0 tx=0x7f8c44008040 comp rx=0 tx=0).stop 2024-04-26T23:40:47.271 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.203+0000 7f16f6ffd640 1 -- 172.21.15.88:0/1280241584 <== osd.6 v2:172.21.15.175:6816/3824112919 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f16ec002dd0 con 0x7f16e80771b0 2024-04-26T23:40:47.271 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.203+0000 7f8c3affd640 1 -- 172.21.15.88:0/2106065146 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8c500c43e0 msgr2=0x7f8c501e22a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:47.271 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.204+0000 7f170ceda640 1 -- 172.21.15.88:0/1280241584 >> [v2:172.21.15.175:6816/3824112919,v1:172.21.15.175:6819/3824112919] conn(0x7f16e80771b0 msgr2=0x7f16e80795d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:47.271 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.204+0000 7f170ceda640 1 --2- 172.21.15.88:0/1280241584 >> [v2:172.21.15.175:6816/3824112919,v1:172.21.15.175:6819/3824112919] conn(0x7f16e80771b0 0x7f16e80795d0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:47.272 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.203+0000 7f8c3affd640 1 --2- 172.21.15.88:0/2106065146 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8c500c43e0 0x7f8c501e22a0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f8c3c00c3c0 tx=0x7f8c3c00c880 comp rx=0 tx=0).stop 2024-04-26T23:40:47.272 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.204+0000 7f8c556bf640 1 -- 172.21.15.88:0/2106065146 reap_dead start 2024-04-26T23:40:47.273 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.204+0000 7f170ceda640 1 -- 172.21.15.88:0/1280241584 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f16e806c920 msgr2=0x7f16e806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:47.273 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.204+0000 7f170ceda640 1 --2- 172.21.15.88:0/1280241584 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f16e806c920 0x7f16e806ede0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f1700049a50 tx=0x7f17080ab000 comp rx=0 tx=0).stop 2024-04-26T23:40:47.273 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.204+0000 7f170ceda640 1 -- 172.21.15.88:0/1280241584 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f170003f6c0 msgr2=0x7f17000448e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:47.273 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.204+0000 7f170ceda640 1 --2- 172.21.15.88:0/1280241584 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f170003f6c0 0x7f17000448e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f16fc00c390 tx=0x7f16fc00c850 comp rx=0 tx=0).stop 2024-04-26T23:40:47.273 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.204+0000 7f1706d9d640 1 -- 172.21.15.88:0/1280241584 reap_dead start 2024-04-26T23:40:47.273 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.204+0000 7f170ceda640 1 -- 172.21.15.88:0/1280241584 shutdown_connections 2024-04-26T23:40:47.274 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.204+0000 7f170ceda640 1 -- 172.21.15.88:0/1280241584 >> 172.21.15.88:0/1280241584 conn(0x7f1700048ab0 msgr2=0x7f17000e48e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:40:47.274 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.204+0000 7f170ceda640 1 -- 172.21.15.88:0/1280241584 shutdown_connections 2024-04-26T23:40:47.274 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.204+0000 7f170ceda640 1 -- 172.21.15.88:0/1280241584 wait complete. 2024-04-26T23:40:47.274 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.205+0000 7f5e98a25640 1 -- 172.21.15.88:0/2355017728 --> [v2:172.21.15.175:6817/3319361162,v1:172.21.15.175:6818/3319361162] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f5e940c2dc0 con 0x7f5e740771d0 2024-04-26T23:40:47.275 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.205+0000 7f8c3affd640 1 -- 172.21.15.88:0/2106065146 shutdown_connections 2024-04-26T23:40:47.275 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.205+0000 7f8c3affd640 1 -- 172.21.15.88:0/2106065146 >> 172.21.15.88:0/2106065146 conn(0x7f8c500c81d0 msgr2=0x7f8c500745d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:40:47.275 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.205+0000 7f8c3affd640 1 -- 172.21.15.88:0/2106065146 shutdown_connections 2024-04-26T23:40:47.275 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.205+0000 7f8c3affd640 1 -- 172.21.15.88:0/2106065146 wait complete. 2024-04-26T23:40:47.275 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.205+0000 7f5e82ffd640 1 -- 172.21.15.88:0/2355017728 <== osd.7 v2:172.21.15.175:6817/3319361162 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f5e940c2dc0 con 0x7f5e740771d0 2024-04-26T23:40:47.276 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.206+0000 7f5e98a25640 1 -- 172.21.15.88:0/2355017728 >> [v2:172.21.15.175:6817/3319361162,v1:172.21.15.175:6818/3319361162] conn(0x7f5e740771d0 msgr2=0x7f5e740795f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:47.276 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.206+0000 7f5e98a25640 1 --2- 172.21.15.88:0/2355017728 >> [v2:172.21.15.175:6817/3319361162,v1:172.21.15.175:6818/3319361162] conn(0x7f5e740771d0 0x7f5e740795f0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:47.276 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.206+0000 7f80aa18e640 1 -- 172.21.15.88:0/842053977 --> [v2:172.21.15.88:6824/2328028922,v1:172.21.15.88:6825/2328028922] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f80a41e6ca0 con 0x7f80880771e0 2024-04-26T23:40:47.276 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.206+0000 7f5e98a25640 1 -- 172.21.15.88:0/2355017728 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f5e7406c940 msgr2=0x7f5e7406ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:47.277 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.206+0000 7f5e98a25640 1 --2- 172.21.15.88:0/2355017728 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f5e7406c940 0x7f5e7406ee00 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f5e94074bb0 tx=0x7f5e88008040 comp rx=0 tx=0).stop 2024-04-26T23:40:47.277 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.206+0000 7f5e98a25640 1 -- 172.21.15.88:0/2355017728 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5e7c0051c0 msgr2=0x7f5e940a7660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:47.277 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.206+0000 7f5e98a25640 1 --2- 172.21.15.88:0/2355017728 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5e7c0051c0 0x7f5e940a7660 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f5e8c00cad0 tx=0x7f5e8c00cf90 comp rx=0 tx=0).stop 2024-04-26T23:40:47.277 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.206+0000 7f5e92d9d640 1 -- 172.21.15.88:0/2355017728 reap_dead start 2024-04-26T23:40:47.277 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.206+0000 7f5e98a25640 1 -- 172.21.15.88:0/2355017728 shutdown_connections 2024-04-26T23:40:47.277 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.206+0000 7f5e98a25640 1 -- 172.21.15.88:0/2355017728 >> 172.21.15.88:0/2355017728 conn(0x7f5e940c52a0 msgr2=0x7f5e940a9cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:40:47.277 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.206+0000 7f5e98a25640 1 -- 172.21.15.88:0/2355017728 shutdown_connections 2024-04-26T23:40:47.277 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.206+0000 7f5e98a25640 1 -- 172.21.15.88:0/2355017728 wait complete. 2024-04-26T23:40:47.277 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.207+0000 7f8099ffb640 1 -- 172.21.15.88:0/842053977 <== osd.3 v2:172.21.15.88:6824/2328028922 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f80a41e6ca0 con 0x7f80880771e0 2024-04-26T23:40:47.278 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.208+0000 7fd033fff640 1 -- 172.21.15.88:0/1960191763 --> [v2:172.21.15.175:6808/3929617402,v1:172.21.15.175:6809/3929617402] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fd02c02b4d0 con 0x7fd0200771d0 2024-04-26T23:40:47.278 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.208+0000 7f80aa18e640 1 -- 172.21.15.88:0/842053977 >> [v2:172.21.15.88:6824/2328028922,v1:172.21.15.88:6825/2328028922] conn(0x7f80880771e0 msgr2=0x7f8088079600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:47.278 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.208+0000 7f80aa18e640 1 --2- 172.21.15.88:0/842053977 >> [v2:172.21.15.88:6824/2328028922,v1:172.21.15.88:6825/2328028922] conn(0x7f80880771e0 0x7f8088079600 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:47.278 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.208+0000 7f80aa18e640 1 -- 172.21.15.88:0/842053977 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f808806c9c0 msgr2=0x7f808806ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:47.278 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.208+0000 7f80aa18e640 1 --2- 172.21.15.88:0/842053977 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f808806c9c0 0x7f808806ee80 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f809c007fd0 tx=0x7f809c009040 comp rx=0 tx=0).stop 2024-04-26T23:40:47.279 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.208+0000 7f80aa18e640 1 -- 172.21.15.88:0/842053977 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f80a40acc50 msgr2=0x7f80a40c9a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:47.279 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.208+0000 7f80aa18e640 1 --2- 172.21.15.88:0/842053977 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f80a40acc50 0x7f80a40c9a10 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f80a4073170 tx=0x7f80a00046c0 comp rx=0 tx=0).stop 2024-04-26T23:40:47.279 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.208+0000 7f80a998d640 1 -- 172.21.15.88:0/842053977 reap_dead start 2024-04-26T23:40:47.279 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.209+0000 7f80aa18e640 1 -- 172.21.15.88:0/842053977 shutdown_connections 2024-04-26T23:40:47.279 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.209+0000 7f80aa18e640 1 -- 172.21.15.88:0/842053977 >> 172.21.15.88:0/842053977 conn(0x7f80a4073630 msgr2=0x7f80a4150e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:40:47.279 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.208+0000 7fd01bfff640 1 -- 172.21.15.88:0/1960191763 <== osd.4 v2:172.21.15.175:6808/3929617402 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fd02c02b4d0 con 0x7fd0200771d0 2024-04-26T23:40:47.280 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.209+0000 7fcfa61af640 1 -- 172.21.15.88:0/3139927920 --> [v2:172.21.15.175:6800/2476644457,v1:172.21.15.175:6801/2476644457] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fcf98005e50 con 0x7fcf84077150 2024-04-26T23:40:47.280 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.209+0000 7f80aa18e640 1 -- 172.21.15.88:0/842053977 shutdown_connections 2024-04-26T23:40:47.280 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.209+0000 7fd033fff640 1 -- 172.21.15.88:0/1960191763 >> [v2:172.21.15.175:6808/3929617402,v1:172.21.15.175:6809/3929617402] conn(0x7fd0200771d0 msgr2=0x7fd0200795f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:47.280 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.209+0000 7fd033fff640 1 --2- 172.21.15.88:0/1960191763 >> [v2:172.21.15.175:6808/3929617402,v1:172.21.15.175:6809/3929617402] conn(0x7fd0200771d0 0x7fd0200795f0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:47.280 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.209+0000 7fd033fff640 1 -- 172.21.15.88:0/1960191763 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fd02006c940 msgr2=0x7fd02006ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:47.281 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.209+0000 7fd033fff640 1 --2- 172.21.15.88:0/1960191763 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fd02006c940 0x7fd02006ee00 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fd02800ae90 tx=0x7fd028008040 comp rx=0 tx=0).stop 2024-04-26T23:40:47.281 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.209+0000 7fd033fff640 1 -- 172.21.15.88:0/1960191763 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd02c04b110 msgr2=0x7fd02c170620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:47.281 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.209+0000 7fd033fff640 1 --2- 172.21.15.88:0/1960191763 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd02c04b110 0x7fd02c170620 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fd02402a720 tx=0x7fd0240046c0 comp rx=0 tx=0).stop 2024-04-26T23:40:47.281 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.209+0000 7fd0337fe640 1 -- 172.21.15.88:0/1960191763 reap_dead start 2024-04-26T23:40:47.281 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.209+0000 7fcf8bfff640 1 -- 172.21.15.88:0/3139927920 <== osd.5 v2:172.21.15.175:6800/2476644457 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fcf8c007cf0 con 0x7fcf84077150 2024-04-26T23:40:47.281 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.209+0000 7fd033fff640 1 -- 172.21.15.88:0/1960191763 shutdown_connections 2024-04-26T23:40:47.282 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.209+0000 7f80aa18e640 1 -- 172.21.15.88:0/842053977 wait complete. 2024-04-26T23:40:47.282 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.209+0000 7fd033fff640 1 -- 172.21.15.88:0/1960191763 >> 172.21.15.88:0/1960191763 conn(0x7fd02c048250 msgr2=0x7fd02c006b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:40:47.283 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.210+0000 7fd033fff640 1 -- 172.21.15.88:0/1960191763 shutdown_connections 2024-04-26T23:40:47.283 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.210+0000 7fd033fff640 1 -- 172.21.15.88:0/1960191763 wait complete. 2024-04-26T23:40:47.284 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.210+0000 7fcfa61af640 1 -- 172.21.15.88:0/3139927920 >> [v2:172.21.15.175:6800/2476644457,v1:172.21.15.175:6801/2476644457] conn(0x7fcf84077150 msgr2=0x7fcf84079570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:47.284 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.210+0000 7fcfa61af640 1 --2- 172.21.15.88:0/3139927920 >> [v2:172.21.15.175:6800/2476644457,v1:172.21.15.175:6801/2476644457] conn(0x7fcf84077150 0x7fcf84079570 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:47.284 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.210+0000 7fcfa61af640 1 -- 172.21.15.88:0/3139927920 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fcf8406c940 msgr2=0x7fcf8406ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:47.284 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.210+0000 7fcfa61af640 1 --2- 172.21.15.88:0/3139927920 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fcf8406c940 0x7fcf8406ee00 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fcfa006b030 tx=0x7fcfa00ab000 comp rx=0 tx=0).stop 2024-04-26T23:40:47.284 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.210+0000 7fcfa61af640 1 -- 172.21.15.88:0/3139927920 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcf98047140 msgr2=0x7fcf980475c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:47.284 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.210+0000 7fcfa61af640 1 --2- 172.21.15.88:0/3139927920 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcf98047140 0x7fcf980475c0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fcf9800ff70 tx=0x7fcf9400f8a0 comp rx=0 tx=0).stop 2024-04-26T23:40:47.284 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.210+0000 7fcf9ffff640 1 -- 172.21.15.88:0/3139927920 reap_dead start 2024-04-26T23:40:47.284 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.211+0000 7fcfa61af640 1 -- 172.21.15.88:0/3139927920 shutdown_connections 2024-04-26T23:40:47.284 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.211+0000 7fcfa61af640 1 -- 172.21.15.88:0/3139927920 >> 172.21.15.88:0/3139927920 conn(0x7fcf98031720 msgr2=0x7fcf980063f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:40:47.284 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.211+0000 7fcfa61af640 1 -- 172.21.15.88:0/3139927920 shutdown_connections 2024-04-26T23:40:47.285 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.211+0000 7fcfa61af640 1 -- 172.21.15.88:0/3139927920 wait complete. 2024-04-26T23:40:47.285 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.211+0000 7f3eb8f46640 1 -- 172.21.15.88:0/2474638527 --> [v2:172.21.15.88:6816/1897380484,v1:172.21.15.88:6817/1897380484] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f3eac048060 con 0x7f3e940773f0 2024-04-26T23:40:47.285 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.212+0000 7f3ea2ffd640 1 -- 172.21.15.88:0/2474638527 <== osd.1 v2:172.21.15.88:6816/1897380484 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f3eac048060 con 0x7f3e940773f0 2024-04-26T23:40:47.285 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.212+0000 7f80d97fa640 1 -- 172.21.15.88:0/586617963 --> [v2:172.21.15.88:6800/2803186054,v1:172.21.15.88:6801/2803186054] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f80dc02fa00 con 0x7f80c4077260 2024-04-26T23:40:47.286 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.213+0000 7f80db7fe640 1 -- 172.21.15.88:0/586617963 <== osd.0 v2:172.21.15.88:6800/2803186054 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f80dc02fa00 con 0x7f80c4077260 2024-04-26T23:40:47.286 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.213+0000 7f3eb8f46640 1 -- 172.21.15.88:0/2474638527 >> [v2:172.21.15.88:6816/1897380484,v1:172.21.15.88:6817/1897380484] conn(0x7f3e940773f0 msgr2=0x7f3e94079810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:47.286 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.213+0000 7f3eb8f46640 1 --2- 172.21.15.88:0/2474638527 >> [v2:172.21.15.88:6816/1897380484,v1:172.21.15.88:6817/1897380484] conn(0x7f3e940773f0 0x7f3e94079810 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:47.286 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.214+0000 7f3eb8f46640 1 -- 172.21.15.88:0/2474638527 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f3e9406cb60 msgr2=0x7f3e9406f020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:47.286 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.214+0000 7f3eb8f46640 1 --2- 172.21.15.88:0/2474638527 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f3e9406cb60 0x7f3e9406f020 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f3ea40017f0 tx=0x7f3ea4009040 comp rx=0 tx=0).stop 2024-04-26T23:40:47.286 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.214+0000 7f3eb8f46640 1 -- 172.21.15.88:0/2474638527 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3eac0d3b70 msgr2=0x7f3eac030290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:47.286 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.214+0000 7f3eb8f46640 1 --2- 172.21.15.88:0/2474638527 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3eac0d3b70 0x7f3eac030290 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f3ea8012fc0 tx=0x7f3ea8014420 comp rx=0 tx=0).stop 2024-04-26T23:40:47.287 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.214+0000 7f3eb2d9d640 1 -- 172.21.15.88:0/2474638527 reap_dead start 2024-04-26T23:40:47.287 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.214+0000 7f80d97fa640 1 -- 172.21.15.88:0/586617963 >> [v2:172.21.15.88:6800/2803186054,v1:172.21.15.88:6801/2803186054] conn(0x7f80c4077260 msgr2=0x7f80c4079680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:47.287 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.214+0000 7f80d97fa640 1 --2- 172.21.15.88:0/586617963 >> [v2:172.21.15.88:6800/2803186054,v1:172.21.15.88:6801/2803186054] conn(0x7f80c4077260 0x7f80c4079680 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:47.287 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.214+0000 7f80d97fa640 1 -- 172.21.15.88:0/586617963 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f80c406c9c0 msgr2=0x7f80c406ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:47.288 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.214+0000 7f3eb8f46640 1 -- 172.21.15.88:0/2474638527 shutdown_connections 2024-04-26T23:40:47.288 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.214+0000 7f3eb8f46640 1 -- 172.21.15.88:0/2474638527 >> 172.21.15.88:0/2474638527 conn(0x7f3eac048280 msgr2=0x7f3eac0d6b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:40:47.288 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.215+0000 7f80d97fa640 1 --2- 172.21.15.88:0/586617963 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f80c406c9c0 0x7f80c406ee80 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f80cc003660 tx=0x7f80cc008040 comp rx=0 tx=0).stop 2024-04-26T23:40:47.289 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.215+0000 7f80d97fa640 1 -- 172.21.15.88:0/586617963 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f80dc04c280 msgr2=0x7f80dc174dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:47.289 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.215+0000 7f80d97fa640 1 --2- 172.21.15.88:0/586617963 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f80dc04c280 0x7f80dc174dc0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f80e4076d60 tx=0x7f80e40661d0 comp rx=0 tx=0).stop 2024-04-26T23:40:47.289 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.215+0000 7f3eb8f46640 1 -- 172.21.15.88:0/2474638527 shutdown_connections 2024-04-26T23:40:47.289 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.215+0000 7f3eb8f46640 1 -- 172.21.15.88:0/2474638527 wait complete. 2024-04-26T23:40:47.290 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.215+0000 7f80e359e640 1 -- 172.21.15.88:0/586617963 reap_dead start 2024-04-26T23:40:47.290 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.215+0000 7f80d97fa640 1 -- 172.21.15.88:0/586617963 shutdown_connections 2024-04-26T23:40:47.290 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.215+0000 7f80d97fa640 1 -- 172.21.15.88:0/586617963 >> 172.21.15.88:0/586617963 conn(0x7f80dc049330 msgr2=0x7f80dc0d4aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:40:47.290 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.215+0000 7f80d97fa640 1 -- 172.21.15.88:0/586617963 shutdown_connections 2024-04-26T23:40:47.290 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.215+0000 7f80d97fa640 1 -- 172.21.15.88:0/586617963 wait complete. 2024-04-26T23:40:47.291 INFO:teuthology.orchestra.run.smithi088.stdout:55834574857 2024-04-26T23:40:47.291 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-04-26T23:40:47.292 INFO:teuthology.orchestra.run.smithi088.stdout:55834574856 2024-04-26T23:40:47.292 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-26T23:40:47.293 INFO:teuthology.orchestra.run.smithi088.stdout:55834574856 2024-04-26T23:40:47.293 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-04-26T23:40:47.294 INFO:teuthology.orchestra.run.smithi088.stdout:55834574858 2024-04-26T23:40:47.294 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-04-26T23:40:47.295 INFO:teuthology.orchestra.run.smithi088.stdout:55834574856 2024-04-26T23:40:47.296 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-26T23:40:47.296 INFO:teuthology.orchestra.run.smithi088.stdout:55834574857 2024-04-26T23:40:47.296 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-04-26T23:40:47.297 INFO:teuthology.orchestra.run.smithi088.stdout:55834574858 2024-04-26T23:40:47.297 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-26T23:40:47.298 INFO:teuthology.orchestra.run.smithi088.stdout:55834574856 2024-04-26T23:40:47.299 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-26T23:40:47.496 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.490+0000 7fa98f59e640 1 Processor -- start 2024-04-26T23:40:47.497 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.490+0000 7fa98f59e640 1 -- start start 2024-04-26T23:40:47.497 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.492+0000 7fa98f59e640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fa990151090 0x7fa99006e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:47.497 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.492+0000 7fa98f59e640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa990154190 0x7fa99006e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:47.497 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.492+0000 7fa98f59e640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa99006eb20 con 0x7fa99006d0f0 2024-04-26T23:40:47.497 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.492+0000 7fa98f59e640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7fa990154700 con 0x7fa990154190 2024-04-26T23:40:47.497 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.492+0000 7fa98f59e640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7fa990157bd0 con 0x7fa990151090 2024-04-26T23:40:47.497 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.492+0000 7fa98ed9d640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa990154190 0x7fa99006e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:47.497 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.492+0000 7fa98ed9d640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa990154190 0x7fa99006e5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:42136/0 (socket says 172.21.15.88:42136) 2024-04-26T23:40:47.497 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.492+0000 7fa98ed9d640 1 -- 172.21.15.88:0/1855816409 learned_addr learned my addr 172.21.15.88:0/1855816409 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:40:47.497 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.493+0000 7fa98dd9b640 1 --2- 172.21.15.88:0/1855816409 >> v2:172.21.15.175:3300/0 conn(0x7fa990151090 0x7fa99006e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:47.497 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.493+0000 7fa98ed9d640 1 -- 172.21.15.88:0/1855816409 >> v2:172.21.15.175:3300/0 conn(0x7fa990151090 msgr2=0x7fa99006e0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:40:47.498 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.493+0000 7fa98ed9d640 1 --2- 172.21.15.88:0/1855816409 >> v2:172.21.15.175:3300/0 conn(0x7fa990151090 0x7fa99006e0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:47.498 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.493+0000 7fa98ed9d640 1 -- 172.21.15.88:0/1855816409 >> v1:172.21.15.175:6789/0 conn(0x7fa99006d0f0 legacy=0x7fa990150980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:40:47.498 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.493+0000 7fa98ed9d640 1 -- 172.21.15.88:0/1855816409 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa990156e10 con 0x7fa990154190 2024-04-26T23:40:47.498 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.494+0000 7fa98ed9d640 1 --2- 172.21.15.88:0/1855816409 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa990154190 0x7fa99006e5e0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fa990154880 tx=0x7fa98802a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d38c735605a1c258 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:47.498 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.494+0000 7fe0d4bbb640 1 Processor -- start 2024-04-26T23:40:47.499 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.494+0000 7fe0d4bbb640 1 -- start start 2024-04-26T23:40:47.499 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.494+0000 7fd610940640 1 Processor -- start 2024-04-26T23:40:47.499 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.494+0000 7fa98dd9b640 1 --2- 172.21.15.88:0/1855816409 >> v2:172.21.15.175:3300/0 conn(0x7fa990151090 0x7fa99006e0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:40:47.500 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.494+0000 7f0541c93640 1 Processor -- start 2024-04-26T23:40:47.500 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.494+0000 7f0541c93640 1 -- start start 2024-04-26T23:40:47.500 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.496+0000 7f0541c93640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f05340d3c70 0x7f053404aca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:47.500 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.495+0000 7fe0d4bbb640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe0d01677f0 0x7fe0d00ac490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:47.500 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.495+0000 7fe0d4bbb640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe0d00ad2e0 con 0x7fe0d006dd00 2024-04-26T23:40:47.500 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.495+0000 7fe0cf7fe640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe0d01677f0 0x7fe0d00ac490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:47.500 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.495+0000 7fe0cffff640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7fe0d0072500 0x7fe0d016e050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.88:36656/0 (socket says 172.21.15.88:36656) 2024-04-26T23:40:47.500 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.495+0000 7fe0cffff640 1 -- 172.21.15.88:0/2348212621 learned_addr learned my addr 172.21.15.88:0/2348212621 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-26T23:40:47.501 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.496+0000 7fe0d4bbb640 1 -- 172.21.15.88:0/2348212621 --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe0d0167bd0 con 0x7fe0d0072500 2024-04-26T23:40:47.501 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.496+0000 7fe0d4bbb640 1 -- 172.21.15.88:0/2348212621 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fe0d006e9d0 con 0x7fe0d01677f0 2024-04-26T23:40:47.501 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.496+0000 7f146f59e640 1 Processor -- start 2024-04-26T23:40:47.501 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.496+0000 7fe0ce7fc640 1 -- 172.21.15.88:0/2348212621 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2298724548 0 0) 0x7fe0d0167bd0 con 0x7fe0d0072500 2024-04-26T23:40:47.501 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.496+0000 7f146f59e640 1 -- start start 2024-04-26T23:40:47.502 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.496+0000 7fe0ce7fc640 1 -- 172.21.15.88:0/2348212621 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe0b8003520 con 0x7fe0d0072500 2024-04-26T23:40:47.502 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.496+0000 7f053b7fe640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f05340d3c70 0x7f053404aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:47.502 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.496+0000 7f968ec2a640 1 Processor -- start 2024-04-26T23:40:47.503 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.496+0000 7f968ec2a640 1 -- start start 2024-04-26T23:40:47.503 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.496+0000 7fd61c007640 1 Processor -- start 2024-04-26T23:40:47.503 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.494+0000 7fd610940640 1 -- start start 2024-04-26T23:40:47.503 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.496+0000 7fd610940640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fd60c153570 0x7fd60c06d530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:47.503 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.496+0000 7fd610940640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fd60c0c3c70 0x7fd60c0c40c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:47.503 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.496+0000 7fd610940640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd60c1539f0 con 0x7fd60c14cae0 2024-04-26T23:40:47.503 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.496+0000 7fd610940640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7fd60c06da70 con 0x7fd60c153570 2024-04-26T23:40:47.503 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.496+0000 7fd610940640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7fd60c0ab9d0 con 0x7fd60c0c3c70 2024-04-26T23:40:47.504 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.496+0000 7fd61c007640 1 -- start start 2024-04-26T23:40:47.504 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.494+0000 7fa98d59a640 1 -- 172.21.15.88:0/1855816409 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa988037070 con 0x7fa990154190 2024-04-26T23:40:47.504 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.494+0000 7fa98d59a640 1 -- 172.21.15.88:0/1855816409 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa988032470 con 0x7fa990154190 2024-04-26T23:40:47.504 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.494+0000 7fa98d59a640 1 -- 172.21.15.88:0/1855816409 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa988032820 con 0x7fa990154190 2024-04-26T23:40:47.504 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.495+0000 7fa98f59e640 1 -- 172.21.15.88:0/1855816409 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa990154190 msgr2=0x7fa99006e5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:47.505 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.495+0000 7fa98f59e640 1 --2- 172.21.15.88:0/1855816409 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa990154190 0x7fa99006e5e0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fa990154880 tx=0x7fa98802a8c0 comp rx=0 tx=0).stop 2024-04-26T23:40:47.505 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.496+0000 7fa98f59e640 1 -- 172.21.15.88:0/1855816409 shutdown_connections 2024-04-26T23:40:47.505 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.496+0000 7fa98f59e640 1 --2- 172.21.15.88:0/1855816409 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa990154190 0x7fa99006e5e0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:47.505 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.496+0000 7fa98f59e640 1 --2- 172.21.15.88:0/1855816409 >> v2:172.21.15.175:3300/0 conn(0x7fa990151090 0x7fa99006e0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:47.505 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.496+0000 7fa98f59e640 1 -- 172.21.15.88:0/1855816409 >> 172.21.15.88:0/1855816409 conn(0x7fa99006c310 msgr2=0x7fa99006c720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:40:47.505 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.496+0000 7fa98f59e640 1 -- 172.21.15.88:0/1855816409 shutdown_connections 2024-04-26T23:40:47.505 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.496+0000 7fa98f59e640 1 -- 172.21.15.88:0/1855816409 wait complete. 2024-04-26T23:40:47.505 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.496+0000 7fe0cf7fe640 1 -- 172.21.15.88:0/2348212621 >> v1:172.21.15.175:6789/0 conn(0x7fe0d0072500 legacy=0x7fe0d016e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:47.505 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.496+0000 7fe0cf7fe640 1 -- 172.21.15.88:0/2348212621 >> v1:172.21.15.88:6789/0 conn(0x7fe0d006dd00 legacy=0x7fe0d00c3ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:47.505 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.496+0000 7fe0cf7fe640 1 -- 172.21.15.88:0/2348212621 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0d00ad580 con 0x7fe0d01677f0 2024-04-26T23:40:47.506 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.497+0000 7fd60a59c640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fd60c14cae0 0x7fd60c0abe60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:39612/0 (socket says 172.21.15.88:39612) 2024-04-26T23:40:47.506 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.497+0000 7fd60a59c640 1 -- 172.21.15.88:0/2201780661 learned_addr learned my addr 172.21.15.88:0/2201780661 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-26T23:40:47.506 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.497+0000 7fd609d9b640 1 --2- 172.21.15.88:0/2201780661 >> v2:172.21.15.88:3300/0 conn(0x7fd60c153570 0x7fd60c06d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:47.506 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.496+0000 7f053b7fe640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f05340d3c70 0x7f053404aca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:42148/0 (socket says 172.21.15.88:42148) 2024-04-26T23:40:47.506 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.496+0000 7f053b7fe640 1 -- 172.21.15.88:0/1786946762 learned_addr learned my addr 172.21.15.88:0/1786946762 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:40:47.506 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.497+0000 7f0541c93640 1 -- 172.21.15.88:0/1786946762 --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0534046900 con 0x7f053404b1e0 2024-04-26T23:40:47.506 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.497+0000 7f0541c93640 1 -- 172.21.15.88:0/1786946762 --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0534046be0 con 0x7f05340decf0 2024-04-26T23:40:47.507 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.497+0000 7f0541c93640 1 -- 172.21.15.88:0/1786946762 --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f0534047690 con 0x7f05340d3c70 2024-04-26T23:40:47.507 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.497+0000 7f146f59e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1470151e70 0x7f14700735a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:47.507 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.497+0000 7f146f59e640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1470071860 con 0x7f147006f7b0 2024-04-26T23:40:47.507 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.497+0000 7f146f59e640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1470071b40 con 0x7f147006e700 2024-04-26T23:40:47.507 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.497+0000 7f146f59e640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f14700c47b0 con 0x7f1470151e70 2024-04-26T23:40:47.507 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.497+0000 7f968ec2a640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f96880ca5a0 0x7f9688156bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:47.507 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.497+0000 7f968ec2a640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f968815a1a0 0x7f96880c9590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:47.507 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.497+0000 7f968ec2a640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f96880c8df0 con 0x7f9688154160 2024-04-26T23:40:47.508 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.497+0000 7f968ec2a640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f96880c9100 con 0x7f96880ca5a0 2024-04-26T23:40:47.508 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.497+0000 7f968ec2a640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f9688154540 con 0x7f968815a1a0 2024-04-26T23:40:47.508 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.497+0000 7f053b7fe640 1 -- 172.21.15.88:0/1786946762 >> v1:172.21.15.175:6789/0 conn(0x7f05340decf0 legacy=0x7f05340e10e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T23:40:47.508 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.497+0000 7f053b7fe640 1 -- 172.21.15.88:0/1786946762 >> v1:172.21.15.88:6789/0 conn(0x7f053404b1e0 legacy=0x7f05340d6a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:40:47.508 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.497+0000 7f053b7fe640 1 -- 172.21.15.88:0/1786946762 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05340096f0 con 0x7f05340d3c70 2024-04-26T23:40:47.508 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.498+0000 7f146e59c640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1470151e70 0x7f14700735a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:47.509 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.498+0000 7f9687fff640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f96880ca5a0 0x7f9688156bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:47.509 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.498+0000 7fa98f59e640 1 Processor -- start 2024-04-26T23:40:47.509 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.498+0000 7fd61c007640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fd60c0d5950 0x7fd60c04cee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:47.510 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.498+0000 7f9687fff640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f96880ca5a0 0x7f9688156bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.88:34312/0 (socket says 172.21.15.88:34312) 2024-04-26T23:40:47.510 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.498+0000 7f9687fff640 1 -- 172.21.15.88:0/3418801014 learned_addr learned my addr 172.21.15.88:0/3418801014 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:40:47.510 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.498+0000 7fa98f59e640 1 -- start start 2024-04-26T23:40:47.510 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.498+0000 7f146dd9b640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f147006e700 0x7f1470154fb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.88:36658/0 (socket says 172.21.15.88:36658) 2024-04-26T23:40:47.511 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.498+0000 7f146dd9b640 1 -- 172.21.15.88:0/3641939005 learned_addr learned my addr 172.21.15.88:0/3641939005 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-26T23:40:47.511 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.498+0000 7fd61c007640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fd60c04d420 0x7fd60c0e2b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:47.511 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.498+0000 7f968d1c7640 1 --2- 172.21.15.88:0/3418801014 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f968815a1a0 0x7f96880c9590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:47.511 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.498+0000 7fd61c007640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd60c0d8410 con 0x7fd60c04b8c0 2024-04-26T23:40:47.512 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.498+0000 7fe0cf7fe640 1 --2- 172.21.15.88:0/2348212621 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe0d01677f0 0x7fe0d00ac490 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fe0c40097d0 tx=0x7fe0c402a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4d30367afbd20654 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:47.512 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.498+0000 7fd61c007640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7fd60c04c490 con 0x7fd60c0d5950 2024-04-26T23:40:47.512 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.498+0000 7fd61c007640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7fd60c04ca50 con 0x7fd60c04d420 2024-04-26T23:40:47.512 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.498+0000 7fd619da3640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fd60c0d5950 0x7fd60c04cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:47.513 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.498+0000 7fe0ce7fc640 1 -- 172.21.15.88:0/2348212621 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0c4037070 con 0x7fe0d01677f0 2024-04-26T23:40:47.513 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.498+0000 7fd619da3640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fd60c0d5950 0x7fd60c04cee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:42180/0 (socket says 172.21.15.88:42180) 2024-04-26T23:40:47.513 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.498+0000 7fd619da3640 1 -- 172.21.15.88:0/1235519348 learned_addr learned my addr 172.21.15.88:0/1235519348 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:40:47.514 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.498+0000 7fd60ad9d640 1 --2- 172.21.15.88:0/2201780661 >> v2:172.21.15.175:3300/0 conn(0x7fd60c0c3c70 0x7fd60c0c40c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:47.514 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.498+0000 7f146d59a640 1 -- 172.21.15.88:0/3641939005 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 573557846 0 0) 0x7f1470071b40 con 0x7f147006e700 2024-04-26T23:40:47.514 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.498+0000 7fe0ce7fc640 1 -- 172.21.15.88:0/2348212621 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0c4032440 con 0x7fe0d01677f0 2024-04-26T23:40:47.515 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.498+0000 7f146d59a640 1 -- 172.21.15.88:0/3641939005 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1458003520 con 0x7f147006e700 2024-04-26T23:40:47.515 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.499+0000 7f146e59c640 1 -- 172.21.15.88:0/3641939005 >> v1:172.21.15.175:6789/0 conn(0x7f147006e700 legacy=0x7f1470154fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:47.515 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.499+0000 7f146e59c640 1 -- 172.21.15.88:0/3641939005 >> v1:172.21.15.88:6789/0 conn(0x7f147006f7b0 legacy=0x7f147006db40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:40:47.515 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.499+0000 7f146e59c640 1 -- 172.21.15.88:0/3641939005 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1470071e20 con 0x7f1470151e70 2024-04-26T23:40:47.515 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.499+0000 7f053b7fe640 1 --2- 172.21.15.88:0/1786946762 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f05340d3c70 0x7f053404aca0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f0530009870 tx=0x7f053002a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=375c05f297a58bae server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:47.516 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.499+0000 7fa98f59e640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa99006d0f0 0x7fa99014ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:47.516 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.499+0000 7fa98f59e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa990151090 0x7fa9900c8660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:47.516 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.499+0000 7fa98f59e640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa990154190 0x7fa9900abd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:47.516 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.498+0000 7f968d1c7640 1 -- 172.21.15.88:0/3418801014 >> v2:172.21.15.175:3300/0 conn(0x7f96880ca5a0 msgr2=0x7f9688156bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:40:47.517 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.499+0000 7fa98dd9b640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa990151090 0x7fa9900c8660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:47.517 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.499+0000 7fa98f59e640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fa9901576b0 con 0x7fa99006d0f0 2024-04-26T23:40:47.517 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.498+0000 7fd609d9b640 1 -- 172.21.15.88:0/2201780661 >> v2:172.21.15.175:3300/0 conn(0x7fd60c0c3c70 msgr2=0x7fd60c0c40c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:40:47.517 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.498+0000 7fd609d9b640 1 --2- 172.21.15.88:0/2201780661 >> v2:172.21.15.175:3300/0 conn(0x7fd60c0c3c70 0x7fd60c0c40c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:47.517 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.498+0000 7fd609d9b640 1 -- 172.21.15.88:0/2201780661 >> v1:172.21.15.88:6789/0 conn(0x7fd60c14cae0 legacy=0x7fd60c0abe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:47.518 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.498+0000 7f968d1c7640 1 --2- 172.21.15.88:0/3418801014 >> v2:172.21.15.175:3300/0 conn(0x7f96880ca5a0 0x7f9688156bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:47.518 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.498+0000 7f968d1c7640 1 -- 172.21.15.88:0/3418801014 >> v1:172.21.15.88:6789/0 conn(0x7f9688154160 legacy=0x7f96880c6e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:40:47.518 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.498+0000 7f968d1c7640 1 -- 172.21.15.88:0/3418801014 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f968815a910 con 0x7f968815a1a0 2024-04-26T23:40:47.518 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.498+0000 7fd609d9b640 1 -- 172.21.15.88:0/2201780661 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd60c0ad3a0 con 0x7fd60c153570 2024-04-26T23:40:47.519 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.498+0000 7fd61a5a4640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fd60c04d420 0x7fd60c0e2b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:47.519 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.499+0000 7fd618da1640 1 -- 172.21.15.88:0/1235519348 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2235476263 0 0) 0x7fd60c0d8410 con 0x7fd60c04b8c0 2024-04-26T23:40:47.519 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.499+0000 7fd618da1640 1 -- 172.21.15.88:0/1235519348 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd600003520 con 0x7fd60c04b8c0 2024-04-26T23:40:47.519 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.499+0000 7fd619da3640 1 -- 172.21.15.88:0/1235519348 >> v2:172.21.15.175:3300/0 conn(0x7fd60c04d420 msgr2=0x7fd60c0e2b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:40:47.519 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.499+0000 7fa98f59e640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fa9901573d0 con 0x7fa990154190 2024-04-26T23:40:47.519 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.499+0000 7fa98f59e640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fa9900736e0 con 0x7fa990151090 2024-04-26T23:40:47.519 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.499+0000 7fa98dd9b640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa990151090 0x7fa9900c8660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.88:46268/0 (socket says 172.21.15.88:46268) 2024-04-26T23:40:47.520 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.499+0000 7f053a7fc640 1 -- 172.21.15.88:0/1786946762 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0530037070 con 0x7f05340d3c70 2024-04-26T23:40:47.520 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.499+0000 7fd619da3640 1 --2- 172.21.15.88:0/1235519348 >> v2:172.21.15.175:3300/0 conn(0x7fd60c04d420 0x7fd60c0e2b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:47.520 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.499+0000 7fd619da3640 1 -- 172.21.15.88:0/1235519348 >> v1:172.21.15.175:6789/0 conn(0x7fd60c04b8c0 legacy=0x7fd60c048340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:47.520 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.499+0000 7fd619da3640 1 -- 172.21.15.88:0/1235519348 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd60c04c6e0 con 0x7fd60c0d5950 2024-04-26T23:40:47.520 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.499+0000 7fa98dd9b640 1 -- 172.21.15.88:0/2232158860 learned_addr learned my addr 172.21.15.88:0/2232158860 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:40:47.520 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.499+0000 7fa98e59c640 1 --2- 172.21.15.88:0/2232158860 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa99006d0f0 0x7fa99014ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:47.521 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.499+0000 7fd61a5a4640 1 --2- 172.21.15.88:0/1235519348 >> v2:172.21.15.175:3300/0 conn(0x7fd60c04d420 0x7fd60c0e2b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:40:47.521 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.500+0000 7f375c8b2640 1 Processor -- start 2024-04-26T23:40:47.521 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.500+0000 7f053a7fc640 1 -- 172.21.15.88:0/1786946762 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0530032440 con 0x7f05340d3c70 2024-04-26T23:40:47.522 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.500+0000 7fa98ed9d640 1 --2- 172.21.15.88:0/2232158860 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa990154190 0x7fa9900abd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:47.522 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.500+0000 7f053a7fc640 1 -- 172.21.15.88:0/1786946762 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0530032810 con 0x7f05340d3c70 2024-04-26T23:40:47.522 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.500+0000 7fe0ce7fc640 1 -- 172.21.15.88:0/2348212621 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0c40327f0 con 0x7fe0d01677f0 2024-04-26T23:40:47.523 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.500+0000 7f146e59c640 1 --2- 172.21.15.88:0/3641939005 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1470151e70 0x7f14700735a0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f1468009dc0 tx=0x7f146802a630 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8ea0c02d7cd1337f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:47.523 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.500+0000 7fa98dd9b640 1 -- 172.21.15.88:0/2232158860 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa990154190 msgr2=0x7fa9900abd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:47.523 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.500+0000 7fd609d9b640 1 --2- 172.21.15.88:0/2201780661 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd60c153570 0x7fd60c06d530 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fd60c0c5d20 tx=0x7fd5fc02c6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d542746726c9c603 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:47.524 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.500+0000 7f968d1c7640 1 --2- 172.21.15.88:0/3418801014 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f968815a1a0 0x7f96880c9590 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f9680009d90 tx=0x7f968002a610 comp rx=0 tx=0).ready entity=mon.2 client_cookie=880a9b9e40b52cc2 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:47.524 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.500+0000 7fa98dd9b640 1 --2- 172.21.15.88:0/2232158860 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa990154190 0x7fa9900abd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:47.524 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.500+0000 7fa98dd9b640 1 -- 172.21.15.88:0/2232158860 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa99006d0f0 msgr2=0x7fa99014ae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:47.524 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.500+0000 7fa98dd9b640 1 --2- 172.21.15.88:0/2232158860 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa99006d0f0 0x7fa99014ae90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:47.524 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.500+0000 7fa98dd9b640 1 -- 172.21.15.88:0/2232158860 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9901ed100 con 0x7fa990151090 2024-04-26T23:40:47.524 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.500+0000 7f146d59a640 1 -- 172.21.15.88:0/3641939005 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1468007740 con 0x7f1470151e70 2024-04-26T23:40:47.525 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.500+0000 7fd619da3640 1 --2- 172.21.15.88:0/1235519348 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd60c0d5950 0x7fd60c04cee0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fd60c00fb70 tx=0x7fd61002a280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f7aa91d9e000116 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:47.525 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.500+0000 7fa98dd9b640 1 --2- 172.21.15.88:0/2232158860 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa990151090 0x7fa9900c8660 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fa98000eb60 tx=0x7fa980007410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:47.525 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.500+0000 7f146d59a640 1 -- 172.21.15.88:0/3641939005 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14680078e0 con 0x7f1470151e70 2024-04-26T23:40:47.526 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.500+0000 7fe0d4bbb640 1 -- 172.21.15.88:0/2348212621 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe0d01677f0 msgr2=0x7fe0d00ac490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:47.526 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.500+0000 7fe0d4bbb640 1 --2- 172.21.15.88:0/2348212621 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe0d01677f0 0x7fe0d00ac490 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fe0c40097d0 tx=0x7fe0c402a180 comp rx=0 tx=0).stop 2024-04-26T23:40:47.526 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.500+0000 7f96877fe640 1 -- 172.21.15.88:0/3418801014 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9680031600 con 0x7f968815a1a0 2024-04-26T23:40:47.527 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.500+0000 7fd60959a640 1 -- 172.21.15.88:0/2201780661 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5fc03a070 con 0x7fd60c153570 2024-04-26T23:40:47.527 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.500+0000 7fd60959a640 1 -- 172.21.15.88:0/2201780661 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5fc02ce50 con 0x7fd60c153570 2024-04-26T23:40:47.527 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.500+0000 7fd60959a640 1 -- 172.21.15.88:0/2201780661 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5fc0326a0 con 0x7fd60c153570 2024-04-26T23:40:47.527 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.500+0000 7fe0d4bbb640 1 -- 172.21.15.88:0/2348212621 shutdown_connections 2024-04-26T23:40:47.527 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.500+0000 7fe0d4bbb640 1 --2- 172.21.15.88:0/2348212621 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe0d01677f0 0x7fe0d00ac490 secure :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fe0c40097d0 tx=0x7fe0c402a180 comp rx=0 tx=0).stop 2024-04-26T23:40:47.527 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.500+0000 7fe0d4bbb640 1 -- 172.21.15.88:0/2348212621 >> 172.21.15.88:0/2348212621 conn(0x7fe0d00c4bc0 msgr2=0x7fe0d00c4fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:40:47.528 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.500+0000 7fa97effd640 1 -- 172.21.15.88:0/2232158860 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa980007d20 con 0x7fa990151090 2024-04-26T23:40:47.528 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.500+0000 7fd618da1640 1 -- 172.21.15.88:0/1235519348 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd610037070 con 0x7fd60c0d5950 2024-04-26T23:40:47.528 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.500+0000 7fd618da1640 1 -- 172.21.15.88:0/1235519348 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd610032440 con 0x7fd60c0d5950 2024-04-26T23:40:47.529 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.500+0000 7f96877fe640 1 -- 172.21.15.88:0/3418801014 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96800317a0 con 0x7f968815a1a0 2024-04-26T23:40:47.529 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.500+0000 7f96877fe640 1 -- 172.21.15.88:0/3418801014 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9680031b70 con 0x7f968815a1a0 2024-04-26T23:40:47.529 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.501+0000 7fa98f59e640 1 -- 172.21.15.88:0/2232158860 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9901ecb40 con 0x7fa990151090 2024-04-26T23:40:47.529 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.501+0000 7fa97effd640 1 -- 172.21.15.88:0/2232158860 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa980010440 con 0x7fa990151090 2024-04-26T23:40:47.529 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.501+0000 7f0541c93640 1 -- 172.21.15.88:0/1786946762 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f05340d3c70 msgr2=0x7f053404aca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:47.530 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.501+0000 7f0541c93640 1 --2- 172.21.15.88:0/1786946762 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f05340d3c70 0x7f053404aca0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f0530009870 tx=0x7f053002a1c0 comp rx=0 tx=0).stop 2024-04-26T23:40:47.530 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.501+0000 7f0541c93640 1 -- 172.21.15.88:0/1786946762 shutdown_connections 2024-04-26T23:40:47.530 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.501+0000 7f0541c93640 1 --2- 172.21.15.88:0/1786946762 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f05340d3c70 0x7f053404aca0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:47.530 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.501+0000 7f0541c93640 1 -- 172.21.15.88:0/1786946762 >> 172.21.15.88:0/1786946762 conn(0x7f0534005ec0 msgr2=0x7f05340062d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:40:47.530 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.501+0000 7fe0d4bbb640 1 -- 172.21.15.88:0/2348212621 shutdown_connections 2024-04-26T23:40:47.530 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.500+0000 7f375c8b2640 1 -- start start 2024-04-26T23:40:47.531 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.501+0000 7f0541c93640 1 -- 172.21.15.88:0/1786946762 shutdown_connections 2024-04-26T23:40:47.531 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.501+0000 7f0541c93640 1 -- 172.21.15.88:0/1786946762 wait complete. 2024-04-26T23:40:47.532 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.501+0000 7f375c8b2640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f37581509b0 0x7f3758156490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:47.532 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.501+0000 7f375c8b2640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f37580c79a0 0x7f37581569d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:47.532 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.501+0000 7f375c8b2640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f37580c7ff0 con 0x7f37581505d0 2024-04-26T23:40:47.532 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.501+0000 7f375c8b2640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f37580c8260 con 0x7f37581509b0 2024-04-26T23:40:47.532 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.501+0000 7f375c8b2640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f37580ab8f0 con 0x7f37580c79a0 2024-04-26T23:40:47.532 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.501+0000 7f37577fe640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f37581505d0 0x7f37580c55c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:39646/0 (socket says 172.21.15.88:39646) 2024-04-26T23:40:47.532 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.501+0000 7f37577fe640 1 -- 172.21.15.88:0/3312274858 learned_addr learned my addr 172.21.15.88:0/3312274858 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-26T23:40:47.533 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.501+0000 7fd618da1640 1 -- 172.21.15.88:0/1235519348 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd610037070 con 0x7fd60c0d5950 2024-04-26T23:40:47.533 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.502+0000 7fd61c007640 1 -- 172.21.15.88:0/1235519348 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd60c0d5950 msgr2=0x7fd60c04cee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:47.533 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.501+0000 7f968ec2a640 1 -- 172.21.15.88:0/3418801014 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f968815a1a0 msgr2=0x7f96880c9590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:47.533 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.501+0000 7f968ec2a640 1 --2- 172.21.15.88:0/3418801014 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f968815a1a0 0x7f96880c9590 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f9680009d90 tx=0x7f968002a610 comp rx=0 tx=0).stop 2024-04-26T23:40:47.533 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.501+0000 7f968ec2a640 1 -- 172.21.15.88:0/3418801014 shutdown_connections 2024-04-26T23:40:47.533 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.501+0000 7f968ec2a640 1 --2- 172.21.15.88:0/3418801014 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f968815a1a0 0x7f96880c9590 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:47.533 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.501+0000 7f968ec2a640 1 --2- 172.21.15.88:0/3418801014 >> v2:172.21.15.175:3300/0 conn(0x7f96880ca5a0 0x7f9688156bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:47.533 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.501+0000 7fe0d4bbb640 1 -- 172.21.15.88:0/2348212621 wait complete. 2024-04-26T23:40:47.534 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.502+0000 7fd61c007640 1 --2- 172.21.15.88:0/1235519348 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd60c0d5950 0x7fd60c04cee0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fd60c00fb70 tx=0x7fd61002a280 comp rx=0 tx=0).stop 2024-04-26T23:40:47.534 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.501+0000 7f968ec2a640 1 -- 172.21.15.88:0/3418801014 >> 172.21.15.88:0/3418801014 conn(0x7f96880ae010 msgr2=0x7f96880ae3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:40:47.534 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.501+0000 7f968ec2a640 1 -- 172.21.15.88:0/3418801014 shutdown_connections 2024-04-26T23:40:47.534 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.501+0000 7f968ec2a640 1 -- 172.21.15.88:0/3418801014 wait complete. 2024-04-26T23:40:47.535 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.502+0000 7fd61c007640 1 -- 172.21.15.88:0/1235519348 shutdown_connections 2024-04-26T23:40:47.535 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.502+0000 7fd61c007640 1 --2- 172.21.15.88:0/1235519348 >> v2:172.21.15.175:3300/0 conn(0x7fd60c04d420 0x7fd60c0e2b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:47.535 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.502+0000 7fd61c007640 1 --2- 172.21.15.88:0/1235519348 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd60c0d5950 0x7fd60c04cee0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:47.535 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.502+0000 7fd61c007640 1 -- 172.21.15.88:0/1235519348 >> 172.21.15.88:0/1235519348 conn(0x7fd60c02f4b0 msgr2=0x7fd60c02f890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:40:47.535 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.502+0000 7fd610940640 1 -- 172.21.15.88:0/2201780661 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd60c153570 msgr2=0x7fd60c06d530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:47.535 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.502+0000 7fd610940640 1 --2- 172.21.15.88:0/2201780661 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd60c153570 0x7fd60c06d530 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fd60c0c5d20 tx=0x7fd5fc02c6f0 comp rx=0 tx=0).stop 2024-04-26T23:40:47.536 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.501+0000 7f146d59a640 1 -- 172.21.15.88:0/3641939005 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1468007cb0 con 0x7f1470151e70 2024-04-26T23:40:47.536 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.502+0000 7fd61c007640 1 -- 172.21.15.88:0/1235519348 shutdown_connections 2024-04-26T23:40:47.536 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.502+0000 7fd610940640 1 -- 172.21.15.88:0/2201780661 shutdown_connections 2024-04-26T23:40:47.536 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.502+0000 7fd610940640 1 --2- 172.21.15.88:0/2201780661 >> v2:172.21.15.175:3300/0 conn(0x7fd60c0c3c70 0x7fd60c0c40c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:47.536 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.502+0000 7fd610940640 1 --2- 172.21.15.88:0/2201780661 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd60c153570 0x7fd60c06d530 secure :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fd60c0c5d20 tx=0x7fd5fc02c6f0 comp rx=0 tx=0).stop 2024-04-26T23:40:47.536 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.502+0000 7fd610940640 1 -- 172.21.15.88:0/2201780661 >> 172.21.15.88:0/2201780661 conn(0x7fd60c0c4d60 msgr2=0x7fd60c0c5170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:40:47.537 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.502+0000 7f37567fc640 1 -- 172.21.15.88:0/3312274858 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2516502901 0 0) 0x7f37580c7ff0 con 0x7f37581505d0 2024-04-26T23:40:47.537 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.502+0000 7f37567fc640 1 -- 172.21.15.88:0/3312274858 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3740003520 con 0x7f37581505d0 2024-04-26T23:40:47.537 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.502+0000 7fd61c007640 1 -- 172.21.15.88:0/1235519348 wait complete. 2024-04-26T23:40:47.538 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.503+0000 7fe0d4bbb640 1 Processor -- start 2024-04-26T23:40:47.538 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.503+0000 7f0541c93640 1 Processor -- start 2024-04-26T23:40:47.538 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.503+0000 7fd610940640 1 -- 172.21.15.88:0/2201780661 shutdown_connections 2024-04-26T23:40:47.538 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.501+0000 7fa98f59e640 1 -- 172.21.15.88:0/2232158860 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9900ab580 con 0x7fa990151090 2024-04-26T23:40:47.539 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.503+0000 7fa97cff9640 1 -- 172.21.15.88:0/2232158860 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa968005290 con 0x7fa990151090 2024-04-26T23:40:47.539 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.503+0000 7fd610940640 1 -- 172.21.15.88:0/2201780661 wait complete. 2024-04-26T23:40:47.539 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.503+0000 7f3756ffd640 1 --2- 172.21.15.88:0/3312274858 >> v2:172.21.15.175:3300/0 conn(0x7f37581509b0 0x7f3758156490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:47.539 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.503+0000 7f37567fc640 1 -- 172.21.15.88:0/3312274858 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 173732703 0 0) 0x7f3740003520 con 0x7f37581505d0 2024-04-26T23:40:47.539 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.503+0000 7f37567fc640 1 -- 172.21.15.88:0/3312274858 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f37580c79a0 msgr2=0x7f37581569d0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-26T23:40:47.539 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.503+0000 7f37567fc640 1 --2- 172.21.15.88:0/3312274858 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f37580c79a0 0x7f37581569d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:47.540 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.503+0000 7f37567fc640 1 -- 172.21.15.88:0/3312274858 >> v2:172.21.15.175:3300/0 conn(0x7f37581509b0 msgr2=0x7f3758156490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:40:47.540 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.503+0000 7f37567fc640 1 --2- 172.21.15.88:0/3312274858 >> v2:172.21.15.175:3300/0 conn(0x7f37581509b0 0x7f3758156490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:47.540 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.503+0000 7f37567fc640 1 -- 172.21.15.88:0/3312274858 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37580c8540 con 0x7f37581505d0 2024-04-26T23:40:47.540 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.503+0000 7f37567fc640 1 -- 172.21.15.88:0/3312274858 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 356324787 0 0) 0x7f37500019f0 con 0x7f37581505d0 2024-04-26T23:40:47.540 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.503+0000 7f37567fc640 1 -- 172.21.15.88:0/3312274858 >> v1:172.21.15.88:6789/0 conn(0x7f37581505d0 legacy=0x7f37580c55c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:47.540 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.503+0000 7f37567fc640 1 --2- 172.21.15.88:0/3312274858 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3740003a30 0x7f3740003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:47.540 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.503+0000 7f37567fc640 1 --2- 172.21.15.88:0/3312274858 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3740004800 0x7f3740004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:47.540 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.503+0000 7f37567fc640 1 --2- 172.21.15.88:0/3312274858 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f37400053c0 0x7f37400079a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:47.540 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.503+0000 7f37567fc640 1 -- 172.21.15.88:0/3312274858 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f37580c8260 con 0x7f3740003a30 2024-04-26T23:40:47.540 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.503+0000 7f37567fc640 1 -- 172.21.15.88:0/3312274858 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f37580ab8f0 con 0x7f3740004800 2024-04-26T23:40:47.540 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.503+0000 7f37567fc640 1 -- 172.21.15.88:0/3312274858 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f37400082b0 con 0x7f37400053c0 2024-04-26T23:40:47.541 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.503+0000 7fa97effd640 1 -- 172.21.15.88:0/2232158860 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9800107f0 con 0x7fa990151090 2024-04-26T23:40:47.541 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.503+0000 7f0541c93640 1 -- start start 2024-04-26T23:40:47.541 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.503+0000 7f968ec2a640 1 Processor -- start 2024-04-26T23:40:47.541 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.504+0000 7fa97effd640 1 -- 172.21.15.88:0/2232158860 <== mon.2 v2:172.21.15.175:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa98000b030 con 0x7fa990151090 2024-04-26T23:40:47.542 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.504+0000 7f968ec2a640 1 -- start start 2024-04-26T23:40:47.542 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.504+0000 7f37577fe640 1 --2- 172.21.15.88:0/3312274858 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3740003a30 0x7f3740003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:47.542 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.504+0000 7fe0d4bbb640 1 -- start start 2024-04-26T23:40:47.542 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.504+0000 7f3756ffd640 1 --2- 172.21.15.88:0/3312274858 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3740004800 0x7f3740004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:47.543 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.504+0000 7fa97effd640 1 --2- 172.21.15.88:0/2232158860 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fa97006c9c0 0x7fa97006ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:47.543 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.504+0000 7f0541c93640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f053404b1e0 0x7f05340c8d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:47.543 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.504+0000 7f3757fff640 1 --2- 172.21.15.88:0/3312274858 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f37400053c0 0x7f37400079a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:47.544 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.504+0000 7f0541c93640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f05340d3c70 0x7f05340c7a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:47.544 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.504+0000 7fd61c007640 1 Processor -- start 2024-04-26T23:40:47.544 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.505+0000 7fa97effd640 1 -- 172.21.15.88:0/2232158860 <== mon.2 v2:172.21.15.175:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7fa98008e160 con 0x7fa990151090 2024-04-26T23:40:47.544 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.505+0000 7fa98e59c640 1 --2- 172.21.15.88:0/2232158860 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fa97006c9c0 0x7fa97006ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:47.545 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.505+0000 7fd61c007640 1 -- start start 2024-04-26T23:40:47.545 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.505+0000 7fe0d4bbb640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe0d0072500 0x7fe0d00ab500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:47.545 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.505+0000 7fe0d4bbb640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe0d02010f0 0x7fe0d008a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:47.545 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.505+0000 7f053affd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f05340d3c70 0x7f05340c7a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:47.546 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.505+0000 7fe0d4bbb640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe0d0201550 0x7fe0d008a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:47.546 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.505+0000 7f053affd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f05340d3c70 0x7f05340c7a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:42214/0 (socket says 172.21.15.88:42214) 2024-04-26T23:40:47.546 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.505+0000 7f053b7fe640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f053404b1e0 0x7f05340c8d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:47.546 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.505+0000 7f053b7fe640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f053404b1e0 0x7f05340c8d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.88:46310/0 (socket says 172.21.15.88:46310) 2024-04-26T23:40:47.546 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.505+0000 7fe0d4bbb640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fe0d00c41e0 con 0x7fe0d02010f0 2024-04-26T23:40:47.547 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.505+0000 7f053affd640 1 -- 172.21.15.88:0/1244607207 learned_addr learned my addr 172.21.15.88:0/1244607207 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:40:47.547 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.505+0000 7fe0d4bbb640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fe0d00c2620 con 0x7fe0d0201550 2024-04-26T23:40:47.547 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.505+0000 7fe0d4bbb640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fe0d00c4360 con 0x7fe0d0072500 2024-04-26T23:40:47.547 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.505+0000 7f0541c93640 1 --2- 172.21.15.88:0/1244607207 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f05340decf0 0x7f0534171e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:47.548 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.505+0000 7f0541c93640 1 -- 172.21.15.88:0/1244607207 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f0534046ec0 con 0x7f05340d3c70 2024-04-26T23:40:47.548 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.502+0000 7f146f59e640 1 -- 172.21.15.88:0/3641939005 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1470151e70 msgr2=0x7f14700735a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:47.548 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.502+0000 7f146f59e640 1 --2- 172.21.15.88:0/3641939005 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1470151e70 0x7f14700735a0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f1468009dc0 tx=0x7f146802a630 comp rx=0 tx=0).stop 2024-04-26T23:40:47.548 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.503+0000 7f146f59e640 1 -- 172.21.15.88:0/3641939005 shutdown_connections 2024-04-26T23:40:47.548 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.503+0000 7f146f59e640 1 --2- 172.21.15.88:0/3641939005 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1470151e70 0x7f14700735a0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:47.548 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.503+0000 7f146f59e640 1 -- 172.21.15.88:0/3641939005 >> 172.21.15.88:0/3641939005 conn(0x7f14700c80c0 msgr2=0x7f14700c84a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:40:47.548 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.503+0000 7f146f59e640 1 -- 172.21.15.88:0/3641939005 shutdown_connections 2024-04-26T23:40:47.549 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.504+0000 7f37577fe640 1 -- 172.21.15.88:0/3312274858 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f37400053c0 msgr2=0x7f37400079a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:40:47.549 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.504+0000 7f37577fe640 1 --2- 172.21.15.88:0/3312274858 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f37400053c0 0x7f37400079a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:47.549 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.504+0000 7f37577fe640 1 -- 172.21.15.88:0/3312274858 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3740004800 msgr2=0x7f3740004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:40:47.549 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.504+0000 7f37577fe640 1 --2- 172.21.15.88:0/3312274858 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3740004800 0x7f3740004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:47.549 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.504+0000 7f37577fe640 1 -- 172.21.15.88:0/3312274858 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3740003520 con 0x7f3740003a30 2024-04-26T23:40:47.549 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.505+0000 7f0541c93640 1 -- 172.21.15.88:0/1244607207 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f05340d6600 con 0x7f05340decf0 2024-04-26T23:40:47.549 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.505+0000 7fe0cffff640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe0d0201550 0x7fe0d008a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:47.550 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.505+0000 7f968ec2a640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f96880ca5a0 0x7f96881ed6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:47.550 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.505+0000 7fe0cffff640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe0d0201550 0x7fe0d008a9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.88:34362/0 (socket says 172.21.15.88:34362) 2024-04-26T23:40:47.550 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.505+0000 7fe0cffff640 1 -- 172.21.15.88:0/3257937200 learned_addr learned my addr 172.21.15.88:0/3257937200 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:40:47.550 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.505+0000 7f0541c93640 1 -- 172.21.15.88:0/1244607207 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f0534047040 con 0x7f053404b1e0 2024-04-26T23:40:47.551 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.505+0000 7f968ec2a640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9688154160 0x7f96880ac4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:47.551 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.505+0000 7fe0ceffd640 1 --2- 172.21.15.88:0/3257937200 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe0d02010f0 0x7fe0d008a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:47.552 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.505+0000 7f968ec2a640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f968815a1a0 0x7f96881edf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:47.552 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.505+0000 7f968c9c6640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f96880ca5a0 0x7f96881ed6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:47.552 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.505+0000 7f968c9c6640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f96880ca5a0 0x7f96881ed6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.88:34382/0 (socket says 172.21.15.88:34382) 2024-04-26T23:40:47.552 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.505+0000 7f9687fff640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9688154160 0x7f96880ac4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:47.552 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.505+0000 7f9687fff640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9688154160 0x7f96880ac4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.88:46324/0 (socket says 172.21.15.88:46324) 2024-04-26T23:40:47.552 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.505+0000 7fd610940640 1 Processor -- start 2024-04-26T23:40:47.553 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.505+0000 7f053bfff640 1 --2- 172.21.15.88:0/1244607207 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f05340decf0 0x7f0534171e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:47.553 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.505+0000 7f968c9c6640 1 -- 172.21.15.88:0/2417426196 learned_addr learned my addr 172.21.15.88:0/2417426196 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:40:47.553 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.506+0000 7fe0cffff640 1 -- 172.21.15.88:0/3257937200 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe0d0072500 msgr2=0x7fe0d00ab500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:47.554 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.505+0000 7f968ec2a640 1 -- 172.21.15.88:0/2417426196 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f968815a5f0 con 0x7f968815a1a0 2024-04-26T23:40:47.554 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.505+0000 7f968ec2a640 1 -- 172.21.15.88:0/2417426196 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f968815aed0 con 0x7f96880ca5a0 2024-04-26T23:40:47.554 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.505+0000 7f968ec2a640 1 -- 172.21.15.88:0/2417426196 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f96880c7510 con 0x7f9688154160 2024-04-26T23:40:47.554 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.506+0000 7fe0cffff640 1 --2- 172.21.15.88:0/3257937200 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe0d0072500 0x7fe0d00ab500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:47.554 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.506+0000 7fe0cffff640 1 -- 172.21.15.88:0/3257937200 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe0d02010f0 msgr2=0x7fe0d008a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:47.555 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.506+0000 7f968d1c7640 1 --2- 172.21.15.88:0/2417426196 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f968815a1a0 0x7f96881edf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:47.555 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.506+0000 7f053bfff640 1 -- 172.21.15.88:0/1244607207 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f053404b1e0 msgr2=0x7f05340c8d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:47.555 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.506+0000 7f053bfff640 1 --2- 172.21.15.88:0/1244607207 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f053404b1e0 0x7f05340c8d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:47.555 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.506+0000 7f053bfff640 1 -- 172.21.15.88:0/1244607207 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f05340d3c70 msgr2=0x7f05340c7a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:47.555 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.506+0000 7f053bfff640 1 --2- 172.21.15.88:0/1244607207 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f05340d3c70 0x7f05340c7a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:47.555 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.506+0000 7f053bfff640 1 -- 172.21.15.88:0/1244607207 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05340cacb0 con 0x7f05340decf0 2024-04-26T23:40:47.556 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.506+0000 7fe0cffff640 1 --2- 172.21.15.88:0/3257937200 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe0d02010f0 0x7fe0d008a4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:47.556 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.506+0000 7fe0cffff640 1 -- 172.21.15.88:0/3257937200 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0d0160a40 con 0x7fe0d0201550 2024-04-26T23:40:47.556 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.506+0000 7fe0cffff640 1 --2- 172.21.15.88:0/3257937200 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe0d0201550 0x7fe0d008a9f0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fe0c800c6f0 tx=0x7fe0c800cbb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:47.556 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.506+0000 7f37577fe640 1 --2- 172.21.15.88:0/3312274858 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3740003a30 0x7f3740003e10 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f375000d0e0 tx=0x7f3740005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4ed4d273b17514a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:47.557 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.506+0000 7f146f59e640 1 -- 172.21.15.88:0/3641939005 wait complete. 2024-04-26T23:40:47.557 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.506+0000 7f9687fff640 1 -- 172.21.15.88:0/2417426196 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f96880ca5a0 msgr2=0x7f96881ed6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:47.557 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.506+0000 7f9687fff640 1 --2- 172.21.15.88:0/2417426196 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f96880ca5a0 0x7f96881ed6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:47.557 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.506+0000 7f9687fff640 1 -- 172.21.15.88:0/2417426196 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f968815a1a0 msgr2=0x7f96881edf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:47.557 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.506+0000 7f9687fff640 1 --2- 172.21.15.88:0/2417426196 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f968815a1a0 0x7f96881edf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:47.557 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.506+0000 7f9687fff640 1 -- 172.21.15.88:0/2417426196 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96881f0bd0 con 0x7f9688154160 2024-04-26T23:40:47.558 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.506+0000 7fe0b7fff640 1 -- 172.21.15.88:0/3257937200 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0c8017070 con 0x7fe0d0201550 2024-04-26T23:40:47.558 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.506+0000 7f053bfff640 1 --2- 172.21.15.88:0/1244607207 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f05340decf0 0x7f0534171e90 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f053c075190 tx=0x7f053c069f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:47.558 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.506+0000 7f37567fc640 1 -- 172.21.15.88:0/3312274858 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37500055f0 con 0x7f3740003a30 2024-04-26T23:40:47.558 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.506+0000 7fe0b7fff640 1 -- 172.21.15.88:0/3257937200 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0c800a640 con 0x7fe0d0201550 2024-04-26T23:40:47.559 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.506+0000 7f37567fc640 1 -- 172.21.15.88:0/3312274858 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37500082d0 con 0x7f3740003a30 2024-04-26T23:40:47.559 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.506+0000 7f37567fc640 1 -- 172.21.15.88:0/3312274858 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3750008740 con 0x7f3740003a30 2024-04-26T23:40:47.559 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.506+0000 7fe0d4bbb640 1 -- 172.21.15.88:0/3257937200 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0d015f190 con 0x7fe0d0201550 2024-04-26T23:40:47.559 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.506+0000 7fd61c007640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd60c04b8c0 0x7fd60c16e020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:47.560 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.507+0000 7fd61c007640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd60c04d420 0x7fd60c16e560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:47.560 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.507+0000 7fa98e59c640 1 --2- 172.21.15.88:0/2232158860 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fa97006c9c0 0x7fa97006ee80 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fa9840017f0 tx=0x7fa984009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:47.560 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.507+0000 7f0527fff640 1 -- 172.21.15.88:0/1244607207 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f053c06f640 con 0x7f05340decf0 2024-04-26T23:40:47.560 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.506+0000 7fd610940640 1 -- start start 2024-04-26T23:40:47.560 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.507+0000 7fd610940640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd60c0c3c70 0x7fd60c155150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:47.561 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.507+0000 7fd610940640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd60c14cae0 0x7fd60c14f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:47.561 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.507+0000 7f0541c93640 1 -- 172.21.15.88:0/1244607207 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05340c51a0 con 0x7f05340decf0 2024-04-26T23:40:47.561 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.507+0000 7f0527fff640 1 -- 172.21.15.88:0/1244607207 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f053c092020 con 0x7f05340decf0 2024-04-26T23:40:47.561 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.507+0000 7f0527fff640 1 -- 172.21.15.88:0/1244607207 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f053c06f640 con 0x7f05340decf0 2024-04-26T23:40:47.561 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.507+0000 7f0541c93640 1 -- 172.21.15.88:0/1244607207 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05340c7fd0 con 0x7f05340decf0 2024-04-26T23:40:47.561 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.507+0000 7fd619da3640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd60c04b8c0 0x7fd60c16e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:47.562 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.507+0000 7fd610940640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd60c14f900 0x7fd60c1e54a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:47.562 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.506+0000 7f9687fff640 1 --2- 172.21.15.88:0/2417426196 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9688154160 0x7f96880ac4e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f967400e880 tx=0x7f967400ed40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:47.563 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.507+0000 7fd609d9b640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd60c14cae0 0x7fd60c14f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:47.563 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.507+0000 7fd610940640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fd60c0ab660 con 0x7fd60c14cae0 2024-04-26T23:40:47.563 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.507+0000 7fd610940640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fd60c0ab380 con 0x7fd60c14f900 2024-04-26T23:40:47.563 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.507+0000 7fd609d9b640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd60c14cae0 0x7fd60c14f3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:42258/0 (socket says 172.21.15.88:42258) 2024-04-26T23:40:47.563 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.507+0000 7fd610940640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fd60c14cec0 con 0x7fd60c0c3c70 2024-04-26T23:40:47.563 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.507+0000 7fd609d9b640 1 -- 172.21.15.88:0/3628750348 learned_addr learned my addr 172.21.15.88:0/3628750348 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:40:47.564 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.507+0000 7fd619da3640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd60c04b8c0 0x7fd60c16e020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:42246/0 (socket says 172.21.15.88:42246) 2024-04-26T23:40:47.564 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.507+0000 7fd619da3640 1 -- 172.21.15.88:0/1529177665 learned_addr learned my addr 172.21.15.88:0/1529177665 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:40:47.564 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.507+0000 7fd61c007640 1 --2- 172.21.15.88:0/1529177665 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd60c0d5950 0x7fd60c0da0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:47.564 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.507+0000 7fd61c007640 1 -- 172.21.15.88:0/1529177665 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fd60c048a50 con 0x7fd60c04b8c0 2024-04-26T23:40:47.564 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.507+0000 7fd61c007640 1 -- 172.21.15.88:0/1529177665 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fd60c030300 con 0x7fd60c0d5950 2024-04-26T23:40:47.564 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.507+0000 7fd61c007640 1 -- 172.21.15.88:0/1529177665 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fd60c048bd0 con 0x7fd60c04d420 2024-04-26T23:40:47.564 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.507+0000 7fd6195a2640 1 --2- 172.21.15.88:0/1529177665 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd60c04d420 0x7fd60c16e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:47.565 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.507+0000 7fd60a59c640 1 --2- 172.21.15.88:0/3628750348 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd60c0c3c70 0x7fd60c155150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:47.565 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.507+0000 7fd609d9b640 1 -- 172.21.15.88:0/3628750348 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd60c0c3c70 msgr2=0x7fd60c155150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:47.565 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.507+0000 7fd609d9b640 1 --2- 172.21.15.88:0/3628750348 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd60c0c3c70 0x7fd60c155150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:47.565 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.507+0000 7fd609d9b640 1 -- 172.21.15.88:0/3628750348 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd60c14f900 msgr2=0x7fd60c1e54a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:47.565 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.507+0000 7fd609d9b640 1 --2- 172.21.15.88:0/3628750348 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd60c14f900 0x7fd60c1e54a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:47.565 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.507+0000 7fd609d9b640 1 -- 172.21.15.88:0/3628750348 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd60c071e40 con 0x7fd60c14cae0 2024-04-26T23:40:47.565 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.507+0000 7f375c8b2640 1 -- 172.21.15.88:0/3312274858 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3740003a30 msgr2=0x7f3740003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:47.565 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.507+0000 7f375c8b2640 1 --2- 172.21.15.88:0/3312274858 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3740003a30 0x7f3740003e10 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f375000d0e0 tx=0x7f3740005830 comp rx=0 tx=0).stop 2024-04-26T23:40:47.566 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.507+0000 7f3757fff640 1 -- 172.21.15.88:0/3312274858 reap_dead start 2024-04-26T23:40:47.566 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.508+0000 7f375c8b2640 1 -- 172.21.15.88:0/3312274858 shutdown_connections 2024-04-26T23:40:47.566 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.508+0000 7f375c8b2640 1 -- 172.21.15.88:0/3312274858 >> 172.21.15.88:0/3312274858 conn(0x7f37580aa8d0 msgr2=0x7f37580aace0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:40:47.566 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.508+0000 7fd61a5a4640 1 --2- 172.21.15.88:0/1529177665 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd60c0d5950 0x7fd60c0da0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:47.566 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.508+0000 7f375c8b2640 1 -- 172.21.15.88:0/3312274858 shutdown_connections 2024-04-26T23:40:47.567 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.508+0000 7fd6195a2640 1 -- 172.21.15.88:0/1529177665 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd60c0d5950 msgr2=0x7fd60c0da0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:47.567 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.508+0000 7fd6195a2640 1 --2- 172.21.15.88:0/1529177665 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd60c0d5950 0x7fd60c0da0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:47.567 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.507+0000 7fe0b7fff640 1 -- 172.21.15.88:0/3257937200 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0c800a9f0 con 0x7fe0d0201550 2024-04-26T23:40:47.567 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.508+0000 7fd6195a2640 1 -- 172.21.15.88:0/1529177665 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd60c04b8c0 msgr2=0x7fd60c16e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:47.567 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.508+0000 7fe0d4bbb640 1 -- 172.21.15.88:0/3257937200 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0d008af30 con 0x7fe0d0201550 2024-04-26T23:40:47.568 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.508+0000 7fd6195a2640 1 --2- 172.21.15.88:0/1529177665 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd60c04b8c0 0x7fd60c16e020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:47.568 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.508+0000 7fd6195a2640 1 -- 172.21.15.88:0/1529177665 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd60c0dbff0 con 0x7fd60c04d420 2024-04-26T23:40:47.568 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.508+0000 7fd61a5a4640 1 --2- 172.21.15.88:0/1529177665 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd60c0d5950 0x7fd60c0da0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:40:47.568 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.508+0000 7fd6195a2640 1 --2- 172.21.15.88:0/1529177665 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd60c04d420 0x7fd60c16e560 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fd60400c3c0 tx=0x7fd60400c880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:47.568 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.508+0000 7fd609d9b640 1 --2- 172.21.15.88:0/3628750348 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd60c14cae0 0x7fd60c14f3c0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fd5fc00bb10 tx=0x7fd5fc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:47.569 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.508+0000 7f146f59e640 1 Processor -- start 2024-04-26T23:40:47.569 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.508+0000 7f146f59e640 1 -- start start 2024-04-26T23:40:47.569 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.508+0000 7f375c8b2640 1 -- 172.21.15.88:0/3312274858 wait complete. 2024-04-26T23:40:47.569 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.508+0000 7f0541c93640 1 -- 172.21.15.88:0/1244607207 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f05340053c0 con 0x7f05340decf0 2024-04-26T23:40:47.570 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.508+0000 7fd602ffd640 1 -- 172.21.15.88:0/3628750348 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5fc03a040 con 0x7fd60c14cae0 2024-04-26T23:40:47.570 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.509+0000 7fd602ffd640 1 -- 172.21.15.88:0/3628750348 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5fc004030 con 0x7fd60c14cae0 2024-04-26T23:40:47.570 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.509+0000 7fe0b7fff640 1 -- 172.21.15.88:0/3257937200 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe0c801a070 con 0x7fe0d0201550 2024-04-26T23:40:47.571 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.509+0000 7f146f59e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f147006e700 0x7f1470141270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:47.571 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.509+0000 7f146f59e640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f147006f7b0 0x7f1470153740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:47.571 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.509+0000 7f146f59e640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1470151e70 0x7f1470153c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:47.571 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.509+0000 7f146f59e640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f1470072100 con 0x7f1470151e70 2024-04-26T23:40:47.571 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.509+0000 7f146f59e640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f1470154b20 con 0x7f147006f7b0 2024-04-26T23:40:47.571 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.509+0000 7f146f59e640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f14701556c0 con 0x7f147006e700 2024-04-26T23:40:47.571 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.509+0000 7f146dd9b640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f147006f7b0 0x7f1470153740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:47.572 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.509+0000 7f146dd9b640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f147006f7b0 0x7f1470153740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.88:34414/0 (socket says 172.21.15.88:34414) 2024-04-26T23:40:47.572 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.509+0000 7f146e59c640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f147006e700 0x7f1470141270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:47.572 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.509+0000 7f146e59c640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f147006e700 0x7f1470141270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.88:46358/0 (socket says 172.21.15.88:46358) 2024-04-26T23:40:47.572 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.509+0000 7f146e59c640 1 -- 172.21.15.88:0/4243481779 learned_addr learned my addr 172.21.15.88:0/4243481779 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:40:47.572 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.509+0000 7fe0d4bbb640 1 -- 172.21.15.88:0/3257937200 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe0d00506c0 con 0x7fe0d0201550 2024-04-26T23:40:47.572 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.509+0000 7fd610940640 1 -- 172.21.15.88:0/3628750348 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd60c14ec00 con 0x7fd60c14cae0 2024-04-26T23:40:47.573 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.509+0000 7fd610940640 1 -- 172.21.15.88:0/3628750348 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd60c14eea0 con 0x7fd60c14cae0 2024-04-26T23:40:47.573 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.509+0000 7fd602ffd640 1 -- 172.21.15.88:0/3628750348 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5fc0043e0 con 0x7fd60c14cae0 2024-04-26T23:40:47.573 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.510+0000 7f146ed9d640 1 --2- 172.21.15.88:0/4243481779 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1470151e70 0x7f1470153c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:47.573 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.510+0000 7fe0b7fff640 1 --2- 172.21.15.88:0/3257937200 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fe0bc06c940 0x7fe0bc06ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:47.574 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.510+0000 7fd60a7fc640 1 -- 172.21.15.88:0/1529177665 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd604017070 con 0x7fd60c04d420 2024-04-26T23:40:47.574 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.510+0000 7fd60a7fc640 1 -- 172.21.15.88:0/1529177665 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6040035f0 con 0x7fd60c04d420 2024-04-26T23:40:47.574 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.510+0000 7fd60a7fc640 1 -- 172.21.15.88:0/1529177665 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd604017070 con 0x7fd60c04d420 2024-04-26T23:40:47.574 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.510+0000 7fa97effd640 1 -- 172.21.15.88:0/2232158860 <== mon.2 v2:172.21.15.175:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fa98005bc80 con 0x7fa990151090 2024-04-26T23:40:47.574 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.510+0000 7fd61c007640 1 -- 172.21.15.88:0/1529177665 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd60c0dc2d0 con 0x7fd60c04d420 2024-04-26T23:40:47.575 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.510+0000 7f0527fff640 1 -- 172.21.15.88:0/1244607207 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f053c06f820 con 0x7f05340decf0 2024-04-26T23:40:47.575 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.510+0000 7fe0cf7fe640 1 --2- 172.21.15.88:0/3257937200 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fe0bc06c940 0x7fe0bc06ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:47.575 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.510+0000 7fd61c007640 1 -- 172.21.15.88:0/1529177665 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fd60c0d0100 con 0x7fd60c04d420 2024-04-26T23:40:47.576 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.510+0000 7f146ed9d640 1 -- 172.21.15.88:0/4243481779 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f147006e700 msgr2=0x7f1470141270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:47.576 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.510+0000 7f146ed9d640 1 --2- 172.21.15.88:0/4243481779 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f147006e700 0x7f1470141270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:47.576 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.510+0000 7f146ed9d640 1 -- 172.21.15.88:0/4243481779 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f147006f7b0 msgr2=0x7f1470153740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:47.576 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.510+0000 7f146ed9d640 1 --2- 172.21.15.88:0/4243481779 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f147006f7b0 0x7f1470153740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:47.576 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.510+0000 7f146ed9d640 1 -- 172.21.15.88:0/4243481779 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1470140950 con 0x7f1470151e70 2024-04-26T23:40:47.576 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.510+0000 7f146ed9d640 1 --2- 172.21.15.88:0/4243481779 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1470151e70 0x7f1470153c80 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f146400c410 tx=0x7f146400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:47.576 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.510+0000 7f96857fa640 1 -- 172.21.15.88:0/2417426196 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9674017070 con 0x7f9688154160 2024-04-26T23:40:47.577 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.511+0000 7fe0cf7fe640 1 --2- 172.21.15.88:0/3257937200 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fe0bc06c940 0x7fe0bc06ee00 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fe0c4034000 tx=0x7fe0c402c000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:47.577 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.511+0000 7f96857fa640 1 -- 172.21.15.88:0/2417426196 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f967400c940 con 0x7f9688154160 2024-04-26T23:40:47.577 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.511+0000 7f96857fa640 1 -- 172.21.15.88:0/2417426196 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f967400cd10 con 0x7f9688154160 2024-04-26T23:40:47.577 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.511+0000 7f968ec2a640 1 -- 172.21.15.88:0/2417426196 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96880b1fa0 con 0x7f9688154160 2024-04-26T23:40:47.577 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.511+0000 7f968ec2a640 1 -- 172.21.15.88:0/2417426196 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f96881ecea0 con 0x7f9688154160 2024-04-26T23:40:47.578 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.509+0000 7f375c8b2640 1 Processor -- start 2024-04-26T23:40:47.578 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.510+0000 7f375c8b2640 1 -- start start 2024-04-26T23:40:47.578 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.511+0000 7f375c8b2640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3740003a30 0x7f37581eb370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:47.578 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.511+0000 7f375c8b2640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3758153b50 0x7f3758152ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:47.579 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.511+0000 7f375c8b2640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3758073510 0x7f37581533e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:47.579 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.511+0000 7f375c8b2640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f37580c5e50 con 0x7f3758073510 2024-04-26T23:40:47.579 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.511+0000 7f375c8b2640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f37580c5cd0 con 0x7f3740003a30 2024-04-26T23:40:47.579 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.511+0000 7f375c8b2640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f37580ac3d0 con 0x7f3758153b50 2024-04-26T23:40:47.579 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.511+0000 7f3757fff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3758073510 0x7f37581533e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:47.579 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.511+0000 7f3757fff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3758073510 0x7f37581533e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:42280/0 (socket says 172.21.15.88:42280) 2024-04-26T23:40:47.579 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.511+0000 7f145effd640 1 -- 172.21.15.88:0/4243481779 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1464017070 con 0x7f1470151e70 2024-04-26T23:40:47.579 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.511+0000 7f145effd640 1 -- 172.21.15.88:0/4243481779 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14640035f0 con 0x7f1470151e70 2024-04-26T23:40:47.579 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.511+0000 7f145effd640 1 -- 172.21.15.88:0/4243481779 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14640039e0 con 0x7f1470151e70 2024-04-26T23:40:47.580 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.511+0000 7f3757fff640 1 -- 172.21.15.88:0/2599172618 learned_addr learned my addr 172.21.15.88:0/2599172618 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:40:47.580 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.511+0000 7f146f59e640 1 -- 172.21.15.88:0/4243481779 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14701ec5d0 con 0x7f1470151e70 2024-04-26T23:40:47.580 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.511+0000 7f37577fe640 1 --2- 172.21.15.88:0/2599172618 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3740003a30 0x7f37581eb370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:47.580 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.510+0000 7f0527fff640 1 --2- 172.21.15.88:0/1244607207 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f052006caf0 0x7f052006efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:47.581 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.511+0000 7f0527fff640 1 -- 172.21.15.88:0/1244607207 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7f053c072e00 con 0x7f05340decf0 2024-04-26T23:40:47.581 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.512+0000 7f146f59e640 1 -- 172.21.15.88:0/4243481779 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14701ecb90 con 0x7f1470151e70 2024-04-26T23:40:47.582 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.511+0000 7f3756ffd640 1 --2- 172.21.15.88:0/2599172618 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3758153b50 0x7f3758152ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:47.582 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.512+0000 7f37577fe640 1 -- 172.21.15.88:0/2599172618 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3758153b50 msgr2=0x7f3758152ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:47.582 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.512+0000 7f37577fe640 1 --2- 172.21.15.88:0/2599172618 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3758153b50 0x7f3758152ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:47.582 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.512+0000 7f37577fe640 1 -- 172.21.15.88:0/2599172618 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3758073510 msgr2=0x7f37581533e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:47.582 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.512+0000 7f37577fe640 1 --2- 172.21.15.88:0/2599172618 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3758073510 0x7f37581533e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:47.582 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.512+0000 7f37577fe640 1 -- 172.21.15.88:0/2599172618 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37581ebbb0 con 0x7f3740003a30 2024-04-26T23:40:47.582 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.512+0000 7f968ec2a640 1 -- 172.21.15.88:0/2417426196 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9688076650 con 0x7f9688154160 2024-04-26T23:40:47.583 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.513+0000 7fd610940640 1 -- 172.21.15.88:0/3628750348 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd60c0506c0 con 0x7fd60c14cae0 2024-04-26T23:40:47.583 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.512+0000 7fd61c007640 1 -- 172.21.15.88:0/1529177665 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd60c0057e0 con 0x7fd60c04d420 2024-04-26T23:40:47.583 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.513+0000 7f96857fa640 1 -- 172.21.15.88:0/2417426196 <== mon.2 v2:172.21.15.175:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f967401a070 con 0x7f9688154160 2024-04-26T23:40:47.583 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.513+0000 7f37577fe640 1 --2- 172.21.15.88:0/2599172618 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3740003a30 0x7f37581eb370 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f3740008200 tx=0x7f3750004dc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:47.584 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.512+0000 7f053b7fe640 1 --2- 172.21.15.88:0/1244607207 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f052006caf0 0x7f052006efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:47.584 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.513+0000 7f053b7fe640 1 --2- 172.21.15.88:0/1244607207 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f052006caf0 0x7f052006efb0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f0530034000 tx=0x7f053002e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:47.584 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.513+0000 7fd60a7fc640 1 -- 172.21.15.88:0/1529177665 <== mon.2 v2:172.21.15.175:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd6040037e0 con 0x7fd60c04d420 2024-04-26T23:40:47.584 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.513+0000 7fd60a7fc640 1 --2- 172.21.15.88:0/1529177665 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fd5f806ccf0 0x7fd5f806f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:47.584 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.513+0000 7f146f59e640 1 -- 172.21.15.88:0/4243481779 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1454005290 con 0x7f1470151e70 2024-04-26T23:40:47.585 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.514+0000 7f96857fa640 1 --2- 172.21.15.88:0/2417426196 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f966c06c940 0x7f966c06ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:47.585 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.513+0000 7fd60a7fc640 1 -- 172.21.15.88:0/1529177665 <== mon.2 v2:172.21.15.175:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7fd6040052e0 con 0x7fd60c04d420 2024-04-26T23:40:47.585 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.514+0000 7fd619da3640 1 --2- 172.21.15.88:0/1529177665 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fd5f806ccf0 0x7fd5f806f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:47.586 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.514+0000 7f968c9c6640 1 --2- 172.21.15.88:0/2417426196 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f966c06c940 0x7f966c06ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:47.586 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.514+0000 7f96857fa640 1 -- 172.21.15.88:0/2417426196 <== mon.2 v2:172.21.15.175:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7f967408bbf0 con 0x7f9688154160 2024-04-26T23:40:47.586 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.514+0000 7fd602ffd640 1 -- 172.21.15.88:0/3628750348 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd5fc03f660 con 0x7fd60c14cae0 2024-04-26T23:40:47.586 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.514+0000 7f373ffff640 1 -- 172.21.15.88:0/2599172618 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3750001c10 con 0x7f3740003a30 2024-04-26T23:40:47.586 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.514+0000 7fd602ffd640 1 --2- 172.21.15.88:0/3628750348 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fd5f406c9c0 0x7fd5f406ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:47.587 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.514+0000 7f375c8b2640 1 -- 172.21.15.88:0/2599172618 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37581ebe50 con 0x7f3740003a30 2024-04-26T23:40:47.587 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.514+0000 7f375c8b2640 1 -- 172.21.15.88:0/2599172618 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37581eb8b0 con 0x7f3740003a30 2024-04-26T23:40:47.587 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.514+0000 7fe0b7fff640 1 -- 172.21.15.88:0/3257937200 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7fe0c8056d00 con 0x7fe0d0201550 2024-04-26T23:40:47.588 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.514+0000 7fd602ffd640 1 -- 172.21.15.88:0/3628750348 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7fd5fc0afec0 con 0x7fd60c14cae0 2024-04-26T23:40:47.588 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.515+0000 7f0527fff640 1 -- 172.21.15.88:0/1244607207 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f053c09c030 con 0x7f05340decf0 2024-04-26T23:40:47.588 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.515+0000 7f145effd640 1 -- 172.21.15.88:0/4243481779 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f146401a070 con 0x7f1470151e70 2024-04-26T23:40:47.588 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.514+0000 7fd619da3640 1 --2- 172.21.15.88:0/1529177665 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fd5f806ccf0 0x7fd5f806f1b0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fd610035040 tx=0x7fd61002e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:47.589 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.515+0000 7fd60a59c640 1 --2- 172.21.15.88:0/3628750348 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fd5f406c9c0 0x7fd5f406ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:47.589 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.515+0000 7f145effd640 1 --2- 172.21.15.88:0/4243481779 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f145006c940 0x7f145006ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:47.589 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.515+0000 7f968c9c6640 1 --2- 172.21.15.88:0/2417426196 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f966c06c940 0x7f966c06ee00 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f96880c42a0 tx=0x7f967c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:47.590 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.515+0000 7f145effd640 1 -- 172.21.15.88:0/4243481779 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7f146408b130 con 0x7f1470151e70 2024-04-26T23:40:47.590 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.515+0000 7f146e59c640 1 --2- 172.21.15.88:0/4243481779 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f145006c940 0x7f145006ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:47.590 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.515+0000 7fd60a59c640 1 --2- 172.21.15.88:0/3628750348 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fd5f406c9c0 0x7fd5f406ee80 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fd604004c80 tx=0x7fd604007400 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:47.590 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.516+0000 7f146e59c640 1 --2- 172.21.15.88:0/4243481779 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f145006c940 0x7f145006ee00 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f1468009bd0 tx=0x7f146802f000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:47.591 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.516+0000 7f375c8b2640 1 -- 172.21.15.88:0/2599172618 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f37580506c0 con 0x7f3740003a30 2024-04-26T23:40:47.591 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.518+0000 7f96857fa640 1 -- 172.21.15.88:0/2417426196 <== mon.2 v2:172.21.15.175:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f9674059810 con 0x7f9688154160 2024-04-26T23:40:47.591 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.519+0000 7f373ffff640 1 -- 172.21.15.88:0/2599172618 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3750001730 con 0x7f3740003a30 2024-04-26T23:40:47.591 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.519+0000 7f373ffff640 1 -- 172.21.15.88:0/2599172618 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37500018e0 con 0x7f3740003a30 2024-04-26T23:40:47.592 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.519+0000 7fe0b7fff640 1 -- 172.21.15.88:0/3257937200 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fe0c8058c60 con 0x7fe0d0201550 2024-04-26T23:40:47.592 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.521+0000 7f373ffff640 1 -- 172.21.15.88:0/2599172618 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f3750008290 con 0x7f3740003a30 2024-04-26T23:40:47.592 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.521+0000 7f373ffff640 1 --2- 172.21.15.88:0/2599172618 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f374406c8f0 0x7f374406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:47.592 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.522+0000 7f3756ffd640 1 --2- 172.21.15.88:0/2599172618 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f374406c8f0 0x7f374406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:47.592 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.522+0000 7f373ffff640 1 -- 172.21.15.88:0/2599172618 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7f3750077e30 con 0x7f3740003a30 2024-04-26T23:40:47.593 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.522+0000 7f3756ffd640 1 --2- 172.21.15.88:0/2599172618 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f374406c8f0 0x7f374406edb0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f37581dddf0 tx=0x7f3748008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:47.593 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.523+0000 7fd60a7fc640 1 -- 172.21.15.88:0/1529177665 <== mon.2 v2:172.21.15.175:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fd604058590 con 0x7fd60c04d420 2024-04-26T23:40:47.593 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.524+0000 7fd602ffd640 1 -- 172.21.15.88:0/3628750348 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fd5fc045020 con 0x7fd60c14cae0 2024-04-26T23:40:47.593 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.524+0000 7f373ffff640 1 -- 172.21.15.88:0/2599172618 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f375007a490 con 0x7f3740003a30 2024-04-26T23:40:47.594 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.533+0000 7f145effd640 1 -- 172.21.15.88:0/4243481779 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f1464058c50 con 0x7f1470151e70 2024-04-26T23:40:47.941 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.937+0000 7fa97cff9640 1 -- 172.21.15.88:0/2232158860 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7fa968005580 con 0x7fa990151090 2024-04-26T23:40:47.941 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.938+0000 7fa97effd640 1 -- 172.21.15.88:0/2232158860 <== mon.2 v2:172.21.15.175:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fa98005ff80 con 0x7fa990151090 2024-04-26T23:40:47.942 INFO:teuthology.orchestra.run.smithi088.stdout:55834574857 2024-04-26T23:40:47.945 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.941+0000 7f968ec2a640 1 -- 172.21.15.88:0/2417426196 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f96880507a0 con 0x7f9688154160 2024-04-26T23:40:47.946 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.941+0000 7fa98f59e640 1 -- 172.21.15.88:0/2232158860 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fa97006c9c0 msgr2=0x7fa97006ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:47.946 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.941+0000 7fa98f59e640 1 --2- 172.21.15.88:0/2232158860 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fa97006c9c0 0x7fa97006ee80 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fa9840017f0 tx=0x7fa984009040 comp rx=0 tx=0).stop 2024-04-26T23:40:47.946 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.941+0000 7fa98f59e640 1 -- 172.21.15.88:0/2232158860 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa990151090 msgr2=0x7fa9900c8660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:47.946 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.941+0000 7fa98f59e640 1 --2- 172.21.15.88:0/2232158860 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa990151090 0x7fa9900c8660 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fa98000eb60 tx=0x7fa980007410 comp rx=0 tx=0).stop 2024-04-26T23:40:47.947 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.941+0000 7fa98f59e640 1 -- 172.21.15.88:0/2232158860 shutdown_connections 2024-04-26T23:40:47.947 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.941+0000 7fa98f59e640 1 --2- 172.21.15.88:0/2232158860 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fa97006c9c0 0x7fa97006ee80 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:47.947 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.941+0000 7fa98f59e640 1 --2- 172.21.15.88:0/2232158860 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa990151090 0x7fa9900c8660 secure :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fa98000eb60 tx=0x7fa980007410 comp rx=0 tx=0).stop 2024-04-26T23:40:47.947 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.941+0000 7fa98f59e640 1 --2- 172.21.15.88:0/2232158860 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa990154190 0x7fa9900abd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:47.947 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.941+0000 7fa98f59e640 1 --2- 172.21.15.88:0/2232158860 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa99006d0f0 0x7fa99014ae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:47.947 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.941+0000 7fa98f59e640 1 -- 172.21.15.88:0/2232158860 >> 172.21.15.88:0/2232158860 conn(0x7fa99006c310 msgr2=0x7fa990150750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:40:47.947 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.941+0000 7fa98f59e640 1 -- 172.21.15.88:0/2232158860 shutdown_connections 2024-04-26T23:40:47.947 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.941+0000 7fa98f59e640 1 -- 172.21.15.88:0/2232158860 wait complete. 2024-04-26T23:40:47.947 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.942+0000 7f96857fa640 1 -- 172.21.15.88:0/2417426196 <== mon.2 v2:172.21.15.175:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f967405db10 con 0x7f9688154160 2024-04-26T23:40:47.948 INFO:teuthology.orchestra.run.smithi088.stdout:55834574855 2024-04-26T23:40:47.948 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.943+0000 7f0541c93640 1 -- 172.21.15.88:0/1244607207 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f0534045a90 con 0x7f05340decf0 2024-04-26T23:40:47.948 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.944+0000 7f0527fff640 1 -- 172.21.15.88:0/1244607207 <== mon.1 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f053c0d65c0 con 0x7f05340decf0 2024-04-26T23:40:47.948 INFO:teuthology.orchestra.run.smithi088.stdout:55834574855 2024-04-26T23:40:47.949 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.944+0000 7fd61c007640 1 -- 172.21.15.88:0/1529177665 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fd60c0d02d0 con 0x7fd60c04d420 2024-04-26T23:40:47.949 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.945+0000 7fd60a7fc640 1 -- 172.21.15.88:0/1529177665 <== mon.2 v2:172.21.15.175:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fd60405c890 con 0x7fd60c04d420 2024-04-26T23:40:47.949 INFO:teuthology.orchestra.run.smithi088.stdout:55834574857 2024-04-26T23:40:47.950 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.945+0000 7f968ec2a640 1 -- 172.21.15.88:0/2417426196 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f966c06c940 msgr2=0x7f966c06ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:47.950 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.945+0000 7f968ec2a640 1 --2- 172.21.15.88:0/2417426196 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f966c06c940 0x7f966c06ee00 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f96880c42a0 tx=0x7f967c009040 comp rx=0 tx=0).stop 2024-04-26T23:40:47.950 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.945+0000 7f968ec2a640 1 -- 172.21.15.88:0/2417426196 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9688154160 msgr2=0x7f96880ac4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:47.950 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.945+0000 7f968ec2a640 1 --2- 172.21.15.88:0/2417426196 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9688154160 0x7f96880ac4e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f967400e880 tx=0x7f967400ed40 comp rx=0 tx=0).stop 2024-04-26T23:40:47.950 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.946+0000 7f968ec2a640 1 -- 172.21.15.88:0/2417426196 shutdown_connections 2024-04-26T23:40:47.950 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.946+0000 7f968ec2a640 1 --2- 172.21.15.88:0/2417426196 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f966c06c940 0x7f966c06ee00 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:47.950 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.946+0000 7f968ec2a640 1 --2- 172.21.15.88:0/2417426196 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9688154160 0x7f96880ac4e0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:47.950 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.946+0000 7f968ec2a640 1 --2- 172.21.15.88:0/2417426196 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f968815a1a0 0x7f96881edf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:47.950 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.946+0000 7f968ec2a640 1 --2- 172.21.15.88:0/2417426196 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f96880ca5a0 0x7f96881ed6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:47.950 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.946+0000 7f968ec2a640 1 -- 172.21.15.88:0/2417426196 >> 172.21.15.88:0/2417426196 conn(0x7f96880ae010 msgr2=0x7f96880ae3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:40:47.951 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.946+0000 7f968ec2a640 1 -- 172.21.15.88:0/2417426196 shutdown_connections 2024-04-26T23:40:47.951 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.946+0000 7f968ec2a640 1 -- 172.21.15.88:0/2417426196 wait complete. 2024-04-26T23:40:47.952 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.947+0000 7f0541c93640 1 -- 172.21.15.88:0/1244607207 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f052006caf0 msgr2=0x7f052006efb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:47.952 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.947+0000 7f0541c93640 1 --2- 172.21.15.88:0/1244607207 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f052006caf0 0x7f052006efb0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f0530034000 tx=0x7f053002e000 comp rx=0 tx=0).stop 2024-04-26T23:40:47.952 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.947+0000 7f0541c93640 1 -- 172.21.15.88:0/1244607207 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f05340decf0 msgr2=0x7f0534171e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:47.952 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.947+0000 7f0541c93640 1 --2- 172.21.15.88:0/1244607207 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f05340decf0 0x7f0534171e90 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f053c075190 tx=0x7f053c069f90 comp rx=0 tx=0).stop 2024-04-26T23:40:47.952 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.948+0000 7fe0d4bbb640 1 -- 172.21.15.88:0/3257937200 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7fe0d0165cc0 con 0x7fe0d0201550 2024-04-26T23:40:47.953 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.948+0000 7f0541c93640 1 -- 172.21.15.88:0/1244607207 shutdown_connections 2024-04-26T23:40:47.953 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.948+0000 7f0541c93640 1 --2- 172.21.15.88:0/1244607207 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f052006caf0 0x7f052006efb0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:47.953 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.948+0000 7f0541c93640 1 --2- 172.21.15.88:0/1244607207 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f05340decf0 0x7f0534171e90 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:47.953 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.948+0000 7fd61c007640 1 -- 172.21.15.88:0/1529177665 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fd5f806ccf0 msgr2=0x7fd5f806f1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:47.954 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.948+0000 7f0541c93640 1 --2- 172.21.15.88:0/1244607207 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f05340d3c70 0x7f05340c7a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:47.954 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.949+0000 7f0541c93640 1 --2- 172.21.15.88:0/1244607207 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f053404b1e0 0x7f05340c8d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:47.954 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.949+0000 7f0541c93640 1 -- 172.21.15.88:0/1244607207 >> 172.21.15.88:0/1244607207 conn(0x7f0534005ec0 msgr2=0x7f0534049600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:40:47.954 INFO:teuthology.orchestra.run.smithi088.stdout:55834574856 2024-04-26T23:40:47.954 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.949+0000 7fe0b7fff640 1 -- 172.21.15.88:0/3257937200 <== mon.1 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fe0c805cf60 con 0x7fe0d0201550 2024-04-26T23:40:47.955 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.948+0000 7fd61c007640 1 --2- 172.21.15.88:0/1529177665 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fd5f806ccf0 0x7fd5f806f1b0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fd610035040 tx=0x7fd61002e000 comp rx=0 tx=0).stop 2024-04-26T23:40:47.956 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.948+0000 7fd61c007640 1 -- 172.21.15.88:0/1529177665 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd60c04d420 msgr2=0x7fd60c16e560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:47.956 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.948+0000 7fd61c007640 1 --2- 172.21.15.88:0/1529177665 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd60c04d420 0x7fd60c16e560 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fd60400c3c0 tx=0x7fd60400c880 comp rx=0 tx=0).stop 2024-04-26T23:40:47.956 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.949+0000 7fd61c007640 1 -- 172.21.15.88:0/1529177665 shutdown_connections 2024-04-26T23:40:47.956 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.949+0000 7fd61c007640 1 --2- 172.21.15.88:0/1529177665 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fd5f806ccf0 0x7fd5f806f1b0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:47.956 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.949+0000 7fd61c007640 1 --2- 172.21.15.88:0/1529177665 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd60c04d420 0x7fd60c16e560 secure :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fd60400c3c0 tx=0x7fd60400c880 comp rx=0 tx=0).stop 2024-04-26T23:40:47.956 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.949+0000 7fd61c007640 1 --2- 172.21.15.88:0/1529177665 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd60c0d5950 0x7fd60c0da0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:47.956 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.949+0000 7fd61c007640 1 --2- 172.21.15.88:0/1529177665 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd60c04b8c0 0x7fd60c16e020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:47.956 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.949+0000 7fd61c007640 1 -- 172.21.15.88:0/1529177665 >> 172.21.15.88:0/1529177665 conn(0x7fd60c02f4b0 msgr2=0x7fd60c048240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:40:47.956 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.949+0000 7fd61c007640 1 -- 172.21.15.88:0/1529177665 shutdown_connections 2024-04-26T23:40:47.956 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.950+0000 7f0541c93640 1 -- 172.21.15.88:0/1244607207 shutdown_connections 2024-04-26T23:40:47.957 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.950+0000 7fd61c007640 1 -- 172.21.15.88:0/1529177665 wait complete. 2024-04-26T23:40:47.957 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.950+0000 7f0541c93640 1 -- 172.21.15.88:0/1244607207 wait complete. 2024-04-26T23:40:47.957 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.950+0000 7f375c8b2640 1 -- 172.21.15.88:0/2599172618 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f37580a7f80 con 0x7f3740003a30 2024-04-26T23:40:47.958 INFO:teuthology.orchestra.run.smithi088.stdout:55834574855 2024-04-26T23:40:47.958 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.951+0000 7f373ffff640 1 -- 172.21.15.88:0/2599172618 <== mon.1 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f3750079d90 con 0x7f3740003a30 2024-04-26T23:40:47.959 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.952+0000 7fe0d4bbb640 1 -- 172.21.15.88:0/3257937200 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fe0bc06c940 msgr2=0x7fe0bc06ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:47.959 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.952+0000 7fe0d4bbb640 1 --2- 172.21.15.88:0/3257937200 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fe0bc06c940 0x7fe0bc06ee00 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fe0c4034000 tx=0x7fe0c402c000 comp rx=0 tx=0).stop 2024-04-26T23:40:47.959 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.953+0000 7fe0d4bbb640 1 -- 172.21.15.88:0/3257937200 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe0d0201550 msgr2=0x7fe0d008a9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:47.959 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.952+0000 7fd610940640 1 -- 172.21.15.88:0/3628750348 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7fd60c06ef40 con 0x7fd60c14cae0 2024-04-26T23:40:47.959 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.953+0000 7fe0d4bbb640 1 --2- 172.21.15.88:0/3257937200 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe0d0201550 0x7fe0d008a9f0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fe0c800c6f0 tx=0x7fe0c800cbb0 comp rx=0 tx=0).stop 2024-04-26T23:40:47.960 INFO:teuthology.orchestra.run.smithi088.stdout:55834574856 2024-04-26T23:40:47.960 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.953+0000 7fd602ffd640 1 -- 172.21.15.88:0/3628750348 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fd5fc0af070 con 0x7fd60c14cae0 2024-04-26T23:40:47.960 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.954+0000 7f375c8b2640 1 -- 172.21.15.88:0/2599172618 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f374406c8f0 msgr2=0x7f374406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:47.960 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.954+0000 7f375c8b2640 1 --2- 172.21.15.88:0/2599172618 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f374406c8f0 0x7f374406edb0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f37581dddf0 tx=0x7f3748008040 comp rx=0 tx=0).stop 2024-04-26T23:40:47.961 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.954+0000 7fe0d4bbb640 1 -- 172.21.15.88:0/3257937200 shutdown_connections 2024-04-26T23:40:47.961 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.954+0000 7fe0d4bbb640 1 --2- 172.21.15.88:0/3257937200 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fe0bc06c940 0x7fe0bc06ee00 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:47.961 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.954+0000 7fe0d4bbb640 1 --2- 172.21.15.88:0/3257937200 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe0d0201550 0x7fe0d008a9f0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:47.961 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.954+0000 7fe0d4bbb640 1 --2- 172.21.15.88:0/3257937200 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe0d02010f0 0x7fe0d008a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:47.961 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.954+0000 7fe0d4bbb640 1 --2- 172.21.15.88:0/3257937200 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe0d0072500 0x7fe0d00ab500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:47.961 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.954+0000 7fe0d4bbb640 1 -- 172.21.15.88:0/3257937200 >> 172.21.15.88:0/3257937200 conn(0x7fe0d00c4bc0 msgr2=0x7fe0d0164af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:40:47.962 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.955+0000 7f375c8b2640 1 -- 172.21.15.88:0/2599172618 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3740003a30 msgr2=0x7f37581eb370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:47.962 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.955+0000 7f375c8b2640 1 --2- 172.21.15.88:0/2599172618 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3740003a30 0x7f37581eb370 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f3740008200 tx=0x7f3750004dc0 comp rx=0 tx=0).stop 2024-04-26T23:40:47.962 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.955+0000 7f375c8b2640 1 -- 172.21.15.88:0/2599172618 shutdown_connections 2024-04-26T23:40:47.962 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.955+0000 7f375c8b2640 1 --2- 172.21.15.88:0/2599172618 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f374406c8f0 0x7f374406edb0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:47.962 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.955+0000 7f375c8b2640 1 --2- 172.21.15.88:0/2599172618 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3758153b50 0x7f3758152ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:47.962 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.955+0000 7f375c8b2640 1 --2- 172.21.15.88:0/2599172618 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3758073510 0x7f37581533e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:47.962 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.955+0000 7f375c8b2640 1 --2- 172.21.15.88:0/2599172618 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3740003a30 0x7f37581eb370 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:47.962 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.955+0000 7f375c8b2640 1 -- 172.21.15.88:0/2599172618 >> 172.21.15.88:0/2599172618 conn(0x7f37580aa8d0 msgr2=0x7f375814fe20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:40:47.962 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.955+0000 7f375c8b2640 1 -- 172.21.15.88:0/2599172618 shutdown_connections 2024-04-26T23:40:47.963 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.955+0000 7f375c8b2640 1 -- 172.21.15.88:0/2599172618 wait complete. 2024-04-26T23:40:47.963 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.955+0000 7fe0d4bbb640 1 -- 172.21.15.88:0/3257937200 shutdown_connections 2024-04-26T23:40:47.963 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.955+0000 7fe0d4bbb640 1 -- 172.21.15.88:0/3257937200 wait complete. 2024-04-26T23:40:47.963 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.957+0000 7f146f59e640 1 -- 172.21.15.88:0/4243481779 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f1454005580 con 0x7f1470151e70 2024-04-26T23:40:47.964 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.957+0000 7fd610940640 1 -- 172.21.15.88:0/3628750348 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fd5f406c9c0 msgr2=0x7fd5f406ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:47.964 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.957+0000 7fd610940640 1 --2- 172.21.15.88:0/3628750348 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fd5f406c9c0 0x7fd5f406ee80 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fd604004c80 tx=0x7fd604007400 comp rx=0 tx=0).stop 2024-04-26T23:40:47.965 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.957+0000 7fd610940640 1 -- 172.21.15.88:0/3628750348 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd60c14cae0 msgr2=0x7fd60c14f3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:47.965 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.957+0000 7fd610940640 1 --2- 172.21.15.88:0/3628750348 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd60c14cae0 0x7fd60c14f3c0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fd5fc00bb10 tx=0x7fd5fc0046c0 comp rx=0 tx=0).stop 2024-04-26T23:40:47.965 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.958+0000 7fd610940640 1 -- 172.21.15.88:0/3628750348 shutdown_connections 2024-04-26T23:40:47.965 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.958+0000 7fd610940640 1 --2- 172.21.15.88:0/3628750348 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fd5f406c9c0 0x7fd5f406ee80 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:47.965 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.958+0000 7fd610940640 1 --2- 172.21.15.88:0/3628750348 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd60c14f900 0x7fd60c1e54a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:47.965 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.958+0000 7fd610940640 1 --2- 172.21.15.88:0/3628750348 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd60c14cae0 0x7fd60c14f3c0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:47.965 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.958+0000 7fd610940640 1 --2- 172.21.15.88:0/3628750348 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd60c0c3c70 0x7fd60c155150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:47.965 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.958+0000 7fd610940640 1 -- 172.21.15.88:0/3628750348 >> 172.21.15.88:0/3628750348 conn(0x7fd60c0c4d60 msgr2=0x7fd60c0c5140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:40:47.965 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.958+0000 7fd610940640 1 -- 172.21.15.88:0/3628750348 shutdown_connections 2024-04-26T23:40:47.965 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.958+0000 7f145effd640 1 -- 172.21.15.88:0/4243481779 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f146405cf50 con 0x7f1470151e70 2024-04-26T23:40:47.966 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.958+0000 7fd610940640 1 -- 172.21.15.88:0/3628750348 wait complete. 2024-04-26T23:40:47.966 INFO:teuthology.orchestra.run.smithi088.stdout:55834574855 2024-04-26T23:40:47.967 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.962+0000 7f146f59e640 1 -- 172.21.15.88:0/4243481779 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f145006c940 msgr2=0x7f145006ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:47.967 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.962+0000 7f146f59e640 1 --2- 172.21.15.88:0/4243481779 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f145006c940 0x7f145006ee00 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f1468009bd0 tx=0x7f146802f000 comp rx=0 tx=0).stop 2024-04-26T23:40:47.967 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.962+0000 7f146f59e640 1 -- 172.21.15.88:0/4243481779 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1470151e70 msgr2=0x7f1470153c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:47.967 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.962+0000 7f146f59e640 1 --2- 172.21.15.88:0/4243481779 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1470151e70 0x7f1470153c80 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f146400c410 tx=0x7f146400c8d0 comp rx=0 tx=0).stop 2024-04-26T23:40:47.967 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.963+0000 7f146f59e640 1 -- 172.21.15.88:0/4243481779 shutdown_connections 2024-04-26T23:40:47.967 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.963+0000 7f146f59e640 1 --2- 172.21.15.88:0/4243481779 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f145006c940 0x7f145006ee00 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:47.967 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.963+0000 7f146f59e640 1 --2- 172.21.15.88:0/4243481779 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1470151e70 0x7f1470153c80 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:47.967 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.963+0000 7f146f59e640 1 --2- 172.21.15.88:0/4243481779 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f147006f7b0 0x7f1470153740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:47.967 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.963+0000 7f146f59e640 1 --2- 172.21.15.88:0/4243481779 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f147006e700 0x7f1470141270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:47.968 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.963+0000 7f146f59e640 1 -- 172.21.15.88:0/4243481779 >> 172.21.15.88:0/4243481779 conn(0x7f14700c80c0 msgr2=0x7f1470073770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:40:47.968 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574857 for osd.4 2024-04-26T23:40:47.969 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.964+0000 7f146f59e640 1 -- 172.21.15.88:0/4243481779 shutdown_connections 2024-04-26T23:40:47.969 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:47.964+0000 7f146f59e640 1 -- 172.21.15.88:0/4243481779 wait complete. 2024-04-26T23:40:47.972 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.1 2024-04-26T23:40:47.974 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574857 for osd.0 2024-04-26T23:40:47.976 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.3 2024-04-26T23:40:47.981 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.5 2024-04-26T23:40:47.982 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.7 2024-04-26T23:40:47.983 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.6 2024-04-26T23:40:47.984 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.2 2024-04-26T23:40:48.970 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-04-26T23:40:48.972 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-26T23:40:48.975 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-26T23:40:48.977 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-26T23:40:48.982 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-04-26T23:40:48.982 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-04-26T23:40:48.985 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-04-26T23:40:48.985 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-26T23:40:49.119 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.111+0000 7f9324722640 1 Processor -- start 2024-04-26T23:40:49.121 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.111+0000 7f9324722640 1 -- start start 2024-04-26T23:40:49.122 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.113+0000 7f9324722640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f931c0ab380 0x7f931c152cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:49.122 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.113+0000 7f9324722640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f931c0c4c90 0x7f931c0c5100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:49.122 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.113+0000 7f9324722640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f931c0c3e00 con 0x7f931c150300 2024-04-26T23:40:49.122 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.113+0000 7f9324722640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f931c06e3d0 con 0x7f931c0ab380 2024-04-26T23:40:49.122 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.113+0000 7f9324722640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f931c06e6b0 con 0x7f931c0c4c90 2024-04-26T23:40:49.122 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.113+0000 7f9321cbd640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f931c0ab380 0x7f931c152cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:49.122 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.113+0000 7f9321cbd640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f931c0ab380 0x7f931c152cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:41506/0 (socket says 172.21.15.88:41506) 2024-04-26T23:40:49.122 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.113+0000 7f9321cbd640 1 -- 172.21.15.88:0/86092124 learned_addr learned my addr 172.21.15.88:0/86092124 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:40:49.122 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.113+0000 7f9321cbd640 1 -- 172.21.15.88:0/86092124 >> v2:172.21.15.175:3300/0 conn(0x7f931c0c4c90 msgr2=0x7f931c0c5100 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T23:40:49.122 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.113+0000 7f9321cbd640 1 --2- 172.21.15.88:0/86092124 >> v2:172.21.15.175:3300/0 conn(0x7f931c0c4c90 0x7f931c0c5100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:49.122 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.113+0000 7f9321cbd640 1 -- 172.21.15.88:0/86092124 >> v1:172.21.15.175:6789/0 conn(0x7f931c150300 legacy=0x7f931c0c3640 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T23:40:49.122 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.113+0000 7f9321cbd640 1 -- 172.21.15.88:0/86092124 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f931c0c40e0 con 0x7f931c0ab380 2024-04-26T23:40:49.123 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.115+0000 7f9321cbd640 1 --2- 172.21.15.88:0/86092124 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f931c0ab380 0x7f931c152cf0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f931c0c8260 tx=0x7f931402a960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48a5e5ade47dbf6a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:49.123 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.115+0000 7f93214bc640 1 -- 172.21.15.88:0/86092124 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9314030410 con 0x7f931c0ab380 2024-04-26T23:40:49.123 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.115+0000 7f93214bc640 1 -- 172.21.15.88:0/86092124 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9314035070 con 0x7f931c0ab380 2024-04-26T23:40:49.123 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.115+0000 7f93214bc640 1 -- 172.21.15.88:0/86092124 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93140307d0 con 0x7f931c0ab380 2024-04-26T23:40:49.123 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.116+0000 7f9324722640 1 -- 172.21.15.88:0/86092124 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f931c0ab380 msgr2=0x7f931c152cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:49.123 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.116+0000 7f9324722640 1 --2- 172.21.15.88:0/86092124 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f931c0ab380 0x7f931c152cf0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f931c0c8260 tx=0x7f931402a960 comp rx=0 tx=0).stop 2024-04-26T23:40:49.124 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.116+0000 7f9324722640 1 -- 172.21.15.88:0/86092124 shutdown_connections 2024-04-26T23:40:49.124 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.116+0000 7f9324722640 1 --2- 172.21.15.88:0/86092124 >> v2:172.21.15.175:3300/0 conn(0x7f931c0c4c90 0x7f931c0c5100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:49.124 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.116+0000 7f9324722640 1 --2- 172.21.15.88:0/86092124 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f931c0ab380 0x7f931c152cf0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:49.124 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.116+0000 7f9324722640 1 -- 172.21.15.88:0/86092124 >> 172.21.15.88:0/86092124 conn(0x7f931c06c310 msgr2=0x7f931c06c6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:40:49.124 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.116+0000 7f9324722640 1 -- 172.21.15.88:0/86092124 shutdown_connections 2024-04-26T23:40:49.124 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.116+0000 7f9324722640 1 -- 172.21.15.88:0/86092124 wait complete. 2024-04-26T23:40:49.124 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.119+0000 7f9324722640 1 Processor -- start 2024-04-26T23:40:49.126 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.111+0000 7fc0aaa83640 1 Processor -- start 2024-04-26T23:40:49.126 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.112+0000 7fc0aaa83640 1 -- start start 2024-04-26T23:40:49.126 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.113+0000 7fc0aaa83640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fc0a40c5720 0x7fc0a414fd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:49.126 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.113+0000 7fc0aaa83640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc0a40c4400 con 0x7fc0a4153240 2024-04-26T23:40:49.126 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.113+0000 7fc0aaa83640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc0a4156370 con 0x7fc0a4156e50 2024-04-26T23:40:49.126 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.113+0000 7fc0aaa83640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7fc0a4156120 con 0x7fc0a40c5720 2024-04-26T23:40:49.126 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.113+0000 7fc0a9020640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fc0a4153240 0x7fc0a415d4b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:58012/0 (socket says 172.21.15.88:58012) 2024-04-26T23:40:49.126 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.113+0000 7fc0a9020640 1 -- 172.21.15.88:0/910757020 learned_addr learned my addr 172.21.15.88:0/910757020 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-26T23:40:49.126 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.113+0000 7fc0a881f640 1 --2- 172.21.15.88:0/910757020 >> v2:172.21.15.175:3300/0 conn(0x7fc0a40c5720 0x7fc0a414fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:49.127 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.114+0000 7fc0a881f640 1 -- 172.21.15.88:0/910757020 >> v1:172.21.15.175:6789/0 conn(0x7fc0a4156e50 legacy=0x7fc0a4152b30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T23:40:49.127 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.114+0000 7fc0a881f640 1 -- 172.21.15.88:0/910757020 >> v1:172.21.15.88:6789/0 conn(0x7fc0a4153240 legacy=0x7fc0a415d4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:49.127 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.114+0000 7fc0a881f640 1 -- 172.21.15.88:0/910757020 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0a4156650 con 0x7fc0a40c5720 2024-04-26T23:40:49.127 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.115+0000 7fc0a881f640 1 --2- 172.21.15.88:0/910757020 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc0a40c5720 0x7fc0a414fd30 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fc09c009d90 tx=0x7fc09c02a6c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d56fa40cd33b7e2e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:49.127 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.115+0000 7fc0a37fe640 1 -- 172.21.15.88:0/910757020 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc09c007740 con 0x7fc0a40c5720 2024-04-26T23:40:49.127 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.115+0000 7fc0a37fe640 1 -- 172.21.15.88:0/910757020 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc09c0078e0 con 0x7fc0a40c5720 2024-04-26T23:40:49.127 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.116+0000 7fc0aaa83640 1 -- 172.21.15.88:0/910757020 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc0a40c5720 msgr2=0x7fc0a414fd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:49.127 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.119+0000 7f9324722640 1 -- start start 2024-04-26T23:40:49.128 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.120+0000 7f9324722640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f931c0ab380 0x7f931c0a8890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:49.128 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.120+0000 7f9324722640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f931c0c4c90 0x7f931c074840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:49.128 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.120+0000 7f9324722640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f931c150300 0x7f931c073810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:49.128 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.120+0000 7f9324722640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f931c06f9c0 con 0x7f931c150300 2024-04-26T23:40:49.128 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.120+0000 7f9324722640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f931c1506e0 con 0x7f931c0ab380 2024-04-26T23:40:49.128 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.120+0000 7f9324722640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f931c06fb40 con 0x7f931c0c4c90 2024-04-26T23:40:49.128 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.116+0000 7fc0aaa83640 1 --2- 172.21.15.88:0/910757020 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc0a40c5720 0x7fc0a414fd30 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fc09c009d90 tx=0x7fc09c02a6c0 comp rx=0 tx=0).stop 2024-04-26T23:40:49.129 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.116+0000 7fc0aaa83640 1 -- 172.21.15.88:0/910757020 shutdown_connections 2024-04-26T23:40:49.129 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.116+0000 7fc0aaa83640 1 --2- 172.21.15.88:0/910757020 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc0a40c5720 0x7fc0a414fd30 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:49.129 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.120+0000 7f93224be640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f931c0ab380 0x7f931c0a8890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:49.130 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.116+0000 7fc0aaa83640 1 -- 172.21.15.88:0/910757020 >> 172.21.15.88:0/910757020 conn(0x7fc0a40c89b0 msgr2=0x7fc0a40c8dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:40:49.130 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.117+0000 7fc0aaa83640 1 -- 172.21.15.88:0/910757020 shutdown_connections 2024-04-26T23:40:49.130 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.117+0000 7fc0aaa83640 1 -- 172.21.15.88:0/910757020 wait complete. 2024-04-26T23:40:49.130 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.118+0000 7fc0aaa83640 1 Processor -- start 2024-04-26T23:40:49.130 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.118+0000 7fc0aaa83640 1 -- start start 2024-04-26T23:40:49.130 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.119+0000 7fc0aaa83640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc0a40c5720 0x7fc0a4144d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:49.130 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.120+0000 7fc0aaa83640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc0a4156e50 0x7fc0a4145250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:49.130 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.120+0000 7fc0aaa83640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc0a40694b0 0x7fc0a4073fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:49.130 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.120+0000 7fc0aaa83640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fc0a40c3aa0 con 0x7fc0a4156e50 2024-04-26T23:40:49.130 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.120+0000 7fc0aaa83640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc0a41569c0 con 0x7fc0a40694b0 2024-04-26T23:40:49.130 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.120+0000 7fc0aaa83640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fc0a40c5b00 con 0x7fc0a40c5720 2024-04-26T23:40:49.131 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.120+0000 7fc0a9020640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc0a40694b0 0x7fc0a4073fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:49.131 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.120+0000 7fc0a881f640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc0a40c5720 0x7fc0a4144d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:49.131 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.120+0000 7fc0a9020640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc0a40694b0 0x7fc0a4073fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.88:36402/0 (socket says 172.21.15.88:36402) 2024-04-26T23:40:49.131 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.120+0000 7fc0a9020640 1 -- 172.21.15.88:0/1633079088 learned_addr learned my addr 172.21.15.88:0/1633079088 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:40:49.131 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.120+0000 7fc0a3fff640 1 --2- 172.21.15.88:0/1633079088 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc0a4156e50 0x7fc0a4145250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:49.132 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.120+0000 7f9321cbd640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f931c0c4c90 0x7f931c074840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:49.132 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.121+0000 7f9321cbd640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f931c0c4c90 0x7f931c074840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.88:37044/0 (socket says 172.21.15.88:37044) 2024-04-26T23:40:49.132 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.121+0000 7f9321cbd640 1 -- 172.21.15.88:0/4015413217 learned_addr learned my addr 172.21.15.88:0/4015413217 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:40:49.132 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.121+0000 7f9322cbf640 1 --2- 172.21.15.88:0/4015413217 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f931c150300 0x7f931c073810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:49.132 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.121+0000 7f9321cbd640 1 -- 172.21.15.88:0/4015413217 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f931c0ab380 msgr2=0x7f931c0a8890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:49.132 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.121+0000 7f9321cbd640 1 --2- 172.21.15.88:0/4015413217 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f931c0ab380 0x7f931c0a8890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:49.132 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.121+0000 7f9321cbd640 1 -- 172.21.15.88:0/4015413217 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f931c150300 msgr2=0x7f931c073810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:49.132 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.121+0000 7fc0a881f640 1 -- 172.21.15.88:0/1633079088 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc0a40694b0 msgr2=0x7fc0a4073fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:49.132 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.121+0000 7fc0a881f640 1 --2- 172.21.15.88:0/1633079088 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc0a40694b0 0x7fc0a4073fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:49.133 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.121+0000 7fc0a881f640 1 -- 172.21.15.88:0/1633079088 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc0a4156e50 msgr2=0x7fc0a4145250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:49.133 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.121+0000 7fc0a881f640 1 --2- 172.21.15.88:0/1633079088 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc0a4156e50 0x7fc0a4145250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:49.133 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.121+0000 7fc0a881f640 1 -- 172.21.15.88:0/1633079088 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0a40bf5a0 con 0x7fc0a40c5720 2024-04-26T23:40:49.133 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.121+0000 7fc0a3fff640 1 --2- 172.21.15.88:0/1633079088 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc0a4156e50 0x7fc0a4145250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:40:49.133 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.121+0000 7fc0a881f640 1 --2- 172.21.15.88:0/1633079088 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc0a40c5720 0x7fc0a4144d10 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fc09c031000 tx=0x7fc09c004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:49.133 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.121+0000 7f9321cbd640 1 --2- 172.21.15.88:0/4015413217 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f931c150300 0x7f931c073810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:49.133 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.121+0000 7f9321cbd640 1 -- 172.21.15.88:0/4015413217 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f931c072ac0 con 0x7f931c0c4c90 2024-04-26T23:40:49.133 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.122+0000 7f9322cbf640 1 --2- 172.21.15.88:0/4015413217 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f931c150300 0x7f931c073810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:40:49.134 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.122+0000 7fc0a17fa640 1 -- 172.21.15.88:0/1633079088 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc09c03b8e0 con 0x7fc0a40c5720 2024-04-26T23:40:49.134 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.122+0000 7fc0a17fa640 1 -- 172.21.15.88:0/1633079088 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc09c03ba80 con 0x7fc0a40c5720 2024-04-26T23:40:49.134 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.122+0000 7fc0aaa83640 1 -- 172.21.15.88:0/1633079088 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0a4152aa0 con 0x7fc0a40c5720 2024-04-26T23:40:49.134 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.122+0000 7f9321cbd640 1 --2- 172.21.15.88:0/4015413217 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f931c0c4c90 0x7f931c074840 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f9314032040 tx=0x7f9314004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:49.135 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.123+0000 7fc0a17fa640 1 -- 172.21.15.88:0/1633079088 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc09c03be50 con 0x7fc0a40c5720 2024-04-26T23:40:49.135 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.122+0000 7f9312ffd640 1 -- 172.21.15.88:0/4015413217 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9314004780 con 0x7f931c0c4c90 2024-04-26T23:40:49.135 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.122+0000 7f9312ffd640 1 -- 172.21.15.88:0/4015413217 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f931403e070 con 0x7f931c0c4c90 2024-04-26T23:40:49.135 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.122+0000 7f9312ffd640 1 -- 172.21.15.88:0/4015413217 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9314042640 con 0x7f931c0c4c90 2024-04-26T23:40:49.136 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.123+0000 7fc0aaa83640 1 -- 172.21.15.88:0/1633079088 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0a40c24d0 con 0x7fc0a40c5720 2024-04-26T23:40:49.136 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.124+0000 7f9324722640 1 -- 172.21.15.88:0/4015413217 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f931c071ea0 con 0x7f931c0c4c90 2024-04-26T23:40:49.136 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.124+0000 7f9324722640 1 -- 172.21.15.88:0/4015413217 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f931c073d50 con 0x7f931c0c4c90 2024-04-26T23:40:49.136 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.125+0000 7fc08affd640 1 -- 172.21.15.88:0/1633079088 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc0a4076100 con 0x7fc0a40c5720 2024-04-26T23:40:49.137 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.125+0000 7f9324722640 1 -- 172.21.15.88:0/4015413217 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f931c0c2d20 con 0x7f931c0c4c90 2024-04-26T23:40:49.137 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.126+0000 7fc0a17fa640 1 -- 172.21.15.88:0/1633079088 <== mon.2 v2:172.21.15.175:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc09c05f650 con 0x7fc0a40c5720 2024-04-26T23:40:49.137 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.126+0000 7fc0a17fa640 1 --2- 172.21.15.88:0/1633079088 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fc09006cae0 0x7fc09006efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:49.137 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.126+0000 7fc0a3fff640 1 --2- 172.21.15.88:0/1633079088 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fc09006cae0 0x7fc09006efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:49.137 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.127+0000 7fc0a17fa640 1 -- 172.21.15.88:0/1633079088 <== mon.2 v2:172.21.15.175:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7fc09c0acfc0 con 0x7fc0a40c5720 2024-04-26T23:40:49.137 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.127+0000 7fc0a3fff640 1 --2- 172.21.15.88:0/1633079088 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fc09006cae0 0x7fc09006efa0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fc09800a8b0 tx=0x7fc098008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:49.138 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.128+0000 7f9312ffd640 1 -- 172.21.15.88:0/4015413217 <== mon.2 v2:172.21.15.175:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f9314039420 con 0x7f931c0c4c90 2024-04-26T23:40:49.138 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.128+0000 7f9312ffd640 1 --2- 172.21.15.88:0/4015413217 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f930006c9c0 0x7f930006ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:49.138 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.128+0000 7f9312ffd640 1 -- 172.21.15.88:0/4015413217 <== mon.2 v2:172.21.15.175:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7f93140ac940 con 0x7f931c0c4c90 2024-04-26T23:40:49.138 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.129+0000 7f93224be640 1 --2- 172.21.15.88:0/4015413217 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f930006c9c0 0x7f930006ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:49.138 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.129+0000 7f93224be640 1 --2- 172.21.15.88:0/4015413217 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f930006c9c0 0x7f930006ee80 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f931c14a650 tx=0x7f93180090e0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:49.139 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.131+0000 7fc0a17fa640 1 -- 172.21.15.88:0/1633079088 <== mon.2 v2:172.21.15.175:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fc09c03f030 con 0x7fc0a40c5720 2024-04-26T23:40:49.141 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.136+0000 7f9312ffd640 1 -- 172.21.15.88:0/4015413217 <== mon.2 v2:172.21.15.175:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f931c0c2d20 con 0x7f931c0c4c90 2024-04-26T23:40:49.178 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.174+0000 7f2fcb96a640 1 Processor -- start 2024-04-26T23:40:49.178 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.173+0000 7fcc78fe6640 1 Processor -- start 2024-04-26T23:40:49.179 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.173+0000 7fcc78fe6640 1 -- start start 2024-04-26T23:40:49.180 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.175+0000 7f2fcb96a640 1 -- start start 2024-04-26T23:40:49.181 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.176+0000 7f2fcb96a640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f2fc40c33f0 0x7f2fc40c6db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:49.181 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.176+0000 7f2fcb96a640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f2fc40c4e30 0x7f2fc40c5480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:49.181 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.176+0000 7f2fcb96a640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2fc415bb40 con 0x7f2fc4158610 2024-04-26T23:40:49.181 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.176+0000 7f2fcb96a640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f2fc41589f0 con 0x7f2fc40c33f0 2024-04-26T23:40:49.181 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.176+0000 7f2fcb96a640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f2fc406f1f0 con 0x7f2fc40c4e30 2024-04-26T23:40:49.181 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.176+0000 7f2fc8f05640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f2fc40c33f0 0x7f2fc40c6db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:49.181 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.176+0000 7f2fc8f05640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f2fc40c33f0 0x7f2fc40c6db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:41542/0 (socket says 172.21.15.88:41542) 2024-04-26T23:40:49.181 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.176+0000 7f2fc8f05640 1 -- 172.21.15.88:0/971448106 learned_addr learned my addr 172.21.15.88:0/971448106 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:40:49.181 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.175+0000 7fcc78fe6640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fcc741510c0 0x7fcc74072f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:49.181 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.175+0000 7fcc78fe6640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fcc740734d0 0x7fcc7406d320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:49.182 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.175+0000 7fcc78fe6640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcc740c4160 0x7fcc74157070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:49.182 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.175+0000 7fcc78fe6640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7fcc740c50d0 con 0x7fcc741510c0 2024-04-26T23:40:49.182 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.175+0000 7fcc78fe6640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7fcc740c4b50 con 0x7fcc740734d0 2024-04-26T23:40:49.182 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.175+0000 7fcc78fe6640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fcc741514a0 con 0x7fcc740c4160 2024-04-26T23:40:49.182 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.175+0000 7fcc72d9d640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcc740c4160 0x7fcc74157070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:49.182 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.175+0000 7fcc72d9d640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcc740c4160 0x7fcc74157070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.88:37054/0 (socket says 172.21.15.88:37054) 2024-04-26T23:40:49.182 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.175+0000 7fcc72d9d640 1 -- 172.21.15.88:0/840868956 learned_addr learned my addr 172.21.15.88:0/840868956 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:40:49.182 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.175+0000 7fcc71d9b640 1 --2- 172.21.15.88:0/840868956 >> v2:172.21.15.175:3300/0 conn(0x7fcc740734d0 0x7fcc7406d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:49.182 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.175+0000 7fcc7259c640 1 --2- 172.21.15.88:0/840868956 >> v2:172.21.15.88:3300/0 conn(0x7fcc741510c0 0x7fcc74072f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:49.182 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.176+0000 7fcc72d9d640 1 -- 172.21.15.88:0/840868956 >> v2:172.21.15.175:3300/0 conn(0x7fcc740734d0 msgr2=0x7fcc7406d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:40:49.182 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.176+0000 7fcc72d9d640 1 --2- 172.21.15.88:0/840868956 >> v2:172.21.15.175:3300/0 conn(0x7fcc740734d0 0x7fcc7406d320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:49.182 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.176+0000 7fcc72d9d640 1 -- 172.21.15.88:0/840868956 >> v2:172.21.15.88:3300/0 conn(0x7fcc741510c0 msgr2=0x7fcc74072f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:40:49.182 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.176+0000 7fcc72d9d640 1 --2- 172.21.15.88:0/840868956 >> v2:172.21.15.88:3300/0 conn(0x7fcc741510c0 0x7fcc74072f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:49.182 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.176+0000 7fcc72d9d640 1 -- 172.21.15.88:0/840868956 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc74154920 con 0x7fcc740c4160 2024-04-26T23:40:49.182 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.176+0000 7fcc7259c640 1 --2- 172.21.15.88:0/840868956 >> v2:172.21.15.88:3300/0 conn(0x7fcc741510c0 0x7fcc74072f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:40:49.183 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.177+0000 7f4aeee08640 1 Processor -- start 2024-04-26T23:40:49.183 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.177+0000 7f2fc9f07640 1 --2- 172.21.15.88:0/971448106 >> v2:172.21.15.175:3300/0 conn(0x7f2fc40c4e30 0x7f2fc40c5480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:49.183 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.177+0000 7f2fc8f05640 1 -- 172.21.15.88:0/971448106 >> v2:172.21.15.175:3300/0 conn(0x7f2fc40c4e30 msgr2=0x7f2fc40c5480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:40:49.183 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.177+0000 7f2fc8f05640 1 --2- 172.21.15.88:0/971448106 >> v2:172.21.15.175:3300/0 conn(0x7f2fc40c4e30 0x7f2fc40c5480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:49.184 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.177+0000 7f2fc8f05640 1 -- 172.21.15.88:0/971448106 >> v1:172.21.15.175:6789/0 conn(0x7f2fc4158610 legacy=0x7f2fc406f680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:49.184 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.177+0000 7f2fc8f05640 1 -- 172.21.15.88:0/971448106 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fc40c3920 con 0x7f2fc40c33f0 2024-04-26T23:40:49.184 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.177+0000 7fcc72d9d640 1 --2- 172.21.15.88:0/840868956 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcc740c4160 0x7fcc74157070 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fcc74070b50 tx=0x7fcc6c02a570 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9233c31fbfd228c3 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:49.184 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.177+0000 7f2fc9f07640 1 --2- 172.21.15.88:0/971448106 >> v2:172.21.15.175:3300/0 conn(0x7f2fc40c4e30 0x7f2fc40c5480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:40:49.184 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.177+0000 7f4aeee08640 1 -- start start 2024-04-26T23:40:49.185 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.178+0000 7f293be7e640 1 Processor -- start 2024-04-26T23:40:49.185 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.178+0000 7f8a530f8640 1 Processor -- start 2024-04-26T23:40:49.185 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.178+0000 7f8a530f8640 1 -- start start 2024-04-26T23:40:49.185 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.178+0000 7f293be7e640 1 -- start start 2024-04-26T23:40:49.186 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.178+0000 7fcc7159a640 1 -- 172.21.15.88:0/840868956 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc6c036070 con 0x7fcc740c4160 2024-04-26T23:40:49.186 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.178+0000 7fcc7159a640 1 -- 172.21.15.88:0/840868956 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc6c031600 con 0x7fcc740c4160 2024-04-26T23:40:49.186 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.178+0000 7fcc7159a640 1 -- 172.21.15.88:0/840868956 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc6c0319d0 con 0x7fcc740c4160 2024-04-26T23:40:49.186 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.178+0000 7f2fc8f05640 1 --2- 172.21.15.88:0/971448106 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2fc40c33f0 0x7f2fc40c6db0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f2fc40c5fc0 tx=0x7f2fbc02a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99d7bc365daeb49a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:49.187 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.178+0000 7f4aeee08640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f4ae8150200 0x7f4ae80ac140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:49.187 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.179+0000 7f4aeee08640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f4ae80ac680 0x7f4ae815d590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:49.187 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.179+0000 7f4aeee08640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4ae806ff20 con 0x7f4ae80c2cd0 2024-04-26T23:40:49.187 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.179+0000 7f4aeee08640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f4ae80c4bd0 con 0x7f4ae80ac680 2024-04-26T23:40:49.187 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.179+0000 7f4aeee08640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f4ae806f4e0 con 0x7f4ae8150200 2024-04-26T23:40:49.187 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.179+0000 7f4ae7fff640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f4ae80c2cd0 0x7f4ae81533b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.88:48524/0 (socket says 172.21.15.88:48524) 2024-04-26T23:40:49.187 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.179+0000 7f4ae7fff640 1 -- 172.21.15.88:0/1890728422 learned_addr learned my addr 172.21.15.88:0/1890728422 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-26T23:40:49.188 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.179+0000 7f2fbbfff640 1 -- 172.21.15.88:0/971448106 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fbc036070 con 0x7f2fc40c33f0 2024-04-26T23:40:49.188 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.179+0000 7f2fbbfff640 1 -- 172.21.15.88:0/971448106 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2fbc031600 con 0x7f2fc40c33f0 2024-04-26T23:40:49.188 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.179+0000 7f2fbbfff640 1 -- 172.21.15.88:0/971448106 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fbc0319d0 con 0x7f2fc40c33f0 2024-04-26T23:40:49.188 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.179+0000 7f8a530f8640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8a4c15a280 0x7f8a4c0c82a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:49.188 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.179+0000 7f4aed3a5640 1 --2- 172.21.15.88:0/1890728422 >> v2:172.21.15.88:3300/0 conn(0x7f4ae80ac680 0x7f4ae815d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:49.189 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.179+0000 7f8a530f8640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f8a4c158180 0x7f8a4c1585f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:49.189 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.179+0000 7f8a530f8640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8a4c0c8a30 con 0x7f8a4c13ffb0 2024-04-26T23:40:49.189 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.179+0000 7f293be7e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f29341540f0 0x7f293415ac70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:49.189 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.179+0000 7f293be7e640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f2934157680 0x7f29340c4a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:49.189 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.179+0000 7f293be7e640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2934156bc0 con 0x7f29340ac610 2024-04-26T23:40:49.190 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.179+0000 7f293be7e640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f29341571f0 con 0x7f2934157680 2024-04-26T23:40:49.190 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.179+0000 7f293be7e640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f29340c5350 con 0x7f29341540f0 2024-04-26T23:40:49.190 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.179+0000 7f8a530f8640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f8a4c072be0 con 0x7f8a4c158180 2024-04-26T23:40:49.190 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.179+0000 7f8a530f8640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f8a4c0c9640 con 0x7f8a4c15a280 2024-04-26T23:40:49.190 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.180+0000 7f2939c1a640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f29341540f0 0x7f293415ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:49.190 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.180+0000 7f2939419640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f2934157680 0x7f29340c4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:49.191 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.180+0000 7f293a41b640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f29340ac610 0x7f293406f080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:58026/0 (socket says 172.21.15.88:58026) 2024-04-26T23:40:49.191 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.180+0000 7f4aed3a5640 1 -- 172.21.15.88:0/1890728422 >> v2:172.21.15.175:3300/0 conn(0x7f4ae8150200 msgr2=0x7f4ae80ac140 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T23:40:49.191 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.180+0000 7f4aed3a5640 1 --2- 172.21.15.88:0/1890728422 >> v2:172.21.15.175:3300/0 conn(0x7f4ae8150200 0x7f4ae80ac140 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:49.191 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.180+0000 7f293a41b640 1 -- 172.21.15.88:0/2230061135 learned_addr learned my addr 172.21.15.88:0/2230061135 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-26T23:40:49.191 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.180+0000 7f4ae77fe640 1 -- 172.21.15.88:0/1890728422 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3032231510 0 0) 0x7f4ad0004900 con 0x7f4ae80c2cd0 2024-04-26T23:40:49.192 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.179+0000 7fcc78fe6640 1 -- 172.21.15.88:0/840868956 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcc740c4160 msgr2=0x7fcc74157070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:49.192 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.179+0000 7fcc78fe6640 1 --2- 172.21.15.88:0/840868956 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcc740c4160 0x7fcc74157070 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fcc74070b50 tx=0x7fcc6c02a570 comp rx=0 tx=0).stop 2024-04-26T23:40:49.192 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.179+0000 7f8a4bfff640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8a4c15a280 0x7f8a4c0c82a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:49.193 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.180+0000 7f4aed3a5640 1 -- 172.21.15.88:0/1890728422 >> v1:172.21.15.175:6789/0 conn(0x7f4ae80c2cd0 legacy=0x7f4ae81533b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:49.193 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.180+0000 7f4aed3a5640 1 -- 172.21.15.88:0/1890728422 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ae80c48f0 con 0x7f4ae80ac680 2024-04-26T23:40:49.193 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.179+0000 7f8a51695640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f8a4c158180 0x7f8a4c1585f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:49.193 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.180+0000 7f2fcb96a640 1 -- 172.21.15.88:0/971448106 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2fc40c33f0 msgr2=0x7f2fc40c6db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:49.193 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.180+0000 7f2fcb96a640 1 --2- 172.21.15.88:0/971448106 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2fc40c33f0 0x7f2fc40c6db0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f2fc40c5fc0 tx=0x7f2fbc02a610 comp rx=0 tx=0).stop 2024-04-26T23:40:49.194 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.180+0000 7f2939419640 1 -- 172.21.15.88:0/2230061135 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f29341540f0 msgr2=0x7f293415ac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:40:49.194 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.180+0000 7f2939419640 1 --2- 172.21.15.88:0/2230061135 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f29341540f0 0x7f293415ac70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:49.194 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.180+0000 7f2939419640 1 -- 172.21.15.88:0/2230061135 >> v1:172.21.15.88:6789/0 conn(0x7f29340ac610 legacy=0x7f293406f080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:49.194 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.180+0000 7f2939419640 1 -- 172.21.15.88:0/2230061135 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29340c5630 con 0x7f2934157680 2024-04-26T23:40:49.194 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.180+0000 7f8a51695640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f8a4c158180 0x7f8a4c1585f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.88:36426/0 (socket says 172.21.15.88:36426) 2024-04-26T23:40:49.194 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.180+0000 7f8a51695640 1 -- 172.21.15.88:0/3444941173 learned_addr learned my addr 172.21.15.88:0/3444941173 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:40:49.195 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.180+0000 7f2fcb96a640 1 -- 172.21.15.88:0/971448106 shutdown_connections 2024-04-26T23:40:49.195 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.180+0000 7f2fcb96a640 1 --2- 172.21.15.88:0/971448106 >> v2:172.21.15.175:3300/0 conn(0x7f2fc40c4e30 0x7f2fc40c5480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:49.195 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.180+0000 7f2fcb96a640 1 --2- 172.21.15.88:0/971448106 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2fc40c33f0 0x7f2fc40c6db0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:49.195 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.180+0000 7f2fcb96a640 1 -- 172.21.15.88:0/971448106 >> 172.21.15.88:0/971448106 conn(0x7f2fc40c89f0 msgr2=0x7f2fc40c8dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:40:49.195 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.180+0000 7fcc78fe6640 1 -- 172.21.15.88:0/840868956 shutdown_connections 2024-04-26T23:40:49.196 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.180+0000 7fcc78fe6640 1 --2- 172.21.15.88:0/840868956 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcc740c4160 0x7fcc74157070 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:49.196 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.180+0000 7fcc78fe6640 1 --2- 172.21.15.88:0/840868956 >> v2:172.21.15.175:3300/0 conn(0x7fcc740734d0 0x7fcc7406d320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:49.196 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.180+0000 7fcc78fe6640 1 --2- 172.21.15.88:0/840868956 >> v2:172.21.15.88:3300/0 conn(0x7fcc741510c0 0x7fcc74072f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:49.196 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.181+0000 7f2fcb96a640 1 -- 172.21.15.88:0/971448106 shutdown_connections 2024-04-26T23:40:49.196 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.180+0000 7fcc78fe6640 1 -- 172.21.15.88:0/840868956 >> 172.21.15.88:0/840868956 conn(0x7fcc740c5ce0 msgr2=0x7fcc740c60f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:40:49.197 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.180+0000 7f8a51695640 1 -- 172.21.15.88:0/3444941173 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8a4c15a280 msgr2=0x7f8a4c0c82a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:40:49.197 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.180+0000 7f8a51695640 1 --2- 172.21.15.88:0/3444941173 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8a4c15a280 0x7f8a4c0c82a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:49.197 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.180+0000 7f8a51695640 1 -- 172.21.15.88:0/3444941173 >> v1:172.21.15.88:6789/0 conn(0x7f8a4c13ffb0 legacy=0x7f8a4c072ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:40:49.197 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.180+0000 7f8a51695640 1 -- 172.21.15.88:0/3444941173 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a4c0c8d10 con 0x7f8a4c158180 2024-04-26T23:40:49.198 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.181+0000 7f4aed3a5640 1 --2- 172.21.15.88:0/1890728422 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4ae80ac680 0x7f4ae815d590 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f4ae8071320 tx=0x7f4ae002b360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c5cbb00a681fd39 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:49.198 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.181+0000 7f2939419640 1 --2- 172.21.15.88:0/2230061135 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2934157680 0x7f29340c4a90 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f29240097a0 tx=0x7f292402a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85577fedd1c3d778 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:49.198 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.181+0000 7f2fcb96a640 1 -- 172.21.15.88:0/971448106 wait complete. 2024-04-26T23:40:49.198 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.181+0000 7fcc78fe6640 1 -- 172.21.15.88:0/840868956 shutdown_connections 2024-04-26T23:40:49.199 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.181+0000 7fcc78fe6640 1 -- 172.21.15.88:0/840868956 wait complete. 2024-04-26T23:40:49.199 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.181+0000 7f8a51695640 1 --2- 172.21.15.88:0/3444941173 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8a4c158180 0x7f8a4c1585f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f8a44009e50 tx=0x7f8a4402a640 comp rx=0 tx=0).ready entity=mon.1 client_cookie=40752f5119176921 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:49.199 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.181+0000 7f8a4b7fe640 1 -- 172.21.15.88:0/3444941173 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a44036070 con 0x7f8a4c158180 2024-04-26T23:40:49.199 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.182+0000 7f4ae77fe640 1 -- 172.21.15.88:0/1890728422 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ae0038070 con 0x7f4ae80ac680 2024-04-26T23:40:49.199 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.182+0000 7f4ae77fe640 1 -- 172.21.15.88:0/1890728422 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ae0033640 con 0x7f4ae80ac680 2024-04-26T23:40:49.200 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.183+0000 7f4aeee08640 1 -- 172.21.15.88:0/1890728422 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4ae80ac680 msgr2=0x7f4ae815d590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:49.200 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.183+0000 7f4ae77fe640 1 -- 172.21.15.88:0/1890728422 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ae0038070 con 0x7f4ae80ac680 2024-04-26T23:40:49.200 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.183+0000 7f4aeee08640 1 --2- 172.21.15.88:0/1890728422 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4ae80ac680 0x7f4ae815d590 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f4ae8071320 tx=0x7f4ae002b360 comp rx=0 tx=0).stop 2024-04-26T23:40:49.200 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.182+0000 7f2fcb96a640 1 Processor -- start 2024-04-26T23:40:49.200 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.182+0000 7f2938c18640 1 -- 172.21.15.88:0/2230061135 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2924037070 con 0x7f2934157680 2024-04-26T23:40:49.200 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.182+0000 7f2938c18640 1 -- 172.21.15.88:0/2230061135 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f292402ae50 con 0x7f2934157680 2024-04-26T23:40:49.200 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.183+0000 7f293be7e640 1 -- 172.21.15.88:0/2230061135 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2934157680 msgr2=0x7f29340c4a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:49.201 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.183+0000 7f293be7e640 1 --2- 172.21.15.88:0/2230061135 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2934157680 0x7f29340c4a90 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f29240097a0 tx=0x7f292402a100 comp rx=0 tx=0).stop 2024-04-26T23:40:49.201 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.182+0000 7f8a4b7fe640 1 -- 172.21.15.88:0/3444941173 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a44031600 con 0x7f8a4c158180 2024-04-26T23:40:49.201 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.182+0000 7f8a4b7fe640 1 -- 172.21.15.88:0/3444941173 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a440319d0 con 0x7f8a4c158180 2024-04-26T23:40:49.201 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.183+0000 7f8a530f8640 1 -- 172.21.15.88:0/3444941173 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8a4c158180 msgr2=0x7f8a4c1585f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:49.201 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.183+0000 7f8a530f8640 1 --2- 172.21.15.88:0/3444941173 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8a4c158180 0x7f8a4c1585f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f8a44009e50 tx=0x7f8a4402a640 comp rx=0 tx=0).stop 2024-04-26T23:40:49.201 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.182+0000 7f2fcb96a640 1 -- start start 2024-04-26T23:40:49.201 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.183+0000 7fcc78fe6640 1 Processor -- start 2024-04-26T23:40:49.202 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.183+0000 7fcc78fe6640 1 -- start start 2024-04-26T23:40:49.202 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.183+0000 7f4aeee08640 1 -- 172.21.15.88:0/1890728422 shutdown_connections 2024-04-26T23:40:49.202 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.183+0000 7f4aeee08640 1 --2- 172.21.15.88:0/1890728422 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4ae80ac680 0x7f4ae815d590 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:49.202 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.183+0000 7f4aeee08640 1 --2- 172.21.15.88:0/1890728422 >> v2:172.21.15.175:3300/0 conn(0x7f4ae8150200 0x7f4ae80ac140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:49.202 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.183+0000 7f4aeee08640 1 -- 172.21.15.88:0/1890728422 >> 172.21.15.88:0/1890728422 conn(0x7f4ae80c82d0 msgr2=0x7f4ae80c86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:40:49.202 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.183+0000 7f8a530f8640 1 -- 172.21.15.88:0/3444941173 shutdown_connections 2024-04-26T23:40:49.203 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.183+0000 7f8a530f8640 1 --2- 172.21.15.88:0/3444941173 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8a4c158180 0x7f8a4c1585f0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:49.203 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.183+0000 7f8a530f8640 1 --2- 172.21.15.88:0/3444941173 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8a4c15a280 0x7f8a4c0c82a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:49.203 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.183+0000 7f8a530f8640 1 -- 172.21.15.88:0/3444941173 >> 172.21.15.88:0/3444941173 conn(0x7f8a4c06dc10 msgr2=0x7f8a4c06c310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:40:49.203 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.183+0000 7f8a530f8640 1 -- 172.21.15.88:0/3444941173 shutdown_connections 2024-04-26T23:40:49.203 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.183+0000 7f8a530f8640 1 -- 172.21.15.88:0/3444941173 wait complete. 2024-04-26T23:40:49.203 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.183+0000 7f4aeee08640 1 -- 172.21.15.88:0/1890728422 shutdown_connections 2024-04-26T23:40:49.203 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.183+0000 7f2fcb96a640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2fc40c33f0 0x7f2fc414b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:49.204 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.183+0000 7f293be7e640 1 -- 172.21.15.88:0/2230061135 shutdown_connections 2024-04-26T23:40:49.204 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.183+0000 7f293be7e640 1 --2- 172.21.15.88:0/2230061135 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2934157680 0x7f29340c4a90 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:49.204 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.183+0000 7f293be7e640 1 --2- 172.21.15.88:0/2230061135 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f29341540f0 0x7f293415ac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:49.204 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.183+0000 7f293be7e640 1 -- 172.21.15.88:0/2230061135 >> 172.21.15.88:0/2230061135 conn(0x7f293406c310 msgr2=0x7f293406c6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:40:49.204 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.183+0000 7f2fcb96a640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2fc40c4e30 0x7f2fc40be090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:49.205 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.183+0000 7f2fcb96a640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2fc4158610 0x7f2fc4073700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:49.205 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.183+0000 7f2fcb96a640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f2fc406fd90 con 0x7f2fc40c4e30 2024-04-26T23:40:49.205 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.183+0000 7f4aeee08640 1 -- 172.21.15.88:0/1890728422 wait complete. 2024-04-26T23:40:49.205 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.184+0000 7f2fc8f05640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2fc40c4e30 0x7f2fc40be090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:49.206 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.184+0000 7f2fc9f07640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2fc4158610 0x7f2fc4073700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:49.206 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.184+0000 7f2fc9f07640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2fc4158610 0x7f2fc4073700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.88:37090/0 (socket says 172.21.15.88:37090) 2024-04-26T23:40:49.206 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.184+0000 7f2fc9f07640 1 -- 172.21.15.88:0/3331628210 learned_addr learned my addr 172.21.15.88:0/3331628210 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:40:49.206 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.184+0000 7f2fcb96a640 1 -- 172.21.15.88:0/3331628210 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f2fc4070460 con 0x7f2fc40c33f0 2024-04-26T23:40:49.206 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.184+0000 7f2fcb96a640 1 -- 172.21.15.88:0/3331628210 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f2fc415bde0 con 0x7f2fc4158610 2024-04-26T23:40:49.206 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.184+0000 7fcc78fe6640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcc740c4160 0x7fcc74144f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:49.206 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.184+0000 7f293be7e640 1 -- 172.21.15.88:0/2230061135 shutdown_connections 2024-04-26T23:40:49.207 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.184+0000 7f2fc9706640 1 --2- 172.21.15.88:0/3331628210 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2fc40c33f0 0x7f2fc414b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:49.207 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.184+0000 7fcc78fe6640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcc741510c0 0x7fcc74145ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:49.207 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.184+0000 7f2fc8f05640 1 -- 172.21.15.88:0/3331628210 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2fc4158610 msgr2=0x7f2fc4073700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:49.207 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.184+0000 7f2fc8f05640 1 --2- 172.21.15.88:0/3331628210 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2fc4158610 0x7f2fc4073700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:49.207 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.184+0000 7f2fc8f05640 1 -- 172.21.15.88:0/3331628210 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2fc40c33f0 msgr2=0x7f2fc414b9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:49.207 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.184+0000 7f2fc8f05640 1 --2- 172.21.15.88:0/3331628210 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2fc40c33f0 0x7f2fc414b9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:49.208 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.184+0000 7f2fc8f05640 1 -- 172.21.15.88:0/3331628210 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fc41542e0 con 0x7f2fc40c4e30 2024-04-26T23:40:49.208 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.184+0000 7fcc7259c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcc740c4160 0x7fcc74144f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:49.208 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.184+0000 7f2fc8f05640 1 --2- 172.21.15.88:0/3331628210 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2fc40c4e30 0x7f2fc40be090 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f2fc40c9ab0 tx=0x7f2fbc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:49.208 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.184+0000 7fcc7259c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcc740c4160 0x7fcc74144f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:41568/0 (socket says 172.21.15.88:41568) 2024-04-26T23:40:49.209 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.185+0000 7fcc78fe6640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcc740aeb80 0x7fcc74143a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:49.209 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.185+0000 7f2fb9ffb640 1 -- 172.21.15.88:0/3331628210 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fbc041020 con 0x7f2fc40c4e30 2024-04-26T23:40:49.209 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.185+0000 7fcc7259c640 1 -- 172.21.15.88:0/237345637 learned_addr learned my addr 172.21.15.88:0/237345637 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:40:49.209 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.185+0000 7fcc78fe6640 1 -- 172.21.15.88:0/237345637 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fcc740c5920 con 0x7fcc740c4160 2024-04-26T23:40:49.210 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.185+0000 7fcc78fe6640 1 -- 172.21.15.88:0/237345637 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fcc740c5400 con 0x7fcc740aeb80 2024-04-26T23:40:49.210 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.185+0000 7fcc78fe6640 1 -- 172.21.15.88:0/237345637 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fcc7406f500 con 0x7fcc741510c0 2024-04-26T23:40:49.210 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.185+0000 7f2fb9ffb640 1 -- 172.21.15.88:0/3331628210 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2fbc008730 con 0x7f2fc40c4e30 2024-04-26T23:40:49.210 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.185+0000 7f2fb9ffb640 1 -- 172.21.15.88:0/3331628210 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fbc036040 con 0x7f2fc40c4e30 2024-04-26T23:40:49.210 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.185+0000 7f2fcb96a640 1 -- 172.21.15.88:0/3331628210 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2fc41545c0 con 0x7f2fc40c4e30 2024-04-26T23:40:49.210 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.185+0000 7fcc71d9b640 1 --2- 172.21.15.88:0/237345637 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcc741510c0 0x7fcc74145ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:49.211 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.185+0000 7f8a530f8640 1 Processor -- start 2024-04-26T23:40:49.214 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.185+0000 7f2fcb96a640 1 -- 172.21.15.88:0/3331628210 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2fc40abdf0 con 0x7f2fc40c4e30 2024-04-26T23:40:49.214 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.185+0000 7f4aeee08640 1 Processor -- start 2024-04-26T23:40:49.214 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.185+0000 7f293be7e640 1 -- 172.21.15.88:0/2230061135 wait complete. 2024-04-26T23:40:49.215 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.185+0000 7f8a530f8640 1 -- start start 2024-04-26T23:40:49.215 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.186+0000 7f8a530f8640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8a4c13ffb0 0x7f8a4c157260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:49.215 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.186+0000 7f8a530f8640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8a4c158180 0x7f8a4c1566c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:49.215 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.187+0000 7f8a530f8640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8a4c15a280 0x7f8a4c156c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:49.215 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.187+0000 7f8a530f8640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f8a4c0c92d0 con 0x7f8a4c158180 2024-04-26T23:40:49.215 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.187+0000 7f8a530f8640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f8a4c0c87e0 con 0x7f8a4c15a280 2024-04-26T23:40:49.216 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.187+0000 7f8a530f8640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f8a4c073700 con 0x7f8a4c13ffb0 2024-04-26T23:40:49.216 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.187+0000 7f8a4bfff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8a4c158180 0x7f8a4c1566c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:49.216 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.187+0000 7f8a4bfff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8a4c158180 0x7f8a4c1566c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:41578/0 (socket says 172.21.15.88:41578) 2024-04-26T23:40:49.216 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.187+0000 7f8a4bfff640 1 -- 172.21.15.88:0/1360475709 learned_addr learned my addr 172.21.15.88:0/1360475709 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:40:49.216 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.187+0000 7f8a51695640 1 --2- 172.21.15.88:0/1360475709 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8a4c15a280 0x7f8a4c156c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:49.216 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.187+0000 7fcc72d9d640 1 --2- 172.21.15.88:0/237345637 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcc740aeb80 0x7fcc74143a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:49.216 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.187+0000 7f8a50e94640 1 --2- 172.21.15.88:0/1360475709 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8a4c13ffb0 0x7f8a4c157260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:49.217 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.185+0000 7f4aeee08640 1 -- start start 2024-04-26T23:40:49.217 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.187+0000 7f293be7e640 1 Processor -- start 2024-04-26T23:40:49.217 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.187+0000 7f4aeee08640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4ae80ac680 0x7f4ae81f9850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:49.217 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.187+0000 7f4aeee08640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4ae80c2cd0 0x7f4ae8146620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:49.217 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.187+0000 7f4aeee08640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4ae8150200 0x7f4ae81facc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:49.217 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.187+0000 7f4aeee08640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f4ae8150760 con 0x7f4ae8150200 2024-04-26T23:40:49.218 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.187+0000 7f4aeee08640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f4ae81505e0 con 0x7f4ae80c2cd0 2024-04-26T23:40:49.218 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.187+0000 7f4aeee08640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f4ae8153ac0 con 0x7f4ae80ac680 2024-04-26T23:40:49.218 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.187+0000 7f4aecba4640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4ae80ac680 0x7f4ae81f9850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:49.218 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.187+0000 7f4aecba4640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4ae80ac680 0x7f4ae81f9850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.88:37118/0 (socket says 172.21.15.88:37118) 2024-04-26T23:40:49.218 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.187+0000 7f4aecba4640 1 -- 172.21.15.88:0/1346190396 learned_addr learned my addr 172.21.15.88:0/1346190396 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:40:49.218 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.187+0000 7f4ae7fff640 1 --2- 172.21.15.88:0/1346190396 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4ae80c2cd0 0x7f4ae8146620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:49.218 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.187+0000 7f293be7e640 1 -- start start 2024-04-26T23:40:49.218 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.187+0000 7f2fcb96a640 1 -- 172.21.15.88:0/3331628210 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2fa4005290 con 0x7f2fc40c4e30 2024-04-26T23:40:49.219 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.187+0000 7f4aed3a5640 1 --2- 172.21.15.88:0/1346190396 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4ae8150200 0x7f4ae81facc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:49.219 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.187+0000 7fcc7259c640 1 -- 172.21.15.88:0/237345637 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcc741510c0 msgr2=0x7fcc74145ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:49.219 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.187+0000 7fcc7259c640 1 --2- 172.21.15.88:0/237345637 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcc741510c0 0x7fcc74145ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:49.219 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.187+0000 7fcc7259c640 1 -- 172.21.15.88:0/237345637 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcc740aeb80 msgr2=0x7fcc74143a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:49.219 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.187+0000 7fcc7259c640 1 --2- 172.21.15.88:0/237345637 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcc740aeb80 0x7fcc74143a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:49.219 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.187+0000 7fcc7259c640 1 -- 172.21.15.88:0/237345637 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc74145520 con 0x7fcc740c4160 2024-04-26T23:40:49.219 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.187+0000 7f8a4bfff640 1 -- 172.21.15.88:0/1360475709 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8a4c13ffb0 msgr2=0x7f8a4c157260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:49.220 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.187+0000 7f8a4bfff640 1 --2- 172.21.15.88:0/1360475709 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8a4c13ffb0 0x7f8a4c157260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:49.220 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.187+0000 7f8a4bfff640 1 -- 172.21.15.88:0/1360475709 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8a4c15a280 msgr2=0x7f8a4c156c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:49.220 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.187+0000 7f8a4bfff640 1 --2- 172.21.15.88:0/1360475709 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8a4c15a280 0x7f8a4c156c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:49.220 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.187+0000 7f8a4bfff640 1 -- 172.21.15.88:0/1360475709 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a4c1f4180 con 0x7f8a4c158180 2024-04-26T23:40:49.220 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.188+0000 7fcc7259c640 1 --2- 172.21.15.88:0/237345637 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcc740c4160 0x7fcc74144f20 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fcc6801e830 tx=0x7fcc6801ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:49.220 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.188+0000 7f4ae7fff640 1 -- 172.21.15.88:0/1346190396 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4ae80ac680 msgr2=0x7f4ae81f9850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:49.220 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.188+0000 7f4ae7fff640 1 --2- 172.21.15.88:0/1346190396 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4ae80ac680 0x7f4ae81f9850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:49.220 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.188+0000 7f4ae7fff640 1 -- 172.21.15.88:0/1346190396 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4ae8150200 msgr2=0x7f4ae81facc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:49.220 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.188+0000 7f4ae7fff640 1 --2- 172.21.15.88:0/1346190396 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4ae8150200 0x7f4ae81facc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:49.221 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.188+0000 7f4ae7fff640 1 -- 172.21.15.88:0/1346190396 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ae8146b60 con 0x7f4ae80c2cd0 2024-04-26T23:40:49.221 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.188+0000 7f4aecba4640 1 --2- 172.21.15.88:0/1346190396 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4ae80ac680 0x7f4ae81f9850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:40:49.221 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.188+0000 7f4ae7fff640 1 --2- 172.21.15.88:0/1346190396 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4ae80c2cd0 0x7f4ae8146620 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f4ae80c30b0 tx=0x7f4ad000cbc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:49.221 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.188+0000 7f2fb9ffb640 1 -- 172.21.15.88:0/3331628210 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2fbc044020 con 0x7f2fc40c4e30 2024-04-26T23:40:49.221 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.188+0000 7f293be7e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f29340ac610 0x7f29340c1b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:49.221 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.188+0000 7f293be7e640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f29341540f0 0x7f293414d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:49.221 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.188+0000 7f293be7e640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2934157680 0x7f293414d910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:49.221 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.188+0000 7f293be7e640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f29340c4fd0 con 0x7f29341540f0 2024-04-26T23:40:49.221 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.188+0000 7f293be7e640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f2934157ac0 con 0x7f2934157680 2024-04-26T23:40:49.222 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.188+0000 7f8a4bfff640 1 --2- 172.21.15.88:0/1360475709 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8a4c158180 0x7f8a4c1566c0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f8a4000e8a0 tx=0x7f8a4000ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:49.222 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.188+0000 7f293be7e640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f293406f790 con 0x7f29340ac610 2024-04-26T23:40:49.222 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.188+0000 7f293a41b640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2934157680 0x7f293414d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:49.222 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.188+0000 7f2939419640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f29341540f0 0x7f293414d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:49.222 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.188+0000 7f2939c1a640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f29340ac610 0x7f29340c1b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:49.222 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.188+0000 7f2939419640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f29341540f0 0x7f293414d3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:41606/0 (socket says 172.21.15.88:41606) 2024-04-26T23:40:49.222 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.188+0000 7f2939419640 1 -- 172.21.15.88:0/2393666763 learned_addr learned my addr 172.21.15.88:0/2393666763 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:40:49.222 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.188+0000 7f293a41b640 1 --2- 172.21.15.88:0/2393666763 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2934157680 0x7f293414d910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.88:36480/0 (socket says 172.21.15.88:36480) 2024-04-26T23:40:49.222 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.189+0000 7f2939419640 1 -- 172.21.15.88:0/2393666763 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f29340ac610 msgr2=0x7f29340c1b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:49.222 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.189+0000 7f2939419640 1 --2- 172.21.15.88:0/2393666763 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f29340ac610 0x7f29340c1b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:49.223 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.189+0000 7f2939419640 1 -- 172.21.15.88:0/2393666763 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2934157680 msgr2=0x7f293414d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:49.223 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.189+0000 7f2939419640 1 --2- 172.21.15.88:0/2393666763 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2934157680 0x7f293414d910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:49.223 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.189+0000 7f2939419640 1 -- 172.21.15.88:0/2393666763 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29341f46e0 con 0x7f29341540f0 2024-04-26T23:40:49.223 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.189+0000 7f293a41b640 1 --2- 172.21.15.88:0/2393666763 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2934157680 0x7f293414d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:40:49.223 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.189+0000 7f8a497fa640 1 -- 172.21.15.88:0/1360475709 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a40017070 con 0x7f8a4c158180 2024-04-26T23:40:49.223 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.189+0000 7f8a497fa640 1 -- 172.21.15.88:0/1360475709 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a4000c940 con 0x7f8a4c158180 2024-04-26T23:40:49.223 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.189+0000 7f8a497fa640 1 -- 172.21.15.88:0/1360475709 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a4000cd30 con 0x7f8a4c158180 2024-04-26T23:40:49.224 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.189+0000 7f4ae57fa640 1 -- 172.21.15.88:0/1346190396 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ad0018070 con 0x7f4ae80c2cd0 2024-04-26T23:40:49.224 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.189+0000 7f4ae57fa640 1 -- 172.21.15.88:0/1346190396 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ad000aa50 con 0x7f4ae80c2cd0 2024-04-26T23:40:49.224 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.189+0000 7f2fb9ffb640 1 --2- 172.21.15.88:0/3331628210 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f2fa806c8f0 0x7f2fa806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:49.224 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.189+0000 7f2fb9ffb640 1 -- 172.21.15.88:0/3331628210 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7f2fbc0acba0 con 0x7f2fc40c4e30 2024-04-26T23:40:49.224 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.189+0000 7f8a530f8640 1 -- 172.21.15.88:0/1360475709 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a4c1f4460 con 0x7f8a4c158180 2024-04-26T23:40:49.224 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.189+0000 7f8a530f8640 1 -- 172.21.15.88:0/1360475709 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a4c1f4a20 con 0x7f8a4c158180 2024-04-26T23:40:49.225 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.189+0000 7f4ae57fa640 1 -- 172.21.15.88:0/1346190396 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ad000ae40 con 0x7f4ae80c2cd0 2024-04-26T23:40:49.225 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.190+0000 7f2fc9706640 1 --2- 172.21.15.88:0/3331628210 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f2fa806c8f0 0x7f2fa806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:49.225 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.190+0000 7f2939419640 1 --2- 172.21.15.88:0/2393666763 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f29341540f0 0x7f293414d3d0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f29240097a0 tx=0x7f29240046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:49.225 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.190+0000 7f4aeee08640 1 -- 172.21.15.88:0/1346190396 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ae8145580 con 0x7f4ae80c2cd0 2024-04-26T23:40:49.225 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.190+0000 7f4aeee08640 1 -- 172.21.15.88:0/1346190396 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ae8145b40 con 0x7f4ae80c2cd0 2024-04-26T23:40:49.226 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.190+0000 7f2fc9706640 1 --2- 172.21.15.88:0/3331628210 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f2fa806c8f0 0x7f2fa806edb0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f2fc40c2d20 tx=0x7f2fb4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:49.226 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.190+0000 7fcc62ffd640 1 -- 172.21.15.88:0/237345637 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc68029020 con 0x7fcc740c4160 2024-04-26T23:40:49.226 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.190+0000 7fcc62ffd640 1 -- 172.21.15.88:0/237345637 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc6801a6c0 con 0x7fcc740c4160 2024-04-26T23:40:49.226 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.190+0000 7fcc62ffd640 1 -- 172.21.15.88:0/237345637 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc6801aab0 con 0x7fcc740c4160 2024-04-26T23:40:49.226 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.190+0000 7fcc78fe6640 1 -- 172.21.15.88:0/237345637 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc74146c20 con 0x7fcc740c4160 2024-04-26T23:40:49.226 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.190+0000 7fcc78fe6640 1 -- 172.21.15.88:0/237345637 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc741471e0 con 0x7fcc740c4160 2024-04-26T23:40:49.227 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.191+0000 7fecaab12640 1 Processor -- start 2024-04-26T23:40:49.227 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.191+0000 7fecaab12640 1 -- start start 2024-04-26T23:40:49.227 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.191+0000 7f4aeee08640 1 -- 172.21.15.88:0/1346190396 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ae80c27e0 con 0x7f4ae80c2cd0 2024-04-26T23:40:49.227 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.192+0000 7fcc78fe6640 1 -- 172.21.15.88:0/237345637 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcc740507a0 con 0x7fcc740c4160 2024-04-26T23:40:49.227 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.193+0000 7f8a530f8640 1 -- 172.21.15.88:0/1360475709 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a4c076650 con 0x7f8a4c158180 2024-04-26T23:40:49.228 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.193+0000 7f4ae57fa640 1 -- 172.21.15.88:0/1346190396 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4ad001b070 con 0x7f4ae80c2cd0 2024-04-26T23:40:49.228 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.193+0000 7fecaab12640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7feca40ac710 0x7feca41555a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:49.229 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.193+0000 7fecaab12640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7feca4073690 0x7feca4073b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:49.229 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.193+0000 7fecaab12640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feca414f0b0 con 0x7feca414ecd0 2024-04-26T23:40:49.229 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.193+0000 7fecaab12640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7feca4074c90 con 0x7feca4073690 2024-04-26T23:40:49.229 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.193+0000 7fecaab12640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7feca40c6400 con 0x7feca40ac710 2024-04-26T23:40:49.229 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.193+0000 7feca88ae640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7feca414ecd0 0x7feca40ab470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:58048/0 (socket says 172.21.15.88:58048) 2024-04-26T23:40:49.229 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.193+0000 7feca88ae640 1 -- 172.21.15.88:0/3576311256 learned_addr learned my addr 172.21.15.88:0/3576311256 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-26T23:40:49.229 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.193+0000 7feca90af640 1 --2- 172.21.15.88:0/3576311256 >> v2:172.21.15.88:3300/0 conn(0x7feca4073690 0x7feca4073b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:49.229 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.193+0000 7feca3fff640 1 --2- 172.21.15.88:0/3576311256 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7feca40ac710 0x7feca41555a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:49.229 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.193+0000 7f4ae57fa640 1 --2- 172.21.15.88:0/1346190396 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f4ac806c9c0 0x7f4ac806ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:49.230 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.193+0000 7feca90af640 1 -- 172.21.15.88:0/3576311256 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7feca40ac710 msgr2=0x7feca41555a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:40:49.230 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.193+0000 7feca90af640 1 --2- 172.21.15.88:0/3576311256 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7feca40ac710 0x7feca41555a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:49.230 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.193+0000 7feca90af640 1 -- 172.21.15.88:0/3576311256 >> v1:172.21.15.88:6789/0 conn(0x7feca414ecd0 legacy=0x7feca40ab470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:49.230 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.193+0000 7feca90af640 1 -- 172.21.15.88:0/3576311256 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feca40c66e0 con 0x7feca4073690 2024-04-26T23:40:49.230 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.193+0000 7f4ae57fa640 1 -- 172.21.15.88:0/1346190396 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7f4ad008b7b0 con 0x7f4ae80c2cd0 2024-04-26T23:40:49.230 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.194+0000 7f4aecba4640 1 --2- 172.21.15.88:0/1346190396 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f4ac806c9c0 0x7f4ac806ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:49.231 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.194+0000 7f4aecba4640 1 --2- 172.21.15.88:0/1346190396 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f4ac806c9c0 0x7f4ac806ee80 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f4ad800c5d0 tx=0x7f4ad800b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:49.231 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.194+0000 7feca90af640 1 --2- 172.21.15.88:0/3576311256 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feca4073690 0x7feca4073b10 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fec9c009d90 tx=0x7fec9c02a530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95bc1dbe0b9b380e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:49.231 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.196+0000 7f2fb9ffb640 1 -- 172.21.15.88:0/3331628210 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f2fbc04b070 con 0x7f2fc40c4e30 2024-04-26T23:40:49.232 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.196+0000 7f292a7fc640 1 -- 172.21.15.88:0/2393666763 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2924042020 con 0x7f29341540f0 2024-04-26T23:40:49.232 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.196+0000 7f293be7e640 1 -- 172.21.15.88:0/2393666763 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29341f49c0 con 0x7f29341540f0 2024-04-26T23:40:49.232 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.196+0000 7f293be7e640 1 -- 172.21.15.88:0/2393666763 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29341f4f80 con 0x7f29341540f0 2024-04-26T23:40:49.232 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.197+0000 7f293be7e640 1 -- 172.21.15.88:0/2393666763 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f29341f5180 con 0x7f29341540f0 2024-04-26T23:40:49.232 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.197+0000 7f8a497fa640 1 -- 172.21.15.88:0/1360475709 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8a4001a070 con 0x7f8a4c158180 2024-04-26T23:40:49.232 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.198+0000 7feca37fe640 1 -- 172.21.15.88:0/3576311256 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec9c007740 con 0x7feca4073690 2024-04-26T23:40:49.232 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.198+0000 7feca37fe640 1 -- 172.21.15.88:0/3576311256 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec9c0078e0 con 0x7feca4073690 2024-04-26T23:40:49.232 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.198+0000 7feca37fe640 1 -- 172.21.15.88:0/3576311256 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec9c007cb0 con 0x7feca4073690 2024-04-26T23:40:49.233 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.198+0000 7f8a497fa640 1 --2- 172.21.15.88:0/1360475709 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f8a3006c9f0 0x7f8a3006eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:49.233 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.198+0000 7fcc62ffd640 1 -- 172.21.15.88:0/237345637 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fcc6802c020 con 0x7fcc740c4160 2024-04-26T23:40:49.233 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.198+0000 7f4ae57fa640 1 -- 172.21.15.88:0/1346190396 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f4ae80c27e0 con 0x7f4ae80c2cd0 2024-04-26T23:40:49.233 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.199+0000 7fecaab12640 1 -- 172.21.15.88:0/3576311256 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feca4073690 msgr2=0x7feca4073b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:49.234 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.199+0000 7fecaab12640 1 --2- 172.21.15.88:0/3576311256 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feca4073690 0x7feca4073b10 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fec9c009d90 tx=0x7fec9c02a530 comp rx=0 tx=0).stop 2024-04-26T23:40:49.234 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.199+0000 7fecaab12640 1 -- 172.21.15.88:0/3576311256 shutdown_connections 2024-04-26T23:40:49.234 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.199+0000 7fecaab12640 1 --2- 172.21.15.88:0/3576311256 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feca4073690 0x7feca4073b10 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:49.234 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.199+0000 7fecaab12640 1 --2- 172.21.15.88:0/3576311256 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7feca40ac710 0x7feca41555a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:49.234 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.199+0000 7fecaab12640 1 -- 172.21.15.88:0/3576311256 >> 172.21.15.88:0/3576311256 conn(0x7feca40c6d80 msgr2=0x7feca40c7160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:40:49.234 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.199+0000 7fcc62ffd640 1 --2- 172.21.15.88:0/237345637 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fcc5406c9c0 0x7fcc5406ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:49.234 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.199+0000 7fcc62ffd640 1 -- 172.21.15.88:0/237345637 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7fcc6809da00 con 0x7fcc740c4160 2024-04-26T23:40:49.234 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.200+0000 7fcc71d9b640 1 --2- 172.21.15.88:0/237345637 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fcc5406c9c0 0x7fcc5406ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:49.235 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.199+0000 7f292a7fc640 1 -- 172.21.15.88:0/2393666763 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2924032440 con 0x7f29341540f0 2024-04-26T23:40:49.235 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.199+0000 7f292a7fc640 1 -- 172.21.15.88:0/2393666763 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2924042020 con 0x7f29341540f0 2024-04-26T23:40:49.235 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.198+0000 7f8a50e94640 1 --2- 172.21.15.88:0/1360475709 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f8a3006c9f0 0x7f8a3006eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:49.235 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.199+0000 7f8a50e94640 1 --2- 172.21.15.88:0/1360475709 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f8a3006c9f0 0x7f8a3006eeb0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f8a38001840 tx=0x7f8a38009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:49.235 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.199+0000 7f8a497fa640 1 -- 172.21.15.88:0/1360475709 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7f8a4008c370 con 0x7f8a4c158180 2024-04-26T23:40:49.235 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.199+0000 7fecaab12640 1 -- 172.21.15.88:0/3576311256 shutdown_connections 2024-04-26T23:40:49.235 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.199+0000 7fecaab12640 1 -- 172.21.15.88:0/3576311256 wait complete. 2024-04-26T23:40:49.236 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.200+0000 7fcc71d9b640 1 --2- 172.21.15.88:0/237345637 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fcc5406c9c0 0x7fcc5406ee80 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fcc74073d40 tx=0x7fcc64009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:49.237 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.201+0000 7fecaab12640 1 Processor -- start 2024-04-26T23:40:49.237 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.201+0000 7fecaab12640 1 -- start start 2024-04-26T23:40:49.237 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.202+0000 7fecaab12640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feca4073690 0x7feca41f1520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:49.237 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.202+0000 7fecaab12640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7feca40ac710 0x7feca414d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:49.237 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.202+0000 7fecaab12640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7feca414ecd0 0x7feca4152fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:49.238 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.202+0000 7feca88ae640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feca4073690 0x7feca41f1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:49.238 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.202+0000 7feca3fff640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7feca40ac710 0x7feca414d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:49.238 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.202+0000 7feca88ae640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feca4073690 0x7feca41f1520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:41626/0 (socket says 172.21.15.88:41626) 2024-04-26T23:40:49.238 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.202+0000 7feca88ae640 1 -- 172.21.15.88:0/3945319750 learned_addr learned my addr 172.21.15.88:0/3945319750 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:40:49.238 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.203+0000 7fecaab12640 1 -- 172.21.15.88:0/3945319750 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7feca4155080 con 0x7feca4073690 2024-04-26T23:40:49.238 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.203+0000 7fecaab12640 1 -- 172.21.15.88:0/3945319750 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7feca4154da0 con 0x7feca414ecd0 2024-04-26T23:40:49.238 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.203+0000 7feca90af640 1 --2- 172.21.15.88:0/3945319750 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7feca414ecd0 0x7feca4152fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:49.238 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.203+0000 7fecaab12640 1 -- 172.21.15.88:0/3945319750 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7feca40c69c0 con 0x7feca40ac710 2024-04-26T23:40:49.238 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.203+0000 7feca88ae640 1 -- 172.21.15.88:0/3945319750 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7feca40ac710 msgr2=0x7feca414d440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:49.238 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.203+0000 7feca88ae640 1 --2- 172.21.15.88:0/3945319750 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7feca40ac710 0x7feca414d440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:49.238 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.203+0000 7feca88ae640 1 -- 172.21.15.88:0/3945319750 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7feca414ecd0 msgr2=0x7feca4152fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:49.238 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.203+0000 7feca88ae640 1 --2- 172.21.15.88:0/3945319750 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7feca414ecd0 0x7feca4152fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:49.238 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.203+0000 7feca88ae640 1 -- 172.21.15.88:0/3945319750 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feca414d980 con 0x7feca4073690 2024-04-26T23:40:49.238 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.203+0000 7feca3fff640 1 --2- 172.21.15.88:0/3945319750 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7feca40ac710 0x7feca414d440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:40:49.238 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.203+0000 7feca88ae640 1 --2- 172.21.15.88:0/3945319750 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feca4073690 0x7feca41f1520 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fec9800c430 tx=0x7fec9800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:49.239 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.205+0000 7f8a497fa640 1 -- 172.21.15.88:0/1360475709 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f8a40059e90 con 0x7f8a4c158180 2024-04-26T23:40:49.239 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.205+0000 7feca17fa640 1 -- 172.21.15.88:0/3945319750 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec98017070 con 0x7feca4073690 2024-04-26T23:40:49.239 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.205+0000 7fecaab12640 1 -- 172.21.15.88:0/3945319750 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feca41522e0 con 0x7feca4073690 2024-04-26T23:40:49.239 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.205+0000 7fecaab12640 1 -- 172.21.15.88:0/3945319750 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feca4157b40 con 0x7feca4073690 2024-04-26T23:40:49.239 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.207+0000 7fecaab12640 1 -- 172.21.15.88:0/3945319750 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feca40507a0 con 0x7feca4073690 2024-04-26T23:40:49.240 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.207+0000 7f292a7fc640 1 -- 172.21.15.88:0/2393666763 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f292402ad10 con 0x7f29341540f0 2024-04-26T23:40:49.240 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.207+0000 7f292a7fc640 1 --2- 172.21.15.88:0/2393666763 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f291806caf0 0x7f291806efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:49.240 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.207+0000 7f2939c1a640 1 --2- 172.21.15.88:0/2393666763 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f291806caf0 0x7f291806efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:49.240 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.208+0000 7f2939c1a640 1 --2- 172.21.15.88:0/2393666763 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f291806caf0 0x7f291806efb0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f29340aa690 tx=0x7f2930009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:49.241 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.211+0000 7feca17fa640 1 -- 172.21.15.88:0/3945319750 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec98005ce0 con 0x7feca4073690 2024-04-26T23:40:49.241 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.211+0000 7feca17fa640 1 -- 172.21.15.88:0/3945319750 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec98021060 con 0x7feca4073690 2024-04-26T23:40:49.241 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.211+0000 7fcc62ffd640 1 -- 172.21.15.88:0/237345637 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fcc68033020 con 0x7fcc740c4160 2024-04-26T23:40:49.241 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.212+0000 7f292a7fc640 1 -- 172.21.15.88:0/2393666763 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7f29240325f0 con 0x7f29341540f0 2024-04-26T23:40:49.241 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.220+0000 7f292a7fc640 1 -- 172.21.15.88:0/2393666763 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f29341f5180 con 0x7f29341540f0 2024-04-26T23:40:49.242 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.222+0000 7feca17fa640 1 -- 172.21.15.88:0/3945319750 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fec9801a070 con 0x7feca4073690 2024-04-26T23:40:49.242 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.222+0000 7feca17fa640 1 --2- 172.21.15.88:0/3945319750 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fec8806c920 0x7fec8806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:49.242 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.222+0000 7feca17fa640 1 -- 172.21.15.88:0/3945319750 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7fec9808b9c0 con 0x7feca4073690 2024-04-26T23:40:49.242 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.223+0000 7feca3fff640 1 --2- 172.21.15.88:0/3945319750 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fec8806c920 0x7fec8806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:49.242 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.224+0000 7feca3fff640 1 --2- 172.21.15.88:0/3945319750 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fec8806c920 0x7fec8806ede0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7feca4158080 tx=0x7fec90009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:49.242 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.229+0000 7feca17fa640 1 -- 172.21.15.88:0/3945319750 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fec980594e0 con 0x7feca4073690 2024-04-26T23:40:49.544 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.540+0000 7f9324722640 1 -- 172.21.15.88:0/4015413217 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f931c14e9b0 con 0x7f931c0c4c90 2024-04-26T23:40:49.545 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.541+0000 7f9312ffd640 1 -- 172.21.15.88:0/4015413217 <== mon.2 v2:172.21.15.175:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f9314047060 con 0x7f931c0c4c90 2024-04-26T23:40:49.545 INFO:teuthology.orchestra.run.smithi088.stdout:55834574858 2024-04-26T23:40:49.545 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.542+0000 7fc08affd640 1 -- 172.21.15.88:0/1633079088 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7fc0a40c3410 con 0x7fc0a40c5720 2024-04-26T23:40:49.546 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.542+0000 7fc0a17fa640 1 -- 172.21.15.88:0/1633079088 <== mon.2 v2:172.21.15.175:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fc09c07abe0 con 0x7fc0a40c5720 2024-04-26T23:40:49.546 INFO:teuthology.orchestra.run.smithi088.stdout:55834574856 2024-04-26T23:40:49.549 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.544+0000 7f9324722640 1 -- 172.21.15.88:0/4015413217 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f930006c9c0 msgr2=0x7f930006ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:49.549 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.544+0000 7f9324722640 1 --2- 172.21.15.88:0/4015413217 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f930006c9c0 0x7f930006ee80 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f931c14a650 tx=0x7f93180090e0 comp rx=0 tx=0).stop 2024-04-26T23:40:49.549 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.544+0000 7f9324722640 1 -- 172.21.15.88:0/4015413217 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f931c0c4c90 msgr2=0x7f931c074840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:49.549 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.545+0000 7f9324722640 1 --2- 172.21.15.88:0/4015413217 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f931c0c4c90 0x7f931c074840 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f9314032040 tx=0x7f9314004a40 comp rx=0 tx=0).stop 2024-04-26T23:40:49.549 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.545+0000 7f9324722640 1 -- 172.21.15.88:0/4015413217 shutdown_connections 2024-04-26T23:40:49.549 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.545+0000 7f9324722640 1 --2- 172.21.15.88:0/4015413217 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f930006c9c0 0x7f930006ee80 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:49.549 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.545+0000 7f9324722640 1 --2- 172.21.15.88:0/4015413217 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f931c0c4c90 0x7f931c074840 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:49.549 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.545+0000 7f9324722640 1 --2- 172.21.15.88:0/4015413217 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f931c150300 0x7f931c073810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:49.550 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.545+0000 7f9324722640 1 --2- 172.21.15.88:0/4015413217 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f931c0ab380 0x7f931c0a8890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:49.550 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.545+0000 7f9324722640 1 -- 172.21.15.88:0/4015413217 >> 172.21.15.88:0/4015413217 conn(0x7f931c06c310 msgr2=0x7f931c06c6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:40:49.550 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.545+0000 7f9324722640 1 -- 172.21.15.88:0/4015413217 shutdown_connections 2024-04-26T23:40:49.550 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.545+0000 7f9324722640 1 -- 172.21.15.88:0/4015413217 wait complete. 2024-04-26T23:40:49.551 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.546+0000 7fc0aaa83640 1 -- 172.21.15.88:0/1633079088 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fc09006cae0 msgr2=0x7fc09006efa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:49.551 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.546+0000 7fc0aaa83640 1 --2- 172.21.15.88:0/1633079088 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fc09006cae0 0x7fc09006efa0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fc09800a8b0 tx=0x7fc098008040 comp rx=0 tx=0).stop 2024-04-26T23:40:49.551 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.546+0000 7fc0aaa83640 1 -- 172.21.15.88:0/1633079088 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc0a40c5720 msgr2=0x7fc0a4144d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:49.551 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.546+0000 7fc0aaa83640 1 --2- 172.21.15.88:0/1633079088 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc0a40c5720 0x7fc0a4144d10 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fc09c031000 tx=0x7fc09c004a40 comp rx=0 tx=0).stop 2024-04-26T23:40:49.551 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.546+0000 7fc0aaa83640 1 -- 172.21.15.88:0/1633079088 shutdown_connections 2024-04-26T23:40:49.552 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.546+0000 7fc0aaa83640 1 --2- 172.21.15.88:0/1633079088 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fc09006cae0 0x7fc09006efa0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:49.552 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.546+0000 7fc0aaa83640 1 --2- 172.21.15.88:0/1633079088 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc0a40694b0 0x7fc0a4073fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:49.552 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.546+0000 7fc0aaa83640 1 --2- 172.21.15.88:0/1633079088 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc0a4156e50 0x7fc0a4145250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:49.552 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.546+0000 7fc0aaa83640 1 --2- 172.21.15.88:0/1633079088 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc0a40c5720 0x7fc0a4144d10 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:49.552 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.546+0000 7fc0aaa83640 1 -- 172.21.15.88:0/1633079088 >> 172.21.15.88:0/1633079088 conn(0x7fc0a40c89b0 msgr2=0x7fc0a408d7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:40:49.552 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.546+0000 7fc0aaa83640 1 -- 172.21.15.88:0/1633079088 shutdown_connections 2024-04-26T23:40:49.552 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.546+0000 7fc0aaa83640 1 -- 172.21.15.88:0/1633079088 wait complete. 2024-04-26T23:40:49.568 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.1 2024-04-26T23:40:49.568 DEBUG:teuthology.parallel:result is None 2024-04-26T23:40:49.569 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.4 2024-04-26T23:40:49.569 DEBUG:teuthology.parallel:result is None 2024-04-26T23:40:49.588 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.584+0000 7f4aeee08640 1 -- 172.21.15.88:0/1346190396 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f4ae80ae630 con 0x7f4ae80c2cd0 2024-04-26T23:40:49.588 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.585+0000 7f2fcb96a640 1 -- 172.21.15.88:0/3331628210 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f2fa4005580 con 0x7f2fc40c4e30 2024-04-26T23:40:49.588 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.585+0000 7f4ae57fa640 1 -- 172.21.15.88:0/1346190396 <== mon.1 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f4ae806ff20 con 0x7f4ae80c2cd0 2024-04-26T23:40:49.589 INFO:teuthology.orchestra.run.smithi088.stdout:55834574858 2024-04-26T23:40:49.589 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.585+0000 7f2fb9ffb640 1 -- 172.21.15.88:0/3331628210 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f2fbc07ac90 con 0x7f2fc40c4e30 2024-04-26T23:40:49.589 INFO:teuthology.orchestra.run.smithi088.stdout:55834574857 2024-04-26T23:40:49.592 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.588+0000 7f4aeee08640 1 -- 172.21.15.88:0/1346190396 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f4ac806c9c0 msgr2=0x7f4ac806ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:49.592 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.588+0000 7f2fcb96a640 1 -- 172.21.15.88:0/3331628210 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f2fa806c8f0 msgr2=0x7f2fa806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:49.592 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.588+0000 7f2fcb96a640 1 --2- 172.21.15.88:0/3331628210 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f2fa806c8f0 0x7f2fa806edb0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f2fc40c2d20 tx=0x7f2fb4009040 comp rx=0 tx=0).stop 2024-04-26T23:40:49.592 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.588+0000 7f4aeee08640 1 --2- 172.21.15.88:0/1346190396 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f4ac806c9c0 0x7f4ac806ee80 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f4ad800c5d0 tx=0x7f4ad800b040 comp rx=0 tx=0).stop 2024-04-26T23:40:49.593 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.588+0000 7f2fcb96a640 1 -- 172.21.15.88:0/3331628210 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2fc40c4e30 msgr2=0x7f2fc40be090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:49.593 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.588+0000 7f2fcb96a640 1 --2- 172.21.15.88:0/3331628210 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2fc40c4e30 0x7f2fc40be090 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f2fc40c9ab0 tx=0x7f2fbc004a40 comp rx=0 tx=0).stop 2024-04-26T23:40:49.594 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.588+0000 7f4aeee08640 1 -- 172.21.15.88:0/1346190396 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4ae80c2cd0 msgr2=0x7f4ae8146620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:49.594 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.588+0000 7f4aeee08640 1 --2- 172.21.15.88:0/1346190396 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4ae80c2cd0 0x7f4ae8146620 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f4ae80c30b0 tx=0x7f4ad000cbc0 comp rx=0 tx=0).stop 2024-04-26T23:40:49.594 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.588+0000 7f4aeee08640 1 -- 172.21.15.88:0/1346190396 shutdown_connections 2024-04-26T23:40:49.594 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.588+0000 7f4aeee08640 1 --2- 172.21.15.88:0/1346190396 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f4ac806c9c0 0x7f4ac806ee80 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:49.595 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.588+0000 7f4aeee08640 1 --2- 172.21.15.88:0/1346190396 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4ae8150200 0x7f4ae81facc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:49.595 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.588+0000 7f4aeee08640 1 --2- 172.21.15.88:0/1346190396 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4ae80c2cd0 0x7f4ae8146620 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:49.595 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.588+0000 7f4aeee08640 1 --2- 172.21.15.88:0/1346190396 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4ae80ac680 0x7f4ae81f9850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:49.595 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.588+0000 7f4aeee08640 1 -- 172.21.15.88:0/1346190396 >> 172.21.15.88:0/1346190396 conn(0x7f4ae80c82d0 msgr2=0x7f4ae80c8900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:40:49.595 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.588+0000 7f2fcb96a640 1 -- 172.21.15.88:0/3331628210 shutdown_connections 2024-04-26T23:40:49.595 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.588+0000 7f2fcb96a640 1 --2- 172.21.15.88:0/3331628210 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f2fa806c8f0 0x7f2fa806edb0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:49.596 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.588+0000 7f2fcb96a640 1 --2- 172.21.15.88:0/3331628210 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2fc4158610 0x7f2fc4073700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:49.596 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.588+0000 7f2fcb96a640 1 --2- 172.21.15.88:0/3331628210 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2fc40c4e30 0x7f2fc40be090 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:49.596 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.588+0000 7f2fcb96a640 1 --2- 172.21.15.88:0/3331628210 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2fc40c33f0 0x7f2fc414b9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:49.596 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.588+0000 7f2fcb96a640 1 -- 172.21.15.88:0/3331628210 >> 172.21.15.88:0/3331628210 conn(0x7f2fc40c89f0 msgr2=0x7f2fc40c5480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:40:49.596 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.588+0000 7f2fcb96a640 1 -- 172.21.15.88:0/3331628210 shutdown_connections 2024-04-26T23:40:49.596 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.588+0000 7f4aeee08640 1 -- 172.21.15.88:0/1346190396 shutdown_connections 2024-04-26T23:40:49.596 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.588+0000 7f2fcb96a640 1 -- 172.21.15.88:0/3331628210 wait complete. 2024-04-26T23:40:49.597 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.589+0000 7f4aeee08640 1 -- 172.21.15.88:0/1346190396 wait complete. 2024-04-26T23:40:49.604 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.5 2024-04-26T23:40:49.605 DEBUG:teuthology.parallel:result is None 2024-04-26T23:40:49.605 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.0 2024-04-26T23:40:49.605 DEBUG:teuthology.parallel:result is None 2024-04-26T23:40:49.621 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.618+0000 7f8a530f8640 1 -- 172.21.15.88:0/1360475709 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f8a4c0507a0 con 0x7f8a4c158180 2024-04-26T23:40:49.622 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.618+0000 7f8a497fa640 1 -- 172.21.15.88:0/1360475709 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f8a4005e190 con 0x7f8a4c158180 2024-04-26T23:40:49.622 INFO:teuthology.orchestra.run.smithi088.stdout:55834574857 2024-04-26T23:40:49.624 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.620+0000 7f8a530f8640 1 -- 172.21.15.88:0/1360475709 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f8a3006c9f0 msgr2=0x7f8a3006eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:49.624 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.620+0000 7f8a530f8640 1 --2- 172.21.15.88:0/1360475709 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f8a3006c9f0 0x7f8a3006eeb0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f8a38001840 tx=0x7f8a38009040 comp rx=0 tx=0).stop 2024-04-26T23:40:49.624 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.620+0000 7f8a530f8640 1 -- 172.21.15.88:0/1360475709 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8a4c158180 msgr2=0x7f8a4c1566c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:49.624 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.620+0000 7f8a530f8640 1 --2- 172.21.15.88:0/1360475709 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8a4c158180 0x7f8a4c1566c0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f8a4000e8a0 tx=0x7f8a4000ed60 comp rx=0 tx=0).stop 2024-04-26T23:40:49.624 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.620+0000 7f8a530f8640 1 -- 172.21.15.88:0/1360475709 shutdown_connections 2024-04-26T23:40:49.625 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.620+0000 7f8a530f8640 1 --2- 172.21.15.88:0/1360475709 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f8a3006c9f0 0x7f8a3006eeb0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:49.625 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.620+0000 7f8a530f8640 1 --2- 172.21.15.88:0/1360475709 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8a4c15a280 0x7f8a4c156c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:49.625 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.620+0000 7f8a530f8640 1 --2- 172.21.15.88:0/1360475709 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8a4c158180 0x7f8a4c1566c0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:49.625 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.620+0000 7f8a530f8640 1 --2- 172.21.15.88:0/1360475709 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8a4c13ffb0 0x7f8a4c157260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:49.625 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.620+0000 7f8a530f8640 1 -- 172.21.15.88:0/1360475709 >> 172.21.15.88:0/1360475709 conn(0x7f8a4c06dc10 msgr2=0x7f8a4c0cc520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:40:49.625 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.620+0000 7f8a530f8640 1 -- 172.21.15.88:0/1360475709 shutdown_connections 2024-04-26T23:40:49.625 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.620+0000 7f8a530f8640 1 -- 172.21.15.88:0/1360475709 wait complete. 2024-04-26T23:40:49.636 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.632+0000 7fcc78fe6640 1 -- 172.21.15.88:0/237345637 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fcc740c3ed0 con 0x7fcc740c4160 2024-04-26T23:40:49.636 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.633+0000 7fcc62ffd640 1 -- 172.21.15.88:0/237345637 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fcc6806b520 con 0x7fcc740c4160 2024-04-26T23:40:49.636 INFO:teuthology.orchestra.run.smithi088.stdout:55834574856 2024-04-26T23:40:49.638 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.6 2024-04-26T23:40:49.639 DEBUG:teuthology.parallel:result is None 2024-04-26T23:40:49.640 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.636+0000 7fcc78fe6640 1 -- 172.21.15.88:0/237345637 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fcc5406c9c0 msgr2=0x7fcc5406ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:49.640 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.636+0000 7fcc78fe6640 1 --2- 172.21.15.88:0/237345637 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fcc5406c9c0 0x7fcc5406ee80 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fcc74073d40 tx=0x7fcc64009190 comp rx=0 tx=0).stop 2024-04-26T23:40:49.640 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.636+0000 7fcc78fe6640 1 -- 172.21.15.88:0/237345637 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcc740c4160 msgr2=0x7fcc74144f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:49.640 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.636+0000 7fcc78fe6640 1 --2- 172.21.15.88:0/237345637 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcc740c4160 0x7fcc74144f20 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fcc6801e830 tx=0x7fcc6801ecf0 comp rx=0 tx=0).stop 2024-04-26T23:40:49.640 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.636+0000 7fcc78fe6640 1 -- 172.21.15.88:0/237345637 shutdown_connections 2024-04-26T23:40:49.640 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.636+0000 7fcc78fe6640 1 --2- 172.21.15.88:0/237345637 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fcc5406c9c0 0x7fcc5406ee80 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:49.640 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.636+0000 7fcc78fe6640 1 --2- 172.21.15.88:0/237345637 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcc741510c0 0x7fcc74145ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:49.641 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.636+0000 7fcc78fe6640 1 --2- 172.21.15.88:0/237345637 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcc740aeb80 0x7fcc74143a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:49.641 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.636+0000 7fcc78fe6640 1 --2- 172.21.15.88:0/237345637 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcc740c4160 0x7fcc74144f20 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:49.641 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.636+0000 7fcc78fe6640 1 -- 172.21.15.88:0/237345637 >> 172.21.15.88:0/237345637 conn(0x7fcc740c5ce0 msgr2=0x7fcc7406cdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:40:49.641 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.636+0000 7fcc78fe6640 1 -- 172.21.15.88:0/237345637 shutdown_connections 2024-04-26T23:40:49.641 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.636+0000 7fcc78fe6640 1 -- 172.21.15.88:0/237345637 wait complete. 2024-04-26T23:40:49.644 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.640+0000 7f293be7e640 1 -- 172.21.15.88:0/2393666763 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f29340ab990 con 0x7f29341540f0 2024-04-26T23:40:49.644 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.641+0000 7f292a7fc640 1 -- 172.21.15.88:0/2393666763 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f292404c070 con 0x7f29341540f0 2024-04-26T23:40:49.645 INFO:teuthology.orchestra.run.smithi088.stdout:55834574856 2024-04-26T23:40:49.647 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.643+0000 7f293be7e640 1 -- 172.21.15.88:0/2393666763 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f291806caf0 msgr2=0x7f291806efb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:49.647 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.643+0000 7f293be7e640 1 --2- 172.21.15.88:0/2393666763 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f291806caf0 0x7f291806efb0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f29340aa690 tx=0x7f2930009190 comp rx=0 tx=0).stop 2024-04-26T23:40:49.647 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.643+0000 7f293be7e640 1 -- 172.21.15.88:0/2393666763 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f29341540f0 msgr2=0x7f293414d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:49.647 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.643+0000 7f293be7e640 1 --2- 172.21.15.88:0/2393666763 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f29341540f0 0x7f293414d3d0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f29240097a0 tx=0x7f29240046c0 comp rx=0 tx=0).stop 2024-04-26T23:40:49.647 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.643+0000 7f293be7e640 1 -- 172.21.15.88:0/2393666763 shutdown_connections 2024-04-26T23:40:49.647 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.643+0000 7f293be7e640 1 --2- 172.21.15.88:0/2393666763 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f291806caf0 0x7f291806efb0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:49.647 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.643+0000 7f293be7e640 1 --2- 172.21.15.88:0/2393666763 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2934157680 0x7f293414d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:49.647 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.643+0000 7f293be7e640 1 --2- 172.21.15.88:0/2393666763 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f29341540f0 0x7f293414d3d0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:49.648 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.643+0000 7f293be7e640 1 --2- 172.21.15.88:0/2393666763 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f29340ac610 0x7f29340c1b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:49.648 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.643+0000 7f293be7e640 1 -- 172.21.15.88:0/2393666763 >> 172.21.15.88:0/2393666763 conn(0x7f293406c310 msgr2=0x7f2934155da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:40:49.648 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.643+0000 7f293be7e640 1 -- 172.21.15.88:0/2393666763 shutdown_connections 2024-04-26T23:40:49.648 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.643+0000 7f293be7e640 1 -- 172.21.15.88:0/2393666763 wait complete. 2024-04-26T23:40:49.650 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.646+0000 7fecaab12640 1 -- 172.21.15.88:0/3945319750 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7feca4076650 con 0x7feca4073690 2024-04-26T23:40:49.650 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.647+0000 7feca17fa640 1 -- 172.21.15.88:0/3945319750 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fec9805d7e0 con 0x7feca4073690 2024-04-26T23:40:49.651 INFO:teuthology.orchestra.run.smithi088.stdout:55834574856 2024-04-26T23:40:49.653 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.649+0000 7fecaab12640 1 -- 172.21.15.88:0/3945319750 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fec8806c920 msgr2=0x7fec8806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:49.653 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.649+0000 7fecaab12640 1 --2- 172.21.15.88:0/3945319750 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fec8806c920 0x7fec8806ede0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7feca4158080 tx=0x7fec90009190 comp rx=0 tx=0).stop 2024-04-26T23:40:49.653 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.649+0000 7fecaab12640 1 -- 172.21.15.88:0/3945319750 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feca4073690 msgr2=0x7feca41f1520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:49.653 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.649+0000 7fecaab12640 1 --2- 172.21.15.88:0/3945319750 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feca4073690 0x7feca41f1520 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fec9800c430 tx=0x7fec9800c8f0 comp rx=0 tx=0).stop 2024-04-26T23:40:49.653 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.649+0000 7fecaab12640 1 -- 172.21.15.88:0/3945319750 shutdown_connections 2024-04-26T23:40:49.653 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.649+0000 7fecaab12640 1 --2- 172.21.15.88:0/3945319750 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fec8806c920 0x7fec8806ede0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:49.653 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.649+0000 7fecaab12640 1 --2- 172.21.15.88:0/3945319750 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7feca40ac710 0x7feca414d440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:49.653 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.649+0000 7fecaab12640 1 --2- 172.21.15.88:0/3945319750 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7feca414ecd0 0x7feca4152fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:49.654 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.649+0000 7fecaab12640 1 --2- 172.21.15.88:0/3945319750 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feca4073690 0x7feca41f1520 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:49.654 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.649+0000 7fecaab12640 1 -- 172.21.15.88:0/3945319750 >> 172.21.15.88:0/3945319750 conn(0x7feca40c6d80 msgr2=0x7feca406fd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:40:49.654 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.649+0000 7fecaab12640 1 -- 172.21.15.88:0/3945319750 shutdown_connections 2024-04-26T23:40:49.654 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.649+0000 7fecaab12640 1 -- 172.21.15.88:0/3945319750 wait complete. 2024-04-26T23:40:49.655 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.3 2024-04-26T23:40:49.655 DEBUG:teuthology.parallel:result is None 2024-04-26T23:40:49.658 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.7 2024-04-26T23:40:49.658 DEBUG:teuthology.parallel:result is None 2024-04-26T23:40:49.664 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.2 2024-04-26T23:40:49.664 DEBUG:teuthology.parallel:result is None 2024-04-26T23:40:49.664 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-26T23:40:49.664 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T23:40:49.801 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.797+0000 7fe5ce0f1640 1 Processor -- start 2024-04-26T23:40:49.801 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.797+0000 7fe5ce0f1640 1 -- start start 2024-04-26T23:40:49.805 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.798+0000 7fe5ce0f1640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fe5c81570d0 0x7fe5c8150a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:49.805 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.798+0000 7fe5ce0f1640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe5c8150f90 0x7fe5c81574b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:49.805 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.798+0000 7fe5ce0f1640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe5c80c3810 con 0x7fe5c80ab3f0 2024-04-26T23:40:49.805 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.798+0000 7fe5ce0f1640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7fe5c80c4330 con 0x7fe5c81570d0 2024-04-26T23:40:49.806 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.798+0000 7fe5ce0f1640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fe5c80c3ab0 con 0x7fe5c8150f90 2024-04-26T23:40:49.806 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.798+0000 7fe5c6ffd640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fe5c80ab3f0 0x7fe5c80c4d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:58052/0 (socket says 172.21.15.88:58052) 2024-04-26T23:40:49.806 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.798+0000 7fe5c6ffd640 1 -- 172.21.15.88:0/1570160085 learned_addr learned my addr 172.21.15.88:0/1570160085 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-26T23:40:49.806 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.798+0000 7fe5c67fc640 1 -- 172.21.15.88:0/1570160085 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3365122208 0 0) 0x7fe5c80c3810 con 0x7fe5c80ab3f0 2024-04-26T23:40:49.806 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.798+0000 7fe5c7fff640 1 --2- 172.21.15.88:0/1570160085 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe5c8150f90 0x7fe5c81574b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:49.806 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.798+0000 7fe5c77fe640 1 --2- 172.21.15.88:0/1570160085 >> v2:172.21.15.175:3300/0 conn(0x7fe5c81570d0 0x7fe5c8150a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:49.806 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.798+0000 7fe5c67fc640 1 -- 172.21.15.88:0/1570160085 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe5b0003520 con 0x7fe5c80ab3f0 2024-04-26T23:40:49.806 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.798+0000 7fe5c67fc640 1 -- 172.21.15.88:0/1570160085 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3612482031 0 0) 0x7fe5b0003520 con 0x7fe5c80ab3f0 2024-04-26T23:40:49.806 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.798+0000 7fe5c67fc640 1 -- 172.21.15.88:0/1570160085 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe5c8150f90 msgr2=0x7fe5c81574b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:40:49.806 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.798+0000 7fe5c67fc640 1 --2- 172.21.15.88:0/1570160085 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe5c8150f90 0x7fe5c81574b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:49.806 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.798+0000 7fe5c67fc640 1 -- 172.21.15.88:0/1570160085 >> v2:172.21.15.175:3300/0 conn(0x7fe5c81570d0 msgr2=0x7fe5c8150a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:40:49.806 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.798+0000 7fe5c67fc640 1 --2- 172.21.15.88:0/1570160085 >> v2:172.21.15.175:3300/0 conn(0x7fe5c81570d0 0x7fe5c8150a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:49.806 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.798+0000 7fe5c67fc640 1 -- 172.21.15.88:0/1570160085 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5c80c4580 con 0x7fe5c80ab3f0 2024-04-26T23:40:49.806 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.798+0000 7fe5c67fc640 1 -- 172.21.15.88:0/1570160085 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 356324787 0 0) 0x7fe5bc001670 con 0x7fe5c80ab3f0 2024-04-26T23:40:49.807 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.799+0000 7fe5c67fc640 1 -- 172.21.15.88:0/1570160085 >> v1:172.21.15.88:6789/0 conn(0x7fe5c80ab3f0 legacy=0x7fe5c80c4d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:49.807 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.799+0000 7fe5c67fc640 1 --2- 172.21.15.88:0/1570160085 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe5b00039b0 0x7fe5b0003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:49.807 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.799+0000 7fe5c67fc640 1 --2- 172.21.15.88:0/1570160085 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe5c8150f90 0x7fe5b0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:49.807 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.799+0000 7fe5c67fc640 1 --2- 172.21.15.88:0/1570160085 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe5b0004d40 0x7fe5b00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:49.807 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.799+0000 7fe5c67fc640 1 -- 172.21.15.88:0/1570160085 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fe5c80c4330 con 0x7fe5b00039b0 2024-04-26T23:40:49.807 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.799+0000 7fe5c67fc640 1 -- 172.21.15.88:0/1570160085 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fe5c80c3ab0 con 0x7fe5b0004d40 2024-04-26T23:40:49.807 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.799+0000 7fe5c67fc640 1 -- 172.21.15.88:0/1570160085 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fe5b000ba70 con 0x7fe5c8150f90 2024-04-26T23:40:49.807 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.799+0000 7fe5c77fe640 1 --2- 172.21.15.88:0/1570160085 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe5b00039b0 0x7fe5b0003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:49.807 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.799+0000 7fe5c6ffd640 1 --2- 172.21.15.88:0/1570160085 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe5c8150f90 0x7fe5b0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:49.807 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.799+0000 7fe5c7fff640 1 --2- 172.21.15.88:0/1570160085 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe5b0004d40 0x7fe5b00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:49.807 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.799+0000 7fe5c77fe640 1 -- 172.21.15.88:0/1570160085 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe5c8150f90 msgr2=0x7fe5b0004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:40:49.807 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.799+0000 7fe5c77fe640 1 --2- 172.21.15.88:0/1570160085 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe5c8150f90 0x7fe5b0004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:49.807 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.799+0000 7fe5c77fe640 1 -- 172.21.15.88:0/1570160085 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe5b0004d40 msgr2=0x7fe5b00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:40:49.807 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.799+0000 7fe5c77fe640 1 --2- 172.21.15.88:0/1570160085 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe5b0004d40 0x7fe5b00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:49.808 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.799+0000 7fe5c77fe640 1 -- 172.21.15.88:0/1570160085 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5b0003520 con 0x7fe5b00039b0 2024-04-26T23:40:49.808 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.800+0000 7fe5c77fe640 1 --2- 172.21.15.88:0/1570160085 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe5b00039b0 0x7fe5b0003df0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fe5b8009a90 tx=0x7fe5b0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f596403ce05196ae server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:49.808 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.800+0000 7fe5c67fc640 1 -- 172.21.15.88:0/1570160085 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5b8036070 con 0x7fe5b00039b0 2024-04-26T23:40:49.808 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.800+0000 7fe5c67fc640 1 -- 172.21.15.88:0/1570160085 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe5b8031400 con 0x7fe5b00039b0 2024-04-26T23:40:49.808 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.800+0000 7fe5c67fc640 1 -- 172.21.15.88:0/1570160085 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5b8009690 con 0x7fe5b00039b0 2024-04-26T23:40:49.808 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.800+0000 7fe5ce0f1640 1 -- 172.21.15.88:0/1570160085 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe5b00039b0 msgr2=0x7fe5b0003df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:49.808 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.800+0000 7fe5ce0f1640 1 --2- 172.21.15.88:0/1570160085 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe5b00039b0 0x7fe5b0003df0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fe5b8009a90 tx=0x7fe5b0005830 comp rx=0 tx=0).stop 2024-04-26T23:40:49.808 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.800+0000 7fe5c7fff640 1 -- 172.21.15.88:0/1570160085 reap_dead start 2024-04-26T23:40:49.808 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.800+0000 7fe5ce0f1640 1 -- 172.21.15.88:0/1570160085 shutdown_connections 2024-04-26T23:40:49.808 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.800+0000 7fe5ce0f1640 1 -- 172.21.15.88:0/1570160085 >> 172.21.15.88:0/1570160085 conn(0x7fe5c806c310 msgr2=0x7fe5c806c6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:40:49.808 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.800+0000 7fe5ce0f1640 1 -- 172.21.15.88:0/1570160085 shutdown_connections 2024-04-26T23:40:49.808 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.800+0000 7fe5ce0f1640 1 -- 172.21.15.88:0/1570160085 wait complete. 2024-04-26T23:40:49.808 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.801+0000 7fe5ce0f1640 1 Processor -- start 2024-04-26T23:40:49.808 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.801+0000 7fe5ce0f1640 1 -- start start 2024-04-26T23:40:49.811 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.802+0000 7fe5ce0f1640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe5b00039b0 0x7fe5c814fe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:49.811 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.802+0000 7fe5ce0f1640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe5c8074ae0 0x7fe5c81edb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:49.811 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.802+0000 7fe5ce0f1640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe5c81ee070 0x7fe5c80c6f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:49.811 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.802+0000 7fe5ce0f1640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fe5c80abbe0 con 0x7fe5b00039b0 2024-04-26T23:40:49.811 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.802+0000 7fe5ce0f1640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fe5c80aba60 con 0x7fe5c81ee070 2024-04-26T23:40:49.811 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.802+0000 7fe5ce0f1640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fe5c80c5490 con 0x7fe5c8074ae0 2024-04-26T23:40:49.811 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.802+0000 7fe5c77fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe5b00039b0 0x7fe5c814fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:49.811 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.802+0000 7fe5c77fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe5b00039b0 0x7fe5c814fe70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:41650/0 (socket says 172.21.15.88:41650) 2024-04-26T23:40:49.811 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.802+0000 7fe5c77fe640 1 -- 172.21.15.88:0/690556619 learned_addr learned my addr 172.21.15.88:0/690556619 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:40:49.811 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.802+0000 7fe5c6ffd640 1 --2- 172.21.15.88:0/690556619 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe5c8074ae0 0x7fe5c81edb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:49.811 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.802+0000 7fe5c7fff640 1 --2- 172.21.15.88:0/690556619 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe5c81ee070 0x7fe5c80c6f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:49.812 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.802+0000 7fe5c77fe640 1 -- 172.21.15.88:0/690556619 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe5c8074ae0 msgr2=0x7fe5c81edb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:49.812 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.802+0000 7fe5c77fe640 1 --2- 172.21.15.88:0/690556619 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe5c8074ae0 0x7fe5c81edb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:49.812 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.802+0000 7fe5c77fe640 1 -- 172.21.15.88:0/690556619 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe5c81ee070 msgr2=0x7fe5c80c6f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:49.812 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.802+0000 7fe5c77fe640 1 --2- 172.21.15.88:0/690556619 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe5c81ee070 0x7fe5c80c6f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:49.812 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.802+0000 7fe5c77fe640 1 -- 172.21.15.88:0/690556619 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5c8072b20 con 0x7fe5b00039b0 2024-04-26T23:40:49.812 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.803+0000 7fe5c77fe640 1 --2- 172.21.15.88:0/690556619 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe5b00039b0 0x7fe5c814fe70 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fe5b8034040 tx=0x7fe5b8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:49.812 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.803+0000 7fe5affff640 1 -- 172.21.15.88:0/690556619 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5b8040020 con 0x7fe5b00039b0 2024-04-26T23:40:49.812 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.803+0000 7fe5affff640 1 -- 172.21.15.88:0/690556619 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe5b8003b40 con 0x7fe5b00039b0 2024-04-26T23:40:49.812 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.803+0000 7fe5ce0f1640 1 -- 172.21.15.88:0/690556619 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5c8151ac0 con 0x7fe5b00039b0 2024-04-26T23:40:49.812 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.803+0000 7fe5affff640 1 -- 172.21.15.88:0/690556619 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5b8036040 con 0x7fe5b00039b0 2024-04-26T23:40:49.812 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.803+0000 7fe5ce0f1640 1 -- 172.21.15.88:0/690556619 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5c81503b0 con 0x7fe5b00039b0 2024-04-26T23:40:49.812 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.804+0000 7fe5ce0f1640 1 -- 172.21.15.88:0/690556619 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe5c8071c70 con 0x7fe5b00039b0 2024-04-26T23:40:49.812 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.804+0000 7fe5affff640 1 -- 172.21.15.88:0/690556619 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe5b8043020 con 0x7fe5b00039b0 2024-04-26T23:40:49.812 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.805+0000 7fe5affff640 1 --2- 172.21.15.88:0/690556619 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fe5b406c920 0x7fe5b406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:49.813 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.805+0000 7fe5affff640 1 -- 172.21.15.88:0/690556619 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7fe5b80abf30 con 0x7fe5b00039b0 2024-04-26T23:40:49.813 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.805+0000 7fe5c6ffd640 1 --2- 172.21.15.88:0/690556619 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fe5b406c920 0x7fe5b406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:49.813 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.805+0000 7fe5c6ffd640 1 --2- 172.21.15.88:0/690556619 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fe5b406c920 0x7fe5b406ede0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fe5c8074ec0 tx=0x7fe5bc000f50 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:49.813 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.809+0000 7fe5affff640 1 -- 172.21.15.88:0/690556619 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fe5c8071c70 con 0x7fe5b00039b0 2024-04-26T23:40:49.987 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.983+0000 7fe5ce0f1640 1 -- 172.21.15.88:0/690556619 --> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe5c8072d20 con 0x7fe5b406c920 2024-04-26T23:40:49.997 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.993+0000 7fe5affff640 1 -- 172.21.15.88:0/690556619 <== mgr.4104 v2:172.21.15.88:6832/651674297 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+490305 (secure 0 0 0) 0x7fe5c8072d20 con 0x7fe5b406c920 2024-04-26T23:40:50.002 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-26T23:40:50.006 INFO:teuthology.orchestra.run.smithi088.stderr:dumped all 2024-04-26T23:40:50.008 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.998+0000 7fe5ce0f1640 1 -- 172.21.15.88:0/690556619 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fe5b406c920 msgr2=0x7fe5b406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:50.008 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.998+0000 7fe5ce0f1640 1 --2- 172.21.15.88:0/690556619 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fe5b406c920 0x7fe5b406ede0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fe5c8074ec0 tx=0x7fe5bc000f50 comp rx=0 tx=0).stop 2024-04-26T23:40:50.008 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.998+0000 7fe5ce0f1640 1 -- 172.21.15.88:0/690556619 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe5b00039b0 msgr2=0x7fe5c814fe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:50.008 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.998+0000 7fe5ce0f1640 1 --2- 172.21.15.88:0/690556619 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe5b00039b0 0x7fe5c814fe70 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fe5b8034040 tx=0x7fe5b8004730 comp rx=0 tx=0).stop 2024-04-26T23:40:50.008 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.998+0000 7fe5ce0f1640 1 -- 172.21.15.88:0/690556619 shutdown_connections 2024-04-26T23:40:50.008 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.998+0000 7fe5ce0f1640 1 --2- 172.21.15.88:0/690556619 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fe5b406c920 0x7fe5b406ede0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:50.008 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.998+0000 7fe5ce0f1640 1 --2- 172.21.15.88:0/690556619 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe5c8074ae0 0x7fe5c81edb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:50.008 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.998+0000 7fe5ce0f1640 1 --2- 172.21.15.88:0/690556619 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe5c81ee070 0x7fe5c80c6f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:50.008 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.998+0000 7fe5ce0f1640 1 --2- 172.21.15.88:0/690556619 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe5b00039b0 0x7fe5c814fe70 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:50.008 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.998+0000 7fe5ce0f1640 1 -- 172.21.15.88:0/690556619 >> 172.21.15.88:0/690556619 conn(0x7fe5c806c310 msgr2=0x7fe5c80c2bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:40:50.008 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.998+0000 7fe5ce0f1640 1 -- 172.21.15.88:0/690556619 shutdown_connections 2024-04-26T23:40:50.008 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:49.998+0000 7fe5ce0f1640 1 -- 172.21.15.88:0/690556619 wait complete. 2024-04-26T23:40:50.012 INFO:teuthology.orchestra.run.smithi088.stdout:{"pg_ready":true,"pg_map":{"version":33,"stamp":"2024-04-26T23:40:49.925860+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595188,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":249,"num_write_kb":2444,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":195,"ondisk_log_size":195,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":386,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219460,"kb_used_data":3272,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755260,"statfs":{"total":773094113280,"available":772869386240,"internally_reserved":0,"allocated":3350528,"data_stored":1984464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.266454"},"pg_stats":[{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636272+0000","last_change":"2024-04-26T23:40:41.683801+0000","last_active":"2024-04-26T23:40:43.636272+0000","last_peered":"2024-04-26T23:40:43.636272+0000","last_clean":"2024-04-26T23:40:43.636272+0000","last_became_active":"2024-04-26T23:40:41.683484+0000","last_became_peered":"2024-04-26T23:40:41.683484+0000","last_unstale":"2024-04-26T23:40:43.636272+0000","last_undegraded":"2024-04-26T23:40:43.636272+0000","last_fullsized":"2024-04-26T23:40:43.636272+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:02:27.160408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":26,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.686904+0000","last_change":"2024-04-26T23:40:31.576688+0000","last_active":"2024-04-26T23:40:42.686904+0000","last_peered":"2024-04-26T23:40:42.686904+0000","last_clean":"2024-04-26T23:40:42.686904+0000","last_became_active":"2024-04-26T23:40:31.576429+0000","last_became_peered":"2024-04-26T23:40:31.576429+0000","last_unstale":"2024-04-26T23:40:42.686904+0000","last_undegraded":"2024-04-26T23:40:42.686904+0000","last_fullsized":"2024-04-26T23:40:42.686904+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:47:42.681376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.637858+0000","last_change":"2024-04-26T23:40:32.578489+0000","last_active":"2024-04-26T23:40:43.637858+0000","last_peered":"2024-04-26T23:40:43.637858+0000","last_clean":"2024-04-26T23:40:43.637858+0000","last_became_active":"2024-04-26T23:40:32.578205+0000","last_became_peered":"2024-04-26T23:40:32.578205+0000","last_unstale":"2024-04-26T23:40:43.637858+0000","last_undegraded":"2024-04-26T23:40:43.637858+0000","last_fullsized":"2024-04-26T23:40:43.637858+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:56:04.309611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636964+0000","last_change":"2024-04-26T23:40:40.666861+0000","last_active":"2024-04-26T23:40:43.636964+0000","last_peered":"2024-04-26T23:40:43.636964+0000","last_clean":"2024-04-26T23:40:43.636964+0000","last_became_active":"2024-04-26T23:40:40.666547+0000","last_became_peered":"2024-04-26T23:40:40.666547+0000","last_unstale":"2024-04-26T23:40:43.636964+0000","last_undegraded":"2024-04-26T23:40:43.636964+0000","last_fullsized":"2024-04-26T23:40:43.636964+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:27:47.818055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.635388+0000","last_change":"2024-04-26T23:40:41.689530+0000","last_active":"2024-04-26T23:40:43.635388+0000","last_peered":"2024-04-26T23:40:43.635388+0000","last_clean":"2024-04-26T23:40:43.635388+0000","last_became_active":"2024-04-26T23:40:41.687652+0000","last_became_peered":"2024-04-26T23:40:41.687652+0000","last_unstale":"2024-04-26T23:40:43.635388+0000","last_undegraded":"2024-04-26T23:40:43.635388+0000","last_fullsized":"2024-04-26T23:40:43.635388+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:58:45.972045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.637959+0000","last_change":"2024-04-26T23:40:31.576867+0000","last_active":"2024-04-26T23:40:43.637959+0000","last_peered":"2024-04-26T23:40:43.637959+0000","last_clean":"2024-04-26T23:40:43.637959+0000","last_became_active":"2024-04-26T23:40:31.576342+0000","last_became_peered":"2024-04-26T23:40:31.576342+0000","last_unstale":"2024-04-26T23:40:43.637959+0000","last_undegraded":"2024-04-26T23:40:43.637959+0000","last_fullsized":"2024-04-26T23:40:43.637959+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:35:54.439397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.686802+0000","last_change":"2024-04-26T23:40:32.589769+0000","last_active":"2024-04-26T23:40:42.686802+0000","last_peered":"2024-04-26T23:40:42.686802+0000","last_clean":"2024-04-26T23:40:42.686802+0000","last_became_active":"2024-04-26T23:40:32.589489+0000","last_became_peered":"2024-04-26T23:40:32.589489+0000","last_unstale":"2024-04-26T23:40:42.686802+0000","last_undegraded":"2024-04-26T23:40:42.686802+0000","last_fullsized":"2024-04-26T23:40:42.686802+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:40:17.167353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636746+0000","last_change":"2024-04-26T23:40:40.672310+0000","last_active":"2024-04-26T23:40:43.636746+0000","last_peered":"2024-04-26T23:40:43.636746+0000","last_clean":"2024-04-26T23:40:43.636746+0000","last_became_active":"2024-04-26T23:40:40.672018+0000","last_became_peered":"2024-04-26T23:40:40.672018+0000","last_unstale":"2024-04-26T23:40:43.636746+0000","last_undegraded":"2024-04-26T23:40:43.636746+0000","last_fullsized":"2024-04-26T23:40:43.636746+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:01:10.835670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636004+0000","last_change":"2024-04-26T23:40:41.686743+0000","last_active":"2024-04-26T23:40:43.636004+0000","last_peered":"2024-04-26T23:40:43.636004+0000","last_clean":"2024-04-26T23:40:43.636004+0000","last_became_active":"2024-04-26T23:40:41.686419+0000","last_became_peered":"2024-04-26T23:40:41.686419+0000","last_unstale":"2024-04-26T23:40:43.636004+0000","last_undegraded":"2024-04-26T23:40:43.636004+0000","last_fullsized":"2024-04-26T23:40:43.636004+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:08:35.027584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.637221+0000","last_change":"2024-04-26T23:40:31.578735+0000","last_active":"2024-04-26T23:40:43.637221+0000","last_peered":"2024-04-26T23:40:43.637221+0000","last_clean":"2024-04-26T23:40:43.637221+0000","last_became_active":"2024-04-26T23:40:31.578438+0000","last_became_peered":"2024-04-26T23:40:31.578438+0000","last_unstale":"2024-04-26T23:40:43.637221+0000","last_undegraded":"2024-04-26T23:40:43.637221+0000","last_fullsized":"2024-04-26T23:40:43.637221+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:30:10.397569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.685239+0000","last_change":"2024-04-26T23:40:32.590624+0000","last_active":"2024-04-26T23:40:42.685239+0000","last_peered":"2024-04-26T23:40:42.685239+0000","last_clean":"2024-04-26T23:40:42.685239+0000","last_became_active":"2024-04-26T23:40:32.589687+0000","last_became_peered":"2024-04-26T23:40:32.589687+0000","last_unstale":"2024-04-26T23:40:42.685239+0000","last_undegraded":"2024-04-26T23:40:42.685239+0000","last_fullsized":"2024-04-26T23:40:42.685239+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:01:02.741964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"23'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.637058+0000","last_change":"2024-04-26T23:40:40.677899+0000","last_active":"2024-04-26T23:40:43.637058+0000","last_peered":"2024-04-26T23:40:43.637058+0000","last_clean":"2024-04-26T23:40:43.637058+0000","last_became_active":"2024-04-26T23:40:40.677388+0000","last_became_peered":"2024-04-26T23:40:40.677388+0000","last_unstale":"2024-04-26T23:40:43.637058+0000","last_undegraded":"2024-04-26T23:40:43.637058+0000","last_fullsized":"2024-04-26T23:40:43.637058+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:52:34.793496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.684740+0000","last_change":"2024-04-26T23:40:41.680097+0000","last_active":"2024-04-26T23:40:42.684740+0000","last_peered":"2024-04-26T23:40:42.684740+0000","last_clean":"2024-04-26T23:40:42.684740+0000","last_became_active":"2024-04-26T23:40:41.679815+0000","last_became_peered":"2024-04-26T23:40:41.679815+0000","last_unstale":"2024-04-26T23:40:42.684740+0000","last_undegraded":"2024-04-26T23:40:42.684740+0000","last_fullsized":"2024-04-26T23:40:42.684740+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:10:30.972726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636837+0000","last_change":"2024-04-26T23:40:31.573648+0000","last_active":"2024-04-26T23:40:43.636837+0000","last_peered":"2024-04-26T23:40:43.636837+0000","last_clean":"2024-04-26T23:40:43.636837+0000","last_became_active":"2024-04-26T23:40:31.573347+0000","last_became_peered":"2024-04-26T23:40:31.573347+0000","last_unstale":"2024-04-26T23:40:43.636837+0000","last_undegraded":"2024-04-26T23:40:43.636837+0000","last_fullsized":"2024-04-26T23:40:43.636837+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:20:28.103413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.685588+0000","last_change":"2024-04-26T23:40:32.588309+0000","last_active":"2024-04-26T23:40:42.685588+0000","last_peered":"2024-04-26T23:40:42.685588+0000","last_clean":"2024-04-26T23:40:42.685588+0000","last_became_active":"2024-04-26T23:40:32.588007+0000","last_became_peered":"2024-04-26T23:40:32.588007+0000","last_unstale":"2024-04-26T23:40:42.685588+0000","last_undegraded":"2024-04-26T23:40:42.685588+0000","last_fullsized":"2024-04-26T23:40:42.685588+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:52:26.699790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"23'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636105+0000","last_change":"2024-04-26T23:40:40.678547+0000","last_active":"2024-04-26T23:40:43.636105+0000","last_peered":"2024-04-26T23:40:43.636105+0000","last_clean":"2024-04-26T23:40:43.636105+0000","last_became_active":"2024-04-26T23:40:40.677668+0000","last_became_peered":"2024-04-26T23:40:40.677668+0000","last_unstale":"2024-04-26T23:40:43.636105+0000","last_undegraded":"2024-04-26T23:40:43.636105+0000","last_fullsized":"2024-04-26T23:40:43.636105+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:34:22.905623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636105+0000","last_change":"2024-04-26T23:40:41.689525+0000","last_active":"2024-04-26T23:40:43.636105+0000","last_peered":"2024-04-26T23:40:43.636105+0000","last_clean":"2024-04-26T23:40:43.636105+0000","last_became_active":"2024-04-26T23:40:41.687433+0000","last_became_peered":"2024-04-26T23:40:41.687433+0000","last_unstale":"2024-04-26T23:40:43.636105+0000","last_undegraded":"2024-04-26T23:40:43.636105+0000","last_fullsized":"2024-04-26T23:40:43.636105+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:38:42.155257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.684004+0000","last_change":"2024-04-26T23:40:32.590053+0000","last_active":"2024-04-26T23:40:42.684004+0000","last_peered":"2024-04-26T23:40:42.684004+0000","last_clean":"2024-04-26T23:40:42.684004+0000","last_became_active":"2024-04-26T23:40:32.589802+0000","last_became_peered":"2024-04-26T23:40:32.589802+0000","last_unstale":"2024-04-26T23:40:42.684004+0000","last_undegraded":"2024-04-26T23:40:42.684004+0000","last_fullsized":"2024-04-26T23:40:42.684004+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:16:46.547536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636775+0000","last_change":"2024-04-26T23:40:31.578524+0000","last_active":"2024-04-26T23:40:43.636775+0000","last_peered":"2024-04-26T23:40:43.636775+0000","last_clean":"2024-04-26T23:40:43.636775+0000","last_became_active":"2024-04-26T23:40:31.578230+0000","last_became_peered":"2024-04-26T23:40:31.578230+0000","last_unstale":"2024-04-26T23:40:43.636775+0000","last_undegraded":"2024-04-26T23:40:43.636775+0000","last_fullsized":"2024-04-26T23:40:43.636775+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:15:51.937774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"23'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636197+0000","last_change":"2024-04-26T23:40:40.676459+0000","last_active":"2024-04-26T23:40:43.636197+0000","last_peered":"2024-04-26T23:40:43.636197+0000","last_clean":"2024-04-26T23:40:43.636197+0000","last_became_active":"2024-04-26T23:40:40.675997+0000","last_became_peered":"2024-04-26T23:40:40.675997+0000","last_unstale":"2024-04-26T23:40:43.636197+0000","last_undegraded":"2024-04-26T23:40:43.636197+0000","last_fullsized":"2024-04-26T23:40:43.636197+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:37:38.455501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.635973+0000","last_change":"2024-04-26T23:40:41.679334+0000","last_active":"2024-04-26T23:40:43.635973+0000","last_peered":"2024-04-26T23:40:43.635973+0000","last_clean":"2024-04-26T23:40:43.635973+0000","last_became_active":"2024-04-26T23:40:41.679098+0000","last_became_peered":"2024-04-26T23:40:41.679098+0000","last_unstale":"2024-04-26T23:40:43.635973+0000","last_undegraded":"2024-04-26T23:40:43.635973+0000","last_fullsized":"2024-04-26T23:40:43.635973+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:52:35.798951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.637449+0000","last_change":"2024-04-26T23:40:32.585827+0000","last_active":"2024-04-26T23:40:43.637449+0000","last_peered":"2024-04-26T23:40:43.637449+0000","last_clean":"2024-04-26T23:40:43.637449+0000","last_became_active":"2024-04-26T23:40:32.585522+0000","last_became_peered":"2024-04-26T23:40:32.585522+0000","last_unstale":"2024-04-26T23:40:43.637449+0000","last_undegraded":"2024-04-26T23:40:43.637449+0000","last_fullsized":"2024-04-26T23:40:43.637449+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:40:17.167353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.635887+0000","last_change":"2024-04-26T23:40:31.575121+0000","last_active":"2024-04-26T23:40:43.635887+0000","last_peered":"2024-04-26T23:40:43.635887+0000","last_clean":"2024-04-26T23:40:43.635887+0000","last_became_active":"2024-04-26T23:40:31.574827+0000","last_became_peered":"2024-04-26T23:40:31.574827+0000","last_unstale":"2024-04-26T23:40:43.635887+0000","last_undegraded":"2024-04-26T23:40:43.635887+0000","last_fullsized":"2024-04-26T23:40:43.635887+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:43:13.740214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636996+0000","last_change":"2024-04-26T23:40:40.678613+0000","last_active":"2024-04-26T23:40:43.636996+0000","last_peered":"2024-04-26T23:40:43.636996+0000","last_clean":"2024-04-26T23:40:43.636996+0000","last_became_active":"2024-04-26T23:40:40.677867+0000","last_became_peered":"2024-04-26T23:40:40.677867+0000","last_unstale":"2024-04-26T23:40:43.636996+0000","last_undegraded":"2024-04-26T23:40:43.636996+0000","last_fullsized":"2024-04-26T23:40:43.636996+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:35:16.288571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636503+0000","last_change":"2024-04-26T23:40:41.685042+0000","last_active":"2024-04-26T23:40:43.636503+0000","last_peered":"2024-04-26T23:40:43.636503+0000","last_clean":"2024-04-26T23:40:43.636503+0000","last_became_active":"2024-04-26T23:40:41.684699+0000","last_became_peered":"2024-04-26T23:40:41.684699+0000","last_unstale":"2024-04-26T23:40:43.636503+0000","last_undegraded":"2024-04-26T23:40:43.636503+0000","last_fullsized":"2024-04-26T23:40:43.636503+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:10:57.826183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636873+0000","last_change":"2024-04-26T23:40:32.582721+0000","last_active":"2024-04-26T23:40:43.636873+0000","last_peered":"2024-04-26T23:40:43.636873+0000","last_clean":"2024-04-26T23:40:43.636873+0000","last_became_active":"2024-04-26T23:40:32.582438+0000","last_became_peered":"2024-04-26T23:40:32.582438+0000","last_unstale":"2024-04-26T23:40:43.636873+0000","last_undegraded":"2024-04-26T23:40:43.636873+0000","last_fullsized":"2024-04-26T23:40:43.636873+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:38:10.884592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.635560+0000","last_change":"2024-04-26T23:40:31.575508+0000","last_active":"2024-04-26T23:40:43.635560+0000","last_peered":"2024-04-26T23:40:43.635560+0000","last_clean":"2024-04-26T23:40:43.635560+0000","last_became_active":"2024-04-26T23:40:31.575242+0000","last_became_peered":"2024-04-26T23:40:31.575242+0000","last_unstale":"2024-04-26T23:40:43.635560+0000","last_undegraded":"2024-04-26T23:40:43.635560+0000","last_fullsized":"2024-04-26T23:40:43.635560+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:48:32.015654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"23'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636104+0000","last_change":"2024-04-26T23:40:40.679196+0000","last_active":"2024-04-26T23:40:43.636104+0000","last_peered":"2024-04-26T23:40:43.636104+0000","last_clean":"2024-04-26T23:40:43.636104+0000","last_became_active":"2024-04-26T23:40:40.678740+0000","last_became_peered":"2024-04-26T23:40:40.678740+0000","last_unstale":"2024-04-26T23:40:43.636104+0000","last_undegraded":"2024-04-26T23:40:43.636104+0000","last_fullsized":"2024-04-26T23:40:43.636104+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:40:14.479631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.685673+0000","last_change":"2024-04-26T23:40:41.686638+0000","last_active":"2024-04-26T23:40:42.685673+0000","last_peered":"2024-04-26T23:40:42.685673+0000","last_clean":"2024-04-26T23:40:42.685673+0000","last_became_active":"2024-04-26T23:40:41.686354+0000","last_became_peered":"2024-04-26T23:40:41.686354+0000","last_unstale":"2024-04-26T23:40:42.685673+0000","last_undegraded":"2024-04-26T23:40:42.685673+0000","last_fullsized":"2024-04-26T23:40:42.685673+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:06:12.755431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.637002+0000","last_change":"2024-04-26T23:40:32.583019+0000","last_active":"2024-04-26T23:40:43.637002+0000","last_peered":"2024-04-26T23:40:43.637002+0000","last_clean":"2024-04-26T23:40:43.637002+0000","last_became_active":"2024-04-26T23:40:32.582719+0000","last_became_peered":"2024-04-26T23:40:32.582719+0000","last_unstale":"2024-04-26T23:40:43.637002+0000","last_undegraded":"2024-04-26T23:40:43.637002+0000","last_fullsized":"2024-04-26T23:40:43.637002+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:25:02.319783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.635607+0000","last_change":"2024-04-26T23:40:31.576866+0000","last_active":"2024-04-26T23:40:43.635607+0000","last_peered":"2024-04-26T23:40:43.635607+0000","last_clean":"2024-04-26T23:40:43.635607+0000","last_became_active":"2024-04-26T23:40:31.576419+0000","last_became_peered":"2024-04-26T23:40:31.576419+0000","last_unstale":"2024-04-26T23:40:43.635607+0000","last_undegraded":"2024-04-26T23:40:43.635607+0000","last_fullsized":"2024-04-26T23:40:43.635607+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:45:49.295198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"23'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636623+0000","last_change":"2024-04-26T23:40:40.675262+0000","last_active":"2024-04-26T23:40:43.636623+0000","last_peered":"2024-04-26T23:40:43.636623+0000","last_clean":"2024-04-26T23:40:43.636623+0000","last_became_active":"2024-04-26T23:40:40.674721+0000","last_became_peered":"2024-04-26T23:40:40.674721+0000","last_unstale":"2024-04-26T23:40:43.636623+0000","last_undegraded":"2024-04-26T23:40:43.636623+0000","last_fullsized":"2024-04-26T23:40:43.636623+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:56:12.403317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.635271+0000","last_change":"2024-04-26T23:40:41.691494+0000","last_active":"2024-04-26T23:40:43.635271+0000","last_peered":"2024-04-26T23:40:43.635271+0000","last_clean":"2024-04-26T23:40:43.635271+0000","last_became_active":"2024-04-26T23:40:41.691241+0000","last_became_peered":"2024-04-26T23:40:41.691241+0000","last_unstale":"2024-04-26T23:40:43.635271+0000","last_undegraded":"2024-04-26T23:40:43.635271+0000","last_fullsized":"2024-04-26T23:40:43.635271+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:08:35.027584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.687075+0000","last_change":"2024-04-26T23:40:32.584988+0000","last_active":"2024-04-26T23:40:42.687075+0000","last_peered":"2024-04-26T23:40:42.687075+0000","last_clean":"2024-04-26T23:40:42.687075+0000","last_became_active":"2024-04-26T23:40:32.584467+0000","last_became_peered":"2024-04-26T23:40:32.584467+0000","last_unstale":"2024-04-26T23:40:42.687075+0000","last_undegraded":"2024-04-26T23:40:42.687075+0000","last_fullsized":"2024-04-26T23:40:42.687075+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:51:30.677247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.684365+0000","last_change":"2024-04-26T23:40:31.573721+0000","last_active":"2024-04-26T23:40:42.684365+0000","last_peered":"2024-04-26T23:40:42.684365+0000","last_clean":"2024-04-26T23:40:42.684365+0000","last_became_active":"2024-04-26T23:40:31.573434+0000","last_became_peered":"2024-04-26T23:40:31.573434+0000","last_unstale":"2024-04-26T23:40:42.684365+0000","last_undegraded":"2024-04-26T23:40:42.684365+0000","last_fullsized":"2024-04-26T23:40:42.684365+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:20:28.103413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636650+0000","last_change":"2024-04-26T23:40:40.678020+0000","last_active":"2024-04-26T23:40:43.636650+0000","last_peered":"2024-04-26T23:40:43.636650+0000","last_clean":"2024-04-26T23:40:43.636650+0000","last_became_active":"2024-04-26T23:40:40.677410+0000","last_became_peered":"2024-04-26T23:40:40.677410+0000","last_unstale":"2024-04-26T23:40:43.636650+0000","last_undegraded":"2024-04-26T23:40:43.636650+0000","last_fullsized":"2024-04-26T23:40:43.636650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:44:50.588556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.635487+0000","last_change":"2024-04-26T23:40:41.689839+0000","last_active":"2024-04-26T23:40:43.635487+0000","last_peered":"2024-04-26T23:40:43.635487+0000","last_clean":"2024-04-26T23:40:43.635487+0000","last_became_active":"2024-04-26T23:40:41.689508+0000","last_became_peered":"2024-04-26T23:40:41.689508+0000","last_unstale":"2024-04-26T23:40:43.635487+0000","last_undegraded":"2024-04-26T23:40:43.635487+0000","last_fullsized":"2024-04-26T23:40:43.635487+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:17:28.672777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.637978+0000","last_change":"2024-04-26T23:40:32.594913+0000","last_active":"2024-04-26T23:40:43.637978+0000","last_peered":"2024-04-26T23:40:43.637978+0000","last_clean":"2024-04-26T23:40:43.637978+0000","last_became_active":"2024-04-26T23:40:32.594616+0000","last_became_peered":"2024-04-26T23:40:32.594616+0000","last_unstale":"2024-04-26T23:40:43.637978+0000","last_undegraded":"2024-04-26T23:40:43.637978+0000","last_fullsized":"2024-04-26T23:40:43.637978+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:04:30.553552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636386+0000","last_change":"2024-04-26T23:40:31.576299+0000","last_active":"2024-04-26T23:40:43.636386+0000","last_peered":"2024-04-26T23:40:43.636386+0000","last_clean":"2024-04-26T23:40:43.636386+0000","last_became_active":"2024-04-26T23:40:31.576006+0000","last_became_peered":"2024-04-26T23:40:31.576006+0000","last_unstale":"2024-04-26T23:40:43.636386+0000","last_undegraded":"2024-04-26T23:40:43.636386+0000","last_fullsized":"2024-04-26T23:40:43.636386+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:15:51.937774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.635376+0000","last_change":"2024-04-26T23:40:40.674806+0000","last_active":"2024-04-26T23:40:43.635376+0000","last_peered":"2024-04-26T23:40:43.635376+0000","last_clean":"2024-04-26T23:40:43.635376+0000","last_became_active":"2024-04-26T23:40:40.674557+0000","last_became_peered":"2024-04-26T23:40:40.674557+0000","last_unstale":"2024-04-26T23:40:43.635376+0000","last_undegraded":"2024-04-26T23:40:43.635376+0000","last_fullsized":"2024-04-26T23:40:43.635376+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:45:33.226487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.683778+0000","last_change":"2024-04-26T23:40:41.688941+0000","last_active":"2024-04-26T23:40:42.683778+0000","last_peered":"2024-04-26T23:40:42.683778+0000","last_clean":"2024-04-26T23:40:42.683778+0000","last_became_active":"2024-04-26T23:40:41.688653+0000","last_became_peered":"2024-04-26T23:40:41.688653+0000","last_unstale":"2024-04-26T23:40:42.683778+0000","last_undegraded":"2024-04-26T23:40:42.683778+0000","last_fullsized":"2024-04-26T23:40:42.683778+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:53:13.531466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636366+0000","last_change":"2024-04-26T23:40:32.582442+0000","last_active":"2024-04-26T23:40:43.636366+0000","last_peered":"2024-04-26T23:40:43.636366+0000","last_clean":"2024-04-26T23:40:43.636366+0000","last_became_active":"2024-04-26T23:40:32.582140+0000","last_became_peered":"2024-04-26T23:40:32.582140+0000","last_unstale":"2024-04-26T23:40:43.636366+0000","last_undegraded":"2024-04-26T23:40:43.636366+0000","last_fullsized":"2024-04-26T23:40:43.636366+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:18:09.706875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.637335+0000","last_change":"2024-04-26T23:40:31.576565+0000","last_active":"2024-04-26T23:40:43.637335+0000","last_peered":"2024-04-26T23:40:43.637335+0000","last_clean":"2024-04-26T23:40:43.637335+0000","last_became_active":"2024-04-26T23:40:31.576313+0000","last_became_peered":"2024-04-26T23:40:31.576313+0000","last_unstale":"2024-04-26T23:40:43.637335+0000","last_undegraded":"2024-04-26T23:40:43.637335+0000","last_fullsized":"2024-04-26T23:40:43.637335+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:25:01.315397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.686609+0000","last_change":"2024-04-26T23:40:40.671047+0000","last_active":"2024-04-26T23:40:42.686609+0000","last_peered":"2024-04-26T23:40:42.686609+0000","last_clean":"2024-04-26T23:40:42.686609+0000","last_became_active":"2024-04-26T23:40:40.670630+0000","last_became_peered":"2024-04-26T23:40:40.670630+0000","last_unstale":"2024-04-26T23:40:42.686609+0000","last_undegraded":"2024-04-26T23:40:42.686609+0000","last_fullsized":"2024-04-26T23:40:42.686609+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:45:07.071050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.686921+0000","last_change":"2024-04-26T23:40:41.686221+0000","last_active":"2024-04-26T23:40:42.686921+0000","last_peered":"2024-04-26T23:40:42.686921+0000","last_clean":"2024-04-26T23:40:42.686921+0000","last_became_active":"2024-04-26T23:40:41.685961+0000","last_became_peered":"2024-04-26T23:40:41.685961+0000","last_unstale":"2024-04-26T23:40:42.686921+0000","last_undegraded":"2024-04-26T23:40:42.686921+0000","last_fullsized":"2024-04-26T23:40:42.686921+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:28:34.920939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.685609+0000","last_change":"2024-04-26T23:40:32.584363+0000","last_active":"2024-04-26T23:40:42.685609+0000","last_peered":"2024-04-26T23:40:42.685609+0000","last_clean":"2024-04-26T23:40:42.685609+0000","last_became_active":"2024-04-26T23:40:32.584082+0000","last_became_peered":"2024-04-26T23:40:32.584082+0000","last_unstale":"2024-04-26T23:40:42.685609+0000","last_undegraded":"2024-04-26T23:40:42.685609+0000","last_fullsized":"2024-04-26T23:40:42.685609+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:35:08.194865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636458+0000","last_change":"2024-04-26T23:40:31.576711+0000","last_active":"2024-04-26T23:40:43.636458+0000","last_peered":"2024-04-26T23:40:43.636458+0000","last_clean":"2024-04-26T23:40:43.636458+0000","last_became_active":"2024-04-26T23:40:31.576404+0000","last_became_peered":"2024-04-26T23:40:31.576404+0000","last_unstale":"2024-04-26T23:40:43.636458+0000","last_undegraded":"2024-04-26T23:40:43.636458+0000","last_fullsized":"2024-04-26T23:40:43.636458+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:45:49.295198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.635616+0000","last_change":"2024-04-26T23:40:40.675296+0000","last_active":"2024-04-26T23:40:43.635616+0000","last_peered":"2024-04-26T23:40:43.635616+0000","last_clean":"2024-04-26T23:40:43.635616+0000","last_became_active":"2024-04-26T23:40:40.674935+0000","last_became_peered":"2024-04-26T23:40:40.674935+0000","last_unstale":"2024-04-26T23:40:43.635616+0000","last_undegraded":"2024-04-26T23:40:43.635616+0000","last_fullsized":"2024-04-26T23:40:43.635616+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:10:10.722905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.686589+0000","last_change":"2024-04-26T23:40:41.691510+0000","last_active":"2024-04-26T23:40:42.686589+0000","last_peered":"2024-04-26T23:40:42.686589+0000","last_clean":"2024-04-26T23:40:42.686589+0000","last_became_active":"2024-04-26T23:40:41.691242+0000","last_became_peered":"2024-04-26T23:40:41.691242+0000","last_unstale":"2024-04-26T23:40:42.686589+0000","last_undegraded":"2024-04-26T23:40:42.686589+0000","last_fullsized":"2024-04-26T23:40:42.686589+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:27:48.823509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.637394+0000","last_change":"2024-04-26T23:40:32.590069+0000","last_active":"2024-04-26T23:40:43.637394+0000","last_peered":"2024-04-26T23:40:43.637394+0000","last_clean":"2024-04-26T23:40:43.637394+0000","last_became_active":"2024-04-26T23:40:32.589790+0000","last_became_peered":"2024-04-26T23:40:32.589790+0000","last_unstale":"2024-04-26T23:40:43.637394+0000","last_undegraded":"2024-04-26T23:40:43.637394+0000","last_fullsized":"2024-04-26T23:40:43.637394+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:15:52.942160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.684776+0000","last_change":"2024-04-26T23:40:31.572432+0000","last_active":"2024-04-26T23:40:42.684776+0000","last_peered":"2024-04-26T23:40:42.684776+0000","last_clean":"2024-04-26T23:40:42.684776+0000","last_became_active":"2024-04-26T23:40:31.572121+0000","last_became_peered":"2024-04-26T23:40:31.572121+0000","last_unstale":"2024-04-26T23:40:42.684776+0000","last_undegraded":"2024-04-26T23:40:42.684776+0000","last_fullsized":"2024-04-26T23:40:42.684776+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:45:49.295198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636314+0000","last_change":"2024-04-26T23:40:40.678404+0000","last_active":"2024-04-26T23:40:43.636314+0000","last_peered":"2024-04-26T23:40:43.636314+0000","last_clean":"2024-04-26T23:40:43.636314+0000","last_became_active":"2024-04-26T23:40:40.678136+0000","last_became_peered":"2024-04-26T23:40:40.678136+0000","last_unstale":"2024-04-26T23:40:43.636314+0000","last_undegraded":"2024-04-26T23:40:43.636314+0000","last_fullsized":"2024-04-26T23:40:43.636314+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:45:11.058699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636232+0000","last_change":"2024-04-26T23:40:41.673542+0000","last_active":"2024-04-26T23:40:43.636232+0000","last_peered":"2024-04-26T23:40:43.636232+0000","last_clean":"2024-04-26T23:40:43.636232+0000","last_became_active":"2024-04-26T23:40:41.673254+0000","last_became_peered":"2024-04-26T23:40:41.673254+0000","last_unstale":"2024-04-26T23:40:43.636232+0000","last_undegraded":"2024-04-26T23:40:43.636232+0000","last_fullsized":"2024-04-26T23:40:43.636232+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:10:11.728359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.635254+0000","last_change":"2024-04-26T23:40:32.576783+0000","last_active":"2024-04-26T23:40:43.635254+0000","last_peered":"2024-04-26T23:40:43.635254+0000","last_clean":"2024-04-26T23:40:43.635254+0000","last_became_active":"2024-04-26T23:40:32.576481+0000","last_became_peered":"2024-04-26T23:40:32.576481+0000","last_unstale":"2024-04-26T23:40:43.635254+0000","last_undegraded":"2024-04-26T23:40:43.635254+0000","last_fullsized":"2024-04-26T23:40:43.635254+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:16:46.547536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.635776+0000","last_change":"2024-04-26T23:40:31.570775+0000","last_active":"2024-04-26T23:40:43.635776+0000","last_peered":"2024-04-26T23:40:43.635776+0000","last_clean":"2024-04-26T23:40:43.635776+0000","last_became_active":"2024-04-26T23:40:31.570493+0000","last_became_peered":"2024-04-26T23:40:31.570493+0000","last_unstale":"2024-04-26T23:40:43.635776+0000","last_undegraded":"2024-04-26T23:40:43.635776+0000","last_fullsized":"2024-04-26T23:40:43.635776+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:45:49.295198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"23'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636208+0000","last_change":"2024-04-26T23:40:40.675115+0000","last_active":"2024-04-26T23:40:43.636208+0000","last_peered":"2024-04-26T23:40:43.636208+0000","last_clean":"2024-04-26T23:40:43.636208+0000","last_became_active":"2024-04-26T23:40:40.674828+0000","last_became_peered":"2024-04-26T23:40:40.674828+0000","last_unstale":"2024-04-26T23:40:43.636208+0000","last_undegraded":"2024-04-26T23:40:43.636208+0000","last_fullsized":"2024-04-26T23:40:43.636208+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:45:07.071050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.685711+0000","last_change":"2024-04-26T23:40:41.691098+0000","last_active":"2024-04-26T23:40:42.685711+0000","last_peered":"2024-04-26T23:40:42.685711+0000","last_clean":"2024-04-26T23:40:42.685711+0000","last_became_active":"2024-04-26T23:40:41.690803+0000","last_became_peered":"2024-04-26T23:40:41.690803+0000","last_unstale":"2024-04-26T23:40:42.685711+0000","last_undegraded":"2024-04-26T23:40:42.685711+0000","last_fullsized":"2024-04-26T23:40:42.685711+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:38:51.195172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.686290+0000","last_change":"2024-04-26T23:40:32.593262+0000","last_active":"2024-04-26T23:40:42.686290+0000","last_peered":"2024-04-26T23:40:42.686290+0000","last_clean":"2024-04-26T23:40:42.686290+0000","last_became_active":"2024-04-26T23:40:32.593003+0000","last_became_peered":"2024-04-26T23:40:32.593003+0000","last_unstale":"2024-04-26T23:40:42.686290+0000","last_undegraded":"2024-04-26T23:40:42.686290+0000","last_fullsized":"2024-04-26T23:40:42.686290+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:47:51.559918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.635660+0000","last_change":"2024-04-26T23:40:31.573864+0000","last_active":"2024-04-26T23:40:43.635660+0000","last_peered":"2024-04-26T23:40:43.635660+0000","last_clean":"2024-04-26T23:40:43.635660+0000","last_became_active":"2024-04-26T23:40:31.573594+0000","last_became_peered":"2024-04-26T23:40:31.573594+0000","last_unstale":"2024-04-26T23:40:43.635660+0000","last_undegraded":"2024-04-26T23:40:43.635660+0000","last_fullsized":"2024-04-26T23:40:43.635660+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:48:32.015654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"24'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.664374+0000","last_change":"2024-04-26T23:40:40.677258+0000","last_active":"2024-04-26T23:40:43.664374+0000","last_peered":"2024-04-26T23:40:43.664374+0000","last_clean":"2024-04-26T23:40:43.664374+0000","last_became_active":"2024-04-26T23:40:40.676937+0000","last_became_peered":"2024-04-26T23:40:40.676937+0000","last_unstale":"2024-04-26T23:40:43.664374+0000","last_undegraded":"2024-04-26T23:40:43.664374+0000","last_fullsized":"2024-04-26T23:40:43.664374+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:44:50.588556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636633+0000","last_change":"2024-04-26T23:40:41.684731+0000","last_active":"2024-04-26T23:40:43.636633+0000","last_peered":"2024-04-26T23:40:43.636633+0000","last_clean":"2024-04-26T23:40:43.636633+0000","last_became_active":"2024-04-26T23:40:41.684459+0000","last_became_peered":"2024-04-26T23:40:41.684459+0000","last_unstale":"2024-04-26T23:40:43.636633+0000","last_undegraded":"2024-04-26T23:40:43.636633+0000","last_fullsized":"2024-04-26T23:40:43.636633+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:24:07.784468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.637233+0000","last_change":"2024-04-26T23:40:32.593216+0000","last_active":"2024-04-26T23:40:43.637233+0000","last_peered":"2024-04-26T23:40:43.637233+0000","last_clean":"2024-04-26T23:40:43.637233+0000","last_became_active":"2024-04-26T23:40:32.592929+0000","last_became_peered":"2024-04-26T23:40:32.592929+0000","last_unstale":"2024-04-26T23:40:43.637233+0000","last_undegraded":"2024-04-26T23:40:43.637233+0000","last_fullsized":"2024-04-26T23:40:43.637233+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:12:45.093169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.684832+0000","last_change":"2024-04-26T23:40:31.570118+0000","last_active":"2024-04-26T23:40:42.684832+0000","last_peered":"2024-04-26T23:40:42.684832+0000","last_clean":"2024-04-26T23:40:42.684832+0000","last_became_active":"2024-04-26T23:40:31.569764+0000","last_became_peered":"2024-04-26T23:40:31.569764+0000","last_unstale":"2024-04-26T23:40:42.684832+0000","last_undegraded":"2024-04-26T23:40:42.684832+0000","last_fullsized":"2024-04-26T23:40:42.684832+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:15:30.884135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":178,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.635784+0000","last_change":"2024-04-26T23:40:20.966672+0000","last_active":"2024-04-26T23:40:43.635784+0000","last_peered":"2024-04-26T23:40:43.635784+0000","last_clean":"2024-04-26T23:40:43.635784+0000","last_became_active":"2024-04-26T23:40:20.963937+0000","last_became_peered":"2024-04-26T23:40:20.963937+0000","last_unstale":"2024-04-26T23:40:43.635784+0000","last_undegraded":"2024-04-26T23:40:43.635784+0000","last_fullsized":"2024-04-26T23:40:43.635784+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:19.950137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:19.950137+0000","last_clean_scrub_stamp":"2024-04-26T23:40:19.950137+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:23:39.166579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.683613+0000","last_change":"2024-04-26T23:40:40.671995+0000","last_active":"2024-04-26T23:40:42.683613+0000","last_peered":"2024-04-26T23:40:42.683613+0000","last_clean":"2024-04-26T23:40:42.683613+0000","last_became_active":"2024-04-26T23:40:40.671642+0000","last_became_peered":"2024-04-26T23:40:40.671642+0000","last_unstale":"2024-04-26T23:40:42.683613+0000","last_undegraded":"2024-04-26T23:40:42.683613+0000","last_fullsized":"2024-04-26T23:40:42.683613+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:35:16.288571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636479+0000","last_change":"2024-04-26T23:40:41.680852+0000","last_active":"2024-04-26T23:40:43.636479+0000","last_peered":"2024-04-26T23:40:43.636479+0000","last_clean":"2024-04-26T23:40:43.636479+0000","last_became_active":"2024-04-26T23:40:41.680567+0000","last_became_peered":"2024-04-26T23:40:41.680567+0000","last_unstale":"2024-04-26T23:40:43.636479+0000","last_undegraded":"2024-04-26T23:40:43.636479+0000","last_fullsized":"2024-04-26T23:40:43.636479+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:40:15.485085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.637223+0000","last_change":"2024-04-26T23:40:32.591906+0000","last_active":"2024-04-26T23:40:43.637223+0000","last_peered":"2024-04-26T23:40:43.637223+0000","last_clean":"2024-04-26T23:40:43.637223+0000","last_became_active":"2024-04-26T23:40:32.590867+0000","last_became_peered":"2024-04-26T23:40:32.590867+0000","last_unstale":"2024-04-26T23:40:43.637223+0000","last_undegraded":"2024-04-26T23:40:43.637223+0000","last_fullsized":"2024-04-26T23:40:43.637223+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:56:04.309611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636141+0000","last_change":"2024-04-26T23:40:31.572391+0000","last_active":"2024-04-26T23:40:43.636141+0000","last_peered":"2024-04-26T23:40:43.636141+0000","last_clean":"2024-04-26T23:40:43.636141+0000","last_became_active":"2024-04-26T23:40:31.571849+0000","last_became_peered":"2024-04-26T23:40:31.571849+0000","last_unstale":"2024-04-26T23:40:43.636141+0000","last_undegraded":"2024-04-26T23:40:43.636141+0000","last_fullsized":"2024-04-26T23:40:43.636141+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:35:54.439397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.683873+0000","last_change":"2024-04-26T23:40:40.676464+0000","last_active":"2024-04-26T23:40:42.683873+0000","last_peered":"2024-04-26T23:40:42.683873+0000","last_clean":"2024-04-26T23:40:42.683873+0000","last_became_active":"2024-04-26T23:40:40.676154+0000","last_became_peered":"2024-04-26T23:40:40.676154+0000","last_unstale":"2024-04-26T23:40:42.683873+0000","last_undegraded":"2024-04-26T23:40:42.683873+0000","last_fullsized":"2024-04-26T23:40:42.683873+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:52:34.793496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636055+0000","last_change":"2024-04-26T23:40:41.688065+0000","last_active":"2024-04-26T23:40:43.636055+0000","last_peered":"2024-04-26T23:40:43.636055+0000","last_clean":"2024-04-26T23:40:43.636055+0000","last_became_active":"2024-04-26T23:40:41.687693+0000","last_became_peered":"2024-04-26T23:40:41.687693+0000","last_unstale":"2024-04-26T23:40:43.636055+0000","last_undegraded":"2024-04-26T23:40:43.636055+0000","last_fullsized":"2024-04-26T23:40:43.636055+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:35:17.294025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.685453+0000","last_change":"2024-04-26T23:40:32.583469+0000","last_active":"2024-04-26T23:40:42.685453+0000","last_peered":"2024-04-26T23:40:42.685453+0000","last_clean":"2024-04-26T23:40:42.685453+0000","last_became_active":"2024-04-26T23:40:32.583174+0000","last_became_peered":"2024-04-26T23:40:32.583174+0000","last_unstale":"2024-04-26T23:40:42.685453+0000","last_undegraded":"2024-04-26T23:40:42.685453+0000","last_fullsized":"2024-04-26T23:40:42.685453+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:34:14.811917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.637058+0000","last_change":"2024-04-26T23:40:31.571749+0000","last_active":"2024-04-26T23:40:43.637058+0000","last_peered":"2024-04-26T23:40:43.637058+0000","last_clean":"2024-04-26T23:40:43.637058+0000","last_became_active":"2024-04-26T23:40:31.571427+0000","last_became_peered":"2024-04-26T23:40:31.571427+0000","last_unstale":"2024-04-26T23:40:43.637058+0000","last_undegraded":"2024-04-26T23:40:43.637058+0000","last_fullsized":"2024-04-26T23:40:43.637058+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:20:28.103413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"23'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.686472+0000","last_change":"2024-04-26T23:40:40.675987+0000","last_active":"2024-04-26T23:40:42.686472+0000","last_peered":"2024-04-26T23:40:42.686472+0000","last_clean":"2024-04-26T23:40:42.686472+0000","last_became_active":"2024-04-26T23:40:40.675682+0000","last_became_peered":"2024-04-26T23:40:40.675682+0000","last_unstale":"2024-04-26T23:40:42.686472+0000","last_undegraded":"2024-04-26T23:40:42.686472+0000","last_fullsized":"2024-04-26T23:40:42.686472+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:10:10.722905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.635569+0000","last_change":"2024-04-26T23:40:41.681408+0000","last_active":"2024-04-26T23:40:43.635569+0000","last_peered":"2024-04-26T23:40:43.635569+0000","last_clean":"2024-04-26T23:40:43.635569+0000","last_became_active":"2024-04-26T23:40:41.681069+0000","last_became_peered":"2024-04-26T23:40:41.681069+0000","last_unstale":"2024-04-26T23:40:43.635569+0000","last_undegraded":"2024-04-26T23:40:43.635569+0000","last_fullsized":"2024-04-26T23:40:43.635569+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:10:30.972726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636555+0000","last_change":"2024-04-26T23:40:32.596306+0000","last_active":"2024-04-26T23:40:43.636555+0000","last_peered":"2024-04-26T23:40:43.636555+0000","last_clean":"2024-04-26T23:40:43.636555+0000","last_became_active":"2024-04-26T23:40:32.595625+0000","last_became_peered":"2024-04-26T23:40:32.595625+0000","last_unstale":"2024-04-26T23:40:43.636555+0000","last_undegraded":"2024-04-26T23:40:43.636555+0000","last_fullsized":"2024-04-26T23:40:43.636555+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:10:02.629199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636280+0000","last_change":"2024-04-26T23:40:31.570870+0000","last_active":"2024-04-26T23:40:43.636280+0000","last_peered":"2024-04-26T23:40:43.636280+0000","last_clean":"2024-04-26T23:40:43.636280+0000","last_became_active":"2024-04-26T23:40:31.570592+0000","last_became_peered":"2024-04-26T23:40:31.570592+0000","last_unstale":"2024-04-26T23:40:43.636280+0000","last_undegraded":"2024-04-26T23:40:43.636280+0000","last_fullsized":"2024-04-26T23:40:43.636280+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:43:13.740214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.685417+0000","last_change":"2024-04-26T23:40:40.673142+0000","last_active":"2024-04-26T23:40:42.685417+0000","last_peered":"2024-04-26T23:40:42.685417+0000","last_clean":"2024-04-26T23:40:42.685417+0000","last_became_active":"2024-04-26T23:40:40.672816+0000","last_became_peered":"2024-04-26T23:40:40.672816+0000","last_unstale":"2024-04-26T23:40:42.685417+0000","last_undegraded":"2024-04-26T23:40:42.685417+0000","last_fullsized":"2024-04-26T23:40:42.685417+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:53:12.526011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.635564+0000","last_change":"2024-04-26T23:40:41.678588+0000","last_active":"2024-04-26T23:40:43.635564+0000","last_peered":"2024-04-26T23:40:43.635564+0000","last_clean":"2024-04-26T23:40:43.635564+0000","last_became_active":"2024-04-26T23:40:41.678039+0000","last_became_peered":"2024-04-26T23:40:41.678039+0000","last_unstale":"2024-04-26T23:40:43.635564+0000","last_undegraded":"2024-04-26T23:40:43.635564+0000","last_fullsized":"2024-04-26T23:40:43.635564+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:04:39.652713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636462+0000","last_change":"2024-04-26T23:40:32.593577+0000","last_active":"2024-04-26T23:40:43.636462+0000","last_peered":"2024-04-26T23:40:43.636462+0000","last_clean":"2024-04-26T23:40:43.636462+0000","last_became_active":"2024-04-26T23:40:32.593235+0000","last_became_peered":"2024-04-26T23:40:32.593235+0000","last_unstale":"2024-04-26T23:40:43.636462+0000","last_undegraded":"2024-04-26T23:40:43.636462+0000","last_fullsized":"2024-04-26T23:40:43.636462+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:01:02.741964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636418+0000","last_change":"2024-04-26T23:40:31.575943+0000","last_active":"2024-04-26T23:40:43.636418+0000","last_peered":"2024-04-26T23:40:43.636418+0000","last_clean":"2024-04-26T23:40:43.636418+0000","last_became_active":"2024-04-26T23:40:31.575632+0000","last_became_peered":"2024-04-26T23:40:31.575632+0000","last_unstale":"2024-04-26T23:40:43.636418+0000","last_undegraded":"2024-04-26T23:40:43.636418+0000","last_fullsized":"2024-04-26T23:40:43.636418+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:11:08.189634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636540+0000","last_change":"2024-04-26T23:40:40.676297+0000","last_active":"2024-04-26T23:40:43.636540+0000","last_peered":"2024-04-26T23:40:43.636540+0000","last_clean":"2024-04-26T23:40:43.636540+0000","last_became_active":"2024-04-26T23:40:40.675888+0000","last_became_peered":"2024-04-26T23:40:40.675888+0000","last_unstale":"2024-04-26T23:40:43.636540+0000","last_undegraded":"2024-04-26T23:40:43.636540+0000","last_fullsized":"2024-04-26T23:40:43.636540+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:04:38.647258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.637873+0000","last_change":"2024-04-26T23:40:41.688506+0000","last_active":"2024-04-26T23:40:43.637873+0000","last_peered":"2024-04-26T23:40:43.637873+0000","last_clean":"2024-04-26T23:40:43.637873+0000","last_became_active":"2024-04-26T23:40:41.688224+0000","last_became_peered":"2024-04-26T23:40:41.688224+0000","last_unstale":"2024-04-26T23:40:43.637873+0000","last_undegraded":"2024-04-26T23:40:43.637873+0000","last_fullsized":"2024-04-26T23:40:43.637873+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:05:34.008024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.637217+0000","last_change":"2024-04-26T23:40:32.593528+0000","last_active":"2024-04-26T23:40:43.637217+0000","last_peered":"2024-04-26T23:40:43.637217+0000","last_clean":"2024-04-26T23:40:43.637217+0000","last_became_active":"2024-04-26T23:40:32.593220+0000","last_became_peered":"2024-04-26T23:40:32.593220+0000","last_unstale":"2024-04-26T23:40:43.637217+0000","last_undegraded":"2024-04-26T23:40:43.637217+0000","last_fullsized":"2024-04-26T23:40:43.637217+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:04:30.553552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":30,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.635390+0000","last_change":"2024-04-26T23:40:31.572685+0000","last_active":"2024-04-26T23:40:43.635390+0000","last_peered":"2024-04-26T23:40:43.635390+0000","last_clean":"2024-04-26T23:40:43.635390+0000","last_became_active":"2024-04-26T23:40:31.572169+0000","last_became_peered":"2024-04-26T23:40:31.572169+0000","last_unstale":"2024-04-26T23:40:43.635390+0000","last_undegraded":"2024-04-26T23:40:43.635390+0000","last_fullsized":"2024-04-26T23:40:43.635390+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:15:30.884135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.687059+0000","last_change":"2024-04-26T23:40:40.672160+0000","last_active":"2024-04-26T23:40:42.687059+0000","last_peered":"2024-04-26T23:40:42.687059+0000","last_clean":"2024-04-26T23:40:42.687059+0000","last_became_active":"2024-04-26T23:40:40.671875+0000","last_became_peered":"2024-04-26T23:40:40.671875+0000","last_unstale":"2024-04-26T23:40:42.687059+0000","last_undegraded":"2024-04-26T23:40:42.687059+0000","last_fullsized":"2024-04-26T23:40:42.687059+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:35:16.288571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.685105+0000","last_change":"2024-04-26T23:40:41.688445+0000","last_active":"2024-04-26T23:40:42.685105+0000","last_peered":"2024-04-26T23:40:42.685105+0000","last_clean":"2024-04-26T23:40:42.685105+0000","last_became_active":"2024-04-26T23:40:41.688053+0000","last_became_peered":"2024-04-26T23:40:41.688053+0000","last_unstale":"2024-04-26T23:40:42.685105+0000","last_undegraded":"2024-04-26T23:40:42.685105+0000","last_fullsized":"2024-04-26T23:40:42.685105+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:08:35.027584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.683320+0000","last_change":"2024-04-26T23:40:32.586832+0000","last_active":"2024-04-26T23:40:42.683320+0000","last_peered":"2024-04-26T23:40:42.683320+0000","last_clean":"2024-04-26T23:40:42.683320+0000","last_became_active":"2024-04-26T23:40:32.585809+0000","last_became_peered":"2024-04-26T23:40:32.585809+0000","last_unstale":"2024-04-26T23:40:42.683320+0000","last_undegraded":"2024-04-26T23:40:42.683320+0000","last_fullsized":"2024-04-26T23:40:42.683320+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:51:30.677247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.683971+0000","last_change":"2024-04-26T23:40:31.569512+0000","last_active":"2024-04-26T23:40:42.683971+0000","last_peered":"2024-04-26T23:40:42.683971+0000","last_clean":"2024-04-26T23:40:42.683971+0000","last_became_active":"2024-04-26T23:40:31.568598+0000","last_became_peered":"2024-04-26T23:40:31.568598+0000","last_unstale":"2024-04-26T23:40:42.683971+0000","last_undegraded":"2024-04-26T23:40:42.683971+0000","last_fullsized":"2024-04-26T23:40:42.683971+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:48:32.015654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.637928+0000","last_change":"2024-04-26T23:40:40.673986+0000","last_active":"2024-04-26T23:40:43.637928+0000","last_peered":"2024-04-26T23:40:43.637928+0000","last_clean":"2024-04-26T23:40:43.637928+0000","last_became_active":"2024-04-26T23:40:40.673704+0000","last_became_peered":"2024-04-26T23:40:40.673704+0000","last_unstale":"2024-04-26T23:40:43.637928+0000","last_undegraded":"2024-04-26T23:40:43.637928+0000","last_fullsized":"2024-04-26T23:40:43.637928+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:37:24.000775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.685367+0000","last_change":"2024-04-26T23:40:41.691441+0000","last_active":"2024-04-26T23:40:42.685367+0000","last_peered":"2024-04-26T23:40:42.685367+0000","last_clean":"2024-04-26T23:40:42.685367+0000","last_became_active":"2024-04-26T23:40:41.691160+0000","last_became_peered":"2024-04-26T23:40:41.691160+0000","last_unstale":"2024-04-26T23:40:42.685367+0000","last_undegraded":"2024-04-26T23:40:42.685367+0000","last_fullsized":"2024-04-26T23:40:42.685367+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:41:52.386084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636667+0000","last_change":"2024-04-26T23:40:32.595377+0000","last_active":"2024-04-26T23:40:43.636667+0000","last_peered":"2024-04-26T23:40:43.636667+0000","last_clean":"2024-04-26T23:40:43.636667+0000","last_became_active":"2024-04-26T23:40:32.595032+0000","last_became_peered":"2024-04-26T23:40:32.595032+0000","last_unstale":"2024-04-26T23:40:43.636667+0000","last_undegraded":"2024-04-26T23:40:43.636667+0000","last_fullsized":"2024-04-26T23:40:43.636667+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:44:42.494850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.684685+0000","last_change":"2024-04-26T23:40:31.575493+0000","last_active":"2024-04-26T23:40:42.684685+0000","last_peered":"2024-04-26T23:40:42.684685+0000","last_clean":"2024-04-26T23:40:42.684685+0000","last_became_active":"2024-04-26T23:40:31.575039+0000","last_became_peered":"2024-04-26T23:40:31.575039+0000","last_unstale":"2024-04-26T23:40:42.684685+0000","last_undegraded":"2024-04-26T23:40:42.684685+0000","last_fullsized":"2024-04-26T23:40:42.684685+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:43:13.740214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"23'6","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.637618+0000","last_change":"2024-04-26T23:40:40.676493+0000","last_active":"2024-04-26T23:40:43.637618+0000","last_peered":"2024-04-26T23:40:43.637618+0000","last_clean":"2024-04-26T23:40:43.637618+0000","last_became_active":"2024-04-26T23:40:40.676124+0000","last_became_peered":"2024-04-26T23:40:40.676124+0000","last_unstale":"2024-04-26T23:40:43.637618+0000","last_undegraded":"2024-04-26T23:40:43.637618+0000","last_fullsized":"2024-04-26T23:40:43.637618+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:28:33.915485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.637568+0000","last_change":"2024-04-26T23:40:41.680735+0000","last_active":"2024-04-26T23:40:43.637568+0000","last_peered":"2024-04-26T23:40:43.637568+0000","last_clean":"2024-04-26T23:40:43.637568+0000","last_became_active":"2024-04-26T23:40:41.680485+0000","last_became_peered":"2024-04-26T23:40:41.680485+0000","last_unstale":"2024-04-26T23:40:43.637568+0000","last_undegraded":"2024-04-26T23:40:43.637568+0000","last_fullsized":"2024-04-26T23:40:43.637568+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:38:51.195172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.686381+0000","last_change":"2024-04-26T23:40:32.589706+0000","last_active":"2024-04-26T23:40:42.686381+0000","last_peered":"2024-04-26T23:40:42.686381+0000","last_clean":"2024-04-26T23:40:42.686381+0000","last_became_active":"2024-04-26T23:40:32.589452+0000","last_became_peered":"2024-04-26T23:40:32.589452+0000","last_unstale":"2024-04-26T23:40:42.686381+0000","last_undegraded":"2024-04-26T23:40:42.686381+0000","last_fullsized":"2024-04-26T23:40:42.686381+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:15:01.970308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.686999+0000","last_change":"2024-04-26T23:40:31.573941+0000","last_active":"2024-04-26T23:40:42.686999+0000","last_peered":"2024-04-26T23:40:42.686999+0000","last_clean":"2024-04-26T23:40:42.686999+0000","last_became_active":"2024-04-26T23:40:31.573668+0000","last_became_peered":"2024-04-26T23:40:31.573668+0000","last_unstale":"2024-04-26T23:40:42.686999+0000","last_undegraded":"2024-04-26T23:40:42.686999+0000","last_fullsized":"2024-04-26T23:40:42.686999+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:58:06.477730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"23'3","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.685527+0000","last_change":"2024-04-26T23:40:40.676408+0000","last_active":"2024-04-26T23:40:42.685527+0000","last_peered":"2024-04-26T23:40:42.685527+0000","last_clean":"2024-04-26T23:40:42.685527+0000","last_became_active":"2024-04-26T23:40:40.676147+0000","last_became_peered":"2024-04-26T23:40:40.676147+0000","last_unstale":"2024-04-26T23:40:42.685527+0000","last_undegraded":"2024-04-26T23:40:42.685527+0000","last_fullsized":"2024-04-26T23:40:42.685527+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:27:47.818055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.637455+0000","last_change":"2024-04-26T23:40:41.685829+0000","last_active":"2024-04-26T23:40:43.637455+0000","last_peered":"2024-04-26T23:40:43.637455+0000","last_clean":"2024-04-26T23:40:43.637455+0000","last_became_active":"2024-04-26T23:40:41.685403+0000","last_became_peered":"2024-04-26T23:40:41.685403+0000","last_unstale":"2024-04-26T23:40:43.637455+0000","last_undegraded":"2024-04-26T23:40:43.637455+0000","last_fullsized":"2024-04-26T23:40:43.637455+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:24:07.784468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.637089+0000","last_change":"2024-04-26T23:40:32.587513+0000","last_active":"2024-04-26T23:40:43.637089+0000","last_peered":"2024-04-26T23:40:43.637089+0000","last_clean":"2024-04-26T23:40:43.637089+0000","last_became_active":"2024-04-26T23:40:32.587200+0000","last_became_peered":"2024-04-26T23:40:32.587200+0000","last_unstale":"2024-04-26T23:40:43.637089+0000","last_undegraded":"2024-04-26T23:40:43.637089+0000","last_fullsized":"2024-04-26T23:40:43.637089+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:37:30.361795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":28,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.683606+0000","last_change":"2024-04-26T23:40:31.572331+0000","last_active":"2024-04-26T23:40:42.683606+0000","last_peered":"2024-04-26T23:40:42.683606+0000","last_clean":"2024-04-26T23:40:42.683606+0000","last_became_active":"2024-04-26T23:40:31.572074+0000","last_became_peered":"2024-04-26T23:40:31.572074+0000","last_unstale":"2024-04-26T23:40:42.683606+0000","last_undegraded":"2024-04-26T23:40:42.683606+0000","last_fullsized":"2024-04-26T23:40:42.683606+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:45:49.295198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.635520+0000","last_change":"2024-04-26T23:40:40.677978+0000","last_active":"2024-04-26T23:40:43.635520+0000","last_peered":"2024-04-26T23:40:43.635520+0000","last_clean":"2024-04-26T23:40:43.635520+0000","last_became_active":"2024-04-26T23:40:40.677714+0000","last_became_peered":"2024-04-26T23:40:40.677714+0000","last_unstale":"2024-04-26T23:40:43.635520+0000","last_undegraded":"2024-04-26T23:40:43.635520+0000","last_fullsized":"2024-04-26T23:40:43.635520+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:44:50.588556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636093+0000","last_change":"2024-04-26T23:40:41.685431+0000","last_active":"2024-04-26T23:40:43.636093+0000","last_peered":"2024-04-26T23:40:43.636093+0000","last_clean":"2024-04-26T23:40:43.636093+0000","last_became_active":"2024-04-26T23:40:41.685147+0000","last_became_peered":"2024-04-26T23:40:41.685147+0000","last_unstale":"2024-04-26T23:40:43.636093+0000","last_undegraded":"2024-04-26T23:40:43.636093+0000","last_fullsized":"2024-04-26T23:40:43.636093+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:33:16.389626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636824+0000","last_change":"2024-04-26T23:40:32.593298+0000","last_active":"2024-04-26T23:40:43.636824+0000","last_peered":"2024-04-26T23:40:43.636824+0000","last_clean":"2024-04-26T23:40:43.636824+0000","last_became_active":"2024-04-26T23:40:32.593030+0000","last_became_peered":"2024-04-26T23:40:32.593030+0000","last_unstale":"2024-04-26T23:40:43.636824+0000","last_undegraded":"2024-04-26T23:40:43.636824+0000","last_fullsized":"2024-04-26T23:40:43.636824+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:20:29.107798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636957+0000","last_change":"2024-04-26T23:40:31.574234+0000","last_active":"2024-04-26T23:40:43.636957+0000","last_peered":"2024-04-26T23:40:43.636957+0000","last_clean":"2024-04-26T23:40:43.636957+0000","last_became_active":"2024-04-26T23:40:31.572218+0000","last_became_peered":"2024-04-26T23:40:31.572218+0000","last_unstale":"2024-04-26T23:40:43.636957+0000","last_undegraded":"2024-04-26T23:40:43.636957+0000","last_fullsized":"2024-04-26T23:40:43.636957+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:25:01.315397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"23'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.637149+0000","last_change":"2024-04-26T23:40:40.674778+0000","last_active":"2024-04-26T23:40:43.637149+0000","last_peered":"2024-04-26T23:40:43.637149+0000","last_clean":"2024-04-26T23:40:43.637149+0000","last_became_active":"2024-04-26T23:40:40.674487+0000","last_became_peered":"2024-04-26T23:40:40.674487+0000","last_unstale":"2024-04-26T23:40:43.637149+0000","last_undegraded":"2024-04-26T23:40:43.637149+0000","last_fullsized":"2024-04-26T23:40:43.637149+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:10:10.722905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.683588+0000","last_change":"2024-04-26T23:40:41.686531+0000","last_active":"2024-04-26T23:40:42.683588+0000","last_peered":"2024-04-26T23:40:42.683588+0000","last_clean":"2024-04-26T23:40:42.683588+0000","last_became_active":"2024-04-26T23:40:41.686259+0000","last_became_peered":"2024-04-26T23:40:41.686259+0000","last_unstale":"2024-04-26T23:40:42.683588+0000","last_undegraded":"2024-04-26T23:40:42.683588+0000","last_fullsized":"2024-04-26T23:40:42.683588+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:45:34.231942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.686899+0000","last_change":"2024-04-26T23:40:32.589146+0000","last_active":"2024-04-26T23:40:42.686899+0000","last_peered":"2024-04-26T23:40:42.686899+0000","last_clean":"2024-04-26T23:40:42.686899+0000","last_became_active":"2024-04-26T23:40:32.588881+0000","last_became_peered":"2024-04-26T23:40:32.588881+0000","last_unstale":"2024-04-26T23:40:42.686899+0000","last_undegraded":"2024-04-26T23:40:42.686899+0000","last_fullsized":"2024-04-26T23:40:42.686899+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:38:10.884592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.685165+0000","last_change":"2024-04-26T23:40:31.575616+0000","last_active":"2024-04-26T23:40:42.685165+0000","last_peered":"2024-04-26T23:40:42.685165+0000","last_clean":"2024-04-26T23:40:42.685165+0000","last_became_active":"2024-04-26T23:40:31.575211+0000","last_became_peered":"2024-04-26T23:40:31.575211+0000","last_unstale":"2024-04-26T23:40:42.685165+0000","last_undegraded":"2024-04-26T23:40:42.685165+0000","last_fullsized":"2024-04-26T23:40:42.685165+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:48:32.015654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"23'8","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636684+0000","last_change":"2024-04-26T23:40:40.675694+0000","last_active":"2024-04-26T23:40:43.636684+0000","last_peered":"2024-04-26T23:40:43.636684+0000","last_clean":"2024-04-26T23:40:43.636684+0000","last_became_active":"2024-04-26T23:40:40.675459+0000","last_became_peered":"2024-04-26T23:40:40.675459+0000","last_unstale":"2024-04-26T23:40:43.636684+0000","last_undegraded":"2024-04-26T23:40:43.636684+0000","last_fullsized":"2024-04-26T23:40:43.636684+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:30:03.993564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.635596+0000","last_change":"2024-04-26T23:40:41.687488+0000","last_active":"2024-04-26T23:40:43.635596+0000","last_peered":"2024-04-26T23:40:43.635596+0000","last_clean":"2024-04-26T23:40:43.635596+0000","last_became_active":"2024-04-26T23:40:41.687210+0000","last_became_peered":"2024-04-26T23:40:41.687210+0000","last_unstale":"2024-04-26T23:40:43.635596+0000","last_undegraded":"2024-04-26T23:40:43.635596+0000","last_fullsized":"2024-04-26T23:40:43.635596+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:36:21.487122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.685110+0000","last_change":"2024-04-26T23:40:32.589793+0000","last_active":"2024-04-26T23:40:42.685110+0000","last_peered":"2024-04-26T23:40:42.685110+0000","last_clean":"2024-04-26T23:40:42.685110+0000","last_became_active":"2024-04-26T23:40:32.589478+0000","last_became_peered":"2024-04-26T23:40:32.589478+0000","last_unstale":"2024-04-26T23:40:42.685110+0000","last_undegraded":"2024-04-26T23:40:42.685110+0000","last_fullsized":"2024-04-26T23:40:42.685110+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:56:04.309611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.684275+0000","last_change":"2024-04-26T23:40:31.573794+0000","last_active":"2024-04-26T23:40:42.684275+0000","last_peered":"2024-04-26T23:40:42.684275+0000","last_clean":"2024-04-26T23:40:42.684275+0000","last_became_active":"2024-04-26T23:40:31.573164+0000","last_became_peered":"2024-04-26T23:40:31.573164+0000","last_unstale":"2024-04-26T23:40:42.684275+0000","last_undegraded":"2024-04-26T23:40:42.684275+0000","last_fullsized":"2024-04-26T23:40:42.684275+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:15:30.884135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636808+0000","last_change":"2024-04-26T23:40:40.674127+0000","last_active":"2024-04-26T23:40:43.636808+0000","last_peered":"2024-04-26T23:40:43.636808+0000","last_clean":"2024-04-26T23:40:43.636808+0000","last_became_active":"2024-04-26T23:40:40.673793+0000","last_became_peered":"2024-04-26T23:40:40.673793+0000","last_unstale":"2024-04-26T23:40:43.636808+0000","last_undegraded":"2024-04-26T23:40:43.636808+0000","last_fullsized":"2024-04-26T23:40:43.636808+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:53:12.526011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.684571+0000","last_change":"2024-04-26T23:40:41.686867+0000","last_active":"2024-04-26T23:40:42.684571+0000","last_peered":"2024-04-26T23:40:42.684571+0000","last_clean":"2024-04-26T23:40:42.684571+0000","last_became_active":"2024-04-26T23:40:41.686536+0000","last_became_peered":"2024-04-26T23:40:41.686536+0000","last_unstale":"2024-04-26T23:40:42.684571+0000","last_undegraded":"2024-04-26T23:40:42.684571+0000","last_fullsized":"2024-04-26T23:40:42.684571+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:28:34.920939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"23'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.686809+0000","last_change":"2024-04-26T23:40:40.674915+0000","last_active":"2024-04-26T23:40:42.686809+0000","last_peered":"2024-04-26T23:40:42.686809+0000","last_clean":"2024-04-26T23:40:42.686809+0000","last_became_active":"2024-04-26T23:40:40.674639+0000","last_became_peered":"2024-04-26T23:40:40.674639+0000","last_unstale":"2024-04-26T23:40:42.686809+0000","last_undegraded":"2024-04-26T23:40:42.686809+0000","last_fullsized":"2024-04-26T23:40:42.686809+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:52:34.793496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.635465+0000","last_change":"2024-04-26T23:40:32.583014+0000","last_active":"2024-04-26T23:40:43.635465+0000","last_peered":"2024-04-26T23:40:43.635465+0000","last_clean":"2024-04-26T23:40:43.635465+0000","last_became_active":"2024-04-26T23:40:32.582751+0000","last_became_peered":"2024-04-26T23:40:32.582751+0000","last_unstale":"2024-04-26T23:40:43.635465+0000","last_undegraded":"2024-04-26T23:40:43.635465+0000","last_fullsized":"2024-04-26T23:40:43.635465+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:38:10.884592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.685541+0000","last_change":"2024-04-26T23:40:31.572402+0000","last_active":"2024-04-26T23:40:42.685541+0000","last_peered":"2024-04-26T23:40:42.685541+0000","last_clean":"2024-04-26T23:40:42.685541+0000","last_became_active":"2024-04-26T23:40:31.572111+0000","last_became_peered":"2024-04-26T23:40:31.572111+0000","last_unstale":"2024-04-26T23:40:42.685541+0000","last_undegraded":"2024-04-26T23:40:42.685541+0000","last_fullsized":"2024-04-26T23:40:42.685541+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:20:28.103413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.686752+0000","last_change":"2024-04-26T23:40:41.684524+0000","last_active":"2024-04-26T23:40:42.686752+0000","last_peered":"2024-04-26T23:40:42.686752+0000","last_clean":"2024-04-26T23:40:42.686752+0000","last_became_active":"2024-04-26T23:40:41.684207+0000","last_became_peered":"2024-04-26T23:40:41.684207+0000","last_unstale":"2024-04-26T23:40:42.686752+0000","last_undegraded":"2024-04-26T23:40:42.686752+0000","last_fullsized":"2024-04-26T23:40:42.686752+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:30:04.999018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"23'4","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.684153+0000","last_change":"2024-04-26T23:40:40.674934+0000","last_active":"2024-04-26T23:40:42.684153+0000","last_peered":"2024-04-26T23:40:42.684153+0000","last_clean":"2024-04-26T23:40:42.684153+0000","last_became_active":"2024-04-26T23:40:40.674628+0000","last_became_peered":"2024-04-26T23:40:40.674628+0000","last_unstale":"2024-04-26T23:40:42.684153+0000","last_undegraded":"2024-04-26T23:40:42.684153+0000","last_fullsized":"2024-04-26T23:40:42.684153+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:44:50.588556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636777+0000","last_change":"2024-04-26T23:40:32.586204+0000","last_active":"2024-04-26T23:40:43.636777+0000","last_peered":"2024-04-26T23:40:43.636777+0000","last_clean":"2024-04-26T23:40:43.636777+0000","last_became_active":"2024-04-26T23:40:32.585725+0000","last_became_peered":"2024-04-26T23:40:32.585725+0000","last_unstale":"2024-04-26T23:40:43.636777+0000","last_undegraded":"2024-04-26T23:40:43.636777+0000","last_fullsized":"2024-04-26T23:40:43.636777+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:51:30.677247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.637081+0000","last_change":"2024-04-26T23:40:31.578929+0000","last_active":"2024-04-26T23:40:43.637081+0000","last_peered":"2024-04-26T23:40:43.637081+0000","last_clean":"2024-04-26T23:40:43.637081+0000","last_became_active":"2024-04-26T23:40:31.578623+0000","last_became_peered":"2024-04-26T23:40:31.578623+0000","last_unstale":"2024-04-26T23:40:43.637081+0000","last_undegraded":"2024-04-26T23:40:43.637081+0000","last_fullsized":"2024-04-26T23:40:43.637081+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:50:21.330821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.637097+0000","last_change":"2024-04-26T23:40:41.689697+0000","last_active":"2024-04-26T23:40:43.637097+0000","last_peered":"2024-04-26T23:40:43.637097+0000","last_clean":"2024-04-26T23:40:43.637097+0000","last_became_active":"2024-04-26T23:40:41.688428+0000","last_became_peered":"2024-04-26T23:40:41.688428+0000","last_unstale":"2024-04-26T23:40:43.637097+0000","last_undegraded":"2024-04-26T23:40:43.637097+0000","last_fullsized":"2024-04-26T23:40:43.637097+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:36:21.487122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.684234+0000","last_change":"2024-04-26T23:40:31.567755+0000","last_active":"2024-04-26T23:40:42.684234+0000","last_peered":"2024-04-26T23:40:42.684234+0000","last_clean":"2024-04-26T23:40:42.684234+0000","last_became_active":"2024-04-26T23:40:31.567484+0000","last_became_peered":"2024-04-26T23:40:31.567484+0000","last_unstale":"2024-04-26T23:40:42.684234+0000","last_undegraded":"2024-04-26T23:40:42.684234+0000","last_fullsized":"2024-04-26T23:40:42.684234+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:43:13.740214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.686881+0000","last_change":"2024-04-26T23:40:32.594689+0000","last_active":"2024-04-26T23:40:42.686881+0000","last_peered":"2024-04-26T23:40:42.686881+0000","last_clean":"2024-04-26T23:40:42.686881+0000","last_became_active":"2024-04-26T23:40:32.592365+0000","last_became_peered":"2024-04-26T23:40:32.592365+0000","last_unstale":"2024-04-26T23:40:42.686881+0000","last_undegraded":"2024-04-26T23:40:42.686881+0000","last_fullsized":"2024-04-26T23:40:42.686881+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:17:46.135806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"23'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.635940+0000","last_change":"2024-04-26T23:40:40.676028+0000","last_active":"2024-04-26T23:40:43.635940+0000","last_peered":"2024-04-26T23:40:43.635940+0000","last_clean":"2024-04-26T23:40:43.635940+0000","last_became_active":"2024-04-26T23:40:40.675736+0000","last_became_peered":"2024-04-26T23:40:40.675736+0000","last_unstale":"2024-04-26T23:40:43.635940+0000","last_undegraded":"2024-04-26T23:40:43.635940+0000","last_fullsized":"2024-04-26T23:40:43.635940+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:51:38.770953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636545+0000","last_change":"2024-04-26T23:40:41.690148+0000","last_active":"2024-04-26T23:40:43.636545+0000","last_peered":"2024-04-26T23:40:43.636545+0000","last_clean":"2024-04-26T23:40:43.636545+0000","last_became_active":"2024-04-26T23:40:41.689765+0000","last_became_peered":"2024-04-26T23:40:41.689765+0000","last_unstale":"2024-04-26T23:40:43.636545+0000","last_undegraded":"2024-04-26T23:40:43.636545+0000","last_fullsized":"2024-04-26T23:40:43.636545+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:33:16.389626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.637574+0000","last_change":"2024-04-26T23:40:31.576749+0000","last_active":"2024-04-26T23:40:43.637574+0000","last_peered":"2024-04-26T23:40:43.637574+0000","last_clean":"2024-04-26T23:40:43.637574+0000","last_became_active":"2024-04-26T23:40:31.576178+0000","last_became_peered":"2024-04-26T23:40:31.576178+0000","last_unstale":"2024-04-26T23:40:43.637574+0000","last_undegraded":"2024-04-26T23:40:43.637574+0000","last_fullsized":"2024-04-26T23:40:43.637574+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:15:30.884135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636389+0000","last_change":"2024-04-26T23:40:32.589208+0000","last_active":"2024-04-26T23:40:43.636389+0000","last_peered":"2024-04-26T23:40:43.636389+0000","last_clean":"2024-04-26T23:40:43.636389+0000","last_became_active":"2024-04-26T23:40:32.588927+0000","last_became_peered":"2024-04-26T23:40:32.588927+0000","last_unstale":"2024-04-26T23:40:43.636389+0000","last_undegraded":"2024-04-26T23:40:43.636389+0000","last_fullsized":"2024-04-26T23:40:43.636389+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:45:50.299583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"23'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.637675+0000","last_change":"2024-04-26T23:40:40.676809+0000","last_active":"2024-04-26T23:40:43.637675+0000","last_peered":"2024-04-26T23:40:43.637675+0000","last_clean":"2024-04-26T23:40:43.637675+0000","last_became_active":"2024-04-26T23:40:40.676070+0000","last_became_peered":"2024-04-26T23:40:40.676070+0000","last_unstale":"2024-04-26T23:40:43.637675+0000","last_undegraded":"2024-04-26T23:40:43.637675+0000","last_fullsized":"2024-04-26T23:40:43.637675+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:17:27.667323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.637854+0000","last_change":"2024-04-26T23:40:41.679796+0000","last_active":"2024-04-26T23:40:43.637854+0000","last_peered":"2024-04-26T23:40:43.637854+0000","last_clean":"2024-04-26T23:40:43.637854+0000","last_became_active":"2024-04-26T23:40:41.679523+0000","last_became_peered":"2024-04-26T23:40:41.679523+0000","last_unstale":"2024-04-26T23:40:43.637854+0000","last_undegraded":"2024-04-26T23:40:43.637854+0000","last_fullsized":"2024-04-26T23:40:43.637854+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:43:02.137315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.683465+0000","last_change":"2024-04-26T23:40:32.586672+0000","last_active":"2024-04-26T23:40:42.683465+0000","last_peered":"2024-04-26T23:40:42.683465+0000","last_clean":"2024-04-26T23:40:42.683465+0000","last_became_active":"2024-04-26T23:40:32.586399+0000","last_became_peered":"2024-04-26T23:40:32.586399+0000","last_unstale":"2024-04-26T23:40:42.683465+0000","last_undegraded":"2024-04-26T23:40:42.683465+0000","last_fullsized":"2024-04-26T23:40:42.683465+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:15:01.970308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636388+0000","last_change":"2024-04-26T23:40:41.687529+0000","last_active":"2024-04-26T23:40:43.636388+0000","last_peered":"2024-04-26T23:40:43.636388+0000","last_clean":"2024-04-26T23:40:43.636388+0000","last_became_active":"2024-04-26T23:40:41.686974+0000","last_became_peered":"2024-04-26T23:40:41.686974+0000","last_unstale":"2024-04-26T23:40:43.636388+0000","last_undegraded":"2024-04-26T23:40:43.636388+0000","last_fullsized":"2024-04-26T23:40:43.636388+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:21:56.950703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.635606+0000","last_change":"2024-04-26T23:40:32.584590+0000","last_active":"2024-04-26T23:40:43.635606+0000","last_peered":"2024-04-26T23:40:43.635606+0000","last_clean":"2024-04-26T23:40:43.635606+0000","last_became_active":"2024-04-26T23:40:32.584234+0000","last_became_peered":"2024-04-26T23:40:32.584234+0000","last_unstale":"2024-04-26T23:40:43.635606+0000","last_undegraded":"2024-04-26T23:40:43.635606+0000","last_fullsized":"2024-04-26T23:40:43.635606+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:15:52.942160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.685091+0000","last_change":"2024-04-26T23:40:41.679549+0000","last_active":"2024-04-26T23:40:42.685091+0000","last_peered":"2024-04-26T23:40:42.685091+0000","last_clean":"2024-04-26T23:40:42.685091+0000","last_became_active":"2024-04-26T23:40:41.679254+0000","last_became_peered":"2024-04-26T23:40:41.679254+0000","last_unstale":"2024-04-26T23:40:42.685091+0000","last_undegraded":"2024-04-26T23:40:42.685091+0000","last_fullsized":"2024-04-26T23:40:42.685091+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:48:09.126894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.684675+0000","last_change":"2024-04-26T23:40:32.580453+0000","last_active":"2024-04-26T23:40:42.684675+0000","last_peered":"2024-04-26T23:40:42.684675+0000","last_clean":"2024-04-26T23:40:42.684675+0000","last_became_active":"2024-04-26T23:40:32.580196+0000","last_became_peered":"2024-04-26T23:40:32.580196+0000","last_unstale":"2024-04-26T23:40:42.684675+0000","last_undegraded":"2024-04-26T23:40:42.684675+0000","last_fullsized":"2024-04-26T23:40:42.684675+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:18:09.706875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636745+0000","last_change":"2024-04-26T23:40:41.690579+0000","last_active":"2024-04-26T23:40:43.636745+0000","last_peered":"2024-04-26T23:40:43.636745+0000","last_clean":"2024-04-26T23:40:43.636745+0000","last_became_active":"2024-04-26T23:40:41.690262+0000","last_became_peered":"2024-04-26T23:40:41.690262+0000","last_unstale":"2024-04-26T23:40:43.636745+0000","last_undegraded":"2024-04-26T23:40:43.636745+0000","last_fullsized":"2024-04-26T23:40:43.636745+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:10:30.972726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.686790+0000","last_change":"2024-04-26T23:40:32.584323+0000","last_active":"2024-04-26T23:40:42.686790+0000","last_peered":"2024-04-26T23:40:42.686790+0000","last_clean":"2024-04-26T23:40:42.686790+0000","last_became_active":"2024-04-26T23:40:32.584010+0000","last_became_peered":"2024-04-26T23:40:32.584010+0000","last_unstale":"2024-04-26T23:40:42.686790+0000","last_undegraded":"2024-04-26T23:40:42.686790+0000","last_fullsized":"2024-04-26T23:40:42.686790+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:16:46.547536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636036+0000","last_change":"2024-04-26T23:40:41.677679+0000","last_active":"2024-04-26T23:40:43.636036+0000","last_peered":"2024-04-26T23:40:43.636036+0000","last_clean":"2024-04-26T23:40:43.636036+0000","last_became_active":"2024-04-26T23:40:41.677398+0000","last_became_peered":"2024-04-26T23:40:41.677398+0000","last_unstale":"2024-04-26T23:40:43.636036+0000","last_undegraded":"2024-04-26T23:40:43.636036+0000","last_fullsized":"2024-04-26T23:40:43.636036+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:42:13.754586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.637704+0000","last_change":"2024-04-26T23:40:32.587921+0000","last_active":"2024-04-26T23:40:43.637704+0000","last_peered":"2024-04-26T23:40:43.637704+0000","last_clean":"2024-04-26T23:40:43.637704+0000","last_became_active":"2024-04-26T23:40:32.587630+0000","last_became_peered":"2024-04-26T23:40:32.587630+0000","last_unstale":"2024-04-26T23:40:43.637704+0000","last_undegraded":"2024-04-26T23:40:43.637704+0000","last_fullsized":"2024-04-26T23:40:43.637704+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:01:02.741964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.637255+0000","last_change":"2024-04-26T23:40:41.690235+0000","last_active":"2024-04-26T23:40:43.637255+0000","last_peered":"2024-04-26T23:40:43.637255+0000","last_clean":"2024-04-26T23:40:43.637255+0000","last_became_active":"2024-04-26T23:40:41.689911+0000","last_became_peered":"2024-04-26T23:40:41.689911+0000","last_unstale":"2024-04-26T23:40:43.637255+0000","last_undegraded":"2024-04-26T23:40:43.637255+0000","last_fullsized":"2024-04-26T23:40:43.637255+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:21:56.950703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636863+0000","last_change":"2024-04-26T23:40:32.583376+0000","last_active":"2024-04-26T23:40:43.636863+0000","last_peered":"2024-04-26T23:40:43.636863+0000","last_clean":"2024-04-26T23:40:43.636863+0000","last_became_active":"2024-04-26T23:40:32.583089+0000","last_became_peered":"2024-04-26T23:40:32.583089+0000","last_unstale":"2024-04-26T23:40:43.636863+0000","last_undegraded":"2024-04-26T23:40:43.636863+0000","last_fullsized":"2024-04-26T23:40:43.636863+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:17:46.135806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.635479+0000","last_change":"2024-04-26T23:40:41.688464+0000","last_active":"2024-04-26T23:40:43.635479+0000","last_peered":"2024-04-26T23:40:43.635479+0000","last_clean":"2024-04-26T23:40:43.635479+0000","last_became_active":"2024-04-26T23:40:41.688028+0000","last_became_peered":"2024-04-26T23:40:41.688028+0000","last_unstale":"2024-04-26T23:40:43.635479+0000","last_undegraded":"2024-04-26T23:40:43.635479+0000","last_fullsized":"2024-04-26T23:40:43.635479+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:21:56.950703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.684171+0000","last_change":"2024-04-26T23:40:32.589080+0000","last_active":"2024-04-26T23:40:42.684171+0000","last_peered":"2024-04-26T23:40:42.684171+0000","last_clean":"2024-04-26T23:40:42.684171+0000","last_became_active":"2024-04-26T23:40:32.588793+0000","last_became_peered":"2024-04-26T23:40:32.588793+0000","last_unstale":"2024-04-26T23:40:42.684171+0000","last_undegraded":"2024-04-26T23:40:42.684171+0000","last_fullsized":"2024-04-26T23:40:42.684171+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:18:09.706875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.684432+0000","last_change":"2024-04-26T23:40:41.688445+0000","last_active":"2024-04-26T23:40:42.684432+0000","last_peered":"2024-04-26T23:40:42.684432+0000","last_clean":"2024-04-26T23:40:42.684432+0000","last_became_active":"2024-04-26T23:40:41.688163+0000","last_became_peered":"2024-04-26T23:40:41.688163+0000","last_unstale":"2024-04-26T23:40:42.684432+0000","last_undegraded":"2024-04-26T23:40:42.684432+0000","last_fullsized":"2024-04-26T23:40:42.684432+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:30:04.999018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.637912+0000","last_change":"2024-04-26T23:40:32.588177+0000","last_active":"2024-04-26T23:40:43.637912+0000","last_peered":"2024-04-26T23:40:43.637912+0000","last_clean":"2024-04-26T23:40:43.637912+0000","last_became_active":"2024-04-26T23:40:32.586926+0000","last_became_peered":"2024-04-26T23:40:32.586926+0000","last_unstale":"2024-04-26T23:40:43.637912+0000","last_undegraded":"2024-04-26T23:40:43.637912+0000","last_fullsized":"2024-04-26T23:40:43.637912+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:34:14.811917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.637801+0000","last_change":"2024-04-26T23:40:41.688396+0000","last_active":"2024-04-26T23:40:43.637801+0000","last_peered":"2024-04-26T23:40:43.637801+0000","last_clean":"2024-04-26T23:40:43.637801+0000","last_became_active":"2024-04-26T23:40:41.688087+0000","last_became_peered":"2024-04-26T23:40:41.688087+0000","last_unstale":"2024-04-26T23:40:43.637801+0000","last_undegraded":"2024-04-26T23:40:43.637801+0000","last_fullsized":"2024-04-26T23:40:43.637801+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:00:49.397610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.685486+0000","last_change":"2024-04-26T23:40:32.582959+0000","last_active":"2024-04-26T23:40:42.685486+0000","last_peered":"2024-04-26T23:40:42.685486+0000","last_clean":"2024-04-26T23:40:42.685486+0000","last_became_active":"2024-04-26T23:40:32.582100+0000","last_became_peered":"2024-04-26T23:40:32.582100+0000","last_unstale":"2024-04-26T23:40:42.685486+0000","last_undegraded":"2024-04-26T23:40:42.685486+0000","last_fullsized":"2024-04-26T23:40:42.685486+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:37:30.361795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636150+0000","last_change":"2024-04-26T23:40:41.681088+0000","last_active":"2024-04-26T23:40:43.636150+0000","last_peered":"2024-04-26T23:40:43.636150+0000","last_clean":"2024-04-26T23:40:43.636150+0000","last_became_active":"2024-04-26T23:40:41.680581+0000","last_became_peered":"2024-04-26T23:40:41.680581+0000","last_unstale":"2024-04-26T23:40:43.636150+0000","last_undegraded":"2024-04-26T23:40:43.636150+0000","last_fullsized":"2024-04-26T23:40:43.636150+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:41:52.386084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636996+0000","last_change":"2024-04-26T23:40:32.593958+0000","last_active":"2024-04-26T23:40:43.636996+0000","last_peered":"2024-04-26T23:40:43.636996+0000","last_clean":"2024-04-26T23:40:43.636996+0000","last_became_active":"2024-04-26T23:40:32.593639+0000","last_became_peered":"2024-04-26T23:40:32.593639+0000","last_unstale":"2024-04-26T23:40:43.636996+0000","last_undegraded":"2024-04-26T23:40:43.636996+0000","last_fullsized":"2024-04-26T23:40:43.636996+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:17:46.135806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.635826+0000","last_change":"2024-04-26T23:40:41.674573+0000","last_active":"2024-04-26T23:40:43.635826+0000","last_peered":"2024-04-26T23:40:43.635826+0000","last_clean":"2024-04-26T23:40:43.635826+0000","last_became_active":"2024-04-26T23:40:41.674274+0000","last_became_peered":"2024-04-26T23:40:41.674274+0000","last_unstale":"2024-04-26T23:40:43.635826+0000","last_undegraded":"2024-04-26T23:40:43.635826+0000","last_fullsized":"2024-04-26T23:40:43.635826+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:37:39.460955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.684563+0000","last_change":"2024-04-26T23:40:32.591700+0000","last_active":"2024-04-26T23:40:42.684563+0000","last_peered":"2024-04-26T23:40:42.684563+0000","last_clean":"2024-04-26T23:40:42.684563+0000","last_became_active":"2024-04-26T23:40:32.591366+0000","last_became_peered":"2024-04-26T23:40:32.591366+0000","last_unstale":"2024-04-26T23:40:42.684563+0000","last_undegraded":"2024-04-26T23:40:42.684563+0000","last_fullsized":"2024-04-26T23:40:42.684563+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:10:02.629199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.637569+0000","last_change":"2024-04-26T23:40:41.692402+0000","last_active":"2024-04-26T23:40:43.637569+0000","last_peered":"2024-04-26T23:40:43.637569+0000","last_clean":"2024-04-26T23:40:43.637569+0000","last_became_active":"2024-04-26T23:40:41.692122+0000","last_became_peered":"2024-04-26T23:40:41.692122+0000","last_unstale":"2024-04-26T23:40:43.637569+0000","last_undegraded":"2024-04-26T23:40:43.637569+0000","last_fullsized":"2024-04-26T23:40:43.637569+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:06:12.755431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.686711+0000","last_change":"2024-04-26T23:40:32.590443+0000","last_active":"2024-04-26T23:40:42.686711+0000","last_peered":"2024-04-26T23:40:42.686711+0000","last_clean":"2024-04-26T23:40:42.686711+0000","last_became_active":"2024-04-26T23:40:32.590193+0000","last_became_peered":"2024-04-26T23:40:32.590193+0000","last_unstale":"2024-04-26T23:40:42.686711+0000","last_undegraded":"2024-04-26T23:40:42.686711+0000","last_fullsized":"2024-04-26T23:40:42.686711+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:14:04.372681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636077+0000","last_change":"2024-04-26T23:40:41.692194+0000","last_active":"2024-04-26T23:40:43.636077+0000","last_peered":"2024-04-26T23:40:43.636077+0000","last_clean":"2024-04-26T23:40:43.636077+0000","last_became_active":"2024-04-26T23:40:41.691837+0000","last_became_peered":"2024-04-26T23:40:41.691837+0000","last_unstale":"2024-04-26T23:40:43.636077+0000","last_undegraded":"2024-04-26T23:40:43.636077+0000","last_fullsized":"2024-04-26T23:40:43.636077+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:58:45.972045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.683546+0000","last_change":"2024-04-26T23:40:32.590538+0000","last_active":"2024-04-26T23:40:42.683546+0000","last_peered":"2024-04-26T23:40:42.683546+0000","last_clean":"2024-04-26T23:40:42.683546+0000","last_became_active":"2024-04-26T23:40:32.590241+0000","last_became_peered":"2024-04-26T23:40:32.590241+0000","last_unstale":"2024-04-26T23:40:42.683546+0000","last_undegraded":"2024-04-26T23:40:42.683546+0000","last_fullsized":"2024-04-26T23:40:42.683546+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:38:10.884592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636930+0000","last_change":"2024-04-26T23:40:41.689529+0000","last_active":"2024-04-26T23:40:43.636930+0000","last_peered":"2024-04-26T23:40:43.636930+0000","last_clean":"2024-04-26T23:40:43.636930+0000","last_became_active":"2024-04-26T23:40:41.689215+0000","last_became_peered":"2024-04-26T23:40:41.689215+0000","last_unstale":"2024-04-26T23:40:43.636930+0000","last_undegraded":"2024-04-26T23:40:43.636930+0000","last_fullsized":"2024-04-26T23:40:43.636930+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:38:42.155257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.637293+0000","last_change":"2024-04-26T23:40:32.588445+0000","last_active":"2024-04-26T23:40:43.637293+0000","last_peered":"2024-04-26T23:40:43.637293+0000","last_clean":"2024-04-26T23:40:43.637293+0000","last_became_active":"2024-04-26T23:40:32.588063+0000","last_became_peered":"2024-04-26T23:40:32.588063+0000","last_unstale":"2024-04-26T23:40:43.637293+0000","last_undegraded":"2024-04-26T23:40:43.637293+0000","last_fullsized":"2024-04-26T23:40:43.637293+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:44:58.977344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.684980+0000","last_change":"2024-04-26T23:40:41.674893+0000","last_active":"2024-04-26T23:40:42.684980+0000","last_peered":"2024-04-26T23:40:42.684980+0000","last_clean":"2024-04-26T23:40:42.684980+0000","last_became_active":"2024-04-26T23:40:41.674573+0000","last_became_peered":"2024-04-26T23:40:41.674573+0000","last_unstale":"2024-04-26T23:40:42.684980+0000","last_undegraded":"2024-04-26T23:40:42.684980+0000","last_fullsized":"2024-04-26T23:40:42.684980+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:36:21.487122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636258+0000","last_change":"2024-04-26T23:40:32.574795+0000","last_active":"2024-04-26T23:40:43.636258+0000","last_peered":"2024-04-26T23:40:43.636258+0000","last_clean":"2024-04-26T23:40:43.636258+0000","last_became_active":"2024-04-26T23:40:32.574503+0000","last_became_peered":"2024-04-26T23:40:32.574503+0000","last_unstale":"2024-04-26T23:40:43.636258+0000","last_undegraded":"2024-04-26T23:40:43.636258+0000","last_fullsized":"2024-04-26T23:40:43.636258+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:30:11.401955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.686330+0000","last_change":"2024-04-26T23:40:41.680247+0000","last_active":"2024-04-26T23:40:42.686330+0000","last_peered":"2024-04-26T23:40:42.686330+0000","last_clean":"2024-04-26T23:40:42.686330+0000","last_became_active":"2024-04-26T23:40:41.679920+0000","last_became_peered":"2024-04-26T23:40:41.679920+0000","last_unstale":"2024-04-26T23:40:42.686330+0000","last_undegraded":"2024-04-26T23:40:42.686330+0000","last_fullsized":"2024-04-26T23:40:42.686330+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:53:13.531466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.685801+0000","last_change":"2024-04-26T23:40:32.593432+0000","last_active":"2024-04-26T23:40:42.685801+0000","last_peered":"2024-04-26T23:40:42.685801+0000","last_clean":"2024-04-26T23:40:42.685801+0000","last_became_active":"2024-04-26T23:40:32.593169+0000","last_became_peered":"2024-04-26T23:40:32.593169+0000","last_unstale":"2024-04-26T23:40:42.685801+0000","last_undegraded":"2024-04-26T23:40:42.685801+0000","last_fullsized":"2024-04-26T23:40:42.685801+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:44:42.494850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.635935+0000","last_change":"2024-04-26T23:40:41.694551+0000","last_active":"2024-04-26T23:40:43.635935+0000","last_peered":"2024-04-26T23:40:43.635935+0000","last_clean":"2024-04-26T23:40:43.635935+0000","last_became_active":"2024-04-26T23:40:41.694297+0000","last_became_peered":"2024-04-26T23:40:41.694297+0000","last_unstale":"2024-04-26T23:40:43.635935+0000","last_undegraded":"2024-04-26T23:40:43.635935+0000","last_fullsized":"2024-04-26T23:40:43.635935+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:02:27.160408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.685388+0000","last_change":"2024-04-26T23:40:32.585137+0000","last_active":"2024-04-26T23:40:42.685388+0000","last_peered":"2024-04-26T23:40:42.685388+0000","last_clean":"2024-04-26T23:40:42.685388+0000","last_became_active":"2024-04-26T23:40:32.584678+0000","last_became_peered":"2024-04-26T23:40:32.584678+0000","last_unstale":"2024-04-26T23:40:42.685388+0000","last_undegraded":"2024-04-26T23:40:42.685388+0000","last_fullsized":"2024-04-26T23:40:42.685388+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:04:30.553552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636071+0000","last_change":"2024-04-26T23:40:41.692433+0000","last_active":"2024-04-26T23:40:43.636071+0000","last_peered":"2024-04-26T23:40:43.636071+0000","last_clean":"2024-04-26T23:40:43.636071+0000","last_became_active":"2024-04-26T23:40:41.692090+0000","last_became_peered":"2024-04-26T23:40:41.692090+0000","last_unstale":"2024-04-26T23:40:43.636071+0000","last_undegraded":"2024-04-26T23:40:43.636071+0000","last_fullsized":"2024-04-26T23:40:43.636071+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:37:25.006229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.635522+0000","last_change":"2024-04-26T23:40:32.590452+0000","last_active":"2024-04-26T23:40:43.635522+0000","last_peered":"2024-04-26T23:40:43.635522+0000","last_clean":"2024-04-26T23:40:43.635522+0000","last_became_active":"2024-04-26T23:40:32.590162+0000","last_became_peered":"2024-04-26T23:40:32.590162+0000","last_unstale":"2024-04-26T23:40:43.635522+0000","last_undegraded":"2024-04-26T23:40:43.635522+0000","last_fullsized":"2024-04-26T23:40:43.635522+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:51:30.677247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.685014+0000","last_change":"2024-04-26T23:40:41.687270+0000","last_active":"2024-04-26T23:40:42.685014+0000","last_peered":"2024-04-26T23:40:42.685014+0000","last_clean":"2024-04-26T23:40:42.685014+0000","last_became_active":"2024-04-26T23:40:41.686999+0000","last_became_peered":"2024-04-26T23:40:41.686999+0000","last_unstale":"2024-04-26T23:40:42.685014+0000","last_undegraded":"2024-04-26T23:40:42.685014+0000","last_fullsized":"2024-04-26T23:40:42.685014+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:21:42.565349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.686378+0000","last_change":"2024-04-26T23:40:32.586436+0000","last_active":"2024-04-26T23:40:42.686378+0000","last_peered":"2024-04-26T23:40:42.686378+0000","last_clean":"2024-04-26T23:40:42.686378+0000","last_became_active":"2024-04-26T23:40:32.585995+0000","last_became_peered":"2024-04-26T23:40:32.585995+0000","last_unstale":"2024-04-26T23:40:42.686378+0000","last_undegraded":"2024-04-26T23:40:42.686378+0000","last_fullsized":"2024-04-26T23:40:42.686378+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:10:42.603833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.637180+0000","last_change":"2024-04-26T23:40:41.691693+0000","last_active":"2024-04-26T23:40:43.637180+0000","last_peered":"2024-04-26T23:40:43.637180+0000","last_clean":"2024-04-26T23:40:43.637180+0000","last_became_active":"2024-04-26T23:40:41.691437+0000","last_became_peered":"2024-04-26T23:40:41.691437+0000","last_unstale":"2024-04-26T23:40:43.637180+0000","last_undegraded":"2024-04-26T23:40:43.637180+0000","last_fullsized":"2024-04-26T23:40:43.637180+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:06:12.755431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.637343+0000","last_change":"2024-04-26T23:40:32.592988+0000","last_active":"2024-04-26T23:40:43.637343+0000","last_peered":"2024-04-26T23:40:43.637343+0000","last_clean":"2024-04-26T23:40:43.637343+0000","last_became_active":"2024-04-26T23:40:32.592717+0000","last_became_peered":"2024-04-26T23:40:32.592717+0000","last_unstale":"2024-04-26T23:40:43.637343+0000","last_undegraded":"2024-04-26T23:40:43.637343+0000","last_fullsized":"2024-04-26T23:40:43.637343+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:18:09.706875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.637029+0000","last_change":"2024-04-26T23:40:41.675335+0000","last_active":"2024-04-26T23:40:43.637029+0000","last_peered":"2024-04-26T23:40:43.637029+0000","last_clean":"2024-04-26T23:40:43.637029+0000","last_became_active":"2024-04-26T23:40:41.675042+0000","last_became_peered":"2024-04-26T23:40:41.675042+0000","last_unstale":"2024-04-26T23:40:43.637029+0000","last_undegraded":"2024-04-26T23:40:43.637029+0000","last_fullsized":"2024-04-26T23:40:43.637029+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:41:52.386084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636813+0000","last_change":"2024-04-26T23:40:32.595129+0000","last_active":"2024-04-26T23:40:43.636813+0000","last_peered":"2024-04-26T23:40:43.636813+0000","last_clean":"2024-04-26T23:40:43.636813+0000","last_became_active":"2024-04-26T23:40:32.594802+0000","last_became_peered":"2024-04-26T23:40:32.594802+0000","last_unstale":"2024-04-26T23:40:43.636813+0000","last_undegraded":"2024-04-26T23:40:43.636813+0000","last_fullsized":"2024-04-26T23:40:43.636813+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:48:33.020039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636362+0000","last_change":"2024-04-26T23:40:41.691159+0000","last_active":"2024-04-26T23:40:43.636362+0000","last_peered":"2024-04-26T23:40:43.636362+0000","last_clean":"2024-04-26T23:40:43.636362+0000","last_became_active":"2024-04-26T23:40:41.690846+0000","last_became_peered":"2024-04-26T23:40:41.690846+0000","last_unstale":"2024-04-26T23:40:43.636362+0000","last_undegraded":"2024-04-26T23:40:43.636362+0000","last_fullsized":"2024-04-26T23:40:43.636362+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:45:08.076505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.683726+0000","last_change":"2024-04-26T23:40:32.578819+0000","last_active":"2024-04-26T23:40:42.683726+0000","last_peered":"2024-04-26T23:40:42.683726+0000","last_clean":"2024-04-26T23:40:42.683726+0000","last_became_active":"2024-04-26T23:40:32.578556+0000","last_became_peered":"2024-04-26T23:40:32.578556+0000","last_unstale":"2024-04-26T23:40:42.683726+0000","last_undegraded":"2024-04-26T23:40:42.683726+0000","last_fullsized":"2024-04-26T23:40:42.683726+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:17:46.135806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.635820+0000","last_change":"2024-04-26T23:40:41.689812+0000","last_active":"2024-04-26T23:40:43.635820+0000","last_peered":"2024-04-26T23:40:43.635820+0000","last_clean":"2024-04-26T23:40:43.635820+0000","last_became_active":"2024-04-26T23:40:41.689267+0000","last_became_peered":"2024-04-26T23:40:41.689267+0000","last_unstale":"2024-04-26T23:40:43.635820+0000","last_undegraded":"2024-04-26T23:40:43.635820+0000","last_fullsized":"2024-04-26T23:40:43.635820+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:21:42.565349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.684116+0000","last_change":"2024-04-26T23:40:32.578155+0000","last_active":"2024-04-26T23:40:42.684116+0000","last_peered":"2024-04-26T23:40:42.684116+0000","last_clean":"2024-04-26T23:40:42.684116+0000","last_became_active":"2024-04-26T23:40:32.577865+0000","last_became_peered":"2024-04-26T23:40:32.577865+0000","last_unstale":"2024-04-26T23:40:42.684116+0000","last_undegraded":"2024-04-26T23:40:42.684116+0000","last_fullsized":"2024-04-26T23:40:42.684116+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:40:17.167353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.685252+0000","last_change":"2024-04-26T23:40:41.680962+0000","last_active":"2024-04-26T23:40:42.685252+0000","last_peered":"2024-04-26T23:40:42.685252+0000","last_clean":"2024-04-26T23:40:42.685252+0000","last_became_active":"2024-04-26T23:40:41.680676+0000","last_became_peered":"2024-04-26T23:40:41.680676+0000","last_unstale":"2024-04-26T23:40:42.685252+0000","last_undegraded":"2024-04-26T23:40:42.685252+0000","last_fullsized":"2024-04-26T23:40:42.685252+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:42:13.754586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636455+0000","last_change":"2024-04-26T23:40:32.591487+0000","last_active":"2024-04-26T23:40:43.636455+0000","last_peered":"2024-04-26T23:40:43.636455+0000","last_clean":"2024-04-26T23:40:43.636455+0000","last_became_active":"2024-04-26T23:40:32.591209+0000","last_became_peered":"2024-04-26T23:40:32.591209+0000","last_unstale":"2024-04-26T23:40:43.636455+0000","last_undegraded":"2024-04-26T23:40:43.636455+0000","last_fullsized":"2024-04-26T23:40:43.636455+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:52:26.699790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.637724+0000","last_change":"2024-04-26T23:40:41.686089+0000","last_active":"2024-04-26T23:40:43.637724+0000","last_peered":"2024-04-26T23:40:43.637724+0000","last_clean":"2024-04-26T23:40:43.637724+0000","last_became_active":"2024-04-26T23:40:41.685786+0000","last_became_peered":"2024-04-26T23:40:41.685786+0000","last_unstale":"2024-04-26T23:40:43.637724+0000","last_undegraded":"2024-04-26T23:40:43.637724+0000","last_fullsized":"2024-04-26T23:40:43.637724+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:36:02.931532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636676+0000","last_change":"2024-04-26T23:40:32.592543+0000","last_active":"2024-04-26T23:40:43.636676+0000","last_peered":"2024-04-26T23:40:43.636676+0000","last_clean":"2024-04-26T23:40:43.636676+0000","last_became_active":"2024-04-26T23:40:32.592282+0000","last_became_peered":"2024-04-26T23:40:32.592282+0000","last_unstale":"2024-04-26T23:40:43.636676+0000","last_undegraded":"2024-04-26T23:40:43.636676+0000","last_fullsized":"2024-04-26T23:40:43.636676+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:16:46.547536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3f","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.684024+0000","last_change":"2024-04-26T23:40:41.679306+0000","last_active":"2024-04-26T23:40:42.684024+0000","last_peered":"2024-04-26T23:40:42.684024+0000","last_clean":"2024-04-26T23:40:42.684024+0000","last_became_active":"2024-04-26T23:40:41.678926+0000","last_became_peered":"2024-04-26T23:40:41.678926+0000","last_unstale":"2024-04-26T23:40:42.684024+0000","last_undegraded":"2024-04-26T23:40:42.684024+0000","last_fullsized":"2024-04-26T23:40:42.684024+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:27:48.823509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.637039+0000","last_change":"2024-04-26T23:40:32.587562+0000","last_active":"2024-04-26T23:40:43.637039+0000","last_peered":"2024-04-26T23:40:43.637039+0000","last_clean":"2024-04-26T23:40:43.637039+0000","last_became_active":"2024-04-26T23:40:32.587249+0000","last_became_peered":"2024-04-26T23:40:32.587249+0000","last_unstale":"2024-04-26T23:40:43.637039+0000","last_undegraded":"2024-04-26T23:40:43.637039+0000","last_fullsized":"2024-04-26T23:40:43.637039+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:12:45.093169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.635956+0000","last_change":"2024-04-26T23:40:41.689567+0000","last_active":"2024-04-26T23:40:43.635956+0000","last_peered":"2024-04-26T23:40:43.635956+0000","last_clean":"2024-04-26T23:40:43.635956+0000","last_became_active":"2024-04-26T23:40:41.688585+0000","last_became_peered":"2024-04-26T23:40:41.688585+0000","last_unstale":"2024-04-26T23:40:43.635956+0000","last_undegraded":"2024-04-26T23:40:43.635956+0000","last_fullsized":"2024-04-26T23:40:43.635956+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:10:57.826183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.684566+0000","last_change":"2024-04-26T23:40:32.584619+0000","last_active":"2024-04-26T23:40:42.684566+0000","last_peered":"2024-04-26T23:40:42.684566+0000","last_clean":"2024-04-26T23:40:42.684566+0000","last_became_active":"2024-04-26T23:40:32.584293+0000","last_became_peered":"2024-04-26T23:40:32.584293+0000","last_unstale":"2024-04-26T23:40:42.684566+0000","last_undegraded":"2024-04-26T23:40:42.684566+0000","last_fullsized":"2024-04-26T23:40:42.684566+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:40:17.167353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.685557+0000","last_change":"2024-04-26T23:40:41.691614+0000","last_active":"2024-04-26T23:40:42.685557+0000","last_peered":"2024-04-26T23:40:42.685557+0000","last_clean":"2024-04-26T23:40:42.685557+0000","last_became_active":"2024-04-26T23:40:41.691081+0000","last_became_peered":"2024-04-26T23:40:41.691081+0000","last_unstale":"2024-04-26T23:40:42.685557+0000","last_undegraded":"2024-04-26T23:40:42.685557+0000","last_fullsized":"2024-04-26T23:40:42.685557+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:24:07.784468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636557+0000","last_change":"2024-04-26T23:40:32.588894+0000","last_active":"2024-04-26T23:40:43.636557+0000","last_peered":"2024-04-26T23:40:43.636557+0000","last_clean":"2024-04-26T23:40:43.636557+0000","last_became_active":"2024-04-26T23:40:32.588409+0000","last_became_peered":"2024-04-26T23:40:32.588409+0000","last_unstale":"2024-04-26T23:40:43.636557+0000","last_undegraded":"2024-04-26T23:40:43.636557+0000","last_fullsized":"2024-04-26T23:40:43.636557+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:35:08.194865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636899+0000","last_change":"2024-04-26T23:40:41.678639+0000","last_active":"2024-04-26T23:40:43.636899+0000","last_peered":"2024-04-26T23:40:43.636899+0000","last_clean":"2024-04-26T23:40:43.636899+0000","last_became_active":"2024-04-26T23:40:41.678333+0000","last_became_peered":"2024-04-26T23:40:41.678333+0000","last_unstale":"2024-04-26T23:40:43.636899+0000","last_undegraded":"2024-04-26T23:40:43.636899+0000","last_fullsized":"2024-04-26T23:40:43.636899+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:42:13.754586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.685161+0000","last_change":"2024-04-26T23:40:32.581875+0000","last_active":"2024-04-26T23:40:42.685161+0000","last_peered":"2024-04-26T23:40:42.685161+0000","last_clean":"2024-04-26T23:40:42.685161+0000","last_became_active":"2024-04-26T23:40:32.580987+0000","last_became_peered":"2024-04-26T23:40:32.580987+0000","last_unstale":"2024-04-26T23:40:42.685161+0000","last_undegraded":"2024-04-26T23:40:42.685161+0000","last_fullsized":"2024-04-26T23:40:42.685161+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:12:45.093169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636219+0000","last_change":"2024-04-26T23:40:41.678366+0000","last_active":"2024-04-26T23:40:43.636219+0000","last_peered":"2024-04-26T23:40:43.636219+0000","last_clean":"2024-04-26T23:40:43.636219+0000","last_became_active":"2024-04-26T23:40:41.678067+0000","last_became_peered":"2024-04-26T23:40:41.678067+0000","last_unstale":"2024-04-26T23:40:43.636219+0000","last_undegraded":"2024-04-26T23:40:43.636219+0000","last_fullsized":"2024-04-26T23:40:43.636219+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:44:51.594010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.686634+0000","last_change":"2024-04-26T23:40:32.579870+0000","last_active":"2024-04-26T23:40:42.686634+0000","last_peered":"2024-04-26T23:40:42.686634+0000","last_clean":"2024-04-26T23:40:42.686634+0000","last_became_active":"2024-04-26T23:40:32.579569+0000","last_became_peered":"2024-04-26T23:40:32.579569+0000","last_unstale":"2024-04-26T23:40:42.686634+0000","last_undegraded":"2024-04-26T23:40:42.686634+0000","last_fullsized":"2024-04-26T23:40:42.686634+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:25:30.040358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.635430+0000","last_change":"2024-04-26T23:40:41.684020+0000","last_active":"2024-04-26T23:40:43.635430+0000","last_peered":"2024-04-26T23:40:43.635430+0000","last_clean":"2024-04-26T23:40:43.635430+0000","last_became_active":"2024-04-26T23:40:41.683734+0000","last_became_peered":"2024-04-26T23:40:41.683734+0000","last_unstale":"2024-04-26T23:40:43.635430+0000","last_undegraded":"2024-04-26T23:40:43.635430+0000","last_fullsized":"2024-04-26T23:40:43.635430+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:38:42.155257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636264+0000","last_change":"2024-04-26T23:40:32.583944+0000","last_active":"2024-04-26T23:40:43.636264+0000","last_peered":"2024-04-26T23:40:43.636264+0000","last_clean":"2024-04-26T23:40:43.636264+0000","last_became_active":"2024-04-26T23:40:32.583655+0000","last_became_peered":"2024-04-26T23:40:32.583655+0000","last_unstale":"2024-04-26T23:40:43.636264+0000","last_undegraded":"2024-04-26T23:40:43.636264+0000","last_fullsized":"2024-04-26T23:40:43.636264+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:40:17.167353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.635858+0000","last_change":"2024-04-26T23:40:41.681412+0000","last_active":"2024-04-26T23:40:43.635858+0000","last_peered":"2024-04-26T23:40:43.635858+0000","last_clean":"2024-04-26T23:40:43.635858+0000","last_became_active":"2024-04-26T23:40:41.681092+0000","last_became_peered":"2024-04-26T23:40:41.681092+0000","last_unstale":"2024-04-26T23:40:43.635858+0000","last_undegraded":"2024-04-26T23:40:43.635858+0000","last_fullsized":"2024-04-26T23:40:43.635858+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:48:09.126894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636358+0000","last_change":"2024-04-26T23:40:32.596351+0000","last_active":"2024-04-26T23:40:43.636358+0000","last_peered":"2024-04-26T23:40:43.636358+0000","last_clean":"2024-04-26T23:40:43.636358+0000","last_became_active":"2024-04-26T23:40:32.596050+0000","last_became_peered":"2024-04-26T23:40:32.596050+0000","last_unstale":"2024-04-26T23:40:43.636358+0000","last_undegraded":"2024-04-26T23:40:43.636358+0000","last_fullsized":"2024-04-26T23:40:43.636358+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:34:14.811917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574857,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27856,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343984,"statfs":{"total":96636764160,"available":96608239616,"internally_reserved":0,"allocated":856064,"data_stored":690301,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574858,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":274432,"data_stored":101489,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574858,"num_pgs":54,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":266240,"data_stored":100023,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574859,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":274432,"data_stored":99491,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574857,"num_pgs":59,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":282624,"data_stored":102507,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574857,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":258048,"data_stored":99331,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574857,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":278528,"data_stored":101055,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574859,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27864,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343976,"statfs":{"total":96636764160,"available":96608231424,"internally_reserved":0,"allocated":860160,"data_stored":690267,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T23:40:50.020 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T23:40:50.150 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:50.146+0000 7f98e475f640 1 Processor -- start 2024-04-26T23:40:50.150 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:50.146+0000 7f98e475f640 1 -- start start 2024-04-26T23:40:50.152 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:50.147+0000 7f98e475f640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f98dc0c6e20 0x7f98dc0c7200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:50.152 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:50.147+0000 7f98e475f640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f98dc0ca3a0 0x7f98dc157630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:50.152 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:50.147+0000 7f98e475f640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f98dc15a530 con 0x7f98dc0740e0 2024-04-26T23:40:50.152 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:50.147+0000 7f98e475f640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f98dc072930 con 0x7f98dc0ca3a0 2024-04-26T23:40:50.152 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:50.147+0000 7f98e475f640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f98dc15a810 con 0x7f98dc0c6e20 2024-04-26T23:40:50.152 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:50.147+0000 7f98e2cfc640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f98dc0ca3a0 0x7f98dc157630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:50.152 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:50.147+0000 7f98e2cfc640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f98dc0ca3a0 0x7f98dc157630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:41654/0 (socket says 172.21.15.88:41654) 2024-04-26T23:40:50.152 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:50.147+0000 7f98e2cfc640 1 -- 172.21.15.88:0/2226878752 learned_addr learned my addr 172.21.15.88:0/2226878752 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:40:50.152 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:50.147+0000 7f98e2cfc640 1 -- 172.21.15.88:0/2226878752 >> v2:172.21.15.175:3300/0 conn(0x7f98dc0c6e20 msgr2=0x7f98dc0c7200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:40:50.152 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:50.147+0000 7f98e24fb640 1 --2- 172.21.15.88:0/2226878752 >> v2:172.21.15.175:3300/0 conn(0x7f98dc0c6e20 0x7f98dc0c7200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:50.153 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:50.147+0000 7f98e2cfc640 1 --2- 172.21.15.88:0/2226878752 >> v2:172.21.15.175:3300/0 conn(0x7f98dc0c6e20 0x7f98dc0c7200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:50.153 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:50.147+0000 7f98e2cfc640 1 -- 172.21.15.88:0/2226878752 >> v1:172.21.15.175:6789/0 conn(0x7f98dc0740e0 legacy=0x7f98dc156f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:40:50.153 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:50.147+0000 7f98e2cfc640 1 -- 172.21.15.88:0/2226878752 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98dc15aaf0 con 0x7f98dc0ca3a0 2024-04-26T23:40:50.153 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:50.148+0000 7f98e2cfc640 1 --2- 172.21.15.88:0/2226878752 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f98dc0ca3a0 0x7f98dc157630 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f98dc0af0b0 tx=0x7f98d402a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd1797083b1ed7b4 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:50.153 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:50.148+0000 7f98e14f9640 1 -- 172.21.15.88:0/2226878752 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98d4036070 con 0x7f98dc0ca3a0 2024-04-26T23:40:50.153 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:50.148+0000 7f98e14f9640 1 -- 172.21.15.88:0/2226878752 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98d4031600 con 0x7f98dc0ca3a0 2024-04-26T23:40:50.153 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:50.148+0000 7f98e14f9640 1 -- 172.21.15.88:0/2226878752 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98d40319d0 con 0x7f98dc0ca3a0 2024-04-26T23:40:50.157 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:50.148+0000 7f98e475f640 1 -- 172.21.15.88:0/2226878752 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f98dc0ca3a0 msgr2=0x7f98dc157630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:50.157 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:50.148+0000 7f98e475f640 1 --2- 172.21.15.88:0/2226878752 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f98dc0ca3a0 0x7f98dc157630 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f98dc0af0b0 tx=0x7f98d402a660 comp rx=0 tx=0).stop 2024-04-26T23:40:50.157 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:50.149+0000 7f98e475f640 1 -- 172.21.15.88:0/2226878752 shutdown_connections 2024-04-26T23:40:50.157 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:50.149+0000 7f98e475f640 1 --2- 172.21.15.88:0/2226878752 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f98dc0ca3a0 0x7f98dc157630 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:50.157 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:50.149+0000 7f98e475f640 1 --2- 172.21.15.88:0/2226878752 >> v2:172.21.15.175:3300/0 conn(0x7f98dc0c6e20 0x7f98dc0c7200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:50.157 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:50.149+0000 7f98e475f640 1 -- 172.21.15.88:0/2226878752 >> 172.21.15.88:0/2226878752 conn(0x7f98dc0ae0b0 msgr2=0x7f98dc0ae490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:40:50.157 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:50.149+0000 7f98e475f640 1 -- 172.21.15.88:0/2226878752 shutdown_connections 2024-04-26T23:40:50.157 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:50.149+0000 7f98e475f640 1 -- 172.21.15.88:0/2226878752 wait complete. 2024-04-26T23:40:50.157 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:50.150+0000 7f98e475f640 1 Processor -- start 2024-04-26T23:40:50.157 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:50.150+0000 7f98e475f640 1 -- start start 2024-04-26T23:40:50.157 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:50.150+0000 7f98e475f640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f98dc0740e0 0x7f98dc1ed560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:50.158 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:50.150+0000 7f98e475f640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f98dc0c6e20 0x7f98dc0c2710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:50.158 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:50.150+0000 7f98e475f640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f98dc0ca3a0 0x7f98dc158df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:50.158 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:50.150+0000 7f98e475f640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f98dc154540 con 0x7f98dc0ca3a0 2024-04-26T23:40:50.158 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:50.150+0000 7f98e475f640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f98dc1543c0 con 0x7f98dc0740e0 2024-04-26T23:40:50.158 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:50.150+0000 7f98e475f640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f98dc15a0c0 con 0x7f98dc0c6e20 2024-04-26T23:40:50.158 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:50.150+0000 7f98e2cfc640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f98dc0ca3a0 0x7f98dc158df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:50.158 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:50.150+0000 7f98e2cfc640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f98dc0ca3a0 0x7f98dc158df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:41660/0 (socket says 172.21.15.88:41660) 2024-04-26T23:40:50.158 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:50.150+0000 7f98e2cfc640 1 -- 172.21.15.88:0/1299219531 learned_addr learned my addr 172.21.15.88:0/1299219531 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:40:50.158 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:50.151+0000 7f98e24fb640 1 --2- 172.21.15.88:0/1299219531 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f98dc0740e0 0x7f98dc1ed560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:50.158 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:50.151+0000 7f98e1cfa640 1 --2- 172.21.15.88:0/1299219531 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f98dc0c6e20 0x7f98dc0c2710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:50.158 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:50.151+0000 7f98e2cfc640 1 -- 172.21.15.88:0/1299219531 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f98dc0c6e20 msgr2=0x7f98dc0c2710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:50.158 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:50.151+0000 7f98e2cfc640 1 --2- 172.21.15.88:0/1299219531 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f98dc0c6e20 0x7f98dc0c2710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:50.158 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:50.151+0000 7f98e2cfc640 1 -- 172.21.15.88:0/1299219531 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f98dc0740e0 msgr2=0x7f98dc1ed560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:50.158 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:50.151+0000 7f98e2cfc640 1 --2- 172.21.15.88:0/1299219531 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f98dc0740e0 0x7f98dc1ed560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:50.159 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:50.151+0000 7f98e2cfc640 1 -- 172.21.15.88:0/1299219531 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98dc1f0db0 con 0x7f98dc0ca3a0 2024-04-26T23:40:50.159 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:50.151+0000 7f98e24fb640 1 --2- 172.21.15.88:0/1299219531 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f98dc0740e0 0x7f98dc1ed560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:40:50.159 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:50.151+0000 7f98e1cfa640 1 --2- 172.21.15.88:0/1299219531 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f98dc0c6e20 0x7f98dc0c2710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:40:50.159 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:50.151+0000 7f98e2cfc640 1 --2- 172.21.15.88:0/1299219531 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f98dc0ca3a0 0x7f98dc158df0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f98d4009f40 tx=0x7f98d4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:50.159 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:50.151+0000 7f98d2ffd640 1 -- 172.21.15.88:0/1299219531 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98d4036050 con 0x7f98dc0ca3a0 2024-04-26T23:40:50.159 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:50.151+0000 7f98d2ffd640 1 -- 172.21.15.88:0/1299219531 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98d4042070 con 0x7f98dc0ca3a0 2024-04-26T23:40:50.159 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:50.151+0000 7f98d2ffd640 1 -- 172.21.15.88:0/1299219531 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98d4009510 con 0x7f98dc0ca3a0 2024-04-26T23:40:50.159 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:50.151+0000 7f98e475f640 1 -- 172.21.15.88:0/1299219531 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98dc1f0ad0 con 0x7f98dc0ca3a0 2024-04-26T23:40:50.159 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:50.151+0000 7f98e475f640 1 -- 172.21.15.88:0/1299219531 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98dc1ecd60 con 0x7f98dc0ca3a0 2024-04-26T23:40:50.159 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:50.152+0000 7f98e475f640 1 -- 172.21.15.88:0/1299219531 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f98dc0766c0 con 0x7f98dc0ca3a0 2024-04-26T23:40:50.159 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:50.152+0000 7f98d2ffd640 1 -- 172.21.15.88:0/1299219531 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f98d4007bd0 con 0x7f98dc0ca3a0 2024-04-26T23:40:50.159 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:50.153+0000 7f98d2ffd640 1 --2- 172.21.15.88:0/1299219531 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f98c006c8f0 0x7f98c006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:50.159 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:50.153+0000 7f98e24fb640 1 --2- 172.21.15.88:0/1299219531 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f98c006c8f0 0x7f98c006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:50.159 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:50.153+0000 7f98d2ffd640 1 -- 172.21.15.88:0/1299219531 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7f98d40aced0 con 0x7f98dc0ca3a0 2024-04-26T23:40:50.160 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:50.153+0000 7f98e24fb640 1 --2- 172.21.15.88:0/1299219531 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f98c006c8f0 0x7f98c006edb0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f98d8008890 tx=0x7f98d8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:50.161 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:50.157+0000 7f98d2ffd640 1 -- 172.21.15.88:0/1299219531 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f98d407af40 con 0x7f98dc0ca3a0 2024-04-26T23:40:50.335 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:50.332+0000 7f98e475f640 1 -- 172.21.15.88:0/1299219531 --> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f98dc0507a0 con 0x7f98c006c8f0 2024-04-26T23:40:50.346 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:50.342+0000 7f98d2ffd640 1 -- 172.21.15.88:0/1299219531 <== mgr.4104 v2:172.21.15.88:6832/651674297 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+490305 (secure 0 0 0) 0x7f98dc0507a0 con 0x7f98c006c8f0 2024-04-26T23:40:50.352 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-26T23:40:50.355 INFO:teuthology.orchestra.run.smithi088.stderr:dumped all 2024-04-26T23:40:50.357 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:50.346+0000 7f98e475f640 1 -- 172.21.15.88:0/1299219531 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f98c006c8f0 msgr2=0x7f98c006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:50.357 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:50.346+0000 7f98e475f640 1 --2- 172.21.15.88:0/1299219531 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f98c006c8f0 0x7f98c006edb0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f98d8008890 tx=0x7f98d8008040 comp rx=0 tx=0).stop 2024-04-26T23:40:50.357 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:50.346+0000 7f98e475f640 1 -- 172.21.15.88:0/1299219531 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f98dc0ca3a0 msgr2=0x7f98dc158df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:50.357 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:50.346+0000 7f98e475f640 1 --2- 172.21.15.88:0/1299219531 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f98dc0ca3a0 0x7f98dc158df0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f98d4009f40 tx=0x7f98d4004a40 comp rx=0 tx=0).stop 2024-04-26T23:40:50.357 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:50.346+0000 7f98e475f640 1 -- 172.21.15.88:0/1299219531 shutdown_connections 2024-04-26T23:40:50.357 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:50.346+0000 7f98e475f640 1 --2- 172.21.15.88:0/1299219531 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f98c006c8f0 0x7f98c006edb0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:50.357 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:50.346+0000 7f98e475f640 1 --2- 172.21.15.88:0/1299219531 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f98dc0c6e20 0x7f98dc0c2710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:50.357 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:50.346+0000 7f98e475f640 1 --2- 172.21.15.88:0/1299219531 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f98dc0ca3a0 0x7f98dc158df0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:50.357 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:50.346+0000 7f98e475f640 1 --2- 172.21.15.88:0/1299219531 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f98dc0740e0 0x7f98dc1ed560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:50.357 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:50.346+0000 7f98e475f640 1 -- 172.21.15.88:0/1299219531 >> 172.21.15.88:0/1299219531 conn(0x7f98dc0ae0b0 msgr2=0x7f98dc0ac110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:40:50.358 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:50.346+0000 7f98e475f640 1 -- 172.21.15.88:0/1299219531 shutdown_connections 2024-04-26T23:40:50.358 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:50.346+0000 7f98e475f640 1 -- 172.21.15.88:0/1299219531 wait complete. 2024-04-26T23:40:50.361 INFO:teuthology.orchestra.run.smithi088.stdout:{"pg_ready":true,"pg_map":{"version":33,"stamp":"2024-04-26T23:40:49.925860+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595188,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":249,"num_write_kb":2444,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":195,"ondisk_log_size":195,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":386,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219460,"kb_used_data":3272,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755260,"statfs":{"total":773094113280,"available":772869386240,"internally_reserved":0,"allocated":3350528,"data_stored":1984464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.266454"},"pg_stats":[{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636272+0000","last_change":"2024-04-26T23:40:41.683801+0000","last_active":"2024-04-26T23:40:43.636272+0000","last_peered":"2024-04-26T23:40:43.636272+0000","last_clean":"2024-04-26T23:40:43.636272+0000","last_became_active":"2024-04-26T23:40:41.683484+0000","last_became_peered":"2024-04-26T23:40:41.683484+0000","last_unstale":"2024-04-26T23:40:43.636272+0000","last_undegraded":"2024-04-26T23:40:43.636272+0000","last_fullsized":"2024-04-26T23:40:43.636272+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:02:27.160408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":26,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.686904+0000","last_change":"2024-04-26T23:40:31.576688+0000","last_active":"2024-04-26T23:40:42.686904+0000","last_peered":"2024-04-26T23:40:42.686904+0000","last_clean":"2024-04-26T23:40:42.686904+0000","last_became_active":"2024-04-26T23:40:31.576429+0000","last_became_peered":"2024-04-26T23:40:31.576429+0000","last_unstale":"2024-04-26T23:40:42.686904+0000","last_undegraded":"2024-04-26T23:40:42.686904+0000","last_fullsized":"2024-04-26T23:40:42.686904+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:47:42.681376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.637858+0000","last_change":"2024-04-26T23:40:32.578489+0000","last_active":"2024-04-26T23:40:43.637858+0000","last_peered":"2024-04-26T23:40:43.637858+0000","last_clean":"2024-04-26T23:40:43.637858+0000","last_became_active":"2024-04-26T23:40:32.578205+0000","last_became_peered":"2024-04-26T23:40:32.578205+0000","last_unstale":"2024-04-26T23:40:43.637858+0000","last_undegraded":"2024-04-26T23:40:43.637858+0000","last_fullsized":"2024-04-26T23:40:43.637858+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:56:04.309611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636964+0000","last_change":"2024-04-26T23:40:40.666861+0000","last_active":"2024-04-26T23:40:43.636964+0000","last_peered":"2024-04-26T23:40:43.636964+0000","last_clean":"2024-04-26T23:40:43.636964+0000","last_became_active":"2024-04-26T23:40:40.666547+0000","last_became_peered":"2024-04-26T23:40:40.666547+0000","last_unstale":"2024-04-26T23:40:43.636964+0000","last_undegraded":"2024-04-26T23:40:43.636964+0000","last_fullsized":"2024-04-26T23:40:43.636964+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:27:47.818055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.635388+0000","last_change":"2024-04-26T23:40:41.689530+0000","last_active":"2024-04-26T23:40:43.635388+0000","last_peered":"2024-04-26T23:40:43.635388+0000","last_clean":"2024-04-26T23:40:43.635388+0000","last_became_active":"2024-04-26T23:40:41.687652+0000","last_became_peered":"2024-04-26T23:40:41.687652+0000","last_unstale":"2024-04-26T23:40:43.635388+0000","last_undegraded":"2024-04-26T23:40:43.635388+0000","last_fullsized":"2024-04-26T23:40:43.635388+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:58:45.972045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.637959+0000","last_change":"2024-04-26T23:40:31.576867+0000","last_active":"2024-04-26T23:40:43.637959+0000","last_peered":"2024-04-26T23:40:43.637959+0000","last_clean":"2024-04-26T23:40:43.637959+0000","last_became_active":"2024-04-26T23:40:31.576342+0000","last_became_peered":"2024-04-26T23:40:31.576342+0000","last_unstale":"2024-04-26T23:40:43.637959+0000","last_undegraded":"2024-04-26T23:40:43.637959+0000","last_fullsized":"2024-04-26T23:40:43.637959+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:35:54.439397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.686802+0000","last_change":"2024-04-26T23:40:32.589769+0000","last_active":"2024-04-26T23:40:42.686802+0000","last_peered":"2024-04-26T23:40:42.686802+0000","last_clean":"2024-04-26T23:40:42.686802+0000","last_became_active":"2024-04-26T23:40:32.589489+0000","last_became_peered":"2024-04-26T23:40:32.589489+0000","last_unstale":"2024-04-26T23:40:42.686802+0000","last_undegraded":"2024-04-26T23:40:42.686802+0000","last_fullsized":"2024-04-26T23:40:42.686802+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:40:17.167353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636746+0000","last_change":"2024-04-26T23:40:40.672310+0000","last_active":"2024-04-26T23:40:43.636746+0000","last_peered":"2024-04-26T23:40:43.636746+0000","last_clean":"2024-04-26T23:40:43.636746+0000","last_became_active":"2024-04-26T23:40:40.672018+0000","last_became_peered":"2024-04-26T23:40:40.672018+0000","last_unstale":"2024-04-26T23:40:43.636746+0000","last_undegraded":"2024-04-26T23:40:43.636746+0000","last_fullsized":"2024-04-26T23:40:43.636746+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:01:10.835670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636004+0000","last_change":"2024-04-26T23:40:41.686743+0000","last_active":"2024-04-26T23:40:43.636004+0000","last_peered":"2024-04-26T23:40:43.636004+0000","last_clean":"2024-04-26T23:40:43.636004+0000","last_became_active":"2024-04-26T23:40:41.686419+0000","last_became_peered":"2024-04-26T23:40:41.686419+0000","last_unstale":"2024-04-26T23:40:43.636004+0000","last_undegraded":"2024-04-26T23:40:43.636004+0000","last_fullsized":"2024-04-26T23:40:43.636004+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:08:35.027584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.637221+0000","last_change":"2024-04-26T23:40:31.578735+0000","last_active":"2024-04-26T23:40:43.637221+0000","last_peered":"2024-04-26T23:40:43.637221+0000","last_clean":"2024-04-26T23:40:43.637221+0000","last_became_active":"2024-04-26T23:40:31.578438+0000","last_became_peered":"2024-04-26T23:40:31.578438+0000","last_unstale":"2024-04-26T23:40:43.637221+0000","last_undegraded":"2024-04-26T23:40:43.637221+0000","last_fullsized":"2024-04-26T23:40:43.637221+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:30:10.397569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.685239+0000","last_change":"2024-04-26T23:40:32.590624+0000","last_active":"2024-04-26T23:40:42.685239+0000","last_peered":"2024-04-26T23:40:42.685239+0000","last_clean":"2024-04-26T23:40:42.685239+0000","last_became_active":"2024-04-26T23:40:32.589687+0000","last_became_peered":"2024-04-26T23:40:32.589687+0000","last_unstale":"2024-04-26T23:40:42.685239+0000","last_undegraded":"2024-04-26T23:40:42.685239+0000","last_fullsized":"2024-04-26T23:40:42.685239+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:01:02.741964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"23'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.637058+0000","last_change":"2024-04-26T23:40:40.677899+0000","last_active":"2024-04-26T23:40:43.637058+0000","last_peered":"2024-04-26T23:40:43.637058+0000","last_clean":"2024-04-26T23:40:43.637058+0000","last_became_active":"2024-04-26T23:40:40.677388+0000","last_became_peered":"2024-04-26T23:40:40.677388+0000","last_unstale":"2024-04-26T23:40:43.637058+0000","last_undegraded":"2024-04-26T23:40:43.637058+0000","last_fullsized":"2024-04-26T23:40:43.637058+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:52:34.793496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.684740+0000","last_change":"2024-04-26T23:40:41.680097+0000","last_active":"2024-04-26T23:40:42.684740+0000","last_peered":"2024-04-26T23:40:42.684740+0000","last_clean":"2024-04-26T23:40:42.684740+0000","last_became_active":"2024-04-26T23:40:41.679815+0000","last_became_peered":"2024-04-26T23:40:41.679815+0000","last_unstale":"2024-04-26T23:40:42.684740+0000","last_undegraded":"2024-04-26T23:40:42.684740+0000","last_fullsized":"2024-04-26T23:40:42.684740+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:10:30.972726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636837+0000","last_change":"2024-04-26T23:40:31.573648+0000","last_active":"2024-04-26T23:40:43.636837+0000","last_peered":"2024-04-26T23:40:43.636837+0000","last_clean":"2024-04-26T23:40:43.636837+0000","last_became_active":"2024-04-26T23:40:31.573347+0000","last_became_peered":"2024-04-26T23:40:31.573347+0000","last_unstale":"2024-04-26T23:40:43.636837+0000","last_undegraded":"2024-04-26T23:40:43.636837+0000","last_fullsized":"2024-04-26T23:40:43.636837+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:20:28.103413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.685588+0000","last_change":"2024-04-26T23:40:32.588309+0000","last_active":"2024-04-26T23:40:42.685588+0000","last_peered":"2024-04-26T23:40:42.685588+0000","last_clean":"2024-04-26T23:40:42.685588+0000","last_became_active":"2024-04-26T23:40:32.588007+0000","last_became_peered":"2024-04-26T23:40:32.588007+0000","last_unstale":"2024-04-26T23:40:42.685588+0000","last_undegraded":"2024-04-26T23:40:42.685588+0000","last_fullsized":"2024-04-26T23:40:42.685588+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:52:26.699790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"23'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636105+0000","last_change":"2024-04-26T23:40:40.678547+0000","last_active":"2024-04-26T23:40:43.636105+0000","last_peered":"2024-04-26T23:40:43.636105+0000","last_clean":"2024-04-26T23:40:43.636105+0000","last_became_active":"2024-04-26T23:40:40.677668+0000","last_became_peered":"2024-04-26T23:40:40.677668+0000","last_unstale":"2024-04-26T23:40:43.636105+0000","last_undegraded":"2024-04-26T23:40:43.636105+0000","last_fullsized":"2024-04-26T23:40:43.636105+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:34:22.905623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636105+0000","last_change":"2024-04-26T23:40:41.689525+0000","last_active":"2024-04-26T23:40:43.636105+0000","last_peered":"2024-04-26T23:40:43.636105+0000","last_clean":"2024-04-26T23:40:43.636105+0000","last_became_active":"2024-04-26T23:40:41.687433+0000","last_became_peered":"2024-04-26T23:40:41.687433+0000","last_unstale":"2024-04-26T23:40:43.636105+0000","last_undegraded":"2024-04-26T23:40:43.636105+0000","last_fullsized":"2024-04-26T23:40:43.636105+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:38:42.155257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.684004+0000","last_change":"2024-04-26T23:40:32.590053+0000","last_active":"2024-04-26T23:40:42.684004+0000","last_peered":"2024-04-26T23:40:42.684004+0000","last_clean":"2024-04-26T23:40:42.684004+0000","last_became_active":"2024-04-26T23:40:32.589802+0000","last_became_peered":"2024-04-26T23:40:32.589802+0000","last_unstale":"2024-04-26T23:40:42.684004+0000","last_undegraded":"2024-04-26T23:40:42.684004+0000","last_fullsized":"2024-04-26T23:40:42.684004+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:16:46.547536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636775+0000","last_change":"2024-04-26T23:40:31.578524+0000","last_active":"2024-04-26T23:40:43.636775+0000","last_peered":"2024-04-26T23:40:43.636775+0000","last_clean":"2024-04-26T23:40:43.636775+0000","last_became_active":"2024-04-26T23:40:31.578230+0000","last_became_peered":"2024-04-26T23:40:31.578230+0000","last_unstale":"2024-04-26T23:40:43.636775+0000","last_undegraded":"2024-04-26T23:40:43.636775+0000","last_fullsized":"2024-04-26T23:40:43.636775+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:15:51.937774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"23'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636197+0000","last_change":"2024-04-26T23:40:40.676459+0000","last_active":"2024-04-26T23:40:43.636197+0000","last_peered":"2024-04-26T23:40:43.636197+0000","last_clean":"2024-04-26T23:40:43.636197+0000","last_became_active":"2024-04-26T23:40:40.675997+0000","last_became_peered":"2024-04-26T23:40:40.675997+0000","last_unstale":"2024-04-26T23:40:43.636197+0000","last_undegraded":"2024-04-26T23:40:43.636197+0000","last_fullsized":"2024-04-26T23:40:43.636197+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:37:38.455501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.635973+0000","last_change":"2024-04-26T23:40:41.679334+0000","last_active":"2024-04-26T23:40:43.635973+0000","last_peered":"2024-04-26T23:40:43.635973+0000","last_clean":"2024-04-26T23:40:43.635973+0000","last_became_active":"2024-04-26T23:40:41.679098+0000","last_became_peered":"2024-04-26T23:40:41.679098+0000","last_unstale":"2024-04-26T23:40:43.635973+0000","last_undegraded":"2024-04-26T23:40:43.635973+0000","last_fullsized":"2024-04-26T23:40:43.635973+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:52:35.798951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.637449+0000","last_change":"2024-04-26T23:40:32.585827+0000","last_active":"2024-04-26T23:40:43.637449+0000","last_peered":"2024-04-26T23:40:43.637449+0000","last_clean":"2024-04-26T23:40:43.637449+0000","last_became_active":"2024-04-26T23:40:32.585522+0000","last_became_peered":"2024-04-26T23:40:32.585522+0000","last_unstale":"2024-04-26T23:40:43.637449+0000","last_undegraded":"2024-04-26T23:40:43.637449+0000","last_fullsized":"2024-04-26T23:40:43.637449+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:40:17.167353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.635887+0000","last_change":"2024-04-26T23:40:31.575121+0000","last_active":"2024-04-26T23:40:43.635887+0000","last_peered":"2024-04-26T23:40:43.635887+0000","last_clean":"2024-04-26T23:40:43.635887+0000","last_became_active":"2024-04-26T23:40:31.574827+0000","last_became_peered":"2024-04-26T23:40:31.574827+0000","last_unstale":"2024-04-26T23:40:43.635887+0000","last_undegraded":"2024-04-26T23:40:43.635887+0000","last_fullsized":"2024-04-26T23:40:43.635887+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:43:13.740214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636996+0000","last_change":"2024-04-26T23:40:40.678613+0000","last_active":"2024-04-26T23:40:43.636996+0000","last_peered":"2024-04-26T23:40:43.636996+0000","last_clean":"2024-04-26T23:40:43.636996+0000","last_became_active":"2024-04-26T23:40:40.677867+0000","last_became_peered":"2024-04-26T23:40:40.677867+0000","last_unstale":"2024-04-26T23:40:43.636996+0000","last_undegraded":"2024-04-26T23:40:43.636996+0000","last_fullsized":"2024-04-26T23:40:43.636996+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:35:16.288571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636503+0000","last_change":"2024-04-26T23:40:41.685042+0000","last_active":"2024-04-26T23:40:43.636503+0000","last_peered":"2024-04-26T23:40:43.636503+0000","last_clean":"2024-04-26T23:40:43.636503+0000","last_became_active":"2024-04-26T23:40:41.684699+0000","last_became_peered":"2024-04-26T23:40:41.684699+0000","last_unstale":"2024-04-26T23:40:43.636503+0000","last_undegraded":"2024-04-26T23:40:43.636503+0000","last_fullsized":"2024-04-26T23:40:43.636503+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:10:57.826183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636873+0000","last_change":"2024-04-26T23:40:32.582721+0000","last_active":"2024-04-26T23:40:43.636873+0000","last_peered":"2024-04-26T23:40:43.636873+0000","last_clean":"2024-04-26T23:40:43.636873+0000","last_became_active":"2024-04-26T23:40:32.582438+0000","last_became_peered":"2024-04-26T23:40:32.582438+0000","last_unstale":"2024-04-26T23:40:43.636873+0000","last_undegraded":"2024-04-26T23:40:43.636873+0000","last_fullsized":"2024-04-26T23:40:43.636873+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:38:10.884592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.635560+0000","last_change":"2024-04-26T23:40:31.575508+0000","last_active":"2024-04-26T23:40:43.635560+0000","last_peered":"2024-04-26T23:40:43.635560+0000","last_clean":"2024-04-26T23:40:43.635560+0000","last_became_active":"2024-04-26T23:40:31.575242+0000","last_became_peered":"2024-04-26T23:40:31.575242+0000","last_unstale":"2024-04-26T23:40:43.635560+0000","last_undegraded":"2024-04-26T23:40:43.635560+0000","last_fullsized":"2024-04-26T23:40:43.635560+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:48:32.015654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"23'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636104+0000","last_change":"2024-04-26T23:40:40.679196+0000","last_active":"2024-04-26T23:40:43.636104+0000","last_peered":"2024-04-26T23:40:43.636104+0000","last_clean":"2024-04-26T23:40:43.636104+0000","last_became_active":"2024-04-26T23:40:40.678740+0000","last_became_peered":"2024-04-26T23:40:40.678740+0000","last_unstale":"2024-04-26T23:40:43.636104+0000","last_undegraded":"2024-04-26T23:40:43.636104+0000","last_fullsized":"2024-04-26T23:40:43.636104+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:40:14.479631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.685673+0000","last_change":"2024-04-26T23:40:41.686638+0000","last_active":"2024-04-26T23:40:42.685673+0000","last_peered":"2024-04-26T23:40:42.685673+0000","last_clean":"2024-04-26T23:40:42.685673+0000","last_became_active":"2024-04-26T23:40:41.686354+0000","last_became_peered":"2024-04-26T23:40:41.686354+0000","last_unstale":"2024-04-26T23:40:42.685673+0000","last_undegraded":"2024-04-26T23:40:42.685673+0000","last_fullsized":"2024-04-26T23:40:42.685673+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:06:12.755431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.637002+0000","last_change":"2024-04-26T23:40:32.583019+0000","last_active":"2024-04-26T23:40:43.637002+0000","last_peered":"2024-04-26T23:40:43.637002+0000","last_clean":"2024-04-26T23:40:43.637002+0000","last_became_active":"2024-04-26T23:40:32.582719+0000","last_became_peered":"2024-04-26T23:40:32.582719+0000","last_unstale":"2024-04-26T23:40:43.637002+0000","last_undegraded":"2024-04-26T23:40:43.637002+0000","last_fullsized":"2024-04-26T23:40:43.637002+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:25:02.319783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.635607+0000","last_change":"2024-04-26T23:40:31.576866+0000","last_active":"2024-04-26T23:40:43.635607+0000","last_peered":"2024-04-26T23:40:43.635607+0000","last_clean":"2024-04-26T23:40:43.635607+0000","last_became_active":"2024-04-26T23:40:31.576419+0000","last_became_peered":"2024-04-26T23:40:31.576419+0000","last_unstale":"2024-04-26T23:40:43.635607+0000","last_undegraded":"2024-04-26T23:40:43.635607+0000","last_fullsized":"2024-04-26T23:40:43.635607+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:45:49.295198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"23'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636623+0000","last_change":"2024-04-26T23:40:40.675262+0000","last_active":"2024-04-26T23:40:43.636623+0000","last_peered":"2024-04-26T23:40:43.636623+0000","last_clean":"2024-04-26T23:40:43.636623+0000","last_became_active":"2024-04-26T23:40:40.674721+0000","last_became_peered":"2024-04-26T23:40:40.674721+0000","last_unstale":"2024-04-26T23:40:43.636623+0000","last_undegraded":"2024-04-26T23:40:43.636623+0000","last_fullsized":"2024-04-26T23:40:43.636623+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:56:12.403317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.635271+0000","last_change":"2024-04-26T23:40:41.691494+0000","last_active":"2024-04-26T23:40:43.635271+0000","last_peered":"2024-04-26T23:40:43.635271+0000","last_clean":"2024-04-26T23:40:43.635271+0000","last_became_active":"2024-04-26T23:40:41.691241+0000","last_became_peered":"2024-04-26T23:40:41.691241+0000","last_unstale":"2024-04-26T23:40:43.635271+0000","last_undegraded":"2024-04-26T23:40:43.635271+0000","last_fullsized":"2024-04-26T23:40:43.635271+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:08:35.027584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.687075+0000","last_change":"2024-04-26T23:40:32.584988+0000","last_active":"2024-04-26T23:40:42.687075+0000","last_peered":"2024-04-26T23:40:42.687075+0000","last_clean":"2024-04-26T23:40:42.687075+0000","last_became_active":"2024-04-26T23:40:32.584467+0000","last_became_peered":"2024-04-26T23:40:32.584467+0000","last_unstale":"2024-04-26T23:40:42.687075+0000","last_undegraded":"2024-04-26T23:40:42.687075+0000","last_fullsized":"2024-04-26T23:40:42.687075+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:51:30.677247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.684365+0000","last_change":"2024-04-26T23:40:31.573721+0000","last_active":"2024-04-26T23:40:42.684365+0000","last_peered":"2024-04-26T23:40:42.684365+0000","last_clean":"2024-04-26T23:40:42.684365+0000","last_became_active":"2024-04-26T23:40:31.573434+0000","last_became_peered":"2024-04-26T23:40:31.573434+0000","last_unstale":"2024-04-26T23:40:42.684365+0000","last_undegraded":"2024-04-26T23:40:42.684365+0000","last_fullsized":"2024-04-26T23:40:42.684365+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:20:28.103413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636650+0000","last_change":"2024-04-26T23:40:40.678020+0000","last_active":"2024-04-26T23:40:43.636650+0000","last_peered":"2024-04-26T23:40:43.636650+0000","last_clean":"2024-04-26T23:40:43.636650+0000","last_became_active":"2024-04-26T23:40:40.677410+0000","last_became_peered":"2024-04-26T23:40:40.677410+0000","last_unstale":"2024-04-26T23:40:43.636650+0000","last_undegraded":"2024-04-26T23:40:43.636650+0000","last_fullsized":"2024-04-26T23:40:43.636650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:44:50.588556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.635487+0000","last_change":"2024-04-26T23:40:41.689839+0000","last_active":"2024-04-26T23:40:43.635487+0000","last_peered":"2024-04-26T23:40:43.635487+0000","last_clean":"2024-04-26T23:40:43.635487+0000","last_became_active":"2024-04-26T23:40:41.689508+0000","last_became_peered":"2024-04-26T23:40:41.689508+0000","last_unstale":"2024-04-26T23:40:43.635487+0000","last_undegraded":"2024-04-26T23:40:43.635487+0000","last_fullsized":"2024-04-26T23:40:43.635487+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:17:28.672777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.637978+0000","last_change":"2024-04-26T23:40:32.594913+0000","last_active":"2024-04-26T23:40:43.637978+0000","last_peered":"2024-04-26T23:40:43.637978+0000","last_clean":"2024-04-26T23:40:43.637978+0000","last_became_active":"2024-04-26T23:40:32.594616+0000","last_became_peered":"2024-04-26T23:40:32.594616+0000","last_unstale":"2024-04-26T23:40:43.637978+0000","last_undegraded":"2024-04-26T23:40:43.637978+0000","last_fullsized":"2024-04-26T23:40:43.637978+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:04:30.553552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636386+0000","last_change":"2024-04-26T23:40:31.576299+0000","last_active":"2024-04-26T23:40:43.636386+0000","last_peered":"2024-04-26T23:40:43.636386+0000","last_clean":"2024-04-26T23:40:43.636386+0000","last_became_active":"2024-04-26T23:40:31.576006+0000","last_became_peered":"2024-04-26T23:40:31.576006+0000","last_unstale":"2024-04-26T23:40:43.636386+0000","last_undegraded":"2024-04-26T23:40:43.636386+0000","last_fullsized":"2024-04-26T23:40:43.636386+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:15:51.937774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.635376+0000","last_change":"2024-04-26T23:40:40.674806+0000","last_active":"2024-04-26T23:40:43.635376+0000","last_peered":"2024-04-26T23:40:43.635376+0000","last_clean":"2024-04-26T23:40:43.635376+0000","last_became_active":"2024-04-26T23:40:40.674557+0000","last_became_peered":"2024-04-26T23:40:40.674557+0000","last_unstale":"2024-04-26T23:40:43.635376+0000","last_undegraded":"2024-04-26T23:40:43.635376+0000","last_fullsized":"2024-04-26T23:40:43.635376+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:45:33.226487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.683778+0000","last_change":"2024-04-26T23:40:41.688941+0000","last_active":"2024-04-26T23:40:42.683778+0000","last_peered":"2024-04-26T23:40:42.683778+0000","last_clean":"2024-04-26T23:40:42.683778+0000","last_became_active":"2024-04-26T23:40:41.688653+0000","last_became_peered":"2024-04-26T23:40:41.688653+0000","last_unstale":"2024-04-26T23:40:42.683778+0000","last_undegraded":"2024-04-26T23:40:42.683778+0000","last_fullsized":"2024-04-26T23:40:42.683778+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:53:13.531466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636366+0000","last_change":"2024-04-26T23:40:32.582442+0000","last_active":"2024-04-26T23:40:43.636366+0000","last_peered":"2024-04-26T23:40:43.636366+0000","last_clean":"2024-04-26T23:40:43.636366+0000","last_became_active":"2024-04-26T23:40:32.582140+0000","last_became_peered":"2024-04-26T23:40:32.582140+0000","last_unstale":"2024-04-26T23:40:43.636366+0000","last_undegraded":"2024-04-26T23:40:43.636366+0000","last_fullsized":"2024-04-26T23:40:43.636366+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:18:09.706875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.637335+0000","last_change":"2024-04-26T23:40:31.576565+0000","last_active":"2024-04-26T23:40:43.637335+0000","last_peered":"2024-04-26T23:40:43.637335+0000","last_clean":"2024-04-26T23:40:43.637335+0000","last_became_active":"2024-04-26T23:40:31.576313+0000","last_became_peered":"2024-04-26T23:40:31.576313+0000","last_unstale":"2024-04-26T23:40:43.637335+0000","last_undegraded":"2024-04-26T23:40:43.637335+0000","last_fullsized":"2024-04-26T23:40:43.637335+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:25:01.315397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.686609+0000","last_change":"2024-04-26T23:40:40.671047+0000","last_active":"2024-04-26T23:40:42.686609+0000","last_peered":"2024-04-26T23:40:42.686609+0000","last_clean":"2024-04-26T23:40:42.686609+0000","last_became_active":"2024-04-26T23:40:40.670630+0000","last_became_peered":"2024-04-26T23:40:40.670630+0000","last_unstale":"2024-04-26T23:40:42.686609+0000","last_undegraded":"2024-04-26T23:40:42.686609+0000","last_fullsized":"2024-04-26T23:40:42.686609+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:45:07.071050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.686921+0000","last_change":"2024-04-26T23:40:41.686221+0000","last_active":"2024-04-26T23:40:42.686921+0000","last_peered":"2024-04-26T23:40:42.686921+0000","last_clean":"2024-04-26T23:40:42.686921+0000","last_became_active":"2024-04-26T23:40:41.685961+0000","last_became_peered":"2024-04-26T23:40:41.685961+0000","last_unstale":"2024-04-26T23:40:42.686921+0000","last_undegraded":"2024-04-26T23:40:42.686921+0000","last_fullsized":"2024-04-26T23:40:42.686921+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:28:34.920939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.685609+0000","last_change":"2024-04-26T23:40:32.584363+0000","last_active":"2024-04-26T23:40:42.685609+0000","last_peered":"2024-04-26T23:40:42.685609+0000","last_clean":"2024-04-26T23:40:42.685609+0000","last_became_active":"2024-04-26T23:40:32.584082+0000","last_became_peered":"2024-04-26T23:40:32.584082+0000","last_unstale":"2024-04-26T23:40:42.685609+0000","last_undegraded":"2024-04-26T23:40:42.685609+0000","last_fullsized":"2024-04-26T23:40:42.685609+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:35:08.194865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636458+0000","last_change":"2024-04-26T23:40:31.576711+0000","last_active":"2024-04-26T23:40:43.636458+0000","last_peered":"2024-04-26T23:40:43.636458+0000","last_clean":"2024-04-26T23:40:43.636458+0000","last_became_active":"2024-04-26T23:40:31.576404+0000","last_became_peered":"2024-04-26T23:40:31.576404+0000","last_unstale":"2024-04-26T23:40:43.636458+0000","last_undegraded":"2024-04-26T23:40:43.636458+0000","last_fullsized":"2024-04-26T23:40:43.636458+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:45:49.295198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.635616+0000","last_change":"2024-04-26T23:40:40.675296+0000","last_active":"2024-04-26T23:40:43.635616+0000","last_peered":"2024-04-26T23:40:43.635616+0000","last_clean":"2024-04-26T23:40:43.635616+0000","last_became_active":"2024-04-26T23:40:40.674935+0000","last_became_peered":"2024-04-26T23:40:40.674935+0000","last_unstale":"2024-04-26T23:40:43.635616+0000","last_undegraded":"2024-04-26T23:40:43.635616+0000","last_fullsized":"2024-04-26T23:40:43.635616+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:10:10.722905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.686589+0000","last_change":"2024-04-26T23:40:41.691510+0000","last_active":"2024-04-26T23:40:42.686589+0000","last_peered":"2024-04-26T23:40:42.686589+0000","last_clean":"2024-04-26T23:40:42.686589+0000","last_became_active":"2024-04-26T23:40:41.691242+0000","last_became_peered":"2024-04-26T23:40:41.691242+0000","last_unstale":"2024-04-26T23:40:42.686589+0000","last_undegraded":"2024-04-26T23:40:42.686589+0000","last_fullsized":"2024-04-26T23:40:42.686589+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:27:48.823509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.637394+0000","last_change":"2024-04-26T23:40:32.590069+0000","last_active":"2024-04-26T23:40:43.637394+0000","last_peered":"2024-04-26T23:40:43.637394+0000","last_clean":"2024-04-26T23:40:43.637394+0000","last_became_active":"2024-04-26T23:40:32.589790+0000","last_became_peered":"2024-04-26T23:40:32.589790+0000","last_unstale":"2024-04-26T23:40:43.637394+0000","last_undegraded":"2024-04-26T23:40:43.637394+0000","last_fullsized":"2024-04-26T23:40:43.637394+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:15:52.942160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.684776+0000","last_change":"2024-04-26T23:40:31.572432+0000","last_active":"2024-04-26T23:40:42.684776+0000","last_peered":"2024-04-26T23:40:42.684776+0000","last_clean":"2024-04-26T23:40:42.684776+0000","last_became_active":"2024-04-26T23:40:31.572121+0000","last_became_peered":"2024-04-26T23:40:31.572121+0000","last_unstale":"2024-04-26T23:40:42.684776+0000","last_undegraded":"2024-04-26T23:40:42.684776+0000","last_fullsized":"2024-04-26T23:40:42.684776+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:45:49.295198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636314+0000","last_change":"2024-04-26T23:40:40.678404+0000","last_active":"2024-04-26T23:40:43.636314+0000","last_peered":"2024-04-26T23:40:43.636314+0000","last_clean":"2024-04-26T23:40:43.636314+0000","last_became_active":"2024-04-26T23:40:40.678136+0000","last_became_peered":"2024-04-26T23:40:40.678136+0000","last_unstale":"2024-04-26T23:40:43.636314+0000","last_undegraded":"2024-04-26T23:40:43.636314+0000","last_fullsized":"2024-04-26T23:40:43.636314+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:45:11.058699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636232+0000","last_change":"2024-04-26T23:40:41.673542+0000","last_active":"2024-04-26T23:40:43.636232+0000","last_peered":"2024-04-26T23:40:43.636232+0000","last_clean":"2024-04-26T23:40:43.636232+0000","last_became_active":"2024-04-26T23:40:41.673254+0000","last_became_peered":"2024-04-26T23:40:41.673254+0000","last_unstale":"2024-04-26T23:40:43.636232+0000","last_undegraded":"2024-04-26T23:40:43.636232+0000","last_fullsized":"2024-04-26T23:40:43.636232+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:10:11.728359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.635254+0000","last_change":"2024-04-26T23:40:32.576783+0000","last_active":"2024-04-26T23:40:43.635254+0000","last_peered":"2024-04-26T23:40:43.635254+0000","last_clean":"2024-04-26T23:40:43.635254+0000","last_became_active":"2024-04-26T23:40:32.576481+0000","last_became_peered":"2024-04-26T23:40:32.576481+0000","last_unstale":"2024-04-26T23:40:43.635254+0000","last_undegraded":"2024-04-26T23:40:43.635254+0000","last_fullsized":"2024-04-26T23:40:43.635254+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:16:46.547536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.635776+0000","last_change":"2024-04-26T23:40:31.570775+0000","last_active":"2024-04-26T23:40:43.635776+0000","last_peered":"2024-04-26T23:40:43.635776+0000","last_clean":"2024-04-26T23:40:43.635776+0000","last_became_active":"2024-04-26T23:40:31.570493+0000","last_became_peered":"2024-04-26T23:40:31.570493+0000","last_unstale":"2024-04-26T23:40:43.635776+0000","last_undegraded":"2024-04-26T23:40:43.635776+0000","last_fullsized":"2024-04-26T23:40:43.635776+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:45:49.295198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"23'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636208+0000","last_change":"2024-04-26T23:40:40.675115+0000","last_active":"2024-04-26T23:40:43.636208+0000","last_peered":"2024-04-26T23:40:43.636208+0000","last_clean":"2024-04-26T23:40:43.636208+0000","last_became_active":"2024-04-26T23:40:40.674828+0000","last_became_peered":"2024-04-26T23:40:40.674828+0000","last_unstale":"2024-04-26T23:40:43.636208+0000","last_undegraded":"2024-04-26T23:40:43.636208+0000","last_fullsized":"2024-04-26T23:40:43.636208+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:45:07.071050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.685711+0000","last_change":"2024-04-26T23:40:41.691098+0000","last_active":"2024-04-26T23:40:42.685711+0000","last_peered":"2024-04-26T23:40:42.685711+0000","last_clean":"2024-04-26T23:40:42.685711+0000","last_became_active":"2024-04-26T23:40:41.690803+0000","last_became_peered":"2024-04-26T23:40:41.690803+0000","last_unstale":"2024-04-26T23:40:42.685711+0000","last_undegraded":"2024-04-26T23:40:42.685711+0000","last_fullsized":"2024-04-26T23:40:42.685711+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:38:51.195172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.686290+0000","last_change":"2024-04-26T23:40:32.593262+0000","last_active":"2024-04-26T23:40:42.686290+0000","last_peered":"2024-04-26T23:40:42.686290+0000","last_clean":"2024-04-26T23:40:42.686290+0000","last_became_active":"2024-04-26T23:40:32.593003+0000","last_became_peered":"2024-04-26T23:40:32.593003+0000","last_unstale":"2024-04-26T23:40:42.686290+0000","last_undegraded":"2024-04-26T23:40:42.686290+0000","last_fullsized":"2024-04-26T23:40:42.686290+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:47:51.559918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.635660+0000","last_change":"2024-04-26T23:40:31.573864+0000","last_active":"2024-04-26T23:40:43.635660+0000","last_peered":"2024-04-26T23:40:43.635660+0000","last_clean":"2024-04-26T23:40:43.635660+0000","last_became_active":"2024-04-26T23:40:31.573594+0000","last_became_peered":"2024-04-26T23:40:31.573594+0000","last_unstale":"2024-04-26T23:40:43.635660+0000","last_undegraded":"2024-04-26T23:40:43.635660+0000","last_fullsized":"2024-04-26T23:40:43.635660+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:48:32.015654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"24'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.664374+0000","last_change":"2024-04-26T23:40:40.677258+0000","last_active":"2024-04-26T23:40:43.664374+0000","last_peered":"2024-04-26T23:40:43.664374+0000","last_clean":"2024-04-26T23:40:43.664374+0000","last_became_active":"2024-04-26T23:40:40.676937+0000","last_became_peered":"2024-04-26T23:40:40.676937+0000","last_unstale":"2024-04-26T23:40:43.664374+0000","last_undegraded":"2024-04-26T23:40:43.664374+0000","last_fullsized":"2024-04-26T23:40:43.664374+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:44:50.588556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636633+0000","last_change":"2024-04-26T23:40:41.684731+0000","last_active":"2024-04-26T23:40:43.636633+0000","last_peered":"2024-04-26T23:40:43.636633+0000","last_clean":"2024-04-26T23:40:43.636633+0000","last_became_active":"2024-04-26T23:40:41.684459+0000","last_became_peered":"2024-04-26T23:40:41.684459+0000","last_unstale":"2024-04-26T23:40:43.636633+0000","last_undegraded":"2024-04-26T23:40:43.636633+0000","last_fullsized":"2024-04-26T23:40:43.636633+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:24:07.784468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.637233+0000","last_change":"2024-04-26T23:40:32.593216+0000","last_active":"2024-04-26T23:40:43.637233+0000","last_peered":"2024-04-26T23:40:43.637233+0000","last_clean":"2024-04-26T23:40:43.637233+0000","last_became_active":"2024-04-26T23:40:32.592929+0000","last_became_peered":"2024-04-26T23:40:32.592929+0000","last_unstale":"2024-04-26T23:40:43.637233+0000","last_undegraded":"2024-04-26T23:40:43.637233+0000","last_fullsized":"2024-04-26T23:40:43.637233+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:12:45.093169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.684832+0000","last_change":"2024-04-26T23:40:31.570118+0000","last_active":"2024-04-26T23:40:42.684832+0000","last_peered":"2024-04-26T23:40:42.684832+0000","last_clean":"2024-04-26T23:40:42.684832+0000","last_became_active":"2024-04-26T23:40:31.569764+0000","last_became_peered":"2024-04-26T23:40:31.569764+0000","last_unstale":"2024-04-26T23:40:42.684832+0000","last_undegraded":"2024-04-26T23:40:42.684832+0000","last_fullsized":"2024-04-26T23:40:42.684832+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:15:30.884135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":178,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.635784+0000","last_change":"2024-04-26T23:40:20.966672+0000","last_active":"2024-04-26T23:40:43.635784+0000","last_peered":"2024-04-26T23:40:43.635784+0000","last_clean":"2024-04-26T23:40:43.635784+0000","last_became_active":"2024-04-26T23:40:20.963937+0000","last_became_peered":"2024-04-26T23:40:20.963937+0000","last_unstale":"2024-04-26T23:40:43.635784+0000","last_undegraded":"2024-04-26T23:40:43.635784+0000","last_fullsized":"2024-04-26T23:40:43.635784+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:19.950137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:19.950137+0000","last_clean_scrub_stamp":"2024-04-26T23:40:19.950137+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:23:39.166579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.683613+0000","last_change":"2024-04-26T23:40:40.671995+0000","last_active":"2024-04-26T23:40:42.683613+0000","last_peered":"2024-04-26T23:40:42.683613+0000","last_clean":"2024-04-26T23:40:42.683613+0000","last_became_active":"2024-04-26T23:40:40.671642+0000","last_became_peered":"2024-04-26T23:40:40.671642+0000","last_unstale":"2024-04-26T23:40:42.683613+0000","last_undegraded":"2024-04-26T23:40:42.683613+0000","last_fullsized":"2024-04-26T23:40:42.683613+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:35:16.288571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636479+0000","last_change":"2024-04-26T23:40:41.680852+0000","last_active":"2024-04-26T23:40:43.636479+0000","last_peered":"2024-04-26T23:40:43.636479+0000","last_clean":"2024-04-26T23:40:43.636479+0000","last_became_active":"2024-04-26T23:40:41.680567+0000","last_became_peered":"2024-04-26T23:40:41.680567+0000","last_unstale":"2024-04-26T23:40:43.636479+0000","last_undegraded":"2024-04-26T23:40:43.636479+0000","last_fullsized":"2024-04-26T23:40:43.636479+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:40:15.485085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.637223+0000","last_change":"2024-04-26T23:40:32.591906+0000","last_active":"2024-04-26T23:40:43.637223+0000","last_peered":"2024-04-26T23:40:43.637223+0000","last_clean":"2024-04-26T23:40:43.637223+0000","last_became_active":"2024-04-26T23:40:32.590867+0000","last_became_peered":"2024-04-26T23:40:32.590867+0000","last_unstale":"2024-04-26T23:40:43.637223+0000","last_undegraded":"2024-04-26T23:40:43.637223+0000","last_fullsized":"2024-04-26T23:40:43.637223+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:56:04.309611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636141+0000","last_change":"2024-04-26T23:40:31.572391+0000","last_active":"2024-04-26T23:40:43.636141+0000","last_peered":"2024-04-26T23:40:43.636141+0000","last_clean":"2024-04-26T23:40:43.636141+0000","last_became_active":"2024-04-26T23:40:31.571849+0000","last_became_peered":"2024-04-26T23:40:31.571849+0000","last_unstale":"2024-04-26T23:40:43.636141+0000","last_undegraded":"2024-04-26T23:40:43.636141+0000","last_fullsized":"2024-04-26T23:40:43.636141+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:35:54.439397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.683873+0000","last_change":"2024-04-26T23:40:40.676464+0000","last_active":"2024-04-26T23:40:42.683873+0000","last_peered":"2024-04-26T23:40:42.683873+0000","last_clean":"2024-04-26T23:40:42.683873+0000","last_became_active":"2024-04-26T23:40:40.676154+0000","last_became_peered":"2024-04-26T23:40:40.676154+0000","last_unstale":"2024-04-26T23:40:42.683873+0000","last_undegraded":"2024-04-26T23:40:42.683873+0000","last_fullsized":"2024-04-26T23:40:42.683873+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:52:34.793496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636055+0000","last_change":"2024-04-26T23:40:41.688065+0000","last_active":"2024-04-26T23:40:43.636055+0000","last_peered":"2024-04-26T23:40:43.636055+0000","last_clean":"2024-04-26T23:40:43.636055+0000","last_became_active":"2024-04-26T23:40:41.687693+0000","last_became_peered":"2024-04-26T23:40:41.687693+0000","last_unstale":"2024-04-26T23:40:43.636055+0000","last_undegraded":"2024-04-26T23:40:43.636055+0000","last_fullsized":"2024-04-26T23:40:43.636055+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:35:17.294025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.685453+0000","last_change":"2024-04-26T23:40:32.583469+0000","last_active":"2024-04-26T23:40:42.685453+0000","last_peered":"2024-04-26T23:40:42.685453+0000","last_clean":"2024-04-26T23:40:42.685453+0000","last_became_active":"2024-04-26T23:40:32.583174+0000","last_became_peered":"2024-04-26T23:40:32.583174+0000","last_unstale":"2024-04-26T23:40:42.685453+0000","last_undegraded":"2024-04-26T23:40:42.685453+0000","last_fullsized":"2024-04-26T23:40:42.685453+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:34:14.811917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.637058+0000","last_change":"2024-04-26T23:40:31.571749+0000","last_active":"2024-04-26T23:40:43.637058+0000","last_peered":"2024-04-26T23:40:43.637058+0000","last_clean":"2024-04-26T23:40:43.637058+0000","last_became_active":"2024-04-26T23:40:31.571427+0000","last_became_peered":"2024-04-26T23:40:31.571427+0000","last_unstale":"2024-04-26T23:40:43.637058+0000","last_undegraded":"2024-04-26T23:40:43.637058+0000","last_fullsized":"2024-04-26T23:40:43.637058+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:20:28.103413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"23'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.686472+0000","last_change":"2024-04-26T23:40:40.675987+0000","last_active":"2024-04-26T23:40:42.686472+0000","last_peered":"2024-04-26T23:40:42.686472+0000","last_clean":"2024-04-26T23:40:42.686472+0000","last_became_active":"2024-04-26T23:40:40.675682+0000","last_became_peered":"2024-04-26T23:40:40.675682+0000","last_unstale":"2024-04-26T23:40:42.686472+0000","last_undegraded":"2024-04-26T23:40:42.686472+0000","last_fullsized":"2024-04-26T23:40:42.686472+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:10:10.722905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.635569+0000","last_change":"2024-04-26T23:40:41.681408+0000","last_active":"2024-04-26T23:40:43.635569+0000","last_peered":"2024-04-26T23:40:43.635569+0000","last_clean":"2024-04-26T23:40:43.635569+0000","last_became_active":"2024-04-26T23:40:41.681069+0000","last_became_peered":"2024-04-26T23:40:41.681069+0000","last_unstale":"2024-04-26T23:40:43.635569+0000","last_undegraded":"2024-04-26T23:40:43.635569+0000","last_fullsized":"2024-04-26T23:40:43.635569+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:10:30.972726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636555+0000","last_change":"2024-04-26T23:40:32.596306+0000","last_active":"2024-04-26T23:40:43.636555+0000","last_peered":"2024-04-26T23:40:43.636555+0000","last_clean":"2024-04-26T23:40:43.636555+0000","last_became_active":"2024-04-26T23:40:32.595625+0000","last_became_peered":"2024-04-26T23:40:32.595625+0000","last_unstale":"2024-04-26T23:40:43.636555+0000","last_undegraded":"2024-04-26T23:40:43.636555+0000","last_fullsized":"2024-04-26T23:40:43.636555+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:10:02.629199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636280+0000","last_change":"2024-04-26T23:40:31.570870+0000","last_active":"2024-04-26T23:40:43.636280+0000","last_peered":"2024-04-26T23:40:43.636280+0000","last_clean":"2024-04-26T23:40:43.636280+0000","last_became_active":"2024-04-26T23:40:31.570592+0000","last_became_peered":"2024-04-26T23:40:31.570592+0000","last_unstale":"2024-04-26T23:40:43.636280+0000","last_undegraded":"2024-04-26T23:40:43.636280+0000","last_fullsized":"2024-04-26T23:40:43.636280+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:43:13.740214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.685417+0000","last_change":"2024-04-26T23:40:40.673142+0000","last_active":"2024-04-26T23:40:42.685417+0000","last_peered":"2024-04-26T23:40:42.685417+0000","last_clean":"2024-04-26T23:40:42.685417+0000","last_became_active":"2024-04-26T23:40:40.672816+0000","last_became_peered":"2024-04-26T23:40:40.672816+0000","last_unstale":"2024-04-26T23:40:42.685417+0000","last_undegraded":"2024-04-26T23:40:42.685417+0000","last_fullsized":"2024-04-26T23:40:42.685417+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:53:12.526011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.635564+0000","last_change":"2024-04-26T23:40:41.678588+0000","last_active":"2024-04-26T23:40:43.635564+0000","last_peered":"2024-04-26T23:40:43.635564+0000","last_clean":"2024-04-26T23:40:43.635564+0000","last_became_active":"2024-04-26T23:40:41.678039+0000","last_became_peered":"2024-04-26T23:40:41.678039+0000","last_unstale":"2024-04-26T23:40:43.635564+0000","last_undegraded":"2024-04-26T23:40:43.635564+0000","last_fullsized":"2024-04-26T23:40:43.635564+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:04:39.652713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636462+0000","last_change":"2024-04-26T23:40:32.593577+0000","last_active":"2024-04-26T23:40:43.636462+0000","last_peered":"2024-04-26T23:40:43.636462+0000","last_clean":"2024-04-26T23:40:43.636462+0000","last_became_active":"2024-04-26T23:40:32.593235+0000","last_became_peered":"2024-04-26T23:40:32.593235+0000","last_unstale":"2024-04-26T23:40:43.636462+0000","last_undegraded":"2024-04-26T23:40:43.636462+0000","last_fullsized":"2024-04-26T23:40:43.636462+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:01:02.741964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636418+0000","last_change":"2024-04-26T23:40:31.575943+0000","last_active":"2024-04-26T23:40:43.636418+0000","last_peered":"2024-04-26T23:40:43.636418+0000","last_clean":"2024-04-26T23:40:43.636418+0000","last_became_active":"2024-04-26T23:40:31.575632+0000","last_became_peered":"2024-04-26T23:40:31.575632+0000","last_unstale":"2024-04-26T23:40:43.636418+0000","last_undegraded":"2024-04-26T23:40:43.636418+0000","last_fullsized":"2024-04-26T23:40:43.636418+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:11:08.189634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636540+0000","last_change":"2024-04-26T23:40:40.676297+0000","last_active":"2024-04-26T23:40:43.636540+0000","last_peered":"2024-04-26T23:40:43.636540+0000","last_clean":"2024-04-26T23:40:43.636540+0000","last_became_active":"2024-04-26T23:40:40.675888+0000","last_became_peered":"2024-04-26T23:40:40.675888+0000","last_unstale":"2024-04-26T23:40:43.636540+0000","last_undegraded":"2024-04-26T23:40:43.636540+0000","last_fullsized":"2024-04-26T23:40:43.636540+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:04:38.647258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.637873+0000","last_change":"2024-04-26T23:40:41.688506+0000","last_active":"2024-04-26T23:40:43.637873+0000","last_peered":"2024-04-26T23:40:43.637873+0000","last_clean":"2024-04-26T23:40:43.637873+0000","last_became_active":"2024-04-26T23:40:41.688224+0000","last_became_peered":"2024-04-26T23:40:41.688224+0000","last_unstale":"2024-04-26T23:40:43.637873+0000","last_undegraded":"2024-04-26T23:40:43.637873+0000","last_fullsized":"2024-04-26T23:40:43.637873+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:05:34.008024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.637217+0000","last_change":"2024-04-26T23:40:32.593528+0000","last_active":"2024-04-26T23:40:43.637217+0000","last_peered":"2024-04-26T23:40:43.637217+0000","last_clean":"2024-04-26T23:40:43.637217+0000","last_became_active":"2024-04-26T23:40:32.593220+0000","last_became_peered":"2024-04-26T23:40:32.593220+0000","last_unstale":"2024-04-26T23:40:43.637217+0000","last_undegraded":"2024-04-26T23:40:43.637217+0000","last_fullsized":"2024-04-26T23:40:43.637217+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:04:30.553552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":30,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.635390+0000","last_change":"2024-04-26T23:40:31.572685+0000","last_active":"2024-04-26T23:40:43.635390+0000","last_peered":"2024-04-26T23:40:43.635390+0000","last_clean":"2024-04-26T23:40:43.635390+0000","last_became_active":"2024-04-26T23:40:31.572169+0000","last_became_peered":"2024-04-26T23:40:31.572169+0000","last_unstale":"2024-04-26T23:40:43.635390+0000","last_undegraded":"2024-04-26T23:40:43.635390+0000","last_fullsized":"2024-04-26T23:40:43.635390+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:15:30.884135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.687059+0000","last_change":"2024-04-26T23:40:40.672160+0000","last_active":"2024-04-26T23:40:42.687059+0000","last_peered":"2024-04-26T23:40:42.687059+0000","last_clean":"2024-04-26T23:40:42.687059+0000","last_became_active":"2024-04-26T23:40:40.671875+0000","last_became_peered":"2024-04-26T23:40:40.671875+0000","last_unstale":"2024-04-26T23:40:42.687059+0000","last_undegraded":"2024-04-26T23:40:42.687059+0000","last_fullsized":"2024-04-26T23:40:42.687059+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:35:16.288571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.685105+0000","last_change":"2024-04-26T23:40:41.688445+0000","last_active":"2024-04-26T23:40:42.685105+0000","last_peered":"2024-04-26T23:40:42.685105+0000","last_clean":"2024-04-26T23:40:42.685105+0000","last_became_active":"2024-04-26T23:40:41.688053+0000","last_became_peered":"2024-04-26T23:40:41.688053+0000","last_unstale":"2024-04-26T23:40:42.685105+0000","last_undegraded":"2024-04-26T23:40:42.685105+0000","last_fullsized":"2024-04-26T23:40:42.685105+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:08:35.027584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.683320+0000","last_change":"2024-04-26T23:40:32.586832+0000","last_active":"2024-04-26T23:40:42.683320+0000","last_peered":"2024-04-26T23:40:42.683320+0000","last_clean":"2024-04-26T23:40:42.683320+0000","last_became_active":"2024-04-26T23:40:32.585809+0000","last_became_peered":"2024-04-26T23:40:32.585809+0000","last_unstale":"2024-04-26T23:40:42.683320+0000","last_undegraded":"2024-04-26T23:40:42.683320+0000","last_fullsized":"2024-04-26T23:40:42.683320+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:51:30.677247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.683971+0000","last_change":"2024-04-26T23:40:31.569512+0000","last_active":"2024-04-26T23:40:42.683971+0000","last_peered":"2024-04-26T23:40:42.683971+0000","last_clean":"2024-04-26T23:40:42.683971+0000","last_became_active":"2024-04-26T23:40:31.568598+0000","last_became_peered":"2024-04-26T23:40:31.568598+0000","last_unstale":"2024-04-26T23:40:42.683971+0000","last_undegraded":"2024-04-26T23:40:42.683971+0000","last_fullsized":"2024-04-26T23:40:42.683971+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:48:32.015654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.637928+0000","last_change":"2024-04-26T23:40:40.673986+0000","last_active":"2024-04-26T23:40:43.637928+0000","last_peered":"2024-04-26T23:40:43.637928+0000","last_clean":"2024-04-26T23:40:43.637928+0000","last_became_active":"2024-04-26T23:40:40.673704+0000","last_became_peered":"2024-04-26T23:40:40.673704+0000","last_unstale":"2024-04-26T23:40:43.637928+0000","last_undegraded":"2024-04-26T23:40:43.637928+0000","last_fullsized":"2024-04-26T23:40:43.637928+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:37:24.000775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.685367+0000","last_change":"2024-04-26T23:40:41.691441+0000","last_active":"2024-04-26T23:40:42.685367+0000","last_peered":"2024-04-26T23:40:42.685367+0000","last_clean":"2024-04-26T23:40:42.685367+0000","last_became_active":"2024-04-26T23:40:41.691160+0000","last_became_peered":"2024-04-26T23:40:41.691160+0000","last_unstale":"2024-04-26T23:40:42.685367+0000","last_undegraded":"2024-04-26T23:40:42.685367+0000","last_fullsized":"2024-04-26T23:40:42.685367+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:41:52.386084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636667+0000","last_change":"2024-04-26T23:40:32.595377+0000","last_active":"2024-04-26T23:40:43.636667+0000","last_peered":"2024-04-26T23:40:43.636667+0000","last_clean":"2024-04-26T23:40:43.636667+0000","last_became_active":"2024-04-26T23:40:32.595032+0000","last_became_peered":"2024-04-26T23:40:32.595032+0000","last_unstale":"2024-04-26T23:40:43.636667+0000","last_undegraded":"2024-04-26T23:40:43.636667+0000","last_fullsized":"2024-04-26T23:40:43.636667+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:44:42.494850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.684685+0000","last_change":"2024-04-26T23:40:31.575493+0000","last_active":"2024-04-26T23:40:42.684685+0000","last_peered":"2024-04-26T23:40:42.684685+0000","last_clean":"2024-04-26T23:40:42.684685+0000","last_became_active":"2024-04-26T23:40:31.575039+0000","last_became_peered":"2024-04-26T23:40:31.575039+0000","last_unstale":"2024-04-26T23:40:42.684685+0000","last_undegraded":"2024-04-26T23:40:42.684685+0000","last_fullsized":"2024-04-26T23:40:42.684685+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:43:13.740214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"23'6","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.637618+0000","last_change":"2024-04-26T23:40:40.676493+0000","last_active":"2024-04-26T23:40:43.637618+0000","last_peered":"2024-04-26T23:40:43.637618+0000","last_clean":"2024-04-26T23:40:43.637618+0000","last_became_active":"2024-04-26T23:40:40.676124+0000","last_became_peered":"2024-04-26T23:40:40.676124+0000","last_unstale":"2024-04-26T23:40:43.637618+0000","last_undegraded":"2024-04-26T23:40:43.637618+0000","last_fullsized":"2024-04-26T23:40:43.637618+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:28:33.915485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.637568+0000","last_change":"2024-04-26T23:40:41.680735+0000","last_active":"2024-04-26T23:40:43.637568+0000","last_peered":"2024-04-26T23:40:43.637568+0000","last_clean":"2024-04-26T23:40:43.637568+0000","last_became_active":"2024-04-26T23:40:41.680485+0000","last_became_peered":"2024-04-26T23:40:41.680485+0000","last_unstale":"2024-04-26T23:40:43.637568+0000","last_undegraded":"2024-04-26T23:40:43.637568+0000","last_fullsized":"2024-04-26T23:40:43.637568+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:38:51.195172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.686381+0000","last_change":"2024-04-26T23:40:32.589706+0000","last_active":"2024-04-26T23:40:42.686381+0000","last_peered":"2024-04-26T23:40:42.686381+0000","last_clean":"2024-04-26T23:40:42.686381+0000","last_became_active":"2024-04-26T23:40:32.589452+0000","last_became_peered":"2024-04-26T23:40:32.589452+0000","last_unstale":"2024-04-26T23:40:42.686381+0000","last_undegraded":"2024-04-26T23:40:42.686381+0000","last_fullsized":"2024-04-26T23:40:42.686381+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:15:01.970308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.686999+0000","last_change":"2024-04-26T23:40:31.573941+0000","last_active":"2024-04-26T23:40:42.686999+0000","last_peered":"2024-04-26T23:40:42.686999+0000","last_clean":"2024-04-26T23:40:42.686999+0000","last_became_active":"2024-04-26T23:40:31.573668+0000","last_became_peered":"2024-04-26T23:40:31.573668+0000","last_unstale":"2024-04-26T23:40:42.686999+0000","last_undegraded":"2024-04-26T23:40:42.686999+0000","last_fullsized":"2024-04-26T23:40:42.686999+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:58:06.477730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"23'3","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.685527+0000","last_change":"2024-04-26T23:40:40.676408+0000","last_active":"2024-04-26T23:40:42.685527+0000","last_peered":"2024-04-26T23:40:42.685527+0000","last_clean":"2024-04-26T23:40:42.685527+0000","last_became_active":"2024-04-26T23:40:40.676147+0000","last_became_peered":"2024-04-26T23:40:40.676147+0000","last_unstale":"2024-04-26T23:40:42.685527+0000","last_undegraded":"2024-04-26T23:40:42.685527+0000","last_fullsized":"2024-04-26T23:40:42.685527+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:27:47.818055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.637455+0000","last_change":"2024-04-26T23:40:41.685829+0000","last_active":"2024-04-26T23:40:43.637455+0000","last_peered":"2024-04-26T23:40:43.637455+0000","last_clean":"2024-04-26T23:40:43.637455+0000","last_became_active":"2024-04-26T23:40:41.685403+0000","last_became_peered":"2024-04-26T23:40:41.685403+0000","last_unstale":"2024-04-26T23:40:43.637455+0000","last_undegraded":"2024-04-26T23:40:43.637455+0000","last_fullsized":"2024-04-26T23:40:43.637455+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:24:07.784468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.637089+0000","last_change":"2024-04-26T23:40:32.587513+0000","last_active":"2024-04-26T23:40:43.637089+0000","last_peered":"2024-04-26T23:40:43.637089+0000","last_clean":"2024-04-26T23:40:43.637089+0000","last_became_active":"2024-04-26T23:40:32.587200+0000","last_became_peered":"2024-04-26T23:40:32.587200+0000","last_unstale":"2024-04-26T23:40:43.637089+0000","last_undegraded":"2024-04-26T23:40:43.637089+0000","last_fullsized":"2024-04-26T23:40:43.637089+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:37:30.361795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":28,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.683606+0000","last_change":"2024-04-26T23:40:31.572331+0000","last_active":"2024-04-26T23:40:42.683606+0000","last_peered":"2024-04-26T23:40:42.683606+0000","last_clean":"2024-04-26T23:40:42.683606+0000","last_became_active":"2024-04-26T23:40:31.572074+0000","last_became_peered":"2024-04-26T23:40:31.572074+0000","last_unstale":"2024-04-26T23:40:42.683606+0000","last_undegraded":"2024-04-26T23:40:42.683606+0000","last_fullsized":"2024-04-26T23:40:42.683606+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:45:49.295198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.635520+0000","last_change":"2024-04-26T23:40:40.677978+0000","last_active":"2024-04-26T23:40:43.635520+0000","last_peered":"2024-04-26T23:40:43.635520+0000","last_clean":"2024-04-26T23:40:43.635520+0000","last_became_active":"2024-04-26T23:40:40.677714+0000","last_became_peered":"2024-04-26T23:40:40.677714+0000","last_unstale":"2024-04-26T23:40:43.635520+0000","last_undegraded":"2024-04-26T23:40:43.635520+0000","last_fullsized":"2024-04-26T23:40:43.635520+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:44:50.588556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636093+0000","last_change":"2024-04-26T23:40:41.685431+0000","last_active":"2024-04-26T23:40:43.636093+0000","last_peered":"2024-04-26T23:40:43.636093+0000","last_clean":"2024-04-26T23:40:43.636093+0000","last_became_active":"2024-04-26T23:40:41.685147+0000","last_became_peered":"2024-04-26T23:40:41.685147+0000","last_unstale":"2024-04-26T23:40:43.636093+0000","last_undegraded":"2024-04-26T23:40:43.636093+0000","last_fullsized":"2024-04-26T23:40:43.636093+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:33:16.389626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636824+0000","last_change":"2024-04-26T23:40:32.593298+0000","last_active":"2024-04-26T23:40:43.636824+0000","last_peered":"2024-04-26T23:40:43.636824+0000","last_clean":"2024-04-26T23:40:43.636824+0000","last_became_active":"2024-04-26T23:40:32.593030+0000","last_became_peered":"2024-04-26T23:40:32.593030+0000","last_unstale":"2024-04-26T23:40:43.636824+0000","last_undegraded":"2024-04-26T23:40:43.636824+0000","last_fullsized":"2024-04-26T23:40:43.636824+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:20:29.107798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636957+0000","last_change":"2024-04-26T23:40:31.574234+0000","last_active":"2024-04-26T23:40:43.636957+0000","last_peered":"2024-04-26T23:40:43.636957+0000","last_clean":"2024-04-26T23:40:43.636957+0000","last_became_active":"2024-04-26T23:40:31.572218+0000","last_became_peered":"2024-04-26T23:40:31.572218+0000","last_unstale":"2024-04-26T23:40:43.636957+0000","last_undegraded":"2024-04-26T23:40:43.636957+0000","last_fullsized":"2024-04-26T23:40:43.636957+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:25:01.315397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"23'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.637149+0000","last_change":"2024-04-26T23:40:40.674778+0000","last_active":"2024-04-26T23:40:43.637149+0000","last_peered":"2024-04-26T23:40:43.637149+0000","last_clean":"2024-04-26T23:40:43.637149+0000","last_became_active":"2024-04-26T23:40:40.674487+0000","last_became_peered":"2024-04-26T23:40:40.674487+0000","last_unstale":"2024-04-26T23:40:43.637149+0000","last_undegraded":"2024-04-26T23:40:43.637149+0000","last_fullsized":"2024-04-26T23:40:43.637149+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:10:10.722905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.683588+0000","last_change":"2024-04-26T23:40:41.686531+0000","last_active":"2024-04-26T23:40:42.683588+0000","last_peered":"2024-04-26T23:40:42.683588+0000","last_clean":"2024-04-26T23:40:42.683588+0000","last_became_active":"2024-04-26T23:40:41.686259+0000","last_became_peered":"2024-04-26T23:40:41.686259+0000","last_unstale":"2024-04-26T23:40:42.683588+0000","last_undegraded":"2024-04-26T23:40:42.683588+0000","last_fullsized":"2024-04-26T23:40:42.683588+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:45:34.231942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.686899+0000","last_change":"2024-04-26T23:40:32.589146+0000","last_active":"2024-04-26T23:40:42.686899+0000","last_peered":"2024-04-26T23:40:42.686899+0000","last_clean":"2024-04-26T23:40:42.686899+0000","last_became_active":"2024-04-26T23:40:32.588881+0000","last_became_peered":"2024-04-26T23:40:32.588881+0000","last_unstale":"2024-04-26T23:40:42.686899+0000","last_undegraded":"2024-04-26T23:40:42.686899+0000","last_fullsized":"2024-04-26T23:40:42.686899+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:38:10.884592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.685165+0000","last_change":"2024-04-26T23:40:31.575616+0000","last_active":"2024-04-26T23:40:42.685165+0000","last_peered":"2024-04-26T23:40:42.685165+0000","last_clean":"2024-04-26T23:40:42.685165+0000","last_became_active":"2024-04-26T23:40:31.575211+0000","last_became_peered":"2024-04-26T23:40:31.575211+0000","last_unstale":"2024-04-26T23:40:42.685165+0000","last_undegraded":"2024-04-26T23:40:42.685165+0000","last_fullsized":"2024-04-26T23:40:42.685165+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:48:32.015654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"23'8","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636684+0000","last_change":"2024-04-26T23:40:40.675694+0000","last_active":"2024-04-26T23:40:43.636684+0000","last_peered":"2024-04-26T23:40:43.636684+0000","last_clean":"2024-04-26T23:40:43.636684+0000","last_became_active":"2024-04-26T23:40:40.675459+0000","last_became_peered":"2024-04-26T23:40:40.675459+0000","last_unstale":"2024-04-26T23:40:43.636684+0000","last_undegraded":"2024-04-26T23:40:43.636684+0000","last_fullsized":"2024-04-26T23:40:43.636684+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:30:03.993564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.635596+0000","last_change":"2024-04-26T23:40:41.687488+0000","last_active":"2024-04-26T23:40:43.635596+0000","last_peered":"2024-04-26T23:40:43.635596+0000","last_clean":"2024-04-26T23:40:43.635596+0000","last_became_active":"2024-04-26T23:40:41.687210+0000","last_became_peered":"2024-04-26T23:40:41.687210+0000","last_unstale":"2024-04-26T23:40:43.635596+0000","last_undegraded":"2024-04-26T23:40:43.635596+0000","last_fullsized":"2024-04-26T23:40:43.635596+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:36:21.487122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.685110+0000","last_change":"2024-04-26T23:40:32.589793+0000","last_active":"2024-04-26T23:40:42.685110+0000","last_peered":"2024-04-26T23:40:42.685110+0000","last_clean":"2024-04-26T23:40:42.685110+0000","last_became_active":"2024-04-26T23:40:32.589478+0000","last_became_peered":"2024-04-26T23:40:32.589478+0000","last_unstale":"2024-04-26T23:40:42.685110+0000","last_undegraded":"2024-04-26T23:40:42.685110+0000","last_fullsized":"2024-04-26T23:40:42.685110+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:56:04.309611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.684275+0000","last_change":"2024-04-26T23:40:31.573794+0000","last_active":"2024-04-26T23:40:42.684275+0000","last_peered":"2024-04-26T23:40:42.684275+0000","last_clean":"2024-04-26T23:40:42.684275+0000","last_became_active":"2024-04-26T23:40:31.573164+0000","last_became_peered":"2024-04-26T23:40:31.573164+0000","last_unstale":"2024-04-26T23:40:42.684275+0000","last_undegraded":"2024-04-26T23:40:42.684275+0000","last_fullsized":"2024-04-26T23:40:42.684275+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:15:30.884135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636808+0000","last_change":"2024-04-26T23:40:40.674127+0000","last_active":"2024-04-26T23:40:43.636808+0000","last_peered":"2024-04-26T23:40:43.636808+0000","last_clean":"2024-04-26T23:40:43.636808+0000","last_became_active":"2024-04-26T23:40:40.673793+0000","last_became_peered":"2024-04-26T23:40:40.673793+0000","last_unstale":"2024-04-26T23:40:43.636808+0000","last_undegraded":"2024-04-26T23:40:43.636808+0000","last_fullsized":"2024-04-26T23:40:43.636808+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:53:12.526011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.684571+0000","last_change":"2024-04-26T23:40:41.686867+0000","last_active":"2024-04-26T23:40:42.684571+0000","last_peered":"2024-04-26T23:40:42.684571+0000","last_clean":"2024-04-26T23:40:42.684571+0000","last_became_active":"2024-04-26T23:40:41.686536+0000","last_became_peered":"2024-04-26T23:40:41.686536+0000","last_unstale":"2024-04-26T23:40:42.684571+0000","last_undegraded":"2024-04-26T23:40:42.684571+0000","last_fullsized":"2024-04-26T23:40:42.684571+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:28:34.920939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"23'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.686809+0000","last_change":"2024-04-26T23:40:40.674915+0000","last_active":"2024-04-26T23:40:42.686809+0000","last_peered":"2024-04-26T23:40:42.686809+0000","last_clean":"2024-04-26T23:40:42.686809+0000","last_became_active":"2024-04-26T23:40:40.674639+0000","last_became_peered":"2024-04-26T23:40:40.674639+0000","last_unstale":"2024-04-26T23:40:42.686809+0000","last_undegraded":"2024-04-26T23:40:42.686809+0000","last_fullsized":"2024-04-26T23:40:42.686809+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:52:34.793496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.635465+0000","last_change":"2024-04-26T23:40:32.583014+0000","last_active":"2024-04-26T23:40:43.635465+0000","last_peered":"2024-04-26T23:40:43.635465+0000","last_clean":"2024-04-26T23:40:43.635465+0000","last_became_active":"2024-04-26T23:40:32.582751+0000","last_became_peered":"2024-04-26T23:40:32.582751+0000","last_unstale":"2024-04-26T23:40:43.635465+0000","last_undegraded":"2024-04-26T23:40:43.635465+0000","last_fullsized":"2024-04-26T23:40:43.635465+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:38:10.884592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.685541+0000","last_change":"2024-04-26T23:40:31.572402+0000","last_active":"2024-04-26T23:40:42.685541+0000","last_peered":"2024-04-26T23:40:42.685541+0000","last_clean":"2024-04-26T23:40:42.685541+0000","last_became_active":"2024-04-26T23:40:31.572111+0000","last_became_peered":"2024-04-26T23:40:31.572111+0000","last_unstale":"2024-04-26T23:40:42.685541+0000","last_undegraded":"2024-04-26T23:40:42.685541+0000","last_fullsized":"2024-04-26T23:40:42.685541+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:20:28.103413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.686752+0000","last_change":"2024-04-26T23:40:41.684524+0000","last_active":"2024-04-26T23:40:42.686752+0000","last_peered":"2024-04-26T23:40:42.686752+0000","last_clean":"2024-04-26T23:40:42.686752+0000","last_became_active":"2024-04-26T23:40:41.684207+0000","last_became_peered":"2024-04-26T23:40:41.684207+0000","last_unstale":"2024-04-26T23:40:42.686752+0000","last_undegraded":"2024-04-26T23:40:42.686752+0000","last_fullsized":"2024-04-26T23:40:42.686752+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:30:04.999018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"23'4","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.684153+0000","last_change":"2024-04-26T23:40:40.674934+0000","last_active":"2024-04-26T23:40:42.684153+0000","last_peered":"2024-04-26T23:40:42.684153+0000","last_clean":"2024-04-26T23:40:42.684153+0000","last_became_active":"2024-04-26T23:40:40.674628+0000","last_became_peered":"2024-04-26T23:40:40.674628+0000","last_unstale":"2024-04-26T23:40:42.684153+0000","last_undegraded":"2024-04-26T23:40:42.684153+0000","last_fullsized":"2024-04-26T23:40:42.684153+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:44:50.588556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636777+0000","last_change":"2024-04-26T23:40:32.586204+0000","last_active":"2024-04-26T23:40:43.636777+0000","last_peered":"2024-04-26T23:40:43.636777+0000","last_clean":"2024-04-26T23:40:43.636777+0000","last_became_active":"2024-04-26T23:40:32.585725+0000","last_became_peered":"2024-04-26T23:40:32.585725+0000","last_unstale":"2024-04-26T23:40:43.636777+0000","last_undegraded":"2024-04-26T23:40:43.636777+0000","last_fullsized":"2024-04-26T23:40:43.636777+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:51:30.677247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.637081+0000","last_change":"2024-04-26T23:40:31.578929+0000","last_active":"2024-04-26T23:40:43.637081+0000","last_peered":"2024-04-26T23:40:43.637081+0000","last_clean":"2024-04-26T23:40:43.637081+0000","last_became_active":"2024-04-26T23:40:31.578623+0000","last_became_peered":"2024-04-26T23:40:31.578623+0000","last_unstale":"2024-04-26T23:40:43.637081+0000","last_undegraded":"2024-04-26T23:40:43.637081+0000","last_fullsized":"2024-04-26T23:40:43.637081+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:50:21.330821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.637097+0000","last_change":"2024-04-26T23:40:41.689697+0000","last_active":"2024-04-26T23:40:43.637097+0000","last_peered":"2024-04-26T23:40:43.637097+0000","last_clean":"2024-04-26T23:40:43.637097+0000","last_became_active":"2024-04-26T23:40:41.688428+0000","last_became_peered":"2024-04-26T23:40:41.688428+0000","last_unstale":"2024-04-26T23:40:43.637097+0000","last_undegraded":"2024-04-26T23:40:43.637097+0000","last_fullsized":"2024-04-26T23:40:43.637097+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:36:21.487122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.684234+0000","last_change":"2024-04-26T23:40:31.567755+0000","last_active":"2024-04-26T23:40:42.684234+0000","last_peered":"2024-04-26T23:40:42.684234+0000","last_clean":"2024-04-26T23:40:42.684234+0000","last_became_active":"2024-04-26T23:40:31.567484+0000","last_became_peered":"2024-04-26T23:40:31.567484+0000","last_unstale":"2024-04-26T23:40:42.684234+0000","last_undegraded":"2024-04-26T23:40:42.684234+0000","last_fullsized":"2024-04-26T23:40:42.684234+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:43:13.740214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.686881+0000","last_change":"2024-04-26T23:40:32.594689+0000","last_active":"2024-04-26T23:40:42.686881+0000","last_peered":"2024-04-26T23:40:42.686881+0000","last_clean":"2024-04-26T23:40:42.686881+0000","last_became_active":"2024-04-26T23:40:32.592365+0000","last_became_peered":"2024-04-26T23:40:32.592365+0000","last_unstale":"2024-04-26T23:40:42.686881+0000","last_undegraded":"2024-04-26T23:40:42.686881+0000","last_fullsized":"2024-04-26T23:40:42.686881+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:17:46.135806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"23'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.635940+0000","last_change":"2024-04-26T23:40:40.676028+0000","last_active":"2024-04-26T23:40:43.635940+0000","last_peered":"2024-04-26T23:40:43.635940+0000","last_clean":"2024-04-26T23:40:43.635940+0000","last_became_active":"2024-04-26T23:40:40.675736+0000","last_became_peered":"2024-04-26T23:40:40.675736+0000","last_unstale":"2024-04-26T23:40:43.635940+0000","last_undegraded":"2024-04-26T23:40:43.635940+0000","last_fullsized":"2024-04-26T23:40:43.635940+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:51:38.770953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636545+0000","last_change":"2024-04-26T23:40:41.690148+0000","last_active":"2024-04-26T23:40:43.636545+0000","last_peered":"2024-04-26T23:40:43.636545+0000","last_clean":"2024-04-26T23:40:43.636545+0000","last_became_active":"2024-04-26T23:40:41.689765+0000","last_became_peered":"2024-04-26T23:40:41.689765+0000","last_unstale":"2024-04-26T23:40:43.636545+0000","last_undegraded":"2024-04-26T23:40:43.636545+0000","last_fullsized":"2024-04-26T23:40:43.636545+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:33:16.389626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.637574+0000","last_change":"2024-04-26T23:40:31.576749+0000","last_active":"2024-04-26T23:40:43.637574+0000","last_peered":"2024-04-26T23:40:43.637574+0000","last_clean":"2024-04-26T23:40:43.637574+0000","last_became_active":"2024-04-26T23:40:31.576178+0000","last_became_peered":"2024-04-26T23:40:31.576178+0000","last_unstale":"2024-04-26T23:40:43.637574+0000","last_undegraded":"2024-04-26T23:40:43.637574+0000","last_fullsized":"2024-04-26T23:40:43.637574+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:15:30.884135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636389+0000","last_change":"2024-04-26T23:40:32.589208+0000","last_active":"2024-04-26T23:40:43.636389+0000","last_peered":"2024-04-26T23:40:43.636389+0000","last_clean":"2024-04-26T23:40:43.636389+0000","last_became_active":"2024-04-26T23:40:32.588927+0000","last_became_peered":"2024-04-26T23:40:32.588927+0000","last_unstale":"2024-04-26T23:40:43.636389+0000","last_undegraded":"2024-04-26T23:40:43.636389+0000","last_fullsized":"2024-04-26T23:40:43.636389+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:45:50.299583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"23'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.637675+0000","last_change":"2024-04-26T23:40:40.676809+0000","last_active":"2024-04-26T23:40:43.637675+0000","last_peered":"2024-04-26T23:40:43.637675+0000","last_clean":"2024-04-26T23:40:43.637675+0000","last_became_active":"2024-04-26T23:40:40.676070+0000","last_became_peered":"2024-04-26T23:40:40.676070+0000","last_unstale":"2024-04-26T23:40:43.637675+0000","last_undegraded":"2024-04-26T23:40:43.637675+0000","last_fullsized":"2024-04-26T23:40:43.637675+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:17:27.667323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.637854+0000","last_change":"2024-04-26T23:40:41.679796+0000","last_active":"2024-04-26T23:40:43.637854+0000","last_peered":"2024-04-26T23:40:43.637854+0000","last_clean":"2024-04-26T23:40:43.637854+0000","last_became_active":"2024-04-26T23:40:41.679523+0000","last_became_peered":"2024-04-26T23:40:41.679523+0000","last_unstale":"2024-04-26T23:40:43.637854+0000","last_undegraded":"2024-04-26T23:40:43.637854+0000","last_fullsized":"2024-04-26T23:40:43.637854+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:43:02.137315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.683465+0000","last_change":"2024-04-26T23:40:32.586672+0000","last_active":"2024-04-26T23:40:42.683465+0000","last_peered":"2024-04-26T23:40:42.683465+0000","last_clean":"2024-04-26T23:40:42.683465+0000","last_became_active":"2024-04-26T23:40:32.586399+0000","last_became_peered":"2024-04-26T23:40:32.586399+0000","last_unstale":"2024-04-26T23:40:42.683465+0000","last_undegraded":"2024-04-26T23:40:42.683465+0000","last_fullsized":"2024-04-26T23:40:42.683465+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:15:01.970308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636388+0000","last_change":"2024-04-26T23:40:41.687529+0000","last_active":"2024-04-26T23:40:43.636388+0000","last_peered":"2024-04-26T23:40:43.636388+0000","last_clean":"2024-04-26T23:40:43.636388+0000","last_became_active":"2024-04-26T23:40:41.686974+0000","last_became_peered":"2024-04-26T23:40:41.686974+0000","last_unstale":"2024-04-26T23:40:43.636388+0000","last_undegraded":"2024-04-26T23:40:43.636388+0000","last_fullsized":"2024-04-26T23:40:43.636388+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:21:56.950703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.635606+0000","last_change":"2024-04-26T23:40:32.584590+0000","last_active":"2024-04-26T23:40:43.635606+0000","last_peered":"2024-04-26T23:40:43.635606+0000","last_clean":"2024-04-26T23:40:43.635606+0000","last_became_active":"2024-04-26T23:40:32.584234+0000","last_became_peered":"2024-04-26T23:40:32.584234+0000","last_unstale":"2024-04-26T23:40:43.635606+0000","last_undegraded":"2024-04-26T23:40:43.635606+0000","last_fullsized":"2024-04-26T23:40:43.635606+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:15:52.942160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.685091+0000","last_change":"2024-04-26T23:40:41.679549+0000","last_active":"2024-04-26T23:40:42.685091+0000","last_peered":"2024-04-26T23:40:42.685091+0000","last_clean":"2024-04-26T23:40:42.685091+0000","last_became_active":"2024-04-26T23:40:41.679254+0000","last_became_peered":"2024-04-26T23:40:41.679254+0000","last_unstale":"2024-04-26T23:40:42.685091+0000","last_undegraded":"2024-04-26T23:40:42.685091+0000","last_fullsized":"2024-04-26T23:40:42.685091+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:48:09.126894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.684675+0000","last_change":"2024-04-26T23:40:32.580453+0000","last_active":"2024-04-26T23:40:42.684675+0000","last_peered":"2024-04-26T23:40:42.684675+0000","last_clean":"2024-04-26T23:40:42.684675+0000","last_became_active":"2024-04-26T23:40:32.580196+0000","last_became_peered":"2024-04-26T23:40:32.580196+0000","last_unstale":"2024-04-26T23:40:42.684675+0000","last_undegraded":"2024-04-26T23:40:42.684675+0000","last_fullsized":"2024-04-26T23:40:42.684675+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:18:09.706875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636745+0000","last_change":"2024-04-26T23:40:41.690579+0000","last_active":"2024-04-26T23:40:43.636745+0000","last_peered":"2024-04-26T23:40:43.636745+0000","last_clean":"2024-04-26T23:40:43.636745+0000","last_became_active":"2024-04-26T23:40:41.690262+0000","last_became_peered":"2024-04-26T23:40:41.690262+0000","last_unstale":"2024-04-26T23:40:43.636745+0000","last_undegraded":"2024-04-26T23:40:43.636745+0000","last_fullsized":"2024-04-26T23:40:43.636745+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:10:30.972726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.686790+0000","last_change":"2024-04-26T23:40:32.584323+0000","last_active":"2024-04-26T23:40:42.686790+0000","last_peered":"2024-04-26T23:40:42.686790+0000","last_clean":"2024-04-26T23:40:42.686790+0000","last_became_active":"2024-04-26T23:40:32.584010+0000","last_became_peered":"2024-04-26T23:40:32.584010+0000","last_unstale":"2024-04-26T23:40:42.686790+0000","last_undegraded":"2024-04-26T23:40:42.686790+0000","last_fullsized":"2024-04-26T23:40:42.686790+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:16:46.547536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636036+0000","last_change":"2024-04-26T23:40:41.677679+0000","last_active":"2024-04-26T23:40:43.636036+0000","last_peered":"2024-04-26T23:40:43.636036+0000","last_clean":"2024-04-26T23:40:43.636036+0000","last_became_active":"2024-04-26T23:40:41.677398+0000","last_became_peered":"2024-04-26T23:40:41.677398+0000","last_unstale":"2024-04-26T23:40:43.636036+0000","last_undegraded":"2024-04-26T23:40:43.636036+0000","last_fullsized":"2024-04-26T23:40:43.636036+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:42:13.754586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.637704+0000","last_change":"2024-04-26T23:40:32.587921+0000","last_active":"2024-04-26T23:40:43.637704+0000","last_peered":"2024-04-26T23:40:43.637704+0000","last_clean":"2024-04-26T23:40:43.637704+0000","last_became_active":"2024-04-26T23:40:32.587630+0000","last_became_peered":"2024-04-26T23:40:32.587630+0000","last_unstale":"2024-04-26T23:40:43.637704+0000","last_undegraded":"2024-04-26T23:40:43.637704+0000","last_fullsized":"2024-04-26T23:40:43.637704+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:01:02.741964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.637255+0000","last_change":"2024-04-26T23:40:41.690235+0000","last_active":"2024-04-26T23:40:43.637255+0000","last_peered":"2024-04-26T23:40:43.637255+0000","last_clean":"2024-04-26T23:40:43.637255+0000","last_became_active":"2024-04-26T23:40:41.689911+0000","last_became_peered":"2024-04-26T23:40:41.689911+0000","last_unstale":"2024-04-26T23:40:43.637255+0000","last_undegraded":"2024-04-26T23:40:43.637255+0000","last_fullsized":"2024-04-26T23:40:43.637255+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:21:56.950703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636863+0000","last_change":"2024-04-26T23:40:32.583376+0000","last_active":"2024-04-26T23:40:43.636863+0000","last_peered":"2024-04-26T23:40:43.636863+0000","last_clean":"2024-04-26T23:40:43.636863+0000","last_became_active":"2024-04-26T23:40:32.583089+0000","last_became_peered":"2024-04-26T23:40:32.583089+0000","last_unstale":"2024-04-26T23:40:43.636863+0000","last_undegraded":"2024-04-26T23:40:43.636863+0000","last_fullsized":"2024-04-26T23:40:43.636863+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:17:46.135806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.635479+0000","last_change":"2024-04-26T23:40:41.688464+0000","last_active":"2024-04-26T23:40:43.635479+0000","last_peered":"2024-04-26T23:40:43.635479+0000","last_clean":"2024-04-26T23:40:43.635479+0000","last_became_active":"2024-04-26T23:40:41.688028+0000","last_became_peered":"2024-04-26T23:40:41.688028+0000","last_unstale":"2024-04-26T23:40:43.635479+0000","last_undegraded":"2024-04-26T23:40:43.635479+0000","last_fullsized":"2024-04-26T23:40:43.635479+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:21:56.950703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.684171+0000","last_change":"2024-04-26T23:40:32.589080+0000","last_active":"2024-04-26T23:40:42.684171+0000","last_peered":"2024-04-26T23:40:42.684171+0000","last_clean":"2024-04-26T23:40:42.684171+0000","last_became_active":"2024-04-26T23:40:32.588793+0000","last_became_peered":"2024-04-26T23:40:32.588793+0000","last_unstale":"2024-04-26T23:40:42.684171+0000","last_undegraded":"2024-04-26T23:40:42.684171+0000","last_fullsized":"2024-04-26T23:40:42.684171+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:18:09.706875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.684432+0000","last_change":"2024-04-26T23:40:41.688445+0000","last_active":"2024-04-26T23:40:42.684432+0000","last_peered":"2024-04-26T23:40:42.684432+0000","last_clean":"2024-04-26T23:40:42.684432+0000","last_became_active":"2024-04-26T23:40:41.688163+0000","last_became_peered":"2024-04-26T23:40:41.688163+0000","last_unstale":"2024-04-26T23:40:42.684432+0000","last_undegraded":"2024-04-26T23:40:42.684432+0000","last_fullsized":"2024-04-26T23:40:42.684432+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:30:04.999018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.637912+0000","last_change":"2024-04-26T23:40:32.588177+0000","last_active":"2024-04-26T23:40:43.637912+0000","last_peered":"2024-04-26T23:40:43.637912+0000","last_clean":"2024-04-26T23:40:43.637912+0000","last_became_active":"2024-04-26T23:40:32.586926+0000","last_became_peered":"2024-04-26T23:40:32.586926+0000","last_unstale":"2024-04-26T23:40:43.637912+0000","last_undegraded":"2024-04-26T23:40:43.637912+0000","last_fullsized":"2024-04-26T23:40:43.637912+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:34:14.811917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.637801+0000","last_change":"2024-04-26T23:40:41.688396+0000","last_active":"2024-04-26T23:40:43.637801+0000","last_peered":"2024-04-26T23:40:43.637801+0000","last_clean":"2024-04-26T23:40:43.637801+0000","last_became_active":"2024-04-26T23:40:41.688087+0000","last_became_peered":"2024-04-26T23:40:41.688087+0000","last_unstale":"2024-04-26T23:40:43.637801+0000","last_undegraded":"2024-04-26T23:40:43.637801+0000","last_fullsized":"2024-04-26T23:40:43.637801+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:00:49.397610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.685486+0000","last_change":"2024-04-26T23:40:32.582959+0000","last_active":"2024-04-26T23:40:42.685486+0000","last_peered":"2024-04-26T23:40:42.685486+0000","last_clean":"2024-04-26T23:40:42.685486+0000","last_became_active":"2024-04-26T23:40:32.582100+0000","last_became_peered":"2024-04-26T23:40:32.582100+0000","last_unstale":"2024-04-26T23:40:42.685486+0000","last_undegraded":"2024-04-26T23:40:42.685486+0000","last_fullsized":"2024-04-26T23:40:42.685486+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:37:30.361795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636150+0000","last_change":"2024-04-26T23:40:41.681088+0000","last_active":"2024-04-26T23:40:43.636150+0000","last_peered":"2024-04-26T23:40:43.636150+0000","last_clean":"2024-04-26T23:40:43.636150+0000","last_became_active":"2024-04-26T23:40:41.680581+0000","last_became_peered":"2024-04-26T23:40:41.680581+0000","last_unstale":"2024-04-26T23:40:43.636150+0000","last_undegraded":"2024-04-26T23:40:43.636150+0000","last_fullsized":"2024-04-26T23:40:43.636150+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:41:52.386084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636996+0000","last_change":"2024-04-26T23:40:32.593958+0000","last_active":"2024-04-26T23:40:43.636996+0000","last_peered":"2024-04-26T23:40:43.636996+0000","last_clean":"2024-04-26T23:40:43.636996+0000","last_became_active":"2024-04-26T23:40:32.593639+0000","last_became_peered":"2024-04-26T23:40:32.593639+0000","last_unstale":"2024-04-26T23:40:43.636996+0000","last_undegraded":"2024-04-26T23:40:43.636996+0000","last_fullsized":"2024-04-26T23:40:43.636996+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:17:46.135806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.635826+0000","last_change":"2024-04-26T23:40:41.674573+0000","last_active":"2024-04-26T23:40:43.635826+0000","last_peered":"2024-04-26T23:40:43.635826+0000","last_clean":"2024-04-26T23:40:43.635826+0000","last_became_active":"2024-04-26T23:40:41.674274+0000","last_became_peered":"2024-04-26T23:40:41.674274+0000","last_unstale":"2024-04-26T23:40:43.635826+0000","last_undegraded":"2024-04-26T23:40:43.635826+0000","last_fullsized":"2024-04-26T23:40:43.635826+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:37:39.460955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.684563+0000","last_change":"2024-04-26T23:40:32.591700+0000","last_active":"2024-04-26T23:40:42.684563+0000","last_peered":"2024-04-26T23:40:42.684563+0000","last_clean":"2024-04-26T23:40:42.684563+0000","last_became_active":"2024-04-26T23:40:32.591366+0000","last_became_peered":"2024-04-26T23:40:32.591366+0000","last_unstale":"2024-04-26T23:40:42.684563+0000","last_undegraded":"2024-04-26T23:40:42.684563+0000","last_fullsized":"2024-04-26T23:40:42.684563+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:10:02.629199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.637569+0000","last_change":"2024-04-26T23:40:41.692402+0000","last_active":"2024-04-26T23:40:43.637569+0000","last_peered":"2024-04-26T23:40:43.637569+0000","last_clean":"2024-04-26T23:40:43.637569+0000","last_became_active":"2024-04-26T23:40:41.692122+0000","last_became_peered":"2024-04-26T23:40:41.692122+0000","last_unstale":"2024-04-26T23:40:43.637569+0000","last_undegraded":"2024-04-26T23:40:43.637569+0000","last_fullsized":"2024-04-26T23:40:43.637569+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:06:12.755431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.686711+0000","last_change":"2024-04-26T23:40:32.590443+0000","last_active":"2024-04-26T23:40:42.686711+0000","last_peered":"2024-04-26T23:40:42.686711+0000","last_clean":"2024-04-26T23:40:42.686711+0000","last_became_active":"2024-04-26T23:40:32.590193+0000","last_became_peered":"2024-04-26T23:40:32.590193+0000","last_unstale":"2024-04-26T23:40:42.686711+0000","last_undegraded":"2024-04-26T23:40:42.686711+0000","last_fullsized":"2024-04-26T23:40:42.686711+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:14:04.372681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636077+0000","last_change":"2024-04-26T23:40:41.692194+0000","last_active":"2024-04-26T23:40:43.636077+0000","last_peered":"2024-04-26T23:40:43.636077+0000","last_clean":"2024-04-26T23:40:43.636077+0000","last_became_active":"2024-04-26T23:40:41.691837+0000","last_became_peered":"2024-04-26T23:40:41.691837+0000","last_unstale":"2024-04-26T23:40:43.636077+0000","last_undegraded":"2024-04-26T23:40:43.636077+0000","last_fullsized":"2024-04-26T23:40:43.636077+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:58:45.972045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.683546+0000","last_change":"2024-04-26T23:40:32.590538+0000","last_active":"2024-04-26T23:40:42.683546+0000","last_peered":"2024-04-26T23:40:42.683546+0000","last_clean":"2024-04-26T23:40:42.683546+0000","last_became_active":"2024-04-26T23:40:32.590241+0000","last_became_peered":"2024-04-26T23:40:32.590241+0000","last_unstale":"2024-04-26T23:40:42.683546+0000","last_undegraded":"2024-04-26T23:40:42.683546+0000","last_fullsized":"2024-04-26T23:40:42.683546+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:38:10.884592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636930+0000","last_change":"2024-04-26T23:40:41.689529+0000","last_active":"2024-04-26T23:40:43.636930+0000","last_peered":"2024-04-26T23:40:43.636930+0000","last_clean":"2024-04-26T23:40:43.636930+0000","last_became_active":"2024-04-26T23:40:41.689215+0000","last_became_peered":"2024-04-26T23:40:41.689215+0000","last_unstale":"2024-04-26T23:40:43.636930+0000","last_undegraded":"2024-04-26T23:40:43.636930+0000","last_fullsized":"2024-04-26T23:40:43.636930+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:38:42.155257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.637293+0000","last_change":"2024-04-26T23:40:32.588445+0000","last_active":"2024-04-26T23:40:43.637293+0000","last_peered":"2024-04-26T23:40:43.637293+0000","last_clean":"2024-04-26T23:40:43.637293+0000","last_became_active":"2024-04-26T23:40:32.588063+0000","last_became_peered":"2024-04-26T23:40:32.588063+0000","last_unstale":"2024-04-26T23:40:43.637293+0000","last_undegraded":"2024-04-26T23:40:43.637293+0000","last_fullsized":"2024-04-26T23:40:43.637293+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:44:58.977344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.684980+0000","last_change":"2024-04-26T23:40:41.674893+0000","last_active":"2024-04-26T23:40:42.684980+0000","last_peered":"2024-04-26T23:40:42.684980+0000","last_clean":"2024-04-26T23:40:42.684980+0000","last_became_active":"2024-04-26T23:40:41.674573+0000","last_became_peered":"2024-04-26T23:40:41.674573+0000","last_unstale":"2024-04-26T23:40:42.684980+0000","last_undegraded":"2024-04-26T23:40:42.684980+0000","last_fullsized":"2024-04-26T23:40:42.684980+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:36:21.487122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636258+0000","last_change":"2024-04-26T23:40:32.574795+0000","last_active":"2024-04-26T23:40:43.636258+0000","last_peered":"2024-04-26T23:40:43.636258+0000","last_clean":"2024-04-26T23:40:43.636258+0000","last_became_active":"2024-04-26T23:40:32.574503+0000","last_became_peered":"2024-04-26T23:40:32.574503+0000","last_unstale":"2024-04-26T23:40:43.636258+0000","last_undegraded":"2024-04-26T23:40:43.636258+0000","last_fullsized":"2024-04-26T23:40:43.636258+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:30:11.401955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.686330+0000","last_change":"2024-04-26T23:40:41.680247+0000","last_active":"2024-04-26T23:40:42.686330+0000","last_peered":"2024-04-26T23:40:42.686330+0000","last_clean":"2024-04-26T23:40:42.686330+0000","last_became_active":"2024-04-26T23:40:41.679920+0000","last_became_peered":"2024-04-26T23:40:41.679920+0000","last_unstale":"2024-04-26T23:40:42.686330+0000","last_undegraded":"2024-04-26T23:40:42.686330+0000","last_fullsized":"2024-04-26T23:40:42.686330+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:53:13.531466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.685801+0000","last_change":"2024-04-26T23:40:32.593432+0000","last_active":"2024-04-26T23:40:42.685801+0000","last_peered":"2024-04-26T23:40:42.685801+0000","last_clean":"2024-04-26T23:40:42.685801+0000","last_became_active":"2024-04-26T23:40:32.593169+0000","last_became_peered":"2024-04-26T23:40:32.593169+0000","last_unstale":"2024-04-26T23:40:42.685801+0000","last_undegraded":"2024-04-26T23:40:42.685801+0000","last_fullsized":"2024-04-26T23:40:42.685801+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:44:42.494850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.635935+0000","last_change":"2024-04-26T23:40:41.694551+0000","last_active":"2024-04-26T23:40:43.635935+0000","last_peered":"2024-04-26T23:40:43.635935+0000","last_clean":"2024-04-26T23:40:43.635935+0000","last_became_active":"2024-04-26T23:40:41.694297+0000","last_became_peered":"2024-04-26T23:40:41.694297+0000","last_unstale":"2024-04-26T23:40:43.635935+0000","last_undegraded":"2024-04-26T23:40:43.635935+0000","last_fullsized":"2024-04-26T23:40:43.635935+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:02:27.160408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.685388+0000","last_change":"2024-04-26T23:40:32.585137+0000","last_active":"2024-04-26T23:40:42.685388+0000","last_peered":"2024-04-26T23:40:42.685388+0000","last_clean":"2024-04-26T23:40:42.685388+0000","last_became_active":"2024-04-26T23:40:32.584678+0000","last_became_peered":"2024-04-26T23:40:32.584678+0000","last_unstale":"2024-04-26T23:40:42.685388+0000","last_undegraded":"2024-04-26T23:40:42.685388+0000","last_fullsized":"2024-04-26T23:40:42.685388+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:04:30.553552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636071+0000","last_change":"2024-04-26T23:40:41.692433+0000","last_active":"2024-04-26T23:40:43.636071+0000","last_peered":"2024-04-26T23:40:43.636071+0000","last_clean":"2024-04-26T23:40:43.636071+0000","last_became_active":"2024-04-26T23:40:41.692090+0000","last_became_peered":"2024-04-26T23:40:41.692090+0000","last_unstale":"2024-04-26T23:40:43.636071+0000","last_undegraded":"2024-04-26T23:40:43.636071+0000","last_fullsized":"2024-04-26T23:40:43.636071+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:37:25.006229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.635522+0000","last_change":"2024-04-26T23:40:32.590452+0000","last_active":"2024-04-26T23:40:43.635522+0000","last_peered":"2024-04-26T23:40:43.635522+0000","last_clean":"2024-04-26T23:40:43.635522+0000","last_became_active":"2024-04-26T23:40:32.590162+0000","last_became_peered":"2024-04-26T23:40:32.590162+0000","last_unstale":"2024-04-26T23:40:43.635522+0000","last_undegraded":"2024-04-26T23:40:43.635522+0000","last_fullsized":"2024-04-26T23:40:43.635522+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:51:30.677247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.685014+0000","last_change":"2024-04-26T23:40:41.687270+0000","last_active":"2024-04-26T23:40:42.685014+0000","last_peered":"2024-04-26T23:40:42.685014+0000","last_clean":"2024-04-26T23:40:42.685014+0000","last_became_active":"2024-04-26T23:40:41.686999+0000","last_became_peered":"2024-04-26T23:40:41.686999+0000","last_unstale":"2024-04-26T23:40:42.685014+0000","last_undegraded":"2024-04-26T23:40:42.685014+0000","last_fullsized":"2024-04-26T23:40:42.685014+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:21:42.565349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.686378+0000","last_change":"2024-04-26T23:40:32.586436+0000","last_active":"2024-04-26T23:40:42.686378+0000","last_peered":"2024-04-26T23:40:42.686378+0000","last_clean":"2024-04-26T23:40:42.686378+0000","last_became_active":"2024-04-26T23:40:32.585995+0000","last_became_peered":"2024-04-26T23:40:32.585995+0000","last_unstale":"2024-04-26T23:40:42.686378+0000","last_undegraded":"2024-04-26T23:40:42.686378+0000","last_fullsized":"2024-04-26T23:40:42.686378+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:10:42.603833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.637180+0000","last_change":"2024-04-26T23:40:41.691693+0000","last_active":"2024-04-26T23:40:43.637180+0000","last_peered":"2024-04-26T23:40:43.637180+0000","last_clean":"2024-04-26T23:40:43.637180+0000","last_became_active":"2024-04-26T23:40:41.691437+0000","last_became_peered":"2024-04-26T23:40:41.691437+0000","last_unstale":"2024-04-26T23:40:43.637180+0000","last_undegraded":"2024-04-26T23:40:43.637180+0000","last_fullsized":"2024-04-26T23:40:43.637180+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:06:12.755431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.637343+0000","last_change":"2024-04-26T23:40:32.592988+0000","last_active":"2024-04-26T23:40:43.637343+0000","last_peered":"2024-04-26T23:40:43.637343+0000","last_clean":"2024-04-26T23:40:43.637343+0000","last_became_active":"2024-04-26T23:40:32.592717+0000","last_became_peered":"2024-04-26T23:40:32.592717+0000","last_unstale":"2024-04-26T23:40:43.637343+0000","last_undegraded":"2024-04-26T23:40:43.637343+0000","last_fullsized":"2024-04-26T23:40:43.637343+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:18:09.706875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.637029+0000","last_change":"2024-04-26T23:40:41.675335+0000","last_active":"2024-04-26T23:40:43.637029+0000","last_peered":"2024-04-26T23:40:43.637029+0000","last_clean":"2024-04-26T23:40:43.637029+0000","last_became_active":"2024-04-26T23:40:41.675042+0000","last_became_peered":"2024-04-26T23:40:41.675042+0000","last_unstale":"2024-04-26T23:40:43.637029+0000","last_undegraded":"2024-04-26T23:40:43.637029+0000","last_fullsized":"2024-04-26T23:40:43.637029+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:41:52.386084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636813+0000","last_change":"2024-04-26T23:40:32.595129+0000","last_active":"2024-04-26T23:40:43.636813+0000","last_peered":"2024-04-26T23:40:43.636813+0000","last_clean":"2024-04-26T23:40:43.636813+0000","last_became_active":"2024-04-26T23:40:32.594802+0000","last_became_peered":"2024-04-26T23:40:32.594802+0000","last_unstale":"2024-04-26T23:40:43.636813+0000","last_undegraded":"2024-04-26T23:40:43.636813+0000","last_fullsized":"2024-04-26T23:40:43.636813+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:48:33.020039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636362+0000","last_change":"2024-04-26T23:40:41.691159+0000","last_active":"2024-04-26T23:40:43.636362+0000","last_peered":"2024-04-26T23:40:43.636362+0000","last_clean":"2024-04-26T23:40:43.636362+0000","last_became_active":"2024-04-26T23:40:41.690846+0000","last_became_peered":"2024-04-26T23:40:41.690846+0000","last_unstale":"2024-04-26T23:40:43.636362+0000","last_undegraded":"2024-04-26T23:40:43.636362+0000","last_fullsized":"2024-04-26T23:40:43.636362+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:45:08.076505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.683726+0000","last_change":"2024-04-26T23:40:32.578819+0000","last_active":"2024-04-26T23:40:42.683726+0000","last_peered":"2024-04-26T23:40:42.683726+0000","last_clean":"2024-04-26T23:40:42.683726+0000","last_became_active":"2024-04-26T23:40:32.578556+0000","last_became_peered":"2024-04-26T23:40:32.578556+0000","last_unstale":"2024-04-26T23:40:42.683726+0000","last_undegraded":"2024-04-26T23:40:42.683726+0000","last_fullsized":"2024-04-26T23:40:42.683726+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:17:46.135806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.635820+0000","last_change":"2024-04-26T23:40:41.689812+0000","last_active":"2024-04-26T23:40:43.635820+0000","last_peered":"2024-04-26T23:40:43.635820+0000","last_clean":"2024-04-26T23:40:43.635820+0000","last_became_active":"2024-04-26T23:40:41.689267+0000","last_became_peered":"2024-04-26T23:40:41.689267+0000","last_unstale":"2024-04-26T23:40:43.635820+0000","last_undegraded":"2024-04-26T23:40:43.635820+0000","last_fullsized":"2024-04-26T23:40:43.635820+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:21:42.565349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.684116+0000","last_change":"2024-04-26T23:40:32.578155+0000","last_active":"2024-04-26T23:40:42.684116+0000","last_peered":"2024-04-26T23:40:42.684116+0000","last_clean":"2024-04-26T23:40:42.684116+0000","last_became_active":"2024-04-26T23:40:32.577865+0000","last_became_peered":"2024-04-26T23:40:32.577865+0000","last_unstale":"2024-04-26T23:40:42.684116+0000","last_undegraded":"2024-04-26T23:40:42.684116+0000","last_fullsized":"2024-04-26T23:40:42.684116+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:40:17.167353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.685252+0000","last_change":"2024-04-26T23:40:41.680962+0000","last_active":"2024-04-26T23:40:42.685252+0000","last_peered":"2024-04-26T23:40:42.685252+0000","last_clean":"2024-04-26T23:40:42.685252+0000","last_became_active":"2024-04-26T23:40:41.680676+0000","last_became_peered":"2024-04-26T23:40:41.680676+0000","last_unstale":"2024-04-26T23:40:42.685252+0000","last_undegraded":"2024-04-26T23:40:42.685252+0000","last_fullsized":"2024-04-26T23:40:42.685252+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:42:13.754586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636455+0000","last_change":"2024-04-26T23:40:32.591487+0000","last_active":"2024-04-26T23:40:43.636455+0000","last_peered":"2024-04-26T23:40:43.636455+0000","last_clean":"2024-04-26T23:40:43.636455+0000","last_became_active":"2024-04-26T23:40:32.591209+0000","last_became_peered":"2024-04-26T23:40:32.591209+0000","last_unstale":"2024-04-26T23:40:43.636455+0000","last_undegraded":"2024-04-26T23:40:43.636455+0000","last_fullsized":"2024-04-26T23:40:43.636455+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:52:26.699790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.637724+0000","last_change":"2024-04-26T23:40:41.686089+0000","last_active":"2024-04-26T23:40:43.637724+0000","last_peered":"2024-04-26T23:40:43.637724+0000","last_clean":"2024-04-26T23:40:43.637724+0000","last_became_active":"2024-04-26T23:40:41.685786+0000","last_became_peered":"2024-04-26T23:40:41.685786+0000","last_unstale":"2024-04-26T23:40:43.637724+0000","last_undegraded":"2024-04-26T23:40:43.637724+0000","last_fullsized":"2024-04-26T23:40:43.637724+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:36:02.931532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636676+0000","last_change":"2024-04-26T23:40:32.592543+0000","last_active":"2024-04-26T23:40:43.636676+0000","last_peered":"2024-04-26T23:40:43.636676+0000","last_clean":"2024-04-26T23:40:43.636676+0000","last_became_active":"2024-04-26T23:40:32.592282+0000","last_became_peered":"2024-04-26T23:40:32.592282+0000","last_unstale":"2024-04-26T23:40:43.636676+0000","last_undegraded":"2024-04-26T23:40:43.636676+0000","last_fullsized":"2024-04-26T23:40:43.636676+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:16:46.547536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3f","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.684024+0000","last_change":"2024-04-26T23:40:41.679306+0000","last_active":"2024-04-26T23:40:42.684024+0000","last_peered":"2024-04-26T23:40:42.684024+0000","last_clean":"2024-04-26T23:40:42.684024+0000","last_became_active":"2024-04-26T23:40:41.678926+0000","last_became_peered":"2024-04-26T23:40:41.678926+0000","last_unstale":"2024-04-26T23:40:42.684024+0000","last_undegraded":"2024-04-26T23:40:42.684024+0000","last_fullsized":"2024-04-26T23:40:42.684024+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:27:48.823509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.637039+0000","last_change":"2024-04-26T23:40:32.587562+0000","last_active":"2024-04-26T23:40:43.637039+0000","last_peered":"2024-04-26T23:40:43.637039+0000","last_clean":"2024-04-26T23:40:43.637039+0000","last_became_active":"2024-04-26T23:40:32.587249+0000","last_became_peered":"2024-04-26T23:40:32.587249+0000","last_unstale":"2024-04-26T23:40:43.637039+0000","last_undegraded":"2024-04-26T23:40:43.637039+0000","last_fullsized":"2024-04-26T23:40:43.637039+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:12:45.093169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.635956+0000","last_change":"2024-04-26T23:40:41.689567+0000","last_active":"2024-04-26T23:40:43.635956+0000","last_peered":"2024-04-26T23:40:43.635956+0000","last_clean":"2024-04-26T23:40:43.635956+0000","last_became_active":"2024-04-26T23:40:41.688585+0000","last_became_peered":"2024-04-26T23:40:41.688585+0000","last_unstale":"2024-04-26T23:40:43.635956+0000","last_undegraded":"2024-04-26T23:40:43.635956+0000","last_fullsized":"2024-04-26T23:40:43.635956+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:10:57.826183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.684566+0000","last_change":"2024-04-26T23:40:32.584619+0000","last_active":"2024-04-26T23:40:42.684566+0000","last_peered":"2024-04-26T23:40:42.684566+0000","last_clean":"2024-04-26T23:40:42.684566+0000","last_became_active":"2024-04-26T23:40:32.584293+0000","last_became_peered":"2024-04-26T23:40:32.584293+0000","last_unstale":"2024-04-26T23:40:42.684566+0000","last_undegraded":"2024-04-26T23:40:42.684566+0000","last_fullsized":"2024-04-26T23:40:42.684566+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:40:17.167353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.685557+0000","last_change":"2024-04-26T23:40:41.691614+0000","last_active":"2024-04-26T23:40:42.685557+0000","last_peered":"2024-04-26T23:40:42.685557+0000","last_clean":"2024-04-26T23:40:42.685557+0000","last_became_active":"2024-04-26T23:40:41.691081+0000","last_became_peered":"2024-04-26T23:40:41.691081+0000","last_unstale":"2024-04-26T23:40:42.685557+0000","last_undegraded":"2024-04-26T23:40:42.685557+0000","last_fullsized":"2024-04-26T23:40:42.685557+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:24:07.784468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636557+0000","last_change":"2024-04-26T23:40:32.588894+0000","last_active":"2024-04-26T23:40:43.636557+0000","last_peered":"2024-04-26T23:40:43.636557+0000","last_clean":"2024-04-26T23:40:43.636557+0000","last_became_active":"2024-04-26T23:40:32.588409+0000","last_became_peered":"2024-04-26T23:40:32.588409+0000","last_unstale":"2024-04-26T23:40:43.636557+0000","last_undegraded":"2024-04-26T23:40:43.636557+0000","last_fullsized":"2024-04-26T23:40:43.636557+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:35:08.194865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636899+0000","last_change":"2024-04-26T23:40:41.678639+0000","last_active":"2024-04-26T23:40:43.636899+0000","last_peered":"2024-04-26T23:40:43.636899+0000","last_clean":"2024-04-26T23:40:43.636899+0000","last_became_active":"2024-04-26T23:40:41.678333+0000","last_became_peered":"2024-04-26T23:40:41.678333+0000","last_unstale":"2024-04-26T23:40:43.636899+0000","last_undegraded":"2024-04-26T23:40:43.636899+0000","last_fullsized":"2024-04-26T23:40:43.636899+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:42:13.754586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.685161+0000","last_change":"2024-04-26T23:40:32.581875+0000","last_active":"2024-04-26T23:40:42.685161+0000","last_peered":"2024-04-26T23:40:42.685161+0000","last_clean":"2024-04-26T23:40:42.685161+0000","last_became_active":"2024-04-26T23:40:32.580987+0000","last_became_peered":"2024-04-26T23:40:32.580987+0000","last_unstale":"2024-04-26T23:40:42.685161+0000","last_undegraded":"2024-04-26T23:40:42.685161+0000","last_fullsized":"2024-04-26T23:40:42.685161+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:12:45.093169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636219+0000","last_change":"2024-04-26T23:40:41.678366+0000","last_active":"2024-04-26T23:40:43.636219+0000","last_peered":"2024-04-26T23:40:43.636219+0000","last_clean":"2024-04-26T23:40:43.636219+0000","last_became_active":"2024-04-26T23:40:41.678067+0000","last_became_peered":"2024-04-26T23:40:41.678067+0000","last_unstale":"2024-04-26T23:40:43.636219+0000","last_undegraded":"2024-04-26T23:40:43.636219+0000","last_fullsized":"2024-04-26T23:40:43.636219+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:44:51.594010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.686634+0000","last_change":"2024-04-26T23:40:32.579870+0000","last_active":"2024-04-26T23:40:42.686634+0000","last_peered":"2024-04-26T23:40:42.686634+0000","last_clean":"2024-04-26T23:40:42.686634+0000","last_became_active":"2024-04-26T23:40:32.579569+0000","last_became_peered":"2024-04-26T23:40:32.579569+0000","last_unstale":"2024-04-26T23:40:42.686634+0000","last_undegraded":"2024-04-26T23:40:42.686634+0000","last_fullsized":"2024-04-26T23:40:42.686634+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:25:30.040358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.635430+0000","last_change":"2024-04-26T23:40:41.684020+0000","last_active":"2024-04-26T23:40:43.635430+0000","last_peered":"2024-04-26T23:40:43.635430+0000","last_clean":"2024-04-26T23:40:43.635430+0000","last_became_active":"2024-04-26T23:40:41.683734+0000","last_became_peered":"2024-04-26T23:40:41.683734+0000","last_unstale":"2024-04-26T23:40:43.635430+0000","last_undegraded":"2024-04-26T23:40:43.635430+0000","last_fullsized":"2024-04-26T23:40:43.635430+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:38:42.155257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636264+0000","last_change":"2024-04-26T23:40:32.583944+0000","last_active":"2024-04-26T23:40:43.636264+0000","last_peered":"2024-04-26T23:40:43.636264+0000","last_clean":"2024-04-26T23:40:43.636264+0000","last_became_active":"2024-04-26T23:40:32.583655+0000","last_became_peered":"2024-04-26T23:40:32.583655+0000","last_unstale":"2024-04-26T23:40:43.636264+0000","last_undegraded":"2024-04-26T23:40:43.636264+0000","last_fullsized":"2024-04-26T23:40:43.636264+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:40:17.167353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.635858+0000","last_change":"2024-04-26T23:40:41.681412+0000","last_active":"2024-04-26T23:40:43.635858+0000","last_peered":"2024-04-26T23:40:43.635858+0000","last_clean":"2024-04-26T23:40:43.635858+0000","last_became_active":"2024-04-26T23:40:41.681092+0000","last_became_peered":"2024-04-26T23:40:41.681092+0000","last_unstale":"2024-04-26T23:40:43.635858+0000","last_undegraded":"2024-04-26T23:40:43.635858+0000","last_fullsized":"2024-04-26T23:40:43.635858+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:48:09.126894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636358+0000","last_change":"2024-04-26T23:40:32.596351+0000","last_active":"2024-04-26T23:40:43.636358+0000","last_peered":"2024-04-26T23:40:43.636358+0000","last_clean":"2024-04-26T23:40:43.636358+0000","last_became_active":"2024-04-26T23:40:32.596050+0000","last_became_peered":"2024-04-26T23:40:32.596050+0000","last_unstale":"2024-04-26T23:40:43.636358+0000","last_undegraded":"2024-04-26T23:40:43.636358+0000","last_fullsized":"2024-04-26T23:40:43.636358+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:34:14.811917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574857,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27856,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343984,"statfs":{"total":96636764160,"available":96608239616,"internally_reserved":0,"allocated":856064,"data_stored":690301,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574858,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":274432,"data_stored":101489,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574858,"num_pgs":54,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":266240,"data_stored":100023,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574859,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":274432,"data_stored":99491,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574857,"num_pgs":59,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":282624,"data_stored":102507,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574857,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":258048,"data_stored":99331,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574857,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":278528,"data_stored":101055,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574859,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27864,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343976,"statfs":{"total":96636764160,"available":96608231424,"internally_reserved":0,"allocated":860160,"data_stored":690267,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T23:40:50.368 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-26T23:40:50.368 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-04-26T23:40:50.368 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-04-26T23:40:50.368 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-26T23:40:50.497 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:50.493+0000 7f9850215640 1 Processor -- start 2024-04-26T23:40:50.497 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:50.493+0000 7f9850215640 1 -- start start 2024-04-26T23:40:50.501 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:50.494+0000 7f9850215640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9848074c10 0x7f98480c4280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:50.501 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:50.494+0000 7f9850215640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f98481579d0 con 0x7f9848073700 2024-04-26T23:40:50.501 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:50.494+0000 7f9850215640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f98480ab680 con 0x7f984813ffb0 2024-04-26T23:40:50.501 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:50.494+0000 7f9850215640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f9848070880 con 0x7f9848074c10 2024-04-26T23:40:50.501 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:50.494+0000 7f984e7b2640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f9848073700 0x7f9848073bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:58066/0 (socket says 172.21.15.88:58066) 2024-04-26T23:40:50.501 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:50.494+0000 7f984e7b2640 1 -- 172.21.15.88:0/4105344168 learned_addr learned my addr 172.21.15.88:0/4105344168 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-26T23:40:50.501 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:50.494+0000 7f984d7b0640 1 --2- 172.21.15.88:0/4105344168 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9848074c10 0x7f98480c4280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:50.501 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:50.494+0000 7f984cfaf640 1 -- 172.21.15.88:0/4105344168 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2575602382 0 0) 0x7f98481579d0 con 0x7f9848073700 2024-04-26T23:40:50.501 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:50.495+0000 7f984cfaf640 1 -- 172.21.15.88:0/4105344168 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9834003520 con 0x7f9848073700 2024-04-26T23:40:50.501 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:50.495+0000 7f984cfaf640 1 -- 172.21.15.88:0/4105344168 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1819672258 0 0) 0x7f9834003520 con 0x7f9848073700 2024-04-26T23:40:50.501 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:50.495+0000 7f984cfaf640 1 -- 172.21.15.88:0/4105344168 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9848074c10 msgr2=0x7f98480c4280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:40:50.501 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:50.495+0000 7f984cfaf640 1 --2- 172.21.15.88:0/4105344168 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9848074c10 0x7f98480c4280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:50.502 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:50.495+0000 7f984cfaf640 1 -- 172.21.15.88:0/4105344168 >> v1:172.21.15.175:6789/0 conn(0x7f984813ffb0 legacy=0x7f98480c3b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:50.502 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:50.495+0000 7f984cfaf640 1 -- 172.21.15.88:0/4105344168 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98480ab960 con 0x7f9848073700 2024-04-26T23:40:50.502 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:50.495+0000 7f984cfaf640 1 -- 172.21.15.88:0/4105344168 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 356324787 0 0) 0x7f9840001670 con 0x7f9848073700 2024-04-26T23:40:50.502 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:50.495+0000 7f984cfaf640 1 -- 172.21.15.88:0/4105344168 >> v1:172.21.15.88:6789/0 conn(0x7f9848073700 legacy=0x7f9848073bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:50.502 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:50.495+0000 7f984cfaf640 1 --2- 172.21.15.88:0/4105344168 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f98340039e0 0x7f9834003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:50.502 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:50.495+0000 7f984cfaf640 1 --2- 172.21.15.88:0/4105344168 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9848074c10 0x7f9834004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:50.502 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:50.495+0000 7f984cfaf640 1 --2- 172.21.15.88:0/4105344168 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9834004d40 0x7f98340051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:50.502 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:50.495+0000 7f984cfaf640 1 -- 172.21.15.88:0/4105344168 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f9848070880 con 0x7f9834004d40 2024-04-26T23:40:50.502 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:50.495+0000 7f984cfaf640 1 -- 172.21.15.88:0/4105344168 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f983400b9f0 con 0x7f98340039e0 2024-04-26T23:40:50.502 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:50.495+0000 7f984cfaf640 1 -- 172.21.15.88:0/4105344168 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f983400bbf0 con 0x7f9848074c10 2024-04-26T23:40:50.502 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:50.495+0000 7f984e7b2640 1 --2- 172.21.15.88:0/4105344168 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9834004d40 0x7f98340051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:50.502 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:50.495+0000 7f984dfb1640 1 --2- 172.21.15.88:0/4105344168 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f98340039e0 0x7f9834003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:50.502 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:50.495+0000 7f984d7b0640 1 --2- 172.21.15.88:0/4105344168 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9848074c10 0x7f9834004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:50.502 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:50.495+0000 7f984e7b2640 1 -- 172.21.15.88:0/4105344168 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9848074c10 msgr2=0x7f9834004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:40:50.503 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:50.495+0000 7f984e7b2640 1 --2- 172.21.15.88:0/4105344168 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9848074c10 0x7f9834004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:50.503 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:50.495+0000 7f984e7b2640 1 -- 172.21.15.88:0/4105344168 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f98340039e0 msgr2=0x7f9834003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:40:50.503 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:50.495+0000 7f984e7b2640 1 --2- 172.21.15.88:0/4105344168 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f98340039e0 0x7f9834003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:50.503 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:50.495+0000 7f984e7b2640 1 -- 172.21.15.88:0/4105344168 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9834003520 con 0x7f9834004d40 2024-04-26T23:40:50.503 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:50.495+0000 7f984d7b0640 1 --2- 172.21.15.88:0/4105344168 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9848074c10 0x7f9834004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:40:50.503 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:50.496+0000 7f984e7b2640 1 --2- 172.21.15.88:0/4105344168 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9834004d40 0x7f98340051c0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f984000c240 tx=0x7f9834005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28a9f9e83c04a212 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:50.503 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:50.496+0000 7f984cfaf640 1 -- 172.21.15.88:0/4105344168 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9840007d10 con 0x7f9834004d40 2024-04-26T23:40:50.503 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:50.496+0000 7f984cfaf640 1 -- 172.21.15.88:0/4105344168 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98400058d0 con 0x7f9834004d40 2024-04-26T23:40:50.503 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:50.496+0000 7f984cfaf640 1 -- 172.21.15.88:0/4105344168 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9840005d00 con 0x7f9834004d40 2024-04-26T23:40:50.503 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:50.496+0000 7f9850215640 1 -- 172.21.15.88:0/4105344168 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9834004d40 msgr2=0x7f98340051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:50.503 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:50.496+0000 7f9850215640 1 --2- 172.21.15.88:0/4105344168 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9834004d40 0x7f98340051c0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f984000c240 tx=0x7f9834005830 comp rx=0 tx=0).stop 2024-04-26T23:40:50.503 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:50.496+0000 7f984e7b2640 1 -- 172.21.15.88:0/4105344168 reap_dead start 2024-04-26T23:40:50.503 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:50.497+0000 7f9850215640 1 -- 172.21.15.88:0/4105344168 shutdown_connections 2024-04-26T23:40:50.503 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:50.497+0000 7f9850215640 1 -- 172.21.15.88:0/4105344168 >> 172.21.15.88:0/4105344168 conn(0x7f98480ca2f0 msgr2=0x7f98480ca6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:40:50.503 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:50.497+0000 7f9850215640 1 -- 172.21.15.88:0/4105344168 shutdown_connections 2024-04-26T23:40:50.504 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:50.497+0000 7f9850215640 1 -- 172.21.15.88:0/4105344168 wait complete. 2024-04-26T23:40:50.506 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:50.498+0000 7f9850215640 1 Processor -- start 2024-04-26T23:40:50.506 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:50.498+0000 7f9850215640 1 -- start start 2024-04-26T23:40:50.506 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:50.498+0000 7f9850215640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9834004d40 0x7f98481eff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:50.506 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:50.498+0000 7f9850215640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f98481f0480 0x7f984812e750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:50.507 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:50.498+0000 7f9850215640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9848139170 0x7f984812ec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:50.507 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:50.498+0000 7f9850215640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f98480742c0 con 0x7f9834004d40 2024-04-26T23:40:50.507 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:50.498+0000 7f9850215640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f9848157660 con 0x7f9848139170 2024-04-26T23:40:50.507 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:50.498+0000 7f9850215640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f9848074440 con 0x7f98481f0480 2024-04-26T23:40:50.507 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:50.498+0000 7f984dfb1640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9834004d40 0x7f98481eff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:50.507 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:50.498+0000 7f984dfb1640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9834004d40 0x7f98481eff40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:41674/0 (socket says 172.21.15.88:41674) 2024-04-26T23:40:50.507 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:50.498+0000 7f984dfb1640 1 -- 172.21.15.88:0/3034863861 learned_addr learned my addr 172.21.15.88:0/3034863861 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:40:50.507 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:50.499+0000 7f984e7b2640 1 --2- 172.21.15.88:0/3034863861 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9848139170 0x7f984812ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:50.507 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:50.499+0000 7f984d7b0640 1 --2- 172.21.15.88:0/3034863861 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f98481f0480 0x7f984812e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:50.507 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:50.499+0000 7f984dfb1640 1 -- 172.21.15.88:0/3034863861 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f98481f0480 msgr2=0x7f984812e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:50.507 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:50.499+0000 7f984dfb1640 1 --2- 172.21.15.88:0/3034863861 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f98481f0480 0x7f984812e750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:50.507 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:50.499+0000 7f984dfb1640 1 -- 172.21.15.88:0/3034863861 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9848139170 msgr2=0x7f984812ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:50.507 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:50.499+0000 7f984dfb1640 1 --2- 172.21.15.88:0/3034863861 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9848139170 0x7f984812ec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:50.507 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:50.499+0000 7f984dfb1640 1 -- 172.21.15.88:0/3034863861 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f984812f1d0 con 0x7f9834004d40 2024-04-26T23:40:50.507 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:50.499+0000 7f984dfb1640 1 --2- 172.21.15.88:0/3034863861 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9834004d40 0x7f98481eff40 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f984400fb60 tx=0x7f984400ff60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:50.507 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:50.499+0000 7f983e7fc640 1 -- 172.21.15.88:0/3034863861 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9844003b80 con 0x7f9834004d40 2024-04-26T23:40:50.507 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:50.499+0000 7f983e7fc640 1 -- 172.21.15.88:0/3034863861 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9844018070 con 0x7f9834004d40 2024-04-26T23:40:50.508 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:50.499+0000 7f9850215640 1 -- 172.21.15.88:0/3034863861 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9848158070 con 0x7f9834004d40 2024-04-26T23:40:50.508 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:50.499+0000 7f983e7fc640 1 -- 172.21.15.88:0/3034863861 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f984400d8e0 con 0x7f9834004d40 2024-04-26T23:40:50.508 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:50.499+0000 7f9850215640 1 -- 172.21.15.88:0/3034863861 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9848138e70 con 0x7f9834004d40 2024-04-26T23:40:50.508 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:50.500+0000 7f9850215640 1 -- 172.21.15.88:0/3034863861 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f98480507a0 con 0x7f9834004d40 2024-04-26T23:40:50.508 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:50.500+0000 7f983e7fc640 1 -- 172.21.15.88:0/3034863861 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f984400da80 con 0x7f9834004d40 2024-04-26T23:40:50.508 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:50.501+0000 7f983e7fc640 1 --2- 172.21.15.88:0/3034863861 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f982c06c8f0 0x7f982c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:50.508 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:50.501+0000 7f984d7b0640 1 --2- 172.21.15.88:0/3034863861 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f982c06c8f0 0x7f982c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:50.508 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:50.501+0000 7f983e7fc640 1 -- 172.21.15.88:0/3034863861 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7f984408c110 con 0x7f9834004d40 2024-04-26T23:40:50.508 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:50.501+0000 7f984d7b0640 1 --2- 172.21.15.88:0/3034863861 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f982c06c8f0 0x7f982c06edb0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f98481f0860 tx=0x7f9838008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:50.509 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:50.505+0000 7f983e7fc640 1 -- 172.21.15.88:0/3034863861 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f984405a210 con 0x7f9834004d40 2024-04-26T23:40:50.724 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:50.720+0000 7f9850215640 1 -- 172.21.15.88:0/3034863861 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f9848076650 con 0x7f9834004d40 2024-04-26T23:40:50.724 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:50.720+0000 7f983e7fc640 1 -- 172.21.15.88:0/3034863861 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f9844059b10 con 0x7f9834004d40 2024-04-26T23:40:50.724 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-26T23:40:50.724 INFO:teuthology.orchestra.run.smithi088.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-04-26T23:40:50.727 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:50.722+0000 7f9850215640 1 -- 172.21.15.88:0/3034863861 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f982c06c8f0 msgr2=0x7f982c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:50.727 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:50.722+0000 7f9850215640 1 --2- 172.21.15.88:0/3034863861 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f982c06c8f0 0x7f982c06edb0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f98481f0860 tx=0x7f9838008040 comp rx=0 tx=0).stop 2024-04-26T23:40:50.727 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:50.722+0000 7f9850215640 1 -- 172.21.15.88:0/3034863861 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9834004d40 msgr2=0x7f98481eff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:50.727 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:50.722+0000 7f9850215640 1 --2- 172.21.15.88:0/3034863861 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9834004d40 0x7f98481eff40 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f984400fb60 tx=0x7f984400ff60 comp rx=0 tx=0).stop 2024-04-26T23:40:50.727 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:50.722+0000 7f9850215640 1 -- 172.21.15.88:0/3034863861 shutdown_connections 2024-04-26T23:40:50.727 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:50.722+0000 7f9850215640 1 --2- 172.21.15.88:0/3034863861 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f982c06c8f0 0x7f982c06edb0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:50.727 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:50.722+0000 7f9850215640 1 --2- 172.21.15.88:0/3034863861 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f98481f0480 0x7f984812e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:50.728 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:50.722+0000 7f9850215640 1 --2- 172.21.15.88:0/3034863861 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9848139170 0x7f984812ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:50.728 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:50.722+0000 7f9850215640 1 --2- 172.21.15.88:0/3034863861 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9834004d40 0x7f98481eff40 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:50.728 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:50.722+0000 7f9850215640 1 -- 172.21.15.88:0/3034863861 >> 172.21.15.88:0/3034863861 conn(0x7f98480ca2f0 msgr2=0x7f9848154a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:40:50.728 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:50.723+0000 7f9850215640 1 -- 172.21.15.88:0/3034863861 shutdown_connections 2024-04-26T23:40:50.728 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:50.723+0000 7f9850215640 1 -- 172.21.15.88:0/3034863861 wait complete. 2024-04-26T23:40:50.737 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-04-26T23:40:50.738 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T23:40:50.834 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:50.830+0000 7fd8d9178640 1 Processor -- start 2024-04-26T23:40:50.834 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:50.830+0000 7fd8d9178640 1 -- start start 2024-04-26T23:40:50.836 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:50.831+0000 7fd8d9178640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fd8d40c4820 0x7fd8d4073a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:50.836 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:50.831+0000 7fd8d9178640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd8d4156f60 con 0x7fd8d40ab630 2024-04-26T23:40:50.836 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:50.831+0000 7fd8d9178640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd8d4157240 con 0x7fd8d40aecf0 2024-04-26T23:40:50.836 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:50.831+0000 7fd8d9178640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7fd8d4157520 con 0x7fd8d40c4820 2024-04-26T23:40:50.836 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:50.831+0000 7fd8d359e640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fd8d40ab630 0x7fd8d4073fb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:58068/0 (socket says 172.21.15.88:58068) 2024-04-26T23:40:50.836 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:50.831+0000 7fd8d359e640 1 -- 172.21.15.88:0/3923575706 learned_addr learned my addr 172.21.15.88:0/3923575706 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-26T23:40:50.836 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:50.831+0000 7fd8d259c640 1 --2- 172.21.15.88:0/3923575706 >> v2:172.21.15.175:3300/0 conn(0x7fd8d40c4820 0x7fd8d4073a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:50.836 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:50.831+0000 7fd8d1d9b640 1 -- 172.21.15.88:0/3923575706 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1591436022 0 0) 0x7fd8d4156f60 con 0x7fd8d40ab630 2024-04-26T23:40:50.837 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:50.831+0000 7fd8d1d9b640 1 -- 172.21.15.88:0/3923575706 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd8bc003520 con 0x7fd8d40ab630 2024-04-26T23:40:50.837 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:50.831+0000 7fd8d259c640 1 -- 172.21.15.88:0/3923575706 >> v1:172.21.15.175:6789/0 conn(0x7fd8d40aecf0 legacy=0x7fd8d40c3800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:50.837 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:50.831+0000 7fd8d259c640 1 -- 172.21.15.88:0/3923575706 >> v1:172.21.15.88:6789/0 conn(0x7fd8d40ab630 legacy=0x7fd8d4073fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:50.837 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:50.831+0000 7fd8d1d9b640 1 -- 172.21.15.88:0/3923575706 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 98460956 0 0) 0x7fd8bc003520 con 0x7fd8d40ab630 2024-04-26T23:40:50.837 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:50.831+0000 7fd8d259c640 1 -- 172.21.15.88:0/3923575706 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8d4157800 con 0x7fd8d40c4820 2024-04-26T23:40:50.837 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:50.832+0000 7fd8d259c640 1 --2- 172.21.15.88:0/3923575706 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd8d40c4820 0x7fd8d4073a70 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fd8c80097a0 tx=0x7fd8c802a130 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c6d6b0c05684b3f2 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:50.837 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:50.832+0000 7fd8d1d9b640 1 -- 172.21.15.88:0/3923575706 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8c8037070 con 0x7fd8d40c4820 2024-04-26T23:40:50.837 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:50.832+0000 7fd8d1d9b640 1 -- 172.21.15.88:0/3923575706 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8c802abc0 con 0x7fd8d40c4820 2024-04-26T23:40:50.837 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:50.832+0000 7fd8d1d9b640 1 -- 172.21.15.88:0/3923575706 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8cc001670 con 0x7fd8d40c4820 2024-04-26T23:40:50.840 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:50.833+0000 7fd8d9178640 1 -- 172.21.15.88:0/3923575706 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd8d40c4820 msgr2=0x7fd8d4073a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:50.840 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:50.833+0000 7fd8d9178640 1 --2- 172.21.15.88:0/3923575706 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd8d40c4820 0x7fd8d4073a70 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fd8c80097a0 tx=0x7fd8c802a130 comp rx=0 tx=0).stop 2024-04-26T23:40:50.840 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:50.833+0000 7fd8d9178640 1 -- 172.21.15.88:0/3923575706 shutdown_connections 2024-04-26T23:40:50.840 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:50.833+0000 7fd8d9178640 1 --2- 172.21.15.88:0/3923575706 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd8d40c4820 0x7fd8d4073a70 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:50.840 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:50.833+0000 7fd8d9178640 1 -- 172.21.15.88:0/3923575706 >> 172.21.15.88:0/3923575706 conn(0x7fd8d40c6ed0 msgr2=0x7fd8d40c72b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:40:50.840 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:50.833+0000 7fd8d9178640 1 -- 172.21.15.88:0/3923575706 shutdown_connections 2024-04-26T23:40:50.840 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:50.833+0000 7fd8d9178640 1 -- 172.21.15.88:0/3923575706 wait complete. 2024-04-26T23:40:50.841 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:50.834+0000 7fd8d9178640 1 Processor -- start 2024-04-26T23:40:50.841 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:50.834+0000 7fd8d9178640 1 -- start start 2024-04-26T23:40:50.841 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:50.835+0000 7fd8d9178640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd8d40ab630 0x7fd8d414e290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:50.841 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:50.835+0000 7fd8d9178640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd8d40aecf0 0x7fd8d4141af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:50.841 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:50.835+0000 7fd8d9178640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd8d40c4820 0x7fd8d4142030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:50.841 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:50.835+0000 7fd8d9178640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fd8d4156c10 con 0x7fd8d40c4820 2024-04-26T23:40:50.841 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:50.835+0000 7fd8d9178640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fd8d40746c0 con 0x7fd8d40ab630 2024-04-26T23:40:50.841 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:50.835+0000 7fd8d9178640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fd8d40c3f10 con 0x7fd8d40aecf0 2024-04-26T23:40:50.841 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:50.835+0000 7fd8d359e640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd8d40c4820 0x7fd8d4142030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:50.841 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:50.835+0000 7fd8d359e640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd8d40c4820 0x7fd8d4142030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:41688/0 (socket says 172.21.15.88:41688) 2024-04-26T23:40:50.841 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:50.835+0000 7fd8d359e640 1 -- 172.21.15.88:0/3004436601 learned_addr learned my addr 172.21.15.88:0/3004436601 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:40:50.842 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:50.835+0000 7fd8d359e640 1 -- 172.21.15.88:0/3004436601 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd8d40aecf0 msgr2=0x7fd8d4141af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:50.842 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:50.835+0000 7fd8d359e640 1 --2- 172.21.15.88:0/3004436601 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd8d40aecf0 0x7fd8d4141af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:50.842 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:50.835+0000 7fd8d359e640 1 -- 172.21.15.88:0/3004436601 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd8d40ab630 msgr2=0x7fd8d414e290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:50.842 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:50.835+0000 7fd8d359e640 1 --2- 172.21.15.88:0/3004436601 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd8d40ab630 0x7fd8d414e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:50.842 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:50.835+0000 7fd8d359e640 1 -- 172.21.15.88:0/3004436601 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8d41581c0 con 0x7fd8d40c4820 2024-04-26T23:40:50.842 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:50.835+0000 7fd8d359e640 1 --2- 172.21.15.88:0/3004436601 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd8d40c4820 0x7fd8d4142030 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fd8cc00c750 tx=0x7fd8cc00cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:50.842 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:50.835+0000 7fd8bb7fe640 1 -- 172.21.15.88:0/3004436601 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8cc017070 con 0x7fd8d40c4820 2024-04-26T23:40:50.842 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:50.836+0000 7fd8bb7fe640 1 -- 172.21.15.88:0/3004436601 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8cc005ad0 con 0x7fd8d40c4820 2024-04-26T23:40:50.842 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:50.836+0000 7fd8bb7fe640 1 -- 172.21.15.88:0/3004436601 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8cc007070 con 0x7fd8d40c4820 2024-04-26T23:40:50.842 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:50.836+0000 7fd8d9178640 1 -- 172.21.15.88:0/3004436601 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8d4158430 con 0x7fd8d40c4820 2024-04-26T23:40:50.842 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:50.836+0000 7fd8d9178640 1 -- 172.21.15.88:0/3004436601 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8d414e7d0 con 0x7fd8d40c4820 2024-04-26T23:40:50.845 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:50.836+0000 7fd8d9178640 1 -- 172.21.15.88:0/3004436601 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd8d4154c20 con 0x7fd8d40c4820 2024-04-26T23:40:50.846 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:50.837+0000 7fd8bb7fe640 1 -- 172.21.15.88:0/3004436601 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd8cc01a070 con 0x7fd8d40c4820 2024-04-26T23:40:50.846 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:50.837+0000 7fd8bb7fe640 1 --2- 172.21.15.88:0/3004436601 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fd8c006c8f0 0x7fd8c006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:50.846 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:50.837+0000 7fd8bb7fe640 1 -- 172.21.15.88:0/3004436601 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7fd8cc08b2f0 con 0x7fd8d40c4820 2024-04-26T23:40:50.846 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:50.837+0000 7fd8d2d9d640 1 --2- 172.21.15.88:0/3004436601 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fd8c006c8f0 0x7fd8c006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:50.846 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:50.838+0000 7fd8d2d9d640 1 --2- 172.21.15.88:0/3004436601 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fd8c006c8f0 0x7fd8c006edb0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fd8c40012e0 tx=0x7fd8c4007d30 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:50.846 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:50.842+0000 7fd8bb7fe640 1 -- 172.21.15.88:0/3004436601 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fd8cc058d20 con 0x7fd8d40c4820 2024-04-26T23:40:51.021 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:51.017+0000 7fd8d9178640 1 -- 172.21.15.88:0/3004436601 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd8d40507a0 con 0x7fd8d40c4820 2024-04-26T23:40:51.022 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:51.018+0000 7fd8bb7fe640 1 -- 172.21.15.88:0/3004436601 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+20343 (secure 0 0 0) 0x7fd8cc05f030 con 0x7fd8d40c4820 2024-04-26T23:40:51.022 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-26T23:40:51.023 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":24,"fsid":"555255e9-7ef9-4454-8dc9-35e96b70035c","created":"2024-04-26T23:40:07.836009+0000","modified":"2024-04-26T23:40:42.673801+0000","last_up_change":"2024-04-26T23:40:18.831369+0000","last_in_change":"2024-04-26T23:40:09.944777+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T23:40:19.936127+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"a_metadata","create_time":"2024-04-26T23:40:29.837465+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"a_data","create_time":"2024-04-26T23:40:30.868651+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"b_metadata","create_time":"2024-04-26T23:40:38.753441+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"b_data","create_time":"2024-04-26T23:40:39.974557+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"92aecea3-ed62-4a29-87c0-76758a0816a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":2803186054},{"type":"v1","addr":"172.21.15.88:6801","nonce":2803186054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":2803186054},{"type":"v1","addr":"172.21.15.88:6803","nonce":2803186054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":2803186054},{"type":"v1","addr":"172.21.15.88:6807","nonce":2803186054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":2803186054},{"type":"v1","addr":"172.21.15.88:6805","nonce":2803186054}]},"public_addr":"172.21.15.88:6801/2803186054","cluster_addr":"172.21.15.88:6803/2803186054","heartbeat_back_addr":"172.21.15.88:6807/2803186054","heartbeat_front_addr":"172.21.15.88:6805/2803186054","state":["exists","up"]},{"osd":1,"uuid":"7a6f0fa9-23d0-4747-880f-798d45ec5eeb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":1897380484},{"type":"v1","addr":"172.21.15.88:6817","nonce":1897380484}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":1897380484},{"type":"v1","addr":"172.21.15.88:6819","nonce":1897380484}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1897380484},{"type":"v1","addr":"172.21.15.88:6823","nonce":1897380484}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":1897380484},{"type":"v1","addr":"172.21.15.88:6821","nonce":1897380484}]},"public_addr":"172.21.15.88:6817/1897380484","cluster_addr":"172.21.15.88:6819/1897380484","heartbeat_back_addr":"172.21.15.88:6823/1897380484","heartbeat_front_addr":"172.21.15.88:6821/1897380484","state":["exists","up"]},{"osd":2,"uuid":"6be88ea0-e133-4200-a4b5-f92d664b248a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":648396269},{"type":"v1","addr":"172.21.15.88:6809","nonce":648396269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":648396269},{"type":"v1","addr":"172.21.15.88:6811","nonce":648396269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":648396269},{"type":"v1","addr":"172.21.15.88:6815","nonce":648396269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":648396269},{"type":"v1","addr":"172.21.15.88:6813","nonce":648396269}]},"public_addr":"172.21.15.88:6809/648396269","cluster_addr":"172.21.15.88:6811/648396269","heartbeat_back_addr":"172.21.15.88:6815/648396269","heartbeat_front_addr":"172.21.15.88:6813/648396269","state":["exists","up"]},{"osd":3,"uuid":"dcb0746b-7b3d-4ecf-8089-2493a5d1857c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":2328028922},{"type":"v1","addr":"172.21.15.88:6825","nonce":2328028922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":2328028922},{"type":"v1","addr":"172.21.15.88:6827","nonce":2328028922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":2328028922},{"type":"v1","addr":"172.21.15.88:6831","nonce":2328028922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":2328028922},{"type":"v1","addr":"172.21.15.88:6829","nonce":2328028922}]},"public_addr":"172.21.15.88:6825/2328028922","cluster_addr":"172.21.15.88:6827/2328028922","heartbeat_back_addr":"172.21.15.88:6831/2328028922","heartbeat_front_addr":"172.21.15.88:6829/2328028922","state":["exists","up"]},{"osd":4,"uuid":"c483de66-c44f-450e-a4ce-b132d50882c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":3929617402},{"type":"v1","addr":"172.21.15.175:6809","nonce":3929617402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":3929617402},{"type":"v1","addr":"172.21.15.175:6811","nonce":3929617402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":3929617402},{"type":"v1","addr":"172.21.15.175:6815","nonce":3929617402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":3929617402},{"type":"v1","addr":"172.21.15.175:6813","nonce":3929617402}]},"public_addr":"172.21.15.175:6809/3929617402","cluster_addr":"172.21.15.175:6811/3929617402","heartbeat_back_addr":"172.21.15.175:6815/3929617402","heartbeat_front_addr":"172.21.15.175:6813/3929617402","state":["exists","up"]},{"osd":5,"uuid":"ac3b1669-d228-40dd-9f9a-cb46aa73dd6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":2476644457},{"type":"v1","addr":"172.21.15.175:6801","nonce":2476644457}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":2476644457},{"type":"v1","addr":"172.21.15.175:6803","nonce":2476644457}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":2476644457},{"type":"v1","addr":"172.21.15.175:6807","nonce":2476644457}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":2476644457},{"type":"v1","addr":"172.21.15.175:6805","nonce":2476644457}]},"public_addr":"172.21.15.175:6801/2476644457","cluster_addr":"172.21.15.175:6803/2476644457","heartbeat_back_addr":"172.21.15.175:6807/2476644457","heartbeat_front_addr":"172.21.15.175:6805/2476644457","state":["exists","up"]},{"osd":6,"uuid":"7bef4896-857e-4c11-b3b2-c2e9a8548338","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":3824112919},{"type":"v1","addr":"172.21.15.175:6819","nonce":3824112919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6821","nonce":3824112919},{"type":"v1","addr":"172.21.15.175:6824","nonce":3824112919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":3824112919},{"type":"v1","addr":"172.21.15.175:6831","nonce":3824112919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":3824112919},{"type":"v1","addr":"172.21.15.175:6829","nonce":3824112919}]},"public_addr":"172.21.15.175:6819/3824112919","cluster_addr":"172.21.15.175:6824/3824112919","heartbeat_back_addr":"172.21.15.175:6831/3824112919","heartbeat_front_addr":"172.21.15.175:6829/3824112919","state":["exists","up"]},{"osd":7,"uuid":"e18d9e09-8673-470d-b9dc-280a409b63f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6817","nonce":3319361162},{"type":"v1","addr":"172.21.15.175:6818","nonce":3319361162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":3319361162},{"type":"v1","addr":"172.21.15.175:6822","nonce":3319361162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6827","nonce":3319361162},{"type":"v1","addr":"172.21.15.175:6828","nonce":3319361162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6823","nonce":3319361162},{"type":"v1","addr":"172.21.15.175:6825","nonce":3319361162}]},"public_addr":"172.21.15.175:6818/3319361162","cluster_addr":"172.21.15.175:6822/3319361162","heartbeat_back_addr":"172.21.15.175:6828/3319361162","heartbeat_front_addr":"172.21.15.175:6825/3319361162","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:40:15.126268+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:40:15.050614+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:40:14.995164+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:40:15.078112+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:40:15.159637+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:40:15.091226+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:40:15.140316+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:40:15.089431+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:40:51.025 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:51.020+0000 7fd8d9178640 1 -- 172.21.15.88:0/3004436601 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fd8c006c8f0 msgr2=0x7fd8c006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:51.025 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:51.020+0000 7fd8d9178640 1 --2- 172.21.15.88:0/3004436601 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fd8c006c8f0 0x7fd8c006edb0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fd8c40012e0 tx=0x7fd8c4007d30 comp rx=0 tx=0).stop 2024-04-26T23:40:51.025 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:51.021+0000 7fd8d9178640 1 -- 172.21.15.88:0/3004436601 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd8d40c4820 msgr2=0x7fd8d4142030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:51.025 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:51.021+0000 7fd8d9178640 1 --2- 172.21.15.88:0/3004436601 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd8d40c4820 0x7fd8d4142030 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fd8cc00c750 tx=0x7fd8cc00cc10 comp rx=0 tx=0).stop 2024-04-26T23:40:51.025 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:51.021+0000 7fd8d9178640 1 -- 172.21.15.88:0/3004436601 shutdown_connections 2024-04-26T23:40:51.025 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:51.021+0000 7fd8d9178640 1 --2- 172.21.15.88:0/3004436601 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fd8c006c8f0 0x7fd8c006edb0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:51.025 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:51.021+0000 7fd8d9178640 1 --2- 172.21.15.88:0/3004436601 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd8d40aecf0 0x7fd8d4141af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:51.025 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:51.021+0000 7fd8d9178640 1 --2- 172.21.15.88:0/3004436601 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd8d40c4820 0x7fd8d4142030 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:51.025 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:51.021+0000 7fd8d9178640 1 --2- 172.21.15.88:0/3004436601 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd8d40ab630 0x7fd8d414e290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:51.025 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:51.021+0000 7fd8d9178640 1 -- 172.21.15.88:0/3004436601 >> 172.21.15.88:0/3004436601 conn(0x7fd8d40c6ed0 msgr2=0x7fd8d40c3800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:40:51.025 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:51.021+0000 7fd8d9178640 1 -- 172.21.15.88:0/3004436601 shutdown_connections 2024-04-26T23:40:51.026 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:51.021+0000 7fd8d9178640 1 -- 172.21.15.88:0/3004436601 wait complete. 2024-04-26T23:40:51.036 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T23:40:19.936127+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'a_metadata', 'create_time': '2024-04-26T23:40:29.837465+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'a'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'a_data', 'create_time': '2024-04-26T23:40:30.868651+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'a'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'b_metadata', 'create_time': '2024-04-26T23:40:38.753441+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'b'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'b_data', 'create_time': '2024-04-26T23:40:39.974557+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'b'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T23:40:51.036 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T23:40:51.135 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:51.131+0000 7f9978a20640 1 Processor -- start 2024-04-26T23:40:51.135 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:51.131+0000 7f9978a20640 1 -- start start 2024-04-26T23:40:51.137 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:51.132+0000 7f9978a20640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f997413ffb0 0x7f99740c3b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:51.137 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:51.132+0000 7f9978a20640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f9974074c10 0x7f99740c40b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:51.137 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:51.132+0000 7f9978a20640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f99741579d0 con 0x7f99740c45f0 2024-04-26T23:40:51.137 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:51.132+0000 7f9978a20640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f9974070880 con 0x7f9974074c10 2024-04-26T23:40:51.137 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:51.132+0000 7f9978a20640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f99740ab680 con 0x7f997413ffb0 2024-04-26T23:40:51.137 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:51.132+0000 7f9971d9b640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f9974074c10 0x7f99740c40b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:51.137 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:51.132+0000 7f9972d9d640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f99740c45f0 0x7f9974073700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:58078/0 (socket says 172.21.15.88:58078) 2024-04-26T23:40:51.137 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:51.132+0000 7f9972d9d640 1 -- 172.21.15.88:0/2831440122 learned_addr learned my addr 172.21.15.88:0/2831440122 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-26T23:40:51.137 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:51.133+0000 7f9971d9b640 1 -- 172.21.15.88:0/2831440122 >> v2:172.21.15.175:3300/0 conn(0x7f997413ffb0 msgr2=0x7f99740c3b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:40:51.137 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:51.133+0000 7f997259c640 1 --2- 172.21.15.88:0/2831440122 >> v2:172.21.15.175:3300/0 conn(0x7f997413ffb0 0x7f99740c3b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:51.137 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:51.133+0000 7f9971d9b640 1 --2- 172.21.15.88:0/2831440122 >> v2:172.21.15.175:3300/0 conn(0x7f997413ffb0 0x7f99740c3b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:51.138 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:51.133+0000 7f997159a640 1 -- 172.21.15.88:0/2831440122 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1999359350 0 0) 0x7f99741579d0 con 0x7f99740c45f0 2024-04-26T23:40:51.138 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:51.133+0000 7f9971d9b640 1 -- 172.21.15.88:0/2831440122 >> v1:172.21.15.88:6789/0 conn(0x7f99740c45f0 legacy=0x7f9974073700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:51.138 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:51.133+0000 7f9971d9b640 1 -- 172.21.15.88:0/2831440122 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99740ab960 con 0x7f9974074c10 2024-04-26T23:40:51.139 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:51.133+0000 7f9971d9b640 1 --2- 172.21.15.88:0/2831440122 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9974074c10 0x7f99740c40b0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f99740cb1e0 tx=0x7f996802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be5c2eb6b28ff65a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:51.139 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:51.134+0000 7f997159a640 1 -- 172.21.15.88:0/2831440122 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9968037070 con 0x7f9974074c10 2024-04-26T23:40:51.139 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:51.134+0000 7f997159a640 1 -- 172.21.15.88:0/2831440122 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9968032440 con 0x7f9974074c10 2024-04-26T23:40:51.139 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:51.134+0000 7f997159a640 1 -- 172.21.15.88:0/2831440122 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9968032810 con 0x7f9974074c10 2024-04-26T23:40:51.140 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:51.134+0000 7f9978a20640 1 -- 172.21.15.88:0/2831440122 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9974074c10 msgr2=0x7f99740c40b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:51.140 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:51.134+0000 7f9978a20640 1 --2- 172.21.15.88:0/2831440122 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9974074c10 0x7f99740c40b0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f99740cb1e0 tx=0x7f996802a1a0 comp rx=0 tx=0).stop 2024-04-26T23:40:51.140 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:51.134+0000 7f9978a20640 1 -- 172.21.15.88:0/2831440122 shutdown_connections 2024-04-26T23:40:51.140 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:51.134+0000 7f9978a20640 1 --2- 172.21.15.88:0/2831440122 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9974074c10 0x7f99740c40b0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:51.140 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:51.134+0000 7f9978a20640 1 --2- 172.21.15.88:0/2831440122 >> v2:172.21.15.175:3300/0 conn(0x7f997413ffb0 0x7f99740c3b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:51.140 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:51.134+0000 7f9978a20640 1 -- 172.21.15.88:0/2831440122 >> 172.21.15.88:0/2831440122 conn(0x7f99740ca2f0 msgr2=0x7f99740ca6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:40:51.140 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:51.134+0000 7f9978a20640 1 -- 172.21.15.88:0/2831440122 shutdown_connections 2024-04-26T23:40:51.140 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:51.134+0000 7f9978a20640 1 -- 172.21.15.88:0/2831440122 wait complete. 2024-04-26T23:40:51.140 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:51.136+0000 7f9978a20640 1 Processor -- start 2024-04-26T23:40:51.140 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:51.136+0000 7f9978a20640 1 -- start start 2024-04-26T23:40:51.143 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:51.136+0000 7f9978a20640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9974074c10 0x7f99740c5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:51.143 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:51.136+0000 7f9978a20640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f99740c45f0 0x7f9974153be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:51.143 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:51.136+0000 7f9978a20640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f997413ffb0 0x7f997413cac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:51.143 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:51.136+0000 7f9978a20640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f9974073e10 con 0x7f997413ffb0 2024-04-26T23:40:51.143 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:51.136+0000 7f9978a20640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f9974157660 con 0x7f9974074c10 2024-04-26T23:40:51.143 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:51.136+0000 7f9978a20640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f9974073f90 con 0x7f99740c45f0 2024-04-26T23:40:51.143 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:51.136+0000 7f9972d9d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f997413ffb0 0x7f997413cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:51.143 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:51.136+0000 7f9972d9d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f997413ffb0 0x7f997413cac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:41702/0 (socket says 172.21.15.88:41702) 2024-04-26T23:40:51.143 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:51.136+0000 7f9972d9d640 1 -- 172.21.15.88:0/3516145638 learned_addr learned my addr 172.21.15.88:0/3516145638 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:40:51.143 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:51.136+0000 7f997259c640 1 --2- 172.21.15.88:0/3516145638 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9974074c10 0x7f99740c5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:51.143 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:51.136+0000 7f9971d9b640 1 --2- 172.21.15.88:0/3516145638 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f99740c45f0 0x7f9974153be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:51.144 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:51.137+0000 7f9972d9d640 1 -- 172.21.15.88:0/3516145638 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f99740c45f0 msgr2=0x7f9974153be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:51.144 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:51.137+0000 7f9972d9d640 1 --2- 172.21.15.88:0/3516145638 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f99740c45f0 0x7f9974153be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:51.144 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:51.137+0000 7f9972d9d640 1 -- 172.21.15.88:0/3516145638 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9974074c10 msgr2=0x7f99740c5070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:51.144 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:51.137+0000 7f9972d9d640 1 --2- 172.21.15.88:0/3516145638 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9974074c10 0x7f99740c5070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:51.144 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:51.137+0000 7f9972d9d640 1 -- 172.21.15.88:0/3516145638 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99741ec780 con 0x7f997413ffb0 2024-04-26T23:40:51.144 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:51.137+0000 7f9972d9d640 1 --2- 172.21.15.88:0/3516145638 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f997413ffb0 0x7f997413cac0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f996c00c4b0 tx=0x7f996c00c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:51.144 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:51.137+0000 7f9962ffd640 1 -- 172.21.15.88:0/3516145638 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f996c018070 con 0x7f997413ffb0 2024-04-26T23:40:51.144 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:51.137+0000 7f9962ffd640 1 -- 172.21.15.88:0/3516145638 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f996c0074e0 con 0x7f997413ffb0 2024-04-26T23:40:51.144 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:51.137+0000 7f9962ffd640 1 -- 172.21.15.88:0/3516145638 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f996c004a20 con 0x7f997413ffb0 2024-04-26T23:40:51.144 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:51.137+0000 7f9978a20640 1 -- 172.21.15.88:0/3516145638 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99741eca60 con 0x7f997413ffb0 2024-04-26T23:40:51.144 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:51.137+0000 7f9978a20640 1 -- 172.21.15.88:0/3516145638 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99740c55b0 con 0x7f997413ffb0 2024-04-26T23:40:51.144 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:51.138+0000 7f9978a20640 1 -- 172.21.15.88:0/3516145638 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f99740507a0 con 0x7f997413ffb0 2024-04-26T23:40:51.144 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:51.138+0000 7f9962ffd640 1 -- 172.21.15.88:0/3516145638 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f996c01b070 con 0x7f997413ffb0 2024-04-26T23:40:51.144 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:51.139+0000 7f9962ffd640 1 --2- 172.21.15.88:0/3516145638 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f995406c8f0 0x7f995406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:51.145 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:51.139+0000 7f997259c640 1 --2- 172.21.15.88:0/3516145638 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f995406c8f0 0x7f995406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:51.145 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:51.139+0000 7f9962ffd640 1 -- 172.21.15.88:0/3516145638 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7f996c08afd0 con 0x7f997413ffb0 2024-04-26T23:40:51.145 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:51.139+0000 7f997259c640 1 --2- 172.21.15.88:0/3516145638 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f995406c8f0 0x7f995406edb0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f99740c66d0 tx=0x7f9964007710 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:51.146 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:51.143+0000 7f9962ffd640 1 -- 172.21.15.88:0/3516145638 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f996c058b10 con 0x7f997413ffb0 2024-04-26T23:40:51.323 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:51.318+0000 7f9978a20640 1 -- 172.21.15.88:0/3516145638 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f9974156430 con 0x7f997413ffb0 2024-04-26T23:40:51.323 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:51.319+0000 7f9962ffd640 1 -- 172.21.15.88:0/3516145638 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) ==== 93+0+10 (secure 0 0 0) 0x7f996c05ce10 con 0x7f997413ffb0 2024-04-26T23:40:51.323 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 1 2024-04-26T23:40:51.325 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:51.321+0000 7f9978a20640 1 -- 172.21.15.88:0/3516145638 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f995406c8f0 msgr2=0x7f995406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:51.325 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:51.321+0000 7f9978a20640 1 --2- 172.21.15.88:0/3516145638 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f995406c8f0 0x7f995406edb0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f99740c66d0 tx=0x7f9964007710 comp rx=0 tx=0).stop 2024-04-26T23:40:51.325 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:51.321+0000 7f9978a20640 1 -- 172.21.15.88:0/3516145638 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f997413ffb0 msgr2=0x7f997413cac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:51.325 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:51.321+0000 7f9978a20640 1 --2- 172.21.15.88:0/3516145638 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f997413ffb0 0x7f997413cac0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f996c00c4b0 tx=0x7f996c00c970 comp rx=0 tx=0).stop 2024-04-26T23:40:51.325 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:51.321+0000 7f9978a20640 1 -- 172.21.15.88:0/3516145638 shutdown_connections 2024-04-26T23:40:51.325 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:51.321+0000 7f9978a20640 1 --2- 172.21.15.88:0/3516145638 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f995406c8f0 0x7f995406edb0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:51.325 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:51.321+0000 7f9978a20640 1 --2- 172.21.15.88:0/3516145638 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f99740c45f0 0x7f9974153be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:51.325 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:51.321+0000 7f9978a20640 1 --2- 172.21.15.88:0/3516145638 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f997413ffb0 0x7f997413cac0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:51.325 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:51.321+0000 7f9978a20640 1 --2- 172.21.15.88:0/3516145638 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9974074c10 0x7f99740c5070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:51.325 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:51.321+0000 7f9978a20640 1 -- 172.21.15.88:0/3516145638 >> 172.21.15.88:0/3516145638 conn(0x7f99740ca2f0 msgr2=0x7f9974073700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:40:51.326 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:51.321+0000 7f9978a20640 1 -- 172.21.15.88:0/3516145638 shutdown_connections 2024-04-26T23:40:51.326 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:51.321+0000 7f9978a20640 1 -- 172.21.15.88:0/3516145638 wait complete. 2024-04-26T23:40:51.336 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get a_metadata pg_num 2024-04-26T23:40:51.435 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:51.431+0000 7f54d3207640 1 Processor -- start 2024-04-26T23:40:51.435 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:51.431+0000 7f54d3207640 1 -- start start 2024-04-26T23:40:51.437 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:51.432+0000 7f54d3207640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f54cc1570d0 0x7f54cc150a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:51.437 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:51.432+0000 7f54d3207640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f54cc0ab3f0 0x7f54cc150f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:51.437 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:51.432+0000 7f54d3207640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f54cc0c3810 con 0x7f54cc0c4d80 2024-04-26T23:40:51.437 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:51.432+0000 7f54d3207640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f54cc0c4330 con 0x7f54cc0ab3f0 2024-04-26T23:40:51.437 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:51.432+0000 7f54d3207640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f54cc0c3ab0 con 0x7f54cc1570d0 2024-04-26T23:40:51.437 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:51.432+0000 7f54cbfff640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f54cc0ab3f0 0x7f54cc150f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:51.437 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:51.432+0000 7f54cbfff640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f54cc0ab3f0 0x7f54cc150f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:41712/0 (socket says 172.21.15.88:41712) 2024-04-26T23:40:51.437 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:51.432+0000 7f54cbfff640 1 -- 172.21.15.88:0/2295495798 learned_addr learned my addr 172.21.15.88:0/2295495798 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:40:51.437 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:51.432+0000 7f54d0fa3640 1 --2- 172.21.15.88:0/2295495798 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f54cc1570d0 0x7f54cc150a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:51.438 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:51.432+0000 7f54cbfff640 1 -- 172.21.15.88:0/2295495798 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f54cc1570d0 msgr2=0x7f54cc150a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:40:51.438 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:51.432+0000 7f54cbfff640 1 --2- 172.21.15.88:0/2295495798 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f54cc1570d0 0x7f54cc150a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:51.438 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:51.432+0000 7f54cbfff640 1 -- 172.21.15.88:0/2295495798 >> v1:172.21.15.175:6789/0 conn(0x7f54cc0c4d80 legacy=0x7f54cc1574b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:40:51.438 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:51.432+0000 7f54cbfff640 1 -- 172.21.15.88:0/2295495798 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54cc0c4580 con 0x7f54cc0ab3f0 2024-04-26T23:40:51.438 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:51.433+0000 7f54cbfff640 1 --2- 172.21.15.88:0/2295495798 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f54cc0ab3f0 0x7f54cc150f90 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f54cc0c5e90 tx=0x7f54c002a0b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63d19e0d1e7a0564 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:51.438 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:51.433+0000 7f54cb7fe640 1 -- 172.21.15.88:0/2295495798 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54c0037070 con 0x7f54cc0ab3f0 2024-04-26T23:40:51.438 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:51.433+0000 7f54cb7fe640 1 -- 172.21.15.88:0/2295495798 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54c002adc0 con 0x7f54cc0ab3f0 2024-04-26T23:40:51.438 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:51.433+0000 7f54cb7fe640 1 -- 172.21.15.88:0/2295495798 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54c0032660 con 0x7f54cc0ab3f0 2024-04-26T23:40:51.441 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:51.434+0000 7f54d3207640 1 -- 172.21.15.88:0/2295495798 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f54cc0ab3f0 msgr2=0x7f54cc150f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:51.441 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:51.434+0000 7f54d3207640 1 --2- 172.21.15.88:0/2295495798 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f54cc0ab3f0 0x7f54cc150f90 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f54cc0c5e90 tx=0x7f54c002a0b0 comp rx=0 tx=0).stop 2024-04-26T23:40:51.441 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:51.434+0000 7f54d3207640 1 -- 172.21.15.88:0/2295495798 shutdown_connections 2024-04-26T23:40:51.441 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:51.434+0000 7f54d3207640 1 --2- 172.21.15.88:0/2295495798 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f54cc0ab3f0 0x7f54cc150f90 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:51.441 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:51.434+0000 7f54d3207640 1 --2- 172.21.15.88:0/2295495798 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f54cc1570d0 0x7f54cc150a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:51.441 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:51.434+0000 7f54d3207640 1 -- 172.21.15.88:0/2295495798 >> 172.21.15.88:0/2295495798 conn(0x7f54cc06c310 msgr2=0x7f54cc06c6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:40:51.441 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:51.434+0000 7f54d3207640 1 -- 172.21.15.88:0/2295495798 shutdown_connections 2024-04-26T23:40:51.441 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:51.434+0000 7f54d3207640 1 -- 172.21.15.88:0/2295495798 wait complete. 2024-04-26T23:40:51.442 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:51.435+0000 7f54d3207640 1 Processor -- start 2024-04-26T23:40:51.442 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:51.435+0000 7f54d3207640 1 -- start start 2024-04-26T23:40:51.442 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:51.436+0000 7f54d3207640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f54cc0ab3f0 0x7f54cc0c7160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:51.442 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:51.436+0000 7f54d3207640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f54cc0c4d80 0x7f54cc072b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:51.442 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:51.436+0000 7f54d3207640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f54cc1570d0 0x7f54cc0730c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:51.442 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:51.436+0000 7f54d3207640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f54cc0abbe0 con 0x7f54cc1570d0 2024-04-26T23:40:51.442 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:51.436+0000 7f54d3207640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f54cc0aba60 con 0x7f54cc0ab3f0 2024-04-26T23:40:51.442 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:51.436+0000 7f54d3207640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f54cc157bc0 con 0x7f54cc0c4d80 2024-04-26T23:40:51.442 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:51.436+0000 7f54d17a4640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f54cc1570d0 0x7f54cc0730c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:51.442 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:51.436+0000 7f54d17a4640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f54cc1570d0 0x7f54cc0730c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:41724/0 (socket says 172.21.15.88:41724) 2024-04-26T23:40:51.442 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:51.436+0000 7f54d17a4640 1 -- 172.21.15.88:0/3674462803 learned_addr learned my addr 172.21.15.88:0/3674462803 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:40:51.442 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:51.436+0000 7f54cbfff640 1 --2- 172.21.15.88:0/3674462803 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f54cc0c4d80 0x7f54cc072b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:51.442 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:51.436+0000 7f54d0fa3640 1 --2- 172.21.15.88:0/3674462803 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f54cc0ab3f0 0x7f54cc0c7160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:51.443 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:51.436+0000 7f54d17a4640 1 -- 172.21.15.88:0/3674462803 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f54cc0c4d80 msgr2=0x7f54cc072b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:51.443 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:51.436+0000 7f54d17a4640 1 --2- 172.21.15.88:0/3674462803 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f54cc0c4d80 0x7f54cc072b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:51.443 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:51.436+0000 7f54d17a4640 1 -- 172.21.15.88:0/3674462803 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f54cc0ab3f0 msgr2=0x7f54cc0c7160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:51.443 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:51.436+0000 7f54d17a4640 1 --2- 172.21.15.88:0/3674462803 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f54cc0ab3f0 0x7f54cc0c7160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:51.443 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:51.436+0000 7f54d17a4640 1 -- 172.21.15.88:0/3674462803 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54cc1ea610 con 0x7f54cc1570d0 2024-04-26T23:40:51.443 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:51.436+0000 7f54d17a4640 1 --2- 172.21.15.88:0/3674462803 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f54cc1570d0 0x7f54cc0730c0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f54c400c780 tx=0x7f54c400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:51.443 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:51.436+0000 7f54c97fa640 1 -- 172.21.15.88:0/3674462803 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54c4004b60 con 0x7f54cc1570d0 2024-04-26T23:40:51.443 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:51.436+0000 7f54c97fa640 1 -- 172.21.15.88:0/3674462803 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54c4004d00 con 0x7f54cc1570d0 2024-04-26T23:40:51.443 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:51.436+0000 7f54d3207640 1 -- 172.21.15.88:0/3674462803 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54cc1ea8d0 con 0x7f54cc1570d0 2024-04-26T23:40:51.443 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:51.436+0000 7f54c97fa640 1 -- 172.21.15.88:0/3674462803 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54c400aa90 con 0x7f54cc1570d0 2024-04-26T23:40:51.443 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:51.436+0000 7f54d3207640 1 -- 172.21.15.88:0/3674462803 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54cc1eae90 con 0x7f54cc1570d0 2024-04-26T23:40:51.443 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:51.437+0000 7f54d3207640 1 -- 172.21.15.88:0/3674462803 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f54cc0507a0 con 0x7f54cc1570d0 2024-04-26T23:40:51.444 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:51.438+0000 7f54c97fa640 1 -- 172.21.15.88:0/3674462803 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f54c400ac30 con 0x7f54cc1570d0 2024-04-26T23:40:51.444 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:51.438+0000 7f54c97fa640 1 --2- 172.21.15.88:0/3674462803 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f54b806c920 0x7f54b806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:51.444 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:51.438+0000 7f54c97fa640 1 -- 172.21.15.88:0/3674462803 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7f54c408c050 con 0x7f54cc1570d0 2024-04-26T23:40:51.444 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:51.438+0000 7f54d0fa3640 1 --2- 172.21.15.88:0/3674462803 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f54b806c920 0x7f54b806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:51.444 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:51.438+0000 7f54d0fa3640 1 --2- 172.21.15.88:0/3674462803 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f54b806c920 0x7f54b806ede0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f54bc006fd0 tx=0x7f54bc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:51.446 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:51.442+0000 7f54c97fa640 1 -- 172.21.15.88:0/3674462803 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f54c4020070 con 0x7f54cc1570d0 2024-04-26T23:40:51.618 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:51.614+0000 7f54d3207640 1 -- 172.21.15.88:0/3674462803 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "a_metadata", "var": "pg_num"} v 0) -- 0x7f54cc0c4110 con 0x7f54cc1570d0 2024-04-26T23:40:51.618 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:51.615+0000 7f54c97fa640 1 -- 172.21.15.88:0/3674462803 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "a_metadata", "var": "pg_num"}]=0 v24) ==== 99+0+11 (secure 0 0 0) 0x7f54c405a1e0 con 0x7f54cc1570d0 2024-04-26T23:40:51.619 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 32 2024-04-26T23:40:51.621 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:51.617+0000 7f54d3207640 1 -- 172.21.15.88:0/3674462803 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f54b806c920 msgr2=0x7f54b806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:51.621 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:51.617+0000 7f54d3207640 1 --2- 172.21.15.88:0/3674462803 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f54b806c920 0x7f54b806ede0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f54bc006fd0 tx=0x7f54bc008040 comp rx=0 tx=0).stop 2024-04-26T23:40:51.621 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:51.617+0000 7f54d3207640 1 -- 172.21.15.88:0/3674462803 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f54cc1570d0 msgr2=0x7f54cc0730c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:51.621 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:51.617+0000 7f54d3207640 1 --2- 172.21.15.88:0/3674462803 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f54cc1570d0 0x7f54cc0730c0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f54c400c780 tx=0x7f54c400cc40 comp rx=0 tx=0).stop 2024-04-26T23:40:51.621 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:51.617+0000 7f54d3207640 1 -- 172.21.15.88:0/3674462803 shutdown_connections 2024-04-26T23:40:51.621 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:51.617+0000 7f54d3207640 1 --2- 172.21.15.88:0/3674462803 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f54b806c920 0x7f54b806ede0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:51.621 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:51.617+0000 7f54d3207640 1 --2- 172.21.15.88:0/3674462803 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f54cc0c4d80 0x7f54cc072b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:51.621 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:51.617+0000 7f54d3207640 1 --2- 172.21.15.88:0/3674462803 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f54cc1570d0 0x7f54cc0730c0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:51.621 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:51.617+0000 7f54d3207640 1 --2- 172.21.15.88:0/3674462803 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f54cc0ab3f0 0x7f54cc0c7160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:51.622 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:51.617+0000 7f54d3207640 1 -- 172.21.15.88:0/3674462803 >> 172.21.15.88:0/3674462803 conn(0x7f54cc06c310 msgr2=0x7f54cc14d040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:40:51.622 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:51.617+0000 7f54d3207640 1 -- 172.21.15.88:0/3674462803 shutdown_connections 2024-04-26T23:40:51.622 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:51.617+0000 7f54d3207640 1 -- 172.21.15.88:0/3674462803 wait complete. 2024-04-26T23:40:51.631 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get a_data pg_num 2024-04-26T23:40:51.732 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:51.728+0000 7f652bb0a640 1 Processor -- start 2024-04-26T23:40:51.732 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:51.728+0000 7f652bb0a640 1 -- start start 2024-04-26T23:40:51.733 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:51.729+0000 7f652bb0a640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f6524150d20 0x7f652415a360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:51.734 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:51.729+0000 7f652bb0a640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f652406f790 0x7f65240c32e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:51.734 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:51.729+0000 7f652bb0a640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f65240c3d10 con 0x7f6524157680 2024-04-26T23:40:51.734 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:51.729+0000 7f652bb0a640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f65240c4290 con 0x7f6524150d20 2024-04-26T23:40:51.734 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:51.729+0000 7f652bb0a640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f65240c3fb0 con 0x7f652406f790 2024-04-26T23:40:51.734 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:51.729+0000 7f65298a6640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f6524150d20 0x7f652415a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:51.734 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:51.729+0000 7f65298a6640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f6524150d20 0x7f652415a360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:41728/0 (socket says 172.21.15.88:41728) 2024-04-26T23:40:51.734 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:51.729+0000 7f65298a6640 1 -- 172.21.15.88:0/1206925580 learned_addr learned my addr 172.21.15.88:0/1206925580 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:40:51.734 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:51.730+0000 7f65290a5640 1 --2- 172.21.15.88:0/1206925580 >> v2:172.21.15.175:3300/0 conn(0x7f652406f790 0x7f65240c32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:51.734 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:51.730+0000 7f65298a6640 1 -- 172.21.15.88:0/1206925580 >> v2:172.21.15.175:3300/0 conn(0x7f652406f790 msgr2=0x7f65240c32e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:40:51.734 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:51.730+0000 7f65298a6640 1 --2- 172.21.15.88:0/1206925580 >> v2:172.21.15.175:3300/0 conn(0x7f652406f790 0x7f65240c32e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:51.734 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:51.730+0000 7f65298a6640 1 -- 172.21.15.88:0/1206925580 >> v1:172.21.15.175:6789/0 conn(0x7f6524157680 legacy=0x7f652406d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:40:51.734 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:51.730+0000 7f65298a6640 1 -- 172.21.15.88:0/1206925580 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6524156e80 con 0x7f6524150d20 2024-04-26T23:40:51.736 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:51.730+0000 7f65298a6640 1 --2- 172.21.15.88:0/1206925580 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6524150d20 0x7f652415a360 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f652406de70 tx=0x7f652002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=128203656152407a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:51.736 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:51.730+0000 7f65288a4640 1 -- 172.21.15.88:0/1206925580 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6520037070 con 0x7f6524150d20 2024-04-26T23:40:51.736 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:51.730+0000 7f65288a4640 1 -- 172.21.15.88:0/1206925580 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6520032440 con 0x7f6524150d20 2024-04-26T23:40:51.736 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:51.730+0000 7f65288a4640 1 -- 172.21.15.88:0/1206925580 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6520032810 con 0x7f6524150d20 2024-04-26T23:40:51.736 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:51.731+0000 7f652bb0a640 1 -- 172.21.15.88:0/1206925580 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6524150d20 msgr2=0x7f652415a360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:51.736 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:51.731+0000 7f652bb0a640 1 --2- 172.21.15.88:0/1206925580 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6524150d20 0x7f652415a360 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f652406de70 tx=0x7f652002a1a0 comp rx=0 tx=0).stop 2024-04-26T23:40:51.736 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:51.731+0000 7f652bb0a640 1 -- 172.21.15.88:0/1206925580 shutdown_connections 2024-04-26T23:40:51.736 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:51.731+0000 7f652bb0a640 1 --2- 172.21.15.88:0/1206925580 >> v2:172.21.15.175:3300/0 conn(0x7f652406f790 0x7f65240c32e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:51.736 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:51.731+0000 7f652bb0a640 1 --2- 172.21.15.88:0/1206925580 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6524150d20 0x7f652415a360 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:51.736 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:51.731+0000 7f652bb0a640 1 -- 172.21.15.88:0/1206925580 >> 172.21.15.88:0/1206925580 conn(0x7f65240c5ce0 msgr2=0x7f65240c60f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:40:51.736 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:51.731+0000 7f652bb0a640 1 -- 172.21.15.88:0/1206925580 shutdown_connections 2024-04-26T23:40:51.737 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:51.731+0000 7f652bb0a640 1 -- 172.21.15.88:0/1206925580 wait complete. 2024-04-26T23:40:51.737 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:51.732+0000 7f652bb0a640 1 Processor -- start 2024-04-26T23:40:51.737 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:51.732+0000 7f652bb0a640 1 -- start start 2024-04-26T23:40:51.739 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:51.733+0000 7f652bb0a640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f652406f790 0x7f65241583d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:51.739 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:51.733+0000 7f652bb0a640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6524150d20 0x7f652414ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:51.739 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:51.733+0000 7f652bb0a640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6524157680 0x7f652414f200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:51.740 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:51.733+0000 7f652bb0a640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f652406da30 con 0x7f652406f790 2024-04-26T23:40:51.740 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:51.733+0000 7f652bb0a640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f65240c3820 con 0x7f6524157680 2024-04-26T23:40:51.740 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:51.733+0000 7f652bb0a640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f652406dbb0 con 0x7f6524150d20 2024-04-26T23:40:51.740 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:51.733+0000 7f65298a6640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f652406f790 0x7f65241583d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:51.740 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:51.733+0000 7f65298a6640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f652406f790 0x7f65241583d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:41738/0 (socket says 172.21.15.88:41738) 2024-04-26T23:40:51.740 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:51.733+0000 7f65298a6640 1 -- 172.21.15.88:0/4264305592 learned_addr learned my addr 172.21.15.88:0/4264305592 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:40:51.740 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:51.733+0000 7f65290a5640 1 --2- 172.21.15.88:0/4264305592 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6524150d20 0x7f652414ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:51.740 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:51.733+0000 7f652a0a7640 1 --2- 172.21.15.88:0/4264305592 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6524157680 0x7f652414f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:51.740 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:51.733+0000 7f65298a6640 1 -- 172.21.15.88:0/4264305592 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6524150d20 msgr2=0x7f652414ecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:51.740 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:51.733+0000 7f65298a6640 1 --2- 172.21.15.88:0/4264305592 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6524150d20 0x7f652414ecc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:51.740 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:51.733+0000 7f65298a6640 1 -- 172.21.15.88:0/4264305592 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6524157680 msgr2=0x7f652414f200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:51.740 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:51.733+0000 7f65298a6640 1 --2- 172.21.15.88:0/4264305592 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6524157680 0x7f652414f200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:51.740 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:51.733+0000 7f65298a6640 1 -- 172.21.15.88:0/4264305592 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6524158e10 con 0x7f652406f790 2024-04-26T23:40:51.740 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:51.733+0000 7f65290a5640 1 --2- 172.21.15.88:0/4264305592 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6524150d20 0x7f652414ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:40:51.740 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:51.733+0000 7f652a0a7640 1 --2- 172.21.15.88:0/4264305592 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6524157680 0x7f652414f200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:40:51.741 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:51.733+0000 7f65298a6640 1 --2- 172.21.15.88:0/4264305592 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f652406f790 0x7f65241583d0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f6520000c00 tx=0x7f65200046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:51.741 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:51.733+0000 7f651a7fc640 1 -- 172.21.15.88:0/4264305592 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6520041020 con 0x7f652406f790 2024-04-26T23:40:51.741 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:51.733+0000 7f651a7fc640 1 -- 172.21.15.88:0/4264305592 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6520030970 con 0x7f652406f790 2024-04-26T23:40:51.741 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:51.734+0000 7f652bb0a640 1 -- 172.21.15.88:0/4264305592 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f652414faa0 con 0x7f652406f790 2024-04-26T23:40:51.741 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:51.734+0000 7f651a7fc640 1 -- 172.21.15.88:0/4264305592 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6520037040 con 0x7f652406f790 2024-04-26T23:40:51.741 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:51.734+0000 7f652bb0a640 1 -- 172.21.15.88:0/4264305592 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65241ecf90 con 0x7f652406f790 2024-04-26T23:40:51.741 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:51.735+0000 7f652bb0a640 1 -- 172.21.15.88:0/4264305592 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6524068dc0 con 0x7f652406f790 2024-04-26T23:40:51.741 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:51.735+0000 7f651a7fc640 1 -- 172.21.15.88:0/4264305592 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6520044020 con 0x7f652406f790 2024-04-26T23:40:51.741 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:51.735+0000 7f651a7fc640 1 --2- 172.21.15.88:0/4264305592 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f650806c920 0x7f650806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:51.741 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:51.735+0000 7f65290a5640 1 --2- 172.21.15.88:0/4264305592 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f650806c920 0x7f650806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:51.741 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:51.735+0000 7f651a7fc640 1 -- 172.21.15.88:0/4264305592 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7f65200ac4b0 con 0x7f652406f790 2024-04-26T23:40:51.741 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:51.736+0000 7f65290a5640 1 --2- 172.21.15.88:0/4264305592 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f650806c920 0x7f650806ede0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f65240af220 tx=0x7f6514008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:51.743 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:51.740+0000 7f651a7fc640 1 -- 172.21.15.88:0/4264305592 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f652004b070 con 0x7f652406f790 2024-04-26T23:40:51.918 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:51.914+0000 7f652bb0a640 1 -- 172.21.15.88:0/4264305592 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "a_data", "var": "pg_num"} v 0) -- 0x7f65240507a0 con 0x7f652406f790 2024-04-26T23:40:51.918 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:51.914+0000 7f651a7fc640 1 -- 172.21.15.88:0/4264305592 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "a_data", "var": "pg_num"}]=0 v24) ==== 95+0+11 (secure 0 0 0) 0x7f652007a640 con 0x7f652406f790 2024-04-26T23:40:51.918 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 64 2024-04-26T23:40:51.920 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:51.916+0000 7f652bb0a640 1 -- 172.21.15.88:0/4264305592 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f650806c920 msgr2=0x7f650806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:51.920 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:51.916+0000 7f652bb0a640 1 --2- 172.21.15.88:0/4264305592 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f650806c920 0x7f650806ede0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f65240af220 tx=0x7f6514008040 comp rx=0 tx=0).stop 2024-04-26T23:40:51.920 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:51.916+0000 7f652bb0a640 1 -- 172.21.15.88:0/4264305592 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f652406f790 msgr2=0x7f65241583d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:51.921 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:51.916+0000 7f652bb0a640 1 --2- 172.21.15.88:0/4264305592 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f652406f790 0x7f65241583d0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f6520000c00 tx=0x7f65200046c0 comp rx=0 tx=0).stop 2024-04-26T23:40:51.921 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:51.916+0000 7f652bb0a640 1 -- 172.21.15.88:0/4264305592 shutdown_connections 2024-04-26T23:40:51.921 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:51.916+0000 7f652bb0a640 1 --2- 172.21.15.88:0/4264305592 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f650806c920 0x7f650806ede0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:51.921 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:51.916+0000 7f652bb0a640 1 --2- 172.21.15.88:0/4264305592 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6524150d20 0x7f652414ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:51.921 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:51.916+0000 7f652bb0a640 1 --2- 172.21.15.88:0/4264305592 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6524157680 0x7f652414f200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:51.921 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:51.916+0000 7f652bb0a640 1 --2- 172.21.15.88:0/4264305592 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f652406f790 0x7f65241583d0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:51.921 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:51.916+0000 7f652bb0a640 1 -- 172.21.15.88:0/4264305592 >> 172.21.15.88:0/4264305592 conn(0x7f65240c5ce0 msgr2=0x7f652406c860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:40:51.921 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:51.916+0000 7f652bb0a640 1 -- 172.21.15.88:0/4264305592 shutdown_connections 2024-04-26T23:40:51.921 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:51.916+0000 7f652bb0a640 1 -- 172.21.15.88:0/4264305592 wait complete. 2024-04-26T23:40:51.931 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get b_metadata pg_num 2024-04-26T23:40:52.030 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.026+0000 7fe0415c1640 1 Processor -- start 2024-04-26T23:40:52.031 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.027+0000 7fe0415c1640 1 -- start start 2024-04-26T23:40:52.032 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.027+0000 7fe0415c1640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fe03c154160 0x7fe03c156bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:52.032 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.027+0000 7fe0415c1640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe03c0ca5a0 0x7fe03c15a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:52.032 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.027+0000 7fe0415c1640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe03c0c8df0 con 0x7fe03c0c6e00 2024-04-26T23:40:52.032 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.027+0000 7fe0415c1640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7fe03c15a6e0 con 0x7fe03c154160 2024-04-26T23:40:52.032 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.027+0000 7fe0415c1640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fe03c0c9100 con 0x7fe03c0ca5a0 2024-04-26T23:40:52.032 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.027+0000 7fe03affd640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fe03c154160 0x7fe03c156bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:52.032 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.027+0000 7fe03b7fe640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fe03c0c6e00 0x7fe03c0c9590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:58090/0 (socket says 172.21.15.88:58090) 2024-04-26T23:40:52.032 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.027+0000 7fe03b7fe640 1 -- 172.21.15.88:0/3423592298 learned_addr learned my addr 172.21.15.88:0/3423592298 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-26T23:40:52.032 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.028+0000 7fe03a7fc640 1 --2- 172.21.15.88:0/3423592298 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe03c0ca5a0 0x7fe03c15a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:52.033 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.028+0000 7fe03affd640 1 -- 172.21.15.88:0/3423592298 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe03c0ca5a0 msgr2=0x7fe03c15a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:40:52.033 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.028+0000 7fe03affd640 1 --2- 172.21.15.88:0/3423592298 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe03c0ca5a0 0x7fe03c15a1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:52.033 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.028+0000 7fe03affd640 1 -- 172.21.15.88:0/3423592298 >> v1:172.21.15.88:6789/0 conn(0x7fe03c0c6e00 legacy=0x7fe03c0c9590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:52.033 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.028+0000 7fe039ffb640 1 -- 172.21.15.88:0/3423592298 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3281873966 0 0) 0x7fe034001490 con 0x7fe03c0c6e00 2024-04-26T23:40:52.033 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.028+0000 7fe03affd640 1 -- 172.21.15.88:0/3423592298 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe03c154540 con 0x7fe03c154160 2024-04-26T23:40:52.033 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.028+0000 7fe03affd640 1 --2- 172.21.15.88:0/3423592298 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe03c154160 0x7fe03c156bb0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fe02c0097a0 tx=0x7fe02c02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bb3e74151581df9 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:52.034 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.028+0000 7fe039ffb640 1 -- 172.21.15.88:0/3423592298 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe02c037070 con 0x7fe03c154160 2024-04-26T23:40:52.034 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.029+0000 7fe039ffb640 1 -- 172.21.15.88:0/3423592298 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe02c032440 con 0x7fe03c154160 2024-04-26T23:40:52.034 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.029+0000 7fe039ffb640 1 -- 172.21.15.88:0/3423592298 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe02c032810 con 0x7fe03c154160 2024-04-26T23:40:52.034 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.029+0000 7fe0415c1640 1 -- 172.21.15.88:0/3423592298 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe03c154160 msgr2=0x7fe03c156bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:52.034 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.029+0000 7fe0415c1640 1 --2- 172.21.15.88:0/3423592298 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe03c154160 0x7fe03c156bb0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fe02c0097a0 tx=0x7fe02c02a180 comp rx=0 tx=0).stop 2024-04-26T23:40:52.034 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.029+0000 7fe0415c1640 1 -- 172.21.15.88:0/3423592298 shutdown_connections 2024-04-26T23:40:52.035 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.029+0000 7fe0415c1640 1 --2- 172.21.15.88:0/3423592298 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe03c0ca5a0 0x7fe03c15a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:52.035 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.029+0000 7fe0415c1640 1 --2- 172.21.15.88:0/3423592298 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe03c154160 0x7fe03c156bb0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:52.035 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.029+0000 7fe0415c1640 1 -- 172.21.15.88:0/3423592298 >> 172.21.15.88:0/3423592298 conn(0x7fe03c0ae010 msgr2=0x7fe03c0ae3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:40:52.035 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.029+0000 7fe0415c1640 1 -- 172.21.15.88:0/3423592298 shutdown_connections 2024-04-26T23:40:52.035 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.029+0000 7fe0415c1640 1 -- 172.21.15.88:0/3423592298 wait complete. 2024-04-26T23:40:52.035 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.030+0000 7fe0415c1640 1 Processor -- start 2024-04-26T23:40:52.035 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.030+0000 7fe0415c1640 1 -- start start 2024-04-26T23:40:52.037 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.031+0000 7fe0415c1640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe03c0c6e00 0x7fe03c149d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:52.037 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.031+0000 7fe0415c1640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe03c0ca5a0 0x7fe03c0c4ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:52.037 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.031+0000 7fe0415c1640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe03c154160 0x7fe03c14ada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:52.037 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.031+0000 7fe0415c1640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fe03c15aed0 con 0x7fe03c0c6e00 2024-04-26T23:40:52.037 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.031+0000 7fe0415c1640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fe03c15abf0 con 0x7fe03c0ca5a0 2024-04-26T23:40:52.037 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.031+0000 7fe0415c1640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fe03c0c9ca0 con 0x7fe03c154160 2024-04-26T23:40:52.038 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.031+0000 7fe03affd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe03c0c6e00 0x7fe03c149d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:52.038 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.031+0000 7fe03affd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe03c0c6e00 0x7fe03c149d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:41752/0 (socket says 172.21.15.88:41752) 2024-04-26T23:40:52.038 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.031+0000 7fe03affd640 1 -- 172.21.15.88:0/3520866958 learned_addr learned my addr 172.21.15.88:0/3520866958 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:40:52.038 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.031+0000 7fe03affd640 1 -- 172.21.15.88:0/3520866958 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe03c154160 msgr2=0x7fe03c14ada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:52.038 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.031+0000 7fe03affd640 1 --2- 172.21.15.88:0/3520866958 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe03c154160 0x7fe03c14ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:52.038 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.031+0000 7fe03affd640 1 -- 172.21.15.88:0/3520866958 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe03c0ca5a0 msgr2=0x7fe03c0c4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:52.038 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.031+0000 7fe03affd640 1 --2- 172.21.15.88:0/3520866958 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe03c0ca5a0 0x7fe03c0c4ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:52.038 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.031+0000 7fe03affd640 1 -- 172.21.15.88:0/3520866958 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe03c1ed280 con 0x7fe03c0c6e00 2024-04-26T23:40:52.038 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.031+0000 7fe03affd640 1 --2- 172.21.15.88:0/3520866958 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe03c0c6e00 0x7fe03c149d40 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fe02c000c00 tx=0x7fe02c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:52.038 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.032+0000 7fe0237fe640 1 -- 172.21.15.88:0/3520866958 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe02c037040 con 0x7fe03c0c6e00 2024-04-26T23:40:52.038 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.032+0000 7fe0237fe640 1 -- 172.21.15.88:0/3520866958 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe02c042070 con 0x7fe03c0c6e00 2024-04-26T23:40:52.038 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.032+0000 7fe0237fe640 1 -- 172.21.15.88:0/3520866958 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe02c030bb0 con 0x7fe03c0c6e00 2024-04-26T23:40:52.038 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.032+0000 7fe0415c1640 1 -- 172.21.15.88:0/3520866958 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe03c1ed560 con 0x7fe03c0c6e00 2024-04-26T23:40:52.038 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.032+0000 7fe0415c1640 1 -- 172.21.15.88:0/3520866958 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe03c1edb20 con 0x7fe03c0c6e00 2024-04-26T23:40:52.038 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.033+0000 7fe0415c1640 1 -- 172.21.15.88:0/3520866958 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe03c0abc80 con 0x7fe03c0c6e00 2024-04-26T23:40:52.039 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.033+0000 7fe0237fe640 1 -- 172.21.15.88:0/3520866958 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe02c047460 con 0x7fe03c0c6e00 2024-04-26T23:40:52.039 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.033+0000 7fe0237fe640 1 --2- 172.21.15.88:0/3520866958 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fe02806c8f0 0x7fe02806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:52.039 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.034+0000 7fe0237fe640 1 -- 172.21.15.88:0/3520866958 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7fe02c0ac980 con 0x7fe03c0c6e00 2024-04-26T23:40:52.039 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.034+0000 7fe03a7fc640 1 --2- 172.21.15.88:0/3520866958 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fe02806c8f0 0x7fe02806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:52.039 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.034+0000 7fe03a7fc640 1 --2- 172.21.15.88:0/3520866958 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fe02806c8f0 0x7fe02806edb0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fe03c14a280 tx=0x7fe030008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:52.041 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.038+0000 7fe0237fe640 1 -- 172.21.15.88:0/3520866958 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fe03c0abc80 con 0x7fe03c0c6e00 2024-04-26T23:40:52.217 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.213+0000 7fe0415c1640 1 -- 172.21.15.88:0/3520866958 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "b_metadata", "var": "pg_num"} v 0) -- 0x7fe03c076650 con 0x7fe03c0c6e00 2024-04-26T23:40:52.217 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.213+0000 7fe0237fe640 1 -- 172.21.15.88:0/3520866958 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "b_metadata", "var": "pg_num"}]=0 v24) ==== 99+0+11 (secure 0 0 0) 0x7fe02c032e20 con 0x7fe03c0c6e00 2024-04-26T23:40:52.217 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 32 2024-04-26T23:40:52.219 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.215+0000 7fe0415c1640 1 -- 172.21.15.88:0/3520866958 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fe02806c8f0 msgr2=0x7fe02806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:52.219 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.215+0000 7fe0415c1640 1 --2- 172.21.15.88:0/3520866958 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fe02806c8f0 0x7fe02806edb0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fe03c14a280 tx=0x7fe030008040 comp rx=0 tx=0).stop 2024-04-26T23:40:52.219 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.215+0000 7fe0415c1640 1 -- 172.21.15.88:0/3520866958 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe03c0c6e00 msgr2=0x7fe03c149d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:52.219 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.215+0000 7fe0415c1640 1 --2- 172.21.15.88:0/3520866958 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe03c0c6e00 0x7fe03c149d40 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fe02c000c00 tx=0x7fe02c0046c0 comp rx=0 tx=0).stop 2024-04-26T23:40:52.219 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.215+0000 7fe0415c1640 1 -- 172.21.15.88:0/3520866958 shutdown_connections 2024-04-26T23:40:52.219 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.215+0000 7fe0415c1640 1 --2- 172.21.15.88:0/3520866958 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fe02806c8f0 0x7fe02806edb0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:52.219 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.215+0000 7fe0415c1640 1 --2- 172.21.15.88:0/3520866958 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe03c154160 0x7fe03c14ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:52.219 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.215+0000 7fe0415c1640 1 --2- 172.21.15.88:0/3520866958 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe03c0ca5a0 0x7fe03c0c4ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:52.220 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.215+0000 7fe0415c1640 1 --2- 172.21.15.88:0/3520866958 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe03c0c6e00 0x7fe03c149d40 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:52.220 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.215+0000 7fe0415c1640 1 -- 172.21.15.88:0/3520866958 >> 172.21.15.88:0/3520866958 conn(0x7fe03c0ae010 msgr2=0x7fe03c0c9590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:40:52.220 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.215+0000 7fe0415c1640 1 -- 172.21.15.88:0/3520866958 shutdown_connections 2024-04-26T23:40:52.220 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.215+0000 7fe0415c1640 1 -- 172.21.15.88:0/3520866958 wait complete. 2024-04-26T23:40:52.229 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get b_data pg_num 2024-04-26T23:40:52.329 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.325+0000 7f4ac8be7640 1 Processor -- start 2024-04-26T23:40:52.329 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.325+0000 7f4ac8be7640 1 -- start start 2024-04-26T23:40:52.331 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.326+0000 7f4ac8be7640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f4ac40ab3f0 0x7f4ac40c4d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:52.332 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.326+0000 7f4ac8be7640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f4ac40c52c0 0x7f4ac41574b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:52.332 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.326+0000 7f4ac8be7640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4ac40c3810 con 0x7f4ac41570d0 2024-04-26T23:40:52.332 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.326+0000 7f4ac8be7640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f4ac40c4330 con 0x7f4ac40c52c0 2024-04-26T23:40:52.332 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.326+0000 7f4ac8be7640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f4ac40c3ab0 con 0x7f4ac40ab3f0 2024-04-26T23:40:52.332 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.326+0000 7f4ac2d9d640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f4ac40c52c0 0x7f4ac41574b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:52.332 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.326+0000 7f4ac259c640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f4ac41570d0 0x7f4ac4150a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:58094/0 (socket says 172.21.15.88:58094) 2024-04-26T23:40:52.332 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.326+0000 7f4ac259c640 1 -- 172.21.15.88:0/1217024011 learned_addr learned my addr 172.21.15.88:0/1217024011 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-26T23:40:52.332 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.326+0000 7f4abbfff640 1 --2- 172.21.15.88:0/1217024011 >> v2:172.21.15.175:3300/0 conn(0x7f4ac40ab3f0 0x7f4ac40c4d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:52.332 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.326+0000 7f4ac2d9d640 1 -- 172.21.15.88:0/1217024011 >> v2:172.21.15.175:3300/0 conn(0x7f4ac40ab3f0 msgr2=0x7f4ac40c4d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:40:52.332 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.326+0000 7f4ac2d9d640 1 --2- 172.21.15.88:0/1217024011 >> v2:172.21.15.175:3300/0 conn(0x7f4ac40ab3f0 0x7f4ac40c4d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:52.332 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.326+0000 7f4ac2d9d640 1 -- 172.21.15.88:0/1217024011 >> v1:172.21.15.88:6789/0 conn(0x7f4ac41570d0 legacy=0x7f4ac4150a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:52.332 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.326+0000 7f4ac2d9d640 1 -- 172.21.15.88:0/1217024011 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ac40c4580 con 0x7f4ac40c52c0 2024-04-26T23:40:52.332 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.326+0000 7f4ac1d9b640 1 -- 172.21.15.88:0/1217024011 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 779531431 0 0) 0x7f4ac40c3810 con 0x7f4ac41570d0 2024-04-26T23:40:52.333 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.327+0000 7f4ac2d9d640 1 --2- 172.21.15.88:0/1217024011 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4ac40c52c0 0x7f4ac41574b0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f4ac40c44b0 tx=0x7f4abc02c770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ef808475ff169c6 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:52.333 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.327+0000 7f4ac1d9b640 1 -- 172.21.15.88:0/1217024011 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4abc038070 con 0x7f4ac40c52c0 2024-04-26T23:40:52.333 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.327+0000 7f4ac1d9b640 1 -- 172.21.15.88:0/1217024011 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4abc007740 con 0x7f4ac40c52c0 2024-04-26T23:40:52.333 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.327+0000 7f4ac1d9b640 1 -- 172.21.15.88:0/1217024011 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4abc007b10 con 0x7f4ac40c52c0 2024-04-26T23:40:52.333 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.327+0000 7f4ac8be7640 1 -- 172.21.15.88:0/1217024011 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4ac40c52c0 msgr2=0x7f4ac41574b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:52.333 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.327+0000 7f4ac8be7640 1 --2- 172.21.15.88:0/1217024011 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4ac40c52c0 0x7f4ac41574b0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f4ac40c44b0 tx=0x7f4abc02c770 comp rx=0 tx=0).stop 2024-04-26T23:40:52.333 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.327+0000 7f4ac8be7640 1 -- 172.21.15.88:0/1217024011 shutdown_connections 2024-04-26T23:40:52.333 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.327+0000 7f4ac8be7640 1 --2- 172.21.15.88:0/1217024011 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4ac40c52c0 0x7f4ac41574b0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:52.333 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.327+0000 7f4ac8be7640 1 --2- 172.21.15.88:0/1217024011 >> v2:172.21.15.175:3300/0 conn(0x7f4ac40ab3f0 0x7f4ac40c4d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:52.333 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.327+0000 7f4ac8be7640 1 -- 172.21.15.88:0/1217024011 >> 172.21.15.88:0/1217024011 conn(0x7f4ac406c310 msgr2=0x7f4ac406c6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:40:52.333 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.327+0000 7f4ac8be7640 1 -- 172.21.15.88:0/1217024011 shutdown_connections 2024-04-26T23:40:52.333 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.327+0000 7f4ac8be7640 1 -- 172.21.15.88:0/1217024011 wait complete. 2024-04-26T23:40:52.337 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.329+0000 7f4ac8be7640 1 Processor -- start 2024-04-26T23:40:52.337 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.329+0000 7f4ac8be7640 1 -- start start 2024-04-26T23:40:52.337 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.329+0000 7f4ac8be7640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4ac40ab3f0 0x7f4ac40c1970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:52.337 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.329+0000 7f4ac8be7640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4ac40c52c0 0x7f4ac4156380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:52.337 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.329+0000 7f4ac8be7640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4ac41570d0 0x7f4ac4149520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:52.337 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.329+0000 7f4ac8be7640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f4ac41512e0 con 0x7f4ac40c52c0 2024-04-26T23:40:52.337 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.329+0000 7f4ac8be7640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f4ac4151160 con 0x7f4ac41570d0 2024-04-26T23:40:52.337 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.329+0000 7f4ac8be7640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f4ac40aba60 con 0x7f4ac40ab3f0 2024-04-26T23:40:52.337 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.329+0000 7f4abbfff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4ac40c52c0 0x7f4ac4156380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:52.337 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.329+0000 7f4abbfff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4ac40c52c0 0x7f4ac4156380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:41770/0 (socket says 172.21.15.88:41770) 2024-04-26T23:40:52.337 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.329+0000 7f4abbfff640 1 -- 172.21.15.88:0/2995081358 learned_addr learned my addr 172.21.15.88:0/2995081358 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:40:52.337 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.330+0000 7f4ac2d9d640 1 --2- 172.21.15.88:0/2995081358 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4ac41570d0 0x7f4ac4149520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:52.338 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.330+0000 7f4ac259c640 1 --2- 172.21.15.88:0/2995081358 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4ac40ab3f0 0x7f4ac40c1970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:52.338 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.330+0000 7f4abbfff640 1 -- 172.21.15.88:0/2995081358 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4ac40ab3f0 msgr2=0x7f4ac40c1970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:52.338 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.330+0000 7f4abbfff640 1 --2- 172.21.15.88:0/2995081358 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4ac40ab3f0 0x7f4ac40c1970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:52.338 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.330+0000 7f4abbfff640 1 -- 172.21.15.88:0/2995081358 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4ac41570d0 msgr2=0x7f4ac4149520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:52.338 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.330+0000 7f4abbfff640 1 --2- 172.21.15.88:0/2995081358 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4ac41570d0 0x7f4ac4149520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:52.338 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.330+0000 7f4abbfff640 1 -- 172.21.15.88:0/2995081358 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ac40ac730 con 0x7f4ac40c52c0 2024-04-26T23:40:52.338 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.330+0000 7f4ac259c640 1 --2- 172.21.15.88:0/2995081358 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4ac40ab3f0 0x7f4ac40c1970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:40:52.338 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.330+0000 7f4abbfff640 1 --2- 172.21.15.88:0/2995081358 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4ac40c52c0 0x7f4ac4156380 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f4aac00d800 tx=0x7f4aac00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:52.338 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.330+0000 7f4abaffd640 1 -- 172.21.15.88:0/2995081358 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4aac00b6c0 con 0x7f4ac40c52c0 2024-04-26T23:40:52.338 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.330+0000 7f4abaffd640 1 -- 172.21.15.88:0/2995081358 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4aac019070 con 0x7f4ac40c52c0 2024-04-26T23:40:52.338 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.330+0000 7f4ac8be7640 1 -- 172.21.15.88:0/2995081358 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ac4156bd0 con 0x7f4ac40c52c0 2024-04-26T23:40:52.338 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.330+0000 7f4abaffd640 1 -- 172.21.15.88:0/2995081358 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4aac00ba80 con 0x7f4ac40c52c0 2024-04-26T23:40:52.338 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.330+0000 7f4ac8be7640 1 -- 172.21.15.88:0/2995081358 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ac4153010 con 0x7f4ac40c52c0 2024-04-26T23:40:52.339 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.331+0000 7f4ac8be7640 1 -- 172.21.15.88:0/2995081358 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ac40c8000 con 0x7f4ac40c52c0 2024-04-26T23:40:52.339 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.331+0000 7f4abaffd640 1 -- 172.21.15.88:0/2995081358 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4aac00bc20 con 0x7f4ac40c52c0 2024-04-26T23:40:52.339 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.332+0000 7f4abaffd640 1 --2- 172.21.15.88:0/2995081358 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f4aa406c920 0x7f4aa406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:52.339 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.332+0000 7f4abaffd640 1 -- 172.21.15.88:0/2995081358 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7f4aac08c280 con 0x7f4ac40c52c0 2024-04-26T23:40:52.339 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.332+0000 7f4ac259c640 1 --2- 172.21.15.88:0/2995081358 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f4aa406c920 0x7f4aa406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:52.339 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.332+0000 7f4ac259c640 1 --2- 172.21.15.88:0/2995081358 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f4aa406c920 0x7f4aa406ede0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f4ab4000f60 tx=0x7f4ab4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:52.339 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.336+0000 7f4abaffd640 1 -- 172.21.15.88:0/2995081358 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f4ac40ac730 con 0x7f4ac40c52c0 2024-04-26T23:40:52.515 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.511+0000 7f4ac8be7640 1 -- 172.21.15.88:0/2995081358 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "b_data", "var": "pg_num"} v 0) -- 0x7f4ac40ab1d0 con 0x7f4ac40c52c0 2024-04-26T23:40:52.515 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.511+0000 7f4abaffd640 1 -- 172.21.15.88:0/2995081358 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "b_data", "var": "pg_num"}]=0 v24) ==== 95+0+11 (secure 0 0 0) 0x7f4aac05a410 con 0x7f4ac40c52c0 2024-04-26T23:40:52.515 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 64 2024-04-26T23:40:52.517 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.513+0000 7f4ac8be7640 1 -- 172.21.15.88:0/2995081358 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f4aa406c920 msgr2=0x7f4aa406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:52.517 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.513+0000 7f4ac8be7640 1 --2- 172.21.15.88:0/2995081358 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f4aa406c920 0x7f4aa406ede0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f4ab4000f60 tx=0x7f4ab4009040 comp rx=0 tx=0).stop 2024-04-26T23:40:52.518 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.513+0000 7f4ac8be7640 1 -- 172.21.15.88:0/2995081358 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4ac40c52c0 msgr2=0x7f4ac4156380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:52.518 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.513+0000 7f4ac8be7640 1 --2- 172.21.15.88:0/2995081358 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4ac40c52c0 0x7f4ac4156380 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f4aac00d800 tx=0x7f4aac00dcc0 comp rx=0 tx=0).stop 2024-04-26T23:40:52.518 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.513+0000 7f4ac8be7640 1 -- 172.21.15.88:0/2995081358 shutdown_connections 2024-04-26T23:40:52.518 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.513+0000 7f4ac8be7640 1 --2- 172.21.15.88:0/2995081358 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f4aa406c920 0x7f4aa406ede0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:52.518 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.513+0000 7f4ac8be7640 1 --2- 172.21.15.88:0/2995081358 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4ac41570d0 0x7f4ac4149520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:52.518 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.513+0000 7f4ac8be7640 1 --2- 172.21.15.88:0/2995081358 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4ac40c52c0 0x7f4ac4156380 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:52.518 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.513+0000 7f4ac8be7640 1 --2- 172.21.15.88:0/2995081358 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4ac40ab3f0 0x7f4ac40c1970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:52.518 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.513+0000 7f4ac8be7640 1 -- 172.21.15.88:0/2995081358 >> 172.21.15.88:0/2995081358 conn(0x7f4ac406c310 msgr2=0x7f4ac40c2bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:40:52.518 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.513+0000 7f4ac8be7640 1 -- 172.21.15.88:0/2995081358 shutdown_connections 2024-04-26T23:40:52.518 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.513+0000 7f4ac8be7640 1 -- 172.21.15.88:0/2995081358 wait complete. 2024-04-26T23:40:52.528 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T23:40:52.623 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.619+0000 7fc97499d640 1 Processor -- start 2024-04-26T23:40:52.623 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.619+0000 7fc97499d640 1 -- start start 2024-04-26T23:40:52.625 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.620+0000 7fc97499d640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fc9700c3060 0x7fc9700720a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:52.625 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.620+0000 7fc97499d640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc9700c40e0 0x7fc970151e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:52.625 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.620+0000 7fc97499d640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc970152360 0x7fc9700c46e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:52.625 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.620+0000 7fc97499d640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7fc970154ba0 con 0x7fc9700c40e0 2024-04-26T23:40:52.625 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.620+0000 7fc97499d640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7fc970154e80 con 0x7fc9700c3060 2024-04-26T23:40:52.625 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.620+0000 7fc97499d640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fc970155160 con 0x7fc970152360 2024-04-26T23:40:52.625 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.620+0000 7fc96dd9b640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc9700c40e0 0x7fc970151e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:52.626 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.620+0000 7fc96dd9b640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc9700c40e0 0x7fc970151e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:41772/0 (socket says 172.21.15.88:41772) 2024-04-26T23:40:52.626 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.620+0000 7fc96dd9b640 1 -- 172.21.15.88:0/1188847162 learned_addr learned my addr 172.21.15.88:0/1188847162 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:40:52.626 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.620+0000 7fc96e59c640 1 --2- 172.21.15.88:0/1188847162 >> v2:172.21.15.175:3300/0 conn(0x7fc9700c3060 0x7fc9700720a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:52.626 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.620+0000 7fc96ed9d640 1 --2- 172.21.15.88:0/1188847162 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc970152360 0x7fc9700c46e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:52.626 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.620+0000 7fc96dd9b640 1 -- 172.21.15.88:0/1188847162 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc970152360 msgr2=0x7fc9700c46e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:40:52.626 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.620+0000 7fc96dd9b640 1 --2- 172.21.15.88:0/1188847162 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc970152360 0x7fc9700c46e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:52.626 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.620+0000 7fc96dd9b640 1 -- 172.21.15.88:0/1188847162 >> v2:172.21.15.175:3300/0 conn(0x7fc9700c3060 msgr2=0x7fc9700720a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:40:52.626 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.620+0000 7fc96dd9b640 1 --2- 172.21.15.88:0/1188847162 >> v2:172.21.15.175:3300/0 conn(0x7fc9700c3060 0x7fc9700720a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:52.626 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.620+0000 7fc96dd9b640 1 -- 172.21.15.88:0/1188847162 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc970155440 con 0x7fc9700c40e0 2024-04-26T23:40:52.626 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.621+0000 7fc96dd9b640 1 --2- 172.21.15.88:0/1188847162 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc9700c40e0 0x7fc970151e20 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fc97006d280 tx=0x7fc96402a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e9efce2b55eaa46 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:52.626 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.621+0000 7fc96d59a640 1 -- 172.21.15.88:0/1188847162 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc964037070 con 0x7fc9700c40e0 2024-04-26T23:40:52.626 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.621+0000 7fc96d59a640 1 -- 172.21.15.88:0/1188847162 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc964032440 con 0x7fc9700c40e0 2024-04-26T23:40:52.626 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.621+0000 7fc96d59a640 1 -- 172.21.15.88:0/1188847162 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc964032810 con 0x7fc9700c40e0 2024-04-26T23:40:52.629 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.622+0000 7fc97499d640 1 -- 172.21.15.88:0/1188847162 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc9700c40e0 msgr2=0x7fc970151e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:52.630 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.622+0000 7fc97499d640 1 --2- 172.21.15.88:0/1188847162 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc9700c40e0 0x7fc970151e20 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fc97006d280 tx=0x7fc96402a140 comp rx=0 tx=0).stop 2024-04-26T23:40:52.630 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.622+0000 7fc97499d640 1 -- 172.21.15.88:0/1188847162 shutdown_connections 2024-04-26T23:40:52.630 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.622+0000 7fc97499d640 1 --2- 172.21.15.88:0/1188847162 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc970152360 0x7fc9700c46e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:52.630 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.622+0000 7fc97499d640 1 --2- 172.21.15.88:0/1188847162 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc9700c40e0 0x7fc970151e20 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:52.630 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.622+0000 7fc97499d640 1 --2- 172.21.15.88:0/1188847162 >> v2:172.21.15.175:3300/0 conn(0x7fc9700c3060 0x7fc9700720a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:52.630 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.622+0000 7fc97499d640 1 -- 172.21.15.88:0/1188847162 >> 172.21.15.88:0/1188847162 conn(0x7fc97006c310 msgr2=0x7fc97006c6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:40:52.630 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.622+0000 7fc97499d640 1 -- 172.21.15.88:0/1188847162 shutdown_connections 2024-04-26T23:40:52.630 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.622+0000 7fc97499d640 1 -- 172.21.15.88:0/1188847162 wait complete. 2024-04-26T23:40:52.630 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.623+0000 7fc97499d640 1 Processor -- start 2024-04-26T23:40:52.630 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.623+0000 7fc97499d640 1 -- start start 2024-04-26T23:40:52.630 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.624+0000 7fc97499d640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc9700c3060 0x7fc9701e98b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:52.630 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.624+0000 7fc97499d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc9700c40e0 0x7fc970150fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:52.630 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.624+0000 7fc97499d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc970152360 0x7fc97014e150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:52.631 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.624+0000 7fc97499d640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fc9700c3440 con 0x7fc970152360 2024-04-26T23:40:52.631 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.624+0000 7fc97499d640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc9700c3aa0 con 0x7fc9700c40e0 2024-04-26T23:40:52.631 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.624+0000 7fc97499d640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fc9700c35c0 con 0x7fc9700c3060 2024-04-26T23:40:52.631 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.624+0000 7fc96ed9d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc970152360 0x7fc97014e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:52.631 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.624+0000 7fc96ed9d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc970152360 0x7fc97014e150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:41784/0 (socket says 172.21.15.88:41784) 2024-04-26T23:40:52.631 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.624+0000 7fc96ed9d640 1 -- 172.21.15.88:0/1228365638 learned_addr learned my addr 172.21.15.88:0/1228365638 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:40:52.631 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.624+0000 7fc96ed9d640 1 -- 172.21.15.88:0/1228365638 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc9700c3060 msgr2=0x7fc9701e98b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:52.631 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.624+0000 7fc96ed9d640 1 --2- 172.21.15.88:0/1228365638 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc9700c3060 0x7fc9701e98b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:52.631 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.624+0000 7fc96ed9d640 1 -- 172.21.15.88:0/1228365638 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc9700c40e0 msgr2=0x7fc970150fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:52.631 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.624+0000 7fc96ed9d640 1 --2- 172.21.15.88:0/1228365638 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc9700c40e0 0x7fc970150fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:52.631 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.624+0000 7fc96ed9d640 1 -- 172.21.15.88:0/1228365638 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9700c1950 con 0x7fc970152360 2024-04-26T23:40:52.631 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.624+0000 7fc96ed9d640 1 --2- 172.21.15.88:0/1228365638 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc970152360 0x7fc97014e150 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fc968007e70 tx=0x7fc96800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:52.631 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.624+0000 7fc95effd640 1 -- 172.21.15.88:0/1228365638 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc968014420 con 0x7fc970152360 2024-04-26T23:40:52.631 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.624+0000 7fc95effd640 1 -- 172.21.15.88:0/1228365638 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc968019070 con 0x7fc970152360 2024-04-26T23:40:52.631 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.624+0000 7fc97499d640 1 -- 172.21.15.88:0/1228365638 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9701ef7e0 con 0x7fc970152360 2024-04-26T23:40:52.632 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.624+0000 7fc95effd640 1 -- 172.21.15.88:0/1228365638 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc968014800 con 0x7fc970152360 2024-04-26T23:40:52.632 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.624+0000 7fc97499d640 1 -- 172.21.15.88:0/1228365638 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc97014dc30 con 0x7fc970152360 2024-04-26T23:40:52.632 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.625+0000 7fc97499d640 1 -- 172.21.15.88:0/1228365638 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc9700507a0 con 0x7fc970152360 2024-04-26T23:40:52.632 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.626+0000 7fc95effd640 1 -- 172.21.15.88:0/1228365638 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc9680149a0 con 0x7fc970152360 2024-04-26T23:40:52.632 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.626+0000 7fc95effd640 1 --2- 172.21.15.88:0/1228365638 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fc95006c920 0x7fc95006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:52.632 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.626+0000 7fc96e59c640 1 --2- 172.21.15.88:0/1228365638 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fc95006c920 0x7fc95006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:52.633 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.626+0000 7fc95effd640 1 -- 172.21.15.88:0/1228365638 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7fc96808c640 con 0x7fc970152360 2024-04-26T23:40:52.633 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.627+0000 7fc96e59c640 1 --2- 172.21.15.88:0/1228365638 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fc95006c920 0x7fc95006ede0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fc96000b7f0 tx=0x7fc960008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:52.634 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.630+0000 7fc95effd640 1 -- 172.21.15.88:0/1228365638 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fc96805a7d0 con 0x7fc970152360 2024-04-26T23:40:52.848 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.844+0000 7fc97499d640 1 -- 172.21.15.88:0/1228365638 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc9701e9df0 con 0x7fc970152360 2024-04-26T23:40:52.848 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.844+0000 7fc95effd640 1 -- 172.21.15.88:0/1228365638 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+6488 (secure 0 0 0) 0x7fc96805a0d0 con 0x7fc970152360 2024-04-26T23:40:52.849 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-26T23:40:52.849 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":12,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6834/3199540397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":3199540397},{"type":"v1","addr":"172.21.15.175:6834","nonce":3199540397}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4270,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6837/2790134952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6835","nonce":2790134952},{"type":"v1","addr":"172.21.15.88:6837","nonce":2790134952}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T23:40:31.909505+0000","modified":"2024-04-26T23:40:34.974455+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4279},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4279":{"gid":4279,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.175:6835/3932058274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6833","nonce":3932058274},{"type":"v1","addr":"172.21.15.175:6835","nonce":3932058274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4279,"qdb_cluster":[4279]},"id":1},{"mdsmap":{"epoch":12,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T23:40:41.008364+0000","modified":"2024-04-26T23:40:44.027288+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4272":{"gid":4272,"name":"c","rank":0,"incarnation":9,"state":"up:active","state_seq":6,"addr":"172.21.15.88:6836/4159390276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6834","nonce":4159390276},{"type":"v1","addr":"172.21.15.88:6836","nonce":4159390276}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4272,"qdb_cluster":[4272]},"id":2}]} 2024-04-26T23:40:52.849 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 12 2024-04-26T23:40:52.851 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.847+0000 7fc97499d640 1 -- 172.21.15.88:0/1228365638 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fc95006c920 msgr2=0x7fc95006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:52.851 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.847+0000 7fc97499d640 1 --2- 172.21.15.88:0/1228365638 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fc95006c920 0x7fc95006ede0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fc96000b7f0 tx=0x7fc960008040 comp rx=0 tx=0).stop 2024-04-26T23:40:52.851 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.847+0000 7fc97499d640 1 -- 172.21.15.88:0/1228365638 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc970152360 msgr2=0x7fc97014e150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:52.851 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.847+0000 7fc97499d640 1 --2- 172.21.15.88:0/1228365638 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc970152360 0x7fc97014e150 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fc968007e70 tx=0x7fc96800e4b0 comp rx=0 tx=0).stop 2024-04-26T23:40:52.851 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.847+0000 7fc97499d640 1 -- 172.21.15.88:0/1228365638 shutdown_connections 2024-04-26T23:40:52.851 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.847+0000 7fc97499d640 1 --2- 172.21.15.88:0/1228365638 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fc95006c920 0x7fc95006ede0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:52.851 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.847+0000 7fc97499d640 1 --2- 172.21.15.88:0/1228365638 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc970152360 0x7fc97014e150 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:52.851 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.847+0000 7fc97499d640 1 --2- 172.21.15.88:0/1228365638 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc9700c40e0 0x7fc970150fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:52.852 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.847+0000 7fc97499d640 1 --2- 172.21.15.88:0/1228365638 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc9700c3060 0x7fc9701e98b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:52.852 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.847+0000 7fc97499d640 1 -- 172.21.15.88:0/1228365638 >> 172.21.15.88:0/1228365638 conn(0x7fc97006c310 msgr2=0x7fc97014a3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:40:52.852 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.847+0000 7fc97499d640 1 -- 172.21.15.88:0/1228365638 shutdown_connections 2024-04-26T23:40:52.852 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.847+0000 7fc97499d640 1 -- 172.21.15.88:0/1228365638 wait complete. 2024-04-26T23:40:52.862 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T23:40:52.958 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.954+0000 7fa13342a640 1 Processor -- start 2024-04-26T23:40:52.958 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.955+0000 7fa13342a640 1 -- start start 2024-04-26T23:40:52.960 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.955+0000 7fa13342a640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa12c13feb0 0x7fa12c1576d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:52.960 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.955+0000 7fa13342a640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa12c156c10 con 0x7fa12c0c5050 2024-04-26T23:40:52.960 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.955+0000 7fa13342a640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa12c0c5570 con 0x7fa12c0c2b80 2024-04-26T23:40:52.960 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.955+0000 7fa13342a640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7fa12c15a8b0 con 0x7fa12c13feb0 2024-04-26T23:40:52.960 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.955+0000 7fa1311c6640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa12c13feb0 0x7fa12c1576d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:52.960 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.956+0000 7fa1309c5640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fa12c0c5050 0x7fa12c15a1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:58102/0 (socket says 172.21.15.88:58102) 2024-04-26T23:40:52.960 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.956+0000 7fa1309c5640 1 -- 172.21.15.88:0/28263312 learned_addr learned my addr 172.21.15.88:0/28263312 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-26T23:40:52.960 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.956+0000 7fa1311c6640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa12c13feb0 0x7fa12c1576d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:41794/0 (socket says 172.21.15.88:41794) 2024-04-26T23:40:52.960 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.956+0000 7fa1311c6640 1 -- 172.21.15.88:0/28263312 >> v1:172.21.15.175:6789/0 conn(0x7fa12c0c2b80 legacy=0x7fa12c06d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:52.960 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.956+0000 7fa1311c6640 1 -- 172.21.15.88:0/28263312 >> v1:172.21.15.88:6789/0 conn(0x7fa12c0c5050 legacy=0x7fa12c15a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:52.960 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.956+0000 7fa1311c6640 1 -- 172.21.15.88:0/28263312 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa12c0c5850 con 0x7fa12c13feb0 2024-04-26T23:40:52.961 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.956+0000 7fa1311c6640 1 --2- 172.21.15.88:0/28263312 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa12c13feb0 0x7fa12c1576d0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fa1280097a0 tx=0x7fa12802a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76259347e13c2c3f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:52.962 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.957+0000 7fa11ffff640 1 -- 172.21.15.88:0/28263312 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa128037070 con 0x7fa12c13feb0 2024-04-26T23:40:52.962 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.957+0000 7fa11ffff640 1 -- 172.21.15.88:0/28263312 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa128032440 con 0x7fa12c13feb0 2024-04-26T23:40:52.962 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.957+0000 7fa11ffff640 1 -- 172.21.15.88:0/28263312 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa12802ae60 con 0x7fa12c13feb0 2024-04-26T23:40:52.962 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.957+0000 7fa13342a640 1 -- 172.21.15.88:0/28263312 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa12c13feb0 msgr2=0x7fa12c1576d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:52.962 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.957+0000 7fa13342a640 1 --2- 172.21.15.88:0/28263312 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa12c13feb0 0x7fa12c1576d0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fa1280097a0 tx=0x7fa12802a110 comp rx=0 tx=0).stop 2024-04-26T23:40:52.962 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.957+0000 7fa13342a640 1 -- 172.21.15.88:0/28263312 shutdown_connections 2024-04-26T23:40:52.962 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.957+0000 7fa13342a640 1 --2- 172.21.15.88:0/28263312 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa12c13feb0 0x7fa12c1576d0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:52.962 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.957+0000 7fa13342a640 1 -- 172.21.15.88:0/28263312 >> 172.21.15.88:0/28263312 conn(0x7fa12c0c5ce0 msgr2=0x7fa12c0c60c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:40:52.962 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.957+0000 7fa13342a640 1 -- 172.21.15.88:0/28263312 shutdown_connections 2024-04-26T23:40:52.962 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.957+0000 7fa13342a640 1 -- 172.21.15.88:0/28263312 wait complete. 2024-04-26T23:40:52.965 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.958+0000 7fa13342a640 1 Processor -- start 2024-04-26T23:40:52.965 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.958+0000 7fa13342a640 1 -- start start 2024-04-26T23:40:52.965 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.959+0000 7fa13342a640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa12c0c2b80 0x7fa12c0c82a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:52.965 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.959+0000 7fa13342a640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa12c0c5050 0x7fa12c13c580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:52.966 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.959+0000 7fa13342a640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa12c13feb0 0x7fa12c13cac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:52.966 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.959+0000 7fa13342a640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fa12c06da30 con 0x7fa12c0c2b80 2024-04-26T23:40:52.966 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.959+0000 7fa13342a640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fa12c157240 con 0x7fa12c0c5050 2024-04-26T23:40:52.966 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.959+0000 7fa13342a640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fa12c06dbb0 con 0x7fa12c13feb0 2024-04-26T23:40:52.966 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.959+0000 7fa1311c6640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa12c0c2b80 0x7fa12c0c82a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:52.966 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.959+0000 7fa1311c6640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa12c0c2b80 0x7fa12c0c82a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:41802/0 (socket says 172.21.15.88:41802) 2024-04-26T23:40:52.966 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.959+0000 7fa1311c6640 1 -- 172.21.15.88:0/2511720175 learned_addr learned my addr 172.21.15.88:0/2511720175 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:40:52.966 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.959+0000 7fa1311c6640 1 -- 172.21.15.88:0/2511720175 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa12c13feb0 msgr2=0x7fa12c13cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:52.966 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.959+0000 7fa1309c5640 1 --2- 172.21.15.88:0/2511720175 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa12c0c5050 0x7fa12c13c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:52.966 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.959+0000 7fa1319c7640 1 --2- 172.21.15.88:0/2511720175 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa12c13feb0 0x7fa12c13cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:52.966 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.959+0000 7fa1311c6640 1 --2- 172.21.15.88:0/2511720175 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa12c13feb0 0x7fa12c13cac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:52.966 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.959+0000 7fa1311c6640 1 -- 172.21.15.88:0/2511720175 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa12c0c5050 msgr2=0x7fa12c13c580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:52.966 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.959+0000 7fa1311c6640 1 --2- 172.21.15.88:0/2511720175 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa12c0c5050 0x7fa12c13c580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:52.966 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.959+0000 7fa1311c6640 1 -- 172.21.15.88:0/2511720175 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa12c1f0310 con 0x7fa12c0c2b80 2024-04-26T23:40:52.966 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.959+0000 7fa1309c5640 1 --2- 172.21.15.88:0/2511720175 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa12c0c5050 0x7fa12c13c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:40:52.967 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.959+0000 7fa1319c7640 1 --2- 172.21.15.88:0/2511720175 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa12c13feb0 0x7fa12c13cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:40:52.967 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.959+0000 7fa1311c6640 1 --2- 172.21.15.88:0/2511720175 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa12c0c2b80 0x7fa12c0c82a0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fa1280098c0 tx=0x7fa1280046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:52.967 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.959+0000 7fa11dffb640 1 -- 172.21.15.88:0/2511720175 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa128037040 con 0x7fa12c0c2b80 2024-04-26T23:40:52.967 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.960+0000 7fa11dffb640 1 -- 172.21.15.88:0/2511720175 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa128042070 con 0x7fa12c0c2b80 2024-04-26T23:40:52.967 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.960+0000 7fa13342a640 1 -- 172.21.15.88:0/2511720175 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa12c06d130 con 0x7fa12c0c2b80 2024-04-26T23:40:52.967 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.960+0000 7fa11dffb640 1 -- 172.21.15.88:0/2511720175 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa128030c90 con 0x7fa12c0c2b80 2024-04-26T23:40:52.967 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.960+0000 7fa13342a640 1 -- 172.21.15.88:0/2511720175 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa12c0ae1f0 con 0x7fa12c0c2b80 2024-04-26T23:40:52.967 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.961+0000 7fa13342a640 1 -- 172.21.15.88:0/2511720175 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa12c0507a0 con 0x7fa12c0c2b80 2024-04-26T23:40:52.967 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.961+0000 7fa11dffb640 1 -- 172.21.15.88:0/2511720175 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa128047460 con 0x7fa12c0c2b80 2024-04-26T23:40:52.967 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.961+0000 7fa11dffb640 1 --2- 172.21.15.88:0/2511720175 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fa11006c8f0 0x7fa11006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:52.967 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.962+0000 7fa11dffb640 1 -- 172.21.15.88:0/2511720175 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7fa1280acab0 con 0x7fa12c0c2b80 2024-04-26T23:40:52.967 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.962+0000 7fa1309c5640 1 --2- 172.21.15.88:0/2511720175 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fa11006c8f0 0x7fa11006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:52.968 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.962+0000 7fa1309c5640 1 --2- 172.21.15.88:0/2511720175 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fa11006c8f0 0x7fa11006edb0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fa12c0ae920 tx=0x7fa120009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:52.970 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:52.966+0000 7fa11dffb640 1 -- 172.21.15.88:0/2511720175 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fa12807ac40 con 0x7fa12c0c2b80 2024-04-26T23:40:53.143 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:53.140+0000 7fa13342a640 1 -- 172.21.15.88:0/2511720175 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa12c0726b0 con 0x7fa12c0c2b80 2024-04-26T23:40:53.145 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:53.141+0000 7fa11dffb640 1 -- 172.21.15.88:0/2511720175 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+20343 (secure 0 0 0) 0x7fa12807a540 con 0x7fa12c0c2b80 2024-04-26T23:40:53.145 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-26T23:40:53.146 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":24,"fsid":"555255e9-7ef9-4454-8dc9-35e96b70035c","created":"2024-04-26T23:40:07.836009+0000","modified":"2024-04-26T23:40:42.673801+0000","last_up_change":"2024-04-26T23:40:18.831369+0000","last_in_change":"2024-04-26T23:40:09.944777+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T23:40:19.936127+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"a_metadata","create_time":"2024-04-26T23:40:29.837465+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"a_data","create_time":"2024-04-26T23:40:30.868651+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"b_metadata","create_time":"2024-04-26T23:40:38.753441+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"b_data","create_time":"2024-04-26T23:40:39.974557+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"92aecea3-ed62-4a29-87c0-76758a0816a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":2803186054},{"type":"v1","addr":"172.21.15.88:6801","nonce":2803186054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":2803186054},{"type":"v1","addr":"172.21.15.88:6803","nonce":2803186054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":2803186054},{"type":"v1","addr":"172.21.15.88:6807","nonce":2803186054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":2803186054},{"type":"v1","addr":"172.21.15.88:6805","nonce":2803186054}]},"public_addr":"172.21.15.88:6801/2803186054","cluster_addr":"172.21.15.88:6803/2803186054","heartbeat_back_addr":"172.21.15.88:6807/2803186054","heartbeat_front_addr":"172.21.15.88:6805/2803186054","state":["exists","up"]},{"osd":1,"uuid":"7a6f0fa9-23d0-4747-880f-798d45ec5eeb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":1897380484},{"type":"v1","addr":"172.21.15.88:6817","nonce":1897380484}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":1897380484},{"type":"v1","addr":"172.21.15.88:6819","nonce":1897380484}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1897380484},{"type":"v1","addr":"172.21.15.88:6823","nonce":1897380484}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":1897380484},{"type":"v1","addr":"172.21.15.88:6821","nonce":1897380484}]},"public_addr":"172.21.15.88:6817/1897380484","cluster_addr":"172.21.15.88:6819/1897380484","heartbeat_back_addr":"172.21.15.88:6823/1897380484","heartbeat_front_addr":"172.21.15.88:6821/1897380484","state":["exists","up"]},{"osd":2,"uuid":"6be88ea0-e133-4200-a4b5-f92d664b248a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":648396269},{"type":"v1","addr":"172.21.15.88:6809","nonce":648396269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":648396269},{"type":"v1","addr":"172.21.15.88:6811","nonce":648396269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":648396269},{"type":"v1","addr":"172.21.15.88:6815","nonce":648396269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":648396269},{"type":"v1","addr":"172.21.15.88:6813","nonce":648396269}]},"public_addr":"172.21.15.88:6809/648396269","cluster_addr":"172.21.15.88:6811/648396269","heartbeat_back_addr":"172.21.15.88:6815/648396269","heartbeat_front_addr":"172.21.15.88:6813/648396269","state":["exists","up"]},{"osd":3,"uuid":"dcb0746b-7b3d-4ecf-8089-2493a5d1857c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":2328028922},{"type":"v1","addr":"172.21.15.88:6825","nonce":2328028922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":2328028922},{"type":"v1","addr":"172.21.15.88:6827","nonce":2328028922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":2328028922},{"type":"v1","addr":"172.21.15.88:6831","nonce":2328028922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":2328028922},{"type":"v1","addr":"172.21.15.88:6829","nonce":2328028922}]},"public_addr":"172.21.15.88:6825/2328028922","cluster_addr":"172.21.15.88:6827/2328028922","heartbeat_back_addr":"172.21.15.88:6831/2328028922","heartbeat_front_addr":"172.21.15.88:6829/2328028922","state":["exists","up"]},{"osd":4,"uuid":"c483de66-c44f-450e-a4ce-b132d50882c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":3929617402},{"type":"v1","addr":"172.21.15.175:6809","nonce":3929617402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":3929617402},{"type":"v1","addr":"172.21.15.175:6811","nonce":3929617402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":3929617402},{"type":"v1","addr":"172.21.15.175:6815","nonce":3929617402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":3929617402},{"type":"v1","addr":"172.21.15.175:6813","nonce":3929617402}]},"public_addr":"172.21.15.175:6809/3929617402","cluster_addr":"172.21.15.175:6811/3929617402","heartbeat_back_addr":"172.21.15.175:6815/3929617402","heartbeat_front_addr":"172.21.15.175:6813/3929617402","state":["exists","up"]},{"osd":5,"uuid":"ac3b1669-d228-40dd-9f9a-cb46aa73dd6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":2476644457},{"type":"v1","addr":"172.21.15.175:6801","nonce":2476644457}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":2476644457},{"type":"v1","addr":"172.21.15.175:6803","nonce":2476644457}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":2476644457},{"type":"v1","addr":"172.21.15.175:6807","nonce":2476644457}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":2476644457},{"type":"v1","addr":"172.21.15.175:6805","nonce":2476644457}]},"public_addr":"172.21.15.175:6801/2476644457","cluster_addr":"172.21.15.175:6803/2476644457","heartbeat_back_addr":"172.21.15.175:6807/2476644457","heartbeat_front_addr":"172.21.15.175:6805/2476644457","state":["exists","up"]},{"osd":6,"uuid":"7bef4896-857e-4c11-b3b2-c2e9a8548338","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":3824112919},{"type":"v1","addr":"172.21.15.175:6819","nonce":3824112919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6821","nonce":3824112919},{"type":"v1","addr":"172.21.15.175:6824","nonce":3824112919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":3824112919},{"type":"v1","addr":"172.21.15.175:6831","nonce":3824112919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":3824112919},{"type":"v1","addr":"172.21.15.175:6829","nonce":3824112919}]},"public_addr":"172.21.15.175:6819/3824112919","cluster_addr":"172.21.15.175:6824/3824112919","heartbeat_back_addr":"172.21.15.175:6831/3824112919","heartbeat_front_addr":"172.21.15.175:6829/3824112919","state":["exists","up"]},{"osd":7,"uuid":"e18d9e09-8673-470d-b9dc-280a409b63f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6817","nonce":3319361162},{"type":"v1","addr":"172.21.15.175:6818","nonce":3319361162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":3319361162},{"type":"v1","addr":"172.21.15.175:6822","nonce":3319361162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6827","nonce":3319361162},{"type":"v1","addr":"172.21.15.175:6828","nonce":3319361162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6823","nonce":3319361162},{"type":"v1","addr":"172.21.15.175:6825","nonce":3319361162}]},"public_addr":"172.21.15.175:6818/3319361162","cluster_addr":"172.21.15.175:6822/3319361162","heartbeat_back_addr":"172.21.15.175:6828/3319361162","heartbeat_front_addr":"172.21.15.175:6825/3319361162","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:40:15.126268+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:40:15.050614+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:40:14.995164+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:40:15.078112+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:40:15.159637+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:40:15.091226+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:40:15.140316+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:40:15.089431+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:40:53.147 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:53.143+0000 7fa13342a640 1 -- 172.21.15.88:0/2511720175 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fa11006c8f0 msgr2=0x7fa11006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:53.147 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:53.143+0000 7fa13342a640 1 --2- 172.21.15.88:0/2511720175 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fa11006c8f0 0x7fa11006edb0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fa12c0ae920 tx=0x7fa120009040 comp rx=0 tx=0).stop 2024-04-26T23:40:53.148 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:53.143+0000 7fa13342a640 1 -- 172.21.15.88:0/2511720175 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa12c0c2b80 msgr2=0x7fa12c0c82a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:53.148 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:53.143+0000 7fa13342a640 1 --2- 172.21.15.88:0/2511720175 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa12c0c2b80 0x7fa12c0c82a0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fa1280098c0 tx=0x7fa1280046c0 comp rx=0 tx=0).stop 2024-04-26T23:40:53.148 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:53.143+0000 7fa13342a640 1 -- 172.21.15.88:0/2511720175 shutdown_connections 2024-04-26T23:40:53.148 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:53.143+0000 7fa13342a640 1 --2- 172.21.15.88:0/2511720175 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fa11006c8f0 0x7fa11006edb0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:53.148 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:53.143+0000 7fa13342a640 1 --2- 172.21.15.88:0/2511720175 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa12c13feb0 0x7fa12c13cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:53.148 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:53.143+0000 7fa13342a640 1 --2- 172.21.15.88:0/2511720175 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa12c0c5050 0x7fa12c13c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:53.148 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:53.143+0000 7fa13342a640 1 --2- 172.21.15.88:0/2511720175 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa12c0c2b80 0x7fa12c0c82a0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:53.148 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:53.143+0000 7fa13342a640 1 -- 172.21.15.88:0/2511720175 >> 172.21.15.88:0/2511720175 conn(0x7fa12c0c5ce0 msgr2=0x7fa12c13dd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:40:53.148 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:53.143+0000 7fa13342a640 1 -- 172.21.15.88:0/2511720175 shutdown_connections 2024-04-26T23:40:53.148 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:53.143+0000 7fa13342a640 1 -- 172.21.15.88:0/2511720175 wait complete. 2024-04-26T23:40:53.158 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T23:40:19.936127+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'a_metadata', 'create_time': '2024-04-26T23:40:29.837465+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'a'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'a_data', 'create_time': '2024-04-26T23:40:30.868651+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'a'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'b_metadata', 'create_time': '2024-04-26T23:40:38.753441+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'b'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'b_data', 'create_time': '2024-04-26T23:40:39.974557+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'b'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T23:40:53.159 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T23:40:53.259 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:53.255+0000 7f083aecf640 1 Processor -- start 2024-04-26T23:40:53.259 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:53.255+0000 7f083aecf640 1 -- start start 2024-04-26T23:40:53.261 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:53.256+0000 7f083aecf640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f08340c4160 0x7f083406d320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:53.261 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:53.256+0000 7f083aecf640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f083406d860 0x7f083415e400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:53.261 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:53.256+0000 7f083aecf640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f08340c4b50 con 0x7f08341510c0 2024-04-26T23:40:53.261 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:53.256+0000 7f083aecf640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f08340c50d0 con 0x7f083406d860 2024-04-26T23:40:53.261 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:53.256+0000 7f083aecf640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f08341514a0 con 0x7f08340c4160 2024-04-26T23:40:53.261 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:53.256+0000 7f083946c640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f083406d860 0x7f083415e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:53.261 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:53.256+0000 7f0838c6b640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f08341510c0 0x7f0834072f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:58118/0 (socket says 172.21.15.88:58118) 2024-04-26T23:40:53.261 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:53.256+0000 7f0838c6b640 1 -- 172.21.15.88:0/1488889307 learned_addr learned my addr 172.21.15.88:0/1488889307 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-26T23:40:53.262 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:53.256+0000 7f0833fff640 1 --2- 172.21.15.88:0/1488889307 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f08340c4160 0x7f083406d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:53.262 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:53.256+0000 7f083946c640 1 -- 172.21.15.88:0/1488889307 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f08340c4160 msgr2=0x7f083406d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:40:53.262 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:53.257+0000 7f083946c640 1 --2- 172.21.15.88:0/1488889307 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f08340c4160 0x7f083406d320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:53.262 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:53.257+0000 7f083946c640 1 -- 172.21.15.88:0/1488889307 >> v1:172.21.15.88:6789/0 conn(0x7f08341510c0 legacy=0x7f0834072f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:53.262 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:53.257+0000 7f083946c640 1 -- 172.21.15.88:0/1488889307 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08340736a0 con 0x7f083406d860 2024-04-26T23:40:53.262 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:53.257+0000 7f08337fe640 1 -- 172.21.15.88:0/1488889307 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2567295802 0 0) 0x7f08340c4b50 con 0x7f08341510c0 2024-04-26T23:40:53.262 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:53.257+0000 7f083946c640 1 --2- 172.21.15.88:0/1488889307 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f083406d860 0x7f083415e400 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f082c009d90 tx=0x7f082c02a530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73913cfcba3318a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:53.262 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:53.257+0000 7f08337fe640 1 -- 172.21.15.88:0/1488889307 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f082c007740 con 0x7f083406d860 2024-04-26T23:40:53.262 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:53.257+0000 7f08337fe640 1 -- 172.21.15.88:0/1488889307 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f082c0078e0 con 0x7f083406d860 2024-04-26T23:40:53.262 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:53.257+0000 7f08337fe640 1 -- 172.21.15.88:0/1488889307 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f082c007cb0 con 0x7f083406d860 2024-04-26T23:40:53.265 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:53.258+0000 7f083aecf640 1 -- 172.21.15.88:0/1488889307 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f083406d860 msgr2=0x7f083415e400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:53.265 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:53.258+0000 7f083aecf640 1 --2- 172.21.15.88:0/1488889307 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f083406d860 0x7f083415e400 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f082c009d90 tx=0x7f082c02a530 comp rx=0 tx=0).stop 2024-04-26T23:40:53.265 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:53.258+0000 7f083aecf640 1 -- 172.21.15.88:0/1488889307 shutdown_connections 2024-04-26T23:40:53.265 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:53.258+0000 7f083aecf640 1 --2- 172.21.15.88:0/1488889307 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f083406d860 0x7f083415e400 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:53.266 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:53.258+0000 7f083aecf640 1 --2- 172.21.15.88:0/1488889307 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f08340c4160 0x7f083406d320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:53.266 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:53.258+0000 7f083aecf640 1 -- 172.21.15.88:0/1488889307 >> 172.21.15.88:0/1488889307 conn(0x7f08340c5ce0 msgr2=0x7f08340c60f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:40:53.266 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:53.258+0000 7f083aecf640 1 -- 172.21.15.88:0/1488889307 shutdown_connections 2024-04-26T23:40:53.266 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:53.258+0000 7f083aecf640 1 -- 172.21.15.88:0/1488889307 wait complete. 2024-04-26T23:40:53.266 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:53.259+0000 7f083aecf640 1 Processor -- start 2024-04-26T23:40:53.266 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:53.259+0000 7f083aecf640 1 -- start start 2024-04-26T23:40:53.266 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:53.260+0000 7f083aecf640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f083406d860 0x7f08340c7250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:53.266 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:53.260+0000 7f083aecf640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f08340c4160 0x7f0834155d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:53.266 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:53.260+0000 7f083aecf640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f08341510c0 0x7f083413ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:53.266 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:53.260+0000 7f083aecf640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f08340c5400 con 0x7f08340c4160 2024-04-26T23:40:53.266 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:53.260+0000 7f083aecf640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f08340c4df0 con 0x7f08341510c0 2024-04-26T23:40:53.266 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:53.260+0000 7f083aecf640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f08340c5920 con 0x7f083406d860 2024-04-26T23:40:53.266 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:53.260+0000 7f0833fff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f08340c4160 0x7f0834155d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:53.267 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:53.260+0000 7f0833fff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f08340c4160 0x7f0834155d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:41812/0 (socket says 172.21.15.88:41812) 2024-04-26T23:40:53.267 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:53.260+0000 7f0833fff640 1 -- 172.21.15.88:0/2709391588 learned_addr learned my addr 172.21.15.88:0/2709391588 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:40:53.267 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:53.260+0000 7f083946c640 1 --2- 172.21.15.88:0/2709391588 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f08341510c0 0x7f083413ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:53.267 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:53.260+0000 7f0838c6b640 1 --2- 172.21.15.88:0/2709391588 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f083406d860 0x7f08340c7250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:53.267 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:53.260+0000 7f0833fff640 1 -- 172.21.15.88:0/2709391588 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f083406d860 msgr2=0x7f08340c7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:53.267 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:53.260+0000 7f0833fff640 1 --2- 172.21.15.88:0/2709391588 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f083406d860 0x7f08340c7250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:53.267 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:53.260+0000 7f0833fff640 1 -- 172.21.15.88:0/2709391588 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f08341510c0 msgr2=0x7f083413ef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:53.267 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:53.260+0000 7f0833fff640 1 --2- 172.21.15.88:0/2709391588 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f08341510c0 0x7f083413ef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:53.267 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:53.260+0000 7f0833fff640 1 -- 172.21.15.88:0/2709391588 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08341ee5b0 con 0x7f08340c4160 2024-04-26T23:40:53.267 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:53.260+0000 7f0833fff640 1 --2- 172.21.15.88:0/2709391588 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f08340c4160 0x7f0834155d90 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f082800d800 tx=0x7f082800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:53.267 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:53.260+0000 7f08317fa640 1 -- 172.21.15.88:0/2709391588 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f082800b6c0 con 0x7f08340c4160 2024-04-26T23:40:53.267 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:53.260+0000 7f08317fa640 1 -- 172.21.15.88:0/2709391588 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0828019070 con 0x7f08340c4160 2024-04-26T23:40:53.267 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:53.260+0000 7f083aecf640 1 -- 172.21.15.88:0/2709391588 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f083413e760 con 0x7f08340c4160 2024-04-26T23:40:53.267 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:53.260+0000 7f08317fa640 1 -- 172.21.15.88:0/2709391588 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f082800ba80 con 0x7f08340c4160 2024-04-26T23:40:53.267 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:53.261+0000 7f083aecf640 1 -- 172.21.15.88:0/2709391588 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08341562d0 con 0x7f08340c4160 2024-04-26T23:40:53.267 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:53.262+0000 7f083aecf640 1 -- 172.21.15.88:0/2709391588 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f08340507a0 con 0x7f08340c4160 2024-04-26T23:40:53.268 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:53.262+0000 7f08317fa640 1 -- 172.21.15.88:0/2709391588 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f082800bc20 con 0x7f08340c4160 2024-04-26T23:40:53.268 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:53.262+0000 7f08317fa640 1 --2- 172.21.15.88:0/2709391588 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f082006c920 0x7f082006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:53.268 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:53.262+0000 7f08317fa640 1 -- 172.21.15.88:0/2709391588 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7f082808c2d0 con 0x7f08340c4160 2024-04-26T23:40:53.268 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:53.262+0000 7f0838c6b640 1 --2- 172.21.15.88:0/2709391588 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f082006c920 0x7f082006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:53.269 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:53.263+0000 7f0838c6b640 1 --2- 172.21.15.88:0/2709391588 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f082006c920 0x7f082006ede0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f0824000f60 tx=0x7f0824007b50 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:53.270 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:53.267+0000 7f08317fa640 1 -- 172.21.15.88:0/2709391588 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f082805a3d0 con 0x7f08340c4160 2024-04-26T23:40:53.448 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:53.444+0000 7f083aecf640 1 -- 172.21.15.88:0/2709391588 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f08340c3ed0 con 0x7f08340c4160 2024-04-26T23:40:53.449 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:53.445+0000 7f08317fa640 1 -- 172.21.15.88:0/2709391588 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) ==== 93+0+10 (secure 0 0 0) 0x7f082808c0f0 con 0x7f08340c4160 2024-04-26T23:40:53.449 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 1 2024-04-26T23:40:53.451 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:53.447+0000 7f083aecf640 1 -- 172.21.15.88:0/2709391588 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f082006c920 msgr2=0x7f082006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:53.451 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:53.447+0000 7f083aecf640 1 --2- 172.21.15.88:0/2709391588 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f082006c920 0x7f082006ede0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f0824000f60 tx=0x7f0824007b50 comp rx=0 tx=0).stop 2024-04-26T23:40:53.451 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:53.447+0000 7f083aecf640 1 -- 172.21.15.88:0/2709391588 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f08340c4160 msgr2=0x7f0834155d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:53.451 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:53.447+0000 7f083aecf640 1 --2- 172.21.15.88:0/2709391588 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f08340c4160 0x7f0834155d90 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f082800d800 tx=0x7f082800dcc0 comp rx=0 tx=0).stop 2024-04-26T23:40:53.451 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:53.447+0000 7f083aecf640 1 -- 172.21.15.88:0/2709391588 shutdown_connections 2024-04-26T23:40:53.451 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:53.447+0000 7f083aecf640 1 --2- 172.21.15.88:0/2709391588 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f082006c920 0x7f082006ede0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:53.451 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:53.447+0000 7f083aecf640 1 --2- 172.21.15.88:0/2709391588 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f08341510c0 0x7f083413ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:53.451 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:53.447+0000 7f083aecf640 1 --2- 172.21.15.88:0/2709391588 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f08340c4160 0x7f0834155d90 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:53.451 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:53.447+0000 7f083aecf640 1 --2- 172.21.15.88:0/2709391588 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f083406d860 0x7f08340c7250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:53.451 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:53.447+0000 7f083aecf640 1 -- 172.21.15.88:0/2709391588 >> 172.21.15.88:0/2709391588 conn(0x7f08340c5ce0 msgr2=0x7f0834152a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:40:53.452 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:53.447+0000 7f083aecf640 1 -- 172.21.15.88:0/2709391588 shutdown_connections 2024-04-26T23:40:53.452 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:53.447+0000 7f083aecf640 1 -- 172.21.15.88:0/2709391588 wait complete. 2024-04-26T23:40:53.462 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get a_metadata pg_num 2024-04-26T23:40:53.562 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:53.558+0000 7fea0601d640 1 Processor -- start 2024-04-26T23:40:53.562 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:53.558+0000 7fea0601d640 1 -- start start 2024-04-26T23:40:53.563 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:53.558+0000 7fea0601d640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fea000aecf0 0x7fea000c3800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:53.563 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:53.559+0000 7fea0601d640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fea000c3d40 0x7fea00074180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:53.563 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:53.559+0000 7fea0601d640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fea00156f60 con 0x7fea000c4820 2024-04-26T23:40:53.563 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:53.559+0000 7fea0601d640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7fea00157240 con 0x7fea000c3d40 2024-04-26T23:40:53.563 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:53.559+0000 7fea0601d640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7fea00157520 con 0x7fea000aecf0 2024-04-26T23:40:53.563 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:53.559+0000 7fe9feffd640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fea000c4820 0x7fea00073a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:58126/0 (socket says 172.21.15.88:58126) 2024-04-26T23:40:53.563 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:53.559+0000 7fe9fffff640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fea000c3d40 0x7fea00074180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:53.563 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:53.559+0000 7fe9feffd640 1 -- 172.21.15.88:0/2349644003 learned_addr learned my addr 172.21.15.88:0/2349644003 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-26T23:40:53.564 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:53.559+0000 7fe9ff7fe640 1 --2- 172.21.15.88:0/2349644003 >> v2:172.21.15.175:3300/0 conn(0x7fea000aecf0 0x7fea000c3800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:53.564 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:53.559+0000 7fe9fffff640 1 -- 172.21.15.88:0/2349644003 >> v2:172.21.15.175:3300/0 conn(0x7fea000aecf0 msgr2=0x7fea000c3800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:40:53.564 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:53.559+0000 7fe9fffff640 1 --2- 172.21.15.88:0/2349644003 >> v2:172.21.15.175:3300/0 conn(0x7fea000aecf0 0x7fea000c3800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:53.564 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:53.559+0000 7fe9fffff640 1 -- 172.21.15.88:0/2349644003 >> v1:172.21.15.88:6789/0 conn(0x7fea000c4820 legacy=0x7fea00073a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:53.564 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:53.559+0000 7fe9fffff640 1 -- 172.21.15.88:0/2349644003 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea00157800 con 0x7fea000c3d40 2024-04-26T23:40:53.564 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:53.559+0000 7fe9ff7fe640 1 --2- 172.21.15.88:0/2349644003 >> v2:172.21.15.175:3300/0 conn(0x7fea000aecf0 0x7fea000c3800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:40:53.565 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:53.560+0000 7fe9fffff640 1 --2- 172.21.15.88:0/2349644003 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fea000c3d40 0x7fea00074180 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fea000cb340 tx=0x7fe9f802a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=364b1cdf217d3073 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:53.565 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:53.560+0000 7fe9fe7fc640 1 -- 172.21.15.88:0/2349644003 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9f8007740 con 0x7fea000c3d40 2024-04-26T23:40:53.565 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:53.560+0000 7fe9fe7fc640 1 -- 172.21.15.88:0/2349644003 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9f80078e0 con 0x7fea000c3d40 2024-04-26T23:40:53.566 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:53.560+0000 7fe9fe7fc640 1 -- 172.21.15.88:0/2349644003 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9f8007cb0 con 0x7fea000c3d40 2024-04-26T23:40:53.566 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:53.560+0000 7fea0601d640 1 -- 172.21.15.88:0/2349644003 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fea000c3d40 msgr2=0x7fea00074180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:53.566 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:53.560+0000 7fea0601d640 1 --2- 172.21.15.88:0/2349644003 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fea000c3d40 0x7fea00074180 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fea000cb340 tx=0x7fe9f802a5f0 comp rx=0 tx=0).stop 2024-04-26T23:40:53.566 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:53.560+0000 7fea0601d640 1 -- 172.21.15.88:0/2349644003 shutdown_connections 2024-04-26T23:40:53.566 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:53.560+0000 7fea0601d640 1 --2- 172.21.15.88:0/2349644003 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fea000c3d40 0x7fea00074180 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:53.566 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:53.560+0000 7fea0601d640 1 --2- 172.21.15.88:0/2349644003 >> v2:172.21.15.175:3300/0 conn(0x7fea000aecf0 0x7fea000c3800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:53.566 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:53.560+0000 7fea0601d640 1 -- 172.21.15.88:0/2349644003 >> 172.21.15.88:0/2349644003 conn(0x7fea000c6ed0 msgr2=0x7fea000c72b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:40:53.566 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:53.560+0000 7fea0601d640 1 -- 172.21.15.88:0/2349644003 shutdown_connections 2024-04-26T23:40:53.566 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:53.560+0000 7fea0601d640 1 -- 172.21.15.88:0/2349644003 wait complete. 2024-04-26T23:40:53.566 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:53.561+0000 7fea0601d640 1 Processor -- start 2024-04-26T23:40:53.566 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:53.562+0000 7fea0601d640 1 -- start start 2024-04-26T23:40:53.569 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:53.562+0000 7fea0601d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fea000aecf0 0x7fea00149350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:53.569 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:53.562+0000 7fea0601d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fea000c3d40 0x7fea0014e640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:53.569 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:53.562+0000 7fea0601d640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fea000c4820 0x7fea001ec750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:53.569 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:53.562+0000 7fea0601d640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fea00156c10 con 0x7fea000aecf0 2024-04-26T23:40:53.569 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:53.562+0000 7fea0601d640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fea000746c0 con 0x7fea000c3d40 2024-04-26T23:40:53.569 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:53.562+0000 7fea0601d640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fea000af0d0 con 0x7fea000c4820 2024-04-26T23:40:53.569 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:53.562+0000 7fe9ff7fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fea000aecf0 0x7fea00149350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:53.569 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:53.562+0000 7fe9ff7fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fea000aecf0 0x7fea00149350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:41832/0 (socket says 172.21.15.88:41832) 2024-04-26T23:40:53.569 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:53.562+0000 7fe9ff7fe640 1 -- 172.21.15.88:0/1328828691 learned_addr learned my addr 172.21.15.88:0/1328828691 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:40:53.570 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:53.562+0000 7fe9feffd640 1 --2- 172.21.15.88:0/1328828691 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fea000c3d40 0x7fea0014e640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:53.570 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:53.563+0000 7fe9ff7fe640 1 -- 172.21.15.88:0/1328828691 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fea000c4820 msgr2=0x7fea001ec750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:53.570 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:53.563+0000 7fe9fffff640 1 --2- 172.21.15.88:0/1328828691 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fea000c4820 0x7fea001ec750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:53.570 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:53.563+0000 7fe9ff7fe640 1 --2- 172.21.15.88:0/1328828691 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fea000c4820 0x7fea001ec750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:53.570 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:53.563+0000 7fe9ff7fe640 1 -- 172.21.15.88:0/1328828691 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fea000c3d40 msgr2=0x7fea0014e640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:53.570 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:53.563+0000 7fe9ff7fe640 1 --2- 172.21.15.88:0/1328828691 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fea000c3d40 0x7fea0014e640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:53.570 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:53.563+0000 7fe9ff7fe640 1 -- 172.21.15.88:0/1328828691 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea001ed010 con 0x7fea000aecf0 2024-04-26T23:40:53.570 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:53.563+0000 7fe9feffd640 1 --2- 172.21.15.88:0/1328828691 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fea000c3d40 0x7fea0014e640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:40:53.570 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:53.563+0000 7fe9fffff640 1 --2- 172.21.15.88:0/1328828691 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fea000c4820 0x7fea001ec750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:40:53.570 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:53.563+0000 7fe9ff7fe640 1 --2- 172.21.15.88:0/1328828691 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fea000aecf0 0x7fea00149350 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fe9f000c7f0 tx=0x7fe9f000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:53.570 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:53.563+0000 7fe9e7fff640 1 -- 172.21.15.88:0/1328828691 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9f0015070 con 0x7fea000aecf0 2024-04-26T23:40:53.570 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:53.563+0000 7fe9e7fff640 1 -- 172.21.15.88:0/1328828691 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9f0007a30 con 0x7fea000aecf0 2024-04-26T23:40:53.570 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:53.563+0000 7fe9e7fff640 1 -- 172.21.15.88:0/1328828691 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9f0007e00 con 0x7fea000aecf0 2024-04-26T23:40:53.570 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:53.563+0000 7fea0601d640 1 -- 172.21.15.88:0/1328828691 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea001ed2f0 con 0x7fea000aecf0 2024-04-26T23:40:53.570 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:53.563+0000 7fea0601d640 1 -- 172.21.15.88:0/1328828691 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea000c7fc0 con 0x7fea000aecf0 2024-04-26T23:40:53.571 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:53.564+0000 7fea0601d640 1 -- 172.21.15.88:0/1328828691 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea000507a0 con 0x7fea000aecf0 2024-04-26T23:40:53.571 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:53.564+0000 7fe9e7fff640 1 -- 172.21.15.88:0/1328828691 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe9f0018070 con 0x7fea000aecf0 2024-04-26T23:40:53.571 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:53.565+0000 7fe9e7fff640 1 --2- 172.21.15.88:0/1328828691 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fe9ec06c8f0 0x7fe9ec06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:53.571 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:53.565+0000 7fe9e7fff640 1 -- 172.21.15.88:0/1328828691 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7fe9f008be00 con 0x7fea000aecf0 2024-04-26T23:40:53.571 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:53.565+0000 7fe9feffd640 1 --2- 172.21.15.88:0/1328828691 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fe9ec06c8f0 0x7fe9ec06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:53.571 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:53.565+0000 7fe9feffd640 1 --2- 172.21.15.88:0/1328828691 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fe9ec06c8f0 0x7fe9ec06edb0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fea000c39e0 tx=0x7fe9f4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:53.573 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:53.569+0000 7fe9e7fff640 1 -- 172.21.15.88:0/1328828691 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fe9f0059f90 con 0x7fea000aecf0 2024-04-26T23:40:53.749 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:53.745+0000 7fea0601d640 1 -- 172.21.15.88:0/1328828691 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "a_metadata", "var": "pg_num"} v 0) -- 0x7fea000c4600 con 0x7fea000aecf0 2024-04-26T23:40:53.749 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:53.745+0000 7fe9e7fff640 1 -- 172.21.15.88:0/1328828691 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "a_metadata", "var": "pg_num"}]=0 v24) ==== 99+0+11 (secure 0 0 0) 0x7fe9f0059890 con 0x7fea000aecf0 2024-04-26T23:40:53.749 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 32 2024-04-26T23:40:53.752 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:53.747+0000 7fea0601d640 1 -- 172.21.15.88:0/1328828691 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fe9ec06c8f0 msgr2=0x7fe9ec06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:53.752 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:53.747+0000 7fea0601d640 1 --2- 172.21.15.88:0/1328828691 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fe9ec06c8f0 0x7fe9ec06edb0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fea000c39e0 tx=0x7fe9f4009040 comp rx=0 tx=0).stop 2024-04-26T23:40:53.752 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:53.747+0000 7fea0601d640 1 -- 172.21.15.88:0/1328828691 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fea000aecf0 msgr2=0x7fea00149350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:53.752 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:53.747+0000 7fea0601d640 1 --2- 172.21.15.88:0/1328828691 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fea000aecf0 0x7fea00149350 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fe9f000c7f0 tx=0x7fe9f000cbf0 comp rx=0 tx=0).stop 2024-04-26T23:40:53.752 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:53.747+0000 7fea0601d640 1 -- 172.21.15.88:0/1328828691 shutdown_connections 2024-04-26T23:40:53.752 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:53.747+0000 7fea0601d640 1 --2- 172.21.15.88:0/1328828691 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fe9ec06c8f0 0x7fe9ec06edb0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:53.752 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:53.747+0000 7fea0601d640 1 --2- 172.21.15.88:0/1328828691 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fea000c4820 0x7fea001ec750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:53.752 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:53.747+0000 7fea0601d640 1 --2- 172.21.15.88:0/1328828691 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fea000c3d40 0x7fea0014e640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:53.752 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:53.747+0000 7fea0601d640 1 --2- 172.21.15.88:0/1328828691 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fea000aecf0 0x7fea00149350 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:53.752 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:53.747+0000 7fea0601d640 1 -- 172.21.15.88:0/1328828691 >> 172.21.15.88:0/1328828691 conn(0x7fea000c6ed0 msgr2=0x7fea000ad270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:40:53.753 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:53.747+0000 7fea0601d640 1 -- 172.21.15.88:0/1328828691 shutdown_connections 2024-04-26T23:40:53.753 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:53.748+0000 7fea0601d640 1 -- 172.21.15.88:0/1328828691 wait complete. 2024-04-26T23:40:53.762 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get a_data pg_num 2024-04-26T23:40:53.861 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:53.857+0000 7f9e6bac5640 1 Processor -- start 2024-04-26T23:40:53.861 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:53.858+0000 7f9e6bac5640 1 -- start start 2024-04-26T23:40:53.863 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:53.858+0000 7f9e6bac5640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9e6413ffb0 0x7f9e640c82a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:53.863 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:53.858+0000 7f9e6bac5640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f9e6415a280 0x7f9e64072ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:53.863 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:53.858+0000 7f9e6bac5640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9e640c8a30 con 0x7f9e64073530 2024-04-26T23:40:53.863 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:53.858+0000 7f9e6bac5640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f9e64072be0 con 0x7f9e6415a280 2024-04-26T23:40:53.863 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:53.858+0000 7f9e6bac5640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f9e640c9640 con 0x7f9e6413ffb0 2024-04-26T23:40:53.863 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:53.859+0000 7f9e69060640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f9e6415a280 0x7f9e64072ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:53.863 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:53.859+0000 7f9e69060640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f9e6415a280 0x7f9e64072ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.88:36732/0 (socket says 172.21.15.88:36732) 2024-04-26T23:40:53.863 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:53.859+0000 7f9e6a062640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f9e64073530 0x7f9e64158180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.88:48576/0 (socket says 172.21.15.88:48576) 2024-04-26T23:40:53.863 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:53.859+0000 7f9e69861640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9e6413ffb0 0x7f9e640c82a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:53.863 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:53.859+0000 7f9e69060640 1 -- 172.21.15.88:0/1545956528 learned_addr learned my addr 172.21.15.88:0/1545956528 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:40:53.863 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:53.859+0000 7f9e69861640 1 -- 172.21.15.88:0/1545956528 >> v2:172.21.15.175:3300/0 conn(0x7f9e6415a280 msgr2=0x7f9e64072ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:40:53.863 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:53.859+0000 7f9e69861640 1 --2- 172.21.15.88:0/1545956528 >> v2:172.21.15.175:3300/0 conn(0x7f9e6415a280 0x7f9e64072ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:53.864 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:53.859+0000 7f9e69861640 1 -- 172.21.15.88:0/1545956528 >> v1:172.21.15.175:6789/0 conn(0x7f9e64073530 legacy=0x7f9e64158180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:53.864 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:53.859+0000 7f9e69861640 1 -- 172.21.15.88:0/1545956528 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e640c8d10 con 0x7f9e6413ffb0 2024-04-26T23:40:53.864 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:53.859+0000 7f9e69060640 1 --2- 172.21.15.88:0/1545956528 >> v2:172.21.15.175:3300/0 conn(0x7f9e6415a280 0x7f9e64072ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:40:53.865 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:53.860+0000 7f9e69861640 1 --2- 172.21.15.88:0/1545956528 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9e6413ffb0 0x7f9e640c82a0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f9e600097a0 tx=0x7f9e6002a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ce6bb5a5c919d836 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:53.865 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:53.860+0000 7f9e6885f640 1 -- 172.21.15.88:0/1545956528 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e60037070 con 0x7f9e6413ffb0 2024-04-26T23:40:53.865 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:53.860+0000 7f9e6885f640 1 -- 172.21.15.88:0/1545956528 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e6002ae50 con 0x7f9e6413ffb0 2024-04-26T23:40:53.865 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:53.860+0000 7f9e6885f640 1 -- 172.21.15.88:0/1545956528 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e60032660 con 0x7f9e6413ffb0 2024-04-26T23:40:53.866 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:53.860+0000 7f9e6bac5640 1 -- 172.21.15.88:0/1545956528 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9e6413ffb0 msgr2=0x7f9e640c82a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:53.866 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:53.860+0000 7f9e6bac5640 1 --2- 172.21.15.88:0/1545956528 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9e6413ffb0 0x7f9e640c82a0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f9e600097a0 tx=0x7f9e6002a100 comp rx=0 tx=0).stop 2024-04-26T23:40:53.866 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:53.860+0000 7f9e6bac5640 1 -- 172.21.15.88:0/1545956528 shutdown_connections 2024-04-26T23:40:53.866 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:53.860+0000 7f9e6bac5640 1 --2- 172.21.15.88:0/1545956528 >> v2:172.21.15.175:3300/0 conn(0x7f9e6415a280 0x7f9e64072ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:53.866 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:53.860+0000 7f9e6bac5640 1 --2- 172.21.15.88:0/1545956528 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9e6413ffb0 0x7f9e640c82a0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:53.866 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:53.860+0000 7f9e6bac5640 1 -- 172.21.15.88:0/1545956528 >> 172.21.15.88:0/1545956528 conn(0x7f9e6406dc10 msgr2=0x7f9e6406c310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:40:53.866 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:53.860+0000 7f9e6bac5640 1 -- 172.21.15.88:0/1545956528 shutdown_connections 2024-04-26T23:40:53.866 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:53.860+0000 7f9e6bac5640 1 -- 172.21.15.88:0/1545956528 wait complete. 2024-04-26T23:40:53.866 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:53.861+0000 7f9e6bac5640 1 Processor -- start 2024-04-26T23:40:53.866 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:53.861+0000 7f9e6bac5640 1 -- start start 2024-04-26T23:40:53.869 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:53.862+0000 7f9e6bac5640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9e64073530 0x7f9e641efba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:53.869 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:53.862+0000 7f9e6bac5640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9e6413ffb0 0x7f9e64153810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:53.869 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:53.862+0000 7f9e6bac5640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9e6415a280 0x7f9e64153d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:53.869 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:53.862+0000 7f9e6bac5640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f9e640c92d0 con 0x7f9e6413ffb0 2024-04-26T23:40:53.869 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:53.862+0000 7f9e6bac5640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f9e640c87e0 con 0x7f9e64073530 2024-04-26T23:40:53.869 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:53.862+0000 7f9e6bac5640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f9e64140390 con 0x7f9e6415a280 2024-04-26T23:40:53.869 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:53.862+0000 7f9e69060640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9e6413ffb0 0x7f9e64153810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:53.869 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:53.862+0000 7f9e69060640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9e6413ffb0 0x7f9e64153810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:41838/0 (socket says 172.21.15.88:41838) 2024-04-26T23:40:53.869 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:53.862+0000 7f9e69060640 1 -- 172.21.15.88:0/827351176 learned_addr learned my addr 172.21.15.88:0/827351176 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:40:53.869 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:53.862+0000 7f9e69861640 1 --2- 172.21.15.88:0/827351176 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9e64073530 0x7f9e641efba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:53.869 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:53.862+0000 7f9e6a062640 1 --2- 172.21.15.88:0/827351176 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9e6415a280 0x7f9e64153d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:53.869 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:53.862+0000 7f9e69060640 1 -- 172.21.15.88:0/827351176 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9e6415a280 msgr2=0x7f9e64153d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:53.869 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:53.862+0000 7f9e69060640 1 --2- 172.21.15.88:0/827351176 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9e6415a280 0x7f9e64153d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:53.870 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:53.862+0000 7f9e69060640 1 -- 172.21.15.88:0/827351176 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9e64073530 msgr2=0x7f9e641efba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:53.870 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:53.862+0000 7f9e69060640 1 --2- 172.21.15.88:0/827351176 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9e64073530 0x7f9e641efba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:53.870 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:53.862+0000 7f9e69060640 1 -- 172.21.15.88:0/827351176 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e641f0650 con 0x7f9e6413ffb0 2024-04-26T23:40:53.870 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:53.862+0000 7f9e69861640 1 --2- 172.21.15.88:0/827351176 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9e64073530 0x7f9e641efba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:40:53.870 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:53.862+0000 7f9e6a062640 1 --2- 172.21.15.88:0/827351176 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9e6415a280 0x7f9e64153d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:40:53.870 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:53.863+0000 7f9e69060640 1 --2- 172.21.15.88:0/827351176 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9e6413ffb0 0x7f9e64153810 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f9e5400e9e0 tx=0x7f9e5400eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:53.870 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:53.863+0000 7f9e5a7fc640 1 -- 172.21.15.88:0/827351176 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e54017070 con 0x7f9e6413ffb0 2024-04-26T23:40:53.870 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:53.863+0000 7f9e5a7fc640 1 -- 172.21.15.88:0/827351176 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e5400c9d0 con 0x7f9e6413ffb0 2024-04-26T23:40:53.870 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:53.863+0000 7f9e6bac5640 1 -- 172.21.15.88:0/827351176 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e641f08f0 con 0x7f9e6413ffb0 2024-04-26T23:40:53.870 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:53.863+0000 7f9e5a7fc640 1 -- 172.21.15.88:0/827351176 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e5400cd80 con 0x7f9e6413ffb0 2024-04-26T23:40:53.870 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:53.863+0000 7f9e6bac5640 1 -- 172.21.15.88:0/827351176 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e641edfd0 con 0x7f9e6413ffb0 2024-04-26T23:40:53.870 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:53.864+0000 7f9e6bac5640 1 -- 172.21.15.88:0/827351176 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e64076650 con 0x7f9e6413ffb0 2024-04-26T23:40:53.870 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:53.864+0000 7f9e5a7fc640 1 -- 172.21.15.88:0/827351176 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f9e5401a070 con 0x7f9e6413ffb0 2024-04-26T23:40:53.871 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:53.865+0000 7f9e5a7fc640 1 --2- 172.21.15.88:0/827351176 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f9e4806c8f0 0x7f9e4806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:53.871 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:53.865+0000 7f9e5a7fc640 1 -- 172.21.15.88:0/827351176 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7f9e5408c050 con 0x7f9e6413ffb0 2024-04-26T23:40:53.871 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:53.865+0000 7f9e69861640 1 --2- 172.21.15.88:0/827351176 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f9e4806c8f0 0x7f9e4806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:53.871 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:53.865+0000 7f9e69861640 1 --2- 172.21.15.88:0/827351176 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f9e4806c8f0 0x7f9e4806edb0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f9e60034000 tx=0x7f9e6002e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:53.873 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:53.869+0000 7f9e5a7fc640 1 -- 172.21.15.88:0/827351176 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f9e5405a1e0 con 0x7f9e6413ffb0 2024-04-26T23:40:54.050 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.046+0000 7f9e6bac5640 1 -- 172.21.15.88:0/827351176 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "a_data", "var": "pg_num"} v 0) -- 0x7f9e640b03d0 con 0x7f9e6413ffb0 2024-04-26T23:40:54.051 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.046+0000 7f9e5a7fc640 1 -- 172.21.15.88:0/827351176 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "a_data", "var": "pg_num"}]=0 v24) ==== 95+0+11 (secure 0 0 0) 0x7f9e54059ae0 con 0x7f9e6413ffb0 2024-04-26T23:40:54.051 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 64 2024-04-26T23:40:54.052 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.048+0000 7f9e6bac5640 1 -- 172.21.15.88:0/827351176 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f9e4806c8f0 msgr2=0x7f9e4806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:54.053 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.048+0000 7f9e6bac5640 1 --2- 172.21.15.88:0/827351176 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f9e4806c8f0 0x7f9e4806edb0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f9e60034000 tx=0x7f9e6002e000 comp rx=0 tx=0).stop 2024-04-26T23:40:54.053 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.048+0000 7f9e6bac5640 1 -- 172.21.15.88:0/827351176 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9e6413ffb0 msgr2=0x7f9e64153810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:54.053 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.048+0000 7f9e6bac5640 1 --2- 172.21.15.88:0/827351176 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9e6413ffb0 0x7f9e64153810 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f9e5400e9e0 tx=0x7f9e5400eea0 comp rx=0 tx=0).stop 2024-04-26T23:40:54.053 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.048+0000 7f9e6bac5640 1 -- 172.21.15.88:0/827351176 shutdown_connections 2024-04-26T23:40:54.053 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.048+0000 7f9e6bac5640 1 --2- 172.21.15.88:0/827351176 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f9e4806c8f0 0x7f9e4806edb0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:54.053 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.048+0000 7f9e6bac5640 1 --2- 172.21.15.88:0/827351176 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9e6415a280 0x7f9e64153d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:54.053 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.048+0000 7f9e6bac5640 1 --2- 172.21.15.88:0/827351176 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9e6413ffb0 0x7f9e64153810 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:54.053 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.048+0000 7f9e6bac5640 1 --2- 172.21.15.88:0/827351176 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9e64073530 0x7f9e641efba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:54.053 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.048+0000 7f9e6bac5640 1 -- 172.21.15.88:0/827351176 >> 172.21.15.88:0/827351176 conn(0x7f9e6406dc10 msgr2=0x7f9e640af130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:40:54.053 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.048+0000 7f9e6bac5640 1 -- 172.21.15.88:0/827351176 shutdown_connections 2024-04-26T23:40:54.054 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.048+0000 7f9e6bac5640 1 -- 172.21.15.88:0/827351176 wait complete. 2024-04-26T23:40:54.063 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get b_metadata pg_num 2024-04-26T23:40:54.162 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.159+0000 7f2bb679d640 1 Processor -- start 2024-04-26T23:40:54.163 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.159+0000 7f2bb679d640 1 -- start start 2024-04-26T23:40:54.164 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.159+0000 7f2bb679d640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f2bb00740e0 0x7f2bb0157630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:54.164 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.160+0000 7f2bb679d640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f2bb00ca3a0 0x7f2bb00c7200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:54.164 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.160+0000 7f2bb679d640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2bb015a530 con 0x7f2bb00c6e20 2024-04-26T23:40:54.165 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.160+0000 7f2bb679d640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f2bb0072930 con 0x7f2bb00ca3a0 2024-04-26T23:40:54.165 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.160+0000 7f2bb679d640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f2bb015a810 con 0x7f2bb00740e0 2024-04-26T23:40:54.165 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.160+0000 7f2bb4d3a640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f2bb00ca3a0 0x7f2bb00c7200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:54.165 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.160+0000 7f2bb4d3a640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f2bb00ca3a0 0x7f2bb00c7200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:41844/0 (socket says 172.21.15.88:41844) 2024-04-26T23:40:54.165 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.160+0000 7f2bb4d3a640 1 -- 172.21.15.88:0/4112869161 learned_addr learned my addr 172.21.15.88:0/4112869161 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:40:54.165 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.160+0000 7f2baf7fe640 1 --2- 172.21.15.88:0/4112869161 >> v2:172.21.15.175:3300/0 conn(0x7f2bb00740e0 0x7f2bb0157630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:54.165 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.160+0000 7f2bb4d3a640 1 -- 172.21.15.88:0/4112869161 >> v2:172.21.15.175:3300/0 conn(0x7f2bb00740e0 msgr2=0x7f2bb0157630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:40:54.165 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.160+0000 7f2bb4d3a640 1 --2- 172.21.15.88:0/4112869161 >> v2:172.21.15.175:3300/0 conn(0x7f2bb00740e0 0x7f2bb0157630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:54.165 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.160+0000 7f2bb4d3a640 1 -- 172.21.15.88:0/4112869161 >> v1:172.21.15.175:6789/0 conn(0x7f2bb00c6e20 legacy=0x7f2bb0156f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:40:54.165 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.160+0000 7f2bb4d3a640 1 -- 172.21.15.88:0/4112869161 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2bb015aaf0 con 0x7f2bb00ca3a0 2024-04-26T23:40:54.165 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.161+0000 7f2bb4d3a640 1 --2- 172.21.15.88:0/4112869161 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2bb00ca3a0 0x7f2bb00c7200 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f2bb00abfd0 tx=0x7f2ba802a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2640d2e13aa6c293 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:54.165 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.161+0000 7f2baeffd640 1 -- 172.21.15.88:0/4112869161 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ba8036070 con 0x7f2bb00ca3a0 2024-04-26T23:40:54.166 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.161+0000 7f2baeffd640 1 -- 172.21.15.88:0/4112869161 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ba8031600 con 0x7f2bb00ca3a0 2024-04-26T23:40:54.166 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.161+0000 7f2baeffd640 1 -- 172.21.15.88:0/4112869161 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ba80319d0 con 0x7f2bb00ca3a0 2024-04-26T23:40:54.169 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.161+0000 7f2bb679d640 1 -- 172.21.15.88:0/4112869161 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2bb00ca3a0 msgr2=0x7f2bb00c7200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:54.169 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.161+0000 7f2bb679d640 1 --2- 172.21.15.88:0/4112869161 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2bb00ca3a0 0x7f2bb00c7200 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f2bb00abfd0 tx=0x7f2ba802a660 comp rx=0 tx=0).stop 2024-04-26T23:40:54.169 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.161+0000 7f2bb679d640 1 -- 172.21.15.88:0/4112869161 shutdown_connections 2024-04-26T23:40:54.169 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.161+0000 7f2bb679d640 1 --2- 172.21.15.88:0/4112869161 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2bb00ca3a0 0x7f2bb00c7200 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:54.170 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.161+0000 7f2bb679d640 1 --2- 172.21.15.88:0/4112869161 >> v2:172.21.15.175:3300/0 conn(0x7f2bb00740e0 0x7f2bb0157630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:54.170 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.161+0000 7f2bb679d640 1 -- 172.21.15.88:0/4112869161 >> 172.21.15.88:0/4112869161 conn(0x7f2bb00ae0b0 msgr2=0x7f2bb00ae490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:40:54.170 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.161+0000 7f2bb679d640 1 -- 172.21.15.88:0/4112869161 shutdown_connections 2024-04-26T23:40:54.170 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.161+0000 7f2bb679d640 1 -- 172.21.15.88:0/4112869161 wait complete. 2024-04-26T23:40:54.170 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.162+0000 7f2bb679d640 1 Processor -- start 2024-04-26T23:40:54.170 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.163+0000 7f2bb679d640 1 -- start start 2024-04-26T23:40:54.170 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.163+0000 7f2bb679d640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2bb00740e0 0x7f2bb01f0a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:54.170 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.163+0000 7f2bb679d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2bb00c6e20 0x7f2bb0152a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:54.170 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.163+0000 7f2bb679d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2bb00ca3a0 0x7f2bb014f910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:54.170 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.163+0000 7f2bb679d640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f2bb0154540 con 0x7f2bb00ca3a0 2024-04-26T23:40:54.170 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.163+0000 7f2bb679d640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f2bb01543c0 con 0x7f2bb00c6e20 2024-04-26T23:40:54.170 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.163+0000 7f2bb679d640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f2bb015a0c0 con 0x7f2bb00740e0 2024-04-26T23:40:54.170 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.163+0000 7f2bb4d3a640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2bb00ca3a0 0x7f2bb014f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:54.171 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.163+0000 7f2bb4d3a640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2bb00ca3a0 0x7f2bb014f910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:41858/0 (socket says 172.21.15.88:41858) 2024-04-26T23:40:54.171 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.163+0000 7f2bb4d3a640 1 -- 172.21.15.88:0/545855418 learned_addr learned my addr 172.21.15.88:0/545855418 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:40:54.171 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.163+0000 7f2baf7fe640 1 --2- 172.21.15.88:0/545855418 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2bb00c6e20 0x7f2bb0152a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:54.171 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.163+0000 7f2baffff640 1 --2- 172.21.15.88:0/545855418 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2bb00740e0 0x7f2bb01f0a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:54.171 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.164+0000 7f2bb4d3a640 1 -- 172.21.15.88:0/545855418 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2bb00740e0 msgr2=0x7f2bb01f0a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:54.171 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.164+0000 7f2bb4d3a640 1 --2- 172.21.15.88:0/545855418 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2bb00740e0 0x7f2bb01f0a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:54.171 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.164+0000 7f2bb4d3a640 1 -- 172.21.15.88:0/545855418 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2bb00c6e20 msgr2=0x7f2bb0152a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:54.171 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.164+0000 7f2bb4d3a640 1 --2- 172.21.15.88:0/545855418 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2bb00c6e20 0x7f2bb0152a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:54.171 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.164+0000 7f2bb4d3a640 1 -- 172.21.15.88:0/545855418 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2bb01ecc20 con 0x7f2bb00ca3a0 2024-04-26T23:40:54.171 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.164+0000 7f2bb4d3a640 1 --2- 172.21.15.88:0/545855418 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2bb00ca3a0 0x7f2bb014f910 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f2ba8009f40 tx=0x7f2ba8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:54.171 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.164+0000 7f2bacff9640 1 -- 172.21.15.88:0/545855418 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ba8041020 con 0x7f2bb00ca3a0 2024-04-26T23:40:54.171 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.164+0000 7f2bacff9640 1 -- 172.21.15.88:0/545855418 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ba8007780 con 0x7f2bb00ca3a0 2024-04-26T23:40:54.172 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.164+0000 7f2bb679d640 1 -- 172.21.15.88:0/545855418 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2bb01eff20 con 0x7f2bb00ca3a0 2024-04-26T23:40:54.172 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.164+0000 7f2bacff9640 1 -- 172.21.15.88:0/545855418 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ba8036040 con 0x7f2bb00ca3a0 2024-04-26T23:40:54.172 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.164+0000 7f2bb679d640 1 -- 172.21.15.88:0/545855418 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2bb0152fc0 con 0x7f2bb00ca3a0 2024-04-26T23:40:54.172 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.165+0000 7f2bb679d640 1 -- 172.21.15.88:0/545855418 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2bb0075a60 con 0x7f2bb00ca3a0 2024-04-26T23:40:54.172 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.165+0000 7f2bacff9640 1 -- 172.21.15.88:0/545855418 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2ba8044020 con 0x7f2bb00ca3a0 2024-04-26T23:40:54.172 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.166+0000 7f2bacff9640 1 --2- 172.21.15.88:0/545855418 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f2b9c06c8f0 0x7f2b9c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:54.172 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.166+0000 7f2baffff640 1 --2- 172.21.15.88:0/545855418 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f2b9c06c8f0 0x7f2b9c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:54.172 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.166+0000 7f2bacff9640 1 -- 172.21.15.88:0/545855418 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7f2ba80acba0 con 0x7f2bb00ca3a0 2024-04-26T23:40:54.173 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.166+0000 7f2baffff640 1 --2- 172.21.15.88:0/545855418 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f2b9c06c8f0 0x7f2b9c06edb0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f2ba4007fd0 tx=0x7f2ba4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:54.174 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.170+0000 7f2bacff9640 1 -- 172.21.15.88:0/545855418 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f2bb0075a60 con 0x7f2bb00ca3a0 2024-04-26T23:40:54.349 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.344+0000 7f2bb679d640 1 -- 172.21.15.88:0/545855418 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "b_metadata", "var": "pg_num"} v 0) -- 0x7f2bb00766c0 con 0x7f2bb00ca3a0 2024-04-26T23:40:54.349 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.345+0000 7f2bacff9640 1 -- 172.21.15.88:0/545855418 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "b_metadata", "var": "pg_num"}]=0 v24) ==== 99+0+11 (secure 0 0 0) 0x7f2ba804b030 con 0x7f2bb00ca3a0 2024-04-26T23:40:54.349 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 32 2024-04-26T23:40:54.351 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.347+0000 7f2bb679d640 1 -- 172.21.15.88:0/545855418 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f2b9c06c8f0 msgr2=0x7f2b9c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:54.351 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.347+0000 7f2bb679d640 1 --2- 172.21.15.88:0/545855418 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f2b9c06c8f0 0x7f2b9c06edb0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f2ba4007fd0 tx=0x7f2ba4009040 comp rx=0 tx=0).stop 2024-04-26T23:40:54.351 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.347+0000 7f2bb679d640 1 -- 172.21.15.88:0/545855418 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2bb00ca3a0 msgr2=0x7f2bb014f910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:54.351 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.347+0000 7f2bb679d640 1 --2- 172.21.15.88:0/545855418 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2bb00ca3a0 0x7f2bb014f910 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f2ba8009f40 tx=0x7f2ba8004a40 comp rx=0 tx=0).stop 2024-04-26T23:40:54.351 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.347+0000 7f2bb679d640 1 -- 172.21.15.88:0/545855418 shutdown_connections 2024-04-26T23:40:54.351 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.347+0000 7f2bb679d640 1 --2- 172.21.15.88:0/545855418 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f2b9c06c8f0 0x7f2b9c06edb0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:54.351 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.347+0000 7f2bb679d640 1 --2- 172.21.15.88:0/545855418 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2bb00ca3a0 0x7f2bb014f910 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:54.352 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.347+0000 7f2bb679d640 1 --2- 172.21.15.88:0/545855418 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2bb00c6e20 0x7f2bb0152a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:54.352 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.347+0000 7f2bb679d640 1 --2- 172.21.15.88:0/545855418 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2bb00740e0 0x7f2bb01f0a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:54.352 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.347+0000 7f2bb679d640 1 -- 172.21.15.88:0/545855418 >> 172.21.15.88:0/545855418 conn(0x7f2bb00ae0b0 msgr2=0x7f2bb0073350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:40:54.352 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.347+0000 7f2bb679d640 1 -- 172.21.15.88:0/545855418 shutdown_connections 2024-04-26T23:40:54.352 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.347+0000 7f2bb679d640 1 -- 172.21.15.88:0/545855418 wait complete. 2024-04-26T23:40:54.361 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get b_data pg_num 2024-04-26T23:40:54.460 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.456+0000 7f419f283640 1 Processor -- start 2024-04-26T23:40:54.460 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.457+0000 7f419f283640 1 -- start start 2024-04-26T23:40:54.462 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.457+0000 7f419f283640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f419813feb0 0x7f41981576d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:54.462 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.457+0000 7f419f283640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f41980c2b80 0x7f419806d320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:54.462 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.457+0000 7f419f283640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4198156c10 con 0x7f41980c5050 2024-04-26T23:40:54.462 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.457+0000 7f419f283640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f419815a8b0 con 0x7f419813feb0 2024-04-26T23:40:54.462 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.457+0000 7f419f283640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f4198157240 con 0x7f41980c2b80 2024-04-26T23:40:54.462 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.458+0000 7f419d01f640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f419813feb0 0x7f41981576d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:54.462 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.458+0000 7f419d820640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f41980c2b80 0x7f419806d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:54.462 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.458+0000 7f419c81e640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f41980c5050 0x7f419815a1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.88:48592/0 (socket says 172.21.15.88:48592) 2024-04-26T23:40:54.462 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.458+0000 7f419c81e640 1 -- 172.21.15.88:0/907815962 learned_addr learned my addr 172.21.15.88:0/907815962 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-26T23:40:54.462 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.458+0000 7f419d820640 1 -- 172.21.15.88:0/907815962 >> v2:172.21.15.175:3300/0 conn(0x7f419813feb0 msgr2=0x7f41981576d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:40:54.462 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.458+0000 7f419d820640 1 --2- 172.21.15.88:0/907815962 >> v2:172.21.15.175:3300/0 conn(0x7f419813feb0 0x7f41981576d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:54.463 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.458+0000 7f419d820640 1 -- 172.21.15.88:0/907815962 >> v1:172.21.15.175:6789/0 conn(0x7f41980c5050 legacy=0x7f419815a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:54.463 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.458+0000 7f419d820640 1 -- 172.21.15.88:0/907815962 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41980c5570 con 0x7f41980c2b80 2024-04-26T23:40:54.463 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.458+0000 7f419d01f640 1 --2- 172.21.15.88:0/907815962 >> v2:172.21.15.175:3300/0 conn(0x7f419813feb0 0x7f41981576d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:40:54.464 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.459+0000 7f419d820640 1 --2- 172.21.15.88:0/907815962 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f41980c2b80 0x7f419806d320 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f4190009d90 tx=0x7f419002a5d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7255346ea67770f6 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:54.464 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.459+0000 7f418ffff640 1 -- 172.21.15.88:0/907815962 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4190031600 con 0x7f41980c2b80 2024-04-26T23:40:54.464 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.459+0000 7f418ffff640 1 -- 172.21.15.88:0/907815962 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41900317a0 con 0x7f41980c2b80 2024-04-26T23:40:54.464 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.459+0000 7f418ffff640 1 -- 172.21.15.88:0/907815962 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4190031b70 con 0x7f41980c2b80 2024-04-26T23:40:54.464 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.459+0000 7f419f283640 1 -- 172.21.15.88:0/907815962 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f41980c2b80 msgr2=0x7f419806d320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:54.464 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.459+0000 7f419f283640 1 --2- 172.21.15.88:0/907815962 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f41980c2b80 0x7f419806d320 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f4190009d90 tx=0x7f419002a5d0 comp rx=0 tx=0).stop 2024-04-26T23:40:54.465 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.459+0000 7f419f283640 1 -- 172.21.15.88:0/907815962 shutdown_connections 2024-04-26T23:40:54.465 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.459+0000 7f419f283640 1 --2- 172.21.15.88:0/907815962 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f41980c2b80 0x7f419806d320 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:54.465 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.459+0000 7f419f283640 1 --2- 172.21.15.88:0/907815962 >> v2:172.21.15.175:3300/0 conn(0x7f419813feb0 0x7f41981576d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:54.465 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.459+0000 7f419f283640 1 -- 172.21.15.88:0/907815962 >> 172.21.15.88:0/907815962 conn(0x7f41980c5ce0 msgr2=0x7f41980c60c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:40:54.465 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.460+0000 7f419f283640 1 -- 172.21.15.88:0/907815962 shutdown_connections 2024-04-26T23:40:54.465 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.460+0000 7f419f283640 1 -- 172.21.15.88:0/907815962 wait complete. 2024-04-26T23:40:54.465 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.461+0000 7f419f283640 1 Processor -- start 2024-04-26T23:40:54.465 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.461+0000 7f419f283640 1 -- start start 2024-04-26T23:40:54.467 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.461+0000 7f419f283640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f41980c2b80 0x7f41980726d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:54.467 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.461+0000 7f419f283640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f41980c5050 0x7f419806c580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:54.467 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.461+0000 7f419f283640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f419813feb0 0x7f41981efb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:54.467 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.461+0000 7f419f283640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f4198140290 con 0x7f419813feb0 2024-04-26T23:40:54.467 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.461+0000 7f419f283640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f4198156ed0 con 0x7f41980c2b80 2024-04-26T23:40:54.468 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.461+0000 7f419f283640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f4198140410 con 0x7f41980c5050 2024-04-26T23:40:54.468 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.461+0000 7f419d820640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f419813feb0 0x7f41981efb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:54.468 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.461+0000 7f419d820640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f419813feb0 0x7f41981efb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:41872/0 (socket says 172.21.15.88:41872) 2024-04-26T23:40:54.468 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.461+0000 7f419d820640 1 -- 172.21.15.88:0/2495166051 learned_addr learned my addr 172.21.15.88:0/2495166051 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:40:54.468 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.461+0000 7f419d01f640 1 --2- 172.21.15.88:0/2495166051 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f41980c2b80 0x7f41980726d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:54.468 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.461+0000 7f419c81e640 1 --2- 172.21.15.88:0/2495166051 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f41980c5050 0x7f419806c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:54.468 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.462+0000 7f419d820640 1 -- 172.21.15.88:0/2495166051 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f41980c5050 msgr2=0x7f419806c580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:54.468 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.462+0000 7f419d820640 1 --2- 172.21.15.88:0/2495166051 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f41980c5050 0x7f419806c580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:54.468 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.462+0000 7f419d820640 1 -- 172.21.15.88:0/2495166051 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f41980c2b80 msgr2=0x7f41980726d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:54.468 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.462+0000 7f419d820640 1 --2- 172.21.15.88:0/2495166051 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f41980c2b80 0x7f41980726d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:54.468 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.462+0000 7f419d820640 1 -- 172.21.15.88:0/2495166051 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41981ed4b0 con 0x7f419813feb0 2024-04-26T23:40:54.468 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.462+0000 7f419d820640 1 --2- 172.21.15.88:0/2495166051 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f419813feb0 0x7f41981efb40 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f419002abc0 tx=0x7f4190004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:54.468 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.462+0000 7f418dffb640 1 -- 172.21.15.88:0/2495166051 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4190040070 con 0x7f419813feb0 2024-04-26T23:40:54.469 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.462+0000 7f418dffb640 1 -- 172.21.15.88:0/2495166051 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4190030b60 con 0x7f419813feb0 2024-04-26T23:40:54.469 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.462+0000 7f419f283640 1 -- 172.21.15.88:0/2495166051 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4198072dd0 con 0x7f419813feb0 2024-04-26T23:40:54.469 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.462+0000 7f418dffb640 1 -- 172.21.15.88:0/2495166051 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4190009450 con 0x7f419813feb0 2024-04-26T23:40:54.469 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.462+0000 7f419f283640 1 -- 172.21.15.88:0/2495166051 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41981ec9d0 con 0x7f419813feb0 2024-04-26T23:40:54.469 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.463+0000 7f419f283640 1 -- 172.21.15.88:0/2495166051 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f41980507a0 con 0x7f419813feb0 2024-04-26T23:40:54.469 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.464+0000 7f418dffb640 1 -- 172.21.15.88:0/2495166051 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4190039040 con 0x7f419813feb0 2024-04-26T23:40:54.470 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.464+0000 7f418dffb640 1 --2- 172.21.15.88:0/2495166051 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f417c06c8f0 0x7f417c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:54.470 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.464+0000 7f418dffb640 1 -- 172.21.15.88:0/2495166051 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7f41900ad2a0 con 0x7f419813feb0 2024-04-26T23:40:54.470 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.464+0000 7f419d01f640 1 --2- 172.21.15.88:0/2495166051 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f417c06c8f0 0x7f417c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:54.470 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.464+0000 7f419d01f640 1 --2- 172.21.15.88:0/2495166051 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f417c06c8f0 0x7f417c06edb0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f4194009560 tx=0x7f4194009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:54.472 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.469+0000 7f418dffb640 1 -- 172.21.15.88:0/2495166051 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f419007ade0 con 0x7f419813feb0 2024-04-26T23:40:54.645 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.641+0000 7f419f283640 1 -- 172.21.15.88:0/2495166051 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "b_data", "var": "pg_num"} v 0) -- 0x7f41980adee0 con 0x7f419813feb0 2024-04-26T23:40:54.646 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.642+0000 7f418dffb640 1 -- 172.21.15.88:0/2495166051 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "b_data", "var": "pg_num"}]=0 v24) ==== 95+0+11 (secure 0 0 0) 0x7f419007f0e0 con 0x7f419813feb0 2024-04-26T23:40:54.646 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 64 2024-04-26T23:40:54.648 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.644+0000 7f419f283640 1 -- 172.21.15.88:0/2495166051 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f417c06c8f0 msgr2=0x7f417c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:54.648 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.644+0000 7f419f283640 1 --2- 172.21.15.88:0/2495166051 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f417c06c8f0 0x7f417c06edb0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f4194009560 tx=0x7f4194009190 comp rx=0 tx=0).stop 2024-04-26T23:40:54.648 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.644+0000 7f419f283640 1 -- 172.21.15.88:0/2495166051 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f419813feb0 msgr2=0x7f41981efb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:54.648 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.644+0000 7f419f283640 1 --2- 172.21.15.88:0/2495166051 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f419813feb0 0x7f41981efb40 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f419002abc0 tx=0x7f4190004a40 comp rx=0 tx=0).stop 2024-04-26T23:40:54.648 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.644+0000 7f419f283640 1 -- 172.21.15.88:0/2495166051 shutdown_connections 2024-04-26T23:40:54.648 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.644+0000 7f419f283640 1 --2- 172.21.15.88:0/2495166051 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f417c06c8f0 0x7f417c06edb0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:54.648 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.644+0000 7f419f283640 1 --2- 172.21.15.88:0/2495166051 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f41980c5050 0x7f419806c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:54.648 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.644+0000 7f419f283640 1 --2- 172.21.15.88:0/2495166051 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f419813feb0 0x7f41981efb40 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:54.649 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.644+0000 7f419f283640 1 --2- 172.21.15.88:0/2495166051 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f41980c2b80 0x7f41980726d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:54.649 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.644+0000 7f419f283640 1 -- 172.21.15.88:0/2495166051 >> 172.21.15.88:0/2495166051 conn(0x7f41980c5ce0 msgr2=0x7f41980ad530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:40:54.649 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.644+0000 7f419f283640 1 -- 172.21.15.88:0/2495166051 shutdown_connections 2024-04-26T23:40:54.649 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.644+0000 7f419f283640 1 -- 172.21.15.88:0/2495166051 wait complete. 2024-04-26T23:40:54.659 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T23:40:54.756 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.752+0000 7f32badf0640 1 Processor -- start 2024-04-26T23:40:54.756 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.752+0000 7f32badf0640 1 -- start start 2024-04-26T23:40:54.759 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.753+0000 7f32badf0640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f32b41510c0 0x7f32b4072f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:54.759 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.753+0000 7f32badf0640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f32b40734d0 0x7f32b406d320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:54.759 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.753+0000 7f32badf0640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f32b40c4160 0x7f32b4157070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:54.759 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.753+0000 7f32badf0640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f32b40c50d0 con 0x7f32b40734d0 2024-04-26T23:40:54.759 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.753+0000 7f32badf0640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f32b40c4b50 con 0x7f32b40c4160 2024-04-26T23:40:54.759 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.753+0000 7f32badf0640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f32b41514a0 con 0x7f32b41510c0 2024-04-26T23:40:54.759 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.753+0000 7f32b3fff640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f32b40734d0 0x7f32b406d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:54.759 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.753+0000 7f32b3fff640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f32b40734d0 0x7f32b406d320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:41888/0 (socket says 172.21.15.88:41888) 2024-04-26T23:40:54.759 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.753+0000 7f32b3fff640 1 -- 172.21.15.88:0/3067079504 learned_addr learned my addr 172.21.15.88:0/3067079504 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:40:54.759 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.753+0000 7f32b938d640 1 --2- 172.21.15.88:0/3067079504 >> v2:172.21.15.175:3300/0 conn(0x7f32b40c4160 0x7f32b4157070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:54.759 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.754+0000 7f32b8b8c640 1 --2- 172.21.15.88:0/3067079504 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f32b41510c0 0x7f32b4072f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:54.760 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.754+0000 7f32b3fff640 1 -- 172.21.15.88:0/3067079504 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f32b41510c0 msgr2=0x7f32b4072f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:40:54.760 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.754+0000 7f32b3fff640 1 --2- 172.21.15.88:0/3067079504 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f32b41510c0 0x7f32b4072f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:54.760 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.754+0000 7f32b3fff640 1 -- 172.21.15.88:0/3067079504 >> v2:172.21.15.175:3300/0 conn(0x7f32b40c4160 msgr2=0x7f32b4157070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:40:54.760 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.754+0000 7f32b3fff640 1 --2- 172.21.15.88:0/3067079504 >> v2:172.21.15.175:3300/0 conn(0x7f32b40c4160 0x7f32b4157070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:54.760 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.754+0000 7f32b3fff640 1 -- 172.21.15.88:0/3067079504 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32b4154920 con 0x7f32b40734d0 2024-04-26T23:40:54.760 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.754+0000 7f32b3fff640 1 --2- 172.21.15.88:0/3067079504 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f32b40734d0 0x7f32b406d320 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f32b4073e00 tx=0x7f32a802a0b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=491cd15e61793269 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:54.760 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.754+0000 7f32b37fe640 1 -- 172.21.15.88:0/3067079504 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32a8037070 con 0x7f32b40734d0 2024-04-26T23:40:54.760 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.754+0000 7f32b37fe640 1 -- 172.21.15.88:0/3067079504 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32a802ae00 con 0x7f32b40734d0 2024-04-26T23:40:54.760 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.754+0000 7f32b37fe640 1 -- 172.21.15.88:0/3067079504 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32a8032660 con 0x7f32b40734d0 2024-04-26T23:40:54.760 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.755+0000 7f32badf0640 1 -- 172.21.15.88:0/3067079504 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f32b40734d0 msgr2=0x7f32b406d320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:54.760 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.755+0000 7f32badf0640 1 --2- 172.21.15.88:0/3067079504 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f32b40734d0 0x7f32b406d320 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f32b4073e00 tx=0x7f32a802a0b0 comp rx=0 tx=0).stop 2024-04-26T23:40:54.760 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.755+0000 7f32badf0640 1 -- 172.21.15.88:0/3067079504 shutdown_connections 2024-04-26T23:40:54.760 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.755+0000 7f32badf0640 1 --2- 172.21.15.88:0/3067079504 >> v2:172.21.15.175:3300/0 conn(0x7f32b40c4160 0x7f32b4157070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:54.760 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.755+0000 7f32badf0640 1 --2- 172.21.15.88:0/3067079504 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f32b40734d0 0x7f32b406d320 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:54.760 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.755+0000 7f32badf0640 1 --2- 172.21.15.88:0/3067079504 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f32b41510c0 0x7f32b4072f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:54.761 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.755+0000 7f32badf0640 1 -- 172.21.15.88:0/3067079504 >> 172.21.15.88:0/3067079504 conn(0x7f32b40c5ce0 msgr2=0x7f32b40c60f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:40:54.761 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.755+0000 7f32badf0640 1 -- 172.21.15.88:0/3067079504 shutdown_connections 2024-04-26T23:40:54.761 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.755+0000 7f32badf0640 1 -- 172.21.15.88:0/3067079504 wait complete. 2024-04-26T23:40:54.763 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.756+0000 7f32badf0640 1 Processor -- start 2024-04-26T23:40:54.763 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.756+0000 7f32badf0640 1 -- start start 2024-04-26T23:40:54.763 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.757+0000 7f32badf0640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f32b40c4160 0x7f32b414b360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:54.763 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.757+0000 7f32badf0640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f32b41510c0 0x7f32b414b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:54.763 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.757+0000 7f32badf0640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f32b40aee30 0x7f32b41f0130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:54.763 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.757+0000 7f32badf0640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f32b40c5920 con 0x7f32b40c4160 2024-04-26T23:40:54.764 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.757+0000 7f32badf0640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f32b40c5400 con 0x7f32b40aee30 2024-04-26T23:40:54.764 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.757+0000 7f32badf0640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f32b406f500 con 0x7f32b41510c0 2024-04-26T23:40:54.764 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.757+0000 7f32b8b8c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f32b40c4160 0x7f32b414b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:54.764 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.757+0000 7f32b8b8c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f32b40c4160 0x7f32b414b360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:41890/0 (socket says 172.21.15.88:41890) 2024-04-26T23:40:54.764 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.757+0000 7f32b8b8c640 1 -- 172.21.15.88:0/2444904269 learned_addr learned my addr 172.21.15.88:0/2444904269 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:40:54.764 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.757+0000 7f32b938d640 1 --2- 172.21.15.88:0/2444904269 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f32b40aee30 0x7f32b41f0130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:54.764 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.757+0000 7f32b3fff640 1 --2- 172.21.15.88:0/2444904269 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f32b41510c0 0x7f32b414b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:54.764 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.757+0000 7f32b8b8c640 1 -- 172.21.15.88:0/2444904269 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f32b41510c0 msgr2=0x7f32b414b8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:54.764 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.757+0000 7f32b8b8c640 1 --2- 172.21.15.88:0/2444904269 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f32b41510c0 0x7f32b414b8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:54.764 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.757+0000 7f32b8b8c640 1 -- 172.21.15.88:0/2444904269 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f32b40aee30 msgr2=0x7f32b41f0130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:54.764 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.757+0000 7f32b8b8c640 1 --2- 172.21.15.88:0/2444904269 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f32b40aee30 0x7f32b41f0130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:54.764 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.757+0000 7f32b8b8c640 1 -- 172.21.15.88:0/2444904269 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32b4152770 con 0x7f32b40c4160 2024-04-26T23:40:54.764 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.757+0000 7f32b8b8c640 1 --2- 172.21.15.88:0/2444904269 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f32b40c4160 0x7f32b414b360 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f32a400d650 tx=0x7f32a400db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:54.764 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.757+0000 7f32b17fa640 1 -- 172.21.15.88:0/2444904269 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32a400b6c0 con 0x7f32b40c4160 2024-04-26T23:40:54.764 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.758+0000 7f32b17fa640 1 -- 172.21.15.88:0/2444904269 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32a4019070 con 0x7f32b40c4160 2024-04-26T23:40:54.764 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.758+0000 7f32badf0640 1 -- 172.21.15.88:0/2444904269 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32b4152a50 con 0x7f32b40c4160 2024-04-26T23:40:54.765 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.758+0000 7f32b17fa640 1 -- 172.21.15.88:0/2444904269 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32a400baa0 con 0x7f32b40c4160 2024-04-26T23:40:54.765 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.758+0000 7f32badf0640 1 -- 172.21.15.88:0/2444904269 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32b4153010 con 0x7f32b40c4160 2024-04-26T23:40:54.765 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.759+0000 7f32badf0640 1 -- 172.21.15.88:0/2444904269 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f32b40507a0 con 0x7f32b40c4160 2024-04-26T23:40:54.765 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.759+0000 7f32b17fa640 1 -- 172.21.15.88:0/2444904269 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f32a400bc40 con 0x7f32b40c4160 2024-04-26T23:40:54.765 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.759+0000 7f32b17fa640 1 --2- 172.21.15.88:0/2444904269 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f32a006c920 0x7f32a006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:54.765 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.759+0000 7f32b17fa640 1 -- 172.21.15.88:0/2444904269 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7f32a408c160 con 0x7f32b40c4160 2024-04-26T23:40:54.765 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.759+0000 7f32b3fff640 1 --2- 172.21.15.88:0/2444904269 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f32a006c920 0x7f32a006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:54.765 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.760+0000 7f32b3fff640 1 --2- 172.21.15.88:0/2444904269 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f32a006c920 0x7f32a006ede0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f32a8034000 tx=0x7f32a802e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:54.767 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.764+0000 7f32b17fa640 1 -- 172.21.15.88:0/2444904269 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f32a405a2f0 con 0x7f32b40c4160 2024-04-26T23:40:54.980 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.976+0000 7f32badf0640 1 -- 172.21.15.88:0/2444904269 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f32b40c3ed0 con 0x7f32b40c4160 2024-04-26T23:40:54.980 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.976+0000 7f32b17fa640 1 -- 172.21.15.88:0/2444904269 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+6488 (secure 0 0 0) 0x7f32a4059bf0 con 0x7f32b40c4160 2024-04-26T23:40:54.981 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-26T23:40:54.981 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":12,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6834/3199540397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":3199540397},{"type":"v1","addr":"172.21.15.175:6834","nonce":3199540397}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4270,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6837/2790134952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6835","nonce":2790134952},{"type":"v1","addr":"172.21.15.88:6837","nonce":2790134952}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T23:40:31.909505+0000","modified":"2024-04-26T23:40:34.974455+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4279},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4279":{"gid":4279,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.175:6835/3932058274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6833","nonce":3932058274},{"type":"v1","addr":"172.21.15.175:6835","nonce":3932058274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4279,"qdb_cluster":[4279]},"id":1},{"mdsmap":{"epoch":12,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T23:40:41.008364+0000","modified":"2024-04-26T23:40:44.027288+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4272":{"gid":4272,"name":"c","rank":0,"incarnation":9,"state":"up:active","state_seq":6,"addr":"172.21.15.88:6836/4159390276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6834","nonce":4159390276},{"type":"v1","addr":"172.21.15.88:6836","nonce":4159390276}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4272,"qdb_cluster":[4272]},"id":2}]} 2024-04-26T23:40:54.981 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 12 2024-04-26T23:40:54.983 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.978+0000 7f32badf0640 1 -- 172.21.15.88:0/2444904269 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f32a006c920 msgr2=0x7f32a006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:54.983 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.978+0000 7f32badf0640 1 --2- 172.21.15.88:0/2444904269 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f32a006c920 0x7f32a006ede0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f32a8034000 tx=0x7f32a802e000 comp rx=0 tx=0).stop 2024-04-26T23:40:54.983 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.978+0000 7f32badf0640 1 -- 172.21.15.88:0/2444904269 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f32b40c4160 msgr2=0x7f32b414b360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:54.983 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.978+0000 7f32badf0640 1 --2- 172.21.15.88:0/2444904269 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f32b40c4160 0x7f32b414b360 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f32a400d650 tx=0x7f32a400db10 comp rx=0 tx=0).stop 2024-04-26T23:40:54.983 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.978+0000 7f32badf0640 1 -- 172.21.15.88:0/2444904269 shutdown_connections 2024-04-26T23:40:54.983 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.978+0000 7f32badf0640 1 --2- 172.21.15.88:0/2444904269 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f32a006c920 0x7f32a006ede0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:54.983 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.978+0000 7f32badf0640 1 --2- 172.21.15.88:0/2444904269 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f32b41510c0 0x7f32b414b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:54.983 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.978+0000 7f32badf0640 1 --2- 172.21.15.88:0/2444904269 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f32b40aee30 0x7f32b41f0130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:54.983 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.978+0000 7f32badf0640 1 --2- 172.21.15.88:0/2444904269 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f32b40c4160 0x7f32b414b360 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:54.983 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.978+0000 7f32badf0640 1 -- 172.21.15.88:0/2444904269 >> 172.21.15.88:0/2444904269 conn(0x7f32b40c5ce0 msgr2=0x7f32b4072500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:40:54.983 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.979+0000 7f32badf0640 1 -- 172.21.15.88:0/2444904269 shutdown_connections 2024-04-26T23:40:54.983 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:54.979+0000 7f32badf0640 1 -- 172.21.15.88:0/2444904269 wait complete. 2024-04-26T23:40:54.994 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T23:40:55.089 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:55.085+0000 7f78ff693640 1 Processor -- start 2024-04-26T23:40:55.089 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:55.085+0000 7f78ff693640 1 -- start start 2024-04-26T23:40:55.090 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:55.086+0000 7f78ff693640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f78f8154160 0x7f78f8156bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:55.091 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:55.086+0000 7f78ff693640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f78f80ca5a0 0x7f78f815a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:55.091 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:55.086+0000 7f78ff693640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f78f80c8df0 con 0x7f78f80c6e00 2024-04-26T23:40:55.091 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:55.086+0000 7f78ff693640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f78f815a6e0 con 0x7f78f80ca5a0 2024-04-26T23:40:55.091 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:55.086+0000 7f78ff693640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f78f80c9100 con 0x7f78f8154160 2024-04-26T23:40:55.091 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:55.086+0000 7f78fcc2e640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f78f80ca5a0 0x7f78f815a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:55.091 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:55.086+0000 7f78fcc2e640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f78f80ca5a0 0x7f78f815a1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:41894/0 (socket says 172.21.15.88:41894) 2024-04-26T23:40:55.091 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:55.086+0000 7f78fcc2e640 1 -- 172.21.15.88:0/3665948225 learned_addr learned my addr 172.21.15.88:0/3665948225 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:40:55.091 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:55.086+0000 7f78fd42f640 1 --2- 172.21.15.88:0/3665948225 >> v2:172.21.15.175:3300/0 conn(0x7f78f8154160 0x7f78f8156bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:55.091 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:55.087+0000 7f78fcc2e640 1 -- 172.21.15.88:0/3665948225 >> v2:172.21.15.175:3300/0 conn(0x7f78f8154160 msgr2=0x7f78f8156bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:40:55.092 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:55.087+0000 7f78fcc2e640 1 --2- 172.21.15.88:0/3665948225 >> v2:172.21.15.175:3300/0 conn(0x7f78f8154160 0x7f78f8156bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:55.092 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:55.087+0000 7f78fcc2e640 1 -- 172.21.15.88:0/3665948225 >> v1:172.21.15.175:6789/0 conn(0x7f78f80c6e00 legacy=0x7f78f80c9590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:40:55.092 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:55.087+0000 7f78fcc2e640 1 -- 172.21.15.88:0/3665948225 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78f8154540 con 0x7f78f80ca5a0 2024-04-26T23:40:55.093 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:55.087+0000 7f78fcc2e640 1 --2- 172.21.15.88:0/3665948225 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f78f80ca5a0 0x7f78f815a1a0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f78f80c9280 tx=0x7f78e802a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=280f2674550f25eb server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:55.093 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:55.087+0000 7f78effff640 1 -- 172.21.15.88:0/3665948225 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78e8037070 con 0x7f78f80ca5a0 2024-04-26T23:40:55.093 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:55.087+0000 7f78effff640 1 -- 172.21.15.88:0/3665948225 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78e8032440 con 0x7f78f80ca5a0 2024-04-26T23:40:55.093 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:55.087+0000 7f78effff640 1 -- 172.21.15.88:0/3665948225 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78e8032810 con 0x7f78f80ca5a0 2024-04-26T23:40:55.093 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:55.088+0000 7f78ff693640 1 -- 172.21.15.88:0/3665948225 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f78f80ca5a0 msgr2=0x7f78f815a1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:55.093 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:55.088+0000 7f78ff693640 1 --2- 172.21.15.88:0/3665948225 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f78f80ca5a0 0x7f78f815a1a0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f78f80c9280 tx=0x7f78e802a210 comp rx=0 tx=0).stop 2024-04-26T23:40:55.093 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:55.088+0000 7f78ff693640 1 -- 172.21.15.88:0/3665948225 shutdown_connections 2024-04-26T23:40:55.093 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:55.088+0000 7f78ff693640 1 --2- 172.21.15.88:0/3665948225 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f78f80ca5a0 0x7f78f815a1a0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:55.094 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:55.088+0000 7f78ff693640 1 --2- 172.21.15.88:0/3665948225 >> v2:172.21.15.175:3300/0 conn(0x7f78f8154160 0x7f78f8156bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:55.094 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:55.088+0000 7f78ff693640 1 -- 172.21.15.88:0/3665948225 >> 172.21.15.88:0/3665948225 conn(0x7f78f80ae010 msgr2=0x7f78f80ae3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:40:55.094 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:55.088+0000 7f78ff693640 1 -- 172.21.15.88:0/3665948225 shutdown_connections 2024-04-26T23:40:55.094 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:55.088+0000 7f78ff693640 1 -- 172.21.15.88:0/3665948225 wait complete. 2024-04-26T23:40:55.094 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:55.089+0000 7f78ff693640 1 Processor -- start 2024-04-26T23:40:55.094 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:55.089+0000 7f78ff693640 1 -- start start 2024-04-26T23:40:55.096 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:55.090+0000 7f78ff693640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f78f80c6e00 0x7f78f814fee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:55.096 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:55.090+0000 7f78ff693640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f78f80ca5a0 0x7f78f8149060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:55.096 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:55.090+0000 7f78ff693640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f78f8154160 0x7f78f81495a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:55.096 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:55.090+0000 7f78ff693640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f78f815aed0 con 0x7f78f80c6e00 2024-04-26T23:40:55.096 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:55.090+0000 7f78ff693640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f78f815abf0 con 0x7f78f8154160 2024-04-26T23:40:55.096 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:55.090+0000 7f78ff693640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f78f80c9ca0 con 0x7f78f80ca5a0 2024-04-26T23:40:55.096 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:55.090+0000 7f78fd42f640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f78f80c6e00 0x7f78f814fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:55.096 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:55.090+0000 7f78fd42f640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f78f80c6e00 0x7f78f814fee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:41896/0 (socket says 172.21.15.88:41896) 2024-04-26T23:40:55.096 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:55.090+0000 7f78fd42f640 1 -- 172.21.15.88:0/3509356147 learned_addr learned my addr 172.21.15.88:0/3509356147 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:40:55.096 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:55.090+0000 7f78fdc30640 1 --2- 172.21.15.88:0/3509356147 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f78f8154160 0x7f78f81495a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:55.096 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:55.090+0000 7f78fcc2e640 1 --2- 172.21.15.88:0/3509356147 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f78f80ca5a0 0x7f78f8149060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:55.096 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:55.090+0000 7f78fd42f640 1 -- 172.21.15.88:0/3509356147 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f78f80ca5a0 msgr2=0x7f78f8149060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:55.096 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:55.090+0000 7f78fd42f640 1 --2- 172.21.15.88:0/3509356147 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f78f80ca5a0 0x7f78f8149060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:55.096 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:55.090+0000 7f78fd42f640 1 -- 172.21.15.88:0/3509356147 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f78f8154160 msgr2=0x7f78f81495a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:55.097 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:55.090+0000 7f78fd42f640 1 --2- 172.21.15.88:0/3509356147 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f78f8154160 0x7f78f81495a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:55.097 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:55.090+0000 7f78fd42f640 1 -- 172.21.15.88:0/3509356147 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78f8159980 con 0x7f78f80c6e00 2024-04-26T23:40:55.097 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:55.090+0000 7f78fdc30640 1 --2- 172.21.15.88:0/3509356147 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f78f8154160 0x7f78f81495a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:40:55.097 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:55.090+0000 7f78fd42f640 1 --2- 172.21.15.88:0/3509356147 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f78f80c6e00 0x7f78f814fee0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f78f4007e70 tx=0x7f78f400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:55.097 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:55.090+0000 7f78edffb640 1 -- 172.21.15.88:0/3509356147 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78f4014620 con 0x7f78f80c6e00 2024-04-26T23:40:55.097 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:55.091+0000 7f78edffb640 1 -- 172.21.15.88:0/3509356147 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78f4019070 con 0x7f78f80c6e00 2024-04-26T23:40:55.097 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:55.091+0000 7f78ff693640 1 -- 172.21.15.88:0/3509356147 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78f8159c60 con 0x7f78f80c6e00 2024-04-26T23:40:55.097 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:55.091+0000 7f78edffb640 1 -- 172.21.15.88:0/3509356147 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78f4014a00 con 0x7f78f80c6e00 2024-04-26T23:40:55.097 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:55.091+0000 7f78ff693640 1 -- 172.21.15.88:0/3509356147 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78f8151ab0 con 0x7f78f80c6e00 2024-04-26T23:40:55.097 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:55.092+0000 7f78ff693640 1 -- 172.21.15.88:0/3509356147 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f78f8076650 con 0x7f78f80c6e00 2024-04-26T23:40:55.097 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:55.092+0000 7f78edffb640 1 -- 172.21.15.88:0/3509356147 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f78f4014ba0 con 0x7f78f80c6e00 2024-04-26T23:40:55.098 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:55.092+0000 7f78edffb640 1 --2- 172.21.15.88:0/3509356147 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f78dc06c920 0x7f78dc06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:55.098 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:55.093+0000 7f78fcc2e640 1 --2- 172.21.15.88:0/3509356147 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f78dc06c920 0x7f78dc06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:55.098 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:55.093+0000 7f78edffb640 1 -- 172.21.15.88:0/3509356147 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7f78f408c670 con 0x7f78f80c6e00 2024-04-26T23:40:55.098 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:55.093+0000 7f78fcc2e640 1 --2- 172.21.15.88:0/3509356147 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f78dc06c920 0x7f78dc06ede0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f78e8034000 tx=0x7f78e802e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:55.100 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:55.097+0000 7f78edffb640 1 -- 172.21.15.88:0/3509356147 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f78f4011260 con 0x7f78f80c6e00 2024-04-26T23:40:55.275 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:55.271+0000 7f78ff693640 1 -- 172.21.15.88:0/3509356147 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f78f80507a0 con 0x7f78f80c6e00 2024-04-26T23:40:55.277 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:55.273+0000 7f78edffb640 1 -- 172.21.15.88:0/3509356147 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+20343 (secure 0 0 0) 0x7f78f405a800 con 0x7f78f80c6e00 2024-04-26T23:40:55.277 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-26T23:40:55.277 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":24,"fsid":"555255e9-7ef9-4454-8dc9-35e96b70035c","created":"2024-04-26T23:40:07.836009+0000","modified":"2024-04-26T23:40:42.673801+0000","last_up_change":"2024-04-26T23:40:18.831369+0000","last_in_change":"2024-04-26T23:40:09.944777+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T23:40:19.936127+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"a_metadata","create_time":"2024-04-26T23:40:29.837465+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"a_data","create_time":"2024-04-26T23:40:30.868651+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"b_metadata","create_time":"2024-04-26T23:40:38.753441+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"b_data","create_time":"2024-04-26T23:40:39.974557+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"92aecea3-ed62-4a29-87c0-76758a0816a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":2803186054},{"type":"v1","addr":"172.21.15.88:6801","nonce":2803186054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":2803186054},{"type":"v1","addr":"172.21.15.88:6803","nonce":2803186054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":2803186054},{"type":"v1","addr":"172.21.15.88:6807","nonce":2803186054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":2803186054},{"type":"v1","addr":"172.21.15.88:6805","nonce":2803186054}]},"public_addr":"172.21.15.88:6801/2803186054","cluster_addr":"172.21.15.88:6803/2803186054","heartbeat_back_addr":"172.21.15.88:6807/2803186054","heartbeat_front_addr":"172.21.15.88:6805/2803186054","state":["exists","up"]},{"osd":1,"uuid":"7a6f0fa9-23d0-4747-880f-798d45ec5eeb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":1897380484},{"type":"v1","addr":"172.21.15.88:6817","nonce":1897380484}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":1897380484},{"type":"v1","addr":"172.21.15.88:6819","nonce":1897380484}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1897380484},{"type":"v1","addr":"172.21.15.88:6823","nonce":1897380484}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":1897380484},{"type":"v1","addr":"172.21.15.88:6821","nonce":1897380484}]},"public_addr":"172.21.15.88:6817/1897380484","cluster_addr":"172.21.15.88:6819/1897380484","heartbeat_back_addr":"172.21.15.88:6823/1897380484","heartbeat_front_addr":"172.21.15.88:6821/1897380484","state":["exists","up"]},{"osd":2,"uuid":"6be88ea0-e133-4200-a4b5-f92d664b248a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":648396269},{"type":"v1","addr":"172.21.15.88:6809","nonce":648396269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":648396269},{"type":"v1","addr":"172.21.15.88:6811","nonce":648396269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":648396269},{"type":"v1","addr":"172.21.15.88:6815","nonce":648396269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":648396269},{"type":"v1","addr":"172.21.15.88:6813","nonce":648396269}]},"public_addr":"172.21.15.88:6809/648396269","cluster_addr":"172.21.15.88:6811/648396269","heartbeat_back_addr":"172.21.15.88:6815/648396269","heartbeat_front_addr":"172.21.15.88:6813/648396269","state":["exists","up"]},{"osd":3,"uuid":"dcb0746b-7b3d-4ecf-8089-2493a5d1857c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":2328028922},{"type":"v1","addr":"172.21.15.88:6825","nonce":2328028922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":2328028922},{"type":"v1","addr":"172.21.15.88:6827","nonce":2328028922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":2328028922},{"type":"v1","addr":"172.21.15.88:6831","nonce":2328028922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":2328028922},{"type":"v1","addr":"172.21.15.88:6829","nonce":2328028922}]},"public_addr":"172.21.15.88:6825/2328028922","cluster_addr":"172.21.15.88:6827/2328028922","heartbeat_back_addr":"172.21.15.88:6831/2328028922","heartbeat_front_addr":"172.21.15.88:6829/2328028922","state":["exists","up"]},{"osd":4,"uuid":"c483de66-c44f-450e-a4ce-b132d50882c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":3929617402},{"type":"v1","addr":"172.21.15.175:6809","nonce":3929617402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":3929617402},{"type":"v1","addr":"172.21.15.175:6811","nonce":3929617402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":3929617402},{"type":"v1","addr":"172.21.15.175:6815","nonce":3929617402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":3929617402},{"type":"v1","addr":"172.21.15.175:6813","nonce":3929617402}]},"public_addr":"172.21.15.175:6809/3929617402","cluster_addr":"172.21.15.175:6811/3929617402","heartbeat_back_addr":"172.21.15.175:6815/3929617402","heartbeat_front_addr":"172.21.15.175:6813/3929617402","state":["exists","up"]},{"osd":5,"uuid":"ac3b1669-d228-40dd-9f9a-cb46aa73dd6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":2476644457},{"type":"v1","addr":"172.21.15.175:6801","nonce":2476644457}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":2476644457},{"type":"v1","addr":"172.21.15.175:6803","nonce":2476644457}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":2476644457},{"type":"v1","addr":"172.21.15.175:6807","nonce":2476644457}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":2476644457},{"type":"v1","addr":"172.21.15.175:6805","nonce":2476644457}]},"public_addr":"172.21.15.175:6801/2476644457","cluster_addr":"172.21.15.175:6803/2476644457","heartbeat_back_addr":"172.21.15.175:6807/2476644457","heartbeat_front_addr":"172.21.15.175:6805/2476644457","state":["exists","up"]},{"osd":6,"uuid":"7bef4896-857e-4c11-b3b2-c2e9a8548338","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":3824112919},{"type":"v1","addr":"172.21.15.175:6819","nonce":3824112919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6821","nonce":3824112919},{"type":"v1","addr":"172.21.15.175:6824","nonce":3824112919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":3824112919},{"type":"v1","addr":"172.21.15.175:6831","nonce":3824112919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":3824112919},{"type":"v1","addr":"172.21.15.175:6829","nonce":3824112919}]},"public_addr":"172.21.15.175:6819/3824112919","cluster_addr":"172.21.15.175:6824/3824112919","heartbeat_back_addr":"172.21.15.175:6831/3824112919","heartbeat_front_addr":"172.21.15.175:6829/3824112919","state":["exists","up"]},{"osd":7,"uuid":"e18d9e09-8673-470d-b9dc-280a409b63f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6817","nonce":3319361162},{"type":"v1","addr":"172.21.15.175:6818","nonce":3319361162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":3319361162},{"type":"v1","addr":"172.21.15.175:6822","nonce":3319361162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6827","nonce":3319361162},{"type":"v1","addr":"172.21.15.175:6828","nonce":3319361162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6823","nonce":3319361162},{"type":"v1","addr":"172.21.15.175:6825","nonce":3319361162}]},"public_addr":"172.21.15.175:6818/3319361162","cluster_addr":"172.21.15.175:6822/3319361162","heartbeat_back_addr":"172.21.15.175:6828/3319361162","heartbeat_front_addr":"172.21.15.175:6825/3319361162","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:40:15.126268+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:40:15.050614+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:40:14.995164+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:40:15.078112+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:40:15.159637+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:40:15.091226+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:40:15.140316+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:40:15.089431+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:40:55.279 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:55.275+0000 7f78ff693640 1 -- 172.21.15.88:0/3509356147 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f78dc06c920 msgr2=0x7f78dc06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:55.279 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:55.275+0000 7f78ff693640 1 --2- 172.21.15.88:0/3509356147 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f78dc06c920 0x7f78dc06ede0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f78e8034000 tx=0x7f78e802e000 comp rx=0 tx=0).stop 2024-04-26T23:40:55.279 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:55.275+0000 7f78ff693640 1 -- 172.21.15.88:0/3509356147 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f78f80c6e00 msgr2=0x7f78f814fee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:55.279 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:55.275+0000 7f78ff693640 1 --2- 172.21.15.88:0/3509356147 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f78f80c6e00 0x7f78f814fee0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f78f4007e70 tx=0x7f78f400e4b0 comp rx=0 tx=0).stop 2024-04-26T23:40:55.279 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:55.275+0000 7f78ff693640 1 -- 172.21.15.88:0/3509356147 shutdown_connections 2024-04-26T23:40:55.279 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:55.275+0000 7f78ff693640 1 --2- 172.21.15.88:0/3509356147 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f78dc06c920 0x7f78dc06ede0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:55.280 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:55.275+0000 7f78ff693640 1 --2- 172.21.15.88:0/3509356147 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f78f80ca5a0 0x7f78f8149060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:55.280 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:55.275+0000 7f78ff693640 1 --2- 172.21.15.88:0/3509356147 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f78f8154160 0x7f78f81495a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:55.280 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:55.275+0000 7f78ff693640 1 --2- 172.21.15.88:0/3509356147 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f78f80c6e00 0x7f78f814fee0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:55.280 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:55.275+0000 7f78ff693640 1 -- 172.21.15.88:0/3509356147 >> 172.21.15.88:0/3509356147 conn(0x7f78f80ae010 msgr2=0x7f78f814e590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:40:55.280 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:55.275+0000 7f78ff693640 1 -- 172.21.15.88:0/3509356147 shutdown_connections 2024-04-26T23:40:55.280 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:55.275+0000 7f78ff693640 1 -- 172.21.15.88:0/3509356147 wait complete. 2024-04-26T23:40:55.290 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T23:40:55.386 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:55.382+0000 7f6ea077f640 1 Processor -- start 2024-04-26T23:40:55.386 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:55.382+0000 7f6ea077f640 1 -- start start 2024-04-26T23:40:55.387 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:55.383+0000 7f6ea077f640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f6e980c4d60 0x7f6e980c68e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:55.387 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:55.383+0000 7f6ea077f640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6e9806f8f0 0x7f6e9806fd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:55.388 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:55.383+0000 7f6ea077f640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6e980abb80 con 0x7f6e9814b480 2024-04-26T23:40:55.388 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:55.383+0000 7f6ea077f640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f6e98074830 con 0x7f6e980c4d60 2024-04-26T23:40:55.388 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:55.383+0000 7f6ea077f640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f6e980c5b20 con 0x7f6e9806f8f0 2024-04-26T23:40:55.388 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:55.383+0000 7f6e9ed1c640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6e9806f8f0 0x7f6e9806fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:55.388 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:55.383+0000 7f6e9dd1a640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f6e980c4d60 0x7f6e980c68e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:55.388 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:55.383+0000 7f6e9e51b640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f6e9814b480 0x7f6e980ab470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.88:48612/0 (socket says 172.21.15.88:48612) 2024-04-26T23:40:55.388 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:55.383+0000 7f6e9e51b640 1 -- 172.21.15.88:0/71302205 learned_addr learned my addr 172.21.15.88:0/71302205 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-26T23:40:55.388 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:55.384+0000 7f6e9ed1c640 1 -- 172.21.15.88:0/71302205 >> v2:172.21.15.175:3300/0 conn(0x7f6e980c4d60 msgr2=0x7f6e980c68e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:40:55.388 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:55.384+0000 7f6e9ed1c640 1 --2- 172.21.15.88:0/71302205 >> v2:172.21.15.175:3300/0 conn(0x7f6e980c4d60 0x7f6e980c68e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:55.388 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:55.384+0000 7f6e9ed1c640 1 -- 172.21.15.88:0/71302205 >> v1:172.21.15.175:6789/0 conn(0x7f6e9814b480 legacy=0x7f6e980ab470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:55.388 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:55.384+0000 7f6e9ed1c640 1 -- 172.21.15.88:0/71302205 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e980c5e00 con 0x7f6e9806f8f0 2024-04-26T23:40:55.388 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:55.384+0000 7f6e9dd1a640 1 --2- 172.21.15.88:0/71302205 >> v2:172.21.15.175:3300/0 conn(0x7f6e980c4d60 0x7f6e980c68e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:40:55.390 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:55.384+0000 7f6e9ed1c640 1 --2- 172.21.15.88:0/71302205 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6e9806f8f0 0x7f6e9806fd80 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f6e900097a0 tx=0x7f6e9002a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c79bff2b06ae20ab server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:55.390 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:55.384+0000 7f6e9d519640 1 -- 172.21.15.88:0/71302205 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e90037070 con 0x7f6e9806f8f0 2024-04-26T23:40:55.390 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:55.385+0000 7f6e9d519640 1 -- 172.21.15.88:0/71302205 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e90032440 con 0x7f6e9806f8f0 2024-04-26T23:40:55.390 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:55.385+0000 7f6e9d519640 1 -- 172.21.15.88:0/71302205 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e90032810 con 0x7f6e9806f8f0 2024-04-26T23:40:55.390 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:55.385+0000 7f6ea077f640 1 -- 172.21.15.88:0/71302205 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6e9806f8f0 msgr2=0x7f6e9806fd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:55.390 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:55.385+0000 7f6ea077f640 1 --2- 172.21.15.88:0/71302205 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6e9806f8f0 0x7f6e9806fd80 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f6e900097a0 tx=0x7f6e9002a180 comp rx=0 tx=0).stop 2024-04-26T23:40:55.390 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:55.385+0000 7f6ea077f640 1 -- 172.21.15.88:0/71302205 shutdown_connections 2024-04-26T23:40:55.390 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:55.385+0000 7f6ea077f640 1 --2- 172.21.15.88:0/71302205 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6e9806f8f0 0x7f6e9806fd80 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:55.390 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:55.385+0000 7f6ea077f640 1 --2- 172.21.15.88:0/71302205 >> v2:172.21.15.175:3300/0 conn(0x7f6e980c4d60 0x7f6e980c68e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:55.390 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:55.385+0000 7f6ea077f640 1 -- 172.21.15.88:0/71302205 >> 172.21.15.88:0/71302205 conn(0x7f6e980c6e60 msgr2=0x7f6e980c7240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:40:55.390 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:55.385+0000 7f6ea077f640 1 -- 172.21.15.88:0/71302205 shutdown_connections 2024-04-26T23:40:55.390 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:55.385+0000 7f6ea077f640 1 -- 172.21.15.88:0/71302205 wait complete. 2024-04-26T23:40:55.393 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:55.386+0000 7f6ea077f640 1 Processor -- start 2024-04-26T23:40:55.393 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:55.386+0000 7f6ea077f640 1 -- start start 2024-04-26T23:40:55.393 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:55.387+0000 7f6ea077f640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6e9806f8f0 0x7f6e98150eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:55.393 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:55.387+0000 7f6ea077f640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6e980c4d60 0x7f6e980afaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:55.393 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:55.387+0000 7f6ea077f640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6e9814b480 0x7f6e980b0030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:55.393 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:55.387+0000 7f6ea077f640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f6e9814b860 con 0x7f6e9814b480 2024-04-26T23:40:55.394 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:55.387+0000 7f6ea077f640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f6e980c63c0 con 0x7f6e980c4d60 2024-04-26T23:40:55.394 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:55.387+0000 7f6ea077f640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f6e98071310 con 0x7f6e9806f8f0 2024-04-26T23:40:55.394 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:55.387+0000 7f6e9ed1c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6e9814b480 0x7f6e980b0030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:55.394 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:55.387+0000 7f6e9ed1c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6e9814b480 0x7f6e980b0030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:41904/0 (socket says 172.21.15.88:41904) 2024-04-26T23:40:55.394 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:55.387+0000 7f6e9ed1c640 1 -- 172.21.15.88:0/152537205 learned_addr learned my addr 172.21.15.88:0/152537205 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:40:55.394 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:55.387+0000 7f6e9e51b640 1 --2- 172.21.15.88:0/152537205 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6e9806f8f0 0x7f6e98150eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:55.394 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:55.387+0000 7f6e9dd1a640 1 --2- 172.21.15.88:0/152537205 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6e980c4d60 0x7f6e980afaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:55.394 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:55.387+0000 7f6e9ed1c640 1 -- 172.21.15.88:0/152537205 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6e9806f8f0 msgr2=0x7f6e98150eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:55.394 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:55.387+0000 7f6e9ed1c640 1 --2- 172.21.15.88:0/152537205 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6e9806f8f0 0x7f6e98150eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:55.394 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:55.387+0000 7f6e9ed1c640 1 -- 172.21.15.88:0/152537205 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6e980c4d60 msgr2=0x7f6e980afaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:55.394 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:55.387+0000 7f6e9ed1c640 1 --2- 172.21.15.88:0/152537205 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6e980c4d60 0x7f6e980afaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:55.394 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:55.387+0000 7f6e9ed1c640 1 -- 172.21.15.88:0/152537205 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e981ea650 con 0x7f6e9814b480 2024-04-26T23:40:55.394 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:55.388+0000 7f6e9ed1c640 1 --2- 172.21.15.88:0/152537205 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6e9814b480 0x7f6e980b0030 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f6e90035040 tx=0x7f6e900046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:55.395 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:55.388+0000 7f6e8effd640 1 -- 172.21.15.88:0/152537205 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e90041030 con 0x7f6e9814b480 2024-04-26T23:40:55.395 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:55.388+0000 7f6e8effd640 1 -- 172.21.15.88:0/152537205 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e90030440 con 0x7f6e9814b480 2024-04-26T23:40:55.395 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:55.388+0000 7f6ea077f640 1 -- 172.21.15.88:0/152537205 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e981ea910 con 0x7f6e9814b480 2024-04-26T23:40:55.395 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:55.388+0000 7f6e8effd640 1 -- 172.21.15.88:0/152537205 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e90037040 con 0x7f6e9814b480 2024-04-26T23:40:55.395 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:55.388+0000 7f6ea077f640 1 -- 172.21.15.88:0/152537205 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e981eaed0 con 0x7f6e9814b480 2024-04-26T23:40:55.395 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:55.389+0000 7f6ea077f640 1 -- 172.21.15.88:0/152537205 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e9806f6e0 con 0x7f6e9814b480 2024-04-26T23:40:55.395 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:55.389+0000 7f6e8effd640 1 -- 172.21.15.88:0/152537205 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6e90044070 con 0x7f6e9814b480 2024-04-26T23:40:55.395 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:55.390+0000 7f6e8effd640 1 --2- 172.21.15.88:0/152537205 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f6e7c06c8f0 0x7f6e7c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:55.396 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:55.390+0000 7f6e9e51b640 1 --2- 172.21.15.88:0/152537205 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f6e7c06c8f0 0x7f6e7c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:55.396 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:55.390+0000 7f6e8effd640 1 -- 172.21.15.88:0/152537205 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7f6e900ac400 con 0x7f6e9814b480 2024-04-26T23:40:55.396 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:55.390+0000 7f6e9e51b640 1 --2- 172.21.15.88:0/152537205 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f6e7c06c8f0 0x7f6e7c06edb0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f6e940012e0 tx=0x7f6e94001990 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:55.398 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:55.394+0000 7f6e8effd640 1 -- 172.21.15.88:0/152537205 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f6e90079f40 con 0x7f6e9814b480 2024-04-26T23:40:55.610 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:55.607+0000 7f6ea077f640 1 -- 172.21.15.88:0/152537205 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6e980507a0 con 0x7f6e9814b480 2024-04-26T23:40:55.611 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:55.607+0000 7f6e8effd640 1 -- 172.21.15.88:0/152537205 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+6488 (secure 0 0 0) 0x7f6e9007e240 con 0x7f6e9814b480 2024-04-26T23:40:55.611 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-26T23:40:55.611 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":12,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6834/3199540397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":3199540397},{"type":"v1","addr":"172.21.15.175:6834","nonce":3199540397}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4270,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6837/2790134952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6835","nonce":2790134952},{"type":"v1","addr":"172.21.15.88:6837","nonce":2790134952}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T23:40:31.909505+0000","modified":"2024-04-26T23:40:34.974455+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4279},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4279":{"gid":4279,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.175:6835/3932058274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6833","nonce":3932058274},{"type":"v1","addr":"172.21.15.175:6835","nonce":3932058274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4279,"qdb_cluster":[4279]},"id":1},{"mdsmap":{"epoch":12,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T23:40:41.008364+0000","modified":"2024-04-26T23:40:44.027288+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4272":{"gid":4272,"name":"c","rank":0,"incarnation":9,"state":"up:active","state_seq":6,"addr":"172.21.15.88:6836/4159390276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6834","nonce":4159390276},{"type":"v1","addr":"172.21.15.88:6836","nonce":4159390276}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4272,"qdb_cluster":[4272]},"id":2}]} 2024-04-26T23:40:55.611 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 12 2024-04-26T23:40:55.613 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:55.609+0000 7f6ea077f640 1 -- 172.21.15.88:0/152537205 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f6e7c06c8f0 msgr2=0x7f6e7c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:55.613 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:55.609+0000 7f6ea077f640 1 --2- 172.21.15.88:0/152537205 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f6e7c06c8f0 0x7f6e7c06edb0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f6e940012e0 tx=0x7f6e94001990 comp rx=0 tx=0).stop 2024-04-26T23:40:55.613 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:55.609+0000 7f6ea077f640 1 -- 172.21.15.88:0/152537205 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6e9814b480 msgr2=0x7f6e980b0030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:55.614 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:55.609+0000 7f6ea077f640 1 --2- 172.21.15.88:0/152537205 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6e9814b480 0x7f6e980b0030 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f6e90035040 tx=0x7f6e900046c0 comp rx=0 tx=0).stop 2024-04-26T23:40:55.614 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:55.609+0000 7f6ea077f640 1 -- 172.21.15.88:0/152537205 shutdown_connections 2024-04-26T23:40:55.614 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:55.609+0000 7f6ea077f640 1 --2- 172.21.15.88:0/152537205 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f6e7c06c8f0 0x7f6e7c06edb0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:55.614 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:55.609+0000 7f6ea077f640 1 --2- 172.21.15.88:0/152537205 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6e9814b480 0x7f6e980b0030 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:55.614 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:55.609+0000 7f6ea077f640 1 --2- 172.21.15.88:0/152537205 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6e980c4d60 0x7f6e980afaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:55.614 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:55.609+0000 7f6ea077f640 1 --2- 172.21.15.88:0/152537205 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6e9806f8f0 0x7f6e98150eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:55.614 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:55.609+0000 7f6ea077f640 1 -- 172.21.15.88:0/152537205 >> 172.21.15.88:0/152537205 conn(0x7f6e980c6e60 msgr2=0x7f6e981524c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:40:55.614 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:55.609+0000 7f6ea077f640 1 -- 172.21.15.88:0/152537205 shutdown_connections 2024-04-26T23:40:55.614 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:55.609+0000 7f6ea077f640 1 -- 172.21.15.88:0/152537205 wait complete. 2024-04-26T23:40:56.026 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-26T23:40:31.909505+0000', 'modified': '2024-04-26T23:40:34.974455+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4279}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4279': {'gid': 4279, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.175:6835/3932058274', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.175:6833', 'nonce': 3932058274}, {'type': 'v1', 'addr': '172.21.15.175:6835', 'nonce': 3932058274}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'a', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4279, 'qdb_cluster': [4279]} 2024-04-26T23:40:56.026 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-26T23:40:56.027 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-04-26T23:40:56.126 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.123+0000 7fef5759e640 1 Processor -- start 2024-04-26T23:40:56.127 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.123+0000 7fef5759e640 1 -- start start 2024-04-26T23:40:56.130 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.123+0000 7fef5759e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fef5814d540 0x7fef580cb630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:56.130 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.123+0000 7fef5759e640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fef580cbb70 0x7fef58073940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:56.130 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.123+0000 7fef5759e640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fef5814d920 con 0x7fef58073e80 2024-04-26T23:40:56.130 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.123+0000 7fef5759e640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7fef581577f0 con 0x7fef580cbb70 2024-04-26T23:40:56.130 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.123+0000 7fef5759e640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fef58156be0 con 0x7fef5814d540 2024-04-26T23:40:56.130 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.124+0000 7fef56d9d640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fef58073e80 0x7fef580ca300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:58136/0 (socket says 172.21.15.88:58136) 2024-04-26T23:40:56.130 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.124+0000 7fef56d9d640 1 -- 172.21.15.88:0/3862200590 learned_addr learned my addr 172.21.15.88:0/3862200590 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-26T23:40:56.130 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.124+0000 7fef5659c640 1 --2- 172.21.15.88:0/3862200590 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fef5814d540 0x7fef580cb630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:56.130 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.124+0000 7fef55d9b640 1 --2- 172.21.15.88:0/3862200590 >> v2:172.21.15.175:3300/0 conn(0x7fef580cbb70 0x7fef58073940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:56.130 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.124+0000 7fef5559a640 1 -- 172.21.15.88:0/3862200590 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1935655896 0 0) 0x7fef5814d920 con 0x7fef58073e80 2024-04-26T23:40:56.130 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.124+0000 7fef5559a640 1 -- 172.21.15.88:0/3862200590 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fef40003520 con 0x7fef58073e80 2024-04-26T23:40:56.131 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.124+0000 7fef5559a640 1 -- 172.21.15.88:0/3862200590 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 742439359 0 0) 0x7fef40003520 con 0x7fef58073e80 2024-04-26T23:40:56.131 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.124+0000 7fef5659c640 1 -- 172.21.15.88:0/3862200590 >> v2:172.21.15.175:3300/0 conn(0x7fef580cbb70 msgr2=0x7fef58073940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:40:56.131 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.124+0000 7fef5659c640 1 --2- 172.21.15.88:0/3862200590 >> v2:172.21.15.175:3300/0 conn(0x7fef580cbb70 0x7fef58073940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:56.131 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.124+0000 7fef5659c640 1 -- 172.21.15.88:0/3862200590 >> v1:172.21.15.88:6789/0 conn(0x7fef58073e80 legacy=0x7fef580ca300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:56.131 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.124+0000 7fef5659c640 1 -- 172.21.15.88:0/3862200590 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef58156ec0 con 0x7fef5814d540 2024-04-26T23:40:56.131 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.124+0000 7fef55d9b640 1 --2- 172.21.15.88:0/3862200590 >> v2:172.21.15.175:3300/0 conn(0x7fef580cbb70 0x7fef58073940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:40:56.131 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.125+0000 7fef5659c640 1 --2- 172.21.15.88:0/3862200590 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fef5814d540 0x7fef580cb630 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fef4c0097a0 tx=0x7fef4c02a110 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6353cd1d1830cf83 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:56.131 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.125+0000 7fef5559a640 1 -- 172.21.15.88:0/3862200590 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef4c037070 con 0x7fef5814d540 2024-04-26T23:40:56.131 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.125+0000 7fef5559a640 1 -- 172.21.15.88:0/3862200590 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef4c02aba0 con 0x7fef5814d540 2024-04-26T23:40:56.131 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.125+0000 7fef5559a640 1 -- 172.21.15.88:0/3862200590 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef500019f0 con 0x7fef5814d540 2024-04-26T23:40:56.131 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.126+0000 7fef5759e640 1 -- 172.21.15.88:0/3862200590 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fef5814d540 msgr2=0x7fef580cb630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:56.131 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.126+0000 7fef5759e640 1 --2- 172.21.15.88:0/3862200590 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fef5814d540 0x7fef580cb630 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fef4c0097a0 tx=0x7fef4c02a110 comp rx=0 tx=0).stop 2024-04-26T23:40:56.131 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.126+0000 7fef5759e640 1 -- 172.21.15.88:0/3862200590 shutdown_connections 2024-04-26T23:40:56.132 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.126+0000 7fef5759e640 1 --2- 172.21.15.88:0/3862200590 >> v2:172.21.15.175:3300/0 conn(0x7fef580cbb70 0x7fef58073940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:56.132 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.126+0000 7fef5759e640 1 --2- 172.21.15.88:0/3862200590 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fef5814d540 0x7fef580cb630 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:56.132 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.126+0000 7fef5759e640 1 -- 172.21.15.88:0/3862200590 >> 172.21.15.88:0/3862200590 conn(0x7fef580c8da0 msgr2=0x7fef580c91b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:40:56.132 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.126+0000 7fef5759e640 1 -- 172.21.15.88:0/3862200590 shutdown_connections 2024-04-26T23:40:56.132 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.126+0000 7fef5759e640 1 -- 172.21.15.88:0/3862200590 wait complete. 2024-04-26T23:40:56.134 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.127+0000 7fef5759e640 1 Processor -- start 2024-04-26T23:40:56.134 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.127+0000 7fef5759e640 1 -- start start 2024-04-26T23:40:56.134 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.127+0000 7fef5759e640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fef58073e80 0x7fef58150390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:56.134 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.128+0000 7fef5759e640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fef5814d540 0x7fef581508d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:56.135 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.128+0000 7fef5759e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fef58158090 0x7fef58148b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:56.135 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.128+0000 7fef5759e640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fef580c9950 con 0x7fef58073e80 2024-04-26T23:40:56.135 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.128+0000 7fef5759e640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fef58157480 con 0x7fef5814d540 2024-04-26T23:40:56.135 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.128+0000 7fef5759e640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fef580c9ad0 con 0x7fef58158090 2024-04-26T23:40:56.135 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.128+0000 7fef5659c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fef58073e80 0x7fef58150390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:56.135 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.128+0000 7fef5659c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fef58073e80 0x7fef58150390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:41906/0 (socket says 172.21.15.88:41906) 2024-04-26T23:40:56.135 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.128+0000 7fef5659c640 1 -- 172.21.15.88:0/357290037 learned_addr learned my addr 172.21.15.88:0/357290037 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:40:56.135 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.128+0000 7fef5659c640 1 -- 172.21.15.88:0/357290037 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fef58158090 msgr2=0x7fef58148b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:56.135 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.128+0000 7fef5659c640 1 --2- 172.21.15.88:0/357290037 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fef58158090 0x7fef58148b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:56.135 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.128+0000 7fef5659c640 1 -- 172.21.15.88:0/357290037 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fef5814d540 msgr2=0x7fef581508d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:56.135 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.128+0000 7fef5659c640 1 --2- 172.21.15.88:0/357290037 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fef5814d540 0x7fef581508d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:56.135 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.128+0000 7fef5659c640 1 -- 172.21.15.88:0/357290037 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef581eca80 con 0x7fef58073e80 2024-04-26T23:40:56.135 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.128+0000 7fef5659c640 1 --2- 172.21.15.88:0/357290037 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fef58073e80 0x7fef58150390 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fef4c0098c0 tx=0x7fef4c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:56.135 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.128+0000 7fef46ffd640 1 -- 172.21.15.88:0/357290037 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef4c037050 con 0x7fef58073e80 2024-04-26T23:40:56.135 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.128+0000 7fef46ffd640 1 -- 172.21.15.88:0/357290037 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef4c043070 con 0x7fef58073e80 2024-04-26T23:40:56.136 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.128+0000 7fef5759e640 1 -- 172.21.15.88:0/357290037 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef581ecd60 con 0x7fef58073e80 2024-04-26T23:40:56.136 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.128+0000 7fef46ffd640 1 -- 172.21.15.88:0/357290037 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef4c006e10 con 0x7fef58073e80 2024-04-26T23:40:56.136 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.128+0000 7fef5759e640 1 -- 172.21.15.88:0/357290037 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef5814dc00 con 0x7fef58073e80 2024-04-26T23:40:56.136 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.130+0000 7fef46ffd640 1 -- 172.21.15.88:0/357290037 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fef4c03ca10 con 0x7fef58073e80 2024-04-26T23:40:56.136 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.130+0000 7fef46ffd640 1 --2- 172.21.15.88:0/357290037 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fef3806c8f0 0x7fef3806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:56.136 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.130+0000 7fef46ffd640 1 -- 172.21.15.88:0/357290037 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7fef4c0aca50 con 0x7fef58073e80 2024-04-26T23:40:56.136 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.130+0000 7fef55d9b640 1 --2- 172.21.15.88:0/357290037 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fef3806c8f0 0x7fef3806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:56.136 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.131+0000 7fef55d9b640 1 --2- 172.21.15.88:0/357290037 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fef3806c8f0 0x7fef3806edb0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fef48006e80 tx=0x7fef48006dd0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:56.143 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.131+0000 7fef5fbf1740 1 Processor -- start 2024-04-26T23:40:56.143 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.131+0000 7fef5fbf1740 1 -- start start 2024-04-26T23:40:56.143 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.132+0000 7fef5fbf1740 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x556d43f77cd0 0x556d43f780b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:56.143 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.132+0000 7fef5fbf1740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x556d43f71610 0x556d43f6e190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:56.143 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.132+0000 7fef5fbf1740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556d43f54970 0x556d43f6e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:56.143 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.132+0000 7fef5fbf1740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x556d43e97740 con 0x556d43f71610 2024-04-26T23:40:56.143 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.132+0000 7fef5fbf1740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x556d43e333a0 con 0x556d43f54970 2024-04-26T23:40:56.143 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.132+0000 7fef5fbf1740 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x556d43e93700 con 0x556d43f77cd0 2024-04-26T23:40:56.143 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.132+0000 7fef55d9b640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x556d43f71610 0x556d43f6e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:56.143 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.132+0000 7fef55d9b640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x556d43f71610 0x556d43f6e190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:41920/0 (socket says 172.21.15.88:41920) 2024-04-26T23:40:56.143 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.132+0000 7fef55d9b640 1 -- 172.21.15.88:0/2122352386 learned_addr learned my addr 172.21.15.88:0/2122352386 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:40:56.143 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.132+0000 7fef56d9d640 1 --2- 172.21.15.88:0/2122352386 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556d43f54970 0x556d43f6e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:56.143 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.132+0000 7fef5659c640 1 --2- 172.21.15.88:0/2122352386 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x556d43f77cd0 0x556d43f780b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:56.144 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.132+0000 7fef55d9b640 1 -- 172.21.15.88:0/2122352386 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x556d43f77cd0 msgr2=0x556d43f780b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:40:56.144 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.132+0000 7fef55d9b640 1 --2- 172.21.15.88:0/2122352386 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x556d43f77cd0 0x556d43f780b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:56.144 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.132+0000 7fef55d9b640 1 -- 172.21.15.88:0/2122352386 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556d43f54970 msgr2=0x556d43f6e6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:40:56.144 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.132+0000 7fef55d9b640 1 --2- 172.21.15.88:0/2122352386 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556d43f54970 0x556d43f6e6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:56.144 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.132+0000 7fef55d9b640 1 -- 172.21.15.88:0/2122352386 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556d43e4f750 con 0x556d43f71610 2024-04-26T23:40:56.144 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.133+0000 7fef55d9b640 1 --2- 172.21.15.88:0/2122352386 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x556d43f71610 0x556d43f6e190 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fef48009530 tx=0x7fef48011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d842bdeeaace9f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:56.144 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.133+0000 7fef37fff640 1 -- 172.21.15.88:0/2122352386 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef4801b040 con 0x556d43f71610 2024-04-26T23:40:56.144 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.133+0000 7fef37fff640 1 -- 172.21.15.88:0/2122352386 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef48024070 con 0x556d43f71610 2024-04-26T23:40:56.144 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.133+0000 7fef37fff640 1 -- 172.21.15.88:0/2122352386 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef48015cd0 con 0x556d43f71610 2024-04-26T23:40:56.144 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.133+0000 7fef5fbf1740 1 -- 172.21.15.88:0/2122352386 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x556d43f71610 msgr2=0x556d43f6e190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:56.144 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.133+0000 7fef5fbf1740 1 --2- 172.21.15.88:0/2122352386 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x556d43f71610 0x556d43f6e190 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fef48009530 tx=0x7fef48011000 comp rx=0 tx=0).stop 2024-04-26T23:40:56.144 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.133+0000 7fef5fbf1740 1 -- 172.21.15.88:0/2122352386 shutdown_connections 2024-04-26T23:40:56.144 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.133+0000 7fef5fbf1740 1 --2- 172.21.15.88:0/2122352386 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556d43f54970 0x556d43f6e6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:56.144 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.133+0000 7fef5fbf1740 1 --2- 172.21.15.88:0/2122352386 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x556d43f71610 0x556d43f6e190 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:56.144 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.133+0000 7fef5fbf1740 1 --2- 172.21.15.88:0/2122352386 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x556d43f77cd0 0x556d43f780b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:56.145 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.133+0000 7fef5fbf1740 1 -- 172.21.15.88:0/2122352386 >> 172.21.15.88:0/2122352386 conn(0x556d43f2fb40 msgr2=0x556d43f54260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:40:56.145 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.133+0000 7fef5fbf1740 1 -- 172.21.15.88:0/2122352386 shutdown_connections 2024-04-26T23:40:56.145 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.133+0000 7fef5fbf1740 1 -- 172.21.15.88:0/2122352386 wait complete. 2024-04-26T23:40:56.145 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.134+0000 7fef5fbf1740 1 -- start start 2024-04-26T23:40:56.145 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.134+0000 7fef5fbf1740 1 Processor -- start 2024-04-26T23:40:56.145 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.135+0000 7fef5fbf1740 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x556d43f71610 0x556d43f4fb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:56.145 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.135+0000 7fef5fbf1740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x556d43f77cd0 0x556d43f769e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:56.145 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.135+0000 7fef5fbf1740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556d43f4cd00 0x556d43f51440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:56.145 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.135+0000 7fef5fbf1740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x556d43f2ed40 con 0x556d43f77cd0 2024-04-26T23:40:56.145 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.135+0000 7fef5fbf1740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x556d43e1efe0 con 0x556d43f4cd00 2024-04-26T23:40:56.145 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.135+0000 7fef5fbf1740 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x556d43f785f0 con 0x556d43f71610 2024-04-26T23:40:56.145 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.135+0000 7fef5fbf1740 10 client.0 _ll_register_callbacks cb 0x556d43e35150 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T23:40:56.145 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.135+0000 7fef55d9b640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x556d43f77cd0 0x556d43f769e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:56.145 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.135+0000 7fef55d9b640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x556d43f77cd0 0x556d43f769e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:41924/0 (socket says 172.21.15.88:41924) 2024-04-26T23:40:56.145 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.135+0000 7fef55d9b640 1 -- 172.21.15.88:0/1983666902 learned_addr learned my addr 172.21.15.88:0/1983666902 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:40:56.146 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.135+0000 7fef5659c640 1 --2- 172.21.15.88:0/1983666902 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x556d43f71610 0x556d43f4fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:56.146 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.135+0000 7fef56d9d640 1 --2- 172.21.15.88:0/1983666902 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556d43f4cd00 0x556d43f51440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:56.146 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.135+0000 7fef55d9b640 1 -- 172.21.15.88:0/1983666902 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x556d43f71610 msgr2=0x556d43f4fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:40:56.146 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.135+0000 7fef55d9b640 1 --2- 172.21.15.88:0/1983666902 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x556d43f71610 0x556d43f4fb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:56.146 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.135+0000 7fef55d9b640 1 -- 172.21.15.88:0/1983666902 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556d43f4cd00 msgr2=0x556d43f51440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:40:56.146 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.135+0000 7fef55d9b640 1 --2- 172.21.15.88:0/1983666902 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556d43f4cd00 0x556d43f51440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:56.146 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.135+0000 7fef55d9b640 1 -- 172.21.15.88:0/1983666902 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556d43ba92d0 con 0x556d43f77cd0 2024-04-26T23:40:56.146 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.135+0000 7fef56d9d640 1 --2- 172.21.15.88:0/1983666902 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556d43f4cd00 0x556d43f51440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:40:56.146 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.135+0000 7fef55d9b640 1 --2- 172.21.15.88:0/1983666902 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x556d43f77cd0 0x556d43f769e0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fef4800f010 tx=0x7fef48009190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ba6c1dc536943d9 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:56.146 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.135+0000 7fef357fa640 10 client.0 ms_handle_connect on v2:172.21.15.88:3300/0 2024-04-26T23:40:56.146 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.136+0000 7fef357fa640 1 -- 172.21.15.88:0/1983666902 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef48029810 con 0x556d43f77cd0 2024-04-26T23:40:56.146 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.136+0000 7fef357fa640 1 -- 172.21.15.88:0/1983666902 <== mon.0 v2:172.21.15.88:3300/0 2 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7fef480299b0 con 0x556d43f77cd0 2024-04-26T23:40:56.146 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.136+0000 7fef5fbf1740 1 -- 172.21.15.88:0/1983666902 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fef48024070 con 0x556d43f77cd0 2024-04-26T23:40:56.147 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.136+0000 7fef357fa640 1 -- 172.21.15.88:0/1983666902 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_get_version_reply(handle=1 version=12) ==== 24+0+0 (secure 0 0 0) 0x7fef4803b050 con 0x556d43f77cd0 2024-04-26T23:40:56.147 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.136+0000 7fef5fbf1740 10 client.4803 fetch_fsmap learned FSMap version 12 2024-04-26T23:40:56.147 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.136+0000 7fef5fbf1740 1 -- 172.21.15.88:0/1983666902 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,fsmap=12,monmap=2+}) -- 0x556d43c736b0 con 0x556d43f77cd0 2024-04-26T23:40:56.147 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.136+0000 7fef357fa640 1 -- 172.21.15.88:0/1983666902 <== mon.0 v2:172.21.15.88:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef48024070 con 0x556d43f77cd0 2024-04-26T23:40:56.147 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.136+0000 7fef357fa640 1 -- 172.21.15.88:0/1983666902 <== mon.0 v2:172.21.15.88:3300/0 5 ==== fsmap(e 12) ==== 4128+0+0 (secure 0 0 0) 0x7fef4803e020 con 0x556d43f77cd0 2024-04-26T23:40:56.147 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.136+0000 7fef5fbf1740 10 client.4803 fetch_fsmap finished waiting for FSMap version 12 2024-04-26T23:40:56.147 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.136+0000 7fef5fbf1740 10 client.4803 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-26T23:40:56.147 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.136+0000 7fef5fbf1740 20 client.4803 populate_metadata read hostname 'smithi088' 2024-04-26T23:40:56.147 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.136+0000 7fef5fbf1740 1 --2- 172.21.15.88:0/1983666902 >> [v2:172.21.15.175:6833/3932058274,v1:172.21.15.175:6835/3932058274] conn(0x556d43f83540 0x556d43f83920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:56.147 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.136+0000 7fef5fbf1740 4 client.4803 mds_command: new command op to 4279 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T23:40:56.147 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.136+0000 7fef5fbf1740 1 -- 172.21.15.88:0/1983666902 --> [v2:172.21.15.175:6833/3932058274,v1:172.21.15.175:6835/3932058274] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556d43ea5350 con 0x556d43f83540 2024-04-26T23:40:56.147 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.136+0000 7fef5659c640 1 --2- 172.21.15.88:0/1983666902 >> [v2:172.21.15.175:6833/3932058274,v1:172.21.15.175:6835/3932058274] conn(0x556d43f83540 0x556d43f83920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:56.147 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.137+0000 7fef357fa640 10 client.4803 ms_handle_connect on v2:172.21.15.175:6833/3932058274 2024-04-26T23:40:56.147 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.137+0000 7fef5659c640 1 --2- 172.21.15.88:0/1983666902 >> [v2:172.21.15.175:6833/3932058274,v1:172.21.15.175:6835/3932058274] conn(0x556d43f83540 0x556d43f83920 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=49d91c08721bc64e server_cookie=e50980f791c1ab1d in_seq=0 out_seq=0 2024-04-26T23:40:56.148 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.137+0000 7fef357fa640 1 -- 172.21.15.88:0/1983666902 <== mds.0 v2:172.21.15.175:6833/3932058274 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x556d43ea5350 con 0x556d43f83540 2024-04-26T23:40:56.148 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.137+0000 7fef357fa640 10 client.4803 handle_command_reply: tid=0 2024-04-26T23:40:56.148 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.137+0000 7fef5fbf1740 1 client.4803 shutdown 2024-04-26T23:40:56.148 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.138+0000 7fef5fbf1740 1 -- 172.21.15.88:0/1983666902 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x556d43f77cd0 msgr2=0x556d43f769e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:56.148 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.138+0000 7fef5fbf1740 1 --2- 172.21.15.88:0/1983666902 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x556d43f77cd0 0x556d43f769e0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fef4800f010 tx=0x7fef48009190 comp rx=0 tx=0).stop 2024-04-26T23:40:56.148 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.138+0000 7fef5fbf1740 1 -- 172.21.15.88:0/1983666902 shutdown_connections 2024-04-26T23:40:56.148 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.138+0000 7fef5fbf1740 1 --2- 172.21.15.88:0/1983666902 >> [v2:172.21.15.175:6833/3932058274,v1:172.21.15.175:6835/3932058274] conn(0x556d43f83540 0x556d43f83920 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:56.148 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.138+0000 7fef5fbf1740 1 --2- 172.21.15.88:0/1983666902 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556d43f4cd00 0x556d43f51440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:56.148 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.138+0000 7fef5fbf1740 1 --2- 172.21.15.88:0/1983666902 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x556d43f77cd0 0x556d43f769e0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:56.148 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.138+0000 7fef5fbf1740 1 --2- 172.21.15.88:0/1983666902 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x556d43f71610 0x556d43f4fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:56.148 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.138+0000 7fef357fa640 0 client.4803 ms_handle_reset on v2:172.21.15.175:6833/3932058274 2024-04-26T23:40:56.148 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.138+0000 7fef5fbf1740 1 -- 172.21.15.88:0/1983666902 >> 172.21.15.88:0/1983666902 conn(0x556d43f54970 msgr2=0x556d43f34260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:40:56.148 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.138+0000 7fef5fbf1740 1 -- 172.21.15.88:0/1983666902 shutdown_connections 2024-04-26T23:40:56.148 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.138+0000 7fef5fbf1740 1 -- 172.21.15.88:0/1983666902 wait complete. 2024-04-26T23:40:56.148 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.138+0000 7fef5fbf1740 20 client.4803 trim_cache size 0 max 16384 2024-04-26T23:40:56.159 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.155+0000 7fef5fbf1740 1 Processor -- start 2024-04-26T23:40:56.159 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.156+0000 7fef5fbf1740 1 -- start start 2024-04-26T23:40:56.162 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.156+0000 7fef5fbf1740 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x556d43f4cd00 0x556d43f76c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:56.162 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.156+0000 7fef5fbf1740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556d43f71610 0x556d43f2c880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:56.162 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.156+0000 7fef5fbf1740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x556d43f77cd0 0x556d43f6d780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:56.162 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.156+0000 7fef5fbf1740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fef581fbce0 con 0x556d43f77cd0 2024-04-26T23:40:56.162 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.156+0000 7fef5fbf1740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fef581f9730 con 0x556d43f71610 2024-04-26T23:40:56.162 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.156+0000 7fef5fbf1740 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fef581f9d80 con 0x556d43f4cd00 2024-04-26T23:40:56.162 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.156+0000 7fef56d9d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x556d43f77cd0 0x556d43f6d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:56.162 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.156+0000 7fef56d9d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x556d43f77cd0 0x556d43f6d780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:41940/0 (socket says 172.21.15.88:41940) 2024-04-26T23:40:56.162 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.156+0000 7fef56d9d640 1 -- 172.21.15.88:0/556116112 learned_addr learned my addr 172.21.15.88:0/556116112 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:40:56.163 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.156+0000 7fef55d9b640 1 --2- 172.21.15.88:0/556116112 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556d43f71610 0x556d43f2c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:56.163 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.157+0000 7fef5659c640 1 --2- 172.21.15.88:0/556116112 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x556d43f4cd00 0x556d43f76c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:56.163 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.157+0000 7fef56d9d640 1 -- 172.21.15.88:0/556116112 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x556d43f4cd00 msgr2=0x556d43f76c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:40:56.163 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.157+0000 7fef56d9d640 1 --2- 172.21.15.88:0/556116112 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x556d43f4cd00 0x556d43f76c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:56.163 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.157+0000 7fef56d9d640 1 -- 172.21.15.88:0/556116112 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556d43f71610 msgr2=0x556d43f2c880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:40:56.163 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.157+0000 7fef56d9d640 1 --2- 172.21.15.88:0/556116112 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556d43f71610 0x556d43f2c880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:56.163 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.157+0000 7fef56d9d640 1 -- 172.21.15.88:0/556116112 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556d43f4bd90 con 0x556d43f77cd0 2024-04-26T23:40:56.163 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.157+0000 7fef56d9d640 1 --2- 172.21.15.88:0/556116112 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x556d43f77cd0 0x556d43f6d780 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fef50001ab0 tx=0x7fef500074e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44759e7afa1a0d60 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:56.163 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.157+0000 7fef377fe640 1 -- 172.21.15.88:0/556116112 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef50014400 con 0x556d43f77cd0 2024-04-26T23:40:56.163 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.157+0000 7fef377fe640 1 -- 172.21.15.88:0/556116112 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef50019070 con 0x556d43f77cd0 2024-04-26T23:40:56.163 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.157+0000 7fef377fe640 1 -- 172.21.15.88:0/556116112 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef500147e0 con 0x556d43f77cd0 2024-04-26T23:40:56.163 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.157+0000 7fef5fbf1740 1 -- 172.21.15.88:0/556116112 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x556d43f77cd0 msgr2=0x556d43f6d780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:56.163 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.157+0000 7fef5fbf1740 1 --2- 172.21.15.88:0/556116112 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x556d43f77cd0 0x556d43f6d780 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fef50001ab0 tx=0x7fef500074e0 comp rx=0 tx=0).stop 2024-04-26T23:40:56.163 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.157+0000 7fef5fbf1740 1 -- 172.21.15.88:0/556116112 shutdown_connections 2024-04-26T23:40:56.163 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.157+0000 7fef5fbf1740 1 --2- 172.21.15.88:0/556116112 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x556d43f77cd0 0x556d43f6d780 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:56.164 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.157+0000 7fef5fbf1740 1 --2- 172.21.15.88:0/556116112 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556d43f71610 0x556d43f2c880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:56.164 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.157+0000 7fef5fbf1740 1 --2- 172.21.15.88:0/556116112 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x556d43f4cd00 0x556d43f76c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:56.164 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.157+0000 7fef5fbf1740 1 -- 172.21.15.88:0/556116112 >> 172.21.15.88:0/556116112 conn(0x556d43f54970 msgr2=0x556d43f34260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:40:56.164 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.158+0000 7fef5fbf1740 1 -- 172.21.15.88:0/556116112 shutdown_connections 2024-04-26T23:40:56.164 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.158+0000 7fef5fbf1740 1 -- 172.21.15.88:0/556116112 wait complete. 2024-04-26T23:40:56.164 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.158+0000 7fef5fbf1740 1 -- start start 2024-04-26T23:40:56.164 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.158+0000 7fef5fbf1740 1 Processor -- start 2024-04-26T23:40:56.168 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.159+0000 7fef5fbf1740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x556d43f4cd00 0x556d43f92a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:56.168 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.159+0000 7fef5fbf1740 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x556d43f71610 0x556d43fee1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:56.168 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.159+0000 7fef5fbf1740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556d43f77cd0 0x556d43fe7f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:56.168 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.159+0000 7fef5fbf1740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x556d43f759c0 con 0x556d43f4cd00 2024-04-26T23:40:56.168 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.159+0000 7fef5fbf1740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x556d43f4f360 con 0x556d43f77cd0 2024-04-26T23:40:56.168 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.159+0000 7fef5fbf1740 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x556d43f82ff0 con 0x556d43f71610 2024-04-26T23:40:56.169 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.159+0000 7fef5fbf1740 10 client.0 _ll_register_callbacks cb 0x7fef4800ea80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T23:40:56.169 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.159+0000 7fef5659c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x556d43f4cd00 0x556d43f92a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:56.169 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.159+0000 7fef5659c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x556d43f4cd00 0x556d43f92a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:41946/0 (socket says 172.21.15.88:41946) 2024-04-26T23:40:56.169 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.159+0000 7fef5659c640 1 -- 172.21.15.88:0/3069948063 learned_addr learned my addr 172.21.15.88:0/3069948063 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:40:56.169 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.159+0000 7fef56d9d640 1 --2- 172.21.15.88:0/3069948063 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556d43f77cd0 0x556d43fe7f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:56.169 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.159+0000 7fef55d9b640 1 --2- 172.21.15.88:0/3069948063 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x556d43f71610 0x556d43fee1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:56.169 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.159+0000 7fef5659c640 1 -- 172.21.15.88:0/3069948063 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x556d43f71610 msgr2=0x556d43fee1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:40:56.169 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.159+0000 7fef5659c640 1 --2- 172.21.15.88:0/3069948063 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x556d43f71610 0x556d43fee1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:56.169 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.159+0000 7fef5659c640 1 -- 172.21.15.88:0/3069948063 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556d43f77cd0 msgr2=0x556d43fe7f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:40:56.169 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.159+0000 7fef5659c640 1 --2- 172.21.15.88:0/3069948063 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556d43f77cd0 0x556d43fe7f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:56.169 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.159+0000 7fef5659c640 1 -- 172.21.15.88:0/3069948063 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556d43f4c900 con 0x556d43f4cd00 2024-04-26T23:40:56.169 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.159+0000 7fef5659c640 1 --2- 172.21.15.88:0/3069948063 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x556d43f4cd00 0x556d43f92a50 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fef4c07a1f0 tx=0x7fef4c032f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31e94bbb4f318d32 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:56.169 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.159+0000 7fef357fa640 10 client.0 ms_handle_connect on v2:172.21.15.88:3300/0 2024-04-26T23:40:56.169 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.159+0000 7fef357fa640 1 -- 172.21.15.88:0/3069948063 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef4c098060 con 0x556d43f4cd00 2024-04-26T23:40:56.169 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.160+0000 7fef357fa640 1 -- 172.21.15.88:0/3069948063 <== mon.0 v2:172.21.15.88:3300/0 2 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7fef4c0787f0 con 0x556d43f4cd00 2024-04-26T23:40:56.170 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.160+0000 7fef5fbf1740 1 -- 172.21.15.88:0/3069948063 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fef50019070 con 0x556d43f4cd00 2024-04-26T23:40:56.170 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.160+0000 7fef357fa640 1 -- 172.21.15.88:0/3069948063 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_get_version_reply(handle=1 version=12) ==== 24+0+0 (secure 0 0 0) 0x7fef4c07e8a0 con 0x556d43f4cd00 2024-04-26T23:40:56.170 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.160+0000 7fef5fbf1740 10 client.4809 fetch_fsmap learned FSMap version 12 2024-04-26T23:40:56.170 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.160+0000 7fef5fbf1740 1 -- 172.21.15.88:0/3069948063 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,fsmap=12,monmap=2+}) -- 0x556d43f68180 con 0x556d43f4cd00 2024-04-26T23:40:56.170 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.160+0000 7fef357fa640 1 -- 172.21.15.88:0/3069948063 <== mon.0 v2:172.21.15.88:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef50019070 con 0x556d43f4cd00 2024-04-26T23:40:56.170 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.160+0000 7fef357fa640 1 -- 172.21.15.88:0/3069948063 <== mon.0 v2:172.21.15.88:3300/0 5 ==== fsmap(e 12) ==== 4128+0+0 (secure 0 0 0) 0x7fef4c076b60 con 0x556d43f4cd00 2024-04-26T23:40:56.170 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.160+0000 7fef5fbf1740 10 client.4809 fetch_fsmap finished waiting for FSMap version 12 2024-04-26T23:40:56.170 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.160+0000 7fef5fbf1740 10 client.4809 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-26T23:40:56.170 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.160+0000 7fef5fbf1740 20 client.4809 populate_metadata read hostname 'smithi088' 2024-04-26T23:40:56.170 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.160+0000 7fef5fbf1740 1 --2- 172.21.15.88:0/3069948063 >> [v2:172.21.15.175:6833/3932058274,v1:172.21.15.175:6835/3932058274] conn(0x556d43f326f0 0x556d43f32ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:56.170 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.160+0000 7fef5fbf1740 4 client.4809 mds_command: new command op to 4279 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-26T23:40:56.170 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.160+0000 7fef5fbf1740 1 -- 172.21.15.88:0/3069948063 --> [v2:172.21.15.175:6833/3932058274,v1:172.21.15.175:6835/3932058274] -- command(tid 0: {"prefix": "status"}) -- 0x556d43f75eb0 con 0x556d43f326f0 2024-04-26T23:40:56.170 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.160+0000 7fef55d9b640 1 --2- 172.21.15.88:0/3069948063 >> [v2:172.21.15.175:6833/3932058274,v1:172.21.15.175:6835/3932058274] conn(0x556d43f326f0 0x556d43f32ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:56.170 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.160+0000 7fef357fa640 10 client.4809 ms_handle_connect on v2:172.21.15.175:6833/3932058274 2024-04-26T23:40:56.170 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.160+0000 7fef55d9b640 1 --2- 172.21.15.88:0/3069948063 >> [v2:172.21.15.175:6833/3932058274,v1:172.21.15.175:6835/3932058274] conn(0x556d43f326f0 0x556d43f32ad0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=90a751b06f2d4e71 server_cookie=9a31c1340842207 in_seq=0 out_seq=0 2024-04-26T23:40:56.171 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.161+0000 7fef357fa640 1 -- 172.21.15.88:0/3069948063 <== mds.0 v2:172.21.15.175:6833/3932058274 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x556d43f75eb0 con 0x556d43f326f0 2024-04-26T23:40:56.171 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.161+0000 7fef357fa640 10 client.4809 handle_command_reply: tid=0 2024-04-26T23:40:56.171 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.161+0000 7fef5fbf1740 1 client.4809 shutdown 2024-04-26T23:40:56.171 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.161+0000 7fef5fbf1740 1 -- 172.21.15.88:0/3069948063 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x556d43f4cd00 msgr2=0x556d43f92a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:56.171 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.161+0000 7fef5fbf1740 1 --2- 172.21.15.88:0/3069948063 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x556d43f4cd00 0x556d43f92a50 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fef4c07a1f0 tx=0x7fef4c032f90 comp rx=0 tx=0).stop 2024-04-26T23:40:56.171 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.161+0000 7fef5fbf1740 1 -- 172.21.15.88:0/3069948063 shutdown_connections 2024-04-26T23:40:56.171 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.161+0000 7fef5fbf1740 1 --2- 172.21.15.88:0/3069948063 >> [v2:172.21.15.175:6833/3932058274,v1:172.21.15.175:6835/3932058274] conn(0x556d43f326f0 0x556d43f32ad0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:56.171 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.161+0000 7fef5fbf1740 1 --2- 172.21.15.88:0/3069948063 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x556d43f71610 0x556d43fee1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:56.171 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.161+0000 7fef357fa640 0 client.4809 ms_handle_reset on v2:172.21.15.175:6833/3932058274 2024-04-26T23:40:56.171 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.161+0000 7fef5fbf1740 1 --2- 172.21.15.88:0/3069948063 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556d43f77cd0 0x556d43fe7f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:56.171 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.161+0000 7fef5fbf1740 1 --2- 172.21.15.88:0/3069948063 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x556d43f4cd00 0x556d43f92a50 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:56.171 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.161+0000 7fef5fbf1740 1 -- 172.21.15.88:0/3069948063 >> 172.21.15.88:0/3069948063 conn(0x556d43f54970 msgr2=0x556d43f34260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:40:56.171 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.161+0000 7fef5fbf1740 1 -- 172.21.15.88:0/3069948063 shutdown_connections 2024-04-26T23:40:56.171 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.161+0000 7fef5fbf1740 1 -- 172.21.15.88:0/3069948063 wait complete. 2024-04-26T23:40:56.171 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.161+0000 7fef5fbf1740 20 client.4809 trim_cache size 0 max 16384 2024-04-26T23:40:56.172 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-04-26T23:40:56.172 INFO:teuthology.orchestra.run.smithi088.stdout: "cluster_fsid": "555255e9-7ef9-4454-8dc9-35e96b70035c", 2024-04-26T23:40:56.172 INFO:teuthology.orchestra.run.smithi088.stdout: "whoami": 0, 2024-04-26T23:40:56.172 INFO:teuthology.orchestra.run.smithi088.stdout: "id": 4279, 2024-04-26T23:40:56.172 INFO:teuthology.orchestra.run.smithi088.stdout: "want_state": "up:active", 2024-04-26T23:40:56.172 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "up:active", 2024-04-26T23:40:56.172 INFO:teuthology.orchestra.run.smithi088.stdout: "fs_name": "a", 2024-04-26T23:40:56.172 INFO:teuthology.orchestra.run.smithi088.stdout: "rank_uptime": 23.584793435000002, 2024-04-26T23:40:56.172 INFO:teuthology.orchestra.run.smithi088.stdout: "mdsmap_epoch": 8, 2024-04-26T23:40:56.172 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap_epoch": 24, 2024-04-26T23:40:56.172 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap_epoch_barrier": 20, 2024-04-26T23:40:56.172 INFO:teuthology.orchestra.run.smithi088.stdout: "uptime": 30.709390163999998 2024-04-26T23:40:56.173 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-04-26T23:40:56.173 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.161+0000 7fef5759e640 1 -- 172.21.15.88:0/357290037 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fef3806c8f0 msgr2=0x7fef3806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:56.173 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.161+0000 7fef5759e640 1 --2- 172.21.15.88:0/357290037 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fef3806c8f0 0x7fef3806edb0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fef48006e80 tx=0x7fef48006dd0 comp rx=0 tx=0).stop 2024-04-26T23:40:56.173 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.161+0000 7fef5759e640 1 -- 172.21.15.88:0/357290037 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fef58073e80 msgr2=0x7fef58150390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:56.173 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.161+0000 7fef5759e640 1 --2- 172.21.15.88:0/357290037 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fef58073e80 0x7fef58150390 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fef4c0098c0 tx=0x7fef4c0046c0 comp rx=0 tx=0).stop 2024-04-26T23:40:56.173 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.162+0000 7fef5759e640 1 -- 172.21.15.88:0/357290037 shutdown_connections 2024-04-26T23:40:56.174 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.162+0000 7fef5759e640 1 --2- 172.21.15.88:0/357290037 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fef3806c8f0 0x7fef3806edb0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:56.174 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.162+0000 7fef5759e640 1 --2- 172.21.15.88:0/357290037 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fef58158090 0x7fef58148b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:56.174 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.162+0000 7fef5759e640 1 --2- 172.21.15.88:0/357290037 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fef5814d540 0x7fef581508d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:56.174 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.162+0000 7fef5759e640 1 --2- 172.21.15.88:0/357290037 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fef58073e80 0x7fef58150390 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:56.174 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.162+0000 7fef5759e640 1 -- 172.21.15.88:0/357290037 >> 172.21.15.88:0/357290037 conn(0x7fef580c8da0 msgr2=0x7fef580c7490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:40:56.174 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.162+0000 7fef5759e640 1 -- 172.21.15.88:0/357290037 shutdown_connections 2024-04-26T23:40:56.174 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.162+0000 7fef5759e640 1 -- 172.21.15.88:0/357290037 wait complete. 2024-04-26T23:40:56.176 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T23:40:56.272 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.268+0000 7f06b5551640 1 Processor -- start 2024-04-26T23:40:56.272 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.268+0000 7f06b5551640 1 -- start start 2024-04-26T23:40:56.276 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.269+0000 7f06b5551640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f06b00ca5a0 0x7f06b0156bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:56.276 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.269+0000 7f06b5551640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f06b00c8df0 con 0x7f06b0154160 2024-04-26T23:40:56.276 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.269+0000 7f06b5551640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f06b0154540 con 0x7f06b015a1a0 2024-04-26T23:40:56.276 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.269+0000 7f06b5551640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f06b00c9100 con 0x7f06b00ca5a0 2024-04-26T23:40:56.276 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.269+0000 7f06aeffd640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f06b0154160 0x7f06b00c6e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:58140/0 (socket says 172.21.15.88:58140) 2024-04-26T23:40:56.276 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.269+0000 7f06aeffd640 1 -- 172.21.15.88:0/3059748821 learned_addr learned my addr 172.21.15.88:0/3059748821 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-26T23:40:56.276 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.269+0000 7f06ae7fc640 1 --2- 172.21.15.88:0/3059748821 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f06b00ca5a0 0x7f06b0156bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:56.276 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.269+0000 7f06adffb640 1 -- 172.21.15.88:0/3059748821 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3571168449 0 0) 0x7f06a0001110 con 0x7f06b0154160 2024-04-26T23:40:56.276 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.269+0000 7f06adffb640 1 -- 172.21.15.88:0/3059748821 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0698003520 con 0x7f06b0154160 2024-04-26T23:40:56.276 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.269+0000 7f06adffb640 1 -- 172.21.15.88:0/3059748821 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2245307190 0 0) 0x7f0698003520 con 0x7f06b0154160 2024-04-26T23:40:56.276 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.269+0000 7f06adffb640 1 -- 172.21.15.88:0/3059748821 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f06b00ca5a0 msgr2=0x7f06b0156bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:40:56.277 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.269+0000 7f06adffb640 1 --2- 172.21.15.88:0/3059748821 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f06b00ca5a0 0x7f06b0156bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:56.277 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.269+0000 7f06adffb640 1 -- 172.21.15.88:0/3059748821 >> v1:172.21.15.175:6789/0 conn(0x7f06b015a1a0 legacy=0x7f06b00c9590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:56.277 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.269+0000 7f06adffb640 1 -- 172.21.15.88:0/3059748821 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06b015a910 con 0x7f06b0154160 2024-04-26T23:40:56.277 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.269+0000 7f06adffb640 1 -- 172.21.15.88:0/3059748821 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 356324787 0 0) 0x7f06a0001840 con 0x7f06b0154160 2024-04-26T23:40:56.277 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.269+0000 7f06adffb640 1 -- 172.21.15.88:0/3059748821 >> v1:172.21.15.88:6789/0 conn(0x7f06b0154160 legacy=0x7f06b00c6e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:56.277 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.269+0000 7f06adffb640 1 --2- 172.21.15.88:0/3059748821 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f06b00ca5a0 0x7f06980039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:56.277 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.269+0000 7f06adffb640 1 --2- 172.21.15.88:0/3059748821 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0698003f60 0x7f0698004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:56.277 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.269+0000 7f06adffb640 1 --2- 172.21.15.88:0/3059748821 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0698004d40 0x7f06980051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:56.277 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.269+0000 7f06adffb640 1 -- 172.21.15.88:0/3059748821 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f06b00c9100 con 0x7f0698003f60 2024-04-26T23:40:56.277 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.269+0000 7f06adffb640 1 -- 172.21.15.88:0/3059748821 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f069800baa0 con 0x7f0698004d40 2024-04-26T23:40:56.277 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.269+0000 7f06adffb640 1 -- 172.21.15.88:0/3059748821 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f069800bca0 con 0x7f06b00ca5a0 2024-04-26T23:40:56.277 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.270+0000 7f06ae7fc640 1 --2- 172.21.15.88:0/3059748821 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0698003f60 0x7f0698004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:56.277 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.270+0000 7f06aeffd640 1 --2- 172.21.15.88:0/3059748821 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f06b00ca5a0 0x7f06980039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:56.278 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.270+0000 7f06af7fe640 1 --2- 172.21.15.88:0/3059748821 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0698004d40 0x7f06980051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:56.278 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.270+0000 7f06ae7fc640 1 -- 172.21.15.88:0/3059748821 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f06b00ca5a0 msgr2=0x7f06980039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:40:56.278 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.270+0000 7f06ae7fc640 1 --2- 172.21.15.88:0/3059748821 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f06b00ca5a0 0x7f06980039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:56.278 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.270+0000 7f06ae7fc640 1 -- 172.21.15.88:0/3059748821 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0698004d40 msgr2=0x7f06980051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:40:56.278 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.270+0000 7f06ae7fc640 1 --2- 172.21.15.88:0/3059748821 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0698004d40 0x7f06980051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:56.278 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.270+0000 7f06ae7fc640 1 -- 172.21.15.88:0/3059748821 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0698003520 con 0x7f0698003f60 2024-04-26T23:40:56.278 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.270+0000 7f06ae7fc640 1 --2- 172.21.15.88:0/3059748821 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0698003f60 0x7f0698004800 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f06a4009a90 tx=0x7f0698005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9751f1e6acb5bec server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:56.278 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.271+0000 7f06adffb640 1 -- 172.21.15.88:0/3059748821 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06a4036070 con 0x7f0698003f60 2024-04-26T23:40:56.278 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.271+0000 7f06adffb640 1 -- 172.21.15.88:0/3059748821 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06a4031400 con 0x7f0698003f60 2024-04-26T23:40:56.278 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.271+0000 7f06adffb640 1 -- 172.21.15.88:0/3059748821 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06a4009690 con 0x7f0698003f60 2024-04-26T23:40:56.278 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.271+0000 7f06b5551640 1 -- 172.21.15.88:0/3059748821 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0698003f60 msgr2=0x7f0698004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:56.278 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.271+0000 7f06b5551640 1 --2- 172.21.15.88:0/3059748821 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0698003f60 0x7f0698004800 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f06a4009a90 tx=0x7f0698005830 comp rx=0 tx=0).stop 2024-04-26T23:40:56.278 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.271+0000 7f06af7fe640 1 -- 172.21.15.88:0/3059748821 reap_dead start 2024-04-26T23:40:56.279 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.271+0000 7f06b5551640 1 -- 172.21.15.88:0/3059748821 shutdown_connections 2024-04-26T23:40:56.279 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.271+0000 7f06b5551640 1 -- 172.21.15.88:0/3059748821 >> 172.21.15.88:0/3059748821 conn(0x7f06b00ae010 msgr2=0x7f06b00ae3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:40:56.279 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.271+0000 7f06b5551640 1 -- 172.21.15.88:0/3059748821 shutdown_connections 2024-04-26T23:40:56.279 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.271+0000 7f06b5551640 1 -- 172.21.15.88:0/3059748821 wait complete. 2024-04-26T23:40:56.282 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.272+0000 7f06b5551640 1 Processor -- start 2024-04-26T23:40:56.282 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.272+0000 7f06b5551640 1 -- start start 2024-04-26T23:40:56.282 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.273+0000 7f06b5551640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0698003f60 0x7f06b01499d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:56.282 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.273+0000 7f06b5551640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f06b0155d20 0x7f06b01e2370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:56.282 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.273+0000 7f06b5551640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f06b01598c0 0x7f06b014a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:56.282 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.273+0000 7f06b5551640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f06b015a630 con 0x7f06b0155d20 2024-04-26T23:40:56.282 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.273+0000 7f06b5551640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f06b015aed0 con 0x7f06b01598c0 2024-04-26T23:40:56.282 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.273+0000 7f06b5551640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f06b00c7510 con 0x7f0698003f60 2024-04-26T23:40:56.282 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.273+0000 7f06ae7fc640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f06b0155d20 0x7f06b01e2370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:56.282 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.273+0000 7f06ae7fc640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f06b0155d20 0x7f06b01e2370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:41968/0 (socket says 172.21.15.88:41968) 2024-04-26T23:40:56.282 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.273+0000 7f06ae7fc640 1 -- 172.21.15.88:0/2467681060 learned_addr learned my addr 172.21.15.88:0/2467681060 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:40:56.283 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.273+0000 7f06aeffd640 1 --2- 172.21.15.88:0/2467681060 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0698003f60 0x7f06b01499d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:56.283 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.273+0000 7f06af7fe640 1 --2- 172.21.15.88:0/2467681060 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f06b01598c0 0x7f06b014a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:56.283 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.273+0000 7f06ae7fc640 1 -- 172.21.15.88:0/2467681060 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0698003f60 msgr2=0x7f06b01499d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:56.283 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.273+0000 7f06ae7fc640 1 --2- 172.21.15.88:0/2467681060 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0698003f60 0x7f06b01499d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:56.283 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.273+0000 7f06ae7fc640 1 -- 172.21.15.88:0/2467681060 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f06b01598c0 msgr2=0x7f06b014a870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:56.283 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.273+0000 7f06ae7fc640 1 --2- 172.21.15.88:0/2467681060 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f06b01598c0 0x7f06b014a870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:56.283 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.273+0000 7f06ae7fc640 1 -- 172.21.15.88:0/2467681060 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06b0149f10 con 0x7f06b0155d20 2024-04-26T23:40:56.283 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.273+0000 7f06aeffd640 1 --2- 172.21.15.88:0/2467681060 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0698003f60 0x7f06b01499d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:40:56.283 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.274+0000 7f06ae7fc640 1 --2- 172.21.15.88:0/2467681060 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f06b0155d20 0x7f06b01e2370 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f06a4034040 tx=0x7f06a4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:56.283 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.274+0000 7f06977fe640 1 -- 172.21.15.88:0/2467681060 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06a4040020 con 0x7f06b0155d20 2024-04-26T23:40:56.283 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.274+0000 7f06977fe640 1 -- 172.21.15.88:0/2467681060 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06a4003c60 con 0x7f06b0155d20 2024-04-26T23:40:56.283 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.274+0000 7f06b5551640 1 -- 172.21.15.88:0/2467681060 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06b01ec9b0 con 0x7f06b0155d20 2024-04-26T23:40:56.283 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.274+0000 7f06977fe640 1 -- 172.21.15.88:0/2467681060 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06a4036040 con 0x7f06b0155d20 2024-04-26T23:40:56.283 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.274+0000 7f06b5551640 1 -- 172.21.15.88:0/2467681060 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06b01ecc70 con 0x7f06b0155d20 2024-04-26T23:40:56.284 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.275+0000 7f06b5551640 1 -- 172.21.15.88:0/2467681060 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06b0076650 con 0x7f06b0155d20 2024-04-26T23:40:56.284 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.275+0000 7f06977fe640 1 -- 172.21.15.88:0/2467681060 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f06a4043020 con 0x7f06b0155d20 2024-04-26T23:40:56.284 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.275+0000 7f06977fe640 1 --2- 172.21.15.88:0/2467681060 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f069c06c920 0x7f069c06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:56.284 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.276+0000 7f06aeffd640 1 --2- 172.21.15.88:0/2467681060 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f069c06c920 0x7f069c06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:56.284 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.276+0000 7f06977fe640 1 -- 172.21.15.88:0/2467681060 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7f06a40ab930 con 0x7f06b0155d20 2024-04-26T23:40:56.284 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.276+0000 7f06aeffd640 1 --2- 172.21.15.88:0/2467681060 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f069c06c920 0x7f069c06ede0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f06a0001eb0 tx=0x7f06a0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:56.284 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.280+0000 7f06977fe640 1 -- 172.21.15.88:0/2467681060 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f06a40044e0 con 0x7f06b0155d20 2024-04-26T23:40:56.461 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.457+0000 7f06b5551640 1 -- 172.21.15.88:0/2467681060 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f06b00507a0 con 0x7f06b0155d20 2024-04-26T23:40:56.462 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.459+0000 7f06977fe640 1 -- 172.21.15.88:0/2467681060 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+20343 (secure 0 0 0) 0x7f06a4079ac0 con 0x7f06b0155d20 2024-04-26T23:40:56.463 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-26T23:40:56.463 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":24,"fsid":"555255e9-7ef9-4454-8dc9-35e96b70035c","created":"2024-04-26T23:40:07.836009+0000","modified":"2024-04-26T23:40:42.673801+0000","last_up_change":"2024-04-26T23:40:18.831369+0000","last_in_change":"2024-04-26T23:40:09.944777+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T23:40:19.936127+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"a_metadata","create_time":"2024-04-26T23:40:29.837465+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"a_data","create_time":"2024-04-26T23:40:30.868651+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"b_metadata","create_time":"2024-04-26T23:40:38.753441+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"b_data","create_time":"2024-04-26T23:40:39.974557+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"92aecea3-ed62-4a29-87c0-76758a0816a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":2803186054},{"type":"v1","addr":"172.21.15.88:6801","nonce":2803186054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":2803186054},{"type":"v1","addr":"172.21.15.88:6803","nonce":2803186054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":2803186054},{"type":"v1","addr":"172.21.15.88:6807","nonce":2803186054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":2803186054},{"type":"v1","addr":"172.21.15.88:6805","nonce":2803186054}]},"public_addr":"172.21.15.88:6801/2803186054","cluster_addr":"172.21.15.88:6803/2803186054","heartbeat_back_addr":"172.21.15.88:6807/2803186054","heartbeat_front_addr":"172.21.15.88:6805/2803186054","state":["exists","up"]},{"osd":1,"uuid":"7a6f0fa9-23d0-4747-880f-798d45ec5eeb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":1897380484},{"type":"v1","addr":"172.21.15.88:6817","nonce":1897380484}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":1897380484},{"type":"v1","addr":"172.21.15.88:6819","nonce":1897380484}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1897380484},{"type":"v1","addr":"172.21.15.88:6823","nonce":1897380484}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":1897380484},{"type":"v1","addr":"172.21.15.88:6821","nonce":1897380484}]},"public_addr":"172.21.15.88:6817/1897380484","cluster_addr":"172.21.15.88:6819/1897380484","heartbeat_back_addr":"172.21.15.88:6823/1897380484","heartbeat_front_addr":"172.21.15.88:6821/1897380484","state":["exists","up"]},{"osd":2,"uuid":"6be88ea0-e133-4200-a4b5-f92d664b248a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":648396269},{"type":"v1","addr":"172.21.15.88:6809","nonce":648396269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":648396269},{"type":"v1","addr":"172.21.15.88:6811","nonce":648396269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":648396269},{"type":"v1","addr":"172.21.15.88:6815","nonce":648396269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":648396269},{"type":"v1","addr":"172.21.15.88:6813","nonce":648396269}]},"public_addr":"172.21.15.88:6809/648396269","cluster_addr":"172.21.15.88:6811/648396269","heartbeat_back_addr":"172.21.15.88:6815/648396269","heartbeat_front_addr":"172.21.15.88:6813/648396269","state":["exists","up"]},{"osd":3,"uuid":"dcb0746b-7b3d-4ecf-8089-2493a5d1857c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":2328028922},{"type":"v1","addr":"172.21.15.88:6825","nonce":2328028922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":2328028922},{"type":"v1","addr":"172.21.15.88:6827","nonce":2328028922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":2328028922},{"type":"v1","addr":"172.21.15.88:6831","nonce":2328028922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":2328028922},{"type":"v1","addr":"172.21.15.88:6829","nonce":2328028922}]},"public_addr":"172.21.15.88:6825/2328028922","cluster_addr":"172.21.15.88:6827/2328028922","heartbeat_back_addr":"172.21.15.88:6831/2328028922","heartbeat_front_addr":"172.21.15.88:6829/2328028922","state":["exists","up"]},{"osd":4,"uuid":"c483de66-c44f-450e-a4ce-b132d50882c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":3929617402},{"type":"v1","addr":"172.21.15.175:6809","nonce":3929617402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":3929617402},{"type":"v1","addr":"172.21.15.175:6811","nonce":3929617402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":3929617402},{"type":"v1","addr":"172.21.15.175:6815","nonce":3929617402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":3929617402},{"type":"v1","addr":"172.21.15.175:6813","nonce":3929617402}]},"public_addr":"172.21.15.175:6809/3929617402","cluster_addr":"172.21.15.175:6811/3929617402","heartbeat_back_addr":"172.21.15.175:6815/3929617402","heartbeat_front_addr":"172.21.15.175:6813/3929617402","state":["exists","up"]},{"osd":5,"uuid":"ac3b1669-d228-40dd-9f9a-cb46aa73dd6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":2476644457},{"type":"v1","addr":"172.21.15.175:6801","nonce":2476644457}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":2476644457},{"type":"v1","addr":"172.21.15.175:6803","nonce":2476644457}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":2476644457},{"type":"v1","addr":"172.21.15.175:6807","nonce":2476644457}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":2476644457},{"type":"v1","addr":"172.21.15.175:6805","nonce":2476644457}]},"public_addr":"172.21.15.175:6801/2476644457","cluster_addr":"172.21.15.175:6803/2476644457","heartbeat_back_addr":"172.21.15.175:6807/2476644457","heartbeat_front_addr":"172.21.15.175:6805/2476644457","state":["exists","up"]},{"osd":6,"uuid":"7bef4896-857e-4c11-b3b2-c2e9a8548338","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":3824112919},{"type":"v1","addr":"172.21.15.175:6819","nonce":3824112919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6821","nonce":3824112919},{"type":"v1","addr":"172.21.15.175:6824","nonce":3824112919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":3824112919},{"type":"v1","addr":"172.21.15.175:6831","nonce":3824112919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":3824112919},{"type":"v1","addr":"172.21.15.175:6829","nonce":3824112919}]},"public_addr":"172.21.15.175:6819/3824112919","cluster_addr":"172.21.15.175:6824/3824112919","heartbeat_back_addr":"172.21.15.175:6831/3824112919","heartbeat_front_addr":"172.21.15.175:6829/3824112919","state":["exists","up"]},{"osd":7,"uuid":"e18d9e09-8673-470d-b9dc-280a409b63f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6817","nonce":3319361162},{"type":"v1","addr":"172.21.15.175:6818","nonce":3319361162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":3319361162},{"type":"v1","addr":"172.21.15.175:6822","nonce":3319361162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6827","nonce":3319361162},{"type":"v1","addr":"172.21.15.175:6828","nonce":3319361162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6823","nonce":3319361162},{"type":"v1","addr":"172.21.15.175:6825","nonce":3319361162}]},"public_addr":"172.21.15.175:6818/3319361162","cluster_addr":"172.21.15.175:6822/3319361162","heartbeat_back_addr":"172.21.15.175:6828/3319361162","heartbeat_front_addr":"172.21.15.175:6825/3319361162","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:40:15.126268+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:40:15.050614+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:40:14.995164+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:40:15.078112+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:40:15.159637+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:40:15.091226+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:40:15.140316+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:40:15.089431+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:40:56.465 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.461+0000 7f06b5551640 1 -- 172.21.15.88:0/2467681060 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f069c06c920 msgr2=0x7f069c06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:56.465 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.461+0000 7f06b5551640 1 --2- 172.21.15.88:0/2467681060 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f069c06c920 0x7f069c06ede0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f06a0001eb0 tx=0x7f06a0009040 comp rx=0 tx=0).stop 2024-04-26T23:40:56.465 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.461+0000 7f06b5551640 1 -- 172.21.15.88:0/2467681060 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f06b0155d20 msgr2=0x7f06b01e2370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:56.465 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.461+0000 7f06b5551640 1 --2- 172.21.15.88:0/2467681060 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f06b0155d20 0x7f06b01e2370 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f06a4034040 tx=0x7f06a4004730 comp rx=0 tx=0).stop 2024-04-26T23:40:56.465 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.461+0000 7f06b5551640 1 -- 172.21.15.88:0/2467681060 shutdown_connections 2024-04-26T23:40:56.465 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.461+0000 7f06b5551640 1 --2- 172.21.15.88:0/2467681060 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f069c06c920 0x7f069c06ede0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:56.465 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.461+0000 7f06b5551640 1 --2- 172.21.15.88:0/2467681060 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f06b01598c0 0x7f06b014a870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:56.465 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.461+0000 7f06b5551640 1 --2- 172.21.15.88:0/2467681060 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f06b0155d20 0x7f06b01e2370 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:56.466 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.461+0000 7f06b5551640 1 --2- 172.21.15.88:0/2467681060 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0698003f60 0x7f06b01499d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:56.466 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.461+0000 7f06b5551640 1 -- 172.21.15.88:0/2467681060 >> 172.21.15.88:0/2467681060 conn(0x7f06b00ae010 msgr2=0x7f06b014e590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:40:56.466 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.461+0000 7f06b5551640 1 -- 172.21.15.88:0/2467681060 shutdown_connections 2024-04-26T23:40:56.466 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.461+0000 7f06b5551640 1 -- 172.21.15.88:0/2467681060 wait complete. 2024-04-26T23:40:56.476 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T23:40:19.936127+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'a_metadata', 'create_time': '2024-04-26T23:40:29.837465+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'a'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'a_data', 'create_time': '2024-04-26T23:40:30.868651+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'a'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'b_metadata', 'create_time': '2024-04-26T23:40:38.753441+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'b'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'b_data', 'create_time': '2024-04-26T23:40:39.974557+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'b'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T23:40:56.476 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T23:40:56.576 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.572+0000 7fc815524640 1 Processor -- start 2024-04-26T23:40:56.577 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.572+0000 7fc815524640 1 -- start start 2024-04-26T23:40:56.577 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.573+0000 7fc815524640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc810154160 0x7fc810156bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:56.577 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.573+0000 7fc815524640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc8100c8df0 con 0x7fc81015a1a0 2024-04-26T23:40:56.577 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.573+0000 7fc815524640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc810154540 con 0x7fc8100ca5a0 2024-04-26T23:40:56.577 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.573+0000 7fc815524640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7fc8100c9100 con 0x7fc810154160 2024-04-26T23:40:56.577 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.573+0000 7fc80effd640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc810154160 0x7fc810156bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:56.577 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.573+0000 7fc80f7fe640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fc81015a1a0 0x7fc8100c9590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:58152/0 (socket says 172.21.15.88:58152) 2024-04-26T23:40:56.577 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.573+0000 7fc80f7fe640 1 -- 172.21.15.88:0/3555638478 learned_addr learned my addr 172.21.15.88:0/3555638478 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-26T23:40:56.579 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.573+0000 7fc80effd640 1 -- 172.21.15.88:0/3555638478 >> v1:172.21.15.175:6789/0 conn(0x7fc8100ca5a0 legacy=0x7fc8100c6e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:40:56.579 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.573+0000 7fc80effd640 1 -- 172.21.15.88:0/3555638478 >> v1:172.21.15.88:6789/0 conn(0x7fc81015a1a0 legacy=0x7fc8100c9590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:56.579 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.573+0000 7fc80effd640 1 -- 172.21.15.88:0/3555638478 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc81015a910 con 0x7fc810154160 2024-04-26T23:40:56.579 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.573+0000 7fc80e7fc640 1 -- 172.21.15.88:0/3555638478 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1849240769 0 0) 0x7fc808001490 con 0x7fc81015a1a0 2024-04-26T23:40:56.579 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.574+0000 7fc80effd640 1 --2- 172.21.15.88:0/3555638478 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc810154160 0x7fc810156bb0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fc81006da80 tx=0x7fc80002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e06cb9e2029019ab server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:56.579 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.574+0000 7fc80e7fc640 1 -- 172.21.15.88:0/3555638478 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc800037070 con 0x7fc810154160 2024-04-26T23:40:56.579 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.574+0000 7fc80e7fc640 1 -- 172.21.15.88:0/3555638478 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc800032440 con 0x7fc810154160 2024-04-26T23:40:56.579 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.574+0000 7fc80e7fc640 1 -- 172.21.15.88:0/3555638478 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc800032810 con 0x7fc810154160 2024-04-26T23:40:56.579 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.575+0000 7fc815524640 1 -- 172.21.15.88:0/3555638478 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc810154160 msgr2=0x7fc810156bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:56.579 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.575+0000 7fc815524640 1 --2- 172.21.15.88:0/3555638478 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc810154160 0x7fc810156bb0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fc81006da80 tx=0x7fc80002a1a0 comp rx=0 tx=0).stop 2024-04-26T23:40:56.579 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.575+0000 7fc815524640 1 -- 172.21.15.88:0/3555638478 shutdown_connections 2024-04-26T23:40:56.579 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.575+0000 7fc815524640 1 --2- 172.21.15.88:0/3555638478 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc810154160 0x7fc810156bb0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:56.579 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.575+0000 7fc815524640 1 -- 172.21.15.88:0/3555638478 >> 172.21.15.88:0/3555638478 conn(0x7fc8100ae010 msgr2=0x7fc8100ae3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:40:56.580 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.575+0000 7fc815524640 1 -- 172.21.15.88:0/3555638478 shutdown_connections 2024-04-26T23:40:56.580 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.575+0000 7fc815524640 1 -- 172.21.15.88:0/3555638478 wait complete. 2024-04-26T23:40:56.583 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.576+0000 7fc815524640 1 Processor -- start 2024-04-26T23:40:56.583 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.576+0000 7fc815524640 1 -- start start 2024-04-26T23:40:56.583 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.576+0000 7fc815524640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc8100ca5a0 0x7fc8101f0760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:56.583 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.576+0000 7fc815524640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc810154160 0x7fc81014b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:56.583 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.576+0000 7fc815524640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc81015a1a0 0x7fc810154ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:56.583 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.576+0000 7fc815524640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fc81015a5b0 con 0x7fc8100ca5a0 2024-04-26T23:40:56.583 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.576+0000 7fc815524640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc81015aed0 con 0x7fc810154160 2024-04-26T23:40:56.583 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.576+0000 7fc815524640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fc8100c7510 con 0x7fc81015a1a0 2024-04-26T23:40:56.583 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.576+0000 7fc80effd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc8100ca5a0 0x7fc8101f0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:56.583 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.576+0000 7fc80effd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc8100ca5a0 0x7fc8101f0760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:41980/0 (socket says 172.21.15.88:41980) 2024-04-26T23:40:56.583 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.576+0000 7fc80effd640 1 -- 172.21.15.88:0/63138345 learned_addr learned my addr 172.21.15.88:0/63138345 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:40:56.583 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.577+0000 7fc807fff640 1 --2- 172.21.15.88:0/63138345 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc810154160 0x7fc81014b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:56.583 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.577+0000 7fc80f7fe640 1 --2- 172.21.15.88:0/63138345 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc81015a1a0 0x7fc810154ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:56.583 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.577+0000 7fc80effd640 1 -- 172.21.15.88:0/63138345 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc81015a1a0 msgr2=0x7fc810154ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:56.584 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.577+0000 7fc80effd640 1 --2- 172.21.15.88:0/63138345 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc81015a1a0 0x7fc810154ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:56.584 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.577+0000 7fc80effd640 1 -- 172.21.15.88:0/63138345 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc810154160 msgr2=0x7fc81014b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:56.584 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.577+0000 7fc80effd640 1 --2- 172.21.15.88:0/63138345 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc810154160 0x7fc81014b9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:56.584 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.577+0000 7fc80effd640 1 -- 172.21.15.88:0/63138345 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc810159130 con 0x7fc8100ca5a0 2024-04-26T23:40:56.584 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.577+0000 7fc80effd640 1 --2- 172.21.15.88:0/63138345 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc8100ca5a0 0x7fc8101f0760 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fc800009890 tx=0x7fc8000046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:56.584 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.577+0000 7fc8077fe640 1 -- 172.21.15.88:0/63138345 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc800041070 con 0x7fc8100ca5a0 2024-04-26T23:40:56.584 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.577+0000 7fc8077fe640 1 -- 172.21.15.88:0/63138345 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc80003c950 con 0x7fc8100ca5a0 2024-04-26T23:40:56.584 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.577+0000 7fc815524640 1 -- 172.21.15.88:0/63138345 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc810149a90 con 0x7fc8100ca5a0 2024-04-26T23:40:56.584 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.577+0000 7fc8077fe640 1 -- 172.21.15.88:0/63138345 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc800037040 con 0x7fc8100ca5a0 2024-04-26T23:40:56.584 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.577+0000 7fc815524640 1 -- 172.21.15.88:0/63138345 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8100c3a80 con 0x7fc8100ca5a0 2024-04-26T23:40:56.584 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.578+0000 7fc815524640 1 -- 172.21.15.88:0/63138345 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc810076650 con 0x7fc8100ca5a0 2024-04-26T23:40:56.584 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.579+0000 7fc8077fe640 1 -- 172.21.15.88:0/63138345 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc800044070 con 0x7fc8100ca5a0 2024-04-26T23:40:56.584 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.579+0000 7fc8077fe640 1 --2- 172.21.15.88:0/63138345 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fc7f006c8f0 0x7fc7f006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:56.584 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.579+0000 7fc8077fe640 1 -- 172.21.15.88:0/63138345 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7fc8000acc00 con 0x7fc8100ca5a0 2024-04-26T23:40:56.585 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.579+0000 7fc807fff640 1 --2- 172.21.15.88:0/63138345 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fc7f006c8f0 0x7fc7f006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:56.586 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.580+0000 7fc807fff640 1 --2- 172.21.15.88:0/63138345 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fc7f006c8f0 0x7fc7f006edb0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fc81014c4e0 tx=0x7fc7f8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:56.588 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.584+0000 7fc8077fe640 1 -- 172.21.15.88:0/63138345 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fc8000b3080 con 0x7fc8100ca5a0 2024-04-26T23:40:56.767 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.763+0000 7fc815524640 1 -- 172.21.15.88:0/63138345 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fc8100507a0 con 0x7fc8100ca5a0 2024-04-26T23:40:56.769 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.763+0000 7fc8077fe640 1 -- 172.21.15.88:0/63138345 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) ==== 93+0+10 (secure 0 0 0) 0x7fc810159130 con 0x7fc8100ca5a0 2024-04-26T23:40:56.769 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 1 2024-04-26T23:40:56.770 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.765+0000 7fc815524640 1 -- 172.21.15.88:0/63138345 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fc7f006c8f0 msgr2=0x7fc7f006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:56.770 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.765+0000 7fc815524640 1 --2- 172.21.15.88:0/63138345 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fc7f006c8f0 0x7fc7f006edb0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fc81014c4e0 tx=0x7fc7f8009040 comp rx=0 tx=0).stop 2024-04-26T23:40:56.770 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.765+0000 7fc815524640 1 -- 172.21.15.88:0/63138345 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc8100ca5a0 msgr2=0x7fc8101f0760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:56.770 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.765+0000 7fc815524640 1 --2- 172.21.15.88:0/63138345 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc8100ca5a0 0x7fc8101f0760 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fc800009890 tx=0x7fc8000046c0 comp rx=0 tx=0).stop 2024-04-26T23:40:56.770 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.765+0000 7fc815524640 1 -- 172.21.15.88:0/63138345 shutdown_connections 2024-04-26T23:40:56.770 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.765+0000 7fc815524640 1 --2- 172.21.15.88:0/63138345 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fc7f006c8f0 0x7fc7f006edb0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:56.770 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.765+0000 7fc815524640 1 --2- 172.21.15.88:0/63138345 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc81015a1a0 0x7fc810154ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:56.770 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.765+0000 7fc815524640 1 --2- 172.21.15.88:0/63138345 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc810154160 0x7fc81014b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:56.770 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.765+0000 7fc815524640 1 --2- 172.21.15.88:0/63138345 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc8100ca5a0 0x7fc8101f0760 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:56.770 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.765+0000 7fc815524640 1 -- 172.21.15.88:0/63138345 >> 172.21.15.88:0/63138345 conn(0x7fc8100ae010 msgr2=0x7fc8100ae3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:40:56.771 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.765+0000 7fc815524640 1 -- 172.21.15.88:0/63138345 shutdown_connections 2024-04-26T23:40:56.771 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.765+0000 7fc815524640 1 -- 172.21.15.88:0/63138345 wait complete. 2024-04-26T23:40:56.780 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get a_metadata pg_num 2024-04-26T23:40:56.880 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.876+0000 7f6d62e52640 1 Processor -- start 2024-04-26T23:40:56.880 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.876+0000 7f6d62e52640 1 -- start start 2024-04-26T23:40:56.884 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.877+0000 7f6d62e52640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6d5c0acc30 0x7f6d5c15abf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:56.884 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.877+0000 7f6d62e52640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f6d5c1572e0 0x7f6d5c157770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:56.884 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.877+0000 7f6d62e52640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6d5c0ad010 con 0x7f6d5c0c4250 2024-04-26T23:40:56.884 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.877+0000 7f6d62e52640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f6d5c0c8ba0 con 0x7f6d5c1572e0 2024-04-26T23:40:56.884 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.877+0000 7f6d62e52640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f6d5c156e50 con 0x7f6d5c0acc30 2024-04-26T23:40:56.884 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.877+0000 7f6d5bfff640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f6d5c0c4250 0x7f6d5c0c3790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:58154/0 (socket says 172.21.15.88:58154) 2024-04-26T23:40:56.885 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.877+0000 7f6d5bfff640 1 -- 172.21.15.88:0/1778870194 learned_addr learned my addr 172.21.15.88:0/1778870194 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-26T23:40:56.885 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.877+0000 7f6d5b7fe640 1 -- 172.21.15.88:0/1778870194 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 312663501 0 0) 0x7f6d5c0ad010 con 0x7f6d5c0c4250 2024-04-26T23:40:56.885 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.877+0000 7f6d60bee640 1 --2- 172.21.15.88:0/1778870194 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6d5c0acc30 0x7f6d5c15abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:56.885 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.877+0000 7f6d613ef640 1 --2- 172.21.15.88:0/1778870194 >> v2:172.21.15.175:3300/0 conn(0x7f6d5c1572e0 0x7f6d5c157770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:56.885 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.877+0000 7f6d5b7fe640 1 -- 172.21.15.88:0/1778870194 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6d44003520 con 0x7f6d5c0c4250 2024-04-26T23:40:56.885 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.877+0000 7f6d5b7fe640 1 -- 172.21.15.88:0/1778870194 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3025701229 0 0) 0x7f6d44003520 con 0x7f6d5c0c4250 2024-04-26T23:40:56.885 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.877+0000 7f6d5b7fe640 1 -- 172.21.15.88:0/1778870194 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6d5c0acc30 msgr2=0x7f6d5c15abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:40:56.885 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.877+0000 7f6d5b7fe640 1 --2- 172.21.15.88:0/1778870194 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6d5c0acc30 0x7f6d5c15abf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:56.885 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.877+0000 7f6d5b7fe640 1 -- 172.21.15.88:0/1778870194 >> v2:172.21.15.175:3300/0 conn(0x7f6d5c1572e0 msgr2=0x7f6d5c157770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:40:56.885 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.877+0000 7f6d5b7fe640 1 --2- 172.21.15.88:0/1778870194 >> v2:172.21.15.175:3300/0 conn(0x7f6d5c1572e0 0x7f6d5c157770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:56.885 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.877+0000 7f6d5b7fe640 1 -- 172.21.15.88:0/1778870194 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d5c15b130 con 0x7f6d5c0c4250 2024-04-26T23:40:56.885 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.878+0000 7f6d5b7fe640 1 -- 172.21.15.88:0/1778870194 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 356324787 0 0) 0x7f6d50001670 con 0x7f6d5c0c4250 2024-04-26T23:40:56.885 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.878+0000 7f6d5b7fe640 1 -- 172.21.15.88:0/1778870194 >> v1:172.21.15.88:6789/0 conn(0x7f6d5c0c4250 legacy=0x7f6d5c0c3790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:56.885 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.878+0000 7f6d5b7fe640 1 --2- 172.21.15.88:0/1778870194 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6d440039b0 0x7f6d44003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:56.885 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.878+0000 7f6d5b7fe640 1 --2- 172.21.15.88:0/1778870194 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6d5c0acc30 0x7f6d44004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:56.886 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.878+0000 7f6d5b7fe640 1 --2- 172.21.15.88:0/1778870194 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6d44004d40 0x7f6d440051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:56.886 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.878+0000 7f6d5b7fe640 1 -- 172.21.15.88:0/1778870194 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f6d5c0c8ba0 con 0x7f6d44004d40 2024-04-26T23:40:56.886 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.878+0000 7f6d5b7fe640 1 -- 172.21.15.88:0/1778870194 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f6d5c156e50 con 0x7f6d440039b0 2024-04-26T23:40:56.886 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.878+0000 7f6d5b7fe640 1 -- 172.21.15.88:0/1778870194 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f6d4400b9c0 con 0x7f6d5c0acc30 2024-04-26T23:40:56.886 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.878+0000 7f6d613ef640 1 --2- 172.21.15.88:0/1778870194 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6d44004d40 0x7f6d440051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:56.886 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.878+0000 7f6d60bee640 1 --2- 172.21.15.88:0/1778870194 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6d440039b0 0x7f6d44003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:56.886 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.878+0000 7f6d5bfff640 1 --2- 172.21.15.88:0/1778870194 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6d5c0acc30 0x7f6d44004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:56.886 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.878+0000 7f6d613ef640 1 -- 172.21.15.88:0/1778870194 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6d5c0acc30 msgr2=0x7f6d44004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:40:56.886 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.878+0000 7f6d613ef640 1 --2- 172.21.15.88:0/1778870194 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6d5c0acc30 0x7f6d44004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:56.886 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.878+0000 7f6d613ef640 1 -- 172.21.15.88:0/1778870194 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6d440039b0 msgr2=0x7f6d44003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:40:56.886 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.878+0000 7f6d613ef640 1 --2- 172.21.15.88:0/1778870194 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6d440039b0 0x7f6d44003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:56.886 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.878+0000 7f6d613ef640 1 -- 172.21.15.88:0/1778870194 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d44003520 con 0x7f6d44004d40 2024-04-26T23:40:56.886 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.879+0000 7f6d613ef640 1 --2- 172.21.15.88:0/1778870194 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6d44004d40 0x7f6d440051c0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f6d54009fc0 tx=0x7f6d44005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1c7bbbf78d2bbf0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:56.886 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.879+0000 7f6d5b7fe640 1 -- 172.21.15.88:0/1778870194 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d54009c10 con 0x7f6d44004d40 2024-04-26T23:40:56.887 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.879+0000 7f6d5b7fe640 1 -- 172.21.15.88:0/1778870194 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d54036070 con 0x7f6d44004d40 2024-04-26T23:40:56.887 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.879+0000 7f6d5b7fe640 1 -- 172.21.15.88:0/1778870194 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d5402d070 con 0x7f6d44004d40 2024-04-26T23:40:56.887 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.879+0000 7f6d62e52640 1 -- 172.21.15.88:0/1778870194 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6d44004d40 msgr2=0x7f6d440051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:56.887 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.879+0000 7f6d62e52640 1 --2- 172.21.15.88:0/1778870194 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6d44004d40 0x7f6d440051c0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f6d54009fc0 tx=0x7f6d44005830 comp rx=0 tx=0).stop 2024-04-26T23:40:56.887 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.879+0000 7f6d613ef640 1 -- 172.21.15.88:0/1778870194 reap_dead start 2024-04-26T23:40:56.887 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.879+0000 7f6d62e52640 1 -- 172.21.15.88:0/1778870194 shutdown_connections 2024-04-26T23:40:56.887 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.879+0000 7f6d62e52640 1 -- 172.21.15.88:0/1778870194 >> 172.21.15.88:0/1778870194 conn(0x7f6d5c0c6e60 msgr2=0x7f6d5c0c7270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:40:56.887 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.879+0000 7f6d62e52640 1 -- 172.21.15.88:0/1778870194 shutdown_connections 2024-04-26T23:40:56.887 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.879+0000 7f6d62e52640 1 -- 172.21.15.88:0/1778870194 wait complete. 2024-04-26T23:40:56.887 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.880+0000 7f6d62e52640 1 Processor -- start 2024-04-26T23:40:56.887 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.881+0000 7f6d62e52640 1 -- start start 2024-04-26T23:40:56.890 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.881+0000 7f6d62e52640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6d44004d40 0x7f6d5c14fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:56.890 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.881+0000 7f6d62e52640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6d5c15ac10 0x7f6d5c0ae770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:56.890 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.881+0000 7f6d62e52640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6d5c06f570 0x7f6d5c06f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:56.890 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.881+0000 7f6d62e52640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f6d5c0c88c0 con 0x7f6d5c06f570 2024-04-26T23:40:56.890 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.881+0000 7f6d62e52640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f6d5c0c85e0 con 0x7f6d44004d40 2024-04-26T23:40:56.890 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.881+0000 7f6d62e52640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f6d5c0c3ea0 con 0x7f6d5c15ac10 2024-04-26T23:40:56.890 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.881+0000 7f6d613ef640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6d5c06f570 0x7f6d5c06f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:56.890 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.881+0000 7f6d613ef640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6d5c06f570 0x7f6d5c06f9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:41996/0 (socket says 172.21.15.88:41996) 2024-04-26T23:40:56.891 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.881+0000 7f6d613ef640 1 -- 172.21.15.88:0/1747397352 learned_addr learned my addr 172.21.15.88:0/1747397352 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:40:56.891 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.881+0000 7f6d60bee640 1 --2- 172.21.15.88:0/1747397352 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6d44004d40 0x7f6d5c14fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:56.891 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.881+0000 7f6d5bfff640 1 --2- 172.21.15.88:0/1747397352 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6d5c15ac10 0x7f6d5c0ae770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:56.891 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.882+0000 7f6d613ef640 1 -- 172.21.15.88:0/1747397352 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6d5c15ac10 msgr2=0x7f6d5c0ae770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:56.891 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.882+0000 7f6d613ef640 1 --2- 172.21.15.88:0/1747397352 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6d5c15ac10 0x7f6d5c0ae770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:56.891 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.882+0000 7f6d613ef640 1 -- 172.21.15.88:0/1747397352 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6d44004d40 msgr2=0x7f6d5c14fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:56.891 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.882+0000 7f6d613ef640 1 --2- 172.21.15.88:0/1747397352 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6d44004d40 0x7f6d5c14fca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:56.891 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.882+0000 7f6d613ef640 1 -- 172.21.15.88:0/1747397352 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d5c1ecc60 con 0x7f6d5c06f570 2024-04-26T23:40:56.891 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.882+0000 7f6d60bee640 1 --2- 172.21.15.88:0/1747397352 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6d44004d40 0x7f6d5c14fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:40:56.891 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.882+0000 7f6d613ef640 1 --2- 172.21.15.88:0/1747397352 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6d5c06f570 0x7f6d5c06f9f0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f6d54033040 tx=0x7f6d54009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:56.891 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.882+0000 7f6d597fa640 1 -- 172.21.15.88:0/1747397352 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d54009c10 con 0x7f6d5c06f570 2024-04-26T23:40:56.891 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.882+0000 7f6d597fa640 1 -- 172.21.15.88:0/1747397352 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d54003b90 con 0x7f6d5c06f570 2024-04-26T23:40:56.891 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.882+0000 7f6d62e52640 1 -- 172.21.15.88:0/1747397352 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d5c1ecf40 con 0x7f6d5c06f570 2024-04-26T23:40:56.891 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.882+0000 7f6d597fa640 1 -- 172.21.15.88:0/1747397352 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d54004020 con 0x7f6d5c06f570 2024-04-26T23:40:56.891 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.882+0000 7f6d62e52640 1 -- 172.21.15.88:0/1747397352 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d5c15a060 con 0x7f6d5c06f570 2024-04-26T23:40:56.892 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.883+0000 7f6d62e52640 1 -- 172.21.15.88:0/1747397352 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d5c14e7e0 con 0x7f6d5c06f570 2024-04-26T23:40:56.892 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.883+0000 7f6d597fa640 1 -- 172.21.15.88:0/1747397352 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6d54005d10 con 0x7f6d5c06f570 2024-04-26T23:40:56.892 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.884+0000 7f6d597fa640 1 --2- 172.21.15.88:0/1747397352 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f6d4806c8f0 0x7f6d4806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:56.892 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.884+0000 7f6d597fa640 1 -- 172.21.15.88:0/1747397352 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7f6d540ad700 con 0x7f6d5c06f570 2024-04-26T23:40:56.892 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.884+0000 7f6d60bee640 1 --2- 172.21.15.88:0/1747397352 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f6d4806c8f0 0x7f6d4806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:56.892 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.884+0000 7f6d60bee640 1 --2- 172.21.15.88:0/1747397352 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f6d4806c8f0 0x7f6d4806edb0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f6d4c009b40 tx=0x7f6d4c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:56.892 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:56.888+0000 7f6d597fa640 1 -- 172.21.15.88:0/1747397352 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f6d5404a060 con 0x7f6d5c06f570 2024-04-26T23:40:57.070 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:57.066+0000 7f6d62e52640 1 -- 172.21.15.88:0/1747397352 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "a_metadata", "var": "pg_num"} v 0) -- 0x7f6d5c15a260 con 0x7f6d5c06f570 2024-04-26T23:40:57.070 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:57.067+0000 7f6d597fa640 1 -- 172.21.15.88:0/1747397352 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "a_metadata", "var": "pg_num"}]=0 v24) ==== 99+0+11 (secure 0 0 0) 0x7f6d5c15a260 con 0x7f6d5c06f570 2024-04-26T23:40:57.071 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 32 2024-04-26T23:40:57.073 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:57.068+0000 7f6d62e52640 1 -- 172.21.15.88:0/1747397352 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f6d4806c8f0 msgr2=0x7f6d4806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:57.073 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:57.068+0000 7f6d62e52640 1 --2- 172.21.15.88:0/1747397352 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f6d4806c8f0 0x7f6d4806edb0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f6d4c009b40 tx=0x7f6d4c008040 comp rx=0 tx=0).stop 2024-04-26T23:40:57.073 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:57.068+0000 7f6d62e52640 1 -- 172.21.15.88:0/1747397352 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6d5c06f570 msgr2=0x7f6d5c06f9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:57.073 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:57.068+0000 7f6d62e52640 1 --2- 172.21.15.88:0/1747397352 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6d5c06f570 0x7f6d5c06f9f0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f6d54033040 tx=0x7f6d54009750 comp rx=0 tx=0).stop 2024-04-26T23:40:57.073 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:57.069+0000 7f6d62e52640 1 -- 172.21.15.88:0/1747397352 shutdown_connections 2024-04-26T23:40:57.073 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:57.069+0000 7f6d62e52640 1 --2- 172.21.15.88:0/1747397352 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f6d4806c8f0 0x7f6d4806edb0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:57.073 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:57.069+0000 7f6d62e52640 1 --2- 172.21.15.88:0/1747397352 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6d5c15ac10 0x7f6d5c0ae770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:57.073 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:57.069+0000 7f6d62e52640 1 --2- 172.21.15.88:0/1747397352 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6d5c06f570 0x7f6d5c06f9f0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:57.073 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:57.069+0000 7f6d62e52640 1 --2- 172.21.15.88:0/1747397352 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6d44004d40 0x7f6d5c14fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:57.073 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:57.069+0000 7f6d62e52640 1 -- 172.21.15.88:0/1747397352 >> 172.21.15.88:0/1747397352 conn(0x7f6d5c0c6e60 msgr2=0x7f6d5c154a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:40:57.073 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:57.069+0000 7f6d62e52640 1 -- 172.21.15.88:0/1747397352 shutdown_connections 2024-04-26T23:40:57.073 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:57.069+0000 7f6d62e52640 1 -- 172.21.15.88:0/1747397352 wait complete. 2024-04-26T23:40:57.083 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get a_data pg_num 2024-04-26T23:40:57.182 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:57.178+0000 7f06fd69c640 1 Processor -- start 2024-04-26T23:40:57.182 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:57.178+0000 7f06fd69c640 1 -- start start 2024-04-26T23:40:57.184 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:57.179+0000 7f06fd69c640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f06f806d590 0x7f06f8158d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:57.184 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:57.179+0000 7f06fd69c640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f06f8154e10 con 0x7f06f8070120 2024-04-26T23:40:57.184 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:57.179+0000 7f06fd69c640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f06f8159240 con 0x7f06f80af140 2024-04-26T23:40:57.184 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:57.179+0000 7f06fd69c640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f06f81559e0 con 0x7f06f806d590 2024-04-26T23:40:57.184 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:57.179+0000 7f06f67fc640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f06f8070120 0x7f06f80aea30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:58156/0 (socket says 172.21.15.88:58156) 2024-04-26T23:40:57.184 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:57.179+0000 7f06f67fc640 1 -- 172.21.15.88:0/2032455690 learned_addr learned my addr 172.21.15.88:0/2032455690 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-26T23:40:57.184 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:57.179+0000 7f06f6ffd640 1 --2- 172.21.15.88:0/2032455690 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f06f806d590 0x7f06f8158d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:57.184 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:57.180+0000 7f06f5ffb640 1 -- 172.21.15.88:0/2032455690 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3983145691 0 0) 0x7f06f8154e10 con 0x7f06f8070120 2024-04-26T23:40:57.184 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:57.180+0000 7f06f5ffb640 1 -- 172.21.15.88:0/2032455690 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f06e0003520 con 0x7f06f8070120 2024-04-26T23:40:57.184 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:57.180+0000 7f06f5ffb640 1 -- 172.21.15.88:0/2032455690 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3701335841 0 0) 0x7f06f8159240 con 0x7f06f80af140 2024-04-26T23:40:57.184 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:57.180+0000 7f06f5ffb640 1 -- 172.21.15.88:0/2032455690 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f06f8154e10 con 0x7f06f80af140 2024-04-26T23:40:57.184 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:57.180+0000 7f06f5ffb640 1 -- 172.21.15.88:0/2032455690 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4199357468 0 0) 0x7f06e0003520 con 0x7f06f8070120 2024-04-26T23:40:57.184 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:57.180+0000 7f06f6ffd640 1 -- 172.21.15.88:0/2032455690 >> v1:172.21.15.175:6789/0 conn(0x7f06f80af140 legacy=0x7f06f80c3be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:57.185 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:57.180+0000 7f06f6ffd640 1 -- 172.21.15.88:0/2032455690 >> v1:172.21.15.88:6789/0 conn(0x7f06f8070120 legacy=0x7f06f80aea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:57.185 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:57.180+0000 7f06f6ffd640 1 -- 172.21.15.88:0/2032455690 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06f81550b0 con 0x7f06f806d590 2024-04-26T23:40:57.186 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:57.181+0000 7f06f6ffd640 1 --2- 172.21.15.88:0/2032455690 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f06f806d590 0x7f06f8158d00 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f06e8009dc0 tx=0x7f06e802a5d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d6fdb9e77b7ca06f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:57.186 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:57.181+0000 7f06f5ffb640 1 -- 172.21.15.88:0/2032455690 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06ec001690 con 0x7f06f806d590 2024-04-26T23:40:57.186 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:57.181+0000 7f06f5ffb640 1 -- 172.21.15.88:0/2032455690 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06e8007540 con 0x7f06f806d590 2024-04-26T23:40:57.186 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:57.181+0000 7f06f5ffb640 1 -- 172.21.15.88:0/2032455690 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06e80078f0 con 0x7f06f806d590 2024-04-26T23:40:57.186 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:57.181+0000 7f06fd69c640 1 -- 172.21.15.88:0/2032455690 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f06f806d590 msgr2=0x7f06f8158d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:57.186 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:57.181+0000 7f06fd69c640 1 --2- 172.21.15.88:0/2032455690 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f06f806d590 0x7f06f8158d00 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f06e8009dc0 tx=0x7f06e802a5d0 comp rx=0 tx=0).stop 2024-04-26T23:40:57.186 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:57.181+0000 7f06fd69c640 1 -- 172.21.15.88:0/2032455690 shutdown_connections 2024-04-26T23:40:57.186 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:57.181+0000 7f06fd69c640 1 --2- 172.21.15.88:0/2032455690 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f06f806d590 0x7f06f8158d00 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:57.186 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:57.181+0000 7f06fd69c640 1 -- 172.21.15.88:0/2032455690 >> 172.21.15.88:0/2032455690 conn(0x7f06f80c5ce0 msgr2=0x7f06f80c60f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:40:57.186 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:57.181+0000 7f06fd69c640 1 -- 172.21.15.88:0/2032455690 shutdown_connections 2024-04-26T23:40:57.186 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:57.181+0000 7f06fd69c640 1 -- 172.21.15.88:0/2032455690 wait complete. 2024-04-26T23:40:57.188 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:57.182+0000 7f06fd69c640 1 Processor -- start 2024-04-26T23:40:57.189 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:57.183+0000 7f06fd69c640 1 -- start start 2024-04-26T23:40:57.189 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:57.183+0000 7f06fd69c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f06f806d590 0x7f06f80c1f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:57.189 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:57.183+0000 7f06fd69c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f06f8070120 0x7f06f80c3d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:57.189 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:57.183+0000 7f06fd69c640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f06f80af140 0x7f06f81ee510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:57.189 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:57.183+0000 7f06fd69c640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f06f806d970 con 0x7f06f8070120 2024-04-26T23:40:57.189 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:57.183+0000 7f06fd69c640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f06f8155670 con 0x7f06f806d590 2024-04-26T23:40:57.189 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:57.183+0000 7f06fd69c640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f06f806daf0 con 0x7f06f80af140 2024-04-26T23:40:57.189 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:57.183+0000 7f06f67fc640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f06f8070120 0x7f06f80c3d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:57.189 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:57.183+0000 7f06f67fc640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f06f8070120 0x7f06f80c3d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:42010/0 (socket says 172.21.15.88:42010) 2024-04-26T23:40:57.189 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:57.183+0000 7f06f67fc640 1 -- 172.21.15.88:0/3276292317 learned_addr learned my addr 172.21.15.88:0/3276292317 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:40:57.189 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:57.183+0000 7f06f6ffd640 1 --2- 172.21.15.88:0/3276292317 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f06f806d590 0x7f06f80c1f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:57.189 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:57.183+0000 7f06f77fe640 1 --2- 172.21.15.88:0/3276292317 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f06f80af140 0x7f06f81ee510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:57.189 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:57.183+0000 7f06f67fc640 1 -- 172.21.15.88:0/3276292317 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f06f80af140 msgr2=0x7f06f81ee510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:57.189 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:57.184+0000 7f06f67fc640 1 --2- 172.21.15.88:0/3276292317 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f06f80af140 0x7f06f81ee510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:57.189 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:57.184+0000 7f06f67fc640 1 -- 172.21.15.88:0/3276292317 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f06f806d590 msgr2=0x7f06f80c1f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:57.190 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:57.184+0000 7f06f67fc640 1 --2- 172.21.15.88:0/3276292317 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f06f806d590 0x7f06f80c1f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:57.190 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:57.184+0000 7f06f67fc640 1 -- 172.21.15.88:0/3276292317 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06f81eb2a0 con 0x7f06f8070120 2024-04-26T23:40:57.190 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:57.184+0000 7f06f67fc640 1 --2- 172.21.15.88:0/3276292317 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f06f8070120 0x7f06f80c3d50 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f06ec001200 tx=0x7f06ec00c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:57.190 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:57.184+0000 7f06df7fe640 1 -- 172.21.15.88:0/3276292317 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06ec018070 con 0x7f06f8070120 2024-04-26T23:40:57.190 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:57.184+0000 7f06df7fe640 1 -- 172.21.15.88:0/3276292317 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06ec0074e0 con 0x7f06f8070120 2024-04-26T23:40:57.190 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:57.184+0000 7f06df7fe640 1 -- 172.21.15.88:0/3276292317 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06ec004a20 con 0x7f06f8070120 2024-04-26T23:40:57.190 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:57.184+0000 7f06fd69c640 1 -- 172.21.15.88:0/3276292317 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06f81eb580 con 0x7f06f8070120 2024-04-26T23:40:57.190 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:57.184+0000 7f06fd69c640 1 -- 172.21.15.88:0/3276292317 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06f80c4290 con 0x7f06f8070120 2024-04-26T23:40:57.190 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:57.185+0000 7f06fd69c640 1 -- 172.21.15.88:0/3276292317 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06f8068dc0 con 0x7f06f8070120 2024-04-26T23:40:57.191 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:57.185+0000 7f06df7fe640 1 -- 172.21.15.88:0/3276292317 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f06ec01b070 con 0x7f06f8070120 2024-04-26T23:40:57.191 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:57.186+0000 7f06df7fe640 1 --2- 172.21.15.88:0/3276292317 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f06e406c920 0x7f06e406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:57.191 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:57.186+0000 7f06df7fe640 1 -- 172.21.15.88:0/3276292317 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7f06ec08b080 con 0x7f06f8070120 2024-04-26T23:40:57.191 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:57.186+0000 7f06f6ffd640 1 --2- 172.21.15.88:0/3276292317 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f06e406c920 0x7f06e406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:57.191 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:57.186+0000 7f06f6ffd640 1 --2- 172.21.15.88:0/3276292317 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f06e406c920 0x7f06e406ede0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f06e8034000 tx=0x7f06e802f000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:57.194 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:57.190+0000 7f06df7fe640 1 -- 172.21.15.88:0/3276292317 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f06ec058bc0 con 0x7f06f8070120 2024-04-26T23:40:57.368 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:57.364+0000 7f06fd69c640 1 -- 172.21.15.88:0/3276292317 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "a_data", "var": "pg_num"} v 0) -- 0x7f06f80507a0 con 0x7f06f8070120 2024-04-26T23:40:57.369 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:57.365+0000 7f06df7fe640 1 -- 172.21.15.88:0/3276292317 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "a_data", "var": "pg_num"}]=0 v24) ==== 95+0+11 (secure 0 0 0) 0x7f06ec05cec0 con 0x7f06f8070120 2024-04-26T23:40:57.369 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 64 2024-04-26T23:40:57.371 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:57.367+0000 7f06fd69c640 1 -- 172.21.15.88:0/3276292317 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f06e406c920 msgr2=0x7f06e406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:57.371 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:57.367+0000 7f06fd69c640 1 --2- 172.21.15.88:0/3276292317 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f06e406c920 0x7f06e406ede0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f06e8034000 tx=0x7f06e802f000 comp rx=0 tx=0).stop 2024-04-26T23:40:57.371 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:57.367+0000 7f06fd69c640 1 -- 172.21.15.88:0/3276292317 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f06f8070120 msgr2=0x7f06f80c3d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:57.371 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:57.367+0000 7f06fd69c640 1 --2- 172.21.15.88:0/3276292317 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f06f8070120 0x7f06f80c3d50 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f06ec001200 tx=0x7f06ec00c9b0 comp rx=0 tx=0).stop 2024-04-26T23:40:57.371 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:57.367+0000 7f06fd69c640 1 -- 172.21.15.88:0/3276292317 shutdown_connections 2024-04-26T23:40:57.371 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:57.367+0000 7f06fd69c640 1 --2- 172.21.15.88:0/3276292317 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f06e406c920 0x7f06e406ede0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:57.371 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:57.367+0000 7f06fd69c640 1 --2- 172.21.15.88:0/3276292317 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f06f80af140 0x7f06f81ee510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:57.372 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:57.367+0000 7f06fd69c640 1 --2- 172.21.15.88:0/3276292317 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f06f8070120 0x7f06f80c3d50 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:57.372 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:57.367+0000 7f06fd69c640 1 --2- 172.21.15.88:0/3276292317 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f06f806d590 0x7f06f80c1f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:57.372 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:57.367+0000 7f06fd69c640 1 -- 172.21.15.88:0/3276292317 >> 172.21.15.88:0/3276292317 conn(0x7f06f80c5ce0 msgr2=0x7f06f80c60c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:40:57.372 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:57.367+0000 7f06fd69c640 1 -- 172.21.15.88:0/3276292317 shutdown_connections 2024-04-26T23:40:57.372 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:57.367+0000 7f06fd69c640 1 -- 172.21.15.88:0/3276292317 wait complete. 2024-04-26T23:40:57.383 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get b_metadata pg_num 2024-04-26T23:40:57.482 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:57.478+0000 7fcb34415640 1 Processor -- start 2024-04-26T23:40:57.483 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:57.478+0000 7fcb34415640 1 -- start start 2024-04-26T23:40:57.485 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:57.479+0000 7fcb34415640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fcb2c14b480 0x7fcb2c0c68e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:57.485 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:57.479+0000 7fcb34415640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcb2c0c4d60 0x7fcb2c0ab470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:57.485 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:57.479+0000 7fcb34415640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcb2c074830 con 0x7fcb2c0ab9b0 2024-04-26T23:40:57.485 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:57.479+0000 7fcb34415640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7fcb2c0c5b20 con 0x7fcb2c14b480 2024-04-26T23:40:57.486 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:57.479+0000 7fcb34415640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fcb2c0c5e00 con 0x7fcb2c0c4d60 2024-04-26T23:40:57.486 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:57.479+0000 7fcb321b1640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fcb2c14b480 0x7fcb2c0c68e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:57.486 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:57.479+0000 7fcb321b1640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fcb2c14b480 0x7fcb2c0c68e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:42016/0 (socket says 172.21.15.88:42016) 2024-04-26T23:40:57.486 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:57.480+0000 7fcb321b1640 1 -- 172.21.15.88:0/1247385365 learned_addr learned my addr 172.21.15.88:0/1247385365 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:40:57.486 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:57.480+0000 7fcb319b0640 1 --2- 172.21.15.88:0/1247385365 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcb2c0c4d60 0x7fcb2c0ab470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:57.486 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:57.480+0000 7fcb321b1640 1 -- 172.21.15.88:0/1247385365 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcb2c0c4d60 msgr2=0x7fcb2c0ab470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:40:57.486 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:57.480+0000 7fcb321b1640 1 --2- 172.21.15.88:0/1247385365 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcb2c0c4d60 0x7fcb2c0ab470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:57.486 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:57.480+0000 7fcb321b1640 1 -- 172.21.15.88:0/1247385365 >> v1:172.21.15.175:6789/0 conn(0x7fcb2c0ab9b0 legacy=0x7fcb2c06f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:57.486 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:57.480+0000 7fcb321b1640 1 -- 172.21.15.88:0/1247385365 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb2c0c60e0 con 0x7fcb2c14b480 2024-04-26T23:40:57.486 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:57.480+0000 7fcb319b0640 1 --2- 172.21.15.88:0/1247385365 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcb2c0c4d60 0x7fcb2c0ab470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:40:57.486 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:57.480+0000 7fcb321b1640 1 --2- 172.21.15.88:0/1247385365 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcb2c14b480 0x7fcb2c0c68e0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fcb28009870 tx=0x7fcb2802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=728f31d963e87320 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:57.487 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:57.480+0000 7fcb311af640 1 -- 172.21.15.88:0/1247385365 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb28037070 con 0x7fcb2c14b480 2024-04-26T23:40:57.487 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:57.481+0000 7fcb311af640 1 -- 172.21.15.88:0/1247385365 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb28032440 con 0x7fcb2c14b480 2024-04-26T23:40:57.487 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:57.481+0000 7fcb311af640 1 -- 172.21.15.88:0/1247385365 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb28032810 con 0x7fcb2c14b480 2024-04-26T23:40:57.487 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:57.481+0000 7fcb34415640 1 -- 172.21.15.88:0/1247385365 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcb2c14b480 msgr2=0x7fcb2c0c68e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:57.487 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:57.481+0000 7fcb34415640 1 --2- 172.21.15.88:0/1247385365 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcb2c14b480 0x7fcb2c0c68e0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fcb28009870 tx=0x7fcb2802a270 comp rx=0 tx=0).stop 2024-04-26T23:40:57.487 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:57.481+0000 7fcb34415640 1 -- 172.21.15.88:0/1247385365 shutdown_connections 2024-04-26T23:40:57.487 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:57.481+0000 7fcb34415640 1 --2- 172.21.15.88:0/1247385365 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcb2c0c4d60 0x7fcb2c0ab470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:57.487 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:57.481+0000 7fcb34415640 1 --2- 172.21.15.88:0/1247385365 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcb2c14b480 0x7fcb2c0c68e0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:57.487 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:57.481+0000 7fcb34415640 1 -- 172.21.15.88:0/1247385365 >> 172.21.15.88:0/1247385365 conn(0x7fcb2c0c6e60 msgr2=0x7fcb2c0c7240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:40:57.487 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:57.481+0000 7fcb34415640 1 -- 172.21.15.88:0/1247385365 shutdown_connections 2024-04-26T23:40:57.487 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:57.481+0000 7fcb34415640 1 -- 172.21.15.88:0/1247385365 wait complete. 2024-04-26T23:40:57.490 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:57.482+0000 7fcb34415640 1 Processor -- start 2024-04-26T23:40:57.490 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:57.482+0000 7fcb34415640 1 -- start start 2024-04-26T23:40:57.491 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:57.483+0000 7fcb34415640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcb2c0c4d60 0x7fcb2c1ea6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:57.491 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:57.483+0000 7fcb34415640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcb2c14b480 0x7fcb2c1516a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:57.491 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:57.483+0000 7fcb34415640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcb2c147ec0 0x7fcb2c158710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:57.491 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:57.483+0000 7fcb34415640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fcb2c070000 con 0x7fcb2c0c4d60 2024-04-26T23:40:57.491 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:57.483+0000 7fcb34415640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fcb2c14b860 con 0x7fcb2c14b480 2024-04-26T23:40:57.491 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:57.483+0000 7fcb34415640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fcb2c070180 con 0x7fcb2c147ec0 2024-04-26T23:40:57.491 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:57.483+0000 7fcb321b1640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcb2c0c4d60 0x7fcb2c1ea6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:57.491 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:57.483+0000 7fcb321b1640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcb2c0c4d60 0x7fcb2c1ea6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:42022/0 (socket says 172.21.15.88:42022) 2024-04-26T23:40:57.491 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:57.483+0000 7fcb321b1640 1 -- 172.21.15.88:0/946351034 learned_addr learned my addr 172.21.15.88:0/946351034 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:40:57.491 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:57.483+0000 7fcb321b1640 1 -- 172.21.15.88:0/946351034 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcb2c147ec0 msgr2=0x7fcb2c158710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:57.492 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:57.483+0000 7fcb321b1640 1 --2- 172.21.15.88:0/946351034 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcb2c147ec0 0x7fcb2c158710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:57.492 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:57.483+0000 7fcb321b1640 1 -- 172.21.15.88:0/946351034 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcb2c14b480 msgr2=0x7fcb2c1516a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:57.492 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:57.483+0000 7fcb319b0640 1 --2- 172.21.15.88:0/946351034 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcb2c14b480 0x7fcb2c1516a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:57.492 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:57.483+0000 7fcb321b1640 1 --2- 172.21.15.88:0/946351034 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcb2c14b480 0x7fcb2c1516a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:57.492 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:57.483+0000 7fcb321b1640 1 -- 172.21.15.88:0/946351034 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb2c1560e0 con 0x7fcb2c0c4d60 2024-04-26T23:40:57.492 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:57.483+0000 7fcb321b1640 1 --2- 172.21.15.88:0/946351034 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcb2c0c4d60 0x7fcb2c1ea6c0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fcb28000c00 tx=0x7fcb280046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:57.492 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:57.484+0000 7fcb1effd640 1 -- 172.21.15.88:0/946351034 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb28041020 con 0x7fcb2c0c4d60 2024-04-26T23:40:57.492 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:57.484+0000 7fcb1effd640 1 -- 172.21.15.88:0/946351034 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb280306c0 con 0x7fcb2c0c4d60 2024-04-26T23:40:57.492 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:57.484+0000 7fcb34415640 1 -- 172.21.15.88:0/946351034 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb2c155e00 con 0x7fcb2c0c4d60 2024-04-26T23:40:57.492 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:57.484+0000 7fcb1effd640 1 -- 172.21.15.88:0/946351034 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb28037040 con 0x7fcb2c0c4d60 2024-04-26T23:40:57.492 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:57.484+0000 7fcb34415640 1 -- 172.21.15.88:0/946351034 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb2c0c9c00 con 0x7fcb2c0c4d60 2024-04-26T23:40:57.492 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:57.485+0000 7fcb34415640 1 -- 172.21.15.88:0/946351034 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb2c06f6e0 con 0x7fcb2c0c4d60 2024-04-26T23:40:57.493 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:57.485+0000 7fcb1effd640 1 -- 172.21.15.88:0/946351034 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fcb28044020 con 0x7fcb2c0c4d60 2024-04-26T23:40:57.493 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:57.485+0000 7fcb1effd640 1 --2- 172.21.15.88:0/946351034 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fcb1006c920 0x7fcb1006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:57.493 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:57.486+0000 7fcb1effd640 1 -- 172.21.15.88:0/946351034 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7fcb280ac5e0 con 0x7fcb2c0c4d60 2024-04-26T23:40:57.493 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:57.486+0000 7fcb319b0640 1 --2- 172.21.15.88:0/946351034 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fcb1006c920 0x7fcb1006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:57.493 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:57.486+0000 7fcb319b0640 1 --2- 172.21.15.88:0/946351034 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fcb1006c920 0x7fcb1006ede0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fcb2c0c44f0 tx=0x7fcb20008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:57.493 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:57.490+0000 7fcb1effd640 1 -- 172.21.15.88:0/946351034 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fcb2804b030 con 0x7fcb2c0c4d60 2024-04-26T23:40:57.670 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:57.665+0000 7fcb34415640 1 -- 172.21.15.88:0/946351034 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "b_metadata", "var": "pg_num"} v 0) -- 0x7fcb2c070860 con 0x7fcb2c0c4d60 2024-04-26T23:40:57.670 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:57.666+0000 7fcb1effd640 1 -- 172.21.15.88:0/946351034 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "b_metadata", "var": "pg_num"}]=0 v24) ==== 99+0+11 (secure 0 0 0) 0x7fcb2807a770 con 0x7fcb2c0c4d60 2024-04-26T23:40:57.670 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 32 2024-04-26T23:40:57.672 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:57.667+0000 7fcb34415640 1 -- 172.21.15.88:0/946351034 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fcb1006c920 msgr2=0x7fcb1006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:57.672 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:57.667+0000 7fcb34415640 1 --2- 172.21.15.88:0/946351034 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fcb1006c920 0x7fcb1006ede0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fcb2c0c44f0 tx=0x7fcb20008040 comp rx=0 tx=0).stop 2024-04-26T23:40:57.672 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:57.667+0000 7fcb34415640 1 -- 172.21.15.88:0/946351034 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcb2c0c4d60 msgr2=0x7fcb2c1ea6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:57.672 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:57.667+0000 7fcb34415640 1 --2- 172.21.15.88:0/946351034 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcb2c0c4d60 0x7fcb2c1ea6c0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fcb28000c00 tx=0x7fcb280046c0 comp rx=0 tx=0).stop 2024-04-26T23:40:57.673 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:57.668+0000 7fcb34415640 1 -- 172.21.15.88:0/946351034 shutdown_connections 2024-04-26T23:40:57.673 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:57.668+0000 7fcb34415640 1 --2- 172.21.15.88:0/946351034 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fcb1006c920 0x7fcb1006ede0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:57.673 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:57.668+0000 7fcb34415640 1 --2- 172.21.15.88:0/946351034 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcb2c147ec0 0x7fcb2c158710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:57.673 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:57.668+0000 7fcb34415640 1 --2- 172.21.15.88:0/946351034 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcb2c14b480 0x7fcb2c1516a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:57.673 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:57.668+0000 7fcb34415640 1 --2- 172.21.15.88:0/946351034 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcb2c0c4d60 0x7fcb2c1ea6c0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:57.673 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:57.668+0000 7fcb34415640 1 -- 172.21.15.88:0/946351034 >> 172.21.15.88:0/946351034 conn(0x7fcb2c0c6e60 msgr2=0x7fcb2c0c7240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:40:57.673 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:57.668+0000 7fcb34415640 1 -- 172.21.15.88:0/946351034 shutdown_connections 2024-04-26T23:40:57.673 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:57.668+0000 7fcb34415640 1 -- 172.21.15.88:0/946351034 wait complete. 2024-04-26T23:40:57.682 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get b_data pg_num 2024-04-26T23:40:57.783 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:57.779+0000 7fbb528c8640 1 Processor -- start 2024-04-26T23:40:57.783 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:57.779+0000 7fbb528c8640 1 -- start start 2024-04-26T23:40:57.786 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:57.779+0000 7fbb528c8640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fbb4c0c4250 0x7fbb4c0c3790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:57.786 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:57.779+0000 7fbb528c8640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbb4c0c3cd0 0x7fbb4c1572e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:57.786 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:57.779+0000 7fbb528c8640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbb4c0ad010 con 0x7fbb4c0acc30 2024-04-26T23:40:57.786 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:57.779+0000 7fbb528c8640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7fbb4c0c8ba0 con 0x7fbb4c0c4250 2024-04-26T23:40:57.786 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:57.779+0000 7fbb528c8640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fbb4c156e50 con 0x7fbb4c0c3cd0 2024-04-26T23:40:57.787 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:57.780+0000 7fbb4b7fe640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fbb4c0c4250 0x7fbb4c0c3790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:57.787 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:57.780+0000 7fbb4b7fe640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fbb4c0c4250 0x7fbb4c0c3790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:42034/0 (socket says 172.21.15.88:42034) 2024-04-26T23:40:57.787 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:57.780+0000 7fbb4b7fe640 1 -- 172.21.15.88:0/351815148 learned_addr learned my addr 172.21.15.88:0/351815148 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:40:57.787 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:57.780+0000 7fbb50e65640 1 --2- 172.21.15.88:0/351815148 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbb4c0c3cd0 0x7fbb4c1572e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:57.787 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:57.780+0000 7fbb4b7fe640 1 -- 172.21.15.88:0/351815148 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbb4c0c3cd0 msgr2=0x7fbb4c1572e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:40:57.787 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:57.780+0000 7fbb4b7fe640 1 --2- 172.21.15.88:0/351815148 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbb4c0c3cd0 0x7fbb4c1572e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:57.787 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:57.780+0000 7fbb4b7fe640 1 -- 172.21.15.88:0/351815148 >> v1:172.21.15.175:6789/0 conn(0x7fbb4c0acc30 legacy=0x7fbb4c15abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:57.787 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:57.780+0000 7fbb4b7fe640 1 -- 172.21.15.88:0/351815148 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb4c0c8300 con 0x7fbb4c0c4250 2024-04-26T23:40:57.787 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:57.781+0000 7fbb4b7fe640 1 --2- 172.21.15.88:0/351815148 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbb4c0c4250 0x7fbb4c0c3790 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fbb40009870 tx=0x7fbb4002a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c72e7ba05cd95c9 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:57.787 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:57.781+0000 7fbb4affd640 1 -- 172.21.15.88:0/351815148 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb40037070 con 0x7fbb4c0c4250 2024-04-26T23:40:57.787 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:57.781+0000 7fbb4affd640 1 -- 172.21.15.88:0/351815148 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb40032440 con 0x7fbb4c0c4250 2024-04-26T23:40:57.787 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:57.781+0000 7fbb4affd640 1 -- 172.21.15.88:0/351815148 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb40032810 con 0x7fbb4c0c4250 2024-04-26T23:40:57.787 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:57.781+0000 7fbb528c8640 1 -- 172.21.15.88:0/351815148 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbb4c0c4250 msgr2=0x7fbb4c0c3790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:57.787 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:57.781+0000 7fbb528c8640 1 --2- 172.21.15.88:0/351815148 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbb4c0c4250 0x7fbb4c0c3790 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fbb40009870 tx=0x7fbb4002a1c0 comp rx=0 tx=0).stop 2024-04-26T23:40:57.787 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:57.781+0000 7fbb528c8640 1 -- 172.21.15.88:0/351815148 shutdown_connections 2024-04-26T23:40:57.788 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:57.781+0000 7fbb528c8640 1 --2- 172.21.15.88:0/351815148 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbb4c0c3cd0 0x7fbb4c1572e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:57.788 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:57.781+0000 7fbb528c8640 1 --2- 172.21.15.88:0/351815148 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbb4c0c4250 0x7fbb4c0c3790 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:57.788 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:57.781+0000 7fbb528c8640 1 -- 172.21.15.88:0/351815148 >> 172.21.15.88:0/351815148 conn(0x7fbb4c0c6e60 msgr2=0x7fbb4c0c7270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:40:57.788 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:57.781+0000 7fbb528c8640 1 -- 172.21.15.88:0/351815148 shutdown_connections 2024-04-26T23:40:57.788 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:57.781+0000 7fbb528c8640 1 -- 172.21.15.88:0/351815148 wait complete. 2024-04-26T23:40:57.788 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:57.782+0000 7fbb528c8640 1 Processor -- start 2024-04-26T23:40:57.788 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:57.783+0000 7fbb528c8640 1 -- start start 2024-04-26T23:40:57.791 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:57.783+0000 7fbb528c8640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbb4c0acc30 0x7fbb4c070d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:57.792 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:57.783+0000 7fbb528c8640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbb4c0c3cd0 0x7fbb4c1ecef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:57.792 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:57.783+0000 7fbb528c8640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbb4c0c4250 0x7fbb4c06f930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:57.792 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:57.783+0000 7fbb528c8640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fbb4c0abec0 con 0x7fbb4c0acc30 2024-04-26T23:40:57.792 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:57.783+0000 7fbb528c8640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fbb4c0c88c0 con 0x7fbb4c0c4250 2024-04-26T23:40:57.792 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:57.783+0000 7fbb528c8640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fbb4c0ac040 con 0x7fbb4c0c3cd0 2024-04-26T23:40:57.792 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:57.783+0000 7fbb4bfff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbb4c0acc30 0x7fbb4c070d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:57.792 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:57.783+0000 7fbb4bfff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbb4c0acc30 0x7fbb4c070d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:42048/0 (socket says 172.21.15.88:42048) 2024-04-26T23:40:57.792 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:57.783+0000 7fbb4bfff640 1 -- 172.21.15.88:0/1506631751 learned_addr learned my addr 172.21.15.88:0/1506631751 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:40:57.792 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:57.783+0000 7fbb50e65640 1 --2- 172.21.15.88:0/1506631751 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbb4c0c4250 0x7fbb4c06f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:57.792 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:57.783+0000 7fbb4b7fe640 1 --2- 172.21.15.88:0/1506631751 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbb4c0c3cd0 0x7fbb4c1ecef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:57.792 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:57.783+0000 7fbb4bfff640 1 -- 172.21.15.88:0/1506631751 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbb4c0c3cd0 msgr2=0x7fbb4c1ecef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:57.792 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:57.783+0000 7fbb4bfff640 1 --2- 172.21.15.88:0/1506631751 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbb4c0c3cd0 0x7fbb4c1ecef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:57.792 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:57.783+0000 7fbb4bfff640 1 -- 172.21.15.88:0/1506631751 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbb4c0c4250 msgr2=0x7fbb4c06f930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:57.792 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:57.784+0000 7fbb4bfff640 1 --2- 172.21.15.88:0/1506631751 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbb4c0c4250 0x7fbb4c06f930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:57.792 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:57.784+0000 7fbb4bfff640 1 -- 172.21.15.88:0/1506631751 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb4c1ed7b0 con 0x7fbb4c0acc30 2024-04-26T23:40:57.793 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:57.784+0000 7fbb4b7fe640 1 --2- 172.21.15.88:0/1506631751 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbb4c0c3cd0 0x7fbb4c1ecef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:40:57.793 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:57.784+0000 7fbb4bfff640 1 --2- 172.21.15.88:0/1506631751 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbb4c0acc30 0x7fbb4c070d60 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fbb3c00c430 tx=0x7fbb3c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:57.793 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:57.784+0000 7fbb48ff9640 1 -- 172.21.15.88:0/1506631751 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb3c0052d0 con 0x7fbb4c0acc30 2024-04-26T23:40:57.793 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:57.784+0000 7fbb48ff9640 1 -- 172.21.15.88:0/1506631751 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb3c005490 con 0x7fbb4c0acc30 2024-04-26T23:40:57.793 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:57.784+0000 7fbb528c8640 1 -- 172.21.15.88:0/1506631751 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb4c1eda90 con 0x7fbb4c0acc30 2024-04-26T23:40:57.793 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:57.784+0000 7fbb48ff9640 1 -- 172.21.15.88:0/1506631751 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb3c007260 con 0x7fbb4c0acc30 2024-04-26T23:40:57.793 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:57.784+0000 7fbb528c8640 1 -- 172.21.15.88:0/1506631751 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb4c157ff0 con 0x7fbb4c0acc30 2024-04-26T23:40:57.793 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:57.785+0000 7fbb528c8640 1 -- 172.21.15.88:0/1506631751 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb4c0507a0 con 0x7fbb4c0acc30 2024-04-26T23:40:57.793 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:57.785+0000 7fbb48ff9640 1 -- 172.21.15.88:0/1506631751 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fbb3c007400 con 0x7fbb4c0acc30 2024-04-26T23:40:57.793 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:57.786+0000 7fbb48ff9640 1 --2- 172.21.15.88:0/1506631751 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fbb3806c920 0x7fbb3806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:57.793 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:57.786+0000 7fbb48ff9640 1 -- 172.21.15.88:0/1506631751 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7fbb3c08b330 con 0x7fbb4c0acc30 2024-04-26T23:40:57.793 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:57.786+0000 7fbb4b7fe640 1 --2- 172.21.15.88:0/1506631751 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fbb3806c920 0x7fbb3806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:57.793 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:57.786+0000 7fbb4b7fe640 1 --2- 172.21.15.88:0/1506631751 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fbb3806c920 0x7fbb3806ede0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fbb40034000 tx=0x7fbb4002e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:57.794 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:57.790+0000 7fbb48ff9640 1 -- 172.21.15.88:0/1506631751 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fbb3c058de0 con 0x7fbb4c0acc30 2024-04-26T23:40:57.970 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:57.966+0000 7fbb528c8640 1 -- 172.21.15.88:0/1506631751 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "b_data", "var": "pg_num"} v 0) -- 0x7fbb4c0c46f0 con 0x7fbb4c0acc30 2024-04-26T23:40:57.970 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:57.966+0000 7fbb48ff9640 1 -- 172.21.15.88:0/1506631751 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "b_data", "var": "pg_num"}]=0 v24) ==== 95+0+11 (secure 0 0 0) 0x7fbb3c05d0e0 con 0x7fbb4c0acc30 2024-04-26T23:40:57.970 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 64 2024-04-26T23:40:57.972 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:57.968+0000 7fbb528c8640 1 -- 172.21.15.88:0/1506631751 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fbb3806c920 msgr2=0x7fbb3806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:57.973 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:57.968+0000 7fbb528c8640 1 --2- 172.21.15.88:0/1506631751 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fbb3806c920 0x7fbb3806ede0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fbb40034000 tx=0x7fbb4002e000 comp rx=0 tx=0).stop 2024-04-26T23:40:57.973 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:57.968+0000 7fbb528c8640 1 -- 172.21.15.88:0/1506631751 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbb4c0acc30 msgr2=0x7fbb4c070d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:57.973 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:57.968+0000 7fbb528c8640 1 --2- 172.21.15.88:0/1506631751 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbb4c0acc30 0x7fbb4c070d60 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fbb3c00c430 tx=0x7fbb3c00c8f0 comp rx=0 tx=0).stop 2024-04-26T23:40:57.973 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:57.968+0000 7fbb528c8640 1 -- 172.21.15.88:0/1506631751 shutdown_connections 2024-04-26T23:40:57.973 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:57.968+0000 7fbb528c8640 1 --2- 172.21.15.88:0/1506631751 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fbb3806c920 0x7fbb3806ede0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:57.973 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:57.968+0000 7fbb528c8640 1 --2- 172.21.15.88:0/1506631751 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbb4c0c3cd0 0x7fbb4c1ecef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:57.973 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:57.968+0000 7fbb528c8640 1 --2- 172.21.15.88:0/1506631751 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbb4c0c4250 0x7fbb4c06f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:57.973 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:57.968+0000 7fbb528c8640 1 --2- 172.21.15.88:0/1506631751 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbb4c0acc30 0x7fbb4c070d60 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:57.973 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:57.968+0000 7fbb528c8640 1 -- 172.21.15.88:0/1506631751 >> 172.21.15.88:0/1506631751 conn(0x7fbb4c0c6e60 msgr2=0x7fbb4c154c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:40:57.973 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:57.968+0000 7fbb528c8640 1 -- 172.21.15.88:0/1506631751 shutdown_connections 2024-04-26T23:40:57.973 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:57.968+0000 7fbb528c8640 1 -- 172.21.15.88:0/1506631751 wait complete. 2024-04-26T23:40:57.983 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T23:40:58.079 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:58.075+0000 7f74c9d78640 1 Processor -- start 2024-04-26T23:40:58.079 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:58.075+0000 7f74c9d78640 1 -- start start 2024-04-26T23:40:58.082 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:58.076+0000 7f74c9d78640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f74c41521f0 0x7f74c406d320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:58.082 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:58.076+0000 7f74c9d78640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f74c40c6960 0x7f74c4158370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:58.082 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:58.076+0000 7f74c9d78640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f74c4070410 con 0x7f74c406d860 2024-04-26T23:40:58.082 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:58.076+0000 7f74c9d78640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f74c406f660 con 0x7f74c40c6960 2024-04-26T23:40:58.082 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:58.076+0000 7f74c9d78640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f74c406f8b0 con 0x7f74c41521f0 2024-04-26T23:40:58.082 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:58.076+0000 7f74c2ffd640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f74c40c6960 0x7f74c4158370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:58.082 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:58.076+0000 7f74c2ffd640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f74c40c6960 0x7f74c4158370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:42052/0 (socket says 172.21.15.88:42052) 2024-04-26T23:40:58.082 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:58.076+0000 7f74c2ffd640 1 -- 172.21.15.88:0/3028926040 learned_addr learned my addr 172.21.15.88:0/3028926040 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:40:58.082 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:58.076+0000 7f74c37fe640 1 --2- 172.21.15.88:0/3028926040 >> v2:172.21.15.175:3300/0 conn(0x7f74c41521f0 0x7f74c406d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:58.082 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:58.076+0000 7f74c2ffd640 1 -- 172.21.15.88:0/3028926040 >> v2:172.21.15.175:3300/0 conn(0x7f74c41521f0 msgr2=0x7f74c406d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:40:58.083 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:58.076+0000 7f74c2ffd640 1 --2- 172.21.15.88:0/3028926040 >> v2:172.21.15.175:3300/0 conn(0x7f74c41521f0 0x7f74c406d320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:58.083 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:58.076+0000 7f74c2ffd640 1 -- 172.21.15.88:0/3028926040 >> v1:172.21.15.175:6789/0 conn(0x7f74c406d860 legacy=0x7f74c41588b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:58.083 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:58.076+0000 7f74c2ffd640 1 -- 172.21.15.88:0/3028926040 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74c406fb90 con 0x7f74c40c6960 2024-04-26T23:40:58.083 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:58.076+0000 7f74c37fe640 1 --2- 172.21.15.88:0/3028926040 >> v2:172.21.15.175:3300/0 conn(0x7f74c41521f0 0x7f74c406d320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:40:58.083 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:58.077+0000 7f74c2ffd640 1 --2- 172.21.15.88:0/3028926040 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f74c40c6960 0x7f74c4158370 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f74c406f7e0 tx=0x7f74b802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26ba7b9e9f2a8257 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:58.083 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:58.077+0000 7f74c27fc640 1 -- 172.21.15.88:0/3028926040 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74b8037070 con 0x7f74c40c6960 2024-04-26T23:40:58.083 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:58.077+0000 7f74c27fc640 1 -- 172.21.15.88:0/3028926040 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74b8032440 con 0x7f74c40c6960 2024-04-26T23:40:58.083 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:58.077+0000 7f74c27fc640 1 -- 172.21.15.88:0/3028926040 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74b8032810 con 0x7f74c40c6960 2024-04-26T23:40:58.083 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:58.078+0000 7f74c9d78640 1 -- 172.21.15.88:0/3028926040 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f74c40c6960 msgr2=0x7f74c4158370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:58.083 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:58.078+0000 7f74c9d78640 1 --2- 172.21.15.88:0/3028926040 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f74c40c6960 0x7f74c4158370 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f74c406f7e0 tx=0x7f74b802a1e0 comp rx=0 tx=0).stop 2024-04-26T23:40:58.083 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:58.078+0000 7f74c9d78640 1 -- 172.21.15.88:0/3028926040 shutdown_connections 2024-04-26T23:40:58.083 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:58.078+0000 7f74c9d78640 1 --2- 172.21.15.88:0/3028926040 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f74c40c6960 0x7f74c4158370 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:58.083 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:58.078+0000 7f74c9d78640 1 --2- 172.21.15.88:0/3028926040 >> v2:172.21.15.175:3300/0 conn(0x7f74c41521f0 0x7f74c406d320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:58.084 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:58.078+0000 7f74c9d78640 1 -- 172.21.15.88:0/3028926040 >> 172.21.15.88:0/3028926040 conn(0x7f74c40c5ce0 msgr2=0x7f74c40c60c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:40:58.084 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:58.078+0000 7f74c9d78640 1 -- 172.21.15.88:0/3028926040 shutdown_connections 2024-04-26T23:40:58.084 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:58.078+0000 7f74c9d78640 1 -- 172.21.15.88:0/3028926040 wait complete. 2024-04-26T23:40:58.087 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:58.079+0000 7f74c9d78640 1 Processor -- start 2024-04-26T23:40:58.087 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:58.079+0000 7f74c9d78640 1 -- start start 2024-04-26T23:40:58.087 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:58.079+0000 7f74c9d78640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f74c406d860 0x7f74c414fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:58.087 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:58.079+0000 7f74c9d78640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f74c40c6960 0x7f74c414bce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:58.087 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:58.079+0000 7f74c9d78640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f74c41521f0 0x7f74c4152890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:58.087 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:58.079+0000 7f74c9d78640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f74c40701b0 con 0x7f74c406d860 2024-04-26T23:40:58.087 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:58.079+0000 7f74c9d78640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f74c4070030 con 0x7f74c40c6960 2024-04-26T23:40:58.087 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:58.079+0000 7f74c9d78640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f74c4070c20 con 0x7f74c41521f0 2024-04-26T23:40:58.087 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:58.080+0000 7f74c37fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f74c406d860 0x7f74c414fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:58.087 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:58.080+0000 7f74c37fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f74c406d860 0x7f74c414fdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:42064/0 (socket says 172.21.15.88:42064) 2024-04-26T23:40:58.087 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:58.080+0000 7f74c37fe640 1 -- 172.21.15.88:0/101935815 learned_addr learned my addr 172.21.15.88:0/101935815 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:40:58.087 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:58.080+0000 7f74c2ffd640 1 --2- 172.21.15.88:0/101935815 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f74c40c6960 0x7f74c414bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:58.087 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:58.080+0000 7f74c3fff640 1 --2- 172.21.15.88:0/101935815 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f74c41521f0 0x7f74c4152890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:58.088 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:58.080+0000 7f74c37fe640 1 -- 172.21.15.88:0/101935815 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f74c41521f0 msgr2=0x7f74c4152890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:58.088 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:58.080+0000 7f74c37fe640 1 --2- 172.21.15.88:0/101935815 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f74c41521f0 0x7f74c4152890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:58.088 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:58.080+0000 7f74c37fe640 1 -- 172.21.15.88:0/101935815 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f74c40c6960 msgr2=0x7f74c414bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:58.088 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:58.080+0000 7f74c37fe640 1 --2- 172.21.15.88:0/101935815 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f74c40c6960 0x7f74c414bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:58.088 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:58.080+0000 7f74c37fe640 1 -- 172.21.15.88:0/101935815 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74c4074410 con 0x7f74c406d860 2024-04-26T23:40:58.088 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:58.080+0000 7f74c2ffd640 1 --2- 172.21.15.88:0/101935815 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f74c40c6960 0x7f74c414bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:40:58.088 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:58.080+0000 7f74c37fe640 1 --2- 172.21.15.88:0/101935815 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f74c406d860 0x7f74c414fdb0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f74b400d7d0 tx=0x7f74b400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:58.088 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:58.080+0000 7f74abfff640 1 -- 172.21.15.88:0/101935815 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74b4004030 con 0x7f74c406d860 2024-04-26T23:40:58.088 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:58.080+0000 7f74abfff640 1 -- 172.21.15.88:0/101935815 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74b40041d0 con 0x7f74c406d860 2024-04-26T23:40:58.088 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:58.080+0000 7f74c9d78640 1 -- 172.21.15.88:0/101935815 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74c40746f0 con 0x7f74c406d860 2024-04-26T23:40:58.088 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:58.080+0000 7f74abfff640 1 -- 172.21.15.88:0/101935815 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74b400b6c0 con 0x7f74c406d860 2024-04-26T23:40:58.088 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:58.080+0000 7f74c9d78640 1 -- 172.21.15.88:0/101935815 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74c414c220 con 0x7f74c406d860 2024-04-26T23:40:58.088 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:58.081+0000 7f74c9d78640 1 -- 172.21.15.88:0/101935815 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f74c41547e0 con 0x7f74c406d860 2024-04-26T23:40:58.088 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:58.081+0000 7f74abfff640 1 -- 172.21.15.88:0/101935815 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f74b400b860 con 0x7f74c406d860 2024-04-26T23:40:58.088 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:58.082+0000 7f74abfff640 1 --2- 172.21.15.88:0/101935815 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f74b006c8f0 0x7f74b006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:58.089 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:58.082+0000 7f74abfff640 1 -- 172.21.15.88:0/101935815 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7f74b408c100 con 0x7f74c406d860 2024-04-26T23:40:58.089 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:58.082+0000 7f74c2ffd640 1 --2- 172.21.15.88:0/101935815 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f74b006c8f0 0x7f74b006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:58.089 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:58.082+0000 7f74c2ffd640 1 --2- 172.21.15.88:0/101935815 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f74b006c8f0 0x7f74b006edb0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f74b8034000 tx=0x7f74b802e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:58.090 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:58.086+0000 7f74abfff640 1 -- 172.21.15.88:0/101935815 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f74c41547e0 con 0x7f74c406d860 2024-04-26T23:40:58.299 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:58.295+0000 7f74c9d78640 1 -- 172.21.15.88:0/101935815 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f74c414f9d0 con 0x7f74c406d860 2024-04-26T23:40:58.300 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:58.296+0000 7f74abfff640 1 -- 172.21.15.88:0/101935815 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+6488 (secure 0 0 0) 0x7f74b405a290 con 0x7f74c406d860 2024-04-26T23:40:58.300 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-26T23:40:58.300 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":12,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6834/3199540397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":3199540397},{"type":"v1","addr":"172.21.15.175:6834","nonce":3199540397}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4270,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6837/2790134952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6835","nonce":2790134952},{"type":"v1","addr":"172.21.15.88:6837","nonce":2790134952}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T23:40:31.909505+0000","modified":"2024-04-26T23:40:34.974455+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4279},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4279":{"gid":4279,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.175:6835/3932058274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6833","nonce":3932058274},{"type":"v1","addr":"172.21.15.175:6835","nonce":3932058274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4279,"qdb_cluster":[4279]},"id":1},{"mdsmap":{"epoch":12,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T23:40:41.008364+0000","modified":"2024-04-26T23:40:44.027288+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4272":{"gid":4272,"name":"c","rank":0,"incarnation":9,"state":"up:active","state_seq":6,"addr":"172.21.15.88:6836/4159390276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6834","nonce":4159390276},{"type":"v1","addr":"172.21.15.88:6836","nonce":4159390276}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4272,"qdb_cluster":[4272]},"id":2}]} 2024-04-26T23:40:58.301 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 12 2024-04-26T23:40:58.303 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:58.298+0000 7f74c9d78640 1 -- 172.21.15.88:0/101935815 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f74b006c8f0 msgr2=0x7f74b006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:58.303 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:58.298+0000 7f74c9d78640 1 --2- 172.21.15.88:0/101935815 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f74b006c8f0 0x7f74b006edb0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f74b8034000 tx=0x7f74b802e000 comp rx=0 tx=0).stop 2024-04-26T23:40:58.303 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:58.298+0000 7f74c9d78640 1 -- 172.21.15.88:0/101935815 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f74c406d860 msgr2=0x7f74c414fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:58.303 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:58.298+0000 7f74c9d78640 1 --2- 172.21.15.88:0/101935815 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f74c406d860 0x7f74c414fdb0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f74b400d7d0 tx=0x7f74b400dc90 comp rx=0 tx=0).stop 2024-04-26T23:40:58.303 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:58.298+0000 7f74c9d78640 1 -- 172.21.15.88:0/101935815 shutdown_connections 2024-04-26T23:40:58.303 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:58.298+0000 7f74c9d78640 1 --2- 172.21.15.88:0/101935815 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f74b006c8f0 0x7f74b006edb0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:58.303 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:58.298+0000 7f74c9d78640 1 --2- 172.21.15.88:0/101935815 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f74c41521f0 0x7f74c4152890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:58.303 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:58.298+0000 7f74c9d78640 1 --2- 172.21.15.88:0/101935815 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f74c40c6960 0x7f74c414bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:58.303 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:58.298+0000 7f74c9d78640 1 --2- 172.21.15.88:0/101935815 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f74c406d860 0x7f74c414fdb0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:58.303 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:58.298+0000 7f74c9d78640 1 -- 172.21.15.88:0/101935815 >> 172.21.15.88:0/101935815 conn(0x7f74c40c5ce0 msgr2=0x7f74c414cd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:40:58.303 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:58.298+0000 7f74c9d78640 1 -- 172.21.15.88:0/101935815 shutdown_connections 2024-04-26T23:40:58.303 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:58.298+0000 7f74c9d78640 1 -- 172.21.15.88:0/101935815 wait complete. 2024-04-26T23:40:58.313 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T23:40:58.410 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:58.405+0000 7fb8b021d640 1 Processor -- start 2024-04-26T23:40:58.410 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:58.406+0000 7fb8b021d640 1 -- start start 2024-04-26T23:40:58.412 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:58.406+0000 7fb8b021d640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fb8a813feb0 0x7fb8a81576d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:58.413 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:58.406+0000 7fb8b021d640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb8a80c5050 0x7fb8a815a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:58.413 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:58.406+0000 7fb8b021d640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb8a8156c10 con 0x7fb8a80c2b80 2024-04-26T23:40:58.413 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:58.406+0000 7fb8b021d640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7fb8a8157240 con 0x7fb8a813feb0 2024-04-26T23:40:58.413 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:58.406+0000 7fb8b021d640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fb8a80c5570 con 0x7fb8a80c5050 2024-04-26T23:40:58.413 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:58.407+0000 7fb8adfb9640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fb8a813feb0 0x7fb8a81576d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:58.413 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:58.407+0000 7fb8ad7b8640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb8a80c5050 0x7fb8a815a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:58.413 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:58.407+0000 7fb8adfb9640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fb8a813feb0 0x7fb8a81576d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.88:36976/0 (socket says 172.21.15.88:36976) 2024-04-26T23:40:58.413 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:58.407+0000 7fb8ad7b8640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb8a80c5050 0x7fb8a815a1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.88:37582/0 (socket says 172.21.15.88:37582) 2024-04-26T23:40:58.413 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:58.407+0000 7fb8adfb9640 1 -- 172.21.15.88:0/3466000873 learned_addr learned my addr 172.21.15.88:0/3466000873 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:40:58.413 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:58.407+0000 7fb8adfb9640 1 -- 172.21.15.88:0/3466000873 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb8a80c5050 msgr2=0x7fb8a815a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:40:58.414 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:58.407+0000 7fb8adfb9640 1 --2- 172.21.15.88:0/3466000873 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb8a80c5050 0x7fb8a815a1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:58.414 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:58.407+0000 7fb8adfb9640 1 -- 172.21.15.88:0/3466000873 >> v1:172.21.15.175:6789/0 conn(0x7fb8a80c2b80 legacy=0x7fb8a806d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:58.414 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:58.407+0000 7fb8adfb9640 1 -- 172.21.15.88:0/3466000873 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8a80c5850 con 0x7fb8a813feb0 2024-04-26T23:40:58.414 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:58.407+0000 7fb8ad7b8640 1 --2- 172.21.15.88:0/3466000873 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb8a80c5050 0x7fb8a815a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:40:58.414 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:58.408+0000 7fb8adfb9640 1 --2- 172.21.15.88:0/3466000873 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb8a813feb0 0x7fb8a81576d0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fb8a0009e50 tx=0x7fb8a002a680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e5d506f7722867ee server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:58.414 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:58.408+0000 7fb8acfb7640 1 -- 172.21.15.88:0/3466000873 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8a0036070 con 0x7fb8a813feb0 2024-04-26T23:40:58.414 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:58.408+0000 7fb8acfb7640 1 -- 172.21.15.88:0/3466000873 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8a0031600 con 0x7fb8a813feb0 2024-04-26T23:40:58.414 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:58.408+0000 7fb8acfb7640 1 -- 172.21.15.88:0/3466000873 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8a00319d0 con 0x7fb8a813feb0 2024-04-26T23:40:58.414 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:58.408+0000 7fb8b021d640 1 -- 172.21.15.88:0/3466000873 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb8a813feb0 msgr2=0x7fb8a81576d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:58.414 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:58.408+0000 7fb8b021d640 1 --2- 172.21.15.88:0/3466000873 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb8a813feb0 0x7fb8a81576d0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fb8a0009e50 tx=0x7fb8a002a680 comp rx=0 tx=0).stop 2024-04-26T23:40:58.414 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:58.409+0000 7fb8b021d640 1 -- 172.21.15.88:0/3466000873 shutdown_connections 2024-04-26T23:40:58.415 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:58.409+0000 7fb8b021d640 1 --2- 172.21.15.88:0/3466000873 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb8a80c5050 0x7fb8a815a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:58.415 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:58.409+0000 7fb8b021d640 1 --2- 172.21.15.88:0/3466000873 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb8a813feb0 0x7fb8a81576d0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:58.415 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:58.409+0000 7fb8b021d640 1 -- 172.21.15.88:0/3466000873 >> 172.21.15.88:0/3466000873 conn(0x7fb8a80c5ce0 msgr2=0x7fb8a80c60c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:40:58.415 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:58.409+0000 7fb8b021d640 1 -- 172.21.15.88:0/3466000873 shutdown_connections 2024-04-26T23:40:58.415 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:58.409+0000 7fb8b021d640 1 -- 172.21.15.88:0/3466000873 wait complete. 2024-04-26T23:40:58.418 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:58.410+0000 7fb8b021d640 1 Processor -- start 2024-04-26T23:40:58.418 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:58.410+0000 7fb8b021d640 1 -- start start 2024-04-26T23:40:58.418 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:58.410+0000 7fb8b021d640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb8a80c2b80 0x7fb8a815a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:58.418 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:58.410+0000 7fb8b021d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb8a80c5050 0x7fb8a80c83d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:58.418 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:58.410+0000 7fb8b021d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb8a813feb0 0x7fb8a8139700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:58.418 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:58.410+0000 7fb8b021d640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fb8a806dbb0 con 0x7fb8a813feb0 2024-04-26T23:40:58.418 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:58.410+0000 7fb8b021d640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fb8a806da30 con 0x7fb8a80c5050 2024-04-26T23:40:58.418 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:58.410+0000 7fb8b021d640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fb8a8140290 con 0x7fb8a80c2b80 2024-04-26T23:40:58.418 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:58.410+0000 7fb8ae7ba640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb8a813feb0 0x7fb8a8139700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:58.418 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:58.411+0000 7fb8ae7ba640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb8a813feb0 0x7fb8a8139700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:42078/0 (socket says 172.21.15.88:42078) 2024-04-26T23:40:58.419 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:58.411+0000 7fb8ae7ba640 1 -- 172.21.15.88:0/2323994321 learned_addr learned my addr 172.21.15.88:0/2323994321 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:40:58.419 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:58.411+0000 7fb8ad7b8640 1 --2- 172.21.15.88:0/2323994321 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb8a80c5050 0x7fb8a80c83d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:58.419 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:58.411+0000 7fb8adfb9640 1 --2- 172.21.15.88:0/2323994321 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb8a80c2b80 0x7fb8a815a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:58.419 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:58.411+0000 7fb8ae7ba640 1 -- 172.21.15.88:0/2323994321 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb8a80c2b80 msgr2=0x7fb8a815a960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:58.419 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:58.411+0000 7fb8ae7ba640 1 --2- 172.21.15.88:0/2323994321 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb8a80c2b80 0x7fb8a815a960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:58.419 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:58.411+0000 7fb8ae7ba640 1 -- 172.21.15.88:0/2323994321 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb8a80c5050 msgr2=0x7fb8a80c83d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:58.419 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:58.411+0000 7fb8ae7ba640 1 --2- 172.21.15.88:0/2323994321 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb8a80c5050 0x7fb8a80c83d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:58.419 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:58.411+0000 7fb8ae7ba640 1 -- 172.21.15.88:0/2323994321 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8a8159800 con 0x7fb8a813feb0 2024-04-26T23:40:58.419 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:58.411+0000 7fb8ae7ba640 1 --2- 172.21.15.88:0/2323994321 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb8a813feb0 0x7fb8a8139700 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fb8a400c390 tx=0x7fb8a400c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:58.419 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:58.411+0000 7fb89e7fc640 1 -- 172.21.15.88:0/2323994321 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8a4017070 con 0x7fb8a813feb0 2024-04-26T23:40:58.419 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:58.411+0000 7fb89e7fc640 1 -- 172.21.15.88:0/2323994321 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8a40052d0 con 0x7fb8a813feb0 2024-04-26T23:40:58.419 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:58.411+0000 7fb8b021d640 1 -- 172.21.15.88:0/2323994321 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8a813a660 con 0x7fb8a813feb0 2024-04-26T23:40:58.420 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:58.411+0000 7fb89e7fc640 1 -- 172.21.15.88:0/2323994321 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8a4003810 con 0x7fb8a813feb0 2024-04-26T23:40:58.420 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:58.411+0000 7fb8b021d640 1 -- 172.21.15.88:0/2323994321 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8a8074920 con 0x7fb8a813feb0 2024-04-26T23:40:58.420 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:58.412+0000 7fb8b021d640 1 -- 172.21.15.88:0/2323994321 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb8a80507a0 con 0x7fb8a813feb0 2024-04-26T23:40:58.420 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:58.412+0000 7fb89e7fc640 1 -- 172.21.15.88:0/2323994321 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb8a401a070 con 0x7fb8a813feb0 2024-04-26T23:40:58.420 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:58.413+0000 7fb89e7fc640 1 --2- 172.21.15.88:0/2323994321 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fb88c06c8f0 0x7fb88c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:58.420 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:58.413+0000 7fb8adfb9640 1 --2- 172.21.15.88:0/2323994321 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fb88c06c8f0 0x7fb88c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:58.420 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:58.413+0000 7fb89e7fc640 1 -- 172.21.15.88:0/2323994321 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7fb8a408b010 con 0x7fb8a813feb0 2024-04-26T23:40:58.420 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:58.413+0000 7fb8adfb9640 1 --2- 172.21.15.88:0/2323994321 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fb88c06c8f0 0x7fb88c06edb0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fb8a0033000 tx=0x7fb8a0009000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:58.421 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:58.417+0000 7fb89e7fc640 1 -- 172.21.15.88:0/2323994321 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fb8a4058b50 con 0x7fb8a813feb0 2024-04-26T23:40:58.595 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:58.591+0000 7fb8b021d640 1 -- 172.21.15.88:0/2323994321 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb8a80c6800 con 0x7fb8a813feb0 2024-04-26T23:40:58.596 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:58.592+0000 7fb89e7fc640 1 -- 172.21.15.88:0/2323994321 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+20343 (secure 0 0 0) 0x7fb8a405ce50 con 0x7fb8a813feb0 2024-04-26T23:40:58.597 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-26T23:40:58.597 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":24,"fsid":"555255e9-7ef9-4454-8dc9-35e96b70035c","created":"2024-04-26T23:40:07.836009+0000","modified":"2024-04-26T23:40:42.673801+0000","last_up_change":"2024-04-26T23:40:18.831369+0000","last_in_change":"2024-04-26T23:40:09.944777+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T23:40:19.936127+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"a_metadata","create_time":"2024-04-26T23:40:29.837465+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"a_data","create_time":"2024-04-26T23:40:30.868651+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"b_metadata","create_time":"2024-04-26T23:40:38.753441+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"b_data","create_time":"2024-04-26T23:40:39.974557+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"92aecea3-ed62-4a29-87c0-76758a0816a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":2803186054},{"type":"v1","addr":"172.21.15.88:6801","nonce":2803186054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":2803186054},{"type":"v1","addr":"172.21.15.88:6803","nonce":2803186054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":2803186054},{"type":"v1","addr":"172.21.15.88:6807","nonce":2803186054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":2803186054},{"type":"v1","addr":"172.21.15.88:6805","nonce":2803186054}]},"public_addr":"172.21.15.88:6801/2803186054","cluster_addr":"172.21.15.88:6803/2803186054","heartbeat_back_addr":"172.21.15.88:6807/2803186054","heartbeat_front_addr":"172.21.15.88:6805/2803186054","state":["exists","up"]},{"osd":1,"uuid":"7a6f0fa9-23d0-4747-880f-798d45ec5eeb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":1897380484},{"type":"v1","addr":"172.21.15.88:6817","nonce":1897380484}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":1897380484},{"type":"v1","addr":"172.21.15.88:6819","nonce":1897380484}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1897380484},{"type":"v1","addr":"172.21.15.88:6823","nonce":1897380484}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":1897380484},{"type":"v1","addr":"172.21.15.88:6821","nonce":1897380484}]},"public_addr":"172.21.15.88:6817/1897380484","cluster_addr":"172.21.15.88:6819/1897380484","heartbeat_back_addr":"172.21.15.88:6823/1897380484","heartbeat_front_addr":"172.21.15.88:6821/1897380484","state":["exists","up"]},{"osd":2,"uuid":"6be88ea0-e133-4200-a4b5-f92d664b248a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":648396269},{"type":"v1","addr":"172.21.15.88:6809","nonce":648396269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":648396269},{"type":"v1","addr":"172.21.15.88:6811","nonce":648396269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":648396269},{"type":"v1","addr":"172.21.15.88:6815","nonce":648396269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":648396269},{"type":"v1","addr":"172.21.15.88:6813","nonce":648396269}]},"public_addr":"172.21.15.88:6809/648396269","cluster_addr":"172.21.15.88:6811/648396269","heartbeat_back_addr":"172.21.15.88:6815/648396269","heartbeat_front_addr":"172.21.15.88:6813/648396269","state":["exists","up"]},{"osd":3,"uuid":"dcb0746b-7b3d-4ecf-8089-2493a5d1857c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":2328028922},{"type":"v1","addr":"172.21.15.88:6825","nonce":2328028922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":2328028922},{"type":"v1","addr":"172.21.15.88:6827","nonce":2328028922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":2328028922},{"type":"v1","addr":"172.21.15.88:6831","nonce":2328028922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":2328028922},{"type":"v1","addr":"172.21.15.88:6829","nonce":2328028922}]},"public_addr":"172.21.15.88:6825/2328028922","cluster_addr":"172.21.15.88:6827/2328028922","heartbeat_back_addr":"172.21.15.88:6831/2328028922","heartbeat_front_addr":"172.21.15.88:6829/2328028922","state":["exists","up"]},{"osd":4,"uuid":"c483de66-c44f-450e-a4ce-b132d50882c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":3929617402},{"type":"v1","addr":"172.21.15.175:6809","nonce":3929617402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":3929617402},{"type":"v1","addr":"172.21.15.175:6811","nonce":3929617402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":3929617402},{"type":"v1","addr":"172.21.15.175:6815","nonce":3929617402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":3929617402},{"type":"v1","addr":"172.21.15.175:6813","nonce":3929617402}]},"public_addr":"172.21.15.175:6809/3929617402","cluster_addr":"172.21.15.175:6811/3929617402","heartbeat_back_addr":"172.21.15.175:6815/3929617402","heartbeat_front_addr":"172.21.15.175:6813/3929617402","state":["exists","up"]},{"osd":5,"uuid":"ac3b1669-d228-40dd-9f9a-cb46aa73dd6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":2476644457},{"type":"v1","addr":"172.21.15.175:6801","nonce":2476644457}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":2476644457},{"type":"v1","addr":"172.21.15.175:6803","nonce":2476644457}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":2476644457},{"type":"v1","addr":"172.21.15.175:6807","nonce":2476644457}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":2476644457},{"type":"v1","addr":"172.21.15.175:6805","nonce":2476644457}]},"public_addr":"172.21.15.175:6801/2476644457","cluster_addr":"172.21.15.175:6803/2476644457","heartbeat_back_addr":"172.21.15.175:6807/2476644457","heartbeat_front_addr":"172.21.15.175:6805/2476644457","state":["exists","up"]},{"osd":6,"uuid":"7bef4896-857e-4c11-b3b2-c2e9a8548338","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":3824112919},{"type":"v1","addr":"172.21.15.175:6819","nonce":3824112919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6821","nonce":3824112919},{"type":"v1","addr":"172.21.15.175:6824","nonce":3824112919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":3824112919},{"type":"v1","addr":"172.21.15.175:6831","nonce":3824112919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":3824112919},{"type":"v1","addr":"172.21.15.175:6829","nonce":3824112919}]},"public_addr":"172.21.15.175:6819/3824112919","cluster_addr":"172.21.15.175:6824/3824112919","heartbeat_back_addr":"172.21.15.175:6831/3824112919","heartbeat_front_addr":"172.21.15.175:6829/3824112919","state":["exists","up"]},{"osd":7,"uuid":"e18d9e09-8673-470d-b9dc-280a409b63f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6817","nonce":3319361162},{"type":"v1","addr":"172.21.15.175:6818","nonce":3319361162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":3319361162},{"type":"v1","addr":"172.21.15.175:6822","nonce":3319361162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6827","nonce":3319361162},{"type":"v1","addr":"172.21.15.175:6828","nonce":3319361162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6823","nonce":3319361162},{"type":"v1","addr":"172.21.15.175:6825","nonce":3319361162}]},"public_addr":"172.21.15.175:6818/3319361162","cluster_addr":"172.21.15.175:6822/3319361162","heartbeat_back_addr":"172.21.15.175:6828/3319361162","heartbeat_front_addr":"172.21.15.175:6825/3319361162","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:40:15.126268+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:40:15.050614+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:40:14.995164+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:40:15.078112+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:40:15.159637+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:40:15.091226+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:40:15.140316+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:40:15.089431+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:40:58.599 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:58.594+0000 7fb8b021d640 1 -- 172.21.15.88:0/2323994321 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fb88c06c8f0 msgr2=0x7fb88c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:58.599 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:58.594+0000 7fb8b021d640 1 --2- 172.21.15.88:0/2323994321 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fb88c06c8f0 0x7fb88c06edb0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fb8a0033000 tx=0x7fb8a0009000 comp rx=0 tx=0).stop 2024-04-26T23:40:58.599 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:58.594+0000 7fb8b021d640 1 -- 172.21.15.88:0/2323994321 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb8a813feb0 msgr2=0x7fb8a8139700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:58.599 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:58.594+0000 7fb8b021d640 1 --2- 172.21.15.88:0/2323994321 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb8a813feb0 0x7fb8a8139700 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fb8a400c390 tx=0x7fb8a400c850 comp rx=0 tx=0).stop 2024-04-26T23:40:58.599 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:58.594+0000 7fb8b021d640 1 -- 172.21.15.88:0/2323994321 shutdown_connections 2024-04-26T23:40:58.599 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:58.594+0000 7fb8b021d640 1 --2- 172.21.15.88:0/2323994321 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fb88c06c8f0 0x7fb88c06edb0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:58.599 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:58.594+0000 7fb8b021d640 1 --2- 172.21.15.88:0/2323994321 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb8a813feb0 0x7fb8a8139700 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:58.599 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:58.594+0000 7fb8b021d640 1 --2- 172.21.15.88:0/2323994321 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb8a80c5050 0x7fb8a80c83d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:58.599 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:58.594+0000 7fb8b021d640 1 --2- 172.21.15.88:0/2323994321 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb8a80c2b80 0x7fb8a815a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:58.599 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:58.594+0000 7fb8b021d640 1 -- 172.21.15.88:0/2323994321 >> 172.21.15.88:0/2323994321 conn(0x7fb8a80c5ce0 msgr2=0x7fb8a81550a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:40:58.599 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:58.595+0000 7fb8b021d640 1 -- 172.21.15.88:0/2323994321 shutdown_connections 2024-04-26T23:40:58.599 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:58.595+0000 7fb8b021d640 1 -- 172.21.15.88:0/2323994321 wait complete. 2024-04-26T23:40:58.610 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T23:40:58.706 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:58.702+0000 7f32d4daf640 1 Processor -- start 2024-04-26T23:40:58.706 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:58.702+0000 7f32d4daf640 1 -- start start 2024-04-26T23:40:58.708 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:58.703+0000 7f32d4daf640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f32d00c4250 0x7f32d00c3790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:58.708 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:58.703+0000 7f32d4daf640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f32d00c3cd0 0x7f32d01572e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:58.708 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:58.703+0000 7f32d4daf640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f32d00ad010 con 0x7f32d00acc30 2024-04-26T23:40:58.708 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:58.703+0000 7f32d4daf640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f32d00c8ba0 con 0x7f32d00c3cd0 2024-04-26T23:40:58.708 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:58.703+0000 7f32d4daf640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f32d0156e50 con 0x7f32d00c4250 2024-04-26T23:40:58.708 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:58.703+0000 7f32ced9d640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f32d00c3cd0 0x7f32d01572e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:58.708 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:58.703+0000 7f32ce59c640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f32d00acc30 0x7f32d015abf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:51934/0 (socket says 172.21.15.88:51934) 2024-04-26T23:40:58.708 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:58.703+0000 7f32ce59c640 1 -- 172.21.15.88:0/1222734705 learned_addr learned my addr 172.21.15.88:0/1222734705 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-26T23:40:58.708 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:58.703+0000 7f32ced9d640 1 -- 172.21.15.88:0/1222734705 >> v2:172.21.15.175:3300/0 conn(0x7f32d00c4250 msgr2=0x7f32d00c3790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:40:58.708 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:58.703+0000 7f32cdd9b640 1 --2- 172.21.15.88:0/1222734705 >> v2:172.21.15.175:3300/0 conn(0x7f32d00c4250 0x7f32d00c3790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:58.708 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:58.703+0000 7f32ced9d640 1 --2- 172.21.15.88:0/1222734705 >> v2:172.21.15.175:3300/0 conn(0x7f32d00c4250 0x7f32d00c3790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:58.708 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:58.703+0000 7f32cd59a640 1 -- 172.21.15.88:0/1222734705 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 79382488 0 0) 0x7f32d00ad010 con 0x7f32d00acc30 2024-04-26T23:40:58.709 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:58.703+0000 7f32ced9d640 1 -- 172.21.15.88:0/1222734705 >> v1:172.21.15.88:6789/0 conn(0x7f32d00acc30 legacy=0x7f32d015abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:58.709 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:58.703+0000 7f32ced9d640 1 -- 172.21.15.88:0/1222734705 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32d00c8300 con 0x7f32d00c3cd0 2024-04-26T23:40:58.709 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:58.704+0000 7f32ced9d640 1 --2- 172.21.15.88:0/1222734705 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f32d00c3cd0 0x7f32d01572e0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f32d0071a50 tx=0x7f32c802a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=616e4a5499ec661c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:58.709 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:58.704+0000 7f32cd59a640 1 -- 172.21.15.88:0/1222734705 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32c8037070 con 0x7f32d00c3cd0 2024-04-26T23:40:58.709 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:58.704+0000 7f32cd59a640 1 -- 172.21.15.88:0/1222734705 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32c8032440 con 0x7f32d00c3cd0 2024-04-26T23:40:58.709 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:58.704+0000 7f32cd59a640 1 -- 172.21.15.88:0/1222734705 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32c802ae60 con 0x7f32d00c3cd0 2024-04-26T23:40:58.712 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:58.705+0000 7f32d4daf640 1 -- 172.21.15.88:0/1222734705 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f32d00c3cd0 msgr2=0x7f32d01572e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:58.712 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:58.705+0000 7f32d4daf640 1 --2- 172.21.15.88:0/1222734705 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f32d00c3cd0 0x7f32d01572e0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f32d0071a50 tx=0x7f32c802a110 comp rx=0 tx=0).stop 2024-04-26T23:40:58.712 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:58.705+0000 7f32d4daf640 1 -- 172.21.15.88:0/1222734705 shutdown_connections 2024-04-26T23:40:58.712 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:58.705+0000 7f32d4daf640 1 --2- 172.21.15.88:0/1222734705 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f32d00c3cd0 0x7f32d01572e0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:58.712 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:58.705+0000 7f32d4daf640 1 --2- 172.21.15.88:0/1222734705 >> v2:172.21.15.175:3300/0 conn(0x7f32d00c4250 0x7f32d00c3790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:58.712 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:58.705+0000 7f32d4daf640 1 -- 172.21.15.88:0/1222734705 >> 172.21.15.88:0/1222734705 conn(0x7f32d00c6e60 msgr2=0x7f32d00c7270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:40:58.712 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:58.705+0000 7f32d4daf640 1 -- 172.21.15.88:0/1222734705 shutdown_connections 2024-04-26T23:40:58.712 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:58.705+0000 7f32d4daf640 1 -- 172.21.15.88:0/1222734705 wait complete. 2024-04-26T23:40:58.712 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:58.706+0000 7f32d4daf640 1 Processor -- start 2024-04-26T23:40:58.712 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:58.706+0000 7f32d4daf640 1 -- start start 2024-04-26T23:40:58.713 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:58.707+0000 7f32d4daf640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f32d00acc30 0x7f32d014eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:58.713 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:58.707+0000 7f32d4daf640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f32d00c3cd0 0x7f32d0147b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:58.713 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:58.707+0000 7f32d4daf640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f32d00c4250 0x7f32d01480b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:58.713 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:58.707+0000 7f32d4daf640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f32d00abec0 con 0x7f32d00acc30 2024-04-26T23:40:58.713 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:58.707+0000 7f32d4daf640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f32d00c88c0 con 0x7f32d00c4250 2024-04-26T23:40:58.713 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:58.707+0000 7f32d4daf640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f32d00ac040 con 0x7f32d00c3cd0 2024-04-26T23:40:58.713 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:58.707+0000 7f32ce59c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f32d00acc30 0x7f32d014eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:58.713 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:58.707+0000 7f32ce59c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f32d00acc30 0x7f32d014eef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:48570/0 (socket says 172.21.15.88:48570) 2024-04-26T23:40:58.713 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:58.707+0000 7f32ce59c640 1 -- 172.21.15.88:0/471079030 learned_addr learned my addr 172.21.15.88:0/471079030 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:40:58.713 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:58.707+0000 7f32cdd9b640 1 --2- 172.21.15.88:0/471079030 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f32d00c3cd0 0x7f32d0147b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:58.713 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:58.707+0000 7f32ced9d640 1 --2- 172.21.15.88:0/471079030 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f32d00c4250 0x7f32d01480b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:58.713 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:58.707+0000 7f32ce59c640 1 -- 172.21.15.88:0/471079030 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f32d00c3cd0 msgr2=0x7f32d0147b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:58.713 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:58.707+0000 7f32ce59c640 1 --2- 172.21.15.88:0/471079030 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f32d00c3cd0 0x7f32d0147b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:58.713 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:58.707+0000 7f32ce59c640 1 -- 172.21.15.88:0/471079030 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f32d00c4250 msgr2=0x7f32d01480b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:58.713 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:58.707+0000 7f32ce59c640 1 --2- 172.21.15.88:0/471079030 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f32d00c4250 0x7f32d01480b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:58.714 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:58.707+0000 7f32ce59c640 1 -- 172.21.15.88:0/471079030 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32d0158170 con 0x7f32d00acc30 2024-04-26T23:40:58.714 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:58.707+0000 7f32ce59c640 1 --2- 172.21.15.88:0/471079030 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f32d00acc30 0x7f32d014eef0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f32c000c8c0 tx=0x7f32c000cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:58.714 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:58.707+0000 7f32beffd640 1 -- 172.21.15.88:0/471079030 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32c0018070 con 0x7f32d00acc30 2024-04-26T23:40:58.714 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:58.707+0000 7f32beffd640 1 -- 172.21.15.88:0/471079030 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32c000a640 con 0x7f32d00acc30 2024-04-26T23:40:58.714 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:58.707+0000 7f32d4daf640 1 -- 172.21.15.88:0/471079030 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32d01ed4a0 con 0x7f32d00acc30 2024-04-26T23:40:58.714 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:58.707+0000 7f32beffd640 1 -- 172.21.15.88:0/471079030 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32c000aa30 con 0x7f32d00acc30 2024-04-26T23:40:58.714 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:58.707+0000 7f32d4daf640 1 -- 172.21.15.88:0/471079030 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32d0159e50 con 0x7f32d00acc30 2024-04-26T23:40:58.715 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:58.708+0000 7f32d4daf640 1 -- 172.21.15.88:0/471079030 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f32d00507a0 con 0x7f32d00acc30 2024-04-26T23:40:58.715 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:58.709+0000 7f32beffd640 1 -- 172.21.15.88:0/471079030 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f32c001b070 con 0x7f32d00acc30 2024-04-26T23:40:58.715 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:58.709+0000 7f32beffd640 1 --2- 172.21.15.88:0/471079030 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f32b006c920 0x7f32b006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:58.715 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:58.709+0000 7f32beffd640 1 -- 172.21.15.88:0/471079030 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7f32c008b3d0 con 0x7f32d00acc30 2024-04-26T23:40:58.715 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:58.709+0000 7f32cdd9b640 1 --2- 172.21.15.88:0/471079030 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f32b006c920 0x7f32b006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:58.715 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:58.710+0000 7f32cdd9b640 1 --2- 172.21.15.88:0/471079030 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f32b006c920 0x7f32b006ede0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f32d00c4690 tx=0x7f32c4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:58.717 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:58.714+0000 7f32beffd640 1 -- 172.21.15.88:0/471079030 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f32c0058f10 con 0x7f32d00acc30 2024-04-26T23:40:58.931 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:58.926+0000 7f32d4daf640 1 -- 172.21.15.88:0/471079030 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f32d00c46f0 con 0x7f32d00acc30 2024-04-26T23:40:58.931 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:58.927+0000 7f32beffd640 1 -- 172.21.15.88:0/471079030 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+6488 (secure 0 0 0) 0x7f32c005d210 con 0x7f32d00acc30 2024-04-26T23:40:58.931 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-26T23:40:58.931 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":12,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6834/3199540397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":3199540397},{"type":"v1","addr":"172.21.15.175:6834","nonce":3199540397}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4270,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6837/2790134952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6835","nonce":2790134952},{"type":"v1","addr":"172.21.15.88:6837","nonce":2790134952}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T23:40:31.909505+0000","modified":"2024-04-26T23:40:34.974455+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4279},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4279":{"gid":4279,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.175:6835/3932058274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6833","nonce":3932058274},{"type":"v1","addr":"172.21.15.175:6835","nonce":3932058274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4279,"qdb_cluster":[4279]},"id":1},{"mdsmap":{"epoch":12,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T23:40:41.008364+0000","modified":"2024-04-26T23:40:44.027288+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4272":{"gid":4272,"name":"c","rank":0,"incarnation":9,"state":"up:active","state_seq":6,"addr":"172.21.15.88:6836/4159390276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6834","nonce":4159390276},{"type":"v1","addr":"172.21.15.88:6836","nonce":4159390276}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4272,"qdb_cluster":[4272]},"id":2}]} 2024-04-26T23:40:58.931 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 12 2024-04-26T23:40:58.933 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:58.929+0000 7f32d4daf640 1 -- 172.21.15.88:0/471079030 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f32b006c920 msgr2=0x7f32b006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:58.933 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:58.929+0000 7f32d4daf640 1 --2- 172.21.15.88:0/471079030 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f32b006c920 0x7f32b006ede0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f32d00c4690 tx=0x7f32c4008040 comp rx=0 tx=0).stop 2024-04-26T23:40:58.933 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:58.929+0000 7f32d4daf640 1 -- 172.21.15.88:0/471079030 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f32d00acc30 msgr2=0x7f32d014eef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:58.933 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:58.929+0000 7f32d4daf640 1 --2- 172.21.15.88:0/471079030 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f32d00acc30 0x7f32d014eef0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f32c000c8c0 tx=0x7f32c000cd80 comp rx=0 tx=0).stop 2024-04-26T23:40:58.933 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:58.929+0000 7f32d4daf640 1 -- 172.21.15.88:0/471079030 shutdown_connections 2024-04-26T23:40:58.933 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:58.929+0000 7f32d4daf640 1 --2- 172.21.15.88:0/471079030 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f32b006c920 0x7f32b006ede0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:58.933 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:58.929+0000 7f32d4daf640 1 --2- 172.21.15.88:0/471079030 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f32d00c3cd0 0x7f32d0147b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:58.933 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:58.929+0000 7f32d4daf640 1 --2- 172.21.15.88:0/471079030 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f32d00c4250 0x7f32d01480b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:58.934 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:58.929+0000 7f32d4daf640 1 --2- 172.21.15.88:0/471079030 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f32d00acc30 0x7f32d014eef0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:58.934 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:58.929+0000 7f32d4daf640 1 -- 172.21.15.88:0/471079030 >> 172.21.15.88:0/471079030 conn(0x7f32d00c6e60 msgr2=0x7f32d01572e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:40:58.934 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:58.929+0000 7f32d4daf640 1 -- 172.21.15.88:0/471079030 shutdown_connections 2024-04-26T23:40:58.934 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:58.929+0000 7f32d4daf640 1 -- 172.21.15.88:0/471079030 wait complete. 2024-04-26T23:40:59.348 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 12, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-26T23:40:41.008364+0000', 'modified': '2024-04-26T23:40:44.027288+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4272}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4272': {'gid': 4272, 'name': 'c', 'rank': 0, 'incarnation': 9, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.88:6836/4159390276', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.88:6834', 'nonce': 4159390276}, {'type': 'v1', 'addr': '172.21.15.88:6836', 'nonce': 4159390276}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'b', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4272, 'qdb_cluster': [4272]} 2024-04-26T23:40:59.348 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-26T23:40:59.349 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-04-26T23:40:59.447 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.443+0000 7f70928e3640 1 Processor -- start 2024-04-26T23:40:59.447 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.443+0000 7f70928e3640 1 -- start start 2024-04-26T23:40:59.451 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.444+0000 7f70928e3640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f708c071cc0 0x7f708c073700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:59.451 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.444+0000 7f70928e3640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f708c0707e0 con 0x7f708c13ddd0 2024-04-26T23:40:59.451 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.444+0000 7f70928e3640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f708c155450 con 0x7f708c073c40 2024-04-26T23:40:59.451 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.444+0000 7f70928e3640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f708c155210 con 0x7f708c071cc0 2024-04-26T23:40:59.451 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.444+0000 7f708bfff640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f708c13ddd0 0x7f708c154b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:51942/0 (socket says 172.21.15.88:51942) 2024-04-26T23:40:59.452 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.444+0000 7f708bfff640 1 -- 172.21.15.88:0/3663279907 learned_addr learned my addr 172.21.15.88:0/3663279907 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-26T23:40:59.452 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.444+0000 7f708affd640 1 -- 172.21.15.88:0/3663279907 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 524214567 0 0) 0x7f708c0707e0 con 0x7f708c13ddd0 2024-04-26T23:40:59.452 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.445+0000 7f708affd640 1 -- 172.21.15.88:0/3663279907 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7074003520 con 0x7f708c13ddd0 2024-04-26T23:40:59.452 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.445+0000 7f708b7fe640 1 --2- 172.21.15.88:0/3663279907 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f708c071cc0 0x7f708c073700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:59.452 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.445+0000 7f708affd640 1 -- 172.21.15.88:0/3663279907 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4126074527 0 0) 0x7f7074003520 con 0x7f708c13ddd0 2024-04-26T23:40:59.452 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.445+0000 7f708affd640 1 -- 172.21.15.88:0/3663279907 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f708c071cc0 msgr2=0x7f708c073700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:40:59.452 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.445+0000 7f708affd640 1 --2- 172.21.15.88:0/3663279907 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f708c071cc0 0x7f708c073700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:59.452 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.445+0000 7f708affd640 1 -- 172.21.15.88:0/3663279907 >> v1:172.21.15.175:6789/0 conn(0x7f708c073c40 legacy=0x7f708c070f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:59.452 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.445+0000 7f708affd640 1 -- 172.21.15.88:0/3663279907 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f708c155730 con 0x7f708c13ddd0 2024-04-26T23:40:59.452 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.445+0000 7f708affd640 1 -- 172.21.15.88:0/3663279907 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 356324787 0 0) 0x7f707c001670 con 0x7f708c13ddd0 2024-04-26T23:40:59.452 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.445+0000 7f708affd640 1 -- 172.21.15.88:0/3663279907 >> v1:172.21.15.88:6789/0 conn(0x7f708c13ddd0 legacy=0x7f708c154b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:59.452 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.445+0000 7f708affd640 1 --2- 172.21.15.88:0/3663279907 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f708c071cc0 0x7f70740039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:59.452 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.445+0000 7f708affd640 1 --2- 172.21.15.88:0/3663279907 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7074003f60 0x7f7074004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:59.452 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.445+0000 7f708affd640 1 --2- 172.21.15.88:0/3663279907 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7074004d40 0x7f70740051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:59.453 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.445+0000 7f708affd640 1 -- 172.21.15.88:0/3663279907 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f708c155210 con 0x7f7074004d40 2024-04-26T23:40:59.453 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.445+0000 7f708affd640 1 -- 172.21.15.88:0/3663279907 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f707400bb50 con 0x7f7074003f60 2024-04-26T23:40:59.453 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.445+0000 7f708affd640 1 -- 172.21.15.88:0/3663279907 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f707400bd50 con 0x7f708c071cc0 2024-04-26T23:40:59.453 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.445+0000 7f7090e80640 1 --2- 172.21.15.88:0/3663279907 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7074004d40 0x7f70740051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:59.453 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.445+0000 7f708bfff640 1 --2- 172.21.15.88:0/3663279907 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f708c071cc0 0x7f70740039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:59.453 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.445+0000 7f708b7fe640 1 --2- 172.21.15.88:0/3663279907 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7074003f60 0x7f7074004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:59.453 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.445+0000 7f7090e80640 1 -- 172.21.15.88:0/3663279907 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f708c071cc0 msgr2=0x7f70740039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:40:59.453 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.445+0000 7f7090e80640 1 --2- 172.21.15.88:0/3663279907 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f708c071cc0 0x7f70740039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:59.453 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.445+0000 7f7090e80640 1 -- 172.21.15.88:0/3663279907 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7074003f60 msgr2=0x7f7074004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:40:59.453 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.445+0000 7f7090e80640 1 --2- 172.21.15.88:0/3663279907 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7074003f60 0x7f7074004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:59.453 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.445+0000 7f7090e80640 1 -- 172.21.15.88:0/3663279907 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7074003520 con 0x7f7074004d40 2024-04-26T23:40:59.453 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.445+0000 7f708b7fe640 1 --2- 172.21.15.88:0/3663279907 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7074003f60 0x7f7074004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:40:59.453 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.446+0000 7f7090e80640 1 --2- 172.21.15.88:0/3663279907 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7074004d40 0x7f70740051c0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f7084001e50 tx=0x7f7074005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6918b221044c1496 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:59.453 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.446+0000 7f708affd640 1 -- 172.21.15.88:0/3663279907 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7084001a70 con 0x7f7074004d40 2024-04-26T23:40:59.454 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.446+0000 7f708affd640 1 -- 172.21.15.88:0/3663279907 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7084003970 con 0x7f7074004d40 2024-04-26T23:40:59.454 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.446+0000 7f708affd640 1 -- 172.21.15.88:0/3663279907 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7084003d60 con 0x7f7074004d40 2024-04-26T23:40:59.454 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.446+0000 7f70928e3640 1 -- 172.21.15.88:0/3663279907 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7074004d40 msgr2=0x7f70740051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:59.454 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.447+0000 7f70928e3640 1 --2- 172.21.15.88:0/3663279907 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7074004d40 0x7f70740051c0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f7084001e50 tx=0x7f7074005830 comp rx=0 tx=0).stop 2024-04-26T23:40:59.454 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.447+0000 7f7090e80640 1 -- 172.21.15.88:0/3663279907 reap_dead start 2024-04-26T23:40:59.454 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.447+0000 7f70928e3640 1 -- 172.21.15.88:0/3663279907 shutdown_connections 2024-04-26T23:40:59.454 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.447+0000 7f70928e3640 1 -- 172.21.15.88:0/3663279907 >> 172.21.15.88:0/3663279907 conn(0x7f708c0ca2f0 msgr2=0x7f708c0ca6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:40:59.454 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.447+0000 7f70928e3640 1 -- 172.21.15.88:0/3663279907 shutdown_connections 2024-04-26T23:40:59.454 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.447+0000 7f70928e3640 1 -- 172.21.15.88:0/3663279907 wait complete. 2024-04-26T23:40:59.454 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.448+0000 7f70928e3640 1 Processor -- start 2024-04-26T23:40:59.463 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.448+0000 7f70928e3640 1 -- start start 2024-04-26T23:40:59.463 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.448+0000 7f70928e3640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7074004d40 0x7f708c1ee720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:59.464 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.449+0000 7f70928e3640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f708c158c90 0x7f708c1545c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:59.464 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.449+0000 7f70928e3640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f708c0c3680 0x7f708c0c3b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:59.464 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.449+0000 7f70928e3640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f708c13e330 con 0x7f708c158c90 2024-04-26T23:40:59.464 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.449+0000 7f70928e3640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f708c13e1b0 con 0x7f708c0c3680 2024-04-26T23:40:59.464 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.449+0000 7f70928e3640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f708c0ab470 con 0x7f7074004d40 2024-04-26T23:40:59.464 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.449+0000 7f708b7fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f708c158c90 0x7f708c1545c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:59.464 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.449+0000 7f708b7fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f708c158c90 0x7f708c1545c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:48590/0 (socket says 172.21.15.88:48590) 2024-04-26T23:40:59.464 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.449+0000 7f708b7fe640 1 -- 172.21.15.88:0/2426847874 learned_addr learned my addr 172.21.15.88:0/2426847874 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:40:59.464 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.449+0000 7f7090e80640 1 --2- 172.21.15.88:0/2426847874 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f708c0c3680 0x7f708c0c3b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:59.464 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.449+0000 7f708bfff640 1 --2- 172.21.15.88:0/2426847874 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7074004d40 0x7f708c1ee720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:59.464 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.449+0000 7f708b7fe640 1 -- 172.21.15.88:0/2426847874 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7074004d40 msgr2=0x7f708c1ee720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:59.464 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.449+0000 7f708b7fe640 1 --2- 172.21.15.88:0/2426847874 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7074004d40 0x7f708c1ee720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:59.464 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.449+0000 7f708b7fe640 1 -- 172.21.15.88:0/2426847874 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f708c0c3680 msgr2=0x7f708c0c3b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:59.464 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.449+0000 7f708b7fe640 1 --2- 172.21.15.88:0/2426847874 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f708c0c3680 0x7f708c0c3b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:59.465 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.449+0000 7f708b7fe640 1 -- 172.21.15.88:0/2426847874 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f708c1eec60 con 0x7f708c158c90 2024-04-26T23:40:59.465 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.449+0000 7f7090e80640 1 --2- 172.21.15.88:0/2426847874 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f708c0c3680 0x7f708c0c3b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:40:59.465 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.449+0000 7f708b7fe640 1 --2- 172.21.15.88:0/2426847874 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f708c158c90 0x7f708c1545c0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f7080011560 tx=0x7f7080011a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:59.465 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.449+0000 7f7088ff9640 1 -- 172.21.15.88:0/2426847874 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7080015870 con 0x7f708c158c90 2024-04-26T23:40:59.465 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.449+0000 7f7088ff9640 1 -- 172.21.15.88:0/2426847874 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7080015a10 con 0x7f708c158c90 2024-04-26T23:40:59.465 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.449+0000 7f70928e3640 1 -- 172.21.15.88:0/2426847874 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f708c1583f0 con 0x7f708c158c90 2024-04-26T23:40:59.465 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.449+0000 7f7088ff9640 1 -- 172.21.15.88:0/2426847874 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7080015dc0 con 0x7f708c158c90 2024-04-26T23:40:59.465 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.449+0000 7f70928e3640 1 -- 172.21.15.88:0/2426847874 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f708c158110 con 0x7f708c158c90 2024-04-26T23:40:59.465 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.451+0000 7f7088ff9640 1 -- 172.21.15.88:0/2426847874 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f708000f460 con 0x7f708c158c90 2024-04-26T23:40:59.465 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.451+0000 7f7088ff9640 1 --2- 172.21.15.88:0/2426847874 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f707806c920 0x7f707806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:59.465 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.451+0000 7f7088ff9640 1 -- 172.21.15.88:0/2426847874 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7f708008c760 con 0x7f708c158c90 2024-04-26T23:40:59.465 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.451+0000 7f708bfff640 1 --2- 172.21.15.88:0/2426847874 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f707806c920 0x7f707806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:59.465 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.452+0000 7f708bfff640 1 --2- 172.21.15.88:0/2426847874 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f707806c920 0x7f707806ede0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f707c007cb0 tx=0x7f707c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:59.465 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.452+0000 7f70955fd740 1 Processor -- start 2024-04-26T23:40:59.466 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.452+0000 7f70955fd740 1 -- start start 2024-04-26T23:40:59.466 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.453+0000 7f70955fd740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55ca9a3000c0 0x55ca9a301dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:59.466 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.453+0000 7f70955fd740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ca9a3004a0 0x55ca9a301450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:59.466 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.453+0000 7f70955fd740 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55ca9a300a00 0x55ca9a2be7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:59.466 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.453+0000 7f70955fd740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x55ca9a228740 con 0x55ca9a3000c0 2024-04-26T23:40:59.466 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.453+0000 7f70955fd740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55ca9a1c43a0 con 0x55ca9a3004a0 2024-04-26T23:40:59.466 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.453+0000 7f70955fd740 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x55ca9a224700 con 0x55ca9a300a00 2024-04-26T23:40:59.466 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.453+0000 7f708bfff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55ca9a3000c0 0x55ca9a301dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:59.466 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.453+0000 7f708bfff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55ca9a3000c0 0x55ca9a301dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:48592/0 (socket says 172.21.15.88:48592) 2024-04-26T23:40:59.466 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.453+0000 7f708bfff640 1 -- 172.21.15.88:0/847162112 learned_addr learned my addr 172.21.15.88:0/847162112 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:40:59.466 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.453+0000 7f708bfff640 1 -- 172.21.15.88:0/847162112 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55ca9a300a00 msgr2=0x55ca9a2be7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:40:59.466 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.453+0000 7f708bfff640 1 --2- 172.21.15.88:0/847162112 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55ca9a300a00 0x55ca9a2be7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:59.466 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.453+0000 7f708bfff640 1 -- 172.21.15.88:0/847162112 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ca9a3004a0 msgr2=0x55ca9a301450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:40:59.467 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.453+0000 7f708bfff640 1 --2- 172.21.15.88:0/847162112 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ca9a3004a0 0x55ca9a301450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:59.467 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.453+0000 7f708bfff640 1 -- 172.21.15.88:0/847162112 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ca9a1e0750 con 0x55ca9a3000c0 2024-04-26T23:40:59.467 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.453+0000 7f708bfff640 1 --2- 172.21.15.88:0/847162112 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55ca9a3000c0 0x55ca9a301dd0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f707c007d10 tx=0x7f707c013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a26d97b70867345 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:59.467 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.453+0000 7f7071ffb640 1 -- 172.21.15.88:0/847162112 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f707c026070 con 0x55ca9a3000c0 2024-04-26T23:40:59.467 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.453+0000 7f7071ffb640 1 -- 172.21.15.88:0/847162112 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f707c01c050 con 0x55ca9a3000c0 2024-04-26T23:40:59.467 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.453+0000 7f7071ffb640 1 -- 172.21.15.88:0/847162112 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f707c021410 con 0x55ca9a3000c0 2024-04-26T23:40:59.467 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.454+0000 7f70955fd740 1 -- 172.21.15.88:0/847162112 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55ca9a3000c0 msgr2=0x55ca9a301dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:59.467 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.454+0000 7f70955fd740 1 --2- 172.21.15.88:0/847162112 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55ca9a3000c0 0x55ca9a301dd0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f707c007d10 tx=0x7f707c013000 comp rx=0 tx=0).stop 2024-04-26T23:40:59.467 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.454+0000 7f70955fd740 1 -- 172.21.15.88:0/847162112 shutdown_connections 2024-04-26T23:40:59.467 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.454+0000 7f70955fd740 1 --2- 172.21.15.88:0/847162112 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55ca9a300a00 0x55ca9a2be7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:59.467 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.454+0000 7f70955fd740 1 --2- 172.21.15.88:0/847162112 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ca9a3004a0 0x55ca9a301450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:59.467 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.454+0000 7f70955fd740 1 --2- 172.21.15.88:0/847162112 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55ca9a3000c0 0x55ca9a301dd0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:59.467 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.454+0000 7f70955fd740 1 -- 172.21.15.88:0/847162112 >> 172.21.15.88:0/847162112 conn(0x55ca9a2c0930 msgr2=0x55ca9a2e5050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:40:59.467 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.454+0000 7f70955fd740 1 -- 172.21.15.88:0/847162112 shutdown_connections 2024-04-26T23:40:59.468 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.454+0000 7f70955fd740 1 -- 172.21.15.88:0/847162112 wait complete. 2024-04-26T23:40:59.468 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.455+0000 7f70955fd740 1 -- start start 2024-04-26T23:40:59.468 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.455+0000 7f70955fd740 1 Processor -- start 2024-04-26T23:40:59.468 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.455+0000 7f70955fd740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ca9a3004a0 0x55ca9a30c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:59.468 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.455+0000 7f70955fd740 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55ca9a300a00 0x55ca9a2faaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:59.468 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.455+0000 7f70955fd740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55ca9a2dbf40 0x55ca9a2db1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:59.468 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.455+0000 7f70955fd740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x55ca9a2bfbb0 con 0x55ca9a2dbf40 2024-04-26T23:40:59.468 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.455+0000 7f70955fd740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55ca9a1affe0 con 0x55ca9a3004a0 2024-04-26T23:40:59.468 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.456+0000 7f70955fd740 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x55ca9a30d890 con 0x55ca9a300a00 2024-04-26T23:40:59.468 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.456+0000 7f70955fd740 10 client.0 _ll_register_callbacks cb 0x55ca9a1c6150 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T23:40:59.468 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.456+0000 7f7090e80640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55ca9a2dbf40 0x55ca9a2db1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:59.468 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.456+0000 7f7090e80640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55ca9a2dbf40 0x55ca9a2db1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:48606/0 (socket says 172.21.15.88:48606) 2024-04-26T23:40:59.468 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.456+0000 7f7090e80640 1 -- 172.21.15.88:0/119298936 learned_addr learned my addr 172.21.15.88:0/119298936 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:40:59.468 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.456+0000 7f708bfff640 1 --2- 172.21.15.88:0/119298936 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ca9a3004a0 0x55ca9a30c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:59.469 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.456+0000 7f708b7fe640 1 --2- 172.21.15.88:0/119298936 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55ca9a300a00 0x55ca9a2faaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:59.469 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.456+0000 7f7090e80640 1 -- 172.21.15.88:0/119298936 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55ca9a300a00 msgr2=0x55ca9a2faaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:40:59.469 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.456+0000 7f7090e80640 1 --2- 172.21.15.88:0/119298936 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55ca9a300a00 0x55ca9a2faaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:59.469 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.456+0000 7f7090e80640 1 -- 172.21.15.88:0/119298936 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ca9a3004a0 msgr2=0x55ca9a30c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:40:59.469 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.456+0000 7f7090e80640 1 --2- 172.21.15.88:0/119298936 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ca9a3004a0 0x55ca9a30c6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:59.469 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.456+0000 7f7090e80640 1 -- 172.21.15.88:0/119298936 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ca99f3a2d0 con 0x55ca9a2dbf40 2024-04-26T23:40:59.469 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.456+0000 7f708b7fe640 1 --2- 172.21.15.88:0/119298936 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55ca9a300a00 0x55ca9a2faaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:40:59.469 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.456+0000 7f7090e80640 1 --2- 172.21.15.88:0/119298936 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55ca9a2dbf40 0x55ca9a2db1f0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f708402a920 tx=0x7f70840014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40afc37523d4a7c5 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:59.469 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.456+0000 7f706affd640 10 client.0 ms_handle_connect on v2:172.21.15.88:3300/0 2024-04-26T23:40:59.469 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.456+0000 7f706affd640 1 -- 172.21.15.88:0/119298936 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7084006d60 con 0x55ca9a2dbf40 2024-04-26T23:40:59.469 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.456+0000 7f706affd640 1 -- 172.21.15.88:0/119298936 <== mon.0 v2:172.21.15.88:3300/0 2 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7f7084003970 con 0x55ca9a2dbf40 2024-04-26T23:40:59.469 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.456+0000 7f70955fd740 1 -- 172.21.15.88:0/119298936 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f707c01c050 con 0x55ca9a2dbf40 2024-04-26T23:40:59.469 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.456+0000 7f706affd640 1 -- 172.21.15.88:0/119298936 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_get_version_reply(handle=1 version=12) ==== 24+0+0 (secure 0 0 0) 0x7f7084048050 con 0x55ca9a2dbf40 2024-04-26T23:40:59.469 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.456+0000 7f70955fd740 10 client.4878 fetch_fsmap learned FSMap version 12 2024-04-26T23:40:59.470 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.456+0000 7f70955fd740 1 -- 172.21.15.88:0/119298936 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,fsmap=12,monmap=2+}) -- 0x55ca9a0046b0 con 0x55ca9a2dbf40 2024-04-26T23:40:59.470 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.456+0000 7f706affd640 1 -- 172.21.15.88:0/119298936 <== mon.0 v2:172.21.15.88:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f707c01c050 con 0x55ca9a2dbf40 2024-04-26T23:40:59.470 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.457+0000 7f706affd640 1 -- 172.21.15.88:0/119298936 <== mon.0 v2:172.21.15.88:3300/0 5 ==== fsmap(e 12) ==== 4128+0+0 (secure 0 0 0) 0x7f708404b020 con 0x55ca9a2dbf40 2024-04-26T23:40:59.470 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.457+0000 7f70955fd740 10 client.4878 fetch_fsmap finished waiting for FSMap version 12 2024-04-26T23:40:59.470 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.457+0000 7f70955fd740 10 client.4878 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-26T23:40:59.470 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.457+0000 7f70955fd740 20 client.4878 populate_metadata read hostname 'smithi088' 2024-04-26T23:40:59.470 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.457+0000 7f70955fd740 1 --2- 172.21.15.88:0/119298936 >> [v2:172.21.15.88:6834/4159390276,v1:172.21.15.88:6836/4159390276] conn(0x55ca9a2c1e40 0x55ca9a2c2220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:59.470 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.457+0000 7f70955fd740 4 client.4878 mds_command: new command op to 4272 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T23:40:59.470 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.457+0000 7f70955fd740 1 -- 172.21.15.88:0/119298936 --> [v2:172.21.15.88:6834/4159390276,v1:172.21.15.88:6836/4159390276] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ca9a236350 con 0x55ca9a2c1e40 2024-04-26T23:40:59.470 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.457+0000 7f708bfff640 1 --2- 172.21.15.88:0/119298936 >> [v2:172.21.15.88:6834/4159390276,v1:172.21.15.88:6836/4159390276] conn(0x55ca9a2c1e40 0x55ca9a2c2220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:59.470 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.457+0000 7f706affd640 10 client.4878 ms_handle_connect on v2:172.21.15.88:6834/4159390276 2024-04-26T23:40:59.470 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.457+0000 7f708bfff640 1 --2- 172.21.15.88:0/119298936 >> [v2:172.21.15.88:6834/4159390276,v1:172.21.15.88:6836/4159390276] conn(0x55ca9a2c1e40 0x55ca9a2c2220 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=43a81eae164d344b server_cookie=d6c50ecceb8c9b0c in_seq=0 out_seq=0 2024-04-26T23:40:59.470 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.458+0000 7f706affd640 1 -- 172.21.15.88:0/119298936 <== mds.0 v2:172.21.15.88:6834/4159390276 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55ca9a236350 con 0x55ca9a2c1e40 2024-04-26T23:40:59.470 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.458+0000 7f706affd640 10 client.4878 handle_command_reply: tid=0 2024-04-26T23:40:59.471 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.458+0000 7f70955fd740 1 client.4878 shutdown 2024-04-26T23:40:59.471 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.458+0000 7f70955fd740 1 -- 172.21.15.88:0/119298936 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55ca9a2dbf40 msgr2=0x55ca9a2db1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:59.471 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.458+0000 7f70955fd740 1 --2- 172.21.15.88:0/119298936 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55ca9a2dbf40 0x55ca9a2db1f0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f708402a920 tx=0x7f70840014a0 comp rx=0 tx=0).stop 2024-04-26T23:40:59.471 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.458+0000 7f70955fd740 1 -- 172.21.15.88:0/119298936 shutdown_connections 2024-04-26T23:40:59.471 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.458+0000 7f70955fd740 1 --2- 172.21.15.88:0/119298936 >> [v2:172.21.15.88:6834/4159390276,v1:172.21.15.88:6836/4159390276] conn(0x55ca9a2c1e40 0x55ca9a2c2220 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:59.471 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.458+0000 7f70955fd740 1 --2- 172.21.15.88:0/119298936 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55ca9a300a00 0x55ca9a2faaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:59.471 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.458+0000 7f70955fd740 1 --2- 172.21.15.88:0/119298936 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55ca9a2dbf40 0x55ca9a2db1f0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:59.471 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.458+0000 7f706affd640 0 client.4878 ms_handle_reset on v2:172.21.15.88:6834/4159390276 2024-04-26T23:40:59.471 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.458+0000 7f70955fd740 1 --2- 172.21.15.88:0/119298936 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ca9a3004a0 0x55ca9a30c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:59.471 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.458+0000 7f70955fd740 1 -- 172.21.15.88:0/119298936 >> 172.21.15.88:0/119298936 conn(0x55ca9a3000c0 msgr2=0x55ca9a301430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:40:59.471 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.458+0000 7f70955fd740 1 -- 172.21.15.88:0/119298936 shutdown_connections 2024-04-26T23:40:59.471 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.458+0000 7f70955fd740 1 -- 172.21.15.88:0/119298936 wait complete. 2024-04-26T23:40:59.471 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.458+0000 7f70955fd740 20 client.4878 trim_cache size 0 max 16384 2024-04-26T23:40:59.480 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.476+0000 7f70955fd740 1 Processor -- start 2024-04-26T23:40:59.480 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.476+0000 7f70955fd740 1 -- start start 2024-04-26T23:40:59.482 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.477+0000 7f70955fd740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55ca9a2dbf40 0x55ca9a2fa3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:59.482 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.477+0000 7f70955fd740 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55ca9a3004a0 0x55ca9a2fee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:59.482 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.477+0000 7f70955fd740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ca9a300a00 0x55ca9a303340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:59.482 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.477+0000 7f70955fd740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f708c1f84a0 con 0x55ca9a2dbf40 2024-04-26T23:40:59.482 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.477+0000 7f70955fd740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f708c06e1d0 con 0x55ca9a300a00 2024-04-26T23:40:59.483 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.477+0000 7f70955fd740 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f708c1f6530 con 0x55ca9a3004a0 2024-04-26T23:40:59.483 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.477+0000 7f708bfff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55ca9a2dbf40 0x55ca9a2fa3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:59.483 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.477+0000 7f708bfff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55ca9a2dbf40 0x55ca9a2fa3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:48620/0 (socket says 172.21.15.88:48620) 2024-04-26T23:40:59.483 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.477+0000 7f708bfff640 1 -- 172.21.15.88:0/897114358 learned_addr learned my addr 172.21.15.88:0/897114358 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:40:59.483 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.477+0000 7f7090e80640 1 --2- 172.21.15.88:0/897114358 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ca9a300a00 0x55ca9a303340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:59.483 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.477+0000 7f708b7fe640 1 --2- 172.21.15.88:0/897114358 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55ca9a3004a0 0x55ca9a2fee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:59.483 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.477+0000 7f708bfff640 1 -- 172.21.15.88:0/897114358 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55ca9a3004a0 msgr2=0x55ca9a2fee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:40:59.483 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.477+0000 7f708bfff640 1 --2- 172.21.15.88:0/897114358 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55ca9a3004a0 0x55ca9a2fee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:59.483 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.477+0000 7f708bfff640 1 -- 172.21.15.88:0/897114358 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ca9a300a00 msgr2=0x55ca9a303340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:40:59.483 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.477+0000 7f708bfff640 1 --2- 172.21.15.88:0/897114358 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ca9a300a00 0x55ca9a303340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:59.483 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.477+0000 7f708bfff640 1 -- 172.21.15.88:0/897114358 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ca9a22abe0 con 0x55ca9a2dbf40 2024-04-26T23:40:59.483 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.477+0000 7f708bfff640 1 --2- 172.21.15.88:0/897114358 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55ca9a2dbf40 0x55ca9a2fa3a0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f707c021000 tx=0x7f707c015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b40a74ad64d1078 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:59.484 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.477+0000 7f70717fa640 1 -- 172.21.15.88:0/897114358 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f707c026040 con 0x55ca9a2dbf40 2024-04-26T23:40:59.484 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.477+0000 7f70717fa640 1 -- 172.21.15.88:0/897114358 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f707c01c070 con 0x55ca9a2dbf40 2024-04-26T23:40:59.484 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.477+0000 7f70717fa640 1 -- 172.21.15.88:0/897114358 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f707c032560 con 0x55ca9a2dbf40 2024-04-26T23:40:59.484 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.478+0000 7f70955fd740 1 -- 172.21.15.88:0/897114358 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55ca9a2dbf40 msgr2=0x55ca9a2fa3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:59.484 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.478+0000 7f70955fd740 1 --2- 172.21.15.88:0/897114358 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55ca9a2dbf40 0x55ca9a2fa3a0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f707c021000 tx=0x7f707c015000 comp rx=0 tx=0).stop 2024-04-26T23:40:59.484 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.478+0000 7f70955fd740 1 -- 172.21.15.88:0/897114358 shutdown_connections 2024-04-26T23:40:59.484 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.478+0000 7f70955fd740 1 --2- 172.21.15.88:0/897114358 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55ca9a3004a0 0x55ca9a2fee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:59.484 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.478+0000 7f70955fd740 1 --2- 172.21.15.88:0/897114358 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ca9a300a00 0x55ca9a303340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:59.484 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.478+0000 7f70955fd740 1 --2- 172.21.15.88:0/897114358 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55ca9a2dbf40 0x55ca9a2fa3a0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:59.484 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.478+0000 7f70955fd740 1 -- 172.21.15.88:0/897114358 >> 172.21.15.88:0/897114358 conn(0x55ca9a3000c0 msgr2=0x55ca9a30c4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:40:59.484 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.478+0000 7f70955fd740 1 -- 172.21.15.88:0/897114358 shutdown_connections 2024-04-26T23:40:59.484 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.478+0000 7f70955fd740 1 -- 172.21.15.88:0/897114358 wait complete. 2024-04-26T23:40:59.485 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.478+0000 7f70955fd740 1 -- start start 2024-04-26T23:40:59.485 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.479+0000 7f70955fd740 1 Processor -- start 2024-04-26T23:40:59.488 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.479+0000 7f70955fd740 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55ca9a2dbf40 0x55ca9a2c3380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:59.489 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.479+0000 7f70955fd740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55ca9a3004a0 0x55ca9a30b530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:59.489 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.479+0000 7f70955fd740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ca9a300a00 0x55ca9a378860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:59.489 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.479+0000 7f70955fd740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x55ca9a2fd3b0 con 0x55ca9a3004a0 2024-04-26T23:40:59.489 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.479+0000 7f70955fd740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55ca9a2c2e00 con 0x55ca9a300a00 2024-04-26T23:40:59.489 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.479+0000 7f70955fd740 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x55ca9a2c1910 con 0x55ca9a2dbf40 2024-04-26T23:40:59.489 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.479+0000 7f70955fd740 10 client.0 _ll_register_callbacks cb 0x7f70740036f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T23:40:59.489 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.479+0000 7f708b7fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55ca9a3004a0 0x55ca9a30b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:59.489 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.479+0000 7f708b7fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55ca9a3004a0 0x55ca9a30b530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:48626/0 (socket says 172.21.15.88:48626) 2024-04-26T23:40:59.490 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.479+0000 7f708b7fe640 1 -- 172.21.15.88:0/1646636914 learned_addr learned my addr 172.21.15.88:0/1646636914 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:40:59.490 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.479+0000 7f708bfff640 1 --2- 172.21.15.88:0/1646636914 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55ca9a2dbf40 0x55ca9a2c3380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:59.490 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.479+0000 7f7090e80640 1 --2- 172.21.15.88:0/1646636914 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ca9a300a00 0x55ca9a378860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:59.490 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.480+0000 7f708b7fe640 1 -- 172.21.15.88:0/1646636914 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55ca9a2dbf40 msgr2=0x55ca9a2c3380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:40:59.490 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.480+0000 7f708b7fe640 1 --2- 172.21.15.88:0/1646636914 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55ca9a2dbf40 0x55ca9a2c3380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:59.490 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.480+0000 7f708b7fe640 1 -- 172.21.15.88:0/1646636914 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ca9a300a00 msgr2=0x55ca9a378860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:40:59.490 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.480+0000 7f708b7fe640 1 --2- 172.21.15.88:0/1646636914 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ca9a300a00 0x55ca9a378860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:59.490 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.480+0000 7f708b7fe640 1 -- 172.21.15.88:0/1646636914 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ca9a2c3cd0 con 0x55ca9a3004a0 2024-04-26T23:40:59.490 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.480+0000 7f708b7fe640 1 --2- 172.21.15.88:0/1646636914 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55ca9a3004a0 0x55ca9a30b530 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f70800565c0 tx=0x7f708005e650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc676ad381927dcb server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:59.490 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.480+0000 7f706affd640 10 client.0 ms_handle_connect on v2:172.21.15.88:3300/0 2024-04-26T23:40:59.490 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.480+0000 7f706affd640 1 -- 172.21.15.88:0/1646636914 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7080072070 con 0x55ca9a3004a0 2024-04-26T23:40:59.490 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.480+0000 7f706affd640 1 -- 172.21.15.88:0/1646636914 <== mon.0 v2:172.21.15.88:3300/0 2 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7f70800628b0 con 0x55ca9a3004a0 2024-04-26T23:40:59.490 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.480+0000 7f70955fd740 1 -- 172.21.15.88:0/1646636914 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f707c01c070 con 0x55ca9a3004a0 2024-04-26T23:40:59.490 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.480+0000 7f706affd640 1 -- 172.21.15.88:0/1646636914 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_get_version_reply(handle=1 version=12) ==== 24+0+0 (secure 0 0 0) 0x7f7080062ab0 con 0x55ca9a3004a0 2024-04-26T23:40:59.491 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.480+0000 7f70955fd740 10 client.4884 fetch_fsmap learned FSMap version 12 2024-04-26T23:40:59.491 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.480+0000 7f70955fd740 1 -- 172.21.15.88:0/1646636914 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,fsmap=12,monmap=2+}) -- 0x55ca9a303850 con 0x55ca9a3004a0 2024-04-26T23:40:59.491 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.480+0000 7f706affd640 1 -- 172.21.15.88:0/1646636914 <== mon.0 v2:172.21.15.88:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f707c01c070 con 0x55ca9a3004a0 2024-04-26T23:40:59.491 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.480+0000 7f706affd640 1 -- 172.21.15.88:0/1646636914 <== mon.0 v2:172.21.15.88:3300/0 5 ==== fsmap(e 12) ==== 4128+0+0 (secure 0 0 0) 0x7f708006eb70 con 0x55ca9a3004a0 2024-04-26T23:40:59.491 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.480+0000 7f70955fd740 10 client.4884 fetch_fsmap finished waiting for FSMap version 12 2024-04-26T23:40:59.491 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.480+0000 7f70955fd740 10 client.4884 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-26T23:40:59.491 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.480+0000 7f70955fd740 20 client.4884 populate_metadata read hostname 'smithi088' 2024-04-26T23:40:59.491 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.480+0000 7f70955fd740 1 --2- 172.21.15.88:0/1646636914 >> [v2:172.21.15.88:6834/4159390276,v1:172.21.15.88:6836/4159390276] conn(0x55ca9a2d9eb0 0x55ca9a2da290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:59.491 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.480+0000 7f70955fd740 4 client.4884 mds_command: new command op to 4272 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-26T23:40:59.491 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.480+0000 7f70955fd740 1 -- 172.21.15.88:0/1646636914 --> [v2:172.21.15.88:6834/4159390276,v1:172.21.15.88:6836/4159390276] -- command(tid 0: {"prefix": "status"}) -- 0x55ca9a2301c0 con 0x55ca9a2d9eb0 2024-04-26T23:40:59.491 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.480+0000 7f708bfff640 1 --2- 172.21.15.88:0/1646636914 >> [v2:172.21.15.88:6834/4159390276,v1:172.21.15.88:6836/4159390276] conn(0x55ca9a2d9eb0 0x55ca9a2da290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:59.491 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.481+0000 7f706affd640 10 client.4884 ms_handle_connect on v2:172.21.15.88:6834/4159390276 2024-04-26T23:40:59.491 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.481+0000 7f708bfff640 1 --2- 172.21.15.88:0/1646636914 >> [v2:172.21.15.88:6834/4159390276,v1:172.21.15.88:6836/4159390276] conn(0x55ca9a2d9eb0 0x55ca9a2da290 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=414272665dc08d05 server_cookie=fe47bfd437eb07e4 in_seq=0 out_seq=0 2024-04-26T23:40:59.492 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.481+0000 7f706affd640 1 -- 172.21.15.88:0/1646636914 <== mds.0 v2:172.21.15.88:6834/4159390276 1 ==== command_reply(tid 0: 0 ) ==== 8+0+314 (crc 0 0 0) 0x55ca9a2301c0 con 0x55ca9a2d9eb0 2024-04-26T23:40:59.492 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.481+0000 7f706affd640 10 client.4884 handle_command_reply: tid=0 2024-04-26T23:40:59.492 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.481+0000 7f70955fd740 1 client.4884 shutdown 2024-04-26T23:40:59.492 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.481+0000 7f70955fd740 1 -- 172.21.15.88:0/1646636914 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55ca9a3004a0 msgr2=0x55ca9a30b530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:59.492 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.481+0000 7f70955fd740 1 --2- 172.21.15.88:0/1646636914 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55ca9a3004a0 0x55ca9a30b530 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f70800565c0 tx=0x7f708005e650 comp rx=0 tx=0).stop 2024-04-26T23:40:59.492 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.481+0000 7f70955fd740 1 -- 172.21.15.88:0/1646636914 shutdown_connections 2024-04-26T23:40:59.492 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.481+0000 7f70955fd740 1 --2- 172.21.15.88:0/1646636914 >> [v2:172.21.15.88:6834/4159390276,v1:172.21.15.88:6836/4159390276] conn(0x55ca9a2d9eb0 0x55ca9a2da290 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:59.492 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.481+0000 7f70955fd740 1 --2- 172.21.15.88:0/1646636914 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ca9a300a00 0x55ca9a378860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:59.492 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.481+0000 7f706affd640 0 client.4884 ms_handle_reset on v2:172.21.15.88:6834/4159390276 2024-04-26T23:40:59.492 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.481+0000 7f70955fd740 1 --2- 172.21.15.88:0/1646636914 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55ca9a3004a0 0x55ca9a30b530 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:59.492 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.481+0000 7f70955fd740 1 --2- 172.21.15.88:0/1646636914 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55ca9a2dbf40 0x55ca9a2c3380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:59.492 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.481+0000 7f70955fd740 1 -- 172.21.15.88:0/1646636914 >> 172.21.15.88:0/1646636914 conn(0x55ca9a3000c0 msgr2=0x55ca9a2fec70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:40:59.492 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.481+0000 7f70955fd740 1 -- 172.21.15.88:0/1646636914 shutdown_connections 2024-04-26T23:40:59.492 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.481+0000 7f70955fd740 1 -- 172.21.15.88:0/1646636914 wait complete. 2024-04-26T23:40:59.492 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.481+0000 7f70955fd740 20 client.4884 trim_cache size 0 max 16384 2024-04-26T23:40:59.493 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-04-26T23:40:59.493 INFO:teuthology.orchestra.run.smithi088.stdout: "cluster_fsid": "555255e9-7ef9-4454-8dc9-35e96b70035c", 2024-04-26T23:40:59.493 INFO:teuthology.orchestra.run.smithi088.stdout: "whoami": 0, 2024-04-26T23:40:59.493 INFO:teuthology.orchestra.run.smithi088.stdout: "id": 4272, 2024-04-26T23:40:59.493 INFO:teuthology.orchestra.run.smithi088.stdout: "want_state": "up:active", 2024-04-26T23:40:59.493 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "up:active", 2024-04-26T23:40:59.493 INFO:teuthology.orchestra.run.smithi088.stdout: "fs_name": "b", 2024-04-26T23:40:59.493 INFO:teuthology.orchestra.run.smithi088.stdout: "rank_uptime": 17.823341401, 2024-04-26T23:40:59.493 INFO:teuthology.orchestra.run.smithi088.stdout: "mdsmap_epoch": 12, 2024-04-26T23:40:59.493 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap_epoch": 24, 2024-04-26T23:40:59.493 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap_epoch_barrier": 24, 2024-04-26T23:40:59.494 INFO:teuthology.orchestra.run.smithi088.stdout: "uptime": 34.046335438 2024-04-26T23:40:59.494 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-04-26T23:40:59.494 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.482+0000 7f70928e3640 1 -- 172.21.15.88:0/2426847874 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f707806c920 msgr2=0x7f707806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:59.495 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.482+0000 7f70928e3640 1 --2- 172.21.15.88:0/2426847874 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f707806c920 0x7f707806ede0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f707c007cb0 tx=0x7f707c009040 comp rx=0 tx=0).stop 2024-04-26T23:40:59.495 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.482+0000 7f70928e3640 1 -- 172.21.15.88:0/2426847874 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f708c158c90 msgr2=0x7f708c1545c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:59.495 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.482+0000 7f70928e3640 1 --2- 172.21.15.88:0/2426847874 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f708c158c90 0x7f708c1545c0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f7080011560 tx=0x7f7080011a20 comp rx=0 tx=0).stop 2024-04-26T23:40:59.495 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.482+0000 7f70928e3640 1 -- 172.21.15.88:0/2426847874 shutdown_connections 2024-04-26T23:40:59.495 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.482+0000 7f70928e3640 1 --2- 172.21.15.88:0/2426847874 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f707806c920 0x7f707806ede0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:59.495 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.482+0000 7f70928e3640 1 --2- 172.21.15.88:0/2426847874 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f708c0c3680 0x7f708c0c3b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:59.495 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.482+0000 7f70928e3640 1 --2- 172.21.15.88:0/2426847874 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f708c158c90 0x7f708c1545c0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:59.495 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.482+0000 7f70928e3640 1 --2- 172.21.15.88:0/2426847874 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7074004d40 0x7f708c1ee720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:59.495 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.482+0000 7f70928e3640 1 -- 172.21.15.88:0/2426847874 >> 172.21.15.88:0/2426847874 conn(0x7f708c0ca2f0 msgr2=0x7f708c13b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:40:59.495 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.482+0000 7f70928e3640 1 -- 172.21.15.88:0/2426847874 shutdown_connections 2024-04-26T23:40:59.495 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.482+0000 7f70928e3640 1 -- 172.21.15.88:0/2426847874 wait complete. 2024-04-26T23:40:59.496 INFO:teuthology.run_tasks:Running task sequential... 2024-04-26T23:40:59.506 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-04-26T23:40:59.507 INFO:teuthology.task.sequential:In sequential, running task print... 2024-04-26T23:40:59.507 INFO:teuthology.task.print:Enabling mgr modules 2024-04-26T23:40:59.507 INFO:teuthology.run_tasks:Running task kclient... 2024-04-26T23:40:59.556 INFO:tasks.kclient:Mounting kernel clients... 2024-04-26T23:40:59.556 INFO:tasks.kclient:config is {'client.0': {}, 'client.1': {}} 2024-04-26T23:40:59.556 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:40:59.556 DEBUG:teuthology.orchestra.run.smithi088:> ip netns list 2024-04-26T23:40:59.572 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:40:59.572 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip link delete ceph-brx 2024-04-26T23:40:59.637 INFO:teuthology.orchestra.run.smithi088.stderr:Cannot find device "ceph-brx" 2024-04-26T23:40:59.638 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T23:40:59.641 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:40:59.641 DEBUG:teuthology.orchestra.run.smithi175:> ip netns list 2024-04-26T23:40:59.660 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:40:59.660 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip link delete ceph-brx 2024-04-26T23:40:59.731 INFO:teuthology.orchestra.run.smithi175.stderr:Cannot find device "ceph-brx" 2024-04-26T23:40:59.732 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T23:40:59.733 INFO:tasks.kclient:client.0 config is {'syntax': 'v2', 'cephfs_name': 'a'} 2024-04-26T23:40:59.733 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-26T23:40:59.733 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-26T23:40:59.733 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-26T23:40:59.829 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.825+0000 7f681e9f7640 1 Processor -- start 2024-04-26T23:40:59.829 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.825+0000 7f681e9f7640 1 -- start start 2024-04-26T23:40:59.833 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.826+0000 7f681e9f7640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f68181570d0 0x7f6818150a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:59.833 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.826+0000 7f681e9f7640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f68180c3810 con 0x7f6818150f90 2024-04-26T23:40:59.833 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.826+0000 7f681e9f7640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f68180c3ab0 con 0x7f68180ab3f0 2024-04-26T23:40:59.833 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.826+0000 7f681e9f7640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f68180c4330 con 0x7f68181570d0 2024-04-26T23:40:59.833 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.826+0000 7f681cf94640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f6818150f90 0x7f68181574b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:51956/0 (socket says 172.21.15.88:51956) 2024-04-26T23:40:59.833 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.826+0000 7f681cf94640 1 -- 172.21.15.88:0/2326664098 learned_addr learned my addr 172.21.15.88:0/2326664098 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-26T23:40:59.833 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.826+0000 7f6816ffd640 1 -- 172.21.15.88:0/2326664098 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1658509854 0 0) 0x7f68180c3810 con 0x7f6818150f90 2024-04-26T23:40:59.833 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.826+0000 7f6817fff640 1 --2- 172.21.15.88:0/2326664098 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f68181570d0 0x7f6818150a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:59.833 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.826+0000 7f6816ffd640 1 -- 172.21.15.88:0/2326664098 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6800005730 con 0x7f6818150f90 2024-04-26T23:40:59.833 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.826+0000 7f6816ffd640 1 -- 172.21.15.88:0/2326664098 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 342961819 0 0) 0x7f6800005730 con 0x7f6818150f90 2024-04-26T23:40:59.833 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.826+0000 7f6816ffd640 1 -- 172.21.15.88:0/2326664098 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f68181570d0 msgr2=0x7f6818150a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:40:59.833 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.826+0000 7f6816ffd640 1 --2- 172.21.15.88:0/2326664098 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f68181570d0 0x7f6818150a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:59.834 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.826+0000 7f6816ffd640 1 -- 172.21.15.88:0/2326664098 >> v1:172.21.15.175:6789/0 conn(0x7f68180ab3f0 legacy=0x7f68180c4d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:59.834 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.826+0000 7f6816ffd640 1 -- 172.21.15.88:0/2326664098 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68180c4580 con 0x7f6818150f90 2024-04-26T23:40:59.834 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.826+0000 7f6816ffd640 1 -- 172.21.15.88:0/2326664098 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 356324787 0 0) 0x7f6810001a10 con 0x7f6818150f90 2024-04-26T23:40:59.834 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.826+0000 7f6816ffd640 1 -- 172.21.15.88:0/2326664098 >> v1:172.21.15.88:6789/0 conn(0x7f6818150f90 legacy=0x7f68181574b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:59.834 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.826+0000 7f6816ffd640 1 --2- 172.21.15.88:0/2326664098 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6800005bf0 0x7f6800006010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:59.834 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.826+0000 7f6816ffd640 1 --2- 172.21.15.88:0/2326664098 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6800006a10 0x7f6800006e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:59.834 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.826+0000 7f6816ffd640 1 --2- 172.21.15.88:0/2326664098 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f68181570d0 0x7f68000074a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:59.834 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.827+0000 7f6816ffd640 1 -- 172.21.15.88:0/2326664098 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f68180c4330 con 0x7f6800006a10 2024-04-26T23:40:59.834 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.827+0000 7f6816ffd640 1 -- 172.21.15.88:0/2326664098 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f680000dd90 con 0x7f6800005bf0 2024-04-26T23:40:59.834 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.827+0000 7f6816ffd640 1 -- 172.21.15.88:0/2326664098 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f680000df90 con 0x7f68181570d0 2024-04-26T23:40:59.834 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.827+0000 7f68177fe640 1 --2- 172.21.15.88:0/2326664098 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6800006a10 0x7f6800006e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:59.834 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.827+0000 7f6817fff640 1 --2- 172.21.15.88:0/2326664098 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6800005bf0 0x7f6800006010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:59.834 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.827+0000 7f681cf94640 1 --2- 172.21.15.88:0/2326664098 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f68181570d0 0x7f68000074a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:59.834 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.827+0000 7f68177fe640 1 -- 172.21.15.88:0/2326664098 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f68181570d0 msgr2=0x7f68000074a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:40:59.835 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.827+0000 7f68177fe640 1 --2- 172.21.15.88:0/2326664098 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f68181570d0 0x7f68000074a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:59.835 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.827+0000 7f68177fe640 1 -- 172.21.15.88:0/2326664098 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6800005bf0 msgr2=0x7f6800006010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:40:59.835 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.827+0000 7f68177fe640 1 --2- 172.21.15.88:0/2326664098 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6800005bf0 0x7f6800006010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:59.835 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.827+0000 7f68177fe640 1 -- 172.21.15.88:0/2326664098 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6800005730 con 0x7f6800006a10 2024-04-26T23:40:59.835 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.827+0000 7f68177fe640 1 --2- 172.21.15.88:0/2326664098 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6800006a10 0x7f6800006e90 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f680c001750 tx=0x7f6800007a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d98592593a8389fc server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:59.835 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.828+0000 7f6816ffd640 1 -- 172.21.15.88:0/2326664098 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f680c001370 con 0x7f6800006a10 2024-04-26T23:40:59.835 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.828+0000 7f6816ffd640 1 -- 172.21.15.88:0/2326664098 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f680c0052d0 con 0x7f6800006a10 2024-04-26T23:40:59.835 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.828+0000 7f6816ffd640 1 -- 172.21.15.88:0/2326664098 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f680c02abe0 con 0x7f6800006a10 2024-04-26T23:40:59.835 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.828+0000 7f681e9f7640 1 -- 172.21.15.88:0/2326664098 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6800006a10 msgr2=0x7f6800006e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:59.835 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.828+0000 7f681e9f7640 1 --2- 172.21.15.88:0/2326664098 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6800006a10 0x7f6800006e90 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f680c001750 tx=0x7f6800007a40 comp rx=0 tx=0).stop 2024-04-26T23:40:59.835 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.828+0000 7f681cf94640 1 -- 172.21.15.88:0/2326664098 reap_dead start 2024-04-26T23:40:59.835 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.828+0000 7f681e9f7640 1 -- 172.21.15.88:0/2326664098 shutdown_connections 2024-04-26T23:40:59.835 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.828+0000 7f681e9f7640 1 -- 172.21.15.88:0/2326664098 >> 172.21.15.88:0/2326664098 conn(0x7f681806c310 msgr2=0x7f681806c6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:40:59.836 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.828+0000 7f681e9f7640 1 -- 172.21.15.88:0/2326664098 shutdown_connections 2024-04-26T23:40:59.836 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.828+0000 7f681e9f7640 1 -- 172.21.15.88:0/2326664098 wait complete. 2024-04-26T23:40:59.836 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.829+0000 7f681e9f7640 1 Processor -- start 2024-04-26T23:40:59.838 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.829+0000 7f681e9f7640 1 -- start start 2024-04-26T23:40:59.838 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.830+0000 7f681e9f7640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6800006a10 0x7f68180c2e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:59.838 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.830+0000 7f681e9f7640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6818153f80 0x7f68181e8190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:59.839 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.830+0000 7f681e9f7640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f68181ec380 0x7f68181e86d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:59.839 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.830+0000 7f681e9f7640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f68180abbe0 con 0x7f6818153f80 2024-04-26T23:40:59.839 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.830+0000 7f681e9f7640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f68180aba60 con 0x7f68181ec380 2024-04-26T23:40:59.839 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.830+0000 7f681e9f7640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f68180c5490 con 0x7f6800006a10 2024-04-26T23:40:59.839 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.830+0000 7f68177fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6818153f80 0x7f68181e8190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:59.839 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.830+0000 7f68177fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6818153f80 0x7f68181e8190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:48632/0 (socket says 172.21.15.88:48632) 2024-04-26T23:40:59.839 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.830+0000 7f68177fe640 1 -- 172.21.15.88:0/1783338831 learned_addr learned my addr 172.21.15.88:0/1783338831 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:40:59.839 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.830+0000 7f6817fff640 1 --2- 172.21.15.88:0/1783338831 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6800006a10 0x7f68180c2e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:59.839 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.830+0000 7f681cf94640 1 --2- 172.21.15.88:0/1783338831 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f68181ec380 0x7f68181e86d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:59.839 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.830+0000 7f68177fe640 1 -- 172.21.15.88:0/1783338831 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6800006a10 msgr2=0x7f68180c2e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:59.839 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.830+0000 7f68177fe640 1 --2- 172.21.15.88:0/1783338831 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6800006a10 0x7f68180c2e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:59.839 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.830+0000 7f68177fe640 1 -- 172.21.15.88:0/1783338831 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f68181ec380 msgr2=0x7f68181e86d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:40:59.839 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.830+0000 7f68177fe640 1 --2- 172.21.15.88:0/1783338831 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f68181ec380 0x7f68181e86d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:40:59.839 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.830+0000 7f68177fe640 1 -- 172.21.15.88:0/1783338831 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6818154410 con 0x7f6818153f80 2024-04-26T23:40:59.840 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.831+0000 7f68177fe640 1 --2- 172.21.15.88:0/1783338831 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6818153f80 0x7f68181e8190 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f680c001870 tx=0x7f680c001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:59.840 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.831+0000 7f6814ff9640 1 -- 172.21.15.88:0/1783338831 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f680c040020 con 0x7f6818153f80 2024-04-26T23:40:59.840 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.831+0000 7f6814ff9640 1 -- 172.21.15.88:0/1783338831 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f680c007680 con 0x7f6818153f80 2024-04-26T23:40:59.840 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.831+0000 7f681e9f7640 1 -- 172.21.15.88:0/1783338831 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68181eb8a0 con 0x7f6818153f80 2024-04-26T23:40:59.840 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.831+0000 7f6814ff9640 1 -- 172.21.15.88:0/1783338831 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f680c007a30 con 0x7f6818153f80 2024-04-26T23:40:59.840 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.831+0000 7f681e9f7640 1 -- 172.21.15.88:0/1783338831 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68181ebe60 con 0x7f6818153f80 2024-04-26T23:40:59.840 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.832+0000 7f681e9f7640 1 -- 172.21.15.88:0/1783338831 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f68180507a0 con 0x7f6818153f80 2024-04-26T23:40:59.840 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.832+0000 7f6814ff9640 1 -- 172.21.15.88:0/1783338831 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f680c043020 con 0x7f6818153f80 2024-04-26T23:40:59.840 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.833+0000 7f6814ff9640 1 --2- 172.21.15.88:0/1783338831 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f680406c8f0 0x7f680406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:40:59.840 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.833+0000 7f6814ff9640 1 -- 172.21.15.88:0/1783338831 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7f680c0abdf0 con 0x7f6818153f80 2024-04-26T23:40:59.840 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.833+0000 7f6817fff640 1 --2- 172.21.15.88:0/1783338831 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f680406c8f0 0x7f680406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:40:59.840 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.833+0000 7f6817fff640 1 --2- 172.21.15.88:0/1783338831 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f680406c8f0 0x7f680406edb0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f68180c3600 tx=0x7f6808008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:40:59.841 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:40:59.837+0000 7f6814ff9640 1 -- 172.21.15.88:0/1783338831 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f680c04a030 con 0x7f6818153f80 2024-04-26T23:41:00.055 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:00.051+0000 7f681e9f7640 1 -- 172.21.15.88:0/1783338831 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f68180c4110 con 0x7f6818153f80 2024-04-26T23:41:00.055 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:00.051+0000 7f6814ff9640 1 -- 172.21.15.88:0/1783338831 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v12) ==== 53+0+116 (secure 0 0 0) 0x7f680c079f80 con 0x7f6818153f80 2024-04-26T23:41:00.056 INFO:teuthology.orchestra.run.smithi088.stdout:name: a, metadata pool: a_metadata, data pools: [a_data ] 2024-04-26T23:41:00.056 INFO:teuthology.orchestra.run.smithi088.stdout:name: b, metadata pool: b_metadata, data pools: [b_data ] 2024-04-26T23:41:00.058 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:00.053+0000 7f681e9f7640 1 -- 172.21.15.88:0/1783338831 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f680406c8f0 msgr2=0x7f680406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:00.058 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:00.053+0000 7f681e9f7640 1 --2- 172.21.15.88:0/1783338831 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f680406c8f0 0x7f680406edb0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f68180c3600 tx=0x7f6808008040 comp rx=0 tx=0).stop 2024-04-26T23:41:00.058 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:00.053+0000 7f681e9f7640 1 -- 172.21.15.88:0/1783338831 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6818153f80 msgr2=0x7f68181e8190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:00.058 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:00.053+0000 7f681e9f7640 1 --2- 172.21.15.88:0/1783338831 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6818153f80 0x7f68181e8190 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f680c001870 tx=0x7f680c001120 comp rx=0 tx=0).stop 2024-04-26T23:41:00.058 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:00.053+0000 7f681e9f7640 1 -- 172.21.15.88:0/1783338831 shutdown_connections 2024-04-26T23:41:00.058 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:00.053+0000 7f681e9f7640 1 --2- 172.21.15.88:0/1783338831 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f680406c8f0 0x7f680406edb0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:00.058 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:00.053+0000 7f681e9f7640 1 --2- 172.21.15.88:0/1783338831 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f68181ec380 0x7f68181e86d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:00.058 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:00.053+0000 7f681e9f7640 1 --2- 172.21.15.88:0/1783338831 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6818153f80 0x7f68181e8190 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:00.058 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:00.053+0000 7f681e9f7640 1 --2- 172.21.15.88:0/1783338831 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6800006a10 0x7f68180c2e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:00.058 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:00.053+0000 7f681e9f7640 1 -- 172.21.15.88:0/1783338831 >> 172.21.15.88:0/1783338831 conn(0x7f681806c310 msgr2=0x7f681814a2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:00.058 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:00.054+0000 7f681e9f7640 1 -- 172.21.15.88:0/1783338831 shutdown_connections 2024-04-26T23:41:00.058 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:00.054+0000 7f681e9f7640 1 -- 172.21.15.88:0/1783338831 wait complete. 2024-04-26T23:41:00.068 INFO:tasks.cephfs.mount:Mounting Ceph FS a; just confirmed its presence on cluster 2024-04-26T23:41:00.068 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-26T23:41:00.068 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi088.front.sepia.ceph.com 2024-04-26T23:41:00.068 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-26T23:41:00.068 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-26T23:41:00.068 INFO:tasks.cephfs.mount:self.cephfs_name = a 2024-04-26T23:41:00.068 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-26T23:41:00.068 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-26T23:41:00.069 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-26T23:41:00.069 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:41:00.069 DEBUG:teuthology.orchestra.run.smithi088:> ip addr 2024-04-26T23:41:00.084 INFO:teuthology.orchestra.run.smithi088.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-26T23:41:00.084 INFO:teuthology.orchestra.run.smithi088.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-26T23:41:00.084 INFO:teuthology.orchestra.run.smithi088.stdout: inet 127.0.0.1/8 scope host lo 2024-04-26T23:41:00.084 INFO:teuthology.orchestra.run.smithi088.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:41:00.084 INFO:teuthology.orchestra.run.smithi088.stdout: inet6 ::1/128 scope host 2024-04-26T23:41:00.084 INFO:teuthology.orchestra.run.smithi088.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:41:00.084 INFO:teuthology.orchestra.run.smithi088.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-26T23:41:00.084 INFO:teuthology.orchestra.run.smithi088.stdout: link/ether 0c:c4:7a:d8:a8:f0 brd ff:ff:ff:ff:ff:ff 2024-04-26T23:41:00.084 INFO:teuthology.orchestra.run.smithi088.stdout: altname enp7s0f0 2024-04-26T23:41:00.084 INFO:teuthology.orchestra.run.smithi088.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-26T23:41:00.084 INFO:teuthology.orchestra.run.smithi088.stdout: link/ether 0c:c4:7a:d8:a8:f1 brd ff:ff:ff:ff:ff:ff 2024-04-26T23:41:00.085 INFO:teuthology.orchestra.run.smithi088.stdout: altname enp7s0f1 2024-04-26T23:41:00.085 INFO:teuthology.orchestra.run.smithi088.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-26T23:41:00.085 INFO:teuthology.orchestra.run.smithi088.stdout: link/ether 0c:c4:7a:8f:d4:2c brd ff:ff:ff:ff:ff:ff 2024-04-26T23:41:00.085 INFO:teuthology.orchestra.run.smithi088.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-26T23:41:00.085 INFO:teuthology.orchestra.run.smithi088.stdout: link/ether 0c:c4:7a:8f:d4:2d brd ff:ff:ff:ff:ff:ff 2024-04-26T23:41:00.085 INFO:teuthology.orchestra.run.smithi088.stdout: inet 172.21.15.88/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-04-26T23:41:00.085 INFO:teuthology.orchestra.run.smithi088.stdout: valid_lft 42750sec preferred_lft 42750sec 2024-04-26T23:41:00.085 INFO:teuthology.orchestra.run.smithi088.stdout: inet6 fe80::1b95:8831:6d38:a382/64 scope link noprefixroute 2024-04-26T23:41:00.085 INFO:teuthology.orchestra.run.smithi088.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:41:00.085 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-26T23:41:00.086 DEBUG:teuthology.orchestra.run.smithi088:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T23:41:00.086 DEBUG:teuthology.orchestra.run.smithi088:> set -e 2024-04-26T23:41:00.086 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip link add name ceph-brx type bridge 2024-04-26T23:41:00.086 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip addr flush dev ceph-brx 2024-04-26T23:41:00.086 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip link set ceph-brx up 2024-04-26T23:41:00.086 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-26T23:41:00.086 DEBUG:teuthology.orchestra.run.smithi088:> ') 2024-04-26T23:41:00.171 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:00 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T23:41:00.255 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T23:41:00.262 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:41:00.262 DEBUG:teuthology.orchestra.run.smithi088:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-26T23:41:00.285 INFO:teuthology.orchestra.run.smithi088.stdout:1 2024-04-26T23:41:00.287 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:41:00.287 DEBUG:teuthology.orchestra.run.smithi088:> route 2024-04-26T23:41:00.357 INFO:teuthology.orchestra.run.smithi088.stdout:Kernel IP routing table 2024-04-26T23:41:00.357 INFO:teuthology.orchestra.run.smithi088.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-26T23:41:00.358 INFO:teuthology.orchestra.run.smithi088.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-26T23:41:00.358 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-26T23:41:00.358 INFO:teuthology.orchestra.run.smithi088.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-26T23:41:00.358 DEBUG:teuthology.orchestra.run.smithi088:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T23:41:00.358 DEBUG:teuthology.orchestra.run.smithi088:> set -e 2024-04-26T23:41:00.358 DEBUG:teuthology.orchestra.run.smithi088:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-26T23:41:00.358 DEBUG:teuthology.orchestra.run.smithi088:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-26T23:41:00.358 DEBUG:teuthology.orchestra.run.smithi088:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-26T23:41:00.359 DEBUG:teuthology.orchestra.run.smithi088:> ') 2024-04-26T23:41:00.445 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:00 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T23:41:00.624 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T23:41:00.630 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:41:00.630 DEBUG:teuthology.orchestra.run.smithi088:> ip netns list 2024-04-26T23:41:00.644 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:41:00.645 DEBUG:teuthology.orchestra.run.smithi088:> ip netns list-id 2024-04-26T23:41:00.700 DEBUG:teuthology.orchestra.run.smithi088:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T23:41:00.700 DEBUG:teuthology.orchestra.run.smithi088:> set -e 2024-04-26T23:41:00.700 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-26T23:41:00.700 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-04-26T23:41:00.700 DEBUG:teuthology.orchestra.run.smithi088:> ') 2024-04-26T23:41:00.788 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:00 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T23:41:00.811 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T23:41:00.817 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-04-26T23:41:00.817 DEBUG:teuthology.orchestra.run.smithi088:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T23:41:00.817 DEBUG:teuthology.orchestra.run.smithi088:> set -e 2024-04-26T23:41:00.817 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-04-26T23:41:00.817 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-26T23:41:00.817 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-04-26T23:41:00.817 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-04-26T23:41:00.817 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-04-26T23:41:00.817 DEBUG:teuthology.orchestra.run.smithi088:> ') 2024-04-26T23:41:00.865 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:00 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T23:41:00.944 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T23:41:00.950 DEBUG:teuthology.orchestra.run.smithi088:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T23:41:00.951 DEBUG:teuthology.orchestra.run.smithi088:> set -e 2024-04-26T23:41:00.951 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip link set brx.0 up 2024-04-26T23:41:00.951 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip link set dev brx.0 master ceph-brx 2024-04-26T23:41:00.951 DEBUG:teuthology.orchestra.run.smithi088:> ') 2024-04-26T23:41:00.999 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:00 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T23:41:01.020 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T23:41:01.028 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-26T23:41:01.028 DEBUG:teuthology.orchestra.run.smithi088:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-26T23:41:01.042 INFO:teuthology.orchestra.run.smithi088.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-26T23:41:01.043 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-26T23:41:01.043 DEBUG:teuthology.orchestra.run.smithi088:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-26T23:41:01.099 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.a=/ 2024-04-26T23:41:01.099 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:41:01.099 DEBUG:teuthology.orchestra.run.smithi088:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.a=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-26T23:41:01.193 INFO:teuthology.orchestra.run.smithi088.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-26T23:41:01.193 INFO:teuthology.orchestra.run.smithi088.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-26T23:41:01.315 INFO:teuthology.orchestra.run.smithi088.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-26T23:41:01.315 INFO:teuthology.orchestra.run.smithi088.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-26T23:41:01.315 INFO:teuthology.orchestra.run.smithi088.stdout:mount.ceph: resolved to: "172.21.15.88:3300,172.21.15.175:3300,172.21.15.175:3301" 2024-04-26T23:41:01.315 INFO:teuthology.orchestra.run.smithi088.stdout:mount.ceph: trying mount with new device syntax: 0@555255e9-7ef9-4454-8dc9-35e96b70035c.a=/ 2024-04-26T23:41:01.315 INFO:teuthology.orchestra.run.smithi088.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.88:3300/172.21.15.175:3300/172.21.15.175:3301" will pass to kernel 2024-04-26T23:41:01.316 INFO:teuthology.orchestra.run.smithi088.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-04-26T23:41:01.316 INFO:teuthology.orchestra.run.smithi088.stdout: You just mounted a file system that supports labels which does not 2024-04-26T23:41:01.316 INFO:teuthology.orchestra.run.smithi088.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-26T23:41:01.316 INFO:teuthology.orchestra.run.smithi088.stdout: applications will generate AVC messages and not be allowed access to 2024-04-26T23:41:01.316 INFO:teuthology.orchestra.run.smithi088.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-26T23:41:01.318 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-26T23:41:01.318 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:41:01.318 DEBUG:teuthology.orchestra.run.smithi088:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-26T23:41:01.342 DEBUG:teuthology.orchestra.run.smithi088:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-26T23:41:01.432 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:01 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-26T23:41:01.437 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T23:41:01.442 INFO:teuthology.orchestra.run.smithi088.stdout:client4893 2024-04-26T23:41:01.443 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-04-26T23:41:01.443 DEBUG:teuthology.orchestra.run.smithi088:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:41:01.458 DEBUG:teuthology.orchestra.run.smithi088:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-26T23:41:01.548 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:01 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-26T23:41:01.556 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T23:41:01.563 INFO:teuthology.orchestra.run.smithi088.stdout:client4893 2024-04-26T23:41:01.563 DEBUG:teuthology.orchestra.run.smithi088:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-26T23:41:01.613 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:01 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-26T23:41:01.620 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T23:41:01.626 INFO:teuthology.orchestra.run.smithi088.stdout:client4893 2024-04-26T23:41:01.626 DEBUG:teuthology.orchestra.run.smithi088:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/555255e9-7ef9-4454-8dc9-35e96b70035c.client4893/status') 2024-04-26T23:41:01.676 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:01 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T23:41:01.689 INFO:teuthology.orchestra.run.smithi088.stdout:instance: client.4893 (3)192.168.0.1:0/744087680 2024-04-26T23:41:01.689 INFO:teuthology.orchestra.run.smithi088.stdout:blocklisted: false 2024-04-26T23:41:01.689 INFO:teuthology.orchestra.run.smithi088.stderr:0+1 records in 2024-04-26T23:41:01.689 INFO:teuthology.orchestra.run.smithi088.stderr:0+1 records out 2024-04-26T23:41:01.689 INFO:teuthology.orchestra.run.smithi088.stderr:68 bytes copied, 2.22e-05 s, 3.1 MB/s 2024-04-26T23:41:01.690 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T23:41:01.696 INFO:tasks.kclient:client.1 config is {'syntax': 'v2', 'cephfs_name': 'b'} 2024-04-26T23:41:01.697 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-26T23:41:01.697 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-04-26T23:41:01.697 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-26T23:41:01.794 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:01.790+0000 7fbe09104640 1 Processor -- start 2024-04-26T23:41:01.794 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:01.790+0000 7fbe09104640 1 -- start start 2024-04-26T23:41:01.797 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:01.791+0000 7fbe09104640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fbe040acc30 0x7fbe0415abf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:01.797 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:01.791+0000 7fbe09104640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fbe040c4250 0x7fbe040c3790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:01.797 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:01.791+0000 7fbe09104640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbe040ad010 con 0x7fbe040c3cd0 2024-04-26T23:41:01.797 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:01.791+0000 7fbe09104640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7fbe040c8ba0 con 0x7fbe040c4250 2024-04-26T23:41:01.797 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:01.791+0000 7fbe09104640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7fbe04156e50 con 0x7fbe040acc30 2024-04-26T23:41:01.797 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:01.791+0000 7fbe0259c640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fbe040c4250 0x7fbe040c3790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:01.797 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:01.791+0000 7fbe0259c640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fbe040c4250 0x7fbe040c3790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:48634/0 (socket says 172.21.15.88:48634) 2024-04-26T23:41:01.797 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:01.791+0000 7fbe0259c640 1 -- 172.21.15.88:0/1865648737 learned_addr learned my addr 172.21.15.88:0/1865648737 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:41:01.797 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:01.791+0000 7fbe02d9d640 1 --2- 172.21.15.88:0/1865648737 >> v2:172.21.15.175:3300/0 conn(0x7fbe040acc30 0x7fbe0415abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:01.797 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:01.791+0000 7fbe0259c640 1 -- 172.21.15.88:0/1865648737 >> v2:172.21.15.175:3300/0 conn(0x7fbe040acc30 msgr2=0x7fbe0415abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:41:01.797 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:01.791+0000 7fbe0259c640 1 --2- 172.21.15.88:0/1865648737 >> v2:172.21.15.175:3300/0 conn(0x7fbe040acc30 0x7fbe0415abf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:01.797 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:01.791+0000 7fbe0259c640 1 -- 172.21.15.88:0/1865648737 >> v1:172.21.15.175:6789/0 conn(0x7fbe040c3cd0 legacy=0x7fbe041572e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:41:01.798 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:01.791+0000 7fbe0259c640 1 -- 172.21.15.88:0/1865648737 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe0415b130 con 0x7fbe040c4250 2024-04-26T23:41:01.798 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:01.792+0000 7fbe0259c640 1 --2- 172.21.15.88:0/1865648737 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbe040c4250 0x7fbe040c3790 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fbe04074860 tx=0x7fbdf802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36c064b54726b86d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:01.798 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:01.792+0000 7fbe01d9b640 1 -- 172.21.15.88:0/1865648737 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdf8037070 con 0x7fbe040c4250 2024-04-26T23:41:01.798 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:01.792+0000 7fbe01d9b640 1 -- 172.21.15.88:0/1865648737 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbdf8032440 con 0x7fbe040c4250 2024-04-26T23:41:01.798 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:01.792+0000 7fbe01d9b640 1 -- 172.21.15.88:0/1865648737 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdf8032810 con 0x7fbe040c4250 2024-04-26T23:41:01.798 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:01.793+0000 7fbe09104640 1 -- 172.21.15.88:0/1865648737 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbe040c4250 msgr2=0x7fbe040c3790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:01.798 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:01.793+0000 7fbe09104640 1 --2- 172.21.15.88:0/1865648737 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbe040c4250 0x7fbe040c3790 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fbe04074860 tx=0x7fbdf802a1a0 comp rx=0 tx=0).stop 2024-04-26T23:41:01.798 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:01.793+0000 7fbe09104640 1 -- 172.21.15.88:0/1865648737 shutdown_connections 2024-04-26T23:41:01.798 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:01.793+0000 7fbe09104640 1 --2- 172.21.15.88:0/1865648737 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbe040c4250 0x7fbe040c3790 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:01.798 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:01.793+0000 7fbe09104640 1 --2- 172.21.15.88:0/1865648737 >> v2:172.21.15.175:3300/0 conn(0x7fbe040acc30 0x7fbe0415abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:01.798 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:01.793+0000 7fbe09104640 1 -- 172.21.15.88:0/1865648737 >> 172.21.15.88:0/1865648737 conn(0x7fbe040c6e60 msgr2=0x7fbe040c7270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:01.798 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:01.793+0000 7fbe09104640 1 -- 172.21.15.88:0/1865648737 shutdown_connections 2024-04-26T23:41:01.798 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:01.793+0000 7fbe09104640 1 -- 172.21.15.88:0/1865648737 wait complete. 2024-04-26T23:41:01.801 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:01.794+0000 7fbe09104640 1 Processor -- start 2024-04-26T23:41:01.801 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:01.794+0000 7fbe09104640 1 -- start start 2024-04-26T23:41:01.801 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:01.795+0000 7fbe09104640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbe040acc30 0x7fbe040ae4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:01.801 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:01.795+0000 7fbe09104640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbe040c3cd0 0x7fbe0414c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:01.801 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:01.795+0000 7fbe09104640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbe040c4250 0x7fbe0414c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:01.801 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:01.795+0000 7fbe09104640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fbe040c88c0 con 0x7fbe040c3cd0 2024-04-26T23:41:01.801 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:01.795+0000 7fbe09104640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fbe040c85e0 con 0x7fbe040acc30 2024-04-26T23:41:01.801 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:01.795+0000 7fbe09104640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fbe040abec0 con 0x7fbe040c4250 2024-04-26T23:41:01.801 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:01.795+0000 7fbe0259c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbe040c3cd0 0x7fbe0414c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:01.802 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:01.795+0000 7fbe0259c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbe040c3cd0 0x7fbe0414c170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:48642/0 (socket says 172.21.15.88:48642) 2024-04-26T23:41:01.802 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:01.795+0000 7fbe0259c640 1 -- 172.21.15.88:0/3151622491 learned_addr learned my addr 172.21.15.88:0/3151622491 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:41:01.802 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:01.795+0000 7fbe02d9d640 1 --2- 172.21.15.88:0/3151622491 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbe040acc30 0x7fbe040ae4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:01.802 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:01.795+0000 7fbe0359e640 1 --2- 172.21.15.88:0/3151622491 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbe040c4250 0x7fbe0414c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:01.802 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:01.795+0000 7fbe0259c640 1 -- 172.21.15.88:0/3151622491 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbe040c4250 msgr2=0x7fbe0414c6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:01.802 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:01.795+0000 7fbe0259c640 1 --2- 172.21.15.88:0/3151622491 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbe040c4250 0x7fbe0414c6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:01.802 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:01.795+0000 7fbe0259c640 1 -- 172.21.15.88:0/3151622491 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbe040acc30 msgr2=0x7fbe040ae4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:01.802 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:01.795+0000 7fbe0259c640 1 --2- 172.21.15.88:0/3151622491 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbe040acc30 0x7fbe040ae4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:01.802 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:01.795+0000 7fbe0259c640 1 -- 172.21.15.88:0/3151622491 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe041ed370 con 0x7fbe040c3cd0 2024-04-26T23:41:01.802 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:01.796+0000 7fbe0259c640 1 --2- 172.21.15.88:0/3151622491 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbe040c3cd0 0x7fbe0414c170 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fbdf8000c00 tx=0x7fbdf80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:01.802 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:01.796+0000 7fbdeb7fe640 1 -- 172.21.15.88:0/3151622491 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdf8041020 con 0x7fbe040c3cd0 2024-04-26T23:41:01.802 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:01.796+0000 7fbdeb7fe640 1 -- 172.21.15.88:0/3151622491 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbdf8030970 con 0x7fbe040c3cd0 2024-04-26T23:41:01.802 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:01.796+0000 7fbe09104640 1 -- 172.21.15.88:0/3151622491 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe041ed610 con 0x7fbe040c3cd0 2024-04-26T23:41:01.802 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:01.796+0000 7fbdeb7fe640 1 -- 172.21.15.88:0/3151622491 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdf8037040 con 0x7fbe040c3cd0 2024-04-26T23:41:01.803 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:01.796+0000 7fbe09104640 1 -- 172.21.15.88:0/3151622491 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe040ae9e0 con 0x7fbe040c3cd0 2024-04-26T23:41:01.803 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:01.797+0000 7fbe09104640 1 -- 172.21.15.88:0/3151622491 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe040507a0 con 0x7fbe040c3cd0 2024-04-26T23:41:01.803 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:01.797+0000 7fbdeb7fe640 1 -- 172.21.15.88:0/3151622491 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fbdf8044020 con 0x7fbe040c3cd0 2024-04-26T23:41:01.803 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:01.798+0000 7fbdeb7fe640 1 --2- 172.21.15.88:0/3151622491 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fbdf006c8f0 0x7fbdf006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:01.803 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:01.798+0000 7fbdeb7fe640 1 -- 172.21.15.88:0/3151622491 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7fbdf80ac860 con 0x7fbe040c3cd0 2024-04-26T23:41:01.803 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:01.798+0000 7fbe02d9d640 1 --2- 172.21.15.88:0/3151622491 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fbdf006c8f0 0x7fbdf006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:01.804 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:01.798+0000 7fbe02d9d640 1 --2- 172.21.15.88:0/3151622491 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fbdf006c8f0 0x7fbdf006edb0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fbe0414f060 tx=0x7fbdf40079a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:01.806 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:01.802+0000 7fbdeb7fe640 1 -- 172.21.15.88:0/3151622491 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fbdf804b030 con 0x7fbe040c3cd0 2024-04-26T23:41:02.021 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:02.017+0000 7fbe09104640 1 -- 172.21.15.88:0/3151622491 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fbe040c46f0 con 0x7fbe040c3cd0 2024-04-26T23:41:02.021 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:02.017+0000 7fbdeb7fe640 1 -- 172.21.15.88:0/3151622491 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v12) ==== 53+0+116 (secure 0 0 0) 0x7fbdf807a9f0 con 0x7fbe040c3cd0 2024-04-26T23:41:02.022 INFO:teuthology.orchestra.run.smithi088.stdout:name: a, metadata pool: a_metadata, data pools: [a_data ] 2024-04-26T23:41:02.022 INFO:teuthology.orchestra.run.smithi088.stdout:name: b, metadata pool: b_metadata, data pools: [b_data ] 2024-04-26T23:41:02.023 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:02.019+0000 7fbe09104640 1 -- 172.21.15.88:0/3151622491 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fbdf006c8f0 msgr2=0x7fbdf006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:02.023 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:02.019+0000 7fbe09104640 1 --2- 172.21.15.88:0/3151622491 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fbdf006c8f0 0x7fbdf006edb0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fbe0414f060 tx=0x7fbdf40079a0 comp rx=0 tx=0).stop 2024-04-26T23:41:02.024 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:02.019+0000 7fbe09104640 1 -- 172.21.15.88:0/3151622491 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbe040c3cd0 msgr2=0x7fbe0414c170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:02.024 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:02.019+0000 7fbe09104640 1 --2- 172.21.15.88:0/3151622491 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbe040c3cd0 0x7fbe0414c170 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fbdf8000c00 tx=0x7fbdf80046c0 comp rx=0 tx=0).stop 2024-04-26T23:41:02.024 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:02.019+0000 7fbe09104640 1 -- 172.21.15.88:0/3151622491 shutdown_connections 2024-04-26T23:41:02.024 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:02.019+0000 7fbe09104640 1 --2- 172.21.15.88:0/3151622491 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fbdf006c8f0 0x7fbdf006edb0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:02.024 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:02.019+0000 7fbe09104640 1 --2- 172.21.15.88:0/3151622491 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbe040c4250 0x7fbe0414c6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:02.024 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:02.019+0000 7fbe09104640 1 --2- 172.21.15.88:0/3151622491 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbe040c3cd0 0x7fbe0414c170 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:02.024 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:02.019+0000 7fbe09104640 1 --2- 172.21.15.88:0/3151622491 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbe040acc30 0x7fbe040ae4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:02.024 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:02.019+0000 7fbe09104640 1 -- 172.21.15.88:0/3151622491 >> 172.21.15.88:0/3151622491 conn(0x7fbe040c6e60 msgr2=0x7fbe040c57f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:02.024 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:02.019+0000 7fbe09104640 1 -- 172.21.15.88:0/3151622491 shutdown_connections 2024-04-26T23:41:02.024 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:02.019+0000 7fbe09104640 1 -- 172.21.15.88:0/3151622491 wait complete. 2024-04-26T23:41:02.034 INFO:tasks.cephfs.mount:Mounting Ceph FS b; just confirmed its presence on cluster 2024-04-26T23:41:02.034 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-26T23:41:02.034 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi175.front.sepia.ceph.com 2024-04-26T23:41:02.034 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-04-26T23:41:02.034 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-04-26T23:41:02.034 INFO:tasks.cephfs.mount:self.cephfs_name = b 2024-04-26T23:41:02.035 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-26T23:41:02.035 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-26T23:41:02.035 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-04-26T23:41:02.035 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:41:02.035 DEBUG:teuthology.orchestra.run.smithi175:> ip addr 2024-04-26T23:41:02.053 INFO:teuthology.orchestra.run.smithi175.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-26T23:41:02.054 INFO:teuthology.orchestra.run.smithi175.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-26T23:41:02.054 INFO:teuthology.orchestra.run.smithi175.stdout: inet 127.0.0.1/8 scope host lo 2024-04-26T23:41:02.054 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:41:02.054 INFO:teuthology.orchestra.run.smithi175.stdout: inet6 ::1/128 scope host 2024-04-26T23:41:02.054 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:41:02.054 INFO:teuthology.orchestra.run.smithi175.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-26T23:41:02.054 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether 0c:c4:7a:d9:39:ee brd ff:ff:ff:ff:ff:ff 2024-04-26T23:41:02.054 INFO:teuthology.orchestra.run.smithi175.stdout: altname enp7s0f0 2024-04-26T23:41:02.054 INFO:teuthology.orchestra.run.smithi175.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-26T23:41:02.054 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether 0c:c4:7a:d9:39:ef brd ff:ff:ff:ff:ff:ff 2024-04-26T23:41:02.054 INFO:teuthology.orchestra.run.smithi175.stdout: altname enp7s0f1 2024-04-26T23:41:02.055 INFO:teuthology.orchestra.run.smithi175.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-26T23:41:02.055 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether 0c:c4:7a:88:71:f0 brd ff:ff:ff:ff:ff:ff 2024-04-26T23:41:02.055 INFO:teuthology.orchestra.run.smithi175.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-26T23:41:02.055 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether 0c:c4:7a:88:71:f1 brd ff:ff:ff:ff:ff:ff 2024-04-26T23:41:02.055 INFO:teuthology.orchestra.run.smithi175.stdout: inet 172.21.15.175/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-04-26T23:41:02.055 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft 42719sec preferred_lft 42719sec 2024-04-26T23:41:02.055 INFO:teuthology.orchestra.run.smithi175.stdout: inet6 fe80::fe18:ebe5:8304:230a/64 scope link noprefixroute 2024-04-26T23:41:02.055 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:41:02.055 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-26T23:41:02.055 DEBUG:teuthology.orchestra.run.smithi175:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T23:41:02.056 DEBUG:teuthology.orchestra.run.smithi175:> set -e 2024-04-26T23:41:02.056 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip link add name ceph-brx type bridge 2024-04-26T23:41:02.056 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip addr flush dev ceph-brx 2024-04-26T23:41:02.056 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip link set ceph-brx up 2024-04-26T23:41:02.056 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-26T23:41:02.056 DEBUG:teuthology.orchestra.run.smithi175:> ') 2024-04-26T23:41:02.149 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:41:02 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T23:41:02.303 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:41:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T23:41:02.310 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:41:02.310 DEBUG:teuthology.orchestra.run.smithi175:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-26T23:41:02.335 INFO:teuthology.orchestra.run.smithi175.stdout:1 2024-04-26T23:41:02.336 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:41:02.336 DEBUG:teuthology.orchestra.run.smithi175:> route 2024-04-26T23:41:02.408 INFO:teuthology.orchestra.run.smithi175.stdout:Kernel IP routing table 2024-04-26T23:41:02.408 INFO:teuthology.orchestra.run.smithi175.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-26T23:41:02.408 INFO:teuthology.orchestra.run.smithi175.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-26T23:41:02.408 INFO:teuthology.orchestra.run.smithi175.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-26T23:41:02.408 INFO:teuthology.orchestra.run.smithi175.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-26T23:41:02.409 DEBUG:teuthology.orchestra.run.smithi175:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T23:41:02.409 DEBUG:teuthology.orchestra.run.smithi175:> set -e 2024-04-26T23:41:02.409 DEBUG:teuthology.orchestra.run.smithi175:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-26T23:41:02.409 DEBUG:teuthology.orchestra.run.smithi175:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-26T23:41:02.409 DEBUG:teuthology.orchestra.run.smithi175:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-26T23:41:02.409 DEBUG:teuthology.orchestra.run.smithi175:> ') 2024-04-26T23:41:02.496 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:41:02 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T23:41:02.647 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:41:02.650 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:41:02.691 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:41:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T23:41:02.699 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:41:02.700 DEBUG:teuthology.orchestra.run.smithi175:> ip netns list 2024-04-26T23:41:02.756 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:41:02.756 DEBUG:teuthology.orchestra.run.smithi175:> ip netns list-id 2024-04-26T23:41:02.811 DEBUG:teuthology.orchestra.run.smithi175:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T23:41:02.811 DEBUG:teuthology.orchestra.run.smithi175:> set -e 2024-04-26T23:41:02.811 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-26T23:41:02.811 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-04-26T23:41:02.811 DEBUG:teuthology.orchestra.run.smithi175:> ') 2024-04-26T23:41:02.899 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:41:02 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T23:41:02.921 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:41:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T23:41:02.927 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-04-26T23:41:02.928 DEBUG:teuthology.orchestra.run.smithi175:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T23:41:02.928 DEBUG:teuthology.orchestra.run.smithi175:> set -e 2024-04-26T23:41:02.928 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-04-26T23:41:02.928 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-26T23:41:02.928 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-04-26T23:41:02.928 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-04-26T23:41:02.928 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-04-26T23:41:02.928 DEBUG:teuthology.orchestra.run.smithi175:> ') 2024-04-26T23:41:02.977 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:41:02 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T23:41:03.044 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:41:03 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T23:41:03.050 DEBUG:teuthology.orchestra.run.smithi175:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T23:41:03.050 DEBUG:teuthology.orchestra.run.smithi175:> set -e 2024-04-26T23:41:03.050 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip link set brx.0 up 2024-04-26T23:41:03.050 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip link set dev brx.0 master ceph-brx 2024-04-26T23:41:03.051 DEBUG:teuthology.orchestra.run.smithi175:> ') 2024-04-26T23:41:03.098 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:41:03 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T23:41:03.119 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:41:03 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T23:41:03.125 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-26T23:41:03.125 DEBUG:teuthology.orchestra.run.smithi175:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-04-26T23:41:03.140 INFO:teuthology.orchestra.run.smithi175.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-04-26T23:41:03.140 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-26T23:41:03.140 DEBUG:teuthology.orchestra.run.smithi175:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-04-26T23:41:03.194 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.b=/ 2024-04-26T23:41:03.194 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:41:03.195 DEBUG:teuthology.orchestra.run.smithi175:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.b=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-26T23:41:03.290 INFO:teuthology.orchestra.run.smithi175.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-26T23:41:03.291 INFO:teuthology.orchestra.run.smithi175.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-26T23:41:03.405 INFO:teuthology.orchestra.run.smithi175.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-26T23:41:03.405 INFO:teuthology.orchestra.run.smithi175.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-26T23:41:03.405 INFO:teuthology.orchestra.run.smithi175.stdout:mount.ceph: resolved to: "172.21.15.88:3300,172.21.15.175:3300,172.21.15.175:3301" 2024-04-26T23:41:03.405 INFO:teuthology.orchestra.run.smithi175.stdout:mount.ceph: trying mount with new device syntax: 1@555255e9-7ef9-4454-8dc9-35e96b70035c.b=/ 2024-04-26T23:41:03.405 INFO:teuthology.orchestra.run.smithi175.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.88:3300/172.21.15.175:3300/172.21.15.175:3301" will pass to kernel 2024-04-26T23:41:03.405 INFO:teuthology.orchestra.run.smithi175.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-04-26T23:41:03.406 INFO:teuthology.orchestra.run.smithi175.stdout: You just mounted a file system that supports labels which does not 2024-04-26T23:41:03.406 INFO:teuthology.orchestra.run.smithi175.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-26T23:41:03.406 INFO:teuthology.orchestra.run.smithi175.stdout: applications will generate AVC messages and not be allowed access to 2024-04-26T23:41:03.406 INFO:teuthology.orchestra.run.smithi175.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-26T23:41:03.407 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-26T23:41:03.407 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:41:03.407 DEBUG:teuthology.orchestra.run.smithi175:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-04-26T23:41:03.431 DEBUG:teuthology.orchestra.run.smithi175:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-26T23:41:03.521 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:41:03 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-26T23:41:03.526 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:41:03 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T23:41:03.532 INFO:teuthology.orchestra.run.smithi175.stdout:client4601 2024-04-26T23:41:03.532 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-26T23:41:03.532 DEBUG:teuthology.orchestra.run.smithi175:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:41:03.548 DEBUG:teuthology.orchestra.run.smithi175:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-26T23:41:03.638 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:41:03 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-26T23:41:03.644 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:41:03 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T23:41:03.650 INFO:teuthology.orchestra.run.smithi175.stdout:client4601 2024-04-26T23:41:03.650 DEBUG:teuthology.orchestra.run.smithi175:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-26T23:41:03.699 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:41:03 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-26T23:41:03.705 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:41:03 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T23:41:03.710 INFO:teuthology.orchestra.run.smithi175.stdout:client4601 2024-04-26T23:41:03.711 DEBUG:teuthology.orchestra.run.smithi175:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/555255e9-7ef9-4454-8dc9-35e96b70035c.client4601/status') 2024-04-26T23:41:03.760 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:41:03 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T23:41:03.772 INFO:teuthology.orchestra.run.smithi175.stdout:instance: client.4601 (3)192.168.0.1:0/1138012809 2024-04-26T23:41:03.773 INFO:teuthology.orchestra.run.smithi175.stdout:blocklisted: false 2024-04-26T23:41:03.773 INFO:teuthology.orchestra.run.smithi175.stderr:0+1 records in 2024-04-26T23:41:03.773 INFO:teuthology.orchestra.run.smithi175.stderr:0+1 records out 2024-04-26T23:41:03.773 INFO:teuthology.orchestra.run.smithi175.stderr:69 bytes copied, 2.2025e-05 s, 3.1 MB/s 2024-04-26T23:41:03.773 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T23:41:03 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T23:41:03.780 INFO:teuthology.run_tasks:Running task mon_thrash... 2024-04-26T23:41:03.792 INFO:tasks.mon_thrash:Beginning mon_thrash... 2024-04-26T23:41:03.792 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T23:41:03.903 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:03.899+0000 7f9086a09640 1 Processor -- start 2024-04-26T23:41:03.903 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:03.899+0000 7f9086a09640 1 -- start start 2024-04-26T23:41:03.906 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:03.900+0000 7f9086a09640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f90801572e0 0x7f9080157770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:03.906 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:03.900+0000 7f9086a09640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f90800ad010 con 0x7f90800acc30 2024-04-26T23:41:03.906 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:03.900+0000 7f9086a09640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f90800c8300 con 0x7f90800c4250 2024-04-26T23:41:03.906 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:03.900+0000 7f9086a09640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f90800c8ba0 con 0x7f90801572e0 2024-04-26T23:41:03.907 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:03.900+0000 7f907ffff640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f90800acc30 0x7f908015abf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:51968/0 (socket says 172.21.15.88:51968) 2024-04-26T23:41:03.907 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:03.900+0000 7f907ffff640 1 -- 172.21.15.88:0/313129977 learned_addr learned my addr 172.21.15.88:0/313129977 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-26T23:41:03.907 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:03.900+0000 7f9084fa6640 1 --2- 172.21.15.88:0/313129977 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f90801572e0 0x7f9080157770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:03.907 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:03.900+0000 7f907effd640 1 -- 172.21.15.88:0/313129977 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1488253763 0 0) 0x7f90800ad010 con 0x7f90800acc30 2024-04-26T23:41:03.907 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:03.900+0000 7f907effd640 1 -- 172.21.15.88:0/313129977 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9068003520 con 0x7f90800acc30 2024-04-26T23:41:03.907 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:03.900+0000 7f907effd640 1 -- 172.21.15.88:0/313129977 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3027130349 0 0) 0x7f90800c8300 con 0x7f90800c4250 2024-04-26T23:41:03.907 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:03.900+0000 7f907effd640 1 -- 172.21.15.88:0/313129977 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f90800ad010 con 0x7f90800c4250 2024-04-26T23:41:03.907 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:03.900+0000 7f907effd640 1 -- 172.21.15.88:0/313129977 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3055790945 0 0) 0x7f9068003520 con 0x7f90800acc30 2024-04-26T23:41:03.907 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:03.900+0000 7f907effd640 1 -- 172.21.15.88:0/313129977 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f90801572e0 msgr2=0x7f9080157770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:41:03.907 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:03.900+0000 7f907effd640 1 --2- 172.21.15.88:0/313129977 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f90801572e0 0x7f9080157770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:03.907 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:03.900+0000 7f907effd640 1 -- 172.21.15.88:0/313129977 >> v1:172.21.15.175:6789/0 conn(0x7f90800c4250 legacy=0x7f90800c3790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:03.907 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:03.900+0000 7f907effd640 1 -- 172.21.15.88:0/313129977 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90800c85e0 con 0x7f90800acc30 2024-04-26T23:41:03.907 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:03.900+0000 7f907effd640 1 -- 172.21.15.88:0/313129977 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 356324787 0 0) 0x7f9074001670 con 0x7f90800acc30 2024-04-26T23:41:03.907 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:03.900+0000 7f9084fa6640 1 --2- 172.21.15.88:0/313129977 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f90801572e0 0x7f9080157770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:41:03.907 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:03.901+0000 7f907effd640 1 -- 172.21.15.88:0/313129977 >> v1:172.21.15.88:6789/0 conn(0x7f90800acc30 legacy=0x7f908015abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:03.907 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:03.901+0000 7f907effd640 1 --2- 172.21.15.88:0/313129977 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9068003b70 0x7f9068003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:03.908 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:03.901+0000 7f907effd640 1 --2- 172.21.15.88:0/313129977 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9068004800 0x7f9068004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:03.908 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:03.901+0000 7f907effd640 1 --2- 172.21.15.88:0/313129977 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f90801572e0 0x7f90680051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:03.908 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:03.901+0000 7f907effd640 1 -- 172.21.15.88:0/313129977 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f90800c8ba0 con 0x7f9068004800 2024-04-26T23:41:03.908 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:03.901+0000 7f907effd640 1 -- 172.21.15.88:0/313129977 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f906800baa0 con 0x7f9068003b70 2024-04-26T23:41:03.908 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:03.901+0000 7f907effd640 1 -- 172.21.15.88:0/313129977 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f906800bca0 con 0x7f90801572e0 2024-04-26T23:41:03.908 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:03.901+0000 7f907f7fe640 1 --2- 172.21.15.88:0/313129977 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9068004800 0x7f9068004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:03.908 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:03.901+0000 7f907ffff640 1 --2- 172.21.15.88:0/313129977 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9068003b70 0x7f9068003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:03.908 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:03.901+0000 7f9084fa6640 1 --2- 172.21.15.88:0/313129977 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f90801572e0 0x7f90680051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:03.908 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:03.901+0000 7f907f7fe640 1 -- 172.21.15.88:0/313129977 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f90801572e0 msgr2=0x7f90680051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:41:03.908 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:03.901+0000 7f907f7fe640 1 --2- 172.21.15.88:0/313129977 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f90801572e0 0x7f90680051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:03.908 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:03.901+0000 7f907f7fe640 1 -- 172.21.15.88:0/313129977 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9068003b70 msgr2=0x7f9068003f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:41:03.908 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:03.901+0000 7f907f7fe640 1 --2- 172.21.15.88:0/313129977 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9068003b70 0x7f9068003f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:03.908 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:03.901+0000 7f907f7fe640 1 -- 172.21.15.88:0/313129977 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9068003520 con 0x7f9068004800 2024-04-26T23:41:03.908 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:03.901+0000 7f907ffff640 1 --2- 172.21.15.88:0/313129977 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9068003b70 0x7f9068003f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:41:03.908 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:03.902+0000 7f907f7fe640 1 --2- 172.21.15.88:0/313129977 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9068004800 0x7f9068004c80 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f90800c4690 tx=0x7f9068005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5505b19c7d89ca8c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:03.908 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:03.902+0000 7f907effd640 1 -- 172.21.15.88:0/313129977 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90700014f0 con 0x7f9068004800 2024-04-26T23:41:03.909 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:03.902+0000 7f907effd640 1 -- 172.21.15.88:0/313129977 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90700052d0 con 0x7f9068004800 2024-04-26T23:41:03.909 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:03.902+0000 7f907effd640 1 -- 172.21.15.88:0/313129977 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f907002ac00 con 0x7f9068004800 2024-04-26T23:41:03.909 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:03.902+0000 7f9086a09640 1 -- 172.21.15.88:0/313129977 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9068004800 msgr2=0x7f9068004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:03.909 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:03.902+0000 7f9086a09640 1 --2- 172.21.15.88:0/313129977 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9068004800 0x7f9068004c80 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f90800c4690 tx=0x7f9068005830 comp rx=0 tx=0).stop 2024-04-26T23:41:03.909 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:03.902+0000 7f9084fa6640 1 -- 172.21.15.88:0/313129977 reap_dead start 2024-04-26T23:41:03.909 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:03.902+0000 7f9086a09640 1 -- 172.21.15.88:0/313129977 shutdown_connections 2024-04-26T23:41:03.909 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:03.902+0000 7f9086a09640 1 -- 172.21.15.88:0/313129977 >> 172.21.15.88:0/313129977 conn(0x7f90800c6e60 msgr2=0x7f90800c7270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:03.909 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:03.903+0000 7f9086a09640 1 -- 172.21.15.88:0/313129977 shutdown_connections 2024-04-26T23:41:03.909 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:03.903+0000 7f9086a09640 1 -- 172.21.15.88:0/313129977 wait complete. 2024-04-26T23:41:03.911 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:03.904+0000 7f9086a09640 1 Processor -- start 2024-04-26T23:41:03.911 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:03.904+0000 7f9086a09640 1 -- start start 2024-04-26T23:41:03.911 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:03.905+0000 7f9086a09640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9068004800 0x7f9080149e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:03.912 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:03.905+0000 7f9086a09640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f908014b730 0x7f90800c6240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:03.912 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:03.905+0000 7f9086a09640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f90801ed9c0 0x7f90801eccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:03.912 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:03.905+0000 7f9086a09640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f90800c3ea0 con 0x7f9068004800 2024-04-26T23:41:03.912 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:03.905+0000 7f9086a09640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f9080156e50 con 0x7f908014b730 2024-04-26T23:41:03.912 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:03.905+0000 7f9086a09640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f90800c4020 con 0x7f90801ed9c0 2024-04-26T23:41:03.912 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:03.905+0000 7f907ffff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9068004800 0x7f9080149e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:03.912 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:03.905+0000 7f907ffff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9068004800 0x7f9080149e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:48666/0 (socket says 172.21.15.88:48666) 2024-04-26T23:41:03.912 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:03.905+0000 7f907ffff640 1 -- 172.21.15.88:0/1393282464 learned_addr learned my addr 172.21.15.88:0/1393282464 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:41:03.912 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:03.905+0000 7f907f7fe640 1 --2- 172.21.15.88:0/1393282464 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f908014b730 0x7f90800c6240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:03.912 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:03.905+0000 7f9084fa6640 1 --2- 172.21.15.88:0/1393282464 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f90801ed9c0 0x7f90801eccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:03.912 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:03.905+0000 7f907ffff640 1 -- 172.21.15.88:0/1393282464 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f90801ed9c0 msgr2=0x7f90801eccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:03.912 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:03.905+0000 7f907ffff640 1 --2- 172.21.15.88:0/1393282464 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f90801ed9c0 0x7f90801eccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:03.912 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:03.905+0000 7f907ffff640 1 -- 172.21.15.88:0/1393282464 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f908014b730 msgr2=0x7f90800c6240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:03.912 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:03.905+0000 7f907ffff640 1 --2- 172.21.15.88:0/1393282464 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f908014b730 0x7f90800c6240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:03.912 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:03.905+0000 7f907ffff640 1 -- 172.21.15.88:0/1393282464 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90801ec4d0 con 0x7f9068004800 2024-04-26T23:41:03.913 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:03.905+0000 7f9084fa6640 1 --2- 172.21.15.88:0/1393282464 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f90801ed9c0 0x7f90801eccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:41:03.913 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:03.905+0000 7f907ffff640 1 --2- 172.21.15.88:0/1393282464 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9068004800 0x7f9080149e10 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f9074007290 tx=0x7f9074007750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:03.913 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:03.905+0000 7f907cff9640 1 -- 172.21.15.88:0/1393282464 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f907400f9c0 con 0x7f9068004800 2024-04-26T23:41:03.913 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:03.905+0000 7f907cff9640 1 -- 172.21.15.88:0/1393282464 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9074018070 con 0x7f9068004800 2024-04-26T23:41:03.913 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:03.905+0000 7f9086a09640 1 -- 172.21.15.88:0/1393282464 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f908014bc80 con 0x7f9068004800 2024-04-26T23:41:03.913 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:03.905+0000 7f907cff9640 1 -- 172.21.15.88:0/1393282464 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f907400fd60 con 0x7f9068004800 2024-04-26T23:41:03.913 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:03.905+0000 7f9086a09640 1 -- 172.21.15.88:0/1393282464 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f908014c240 con 0x7f9068004800 2024-04-26T23:41:03.913 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:03.906+0000 7f9086a09640 1 -- 172.21.15.88:0/1393282464 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f90800507a0 con 0x7f9068004800 2024-04-26T23:41:03.913 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:03.907+0000 7f907cff9640 1 -- 172.21.15.88:0/1393282464 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f907401d460 con 0x7f9068004800 2024-04-26T23:41:03.913 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:03.907+0000 7f907cff9640 1 --2- 172.21.15.88:0/1393282464 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f906c06c8f0 0x7f906c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:03.913 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:03.907+0000 7f907cff9640 1 -- 172.21.15.88:0/1393282464 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7f907408bee0 con 0x7f9068004800 2024-04-26T23:41:03.913 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:03.907+0000 7f907f7fe640 1 --2- 172.21.15.88:0/1393282464 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f906c06c8f0 0x7f906c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:03.913 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:03.908+0000 7f907f7fe640 1 --2- 172.21.15.88:0/1393282464 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f906c06c8f0 0x7f906c06edb0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f9070032000 tx=0x7f9070009030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:03.915 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:03.912+0000 7f907cff9640 1 -- 172.21.15.88:0/1393282464 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f9074059fe0 con 0x7f9068004800 2024-04-26T23:41:04.093 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:04.091+0000 7f9086a09640 1 -- 172.21.15.88:0/1393282464 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f90800c46f0 con 0x7f9068004800 2024-04-26T23:41:04.095 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:04.091+0000 7f907cff9640 1 -- 172.21.15.88:0/1393282464 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+20343 (secure 0 0 0) 0x7f907405ee20 con 0x7f9068004800 2024-04-26T23:41:04.095 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-26T23:41:04.095 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":24,"fsid":"555255e9-7ef9-4454-8dc9-35e96b70035c","created":"2024-04-26T23:40:07.836009+0000","modified":"2024-04-26T23:40:42.673801+0000","last_up_change":"2024-04-26T23:40:18.831369+0000","last_in_change":"2024-04-26T23:40:09.944777+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T23:40:19.936127+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"a_metadata","create_time":"2024-04-26T23:40:29.837465+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"a_data","create_time":"2024-04-26T23:40:30.868651+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"b_metadata","create_time":"2024-04-26T23:40:38.753441+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"b_data","create_time":"2024-04-26T23:40:39.974557+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"92aecea3-ed62-4a29-87c0-76758a0816a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":2803186054},{"type":"v1","addr":"172.21.15.88:6801","nonce":2803186054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":2803186054},{"type":"v1","addr":"172.21.15.88:6803","nonce":2803186054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":2803186054},{"type":"v1","addr":"172.21.15.88:6807","nonce":2803186054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":2803186054},{"type":"v1","addr":"172.21.15.88:6805","nonce":2803186054}]},"public_addr":"172.21.15.88:6801/2803186054","cluster_addr":"172.21.15.88:6803/2803186054","heartbeat_back_addr":"172.21.15.88:6807/2803186054","heartbeat_front_addr":"172.21.15.88:6805/2803186054","state":["exists","up"]},{"osd":1,"uuid":"7a6f0fa9-23d0-4747-880f-798d45ec5eeb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":1897380484},{"type":"v1","addr":"172.21.15.88:6817","nonce":1897380484}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":1897380484},{"type":"v1","addr":"172.21.15.88:6819","nonce":1897380484}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1897380484},{"type":"v1","addr":"172.21.15.88:6823","nonce":1897380484}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":1897380484},{"type":"v1","addr":"172.21.15.88:6821","nonce":1897380484}]},"public_addr":"172.21.15.88:6817/1897380484","cluster_addr":"172.21.15.88:6819/1897380484","heartbeat_back_addr":"172.21.15.88:6823/1897380484","heartbeat_front_addr":"172.21.15.88:6821/1897380484","state":["exists","up"]},{"osd":2,"uuid":"6be88ea0-e133-4200-a4b5-f92d664b248a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":648396269},{"type":"v1","addr":"172.21.15.88:6809","nonce":648396269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":648396269},{"type":"v1","addr":"172.21.15.88:6811","nonce":648396269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":648396269},{"type":"v1","addr":"172.21.15.88:6815","nonce":648396269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":648396269},{"type":"v1","addr":"172.21.15.88:6813","nonce":648396269}]},"public_addr":"172.21.15.88:6809/648396269","cluster_addr":"172.21.15.88:6811/648396269","heartbeat_back_addr":"172.21.15.88:6815/648396269","heartbeat_front_addr":"172.21.15.88:6813/648396269","state":["exists","up"]},{"osd":3,"uuid":"dcb0746b-7b3d-4ecf-8089-2493a5d1857c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":2328028922},{"type":"v1","addr":"172.21.15.88:6825","nonce":2328028922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":2328028922},{"type":"v1","addr":"172.21.15.88:6827","nonce":2328028922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":2328028922},{"type":"v1","addr":"172.21.15.88:6831","nonce":2328028922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":2328028922},{"type":"v1","addr":"172.21.15.88:6829","nonce":2328028922}]},"public_addr":"172.21.15.88:6825/2328028922","cluster_addr":"172.21.15.88:6827/2328028922","heartbeat_back_addr":"172.21.15.88:6831/2328028922","heartbeat_front_addr":"172.21.15.88:6829/2328028922","state":["exists","up"]},{"osd":4,"uuid":"c483de66-c44f-450e-a4ce-b132d50882c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":3929617402},{"type":"v1","addr":"172.21.15.175:6809","nonce":3929617402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":3929617402},{"type":"v1","addr":"172.21.15.175:6811","nonce":3929617402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":3929617402},{"type":"v1","addr":"172.21.15.175:6815","nonce":3929617402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":3929617402},{"type":"v1","addr":"172.21.15.175:6813","nonce":3929617402}]},"public_addr":"172.21.15.175:6809/3929617402","cluster_addr":"172.21.15.175:6811/3929617402","heartbeat_back_addr":"172.21.15.175:6815/3929617402","heartbeat_front_addr":"172.21.15.175:6813/3929617402","state":["exists","up"]},{"osd":5,"uuid":"ac3b1669-d228-40dd-9f9a-cb46aa73dd6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":2476644457},{"type":"v1","addr":"172.21.15.175:6801","nonce":2476644457}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":2476644457},{"type":"v1","addr":"172.21.15.175:6803","nonce":2476644457}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":2476644457},{"type":"v1","addr":"172.21.15.175:6807","nonce":2476644457}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":2476644457},{"type":"v1","addr":"172.21.15.175:6805","nonce":2476644457}]},"public_addr":"172.21.15.175:6801/2476644457","cluster_addr":"172.21.15.175:6803/2476644457","heartbeat_back_addr":"172.21.15.175:6807/2476644457","heartbeat_front_addr":"172.21.15.175:6805/2476644457","state":["exists","up"]},{"osd":6,"uuid":"7bef4896-857e-4c11-b3b2-c2e9a8548338","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":3824112919},{"type":"v1","addr":"172.21.15.175:6819","nonce":3824112919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6821","nonce":3824112919},{"type":"v1","addr":"172.21.15.175:6824","nonce":3824112919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":3824112919},{"type":"v1","addr":"172.21.15.175:6831","nonce":3824112919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":3824112919},{"type":"v1","addr":"172.21.15.175:6829","nonce":3824112919}]},"public_addr":"172.21.15.175:6819/3824112919","cluster_addr":"172.21.15.175:6824/3824112919","heartbeat_back_addr":"172.21.15.175:6831/3824112919","heartbeat_front_addr":"172.21.15.175:6829/3824112919","state":["exists","up"]},{"osd":7,"uuid":"e18d9e09-8673-470d-b9dc-280a409b63f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6817","nonce":3319361162},{"type":"v1","addr":"172.21.15.175:6818","nonce":3319361162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":3319361162},{"type":"v1","addr":"172.21.15.175:6822","nonce":3319361162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6827","nonce":3319361162},{"type":"v1","addr":"172.21.15.175:6828","nonce":3319361162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6823","nonce":3319361162},{"type":"v1","addr":"172.21.15.175:6825","nonce":3319361162}]},"public_addr":"172.21.15.175:6818/3319361162","cluster_addr":"172.21.15.175:6822/3319361162","heartbeat_back_addr":"172.21.15.175:6828/3319361162","heartbeat_front_addr":"172.21.15.175:6825/3319361162","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:40:15.126268+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:40:15.050614+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:40:14.995164+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:40:15.078112+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:40:15.159637+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:40:15.091226+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:40:15.140316+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:40:15.089431+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:41:04.097 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:04.093+0000 7f9086a09640 1 -- 172.21.15.88:0/1393282464 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f906c06c8f0 msgr2=0x7f906c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:04.098 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:04.093+0000 7f9086a09640 1 --2- 172.21.15.88:0/1393282464 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f906c06c8f0 0x7f906c06edb0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f9070032000 tx=0x7f9070009030 comp rx=0 tx=0).stop 2024-04-26T23:41:04.098 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:04.093+0000 7f9086a09640 1 -- 172.21.15.88:0/1393282464 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9068004800 msgr2=0x7f9080149e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:04.098 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:04.093+0000 7f9086a09640 1 --2- 172.21.15.88:0/1393282464 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9068004800 0x7f9080149e10 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f9074007290 tx=0x7f9074007750 comp rx=0 tx=0).stop 2024-04-26T23:41:04.098 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:04.093+0000 7f9086a09640 1 -- 172.21.15.88:0/1393282464 shutdown_connections 2024-04-26T23:41:04.098 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:04.093+0000 7f9086a09640 1 --2- 172.21.15.88:0/1393282464 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f906c06c8f0 0x7f906c06edb0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:04.098 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:04.093+0000 7f9086a09640 1 --2- 172.21.15.88:0/1393282464 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f90801ed9c0 0x7f90801eccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:04.098 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:04.093+0000 7f9086a09640 1 --2- 172.21.15.88:0/1393282464 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f908014b730 0x7f90800c6240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:04.098 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:04.093+0000 7f9086a09640 1 --2- 172.21.15.88:0/1393282464 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9068004800 0x7f9080149e10 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:04.098 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:04.093+0000 7f9086a09640 1 -- 172.21.15.88:0/1393282464 >> 172.21.15.88:0/1393282464 conn(0x7f90800c6e60 msgr2=0x7f9080151f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:04.098 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:04.093+0000 7f9086a09640 1 -- 172.21.15.88:0/1393282464 shutdown_connections 2024-04-26T23:41:04.098 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:04.093+0000 7f9086a09640 1 -- 172.21.15.88:0/1393282464 wait complete. 2024-04-26T23:41:04.108 INFO:tasks.mon_thrash.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T23:40:19.936127+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'a_metadata', 'create_time': '2024-04-26T23:40:29.837465+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'a'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'a_data', 'create_time': '2024-04-26T23:40:30.868651+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'a'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'b_metadata', 'create_time': '2024-04-26T23:40:38.753441+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'b'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'b_data', 'create_time': '2024-04-26T23:40:39.974557+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'b'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T23:41:04.108 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T23:41:04.208 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:04.204+0000 7f0d051e4640 1 Processor -- start 2024-04-26T23:41:04.208 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:04.204+0000 7f0d051e4640 1 -- start start 2024-04-26T23:41:04.209 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:04.205+0000 7f0d051e4640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f0d0006d590 0x7f0d00158d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:04.209 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:04.205+0000 7f0d051e4640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f0d00070120 0x7f0d000aea30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:04.209 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:04.205+0000 7f0d051e4640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0d000af3b0 con 0x7f0d000aef70 2024-04-26T23:41:04.209 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:04.205+0000 7f0d051e4640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f0d001559e0 con 0x7f0d00070120 2024-04-26T23:41:04.209 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:04.205+0000 7f0d051e4640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f0d00154e10 con 0x7f0d0006d590 2024-04-26T23:41:04.209 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:04.205+0000 7f0cf7fff640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f0d00070120 0x7f0d000aea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:04.210 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:04.205+0000 7f0cf7fff640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f0d00070120 0x7f0d000aea30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:48674/0 (socket says 172.21.15.88:48674) 2024-04-26T23:41:04.210 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:04.205+0000 7f0cf7fff640 1 -- 172.21.15.88:0/1051592824 learned_addr learned my addr 172.21.15.88:0/1051592824 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:41:04.210 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:04.205+0000 7f0cfed9d640 1 --2- 172.21.15.88:0/1051592824 >> v2:172.21.15.175:3300/0 conn(0x7f0d0006d590 0x7f0d00158d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:04.210 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:04.205+0000 7f0cf7fff640 1 -- 172.21.15.88:0/1051592824 >> v2:172.21.15.175:3300/0 conn(0x7f0d0006d590 msgr2=0x7f0d00158d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:41:04.210 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:04.205+0000 7f0cf7fff640 1 --2- 172.21.15.88:0/1051592824 >> v2:172.21.15.175:3300/0 conn(0x7f0d0006d590 0x7f0d00158d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:04.210 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:04.205+0000 7f0cf7fff640 1 -- 172.21.15.88:0/1051592824 >> v1:172.21.15.175:6789/0 conn(0x7f0d000aef70 legacy=0x7f0d000c3be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:41:04.210 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:04.205+0000 7f0cf7fff640 1 -- 172.21.15.88:0/1051592824 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d00159240 con 0x7f0d00070120 2024-04-26T23:41:04.211 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:04.206+0000 7f0cf7fff640 1 --2- 172.21.15.88:0/1051592824 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0d00070120 0x7f0d000aea30 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f0d000c6b90 tx=0x7f0ce802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9017a589c0c6839 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:04.211 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:04.206+0000 7f0cfe59c640 1 -- 172.21.15.88:0/1051592824 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ce8037070 con 0x7f0d00070120 2024-04-26T23:41:04.211 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:04.206+0000 7f0cfe59c640 1 -- 172.21.15.88:0/1051592824 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ce8032440 con 0x7f0d00070120 2024-04-26T23:41:04.211 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:04.206+0000 7f0cfe59c640 1 -- 172.21.15.88:0/1051592824 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ce8032810 con 0x7f0d00070120 2024-04-26T23:41:04.211 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:04.206+0000 7f0d051e4640 1 -- 172.21.15.88:0/1051592824 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0d00070120 msgr2=0x7f0d000aea30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:04.212 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:04.206+0000 7f0d051e4640 1 --2- 172.21.15.88:0/1051592824 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0d00070120 0x7f0d000aea30 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f0d000c6b90 tx=0x7f0ce802a1a0 comp rx=0 tx=0).stop 2024-04-26T23:41:04.212 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:04.206+0000 7f0d051e4640 1 -- 172.21.15.88:0/1051592824 shutdown_connections 2024-04-26T23:41:04.212 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:04.206+0000 7f0d051e4640 1 --2- 172.21.15.88:0/1051592824 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0d00070120 0x7f0d000aea30 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:04.212 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:04.206+0000 7f0d051e4640 1 --2- 172.21.15.88:0/1051592824 >> v2:172.21.15.175:3300/0 conn(0x7f0d0006d590 0x7f0d00158d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:04.212 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:04.206+0000 7f0d051e4640 1 -- 172.21.15.88:0/1051592824 >> 172.21.15.88:0/1051592824 conn(0x7f0d000c5ce0 msgr2=0x7f0d000c60f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:04.212 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:04.206+0000 7f0d051e4640 1 -- 172.21.15.88:0/1051592824 shutdown_connections 2024-04-26T23:41:04.212 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:04.207+0000 7f0d051e4640 1 -- 172.21.15.88:0/1051592824 wait complete. 2024-04-26T23:41:04.212 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:04.208+0000 7f0d051e4640 1 Processor -- start 2024-04-26T23:41:04.212 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:04.208+0000 7f0d051e4640 1 -- start start 2024-04-26T23:41:04.214 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:04.208+0000 7f0d051e4640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0d0006d590 0x7f0d00158760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:04.215 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:04.208+0000 7f0d051e4640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0d00070120 0x7f0d001eaf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:04.215 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:04.208+0000 7f0d051e4640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0d000aef70 0x7f0d001eb4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:04.215 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:04.208+0000 7f0d051e4640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f0d00155670 con 0x7f0d0006d590 2024-04-26T23:41:04.215 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:04.208+0000 7f0d051e4640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f0d00155390 con 0x7f0d00070120 2024-04-26T23:41:04.215 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:04.208+0000 7f0d051e4640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f0d0006d970 con 0x7f0d000aef70 2024-04-26T23:41:04.215 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:04.208+0000 7f0cfed9d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0d0006d590 0x7f0d00158760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:04.215 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:04.208+0000 7f0cfed9d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0d0006d590 0x7f0d00158760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:48676/0 (socket says 172.21.15.88:48676) 2024-04-26T23:41:04.215 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:04.208+0000 7f0cfed9d640 1 -- 172.21.15.88:0/2855485180 learned_addr learned my addr 172.21.15.88:0/2855485180 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:41:04.215 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:04.209+0000 7f0cf7fff640 1 --2- 172.21.15.88:0/2855485180 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0d00070120 0x7f0d001eaf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:04.215 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:04.209+0000 7f0cff59e640 1 --2- 172.21.15.88:0/2855485180 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0d000aef70 0x7f0d001eb4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:04.215 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:04.209+0000 7f0cfed9d640 1 -- 172.21.15.88:0/2855485180 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0d000aef70 msgr2=0x7f0d001eb4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:04.215 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:04.209+0000 7f0cfed9d640 1 --2- 172.21.15.88:0/2855485180 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0d000aef70 0x7f0d001eb4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:04.215 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:04.209+0000 7f0cfed9d640 1 -- 172.21.15.88:0/2855485180 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0d00070120 msgr2=0x7f0d001eaf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:04.215 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:04.209+0000 7f0cfed9d640 1 --2- 172.21.15.88:0/2855485180 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0d00070120 0x7f0d001eaf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:04.216 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:04.209+0000 7f0cfed9d640 1 -- 172.21.15.88:0/2855485180 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d00156a30 con 0x7f0d0006d590 2024-04-26T23:41:04.216 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:04.209+0000 7f0cfed9d640 1 --2- 172.21.15.88:0/2855485180 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0d0006d590 0x7f0d00158760 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f0cf000c7f0 tx=0x7f0cf000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:04.216 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:04.209+0000 7f0cf77fe640 1 -- 172.21.15.88:0/2855485180 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cf0015070 con 0x7f0d0006d590 2024-04-26T23:41:04.216 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:04.209+0000 7f0cf77fe640 1 -- 172.21.15.88:0/2855485180 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0cf0004240 con 0x7f0d0006d590 2024-04-26T23:41:04.216 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:04.209+0000 7f0cf77fe640 1 -- 172.21.15.88:0/2855485180 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cf0007620 con 0x7f0d0006d590 2024-04-26T23:41:04.216 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:04.209+0000 7f0d051e4640 1 -- 172.21.15.88:0/2855485180 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d00156190 con 0x7f0d0006d590 2024-04-26T23:41:04.216 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:04.209+0000 7f0d051e4640 1 -- 172.21.15.88:0/2855485180 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d00156750 con 0x7f0d0006d590 2024-04-26T23:41:04.216 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:04.210+0000 7f0d051e4640 1 -- 172.21.15.88:0/2855485180 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d00068dc0 con 0x7f0d0006d590 2024-04-26T23:41:04.216 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:04.210+0000 7f0cf77fe640 1 -- 172.21.15.88:0/2855485180 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f0cf00079d0 con 0x7f0d0006d590 2024-04-26T23:41:04.216 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:04.211+0000 7f0cf77fe640 1 --2- 172.21.15.88:0/2855485180 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f0ce006c8f0 0x7f0ce006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:04.216 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:04.211+0000 7f0cf77fe640 1 -- 172.21.15.88:0/2855485180 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7f0cf008c200 con 0x7f0d0006d590 2024-04-26T23:41:04.216 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:04.211+0000 7f0cf7fff640 1 --2- 172.21.15.88:0/2855485180 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f0ce006c8f0 0x7f0ce006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:04.217 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:04.211+0000 7f0cf7fff640 1 --2- 172.21.15.88:0/2855485180 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f0ce006c8f0 0x7f0ce006edb0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f0ce8034000 tx=0x7f0ce802e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:04.219 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:04.216+0000 7f0cf77fe640 1 -- 172.21.15.88:0/2855485180 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f0cf005a390 con 0x7f0d0006d590 2024-04-26T23:41:04.395 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:04.391+0000 7f0d051e4640 1 -- 172.21.15.88:0/2855485180 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f0d000507a0 con 0x7f0d0006d590 2024-04-26T23:41:04.395 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:04.391+0000 7f0cf77fe640 1 -- 172.21.15.88:0/2855485180 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) ==== 93+0+10 (secure 0 0 0) 0x7f0cf0059c90 con 0x7f0d0006d590 2024-04-26T23:41:04.395 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 1 2024-04-26T23:41:04.397 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:04.393+0000 7f0d051e4640 1 -- 172.21.15.88:0/2855485180 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f0ce006c8f0 msgr2=0x7f0ce006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:04.397 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:04.393+0000 7f0d051e4640 1 --2- 172.21.15.88:0/2855485180 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f0ce006c8f0 0x7f0ce006edb0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f0ce8034000 tx=0x7f0ce802e000 comp rx=0 tx=0).stop 2024-04-26T23:41:04.397 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:04.393+0000 7f0d051e4640 1 -- 172.21.15.88:0/2855485180 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0d0006d590 msgr2=0x7f0d00158760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:04.397 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:04.393+0000 7f0d051e4640 1 --2- 172.21.15.88:0/2855485180 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0d0006d590 0x7f0d00158760 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f0cf000c7f0 tx=0x7f0cf000ccb0 comp rx=0 tx=0).stop 2024-04-26T23:41:04.397 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:04.393+0000 7f0d051e4640 1 -- 172.21.15.88:0/2855485180 shutdown_connections 2024-04-26T23:41:04.397 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:04.393+0000 7f0d051e4640 1 --2- 172.21.15.88:0/2855485180 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f0ce006c8f0 0x7f0ce006edb0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:04.398 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:04.393+0000 7f0d051e4640 1 --2- 172.21.15.88:0/2855485180 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0d000aef70 0x7f0d001eb4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:04.398 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:04.393+0000 7f0d051e4640 1 --2- 172.21.15.88:0/2855485180 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0d00070120 0x7f0d001eaf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:04.398 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:04.393+0000 7f0d051e4640 1 --2- 172.21.15.88:0/2855485180 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0d0006d590 0x7f0d00158760 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:04.398 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:04.393+0000 7f0d051e4640 1 -- 172.21.15.88:0/2855485180 >> 172.21.15.88:0/2855485180 conn(0x7f0d000c5ce0 msgr2=0x7f0d00154170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:04.398 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:04.393+0000 7f0d051e4640 1 -- 172.21.15.88:0/2855485180 shutdown_connections 2024-04-26T23:41:04.398 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:04.393+0000 7f0d051e4640 1 -- 172.21.15.88:0/2855485180 wait complete. 2024-04-26T23:41:04.408 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get a_metadata pg_num 2024-04-26T23:41:04.507 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:04.505+0000 7f97f86f8640 1 Processor -- start 2024-04-26T23:41:04.508 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:04.505+0000 7f97f86f8640 1 -- start start 2024-04-26T23:41:04.510 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:04.505+0000 7f97f86f8640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f97f00c6e20 0x7f97f00c7200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:04.510 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:04.505+0000 7f97f86f8640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f97f00740e0 0x7f97f0156f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:04.510 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:04.505+0000 7f97f86f8640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f97f015a530 con 0x7f97f00ca3a0 2024-04-26T23:41:04.511 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:04.505+0000 7f97f86f8640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f97f0072930 con 0x7f97f00740e0 2024-04-26T23:41:04.511 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:04.505+0000 7f97f86f8640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f97f015a810 con 0x7f97f00c6e20 2024-04-26T23:41:04.511 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:04.505+0000 7f97f5c93640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f97f00740e0 0x7f97f0156f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:04.511 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:04.505+0000 7f97f5c93640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f97f00740e0 0x7f97f0156f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:48688/0 (socket says 172.21.15.88:48688) 2024-04-26T23:41:04.511 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:04.505+0000 7f97f5c93640 1 -- 172.21.15.88:0/1960741560 learned_addr learned my addr 172.21.15.88:0/1960741560 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:41:04.511 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:04.505+0000 7f97f6494640 1 --2- 172.21.15.88:0/1960741560 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f97f00c6e20 0x7f97f00c7200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:04.511 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:04.505+0000 7f97f5c93640 1 -- 172.21.15.88:0/1960741560 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f97f00c6e20 msgr2=0x7f97f00c7200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:41:04.511 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:04.505+0000 7f97f5c93640 1 --2- 172.21.15.88:0/1960741560 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f97f00c6e20 0x7f97f00c7200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:04.511 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:04.505+0000 7f97f5c93640 1 -- 172.21.15.88:0/1960741560 >> v1:172.21.15.175:6789/0 conn(0x7f97f00ca3a0 legacy=0x7f97f0157460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:41:04.511 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:04.505+0000 7f97f5c93640 1 -- 172.21.15.88:0/1960741560 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97f015aaf0 con 0x7f97f00740e0 2024-04-26T23:41:04.511 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:04.506+0000 7f97f5c93640 1 --2- 172.21.15.88:0/1960741560 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f97f00740e0 0x7f97f0156f20 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f97e0009870 tx=0x7f97e002a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32f88597e8341d85 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:04.511 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:04.506+0000 7f97f5492640 1 -- 172.21.15.88:0/1960741560 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97e0037070 con 0x7f97f00740e0 2024-04-26T23:41:04.511 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:04.506+0000 7f97f5492640 1 -- 172.21.15.88:0/1960741560 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97e0032440 con 0x7f97f00740e0 2024-04-26T23:41:04.511 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:04.506+0000 7f97f5492640 1 -- 172.21.15.88:0/1960741560 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97e0032810 con 0x7f97f00740e0 2024-04-26T23:41:04.511 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:04.506+0000 7f97f86f8640 1 -- 172.21.15.88:0/1960741560 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f97f00740e0 msgr2=0x7f97f0156f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:04.511 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:04.506+0000 7f97f86f8640 1 --2- 172.21.15.88:0/1960741560 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f97f00740e0 0x7f97f0156f20 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f97e0009870 tx=0x7f97e002a180 comp rx=0 tx=0).stop 2024-04-26T23:41:04.512 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:04.506+0000 7f97f86f8640 1 -- 172.21.15.88:0/1960741560 shutdown_connections 2024-04-26T23:41:04.512 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:04.506+0000 7f97f86f8640 1 --2- 172.21.15.88:0/1960741560 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f97f00740e0 0x7f97f0156f20 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:04.512 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:04.506+0000 7f97f86f8640 1 --2- 172.21.15.88:0/1960741560 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f97f00c6e20 0x7f97f00c7200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:04.512 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:04.506+0000 7f97f86f8640 1 -- 172.21.15.88:0/1960741560 >> 172.21.15.88:0/1960741560 conn(0x7f97f00ae0b0 msgr2=0x7f97f00ae490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:04.512 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:04.506+0000 7f97f86f8640 1 -- 172.21.15.88:0/1960741560 shutdown_connections 2024-04-26T23:41:04.512 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:04.506+0000 7f97f86f8640 1 -- 172.21.15.88:0/1960741560 wait complete. 2024-04-26T23:41:04.514 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:04.507+0000 7f97f86f8640 1 Processor -- start 2024-04-26T23:41:04.514 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:04.508+0000 7f97f86f8640 1 -- start start 2024-04-26T23:41:04.514 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:04.508+0000 7f97f86f8640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f97f00740e0 0x7f97f0152c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:04.514 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:04.508+0000 7f97f86f8640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f97f00c6e20 0x7f97f01508d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:04.514 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:04.508+0000 7f97f86f8640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f97f00ca3a0 0x7f97f01eca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:04.514 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:04.508+0000 7f97f86f8640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f97f0154540 con 0x7f97f00c6e20 2024-04-26T23:41:04.514 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:04.508+0000 7f97f86f8640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f97f01543c0 con 0x7f97f00ca3a0 2024-04-26T23:41:04.514 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:04.508+0000 7f97f86f8640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f97f015a0c0 con 0x7f97f00740e0 2024-04-26T23:41:04.514 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:04.508+0000 7f97f5c93640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f97f00c6e20 0x7f97f01508d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:04.514 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:04.508+0000 7f97f5c93640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f97f00c6e20 0x7f97f01508d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:48694/0 (socket says 172.21.15.88:48694) 2024-04-26T23:41:04.514 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:04.508+0000 7f97f5c93640 1 -- 172.21.15.88:0/3974803773 learned_addr learned my addr 172.21.15.88:0/3974803773 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:41:04.514 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:04.508+0000 7f97f6c95640 1 --2- 172.21.15.88:0/3974803773 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f97f00ca3a0 0x7f97f01eca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:04.515 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:04.508+0000 7f97f6494640 1 --2- 172.21.15.88:0/3974803773 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f97f00740e0 0x7f97f0152c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:04.515 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:04.509+0000 7f97f5c93640 1 -- 172.21.15.88:0/3974803773 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f97f00740e0 msgr2=0x7f97f0152c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:04.515 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:04.509+0000 7f97f5c93640 1 --2- 172.21.15.88:0/3974803773 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f97f00740e0 0x7f97f0152c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:04.515 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:04.509+0000 7f97f5c93640 1 -- 172.21.15.88:0/3974803773 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f97f00ca3a0 msgr2=0x7f97f01eca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:04.515 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:04.509+0000 7f97f5c93640 1 --2- 172.21.15.88:0/3974803773 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f97f00ca3a0 0x7f97f01eca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:04.515 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:04.509+0000 7f97f5c93640 1 -- 172.21.15.88:0/3974803773 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97f01476a0 con 0x7f97f00c6e20 2024-04-26T23:41:04.515 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:04.509+0000 7f97f5c93640 1 --2- 172.21.15.88:0/3974803773 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f97f00c6e20 0x7f97f01508d0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f97e0009870 tx=0x7f97e00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:04.515 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:04.509+0000 7f97e6ffd640 1 -- 172.21.15.88:0/3974803773 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97e0041020 con 0x7f97f00c6e20 2024-04-26T23:41:04.515 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:04.509+0000 7f97e6ffd640 1 -- 172.21.15.88:0/3974803773 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97e0030970 con 0x7f97f00c6e20 2024-04-26T23:41:04.515 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:04.509+0000 7f97e6ffd640 1 -- 172.21.15.88:0/3974803773 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97e0037040 con 0x7f97f00c6e20 2024-04-26T23:41:04.515 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:04.509+0000 7f97f86f8640 1 -- 172.21.15.88:0/3974803773 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97f01e28b0 con 0x7f97f00c6e20 2024-04-26T23:41:04.515 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:04.509+0000 7f97f86f8640 1 -- 172.21.15.88:0/3974803773 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97f01e20b0 con 0x7f97f00c6e20 2024-04-26T23:41:04.515 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:04.510+0000 7f97f86f8640 1 -- 172.21.15.88:0/3974803773 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f97f00766c0 con 0x7f97f00c6e20 2024-04-26T23:41:04.516 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:04.511+0000 7f97e6ffd640 1 -- 172.21.15.88:0/3974803773 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f97e0044020 con 0x7f97f00c6e20 2024-04-26T23:41:04.516 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:04.511+0000 7f97e6ffd640 1 --2- 172.21.15.88:0/3974803773 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f97d406c8f0 0x7f97d406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:04.516 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:04.511+0000 7f97e6ffd640 1 -- 172.21.15.88:0/3974803773 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7f97e00ac690 con 0x7f97f00c6e20 2024-04-26T23:41:04.516 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:04.511+0000 7f97f6494640 1 --2- 172.21.15.88:0/3974803773 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f97d406c8f0 0x7f97d406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:04.516 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:04.511+0000 7f97f6494640 1 --2- 172.21.15.88:0/3974803773 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f97d406c8f0 0x7f97d406edb0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f97ec00aac0 tx=0x7f97ec008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:04.519 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:04.516+0000 7f97e6ffd640 1 -- 172.21.15.88:0/3974803773 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f97e004b030 con 0x7f97f00c6e20 2024-04-26T23:41:04.699 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:04.696+0000 7f97f86f8640 1 -- 172.21.15.88:0/3974803773 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "a_metadata", "var": "pg_num"} v 0) -- 0x7f97f00cad70 con 0x7f97f00c6e20 2024-04-26T23:41:04.699 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:04.696+0000 7f97e6ffd640 1 -- 172.21.15.88:0/3974803773 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "a_metadata", "var": "pg_num"}]=0 v24) ==== 99+0+11 (secure 0 0 0) 0x7f97e007a1d0 con 0x7f97f00c6e20 2024-04-26T23:41:04.699 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 32 2024-04-26T23:41:04.701 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:04.697+0000 7f97f86f8640 1 -- 172.21.15.88:0/3974803773 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f97d406c8f0 msgr2=0x7f97d406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:04.701 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:04.697+0000 7f97f86f8640 1 --2- 172.21.15.88:0/3974803773 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f97d406c8f0 0x7f97d406edb0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f97ec00aac0 tx=0x7f97ec008040 comp rx=0 tx=0).stop 2024-04-26T23:41:04.701 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:04.697+0000 7f97f86f8640 1 -- 172.21.15.88:0/3974803773 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f97f00c6e20 msgr2=0x7f97f01508d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:04.702 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:04.697+0000 7f97f86f8640 1 --2- 172.21.15.88:0/3974803773 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f97f00c6e20 0x7f97f01508d0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f97e0009870 tx=0x7f97e00046c0 comp rx=0 tx=0).stop 2024-04-26T23:41:04.702 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:04.697+0000 7f97f86f8640 1 -- 172.21.15.88:0/3974803773 shutdown_connections 2024-04-26T23:41:04.702 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:04.697+0000 7f97f86f8640 1 --2- 172.21.15.88:0/3974803773 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f97d406c8f0 0x7f97d406edb0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:04.702 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:04.697+0000 7f97f86f8640 1 --2- 172.21.15.88:0/3974803773 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f97f00ca3a0 0x7f97f01eca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:04.702 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:04.697+0000 7f97f86f8640 1 --2- 172.21.15.88:0/3974803773 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f97f00c6e20 0x7f97f01508d0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:04.702 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:04.697+0000 7f97f86f8640 1 --2- 172.21.15.88:0/3974803773 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f97f00740e0 0x7f97f0152c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:04.702 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:04.697+0000 7f97f86f8640 1 -- 172.21.15.88:0/3974803773 >> 172.21.15.88:0/3974803773 conn(0x7f97f00ae0b0 msgr2=0x7f97f0072ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:04.702 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:04.697+0000 7f97f86f8640 1 -- 172.21.15.88:0/3974803773 shutdown_connections 2024-04-26T23:41:04.702 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:04.697+0000 7f97f86f8640 1 -- 172.21.15.88:0/3974803773 wait complete. 2024-04-26T23:41:04.711 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get a_data pg_num 2024-04-26T23:41:04.812 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:04.809+0000 7feb5f683640 1 Processor -- start 2024-04-26T23:41:04.812 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:04.809+0000 7feb5f683640 1 -- start start 2024-04-26T23:41:04.813 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:04.810+0000 7feb5f683640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7feb580ab3f0 0x7feb580c4d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:04.813 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:04.810+0000 7feb5f683640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7feb580c52c0 0x7feb581574b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:04.813 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:04.810+0000 7feb5f683640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb580c3810 con 0x7feb581570d0 2024-04-26T23:41:04.813 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:04.810+0000 7feb5f683640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7feb580c56c0 con 0x7feb580ab3f0 2024-04-26T23:41:04.813 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:04.810+0000 7feb5f683640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7feb580c4330 con 0x7feb580c52c0 2024-04-26T23:41:04.813 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:04.810+0000 7feb5cc1e640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7feb580ab3f0 0x7feb580c4d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:04.813 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:04.810+0000 7feb5cc1e640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7feb580ab3f0 0x7feb580c4d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:48696/0 (socket says 172.21.15.88:48696) 2024-04-26T23:41:04.813 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:04.810+0000 7feb5d41f640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7feb581570d0 0x7feb58150a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:51980/0 (socket says 172.21.15.88:51980) 2024-04-26T23:41:04.813 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:04.810+0000 7feb5cc1e640 1 -- 172.21.15.88:0/1389098058 learned_addr learned my addr 172.21.15.88:0/1389098058 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:41:04.813 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:04.810+0000 7feb5cc1e640 1 -- 172.21.15.88:0/1389098058 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7feb580c52c0 msgr2=0x7feb581574b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:41:04.813 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:04.810+0000 7feb5cc1e640 1 --2- 172.21.15.88:0/1389098058 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7feb580c52c0 0x7feb581574b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:04.814 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:04.810+0000 7feb5cc1e640 1 -- 172.21.15.88:0/1389098058 >> v1:172.21.15.88:6789/0 conn(0x7feb581570d0 legacy=0x7feb58150a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:04.814 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:04.810+0000 7feb4ffff640 1 -- 172.21.15.88:0/1389098058 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3445798804 0 0) 0x7feb580c3810 con 0x7feb581570d0 2024-04-26T23:41:04.814 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:04.810+0000 7feb5cc1e640 1 -- 172.21.15.88:0/1389098058 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb580c3ab0 con 0x7feb580ab3f0 2024-04-26T23:41:04.815 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:04.811+0000 7feb5cc1e640 1 --2- 172.21.15.88:0/1389098058 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feb580ab3f0 0x7feb580c4d80 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7feb580c44b0 tx=0x7feb4802a130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a59e9b968979b414 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:04.816 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:04.811+0000 7feb4ffff640 1 -- 172.21.15.88:0/1389098058 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb48037070 con 0x7feb580ab3f0 2024-04-26T23:41:04.816 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:04.811+0000 7feb4ffff640 1 -- 172.21.15.88:0/1389098058 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb48032440 con 0x7feb580ab3f0 2024-04-26T23:41:04.816 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:04.811+0000 7feb4ffff640 1 -- 172.21.15.88:0/1389098058 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb48032810 con 0x7feb580ab3f0 2024-04-26T23:41:04.816 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:04.811+0000 7feb5f683640 1 -- 172.21.15.88:0/1389098058 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feb580ab3f0 msgr2=0x7feb580c4d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:04.816 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:04.811+0000 7feb5f683640 1 --2- 172.21.15.88:0/1389098058 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feb580ab3f0 0x7feb580c4d80 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7feb580c44b0 tx=0x7feb4802a130 comp rx=0 tx=0).stop 2024-04-26T23:41:04.816 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:04.811+0000 7feb5f683640 1 -- 172.21.15.88:0/1389098058 shutdown_connections 2024-04-26T23:41:04.816 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:04.811+0000 7feb5f683640 1 --2- 172.21.15.88:0/1389098058 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7feb580c52c0 0x7feb581574b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:04.817 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:04.811+0000 7feb5f683640 1 --2- 172.21.15.88:0/1389098058 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feb580ab3f0 0x7feb580c4d80 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:04.817 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:04.811+0000 7feb5f683640 1 -- 172.21.15.88:0/1389098058 >> 172.21.15.88:0/1389098058 conn(0x7feb5806c310 msgr2=0x7feb5806c6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:04.817 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:04.811+0000 7feb5f683640 1 -- 172.21.15.88:0/1389098058 shutdown_connections 2024-04-26T23:41:04.817 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:04.811+0000 7feb5f683640 1 -- 172.21.15.88:0/1389098058 wait complete. 2024-04-26T23:41:04.817 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:04.813+0000 7feb5f683640 1 Processor -- start 2024-04-26T23:41:04.817 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:04.813+0000 7feb5f683640 1 -- start start 2024-04-26T23:41:04.821 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:04.813+0000 7feb5f683640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7feb580ab3f0 0x7feb581565f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:04.822 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:04.813+0000 7feb5f683640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7feb580c52c0 0x7feb58148410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:04.822 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:04.813+0000 7feb5f683640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feb581570d0 0x7feb58148950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:04.822 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:04.813+0000 7feb5f683640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7feb58151160 con 0x7feb581570d0 2024-04-26T23:41:04.822 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:04.813+0000 7feb5f683640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7feb580c4860 con 0x7feb580ab3f0 2024-04-26T23:41:04.822 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:04.813+0000 7feb5f683640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7feb581512e0 con 0x7feb580c52c0 2024-04-26T23:41:04.822 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:04.813+0000 7feb5dc20640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feb581570d0 0x7feb58148950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:04.822 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:04.813+0000 7feb5dc20640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feb581570d0 0x7feb58148950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:48700/0 (socket says 172.21.15.88:48700) 2024-04-26T23:41:04.822 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:04.813+0000 7feb5dc20640 1 -- 172.21.15.88:0/3843426080 learned_addr learned my addr 172.21.15.88:0/3843426080 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:41:04.822 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:04.814+0000 7feb5d41f640 1 --2- 172.21.15.88:0/3843426080 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7feb580ab3f0 0x7feb581565f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:04.822 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:04.814+0000 7feb5cc1e640 1 --2- 172.21.15.88:0/3843426080 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7feb580c52c0 0x7feb58148410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:04.822 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:04.814+0000 7feb5dc20640 1 -- 172.21.15.88:0/3843426080 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7feb580c52c0 msgr2=0x7feb58148410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:04.822 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:04.814+0000 7feb5dc20640 1 --2- 172.21.15.88:0/3843426080 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7feb580c52c0 0x7feb58148410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:04.822 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:04.814+0000 7feb5dc20640 1 -- 172.21.15.88:0/3843426080 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7feb580ab3f0 msgr2=0x7feb581565f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:04.822 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:04.814+0000 7feb5dc20640 1 --2- 172.21.15.88:0/3843426080 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7feb580ab3f0 0x7feb581565f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:04.823 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:04.814+0000 7feb5dc20640 1 -- 172.21.15.88:0/3843426080 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb58154670 con 0x7feb581570d0 2024-04-26T23:41:04.823 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:04.814+0000 7feb5d41f640 1 --2- 172.21.15.88:0/3843426080 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7feb580ab3f0 0x7feb581565f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:41:04.823 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:04.814+0000 7feb5dc20640 1 --2- 172.21.15.88:0/3843426080 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feb581570d0 0x7feb58148950 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7feb5000b970 tx=0x7feb5000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:04.823 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:04.814+0000 7feb4dffb640 1 -- 172.21.15.88:0/3843426080 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb50019070 con 0x7feb581570d0 2024-04-26T23:41:04.823 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:04.814+0000 7feb4dffb640 1 -- 172.21.15.88:0/3843426080 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb5000cb60 con 0x7feb581570d0 2024-04-26T23:41:04.823 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:04.814+0000 7feb4dffb640 1 -- 172.21.15.88:0/3843426080 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb50014440 con 0x7feb581570d0 2024-04-26T23:41:04.823 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:04.814+0000 7feb5f683640 1 -- 172.21.15.88:0/3843426080 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb58152160 con 0x7feb581570d0 2024-04-26T23:41:04.823 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:04.814+0000 7feb5f683640 1 -- 172.21.15.88:0/3843426080 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb581526e0 con 0x7feb581570d0 2024-04-26T23:41:04.823 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:04.815+0000 7feb5f683640 1 -- 172.21.15.88:0/3843426080 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb580ad080 con 0x7feb581570d0 2024-04-26T23:41:04.823 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:04.815+0000 7feb4dffb640 1 -- 172.21.15.88:0/3843426080 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7feb5001c070 con 0x7feb581570d0 2024-04-26T23:41:04.823 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:04.816+0000 7feb4dffb640 1 --2- 172.21.15.88:0/3843426080 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7feb3c06c8f0 0x7feb3c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:04.823 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:04.816+0000 7feb5d41f640 1 --2- 172.21.15.88:0/3843426080 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7feb3c06c8f0 0x7feb3c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:04.823 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:04.816+0000 7feb4dffb640 1 -- 172.21.15.88:0/3843426080 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7feb5008bb60 con 0x7feb581570d0 2024-04-26T23:41:04.823 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:04.816+0000 7feb5d41f640 1 --2- 172.21.15.88:0/3843426080 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7feb3c06c8f0 0x7feb3c06edb0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7feb54000f60 tx=0x7feb54009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:04.824 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:04.820+0000 7feb4dffb640 1 -- 172.21.15.88:0/3843426080 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7feb50059c60 con 0x7feb581570d0 2024-04-26T23:41:05.001 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:04.998+0000 7feb5f683640 1 -- 172.21.15.88:0/3843426080 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "a_data", "var": "pg_num"} v 0) -- 0x7feb580507a0 con 0x7feb581570d0 2024-04-26T23:41:05.001 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:04.998+0000 7feb4dffb640 1 -- 172.21.15.88:0/3843426080 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "a_data", "var": "pg_num"}]=0 v24) ==== 95+0+11 (secure 0 0 0) 0x7feb50059560 con 0x7feb581570d0 2024-04-26T23:41:05.001 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 64 2024-04-26T23:41:05.003 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.000+0000 7feb5f683640 1 -- 172.21.15.88:0/3843426080 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7feb3c06c8f0 msgr2=0x7feb3c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:05.003 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.000+0000 7feb5f683640 1 --2- 172.21.15.88:0/3843426080 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7feb3c06c8f0 0x7feb3c06edb0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7feb54000f60 tx=0x7feb54009040 comp rx=0 tx=0).stop 2024-04-26T23:41:05.004 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.000+0000 7feb5f683640 1 -- 172.21.15.88:0/3843426080 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feb581570d0 msgr2=0x7feb58148950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:05.004 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.000+0000 7feb5f683640 1 --2- 172.21.15.88:0/3843426080 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feb581570d0 0x7feb58148950 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7feb5000b970 tx=0x7feb5000be30 comp rx=0 tx=0).stop 2024-04-26T23:41:05.004 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.000+0000 7feb5f683640 1 -- 172.21.15.88:0/3843426080 shutdown_connections 2024-04-26T23:41:05.004 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.000+0000 7feb5f683640 1 --2- 172.21.15.88:0/3843426080 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7feb3c06c8f0 0x7feb3c06edb0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:05.004 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.000+0000 7feb5f683640 1 --2- 172.21.15.88:0/3843426080 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7feb580c52c0 0x7feb58148410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:05.004 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.000+0000 7feb5f683640 1 --2- 172.21.15.88:0/3843426080 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feb581570d0 0x7feb58148950 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:05.004 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.000+0000 7feb5f683640 1 --2- 172.21.15.88:0/3843426080 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7feb580ab3f0 0x7feb581565f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:05.004 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.000+0000 7feb5f683640 1 -- 172.21.15.88:0/3843426080 >> 172.21.15.88:0/3843426080 conn(0x7feb5806c310 msgr2=0x7feb580c2bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:05.004 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.000+0000 7feb5f683640 1 -- 172.21.15.88:0/3843426080 shutdown_connections 2024-04-26T23:41:05.004 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.000+0000 7feb5f683640 1 -- 172.21.15.88:0/3843426080 wait complete. 2024-04-26T23:41:05.014 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get b_metadata pg_num 2024-04-26T23:41:05.114 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.111+0000 7ffb22d5f640 1 Processor -- start 2024-04-26T23:41:05.114 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.111+0000 7ffb22d5f640 1 -- start start 2024-04-26T23:41:05.117 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.112+0000 7ffb22d5f640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7ffb1c0c6e20 0x7ffb1c0c7200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:05.118 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.112+0000 7ffb22d5f640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffb1c15a530 con 0x7ffb1c0ca3a0 2024-04-26T23:41:05.118 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.112+0000 7ffb22d5f640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffb1c15a810 con 0x7ffb1c0740e0 2024-04-26T23:41:05.118 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.112+0000 7ffb22d5f640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7ffb1c072930 con 0x7ffb1c0c6e20 2024-04-26T23:41:05.118 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.112+0000 7ffb212fc640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7ffb1c0ca3a0 0x7ffb1c161450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:51988/0 (socket says 172.21.15.88:51988) 2024-04-26T23:41:05.118 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.112+0000 7ffb212fc640 1 -- 172.21.15.88:0/2442953856 learned_addr learned my addr 172.21.15.88:0/2442953856 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-26T23:41:05.118 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.112+0000 7ffb20afb640 1 --2- 172.21.15.88:0/2442953856 >> v2:172.21.15.175:3300/0 conn(0x7ffb1c0c6e20 0x7ffb1c0c7200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:05.118 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.112+0000 7ffb1b7fe640 1 -- 172.21.15.88:0/2442953856 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1085411695 0 0) 0x7ffb1c15a530 con 0x7ffb1c0ca3a0 2024-04-26T23:41:05.118 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.112+0000 7ffb1b7fe640 1 -- 172.21.15.88:0/2442953856 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffb04003520 con 0x7ffb1c0ca3a0 2024-04-26T23:41:05.118 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.113+0000 7ffb1b7fe640 1 -- 172.21.15.88:0/2442953856 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1176136070 0 0) 0x7ffb04003520 con 0x7ffb1c0ca3a0 2024-04-26T23:41:05.118 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.113+0000 7ffb1b7fe640 1 -- 172.21.15.88:0/2442953856 >> v2:172.21.15.175:3300/0 conn(0x7ffb1c0c6e20 msgr2=0x7ffb1c0c7200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:41:05.118 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.113+0000 7ffb1b7fe640 1 --2- 172.21.15.88:0/2442953856 >> v2:172.21.15.175:3300/0 conn(0x7ffb1c0c6e20 0x7ffb1c0c7200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:05.118 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.113+0000 7ffb1b7fe640 1 -- 172.21.15.88:0/2442953856 >> v1:172.21.15.175:6789/0 conn(0x7ffb1c0740e0 legacy=0x7ffb1c156f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:05.118 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.113+0000 7ffb1b7fe640 1 -- 172.21.15.88:0/2442953856 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb1c15aaf0 con 0x7ffb1c0ca3a0 2024-04-26T23:41:05.119 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.113+0000 7ffb1b7fe640 1 -- 172.21.15.88:0/2442953856 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 356324787 0 0) 0x7ffb140019f0 con 0x7ffb1c0ca3a0 2024-04-26T23:41:05.119 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.113+0000 7ffb1b7fe640 1 -- 172.21.15.88:0/2442953856 >> v1:172.21.15.88:6789/0 conn(0x7ffb1c0ca3a0 legacy=0x7ffb1c161450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:05.119 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.113+0000 7ffb1b7fe640 1 --2- 172.21.15.88:0/2442953856 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ffb040039b0 0x7ffb04003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:05.119 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.113+0000 7ffb1b7fe640 1 --2- 172.21.15.88:0/2442953856 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffb04004800 0x7ffb04004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:05.119 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.113+0000 7ffb1b7fe640 1 --2- 172.21.15.88:0/2442953856 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffb040051c0 0x7ffb0400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:05.119 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.113+0000 7ffb1b7fe640 1 -- 172.21.15.88:0/2442953856 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7ffb0400c130 con 0x7ffb04004800 2024-04-26T23:41:05.119 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.113+0000 7ffb1b7fe640 1 -- 172.21.15.88:0/2442953856 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ffb0400c2e0 con 0x7ffb040051c0 2024-04-26T23:41:05.119 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.113+0000 7ffb1b7fe640 1 -- 172.21.15.88:0/2442953856 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7ffb0400c4e0 con 0x7ffb040039b0 2024-04-26T23:41:05.119 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.113+0000 7ffb1bfff640 1 --2- 172.21.15.88:0/2442953856 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffb04004800 0x7ffb04004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:05.119 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.113+0000 7ffb212fc640 1 --2- 172.21.15.88:0/2442953856 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffb040051c0 0x7ffb0400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:05.119 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.113+0000 7ffb20afb640 1 --2- 172.21.15.88:0/2442953856 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ffb040039b0 0x7ffb04003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:05.119 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.113+0000 7ffb1bfff640 1 -- 172.21.15.88:0/2442953856 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ffb040039b0 msgr2=0x7ffb04003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:41:05.119 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.113+0000 7ffb1bfff640 1 --2- 172.21.15.88:0/2442953856 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ffb040039b0 0x7ffb04003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:05.119 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.113+0000 7ffb1bfff640 1 -- 172.21.15.88:0/2442953856 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffb040051c0 msgr2=0x7ffb0400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:41:05.119 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.113+0000 7ffb1bfff640 1 --2- 172.21.15.88:0/2442953856 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffb040051c0 0x7ffb0400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:05.120 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.113+0000 7ffb1bfff640 1 -- 172.21.15.88:0/2442953856 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb04003520 con 0x7ffb04004800 2024-04-26T23:41:05.120 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.113+0000 7ffb212fc640 1 --2- 172.21.15.88:0/2442953856 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffb040051c0 0x7ffb0400b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:41:05.120 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.113+0000 7ffb212fc640 1 -- 172.21.15.88:0/2442953856 reap_dead start 2024-04-26T23:41:05.120 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.114+0000 7ffb1bfff640 1 --2- 172.21.15.88:0/2442953856 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffb04004800 0x7ffb04004c80 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7ffb10001720 tx=0x7ffb04005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e92430e2e99354c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:05.120 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.114+0000 7ffb1b7fe640 1 -- 172.21.15.88:0/2442953856 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb10001370 con 0x7ffb04004800 2024-04-26T23:41:05.120 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.114+0000 7ffb1b7fe640 1 -- 172.21.15.88:0/2442953856 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb100052d0 con 0x7ffb04004800 2024-04-26T23:41:05.120 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.114+0000 7ffb1b7fe640 1 -- 172.21.15.88:0/2442953856 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb1002ab90 con 0x7ffb04004800 2024-04-26T23:41:05.120 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.114+0000 7ffb22d5f640 1 -- 172.21.15.88:0/2442953856 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffb04004800 msgr2=0x7ffb04004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:05.120 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.114+0000 7ffb22d5f640 1 --2- 172.21.15.88:0/2442953856 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffb04004800 0x7ffb04004c80 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7ffb10001720 tx=0x7ffb04005830 comp rx=0 tx=0).stop 2024-04-26T23:41:05.120 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.114+0000 7ffb22d5f640 1 -- 172.21.15.88:0/2442953856 shutdown_connections 2024-04-26T23:41:05.120 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.114+0000 7ffb22d5f640 1 --2- 172.21.15.88:0/2442953856 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffb04004800 0x7ffb04004c80 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:05.120 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.114+0000 7ffb22d5f640 1 -- 172.21.15.88:0/2442953856 >> 172.21.15.88:0/2442953856 conn(0x7ffb1c0ae0b0 msgr2=0x7ffb1c0ae490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:05.120 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.114+0000 7ffb22d5f640 1 -- 172.21.15.88:0/2442953856 shutdown_connections 2024-04-26T23:41:05.120 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.114+0000 7ffb22d5f640 1 -- 172.21.15.88:0/2442953856 wait complete. 2024-04-26T23:41:05.123 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.116+0000 7ffb22d5f640 1 Processor -- start 2024-04-26T23:41:05.123 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.116+0000 7ffb22d5f640 1 -- start start 2024-04-26T23:41:05.123 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.116+0000 7ffb22d5f640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ffb04004800 0x7ffb1c1efcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:05.123 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.116+0000 7ffb22d5f640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffb1c1429e0 0x7ffb1c1ec4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:05.123 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.116+0000 7ffb22d5f640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffb1c1f0200 0x7ffb1c1eca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:05.123 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.116+0000 7ffb22d5f640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7ffb1c154540 con 0x7ffb1c1f0200 2024-04-26T23:41:05.123 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.116+0000 7ffb22d5f640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ffb1c1543c0 con 0x7ffb1c1429e0 2024-04-26T23:41:05.123 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.116+0000 7ffb22d5f640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7ffb1c15a0c0 con 0x7ffb04004800 2024-04-26T23:41:05.124 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.117+0000 7ffb212fc640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffb1c1f0200 0x7ffb1c1eca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:05.124 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.117+0000 7ffb212fc640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffb1c1f0200 0x7ffb1c1eca20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:48718/0 (socket says 172.21.15.88:48718) 2024-04-26T23:41:05.124 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.117+0000 7ffb212fc640 1 -- 172.21.15.88:0/2965231800 learned_addr learned my addr 172.21.15.88:0/2965231800 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:41:05.124 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.117+0000 7ffb20afb640 1 --2- 172.21.15.88:0/2965231800 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ffb04004800 0x7ffb1c1efcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:05.124 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.117+0000 7ffb1bfff640 1 --2- 172.21.15.88:0/2965231800 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffb1c1429e0 0x7ffb1c1ec4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:05.124 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.117+0000 7ffb212fc640 1 -- 172.21.15.88:0/2965231800 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ffb04004800 msgr2=0x7ffb1c1efcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:05.124 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.117+0000 7ffb212fc640 1 --2- 172.21.15.88:0/2965231800 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ffb04004800 0x7ffb1c1efcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:05.124 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.117+0000 7ffb212fc640 1 -- 172.21.15.88:0/2965231800 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffb1c1429e0 msgr2=0x7ffb1c1ec4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:05.124 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.117+0000 7ffb212fc640 1 --2- 172.21.15.88:0/2965231800 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffb1c1429e0 0x7ffb1c1ec4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:05.124 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.117+0000 7ffb212fc640 1 -- 172.21.15.88:0/2965231800 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb1c1f06b0 con 0x7ffb1c1f0200 2024-04-26T23:41:05.124 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.117+0000 7ffb212fc640 1 --2- 172.21.15.88:0/2965231800 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffb1c1f0200 0x7ffb1c1eca20 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7ffb1c0cd570 tx=0x7ffb1400e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:05.124 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.117+0000 7ffb197fa640 1 -- 172.21.15.88:0/2965231800 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb1400eb90 con 0x7ffb1c1f0200 2024-04-26T23:41:05.124 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.117+0000 7ffb197fa640 1 -- 172.21.15.88:0/2965231800 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb1400ed30 con 0x7ffb1c1f0200 2024-04-26T23:41:05.124 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.117+0000 7ffb197fa640 1 -- 172.21.15.88:0/2965231800 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb14014670 con 0x7ffb1c1f0200 2024-04-26T23:41:05.125 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.117+0000 7ffb22d5f640 1 -- 172.21.15.88:0/2965231800 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb1c0c29c0 con 0x7ffb1c1f0200 2024-04-26T23:41:05.125 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.117+0000 7ffb22d5f640 1 -- 172.21.15.88:0/2965231800 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb1c0af7b0 con 0x7ffb1c1f0200 2024-04-26T23:41:05.125 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.118+0000 7ffb22d5f640 1 -- 172.21.15.88:0/2965231800 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffb1c0766c0 con 0x7ffb1c1f0200 2024-04-26T23:41:05.125 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.119+0000 7ffb197fa640 1 -- 172.21.15.88:0/2965231800 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ffb14014810 con 0x7ffb1c1f0200 2024-04-26T23:41:05.125 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.119+0000 7ffb197fa640 1 --2- 172.21.15.88:0/2965231800 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7ffb0806c8f0 0x7ffb0806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:05.125 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.119+0000 7ffb197fa640 1 -- 172.21.15.88:0/2965231800 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7ffb1408bbb0 con 0x7ffb1c1f0200 2024-04-26T23:41:05.125 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.119+0000 7ffb20afb640 1 --2- 172.21.15.88:0/2965231800 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7ffb0806c8f0 0x7ffb0806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:05.125 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.119+0000 7ffb20afb640 1 --2- 172.21.15.88:0/2965231800 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7ffb0806c8f0 0x7ffb0806edb0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7ffb1c1563f0 tx=0x7ffb0c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:05.126 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.123+0000 7ffb197fa640 1 -- 172.21.15.88:0/2965231800 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7ffb140596f0 con 0x7ffb1c1f0200 2024-04-26T23:41:05.299 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.296+0000 7ffb22d5f640 1 -- 172.21.15.88:0/2965231800 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "b_metadata", "var": "pg_num"} v 0) -- 0x7ffb1c0afa40 con 0x7ffb1c1f0200 2024-04-26T23:41:05.300 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.297+0000 7ffb197fa640 1 -- 172.21.15.88:0/2965231800 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "b_metadata", "var": "pg_num"}]=0 v24) ==== 99+0+11 (secure 0 0 0) 0x7ffb1405d9f0 con 0x7ffb1c1f0200 2024-04-26T23:41:05.300 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 32 2024-04-26T23:41:05.302 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.298+0000 7ffb22d5f640 1 -- 172.21.15.88:0/2965231800 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7ffb0806c8f0 msgr2=0x7ffb0806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:05.302 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.298+0000 7ffb22d5f640 1 --2- 172.21.15.88:0/2965231800 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7ffb0806c8f0 0x7ffb0806edb0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7ffb1c1563f0 tx=0x7ffb0c008040 comp rx=0 tx=0).stop 2024-04-26T23:41:05.302 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.298+0000 7ffb22d5f640 1 -- 172.21.15.88:0/2965231800 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffb1c1f0200 msgr2=0x7ffb1c1eca20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:05.302 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.298+0000 7ffb22d5f640 1 --2- 172.21.15.88:0/2965231800 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffb1c1f0200 0x7ffb1c1eca20 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7ffb1c0cd570 tx=0x7ffb1400e530 comp rx=0 tx=0).stop 2024-04-26T23:41:05.302 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.299+0000 7ffb22d5f640 1 -- 172.21.15.88:0/2965231800 shutdown_connections 2024-04-26T23:41:05.302 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.299+0000 7ffb22d5f640 1 --2- 172.21.15.88:0/2965231800 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7ffb0806c8f0 0x7ffb0806edb0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:05.302 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.299+0000 7ffb22d5f640 1 --2- 172.21.15.88:0/2965231800 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffb1c1f0200 0x7ffb1c1eca20 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:05.302 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.299+0000 7ffb22d5f640 1 --2- 172.21.15.88:0/2965231800 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffb1c1429e0 0x7ffb1c1ec4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:05.303 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.299+0000 7ffb22d5f640 1 --2- 172.21.15.88:0/2965231800 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ffb04004800 0x7ffb1c1efcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:05.303 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.299+0000 7ffb22d5f640 1 -- 172.21.15.88:0/2965231800 >> 172.21.15.88:0/2965231800 conn(0x7ffb1c0ae0b0 msgr2=0x7ffb1c072930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:05.303 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.299+0000 7ffb22d5f640 1 -- 172.21.15.88:0/2965231800 shutdown_connections 2024-04-26T23:41:05.303 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.299+0000 7ffb22d5f640 1 -- 172.21.15.88:0/2965231800 wait complete. 2024-04-26T23:41:05.312 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get b_data pg_num 2024-04-26T23:41:05.412 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.409+0000 7ff5549c6640 1 Processor -- start 2024-04-26T23:41:05.412 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.409+0000 7ff5549c6640 1 -- start start 2024-04-26T23:41:05.413 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.409+0000 7ff5549c6640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7ff5500720a0 0x7ff5500c4df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:05.413 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.409+0000 7ff5549c6640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff5500c5330 con 0x7ff5500c40e0 2024-04-26T23:41:05.413 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.409+0000 7ff5549c6640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff550154ba0 con 0x7ff5500c3060 2024-04-26T23:41:05.413 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.409+0000 7ff5549c6640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7ff550154e80 con 0x7ff5500720a0 2024-04-26T23:41:05.413 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.410+0000 7ff547fff640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7ff5500c40e0 0x7ff5500c46e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:52000/0 (socket says 172.21.15.88:52000) 2024-04-26T23:41:05.413 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.410+0000 7ff547fff640 1 -- 172.21.15.88:0/3575889981 learned_addr learned my addr 172.21.15.88:0/3575889981 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-26T23:41:05.413 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.410+0000 7ff54ed9d640 1 --2- 172.21.15.88:0/3575889981 >> v2:172.21.15.175:3300/0 conn(0x7ff5500720a0 0x7ff5500c4df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:05.414 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.410+0000 7ff54dd9b640 1 -- 172.21.15.88:0/3575889981 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 170512080 0 0) 0x7ff5500c5330 con 0x7ff5500c40e0 2024-04-26T23:41:05.414 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.410+0000 7ff54dd9b640 1 -- 172.21.15.88:0/3575889981 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff53c003520 con 0x7ff5500c40e0 2024-04-26T23:41:05.414 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.410+0000 7ff54ed9d640 1 -- 172.21.15.88:0/3575889981 >> v1:172.21.15.175:6789/0 conn(0x7ff5500c3060 legacy=0x7ff550151e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:05.414 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.410+0000 7ff54dd9b640 1 -- 172.21.15.88:0/3575889981 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2089466307 0 0) 0x7ff53c003520 con 0x7ff5500c40e0 2024-04-26T23:41:05.414 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.410+0000 7ff54ed9d640 1 -- 172.21.15.88:0/3575889981 >> v1:172.21.15.88:6789/0 conn(0x7ff5500c40e0 legacy=0x7ff5500c46e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:05.414 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.410+0000 7ff54ed9d640 1 -- 172.21.15.88:0/3575889981 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff550155160 con 0x7ff5500720a0 2024-04-26T23:41:05.415 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.411+0000 7ff54ed9d640 1 --2- 172.21.15.88:0/3575889981 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff5500720a0 0x7ff5500c4df0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7ff548009d90 tx=0x7ff54802a5f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c42b2bc24be245c9 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:05.415 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.411+0000 7ff54dd9b640 1 -- 172.21.15.88:0/3575889981 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff538001670 con 0x7ff5500720a0 2024-04-26T23:41:05.415 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.411+0000 7ff54dd9b640 1 -- 172.21.15.88:0/3575889981 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff548007540 con 0x7ff5500720a0 2024-04-26T23:41:05.415 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.411+0000 7ff54dd9b640 1 -- 172.21.15.88:0/3575889981 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5480078f0 con 0x7ff5500720a0 2024-04-26T23:41:05.415 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.412+0000 7ff5549c6640 1 -- 172.21.15.88:0/3575889981 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff5500720a0 msgr2=0x7ff5500c4df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:05.415 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.412+0000 7ff5549c6640 1 --2- 172.21.15.88:0/3575889981 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff5500720a0 0x7ff5500c4df0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7ff548009d90 tx=0x7ff54802a5f0 comp rx=0 tx=0).stop 2024-04-26T23:41:05.415 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.412+0000 7ff5549c6640 1 -- 172.21.15.88:0/3575889981 shutdown_connections 2024-04-26T23:41:05.416 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.412+0000 7ff5549c6640 1 --2- 172.21.15.88:0/3575889981 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff5500720a0 0x7ff5500c4df0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:05.416 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.412+0000 7ff5549c6640 1 -- 172.21.15.88:0/3575889981 >> 172.21.15.88:0/3575889981 conn(0x7ff55006c310 msgr2=0x7ff55006c6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:05.416 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.412+0000 7ff5549c6640 1 -- 172.21.15.88:0/3575889981 shutdown_connections 2024-04-26T23:41:05.416 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.412+0000 7ff5549c6640 1 -- 172.21.15.88:0/3575889981 wait complete. 2024-04-26T23:41:05.418 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.413+0000 7ff5549c6640 1 Processor -- start 2024-04-26T23:41:05.418 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.413+0000 7ff5549c6640 1 -- start start 2024-04-26T23:41:05.418 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.414+0000 7ff5549c6640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff5500720a0 0x7ff550153bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:05.418 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.414+0000 7ff5549c6640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff5500c3060 0x7ff5501ea580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:05.418 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.414+0000 7ff5549c6640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff5500c40e0 0x7ff5501eaac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:05.418 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.414+0000 7ff5549c6640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7ff5500c3aa0 con 0x7ff5500c3060 2024-04-26T23:41:05.418 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.414+0000 7ff5549c6640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff550155720 con 0x7ff5500720a0 2024-04-26T23:41:05.418 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.414+0000 7ff5549c6640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7ff5500c3440 con 0x7ff5500c40e0 2024-04-26T23:41:05.418 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.414+0000 7ff547fff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff5500c3060 0x7ff5501ea580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:05.419 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.414+0000 7ff547fff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff5500c3060 0x7ff5501ea580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:48720/0 (socket says 172.21.15.88:48720) 2024-04-26T23:41:05.419 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.414+0000 7ff547fff640 1 -- 172.21.15.88:0/2063045190 learned_addr learned my addr 172.21.15.88:0/2063045190 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:41:05.419 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.414+0000 7ff54e59c640 1 --2- 172.21.15.88:0/2063045190 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff5500720a0 0x7ff550153bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:05.419 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.414+0000 7ff54ed9d640 1 --2- 172.21.15.88:0/2063045190 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff5500c40e0 0x7ff5501eaac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:05.419 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.414+0000 7ff547fff640 1 -- 172.21.15.88:0/2063045190 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff5500c40e0 msgr2=0x7ff5501eaac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:05.419 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.414+0000 7ff547fff640 1 --2- 172.21.15.88:0/2063045190 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff5500c40e0 0x7ff5501eaac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:05.419 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.414+0000 7ff547fff640 1 -- 172.21.15.88:0/2063045190 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff5500720a0 msgr2=0x7ff550153bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:05.419 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.414+0000 7ff547fff640 1 --2- 172.21.15.88:0/2063045190 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff5500720a0 0x7ff550153bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:05.419 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.414+0000 7ff547fff640 1 -- 172.21.15.88:0/2063045190 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5501ede10 con 0x7ff5500c3060 2024-04-26T23:41:05.419 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.414+0000 7ff54e59c640 1 --2- 172.21.15.88:0/2063045190 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff5500720a0 0x7ff550153bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:41:05.419 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.414+0000 7ff54ed9d640 1 --2- 172.21.15.88:0/2063045190 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff5500c40e0 0x7ff5501eaac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:41:05.419 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.414+0000 7ff547fff640 1 --2- 172.21.15.88:0/2063045190 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff5500c3060 0x7ff5501ea580 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7ff53800c580 tx=0x7ff53800ca40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:05.419 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.414+0000 7ff546ffd640 1 -- 172.21.15.88:0/2063045190 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff538017070 con 0x7ff5500c3060 2024-04-26T23:41:05.419 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.414+0000 7ff546ffd640 1 -- 172.21.15.88:0/2063045190 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff538005d00 con 0x7ff5500c3060 2024-04-26T23:41:05.419 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.414+0000 7ff5549c6640 1 -- 172.21.15.88:0/2063045190 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5500c7170 con 0x7ff5500c3060 2024-04-26T23:41:05.419 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.414+0000 7ff546ffd640 1 -- 172.21.15.88:0/2063045190 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff538007330 con 0x7ff5500c3060 2024-04-26T23:41:05.420 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.414+0000 7ff5549c6640 1 -- 172.21.15.88:0/2063045190 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff550154100 con 0x7ff5500c3060 2024-04-26T23:41:05.420 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.415+0000 7ff5549c6640 1 -- 172.21.15.88:0/2063045190 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff5501e9ec0 con 0x7ff5500c3060 2024-04-26T23:41:05.420 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.416+0000 7ff546ffd640 1 -- 172.21.15.88:0/2063045190 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff53801a070 con 0x7ff5500c3060 2024-04-26T23:41:05.420 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.416+0000 7ff546ffd640 1 --2- 172.21.15.88:0/2063045190 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7ff53006c8f0 0x7ff53006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:05.421 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.416+0000 7ff54e59c640 1 --2- 172.21.15.88:0/2063045190 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7ff53006c8f0 0x7ff53006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:05.421 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.416+0000 7ff546ffd640 1 -- 172.21.15.88:0/2063045190 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7ff53808b2a0 con 0x7ff5500c3060 2024-04-26T23:41:05.421 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.417+0000 7ff54e59c640 1 --2- 172.21.15.88:0/2063045190 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7ff53006c8f0 0x7ff53006edb0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7ff540000f60 tx=0x7ff540009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:05.424 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.421+0000 7ff546ffd640 1 -- 172.21.15.88:0/2063045190 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7ff5501ede10 con 0x7ff5500c3060 2024-04-26T23:41:05.599 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.596+0000 7ff5549c6640 1 -- 172.21.15.88:0/2063045190 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "b_data", "var": "pg_num"} v 0) -- 0x7ff550073c50 con 0x7ff5500c3060 2024-04-26T23:41:05.599 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.596+0000 7ff546ffd640 1 -- 172.21.15.88:0/2063045190 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "b_data", "var": "pg_num"}]=0 v24) ==== 95+0+11 (secure 0 0 0) 0x7ff5380593b0 con 0x7ff5500c3060 2024-04-26T23:41:05.599 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 64 2024-04-26T23:41:05.601 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.598+0000 7ff5549c6640 1 -- 172.21.15.88:0/2063045190 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7ff53006c8f0 msgr2=0x7ff53006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:05.601 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.598+0000 7ff5549c6640 1 --2- 172.21.15.88:0/2063045190 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7ff53006c8f0 0x7ff53006edb0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7ff540000f60 tx=0x7ff540009040 comp rx=0 tx=0).stop 2024-04-26T23:41:05.601 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.598+0000 7ff5549c6640 1 -- 172.21.15.88:0/2063045190 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff5500c3060 msgr2=0x7ff5501ea580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:05.601 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.598+0000 7ff5549c6640 1 --2- 172.21.15.88:0/2063045190 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff5500c3060 0x7ff5501ea580 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7ff53800c580 tx=0x7ff53800ca40 comp rx=0 tx=0).stop 2024-04-26T23:41:05.601 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.598+0000 7ff5549c6640 1 -- 172.21.15.88:0/2063045190 shutdown_connections 2024-04-26T23:41:05.601 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.598+0000 7ff5549c6640 1 --2- 172.21.15.88:0/2063045190 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7ff53006c8f0 0x7ff53006edb0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:05.601 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.598+0000 7ff5549c6640 1 --2- 172.21.15.88:0/2063045190 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff5500c40e0 0x7ff5501eaac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:05.601 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.598+0000 7ff5549c6640 1 --2- 172.21.15.88:0/2063045190 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff5500c3060 0x7ff5501ea580 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:05.602 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.598+0000 7ff5549c6640 1 --2- 172.21.15.88:0/2063045190 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff5500720a0 0x7ff550153bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:05.602 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.598+0000 7ff5549c6640 1 -- 172.21.15.88:0/2063045190 >> 172.21.15.88:0/2063045190 conn(0x7ff55006c310 msgr2=0x7ff55014b970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:05.602 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.598+0000 7ff5549c6640 1 -- 172.21.15.88:0/2063045190 shutdown_connections 2024-04-26T23:41:05.602 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.598+0000 7ff5549c6640 1 -- 172.21.15.88:0/2063045190 wait complete. 2024-04-26T23:41:05.612 INFO:tasks.mon_thrash.ceph_manager:waiting for clean 2024-04-26T23:41:05.612 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T23:41:05.711 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.708+0000 7fba4efe4640 1 Processor -- start 2024-04-26T23:41:05.711 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.708+0000 7fba4efe4640 1 -- start start 2024-04-26T23:41:05.713 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.709+0000 7fba4efe4640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fba48154160 0x7fba48156bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:05.713 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.709+0000 7fba4efe4640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fba480ca5a0 0x7fba4815a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:05.713 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.709+0000 7fba4efe4640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fba480c8df0 con 0x7fba480c6e00 2024-04-26T23:41:05.713 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.709+0000 7fba4efe4640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7fba4815a6e0 con 0x7fba480ca5a0 2024-04-26T23:41:05.713 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.709+0000 7fba4efe4640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fba480c9100 con 0x7fba48154160 2024-04-26T23:41:05.713 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.709+0000 7fba47fff640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fba480ca5a0 0x7fba4815a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:05.713 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.709+0000 7fba47fff640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fba480ca5a0 0x7fba4815a1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:48726/0 (socket says 172.21.15.88:48726) 2024-04-26T23:41:05.713 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.709+0000 7fba47fff640 1 -- 172.21.15.88:0/935042493 learned_addr learned my addr 172.21.15.88:0/935042493 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:41:05.713 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.710+0000 7fba47fff640 1 -- 172.21.15.88:0/935042493 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fba48154160 msgr2=0x7fba48156bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:41:05.713 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.710+0000 7fba47fff640 1 --2- 172.21.15.88:0/935042493 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fba48154160 0x7fba48156bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:05.713 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.710+0000 7fba47fff640 1 -- 172.21.15.88:0/935042493 >> v1:172.21.15.175:6789/0 conn(0x7fba480c6e00 legacy=0x7fba480c9590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:41:05.714 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.710+0000 7fba47fff640 1 -- 172.21.15.88:0/935042493 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba48154540 con 0x7fba480ca5a0 2024-04-26T23:41:05.714 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.710+0000 7fba47fff640 1 --2- 172.21.15.88:0/935042493 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fba480ca5a0 0x7fba4815a1a0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fba3c009870 tx=0x7fba3c02a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10996785cc51d16a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:05.715 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.710+0000 7fba477fe640 1 -- 172.21.15.88:0/935042493 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba3c037070 con 0x7fba480ca5a0 2024-04-26T23:41:05.715 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.710+0000 7fba477fe640 1 -- 172.21.15.88:0/935042493 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba3c032440 con 0x7fba480ca5a0 2024-04-26T23:41:05.715 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.710+0000 7fba477fe640 1 -- 172.21.15.88:0/935042493 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba3c032810 con 0x7fba480ca5a0 2024-04-26T23:41:05.715 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.711+0000 7fba4efe4640 1 -- 172.21.15.88:0/935042493 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fba480ca5a0 msgr2=0x7fba4815a1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:05.715 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.711+0000 7fba4efe4640 1 --2- 172.21.15.88:0/935042493 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fba480ca5a0 0x7fba4815a1a0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fba3c009870 tx=0x7fba3c02a210 comp rx=0 tx=0).stop 2024-04-26T23:41:05.715 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.711+0000 7fba4efe4640 1 -- 172.21.15.88:0/935042493 shutdown_connections 2024-04-26T23:41:05.715 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.711+0000 7fba4efe4640 1 --2- 172.21.15.88:0/935042493 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fba480ca5a0 0x7fba4815a1a0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:05.715 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.711+0000 7fba4efe4640 1 --2- 172.21.15.88:0/935042493 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fba48154160 0x7fba48156bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:05.715 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.711+0000 7fba4efe4640 1 -- 172.21.15.88:0/935042493 >> 172.21.15.88:0/935042493 conn(0x7fba480ae010 msgr2=0x7fba480ae3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:05.716 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.711+0000 7fba4efe4640 1 -- 172.21.15.88:0/935042493 shutdown_connections 2024-04-26T23:41:05.716 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.711+0000 7fba4efe4640 1 -- 172.21.15.88:0/935042493 wait complete. 2024-04-26T23:41:05.716 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.712+0000 7fba4efe4640 1 Processor -- start 2024-04-26T23:41:05.716 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.712+0000 7fba4efe4640 1 -- start start 2024-04-26T23:41:05.718 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.713+0000 7fba4efe4640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fba480c6e00 0x7fba480c2910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:05.718 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.713+0000 7fba4efe4640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fba480ca5a0 0x7fba4814d840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:05.718 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.713+0000 7fba4efe4640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fba48154160 0x7fba4814dd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:05.718 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.713+0000 7fba4efe4640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fba4815aed0 con 0x7fba48154160 2024-04-26T23:41:05.718 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.713+0000 7fba4efe4640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fba4815abf0 con 0x7fba480ca5a0 2024-04-26T23:41:05.718 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.713+0000 7fba4efe4640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fba480c9ca0 con 0x7fba480c6e00 2024-04-26T23:41:05.718 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.713+0000 7fba4d581640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fba48154160 0x7fba4814dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:05.718 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.713+0000 7fba4d581640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fba48154160 0x7fba4814dd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:48732/0 (socket says 172.21.15.88:48732) 2024-04-26T23:41:05.718 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.713+0000 7fba4d581640 1 -- 172.21.15.88:0/3507396737 learned_addr learned my addr 172.21.15.88:0/3507396737 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:41:05.719 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.713+0000 7fba4cd80640 1 --2- 172.21.15.88:0/3507396737 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fba480c6e00 0x7fba480c2910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:05.719 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.713+0000 7fba47fff640 1 --2- 172.21.15.88:0/3507396737 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fba480ca5a0 0x7fba4814d840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:05.719 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.713+0000 7fba4d581640 1 -- 172.21.15.88:0/3507396737 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fba480c6e00 msgr2=0x7fba480c2910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:05.719 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.713+0000 7fba4d581640 1 --2- 172.21.15.88:0/3507396737 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fba480c6e00 0x7fba480c2910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:05.719 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.713+0000 7fba4d581640 1 -- 172.21.15.88:0/3507396737 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fba480ca5a0 msgr2=0x7fba4814d840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:05.719 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.713+0000 7fba4d581640 1 --2- 172.21.15.88:0/3507396737 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fba480ca5a0 0x7fba4814d840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:05.719 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.713+0000 7fba4d581640 1 -- 172.21.15.88:0/3507396737 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba481ed740 con 0x7fba48154160 2024-04-26T23:41:05.719 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.714+0000 7fba4d581640 1 --2- 172.21.15.88:0/3507396737 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fba48154160 0x7fba4814dd80 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fba4000c780 tx=0x7fba4000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:05.719 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.714+0000 7fba457fa640 1 -- 172.21.15.88:0/3507396737 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba40004b60 con 0x7fba48154160 2024-04-26T23:41:05.719 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.714+0000 7fba457fa640 1 -- 172.21.15.88:0/3507396737 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba40004d00 con 0x7fba48154160 2024-04-26T23:41:05.719 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.714+0000 7fba457fa640 1 -- 172.21.15.88:0/3507396737 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba4000aa90 con 0x7fba48154160 2024-04-26T23:41:05.719 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.714+0000 7fba4efe4640 1 -- 172.21.15.88:0/3507396737 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba481eda20 con 0x7fba48154160 2024-04-26T23:41:05.719 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.714+0000 7fba4efe4640 1 -- 172.21.15.88:0/3507396737 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba480c0330 con 0x7fba48154160 2024-04-26T23:41:05.719 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.715+0000 7fba4efe4640 1 -- 172.21.15.88:0/3507396737 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba48076650 con 0x7fba48154160 2024-04-26T23:41:05.719 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.715+0000 7fba457fa640 1 -- 172.21.15.88:0/3507396737 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fba4000ac30 con 0x7fba48154160 2024-04-26T23:41:05.720 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.716+0000 7fba457fa640 1 --2- 172.21.15.88:0/3507396737 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fba3406c8f0 0x7fba3406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:05.720 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.716+0000 7fba4cd80640 1 --2- 172.21.15.88:0/3507396737 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fba3406c8f0 0x7fba3406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:05.720 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.716+0000 7fba457fa640 1 -- 172.21.15.88:0/3507396737 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7fba4008c0f0 con 0x7fba48154160 2024-04-26T23:41:05.720 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.716+0000 7fba4cd80640 1 --2- 172.21.15.88:0/3507396737 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fba3406c8f0 0x7fba3406edb0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fba3800a770 tx=0x7fba38008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:05.723 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.720+0000 7fba457fa640 1 -- 172.21.15.88:0/3507396737 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fba40020070 con 0x7fba48154160 2024-04-26T23:41:05.897 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.894+0000 7fba4efe4640 1 -- 172.21.15.88:0/3507396737 --> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fba480addf0 con 0x7fba3406c8f0 2024-04-26T23:41:05.908 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.905+0000 7fba457fa640 1 -- 172.21.15.88:0/3507396737 <== mgr.4104 v2:172.21.15.88:6832/651674297 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+490297 (secure 0 0 0) 0x7fba480addf0 con 0x7fba3406c8f0 2024-04-26T23:41:05.914 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-26T23:41:05.917 INFO:teuthology.orchestra.run.smithi088.stderr:dumped all 2024-04-26T23:41:05.919 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.909+0000 7fba4efe4640 1 -- 172.21.15.88:0/3507396737 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fba3406c8f0 msgr2=0x7fba3406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:05.919 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.909+0000 7fba4efe4640 1 --2- 172.21.15.88:0/3507396737 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fba3406c8f0 0x7fba3406edb0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fba3800a770 tx=0x7fba38008040 comp rx=0 tx=0).stop 2024-04-26T23:41:05.919 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.909+0000 7fba4efe4640 1 -- 172.21.15.88:0/3507396737 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fba48154160 msgr2=0x7fba4814dd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:05.919 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.909+0000 7fba4efe4640 1 --2- 172.21.15.88:0/3507396737 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fba48154160 0x7fba4814dd80 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fba4000c780 tx=0x7fba4000cc40 comp rx=0 tx=0).stop 2024-04-26T23:41:05.919 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.909+0000 7fba4efe4640 1 -- 172.21.15.88:0/3507396737 shutdown_connections 2024-04-26T23:41:05.919 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.909+0000 7fba4efe4640 1 --2- 172.21.15.88:0/3507396737 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fba3406c8f0 0x7fba3406edb0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:05.919 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.909+0000 7fba4efe4640 1 --2- 172.21.15.88:0/3507396737 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fba48154160 0x7fba4814dd80 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:05.919 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.909+0000 7fba4efe4640 1 --2- 172.21.15.88:0/3507396737 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fba480ca5a0 0x7fba4814d840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:05.919 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.909+0000 7fba4efe4640 1 --2- 172.21.15.88:0/3507396737 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fba480c6e00 0x7fba480c2910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:05.919 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.909+0000 7fba4efe4640 1 -- 172.21.15.88:0/3507396737 >> 172.21.15.88:0/3507396737 conn(0x7fba480ae010 msgr2=0x7fba480cb7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:05.920 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.910+0000 7fba4efe4640 1 -- 172.21.15.88:0/3507396737 shutdown_connections 2024-04-26T23:41:05.920 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:05.910+0000 7fba4efe4640 1 -- 172.21.15.88:0/3507396737 wait complete. 2024-04-26T23:41:05.923 INFO:teuthology.orchestra.run.smithi088.stdout:{"pg_ready":true,"pg_map":{"version":40,"stamp":"2024-04-26T23:41:03.928879+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595188,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":249,"num_write_kb":2444,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":195,"ondisk_log_size":195,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":386,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219460,"kb_used_data":3272,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755260,"statfs":{"total":773094113280,"available":772869386240,"internally_reserved":0,"allocated":3350528,"data_stored":1984464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002471"},"pg_stats":[{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636272+0000","last_change":"2024-04-26T23:40:41.683801+0000","last_active":"2024-04-26T23:40:43.636272+0000","last_peered":"2024-04-26T23:40:43.636272+0000","last_clean":"2024-04-26T23:40:43.636272+0000","last_became_active":"2024-04-26T23:40:41.683484+0000","last_became_peered":"2024-04-26T23:40:41.683484+0000","last_unstale":"2024-04-26T23:40:43.636272+0000","last_undegraded":"2024-04-26T23:40:43.636272+0000","last_fullsized":"2024-04-26T23:40:43.636272+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:02:27.160408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":26,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.686904+0000","last_change":"2024-04-26T23:40:31.576688+0000","last_active":"2024-04-26T23:40:42.686904+0000","last_peered":"2024-04-26T23:40:42.686904+0000","last_clean":"2024-04-26T23:40:42.686904+0000","last_became_active":"2024-04-26T23:40:31.576429+0000","last_became_peered":"2024-04-26T23:40:31.576429+0000","last_unstale":"2024-04-26T23:40:42.686904+0000","last_undegraded":"2024-04-26T23:40:42.686904+0000","last_fullsized":"2024-04-26T23:40:42.686904+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:47:42.681376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.637858+0000","last_change":"2024-04-26T23:40:32.578489+0000","last_active":"2024-04-26T23:40:43.637858+0000","last_peered":"2024-04-26T23:40:43.637858+0000","last_clean":"2024-04-26T23:40:43.637858+0000","last_became_active":"2024-04-26T23:40:32.578205+0000","last_became_peered":"2024-04-26T23:40:32.578205+0000","last_unstale":"2024-04-26T23:40:43.637858+0000","last_undegraded":"2024-04-26T23:40:43.637858+0000","last_fullsized":"2024-04-26T23:40:43.637858+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:56:04.309611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636964+0000","last_change":"2024-04-26T23:40:40.666861+0000","last_active":"2024-04-26T23:40:43.636964+0000","last_peered":"2024-04-26T23:40:43.636964+0000","last_clean":"2024-04-26T23:40:43.636964+0000","last_became_active":"2024-04-26T23:40:40.666547+0000","last_became_peered":"2024-04-26T23:40:40.666547+0000","last_unstale":"2024-04-26T23:40:43.636964+0000","last_undegraded":"2024-04-26T23:40:43.636964+0000","last_fullsized":"2024-04-26T23:40:43.636964+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:27:47.818055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.635388+0000","last_change":"2024-04-26T23:40:41.689530+0000","last_active":"2024-04-26T23:40:43.635388+0000","last_peered":"2024-04-26T23:40:43.635388+0000","last_clean":"2024-04-26T23:40:43.635388+0000","last_became_active":"2024-04-26T23:40:41.687652+0000","last_became_peered":"2024-04-26T23:40:41.687652+0000","last_unstale":"2024-04-26T23:40:43.635388+0000","last_undegraded":"2024-04-26T23:40:43.635388+0000","last_fullsized":"2024-04-26T23:40:43.635388+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:58:45.972045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.637959+0000","last_change":"2024-04-26T23:40:31.576867+0000","last_active":"2024-04-26T23:40:43.637959+0000","last_peered":"2024-04-26T23:40:43.637959+0000","last_clean":"2024-04-26T23:40:43.637959+0000","last_became_active":"2024-04-26T23:40:31.576342+0000","last_became_peered":"2024-04-26T23:40:31.576342+0000","last_unstale":"2024-04-26T23:40:43.637959+0000","last_undegraded":"2024-04-26T23:40:43.637959+0000","last_fullsized":"2024-04-26T23:40:43.637959+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:35:54.439397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.686802+0000","last_change":"2024-04-26T23:40:32.589769+0000","last_active":"2024-04-26T23:40:42.686802+0000","last_peered":"2024-04-26T23:40:42.686802+0000","last_clean":"2024-04-26T23:40:42.686802+0000","last_became_active":"2024-04-26T23:40:32.589489+0000","last_became_peered":"2024-04-26T23:40:32.589489+0000","last_unstale":"2024-04-26T23:40:42.686802+0000","last_undegraded":"2024-04-26T23:40:42.686802+0000","last_fullsized":"2024-04-26T23:40:42.686802+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:40:17.167353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636746+0000","last_change":"2024-04-26T23:40:40.672310+0000","last_active":"2024-04-26T23:40:43.636746+0000","last_peered":"2024-04-26T23:40:43.636746+0000","last_clean":"2024-04-26T23:40:43.636746+0000","last_became_active":"2024-04-26T23:40:40.672018+0000","last_became_peered":"2024-04-26T23:40:40.672018+0000","last_unstale":"2024-04-26T23:40:43.636746+0000","last_undegraded":"2024-04-26T23:40:43.636746+0000","last_fullsized":"2024-04-26T23:40:43.636746+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:01:10.835670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636004+0000","last_change":"2024-04-26T23:40:41.686743+0000","last_active":"2024-04-26T23:40:43.636004+0000","last_peered":"2024-04-26T23:40:43.636004+0000","last_clean":"2024-04-26T23:40:43.636004+0000","last_became_active":"2024-04-26T23:40:41.686419+0000","last_became_peered":"2024-04-26T23:40:41.686419+0000","last_unstale":"2024-04-26T23:40:43.636004+0000","last_undegraded":"2024-04-26T23:40:43.636004+0000","last_fullsized":"2024-04-26T23:40:43.636004+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:08:35.027584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.637221+0000","last_change":"2024-04-26T23:40:31.578735+0000","last_active":"2024-04-26T23:40:43.637221+0000","last_peered":"2024-04-26T23:40:43.637221+0000","last_clean":"2024-04-26T23:40:43.637221+0000","last_became_active":"2024-04-26T23:40:31.578438+0000","last_became_peered":"2024-04-26T23:40:31.578438+0000","last_unstale":"2024-04-26T23:40:43.637221+0000","last_undegraded":"2024-04-26T23:40:43.637221+0000","last_fullsized":"2024-04-26T23:40:43.637221+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:30:10.397569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.685239+0000","last_change":"2024-04-26T23:40:32.590624+0000","last_active":"2024-04-26T23:40:42.685239+0000","last_peered":"2024-04-26T23:40:42.685239+0000","last_clean":"2024-04-26T23:40:42.685239+0000","last_became_active":"2024-04-26T23:40:32.589687+0000","last_became_peered":"2024-04-26T23:40:32.589687+0000","last_unstale":"2024-04-26T23:40:42.685239+0000","last_undegraded":"2024-04-26T23:40:42.685239+0000","last_fullsized":"2024-04-26T23:40:42.685239+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:01:02.741964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"23'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.637058+0000","last_change":"2024-04-26T23:40:40.677899+0000","last_active":"2024-04-26T23:40:43.637058+0000","last_peered":"2024-04-26T23:40:43.637058+0000","last_clean":"2024-04-26T23:40:43.637058+0000","last_became_active":"2024-04-26T23:40:40.677388+0000","last_became_peered":"2024-04-26T23:40:40.677388+0000","last_unstale":"2024-04-26T23:40:43.637058+0000","last_undegraded":"2024-04-26T23:40:43.637058+0000","last_fullsized":"2024-04-26T23:40:43.637058+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:52:34.793496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.684740+0000","last_change":"2024-04-26T23:40:41.680097+0000","last_active":"2024-04-26T23:40:42.684740+0000","last_peered":"2024-04-26T23:40:42.684740+0000","last_clean":"2024-04-26T23:40:42.684740+0000","last_became_active":"2024-04-26T23:40:41.679815+0000","last_became_peered":"2024-04-26T23:40:41.679815+0000","last_unstale":"2024-04-26T23:40:42.684740+0000","last_undegraded":"2024-04-26T23:40:42.684740+0000","last_fullsized":"2024-04-26T23:40:42.684740+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:10:30.972726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636837+0000","last_change":"2024-04-26T23:40:31.573648+0000","last_active":"2024-04-26T23:40:43.636837+0000","last_peered":"2024-04-26T23:40:43.636837+0000","last_clean":"2024-04-26T23:40:43.636837+0000","last_became_active":"2024-04-26T23:40:31.573347+0000","last_became_peered":"2024-04-26T23:40:31.573347+0000","last_unstale":"2024-04-26T23:40:43.636837+0000","last_undegraded":"2024-04-26T23:40:43.636837+0000","last_fullsized":"2024-04-26T23:40:43.636837+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:20:28.103413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.685588+0000","last_change":"2024-04-26T23:40:32.588309+0000","last_active":"2024-04-26T23:40:42.685588+0000","last_peered":"2024-04-26T23:40:42.685588+0000","last_clean":"2024-04-26T23:40:42.685588+0000","last_became_active":"2024-04-26T23:40:32.588007+0000","last_became_peered":"2024-04-26T23:40:32.588007+0000","last_unstale":"2024-04-26T23:40:42.685588+0000","last_undegraded":"2024-04-26T23:40:42.685588+0000","last_fullsized":"2024-04-26T23:40:42.685588+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:52:26.699790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"23'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636105+0000","last_change":"2024-04-26T23:40:40.678547+0000","last_active":"2024-04-26T23:40:43.636105+0000","last_peered":"2024-04-26T23:40:43.636105+0000","last_clean":"2024-04-26T23:40:43.636105+0000","last_became_active":"2024-04-26T23:40:40.677668+0000","last_became_peered":"2024-04-26T23:40:40.677668+0000","last_unstale":"2024-04-26T23:40:43.636105+0000","last_undegraded":"2024-04-26T23:40:43.636105+0000","last_fullsized":"2024-04-26T23:40:43.636105+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:34:22.905623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636105+0000","last_change":"2024-04-26T23:40:41.689525+0000","last_active":"2024-04-26T23:40:43.636105+0000","last_peered":"2024-04-26T23:40:43.636105+0000","last_clean":"2024-04-26T23:40:43.636105+0000","last_became_active":"2024-04-26T23:40:41.687433+0000","last_became_peered":"2024-04-26T23:40:41.687433+0000","last_unstale":"2024-04-26T23:40:43.636105+0000","last_undegraded":"2024-04-26T23:40:43.636105+0000","last_fullsized":"2024-04-26T23:40:43.636105+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:38:42.155257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.684004+0000","last_change":"2024-04-26T23:40:32.590053+0000","last_active":"2024-04-26T23:40:42.684004+0000","last_peered":"2024-04-26T23:40:42.684004+0000","last_clean":"2024-04-26T23:40:42.684004+0000","last_became_active":"2024-04-26T23:40:32.589802+0000","last_became_peered":"2024-04-26T23:40:32.589802+0000","last_unstale":"2024-04-26T23:40:42.684004+0000","last_undegraded":"2024-04-26T23:40:42.684004+0000","last_fullsized":"2024-04-26T23:40:42.684004+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:16:46.547536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636775+0000","last_change":"2024-04-26T23:40:31.578524+0000","last_active":"2024-04-26T23:40:43.636775+0000","last_peered":"2024-04-26T23:40:43.636775+0000","last_clean":"2024-04-26T23:40:43.636775+0000","last_became_active":"2024-04-26T23:40:31.578230+0000","last_became_peered":"2024-04-26T23:40:31.578230+0000","last_unstale":"2024-04-26T23:40:43.636775+0000","last_undegraded":"2024-04-26T23:40:43.636775+0000","last_fullsized":"2024-04-26T23:40:43.636775+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:15:51.937774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"23'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636197+0000","last_change":"2024-04-26T23:40:40.676459+0000","last_active":"2024-04-26T23:40:43.636197+0000","last_peered":"2024-04-26T23:40:43.636197+0000","last_clean":"2024-04-26T23:40:43.636197+0000","last_became_active":"2024-04-26T23:40:40.675997+0000","last_became_peered":"2024-04-26T23:40:40.675997+0000","last_unstale":"2024-04-26T23:40:43.636197+0000","last_undegraded":"2024-04-26T23:40:43.636197+0000","last_fullsized":"2024-04-26T23:40:43.636197+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:37:38.455501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.635973+0000","last_change":"2024-04-26T23:40:41.679334+0000","last_active":"2024-04-26T23:40:43.635973+0000","last_peered":"2024-04-26T23:40:43.635973+0000","last_clean":"2024-04-26T23:40:43.635973+0000","last_became_active":"2024-04-26T23:40:41.679098+0000","last_became_peered":"2024-04-26T23:40:41.679098+0000","last_unstale":"2024-04-26T23:40:43.635973+0000","last_undegraded":"2024-04-26T23:40:43.635973+0000","last_fullsized":"2024-04-26T23:40:43.635973+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:52:35.798951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.637449+0000","last_change":"2024-04-26T23:40:32.585827+0000","last_active":"2024-04-26T23:40:43.637449+0000","last_peered":"2024-04-26T23:40:43.637449+0000","last_clean":"2024-04-26T23:40:43.637449+0000","last_became_active":"2024-04-26T23:40:32.585522+0000","last_became_peered":"2024-04-26T23:40:32.585522+0000","last_unstale":"2024-04-26T23:40:43.637449+0000","last_undegraded":"2024-04-26T23:40:43.637449+0000","last_fullsized":"2024-04-26T23:40:43.637449+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:40:17.167353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.635887+0000","last_change":"2024-04-26T23:40:31.575121+0000","last_active":"2024-04-26T23:40:43.635887+0000","last_peered":"2024-04-26T23:40:43.635887+0000","last_clean":"2024-04-26T23:40:43.635887+0000","last_became_active":"2024-04-26T23:40:31.574827+0000","last_became_peered":"2024-04-26T23:40:31.574827+0000","last_unstale":"2024-04-26T23:40:43.635887+0000","last_undegraded":"2024-04-26T23:40:43.635887+0000","last_fullsized":"2024-04-26T23:40:43.635887+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:43:13.740214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636996+0000","last_change":"2024-04-26T23:40:40.678613+0000","last_active":"2024-04-26T23:40:43.636996+0000","last_peered":"2024-04-26T23:40:43.636996+0000","last_clean":"2024-04-26T23:40:43.636996+0000","last_became_active":"2024-04-26T23:40:40.677867+0000","last_became_peered":"2024-04-26T23:40:40.677867+0000","last_unstale":"2024-04-26T23:40:43.636996+0000","last_undegraded":"2024-04-26T23:40:43.636996+0000","last_fullsized":"2024-04-26T23:40:43.636996+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:35:16.288571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636503+0000","last_change":"2024-04-26T23:40:41.685042+0000","last_active":"2024-04-26T23:40:43.636503+0000","last_peered":"2024-04-26T23:40:43.636503+0000","last_clean":"2024-04-26T23:40:43.636503+0000","last_became_active":"2024-04-26T23:40:41.684699+0000","last_became_peered":"2024-04-26T23:40:41.684699+0000","last_unstale":"2024-04-26T23:40:43.636503+0000","last_undegraded":"2024-04-26T23:40:43.636503+0000","last_fullsized":"2024-04-26T23:40:43.636503+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:10:57.826183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636873+0000","last_change":"2024-04-26T23:40:32.582721+0000","last_active":"2024-04-26T23:40:43.636873+0000","last_peered":"2024-04-26T23:40:43.636873+0000","last_clean":"2024-04-26T23:40:43.636873+0000","last_became_active":"2024-04-26T23:40:32.582438+0000","last_became_peered":"2024-04-26T23:40:32.582438+0000","last_unstale":"2024-04-26T23:40:43.636873+0000","last_undegraded":"2024-04-26T23:40:43.636873+0000","last_fullsized":"2024-04-26T23:40:43.636873+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:38:10.884592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.635560+0000","last_change":"2024-04-26T23:40:31.575508+0000","last_active":"2024-04-26T23:40:43.635560+0000","last_peered":"2024-04-26T23:40:43.635560+0000","last_clean":"2024-04-26T23:40:43.635560+0000","last_became_active":"2024-04-26T23:40:31.575242+0000","last_became_peered":"2024-04-26T23:40:31.575242+0000","last_unstale":"2024-04-26T23:40:43.635560+0000","last_undegraded":"2024-04-26T23:40:43.635560+0000","last_fullsized":"2024-04-26T23:40:43.635560+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:48:32.015654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"23'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636104+0000","last_change":"2024-04-26T23:40:40.679196+0000","last_active":"2024-04-26T23:40:43.636104+0000","last_peered":"2024-04-26T23:40:43.636104+0000","last_clean":"2024-04-26T23:40:43.636104+0000","last_became_active":"2024-04-26T23:40:40.678740+0000","last_became_peered":"2024-04-26T23:40:40.678740+0000","last_unstale":"2024-04-26T23:40:43.636104+0000","last_undegraded":"2024-04-26T23:40:43.636104+0000","last_fullsized":"2024-04-26T23:40:43.636104+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:40:14.479631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.685673+0000","last_change":"2024-04-26T23:40:41.686638+0000","last_active":"2024-04-26T23:40:42.685673+0000","last_peered":"2024-04-26T23:40:42.685673+0000","last_clean":"2024-04-26T23:40:42.685673+0000","last_became_active":"2024-04-26T23:40:41.686354+0000","last_became_peered":"2024-04-26T23:40:41.686354+0000","last_unstale":"2024-04-26T23:40:42.685673+0000","last_undegraded":"2024-04-26T23:40:42.685673+0000","last_fullsized":"2024-04-26T23:40:42.685673+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:06:12.755431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.637002+0000","last_change":"2024-04-26T23:40:32.583019+0000","last_active":"2024-04-26T23:40:43.637002+0000","last_peered":"2024-04-26T23:40:43.637002+0000","last_clean":"2024-04-26T23:40:43.637002+0000","last_became_active":"2024-04-26T23:40:32.582719+0000","last_became_peered":"2024-04-26T23:40:32.582719+0000","last_unstale":"2024-04-26T23:40:43.637002+0000","last_undegraded":"2024-04-26T23:40:43.637002+0000","last_fullsized":"2024-04-26T23:40:43.637002+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:25:02.319783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.635607+0000","last_change":"2024-04-26T23:40:31.576866+0000","last_active":"2024-04-26T23:40:43.635607+0000","last_peered":"2024-04-26T23:40:43.635607+0000","last_clean":"2024-04-26T23:40:43.635607+0000","last_became_active":"2024-04-26T23:40:31.576419+0000","last_became_peered":"2024-04-26T23:40:31.576419+0000","last_unstale":"2024-04-26T23:40:43.635607+0000","last_undegraded":"2024-04-26T23:40:43.635607+0000","last_fullsized":"2024-04-26T23:40:43.635607+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:45:49.295198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"23'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636623+0000","last_change":"2024-04-26T23:40:40.675262+0000","last_active":"2024-04-26T23:40:43.636623+0000","last_peered":"2024-04-26T23:40:43.636623+0000","last_clean":"2024-04-26T23:40:43.636623+0000","last_became_active":"2024-04-26T23:40:40.674721+0000","last_became_peered":"2024-04-26T23:40:40.674721+0000","last_unstale":"2024-04-26T23:40:43.636623+0000","last_undegraded":"2024-04-26T23:40:43.636623+0000","last_fullsized":"2024-04-26T23:40:43.636623+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:56:12.403317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.635271+0000","last_change":"2024-04-26T23:40:41.691494+0000","last_active":"2024-04-26T23:40:43.635271+0000","last_peered":"2024-04-26T23:40:43.635271+0000","last_clean":"2024-04-26T23:40:43.635271+0000","last_became_active":"2024-04-26T23:40:41.691241+0000","last_became_peered":"2024-04-26T23:40:41.691241+0000","last_unstale":"2024-04-26T23:40:43.635271+0000","last_undegraded":"2024-04-26T23:40:43.635271+0000","last_fullsized":"2024-04-26T23:40:43.635271+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:08:35.027584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.687075+0000","last_change":"2024-04-26T23:40:32.584988+0000","last_active":"2024-04-26T23:40:42.687075+0000","last_peered":"2024-04-26T23:40:42.687075+0000","last_clean":"2024-04-26T23:40:42.687075+0000","last_became_active":"2024-04-26T23:40:32.584467+0000","last_became_peered":"2024-04-26T23:40:32.584467+0000","last_unstale":"2024-04-26T23:40:42.687075+0000","last_undegraded":"2024-04-26T23:40:42.687075+0000","last_fullsized":"2024-04-26T23:40:42.687075+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:51:30.677247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.684365+0000","last_change":"2024-04-26T23:40:31.573721+0000","last_active":"2024-04-26T23:40:42.684365+0000","last_peered":"2024-04-26T23:40:42.684365+0000","last_clean":"2024-04-26T23:40:42.684365+0000","last_became_active":"2024-04-26T23:40:31.573434+0000","last_became_peered":"2024-04-26T23:40:31.573434+0000","last_unstale":"2024-04-26T23:40:42.684365+0000","last_undegraded":"2024-04-26T23:40:42.684365+0000","last_fullsized":"2024-04-26T23:40:42.684365+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:20:28.103413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636650+0000","last_change":"2024-04-26T23:40:40.678020+0000","last_active":"2024-04-26T23:40:43.636650+0000","last_peered":"2024-04-26T23:40:43.636650+0000","last_clean":"2024-04-26T23:40:43.636650+0000","last_became_active":"2024-04-26T23:40:40.677410+0000","last_became_peered":"2024-04-26T23:40:40.677410+0000","last_unstale":"2024-04-26T23:40:43.636650+0000","last_undegraded":"2024-04-26T23:40:43.636650+0000","last_fullsized":"2024-04-26T23:40:43.636650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:44:50.588556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.635487+0000","last_change":"2024-04-26T23:40:41.689839+0000","last_active":"2024-04-26T23:40:43.635487+0000","last_peered":"2024-04-26T23:40:43.635487+0000","last_clean":"2024-04-26T23:40:43.635487+0000","last_became_active":"2024-04-26T23:40:41.689508+0000","last_became_peered":"2024-04-26T23:40:41.689508+0000","last_unstale":"2024-04-26T23:40:43.635487+0000","last_undegraded":"2024-04-26T23:40:43.635487+0000","last_fullsized":"2024-04-26T23:40:43.635487+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:17:28.672777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.637978+0000","last_change":"2024-04-26T23:40:32.594913+0000","last_active":"2024-04-26T23:40:43.637978+0000","last_peered":"2024-04-26T23:40:43.637978+0000","last_clean":"2024-04-26T23:40:43.637978+0000","last_became_active":"2024-04-26T23:40:32.594616+0000","last_became_peered":"2024-04-26T23:40:32.594616+0000","last_unstale":"2024-04-26T23:40:43.637978+0000","last_undegraded":"2024-04-26T23:40:43.637978+0000","last_fullsized":"2024-04-26T23:40:43.637978+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:04:30.553552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636386+0000","last_change":"2024-04-26T23:40:31.576299+0000","last_active":"2024-04-26T23:40:43.636386+0000","last_peered":"2024-04-26T23:40:43.636386+0000","last_clean":"2024-04-26T23:40:43.636386+0000","last_became_active":"2024-04-26T23:40:31.576006+0000","last_became_peered":"2024-04-26T23:40:31.576006+0000","last_unstale":"2024-04-26T23:40:43.636386+0000","last_undegraded":"2024-04-26T23:40:43.636386+0000","last_fullsized":"2024-04-26T23:40:43.636386+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:15:51.937774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.635376+0000","last_change":"2024-04-26T23:40:40.674806+0000","last_active":"2024-04-26T23:40:43.635376+0000","last_peered":"2024-04-26T23:40:43.635376+0000","last_clean":"2024-04-26T23:40:43.635376+0000","last_became_active":"2024-04-26T23:40:40.674557+0000","last_became_peered":"2024-04-26T23:40:40.674557+0000","last_unstale":"2024-04-26T23:40:43.635376+0000","last_undegraded":"2024-04-26T23:40:43.635376+0000","last_fullsized":"2024-04-26T23:40:43.635376+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:45:33.226487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.683778+0000","last_change":"2024-04-26T23:40:41.688941+0000","last_active":"2024-04-26T23:40:42.683778+0000","last_peered":"2024-04-26T23:40:42.683778+0000","last_clean":"2024-04-26T23:40:42.683778+0000","last_became_active":"2024-04-26T23:40:41.688653+0000","last_became_peered":"2024-04-26T23:40:41.688653+0000","last_unstale":"2024-04-26T23:40:42.683778+0000","last_undegraded":"2024-04-26T23:40:42.683778+0000","last_fullsized":"2024-04-26T23:40:42.683778+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:53:13.531466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636366+0000","last_change":"2024-04-26T23:40:32.582442+0000","last_active":"2024-04-26T23:40:43.636366+0000","last_peered":"2024-04-26T23:40:43.636366+0000","last_clean":"2024-04-26T23:40:43.636366+0000","last_became_active":"2024-04-26T23:40:32.582140+0000","last_became_peered":"2024-04-26T23:40:32.582140+0000","last_unstale":"2024-04-26T23:40:43.636366+0000","last_undegraded":"2024-04-26T23:40:43.636366+0000","last_fullsized":"2024-04-26T23:40:43.636366+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:18:09.706875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.637335+0000","last_change":"2024-04-26T23:40:31.576565+0000","last_active":"2024-04-26T23:40:43.637335+0000","last_peered":"2024-04-26T23:40:43.637335+0000","last_clean":"2024-04-26T23:40:43.637335+0000","last_became_active":"2024-04-26T23:40:31.576313+0000","last_became_peered":"2024-04-26T23:40:31.576313+0000","last_unstale":"2024-04-26T23:40:43.637335+0000","last_undegraded":"2024-04-26T23:40:43.637335+0000","last_fullsized":"2024-04-26T23:40:43.637335+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:25:01.315397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.686609+0000","last_change":"2024-04-26T23:40:40.671047+0000","last_active":"2024-04-26T23:40:42.686609+0000","last_peered":"2024-04-26T23:40:42.686609+0000","last_clean":"2024-04-26T23:40:42.686609+0000","last_became_active":"2024-04-26T23:40:40.670630+0000","last_became_peered":"2024-04-26T23:40:40.670630+0000","last_unstale":"2024-04-26T23:40:42.686609+0000","last_undegraded":"2024-04-26T23:40:42.686609+0000","last_fullsized":"2024-04-26T23:40:42.686609+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:45:07.071050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.686921+0000","last_change":"2024-04-26T23:40:41.686221+0000","last_active":"2024-04-26T23:40:42.686921+0000","last_peered":"2024-04-26T23:40:42.686921+0000","last_clean":"2024-04-26T23:40:42.686921+0000","last_became_active":"2024-04-26T23:40:41.685961+0000","last_became_peered":"2024-04-26T23:40:41.685961+0000","last_unstale":"2024-04-26T23:40:42.686921+0000","last_undegraded":"2024-04-26T23:40:42.686921+0000","last_fullsized":"2024-04-26T23:40:42.686921+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:28:34.920939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.685609+0000","last_change":"2024-04-26T23:40:32.584363+0000","last_active":"2024-04-26T23:40:42.685609+0000","last_peered":"2024-04-26T23:40:42.685609+0000","last_clean":"2024-04-26T23:40:42.685609+0000","last_became_active":"2024-04-26T23:40:32.584082+0000","last_became_peered":"2024-04-26T23:40:32.584082+0000","last_unstale":"2024-04-26T23:40:42.685609+0000","last_undegraded":"2024-04-26T23:40:42.685609+0000","last_fullsized":"2024-04-26T23:40:42.685609+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:35:08.194865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636458+0000","last_change":"2024-04-26T23:40:31.576711+0000","last_active":"2024-04-26T23:40:43.636458+0000","last_peered":"2024-04-26T23:40:43.636458+0000","last_clean":"2024-04-26T23:40:43.636458+0000","last_became_active":"2024-04-26T23:40:31.576404+0000","last_became_peered":"2024-04-26T23:40:31.576404+0000","last_unstale":"2024-04-26T23:40:43.636458+0000","last_undegraded":"2024-04-26T23:40:43.636458+0000","last_fullsized":"2024-04-26T23:40:43.636458+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:45:49.295198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.635616+0000","last_change":"2024-04-26T23:40:40.675296+0000","last_active":"2024-04-26T23:40:43.635616+0000","last_peered":"2024-04-26T23:40:43.635616+0000","last_clean":"2024-04-26T23:40:43.635616+0000","last_became_active":"2024-04-26T23:40:40.674935+0000","last_became_peered":"2024-04-26T23:40:40.674935+0000","last_unstale":"2024-04-26T23:40:43.635616+0000","last_undegraded":"2024-04-26T23:40:43.635616+0000","last_fullsized":"2024-04-26T23:40:43.635616+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:10:10.722905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.686589+0000","last_change":"2024-04-26T23:40:41.691510+0000","last_active":"2024-04-26T23:40:42.686589+0000","last_peered":"2024-04-26T23:40:42.686589+0000","last_clean":"2024-04-26T23:40:42.686589+0000","last_became_active":"2024-04-26T23:40:41.691242+0000","last_became_peered":"2024-04-26T23:40:41.691242+0000","last_unstale":"2024-04-26T23:40:42.686589+0000","last_undegraded":"2024-04-26T23:40:42.686589+0000","last_fullsized":"2024-04-26T23:40:42.686589+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:27:48.823509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.637394+0000","last_change":"2024-04-26T23:40:32.590069+0000","last_active":"2024-04-26T23:40:43.637394+0000","last_peered":"2024-04-26T23:40:43.637394+0000","last_clean":"2024-04-26T23:40:43.637394+0000","last_became_active":"2024-04-26T23:40:32.589790+0000","last_became_peered":"2024-04-26T23:40:32.589790+0000","last_unstale":"2024-04-26T23:40:43.637394+0000","last_undegraded":"2024-04-26T23:40:43.637394+0000","last_fullsized":"2024-04-26T23:40:43.637394+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:15:52.942160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.684776+0000","last_change":"2024-04-26T23:40:31.572432+0000","last_active":"2024-04-26T23:40:42.684776+0000","last_peered":"2024-04-26T23:40:42.684776+0000","last_clean":"2024-04-26T23:40:42.684776+0000","last_became_active":"2024-04-26T23:40:31.572121+0000","last_became_peered":"2024-04-26T23:40:31.572121+0000","last_unstale":"2024-04-26T23:40:42.684776+0000","last_undegraded":"2024-04-26T23:40:42.684776+0000","last_fullsized":"2024-04-26T23:40:42.684776+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:45:49.295198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636314+0000","last_change":"2024-04-26T23:40:40.678404+0000","last_active":"2024-04-26T23:40:43.636314+0000","last_peered":"2024-04-26T23:40:43.636314+0000","last_clean":"2024-04-26T23:40:43.636314+0000","last_became_active":"2024-04-26T23:40:40.678136+0000","last_became_peered":"2024-04-26T23:40:40.678136+0000","last_unstale":"2024-04-26T23:40:43.636314+0000","last_undegraded":"2024-04-26T23:40:43.636314+0000","last_fullsized":"2024-04-26T23:40:43.636314+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:45:11.058699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636232+0000","last_change":"2024-04-26T23:40:41.673542+0000","last_active":"2024-04-26T23:40:43.636232+0000","last_peered":"2024-04-26T23:40:43.636232+0000","last_clean":"2024-04-26T23:40:43.636232+0000","last_became_active":"2024-04-26T23:40:41.673254+0000","last_became_peered":"2024-04-26T23:40:41.673254+0000","last_unstale":"2024-04-26T23:40:43.636232+0000","last_undegraded":"2024-04-26T23:40:43.636232+0000","last_fullsized":"2024-04-26T23:40:43.636232+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:10:11.728359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.635254+0000","last_change":"2024-04-26T23:40:32.576783+0000","last_active":"2024-04-26T23:40:43.635254+0000","last_peered":"2024-04-26T23:40:43.635254+0000","last_clean":"2024-04-26T23:40:43.635254+0000","last_became_active":"2024-04-26T23:40:32.576481+0000","last_became_peered":"2024-04-26T23:40:32.576481+0000","last_unstale":"2024-04-26T23:40:43.635254+0000","last_undegraded":"2024-04-26T23:40:43.635254+0000","last_fullsized":"2024-04-26T23:40:43.635254+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:16:46.547536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.635776+0000","last_change":"2024-04-26T23:40:31.570775+0000","last_active":"2024-04-26T23:40:43.635776+0000","last_peered":"2024-04-26T23:40:43.635776+0000","last_clean":"2024-04-26T23:40:43.635776+0000","last_became_active":"2024-04-26T23:40:31.570493+0000","last_became_peered":"2024-04-26T23:40:31.570493+0000","last_unstale":"2024-04-26T23:40:43.635776+0000","last_undegraded":"2024-04-26T23:40:43.635776+0000","last_fullsized":"2024-04-26T23:40:43.635776+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:45:49.295198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"23'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636208+0000","last_change":"2024-04-26T23:40:40.675115+0000","last_active":"2024-04-26T23:40:43.636208+0000","last_peered":"2024-04-26T23:40:43.636208+0000","last_clean":"2024-04-26T23:40:43.636208+0000","last_became_active":"2024-04-26T23:40:40.674828+0000","last_became_peered":"2024-04-26T23:40:40.674828+0000","last_unstale":"2024-04-26T23:40:43.636208+0000","last_undegraded":"2024-04-26T23:40:43.636208+0000","last_fullsized":"2024-04-26T23:40:43.636208+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:45:07.071050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.685711+0000","last_change":"2024-04-26T23:40:41.691098+0000","last_active":"2024-04-26T23:40:42.685711+0000","last_peered":"2024-04-26T23:40:42.685711+0000","last_clean":"2024-04-26T23:40:42.685711+0000","last_became_active":"2024-04-26T23:40:41.690803+0000","last_became_peered":"2024-04-26T23:40:41.690803+0000","last_unstale":"2024-04-26T23:40:42.685711+0000","last_undegraded":"2024-04-26T23:40:42.685711+0000","last_fullsized":"2024-04-26T23:40:42.685711+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:38:51.195172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.686290+0000","last_change":"2024-04-26T23:40:32.593262+0000","last_active":"2024-04-26T23:40:42.686290+0000","last_peered":"2024-04-26T23:40:42.686290+0000","last_clean":"2024-04-26T23:40:42.686290+0000","last_became_active":"2024-04-26T23:40:32.593003+0000","last_became_peered":"2024-04-26T23:40:32.593003+0000","last_unstale":"2024-04-26T23:40:42.686290+0000","last_undegraded":"2024-04-26T23:40:42.686290+0000","last_fullsized":"2024-04-26T23:40:42.686290+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:47:51.559918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.635660+0000","last_change":"2024-04-26T23:40:31.573864+0000","last_active":"2024-04-26T23:40:43.635660+0000","last_peered":"2024-04-26T23:40:43.635660+0000","last_clean":"2024-04-26T23:40:43.635660+0000","last_became_active":"2024-04-26T23:40:31.573594+0000","last_became_peered":"2024-04-26T23:40:31.573594+0000","last_unstale":"2024-04-26T23:40:43.635660+0000","last_undegraded":"2024-04-26T23:40:43.635660+0000","last_fullsized":"2024-04-26T23:40:43.635660+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:48:32.015654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"24'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.664374+0000","last_change":"2024-04-26T23:40:40.677258+0000","last_active":"2024-04-26T23:40:43.664374+0000","last_peered":"2024-04-26T23:40:43.664374+0000","last_clean":"2024-04-26T23:40:43.664374+0000","last_became_active":"2024-04-26T23:40:40.676937+0000","last_became_peered":"2024-04-26T23:40:40.676937+0000","last_unstale":"2024-04-26T23:40:43.664374+0000","last_undegraded":"2024-04-26T23:40:43.664374+0000","last_fullsized":"2024-04-26T23:40:43.664374+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:44:50.588556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636633+0000","last_change":"2024-04-26T23:40:41.684731+0000","last_active":"2024-04-26T23:40:43.636633+0000","last_peered":"2024-04-26T23:40:43.636633+0000","last_clean":"2024-04-26T23:40:43.636633+0000","last_became_active":"2024-04-26T23:40:41.684459+0000","last_became_peered":"2024-04-26T23:40:41.684459+0000","last_unstale":"2024-04-26T23:40:43.636633+0000","last_undegraded":"2024-04-26T23:40:43.636633+0000","last_fullsized":"2024-04-26T23:40:43.636633+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:24:07.784468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.637233+0000","last_change":"2024-04-26T23:40:32.593216+0000","last_active":"2024-04-26T23:40:43.637233+0000","last_peered":"2024-04-26T23:40:43.637233+0000","last_clean":"2024-04-26T23:40:43.637233+0000","last_became_active":"2024-04-26T23:40:32.592929+0000","last_became_peered":"2024-04-26T23:40:32.592929+0000","last_unstale":"2024-04-26T23:40:43.637233+0000","last_undegraded":"2024-04-26T23:40:43.637233+0000","last_fullsized":"2024-04-26T23:40:43.637233+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:12:45.093169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.684832+0000","last_change":"2024-04-26T23:40:31.570118+0000","last_active":"2024-04-26T23:40:42.684832+0000","last_peered":"2024-04-26T23:40:42.684832+0000","last_clean":"2024-04-26T23:40:42.684832+0000","last_became_active":"2024-04-26T23:40:31.569764+0000","last_became_peered":"2024-04-26T23:40:31.569764+0000","last_unstale":"2024-04-26T23:40:42.684832+0000","last_undegraded":"2024-04-26T23:40:42.684832+0000","last_fullsized":"2024-04-26T23:40:42.684832+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:15:30.884135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":178,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.635784+0000","last_change":"2024-04-26T23:40:20.966672+0000","last_active":"2024-04-26T23:40:43.635784+0000","last_peered":"2024-04-26T23:40:43.635784+0000","last_clean":"2024-04-26T23:40:43.635784+0000","last_became_active":"2024-04-26T23:40:20.963937+0000","last_became_peered":"2024-04-26T23:40:20.963937+0000","last_unstale":"2024-04-26T23:40:43.635784+0000","last_undegraded":"2024-04-26T23:40:43.635784+0000","last_fullsized":"2024-04-26T23:40:43.635784+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:19.950137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:19.950137+0000","last_clean_scrub_stamp":"2024-04-26T23:40:19.950137+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:23:39.166579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.683613+0000","last_change":"2024-04-26T23:40:40.671995+0000","last_active":"2024-04-26T23:40:42.683613+0000","last_peered":"2024-04-26T23:40:42.683613+0000","last_clean":"2024-04-26T23:40:42.683613+0000","last_became_active":"2024-04-26T23:40:40.671642+0000","last_became_peered":"2024-04-26T23:40:40.671642+0000","last_unstale":"2024-04-26T23:40:42.683613+0000","last_undegraded":"2024-04-26T23:40:42.683613+0000","last_fullsized":"2024-04-26T23:40:42.683613+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:35:16.288571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636479+0000","last_change":"2024-04-26T23:40:41.680852+0000","last_active":"2024-04-26T23:40:43.636479+0000","last_peered":"2024-04-26T23:40:43.636479+0000","last_clean":"2024-04-26T23:40:43.636479+0000","last_became_active":"2024-04-26T23:40:41.680567+0000","last_became_peered":"2024-04-26T23:40:41.680567+0000","last_unstale":"2024-04-26T23:40:43.636479+0000","last_undegraded":"2024-04-26T23:40:43.636479+0000","last_fullsized":"2024-04-26T23:40:43.636479+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:40:15.485085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.637223+0000","last_change":"2024-04-26T23:40:32.591906+0000","last_active":"2024-04-26T23:40:43.637223+0000","last_peered":"2024-04-26T23:40:43.637223+0000","last_clean":"2024-04-26T23:40:43.637223+0000","last_became_active":"2024-04-26T23:40:32.590867+0000","last_became_peered":"2024-04-26T23:40:32.590867+0000","last_unstale":"2024-04-26T23:40:43.637223+0000","last_undegraded":"2024-04-26T23:40:43.637223+0000","last_fullsized":"2024-04-26T23:40:43.637223+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:56:04.309611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636141+0000","last_change":"2024-04-26T23:40:31.572391+0000","last_active":"2024-04-26T23:40:43.636141+0000","last_peered":"2024-04-26T23:40:43.636141+0000","last_clean":"2024-04-26T23:40:43.636141+0000","last_became_active":"2024-04-26T23:40:31.571849+0000","last_became_peered":"2024-04-26T23:40:31.571849+0000","last_unstale":"2024-04-26T23:40:43.636141+0000","last_undegraded":"2024-04-26T23:40:43.636141+0000","last_fullsized":"2024-04-26T23:40:43.636141+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:35:54.439397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.683873+0000","last_change":"2024-04-26T23:40:40.676464+0000","last_active":"2024-04-26T23:40:42.683873+0000","last_peered":"2024-04-26T23:40:42.683873+0000","last_clean":"2024-04-26T23:40:42.683873+0000","last_became_active":"2024-04-26T23:40:40.676154+0000","last_became_peered":"2024-04-26T23:40:40.676154+0000","last_unstale":"2024-04-26T23:40:42.683873+0000","last_undegraded":"2024-04-26T23:40:42.683873+0000","last_fullsized":"2024-04-26T23:40:42.683873+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:52:34.793496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636055+0000","last_change":"2024-04-26T23:40:41.688065+0000","last_active":"2024-04-26T23:40:43.636055+0000","last_peered":"2024-04-26T23:40:43.636055+0000","last_clean":"2024-04-26T23:40:43.636055+0000","last_became_active":"2024-04-26T23:40:41.687693+0000","last_became_peered":"2024-04-26T23:40:41.687693+0000","last_unstale":"2024-04-26T23:40:43.636055+0000","last_undegraded":"2024-04-26T23:40:43.636055+0000","last_fullsized":"2024-04-26T23:40:43.636055+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:35:17.294025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.685453+0000","last_change":"2024-04-26T23:40:32.583469+0000","last_active":"2024-04-26T23:40:42.685453+0000","last_peered":"2024-04-26T23:40:42.685453+0000","last_clean":"2024-04-26T23:40:42.685453+0000","last_became_active":"2024-04-26T23:40:32.583174+0000","last_became_peered":"2024-04-26T23:40:32.583174+0000","last_unstale":"2024-04-26T23:40:42.685453+0000","last_undegraded":"2024-04-26T23:40:42.685453+0000","last_fullsized":"2024-04-26T23:40:42.685453+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:34:14.811917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.637058+0000","last_change":"2024-04-26T23:40:31.571749+0000","last_active":"2024-04-26T23:40:43.637058+0000","last_peered":"2024-04-26T23:40:43.637058+0000","last_clean":"2024-04-26T23:40:43.637058+0000","last_became_active":"2024-04-26T23:40:31.571427+0000","last_became_peered":"2024-04-26T23:40:31.571427+0000","last_unstale":"2024-04-26T23:40:43.637058+0000","last_undegraded":"2024-04-26T23:40:43.637058+0000","last_fullsized":"2024-04-26T23:40:43.637058+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:20:28.103413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"23'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.686472+0000","last_change":"2024-04-26T23:40:40.675987+0000","last_active":"2024-04-26T23:40:42.686472+0000","last_peered":"2024-04-26T23:40:42.686472+0000","last_clean":"2024-04-26T23:40:42.686472+0000","last_became_active":"2024-04-26T23:40:40.675682+0000","last_became_peered":"2024-04-26T23:40:40.675682+0000","last_unstale":"2024-04-26T23:40:42.686472+0000","last_undegraded":"2024-04-26T23:40:42.686472+0000","last_fullsized":"2024-04-26T23:40:42.686472+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:10:10.722905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.635569+0000","last_change":"2024-04-26T23:40:41.681408+0000","last_active":"2024-04-26T23:40:43.635569+0000","last_peered":"2024-04-26T23:40:43.635569+0000","last_clean":"2024-04-26T23:40:43.635569+0000","last_became_active":"2024-04-26T23:40:41.681069+0000","last_became_peered":"2024-04-26T23:40:41.681069+0000","last_unstale":"2024-04-26T23:40:43.635569+0000","last_undegraded":"2024-04-26T23:40:43.635569+0000","last_fullsized":"2024-04-26T23:40:43.635569+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:10:30.972726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636555+0000","last_change":"2024-04-26T23:40:32.596306+0000","last_active":"2024-04-26T23:40:43.636555+0000","last_peered":"2024-04-26T23:40:43.636555+0000","last_clean":"2024-04-26T23:40:43.636555+0000","last_became_active":"2024-04-26T23:40:32.595625+0000","last_became_peered":"2024-04-26T23:40:32.595625+0000","last_unstale":"2024-04-26T23:40:43.636555+0000","last_undegraded":"2024-04-26T23:40:43.636555+0000","last_fullsized":"2024-04-26T23:40:43.636555+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:10:02.629199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636280+0000","last_change":"2024-04-26T23:40:31.570870+0000","last_active":"2024-04-26T23:40:43.636280+0000","last_peered":"2024-04-26T23:40:43.636280+0000","last_clean":"2024-04-26T23:40:43.636280+0000","last_became_active":"2024-04-26T23:40:31.570592+0000","last_became_peered":"2024-04-26T23:40:31.570592+0000","last_unstale":"2024-04-26T23:40:43.636280+0000","last_undegraded":"2024-04-26T23:40:43.636280+0000","last_fullsized":"2024-04-26T23:40:43.636280+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:43:13.740214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.685417+0000","last_change":"2024-04-26T23:40:40.673142+0000","last_active":"2024-04-26T23:40:42.685417+0000","last_peered":"2024-04-26T23:40:42.685417+0000","last_clean":"2024-04-26T23:40:42.685417+0000","last_became_active":"2024-04-26T23:40:40.672816+0000","last_became_peered":"2024-04-26T23:40:40.672816+0000","last_unstale":"2024-04-26T23:40:42.685417+0000","last_undegraded":"2024-04-26T23:40:42.685417+0000","last_fullsized":"2024-04-26T23:40:42.685417+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:53:12.526011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.635564+0000","last_change":"2024-04-26T23:40:41.678588+0000","last_active":"2024-04-26T23:40:43.635564+0000","last_peered":"2024-04-26T23:40:43.635564+0000","last_clean":"2024-04-26T23:40:43.635564+0000","last_became_active":"2024-04-26T23:40:41.678039+0000","last_became_peered":"2024-04-26T23:40:41.678039+0000","last_unstale":"2024-04-26T23:40:43.635564+0000","last_undegraded":"2024-04-26T23:40:43.635564+0000","last_fullsized":"2024-04-26T23:40:43.635564+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:04:39.652713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636462+0000","last_change":"2024-04-26T23:40:32.593577+0000","last_active":"2024-04-26T23:40:43.636462+0000","last_peered":"2024-04-26T23:40:43.636462+0000","last_clean":"2024-04-26T23:40:43.636462+0000","last_became_active":"2024-04-26T23:40:32.593235+0000","last_became_peered":"2024-04-26T23:40:32.593235+0000","last_unstale":"2024-04-26T23:40:43.636462+0000","last_undegraded":"2024-04-26T23:40:43.636462+0000","last_fullsized":"2024-04-26T23:40:43.636462+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:01:02.741964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636418+0000","last_change":"2024-04-26T23:40:31.575943+0000","last_active":"2024-04-26T23:40:43.636418+0000","last_peered":"2024-04-26T23:40:43.636418+0000","last_clean":"2024-04-26T23:40:43.636418+0000","last_became_active":"2024-04-26T23:40:31.575632+0000","last_became_peered":"2024-04-26T23:40:31.575632+0000","last_unstale":"2024-04-26T23:40:43.636418+0000","last_undegraded":"2024-04-26T23:40:43.636418+0000","last_fullsized":"2024-04-26T23:40:43.636418+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:11:08.189634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636540+0000","last_change":"2024-04-26T23:40:40.676297+0000","last_active":"2024-04-26T23:40:43.636540+0000","last_peered":"2024-04-26T23:40:43.636540+0000","last_clean":"2024-04-26T23:40:43.636540+0000","last_became_active":"2024-04-26T23:40:40.675888+0000","last_became_peered":"2024-04-26T23:40:40.675888+0000","last_unstale":"2024-04-26T23:40:43.636540+0000","last_undegraded":"2024-04-26T23:40:43.636540+0000","last_fullsized":"2024-04-26T23:40:43.636540+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:04:38.647258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.637873+0000","last_change":"2024-04-26T23:40:41.688506+0000","last_active":"2024-04-26T23:40:43.637873+0000","last_peered":"2024-04-26T23:40:43.637873+0000","last_clean":"2024-04-26T23:40:43.637873+0000","last_became_active":"2024-04-26T23:40:41.688224+0000","last_became_peered":"2024-04-26T23:40:41.688224+0000","last_unstale":"2024-04-26T23:40:43.637873+0000","last_undegraded":"2024-04-26T23:40:43.637873+0000","last_fullsized":"2024-04-26T23:40:43.637873+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:05:34.008024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.637217+0000","last_change":"2024-04-26T23:40:32.593528+0000","last_active":"2024-04-26T23:40:43.637217+0000","last_peered":"2024-04-26T23:40:43.637217+0000","last_clean":"2024-04-26T23:40:43.637217+0000","last_became_active":"2024-04-26T23:40:32.593220+0000","last_became_peered":"2024-04-26T23:40:32.593220+0000","last_unstale":"2024-04-26T23:40:43.637217+0000","last_undegraded":"2024-04-26T23:40:43.637217+0000","last_fullsized":"2024-04-26T23:40:43.637217+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:04:30.553552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":30,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.635390+0000","last_change":"2024-04-26T23:40:31.572685+0000","last_active":"2024-04-26T23:40:43.635390+0000","last_peered":"2024-04-26T23:40:43.635390+0000","last_clean":"2024-04-26T23:40:43.635390+0000","last_became_active":"2024-04-26T23:40:31.572169+0000","last_became_peered":"2024-04-26T23:40:31.572169+0000","last_unstale":"2024-04-26T23:40:43.635390+0000","last_undegraded":"2024-04-26T23:40:43.635390+0000","last_fullsized":"2024-04-26T23:40:43.635390+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:15:30.884135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.687059+0000","last_change":"2024-04-26T23:40:40.672160+0000","last_active":"2024-04-26T23:40:42.687059+0000","last_peered":"2024-04-26T23:40:42.687059+0000","last_clean":"2024-04-26T23:40:42.687059+0000","last_became_active":"2024-04-26T23:40:40.671875+0000","last_became_peered":"2024-04-26T23:40:40.671875+0000","last_unstale":"2024-04-26T23:40:42.687059+0000","last_undegraded":"2024-04-26T23:40:42.687059+0000","last_fullsized":"2024-04-26T23:40:42.687059+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:35:16.288571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.685105+0000","last_change":"2024-04-26T23:40:41.688445+0000","last_active":"2024-04-26T23:40:42.685105+0000","last_peered":"2024-04-26T23:40:42.685105+0000","last_clean":"2024-04-26T23:40:42.685105+0000","last_became_active":"2024-04-26T23:40:41.688053+0000","last_became_peered":"2024-04-26T23:40:41.688053+0000","last_unstale":"2024-04-26T23:40:42.685105+0000","last_undegraded":"2024-04-26T23:40:42.685105+0000","last_fullsized":"2024-04-26T23:40:42.685105+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:08:35.027584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.683320+0000","last_change":"2024-04-26T23:40:32.586832+0000","last_active":"2024-04-26T23:40:42.683320+0000","last_peered":"2024-04-26T23:40:42.683320+0000","last_clean":"2024-04-26T23:40:42.683320+0000","last_became_active":"2024-04-26T23:40:32.585809+0000","last_became_peered":"2024-04-26T23:40:32.585809+0000","last_unstale":"2024-04-26T23:40:42.683320+0000","last_undegraded":"2024-04-26T23:40:42.683320+0000","last_fullsized":"2024-04-26T23:40:42.683320+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:51:30.677247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.683971+0000","last_change":"2024-04-26T23:40:31.569512+0000","last_active":"2024-04-26T23:40:42.683971+0000","last_peered":"2024-04-26T23:40:42.683971+0000","last_clean":"2024-04-26T23:40:42.683971+0000","last_became_active":"2024-04-26T23:40:31.568598+0000","last_became_peered":"2024-04-26T23:40:31.568598+0000","last_unstale":"2024-04-26T23:40:42.683971+0000","last_undegraded":"2024-04-26T23:40:42.683971+0000","last_fullsized":"2024-04-26T23:40:42.683971+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:48:32.015654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.637928+0000","last_change":"2024-04-26T23:40:40.673986+0000","last_active":"2024-04-26T23:40:43.637928+0000","last_peered":"2024-04-26T23:40:43.637928+0000","last_clean":"2024-04-26T23:40:43.637928+0000","last_became_active":"2024-04-26T23:40:40.673704+0000","last_became_peered":"2024-04-26T23:40:40.673704+0000","last_unstale":"2024-04-26T23:40:43.637928+0000","last_undegraded":"2024-04-26T23:40:43.637928+0000","last_fullsized":"2024-04-26T23:40:43.637928+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:37:24.000775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.685367+0000","last_change":"2024-04-26T23:40:41.691441+0000","last_active":"2024-04-26T23:40:42.685367+0000","last_peered":"2024-04-26T23:40:42.685367+0000","last_clean":"2024-04-26T23:40:42.685367+0000","last_became_active":"2024-04-26T23:40:41.691160+0000","last_became_peered":"2024-04-26T23:40:41.691160+0000","last_unstale":"2024-04-26T23:40:42.685367+0000","last_undegraded":"2024-04-26T23:40:42.685367+0000","last_fullsized":"2024-04-26T23:40:42.685367+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:41:52.386084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636667+0000","last_change":"2024-04-26T23:40:32.595377+0000","last_active":"2024-04-26T23:40:43.636667+0000","last_peered":"2024-04-26T23:40:43.636667+0000","last_clean":"2024-04-26T23:40:43.636667+0000","last_became_active":"2024-04-26T23:40:32.595032+0000","last_became_peered":"2024-04-26T23:40:32.595032+0000","last_unstale":"2024-04-26T23:40:43.636667+0000","last_undegraded":"2024-04-26T23:40:43.636667+0000","last_fullsized":"2024-04-26T23:40:43.636667+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:44:42.494850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.684685+0000","last_change":"2024-04-26T23:40:31.575493+0000","last_active":"2024-04-26T23:40:42.684685+0000","last_peered":"2024-04-26T23:40:42.684685+0000","last_clean":"2024-04-26T23:40:42.684685+0000","last_became_active":"2024-04-26T23:40:31.575039+0000","last_became_peered":"2024-04-26T23:40:31.575039+0000","last_unstale":"2024-04-26T23:40:42.684685+0000","last_undegraded":"2024-04-26T23:40:42.684685+0000","last_fullsized":"2024-04-26T23:40:42.684685+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:43:13.740214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"23'6","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.637618+0000","last_change":"2024-04-26T23:40:40.676493+0000","last_active":"2024-04-26T23:40:43.637618+0000","last_peered":"2024-04-26T23:40:43.637618+0000","last_clean":"2024-04-26T23:40:43.637618+0000","last_became_active":"2024-04-26T23:40:40.676124+0000","last_became_peered":"2024-04-26T23:40:40.676124+0000","last_unstale":"2024-04-26T23:40:43.637618+0000","last_undegraded":"2024-04-26T23:40:43.637618+0000","last_fullsized":"2024-04-26T23:40:43.637618+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:28:33.915485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.637568+0000","last_change":"2024-04-26T23:40:41.680735+0000","last_active":"2024-04-26T23:40:43.637568+0000","last_peered":"2024-04-26T23:40:43.637568+0000","last_clean":"2024-04-26T23:40:43.637568+0000","last_became_active":"2024-04-26T23:40:41.680485+0000","last_became_peered":"2024-04-26T23:40:41.680485+0000","last_unstale":"2024-04-26T23:40:43.637568+0000","last_undegraded":"2024-04-26T23:40:43.637568+0000","last_fullsized":"2024-04-26T23:40:43.637568+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:38:51.195172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.686381+0000","last_change":"2024-04-26T23:40:32.589706+0000","last_active":"2024-04-26T23:40:42.686381+0000","last_peered":"2024-04-26T23:40:42.686381+0000","last_clean":"2024-04-26T23:40:42.686381+0000","last_became_active":"2024-04-26T23:40:32.589452+0000","last_became_peered":"2024-04-26T23:40:32.589452+0000","last_unstale":"2024-04-26T23:40:42.686381+0000","last_undegraded":"2024-04-26T23:40:42.686381+0000","last_fullsized":"2024-04-26T23:40:42.686381+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:15:01.970308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.686999+0000","last_change":"2024-04-26T23:40:31.573941+0000","last_active":"2024-04-26T23:40:42.686999+0000","last_peered":"2024-04-26T23:40:42.686999+0000","last_clean":"2024-04-26T23:40:42.686999+0000","last_became_active":"2024-04-26T23:40:31.573668+0000","last_became_peered":"2024-04-26T23:40:31.573668+0000","last_unstale":"2024-04-26T23:40:42.686999+0000","last_undegraded":"2024-04-26T23:40:42.686999+0000","last_fullsized":"2024-04-26T23:40:42.686999+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:58:06.477730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"23'3","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.685527+0000","last_change":"2024-04-26T23:40:40.676408+0000","last_active":"2024-04-26T23:40:42.685527+0000","last_peered":"2024-04-26T23:40:42.685527+0000","last_clean":"2024-04-26T23:40:42.685527+0000","last_became_active":"2024-04-26T23:40:40.676147+0000","last_became_peered":"2024-04-26T23:40:40.676147+0000","last_unstale":"2024-04-26T23:40:42.685527+0000","last_undegraded":"2024-04-26T23:40:42.685527+0000","last_fullsized":"2024-04-26T23:40:42.685527+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:27:47.818055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.637455+0000","last_change":"2024-04-26T23:40:41.685829+0000","last_active":"2024-04-26T23:40:43.637455+0000","last_peered":"2024-04-26T23:40:43.637455+0000","last_clean":"2024-04-26T23:40:43.637455+0000","last_became_active":"2024-04-26T23:40:41.685403+0000","last_became_peered":"2024-04-26T23:40:41.685403+0000","last_unstale":"2024-04-26T23:40:43.637455+0000","last_undegraded":"2024-04-26T23:40:43.637455+0000","last_fullsized":"2024-04-26T23:40:43.637455+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:24:07.784468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.637089+0000","last_change":"2024-04-26T23:40:32.587513+0000","last_active":"2024-04-26T23:40:43.637089+0000","last_peered":"2024-04-26T23:40:43.637089+0000","last_clean":"2024-04-26T23:40:43.637089+0000","last_became_active":"2024-04-26T23:40:32.587200+0000","last_became_peered":"2024-04-26T23:40:32.587200+0000","last_unstale":"2024-04-26T23:40:43.637089+0000","last_undegraded":"2024-04-26T23:40:43.637089+0000","last_fullsized":"2024-04-26T23:40:43.637089+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:37:30.361795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":28,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.683606+0000","last_change":"2024-04-26T23:40:31.572331+0000","last_active":"2024-04-26T23:40:42.683606+0000","last_peered":"2024-04-26T23:40:42.683606+0000","last_clean":"2024-04-26T23:40:42.683606+0000","last_became_active":"2024-04-26T23:40:31.572074+0000","last_became_peered":"2024-04-26T23:40:31.572074+0000","last_unstale":"2024-04-26T23:40:42.683606+0000","last_undegraded":"2024-04-26T23:40:42.683606+0000","last_fullsized":"2024-04-26T23:40:42.683606+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:45:49.295198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.635520+0000","last_change":"2024-04-26T23:40:40.677978+0000","last_active":"2024-04-26T23:40:43.635520+0000","last_peered":"2024-04-26T23:40:43.635520+0000","last_clean":"2024-04-26T23:40:43.635520+0000","last_became_active":"2024-04-26T23:40:40.677714+0000","last_became_peered":"2024-04-26T23:40:40.677714+0000","last_unstale":"2024-04-26T23:40:43.635520+0000","last_undegraded":"2024-04-26T23:40:43.635520+0000","last_fullsized":"2024-04-26T23:40:43.635520+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:44:50.588556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636093+0000","last_change":"2024-04-26T23:40:41.685431+0000","last_active":"2024-04-26T23:40:43.636093+0000","last_peered":"2024-04-26T23:40:43.636093+0000","last_clean":"2024-04-26T23:40:43.636093+0000","last_became_active":"2024-04-26T23:40:41.685147+0000","last_became_peered":"2024-04-26T23:40:41.685147+0000","last_unstale":"2024-04-26T23:40:43.636093+0000","last_undegraded":"2024-04-26T23:40:43.636093+0000","last_fullsized":"2024-04-26T23:40:43.636093+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:33:16.389626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636824+0000","last_change":"2024-04-26T23:40:32.593298+0000","last_active":"2024-04-26T23:40:43.636824+0000","last_peered":"2024-04-26T23:40:43.636824+0000","last_clean":"2024-04-26T23:40:43.636824+0000","last_became_active":"2024-04-26T23:40:32.593030+0000","last_became_peered":"2024-04-26T23:40:32.593030+0000","last_unstale":"2024-04-26T23:40:43.636824+0000","last_undegraded":"2024-04-26T23:40:43.636824+0000","last_fullsized":"2024-04-26T23:40:43.636824+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:20:29.107798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636957+0000","last_change":"2024-04-26T23:40:31.574234+0000","last_active":"2024-04-26T23:40:43.636957+0000","last_peered":"2024-04-26T23:40:43.636957+0000","last_clean":"2024-04-26T23:40:43.636957+0000","last_became_active":"2024-04-26T23:40:31.572218+0000","last_became_peered":"2024-04-26T23:40:31.572218+0000","last_unstale":"2024-04-26T23:40:43.636957+0000","last_undegraded":"2024-04-26T23:40:43.636957+0000","last_fullsized":"2024-04-26T23:40:43.636957+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:25:01.315397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"23'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.637149+0000","last_change":"2024-04-26T23:40:40.674778+0000","last_active":"2024-04-26T23:40:43.637149+0000","last_peered":"2024-04-26T23:40:43.637149+0000","last_clean":"2024-04-26T23:40:43.637149+0000","last_became_active":"2024-04-26T23:40:40.674487+0000","last_became_peered":"2024-04-26T23:40:40.674487+0000","last_unstale":"2024-04-26T23:40:43.637149+0000","last_undegraded":"2024-04-26T23:40:43.637149+0000","last_fullsized":"2024-04-26T23:40:43.637149+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:10:10.722905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.683588+0000","last_change":"2024-04-26T23:40:41.686531+0000","last_active":"2024-04-26T23:40:42.683588+0000","last_peered":"2024-04-26T23:40:42.683588+0000","last_clean":"2024-04-26T23:40:42.683588+0000","last_became_active":"2024-04-26T23:40:41.686259+0000","last_became_peered":"2024-04-26T23:40:41.686259+0000","last_unstale":"2024-04-26T23:40:42.683588+0000","last_undegraded":"2024-04-26T23:40:42.683588+0000","last_fullsized":"2024-04-26T23:40:42.683588+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:45:34.231942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.686899+0000","last_change":"2024-04-26T23:40:32.589146+0000","last_active":"2024-04-26T23:40:42.686899+0000","last_peered":"2024-04-26T23:40:42.686899+0000","last_clean":"2024-04-26T23:40:42.686899+0000","last_became_active":"2024-04-26T23:40:32.588881+0000","last_became_peered":"2024-04-26T23:40:32.588881+0000","last_unstale":"2024-04-26T23:40:42.686899+0000","last_undegraded":"2024-04-26T23:40:42.686899+0000","last_fullsized":"2024-04-26T23:40:42.686899+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:38:10.884592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.685165+0000","last_change":"2024-04-26T23:40:31.575616+0000","last_active":"2024-04-26T23:40:42.685165+0000","last_peered":"2024-04-26T23:40:42.685165+0000","last_clean":"2024-04-26T23:40:42.685165+0000","last_became_active":"2024-04-26T23:40:31.575211+0000","last_became_peered":"2024-04-26T23:40:31.575211+0000","last_unstale":"2024-04-26T23:40:42.685165+0000","last_undegraded":"2024-04-26T23:40:42.685165+0000","last_fullsized":"2024-04-26T23:40:42.685165+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:48:32.015654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"23'8","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636684+0000","last_change":"2024-04-26T23:40:40.675694+0000","last_active":"2024-04-26T23:40:43.636684+0000","last_peered":"2024-04-26T23:40:43.636684+0000","last_clean":"2024-04-26T23:40:43.636684+0000","last_became_active":"2024-04-26T23:40:40.675459+0000","last_became_peered":"2024-04-26T23:40:40.675459+0000","last_unstale":"2024-04-26T23:40:43.636684+0000","last_undegraded":"2024-04-26T23:40:43.636684+0000","last_fullsized":"2024-04-26T23:40:43.636684+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:30:03.993564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.635596+0000","last_change":"2024-04-26T23:40:41.687488+0000","last_active":"2024-04-26T23:40:43.635596+0000","last_peered":"2024-04-26T23:40:43.635596+0000","last_clean":"2024-04-26T23:40:43.635596+0000","last_became_active":"2024-04-26T23:40:41.687210+0000","last_became_peered":"2024-04-26T23:40:41.687210+0000","last_unstale":"2024-04-26T23:40:43.635596+0000","last_undegraded":"2024-04-26T23:40:43.635596+0000","last_fullsized":"2024-04-26T23:40:43.635596+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:36:21.487122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.685110+0000","last_change":"2024-04-26T23:40:32.589793+0000","last_active":"2024-04-26T23:40:42.685110+0000","last_peered":"2024-04-26T23:40:42.685110+0000","last_clean":"2024-04-26T23:40:42.685110+0000","last_became_active":"2024-04-26T23:40:32.589478+0000","last_became_peered":"2024-04-26T23:40:32.589478+0000","last_unstale":"2024-04-26T23:40:42.685110+0000","last_undegraded":"2024-04-26T23:40:42.685110+0000","last_fullsized":"2024-04-26T23:40:42.685110+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:56:04.309611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.684275+0000","last_change":"2024-04-26T23:40:31.573794+0000","last_active":"2024-04-26T23:40:42.684275+0000","last_peered":"2024-04-26T23:40:42.684275+0000","last_clean":"2024-04-26T23:40:42.684275+0000","last_became_active":"2024-04-26T23:40:31.573164+0000","last_became_peered":"2024-04-26T23:40:31.573164+0000","last_unstale":"2024-04-26T23:40:42.684275+0000","last_undegraded":"2024-04-26T23:40:42.684275+0000","last_fullsized":"2024-04-26T23:40:42.684275+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:15:30.884135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636808+0000","last_change":"2024-04-26T23:40:40.674127+0000","last_active":"2024-04-26T23:40:43.636808+0000","last_peered":"2024-04-26T23:40:43.636808+0000","last_clean":"2024-04-26T23:40:43.636808+0000","last_became_active":"2024-04-26T23:40:40.673793+0000","last_became_peered":"2024-04-26T23:40:40.673793+0000","last_unstale":"2024-04-26T23:40:43.636808+0000","last_undegraded":"2024-04-26T23:40:43.636808+0000","last_fullsized":"2024-04-26T23:40:43.636808+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:53:12.526011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.684571+0000","last_change":"2024-04-26T23:40:41.686867+0000","last_active":"2024-04-26T23:40:42.684571+0000","last_peered":"2024-04-26T23:40:42.684571+0000","last_clean":"2024-04-26T23:40:42.684571+0000","last_became_active":"2024-04-26T23:40:41.686536+0000","last_became_peered":"2024-04-26T23:40:41.686536+0000","last_unstale":"2024-04-26T23:40:42.684571+0000","last_undegraded":"2024-04-26T23:40:42.684571+0000","last_fullsized":"2024-04-26T23:40:42.684571+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:28:34.920939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"23'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.686809+0000","last_change":"2024-04-26T23:40:40.674915+0000","last_active":"2024-04-26T23:40:42.686809+0000","last_peered":"2024-04-26T23:40:42.686809+0000","last_clean":"2024-04-26T23:40:42.686809+0000","last_became_active":"2024-04-26T23:40:40.674639+0000","last_became_peered":"2024-04-26T23:40:40.674639+0000","last_unstale":"2024-04-26T23:40:42.686809+0000","last_undegraded":"2024-04-26T23:40:42.686809+0000","last_fullsized":"2024-04-26T23:40:42.686809+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:52:34.793496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.635465+0000","last_change":"2024-04-26T23:40:32.583014+0000","last_active":"2024-04-26T23:40:43.635465+0000","last_peered":"2024-04-26T23:40:43.635465+0000","last_clean":"2024-04-26T23:40:43.635465+0000","last_became_active":"2024-04-26T23:40:32.582751+0000","last_became_peered":"2024-04-26T23:40:32.582751+0000","last_unstale":"2024-04-26T23:40:43.635465+0000","last_undegraded":"2024-04-26T23:40:43.635465+0000","last_fullsized":"2024-04-26T23:40:43.635465+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:38:10.884592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.685541+0000","last_change":"2024-04-26T23:40:31.572402+0000","last_active":"2024-04-26T23:40:42.685541+0000","last_peered":"2024-04-26T23:40:42.685541+0000","last_clean":"2024-04-26T23:40:42.685541+0000","last_became_active":"2024-04-26T23:40:31.572111+0000","last_became_peered":"2024-04-26T23:40:31.572111+0000","last_unstale":"2024-04-26T23:40:42.685541+0000","last_undegraded":"2024-04-26T23:40:42.685541+0000","last_fullsized":"2024-04-26T23:40:42.685541+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:20:28.103413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.686752+0000","last_change":"2024-04-26T23:40:41.684524+0000","last_active":"2024-04-26T23:40:42.686752+0000","last_peered":"2024-04-26T23:40:42.686752+0000","last_clean":"2024-04-26T23:40:42.686752+0000","last_became_active":"2024-04-26T23:40:41.684207+0000","last_became_peered":"2024-04-26T23:40:41.684207+0000","last_unstale":"2024-04-26T23:40:42.686752+0000","last_undegraded":"2024-04-26T23:40:42.686752+0000","last_fullsized":"2024-04-26T23:40:42.686752+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:30:04.999018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"23'4","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.684153+0000","last_change":"2024-04-26T23:40:40.674934+0000","last_active":"2024-04-26T23:40:42.684153+0000","last_peered":"2024-04-26T23:40:42.684153+0000","last_clean":"2024-04-26T23:40:42.684153+0000","last_became_active":"2024-04-26T23:40:40.674628+0000","last_became_peered":"2024-04-26T23:40:40.674628+0000","last_unstale":"2024-04-26T23:40:42.684153+0000","last_undegraded":"2024-04-26T23:40:42.684153+0000","last_fullsized":"2024-04-26T23:40:42.684153+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:44:50.588556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636777+0000","last_change":"2024-04-26T23:40:32.586204+0000","last_active":"2024-04-26T23:40:43.636777+0000","last_peered":"2024-04-26T23:40:43.636777+0000","last_clean":"2024-04-26T23:40:43.636777+0000","last_became_active":"2024-04-26T23:40:32.585725+0000","last_became_peered":"2024-04-26T23:40:32.585725+0000","last_unstale":"2024-04-26T23:40:43.636777+0000","last_undegraded":"2024-04-26T23:40:43.636777+0000","last_fullsized":"2024-04-26T23:40:43.636777+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:51:30.677247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.637081+0000","last_change":"2024-04-26T23:40:31.578929+0000","last_active":"2024-04-26T23:40:43.637081+0000","last_peered":"2024-04-26T23:40:43.637081+0000","last_clean":"2024-04-26T23:40:43.637081+0000","last_became_active":"2024-04-26T23:40:31.578623+0000","last_became_peered":"2024-04-26T23:40:31.578623+0000","last_unstale":"2024-04-26T23:40:43.637081+0000","last_undegraded":"2024-04-26T23:40:43.637081+0000","last_fullsized":"2024-04-26T23:40:43.637081+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:50:21.330821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.637097+0000","last_change":"2024-04-26T23:40:41.689697+0000","last_active":"2024-04-26T23:40:43.637097+0000","last_peered":"2024-04-26T23:40:43.637097+0000","last_clean":"2024-04-26T23:40:43.637097+0000","last_became_active":"2024-04-26T23:40:41.688428+0000","last_became_peered":"2024-04-26T23:40:41.688428+0000","last_unstale":"2024-04-26T23:40:43.637097+0000","last_undegraded":"2024-04-26T23:40:43.637097+0000","last_fullsized":"2024-04-26T23:40:43.637097+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:36:21.487122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.684234+0000","last_change":"2024-04-26T23:40:31.567755+0000","last_active":"2024-04-26T23:40:42.684234+0000","last_peered":"2024-04-26T23:40:42.684234+0000","last_clean":"2024-04-26T23:40:42.684234+0000","last_became_active":"2024-04-26T23:40:31.567484+0000","last_became_peered":"2024-04-26T23:40:31.567484+0000","last_unstale":"2024-04-26T23:40:42.684234+0000","last_undegraded":"2024-04-26T23:40:42.684234+0000","last_fullsized":"2024-04-26T23:40:42.684234+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:43:13.740214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.686881+0000","last_change":"2024-04-26T23:40:32.594689+0000","last_active":"2024-04-26T23:40:42.686881+0000","last_peered":"2024-04-26T23:40:42.686881+0000","last_clean":"2024-04-26T23:40:42.686881+0000","last_became_active":"2024-04-26T23:40:32.592365+0000","last_became_peered":"2024-04-26T23:40:32.592365+0000","last_unstale":"2024-04-26T23:40:42.686881+0000","last_undegraded":"2024-04-26T23:40:42.686881+0000","last_fullsized":"2024-04-26T23:40:42.686881+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:17:46.135806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"23'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.635940+0000","last_change":"2024-04-26T23:40:40.676028+0000","last_active":"2024-04-26T23:40:43.635940+0000","last_peered":"2024-04-26T23:40:43.635940+0000","last_clean":"2024-04-26T23:40:43.635940+0000","last_became_active":"2024-04-26T23:40:40.675736+0000","last_became_peered":"2024-04-26T23:40:40.675736+0000","last_unstale":"2024-04-26T23:40:43.635940+0000","last_undegraded":"2024-04-26T23:40:43.635940+0000","last_fullsized":"2024-04-26T23:40:43.635940+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:51:38.770953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636545+0000","last_change":"2024-04-26T23:40:41.690148+0000","last_active":"2024-04-26T23:40:43.636545+0000","last_peered":"2024-04-26T23:40:43.636545+0000","last_clean":"2024-04-26T23:40:43.636545+0000","last_became_active":"2024-04-26T23:40:41.689765+0000","last_became_peered":"2024-04-26T23:40:41.689765+0000","last_unstale":"2024-04-26T23:40:43.636545+0000","last_undegraded":"2024-04-26T23:40:43.636545+0000","last_fullsized":"2024-04-26T23:40:43.636545+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:33:16.389626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.637574+0000","last_change":"2024-04-26T23:40:31.576749+0000","last_active":"2024-04-26T23:40:43.637574+0000","last_peered":"2024-04-26T23:40:43.637574+0000","last_clean":"2024-04-26T23:40:43.637574+0000","last_became_active":"2024-04-26T23:40:31.576178+0000","last_became_peered":"2024-04-26T23:40:31.576178+0000","last_unstale":"2024-04-26T23:40:43.637574+0000","last_undegraded":"2024-04-26T23:40:43.637574+0000","last_fullsized":"2024-04-26T23:40:43.637574+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:15:30.884135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636389+0000","last_change":"2024-04-26T23:40:32.589208+0000","last_active":"2024-04-26T23:40:43.636389+0000","last_peered":"2024-04-26T23:40:43.636389+0000","last_clean":"2024-04-26T23:40:43.636389+0000","last_became_active":"2024-04-26T23:40:32.588927+0000","last_became_peered":"2024-04-26T23:40:32.588927+0000","last_unstale":"2024-04-26T23:40:43.636389+0000","last_undegraded":"2024-04-26T23:40:43.636389+0000","last_fullsized":"2024-04-26T23:40:43.636389+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:45:50.299583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"23'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.637675+0000","last_change":"2024-04-26T23:40:40.676809+0000","last_active":"2024-04-26T23:40:43.637675+0000","last_peered":"2024-04-26T23:40:43.637675+0000","last_clean":"2024-04-26T23:40:43.637675+0000","last_became_active":"2024-04-26T23:40:40.676070+0000","last_became_peered":"2024-04-26T23:40:40.676070+0000","last_unstale":"2024-04-26T23:40:43.637675+0000","last_undegraded":"2024-04-26T23:40:43.637675+0000","last_fullsized":"2024-04-26T23:40:43.637675+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:17:27.667323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.637854+0000","last_change":"2024-04-26T23:40:41.679796+0000","last_active":"2024-04-26T23:40:43.637854+0000","last_peered":"2024-04-26T23:40:43.637854+0000","last_clean":"2024-04-26T23:40:43.637854+0000","last_became_active":"2024-04-26T23:40:41.679523+0000","last_became_peered":"2024-04-26T23:40:41.679523+0000","last_unstale":"2024-04-26T23:40:43.637854+0000","last_undegraded":"2024-04-26T23:40:43.637854+0000","last_fullsized":"2024-04-26T23:40:43.637854+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:43:02.137315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.683465+0000","last_change":"2024-04-26T23:40:32.586672+0000","last_active":"2024-04-26T23:40:42.683465+0000","last_peered":"2024-04-26T23:40:42.683465+0000","last_clean":"2024-04-26T23:40:42.683465+0000","last_became_active":"2024-04-26T23:40:32.586399+0000","last_became_peered":"2024-04-26T23:40:32.586399+0000","last_unstale":"2024-04-26T23:40:42.683465+0000","last_undegraded":"2024-04-26T23:40:42.683465+0000","last_fullsized":"2024-04-26T23:40:42.683465+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:15:01.970308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636388+0000","last_change":"2024-04-26T23:40:41.687529+0000","last_active":"2024-04-26T23:40:43.636388+0000","last_peered":"2024-04-26T23:40:43.636388+0000","last_clean":"2024-04-26T23:40:43.636388+0000","last_became_active":"2024-04-26T23:40:41.686974+0000","last_became_peered":"2024-04-26T23:40:41.686974+0000","last_unstale":"2024-04-26T23:40:43.636388+0000","last_undegraded":"2024-04-26T23:40:43.636388+0000","last_fullsized":"2024-04-26T23:40:43.636388+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:21:56.950703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.635606+0000","last_change":"2024-04-26T23:40:32.584590+0000","last_active":"2024-04-26T23:40:43.635606+0000","last_peered":"2024-04-26T23:40:43.635606+0000","last_clean":"2024-04-26T23:40:43.635606+0000","last_became_active":"2024-04-26T23:40:32.584234+0000","last_became_peered":"2024-04-26T23:40:32.584234+0000","last_unstale":"2024-04-26T23:40:43.635606+0000","last_undegraded":"2024-04-26T23:40:43.635606+0000","last_fullsized":"2024-04-26T23:40:43.635606+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:15:52.942160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.685091+0000","last_change":"2024-04-26T23:40:41.679549+0000","last_active":"2024-04-26T23:40:42.685091+0000","last_peered":"2024-04-26T23:40:42.685091+0000","last_clean":"2024-04-26T23:40:42.685091+0000","last_became_active":"2024-04-26T23:40:41.679254+0000","last_became_peered":"2024-04-26T23:40:41.679254+0000","last_unstale":"2024-04-26T23:40:42.685091+0000","last_undegraded":"2024-04-26T23:40:42.685091+0000","last_fullsized":"2024-04-26T23:40:42.685091+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:48:09.126894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.684675+0000","last_change":"2024-04-26T23:40:32.580453+0000","last_active":"2024-04-26T23:40:42.684675+0000","last_peered":"2024-04-26T23:40:42.684675+0000","last_clean":"2024-04-26T23:40:42.684675+0000","last_became_active":"2024-04-26T23:40:32.580196+0000","last_became_peered":"2024-04-26T23:40:32.580196+0000","last_unstale":"2024-04-26T23:40:42.684675+0000","last_undegraded":"2024-04-26T23:40:42.684675+0000","last_fullsized":"2024-04-26T23:40:42.684675+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:18:09.706875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636745+0000","last_change":"2024-04-26T23:40:41.690579+0000","last_active":"2024-04-26T23:40:43.636745+0000","last_peered":"2024-04-26T23:40:43.636745+0000","last_clean":"2024-04-26T23:40:43.636745+0000","last_became_active":"2024-04-26T23:40:41.690262+0000","last_became_peered":"2024-04-26T23:40:41.690262+0000","last_unstale":"2024-04-26T23:40:43.636745+0000","last_undegraded":"2024-04-26T23:40:43.636745+0000","last_fullsized":"2024-04-26T23:40:43.636745+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:10:30.972726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.686790+0000","last_change":"2024-04-26T23:40:32.584323+0000","last_active":"2024-04-26T23:40:42.686790+0000","last_peered":"2024-04-26T23:40:42.686790+0000","last_clean":"2024-04-26T23:40:42.686790+0000","last_became_active":"2024-04-26T23:40:32.584010+0000","last_became_peered":"2024-04-26T23:40:32.584010+0000","last_unstale":"2024-04-26T23:40:42.686790+0000","last_undegraded":"2024-04-26T23:40:42.686790+0000","last_fullsized":"2024-04-26T23:40:42.686790+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:16:46.547536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636036+0000","last_change":"2024-04-26T23:40:41.677679+0000","last_active":"2024-04-26T23:40:43.636036+0000","last_peered":"2024-04-26T23:40:43.636036+0000","last_clean":"2024-04-26T23:40:43.636036+0000","last_became_active":"2024-04-26T23:40:41.677398+0000","last_became_peered":"2024-04-26T23:40:41.677398+0000","last_unstale":"2024-04-26T23:40:43.636036+0000","last_undegraded":"2024-04-26T23:40:43.636036+0000","last_fullsized":"2024-04-26T23:40:43.636036+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:42:13.754586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.637704+0000","last_change":"2024-04-26T23:40:32.587921+0000","last_active":"2024-04-26T23:40:43.637704+0000","last_peered":"2024-04-26T23:40:43.637704+0000","last_clean":"2024-04-26T23:40:43.637704+0000","last_became_active":"2024-04-26T23:40:32.587630+0000","last_became_peered":"2024-04-26T23:40:32.587630+0000","last_unstale":"2024-04-26T23:40:43.637704+0000","last_undegraded":"2024-04-26T23:40:43.637704+0000","last_fullsized":"2024-04-26T23:40:43.637704+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:01:02.741964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.637255+0000","last_change":"2024-04-26T23:40:41.690235+0000","last_active":"2024-04-26T23:40:43.637255+0000","last_peered":"2024-04-26T23:40:43.637255+0000","last_clean":"2024-04-26T23:40:43.637255+0000","last_became_active":"2024-04-26T23:40:41.689911+0000","last_became_peered":"2024-04-26T23:40:41.689911+0000","last_unstale":"2024-04-26T23:40:43.637255+0000","last_undegraded":"2024-04-26T23:40:43.637255+0000","last_fullsized":"2024-04-26T23:40:43.637255+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:21:56.950703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636863+0000","last_change":"2024-04-26T23:40:32.583376+0000","last_active":"2024-04-26T23:40:43.636863+0000","last_peered":"2024-04-26T23:40:43.636863+0000","last_clean":"2024-04-26T23:40:43.636863+0000","last_became_active":"2024-04-26T23:40:32.583089+0000","last_became_peered":"2024-04-26T23:40:32.583089+0000","last_unstale":"2024-04-26T23:40:43.636863+0000","last_undegraded":"2024-04-26T23:40:43.636863+0000","last_fullsized":"2024-04-26T23:40:43.636863+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:17:46.135806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.635479+0000","last_change":"2024-04-26T23:40:41.688464+0000","last_active":"2024-04-26T23:40:43.635479+0000","last_peered":"2024-04-26T23:40:43.635479+0000","last_clean":"2024-04-26T23:40:43.635479+0000","last_became_active":"2024-04-26T23:40:41.688028+0000","last_became_peered":"2024-04-26T23:40:41.688028+0000","last_unstale":"2024-04-26T23:40:43.635479+0000","last_undegraded":"2024-04-26T23:40:43.635479+0000","last_fullsized":"2024-04-26T23:40:43.635479+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:21:56.950703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.684171+0000","last_change":"2024-04-26T23:40:32.589080+0000","last_active":"2024-04-26T23:40:42.684171+0000","last_peered":"2024-04-26T23:40:42.684171+0000","last_clean":"2024-04-26T23:40:42.684171+0000","last_became_active":"2024-04-26T23:40:32.588793+0000","last_became_peered":"2024-04-26T23:40:32.588793+0000","last_unstale":"2024-04-26T23:40:42.684171+0000","last_undegraded":"2024-04-26T23:40:42.684171+0000","last_fullsized":"2024-04-26T23:40:42.684171+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:18:09.706875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.684432+0000","last_change":"2024-04-26T23:40:41.688445+0000","last_active":"2024-04-26T23:40:42.684432+0000","last_peered":"2024-04-26T23:40:42.684432+0000","last_clean":"2024-04-26T23:40:42.684432+0000","last_became_active":"2024-04-26T23:40:41.688163+0000","last_became_peered":"2024-04-26T23:40:41.688163+0000","last_unstale":"2024-04-26T23:40:42.684432+0000","last_undegraded":"2024-04-26T23:40:42.684432+0000","last_fullsized":"2024-04-26T23:40:42.684432+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:30:04.999018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.637912+0000","last_change":"2024-04-26T23:40:32.588177+0000","last_active":"2024-04-26T23:40:43.637912+0000","last_peered":"2024-04-26T23:40:43.637912+0000","last_clean":"2024-04-26T23:40:43.637912+0000","last_became_active":"2024-04-26T23:40:32.586926+0000","last_became_peered":"2024-04-26T23:40:32.586926+0000","last_unstale":"2024-04-26T23:40:43.637912+0000","last_undegraded":"2024-04-26T23:40:43.637912+0000","last_fullsized":"2024-04-26T23:40:43.637912+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:34:14.811917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.637801+0000","last_change":"2024-04-26T23:40:41.688396+0000","last_active":"2024-04-26T23:40:43.637801+0000","last_peered":"2024-04-26T23:40:43.637801+0000","last_clean":"2024-04-26T23:40:43.637801+0000","last_became_active":"2024-04-26T23:40:41.688087+0000","last_became_peered":"2024-04-26T23:40:41.688087+0000","last_unstale":"2024-04-26T23:40:43.637801+0000","last_undegraded":"2024-04-26T23:40:43.637801+0000","last_fullsized":"2024-04-26T23:40:43.637801+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:00:49.397610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.685486+0000","last_change":"2024-04-26T23:40:32.582959+0000","last_active":"2024-04-26T23:40:42.685486+0000","last_peered":"2024-04-26T23:40:42.685486+0000","last_clean":"2024-04-26T23:40:42.685486+0000","last_became_active":"2024-04-26T23:40:32.582100+0000","last_became_peered":"2024-04-26T23:40:32.582100+0000","last_unstale":"2024-04-26T23:40:42.685486+0000","last_undegraded":"2024-04-26T23:40:42.685486+0000","last_fullsized":"2024-04-26T23:40:42.685486+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:37:30.361795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636150+0000","last_change":"2024-04-26T23:40:41.681088+0000","last_active":"2024-04-26T23:40:43.636150+0000","last_peered":"2024-04-26T23:40:43.636150+0000","last_clean":"2024-04-26T23:40:43.636150+0000","last_became_active":"2024-04-26T23:40:41.680581+0000","last_became_peered":"2024-04-26T23:40:41.680581+0000","last_unstale":"2024-04-26T23:40:43.636150+0000","last_undegraded":"2024-04-26T23:40:43.636150+0000","last_fullsized":"2024-04-26T23:40:43.636150+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:41:52.386084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636996+0000","last_change":"2024-04-26T23:40:32.593958+0000","last_active":"2024-04-26T23:40:43.636996+0000","last_peered":"2024-04-26T23:40:43.636996+0000","last_clean":"2024-04-26T23:40:43.636996+0000","last_became_active":"2024-04-26T23:40:32.593639+0000","last_became_peered":"2024-04-26T23:40:32.593639+0000","last_unstale":"2024-04-26T23:40:43.636996+0000","last_undegraded":"2024-04-26T23:40:43.636996+0000","last_fullsized":"2024-04-26T23:40:43.636996+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:17:46.135806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.635826+0000","last_change":"2024-04-26T23:40:41.674573+0000","last_active":"2024-04-26T23:40:43.635826+0000","last_peered":"2024-04-26T23:40:43.635826+0000","last_clean":"2024-04-26T23:40:43.635826+0000","last_became_active":"2024-04-26T23:40:41.674274+0000","last_became_peered":"2024-04-26T23:40:41.674274+0000","last_unstale":"2024-04-26T23:40:43.635826+0000","last_undegraded":"2024-04-26T23:40:43.635826+0000","last_fullsized":"2024-04-26T23:40:43.635826+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:37:39.460955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.684563+0000","last_change":"2024-04-26T23:40:32.591700+0000","last_active":"2024-04-26T23:40:42.684563+0000","last_peered":"2024-04-26T23:40:42.684563+0000","last_clean":"2024-04-26T23:40:42.684563+0000","last_became_active":"2024-04-26T23:40:32.591366+0000","last_became_peered":"2024-04-26T23:40:32.591366+0000","last_unstale":"2024-04-26T23:40:42.684563+0000","last_undegraded":"2024-04-26T23:40:42.684563+0000","last_fullsized":"2024-04-26T23:40:42.684563+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:10:02.629199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.637569+0000","last_change":"2024-04-26T23:40:41.692402+0000","last_active":"2024-04-26T23:40:43.637569+0000","last_peered":"2024-04-26T23:40:43.637569+0000","last_clean":"2024-04-26T23:40:43.637569+0000","last_became_active":"2024-04-26T23:40:41.692122+0000","last_became_peered":"2024-04-26T23:40:41.692122+0000","last_unstale":"2024-04-26T23:40:43.637569+0000","last_undegraded":"2024-04-26T23:40:43.637569+0000","last_fullsized":"2024-04-26T23:40:43.637569+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:06:12.755431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.686711+0000","last_change":"2024-04-26T23:40:32.590443+0000","last_active":"2024-04-26T23:40:42.686711+0000","last_peered":"2024-04-26T23:40:42.686711+0000","last_clean":"2024-04-26T23:40:42.686711+0000","last_became_active":"2024-04-26T23:40:32.590193+0000","last_became_peered":"2024-04-26T23:40:32.590193+0000","last_unstale":"2024-04-26T23:40:42.686711+0000","last_undegraded":"2024-04-26T23:40:42.686711+0000","last_fullsized":"2024-04-26T23:40:42.686711+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:14:04.372681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636077+0000","last_change":"2024-04-26T23:40:41.692194+0000","last_active":"2024-04-26T23:40:43.636077+0000","last_peered":"2024-04-26T23:40:43.636077+0000","last_clean":"2024-04-26T23:40:43.636077+0000","last_became_active":"2024-04-26T23:40:41.691837+0000","last_became_peered":"2024-04-26T23:40:41.691837+0000","last_unstale":"2024-04-26T23:40:43.636077+0000","last_undegraded":"2024-04-26T23:40:43.636077+0000","last_fullsized":"2024-04-26T23:40:43.636077+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:58:45.972045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.683546+0000","last_change":"2024-04-26T23:40:32.590538+0000","last_active":"2024-04-26T23:40:42.683546+0000","last_peered":"2024-04-26T23:40:42.683546+0000","last_clean":"2024-04-26T23:40:42.683546+0000","last_became_active":"2024-04-26T23:40:32.590241+0000","last_became_peered":"2024-04-26T23:40:32.590241+0000","last_unstale":"2024-04-26T23:40:42.683546+0000","last_undegraded":"2024-04-26T23:40:42.683546+0000","last_fullsized":"2024-04-26T23:40:42.683546+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:38:10.884592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636930+0000","last_change":"2024-04-26T23:40:41.689529+0000","last_active":"2024-04-26T23:40:43.636930+0000","last_peered":"2024-04-26T23:40:43.636930+0000","last_clean":"2024-04-26T23:40:43.636930+0000","last_became_active":"2024-04-26T23:40:41.689215+0000","last_became_peered":"2024-04-26T23:40:41.689215+0000","last_unstale":"2024-04-26T23:40:43.636930+0000","last_undegraded":"2024-04-26T23:40:43.636930+0000","last_fullsized":"2024-04-26T23:40:43.636930+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:38:42.155257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.637293+0000","last_change":"2024-04-26T23:40:32.588445+0000","last_active":"2024-04-26T23:40:43.637293+0000","last_peered":"2024-04-26T23:40:43.637293+0000","last_clean":"2024-04-26T23:40:43.637293+0000","last_became_active":"2024-04-26T23:40:32.588063+0000","last_became_peered":"2024-04-26T23:40:32.588063+0000","last_unstale":"2024-04-26T23:40:43.637293+0000","last_undegraded":"2024-04-26T23:40:43.637293+0000","last_fullsized":"2024-04-26T23:40:43.637293+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:44:58.977344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.684980+0000","last_change":"2024-04-26T23:40:41.674893+0000","last_active":"2024-04-26T23:40:42.684980+0000","last_peered":"2024-04-26T23:40:42.684980+0000","last_clean":"2024-04-26T23:40:42.684980+0000","last_became_active":"2024-04-26T23:40:41.674573+0000","last_became_peered":"2024-04-26T23:40:41.674573+0000","last_unstale":"2024-04-26T23:40:42.684980+0000","last_undegraded":"2024-04-26T23:40:42.684980+0000","last_fullsized":"2024-04-26T23:40:42.684980+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:36:21.487122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636258+0000","last_change":"2024-04-26T23:40:32.574795+0000","last_active":"2024-04-26T23:40:43.636258+0000","last_peered":"2024-04-26T23:40:43.636258+0000","last_clean":"2024-04-26T23:40:43.636258+0000","last_became_active":"2024-04-26T23:40:32.574503+0000","last_became_peered":"2024-04-26T23:40:32.574503+0000","last_unstale":"2024-04-26T23:40:43.636258+0000","last_undegraded":"2024-04-26T23:40:43.636258+0000","last_fullsized":"2024-04-26T23:40:43.636258+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:30:11.401955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.686330+0000","last_change":"2024-04-26T23:40:41.680247+0000","last_active":"2024-04-26T23:40:42.686330+0000","last_peered":"2024-04-26T23:40:42.686330+0000","last_clean":"2024-04-26T23:40:42.686330+0000","last_became_active":"2024-04-26T23:40:41.679920+0000","last_became_peered":"2024-04-26T23:40:41.679920+0000","last_unstale":"2024-04-26T23:40:42.686330+0000","last_undegraded":"2024-04-26T23:40:42.686330+0000","last_fullsized":"2024-04-26T23:40:42.686330+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:53:13.531466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.685801+0000","last_change":"2024-04-26T23:40:32.593432+0000","last_active":"2024-04-26T23:40:42.685801+0000","last_peered":"2024-04-26T23:40:42.685801+0000","last_clean":"2024-04-26T23:40:42.685801+0000","last_became_active":"2024-04-26T23:40:32.593169+0000","last_became_peered":"2024-04-26T23:40:32.593169+0000","last_unstale":"2024-04-26T23:40:42.685801+0000","last_undegraded":"2024-04-26T23:40:42.685801+0000","last_fullsized":"2024-04-26T23:40:42.685801+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:44:42.494850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.635935+0000","last_change":"2024-04-26T23:40:41.694551+0000","last_active":"2024-04-26T23:40:43.635935+0000","last_peered":"2024-04-26T23:40:43.635935+0000","last_clean":"2024-04-26T23:40:43.635935+0000","last_became_active":"2024-04-26T23:40:41.694297+0000","last_became_peered":"2024-04-26T23:40:41.694297+0000","last_unstale":"2024-04-26T23:40:43.635935+0000","last_undegraded":"2024-04-26T23:40:43.635935+0000","last_fullsized":"2024-04-26T23:40:43.635935+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:02:27.160408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.685388+0000","last_change":"2024-04-26T23:40:32.585137+0000","last_active":"2024-04-26T23:40:42.685388+0000","last_peered":"2024-04-26T23:40:42.685388+0000","last_clean":"2024-04-26T23:40:42.685388+0000","last_became_active":"2024-04-26T23:40:32.584678+0000","last_became_peered":"2024-04-26T23:40:32.584678+0000","last_unstale":"2024-04-26T23:40:42.685388+0000","last_undegraded":"2024-04-26T23:40:42.685388+0000","last_fullsized":"2024-04-26T23:40:42.685388+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:04:30.553552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636071+0000","last_change":"2024-04-26T23:40:41.692433+0000","last_active":"2024-04-26T23:40:43.636071+0000","last_peered":"2024-04-26T23:40:43.636071+0000","last_clean":"2024-04-26T23:40:43.636071+0000","last_became_active":"2024-04-26T23:40:41.692090+0000","last_became_peered":"2024-04-26T23:40:41.692090+0000","last_unstale":"2024-04-26T23:40:43.636071+0000","last_undegraded":"2024-04-26T23:40:43.636071+0000","last_fullsized":"2024-04-26T23:40:43.636071+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:37:25.006229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.635522+0000","last_change":"2024-04-26T23:40:32.590452+0000","last_active":"2024-04-26T23:40:43.635522+0000","last_peered":"2024-04-26T23:40:43.635522+0000","last_clean":"2024-04-26T23:40:43.635522+0000","last_became_active":"2024-04-26T23:40:32.590162+0000","last_became_peered":"2024-04-26T23:40:32.590162+0000","last_unstale":"2024-04-26T23:40:43.635522+0000","last_undegraded":"2024-04-26T23:40:43.635522+0000","last_fullsized":"2024-04-26T23:40:43.635522+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:51:30.677247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.685014+0000","last_change":"2024-04-26T23:40:41.687270+0000","last_active":"2024-04-26T23:40:42.685014+0000","last_peered":"2024-04-26T23:40:42.685014+0000","last_clean":"2024-04-26T23:40:42.685014+0000","last_became_active":"2024-04-26T23:40:41.686999+0000","last_became_peered":"2024-04-26T23:40:41.686999+0000","last_unstale":"2024-04-26T23:40:42.685014+0000","last_undegraded":"2024-04-26T23:40:42.685014+0000","last_fullsized":"2024-04-26T23:40:42.685014+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:21:42.565349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.686378+0000","last_change":"2024-04-26T23:40:32.586436+0000","last_active":"2024-04-26T23:40:42.686378+0000","last_peered":"2024-04-26T23:40:42.686378+0000","last_clean":"2024-04-26T23:40:42.686378+0000","last_became_active":"2024-04-26T23:40:32.585995+0000","last_became_peered":"2024-04-26T23:40:32.585995+0000","last_unstale":"2024-04-26T23:40:42.686378+0000","last_undegraded":"2024-04-26T23:40:42.686378+0000","last_fullsized":"2024-04-26T23:40:42.686378+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:10:42.603833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.637180+0000","last_change":"2024-04-26T23:40:41.691693+0000","last_active":"2024-04-26T23:40:43.637180+0000","last_peered":"2024-04-26T23:40:43.637180+0000","last_clean":"2024-04-26T23:40:43.637180+0000","last_became_active":"2024-04-26T23:40:41.691437+0000","last_became_peered":"2024-04-26T23:40:41.691437+0000","last_unstale":"2024-04-26T23:40:43.637180+0000","last_undegraded":"2024-04-26T23:40:43.637180+0000","last_fullsized":"2024-04-26T23:40:43.637180+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:06:12.755431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.637343+0000","last_change":"2024-04-26T23:40:32.592988+0000","last_active":"2024-04-26T23:40:43.637343+0000","last_peered":"2024-04-26T23:40:43.637343+0000","last_clean":"2024-04-26T23:40:43.637343+0000","last_became_active":"2024-04-26T23:40:32.592717+0000","last_became_peered":"2024-04-26T23:40:32.592717+0000","last_unstale":"2024-04-26T23:40:43.637343+0000","last_undegraded":"2024-04-26T23:40:43.637343+0000","last_fullsized":"2024-04-26T23:40:43.637343+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:18:09.706875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.637029+0000","last_change":"2024-04-26T23:40:41.675335+0000","last_active":"2024-04-26T23:40:43.637029+0000","last_peered":"2024-04-26T23:40:43.637029+0000","last_clean":"2024-04-26T23:40:43.637029+0000","last_became_active":"2024-04-26T23:40:41.675042+0000","last_became_peered":"2024-04-26T23:40:41.675042+0000","last_unstale":"2024-04-26T23:40:43.637029+0000","last_undegraded":"2024-04-26T23:40:43.637029+0000","last_fullsized":"2024-04-26T23:40:43.637029+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:41:52.386084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636813+0000","last_change":"2024-04-26T23:40:32.595129+0000","last_active":"2024-04-26T23:40:43.636813+0000","last_peered":"2024-04-26T23:40:43.636813+0000","last_clean":"2024-04-26T23:40:43.636813+0000","last_became_active":"2024-04-26T23:40:32.594802+0000","last_became_peered":"2024-04-26T23:40:32.594802+0000","last_unstale":"2024-04-26T23:40:43.636813+0000","last_undegraded":"2024-04-26T23:40:43.636813+0000","last_fullsized":"2024-04-26T23:40:43.636813+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:48:33.020039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636362+0000","last_change":"2024-04-26T23:40:41.691159+0000","last_active":"2024-04-26T23:40:43.636362+0000","last_peered":"2024-04-26T23:40:43.636362+0000","last_clean":"2024-04-26T23:40:43.636362+0000","last_became_active":"2024-04-26T23:40:41.690846+0000","last_became_peered":"2024-04-26T23:40:41.690846+0000","last_unstale":"2024-04-26T23:40:43.636362+0000","last_undegraded":"2024-04-26T23:40:43.636362+0000","last_fullsized":"2024-04-26T23:40:43.636362+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:45:08.076505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.683726+0000","last_change":"2024-04-26T23:40:32.578819+0000","last_active":"2024-04-26T23:40:42.683726+0000","last_peered":"2024-04-26T23:40:42.683726+0000","last_clean":"2024-04-26T23:40:42.683726+0000","last_became_active":"2024-04-26T23:40:32.578556+0000","last_became_peered":"2024-04-26T23:40:32.578556+0000","last_unstale":"2024-04-26T23:40:42.683726+0000","last_undegraded":"2024-04-26T23:40:42.683726+0000","last_fullsized":"2024-04-26T23:40:42.683726+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:17:46.135806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.635820+0000","last_change":"2024-04-26T23:40:41.689812+0000","last_active":"2024-04-26T23:40:43.635820+0000","last_peered":"2024-04-26T23:40:43.635820+0000","last_clean":"2024-04-26T23:40:43.635820+0000","last_became_active":"2024-04-26T23:40:41.689267+0000","last_became_peered":"2024-04-26T23:40:41.689267+0000","last_unstale":"2024-04-26T23:40:43.635820+0000","last_undegraded":"2024-04-26T23:40:43.635820+0000","last_fullsized":"2024-04-26T23:40:43.635820+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:21:42.565349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.684116+0000","last_change":"2024-04-26T23:40:32.578155+0000","last_active":"2024-04-26T23:40:42.684116+0000","last_peered":"2024-04-26T23:40:42.684116+0000","last_clean":"2024-04-26T23:40:42.684116+0000","last_became_active":"2024-04-26T23:40:32.577865+0000","last_became_peered":"2024-04-26T23:40:32.577865+0000","last_unstale":"2024-04-26T23:40:42.684116+0000","last_undegraded":"2024-04-26T23:40:42.684116+0000","last_fullsized":"2024-04-26T23:40:42.684116+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:40:17.167353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.685252+0000","last_change":"2024-04-26T23:40:41.680962+0000","last_active":"2024-04-26T23:40:42.685252+0000","last_peered":"2024-04-26T23:40:42.685252+0000","last_clean":"2024-04-26T23:40:42.685252+0000","last_became_active":"2024-04-26T23:40:41.680676+0000","last_became_peered":"2024-04-26T23:40:41.680676+0000","last_unstale":"2024-04-26T23:40:42.685252+0000","last_undegraded":"2024-04-26T23:40:42.685252+0000","last_fullsized":"2024-04-26T23:40:42.685252+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:42:13.754586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636455+0000","last_change":"2024-04-26T23:40:32.591487+0000","last_active":"2024-04-26T23:40:43.636455+0000","last_peered":"2024-04-26T23:40:43.636455+0000","last_clean":"2024-04-26T23:40:43.636455+0000","last_became_active":"2024-04-26T23:40:32.591209+0000","last_became_peered":"2024-04-26T23:40:32.591209+0000","last_unstale":"2024-04-26T23:40:43.636455+0000","last_undegraded":"2024-04-26T23:40:43.636455+0000","last_fullsized":"2024-04-26T23:40:43.636455+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:52:26.699790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.637724+0000","last_change":"2024-04-26T23:40:41.686089+0000","last_active":"2024-04-26T23:40:43.637724+0000","last_peered":"2024-04-26T23:40:43.637724+0000","last_clean":"2024-04-26T23:40:43.637724+0000","last_became_active":"2024-04-26T23:40:41.685786+0000","last_became_peered":"2024-04-26T23:40:41.685786+0000","last_unstale":"2024-04-26T23:40:43.637724+0000","last_undegraded":"2024-04-26T23:40:43.637724+0000","last_fullsized":"2024-04-26T23:40:43.637724+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:36:02.931532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636676+0000","last_change":"2024-04-26T23:40:32.592543+0000","last_active":"2024-04-26T23:40:43.636676+0000","last_peered":"2024-04-26T23:40:43.636676+0000","last_clean":"2024-04-26T23:40:43.636676+0000","last_became_active":"2024-04-26T23:40:32.592282+0000","last_became_peered":"2024-04-26T23:40:32.592282+0000","last_unstale":"2024-04-26T23:40:43.636676+0000","last_undegraded":"2024-04-26T23:40:43.636676+0000","last_fullsized":"2024-04-26T23:40:43.636676+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:16:46.547536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3f","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.684024+0000","last_change":"2024-04-26T23:40:41.679306+0000","last_active":"2024-04-26T23:40:42.684024+0000","last_peered":"2024-04-26T23:40:42.684024+0000","last_clean":"2024-04-26T23:40:42.684024+0000","last_became_active":"2024-04-26T23:40:41.678926+0000","last_became_peered":"2024-04-26T23:40:41.678926+0000","last_unstale":"2024-04-26T23:40:42.684024+0000","last_undegraded":"2024-04-26T23:40:42.684024+0000","last_fullsized":"2024-04-26T23:40:42.684024+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:27:48.823509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.637039+0000","last_change":"2024-04-26T23:40:32.587562+0000","last_active":"2024-04-26T23:40:43.637039+0000","last_peered":"2024-04-26T23:40:43.637039+0000","last_clean":"2024-04-26T23:40:43.637039+0000","last_became_active":"2024-04-26T23:40:32.587249+0000","last_became_peered":"2024-04-26T23:40:32.587249+0000","last_unstale":"2024-04-26T23:40:43.637039+0000","last_undegraded":"2024-04-26T23:40:43.637039+0000","last_fullsized":"2024-04-26T23:40:43.637039+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:12:45.093169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.635956+0000","last_change":"2024-04-26T23:40:41.689567+0000","last_active":"2024-04-26T23:40:43.635956+0000","last_peered":"2024-04-26T23:40:43.635956+0000","last_clean":"2024-04-26T23:40:43.635956+0000","last_became_active":"2024-04-26T23:40:41.688585+0000","last_became_peered":"2024-04-26T23:40:41.688585+0000","last_unstale":"2024-04-26T23:40:43.635956+0000","last_undegraded":"2024-04-26T23:40:43.635956+0000","last_fullsized":"2024-04-26T23:40:43.635956+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:10:57.826183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.684566+0000","last_change":"2024-04-26T23:40:32.584619+0000","last_active":"2024-04-26T23:40:42.684566+0000","last_peered":"2024-04-26T23:40:42.684566+0000","last_clean":"2024-04-26T23:40:42.684566+0000","last_became_active":"2024-04-26T23:40:32.584293+0000","last_became_peered":"2024-04-26T23:40:32.584293+0000","last_unstale":"2024-04-26T23:40:42.684566+0000","last_undegraded":"2024-04-26T23:40:42.684566+0000","last_fullsized":"2024-04-26T23:40:42.684566+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:40:17.167353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.685557+0000","last_change":"2024-04-26T23:40:41.691614+0000","last_active":"2024-04-26T23:40:42.685557+0000","last_peered":"2024-04-26T23:40:42.685557+0000","last_clean":"2024-04-26T23:40:42.685557+0000","last_became_active":"2024-04-26T23:40:41.691081+0000","last_became_peered":"2024-04-26T23:40:41.691081+0000","last_unstale":"2024-04-26T23:40:42.685557+0000","last_undegraded":"2024-04-26T23:40:42.685557+0000","last_fullsized":"2024-04-26T23:40:42.685557+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:24:07.784468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636557+0000","last_change":"2024-04-26T23:40:32.588894+0000","last_active":"2024-04-26T23:40:43.636557+0000","last_peered":"2024-04-26T23:40:43.636557+0000","last_clean":"2024-04-26T23:40:43.636557+0000","last_became_active":"2024-04-26T23:40:32.588409+0000","last_became_peered":"2024-04-26T23:40:32.588409+0000","last_unstale":"2024-04-26T23:40:43.636557+0000","last_undegraded":"2024-04-26T23:40:43.636557+0000","last_fullsized":"2024-04-26T23:40:43.636557+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:35:08.194865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636899+0000","last_change":"2024-04-26T23:40:41.678639+0000","last_active":"2024-04-26T23:40:43.636899+0000","last_peered":"2024-04-26T23:40:43.636899+0000","last_clean":"2024-04-26T23:40:43.636899+0000","last_became_active":"2024-04-26T23:40:41.678333+0000","last_became_peered":"2024-04-26T23:40:41.678333+0000","last_unstale":"2024-04-26T23:40:43.636899+0000","last_undegraded":"2024-04-26T23:40:43.636899+0000","last_fullsized":"2024-04-26T23:40:43.636899+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:42:13.754586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.685161+0000","last_change":"2024-04-26T23:40:32.581875+0000","last_active":"2024-04-26T23:40:42.685161+0000","last_peered":"2024-04-26T23:40:42.685161+0000","last_clean":"2024-04-26T23:40:42.685161+0000","last_became_active":"2024-04-26T23:40:32.580987+0000","last_became_peered":"2024-04-26T23:40:32.580987+0000","last_unstale":"2024-04-26T23:40:42.685161+0000","last_undegraded":"2024-04-26T23:40:42.685161+0000","last_fullsized":"2024-04-26T23:40:42.685161+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:12:45.093169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636219+0000","last_change":"2024-04-26T23:40:41.678366+0000","last_active":"2024-04-26T23:40:43.636219+0000","last_peered":"2024-04-26T23:40:43.636219+0000","last_clean":"2024-04-26T23:40:43.636219+0000","last_became_active":"2024-04-26T23:40:41.678067+0000","last_became_peered":"2024-04-26T23:40:41.678067+0000","last_unstale":"2024-04-26T23:40:43.636219+0000","last_undegraded":"2024-04-26T23:40:43.636219+0000","last_fullsized":"2024-04-26T23:40:43.636219+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:44:51.594010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.686634+0000","last_change":"2024-04-26T23:40:32.579870+0000","last_active":"2024-04-26T23:40:42.686634+0000","last_peered":"2024-04-26T23:40:42.686634+0000","last_clean":"2024-04-26T23:40:42.686634+0000","last_became_active":"2024-04-26T23:40:32.579569+0000","last_became_peered":"2024-04-26T23:40:32.579569+0000","last_unstale":"2024-04-26T23:40:42.686634+0000","last_undegraded":"2024-04-26T23:40:42.686634+0000","last_fullsized":"2024-04-26T23:40:42.686634+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:25:30.040358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.635430+0000","last_change":"2024-04-26T23:40:41.684020+0000","last_active":"2024-04-26T23:40:43.635430+0000","last_peered":"2024-04-26T23:40:43.635430+0000","last_clean":"2024-04-26T23:40:43.635430+0000","last_became_active":"2024-04-26T23:40:41.683734+0000","last_became_peered":"2024-04-26T23:40:41.683734+0000","last_unstale":"2024-04-26T23:40:43.635430+0000","last_undegraded":"2024-04-26T23:40:43.635430+0000","last_fullsized":"2024-04-26T23:40:43.635430+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:38:42.155257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636264+0000","last_change":"2024-04-26T23:40:32.583944+0000","last_active":"2024-04-26T23:40:43.636264+0000","last_peered":"2024-04-26T23:40:43.636264+0000","last_clean":"2024-04-26T23:40:43.636264+0000","last_became_active":"2024-04-26T23:40:32.583655+0000","last_became_peered":"2024-04-26T23:40:32.583655+0000","last_unstale":"2024-04-26T23:40:43.636264+0000","last_undegraded":"2024-04-26T23:40:43.636264+0000","last_fullsized":"2024-04-26T23:40:43.636264+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:40:17.167353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.635858+0000","last_change":"2024-04-26T23:40:41.681412+0000","last_active":"2024-04-26T23:40:43.635858+0000","last_peered":"2024-04-26T23:40:43.635858+0000","last_clean":"2024-04-26T23:40:43.635858+0000","last_became_active":"2024-04-26T23:40:41.681092+0000","last_became_peered":"2024-04-26T23:40:41.681092+0000","last_unstale":"2024-04-26T23:40:43.635858+0000","last_undegraded":"2024-04-26T23:40:43.635858+0000","last_fullsized":"2024-04-26T23:40:43.635858+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:48:09.126894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636358+0000","last_change":"2024-04-26T23:40:32.596351+0000","last_active":"2024-04-26T23:40:43.636358+0000","last_peered":"2024-04-26T23:40:43.636358+0000","last_clean":"2024-04-26T23:40:43.636358+0000","last_became_active":"2024-04-26T23:40:32.596050+0000","last_became_peered":"2024-04-26T23:40:32.596050+0000","last_unstale":"2024-04-26T23:40:43.636358+0000","last_undegraded":"2024-04-26T23:40:43.636358+0000","last_fullsized":"2024-04-26T23:40:43.636358+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:34:14.811917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574859,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27856,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343984,"statfs":{"total":96636764160,"available":96608239616,"internally_reserved":0,"allocated":856064,"data_stored":690301,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574860,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":274432,"data_stored":101489,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574860,"num_pgs":54,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":266240,"data_stored":100023,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574861,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":274432,"data_stored":99491,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574859,"num_pgs":59,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":282624,"data_stored":102507,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574859,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":258048,"data_stored":99331,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574859,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":278528,"data_stored":101055,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574861,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27864,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343976,"statfs":{"total":96636764160,"available":96608231424,"internally_reserved":0,"allocated":860160,"data_stored":690267,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T23:41:05.930 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T23:41:06.061 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:06.058+0000 7fbade6ea640 1 Processor -- start 2024-04-26T23:41:06.061 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:06.058+0000 7fbade6ea640 1 -- start start 2024-04-26T23:41:06.064 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:06.059+0000 7fbade6ea640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fbad813feb0 0x7fbad81576d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:06.064 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:06.059+0000 7fbade6ea640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fbad80c5050 0x7fbad815a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:06.064 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:06.059+0000 7fbade6ea640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbad8156c10 con 0x7fbad80c2b80 2024-04-26T23:41:06.064 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:06.059+0000 7fbade6ea640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7fbad8157240 con 0x7fbad813feb0 2024-04-26T23:41:06.064 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:06.059+0000 7fbade6ea640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7fbad80c5570 con 0x7fbad80c5050 2024-04-26T23:41:06.064 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:06.059+0000 7fbad7fff640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fbad813feb0 0x7fbad81576d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:06.064 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:06.059+0000 7fbad7fff640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fbad813feb0 0x7fbad81576d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:48738/0 (socket says 172.21.15.88:48738) 2024-04-26T23:41:06.064 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:06.059+0000 7fbad7fff640 1 -- 172.21.15.88:0/2389305200 learned_addr learned my addr 172.21.15.88:0/2389305200 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:41:06.064 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:06.059+0000 7fbad7fff640 1 -- 172.21.15.88:0/2389305200 >> v2:172.21.15.175:3300/0 conn(0x7fbad80c5050 msgr2=0x7fbad815a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:41:06.064 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:06.059+0000 7fbad7fff640 1 --2- 172.21.15.88:0/2389305200 >> v2:172.21.15.175:3300/0 conn(0x7fbad80c5050 0x7fbad815a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:06.064 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:06.059+0000 7fbad7fff640 1 -- 172.21.15.88:0/2389305200 >> v1:172.21.15.175:6789/0 conn(0x7fbad80c2b80 legacy=0x7fbad806d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:41:06.065 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:06.059+0000 7fbad7fff640 1 -- 172.21.15.88:0/2389305200 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbad80c5850 con 0x7fbad813feb0 2024-04-26T23:41:06.065 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:06.060+0000 7fbad7fff640 1 --2- 172.21.15.88:0/2389305200 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbad813feb0 0x7fbad81576d0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fbad8070760 tx=0x7fbac802a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c723a7bd4f279063 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:06.065 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:06.060+0000 7fbad6ffd640 1 -- 172.21.15.88:0/2389305200 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbac8037070 con 0x7fbad813feb0 2024-04-26T23:41:06.065 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:06.060+0000 7fbad6ffd640 1 -- 172.21.15.88:0/2389305200 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbac802ae20 con 0x7fbad813feb0 2024-04-26T23:41:06.065 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:06.060+0000 7fbad6ffd640 1 -- 172.21.15.88:0/2389305200 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbac8032660 con 0x7fbad813feb0 2024-04-26T23:41:06.065 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:06.060+0000 7fbade6ea640 1 -- 172.21.15.88:0/2389305200 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbad813feb0 msgr2=0x7fbad81576d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:06.065 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:06.060+0000 7fbade6ea640 1 --2- 172.21.15.88:0/2389305200 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbad813feb0 0x7fbad81576d0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fbad8070760 tx=0x7fbac802a110 comp rx=0 tx=0).stop 2024-04-26T23:41:06.065 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:06.060+0000 7fbade6ea640 1 -- 172.21.15.88:0/2389305200 shutdown_connections 2024-04-26T23:41:06.065 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:06.060+0000 7fbade6ea640 1 --2- 172.21.15.88:0/2389305200 >> v2:172.21.15.175:3300/0 conn(0x7fbad80c5050 0x7fbad815a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:06.065 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:06.060+0000 7fbade6ea640 1 --2- 172.21.15.88:0/2389305200 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbad813feb0 0x7fbad81576d0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:06.065 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:06.060+0000 7fbade6ea640 1 -- 172.21.15.88:0/2389305200 >> 172.21.15.88:0/2389305200 conn(0x7fbad80c5ce0 msgr2=0x7fbad80c60c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:06.065 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:06.061+0000 7fbade6ea640 1 -- 172.21.15.88:0/2389305200 shutdown_connections 2024-04-26T23:41:06.065 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:06.061+0000 7fbade6ea640 1 -- 172.21.15.88:0/2389305200 wait complete. 2024-04-26T23:41:06.068 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:06.062+0000 7fbade6ea640 1 Processor -- start 2024-04-26T23:41:06.069 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:06.062+0000 7fbade6ea640 1 -- start start 2024-04-26T23:41:06.069 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:06.062+0000 7fbade6ea640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbad80c2b80 0x7fbad8073990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:06.069 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:06.062+0000 7fbade6ea640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbad80c5050 0x7fbad8073ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:06.069 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:06.062+0000 7fbade6ea640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbad813feb0 0x7fbad8159710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:06.069 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:06.062+0000 7fbade6ea640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fbad806dbb0 con 0x7fbad80c2b80 2024-04-26T23:41:06.069 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:06.062+0000 7fbade6ea640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fbad806da30 con 0x7fbad813feb0 2024-04-26T23:41:06.069 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:06.062+0000 7fbade6ea640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fbad8140290 con 0x7fbad80c5050 2024-04-26T23:41:06.069 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:06.062+0000 7fbad7fff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbad80c2b80 0x7fbad8073990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:06.069 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:06.063+0000 7fbad7fff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbad80c2b80 0x7fbad8073990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:48752/0 (socket says 172.21.15.88:48752) 2024-04-26T23:41:06.069 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:06.063+0000 7fbad7fff640 1 -- 172.21.15.88:0/1163779453 learned_addr learned my addr 172.21.15.88:0/1163779453 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:41:06.069 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:06.063+0000 7fbad7fff640 1 -- 172.21.15.88:0/1163779453 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbad80c5050 msgr2=0x7fbad8073ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:06.069 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:06.063+0000 7fbad7fff640 1 --2- 172.21.15.88:0/1163779453 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbad80c5050 0x7fbad8073ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:06.069 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:06.063+0000 7fbad7fff640 1 -- 172.21.15.88:0/1163779453 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbad813feb0 msgr2=0x7fbad8159710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:06.069 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:06.063+0000 7fbadcc87640 1 --2- 172.21.15.88:0/1163779453 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbad813feb0 0x7fbad8159710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:06.070 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:06.063+0000 7fbad7fff640 1 --2- 172.21.15.88:0/1163779453 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbad813feb0 0x7fbad8159710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:06.070 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:06.063+0000 7fbad7fff640 1 -- 172.21.15.88:0/1163779453 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbad81e0210 con 0x7fbad80c2b80 2024-04-26T23:41:06.070 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:06.063+0000 7fbad7fff640 1 --2- 172.21.15.88:0/1163779453 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbad80c2b80 0x7fbad8073990 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fbac80097c0 tx=0x7fbac80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:06.070 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:06.063+0000 7fbad4ff9640 1 -- 172.21.15.88:0/1163779453 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbac8042070 con 0x7fbad80c2b80 2024-04-26T23:41:06.070 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:06.063+0000 7fbad4ff9640 1 -- 172.21.15.88:0/1163779453 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbac803e670 con 0x7fbad80c2b80 2024-04-26T23:41:06.070 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:06.063+0000 7fbad4ff9640 1 -- 172.21.15.88:0/1163779453 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbac8037040 con 0x7fbad80c2b80 2024-04-26T23:41:06.070 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:06.063+0000 7fbade6ea640 1 -- 172.21.15.88:0/1163779453 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbad81e04f0 con 0x7fbad80c2b80 2024-04-26T23:41:06.070 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:06.063+0000 7fbade6ea640 1 -- 172.21.15.88:0/1163779453 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbad8159170 con 0x7fbad80c2b80 2024-04-26T23:41:06.070 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:06.064+0000 7fbade6ea640 1 -- 172.21.15.88:0/1163779453 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbad80ae790 con 0x7fbad80c2b80 2024-04-26T23:41:06.070 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:06.064+0000 7fbad4ff9640 1 -- 172.21.15.88:0/1163779453 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fbac8045070 con 0x7fbad80c2b80 2024-04-26T23:41:06.070 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:06.065+0000 7fbad4ff9640 1 --2- 172.21.15.88:0/1163779453 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fbac406c8f0 0x7fbac406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:06.070 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:06.065+0000 7fbad4ff9640 1 -- 172.21.15.88:0/1163779453 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7fbac80ac500 con 0x7fbad80c2b80 2024-04-26T23:41:06.070 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:06.065+0000 7fbad77fe640 1 --2- 172.21.15.88:0/1163779453 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fbac406c8f0 0x7fbac406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:06.070 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:06.065+0000 7fbad77fe640 1 --2- 172.21.15.88:0/1163779453 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fbac406c8f0 0x7fbac406edb0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fbad81e1a80 tx=0x7fbacc006bf0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:06.072 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:06.069+0000 7fbad4ff9640 1 -- 172.21.15.88:0/1163779453 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fbac807a690 con 0x7fbad80c2b80 2024-04-26T23:41:06.243 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:06.239+0000 7fbade6ea640 1 -- 172.21.15.88:0/1163779453 --> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fbad80507a0 con 0x7fbac406c8f0 2024-04-26T23:41:06.253 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:06.250+0000 7fbad4ff9640 1 -- 172.21.15.88:0/1163779453 <== mgr.4104 v2:172.21.15.88:6832/651674297 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+490299 (secure 0 0 0) 0x7fbad80507a0 con 0x7fbac406c8f0 2024-04-26T23:41:06.258 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-26T23:41:06.261 INFO:teuthology.orchestra.run.smithi088.stderr:dumped all 2024-04-26T23:41:06.264 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:06.254+0000 7fbade6ea640 1 -- 172.21.15.88:0/1163779453 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fbac406c8f0 msgr2=0x7fbac406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:06.264 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:06.254+0000 7fbade6ea640 1 --2- 172.21.15.88:0/1163779453 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fbac406c8f0 0x7fbac406edb0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fbad81e1a80 tx=0x7fbacc006bf0 comp rx=0 tx=0).stop 2024-04-26T23:41:06.264 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:06.254+0000 7fbade6ea640 1 -- 172.21.15.88:0/1163779453 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbad80c2b80 msgr2=0x7fbad8073990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:06.265 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:06.254+0000 7fbade6ea640 1 --2- 172.21.15.88:0/1163779453 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbad80c2b80 0x7fbad8073990 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fbac80097c0 tx=0x7fbac80046c0 comp rx=0 tx=0).stop 2024-04-26T23:41:06.265 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:06.254+0000 7fbade6ea640 1 -- 172.21.15.88:0/1163779453 shutdown_connections 2024-04-26T23:41:06.265 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:06.254+0000 7fbade6ea640 1 --2- 172.21.15.88:0/1163779453 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fbac406c8f0 0x7fbac406edb0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:06.265 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:06.254+0000 7fbade6ea640 1 --2- 172.21.15.88:0/1163779453 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbad80c5050 0x7fbad8073ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:06.265 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:06.254+0000 7fbade6ea640 1 --2- 172.21.15.88:0/1163779453 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbad813feb0 0x7fbad8159710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:06.265 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:06.254+0000 7fbade6ea640 1 --2- 172.21.15.88:0/1163779453 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbad80c2b80 0x7fbad8073990 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:06.265 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:06.254+0000 7fbade6ea640 1 -- 172.21.15.88:0/1163779453 >> 172.21.15.88:0/1163779453 conn(0x7fbad80c5ce0 msgr2=0x7fbad806f440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:06.266 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:06.254+0000 7fbade6ea640 1 -- 172.21.15.88:0/1163779453 shutdown_connections 2024-04-26T23:41:06.266 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:06.254+0000 7fbade6ea640 1 -- 172.21.15.88:0/1163779453 wait complete. 2024-04-26T23:41:06.268 INFO:teuthology.orchestra.run.smithi088.stdout:{"pg_ready":true,"pg_map":{"version":41,"stamp":"2024-04-26T23:41:05.929251+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595700,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":253,"num_write_kb":2448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":199,"ondisk_log_size":199,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":386,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219444,"kb_used_data":3272,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755276,"statfs":{"total":773094113280,"available":772869402624,"internally_reserved":0,"allocated":3350528,"data_stored":1984976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":512,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002545"},"pg_stats":[{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636272+0000","last_change":"2024-04-26T23:40:41.683801+0000","last_active":"2024-04-26T23:40:43.636272+0000","last_peered":"2024-04-26T23:40:43.636272+0000","last_clean":"2024-04-26T23:40:43.636272+0000","last_became_active":"2024-04-26T23:40:41.683484+0000","last_became_peered":"2024-04-26T23:40:41.683484+0000","last_unstale":"2024-04-26T23:40:43.636272+0000","last_undegraded":"2024-04-26T23:40:43.636272+0000","last_fullsized":"2024-04-26T23:40:43.636272+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:02:27.160408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":26,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.686904+0000","last_change":"2024-04-26T23:40:31.576688+0000","last_active":"2024-04-26T23:40:42.686904+0000","last_peered":"2024-04-26T23:40:42.686904+0000","last_clean":"2024-04-26T23:40:42.686904+0000","last_became_active":"2024-04-26T23:40:31.576429+0000","last_became_peered":"2024-04-26T23:40:31.576429+0000","last_unstale":"2024-04-26T23:40:42.686904+0000","last_undegraded":"2024-04-26T23:40:42.686904+0000","last_fullsized":"2024-04-26T23:40:42.686904+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:47:42.681376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.637858+0000","last_change":"2024-04-26T23:40:32.578489+0000","last_active":"2024-04-26T23:40:43.637858+0000","last_peered":"2024-04-26T23:40:43.637858+0000","last_clean":"2024-04-26T23:40:43.637858+0000","last_became_active":"2024-04-26T23:40:32.578205+0000","last_became_peered":"2024-04-26T23:40:32.578205+0000","last_unstale":"2024-04-26T23:40:43.637858+0000","last_undegraded":"2024-04-26T23:40:43.637858+0000","last_fullsized":"2024-04-26T23:40:43.637858+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:56:04.309611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636964+0000","last_change":"2024-04-26T23:40:40.666861+0000","last_active":"2024-04-26T23:40:43.636964+0000","last_peered":"2024-04-26T23:40:43.636964+0000","last_clean":"2024-04-26T23:40:43.636964+0000","last_became_active":"2024-04-26T23:40:40.666547+0000","last_became_peered":"2024-04-26T23:40:40.666547+0000","last_unstale":"2024-04-26T23:40:43.636964+0000","last_undegraded":"2024-04-26T23:40:43.636964+0000","last_fullsized":"2024-04-26T23:40:43.636964+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:27:47.818055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.635388+0000","last_change":"2024-04-26T23:40:41.689530+0000","last_active":"2024-04-26T23:40:43.635388+0000","last_peered":"2024-04-26T23:40:43.635388+0000","last_clean":"2024-04-26T23:40:43.635388+0000","last_became_active":"2024-04-26T23:40:41.687652+0000","last_became_peered":"2024-04-26T23:40:41.687652+0000","last_unstale":"2024-04-26T23:40:43.635388+0000","last_undegraded":"2024-04-26T23:40:43.635388+0000","last_fullsized":"2024-04-26T23:40:43.635388+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:58:45.972045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.637959+0000","last_change":"2024-04-26T23:40:31.576867+0000","last_active":"2024-04-26T23:40:43.637959+0000","last_peered":"2024-04-26T23:40:43.637959+0000","last_clean":"2024-04-26T23:40:43.637959+0000","last_became_active":"2024-04-26T23:40:31.576342+0000","last_became_peered":"2024-04-26T23:40:31.576342+0000","last_unstale":"2024-04-26T23:40:43.637959+0000","last_undegraded":"2024-04-26T23:40:43.637959+0000","last_fullsized":"2024-04-26T23:40:43.637959+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:35:54.439397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.686802+0000","last_change":"2024-04-26T23:40:32.589769+0000","last_active":"2024-04-26T23:40:42.686802+0000","last_peered":"2024-04-26T23:40:42.686802+0000","last_clean":"2024-04-26T23:40:42.686802+0000","last_became_active":"2024-04-26T23:40:32.589489+0000","last_became_peered":"2024-04-26T23:40:32.589489+0000","last_unstale":"2024-04-26T23:40:42.686802+0000","last_undegraded":"2024-04-26T23:40:42.686802+0000","last_fullsized":"2024-04-26T23:40:42.686802+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:40:17.167353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636746+0000","last_change":"2024-04-26T23:40:40.672310+0000","last_active":"2024-04-26T23:40:43.636746+0000","last_peered":"2024-04-26T23:40:43.636746+0000","last_clean":"2024-04-26T23:40:43.636746+0000","last_became_active":"2024-04-26T23:40:40.672018+0000","last_became_peered":"2024-04-26T23:40:40.672018+0000","last_unstale":"2024-04-26T23:40:43.636746+0000","last_undegraded":"2024-04-26T23:40:43.636746+0000","last_fullsized":"2024-04-26T23:40:43.636746+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:01:10.835670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636004+0000","last_change":"2024-04-26T23:40:41.686743+0000","last_active":"2024-04-26T23:40:43.636004+0000","last_peered":"2024-04-26T23:40:43.636004+0000","last_clean":"2024-04-26T23:40:43.636004+0000","last_became_active":"2024-04-26T23:40:41.686419+0000","last_became_peered":"2024-04-26T23:40:41.686419+0000","last_unstale":"2024-04-26T23:40:43.636004+0000","last_undegraded":"2024-04-26T23:40:43.636004+0000","last_fullsized":"2024-04-26T23:40:43.636004+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:08:35.027584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.637221+0000","last_change":"2024-04-26T23:40:31.578735+0000","last_active":"2024-04-26T23:40:43.637221+0000","last_peered":"2024-04-26T23:40:43.637221+0000","last_clean":"2024-04-26T23:40:43.637221+0000","last_became_active":"2024-04-26T23:40:31.578438+0000","last_became_peered":"2024-04-26T23:40:31.578438+0000","last_unstale":"2024-04-26T23:40:43.637221+0000","last_undegraded":"2024-04-26T23:40:43.637221+0000","last_fullsized":"2024-04-26T23:40:43.637221+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:30:10.397569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.685239+0000","last_change":"2024-04-26T23:40:32.590624+0000","last_active":"2024-04-26T23:40:42.685239+0000","last_peered":"2024-04-26T23:40:42.685239+0000","last_clean":"2024-04-26T23:40:42.685239+0000","last_became_active":"2024-04-26T23:40:32.589687+0000","last_became_peered":"2024-04-26T23:40:32.589687+0000","last_unstale":"2024-04-26T23:40:42.685239+0000","last_undegraded":"2024-04-26T23:40:42.685239+0000","last_fullsized":"2024-04-26T23:40:42.685239+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:01:02.741964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"23'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.637058+0000","last_change":"2024-04-26T23:40:40.677899+0000","last_active":"2024-04-26T23:40:43.637058+0000","last_peered":"2024-04-26T23:40:43.637058+0000","last_clean":"2024-04-26T23:40:43.637058+0000","last_became_active":"2024-04-26T23:40:40.677388+0000","last_became_peered":"2024-04-26T23:40:40.677388+0000","last_unstale":"2024-04-26T23:40:43.637058+0000","last_undegraded":"2024-04-26T23:40:43.637058+0000","last_fullsized":"2024-04-26T23:40:43.637058+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:52:34.793496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.684740+0000","last_change":"2024-04-26T23:40:41.680097+0000","last_active":"2024-04-26T23:40:42.684740+0000","last_peered":"2024-04-26T23:40:42.684740+0000","last_clean":"2024-04-26T23:40:42.684740+0000","last_became_active":"2024-04-26T23:40:41.679815+0000","last_became_peered":"2024-04-26T23:40:41.679815+0000","last_unstale":"2024-04-26T23:40:42.684740+0000","last_undegraded":"2024-04-26T23:40:42.684740+0000","last_fullsized":"2024-04-26T23:40:42.684740+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:10:30.972726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636837+0000","last_change":"2024-04-26T23:40:31.573648+0000","last_active":"2024-04-26T23:40:43.636837+0000","last_peered":"2024-04-26T23:40:43.636837+0000","last_clean":"2024-04-26T23:40:43.636837+0000","last_became_active":"2024-04-26T23:40:31.573347+0000","last_became_peered":"2024-04-26T23:40:31.573347+0000","last_unstale":"2024-04-26T23:40:43.636837+0000","last_undegraded":"2024-04-26T23:40:43.636837+0000","last_fullsized":"2024-04-26T23:40:43.636837+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:20:28.103413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.685588+0000","last_change":"2024-04-26T23:40:32.588309+0000","last_active":"2024-04-26T23:40:42.685588+0000","last_peered":"2024-04-26T23:40:42.685588+0000","last_clean":"2024-04-26T23:40:42.685588+0000","last_became_active":"2024-04-26T23:40:32.588007+0000","last_became_peered":"2024-04-26T23:40:32.588007+0000","last_unstale":"2024-04-26T23:40:42.685588+0000","last_undegraded":"2024-04-26T23:40:42.685588+0000","last_fullsized":"2024-04-26T23:40:42.685588+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:52:26.699790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"23'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636105+0000","last_change":"2024-04-26T23:40:40.678547+0000","last_active":"2024-04-26T23:40:43.636105+0000","last_peered":"2024-04-26T23:40:43.636105+0000","last_clean":"2024-04-26T23:40:43.636105+0000","last_became_active":"2024-04-26T23:40:40.677668+0000","last_became_peered":"2024-04-26T23:40:40.677668+0000","last_unstale":"2024-04-26T23:40:43.636105+0000","last_undegraded":"2024-04-26T23:40:43.636105+0000","last_fullsized":"2024-04-26T23:40:43.636105+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:34:22.905623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636105+0000","last_change":"2024-04-26T23:40:41.689525+0000","last_active":"2024-04-26T23:40:43.636105+0000","last_peered":"2024-04-26T23:40:43.636105+0000","last_clean":"2024-04-26T23:40:43.636105+0000","last_became_active":"2024-04-26T23:40:41.687433+0000","last_became_peered":"2024-04-26T23:40:41.687433+0000","last_unstale":"2024-04-26T23:40:43.636105+0000","last_undegraded":"2024-04-26T23:40:43.636105+0000","last_fullsized":"2024-04-26T23:40:43.636105+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:38:42.155257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.684004+0000","last_change":"2024-04-26T23:40:32.590053+0000","last_active":"2024-04-26T23:40:42.684004+0000","last_peered":"2024-04-26T23:40:42.684004+0000","last_clean":"2024-04-26T23:40:42.684004+0000","last_became_active":"2024-04-26T23:40:32.589802+0000","last_became_peered":"2024-04-26T23:40:32.589802+0000","last_unstale":"2024-04-26T23:40:42.684004+0000","last_undegraded":"2024-04-26T23:40:42.684004+0000","last_fullsized":"2024-04-26T23:40:42.684004+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:16:46.547536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636775+0000","last_change":"2024-04-26T23:40:31.578524+0000","last_active":"2024-04-26T23:40:43.636775+0000","last_peered":"2024-04-26T23:40:43.636775+0000","last_clean":"2024-04-26T23:40:43.636775+0000","last_became_active":"2024-04-26T23:40:31.578230+0000","last_became_peered":"2024-04-26T23:40:31.578230+0000","last_unstale":"2024-04-26T23:40:43.636775+0000","last_undegraded":"2024-04-26T23:40:43.636775+0000","last_fullsized":"2024-04-26T23:40:43.636775+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:15:51.937774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"23'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636197+0000","last_change":"2024-04-26T23:40:40.676459+0000","last_active":"2024-04-26T23:40:43.636197+0000","last_peered":"2024-04-26T23:40:43.636197+0000","last_clean":"2024-04-26T23:40:43.636197+0000","last_became_active":"2024-04-26T23:40:40.675997+0000","last_became_peered":"2024-04-26T23:40:40.675997+0000","last_unstale":"2024-04-26T23:40:43.636197+0000","last_undegraded":"2024-04-26T23:40:43.636197+0000","last_fullsized":"2024-04-26T23:40:43.636197+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:37:38.455501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.635973+0000","last_change":"2024-04-26T23:40:41.679334+0000","last_active":"2024-04-26T23:40:43.635973+0000","last_peered":"2024-04-26T23:40:43.635973+0000","last_clean":"2024-04-26T23:40:43.635973+0000","last_became_active":"2024-04-26T23:40:41.679098+0000","last_became_peered":"2024-04-26T23:40:41.679098+0000","last_unstale":"2024-04-26T23:40:43.635973+0000","last_undegraded":"2024-04-26T23:40:43.635973+0000","last_fullsized":"2024-04-26T23:40:43.635973+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:52:35.798951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.637449+0000","last_change":"2024-04-26T23:40:32.585827+0000","last_active":"2024-04-26T23:40:43.637449+0000","last_peered":"2024-04-26T23:40:43.637449+0000","last_clean":"2024-04-26T23:40:43.637449+0000","last_became_active":"2024-04-26T23:40:32.585522+0000","last_became_peered":"2024-04-26T23:40:32.585522+0000","last_unstale":"2024-04-26T23:40:43.637449+0000","last_undegraded":"2024-04-26T23:40:43.637449+0000","last_fullsized":"2024-04-26T23:40:43.637449+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:40:17.167353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.635887+0000","last_change":"2024-04-26T23:40:31.575121+0000","last_active":"2024-04-26T23:40:43.635887+0000","last_peered":"2024-04-26T23:40:43.635887+0000","last_clean":"2024-04-26T23:40:43.635887+0000","last_became_active":"2024-04-26T23:40:31.574827+0000","last_became_peered":"2024-04-26T23:40:31.574827+0000","last_unstale":"2024-04-26T23:40:43.635887+0000","last_undegraded":"2024-04-26T23:40:43.635887+0000","last_fullsized":"2024-04-26T23:40:43.635887+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:43:13.740214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636996+0000","last_change":"2024-04-26T23:40:40.678613+0000","last_active":"2024-04-26T23:40:43.636996+0000","last_peered":"2024-04-26T23:40:43.636996+0000","last_clean":"2024-04-26T23:40:43.636996+0000","last_became_active":"2024-04-26T23:40:40.677867+0000","last_became_peered":"2024-04-26T23:40:40.677867+0000","last_unstale":"2024-04-26T23:40:43.636996+0000","last_undegraded":"2024-04-26T23:40:43.636996+0000","last_fullsized":"2024-04-26T23:40:43.636996+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:35:16.288571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636503+0000","last_change":"2024-04-26T23:40:41.685042+0000","last_active":"2024-04-26T23:40:43.636503+0000","last_peered":"2024-04-26T23:40:43.636503+0000","last_clean":"2024-04-26T23:40:43.636503+0000","last_became_active":"2024-04-26T23:40:41.684699+0000","last_became_peered":"2024-04-26T23:40:41.684699+0000","last_unstale":"2024-04-26T23:40:43.636503+0000","last_undegraded":"2024-04-26T23:40:43.636503+0000","last_fullsized":"2024-04-26T23:40:43.636503+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:10:57.826183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636873+0000","last_change":"2024-04-26T23:40:32.582721+0000","last_active":"2024-04-26T23:40:43.636873+0000","last_peered":"2024-04-26T23:40:43.636873+0000","last_clean":"2024-04-26T23:40:43.636873+0000","last_became_active":"2024-04-26T23:40:32.582438+0000","last_became_peered":"2024-04-26T23:40:32.582438+0000","last_unstale":"2024-04-26T23:40:43.636873+0000","last_undegraded":"2024-04-26T23:40:43.636873+0000","last_fullsized":"2024-04-26T23:40:43.636873+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:38:10.884592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.635560+0000","last_change":"2024-04-26T23:40:31.575508+0000","last_active":"2024-04-26T23:40:43.635560+0000","last_peered":"2024-04-26T23:40:43.635560+0000","last_clean":"2024-04-26T23:40:43.635560+0000","last_became_active":"2024-04-26T23:40:31.575242+0000","last_became_peered":"2024-04-26T23:40:31.575242+0000","last_unstale":"2024-04-26T23:40:43.635560+0000","last_undegraded":"2024-04-26T23:40:43.635560+0000","last_fullsized":"2024-04-26T23:40:43.635560+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:48:32.015654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"23'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636104+0000","last_change":"2024-04-26T23:40:40.679196+0000","last_active":"2024-04-26T23:40:43.636104+0000","last_peered":"2024-04-26T23:40:43.636104+0000","last_clean":"2024-04-26T23:40:43.636104+0000","last_became_active":"2024-04-26T23:40:40.678740+0000","last_became_peered":"2024-04-26T23:40:40.678740+0000","last_unstale":"2024-04-26T23:40:43.636104+0000","last_undegraded":"2024-04-26T23:40:43.636104+0000","last_fullsized":"2024-04-26T23:40:43.636104+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:40:14.479631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.685673+0000","last_change":"2024-04-26T23:40:41.686638+0000","last_active":"2024-04-26T23:40:42.685673+0000","last_peered":"2024-04-26T23:40:42.685673+0000","last_clean":"2024-04-26T23:40:42.685673+0000","last_became_active":"2024-04-26T23:40:41.686354+0000","last_became_peered":"2024-04-26T23:40:41.686354+0000","last_unstale":"2024-04-26T23:40:42.685673+0000","last_undegraded":"2024-04-26T23:40:42.685673+0000","last_fullsized":"2024-04-26T23:40:42.685673+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:06:12.755431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.637002+0000","last_change":"2024-04-26T23:40:32.583019+0000","last_active":"2024-04-26T23:40:43.637002+0000","last_peered":"2024-04-26T23:40:43.637002+0000","last_clean":"2024-04-26T23:40:43.637002+0000","last_became_active":"2024-04-26T23:40:32.582719+0000","last_became_peered":"2024-04-26T23:40:32.582719+0000","last_unstale":"2024-04-26T23:40:43.637002+0000","last_undegraded":"2024-04-26T23:40:43.637002+0000","last_fullsized":"2024-04-26T23:40:43.637002+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:25:02.319783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.635607+0000","last_change":"2024-04-26T23:40:31.576866+0000","last_active":"2024-04-26T23:40:43.635607+0000","last_peered":"2024-04-26T23:40:43.635607+0000","last_clean":"2024-04-26T23:40:43.635607+0000","last_became_active":"2024-04-26T23:40:31.576419+0000","last_became_peered":"2024-04-26T23:40:31.576419+0000","last_unstale":"2024-04-26T23:40:43.635607+0000","last_undegraded":"2024-04-26T23:40:43.635607+0000","last_fullsized":"2024-04-26T23:40:43.635607+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:45:49.295198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"23'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636623+0000","last_change":"2024-04-26T23:40:40.675262+0000","last_active":"2024-04-26T23:40:43.636623+0000","last_peered":"2024-04-26T23:40:43.636623+0000","last_clean":"2024-04-26T23:40:43.636623+0000","last_became_active":"2024-04-26T23:40:40.674721+0000","last_became_peered":"2024-04-26T23:40:40.674721+0000","last_unstale":"2024-04-26T23:40:43.636623+0000","last_undegraded":"2024-04-26T23:40:43.636623+0000","last_fullsized":"2024-04-26T23:40:43.636623+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:56:12.403317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.635271+0000","last_change":"2024-04-26T23:40:41.691494+0000","last_active":"2024-04-26T23:40:43.635271+0000","last_peered":"2024-04-26T23:40:43.635271+0000","last_clean":"2024-04-26T23:40:43.635271+0000","last_became_active":"2024-04-26T23:40:41.691241+0000","last_became_peered":"2024-04-26T23:40:41.691241+0000","last_unstale":"2024-04-26T23:40:43.635271+0000","last_undegraded":"2024-04-26T23:40:43.635271+0000","last_fullsized":"2024-04-26T23:40:43.635271+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:08:35.027584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.687075+0000","last_change":"2024-04-26T23:40:32.584988+0000","last_active":"2024-04-26T23:40:42.687075+0000","last_peered":"2024-04-26T23:40:42.687075+0000","last_clean":"2024-04-26T23:40:42.687075+0000","last_became_active":"2024-04-26T23:40:32.584467+0000","last_became_peered":"2024-04-26T23:40:32.584467+0000","last_unstale":"2024-04-26T23:40:42.687075+0000","last_undegraded":"2024-04-26T23:40:42.687075+0000","last_fullsized":"2024-04-26T23:40:42.687075+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:51:30.677247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.684365+0000","last_change":"2024-04-26T23:40:31.573721+0000","last_active":"2024-04-26T23:40:42.684365+0000","last_peered":"2024-04-26T23:40:42.684365+0000","last_clean":"2024-04-26T23:40:42.684365+0000","last_became_active":"2024-04-26T23:40:31.573434+0000","last_became_peered":"2024-04-26T23:40:31.573434+0000","last_unstale":"2024-04-26T23:40:42.684365+0000","last_undegraded":"2024-04-26T23:40:42.684365+0000","last_fullsized":"2024-04-26T23:40:42.684365+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:20:28.103413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636650+0000","last_change":"2024-04-26T23:40:40.678020+0000","last_active":"2024-04-26T23:40:43.636650+0000","last_peered":"2024-04-26T23:40:43.636650+0000","last_clean":"2024-04-26T23:40:43.636650+0000","last_became_active":"2024-04-26T23:40:40.677410+0000","last_became_peered":"2024-04-26T23:40:40.677410+0000","last_unstale":"2024-04-26T23:40:43.636650+0000","last_undegraded":"2024-04-26T23:40:43.636650+0000","last_fullsized":"2024-04-26T23:40:43.636650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:44:50.588556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.635487+0000","last_change":"2024-04-26T23:40:41.689839+0000","last_active":"2024-04-26T23:40:43.635487+0000","last_peered":"2024-04-26T23:40:43.635487+0000","last_clean":"2024-04-26T23:40:43.635487+0000","last_became_active":"2024-04-26T23:40:41.689508+0000","last_became_peered":"2024-04-26T23:40:41.689508+0000","last_unstale":"2024-04-26T23:40:43.635487+0000","last_undegraded":"2024-04-26T23:40:43.635487+0000","last_fullsized":"2024-04-26T23:40:43.635487+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:17:28.672777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.637978+0000","last_change":"2024-04-26T23:40:32.594913+0000","last_active":"2024-04-26T23:40:43.637978+0000","last_peered":"2024-04-26T23:40:43.637978+0000","last_clean":"2024-04-26T23:40:43.637978+0000","last_became_active":"2024-04-26T23:40:32.594616+0000","last_became_peered":"2024-04-26T23:40:32.594616+0000","last_unstale":"2024-04-26T23:40:43.637978+0000","last_undegraded":"2024-04-26T23:40:43.637978+0000","last_fullsized":"2024-04-26T23:40:43.637978+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:04:30.553552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636386+0000","last_change":"2024-04-26T23:40:31.576299+0000","last_active":"2024-04-26T23:40:43.636386+0000","last_peered":"2024-04-26T23:40:43.636386+0000","last_clean":"2024-04-26T23:40:43.636386+0000","last_became_active":"2024-04-26T23:40:31.576006+0000","last_became_peered":"2024-04-26T23:40:31.576006+0000","last_unstale":"2024-04-26T23:40:43.636386+0000","last_undegraded":"2024-04-26T23:40:43.636386+0000","last_fullsized":"2024-04-26T23:40:43.636386+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:15:51.937774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.635376+0000","last_change":"2024-04-26T23:40:40.674806+0000","last_active":"2024-04-26T23:40:43.635376+0000","last_peered":"2024-04-26T23:40:43.635376+0000","last_clean":"2024-04-26T23:40:43.635376+0000","last_became_active":"2024-04-26T23:40:40.674557+0000","last_became_peered":"2024-04-26T23:40:40.674557+0000","last_unstale":"2024-04-26T23:40:43.635376+0000","last_undegraded":"2024-04-26T23:40:43.635376+0000","last_fullsized":"2024-04-26T23:40:43.635376+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:45:33.226487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.683778+0000","last_change":"2024-04-26T23:40:41.688941+0000","last_active":"2024-04-26T23:40:42.683778+0000","last_peered":"2024-04-26T23:40:42.683778+0000","last_clean":"2024-04-26T23:40:42.683778+0000","last_became_active":"2024-04-26T23:40:41.688653+0000","last_became_peered":"2024-04-26T23:40:41.688653+0000","last_unstale":"2024-04-26T23:40:42.683778+0000","last_undegraded":"2024-04-26T23:40:42.683778+0000","last_fullsized":"2024-04-26T23:40:42.683778+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:53:13.531466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636366+0000","last_change":"2024-04-26T23:40:32.582442+0000","last_active":"2024-04-26T23:40:43.636366+0000","last_peered":"2024-04-26T23:40:43.636366+0000","last_clean":"2024-04-26T23:40:43.636366+0000","last_became_active":"2024-04-26T23:40:32.582140+0000","last_became_peered":"2024-04-26T23:40:32.582140+0000","last_unstale":"2024-04-26T23:40:43.636366+0000","last_undegraded":"2024-04-26T23:40:43.636366+0000","last_fullsized":"2024-04-26T23:40:43.636366+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:18:09.706875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.637335+0000","last_change":"2024-04-26T23:40:31.576565+0000","last_active":"2024-04-26T23:40:43.637335+0000","last_peered":"2024-04-26T23:40:43.637335+0000","last_clean":"2024-04-26T23:40:43.637335+0000","last_became_active":"2024-04-26T23:40:31.576313+0000","last_became_peered":"2024-04-26T23:40:31.576313+0000","last_unstale":"2024-04-26T23:40:43.637335+0000","last_undegraded":"2024-04-26T23:40:43.637335+0000","last_fullsized":"2024-04-26T23:40:43.637335+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:25:01.315397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.686609+0000","last_change":"2024-04-26T23:40:40.671047+0000","last_active":"2024-04-26T23:40:42.686609+0000","last_peered":"2024-04-26T23:40:42.686609+0000","last_clean":"2024-04-26T23:40:42.686609+0000","last_became_active":"2024-04-26T23:40:40.670630+0000","last_became_peered":"2024-04-26T23:40:40.670630+0000","last_unstale":"2024-04-26T23:40:42.686609+0000","last_undegraded":"2024-04-26T23:40:42.686609+0000","last_fullsized":"2024-04-26T23:40:42.686609+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:45:07.071050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.686921+0000","last_change":"2024-04-26T23:40:41.686221+0000","last_active":"2024-04-26T23:40:42.686921+0000","last_peered":"2024-04-26T23:40:42.686921+0000","last_clean":"2024-04-26T23:40:42.686921+0000","last_became_active":"2024-04-26T23:40:41.685961+0000","last_became_peered":"2024-04-26T23:40:41.685961+0000","last_unstale":"2024-04-26T23:40:42.686921+0000","last_undegraded":"2024-04-26T23:40:42.686921+0000","last_fullsized":"2024-04-26T23:40:42.686921+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:28:34.920939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.685609+0000","last_change":"2024-04-26T23:40:32.584363+0000","last_active":"2024-04-26T23:40:42.685609+0000","last_peered":"2024-04-26T23:40:42.685609+0000","last_clean":"2024-04-26T23:40:42.685609+0000","last_became_active":"2024-04-26T23:40:32.584082+0000","last_became_peered":"2024-04-26T23:40:32.584082+0000","last_unstale":"2024-04-26T23:40:42.685609+0000","last_undegraded":"2024-04-26T23:40:42.685609+0000","last_fullsized":"2024-04-26T23:40:42.685609+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:35:08.194865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636458+0000","last_change":"2024-04-26T23:40:31.576711+0000","last_active":"2024-04-26T23:40:43.636458+0000","last_peered":"2024-04-26T23:40:43.636458+0000","last_clean":"2024-04-26T23:40:43.636458+0000","last_became_active":"2024-04-26T23:40:31.576404+0000","last_became_peered":"2024-04-26T23:40:31.576404+0000","last_unstale":"2024-04-26T23:40:43.636458+0000","last_undegraded":"2024-04-26T23:40:43.636458+0000","last_fullsized":"2024-04-26T23:40:43.636458+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:45:49.295198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.635616+0000","last_change":"2024-04-26T23:40:40.675296+0000","last_active":"2024-04-26T23:40:43.635616+0000","last_peered":"2024-04-26T23:40:43.635616+0000","last_clean":"2024-04-26T23:40:43.635616+0000","last_became_active":"2024-04-26T23:40:40.674935+0000","last_became_peered":"2024-04-26T23:40:40.674935+0000","last_unstale":"2024-04-26T23:40:43.635616+0000","last_undegraded":"2024-04-26T23:40:43.635616+0000","last_fullsized":"2024-04-26T23:40:43.635616+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:10:10.722905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.686589+0000","last_change":"2024-04-26T23:40:41.691510+0000","last_active":"2024-04-26T23:40:42.686589+0000","last_peered":"2024-04-26T23:40:42.686589+0000","last_clean":"2024-04-26T23:40:42.686589+0000","last_became_active":"2024-04-26T23:40:41.691242+0000","last_became_peered":"2024-04-26T23:40:41.691242+0000","last_unstale":"2024-04-26T23:40:42.686589+0000","last_undegraded":"2024-04-26T23:40:42.686589+0000","last_fullsized":"2024-04-26T23:40:42.686589+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:27:48.823509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.637394+0000","last_change":"2024-04-26T23:40:32.590069+0000","last_active":"2024-04-26T23:40:43.637394+0000","last_peered":"2024-04-26T23:40:43.637394+0000","last_clean":"2024-04-26T23:40:43.637394+0000","last_became_active":"2024-04-26T23:40:32.589790+0000","last_became_peered":"2024-04-26T23:40:32.589790+0000","last_unstale":"2024-04-26T23:40:43.637394+0000","last_undegraded":"2024-04-26T23:40:43.637394+0000","last_fullsized":"2024-04-26T23:40:43.637394+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:15:52.942160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.684776+0000","last_change":"2024-04-26T23:40:31.572432+0000","last_active":"2024-04-26T23:40:42.684776+0000","last_peered":"2024-04-26T23:40:42.684776+0000","last_clean":"2024-04-26T23:40:42.684776+0000","last_became_active":"2024-04-26T23:40:31.572121+0000","last_became_peered":"2024-04-26T23:40:31.572121+0000","last_unstale":"2024-04-26T23:40:42.684776+0000","last_undegraded":"2024-04-26T23:40:42.684776+0000","last_fullsized":"2024-04-26T23:40:42.684776+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:45:49.295198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636314+0000","last_change":"2024-04-26T23:40:40.678404+0000","last_active":"2024-04-26T23:40:43.636314+0000","last_peered":"2024-04-26T23:40:43.636314+0000","last_clean":"2024-04-26T23:40:43.636314+0000","last_became_active":"2024-04-26T23:40:40.678136+0000","last_became_peered":"2024-04-26T23:40:40.678136+0000","last_unstale":"2024-04-26T23:40:43.636314+0000","last_undegraded":"2024-04-26T23:40:43.636314+0000","last_fullsized":"2024-04-26T23:40:43.636314+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:45:11.058699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636232+0000","last_change":"2024-04-26T23:40:41.673542+0000","last_active":"2024-04-26T23:40:43.636232+0000","last_peered":"2024-04-26T23:40:43.636232+0000","last_clean":"2024-04-26T23:40:43.636232+0000","last_became_active":"2024-04-26T23:40:41.673254+0000","last_became_peered":"2024-04-26T23:40:41.673254+0000","last_unstale":"2024-04-26T23:40:43.636232+0000","last_undegraded":"2024-04-26T23:40:43.636232+0000","last_fullsized":"2024-04-26T23:40:43.636232+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:10:11.728359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.635254+0000","last_change":"2024-04-26T23:40:32.576783+0000","last_active":"2024-04-26T23:40:43.635254+0000","last_peered":"2024-04-26T23:40:43.635254+0000","last_clean":"2024-04-26T23:40:43.635254+0000","last_became_active":"2024-04-26T23:40:32.576481+0000","last_became_peered":"2024-04-26T23:40:32.576481+0000","last_unstale":"2024-04-26T23:40:43.635254+0000","last_undegraded":"2024-04-26T23:40:43.635254+0000","last_fullsized":"2024-04-26T23:40:43.635254+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:16:46.547536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.635776+0000","last_change":"2024-04-26T23:40:31.570775+0000","last_active":"2024-04-26T23:40:43.635776+0000","last_peered":"2024-04-26T23:40:43.635776+0000","last_clean":"2024-04-26T23:40:43.635776+0000","last_became_active":"2024-04-26T23:40:31.570493+0000","last_became_peered":"2024-04-26T23:40:31.570493+0000","last_unstale":"2024-04-26T23:40:43.635776+0000","last_undegraded":"2024-04-26T23:40:43.635776+0000","last_fullsized":"2024-04-26T23:40:43.635776+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:45:49.295198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"23'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636208+0000","last_change":"2024-04-26T23:40:40.675115+0000","last_active":"2024-04-26T23:40:43.636208+0000","last_peered":"2024-04-26T23:40:43.636208+0000","last_clean":"2024-04-26T23:40:43.636208+0000","last_became_active":"2024-04-26T23:40:40.674828+0000","last_became_peered":"2024-04-26T23:40:40.674828+0000","last_unstale":"2024-04-26T23:40:43.636208+0000","last_undegraded":"2024-04-26T23:40:43.636208+0000","last_fullsized":"2024-04-26T23:40:43.636208+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:45:07.071050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.685711+0000","last_change":"2024-04-26T23:40:41.691098+0000","last_active":"2024-04-26T23:40:42.685711+0000","last_peered":"2024-04-26T23:40:42.685711+0000","last_clean":"2024-04-26T23:40:42.685711+0000","last_became_active":"2024-04-26T23:40:41.690803+0000","last_became_peered":"2024-04-26T23:40:41.690803+0000","last_unstale":"2024-04-26T23:40:42.685711+0000","last_undegraded":"2024-04-26T23:40:42.685711+0000","last_fullsized":"2024-04-26T23:40:42.685711+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:38:51.195172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.686290+0000","last_change":"2024-04-26T23:40:32.593262+0000","last_active":"2024-04-26T23:40:42.686290+0000","last_peered":"2024-04-26T23:40:42.686290+0000","last_clean":"2024-04-26T23:40:42.686290+0000","last_became_active":"2024-04-26T23:40:32.593003+0000","last_became_peered":"2024-04-26T23:40:32.593003+0000","last_unstale":"2024-04-26T23:40:42.686290+0000","last_undegraded":"2024-04-26T23:40:42.686290+0000","last_fullsized":"2024-04-26T23:40:42.686290+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:47:51.559918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.635660+0000","last_change":"2024-04-26T23:40:31.573864+0000","last_active":"2024-04-26T23:40:43.635660+0000","last_peered":"2024-04-26T23:40:43.635660+0000","last_clean":"2024-04-26T23:40:43.635660+0000","last_became_active":"2024-04-26T23:40:31.573594+0000","last_became_peered":"2024-04-26T23:40:31.573594+0000","last_unstale":"2024-04-26T23:40:43.635660+0000","last_undegraded":"2024-04-26T23:40:43.635660+0000","last_fullsized":"2024-04-26T23:40:43.635660+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:48:32.015654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"24'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.664374+0000","last_change":"2024-04-26T23:40:40.677258+0000","last_active":"2024-04-26T23:40:43.664374+0000","last_peered":"2024-04-26T23:40:43.664374+0000","last_clean":"2024-04-26T23:40:43.664374+0000","last_became_active":"2024-04-26T23:40:40.676937+0000","last_became_peered":"2024-04-26T23:40:40.676937+0000","last_unstale":"2024-04-26T23:40:43.664374+0000","last_undegraded":"2024-04-26T23:40:43.664374+0000","last_fullsized":"2024-04-26T23:40:43.664374+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:44:50.588556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636633+0000","last_change":"2024-04-26T23:40:41.684731+0000","last_active":"2024-04-26T23:40:43.636633+0000","last_peered":"2024-04-26T23:40:43.636633+0000","last_clean":"2024-04-26T23:40:43.636633+0000","last_became_active":"2024-04-26T23:40:41.684459+0000","last_became_peered":"2024-04-26T23:40:41.684459+0000","last_unstale":"2024-04-26T23:40:43.636633+0000","last_undegraded":"2024-04-26T23:40:43.636633+0000","last_fullsized":"2024-04-26T23:40:43.636633+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:24:07.784468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.637233+0000","last_change":"2024-04-26T23:40:32.593216+0000","last_active":"2024-04-26T23:40:43.637233+0000","last_peered":"2024-04-26T23:40:43.637233+0000","last_clean":"2024-04-26T23:40:43.637233+0000","last_became_active":"2024-04-26T23:40:32.592929+0000","last_became_peered":"2024-04-26T23:40:32.592929+0000","last_unstale":"2024-04-26T23:40:43.637233+0000","last_undegraded":"2024-04-26T23:40:43.637233+0000","last_fullsized":"2024-04-26T23:40:43.637233+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:12:45.093169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.684832+0000","last_change":"2024-04-26T23:40:31.570118+0000","last_active":"2024-04-26T23:40:42.684832+0000","last_peered":"2024-04-26T23:40:42.684832+0000","last_clean":"2024-04-26T23:40:42.684832+0000","last_became_active":"2024-04-26T23:40:31.569764+0000","last_became_peered":"2024-04-26T23:40:31.569764+0000","last_unstale":"2024-04-26T23:40:42.684832+0000","last_undegraded":"2024-04-26T23:40:42.684832+0000","last_fullsized":"2024-04-26T23:40:42.684832+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:15:30.884135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":178,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.635784+0000","last_change":"2024-04-26T23:40:20.966672+0000","last_active":"2024-04-26T23:40:43.635784+0000","last_peered":"2024-04-26T23:40:43.635784+0000","last_clean":"2024-04-26T23:40:43.635784+0000","last_became_active":"2024-04-26T23:40:20.963937+0000","last_became_peered":"2024-04-26T23:40:20.963937+0000","last_unstale":"2024-04-26T23:40:43.635784+0000","last_undegraded":"2024-04-26T23:40:43.635784+0000","last_fullsized":"2024-04-26T23:40:43.635784+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:19.950137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:19.950137+0000","last_clean_scrub_stamp":"2024-04-26T23:40:19.950137+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:23:39.166579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.683613+0000","last_change":"2024-04-26T23:40:40.671995+0000","last_active":"2024-04-26T23:40:42.683613+0000","last_peered":"2024-04-26T23:40:42.683613+0000","last_clean":"2024-04-26T23:40:42.683613+0000","last_became_active":"2024-04-26T23:40:40.671642+0000","last_became_peered":"2024-04-26T23:40:40.671642+0000","last_unstale":"2024-04-26T23:40:42.683613+0000","last_undegraded":"2024-04-26T23:40:42.683613+0000","last_fullsized":"2024-04-26T23:40:42.683613+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:35:16.288571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636479+0000","last_change":"2024-04-26T23:40:41.680852+0000","last_active":"2024-04-26T23:40:43.636479+0000","last_peered":"2024-04-26T23:40:43.636479+0000","last_clean":"2024-04-26T23:40:43.636479+0000","last_became_active":"2024-04-26T23:40:41.680567+0000","last_became_peered":"2024-04-26T23:40:41.680567+0000","last_unstale":"2024-04-26T23:40:43.636479+0000","last_undegraded":"2024-04-26T23:40:43.636479+0000","last_fullsized":"2024-04-26T23:40:43.636479+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:40:15.485085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.637223+0000","last_change":"2024-04-26T23:40:32.591906+0000","last_active":"2024-04-26T23:40:43.637223+0000","last_peered":"2024-04-26T23:40:43.637223+0000","last_clean":"2024-04-26T23:40:43.637223+0000","last_became_active":"2024-04-26T23:40:32.590867+0000","last_became_peered":"2024-04-26T23:40:32.590867+0000","last_unstale":"2024-04-26T23:40:43.637223+0000","last_undegraded":"2024-04-26T23:40:43.637223+0000","last_fullsized":"2024-04-26T23:40:43.637223+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:56:04.309611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636141+0000","last_change":"2024-04-26T23:40:31.572391+0000","last_active":"2024-04-26T23:40:43.636141+0000","last_peered":"2024-04-26T23:40:43.636141+0000","last_clean":"2024-04-26T23:40:43.636141+0000","last_became_active":"2024-04-26T23:40:31.571849+0000","last_became_peered":"2024-04-26T23:40:31.571849+0000","last_unstale":"2024-04-26T23:40:43.636141+0000","last_undegraded":"2024-04-26T23:40:43.636141+0000","last_fullsized":"2024-04-26T23:40:43.636141+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:35:54.439397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.683873+0000","last_change":"2024-04-26T23:40:40.676464+0000","last_active":"2024-04-26T23:40:42.683873+0000","last_peered":"2024-04-26T23:40:42.683873+0000","last_clean":"2024-04-26T23:40:42.683873+0000","last_became_active":"2024-04-26T23:40:40.676154+0000","last_became_peered":"2024-04-26T23:40:40.676154+0000","last_unstale":"2024-04-26T23:40:42.683873+0000","last_undegraded":"2024-04-26T23:40:42.683873+0000","last_fullsized":"2024-04-26T23:40:42.683873+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:52:34.793496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636055+0000","last_change":"2024-04-26T23:40:41.688065+0000","last_active":"2024-04-26T23:40:43.636055+0000","last_peered":"2024-04-26T23:40:43.636055+0000","last_clean":"2024-04-26T23:40:43.636055+0000","last_became_active":"2024-04-26T23:40:41.687693+0000","last_became_peered":"2024-04-26T23:40:41.687693+0000","last_unstale":"2024-04-26T23:40:43.636055+0000","last_undegraded":"2024-04-26T23:40:43.636055+0000","last_fullsized":"2024-04-26T23:40:43.636055+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:35:17.294025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.685453+0000","last_change":"2024-04-26T23:40:32.583469+0000","last_active":"2024-04-26T23:40:42.685453+0000","last_peered":"2024-04-26T23:40:42.685453+0000","last_clean":"2024-04-26T23:40:42.685453+0000","last_became_active":"2024-04-26T23:40:32.583174+0000","last_became_peered":"2024-04-26T23:40:32.583174+0000","last_unstale":"2024-04-26T23:40:42.685453+0000","last_undegraded":"2024-04-26T23:40:42.685453+0000","last_fullsized":"2024-04-26T23:40:42.685453+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:34:14.811917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.637058+0000","last_change":"2024-04-26T23:40:31.571749+0000","last_active":"2024-04-26T23:40:43.637058+0000","last_peered":"2024-04-26T23:40:43.637058+0000","last_clean":"2024-04-26T23:40:43.637058+0000","last_became_active":"2024-04-26T23:40:31.571427+0000","last_became_peered":"2024-04-26T23:40:31.571427+0000","last_unstale":"2024-04-26T23:40:43.637058+0000","last_undegraded":"2024-04-26T23:40:43.637058+0000","last_fullsized":"2024-04-26T23:40:43.637058+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:20:28.103413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"23'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.686472+0000","last_change":"2024-04-26T23:40:40.675987+0000","last_active":"2024-04-26T23:40:42.686472+0000","last_peered":"2024-04-26T23:40:42.686472+0000","last_clean":"2024-04-26T23:40:42.686472+0000","last_became_active":"2024-04-26T23:40:40.675682+0000","last_became_peered":"2024-04-26T23:40:40.675682+0000","last_unstale":"2024-04-26T23:40:42.686472+0000","last_undegraded":"2024-04-26T23:40:42.686472+0000","last_fullsized":"2024-04-26T23:40:42.686472+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:10:10.722905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.635569+0000","last_change":"2024-04-26T23:40:41.681408+0000","last_active":"2024-04-26T23:40:43.635569+0000","last_peered":"2024-04-26T23:40:43.635569+0000","last_clean":"2024-04-26T23:40:43.635569+0000","last_became_active":"2024-04-26T23:40:41.681069+0000","last_became_peered":"2024-04-26T23:40:41.681069+0000","last_unstale":"2024-04-26T23:40:43.635569+0000","last_undegraded":"2024-04-26T23:40:43.635569+0000","last_fullsized":"2024-04-26T23:40:43.635569+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:10:30.972726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636555+0000","last_change":"2024-04-26T23:40:32.596306+0000","last_active":"2024-04-26T23:40:43.636555+0000","last_peered":"2024-04-26T23:40:43.636555+0000","last_clean":"2024-04-26T23:40:43.636555+0000","last_became_active":"2024-04-26T23:40:32.595625+0000","last_became_peered":"2024-04-26T23:40:32.595625+0000","last_unstale":"2024-04-26T23:40:43.636555+0000","last_undegraded":"2024-04-26T23:40:43.636555+0000","last_fullsized":"2024-04-26T23:40:43.636555+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:10:02.629199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636280+0000","last_change":"2024-04-26T23:40:31.570870+0000","last_active":"2024-04-26T23:40:43.636280+0000","last_peered":"2024-04-26T23:40:43.636280+0000","last_clean":"2024-04-26T23:40:43.636280+0000","last_became_active":"2024-04-26T23:40:31.570592+0000","last_became_peered":"2024-04-26T23:40:31.570592+0000","last_unstale":"2024-04-26T23:40:43.636280+0000","last_undegraded":"2024-04-26T23:40:43.636280+0000","last_fullsized":"2024-04-26T23:40:43.636280+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:43:13.740214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.685417+0000","last_change":"2024-04-26T23:40:40.673142+0000","last_active":"2024-04-26T23:40:42.685417+0000","last_peered":"2024-04-26T23:40:42.685417+0000","last_clean":"2024-04-26T23:40:42.685417+0000","last_became_active":"2024-04-26T23:40:40.672816+0000","last_became_peered":"2024-04-26T23:40:40.672816+0000","last_unstale":"2024-04-26T23:40:42.685417+0000","last_undegraded":"2024-04-26T23:40:42.685417+0000","last_fullsized":"2024-04-26T23:40:42.685417+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:53:12.526011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.635564+0000","last_change":"2024-04-26T23:40:41.678588+0000","last_active":"2024-04-26T23:40:43.635564+0000","last_peered":"2024-04-26T23:40:43.635564+0000","last_clean":"2024-04-26T23:40:43.635564+0000","last_became_active":"2024-04-26T23:40:41.678039+0000","last_became_peered":"2024-04-26T23:40:41.678039+0000","last_unstale":"2024-04-26T23:40:43.635564+0000","last_undegraded":"2024-04-26T23:40:43.635564+0000","last_fullsized":"2024-04-26T23:40:43.635564+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:04:39.652713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636462+0000","last_change":"2024-04-26T23:40:32.593577+0000","last_active":"2024-04-26T23:40:43.636462+0000","last_peered":"2024-04-26T23:40:43.636462+0000","last_clean":"2024-04-26T23:40:43.636462+0000","last_became_active":"2024-04-26T23:40:32.593235+0000","last_became_peered":"2024-04-26T23:40:32.593235+0000","last_unstale":"2024-04-26T23:40:43.636462+0000","last_undegraded":"2024-04-26T23:40:43.636462+0000","last_fullsized":"2024-04-26T23:40:43.636462+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:01:02.741964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636418+0000","last_change":"2024-04-26T23:40:31.575943+0000","last_active":"2024-04-26T23:40:43.636418+0000","last_peered":"2024-04-26T23:40:43.636418+0000","last_clean":"2024-04-26T23:40:43.636418+0000","last_became_active":"2024-04-26T23:40:31.575632+0000","last_became_peered":"2024-04-26T23:40:31.575632+0000","last_unstale":"2024-04-26T23:40:43.636418+0000","last_undegraded":"2024-04-26T23:40:43.636418+0000","last_fullsized":"2024-04-26T23:40:43.636418+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:11:08.189634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636540+0000","last_change":"2024-04-26T23:40:40.676297+0000","last_active":"2024-04-26T23:40:43.636540+0000","last_peered":"2024-04-26T23:40:43.636540+0000","last_clean":"2024-04-26T23:40:43.636540+0000","last_became_active":"2024-04-26T23:40:40.675888+0000","last_became_peered":"2024-04-26T23:40:40.675888+0000","last_unstale":"2024-04-26T23:40:43.636540+0000","last_undegraded":"2024-04-26T23:40:43.636540+0000","last_fullsized":"2024-04-26T23:40:43.636540+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:04:38.647258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.637873+0000","last_change":"2024-04-26T23:40:41.688506+0000","last_active":"2024-04-26T23:40:43.637873+0000","last_peered":"2024-04-26T23:40:43.637873+0000","last_clean":"2024-04-26T23:40:43.637873+0000","last_became_active":"2024-04-26T23:40:41.688224+0000","last_became_peered":"2024-04-26T23:40:41.688224+0000","last_unstale":"2024-04-26T23:40:43.637873+0000","last_undegraded":"2024-04-26T23:40:43.637873+0000","last_fullsized":"2024-04-26T23:40:43.637873+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:05:34.008024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.637217+0000","last_change":"2024-04-26T23:40:32.593528+0000","last_active":"2024-04-26T23:40:43.637217+0000","last_peered":"2024-04-26T23:40:43.637217+0000","last_clean":"2024-04-26T23:40:43.637217+0000","last_became_active":"2024-04-26T23:40:32.593220+0000","last_became_peered":"2024-04-26T23:40:32.593220+0000","last_unstale":"2024-04-26T23:40:43.637217+0000","last_undegraded":"2024-04-26T23:40:43.637217+0000","last_fullsized":"2024-04-26T23:40:43.637217+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:04:30.553552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":30,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.635390+0000","last_change":"2024-04-26T23:40:31.572685+0000","last_active":"2024-04-26T23:40:43.635390+0000","last_peered":"2024-04-26T23:40:43.635390+0000","last_clean":"2024-04-26T23:40:43.635390+0000","last_became_active":"2024-04-26T23:40:31.572169+0000","last_became_peered":"2024-04-26T23:40:31.572169+0000","last_unstale":"2024-04-26T23:40:43.635390+0000","last_undegraded":"2024-04-26T23:40:43.635390+0000","last_fullsized":"2024-04-26T23:40:43.635390+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:15:30.884135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.687059+0000","last_change":"2024-04-26T23:40:40.672160+0000","last_active":"2024-04-26T23:40:42.687059+0000","last_peered":"2024-04-26T23:40:42.687059+0000","last_clean":"2024-04-26T23:40:42.687059+0000","last_became_active":"2024-04-26T23:40:40.671875+0000","last_became_peered":"2024-04-26T23:40:40.671875+0000","last_unstale":"2024-04-26T23:40:42.687059+0000","last_undegraded":"2024-04-26T23:40:42.687059+0000","last_fullsized":"2024-04-26T23:40:42.687059+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:35:16.288571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.685105+0000","last_change":"2024-04-26T23:40:41.688445+0000","last_active":"2024-04-26T23:40:42.685105+0000","last_peered":"2024-04-26T23:40:42.685105+0000","last_clean":"2024-04-26T23:40:42.685105+0000","last_became_active":"2024-04-26T23:40:41.688053+0000","last_became_peered":"2024-04-26T23:40:41.688053+0000","last_unstale":"2024-04-26T23:40:42.685105+0000","last_undegraded":"2024-04-26T23:40:42.685105+0000","last_fullsized":"2024-04-26T23:40:42.685105+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:08:35.027584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.683320+0000","last_change":"2024-04-26T23:40:32.586832+0000","last_active":"2024-04-26T23:40:42.683320+0000","last_peered":"2024-04-26T23:40:42.683320+0000","last_clean":"2024-04-26T23:40:42.683320+0000","last_became_active":"2024-04-26T23:40:32.585809+0000","last_became_peered":"2024-04-26T23:40:32.585809+0000","last_unstale":"2024-04-26T23:40:42.683320+0000","last_undegraded":"2024-04-26T23:40:42.683320+0000","last_fullsized":"2024-04-26T23:40:42.683320+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:51:30.677247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.683971+0000","last_change":"2024-04-26T23:40:31.569512+0000","last_active":"2024-04-26T23:40:42.683971+0000","last_peered":"2024-04-26T23:40:42.683971+0000","last_clean":"2024-04-26T23:40:42.683971+0000","last_became_active":"2024-04-26T23:40:31.568598+0000","last_became_peered":"2024-04-26T23:40:31.568598+0000","last_unstale":"2024-04-26T23:40:42.683971+0000","last_undegraded":"2024-04-26T23:40:42.683971+0000","last_fullsized":"2024-04-26T23:40:42.683971+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:48:32.015654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.637928+0000","last_change":"2024-04-26T23:40:40.673986+0000","last_active":"2024-04-26T23:40:43.637928+0000","last_peered":"2024-04-26T23:40:43.637928+0000","last_clean":"2024-04-26T23:40:43.637928+0000","last_became_active":"2024-04-26T23:40:40.673704+0000","last_became_peered":"2024-04-26T23:40:40.673704+0000","last_unstale":"2024-04-26T23:40:43.637928+0000","last_undegraded":"2024-04-26T23:40:43.637928+0000","last_fullsized":"2024-04-26T23:40:43.637928+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:37:24.000775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.685367+0000","last_change":"2024-04-26T23:40:41.691441+0000","last_active":"2024-04-26T23:40:42.685367+0000","last_peered":"2024-04-26T23:40:42.685367+0000","last_clean":"2024-04-26T23:40:42.685367+0000","last_became_active":"2024-04-26T23:40:41.691160+0000","last_became_peered":"2024-04-26T23:40:41.691160+0000","last_unstale":"2024-04-26T23:40:42.685367+0000","last_undegraded":"2024-04-26T23:40:42.685367+0000","last_fullsized":"2024-04-26T23:40:42.685367+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:41:52.386084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636667+0000","last_change":"2024-04-26T23:40:32.595377+0000","last_active":"2024-04-26T23:40:43.636667+0000","last_peered":"2024-04-26T23:40:43.636667+0000","last_clean":"2024-04-26T23:40:43.636667+0000","last_became_active":"2024-04-26T23:40:32.595032+0000","last_became_peered":"2024-04-26T23:40:32.595032+0000","last_unstale":"2024-04-26T23:40:43.636667+0000","last_undegraded":"2024-04-26T23:40:43.636667+0000","last_fullsized":"2024-04-26T23:40:43.636667+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:44:42.494850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.684685+0000","last_change":"2024-04-26T23:40:31.575493+0000","last_active":"2024-04-26T23:40:42.684685+0000","last_peered":"2024-04-26T23:40:42.684685+0000","last_clean":"2024-04-26T23:40:42.684685+0000","last_became_active":"2024-04-26T23:40:31.575039+0000","last_became_peered":"2024-04-26T23:40:31.575039+0000","last_unstale":"2024-04-26T23:40:42.684685+0000","last_undegraded":"2024-04-26T23:40:42.684685+0000","last_fullsized":"2024-04-26T23:40:42.684685+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:43:13.740214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"24'8","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:41:03.401514+0000","last_change":"2024-04-26T23:40:40.676493+0000","last_active":"2024-04-26T23:41:03.401514+0000","last_peered":"2024-04-26T23:41:03.401514+0000","last_clean":"2024-04-26T23:41:03.401514+0000","last_became_active":"2024-04-26T23:40:40.676124+0000","last_became_peered":"2024-04-26T23:40:40.676124+0000","last_unstale":"2024-04-26T23:41:03.401514+0000","last_undegraded":"2024-04-26T23:41:03.401514+0000","last_fullsized":"2024-04-26T23:41:03.401514+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:28:33.915485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1868,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.637568+0000","last_change":"2024-04-26T23:40:41.680735+0000","last_active":"2024-04-26T23:40:43.637568+0000","last_peered":"2024-04-26T23:40:43.637568+0000","last_clean":"2024-04-26T23:40:43.637568+0000","last_became_active":"2024-04-26T23:40:41.680485+0000","last_became_peered":"2024-04-26T23:40:41.680485+0000","last_unstale":"2024-04-26T23:40:43.637568+0000","last_undegraded":"2024-04-26T23:40:43.637568+0000","last_fullsized":"2024-04-26T23:40:43.637568+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:38:51.195172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.686381+0000","last_change":"2024-04-26T23:40:32.589706+0000","last_active":"2024-04-26T23:40:42.686381+0000","last_peered":"2024-04-26T23:40:42.686381+0000","last_clean":"2024-04-26T23:40:42.686381+0000","last_became_active":"2024-04-26T23:40:32.589452+0000","last_became_peered":"2024-04-26T23:40:32.589452+0000","last_unstale":"2024-04-26T23:40:42.686381+0000","last_undegraded":"2024-04-26T23:40:42.686381+0000","last_fullsized":"2024-04-26T23:40:42.686381+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:15:01.970308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.686999+0000","last_change":"2024-04-26T23:40:31.573941+0000","last_active":"2024-04-26T23:40:42.686999+0000","last_peered":"2024-04-26T23:40:42.686999+0000","last_clean":"2024-04-26T23:40:42.686999+0000","last_became_active":"2024-04-26T23:40:31.573668+0000","last_became_peered":"2024-04-26T23:40:31.573668+0000","last_unstale":"2024-04-26T23:40:42.686999+0000","last_undegraded":"2024-04-26T23:40:42.686999+0000","last_fullsized":"2024-04-26T23:40:42.686999+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:58:06.477730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"23'3","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.685527+0000","last_change":"2024-04-26T23:40:40.676408+0000","last_active":"2024-04-26T23:40:42.685527+0000","last_peered":"2024-04-26T23:40:42.685527+0000","last_clean":"2024-04-26T23:40:42.685527+0000","last_became_active":"2024-04-26T23:40:40.676147+0000","last_became_peered":"2024-04-26T23:40:40.676147+0000","last_unstale":"2024-04-26T23:40:42.685527+0000","last_undegraded":"2024-04-26T23:40:42.685527+0000","last_fullsized":"2024-04-26T23:40:42.685527+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:27:47.818055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.637455+0000","last_change":"2024-04-26T23:40:41.685829+0000","last_active":"2024-04-26T23:40:43.637455+0000","last_peered":"2024-04-26T23:40:43.637455+0000","last_clean":"2024-04-26T23:40:43.637455+0000","last_became_active":"2024-04-26T23:40:41.685403+0000","last_became_peered":"2024-04-26T23:40:41.685403+0000","last_unstale":"2024-04-26T23:40:43.637455+0000","last_undegraded":"2024-04-26T23:40:43.637455+0000","last_fullsized":"2024-04-26T23:40:43.637455+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:24:07.784468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.637089+0000","last_change":"2024-04-26T23:40:32.587513+0000","last_active":"2024-04-26T23:40:43.637089+0000","last_peered":"2024-04-26T23:40:43.637089+0000","last_clean":"2024-04-26T23:40:43.637089+0000","last_became_active":"2024-04-26T23:40:32.587200+0000","last_became_peered":"2024-04-26T23:40:32.587200+0000","last_unstale":"2024-04-26T23:40:43.637089+0000","last_undegraded":"2024-04-26T23:40:43.637089+0000","last_fullsized":"2024-04-26T23:40:43.637089+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:37:30.361795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"24'8","reported_seq":30,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:41:01.311581+0000","last_change":"2024-04-26T23:40:31.572331+0000","last_active":"2024-04-26T23:41:01.311581+0000","last_peered":"2024-04-26T23:41:01.311581+0000","last_clean":"2024-04-26T23:41:01.311581+0000","last_became_active":"2024-04-26T23:40:31.572074+0000","last_became_peered":"2024-04-26T23:40:31.572074+0000","last_unstale":"2024-04-26T23:41:01.311581+0000","last_undegraded":"2024-04-26T23:41:01.311581+0000","last_fullsized":"2024-04-26T23:41:01.311581+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:45:49.295198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1868,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.635520+0000","last_change":"2024-04-26T23:40:40.677978+0000","last_active":"2024-04-26T23:40:43.635520+0000","last_peered":"2024-04-26T23:40:43.635520+0000","last_clean":"2024-04-26T23:40:43.635520+0000","last_became_active":"2024-04-26T23:40:40.677714+0000","last_became_peered":"2024-04-26T23:40:40.677714+0000","last_unstale":"2024-04-26T23:40:43.635520+0000","last_undegraded":"2024-04-26T23:40:43.635520+0000","last_fullsized":"2024-04-26T23:40:43.635520+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:44:50.588556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636093+0000","last_change":"2024-04-26T23:40:41.685431+0000","last_active":"2024-04-26T23:40:43.636093+0000","last_peered":"2024-04-26T23:40:43.636093+0000","last_clean":"2024-04-26T23:40:43.636093+0000","last_became_active":"2024-04-26T23:40:41.685147+0000","last_became_peered":"2024-04-26T23:40:41.685147+0000","last_unstale":"2024-04-26T23:40:43.636093+0000","last_undegraded":"2024-04-26T23:40:43.636093+0000","last_fullsized":"2024-04-26T23:40:43.636093+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:33:16.389626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636824+0000","last_change":"2024-04-26T23:40:32.593298+0000","last_active":"2024-04-26T23:40:43.636824+0000","last_peered":"2024-04-26T23:40:43.636824+0000","last_clean":"2024-04-26T23:40:43.636824+0000","last_became_active":"2024-04-26T23:40:32.593030+0000","last_became_peered":"2024-04-26T23:40:32.593030+0000","last_unstale":"2024-04-26T23:40:43.636824+0000","last_undegraded":"2024-04-26T23:40:43.636824+0000","last_fullsized":"2024-04-26T23:40:43.636824+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:20:29.107798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636957+0000","last_change":"2024-04-26T23:40:31.574234+0000","last_active":"2024-04-26T23:40:43.636957+0000","last_peered":"2024-04-26T23:40:43.636957+0000","last_clean":"2024-04-26T23:40:43.636957+0000","last_became_active":"2024-04-26T23:40:31.572218+0000","last_became_peered":"2024-04-26T23:40:31.572218+0000","last_unstale":"2024-04-26T23:40:43.636957+0000","last_undegraded":"2024-04-26T23:40:43.636957+0000","last_fullsized":"2024-04-26T23:40:43.636957+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:25:01.315397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"23'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.637149+0000","last_change":"2024-04-26T23:40:40.674778+0000","last_active":"2024-04-26T23:40:43.637149+0000","last_peered":"2024-04-26T23:40:43.637149+0000","last_clean":"2024-04-26T23:40:43.637149+0000","last_became_active":"2024-04-26T23:40:40.674487+0000","last_became_peered":"2024-04-26T23:40:40.674487+0000","last_unstale":"2024-04-26T23:40:43.637149+0000","last_undegraded":"2024-04-26T23:40:43.637149+0000","last_fullsized":"2024-04-26T23:40:43.637149+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:10:10.722905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.683588+0000","last_change":"2024-04-26T23:40:41.686531+0000","last_active":"2024-04-26T23:40:42.683588+0000","last_peered":"2024-04-26T23:40:42.683588+0000","last_clean":"2024-04-26T23:40:42.683588+0000","last_became_active":"2024-04-26T23:40:41.686259+0000","last_became_peered":"2024-04-26T23:40:41.686259+0000","last_unstale":"2024-04-26T23:40:42.683588+0000","last_undegraded":"2024-04-26T23:40:42.683588+0000","last_fullsized":"2024-04-26T23:40:42.683588+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:45:34.231942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.686899+0000","last_change":"2024-04-26T23:40:32.589146+0000","last_active":"2024-04-26T23:40:42.686899+0000","last_peered":"2024-04-26T23:40:42.686899+0000","last_clean":"2024-04-26T23:40:42.686899+0000","last_became_active":"2024-04-26T23:40:32.588881+0000","last_became_peered":"2024-04-26T23:40:32.588881+0000","last_unstale":"2024-04-26T23:40:42.686899+0000","last_undegraded":"2024-04-26T23:40:42.686899+0000","last_fullsized":"2024-04-26T23:40:42.686899+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:38:10.884592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.685165+0000","last_change":"2024-04-26T23:40:31.575616+0000","last_active":"2024-04-26T23:40:42.685165+0000","last_peered":"2024-04-26T23:40:42.685165+0000","last_clean":"2024-04-26T23:40:42.685165+0000","last_became_active":"2024-04-26T23:40:31.575211+0000","last_became_peered":"2024-04-26T23:40:31.575211+0000","last_unstale":"2024-04-26T23:40:42.685165+0000","last_undegraded":"2024-04-26T23:40:42.685165+0000","last_fullsized":"2024-04-26T23:40:42.685165+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:48:32.015654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"23'8","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636684+0000","last_change":"2024-04-26T23:40:40.675694+0000","last_active":"2024-04-26T23:40:43.636684+0000","last_peered":"2024-04-26T23:40:43.636684+0000","last_clean":"2024-04-26T23:40:43.636684+0000","last_became_active":"2024-04-26T23:40:40.675459+0000","last_became_peered":"2024-04-26T23:40:40.675459+0000","last_unstale":"2024-04-26T23:40:43.636684+0000","last_undegraded":"2024-04-26T23:40:43.636684+0000","last_fullsized":"2024-04-26T23:40:43.636684+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:30:03.993564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.635596+0000","last_change":"2024-04-26T23:40:41.687488+0000","last_active":"2024-04-26T23:40:43.635596+0000","last_peered":"2024-04-26T23:40:43.635596+0000","last_clean":"2024-04-26T23:40:43.635596+0000","last_became_active":"2024-04-26T23:40:41.687210+0000","last_became_peered":"2024-04-26T23:40:41.687210+0000","last_unstale":"2024-04-26T23:40:43.635596+0000","last_undegraded":"2024-04-26T23:40:43.635596+0000","last_fullsized":"2024-04-26T23:40:43.635596+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:36:21.487122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.685110+0000","last_change":"2024-04-26T23:40:32.589793+0000","last_active":"2024-04-26T23:40:42.685110+0000","last_peered":"2024-04-26T23:40:42.685110+0000","last_clean":"2024-04-26T23:40:42.685110+0000","last_became_active":"2024-04-26T23:40:32.589478+0000","last_became_peered":"2024-04-26T23:40:32.589478+0000","last_unstale":"2024-04-26T23:40:42.685110+0000","last_undegraded":"2024-04-26T23:40:42.685110+0000","last_fullsized":"2024-04-26T23:40:42.685110+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:56:04.309611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.684275+0000","last_change":"2024-04-26T23:40:31.573794+0000","last_active":"2024-04-26T23:40:42.684275+0000","last_peered":"2024-04-26T23:40:42.684275+0000","last_clean":"2024-04-26T23:40:42.684275+0000","last_became_active":"2024-04-26T23:40:31.573164+0000","last_became_peered":"2024-04-26T23:40:31.573164+0000","last_unstale":"2024-04-26T23:40:42.684275+0000","last_undegraded":"2024-04-26T23:40:42.684275+0000","last_fullsized":"2024-04-26T23:40:42.684275+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:15:30.884135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636808+0000","last_change":"2024-04-26T23:40:40.674127+0000","last_active":"2024-04-26T23:40:43.636808+0000","last_peered":"2024-04-26T23:40:43.636808+0000","last_clean":"2024-04-26T23:40:43.636808+0000","last_became_active":"2024-04-26T23:40:40.673793+0000","last_became_peered":"2024-04-26T23:40:40.673793+0000","last_unstale":"2024-04-26T23:40:43.636808+0000","last_undegraded":"2024-04-26T23:40:43.636808+0000","last_fullsized":"2024-04-26T23:40:43.636808+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:53:12.526011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.684571+0000","last_change":"2024-04-26T23:40:41.686867+0000","last_active":"2024-04-26T23:40:42.684571+0000","last_peered":"2024-04-26T23:40:42.684571+0000","last_clean":"2024-04-26T23:40:42.684571+0000","last_became_active":"2024-04-26T23:40:41.686536+0000","last_became_peered":"2024-04-26T23:40:41.686536+0000","last_unstale":"2024-04-26T23:40:42.684571+0000","last_undegraded":"2024-04-26T23:40:42.684571+0000","last_fullsized":"2024-04-26T23:40:42.684571+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:28:34.920939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"23'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.686809+0000","last_change":"2024-04-26T23:40:40.674915+0000","last_active":"2024-04-26T23:40:42.686809+0000","last_peered":"2024-04-26T23:40:42.686809+0000","last_clean":"2024-04-26T23:40:42.686809+0000","last_became_active":"2024-04-26T23:40:40.674639+0000","last_became_peered":"2024-04-26T23:40:40.674639+0000","last_unstale":"2024-04-26T23:40:42.686809+0000","last_undegraded":"2024-04-26T23:40:42.686809+0000","last_fullsized":"2024-04-26T23:40:42.686809+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:52:34.793496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.635465+0000","last_change":"2024-04-26T23:40:32.583014+0000","last_active":"2024-04-26T23:40:43.635465+0000","last_peered":"2024-04-26T23:40:43.635465+0000","last_clean":"2024-04-26T23:40:43.635465+0000","last_became_active":"2024-04-26T23:40:32.582751+0000","last_became_peered":"2024-04-26T23:40:32.582751+0000","last_unstale":"2024-04-26T23:40:43.635465+0000","last_undegraded":"2024-04-26T23:40:43.635465+0000","last_fullsized":"2024-04-26T23:40:43.635465+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:38:10.884592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.685541+0000","last_change":"2024-04-26T23:40:31.572402+0000","last_active":"2024-04-26T23:40:42.685541+0000","last_peered":"2024-04-26T23:40:42.685541+0000","last_clean":"2024-04-26T23:40:42.685541+0000","last_became_active":"2024-04-26T23:40:31.572111+0000","last_became_peered":"2024-04-26T23:40:31.572111+0000","last_unstale":"2024-04-26T23:40:42.685541+0000","last_undegraded":"2024-04-26T23:40:42.685541+0000","last_fullsized":"2024-04-26T23:40:42.685541+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:20:28.103413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.686752+0000","last_change":"2024-04-26T23:40:41.684524+0000","last_active":"2024-04-26T23:40:42.686752+0000","last_peered":"2024-04-26T23:40:42.686752+0000","last_clean":"2024-04-26T23:40:42.686752+0000","last_became_active":"2024-04-26T23:40:41.684207+0000","last_became_peered":"2024-04-26T23:40:41.684207+0000","last_unstale":"2024-04-26T23:40:42.686752+0000","last_undegraded":"2024-04-26T23:40:42.686752+0000","last_fullsized":"2024-04-26T23:40:42.686752+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:30:04.999018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"23'4","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.684153+0000","last_change":"2024-04-26T23:40:40.674934+0000","last_active":"2024-04-26T23:40:42.684153+0000","last_peered":"2024-04-26T23:40:42.684153+0000","last_clean":"2024-04-26T23:40:42.684153+0000","last_became_active":"2024-04-26T23:40:40.674628+0000","last_became_peered":"2024-04-26T23:40:40.674628+0000","last_unstale":"2024-04-26T23:40:42.684153+0000","last_undegraded":"2024-04-26T23:40:42.684153+0000","last_fullsized":"2024-04-26T23:40:42.684153+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:44:50.588556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636777+0000","last_change":"2024-04-26T23:40:32.586204+0000","last_active":"2024-04-26T23:40:43.636777+0000","last_peered":"2024-04-26T23:40:43.636777+0000","last_clean":"2024-04-26T23:40:43.636777+0000","last_became_active":"2024-04-26T23:40:32.585725+0000","last_became_peered":"2024-04-26T23:40:32.585725+0000","last_unstale":"2024-04-26T23:40:43.636777+0000","last_undegraded":"2024-04-26T23:40:43.636777+0000","last_fullsized":"2024-04-26T23:40:43.636777+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:51:30.677247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.637081+0000","last_change":"2024-04-26T23:40:31.578929+0000","last_active":"2024-04-26T23:40:43.637081+0000","last_peered":"2024-04-26T23:40:43.637081+0000","last_clean":"2024-04-26T23:40:43.637081+0000","last_became_active":"2024-04-26T23:40:31.578623+0000","last_became_peered":"2024-04-26T23:40:31.578623+0000","last_unstale":"2024-04-26T23:40:43.637081+0000","last_undegraded":"2024-04-26T23:40:43.637081+0000","last_fullsized":"2024-04-26T23:40:43.637081+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:50:21.330821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.637097+0000","last_change":"2024-04-26T23:40:41.689697+0000","last_active":"2024-04-26T23:40:43.637097+0000","last_peered":"2024-04-26T23:40:43.637097+0000","last_clean":"2024-04-26T23:40:43.637097+0000","last_became_active":"2024-04-26T23:40:41.688428+0000","last_became_peered":"2024-04-26T23:40:41.688428+0000","last_unstale":"2024-04-26T23:40:43.637097+0000","last_undegraded":"2024-04-26T23:40:43.637097+0000","last_fullsized":"2024-04-26T23:40:43.637097+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:36:21.487122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.684234+0000","last_change":"2024-04-26T23:40:31.567755+0000","last_active":"2024-04-26T23:40:42.684234+0000","last_peered":"2024-04-26T23:40:42.684234+0000","last_clean":"2024-04-26T23:40:42.684234+0000","last_became_active":"2024-04-26T23:40:31.567484+0000","last_became_peered":"2024-04-26T23:40:31.567484+0000","last_unstale":"2024-04-26T23:40:42.684234+0000","last_undegraded":"2024-04-26T23:40:42.684234+0000","last_fullsized":"2024-04-26T23:40:42.684234+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:43:13.740214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.686881+0000","last_change":"2024-04-26T23:40:32.594689+0000","last_active":"2024-04-26T23:40:42.686881+0000","last_peered":"2024-04-26T23:40:42.686881+0000","last_clean":"2024-04-26T23:40:42.686881+0000","last_became_active":"2024-04-26T23:40:32.592365+0000","last_became_peered":"2024-04-26T23:40:32.592365+0000","last_unstale":"2024-04-26T23:40:42.686881+0000","last_undegraded":"2024-04-26T23:40:42.686881+0000","last_fullsized":"2024-04-26T23:40:42.686881+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:17:46.135806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"23'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.635940+0000","last_change":"2024-04-26T23:40:40.676028+0000","last_active":"2024-04-26T23:40:43.635940+0000","last_peered":"2024-04-26T23:40:43.635940+0000","last_clean":"2024-04-26T23:40:43.635940+0000","last_became_active":"2024-04-26T23:40:40.675736+0000","last_became_peered":"2024-04-26T23:40:40.675736+0000","last_unstale":"2024-04-26T23:40:43.635940+0000","last_undegraded":"2024-04-26T23:40:43.635940+0000","last_fullsized":"2024-04-26T23:40:43.635940+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:51:38.770953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636545+0000","last_change":"2024-04-26T23:40:41.690148+0000","last_active":"2024-04-26T23:40:43.636545+0000","last_peered":"2024-04-26T23:40:43.636545+0000","last_clean":"2024-04-26T23:40:43.636545+0000","last_became_active":"2024-04-26T23:40:41.689765+0000","last_became_peered":"2024-04-26T23:40:41.689765+0000","last_unstale":"2024-04-26T23:40:43.636545+0000","last_undegraded":"2024-04-26T23:40:43.636545+0000","last_fullsized":"2024-04-26T23:40:43.636545+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:33:16.389626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.637574+0000","last_change":"2024-04-26T23:40:31.576749+0000","last_active":"2024-04-26T23:40:43.637574+0000","last_peered":"2024-04-26T23:40:43.637574+0000","last_clean":"2024-04-26T23:40:43.637574+0000","last_became_active":"2024-04-26T23:40:31.576178+0000","last_became_peered":"2024-04-26T23:40:31.576178+0000","last_unstale":"2024-04-26T23:40:43.637574+0000","last_undegraded":"2024-04-26T23:40:43.637574+0000","last_fullsized":"2024-04-26T23:40:43.637574+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:15:30.884135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636389+0000","last_change":"2024-04-26T23:40:32.589208+0000","last_active":"2024-04-26T23:40:43.636389+0000","last_peered":"2024-04-26T23:40:43.636389+0000","last_clean":"2024-04-26T23:40:43.636389+0000","last_became_active":"2024-04-26T23:40:32.588927+0000","last_became_peered":"2024-04-26T23:40:32.588927+0000","last_unstale":"2024-04-26T23:40:43.636389+0000","last_undegraded":"2024-04-26T23:40:43.636389+0000","last_fullsized":"2024-04-26T23:40:43.636389+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:45:50.299583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"23'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.637675+0000","last_change":"2024-04-26T23:40:40.676809+0000","last_active":"2024-04-26T23:40:43.637675+0000","last_peered":"2024-04-26T23:40:43.637675+0000","last_clean":"2024-04-26T23:40:43.637675+0000","last_became_active":"2024-04-26T23:40:40.676070+0000","last_became_peered":"2024-04-26T23:40:40.676070+0000","last_unstale":"2024-04-26T23:40:43.637675+0000","last_undegraded":"2024-04-26T23:40:43.637675+0000","last_fullsized":"2024-04-26T23:40:43.637675+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:17:27.667323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.637854+0000","last_change":"2024-04-26T23:40:41.679796+0000","last_active":"2024-04-26T23:40:43.637854+0000","last_peered":"2024-04-26T23:40:43.637854+0000","last_clean":"2024-04-26T23:40:43.637854+0000","last_became_active":"2024-04-26T23:40:41.679523+0000","last_became_peered":"2024-04-26T23:40:41.679523+0000","last_unstale":"2024-04-26T23:40:43.637854+0000","last_undegraded":"2024-04-26T23:40:43.637854+0000","last_fullsized":"2024-04-26T23:40:43.637854+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:43:02.137315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.683465+0000","last_change":"2024-04-26T23:40:32.586672+0000","last_active":"2024-04-26T23:40:42.683465+0000","last_peered":"2024-04-26T23:40:42.683465+0000","last_clean":"2024-04-26T23:40:42.683465+0000","last_became_active":"2024-04-26T23:40:32.586399+0000","last_became_peered":"2024-04-26T23:40:32.586399+0000","last_unstale":"2024-04-26T23:40:42.683465+0000","last_undegraded":"2024-04-26T23:40:42.683465+0000","last_fullsized":"2024-04-26T23:40:42.683465+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:15:01.970308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636388+0000","last_change":"2024-04-26T23:40:41.687529+0000","last_active":"2024-04-26T23:40:43.636388+0000","last_peered":"2024-04-26T23:40:43.636388+0000","last_clean":"2024-04-26T23:40:43.636388+0000","last_became_active":"2024-04-26T23:40:41.686974+0000","last_became_peered":"2024-04-26T23:40:41.686974+0000","last_unstale":"2024-04-26T23:40:43.636388+0000","last_undegraded":"2024-04-26T23:40:43.636388+0000","last_fullsized":"2024-04-26T23:40:43.636388+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:21:56.950703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.635606+0000","last_change":"2024-04-26T23:40:32.584590+0000","last_active":"2024-04-26T23:40:43.635606+0000","last_peered":"2024-04-26T23:40:43.635606+0000","last_clean":"2024-04-26T23:40:43.635606+0000","last_became_active":"2024-04-26T23:40:32.584234+0000","last_became_peered":"2024-04-26T23:40:32.584234+0000","last_unstale":"2024-04-26T23:40:43.635606+0000","last_undegraded":"2024-04-26T23:40:43.635606+0000","last_fullsized":"2024-04-26T23:40:43.635606+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:15:52.942160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.685091+0000","last_change":"2024-04-26T23:40:41.679549+0000","last_active":"2024-04-26T23:40:42.685091+0000","last_peered":"2024-04-26T23:40:42.685091+0000","last_clean":"2024-04-26T23:40:42.685091+0000","last_became_active":"2024-04-26T23:40:41.679254+0000","last_became_peered":"2024-04-26T23:40:41.679254+0000","last_unstale":"2024-04-26T23:40:42.685091+0000","last_undegraded":"2024-04-26T23:40:42.685091+0000","last_fullsized":"2024-04-26T23:40:42.685091+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:48:09.126894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.684675+0000","last_change":"2024-04-26T23:40:32.580453+0000","last_active":"2024-04-26T23:40:42.684675+0000","last_peered":"2024-04-26T23:40:42.684675+0000","last_clean":"2024-04-26T23:40:42.684675+0000","last_became_active":"2024-04-26T23:40:32.580196+0000","last_became_peered":"2024-04-26T23:40:32.580196+0000","last_unstale":"2024-04-26T23:40:42.684675+0000","last_undegraded":"2024-04-26T23:40:42.684675+0000","last_fullsized":"2024-04-26T23:40:42.684675+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:18:09.706875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636745+0000","last_change":"2024-04-26T23:40:41.690579+0000","last_active":"2024-04-26T23:40:43.636745+0000","last_peered":"2024-04-26T23:40:43.636745+0000","last_clean":"2024-04-26T23:40:43.636745+0000","last_became_active":"2024-04-26T23:40:41.690262+0000","last_became_peered":"2024-04-26T23:40:41.690262+0000","last_unstale":"2024-04-26T23:40:43.636745+0000","last_undegraded":"2024-04-26T23:40:43.636745+0000","last_fullsized":"2024-04-26T23:40:43.636745+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:10:30.972726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.686790+0000","last_change":"2024-04-26T23:40:32.584323+0000","last_active":"2024-04-26T23:40:42.686790+0000","last_peered":"2024-04-26T23:40:42.686790+0000","last_clean":"2024-04-26T23:40:42.686790+0000","last_became_active":"2024-04-26T23:40:32.584010+0000","last_became_peered":"2024-04-26T23:40:32.584010+0000","last_unstale":"2024-04-26T23:40:42.686790+0000","last_undegraded":"2024-04-26T23:40:42.686790+0000","last_fullsized":"2024-04-26T23:40:42.686790+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:16:46.547536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636036+0000","last_change":"2024-04-26T23:40:41.677679+0000","last_active":"2024-04-26T23:40:43.636036+0000","last_peered":"2024-04-26T23:40:43.636036+0000","last_clean":"2024-04-26T23:40:43.636036+0000","last_became_active":"2024-04-26T23:40:41.677398+0000","last_became_peered":"2024-04-26T23:40:41.677398+0000","last_unstale":"2024-04-26T23:40:43.636036+0000","last_undegraded":"2024-04-26T23:40:43.636036+0000","last_fullsized":"2024-04-26T23:40:43.636036+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:42:13.754586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.637704+0000","last_change":"2024-04-26T23:40:32.587921+0000","last_active":"2024-04-26T23:40:43.637704+0000","last_peered":"2024-04-26T23:40:43.637704+0000","last_clean":"2024-04-26T23:40:43.637704+0000","last_became_active":"2024-04-26T23:40:32.587630+0000","last_became_peered":"2024-04-26T23:40:32.587630+0000","last_unstale":"2024-04-26T23:40:43.637704+0000","last_undegraded":"2024-04-26T23:40:43.637704+0000","last_fullsized":"2024-04-26T23:40:43.637704+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:01:02.741964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.637255+0000","last_change":"2024-04-26T23:40:41.690235+0000","last_active":"2024-04-26T23:40:43.637255+0000","last_peered":"2024-04-26T23:40:43.637255+0000","last_clean":"2024-04-26T23:40:43.637255+0000","last_became_active":"2024-04-26T23:40:41.689911+0000","last_became_peered":"2024-04-26T23:40:41.689911+0000","last_unstale":"2024-04-26T23:40:43.637255+0000","last_undegraded":"2024-04-26T23:40:43.637255+0000","last_fullsized":"2024-04-26T23:40:43.637255+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:21:56.950703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636863+0000","last_change":"2024-04-26T23:40:32.583376+0000","last_active":"2024-04-26T23:40:43.636863+0000","last_peered":"2024-04-26T23:40:43.636863+0000","last_clean":"2024-04-26T23:40:43.636863+0000","last_became_active":"2024-04-26T23:40:32.583089+0000","last_became_peered":"2024-04-26T23:40:32.583089+0000","last_unstale":"2024-04-26T23:40:43.636863+0000","last_undegraded":"2024-04-26T23:40:43.636863+0000","last_fullsized":"2024-04-26T23:40:43.636863+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:17:46.135806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.635479+0000","last_change":"2024-04-26T23:40:41.688464+0000","last_active":"2024-04-26T23:40:43.635479+0000","last_peered":"2024-04-26T23:40:43.635479+0000","last_clean":"2024-04-26T23:40:43.635479+0000","last_became_active":"2024-04-26T23:40:41.688028+0000","last_became_peered":"2024-04-26T23:40:41.688028+0000","last_unstale":"2024-04-26T23:40:43.635479+0000","last_undegraded":"2024-04-26T23:40:43.635479+0000","last_fullsized":"2024-04-26T23:40:43.635479+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:21:56.950703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.684171+0000","last_change":"2024-04-26T23:40:32.589080+0000","last_active":"2024-04-26T23:40:42.684171+0000","last_peered":"2024-04-26T23:40:42.684171+0000","last_clean":"2024-04-26T23:40:42.684171+0000","last_became_active":"2024-04-26T23:40:32.588793+0000","last_became_peered":"2024-04-26T23:40:32.588793+0000","last_unstale":"2024-04-26T23:40:42.684171+0000","last_undegraded":"2024-04-26T23:40:42.684171+0000","last_fullsized":"2024-04-26T23:40:42.684171+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:18:09.706875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.684432+0000","last_change":"2024-04-26T23:40:41.688445+0000","last_active":"2024-04-26T23:40:42.684432+0000","last_peered":"2024-04-26T23:40:42.684432+0000","last_clean":"2024-04-26T23:40:42.684432+0000","last_became_active":"2024-04-26T23:40:41.688163+0000","last_became_peered":"2024-04-26T23:40:41.688163+0000","last_unstale":"2024-04-26T23:40:42.684432+0000","last_undegraded":"2024-04-26T23:40:42.684432+0000","last_fullsized":"2024-04-26T23:40:42.684432+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:30:04.999018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.637912+0000","last_change":"2024-04-26T23:40:32.588177+0000","last_active":"2024-04-26T23:40:43.637912+0000","last_peered":"2024-04-26T23:40:43.637912+0000","last_clean":"2024-04-26T23:40:43.637912+0000","last_became_active":"2024-04-26T23:40:32.586926+0000","last_became_peered":"2024-04-26T23:40:32.586926+0000","last_unstale":"2024-04-26T23:40:43.637912+0000","last_undegraded":"2024-04-26T23:40:43.637912+0000","last_fullsized":"2024-04-26T23:40:43.637912+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:34:14.811917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.637801+0000","last_change":"2024-04-26T23:40:41.688396+0000","last_active":"2024-04-26T23:40:43.637801+0000","last_peered":"2024-04-26T23:40:43.637801+0000","last_clean":"2024-04-26T23:40:43.637801+0000","last_became_active":"2024-04-26T23:40:41.688087+0000","last_became_peered":"2024-04-26T23:40:41.688087+0000","last_unstale":"2024-04-26T23:40:43.637801+0000","last_undegraded":"2024-04-26T23:40:43.637801+0000","last_fullsized":"2024-04-26T23:40:43.637801+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:00:49.397610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.685486+0000","last_change":"2024-04-26T23:40:32.582959+0000","last_active":"2024-04-26T23:40:42.685486+0000","last_peered":"2024-04-26T23:40:42.685486+0000","last_clean":"2024-04-26T23:40:42.685486+0000","last_became_active":"2024-04-26T23:40:32.582100+0000","last_became_peered":"2024-04-26T23:40:32.582100+0000","last_unstale":"2024-04-26T23:40:42.685486+0000","last_undegraded":"2024-04-26T23:40:42.685486+0000","last_fullsized":"2024-04-26T23:40:42.685486+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:37:30.361795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636150+0000","last_change":"2024-04-26T23:40:41.681088+0000","last_active":"2024-04-26T23:40:43.636150+0000","last_peered":"2024-04-26T23:40:43.636150+0000","last_clean":"2024-04-26T23:40:43.636150+0000","last_became_active":"2024-04-26T23:40:41.680581+0000","last_became_peered":"2024-04-26T23:40:41.680581+0000","last_unstale":"2024-04-26T23:40:43.636150+0000","last_undegraded":"2024-04-26T23:40:43.636150+0000","last_fullsized":"2024-04-26T23:40:43.636150+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:41:52.386084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636996+0000","last_change":"2024-04-26T23:40:32.593958+0000","last_active":"2024-04-26T23:40:43.636996+0000","last_peered":"2024-04-26T23:40:43.636996+0000","last_clean":"2024-04-26T23:40:43.636996+0000","last_became_active":"2024-04-26T23:40:32.593639+0000","last_became_peered":"2024-04-26T23:40:32.593639+0000","last_unstale":"2024-04-26T23:40:43.636996+0000","last_undegraded":"2024-04-26T23:40:43.636996+0000","last_fullsized":"2024-04-26T23:40:43.636996+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:17:46.135806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.635826+0000","last_change":"2024-04-26T23:40:41.674573+0000","last_active":"2024-04-26T23:40:43.635826+0000","last_peered":"2024-04-26T23:40:43.635826+0000","last_clean":"2024-04-26T23:40:43.635826+0000","last_became_active":"2024-04-26T23:40:41.674274+0000","last_became_peered":"2024-04-26T23:40:41.674274+0000","last_unstale":"2024-04-26T23:40:43.635826+0000","last_undegraded":"2024-04-26T23:40:43.635826+0000","last_fullsized":"2024-04-26T23:40:43.635826+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:37:39.460955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.684563+0000","last_change":"2024-04-26T23:40:32.591700+0000","last_active":"2024-04-26T23:40:42.684563+0000","last_peered":"2024-04-26T23:40:42.684563+0000","last_clean":"2024-04-26T23:40:42.684563+0000","last_became_active":"2024-04-26T23:40:32.591366+0000","last_became_peered":"2024-04-26T23:40:32.591366+0000","last_unstale":"2024-04-26T23:40:42.684563+0000","last_undegraded":"2024-04-26T23:40:42.684563+0000","last_fullsized":"2024-04-26T23:40:42.684563+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:10:02.629199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.637569+0000","last_change":"2024-04-26T23:40:41.692402+0000","last_active":"2024-04-26T23:40:43.637569+0000","last_peered":"2024-04-26T23:40:43.637569+0000","last_clean":"2024-04-26T23:40:43.637569+0000","last_became_active":"2024-04-26T23:40:41.692122+0000","last_became_peered":"2024-04-26T23:40:41.692122+0000","last_unstale":"2024-04-26T23:40:43.637569+0000","last_undegraded":"2024-04-26T23:40:43.637569+0000","last_fullsized":"2024-04-26T23:40:43.637569+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:06:12.755431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.686711+0000","last_change":"2024-04-26T23:40:32.590443+0000","last_active":"2024-04-26T23:40:42.686711+0000","last_peered":"2024-04-26T23:40:42.686711+0000","last_clean":"2024-04-26T23:40:42.686711+0000","last_became_active":"2024-04-26T23:40:32.590193+0000","last_became_peered":"2024-04-26T23:40:32.590193+0000","last_unstale":"2024-04-26T23:40:42.686711+0000","last_undegraded":"2024-04-26T23:40:42.686711+0000","last_fullsized":"2024-04-26T23:40:42.686711+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:14:04.372681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636077+0000","last_change":"2024-04-26T23:40:41.692194+0000","last_active":"2024-04-26T23:40:43.636077+0000","last_peered":"2024-04-26T23:40:43.636077+0000","last_clean":"2024-04-26T23:40:43.636077+0000","last_became_active":"2024-04-26T23:40:41.691837+0000","last_became_peered":"2024-04-26T23:40:41.691837+0000","last_unstale":"2024-04-26T23:40:43.636077+0000","last_undegraded":"2024-04-26T23:40:43.636077+0000","last_fullsized":"2024-04-26T23:40:43.636077+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:58:45.972045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.683546+0000","last_change":"2024-04-26T23:40:32.590538+0000","last_active":"2024-04-26T23:40:42.683546+0000","last_peered":"2024-04-26T23:40:42.683546+0000","last_clean":"2024-04-26T23:40:42.683546+0000","last_became_active":"2024-04-26T23:40:32.590241+0000","last_became_peered":"2024-04-26T23:40:32.590241+0000","last_unstale":"2024-04-26T23:40:42.683546+0000","last_undegraded":"2024-04-26T23:40:42.683546+0000","last_fullsized":"2024-04-26T23:40:42.683546+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:38:10.884592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636930+0000","last_change":"2024-04-26T23:40:41.689529+0000","last_active":"2024-04-26T23:40:43.636930+0000","last_peered":"2024-04-26T23:40:43.636930+0000","last_clean":"2024-04-26T23:40:43.636930+0000","last_became_active":"2024-04-26T23:40:41.689215+0000","last_became_peered":"2024-04-26T23:40:41.689215+0000","last_unstale":"2024-04-26T23:40:43.636930+0000","last_undegraded":"2024-04-26T23:40:43.636930+0000","last_fullsized":"2024-04-26T23:40:43.636930+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:38:42.155257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.637293+0000","last_change":"2024-04-26T23:40:32.588445+0000","last_active":"2024-04-26T23:40:43.637293+0000","last_peered":"2024-04-26T23:40:43.637293+0000","last_clean":"2024-04-26T23:40:43.637293+0000","last_became_active":"2024-04-26T23:40:32.588063+0000","last_became_peered":"2024-04-26T23:40:32.588063+0000","last_unstale":"2024-04-26T23:40:43.637293+0000","last_undegraded":"2024-04-26T23:40:43.637293+0000","last_fullsized":"2024-04-26T23:40:43.637293+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:44:58.977344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.684980+0000","last_change":"2024-04-26T23:40:41.674893+0000","last_active":"2024-04-26T23:40:42.684980+0000","last_peered":"2024-04-26T23:40:42.684980+0000","last_clean":"2024-04-26T23:40:42.684980+0000","last_became_active":"2024-04-26T23:40:41.674573+0000","last_became_peered":"2024-04-26T23:40:41.674573+0000","last_unstale":"2024-04-26T23:40:42.684980+0000","last_undegraded":"2024-04-26T23:40:42.684980+0000","last_fullsized":"2024-04-26T23:40:42.684980+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:36:21.487122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636258+0000","last_change":"2024-04-26T23:40:32.574795+0000","last_active":"2024-04-26T23:40:43.636258+0000","last_peered":"2024-04-26T23:40:43.636258+0000","last_clean":"2024-04-26T23:40:43.636258+0000","last_became_active":"2024-04-26T23:40:32.574503+0000","last_became_peered":"2024-04-26T23:40:32.574503+0000","last_unstale":"2024-04-26T23:40:43.636258+0000","last_undegraded":"2024-04-26T23:40:43.636258+0000","last_fullsized":"2024-04-26T23:40:43.636258+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:30:11.401955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.686330+0000","last_change":"2024-04-26T23:40:41.680247+0000","last_active":"2024-04-26T23:40:42.686330+0000","last_peered":"2024-04-26T23:40:42.686330+0000","last_clean":"2024-04-26T23:40:42.686330+0000","last_became_active":"2024-04-26T23:40:41.679920+0000","last_became_peered":"2024-04-26T23:40:41.679920+0000","last_unstale":"2024-04-26T23:40:42.686330+0000","last_undegraded":"2024-04-26T23:40:42.686330+0000","last_fullsized":"2024-04-26T23:40:42.686330+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:53:13.531466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.685801+0000","last_change":"2024-04-26T23:40:32.593432+0000","last_active":"2024-04-26T23:40:42.685801+0000","last_peered":"2024-04-26T23:40:42.685801+0000","last_clean":"2024-04-26T23:40:42.685801+0000","last_became_active":"2024-04-26T23:40:32.593169+0000","last_became_peered":"2024-04-26T23:40:32.593169+0000","last_unstale":"2024-04-26T23:40:42.685801+0000","last_undegraded":"2024-04-26T23:40:42.685801+0000","last_fullsized":"2024-04-26T23:40:42.685801+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:44:42.494850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.635935+0000","last_change":"2024-04-26T23:40:41.694551+0000","last_active":"2024-04-26T23:40:43.635935+0000","last_peered":"2024-04-26T23:40:43.635935+0000","last_clean":"2024-04-26T23:40:43.635935+0000","last_became_active":"2024-04-26T23:40:41.694297+0000","last_became_peered":"2024-04-26T23:40:41.694297+0000","last_unstale":"2024-04-26T23:40:43.635935+0000","last_undegraded":"2024-04-26T23:40:43.635935+0000","last_fullsized":"2024-04-26T23:40:43.635935+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:02:27.160408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.685388+0000","last_change":"2024-04-26T23:40:32.585137+0000","last_active":"2024-04-26T23:40:42.685388+0000","last_peered":"2024-04-26T23:40:42.685388+0000","last_clean":"2024-04-26T23:40:42.685388+0000","last_became_active":"2024-04-26T23:40:32.584678+0000","last_became_peered":"2024-04-26T23:40:32.584678+0000","last_unstale":"2024-04-26T23:40:42.685388+0000","last_undegraded":"2024-04-26T23:40:42.685388+0000","last_fullsized":"2024-04-26T23:40:42.685388+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:04:30.553552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636071+0000","last_change":"2024-04-26T23:40:41.692433+0000","last_active":"2024-04-26T23:40:43.636071+0000","last_peered":"2024-04-26T23:40:43.636071+0000","last_clean":"2024-04-26T23:40:43.636071+0000","last_became_active":"2024-04-26T23:40:41.692090+0000","last_became_peered":"2024-04-26T23:40:41.692090+0000","last_unstale":"2024-04-26T23:40:43.636071+0000","last_undegraded":"2024-04-26T23:40:43.636071+0000","last_fullsized":"2024-04-26T23:40:43.636071+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:37:25.006229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.635522+0000","last_change":"2024-04-26T23:40:32.590452+0000","last_active":"2024-04-26T23:40:43.635522+0000","last_peered":"2024-04-26T23:40:43.635522+0000","last_clean":"2024-04-26T23:40:43.635522+0000","last_became_active":"2024-04-26T23:40:32.590162+0000","last_became_peered":"2024-04-26T23:40:32.590162+0000","last_unstale":"2024-04-26T23:40:43.635522+0000","last_undegraded":"2024-04-26T23:40:43.635522+0000","last_fullsized":"2024-04-26T23:40:43.635522+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:51:30.677247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.685014+0000","last_change":"2024-04-26T23:40:41.687270+0000","last_active":"2024-04-26T23:40:42.685014+0000","last_peered":"2024-04-26T23:40:42.685014+0000","last_clean":"2024-04-26T23:40:42.685014+0000","last_became_active":"2024-04-26T23:40:41.686999+0000","last_became_peered":"2024-04-26T23:40:41.686999+0000","last_unstale":"2024-04-26T23:40:42.685014+0000","last_undegraded":"2024-04-26T23:40:42.685014+0000","last_fullsized":"2024-04-26T23:40:42.685014+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:21:42.565349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.686378+0000","last_change":"2024-04-26T23:40:32.586436+0000","last_active":"2024-04-26T23:40:42.686378+0000","last_peered":"2024-04-26T23:40:42.686378+0000","last_clean":"2024-04-26T23:40:42.686378+0000","last_became_active":"2024-04-26T23:40:32.585995+0000","last_became_peered":"2024-04-26T23:40:32.585995+0000","last_unstale":"2024-04-26T23:40:42.686378+0000","last_undegraded":"2024-04-26T23:40:42.686378+0000","last_fullsized":"2024-04-26T23:40:42.686378+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:10:42.603833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.637180+0000","last_change":"2024-04-26T23:40:41.691693+0000","last_active":"2024-04-26T23:40:43.637180+0000","last_peered":"2024-04-26T23:40:43.637180+0000","last_clean":"2024-04-26T23:40:43.637180+0000","last_became_active":"2024-04-26T23:40:41.691437+0000","last_became_peered":"2024-04-26T23:40:41.691437+0000","last_unstale":"2024-04-26T23:40:43.637180+0000","last_undegraded":"2024-04-26T23:40:43.637180+0000","last_fullsized":"2024-04-26T23:40:43.637180+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:06:12.755431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.637343+0000","last_change":"2024-04-26T23:40:32.592988+0000","last_active":"2024-04-26T23:40:43.637343+0000","last_peered":"2024-04-26T23:40:43.637343+0000","last_clean":"2024-04-26T23:40:43.637343+0000","last_became_active":"2024-04-26T23:40:32.592717+0000","last_became_peered":"2024-04-26T23:40:32.592717+0000","last_unstale":"2024-04-26T23:40:43.637343+0000","last_undegraded":"2024-04-26T23:40:43.637343+0000","last_fullsized":"2024-04-26T23:40:43.637343+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:18:09.706875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.637029+0000","last_change":"2024-04-26T23:40:41.675335+0000","last_active":"2024-04-26T23:40:43.637029+0000","last_peered":"2024-04-26T23:40:43.637029+0000","last_clean":"2024-04-26T23:40:43.637029+0000","last_became_active":"2024-04-26T23:40:41.675042+0000","last_became_peered":"2024-04-26T23:40:41.675042+0000","last_unstale":"2024-04-26T23:40:43.637029+0000","last_undegraded":"2024-04-26T23:40:43.637029+0000","last_fullsized":"2024-04-26T23:40:43.637029+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:41:52.386084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636813+0000","last_change":"2024-04-26T23:40:32.595129+0000","last_active":"2024-04-26T23:40:43.636813+0000","last_peered":"2024-04-26T23:40:43.636813+0000","last_clean":"2024-04-26T23:40:43.636813+0000","last_became_active":"2024-04-26T23:40:32.594802+0000","last_became_peered":"2024-04-26T23:40:32.594802+0000","last_unstale":"2024-04-26T23:40:43.636813+0000","last_undegraded":"2024-04-26T23:40:43.636813+0000","last_fullsized":"2024-04-26T23:40:43.636813+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:48:33.020039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636362+0000","last_change":"2024-04-26T23:40:41.691159+0000","last_active":"2024-04-26T23:40:43.636362+0000","last_peered":"2024-04-26T23:40:43.636362+0000","last_clean":"2024-04-26T23:40:43.636362+0000","last_became_active":"2024-04-26T23:40:41.690846+0000","last_became_peered":"2024-04-26T23:40:41.690846+0000","last_unstale":"2024-04-26T23:40:43.636362+0000","last_undegraded":"2024-04-26T23:40:43.636362+0000","last_fullsized":"2024-04-26T23:40:43.636362+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:45:08.076505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.683726+0000","last_change":"2024-04-26T23:40:32.578819+0000","last_active":"2024-04-26T23:40:42.683726+0000","last_peered":"2024-04-26T23:40:42.683726+0000","last_clean":"2024-04-26T23:40:42.683726+0000","last_became_active":"2024-04-26T23:40:32.578556+0000","last_became_peered":"2024-04-26T23:40:32.578556+0000","last_unstale":"2024-04-26T23:40:42.683726+0000","last_undegraded":"2024-04-26T23:40:42.683726+0000","last_fullsized":"2024-04-26T23:40:42.683726+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:17:46.135806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.635820+0000","last_change":"2024-04-26T23:40:41.689812+0000","last_active":"2024-04-26T23:40:43.635820+0000","last_peered":"2024-04-26T23:40:43.635820+0000","last_clean":"2024-04-26T23:40:43.635820+0000","last_became_active":"2024-04-26T23:40:41.689267+0000","last_became_peered":"2024-04-26T23:40:41.689267+0000","last_unstale":"2024-04-26T23:40:43.635820+0000","last_undegraded":"2024-04-26T23:40:43.635820+0000","last_fullsized":"2024-04-26T23:40:43.635820+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:21:42.565349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.684116+0000","last_change":"2024-04-26T23:40:32.578155+0000","last_active":"2024-04-26T23:40:42.684116+0000","last_peered":"2024-04-26T23:40:42.684116+0000","last_clean":"2024-04-26T23:40:42.684116+0000","last_became_active":"2024-04-26T23:40:32.577865+0000","last_became_peered":"2024-04-26T23:40:32.577865+0000","last_unstale":"2024-04-26T23:40:42.684116+0000","last_undegraded":"2024-04-26T23:40:42.684116+0000","last_fullsized":"2024-04-26T23:40:42.684116+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:40:17.167353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.685252+0000","last_change":"2024-04-26T23:40:41.680962+0000","last_active":"2024-04-26T23:40:42.685252+0000","last_peered":"2024-04-26T23:40:42.685252+0000","last_clean":"2024-04-26T23:40:42.685252+0000","last_became_active":"2024-04-26T23:40:41.680676+0000","last_became_peered":"2024-04-26T23:40:41.680676+0000","last_unstale":"2024-04-26T23:40:42.685252+0000","last_undegraded":"2024-04-26T23:40:42.685252+0000","last_fullsized":"2024-04-26T23:40:42.685252+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:42:13.754586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636455+0000","last_change":"2024-04-26T23:40:32.591487+0000","last_active":"2024-04-26T23:40:43.636455+0000","last_peered":"2024-04-26T23:40:43.636455+0000","last_clean":"2024-04-26T23:40:43.636455+0000","last_became_active":"2024-04-26T23:40:32.591209+0000","last_became_peered":"2024-04-26T23:40:32.591209+0000","last_unstale":"2024-04-26T23:40:43.636455+0000","last_undegraded":"2024-04-26T23:40:43.636455+0000","last_fullsized":"2024-04-26T23:40:43.636455+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:52:26.699790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.637724+0000","last_change":"2024-04-26T23:40:41.686089+0000","last_active":"2024-04-26T23:40:43.637724+0000","last_peered":"2024-04-26T23:40:43.637724+0000","last_clean":"2024-04-26T23:40:43.637724+0000","last_became_active":"2024-04-26T23:40:41.685786+0000","last_became_peered":"2024-04-26T23:40:41.685786+0000","last_unstale":"2024-04-26T23:40:43.637724+0000","last_undegraded":"2024-04-26T23:40:43.637724+0000","last_fullsized":"2024-04-26T23:40:43.637724+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:36:02.931532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636676+0000","last_change":"2024-04-26T23:40:32.592543+0000","last_active":"2024-04-26T23:40:43.636676+0000","last_peered":"2024-04-26T23:40:43.636676+0000","last_clean":"2024-04-26T23:40:43.636676+0000","last_became_active":"2024-04-26T23:40:32.592282+0000","last_became_peered":"2024-04-26T23:40:32.592282+0000","last_unstale":"2024-04-26T23:40:43.636676+0000","last_undegraded":"2024-04-26T23:40:43.636676+0000","last_fullsized":"2024-04-26T23:40:43.636676+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:16:46.547536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3f","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.684024+0000","last_change":"2024-04-26T23:40:41.679306+0000","last_active":"2024-04-26T23:40:42.684024+0000","last_peered":"2024-04-26T23:40:42.684024+0000","last_clean":"2024-04-26T23:40:42.684024+0000","last_became_active":"2024-04-26T23:40:41.678926+0000","last_became_peered":"2024-04-26T23:40:41.678926+0000","last_unstale":"2024-04-26T23:40:42.684024+0000","last_undegraded":"2024-04-26T23:40:42.684024+0000","last_fullsized":"2024-04-26T23:40:42.684024+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:27:48.823509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.637039+0000","last_change":"2024-04-26T23:40:32.587562+0000","last_active":"2024-04-26T23:40:43.637039+0000","last_peered":"2024-04-26T23:40:43.637039+0000","last_clean":"2024-04-26T23:40:43.637039+0000","last_became_active":"2024-04-26T23:40:32.587249+0000","last_became_peered":"2024-04-26T23:40:32.587249+0000","last_unstale":"2024-04-26T23:40:43.637039+0000","last_undegraded":"2024-04-26T23:40:43.637039+0000","last_fullsized":"2024-04-26T23:40:43.637039+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:12:45.093169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.635956+0000","last_change":"2024-04-26T23:40:41.689567+0000","last_active":"2024-04-26T23:40:43.635956+0000","last_peered":"2024-04-26T23:40:43.635956+0000","last_clean":"2024-04-26T23:40:43.635956+0000","last_became_active":"2024-04-26T23:40:41.688585+0000","last_became_peered":"2024-04-26T23:40:41.688585+0000","last_unstale":"2024-04-26T23:40:43.635956+0000","last_undegraded":"2024-04-26T23:40:43.635956+0000","last_fullsized":"2024-04-26T23:40:43.635956+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:10:57.826183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.684566+0000","last_change":"2024-04-26T23:40:32.584619+0000","last_active":"2024-04-26T23:40:42.684566+0000","last_peered":"2024-04-26T23:40:42.684566+0000","last_clean":"2024-04-26T23:40:42.684566+0000","last_became_active":"2024-04-26T23:40:32.584293+0000","last_became_peered":"2024-04-26T23:40:32.584293+0000","last_unstale":"2024-04-26T23:40:42.684566+0000","last_undegraded":"2024-04-26T23:40:42.684566+0000","last_fullsized":"2024-04-26T23:40:42.684566+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:40:17.167353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.685557+0000","last_change":"2024-04-26T23:40:41.691614+0000","last_active":"2024-04-26T23:40:42.685557+0000","last_peered":"2024-04-26T23:40:42.685557+0000","last_clean":"2024-04-26T23:40:42.685557+0000","last_became_active":"2024-04-26T23:40:41.691081+0000","last_became_peered":"2024-04-26T23:40:41.691081+0000","last_unstale":"2024-04-26T23:40:42.685557+0000","last_undegraded":"2024-04-26T23:40:42.685557+0000","last_fullsized":"2024-04-26T23:40:42.685557+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:24:07.784468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636557+0000","last_change":"2024-04-26T23:40:32.588894+0000","last_active":"2024-04-26T23:40:43.636557+0000","last_peered":"2024-04-26T23:40:43.636557+0000","last_clean":"2024-04-26T23:40:43.636557+0000","last_became_active":"2024-04-26T23:40:32.588409+0000","last_became_peered":"2024-04-26T23:40:32.588409+0000","last_unstale":"2024-04-26T23:40:43.636557+0000","last_undegraded":"2024-04-26T23:40:43.636557+0000","last_fullsized":"2024-04-26T23:40:43.636557+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:35:08.194865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636899+0000","last_change":"2024-04-26T23:40:41.678639+0000","last_active":"2024-04-26T23:40:43.636899+0000","last_peered":"2024-04-26T23:40:43.636899+0000","last_clean":"2024-04-26T23:40:43.636899+0000","last_became_active":"2024-04-26T23:40:41.678333+0000","last_became_peered":"2024-04-26T23:40:41.678333+0000","last_unstale":"2024-04-26T23:40:43.636899+0000","last_undegraded":"2024-04-26T23:40:43.636899+0000","last_fullsized":"2024-04-26T23:40:43.636899+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:42:13.754586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.685161+0000","last_change":"2024-04-26T23:40:32.581875+0000","last_active":"2024-04-26T23:40:42.685161+0000","last_peered":"2024-04-26T23:40:42.685161+0000","last_clean":"2024-04-26T23:40:42.685161+0000","last_became_active":"2024-04-26T23:40:32.580987+0000","last_became_peered":"2024-04-26T23:40:32.580987+0000","last_unstale":"2024-04-26T23:40:42.685161+0000","last_undegraded":"2024-04-26T23:40:42.685161+0000","last_fullsized":"2024-04-26T23:40:42.685161+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:12:45.093169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636219+0000","last_change":"2024-04-26T23:40:41.678366+0000","last_active":"2024-04-26T23:40:43.636219+0000","last_peered":"2024-04-26T23:40:43.636219+0000","last_clean":"2024-04-26T23:40:43.636219+0000","last_became_active":"2024-04-26T23:40:41.678067+0000","last_became_peered":"2024-04-26T23:40:41.678067+0000","last_unstale":"2024-04-26T23:40:43.636219+0000","last_undegraded":"2024-04-26T23:40:43.636219+0000","last_fullsized":"2024-04-26T23:40:43.636219+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:44:51.594010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:42.686634+0000","last_change":"2024-04-26T23:40:32.579870+0000","last_active":"2024-04-26T23:40:42.686634+0000","last_peered":"2024-04-26T23:40:42.686634+0000","last_clean":"2024-04-26T23:40:42.686634+0000","last_became_active":"2024-04-26T23:40:32.579569+0000","last_became_peered":"2024-04-26T23:40:32.579569+0000","last_unstale":"2024-04-26T23:40:42.686634+0000","last_undegraded":"2024-04-26T23:40:42.686634+0000","last_fullsized":"2024-04-26T23:40:42.686634+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:25:30.040358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.635430+0000","last_change":"2024-04-26T23:40:41.684020+0000","last_active":"2024-04-26T23:40:43.635430+0000","last_peered":"2024-04-26T23:40:43.635430+0000","last_clean":"2024-04-26T23:40:43.635430+0000","last_became_active":"2024-04-26T23:40:41.683734+0000","last_became_peered":"2024-04-26T23:40:41.683734+0000","last_unstale":"2024-04-26T23:40:43.635430+0000","last_undegraded":"2024-04-26T23:40:43.635430+0000","last_fullsized":"2024-04-26T23:40:43.635430+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:38:42.155257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636264+0000","last_change":"2024-04-26T23:40:32.583944+0000","last_active":"2024-04-26T23:40:43.636264+0000","last_peered":"2024-04-26T23:40:43.636264+0000","last_clean":"2024-04-26T23:40:43.636264+0000","last_became_active":"2024-04-26T23:40:32.583655+0000","last_became_peered":"2024-04-26T23:40:32.583655+0000","last_unstale":"2024-04-26T23:40:43.636264+0000","last_undegraded":"2024-04-26T23:40:43.636264+0000","last_fullsized":"2024-04-26T23:40:43.636264+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:40:17.167353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.635858+0000","last_change":"2024-04-26T23:40:41.681412+0000","last_active":"2024-04-26T23:40:43.635858+0000","last_peered":"2024-04-26T23:40:43.635858+0000","last_clean":"2024-04-26T23:40:43.635858+0000","last_became_active":"2024-04-26T23:40:41.681092+0000","last_became_peered":"2024-04-26T23:40:41.681092+0000","last_unstale":"2024-04-26T23:40:43.635858+0000","last_undegraded":"2024-04-26T23:40:43.635858+0000","last_fullsized":"2024-04-26T23:40:43.635858+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:48:09.126894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T23:40:43.636358+0000","last_change":"2024-04-26T23:40:32.596351+0000","last_active":"2024-04-26T23:40:43.636358+0000","last_peered":"2024-04-26T23:40:43.636358+0000","last_clean":"2024-04-26T23:40:43.636358+0000","last_became_active":"2024-04-26T23:40:32.596050+0000","last_became_peered":"2024-04-26T23:40:32.596050+0000","last_unstale":"2024-04-26T23:40:43.636358+0000","last_undegraded":"2024-04-26T23:40:43.636358+0000","last_fullsized":"2024-04-26T23:40:43.636358+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:34:14.811917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2666,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":5332,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2666,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":5332,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574860,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27856,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343984,"statfs":{"total":96636764160,"available":96608239616,"internally_reserved":0,"allocated":856064,"data_stored":690301,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574861,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":274432,"data_stored":101745,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574861,"num_pgs":54,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":266240,"data_stored":100023,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574862,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":274432,"data_stored":99491,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574860,"num_pgs":59,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":282624,"data_stored":102763,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574860,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":258048,"data_stored":99331,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574860,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":278528,"data_stored":101055,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574862,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27864,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343976,"statfs":{"total":96636764160,"available":96608231424,"internally_reserved":0,"allocated":860160,"data_stored":690267,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1868,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1868,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1890,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1890,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T23:41:06.275 INFO:tasks.mon_thrash.ceph_manager:clean! 2024-04-26T23:41:06.276 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T23:41:06.406 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:06.403+0000 7f1f3c485640 1 Processor -- start 2024-04-26T23:41:06.406 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:06.403+0000 7f1f3c485640 1 -- start start 2024-04-26T23:41:06.408 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:06.404+0000 7f1f3c485640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1f3413ddd0 0x7f1f34154b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:06.408 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:06.404+0000 7f1f3c485640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f1f34071cc0 0x7f1f34073700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:06.408 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:06.404+0000 7f1f3c485640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1f340707e0 con 0x7f1f34073c40 2024-04-26T23:41:06.409 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:06.404+0000 7f1f3c485640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f1f34155450 con 0x7f1f34071cc0 2024-04-26T23:41:06.409 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:06.404+0000 7f1f3c485640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f1f34155730 con 0x7f1f3413ddd0 2024-04-26T23:41:06.409 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:06.404+0000 7f1f39a20640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f1f34071cc0 0x7f1f34073700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:06.409 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:06.404+0000 7f1f3aa22640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f1f34073c40 0x7f1f34070f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:52004/0 (socket says 172.21.15.88:52004) 2024-04-26T23:41:06.409 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:06.404+0000 7f1f3aa22640 1 -- 172.21.15.88:0/614288619 learned_addr learned my addr 172.21.15.88:0/614288619 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-26T23:41:06.409 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:06.404+0000 7f1f39a20640 1 --2- 172.21.15.88:0/614288619 >> v2:172.21.15.88:3300/0 conn(0x7f1f34071cc0 0x7f1f34073700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:48766/0 (socket says 172.21.15.88:48766) 2024-04-26T23:41:06.409 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:06.405+0000 7f1f3a221640 1 --2- 172.21.15.88:0/614288619 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1f3413ddd0 0x7f1f34154b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:06.409 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:06.405+0000 7f1f39a20640 1 -- 172.21.15.88:0/614288619 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1f3413ddd0 msgr2=0x7f1f34154b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:41:06.409 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:06.405+0000 7f1f39a20640 1 --2- 172.21.15.88:0/614288619 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1f3413ddd0 0x7f1f34154b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:06.409 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:06.405+0000 7f1f39a20640 1 -- 172.21.15.88:0/614288619 >> v1:172.21.15.88:6789/0 conn(0x7f1f34073c40 legacy=0x7f1f34070f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:06.409 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:06.405+0000 7f1f39a20640 1 -- 172.21.15.88:0/614288619 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f34155a10 con 0x7f1f34071cc0 2024-04-26T23:41:06.409 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:06.405+0000 7f1f39a20640 1 --2- 172.21.15.88:0/614288619 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1f34071cc0 0x7f1f34073700 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f1f240097a0 tx=0x7f1f2402a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ed13e7e1b773dbe server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:06.409 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:06.405+0000 7f1f3921f640 1 -- 172.21.15.88:0/614288619 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f24037070 con 0x7f1f34071cc0 2024-04-26T23:41:06.409 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:06.405+0000 7f1f3921f640 1 -- 172.21.15.88:0/614288619 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f2402ae50 con 0x7f1f34071cc0 2024-04-26T23:41:06.410 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:06.405+0000 7f1f3921f640 1 -- 172.21.15.88:0/614288619 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f24032660 con 0x7f1f34071cc0 2024-04-26T23:41:06.412 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:06.406+0000 7f1f3c485640 1 -- 172.21.15.88:0/614288619 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1f34071cc0 msgr2=0x7f1f34073700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:06.413 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:06.406+0000 7f1f3c485640 1 --2- 172.21.15.88:0/614288619 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1f34071cc0 0x7f1f34073700 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f1f240097a0 tx=0x7f1f2402a100 comp rx=0 tx=0).stop 2024-04-26T23:41:06.413 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:06.406+0000 7f1f3c485640 1 -- 172.21.15.88:0/614288619 shutdown_connections 2024-04-26T23:41:06.413 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:06.406+0000 7f1f3c485640 1 --2- 172.21.15.88:0/614288619 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1f34071cc0 0x7f1f34073700 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:06.413 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:06.406+0000 7f1f3c485640 1 --2- 172.21.15.88:0/614288619 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1f3413ddd0 0x7f1f34154b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:06.413 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:06.406+0000 7f1f3c485640 1 -- 172.21.15.88:0/614288619 >> 172.21.15.88:0/614288619 conn(0x7f1f340ca2f0 msgr2=0x7f1f340ca6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:06.413 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:06.406+0000 7f1f3c485640 1 -- 172.21.15.88:0/614288619 shutdown_connections 2024-04-26T23:41:06.413 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:06.406+0000 7f1f3c485640 1 -- 172.21.15.88:0/614288619 wait complete. 2024-04-26T23:41:06.413 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:06.407+0000 7f1f3c485640 1 Processor -- start 2024-04-26T23:41:06.413 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:06.407+0000 7f1f3c485640 1 -- start start 2024-04-26T23:41:06.413 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:06.408+0000 7f1f3c485640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1f34071cc0 0x7f1f341edb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:06.413 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:06.408+0000 7f1f3c485640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1f34073c40 0x7f1f34137c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:06.414 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:06.408+0000 7f1f3c485640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1f3413ddd0 0x7f1f34138150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:06.414 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:06.408+0000 7f1f3c485640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f1f341551c0 con 0x7f1f3413ddd0 2024-04-26T23:41:06.414 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:06.408+0000 7f1f3c485640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f1f34155040 con 0x7f1f34073c40 2024-04-26T23:41:06.414 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:06.408+0000 7f1f3c485640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f1f340ab470 con 0x7f1f34071cc0 2024-04-26T23:41:06.414 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:06.408+0000 7f1f3aa22640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1f3413ddd0 0x7f1f34138150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:06.414 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:06.408+0000 7f1f3aa22640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1f3413ddd0 0x7f1f34138150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:48778/0 (socket says 172.21.15.88:48778) 2024-04-26T23:41:06.414 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:06.408+0000 7f1f3aa22640 1 -- 172.21.15.88:0/744328739 learned_addr learned my addr 172.21.15.88:0/744328739 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:41:06.414 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:06.408+0000 7f1f3aa22640 1 -- 172.21.15.88:0/744328739 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1f34071cc0 msgr2=0x7f1f341edb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:06.414 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:06.408+0000 7f1f3aa22640 1 --2- 172.21.15.88:0/744328739 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1f34071cc0 0x7f1f341edb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:06.414 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:06.408+0000 7f1f3aa22640 1 -- 172.21.15.88:0/744328739 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1f34073c40 msgr2=0x7f1f34137c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:06.414 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:06.408+0000 7f1f3aa22640 1 --2- 172.21.15.88:0/744328739 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1f34073c40 0x7f1f34137c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:06.414 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:06.408+0000 7f1f3aa22640 1 -- 172.21.15.88:0/744328739 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f341ee5b0 con 0x7f1f3413ddd0 2024-04-26T23:41:06.414 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:06.408+0000 7f1f3aa22640 1 --2- 172.21.15.88:0/744328739 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1f3413ddd0 0x7f1f34138150 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f1f2c00cbc0 tx=0x7f1f2c00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:06.414 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:06.408+0000 7f1f2affd640 1 -- 172.21.15.88:0/744328739 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f2c017070 con 0x7f1f3413ddd0 2024-04-26T23:41:06.415 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:06.408+0000 7f1f2affd640 1 -- 172.21.15.88:0/744328739 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f2c00ad40 con 0x7f1f3413ddd0 2024-04-26T23:41:06.415 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:06.408+0000 7f1f3c485640 1 -- 172.21.15.88:0/744328739 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f34156070 con 0x7f1f3413ddd0 2024-04-26T23:41:06.415 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:06.408+0000 7f1f2affd640 1 -- 172.21.15.88:0/744328739 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f2c012600 con 0x7f1f3413ddd0 2024-04-26T23:41:06.415 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:06.408+0000 7f1f3c485640 1 -- 172.21.15.88:0/744328739 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f340c8010 con 0x7f1f3413ddd0 2024-04-26T23:41:06.415 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:06.409+0000 7f1f3c485640 1 -- 172.21.15.88:0/744328739 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f34074900 con 0x7f1f3413ddd0 2024-04-26T23:41:06.415 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:06.410+0000 7f1f2affd640 1 -- 172.21.15.88:0/744328739 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f1f2c01a070 con 0x7f1f3413ddd0 2024-04-26T23:41:06.415 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:06.410+0000 7f1f2affd640 1 --2- 172.21.15.88:0/744328739 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f1f1806c8f0 0x7f1f1806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:06.416 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:06.410+0000 7f1f2affd640 1 -- 172.21.15.88:0/744328739 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7f1f2c08bac0 con 0x7f1f3413ddd0 2024-04-26T23:41:06.416 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:06.410+0000 7f1f3a221640 1 --2- 172.21.15.88:0/744328739 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f1f1806c8f0 0x7f1f1806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:06.416 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:06.411+0000 7f1f3a221640 1 --2- 172.21.15.88:0/744328739 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f1f1806c8f0 0x7f1f1806edb0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f1f300098f0 tx=0x7f1f30008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:06.417 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:06.415+0000 7f1f2affd640 1 -- 172.21.15.88:0/744328739 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f1f2c059600 con 0x7f1f3413ddd0 2024-04-26T23:41:06.592 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:06.589+0000 7f1f3c485640 1 -- 172.21.15.88:0/744328739 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1f340507a0 con 0x7f1f3413ddd0 2024-04-26T23:41:06.594 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:06.590+0000 7f1f2affd640 1 -- 172.21.15.88:0/744328739 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+20343 (secure 0 0 0) 0x7f1f2c05d900 con 0x7f1f3413ddd0 2024-04-26T23:41:06.594 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-26T23:41:06.594 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":24,"fsid":"555255e9-7ef9-4454-8dc9-35e96b70035c","created":"2024-04-26T23:40:07.836009+0000","modified":"2024-04-26T23:40:42.673801+0000","last_up_change":"2024-04-26T23:40:18.831369+0000","last_in_change":"2024-04-26T23:40:09.944777+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T23:40:19.936127+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"a_metadata","create_time":"2024-04-26T23:40:29.837465+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"a_data","create_time":"2024-04-26T23:40:30.868651+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"b_metadata","create_time":"2024-04-26T23:40:38.753441+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"b_data","create_time":"2024-04-26T23:40:39.974557+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"92aecea3-ed62-4a29-87c0-76758a0816a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":2803186054},{"type":"v1","addr":"172.21.15.88:6801","nonce":2803186054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":2803186054},{"type":"v1","addr":"172.21.15.88:6803","nonce":2803186054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":2803186054},{"type":"v1","addr":"172.21.15.88:6807","nonce":2803186054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":2803186054},{"type":"v1","addr":"172.21.15.88:6805","nonce":2803186054}]},"public_addr":"172.21.15.88:6801/2803186054","cluster_addr":"172.21.15.88:6803/2803186054","heartbeat_back_addr":"172.21.15.88:6807/2803186054","heartbeat_front_addr":"172.21.15.88:6805/2803186054","state":["exists","up"]},{"osd":1,"uuid":"7a6f0fa9-23d0-4747-880f-798d45ec5eeb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":1897380484},{"type":"v1","addr":"172.21.15.88:6817","nonce":1897380484}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":1897380484},{"type":"v1","addr":"172.21.15.88:6819","nonce":1897380484}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1897380484},{"type":"v1","addr":"172.21.15.88:6823","nonce":1897380484}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":1897380484},{"type":"v1","addr":"172.21.15.88:6821","nonce":1897380484}]},"public_addr":"172.21.15.88:6817/1897380484","cluster_addr":"172.21.15.88:6819/1897380484","heartbeat_back_addr":"172.21.15.88:6823/1897380484","heartbeat_front_addr":"172.21.15.88:6821/1897380484","state":["exists","up"]},{"osd":2,"uuid":"6be88ea0-e133-4200-a4b5-f92d664b248a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":648396269},{"type":"v1","addr":"172.21.15.88:6809","nonce":648396269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":648396269},{"type":"v1","addr":"172.21.15.88:6811","nonce":648396269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":648396269},{"type":"v1","addr":"172.21.15.88:6815","nonce":648396269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":648396269},{"type":"v1","addr":"172.21.15.88:6813","nonce":648396269}]},"public_addr":"172.21.15.88:6809/648396269","cluster_addr":"172.21.15.88:6811/648396269","heartbeat_back_addr":"172.21.15.88:6815/648396269","heartbeat_front_addr":"172.21.15.88:6813/648396269","state":["exists","up"]},{"osd":3,"uuid":"dcb0746b-7b3d-4ecf-8089-2493a5d1857c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":2328028922},{"type":"v1","addr":"172.21.15.88:6825","nonce":2328028922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":2328028922},{"type":"v1","addr":"172.21.15.88:6827","nonce":2328028922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":2328028922},{"type":"v1","addr":"172.21.15.88:6831","nonce":2328028922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":2328028922},{"type":"v1","addr":"172.21.15.88:6829","nonce":2328028922}]},"public_addr":"172.21.15.88:6825/2328028922","cluster_addr":"172.21.15.88:6827/2328028922","heartbeat_back_addr":"172.21.15.88:6831/2328028922","heartbeat_front_addr":"172.21.15.88:6829/2328028922","state":["exists","up"]},{"osd":4,"uuid":"c483de66-c44f-450e-a4ce-b132d50882c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":3929617402},{"type":"v1","addr":"172.21.15.175:6809","nonce":3929617402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":3929617402},{"type":"v1","addr":"172.21.15.175:6811","nonce":3929617402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":3929617402},{"type":"v1","addr":"172.21.15.175:6815","nonce":3929617402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":3929617402},{"type":"v1","addr":"172.21.15.175:6813","nonce":3929617402}]},"public_addr":"172.21.15.175:6809/3929617402","cluster_addr":"172.21.15.175:6811/3929617402","heartbeat_back_addr":"172.21.15.175:6815/3929617402","heartbeat_front_addr":"172.21.15.175:6813/3929617402","state":["exists","up"]},{"osd":5,"uuid":"ac3b1669-d228-40dd-9f9a-cb46aa73dd6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":2476644457},{"type":"v1","addr":"172.21.15.175:6801","nonce":2476644457}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":2476644457},{"type":"v1","addr":"172.21.15.175:6803","nonce":2476644457}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":2476644457},{"type":"v1","addr":"172.21.15.175:6807","nonce":2476644457}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":2476644457},{"type":"v1","addr":"172.21.15.175:6805","nonce":2476644457}]},"public_addr":"172.21.15.175:6801/2476644457","cluster_addr":"172.21.15.175:6803/2476644457","heartbeat_back_addr":"172.21.15.175:6807/2476644457","heartbeat_front_addr":"172.21.15.175:6805/2476644457","state":["exists","up"]},{"osd":6,"uuid":"7bef4896-857e-4c11-b3b2-c2e9a8548338","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":3824112919},{"type":"v1","addr":"172.21.15.175:6819","nonce":3824112919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6821","nonce":3824112919},{"type":"v1","addr":"172.21.15.175:6824","nonce":3824112919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":3824112919},{"type":"v1","addr":"172.21.15.175:6831","nonce":3824112919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":3824112919},{"type":"v1","addr":"172.21.15.175:6829","nonce":3824112919}]},"public_addr":"172.21.15.175:6819/3824112919","cluster_addr":"172.21.15.175:6824/3824112919","heartbeat_back_addr":"172.21.15.175:6831/3824112919","heartbeat_front_addr":"172.21.15.175:6829/3824112919","state":["exists","up"]},{"osd":7,"uuid":"e18d9e09-8673-470d-b9dc-280a409b63f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6817","nonce":3319361162},{"type":"v1","addr":"172.21.15.175:6818","nonce":3319361162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":3319361162},{"type":"v1","addr":"172.21.15.175:6822","nonce":3319361162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6827","nonce":3319361162},{"type":"v1","addr":"172.21.15.175:6828","nonce":3319361162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6823","nonce":3319361162},{"type":"v1","addr":"172.21.15.175:6825","nonce":3319361162}]},"public_addr":"172.21.15.175:6818/3319361162","cluster_addr":"172.21.15.175:6822/3319361162","heartbeat_back_addr":"172.21.15.175:6828/3319361162","heartbeat_front_addr":"172.21.15.175:6825/3319361162","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:40:15.126268+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:40:15.050614+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:40:14.995164+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:40:15.078112+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:40:15.159637+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:40:15.091226+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:40:15.140316+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:40:15.089431+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:41:06.595 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:06.592+0000 7f1f3c485640 1 -- 172.21.15.88:0/744328739 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f1f1806c8f0 msgr2=0x7f1f1806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:06.596 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:06.592+0000 7f1f3c485640 1 --2- 172.21.15.88:0/744328739 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f1f1806c8f0 0x7f1f1806edb0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f1f300098f0 tx=0x7f1f30008040 comp rx=0 tx=0).stop 2024-04-26T23:41:06.596 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:06.592+0000 7f1f3c485640 1 -- 172.21.15.88:0/744328739 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1f3413ddd0 msgr2=0x7f1f34138150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:06.596 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:06.592+0000 7f1f3c485640 1 --2- 172.21.15.88:0/744328739 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1f3413ddd0 0x7f1f34138150 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f1f2c00cbc0 tx=0x7f1f2c00a430 comp rx=0 tx=0).stop 2024-04-26T23:41:06.596 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:06.592+0000 7f1f3c485640 1 -- 172.21.15.88:0/744328739 shutdown_connections 2024-04-26T23:41:06.596 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:06.592+0000 7f1f3c485640 1 --2- 172.21.15.88:0/744328739 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f1f1806c8f0 0x7f1f1806edb0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:06.596 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:06.592+0000 7f1f3c485640 1 --2- 172.21.15.88:0/744328739 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1f3413ddd0 0x7f1f34138150 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:06.596 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:06.592+0000 7f1f3c485640 1 --2- 172.21.15.88:0/744328739 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1f34073c40 0x7f1f34137c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:06.596 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:06.592+0000 7f1f3c485640 1 --2- 172.21.15.88:0/744328739 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1f34071cc0 0x7f1f341edb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:06.596 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:06.592+0000 7f1f3c485640 1 -- 172.21.15.88:0/744328739 >> 172.21.15.88:0/744328739 conn(0x7f1f340ca2f0 msgr2=0x7f1f3413c3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:06.596 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:06.593+0000 7f1f3c485640 1 -- 172.21.15.88:0/744328739 shutdown_connections 2024-04-26T23:41:06.596 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:06.593+0000 7f1f3c485640 1 -- 172.21.15.88:0/744328739 wait complete. 2024-04-26T23:41:06.606 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T23:40:19.936127+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'a_metadata', 'create_time': '2024-04-26T23:40:29.837465+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'a'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'a_data', 'create_time': '2024-04-26T23:40:30.868651+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'a'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'b_metadata', 'create_time': '2024-04-26T23:40:38.753441+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'b'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'b_data', 'create_time': '2024-04-26T23:40:39.974557+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'b'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T23:41:06.607 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T23:41:06.706 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:06.703+0000 7f9618093640 1 Processor -- start 2024-04-26T23:41:06.707 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:06.704+0000 7f9618093640 1 -- start start 2024-04-26T23:41:06.709 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:06.704+0000 7f9618093640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f961013ffb0 0x7f96100c3b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:06.709 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:06.704+0000 7f9618093640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f9610073700 0x7f9610073b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:06.709 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:06.704+0000 7f9618093640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f96101579d0 con 0x7f9610074c10 2024-04-26T23:41:06.709 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:06.704+0000 7f9618093640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f9610070880 con 0x7f961013ffb0 2024-04-26T23:41:06.709 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:06.704+0000 7f9618093640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f96100ab680 con 0x7f9610073700 2024-04-26T23:41:06.709 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:06.705+0000 7f9615e2f640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f961013ffb0 0x7f96100c3b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:06.710 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:06.705+0000 7f9615e2f640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f961013ffb0 0x7f96100c3b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:48794/0 (socket says 172.21.15.88:48794) 2024-04-26T23:41:06.710 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:06.705+0000 7f9615e2f640 1 -- 172.21.15.88:0/2221987486 learned_addr learned my addr 172.21.15.88:0/2221987486 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:41:06.710 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:06.705+0000 7f9616630640 1 --2- 172.21.15.88:0/2221987486 >> v2:172.21.15.175:3300/0 conn(0x7f9610073700 0x7f9610073b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:06.710 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:06.705+0000 7f9615e2f640 1 -- 172.21.15.88:0/2221987486 >> v2:172.21.15.175:3300/0 conn(0x7f9610073700 msgr2=0x7f9610073b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:41:06.710 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:06.705+0000 7f9615e2f640 1 --2- 172.21.15.88:0/2221987486 >> v2:172.21.15.175:3300/0 conn(0x7f9610073700 0x7f9610073b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:06.710 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:06.705+0000 7f9615e2f640 1 -- 172.21.15.88:0/2221987486 >> v1:172.21.15.175:6789/0 conn(0x7f9610074c10 legacy=0x7f96100c40b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:41:06.710 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:06.705+0000 7f9615e2f640 1 -- 172.21.15.88:0/2221987486 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96100ab960 con 0x7f961013ffb0 2024-04-26T23:41:06.710 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:06.705+0000 7f9616630640 1 --2- 172.21.15.88:0/2221987486 >> v2:172.21.15.175:3300/0 conn(0x7f9610073700 0x7f9610073b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:41:06.710 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:06.705+0000 7f9615e2f640 1 --2- 172.21.15.88:0/2221987486 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f961013ffb0 0x7f96100c3b70 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f96100705d0 tx=0x7f960802a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=308fd9b9a5ff913b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:06.710 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:06.706+0000 7f9614e2d640 1 -- 172.21.15.88:0/2221987486 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9608036070 con 0x7f961013ffb0 2024-04-26T23:41:06.710 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:06.706+0000 7f9614e2d640 1 -- 172.21.15.88:0/2221987486 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9608031600 con 0x7f961013ffb0 2024-04-26T23:41:06.711 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:06.706+0000 7f9614e2d640 1 -- 172.21.15.88:0/2221987486 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96080319d0 con 0x7f961013ffb0 2024-04-26T23:41:06.711 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:06.706+0000 7f9618093640 1 -- 172.21.15.88:0/2221987486 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f961013ffb0 msgr2=0x7f96100c3b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:06.711 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:06.706+0000 7f9618093640 1 --2- 172.21.15.88:0/2221987486 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f961013ffb0 0x7f96100c3b70 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f96100705d0 tx=0x7f960802a6f0 comp rx=0 tx=0).stop 2024-04-26T23:41:06.711 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:06.706+0000 7f9618093640 1 -- 172.21.15.88:0/2221987486 shutdown_connections 2024-04-26T23:41:06.711 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:06.706+0000 7f9618093640 1 --2- 172.21.15.88:0/2221987486 >> v2:172.21.15.175:3300/0 conn(0x7f9610073700 0x7f9610073b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:06.711 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:06.706+0000 7f9618093640 1 --2- 172.21.15.88:0/2221987486 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f961013ffb0 0x7f96100c3b70 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:06.711 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:06.706+0000 7f9618093640 1 -- 172.21.15.88:0/2221987486 >> 172.21.15.88:0/2221987486 conn(0x7f96100ca2f0 msgr2=0x7f96100ca6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:06.711 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:06.706+0000 7f9618093640 1 -- 172.21.15.88:0/2221987486 shutdown_connections 2024-04-26T23:41:06.711 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:06.706+0000 7f9618093640 1 -- 172.21.15.88:0/2221987486 wait complete. 2024-04-26T23:41:06.713 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:06.707+0000 7f9618093640 1 Processor -- start 2024-04-26T23:41:06.714 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:06.707+0000 7f9618093640 1 -- start start 2024-04-26T23:41:06.714 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:06.708+0000 7f9618093640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9610073700 0x7f9610157be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:06.714 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:06.708+0000 7f9618093640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9610074c10 0x7f96101535c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:06.714 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:06.708+0000 7f9618093640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f961013ffb0 0x7f9610151bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:06.714 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:06.708+0000 7f9618093640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f9610157660 con 0x7f961013ffb0 2024-04-26T23:41:06.714 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:06.708+0000 7f9618093640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f9610140390 con 0x7f9610074c10 2024-04-26T23:41:06.714 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:06.708+0000 7f9618093640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f9610074040 con 0x7f9610073700 2024-04-26T23:41:06.714 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:06.708+0000 7f9616630640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f961013ffb0 0x7f9610151bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:06.714 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:06.708+0000 7f9616630640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f961013ffb0 0x7f9610151bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:48808/0 (socket says 172.21.15.88:48808) 2024-04-26T23:41:06.714 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:06.708+0000 7f9616630640 1 -- 172.21.15.88:0/2111244066 learned_addr learned my addr 172.21.15.88:0/2111244066 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:41:06.714 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:06.708+0000 7f961562e640 1 --2- 172.21.15.88:0/2111244066 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9610074c10 0x7f96101535c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:06.714 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:06.708+0000 7f9615e2f640 1 --2- 172.21.15.88:0/2111244066 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9610073700 0x7f9610157be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:06.714 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:06.709+0000 7f9616630640 1 -- 172.21.15.88:0/2111244066 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9610073700 msgr2=0x7f9610157be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:06.714 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:06.709+0000 7f9616630640 1 --2- 172.21.15.88:0/2111244066 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9610073700 0x7f9610157be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:06.715 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:06.709+0000 7f9616630640 1 -- 172.21.15.88:0/2111244066 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9610074c10 msgr2=0x7f96101535c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:06.715 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:06.709+0000 7f9616630640 1 --2- 172.21.15.88:0/2111244066 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9610074c10 0x7f96101535c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:06.715 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:06.709+0000 7f9616630640 1 -- 172.21.15.88:0/2111244066 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f961013c930 con 0x7f961013ffb0 2024-04-26T23:41:06.715 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:06.709+0000 7f9616630640 1 --2- 172.21.15.88:0/2111244066 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f961013ffb0 0x7f9610151bd0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f960c00c820 tx=0x7f960c00cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:06.715 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:06.709+0000 7f96067fc640 1 -- 172.21.15.88:0/2111244066 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f960c015070 con 0x7f961013ffb0 2024-04-26T23:41:06.715 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:06.709+0000 7f96067fc640 1 -- 172.21.15.88:0/2111244066 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f960c007a30 con 0x7f961013ffb0 2024-04-26T23:41:06.715 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:06.709+0000 7f9618093640 1 -- 172.21.15.88:0/2111244066 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f961015a9c0 con 0x7f961013ffb0 2024-04-26T23:41:06.715 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:06.709+0000 7f96067fc640 1 -- 172.21.15.88:0/2111244066 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f960c007e20 con 0x7f961013ffb0 2024-04-26T23:41:06.715 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:06.709+0000 7f9618093640 1 -- 172.21.15.88:0/2111244066 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96101513d0 con 0x7f961013ffb0 2024-04-26T23:41:06.715 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:06.710+0000 7f9618093640 1 -- 172.21.15.88:0/2111244066 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f96100507a0 con 0x7f961013ffb0 2024-04-26T23:41:06.715 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:06.710+0000 7f96067fc640 1 -- 172.21.15.88:0/2111244066 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f960c018070 con 0x7f961013ffb0 2024-04-26T23:41:06.715 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:06.711+0000 7f96067fc640 1 --2- 172.21.15.88:0/2111244066 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f95f406c920 0x7f95f406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:06.715 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:06.711+0000 7f9615e2f640 1 --2- 172.21.15.88:0/2111244066 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f95f406c920 0x7f95f406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:06.715 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:06.711+0000 7f96067fc640 1 -- 172.21.15.88:0/2111244066 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7f960c08bc30 con 0x7f961013ffb0 2024-04-26T23:41:06.716 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:06.711+0000 7f9615e2f640 1 --2- 172.21.15.88:0/2111244066 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f95f406c920 0x7f95f406ede0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f9608033000 tx=0x7f9608009000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:06.718 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:06.715+0000 7f96067fc640 1 -- 172.21.15.88:0/2111244066 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f960c059770 con 0x7f961013ffb0 2024-04-26T23:41:06.895 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:06.892+0000 7f9618093640 1 -- 172.21.15.88:0/2111244066 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f961006d6a0 con 0x7f961013ffb0 2024-04-26T23:41:06.896 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:06.893+0000 7f96067fc640 1 -- 172.21.15.88:0/2111244066 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) ==== 93+0+10 (secure 0 0 0) 0x7f960c05da70 con 0x7f961013ffb0 2024-04-26T23:41:06.896 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 1 2024-04-26T23:41:06.898 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:06.894+0000 7f9618093640 1 -- 172.21.15.88:0/2111244066 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f95f406c920 msgr2=0x7f95f406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:06.898 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:06.894+0000 7f9618093640 1 --2- 172.21.15.88:0/2111244066 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f95f406c920 0x7f95f406ede0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f9608033000 tx=0x7f9608009000 comp rx=0 tx=0).stop 2024-04-26T23:41:06.898 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:06.894+0000 7f9618093640 1 -- 172.21.15.88:0/2111244066 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f961013ffb0 msgr2=0x7f9610151bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:06.898 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:06.894+0000 7f9618093640 1 --2- 172.21.15.88:0/2111244066 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f961013ffb0 0x7f9610151bd0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f960c00c820 tx=0x7f960c00cce0 comp rx=0 tx=0).stop 2024-04-26T23:41:06.898 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:06.895+0000 7f9618093640 1 -- 172.21.15.88:0/2111244066 shutdown_connections 2024-04-26T23:41:06.898 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:06.895+0000 7f9618093640 1 --2- 172.21.15.88:0/2111244066 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f95f406c920 0x7f95f406ede0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:06.898 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:06.895+0000 7f9618093640 1 --2- 172.21.15.88:0/2111244066 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f961013ffb0 0x7f9610151bd0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:06.898 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:06.895+0000 7f9618093640 1 --2- 172.21.15.88:0/2111244066 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9610074c10 0x7f96101535c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:06.898 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:06.895+0000 7f9618093640 1 --2- 172.21.15.88:0/2111244066 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9610073700 0x7f9610157be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:06.898 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:06.895+0000 7f9618093640 1 -- 172.21.15.88:0/2111244066 >> 172.21.15.88:0/2111244066 conn(0x7f96100ca2f0 msgr2=0x7f96100c3a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:06.899 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:06.895+0000 7f9618093640 1 -- 172.21.15.88:0/2111244066 shutdown_connections 2024-04-26T23:41:06.899 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:06.895+0000 7f9618093640 1 -- 172.21.15.88:0/2111244066 wait complete. 2024-04-26T23:41:06.908 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get a_metadata pg_num 2024-04-26T23:41:07.008 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.005+0000 7f666b50a640 1 Processor -- start 2024-04-26T23:41:07.008 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.005+0000 7f666b50a640 1 -- start start 2024-04-26T23:41:07.012 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.006+0000 7f666b50a640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f6664156c00 0x7f66640ac620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:07.012 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.006+0000 7f666b50a640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f666415b010 con 0x7f66640c5520 2024-04-26T23:41:07.012 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.006+0000 7f666b50a640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f666406f0c0 con 0x7f66640c5140 2024-04-26T23:41:07.012 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.006+0000 7f666b50a640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f666415a190 con 0x7f6664156c00 2024-04-26T23:41:07.012 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.006+0000 7f6668aa5640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f66640c5520 0x7f666415a900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:52012/0 (socket says 172.21.15.88:52012) 2024-04-26T23:41:07.012 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.006+0000 7f6668aa5640 1 -- 172.21.15.88:0/2884626227 learned_addr learned my addr 172.21.15.88:0/2884626227 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-26T23:41:07.012 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.006+0000 7f665bfff640 1 -- 172.21.15.88:0/2884626227 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3568010269 0 0) 0x7f666415b010 con 0x7f66640c5520 2024-04-26T23:41:07.012 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.006+0000 7f665bfff640 1 -- 172.21.15.88:0/2884626227 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6650003520 con 0x7f66640c5520 2024-04-26T23:41:07.012 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.006+0000 7f6669aa7640 1 --2- 172.21.15.88:0/2884626227 >> v2:172.21.15.175:3300/0 conn(0x7f6664156c00 0x7f66640ac620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:07.012 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.006+0000 7f665bfff640 1 -- 172.21.15.88:0/2884626227 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 160621915 0 0) 0x7f6650003520 con 0x7f66640c5520 2024-04-26T23:41:07.013 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.006+0000 7f665bfff640 1 -- 172.21.15.88:0/2884626227 >> v2:172.21.15.175:3300/0 conn(0x7f6664156c00 msgr2=0x7f66640ac620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:41:07.013 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.006+0000 7f665bfff640 1 --2- 172.21.15.88:0/2884626227 >> v2:172.21.15.175:3300/0 conn(0x7f6664156c00 0x7f66640ac620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:07.013 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.006+0000 7f665bfff640 1 -- 172.21.15.88:0/2884626227 >> v1:172.21.15.175:6789/0 conn(0x7f66640c5140 legacy=0x7f666406e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:07.013 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.006+0000 7f665bfff640 1 -- 172.21.15.88:0/2884626227 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f666406f3a0 con 0x7f66640c5520 2024-04-26T23:41:07.013 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.006+0000 7f665bfff640 1 -- 172.21.15.88:0/2884626227 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 356324787 0 0) 0x7f6654001690 con 0x7f66640c5520 2024-04-26T23:41:07.013 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.006+0000 7f665bfff640 1 -- 172.21.15.88:0/2884626227 >> v1:172.21.15.88:6789/0 conn(0x7f66640c5520 legacy=0x7f666415a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:07.013 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.006+0000 7f665bfff640 1 --2- 172.21.15.88:0/2884626227 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f66500039b0 0x7f6650003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:07.013 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.006+0000 7f665bfff640 1 --2- 172.21.15.88:0/2884626227 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6650004800 0x7f6650004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:07.013 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.006+0000 7f665bfff640 1 --2- 172.21.15.88:0/2884626227 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f66500052e0 0x7f665000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:07.013 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.006+0000 7f665bfff640 1 -- 172.21.15.88:0/2884626227 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f666415a190 con 0x7f66500052e0 2024-04-26T23:41:07.013 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.006+0000 7f665bfff640 1 -- 172.21.15.88:0/2884626227 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f665000c1b0 con 0x7f6650004800 2024-04-26T23:41:07.013 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.006+0000 7f665bfff640 1 -- 172.21.15.88:0/2884626227 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f665000c3b0 con 0x7f66500039b0 2024-04-26T23:41:07.013 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.006+0000 7f6669aa7640 1 --2- 172.21.15.88:0/2884626227 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f66500052e0 0x7f665000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:07.013 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.006+0000 7f6668aa5640 1 --2- 172.21.15.88:0/2884626227 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6650004800 0x7f6650004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:07.013 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.006+0000 7f66692a6640 1 --2- 172.21.15.88:0/2884626227 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f66500039b0 0x7f6650003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:07.014 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.007+0000 7f6669aa7640 1 -- 172.21.15.88:0/2884626227 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f66500039b0 msgr2=0x7f6650003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:41:07.014 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.007+0000 7f6669aa7640 1 --2- 172.21.15.88:0/2884626227 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f66500039b0 0x7f6650003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:07.014 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.007+0000 7f6669aa7640 1 -- 172.21.15.88:0/2884626227 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6650004800 msgr2=0x7f6650004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:41:07.014 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.007+0000 7f6669aa7640 1 --2- 172.21.15.88:0/2884626227 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6650004800 0x7f6650004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:07.014 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.007+0000 7f6669aa7640 1 -- 172.21.15.88:0/2884626227 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6650003520 con 0x7f66500052e0 2024-04-26T23:41:07.014 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.007+0000 7f66692a6640 1 --2- 172.21.15.88:0/2884626227 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f66500039b0 0x7f6650003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:41:07.014 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.007+0000 7f6669aa7640 1 -- 172.21.15.88:0/2884626227 reap_dead start 2024-04-26T23:41:07.014 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.007+0000 7f6669aa7640 1 --2- 172.21.15.88:0/2884626227 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f66500052e0 0x7f665000b9c0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f66640acb60 tx=0x7f6650005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=467ced834da7ffc4 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:07.014 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.007+0000 7f665bfff640 1 -- 172.21.15.88:0/2884626227 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f665c033070 con 0x7f66500052e0 2024-04-26T23:41:07.014 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.007+0000 7f665bfff640 1 -- 172.21.15.88:0/2884626227 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f665c02f650 con 0x7f66500052e0 2024-04-26T23:41:07.014 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.007+0000 7f665bfff640 1 -- 172.21.15.88:0/2884626227 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f665c009be0 con 0x7f66500052e0 2024-04-26T23:41:07.014 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.008+0000 7f666b50a640 1 -- 172.21.15.88:0/2884626227 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f66500052e0 msgr2=0x7f665000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:07.015 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.008+0000 7f666b50a640 1 --2- 172.21.15.88:0/2884626227 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f66500052e0 0x7f665000b9c0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f66640acb60 tx=0x7f6650005830 comp rx=0 tx=0).stop 2024-04-26T23:41:07.015 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.008+0000 7f666b50a640 1 -- 172.21.15.88:0/2884626227 shutdown_connections 2024-04-26T23:41:07.015 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.008+0000 7f666b50a640 1 --2- 172.21.15.88:0/2884626227 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f66500052e0 0x7f665000b9c0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:07.015 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.008+0000 7f666b50a640 1 -- 172.21.15.88:0/2884626227 >> 172.21.15.88:0/2884626227 conn(0x7f666406e090 msgr2=0x7f666406c310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:07.015 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.008+0000 7f666b50a640 1 -- 172.21.15.88:0/2884626227 shutdown_connections 2024-04-26T23:41:07.015 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.008+0000 7f666b50a640 1 -- 172.21.15.88:0/2884626227 wait complete. 2024-04-26T23:41:07.015 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.009+0000 7f666b50a640 1 Processor -- start 2024-04-26T23:41:07.015 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.009+0000 7f666b50a640 1 -- start start 2024-04-26T23:41:07.018 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.010+0000 7f666b50a640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f66500052e0 0x7f6664157f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:07.018 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.010+0000 7f666b50a640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6664153070 0x7f66641ed310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:07.018 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.010+0000 7f666b50a640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6664152170 0x7f6664155450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:07.018 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.010+0000 7f666b50a640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f66640ac620 con 0x7f6664153070 2024-04-26T23:41:07.018 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.010+0000 7f666b50a640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f666415a470 con 0x7f6664152170 2024-04-26T23:41:07.018 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.010+0000 7f666b50a640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f66640ac7a0 con 0x7f66500052e0 2024-04-26T23:41:07.018 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.010+0000 7f6668aa5640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6664153070 0x7f66641ed310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:07.018 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.010+0000 7f6668aa5640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6664153070 0x7f66641ed310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:48820/0 (socket says 172.21.15.88:48820) 2024-04-26T23:41:07.018 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.010+0000 7f6668aa5640 1 -- 172.21.15.88:0/1330871812 learned_addr learned my addr 172.21.15.88:0/1330871812 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:41:07.018 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.010+0000 7f66692a6640 1 --2- 172.21.15.88:0/1330871812 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f66500052e0 0x7f6664157f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:07.018 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.010+0000 7f6669aa7640 1 --2- 172.21.15.88:0/1330871812 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6664152170 0x7f6664155450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:07.019 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.010+0000 7f6668aa5640 1 -- 172.21.15.88:0/1330871812 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f66500052e0 msgr2=0x7f6664157f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:07.019 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.010+0000 7f6668aa5640 1 --2- 172.21.15.88:0/1330871812 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f66500052e0 0x7f6664157f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:07.019 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.010+0000 7f6668aa5640 1 -- 172.21.15.88:0/1330871812 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6664152170 msgr2=0x7f6664155450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:07.019 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.010+0000 7f6668aa5640 1 --2- 172.21.15.88:0/1330871812 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6664152170 0x7f6664155450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:07.019 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.010+0000 7f6668aa5640 1 -- 172.21.15.88:0/1330871812 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6664151a70 con 0x7f6664153070 2024-04-26T23:41:07.019 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.010+0000 7f66692a6640 1 --2- 172.21.15.88:0/1330871812 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f66500052e0 0x7f6664157f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:41:07.019 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.010+0000 7f6669aa7640 1 --2- 172.21.15.88:0/1330871812 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6664152170 0x7f6664155450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:41:07.019 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.010+0000 7f6668aa5640 1 --2- 172.21.15.88:0/1330871812 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6664153070 0x7f66641ed310 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f6654001200 tx=0x7f66540077a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:07.019 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.010+0000 7f6659ffb640 1 -- 172.21.15.88:0/1330871812 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6654001670 con 0x7f6664153070 2024-04-26T23:41:07.019 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.011+0000 7f6659ffb640 1 -- 172.21.15.88:0/1330871812 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6654018070 con 0x7f6664153070 2024-04-26T23:41:07.019 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.011+0000 7f666b50a640 1 -- 172.21.15.88:0/1330871812 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6664153500 con 0x7f6664153070 2024-04-26T23:41:07.019 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.011+0000 7f6659ffb640 1 -- 172.21.15.88:0/1330871812 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f665400fba0 con 0x7f6664153070 2024-04-26T23:41:07.019 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.011+0000 7f666b50a640 1 -- 172.21.15.88:0/1330871812 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6664154c50 con 0x7f6664153070 2024-04-26T23:41:07.019 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.012+0000 7f666b50a640 1 -- 172.21.15.88:0/1330871812 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f66640c5d00 con 0x7f6664153070 2024-04-26T23:41:07.020 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.012+0000 7f6659ffb640 1 -- 172.21.15.88:0/1330871812 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f665400fd40 con 0x7f6664153070 2024-04-26T23:41:07.020 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.012+0000 7f6659ffb640 1 --2- 172.21.15.88:0/1330871812 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f664806c8f0 0x7f664806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:07.020 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.013+0000 7f6659ffb640 1 -- 172.21.15.88:0/1330871812 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7f665408bdc0 con 0x7f6664153070 2024-04-26T23:41:07.020 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.013+0000 7f66692a6640 1 --2- 172.21.15.88:0/1330871812 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f664806c8f0 0x7f664806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:07.020 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.013+0000 7f66692a6640 1 --2- 172.21.15.88:0/1330871812 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f664806c8f0 0x7f664806edb0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f6660000c00 tx=0x7f6660009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:07.020 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.017+0000 7f6659ffb640 1 -- 172.21.15.88:0/1330871812 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f6654059900 con 0x7f6664153070 2024-04-26T23:41:07.196 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.193+0000 7f666b50a640 1 -- 172.21.15.88:0/1330871812 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "a_metadata", "var": "pg_num"} v 0) -- 0x7f66640aafb0 con 0x7f6664153070 2024-04-26T23:41:07.196 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.193+0000 7f6659ffb640 1 -- 172.21.15.88:0/1330871812 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "a_metadata", "var": "pg_num"}]=0 v24) ==== 99+0+11 (secure 0 0 0) 0x7f665405dc00 con 0x7f6664153070 2024-04-26T23:41:07.197 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 32 2024-04-26T23:41:07.202 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.195+0000 7f666b50a640 1 -- 172.21.15.88:0/1330871812 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f664806c8f0 msgr2=0x7f664806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:07.203 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.195+0000 7f666b50a640 1 --2- 172.21.15.88:0/1330871812 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f664806c8f0 0x7f664806edb0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f6660000c00 tx=0x7f6660009040 comp rx=0 tx=0).stop 2024-04-26T23:41:07.203 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.195+0000 7f666b50a640 1 -- 172.21.15.88:0/1330871812 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6664153070 msgr2=0x7f66641ed310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:07.203 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.195+0000 7f666b50a640 1 --2- 172.21.15.88:0/1330871812 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6664153070 0x7f66641ed310 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f6654001200 tx=0x7f66540077a0 comp rx=0 tx=0).stop 2024-04-26T23:41:07.203 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.195+0000 7f666b50a640 1 -- 172.21.15.88:0/1330871812 shutdown_connections 2024-04-26T23:41:07.203 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.195+0000 7f666b50a640 1 --2- 172.21.15.88:0/1330871812 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f664806c8f0 0x7f664806edb0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:07.203 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.195+0000 7f666b50a640 1 --2- 172.21.15.88:0/1330871812 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6664152170 0x7f6664155450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:07.203 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.195+0000 7f666b50a640 1 --2- 172.21.15.88:0/1330871812 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6664153070 0x7f66641ed310 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:07.203 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.195+0000 7f666b50a640 1 --2- 172.21.15.88:0/1330871812 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f66500052e0 0x7f6664157f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:07.203 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.195+0000 7f666b50a640 1 -- 172.21.15.88:0/1330871812 >> 172.21.15.88:0/1330871812 conn(0x7f666406e090 msgr2=0x7f6664150140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:07.203 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.195+0000 7f666b50a640 1 -- 172.21.15.88:0/1330871812 shutdown_connections 2024-04-26T23:41:07.203 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.195+0000 7f666b50a640 1 -- 172.21.15.88:0/1330871812 wait complete. 2024-04-26T23:41:07.209 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get a_data pg_num 2024-04-26T23:41:07.308 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.306+0000 7fc6df8c8640 1 Processor -- start 2024-04-26T23:41:07.309 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.306+0000 7fc6df8c8640 1 -- start start 2024-04-26T23:41:07.311 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.307+0000 7fc6df8c8640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc6d81572e0 0x7fc6d8157770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:07.311 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.307+0000 7fc6df8c8640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc6d80ad010 con 0x7fc6d80c4250 2024-04-26T23:41:07.311 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.307+0000 7fc6df8c8640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc6d80c8300 con 0x7fc6d80acc30 2024-04-26T23:41:07.311 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.307+0000 7fc6df8c8640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fc6d80c8ba0 con 0x7fc6d81572e0 2024-04-26T23:41:07.312 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.307+0000 7fc6dce63640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fc6d80c4250 0x7fc6d80c3790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:52022/0 (socket says 172.21.15.88:52022) 2024-04-26T23:41:07.312 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.307+0000 7fc6dce63640 1 -- 172.21.15.88:0/2132720996 learned_addr learned my addr 172.21.15.88:0/2132720996 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-26T23:41:07.312 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.307+0000 7fc6cffff640 1 -- 172.21.15.88:0/2132720996 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2458167616 0 0) 0x7fc6d80ad010 con 0x7fc6d80c4250 2024-04-26T23:41:07.312 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.307+0000 7fc6dde65640 1 --2- 172.21.15.88:0/2132720996 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc6d81572e0 0x7fc6d8157770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:07.312 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.307+0000 7fc6cffff640 1 -- 172.21.15.88:0/2132720996 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc6c4003520 con 0x7fc6d80c4250 2024-04-26T23:41:07.312 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.307+0000 7fc6cffff640 1 -- 172.21.15.88:0/2132720996 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3089131336 0 0) 0x7fc6c4003520 con 0x7fc6d80c4250 2024-04-26T23:41:07.312 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.307+0000 7fc6cffff640 1 -- 172.21.15.88:0/2132720996 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc6d81572e0 msgr2=0x7fc6d8157770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:41:07.312 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.307+0000 7fc6cffff640 1 --2- 172.21.15.88:0/2132720996 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc6d81572e0 0x7fc6d8157770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:07.312 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.307+0000 7fc6cffff640 1 -- 172.21.15.88:0/2132720996 >> v1:172.21.15.175:6789/0 conn(0x7fc6d80acc30 legacy=0x7fc6d815abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:07.312 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.307+0000 7fc6cffff640 1 -- 172.21.15.88:0/2132720996 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6d80c85e0 con 0x7fc6d80c4250 2024-04-26T23:41:07.312 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.307+0000 7fc6cffff640 1 -- 172.21.15.88:0/2132720996 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 356324787 0 0) 0x7fc6c8001670 con 0x7fc6d80c4250 2024-04-26T23:41:07.312 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.307+0000 7fc6cffff640 1 -- 172.21.15.88:0/2132720996 >> v1:172.21.15.88:6789/0 conn(0x7fc6d80c4250 legacy=0x7fc6d80c3790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:07.312 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.307+0000 7fc6cffff640 1 --2- 172.21.15.88:0/2132720996 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc6d81572e0 0x7fc6c40039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:07.312 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.307+0000 7fc6cffff640 1 --2- 172.21.15.88:0/2132720996 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc6c4003f60 0x7fc6c4004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:07.313 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.307+0000 7fc6cffff640 1 --2- 172.21.15.88:0/2132720996 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc6c4004d40 0x7fc6c40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:07.313 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.307+0000 7fc6cffff640 1 -- 172.21.15.88:0/2132720996 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fc6d80c8ba0 con 0x7fc6c4004d40 2024-04-26T23:41:07.313 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.307+0000 7fc6cffff640 1 -- 172.21.15.88:0/2132720996 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc6c400bb50 con 0x7fc6c4003f60 2024-04-26T23:41:07.313 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.307+0000 7fc6cffff640 1 -- 172.21.15.88:0/2132720996 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fc6c400bd50 con 0x7fc6d81572e0 2024-04-26T23:41:07.313 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.307+0000 7fc6dde65640 1 --2- 172.21.15.88:0/2132720996 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc6c4004d40 0x7fc6c40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:07.313 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.307+0000 7fc6dd664640 1 --2- 172.21.15.88:0/2132720996 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc6d81572e0 0x7fc6c40039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:07.313 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.307+0000 7fc6dce63640 1 --2- 172.21.15.88:0/2132720996 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc6c4003f60 0x7fc6c4004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:07.313 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.308+0000 7fc6dde65640 1 -- 172.21.15.88:0/2132720996 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc6d81572e0 msgr2=0x7fc6c40039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:41:07.313 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.308+0000 7fc6dde65640 1 --2- 172.21.15.88:0/2132720996 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc6d81572e0 0x7fc6c40039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:07.313 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.308+0000 7fc6dde65640 1 -- 172.21.15.88:0/2132720996 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc6c4003f60 msgr2=0x7fc6c4004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:41:07.313 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.308+0000 7fc6dde65640 1 --2- 172.21.15.88:0/2132720996 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc6c4003f60 0x7fc6c4004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:07.313 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.308+0000 7fc6dde65640 1 -- 172.21.15.88:0/2132720996 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6c4003520 con 0x7fc6c4004d40 2024-04-26T23:41:07.313 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.308+0000 7fc6dde65640 1 --2- 172.21.15.88:0/2132720996 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc6c4004d40 0x7fc6c40051c0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fc6d0009fc0 tx=0x7fc6c4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4786f330bbaa82c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:07.313 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.308+0000 7fc6cffff640 1 -- 172.21.15.88:0/2132720996 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6d0009c10 con 0x7fc6c4004d40 2024-04-26T23:41:07.314 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.308+0000 7fc6cffff640 1 -- 172.21.15.88:0/2132720996 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6d0036070 con 0x7fc6c4004d40 2024-04-26T23:41:07.314 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.308+0000 7fc6cffff640 1 -- 172.21.15.88:0/2132720996 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6d0031880 con 0x7fc6c4004d40 2024-04-26T23:41:07.317 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.309+0000 7fc6df8c8640 1 -- 172.21.15.88:0/2132720996 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc6c4004d40 msgr2=0x7fc6c40051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:07.317 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.309+0000 7fc6df8c8640 1 --2- 172.21.15.88:0/2132720996 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc6c4004d40 0x7fc6c40051c0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fc6d0009fc0 tx=0x7fc6c4005830 comp rx=0 tx=0).stop 2024-04-26T23:41:07.317 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.309+0000 7fc6dde65640 1 -- 172.21.15.88:0/2132720996 reap_dead start 2024-04-26T23:41:07.317 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.309+0000 7fc6df8c8640 1 -- 172.21.15.88:0/2132720996 shutdown_connections 2024-04-26T23:41:07.317 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.309+0000 7fc6df8c8640 1 -- 172.21.15.88:0/2132720996 >> 172.21.15.88:0/2132720996 conn(0x7fc6d80c6e60 msgr2=0x7fc6d80c7270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:07.317 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.309+0000 7fc6df8c8640 1 -- 172.21.15.88:0/2132720996 shutdown_connections 2024-04-26T23:41:07.317 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.309+0000 7fc6df8c8640 1 -- 172.21.15.88:0/2132720996 wait complete. 2024-04-26T23:41:07.317 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.310+0000 7fc6df8c8640 1 Processor -- start 2024-04-26T23:41:07.317 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.310+0000 7fc6df8c8640 1 -- start start 2024-04-26T23:41:07.317 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.311+0000 7fc6df8c8640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc6c4004d40 0x7fc6d8148d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:07.318 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.311+0000 7fc6df8c8640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc6d81589c0 0x7fc6d8159fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:07.318 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.311+0000 7fc6df8c8640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc6d81efd30 0x7fc6d8147b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:07.318 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.311+0000 7fc6df8c8640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fc6d80c3ea0 con 0x7fc6d81efd30 2024-04-26T23:41:07.318 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.311+0000 7fc6df8c8640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc6d8156e50 con 0x7fc6d81589c0 2024-04-26T23:41:07.318 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.311+0000 7fc6df8c8640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fc6d80c4020 con 0x7fc6c4004d40 2024-04-26T23:41:07.318 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.311+0000 7fc6dde65640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc6d81efd30 0x7fc6d8147b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:07.318 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.311+0000 7fc6dde65640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc6d81efd30 0x7fc6d8147b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:48832/0 (socket says 172.21.15.88:48832) 2024-04-26T23:41:07.318 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.311+0000 7fc6dde65640 1 -- 172.21.15.88:0/2616368332 learned_addr learned my addr 172.21.15.88:0/2616368332 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:41:07.318 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.311+0000 7fc6dce63640 1 --2- 172.21.15.88:0/2616368332 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc6d81589c0 0x7fc6d8159fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:07.318 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.311+0000 7fc6dde65640 1 -- 172.21.15.88:0/2616368332 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc6c4004d40 msgr2=0x7fc6d8148d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:07.318 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.311+0000 7fc6dde65640 1 --2- 172.21.15.88:0/2616368332 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc6c4004d40 0x7fc6d8148d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:07.318 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.311+0000 7fc6dde65640 1 -- 172.21.15.88:0/2616368332 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc6d81589c0 msgr2=0x7fc6d8159fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:07.319 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.311+0000 7fc6dde65640 1 --2- 172.21.15.88:0/2616368332 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc6d81589c0 0x7fc6d8159fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:07.319 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.311+0000 7fc6dde65640 1 -- 172.21.15.88:0/2616368332 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6d8148a60 con 0x7fc6d81efd30 2024-04-26T23:41:07.319 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.311+0000 7fc6dce63640 1 --2- 172.21.15.88:0/2616368332 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc6d81589c0 0x7fc6d8159fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:41:07.319 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.311+0000 7fc6dde65640 1 --2- 172.21.15.88:0/2616368332 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc6d81efd30 0x7fc6d8147b70 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fc6d0033040 tx=0x7fc6d0009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:07.319 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.311+0000 7fc6cdffb640 1 -- 172.21.15.88:0/2616368332 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6d0009c10 con 0x7fc6d81efd30 2024-04-26T23:41:07.319 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.311+0000 7fc6cdffb640 1 -- 172.21.15.88:0/2616368332 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6d0031dd0 con 0x7fc6d81efd30 2024-04-26T23:41:07.319 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.312+0000 7fc6df8c8640 1 -- 172.21.15.88:0/2616368332 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6d815afa0 con 0x7fc6d81efd30 2024-04-26T23:41:07.319 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.312+0000 7fc6cdffb640 1 -- 172.21.15.88:0/2616368332 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6d0003bd0 con 0x7fc6d81efd30 2024-04-26T23:41:07.319 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.312+0000 7fc6df8c8640 1 -- 172.21.15.88:0/2616368332 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6d80c5d10 con 0x7fc6d81efd30 2024-04-26T23:41:07.319 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.313+0000 7fc6df8c8640 1 -- 172.21.15.88:0/2616368332 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc6d80abec0 con 0x7fc6d81efd30 2024-04-26T23:41:07.319 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.313+0000 7fc6cdffb640 1 -- 172.21.15.88:0/2616368332 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc6d0005d10 con 0x7fc6d81efd30 2024-04-26T23:41:07.319 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.313+0000 7fc6cdffb640 1 --2- 172.21.15.88:0/2616368332 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fc6bc06c8f0 0x7fc6bc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:07.319 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.314+0000 7fc6cdffb640 1 -- 172.21.15.88:0/2616368332 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7fc6d00ad5a0 con 0x7fc6d81efd30 2024-04-26T23:41:07.319 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.314+0000 7fc6dd664640 1 --2- 172.21.15.88:0/2616368332 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fc6bc06c8f0 0x7fc6bc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:07.319 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.314+0000 7fc6dd664640 1 --2- 172.21.15.88:0/2616368332 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fc6bc06c8f0 0x7fc6bc06edb0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fc6d814cdc0 tx=0x7fc6d4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:07.320 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.318+0000 7fc6cdffb640 1 -- 172.21.15.88:0/2616368332 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fc6d80abec0 con 0x7fc6d81efd30 2024-04-26T23:41:07.496 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.493+0000 7fc6df8c8640 1 -- 172.21.15.88:0/2616368332 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "a_data", "var": "pg_num"} v 0) -- 0x7fc6d815ad90 con 0x7fc6d81efd30 2024-04-26T23:41:07.496 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.493+0000 7fc6cdffb640 1 -- 172.21.15.88:0/2616368332 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "a_data", "var": "pg_num"}]=0 v24) ==== 95+0+11 (secure 0 0 0) 0x7fc6d004a060 con 0x7fc6d81efd30 2024-04-26T23:41:07.497 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 64 2024-04-26T23:41:07.499 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.495+0000 7fc6df8c8640 1 -- 172.21.15.88:0/2616368332 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fc6bc06c8f0 msgr2=0x7fc6bc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:07.499 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.495+0000 7fc6df8c8640 1 --2- 172.21.15.88:0/2616368332 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fc6bc06c8f0 0x7fc6bc06edb0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fc6d814cdc0 tx=0x7fc6d4009040 comp rx=0 tx=0).stop 2024-04-26T23:41:07.499 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.495+0000 7fc6df8c8640 1 -- 172.21.15.88:0/2616368332 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc6d81efd30 msgr2=0x7fc6d8147b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:07.499 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.495+0000 7fc6df8c8640 1 --2- 172.21.15.88:0/2616368332 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc6d81efd30 0x7fc6d8147b70 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fc6d0033040 tx=0x7fc6d0009750 comp rx=0 tx=0).stop 2024-04-26T23:41:07.499 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.495+0000 7fc6df8c8640 1 -- 172.21.15.88:0/2616368332 shutdown_connections 2024-04-26T23:41:07.499 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.495+0000 7fc6df8c8640 1 --2- 172.21.15.88:0/2616368332 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fc6bc06c8f0 0x7fc6bc06edb0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:07.499 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.495+0000 7fc6df8c8640 1 --2- 172.21.15.88:0/2616368332 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc6d81efd30 0x7fc6d8147b70 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:07.499 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.495+0000 7fc6df8c8640 1 --2- 172.21.15.88:0/2616368332 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc6d81589c0 0x7fc6d8159fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:07.499 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.495+0000 7fc6df8c8640 1 --2- 172.21.15.88:0/2616368332 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc6c4004d40 0x7fc6d8148d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:07.499 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.495+0000 7fc6df8c8640 1 -- 172.21.15.88:0/2616368332 >> 172.21.15.88:0/2616368332 conn(0x7fc6d80c6e60 msgr2=0x7fc6d8156550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:07.499 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.495+0000 7fc6df8c8640 1 -- 172.21.15.88:0/2616368332 shutdown_connections 2024-04-26T23:41:07.500 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.496+0000 7fc6df8c8640 1 -- 172.21.15.88:0/2616368332 wait complete. 2024-04-26T23:41:07.509 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get b_metadata pg_num 2024-04-26T23:41:07.607 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.604+0000 7efdc0eda640 1 Processor -- start 2024-04-26T23:41:07.607 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.604+0000 7efdc0eda640 1 -- start start 2024-04-26T23:41:07.609 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.605+0000 7efdc0eda640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7efdbc0740e0 0x7efdbc157630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:07.609 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.605+0000 7efdc0eda640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efdbc15a530 con 0x7efdbc0c6e20 2024-04-26T23:41:07.609 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.605+0000 7efdc0eda640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efdbc15a810 con 0x7efdbc0ca3a0 2024-04-26T23:41:07.609 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.605+0000 7efdc0eda640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7efdbc072930 con 0x7efdbc0740e0 2024-04-26T23:41:07.609 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.605+0000 7efdba59c640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7efdbc0c6e20 0x7efdbc156f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:52030/0 (socket says 172.21.15.88:52030) 2024-04-26T23:41:07.609 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.605+0000 7efdba59c640 1 -- 172.21.15.88:0/2789571169 learned_addr learned my addr 172.21.15.88:0/2789571169 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-26T23:41:07.609 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.605+0000 7efdb9d9b640 1 --2- 172.21.15.88:0/2789571169 >> v2:172.21.15.175:3300/0 conn(0x7efdbc0740e0 0x7efdbc157630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:07.609 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.605+0000 7efdb959a640 1 -- 172.21.15.88:0/2789571169 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1360850423 0 0) 0x7efdbc15a530 con 0x7efdbc0c6e20 2024-04-26T23:41:07.609 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.605+0000 7efdb959a640 1 -- 172.21.15.88:0/2789571169 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efda4003520 con 0x7efdbc0c6e20 2024-04-26T23:41:07.610 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.606+0000 7efdb959a640 1 -- 172.21.15.88:0/2789571169 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2238088574 0 0) 0x7efdbc15a810 con 0x7efdbc0ca3a0 2024-04-26T23:41:07.610 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.606+0000 7efdb959a640 1 -- 172.21.15.88:0/2789571169 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efdbc15a530 con 0x7efdbc0ca3a0 2024-04-26T23:41:07.610 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.606+0000 7efdb959a640 1 -- 172.21.15.88:0/2789571169 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3148548806 0 0) 0x7efda4003520 con 0x7efdbc0c6e20 2024-04-26T23:41:07.610 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.606+0000 7efdb9d9b640 1 -- 172.21.15.88:0/2789571169 >> v1:172.21.15.175:6789/0 conn(0x7efdbc0ca3a0 legacy=0x7efdbc161450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:07.610 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.606+0000 7efdb9d9b640 1 -- 172.21.15.88:0/2789571169 >> v1:172.21.15.88:6789/0 conn(0x7efdbc0c6e20 legacy=0x7efdbc156f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:07.610 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.606+0000 7efdb9d9b640 1 -- 172.21.15.88:0/2789571169 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efdbc15aaf0 con 0x7efdbc0740e0 2024-04-26T23:41:07.610 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.606+0000 7efdb9d9b640 1 --2- 172.21.15.88:0/2789571169 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efdbc0740e0 0x7efdbc157630 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7efdb00097a0 tx=0x7efdb002a130 comp rx=0 tx=0).ready entity=mon.1 client_cookie=883658cd2f28e985 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:07.613 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.607+0000 7efdb959a640 1 -- 172.21.15.88:0/2789571169 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdb0037070 con 0x7efdbc0740e0 2024-04-26T23:41:07.614 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.607+0000 7efdb959a640 1 -- 172.21.15.88:0/2789571169 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efdb002abc0 con 0x7efdbc0740e0 2024-04-26T23:41:07.614 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.607+0000 7efdb959a640 1 -- 172.21.15.88:0/2789571169 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdac0019f0 con 0x7efdbc0740e0 2024-04-26T23:41:07.614 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.607+0000 7efdc0eda640 1 -- 172.21.15.88:0/2789571169 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efdbc0740e0 msgr2=0x7efdbc157630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:07.614 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.607+0000 7efdc0eda640 1 --2- 172.21.15.88:0/2789571169 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efdbc0740e0 0x7efdbc157630 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7efdb00097a0 tx=0x7efdb002a130 comp rx=0 tx=0).stop 2024-04-26T23:41:07.614 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.607+0000 7efdc0eda640 1 -- 172.21.15.88:0/2789571169 shutdown_connections 2024-04-26T23:41:07.614 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.607+0000 7efdc0eda640 1 --2- 172.21.15.88:0/2789571169 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efdbc0740e0 0x7efdbc157630 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:07.614 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.607+0000 7efdc0eda640 1 -- 172.21.15.88:0/2789571169 >> 172.21.15.88:0/2789571169 conn(0x7efdbc0ae0b0 msgr2=0x7efdbc0ae490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:07.614 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.607+0000 7efdc0eda640 1 -- 172.21.15.88:0/2789571169 shutdown_connections 2024-04-26T23:41:07.614 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.607+0000 7efdc0eda640 1 -- 172.21.15.88:0/2789571169 wait complete. 2024-04-26T23:41:07.614 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.608+0000 7efdc0eda640 1 Processor -- start 2024-04-26T23:41:07.615 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.608+0000 7efdc0eda640 1 -- start start 2024-04-26T23:41:07.615 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.609+0000 7efdc0eda640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efdbc0740e0 0x7efdbc153490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:07.615 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.609+0000 7efdc0eda640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efdbc0c6e20 0x7efdbc159570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:07.615 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.609+0000 7efdc0eda640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efdbc0ca3a0 0x7efdbc142850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:07.615 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.609+0000 7efdc0eda640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7efdbc154540 con 0x7efdbc0c6e20 2024-04-26T23:41:07.615 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.609+0000 7efdc0eda640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7efdbc1543c0 con 0x7efdbc0740e0 2024-04-26T23:41:07.615 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.609+0000 7efdc0eda640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7efdbc15a0c0 con 0x7efdbc0ca3a0 2024-04-26T23:41:07.615 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.609+0000 7efdb9d9b640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efdbc0c6e20 0x7efdbc159570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:07.615 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.609+0000 7efdb9d9b640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efdbc0c6e20 0x7efdbc159570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:48836/0 (socket says 172.21.15.88:48836) 2024-04-26T23:41:07.615 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.609+0000 7efdb9d9b640 1 -- 172.21.15.88:0/1584178429 learned_addr learned my addr 172.21.15.88:0/1584178429 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:41:07.615 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.609+0000 7efdba59c640 1 --2- 172.21.15.88:0/1584178429 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efdbc0740e0 0x7efdbc153490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:07.615 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.609+0000 7efdbad9d640 1 --2- 172.21.15.88:0/1584178429 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efdbc0ca3a0 0x7efdbc142850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:07.615 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.609+0000 7efdb9d9b640 1 -- 172.21.15.88:0/1584178429 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efdbc0ca3a0 msgr2=0x7efdbc142850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:07.615 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.609+0000 7efdb9d9b640 1 --2- 172.21.15.88:0/1584178429 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efdbc0ca3a0 0x7efdbc142850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:07.615 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.609+0000 7efdb9d9b640 1 -- 172.21.15.88:0/1584178429 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efdbc0740e0 msgr2=0x7efdbc153490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:07.615 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.609+0000 7efdb9d9b640 1 --2- 172.21.15.88:0/1584178429 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efdbc0740e0 0x7efdbc153490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:07.616 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.609+0000 7efdb9d9b640 1 -- 172.21.15.88:0/1584178429 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efdbc159090 con 0x7efdbc0c6e20 2024-04-26T23:41:07.616 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.610+0000 7efdb9d9b640 1 --2- 172.21.15.88:0/1584178429 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efdbc0c6e20 0x7efdbc159570 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7efdb00098c0 tx=0x7efdb00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:07.616 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.610+0000 7efdaaffd640 1 -- 172.21.15.88:0/1584178429 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdb0037050 con 0x7efdbc0c6e20 2024-04-26T23:41:07.616 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.610+0000 7efdaaffd640 1 -- 172.21.15.88:0/1584178429 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efdb0043070 con 0x7efdbc0c6e20 2024-04-26T23:41:07.616 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.610+0000 7efdc0eda640 1 -- 172.21.15.88:0/1584178429 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efdbc072f90 con 0x7efdbc0c6e20 2024-04-26T23:41:07.616 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.610+0000 7efdaaffd640 1 -- 172.21.15.88:0/1584178429 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdb0006e10 con 0x7efdbc0c6e20 2024-04-26T23:41:07.616 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.610+0000 7efdc0eda640 1 -- 172.21.15.88:0/1584178429 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efdbc073550 con 0x7efdbc0c6e20 2024-04-26T23:41:07.616 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.611+0000 7efdc0eda640 1 -- 172.21.15.88:0/1584178429 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efdbc0766c0 con 0x7efdbc0c6e20 2024-04-26T23:41:07.617 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.611+0000 7efdaaffd640 1 -- 172.21.15.88:0/1584178429 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7efdb0048460 con 0x7efdbc0c6e20 2024-04-26T23:41:07.617 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.612+0000 7efdaaffd640 1 --2- 172.21.15.88:0/1584178429 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7efd9c06c8f0 0x7efd9c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:07.617 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.612+0000 7efdaaffd640 1 -- 172.21.15.88:0/1584178429 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7efdb00ac720 con 0x7efdbc0c6e20 2024-04-26T23:41:07.617 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.612+0000 7efdba59c640 1 --2- 172.21.15.88:0/1584178429 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7efd9c06c8f0 0x7efd9c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:07.617 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.612+0000 7efdba59c640 1 --2- 172.21.15.88:0/1584178429 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7efd9c06c8f0 0x7efd9c06edb0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7efdac001560 tx=0x7efdac009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:07.618 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.616+0000 7efdaaffd640 1 -- 172.21.15.88:0/1584178429 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7efdb007a830 con 0x7efdbc0c6e20 2024-04-26T23:41:07.795 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.792+0000 7efdc0eda640 1 -- 172.21.15.88:0/1584178429 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "b_metadata", "var": "pg_num"} v 0) -- 0x7efdbc0c7200 con 0x7efdbc0c6e20 2024-04-26T23:41:07.795 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.793+0000 7efdaaffd640 1 -- 172.21.15.88:0/1584178429 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "b_metadata", "var": "pg_num"}]=0 v24) ==== 99+0+11 (secure 0 0 0) 0x7efdb007a130 con 0x7efdbc0c6e20 2024-04-26T23:41:07.796 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 32 2024-04-26T23:41:07.798 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.795+0000 7efdc0eda640 1 -- 172.21.15.88:0/1584178429 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7efd9c06c8f0 msgr2=0x7efd9c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:07.798 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.795+0000 7efdc0eda640 1 --2- 172.21.15.88:0/1584178429 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7efd9c06c8f0 0x7efd9c06edb0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7efdac001560 tx=0x7efdac009040 comp rx=0 tx=0).stop 2024-04-26T23:41:07.798 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.795+0000 7efdc0eda640 1 -- 172.21.15.88:0/1584178429 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efdbc0c6e20 msgr2=0x7efdbc159570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:07.798 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.795+0000 7efdc0eda640 1 --2- 172.21.15.88:0/1584178429 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efdbc0c6e20 0x7efdbc159570 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7efdb00098c0 tx=0x7efdb00046c0 comp rx=0 tx=0).stop 2024-04-26T23:41:07.798 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.795+0000 7efdc0eda640 1 -- 172.21.15.88:0/1584178429 shutdown_connections 2024-04-26T23:41:07.798 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.795+0000 7efdc0eda640 1 --2- 172.21.15.88:0/1584178429 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7efd9c06c8f0 0x7efd9c06edb0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:07.798 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.795+0000 7efdc0eda640 1 --2- 172.21.15.88:0/1584178429 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efdbc0ca3a0 0x7efdbc142850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:07.798 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.795+0000 7efdc0eda640 1 --2- 172.21.15.88:0/1584178429 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efdbc0c6e20 0x7efdbc159570 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:07.798 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.795+0000 7efdc0eda640 1 --2- 172.21.15.88:0/1584178429 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efdbc0740e0 0x7efdbc153490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:07.799 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.795+0000 7efdc0eda640 1 -- 172.21.15.88:0/1584178429 >> 172.21.15.88:0/1584178429 conn(0x7efdbc0ae0b0 msgr2=0x7efdbc0ac820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:07.799 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.795+0000 7efdc0eda640 1 -- 172.21.15.88:0/1584178429 shutdown_connections 2024-04-26T23:41:07.799 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.795+0000 7efdc0eda640 1 -- 172.21.15.88:0/1584178429 wait complete. 2024-04-26T23:41:07.809 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get b_data pg_num 2024-04-26T23:41:07.908 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.905+0000 7f137f2ea640 1 Processor -- start 2024-04-26T23:41:07.908 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.905+0000 7f137f2ea640 1 -- start start 2024-04-26T23:41:07.909 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.906+0000 7f137f2ea640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f13781541d0 0x7f13780c8400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:07.909 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.906+0000 7f137f2ea640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1378070490 0x7f13780c7420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:07.909 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.906+0000 7f137f2ea640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f13780c7960 0x7f137815a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:07.909 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.906+0000 7f137f2ea640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f13780c3fc0 con 0x7f13781541d0 2024-04-26T23:41:07.909 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.906+0000 7f137f2ea640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f13780c3500 con 0x7f13780c7960 2024-04-26T23:41:07.909 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.906+0000 7f137f2ea640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f13780c37e0 con 0x7f1378070490 2024-04-26T23:41:07.909 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.906+0000 7f137d086640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f13781541d0 0x7f13780c8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:07.910 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.906+0000 7f137d086640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f13781541d0 0x7f13780c8400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:48846/0 (socket says 172.21.15.88:48846) 2024-04-26T23:41:07.910 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.906+0000 7f137d086640 1 -- 172.21.15.88:0/4184290558 learned_addr learned my addr 172.21.15.88:0/4184290558 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:41:07.910 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.906+0000 7f137d086640 1 -- 172.21.15.88:0/4184290558 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1378070490 msgr2=0x7f13780c7420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:41:07.910 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.906+0000 7f137d086640 1 --2- 172.21.15.88:0/4184290558 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1378070490 0x7f13780c7420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:07.910 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.906+0000 7f137d086640 1 -- 172.21.15.88:0/4184290558 >> v2:172.21.15.175:3300/0 conn(0x7f13780c7960 msgr2=0x7f137815a3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:41:07.910 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.906+0000 7f137d086640 1 --2- 172.21.15.88:0/4184290558 >> v2:172.21.15.175:3300/0 conn(0x7f13780c7960 0x7f137815a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:07.910 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.906+0000 7f137d086640 1 -- 172.21.15.88:0/4184290558 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13780c3ac0 con 0x7f13781541d0 2024-04-26T23:41:07.911 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.907+0000 7f137d086640 1 --2- 172.21.15.88:0/4184290558 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f13781541d0 0x7f13780c8400 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f13780c6a70 tx=0x7f136802a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed5ca72406538204 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:07.912 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.907+0000 7f136ffff640 1 -- 172.21.15.88:0/4184290558 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1368037070 con 0x7f13781541d0 2024-04-26T23:41:07.912 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.907+0000 7f136ffff640 1 -- 172.21.15.88:0/4184290558 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1368032440 con 0x7f13781541d0 2024-04-26T23:41:07.912 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.907+0000 7f136ffff640 1 -- 172.21.15.88:0/4184290558 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1368032810 con 0x7f13781541d0 2024-04-26T23:41:07.912 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.907+0000 7f137f2ea640 1 -- 172.21.15.88:0/4184290558 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f13781541d0 msgr2=0x7f13780c8400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:07.912 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.907+0000 7f137f2ea640 1 --2- 172.21.15.88:0/4184290558 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f13781541d0 0x7f13780c8400 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f13780c6a70 tx=0x7f136802a140 comp rx=0 tx=0).stop 2024-04-26T23:41:07.912 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.907+0000 7f137f2ea640 1 -- 172.21.15.88:0/4184290558 shutdown_connections 2024-04-26T23:41:07.912 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.907+0000 7f137f2ea640 1 --2- 172.21.15.88:0/4184290558 >> v2:172.21.15.175:3300/0 conn(0x7f13780c7960 0x7f137815a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:07.912 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.907+0000 7f137f2ea640 1 --2- 172.21.15.88:0/4184290558 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1378070490 0x7f13780c7420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:07.912 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.907+0000 7f137f2ea640 1 --2- 172.21.15.88:0/4184290558 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f13781541d0 0x7f13780c8400 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:07.912 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.907+0000 7f137f2ea640 1 -- 172.21.15.88:0/4184290558 >> 172.21.15.88:0/4184290558 conn(0x7f13780c8c40 msgr2=0x7f13780c9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:07.912 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.908+0000 7f137f2ea640 1 -- 172.21.15.88:0/4184290558 shutdown_connections 2024-04-26T23:41:07.912 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.908+0000 7f137f2ea640 1 -- 172.21.15.88:0/4184290558 wait complete. 2024-04-26T23:41:07.912 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.909+0000 7f137f2ea640 1 Processor -- start 2024-04-26T23:41:07.912 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.909+0000 7f137f2ea640 1 -- start start 2024-04-26T23:41:07.915 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.909+0000 7f137f2ea640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1378070490 0x7f137806f500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:07.915 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.909+0000 7f137f2ea640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f13780c7960 0x7f13781e3220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:07.915 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.909+0000 7f137f2ea640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f13781541d0 0x7f13781ed0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:07.915 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.909+0000 7f137f2ea640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f13780c4420 con 0x7f13780c7960 2024-04-26T23:41:07.915 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.909+0000 7f137f2ea640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f13780c42a0 con 0x7f13781541d0 2024-04-26T23:41:07.915 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.909+0000 7f137f2ea640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f137815a900 con 0x7f1378070490 2024-04-26T23:41:07.915 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.909+0000 7f137c885640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f13780c7960 0x7f13781e3220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:07.915 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.909+0000 7f137c885640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f13780c7960 0x7f13781e3220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:48862/0 (socket says 172.21.15.88:48862) 2024-04-26T23:41:07.915 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.909+0000 7f137c885640 1 -- 172.21.15.88:0/312545226 learned_addr learned my addr 172.21.15.88:0/312545226 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:41:07.915 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.909+0000 7f137d086640 1 --2- 172.21.15.88:0/312545226 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1378070490 0x7f137806f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:07.915 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.909+0000 7f137d887640 1 --2- 172.21.15.88:0/312545226 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f13781541d0 0x7f13781ed0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:07.915 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.910+0000 7f137c885640 1 -- 172.21.15.88:0/312545226 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1378070490 msgr2=0x7f137806f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:07.915 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.910+0000 7f137c885640 1 --2- 172.21.15.88:0/312545226 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1378070490 0x7f137806f500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:07.915 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.910+0000 7f137c885640 1 -- 172.21.15.88:0/312545226 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f13781541d0 msgr2=0x7f13781ed0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:07.916 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.910+0000 7f137c885640 1 --2- 172.21.15.88:0/312545226 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f13781541d0 0x7f13781ed0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:07.916 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.910+0000 7f137c885640 1 -- 172.21.15.88:0/312545226 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f137814b820 con 0x7f13780c7960 2024-04-26T23:41:07.916 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.910+0000 7f137d887640 1 --2- 172.21.15.88:0/312545226 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f13781541d0 0x7f13781ed0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:41:07.916 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.910+0000 7f137c885640 1 --2- 172.21.15.88:0/312545226 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f13780c7960 0x7f13781e3220 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f137400b4a0 tx=0x7f137400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:07.916 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.910+0000 7f136dffb640 1 -- 172.21.15.88:0/312545226 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1374014070 con 0x7f13780c7960 2024-04-26T23:41:07.916 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.910+0000 7f136dffb640 1 -- 172.21.15.88:0/312545226 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1374010610 con 0x7f13780c7960 2024-04-26T23:41:07.916 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.910+0000 7f137f2ea640 1 -- 172.21.15.88:0/312545226 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13781f0650 con 0x7f13780c7960 2024-04-26T23:41:07.916 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.910+0000 7f136dffb640 1 -- 172.21.15.88:0/312545226 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1374010a00 con 0x7f13780c7960 2024-04-26T23:41:07.916 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.910+0000 7f137f2ea640 1 -- 172.21.15.88:0/312545226 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13781f0c10 con 0x7f13780c7960 2024-04-26T23:41:07.916 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.911+0000 7f137f2ea640 1 -- 172.21.15.88:0/312545226 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1378076690 con 0x7f13780c7960 2024-04-26T23:41:07.916 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.911+0000 7f136dffb640 1 -- 172.21.15.88:0/312545226 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f1374017070 con 0x7f13780c7960 2024-04-26T23:41:07.916 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.912+0000 7f136dffb640 1 --2- 172.21.15.88:0/312545226 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f135c06c920 0x7f135c06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:07.916 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.912+0000 7f136dffb640 1 -- 172.21.15.88:0/312545226 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7f137408b6f0 con 0x7f13780c7960 2024-04-26T23:41:07.916 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.912+0000 7f137d086640 1 --2- 172.21.15.88:0/312545226 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f135c06c920 0x7f135c06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:07.917 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.912+0000 7f137d086640 1 --2- 172.21.15.88:0/312545226 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f135c06c920 0x7f135c06ede0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f1368034000 tx=0x7f136802e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:07.919 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:07.916+0000 7f136dffb640 1 -- 172.21.15.88:0/312545226 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f1374059230 con 0x7f13780c7960 2024-04-26T23:41:08.095 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.091+0000 7f137f2ea640 1 -- 172.21.15.88:0/312545226 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "b_data", "var": "pg_num"} v 0) -- 0x7f1378152c20 con 0x7f13780c7960 2024-04-26T23:41:08.095 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.092+0000 7f136dffb640 1 -- 172.21.15.88:0/312545226 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "b_data", "var": "pg_num"}]=0 v24) ==== 95+0+11 (secure 0 0 0) 0x7f137405d530 con 0x7f13780c7960 2024-04-26T23:41:08.095 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 64 2024-04-26T23:41:08.097 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.094+0000 7f137f2ea640 1 -- 172.21.15.88:0/312545226 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f135c06c920 msgr2=0x7f135c06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:08.097 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.094+0000 7f137f2ea640 1 --2- 172.21.15.88:0/312545226 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f135c06c920 0x7f135c06ede0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f1368034000 tx=0x7f136802e000 comp rx=0 tx=0).stop 2024-04-26T23:41:08.097 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.094+0000 7f137f2ea640 1 -- 172.21.15.88:0/312545226 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f13780c7960 msgr2=0x7f13781e3220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:08.097 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.094+0000 7f137f2ea640 1 --2- 172.21.15.88:0/312545226 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f13780c7960 0x7f13781e3220 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f137400b4a0 tx=0x7f137400b960 comp rx=0 tx=0).stop 2024-04-26T23:41:08.097 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.094+0000 7f137f2ea640 1 -- 172.21.15.88:0/312545226 shutdown_connections 2024-04-26T23:41:08.097 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.094+0000 7f137f2ea640 1 --2- 172.21.15.88:0/312545226 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f135c06c920 0x7f135c06ede0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:08.097 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.094+0000 7f137f2ea640 1 --2- 172.21.15.88:0/312545226 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f13781541d0 0x7f13781ed0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:08.097 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.094+0000 7f137f2ea640 1 --2- 172.21.15.88:0/312545226 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f13780c7960 0x7f13781e3220 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:08.098 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.094+0000 7f137f2ea640 1 --2- 172.21.15.88:0/312545226 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1378070490 0x7f137806f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:08.098 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.094+0000 7f137f2ea640 1 -- 172.21.15.88:0/312545226 >> 172.21.15.88:0/312545226 conn(0x7f13780c8c40 msgr2=0x7f13780c53a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:08.098 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.094+0000 7f137f2ea640 1 -- 172.21.15.88:0/312545226 shutdown_connections 2024-04-26T23:41:08.098 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.094+0000 7f137f2ea640 1 -- 172.21.15.88:0/312545226 wait complete. 2024-04-26T23:41:08.107 DEBUG:tasks.mon_thrash:Yielding 2024-04-26T23:41:08.107 INFO:teuthology.run_tasks:Running task workunit... 2024-04-26T23:41:08.120 INFO:tasks.workunit:Pulling workunits from ref bc612ffb9c1d5bc27536bc917a705262a36d4387 2024-04-26T23:41:08.120 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-04-26T23:41:08.120 INFO:tasks.workunit:timeout=3h 2024-04-26T23:41:08.120 INFO:tasks.workunit:cleanup=True 2024-04-26T23:41:08.120 DEBUG:teuthology.orchestra.run.smithi088:> stat -- /home/ubuntu/cephtest/mnt.0 2024-04-26T23:41:08.121 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T23:41:08.136 INFO:teuthology.orchestra.run.smithi088.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-04-26T23:41:08.136 INFO:teuthology.orchestra.run.smithi088.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2024-04-26T23:41:08.136 INFO:teuthology.orchestra.run.smithi088.stdout:Device: 2bh/43d Inode: 1 Links: 2 2024-04-26T23:41:08.136 INFO:teuthology.orchestra.run.smithi088.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T23:41:08.136 INFO:teuthology.orchestra.run.smithi088.stdout:Context: system_u:object_r:unlabeled_t:s0 2024-04-26T23:41:08.136 INFO:teuthology.orchestra.run.smithi088.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-04-26T23:41:08.136 INFO:teuthology.orchestra.run.smithi088.stdout:Modify: 2024-04-26 23:40:32.578426981 +0000 2024-04-26T23:41:08.137 INFO:teuthology.orchestra.run.smithi088.stdout:Change: 2024-04-26 23:41:01.336421459 +0000 2024-04-26T23:41:08.137 INFO:teuthology.orchestra.run.smithi088.stdout: Birth: 2024-04-26 23:40:32.578426981 +0000 2024-04-26T23:41:08.137 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-04-26T23:41:08.137 DEBUG:teuthology.orchestra.run.smithi088:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-04-26T23:41:08.203 DEBUG:teuthology.orchestra.run.smithi175:> stat -- /home/ubuntu/cephtest/mnt.1 2024-04-26T23:41:08.221 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.218+0000 7fda00914640 1 Processor -- start 2024-04-26T23:41:08.221 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.218+0000 7fda00914640 1 -- start start 2024-04-26T23:41:08.222 INFO:teuthology.orchestra.run.smithi175.stdout: File: /home/ubuntu/cephtest/mnt.1 2024-04-26T23:41:08.222 INFO:teuthology.orchestra.run.smithi175.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2024-04-26T23:41:08.222 INFO:teuthology.orchestra.run.smithi175.stdout:Device: 2bh/43d Inode: 1 Links: 2 2024-04-26T23:41:08.222 INFO:teuthology.orchestra.run.smithi175.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T23:41:08.222 INFO:teuthology.orchestra.run.smithi175.stdout:Context: system_u:object_r:unlabeled_t:s0 2024-04-26T23:41:08.222 INFO:teuthology.orchestra.run.smithi175.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-04-26T23:41:08.222 INFO:teuthology.orchestra.run.smithi175.stdout:Modify: 2024-04-26 23:40:41.660024091 +0000 2024-04-26T23:41:08.222 INFO:teuthology.orchestra.run.smithi175.stdout:Change: 2024-04-26 23:41:03.425502740 +0000 2024-04-26T23:41:08.222 INFO:teuthology.orchestra.run.smithi175.stdout: Birth: 2024-04-26 23:40:41.660024091 +0000 2024-04-26T23:41:08.223 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.1 2024-04-26T23:41:08.223 DEBUG:teuthology.orchestra.run.smithi175:> cd -- /home/ubuntu/cephtest/mnt.1 && sudo install -d -m 0755 --owner=ubuntu -- client.1 2024-04-26T23:41:08.227 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.219+0000 7fda00914640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fd9fc154160 0x7fd9fc156bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:08.227 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.219+0000 7fda00914640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fd9fc0ca5a0 0x7fd9fc15a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:08.227 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.219+0000 7fda00914640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd9fc0c8df0 con 0x7fd9fc0c6e00 2024-04-26T23:41:08.227 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.219+0000 7fda00914640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7fd9fc15a6e0 con 0x7fd9fc0ca5a0 2024-04-26T23:41:08.228 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.219+0000 7fda00914640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7fd9fc0c9100 con 0x7fd9fc154160 2024-04-26T23:41:08.228 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.219+0000 7fd9f9d9b640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fd9fc0ca5a0 0x7fd9fc15a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:08.228 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.219+0000 7fd9f9d9b640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fd9fc0ca5a0 0x7fd9fc15a1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:48868/0 (socket says 172.21.15.88:48868) 2024-04-26T23:41:08.228 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.219+0000 7fd9fad9d640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fd9fc0c6e00 0x7fd9fc0c9590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:52042/0 (socket says 172.21.15.88:52042) 2024-04-26T23:41:08.228 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.219+0000 7fd9f9d9b640 1 -- 172.21.15.88:0/837409832 learned_addr learned my addr 172.21.15.88:0/837409832 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:41:08.228 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.219+0000 7fd9fa59c640 1 --2- 172.21.15.88:0/837409832 >> v2:172.21.15.175:3300/0 conn(0x7fd9fc154160 0x7fd9fc156bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:08.228 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.219+0000 7fd9f9d9b640 1 -- 172.21.15.88:0/837409832 >> v2:172.21.15.175:3300/0 conn(0x7fd9fc154160 msgr2=0x7fd9fc156bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:41:08.228 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.219+0000 7fd9f9d9b640 1 --2- 172.21.15.88:0/837409832 >> v2:172.21.15.175:3300/0 conn(0x7fd9fc154160 0x7fd9fc156bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:08.228 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.219+0000 7fd9f9d9b640 1 -- 172.21.15.88:0/837409832 >> v1:172.21.15.88:6789/0 conn(0x7fd9fc0c6e00 legacy=0x7fd9fc0c9590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:08.228 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.219+0000 7fd9f9d9b640 1 -- 172.21.15.88:0/837409832 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9fc154540 con 0x7fd9fc0ca5a0 2024-04-26T23:41:08.228 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.220+0000 7fd9f9d9b640 1 --2- 172.21.15.88:0/837409832 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd9fc0ca5a0 0x7fd9fc15a1a0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fd9fc0c9280 tx=0x7fd9f002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9d174cd455365a3 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:08.228 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.220+0000 7fd9f959a640 1 -- 172.21.15.88:0/837409832 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9f0037070 con 0x7fd9fc0ca5a0 2024-04-26T23:41:08.228 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.220+0000 7fd9f959a640 1 -- 172.21.15.88:0/837409832 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9f0032440 con 0x7fd9fc0ca5a0 2024-04-26T23:41:08.228 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.220+0000 7fd9f959a640 1 -- 172.21.15.88:0/837409832 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9f0032810 con 0x7fd9fc0ca5a0 2024-04-26T23:41:08.228 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.221+0000 7fda00914640 1 -- 172.21.15.88:0/837409832 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd9fc0ca5a0 msgr2=0x7fd9fc15a1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:08.229 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.221+0000 7fda00914640 1 --2- 172.21.15.88:0/837409832 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd9fc0ca5a0 0x7fd9fc15a1a0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fd9fc0c9280 tx=0x7fd9f002a270 comp rx=0 tx=0).stop 2024-04-26T23:41:08.229 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.221+0000 7fda00914640 1 -- 172.21.15.88:0/837409832 shutdown_connections 2024-04-26T23:41:08.229 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.221+0000 7fda00914640 1 --2- 172.21.15.88:0/837409832 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd9fc0ca5a0 0x7fd9fc15a1a0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:08.229 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.221+0000 7fda00914640 1 --2- 172.21.15.88:0/837409832 >> v2:172.21.15.175:3300/0 conn(0x7fd9fc154160 0x7fd9fc156bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:08.229 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.221+0000 7fda00914640 1 -- 172.21.15.88:0/837409832 >> 172.21.15.88:0/837409832 conn(0x7fd9fc0ae010 msgr2=0x7fd9fc0ae3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:08.229 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.221+0000 7fda00914640 1 -- 172.21.15.88:0/837409832 shutdown_connections 2024-04-26T23:41:08.229 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.221+0000 7fda00914640 1 -- 172.21.15.88:0/837409832 wait complete. 2024-04-26T23:41:08.229 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.222+0000 7fda00914640 1 Processor -- start 2024-04-26T23:41:08.229 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.222+0000 7fda00914640 1 -- start start 2024-04-26T23:41:08.229 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.223+0000 7fda00914640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd9fc0c6e00 0x7fd9fc0c5f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:08.229 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.223+0000 7fda00914640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd9fc0ca5a0 0x7fd9fc0c5520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:08.229 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.223+0000 7fda00914640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd9fc154160 0x7fd9fc0bffb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:08.229 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.223+0000 7fda00914640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fd9fc15aed0 con 0x7fd9fc154160 2024-04-26T23:41:08.229 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.223+0000 7fda00914640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fd9fc15abf0 con 0x7fd9fc0ca5a0 2024-04-26T23:41:08.229 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.223+0000 7fda00914640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fd9fc0c9ca0 con 0x7fd9fc0c6e00 2024-04-26T23:41:08.230 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.223+0000 7fd9fad9d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd9fc154160 0x7fd9fc0bffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:08.230 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.223+0000 7fd9fad9d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd9fc154160 0x7fd9fc0bffb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:48878/0 (socket says 172.21.15.88:48878) 2024-04-26T23:41:08.230 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.223+0000 7fd9fad9d640 1 -- 172.21.15.88:0/2924003913 learned_addr learned my addr 172.21.15.88:0/2924003913 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:41:08.230 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.223+0000 7fd9f9d9b640 1 --2- 172.21.15.88:0/2924003913 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd9fc0ca5a0 0x7fd9fc0c5520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:08.230 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.223+0000 7fd9fa59c640 1 --2- 172.21.15.88:0/2924003913 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd9fc0c6e00 0x7fd9fc0c5f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:08.230 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.223+0000 7fd9fad9d640 1 -- 172.21.15.88:0/2924003913 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd9fc0c6e00 msgr2=0x7fd9fc0c5f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:08.230 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.223+0000 7fd9fad9d640 1 --2- 172.21.15.88:0/2924003913 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd9fc0c6e00 0x7fd9fc0c5f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:08.230 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.223+0000 7fd9fad9d640 1 -- 172.21.15.88:0/2924003913 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd9fc0ca5a0 msgr2=0x7fd9fc0c5520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:08.230 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.223+0000 7fd9fad9d640 1 --2- 172.21.15.88:0/2924003913 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd9fc0ca5a0 0x7fd9fc0c5520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:08.230 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.223+0000 7fd9fad9d640 1 -- 172.21.15.88:0/2924003913 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9fc0c64a0 con 0x7fd9fc154160 2024-04-26T23:41:08.230 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.223+0000 7fd9f9d9b640 1 --2- 172.21.15.88:0/2924003913 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd9fc0ca5a0 0x7fd9fc0c5520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:41:08.230 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.223+0000 7fd9fad9d640 1 --2- 172.21.15.88:0/2924003913 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd9fc154160 0x7fd9fc0bffb0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fd9f400c780 tx=0x7fd9f400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:08.230 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.223+0000 7fd9eaffd640 1 -- 172.21.15.88:0/2924003913 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9f4017070 con 0x7fd9fc154160 2024-04-26T23:41:08.230 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.223+0000 7fd9eaffd640 1 -- 172.21.15.88:0/2924003913 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9f400a640 con 0x7fd9fc154160 2024-04-26T23:41:08.231 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.224+0000 7fda00914640 1 -- 172.21.15.88:0/2924003913 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9fc1efac0 con 0x7fd9fc154160 2024-04-26T23:41:08.231 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.224+0000 7fd9eaffd640 1 -- 172.21.15.88:0/2924003913 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9f400aa30 con 0x7fd9fc154160 2024-04-26T23:41:08.231 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.224+0000 7fda00914640 1 -- 172.21.15.88:0/2924003913 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9fc1f0080 con 0x7fd9fc154160 2024-04-26T23:41:08.231 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.225+0000 7fda00914640 1 -- 172.21.15.88:0/2924003913 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd9fc076650 con 0x7fd9fc154160 2024-04-26T23:41:08.231 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.225+0000 7fd9eaffd640 1 -- 172.21.15.88:0/2924003913 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd9f401a070 con 0x7fd9fc154160 2024-04-26T23:41:08.232 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.225+0000 7fd9eaffd640 1 --2- 172.21.15.88:0/2924003913 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fd9dc06c8f0 0x7fd9dc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:08.232 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.225+0000 7fd9eaffd640 1 -- 172.21.15.88:0/2924003913 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7fd9f408b310 con 0x7fd9fc154160 2024-04-26T23:41:08.232 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.225+0000 7fd9fa59c640 1 --2- 172.21.15.88:0/2924003913 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fd9dc06c8f0 0x7fd9dc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:08.232 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.226+0000 7fd9fa59c640 1 --2- 172.21.15.88:0/2924003913 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fd9dc06c8f0 0x7fd9dc06edb0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fd9ec006fd0 tx=0x7fd9ec008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:08.232 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.230+0000 7fd9eaffd640 1 -- 172.21.15.88:0/2924003913 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fd9fc0c8df0 con 0x7fd9fc154160 2024-04-26T23:41:08.295 DEBUG:teuthology.orchestra.run.smithi088:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout bc612ffb9c1d5bc27536bc917a705262a36d4387 2024-04-26T23:41:08.296 DEBUG:teuthology.orchestra.run.smithi175:> rm -rf /home/ubuntu/cephtest/clone.client.1 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.1 && cd /home/ubuntu/cephtest/clone.client.1 && git checkout bc612ffb9c1d5bc27536bc917a705262a36d4387 2024-04-26T23:41:08.311 INFO:tasks.workunit.client.0.smithi088.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-04-26T23:41:08.353 INFO:tasks.workunit.client.1.smithi175.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.1'... 2024-04-26T23:41:08.449 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.446+0000 7fda00914640 1 -- 172.21.15.88:0/2924003913 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd9fc0ca380 con 0x7fd9fc154160 2024-04-26T23:41:08.450 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.447+0000 7fd9eaffd640 1 -- 172.21.15.88:0/2924003913 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+6488 (secure 0 0 0) 0x7fd9f4058e50 con 0x7fd9fc154160 2024-04-26T23:41:08.450 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-26T23:41:08.450 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":12,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6834/3199540397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":3199540397},{"type":"v1","addr":"172.21.15.175:6834","nonce":3199540397}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4270,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6837/2790134952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6835","nonce":2790134952},{"type":"v1","addr":"172.21.15.88:6837","nonce":2790134952}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T23:40:31.909505+0000","modified":"2024-04-26T23:40:34.974455+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4279},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4279":{"gid":4279,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.175:6835/3932058274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6833","nonce":3932058274},{"type":"v1","addr":"172.21.15.175:6835","nonce":3932058274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4279,"qdb_cluster":[4279]},"id":1},{"mdsmap":{"epoch":12,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T23:40:41.008364+0000","modified":"2024-04-26T23:40:44.027288+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4272":{"gid":4272,"name":"c","rank":0,"incarnation":9,"state":"up:active","state_seq":6,"addr":"172.21.15.88:6836/4159390276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6834","nonce":4159390276},{"type":"v1","addr":"172.21.15.88:6836","nonce":4159390276}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4272,"qdb_cluster":[4272]},"id":2}]} 2024-04-26T23:41:08.450 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 12 2024-04-26T23:41:08.452 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.448+0000 7fda00914640 1 -- 172.21.15.88:0/2924003913 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fd9dc06c8f0 msgr2=0x7fd9dc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:08.452 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.448+0000 7fda00914640 1 --2- 172.21.15.88:0/2924003913 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fd9dc06c8f0 0x7fd9dc06edb0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fd9ec006fd0 tx=0x7fd9ec008040 comp rx=0 tx=0).stop 2024-04-26T23:41:08.452 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.448+0000 7fda00914640 1 -- 172.21.15.88:0/2924003913 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd9fc154160 msgr2=0x7fd9fc0bffb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:08.452 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.448+0000 7fda00914640 1 --2- 172.21.15.88:0/2924003913 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd9fc154160 0x7fd9fc0bffb0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fd9f400c780 tx=0x7fd9f400cc40 comp rx=0 tx=0).stop 2024-04-26T23:41:08.452 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.448+0000 7fda00914640 1 -- 172.21.15.88:0/2924003913 shutdown_connections 2024-04-26T23:41:08.452 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.448+0000 7fda00914640 1 --2- 172.21.15.88:0/2924003913 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fd9dc06c8f0 0x7fd9dc06edb0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:08.452 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.448+0000 7fda00914640 1 --2- 172.21.15.88:0/2924003913 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd9fc154160 0x7fd9fc0bffb0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:08.452 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.448+0000 7fda00914640 1 --2- 172.21.15.88:0/2924003913 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd9fc0ca5a0 0x7fd9fc0c5520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:08.452 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.448+0000 7fda00914640 1 --2- 172.21.15.88:0/2924003913 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd9fc0c6e00 0x7fd9fc0c5f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:08.452 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.449+0000 7fda00914640 1 -- 172.21.15.88:0/2924003913 >> 172.21.15.88:0/2924003913 conn(0x7fd9fc0ae010 msgr2=0x7fd9fc068170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:08.452 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.449+0000 7fda00914640 1 -- 172.21.15.88:0/2924003913 shutdown_connections 2024-04-26T23:41:08.452 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.449+0000 7fda00914640 1 -- 172.21.15.88:0/2924003913 wait complete. 2024-04-26T23:41:08.462 INFO:tasks.mon_thrash.mon_thrasher:start thrashing 2024-04-26T23:41:08.462 INFO:tasks.mon_thrash.mon_thrasher:seed: 1714174866, revive delay: 20.0, thrash delay: 10.0 thrash many: False, maintain quorum: True store thrash: False, probability: 50 freeze mon: prob 10.0 duration 15.0 2024-04-26T23:41:08.463 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-04-26T23:41:08.463 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-04-26T23:41:08.601 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.598+0000 7fdcca6e3640 1 Processor -- start 2024-04-26T23:41:08.601 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.598+0000 7fdcca6e3640 1 -- start start 2024-04-26T23:41:08.604 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.599+0000 7fdcca6e3640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fdcc40ca5a0 0x7fdcc4156bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:08.604 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.599+0000 7fdcca6e3640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdcc40c8df0 con 0x7fdcc415a1a0 2024-04-26T23:41:08.604 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.599+0000 7fdcca6e3640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdcc4154540 con 0x7fdcc4154160 2024-04-26T23:41:08.604 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.599+0000 7fdcca6e3640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7fdcc40c9100 con 0x7fdcc40ca5a0 2024-04-26T23:41:08.605 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.599+0000 7fdcc8c80640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fdcc415a1a0 0x7fdcc40c9590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:39852/0 (socket says 172.21.15.88:39852) 2024-04-26T23:41:08.605 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.599+0000 7fdcc8c80640 1 -- 172.21.15.88:0/58597041 learned_addr learned my addr 172.21.15.88:0/58597041 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-26T23:41:08.605 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.599+0000 7fdcc37fe640 1 --2- 172.21.15.88:0/58597041 >> v2:172.21.15.175:3300/0 conn(0x7fdcc40ca5a0 0x7fdcc4156bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:08.605 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.599+0000 7fdcc2ffd640 1 -- 172.21.15.88:0/58597041 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2046246219 0 0) 0x7fdcbc001490 con 0x7fdcc415a1a0 2024-04-26T23:41:08.605 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.599+0000 7fdcc2ffd640 1 -- 172.21.15.88:0/58597041 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdcb0003520 con 0x7fdcc415a1a0 2024-04-26T23:41:08.605 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.599+0000 7fdcc2ffd640 1 -- 172.21.15.88:0/58597041 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3308959244 0 0) 0x7fdcb0003520 con 0x7fdcc415a1a0 2024-04-26T23:41:08.605 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.599+0000 7fdcc2ffd640 1 -- 172.21.15.88:0/58597041 >> v2:172.21.15.175:3300/0 conn(0x7fdcc40ca5a0 msgr2=0x7fdcc4156bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:41:08.605 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.599+0000 7fdcc2ffd640 1 --2- 172.21.15.88:0/58597041 >> v2:172.21.15.175:3300/0 conn(0x7fdcc40ca5a0 0x7fdcc4156bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:08.605 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.599+0000 7fdcc2ffd640 1 -- 172.21.15.88:0/58597041 >> v1:172.21.15.175:6789/0 conn(0x7fdcc4154160 legacy=0x7fdcc40c6e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:08.605 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.599+0000 7fdcc2ffd640 1 -- 172.21.15.88:0/58597041 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdcc415a910 con 0x7fdcc415a1a0 2024-04-26T23:41:08.605 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.599+0000 7fdcc2ffd640 1 -- 172.21.15.88:0/58597041 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 356324787 0 0) 0x7fdcbc001bc0 con 0x7fdcc415a1a0 2024-04-26T23:41:08.605 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.599+0000 7fdcc2ffd640 1 -- 172.21.15.88:0/58597041 >> v1:172.21.15.88:6789/0 conn(0x7fdcc415a1a0 legacy=0x7fdcc40c9590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:08.605 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.599+0000 7fdcc2ffd640 1 --2- 172.21.15.88:0/58597041 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdcb00039b0 0x7fdcb0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:08.605 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.599+0000 7fdcc2ffd640 1 --2- 172.21.15.88:0/58597041 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdcb0004800 0x7fdcb0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:08.605 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.600+0000 7fdcc2ffd640 1 --2- 172.21.15.88:0/58597041 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdcb00051c0 0x7fdcb000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:08.605 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.600+0000 7fdcc2ffd640 1 -- 172.21.15.88:0/58597041 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fdcc40c9100 con 0x7fdcb00051c0 2024-04-26T23:41:08.606 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.600+0000 7fdcc2ffd640 1 -- 172.21.15.88:0/58597041 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fdcb000c060 con 0x7fdcb00039b0 2024-04-26T23:41:08.606 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.600+0000 7fdcc2ffd640 1 -- 172.21.15.88:0/58597041 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fdcb000c260 con 0x7fdcb0004800 2024-04-26T23:41:08.606 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.600+0000 7fdcc8c80640 1 --2- 172.21.15.88:0/58597041 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdcb00051c0 0x7fdcb000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:08.606 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.600+0000 7fdcc3fff640 1 --2- 172.21.15.88:0/58597041 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdcb00039b0 0x7fdcb0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:08.606 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.600+0000 7fdcc37fe640 1 --2- 172.21.15.88:0/58597041 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdcb0004800 0x7fdcb0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:08.606 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.600+0000 7fdcc8c80640 1 -- 172.21.15.88:0/58597041 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdcb0004800 msgr2=0x7fdcb0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:41:08.606 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.600+0000 7fdcc8c80640 1 --2- 172.21.15.88:0/58597041 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdcb0004800 0x7fdcb0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:08.606 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.600+0000 7fdcc8c80640 1 -- 172.21.15.88:0/58597041 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdcb00039b0 msgr2=0x7fdcb0003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:41:08.606 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.600+0000 7fdcc8c80640 1 --2- 172.21.15.88:0/58597041 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdcb00039b0 0x7fdcb0003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:08.606 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.600+0000 7fdcc8c80640 1 -- 172.21.15.88:0/58597041 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdcb0003520 con 0x7fdcb00051c0 2024-04-26T23:41:08.606 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.600+0000 7fdcc8c80640 1 -- 172.21.15.88:0/58597041 reap_dead start 2024-04-26T23:41:08.606 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.601+0000 7fdcc8c80640 1 --2- 172.21.15.88:0/58597041 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdcb00051c0 0x7fdcb000b9c0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fdcbc00aa20 tx=0x7fdcb0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91923e0dea097ae9 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:08.606 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.601+0000 7fdcc2ffd640 1 -- 172.21.15.88:0/58597041 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcbc00a640 con 0x7fdcb00051c0 2024-04-26T23:41:08.606 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.601+0000 7fdcc2ffd640 1 -- 172.21.15.88:0/58597041 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdcbc02f070 con 0x7fdcb00051c0 2024-04-26T23:41:08.607 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.601+0000 7fdcc2ffd640 1 -- 172.21.15.88:0/58597041 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcbc034470 con 0x7fdcb00051c0 2024-04-26T23:41:08.607 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.601+0000 7fdcca6e3640 1 -- 172.21.15.88:0/58597041 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdcb00051c0 msgr2=0x7fdcb000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:08.607 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.601+0000 7fdcca6e3640 1 --2- 172.21.15.88:0/58597041 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdcb00051c0 0x7fdcb000b9c0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fdcbc00aa20 tx=0x7fdcb0005830 comp rx=0 tx=0).stop 2024-04-26T23:41:08.607 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.601+0000 7fdcca6e3640 1 -- 172.21.15.88:0/58597041 shutdown_connections 2024-04-26T23:41:08.607 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.601+0000 7fdcca6e3640 1 --2- 172.21.15.88:0/58597041 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdcb00051c0 0x7fdcb000b9c0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:08.607 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.601+0000 7fdcca6e3640 1 -- 172.21.15.88:0/58597041 >> 172.21.15.88:0/58597041 conn(0x7fdcc40ae010 msgr2=0x7fdcc40ae3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:08.607 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.601+0000 7fdcca6e3640 1 -- 172.21.15.88:0/58597041 shutdown_connections 2024-04-26T23:41:08.607 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.601+0000 7fdcca6e3640 1 -- 172.21.15.88:0/58597041 wait complete. 2024-04-26T23:41:08.610 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.602+0000 7fdcca6e3640 1 Processor -- start 2024-04-26T23:41:08.610 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.603+0000 7fdcca6e3640 1 -- start start 2024-04-26T23:41:08.610 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.603+0000 7fdcca6e3640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdcb00051c0 0x7fdcc41f0890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:08.610 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.603+0000 7fdcca6e3640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdcc4151b90 0x7fdcc414f910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:08.610 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.603+0000 7fdcca6e3640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdcc4149a80 0x7fdcc41ec7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:08.610 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.603+0000 7fdcca6e3640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fdcc415a5b0 con 0x7fdcc4151b90 2024-04-26T23:41:08.610 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.603+0000 7fdcca6e3640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fdcc415aed0 con 0x7fdcb00051c0 2024-04-26T23:41:08.610 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.603+0000 7fdcca6e3640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fdcc4156bb0 con 0x7fdcc4149a80 2024-04-26T23:41:08.610 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.603+0000 7fdcc37fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdcc4151b90 0x7fdcc414f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:08.611 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.603+0000 7fdcc37fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdcc4151b90 0x7fdcc414f910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:34440/0 (socket says 172.21.15.88:34440) 2024-04-26T23:41:08.611 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.603+0000 7fdcc37fe640 1 -- 172.21.15.88:0/2567008087 learned_addr learned my addr 172.21.15.88:0/2567008087 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:41:08.611 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.603+0000 7fdcc8c80640 1 --2- 172.21.15.88:0/2567008087 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdcc4149a80 0x7fdcc41ec7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:08.611 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.603+0000 7fdcc3fff640 1 --2- 172.21.15.88:0/2567008087 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdcb00051c0 0x7fdcc41f0890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:08.611 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.604+0000 7fdcc37fe640 1 -- 172.21.15.88:0/2567008087 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdcc4149a80 msgr2=0x7fdcc41ec7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:08.611 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.604+0000 7fdcc37fe640 1 --2- 172.21.15.88:0/2567008087 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdcc4149a80 0x7fdcc41ec7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:08.611 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.604+0000 7fdcc37fe640 1 -- 172.21.15.88:0/2567008087 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdcb00051c0 msgr2=0x7fdcc41f0890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:08.611 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.604+0000 7fdcc37fe640 1 --2- 172.21.15.88:0/2567008087 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdcb00051c0 0x7fdcc41f0890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:08.611 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.604+0000 7fdcc37fe640 1 -- 172.21.15.88:0/2567008087 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdcc4152100 con 0x7fdcc4151b90 2024-04-26T23:41:08.611 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.604+0000 7fdcc3fff640 1 --2- 172.21.15.88:0/2567008087 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdcb00051c0 0x7fdcc41f0890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:41:08.611 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.604+0000 7fdcc37fe640 1 --2- 172.21.15.88:0/2567008087 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdcc4151b90 0x7fdcc414f910 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fdcb40118e0 tx=0x7fdcb4011da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:08.611 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.604+0000 7fdcc0ff9640 1 -- 172.21.15.88:0/2567008087 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcb400fa90 con 0x7fdcc4151b90 2024-04-26T23:41:08.611 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.604+0000 7fdcc0ff9640 1 -- 172.21.15.88:0/2567008087 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdcb400fc30 con 0x7fdcc4151b90 2024-04-26T23:41:08.611 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.604+0000 7fdcca6e3640 1 -- 172.21.15.88:0/2567008087 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdcc41523e0 con 0x7fdcc4151b90 2024-04-26T23:41:08.611 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.604+0000 7fdcc0ff9640 1 -- 172.21.15.88:0/2567008087 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcb4014440 con 0x7fdcc4151b90 2024-04-26T23:41:08.612 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.604+0000 7fdcca6e3640 1 -- 172.21.15.88:0/2567008087 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdcc41f0090 con 0x7fdcc4151b90 2024-04-26T23:41:08.612 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.605+0000 7fdcca6e3640 1 -- 172.21.15.88:0/2567008087 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdcc4076650 con 0x7fdcc4151b90 2024-04-26T23:41:08.612 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.605+0000 7fdcc0ff9640 1 -- 172.21.15.88:0/2567008087 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fdcb4012040 con 0x7fdcc4151b90 2024-04-26T23:41:08.612 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.606+0000 7fdcc0ff9640 1 --2- 172.21.15.88:0/2567008087 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fdca406c920 0x7fdca406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:08.612 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.606+0000 7fdcc0ff9640 1 -- 172.21.15.88:0/2567008087 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7fdcb408c3d0 con 0x7fdcc4151b90 2024-04-26T23:41:08.612 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.606+0000 7fdcc3fff640 1 --2- 172.21.15.88:0/2567008087 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fdca406c920 0x7fdca406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:08.612 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.606+0000 7fdcc3fff640 1 --2- 172.21.15.88:0/2567008087 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fdca406c920 0x7fdca406ede0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fdcc4154710 tx=0x7fdcac009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:08.613 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.610+0000 7fdcc0ff9640 1 -- 172.21.15.88:0/2567008087 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fdcb4019030 con 0x7fdcc4151b90 2024-04-26T23:41:08.873 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.870+0000 7fdcca6e3640 1 -- 172.21.15.88:0/2567008087 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fdcc40507a0 con 0x7fdcc4151b90 2024-04-26T23:41:08.874 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.871+0000 7fdcc0ff9640 1 -- 172.21.15.88:0/2567008087 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1564 (secure 0 0 0) 0x7fdcb405a560 con 0x7fdcc4151b90 2024-04-26T23:41:08.874 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":61,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"555255e9-7ef9-4454-8dc9-35e96b70035c","modified":"2024-04-26T23:39:34.291658Z","created":"2024-04-26T23:39:34.291658Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:3300","nonce":0},{"type":"v1","addr":"172.21.15.175:6789","nonce":0}]},"addr":"172.21.15.175:6789/0","public_addr":"172.21.15.175:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:3301","nonce":0},{"type":"v1","addr":"172.21.15.175:6790","nonce":0}]},"addr":"172.21.15.175:6790/0","public_addr":"172.21.15.175:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-04-26T23:41:08.876 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.873+0000 7fdcca6e3640 1 -- 172.21.15.88:0/2567008087 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fdca406c920 msgr2=0x7fdca406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:08.876 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.873+0000 7fdcca6e3640 1 --2- 172.21.15.88:0/2567008087 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fdca406c920 0x7fdca406ede0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fdcc4154710 tx=0x7fdcac009040 comp rx=0 tx=0).stop 2024-04-26T23:41:08.876 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.873+0000 7fdcca6e3640 1 -- 172.21.15.88:0/2567008087 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdcc4151b90 msgr2=0x7fdcc414f910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:08.876 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.873+0000 7fdcca6e3640 1 --2- 172.21.15.88:0/2567008087 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdcc4151b90 0x7fdcc414f910 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fdcb40118e0 tx=0x7fdcb4011da0 comp rx=0 tx=0).stop 2024-04-26T23:41:08.876 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.873+0000 7fdcca6e3640 1 -- 172.21.15.88:0/2567008087 shutdown_connections 2024-04-26T23:41:08.876 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.873+0000 7fdcca6e3640 1 --2- 172.21.15.88:0/2567008087 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fdca406c920 0x7fdca406ede0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:08.876 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.873+0000 7fdcca6e3640 1 --2- 172.21.15.88:0/2567008087 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdcc4149a80 0x7fdcc41ec7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:08.876 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.873+0000 7fdcca6e3640 1 --2- 172.21.15.88:0/2567008087 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdcc4151b90 0x7fdcc414f910 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:08.876 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.873+0000 7fdcca6e3640 1 --2- 172.21.15.88:0/2567008087 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdcb00051c0 0x7fdcc41f0890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:08.876 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.873+0000 7fdcca6e3640 1 -- 172.21.15.88:0/2567008087 >> 172.21.15.88:0/2567008087 conn(0x7fdcc40ae010 msgr2=0x7fdcc414c700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:08.876 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.873+0000 7fdcca6e3640 1 -- 172.21.15.88:0/2567008087 shutdown_connections 2024-04-26T23:41:08.877 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.873+0000 7fdcca6e3640 1 -- 172.21.15.88:0/2567008087 wait complete. 2024-04-26T23:41:08.887 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-04-26T23:41:08.887 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2024-04-26T23:41:08.887 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-04-26T23:41:08.887 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-04-26T23:41:08.985 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.983+0000 7f331e615640 1 Processor -- start 2024-04-26T23:41:08.985 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.983+0000 7f331e615640 1 -- start start 2024-04-26T23:41:08.987 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.983+0000 7f331e615640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f331813ffb0 0x7f33180c3b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:08.987 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.983+0000 7f331e615640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f3318073700 0x7f3318073bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:08.987 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.983+0000 7f331e615640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f33181579d0 con 0x7f3318074c10 2024-04-26T23:41:08.987 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.983+0000 7f331e615640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f3318070880 con 0x7f3318073700 2024-04-26T23:41:08.988 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.983+0000 7f331e615640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f33180ab680 con 0x7f331813ffb0 2024-04-26T23:41:08.988 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.984+0000 7f331cbb2640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f3318073700 0x7f3318073bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:08.988 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.984+0000 7f331cbb2640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f3318073700 0x7f3318073bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:34442/0 (socket says 172.21.15.88:34442) 2024-04-26T23:41:08.988 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.984+0000 7f331cbb2640 1 -- 172.21.15.88:0/1465255520 learned_addr learned my addr 172.21.15.88:0/1465255520 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:41:08.988 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.984+0000 7f331cbb2640 1 -- 172.21.15.88:0/1465255520 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f331813ffb0 msgr2=0x7f33180c3b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:41:08.988 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.984+0000 7f3317fff640 1 --2- 172.21.15.88:0/1465255520 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f331813ffb0 0x7f33180c3b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:08.988 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.984+0000 7f331cbb2640 1 --2- 172.21.15.88:0/1465255520 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f331813ffb0 0x7f33180c3b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:08.988 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.984+0000 7f331cbb2640 1 -- 172.21.15.88:0/1465255520 >> v1:172.21.15.175:6789/0 conn(0x7f3318074c10 legacy=0x7f33180c40b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:41:08.988 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.984+0000 7f331cbb2640 1 -- 172.21.15.88:0/1465255520 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33180ab960 con 0x7f3318073700 2024-04-26T23:41:08.988 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.984+0000 7f331cbb2640 1 --2- 172.21.15.88:0/1465255520 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3318073700 0x7f3318073bb0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f3310009e50 tx=0x7f331002a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a197e1c16e931b4 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:08.988 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.985+0000 7f3316ffd640 1 -- 172.21.15.88:0/1465255520 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3310036070 con 0x7f3318073700 2024-04-26T23:41:08.988 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.985+0000 7f3316ffd640 1 -- 172.21.15.88:0/1465255520 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3310031600 con 0x7f3318073700 2024-04-26T23:41:08.988 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.985+0000 7f3316ffd640 1 -- 172.21.15.88:0/1465255520 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33100319d0 con 0x7f3318073700 2024-04-26T23:41:08.989 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.985+0000 7f331e615640 1 -- 172.21.15.88:0/1465255520 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3318073700 msgr2=0x7f3318073bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:08.990 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.985+0000 7f331e615640 1 --2- 172.21.15.88:0/1465255520 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3318073700 0x7f3318073bb0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f3310009e50 tx=0x7f331002a6c0 comp rx=0 tx=0).stop 2024-04-26T23:41:08.990 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.985+0000 7f331e615640 1 -- 172.21.15.88:0/1465255520 shutdown_connections 2024-04-26T23:41:08.990 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.985+0000 7f331e615640 1 --2- 172.21.15.88:0/1465255520 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3318073700 0x7f3318073bb0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:08.990 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.985+0000 7f331e615640 1 --2- 172.21.15.88:0/1465255520 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f331813ffb0 0x7f33180c3b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:08.990 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.985+0000 7f331e615640 1 -- 172.21.15.88:0/1465255520 >> 172.21.15.88:0/1465255520 conn(0x7f33180ca2f0 msgr2=0x7f33180ca6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:08.990 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.985+0000 7f331e615640 1 -- 172.21.15.88:0/1465255520 shutdown_connections 2024-04-26T23:41:08.990 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.985+0000 7f331e615640 1 -- 172.21.15.88:0/1465255520 wait complete. 2024-04-26T23:41:08.990 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.986+0000 7f331e615640 1 Processor -- start 2024-04-26T23:41:08.990 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.987+0000 7f331e615640 1 -- start start 2024-04-26T23:41:08.994 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.987+0000 7f331e615640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3318073700 0x7f331815a130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:08.994 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.987+0000 7f331e615640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3318074c10 0x7f331812e750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:08.994 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.987+0000 7f331e615640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f331813ffb0 0x7f331812ec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:08.994 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.987+0000 7f331e615640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f3318157660 con 0x7f3318074c10 2024-04-26T23:41:08.994 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.987+0000 7f331e615640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f3318140390 con 0x7f331813ffb0 2024-04-26T23:41:08.994 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.987+0000 7f331e615640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f33180740f0 con 0x7f3318073700 2024-04-26T23:41:08.994 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.987+0000 7f33177fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3318074c10 0x7f331812e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:08.994 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.987+0000 7f33177fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3318074c10 0x7f331812e750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:34446/0 (socket says 172.21.15.88:34446) 2024-04-26T23:41:08.994 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.987+0000 7f33177fe640 1 -- 172.21.15.88:0/3814876527 learned_addr learned my addr 172.21.15.88:0/3814876527 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:41:08.994 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.987+0000 7f3317fff640 1 --2- 172.21.15.88:0/3814876527 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3318073700 0x7f331815a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:08.994 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.987+0000 7f331cbb2640 1 --2- 172.21.15.88:0/3814876527 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f331813ffb0 0x7f331812ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:08.994 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.988+0000 7f33177fe640 1 -- 172.21.15.88:0/3814876527 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3318073700 msgr2=0x7f331815a130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:08.994 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.988+0000 7f33177fe640 1 --2- 172.21.15.88:0/3814876527 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3318073700 0x7f331815a130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:08.995 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.988+0000 7f33177fe640 1 -- 172.21.15.88:0/3814876527 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f331813ffb0 msgr2=0x7f331812ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:08.995 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.988+0000 7f33177fe640 1 --2- 172.21.15.88:0/3814876527 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f331813ffb0 0x7f331812ec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:08.995 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.988+0000 7f33177fe640 1 -- 172.21.15.88:0/3814876527 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33181ed460 con 0x7f3318074c10 2024-04-26T23:41:08.995 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.988+0000 7f331cbb2640 1 --2- 172.21.15.88:0/3814876527 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f331813ffb0 0x7f331812ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:41:08.995 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.988+0000 7f3317fff640 1 --2- 172.21.15.88:0/3814876527 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3318073700 0x7f331815a130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:41:08.995 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.988+0000 7f33177fe640 1 --2- 172.21.15.88:0/3814876527 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3318074c10 0x7f331812e750 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f330c00c400 tx=0x7f330c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:08.995 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.988+0000 7f3314ff9640 1 -- 172.21.15.88:0/3814876527 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f330c011790 con 0x7f3318074c10 2024-04-26T23:41:08.995 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.988+0000 7f3314ff9640 1 -- 172.21.15.88:0/3814876527 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f330c017070 con 0x7f3318074c10 2024-04-26T23:41:08.995 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.988+0000 7f3314ff9640 1 -- 172.21.15.88:0/3814876527 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f330c011bb0 con 0x7f3318074c10 2024-04-26T23:41:08.995 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.988+0000 7f331e615640 1 -- 172.21.15.88:0/3814876527 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33181ed740 con 0x7f3318074c10 2024-04-26T23:41:08.995 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.988+0000 7f331e615640 1 -- 172.21.15.88:0/3814876527 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3318158430 con 0x7f3318074c10 2024-04-26T23:41:08.995 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.989+0000 7f331e615640 1 --2- 172.21.15.88:0/3814876527 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f33181587a0 0x7f3318158c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:08.995 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.989+0000 7f331e615640 1 -- 172.21.15.88:0/3814876527 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f331806d690 con 0x7f33181587a0 2024-04-26T23:41:08.995 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.989+0000 7f3317fff640 1 --2- 172.21.15.88:0/3814876527 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f33181587a0 0x7f3318158c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:08.995 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.989+0000 7f3317fff640 1 -- 172.21.15.88:0/3814876527 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f331815b100 con 0x7f33181587a0 2024-04-26T23:41:08.996 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.989+0000 7f3317fff640 1 --2- 172.21.15.88:0/3814876527 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f33181587a0 0x7f3318158c10 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f330800e770 tx=0x7f330800ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:08.996 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.989+0000 7f3314ff9640 1 -- 172.21.15.88:0/3814876527 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3308019020 con 0x7f33181587a0 2024-04-26T23:41:08.996 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.989+0000 7f3314ff9640 1 -- 172.21.15.88:0/3814876527 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f330c01c460 con 0x7f3318074c10 2024-04-26T23:41:08.996 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.990+0000 7f3314ff9640 1 --2- 172.21.15.88:0/3814876527 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f330406c7f0 0x7f330406ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:08.996 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.990+0000 7f3314ff9640 1 -- 172.21.15.88:0/3814876527 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7f330c08bc70 con 0x7f3318074c10 2024-04-26T23:41:08.996 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.990+0000 7f331cbb2640 1 --2- 172.21.15.88:0/3814876527 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f330406c7f0 0x7f330406ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:08.996 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.990+0000 7f3314ff9640 1 -- 172.21.15.88:0/3814876527 <== mon.0 v2:172.21.15.88:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f330800a780 con 0x7f33181587a0 2024-04-26T23:41:08.996 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.990+0000 7f3314ff9640 1 -- 172.21.15.88:0/3814876527 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f33181587a0 msgr2=0x7f3318158c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:08.996 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.990+0000 7f3314ff9640 1 --2- 172.21.15.88:0/3814876527 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f33181587a0 0x7f3318158c10 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f330800e770 tx=0x7f330800ec30 comp rx=0 tx=0).stop 2024-04-26T23:41:08.996 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.990+0000 7f3314ff9640 1 -- 172.21.15.88:0/3814876527 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f33181587a0 msgr2=0x7f3318158c10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:41:08.996 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.990+0000 7f3314ff9640 1 --2- 172.21.15.88:0/3814876527 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f33181587a0 0x7f3318158c10 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:08.996 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.990+0000 7f331cbb2640 1 --2- 172.21.15.88:0/3814876527 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f330406c7f0 0x7f330406ecb0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f3310033000 tx=0x7f3310009000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:08.999 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.996+0000 7f331e615640 1 --2- 172.21.15.88:0/3814876527 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f331813d220 0x7f3318159150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:09.000 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.996+0000 7f331e615640 1 -- 172.21.15.88:0/3814876527 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f33180507a0 con 0x7f331813d220 2024-04-26T23:41:09.000 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.996+0000 7f3317fff640 1 --2- 172.21.15.88:0/3814876527 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f331813d220 0x7f3318159150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:09.000 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.997+0000 7f3317fff640 1 -- 172.21.15.88:0/3814876527 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f3318076650 con 0x7f331813d220 2024-04-26T23:41:09.000 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.997+0000 7f3317fff640 1 --2- 172.21.15.88:0/3814876527 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f331813d220 0x7f3318159150 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f330801a000 tx=0x7f3308004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:09.000 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.997+0000 7f3314ff9640 1 -- 172.21.15.88:0/3814876527 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3308026070 con 0x7f331813d220 2024-04-26T23:41:09.000 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.997+0000 7f3314ff9640 1 -- 172.21.15.88:0/3814876527 <== mon.0 v2:172.21.15.88:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5209 (secure 0 0 0) 0x7f330802a410 con 0x7f331813d220 2024-04-26T23:41:09.001 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.997+0000 7f3314ff9640 1 -- 172.21.15.88:0/3814876527 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f331813d220 msgr2=0x7f3318159150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:09.001 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.997+0000 7f3314ff9640 1 --2- 172.21.15.88:0/3814876527 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f331813d220 0x7f3318159150 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f330801a000 tx=0x7f3308004730 comp rx=0 tx=0).stop 2024-04-26T23:41:09.001 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.997+0000 7f3314ff9640 1 -- 172.21.15.88:0/3814876527 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f331813d220 msgr2=0x7f3318159150 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:41:09.001 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.997+0000 7f3314ff9640 1 --2- 172.21.15.88:0/3814876527 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f331813d220 0x7f3318159150 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:09.001 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-04-26T23:41:09.001 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2024-04-26T23:41:09.001 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2024-04-26T23:41:09.001 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "leader", 2024-04-26T23:41:09.001 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 4, 2024-04-26T23:41:09.001 INFO:teuthology.orchestra.run.smithi088.stdout: "uptime": 61378, 2024-04-26T23:41:09.001 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2024-04-26T23:41:09.001 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2024-04-26T23:41:09.001 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2024-04-26T23:41:09.002 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2024-04-26T23:41:09.002 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:41:09.002 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 61, 2024-04-26T23:41:09.002 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2024-04-26T23:41:09.002 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2450521708007866372", 2024-04-26T23:41:09.002 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2024-04-26T23:41:09.002 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-04-26T23:41:09.002 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-04-26T23:41:09.002 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-04-26T23:41:09.002 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-04-26T23:41:09.002 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-04-26T23:41:09.002 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-04-26T23:41:09.002 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-04-26T23:41:09.002 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-04-26T23:41:09.003 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-04-26T23:41:09.003 INFO:teuthology.orchestra.run.smithi088.stdout: "reef", 2024-04-26T23:41:09.003 INFO:teuthology.orchestra.run.smithi088.stdout: "squid" 2024-04-26T23:41:09.003 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:41:09.003 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540701547738038271", 2024-04-26T23:41:09.003 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2024-04-26T23:41:09.003 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-04-26T23:41:09.003 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-04-26T23:41:09.003 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-04-26T23:41:09.003 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-04-26T23:41:09.003 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-04-26T23:41:09.003 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-04-26T23:41:09.003 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-04-26T23:41:09.003 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-04-26T23:41:09.003 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-04-26T23:41:09.003 INFO:teuthology.orchestra.run.smithi088.stdout: "reef", 2024-04-26T23:41:09.004 INFO:teuthology.orchestra.run.smithi088.stdout: "squid" 2024-04-26T23:41:09.004 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:41:09.004 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:41:09.004 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2024-04-26T23:41:09.004 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2024-04-26T23:41:09.004 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2024-04-26T23:41:09.004 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2024-04-26T23:41:09.004 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2024-04-26T23:41:09.004 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "555255e9-7ef9-4454-8dc9-35e96b70035c", 2024-04-26T23:41:09.004 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2024-04-26T23:39:34.291658Z", 2024-04-26T23:41:09.004 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2024-04-26T23:39:34.291658Z", 2024-04-26T23:41:09.004 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 19, 2024-04-26T23:41:09.004 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "squid", 2024-04-26T23:41:09.004 INFO:teuthology.orchestra.run.smithi088.stdout: "election_strategy": 1, 2024-04-26T23:41:09.004 INFO:teuthology.orchestra.run.smithi088.stdout: "disallowed_leaders: ": "", 2024-04-26T23:41:09.004 INFO:teuthology.orchestra.run.smithi088.stdout: "stretch_mode": false, 2024-04-26T23:41:09.005 INFO:teuthology.orchestra.run.smithi088.stdout: "tiebreaker_mon": "", 2024-04-26T23:41:09.005 INFO:teuthology.orchestra.run.smithi088.stdout: "removed_ranks: ": "", 2024-04-26T23:41:09.005 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2024-04-26T23:41:09.005 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2024-04-26T23:41:09.005 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-04-26T23:41:09.005 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-04-26T23:41:09.005 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-04-26T23:41:09.005 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-04-26T23:41:09.005 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-04-26T23:41:09.005 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-04-26T23:41:09.005 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-04-26T23:41:09.005 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-04-26T23:41:09.005 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-04-26T23:41:09.005 INFO:teuthology.orchestra.run.smithi088.stdout: "reef", 2024-04-26T23:41:09.005 INFO:teuthology.orchestra.run.smithi088.stdout: "squid" 2024-04-26T23:41:09.005 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:41:09.006 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2024-04-26T23:41:09.006 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:41:09.006 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2024-04-26T23:41:09.006 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:41:09.006 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2024-04-26T23:41:09.006 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2024-04-26T23:41:09.006 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-04-26T23:41:09.006 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-04-26T23:41:09.006 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:41:09.006 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-04-26T23:41:09.006 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2024-04-26T23:41:09.006 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:41:09.006 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:41:09.006 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:41:09.006 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-04-26T23:41:09.007 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2024-04-26T23:41:09.007 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:41:09.007 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:41:09.007 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:41:09.007 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:41:09.007 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2024-04-26T23:41:09.007 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2024-04-26T23:41:09.007 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-04-26T23:41:09.007 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-04-26T23:41:09.007 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-04-26T23:41:09.007 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:41:09.007 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:41:09.007 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2024-04-26T23:41:09.007 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2024-04-26T23:41:09.007 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-04-26T23:41:09.007 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-04-26T23:41:09.007 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:41:09.008 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-04-26T23:41:09.008 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:3300", 2024-04-26T23:41:09.008 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:41:09.008 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:41:09.008 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:41:09.008 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-04-26T23:41:09.008 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6789", 2024-04-26T23:41:09.008 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:41:09.008 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:41:09.008 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:41:09.008 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:41:09.008 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6789/0", 2024-04-26T23:41:09.008 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.175:6789/0", 2024-04-26T23:41:09.008 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-04-26T23:41:09.008 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-04-26T23:41:09.008 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-04-26T23:41:09.009 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:41:09.009 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:41:09.009 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2024-04-26T23:41:09.009 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2024-04-26T23:41:09.009 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-04-26T23:41:09.009 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-04-26T23:41:09.009 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:41:09.009 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-04-26T23:41:09.009 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:3301", 2024-04-26T23:41:09.009 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:41:09.009 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:41:09.009 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:41:09.009 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-04-26T23:41:09.009 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6790", 2024-04-26T23:41:09.009 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:41:09.009 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:41:09.010 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:41:09.010 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:41:09.010 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6790/0", 2024-04-26T23:41:09.010 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.175:6790/0", 2024-04-26T23:41:09.010 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-04-26T23:41:09.010 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-04-26T23:41:09.010 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-04-26T23:41:09.010 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:41:09.010 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:41:09.010 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:41:09.010 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2024-04-26T23:41:09.010 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2024-04-26T23:41:09.010 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:41:09.010 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:41:09.010 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:41:09.011 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2024-04-26T23:41:09.011 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:41:09.011 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:41:09.011 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": [ 2024-04-26T23:41:09.011 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:41:09.011 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:41:09.011 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:41:09.011 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2024-04-26T23:41:09.011 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:41:09.011 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:41:09.011 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": [ 2024-04-26T23:41:09.011 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:41:09.011 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:41:09.011 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:41:09.011 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 4 2024-04-26T23:41:09.011 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:41:09.012 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:41:09.012 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2024-04-26T23:41:09.012 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:41:09.012 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x2f018fb87aa4aafe", 2024-04-26T23:41:09.012 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:41:09.012 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2024-04-26T23:41:09.012 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:41:09.012 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:41:09.012 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:41:09.012 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:41:09.012 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 6 2024-04-26T23:41:09.012 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:41:09.012 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:41:09.012 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": [ 2024-04-26T23:41:09.012 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:41:09.012 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:41:09.013 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:41:09.013 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2024-04-26T23:41:09.013 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:41:09.013 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:41:09.013 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:41:09.013 INFO:teuthology.orchestra.run.smithi088.stdout: "stretch_mode": false 2024-04-26T23:41:09.013 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-04-26T23:41:09.014 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.997+0000 7f331e615640 1 -- 172.21.15.88:0/3814876527 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f330406c7f0 msgr2=0x7f330406ecb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:09.014 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.998+0000 7f331e615640 1 --2- 172.21.15.88:0/3814876527 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f330406c7f0 0x7f330406ecb0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f3310033000 tx=0x7f3310009000 comp rx=0 tx=0).stop 2024-04-26T23:41:09.014 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.998+0000 7f331e615640 1 -- 172.21.15.88:0/3814876527 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3318074c10 msgr2=0x7f331812e750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:09.014 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.998+0000 7f331e615640 1 --2- 172.21.15.88:0/3814876527 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3318074c10 0x7f331812e750 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f330c00c400 tx=0x7f330c00c8c0 comp rx=0 tx=0).stop 2024-04-26T23:41:09.015 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.998+0000 7f331cbb2640 1 -- 172.21.15.88:0/3814876527 reap_dead start 2024-04-26T23:41:09.015 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.998+0000 7f331cbb2640 1 -- 172.21.15.88:0/3814876527 reap_dead start 2024-04-26T23:41:09.015 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.998+0000 7f331e615640 1 -- 172.21.15.88:0/3814876527 shutdown_connections 2024-04-26T23:41:09.015 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.998+0000 7f331e615640 1 -- 172.21.15.88:0/3814876527 >> 172.21.15.88:0/3814876527 conn(0x7f33180ca2f0 msgr2=0x7f331806c310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:09.015 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.998+0000 7f331e615640 1 -- 172.21.15.88:0/3814876527 shutdown_connections 2024-04-26T23:41:09.015 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:08.998+0000 7f331e615640 1 -- 172.21.15.88:0/3814876527 wait complete. 2024-04-26T23:41:09.015 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-04-26T23:41:09.015 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-04-26T23:41:09.015 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-04-26T23:41:09.113 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:09.110+0000 7f78d6740640 1 Processor -- start 2024-04-26T23:41:09.113 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:09.110+0000 7f78d6740640 1 -- start start 2024-04-26T23:41:09.115 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:09.111+0000 7f78d6740640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f78d00703c0 0x7f78d00c7170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:09.116 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:09.111+0000 7f78d6740640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f78d00c3120 con 0x7f78d0151df0 2024-04-26T23:41:09.116 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:09.111+0000 7f78d6740640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f78d0154a80 con 0x7f78d006fd10 2024-04-26T23:41:09.116 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:09.111+0000 7f78d6740640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f78d0154d60 con 0x7f78d00703c0 2024-04-26T23:41:09.116 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:09.111+0000 7f78cffff640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f78d0151df0 0x7f78d00c7d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:39864/0 (socket says 172.21.15.88:39864) 2024-04-26T23:41:09.116 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:09.111+0000 7f78cffff640 1 -- 172.21.15.88:0/3021129997 learned_addr learned my addr 172.21.15.88:0/3021129997 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-26T23:41:09.116 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:09.111+0000 7f78d4cdd640 1 --2- 172.21.15.88:0/3021129997 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f78d00703c0 0x7f78d00c7170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:09.116 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:09.111+0000 7f78ceffd640 1 -- 172.21.15.88:0/3021129997 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1400340065 0 0) 0x7f78d00c3120 con 0x7f78d0151df0 2024-04-26T23:41:09.116 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:09.111+0000 7f78ceffd640 1 -- 172.21.15.88:0/3021129997 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f78b8003520 con 0x7f78d0151df0 2024-04-26T23:41:09.116 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:09.111+0000 7f78ceffd640 1 -- 172.21.15.88:0/3021129997 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2392273603 0 0) 0x7f78b8003520 con 0x7f78d0151df0 2024-04-26T23:41:09.116 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:09.111+0000 7f78ceffd640 1 -- 172.21.15.88:0/3021129997 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f78d00703c0 msgr2=0x7f78d00c7170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:41:09.116 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:09.111+0000 7f78ceffd640 1 --2- 172.21.15.88:0/3021129997 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f78d00703c0 0x7f78d00c7170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:09.116 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:09.111+0000 7f78ceffd640 1 -- 172.21.15.88:0/3021129997 >> v1:172.21.15.175:6789/0 conn(0x7f78d006fd10 legacy=0x7f78d00c6a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:09.116 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:09.111+0000 7f78ceffd640 1 -- 172.21.15.88:0/3021129997 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78d0155040 con 0x7f78d0151df0 2024-04-26T23:41:09.117 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:09.111+0000 7f78ceffd640 1 -- 172.21.15.88:0/3021129997 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 356324787 0 0) 0x7f78c4001690 con 0x7f78d0151df0 2024-04-26T23:41:09.117 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:09.112+0000 7f78ceffd640 1 -- 172.21.15.88:0/3021129997 >> v1:172.21.15.88:6789/0 conn(0x7f78d0151df0 legacy=0x7f78d00c7d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:09.117 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:09.112+0000 7f78ceffd640 1 --2- 172.21.15.88:0/3021129997 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f78b80039e0 0x7f78b8003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:09.117 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:09.112+0000 7f78ceffd640 1 --2- 172.21.15.88:0/3021129997 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f78b8004800 0x7f78b8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:09.117 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:09.112+0000 7f78ceffd640 1 --2- 172.21.15.88:0/3021129997 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f78d00703c0 0x7f78b8005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:09.117 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:09.112+0000 7f78ceffd640 1 -- 172.21.15.88:0/3021129997 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f78d0154d60 con 0x7f78b80039e0 2024-04-26T23:41:09.117 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:09.112+0000 7f78ceffd640 1 -- 172.21.15.88:0/3021129997 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f78b800bb20 con 0x7f78b8004800 2024-04-26T23:41:09.117 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:09.112+0000 7f78ceffd640 1 -- 172.21.15.88:0/3021129997 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f78b800bd20 con 0x7f78d00703c0 2024-04-26T23:41:09.117 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:09.112+0000 7f78cffff640 1 --2- 172.21.15.88:0/3021129997 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f78b80039e0 0x7f78b8003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:09.117 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:09.112+0000 7f78cf7fe640 1 --2- 172.21.15.88:0/3021129997 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f78b8004800 0x7f78b8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:09.117 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:09.112+0000 7f78d4cdd640 1 --2- 172.21.15.88:0/3021129997 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f78d00703c0 0x7f78b8005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:09.117 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:09.112+0000 7f78cffff640 1 -- 172.21.15.88:0/3021129997 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f78d00703c0 msgr2=0x7f78b8005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:41:09.117 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:09.112+0000 7f78cffff640 1 --2- 172.21.15.88:0/3021129997 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f78d00703c0 0x7f78b8005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:09.117 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:09.112+0000 7f78cffff640 1 -- 172.21.15.88:0/3021129997 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f78b8004800 msgr2=0x7f78b8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:41:09.117 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:09.112+0000 7f78cffff640 1 --2- 172.21.15.88:0/3021129997 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f78b8004800 0x7f78b8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:09.118 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:09.112+0000 7f78cffff640 1 -- 172.21.15.88:0/3021129997 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78b8003520 con 0x7f78b80039e0 2024-04-26T23:41:09.118 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:09.113+0000 7f78cffff640 1 --2- 172.21.15.88:0/3021129997 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f78b80039e0 0x7f78b8003dc0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f78c400c210 tx=0x7f78b8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f936cd8715074fca server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:09.118 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:09.113+0000 7f78ceffd640 1 -- 172.21.15.88:0/3021129997 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78c4007d30 con 0x7f78b80039e0 2024-04-26T23:41:09.118 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:09.113+0000 7f78ceffd640 1 -- 172.21.15.88:0/3021129997 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78c40058d0 con 0x7f78b80039e0 2024-04-26T23:41:09.118 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:09.113+0000 7f78ceffd640 1 -- 172.21.15.88:0/3021129997 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78c4005c80 con 0x7f78b80039e0 2024-04-26T23:41:09.122 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:09.113+0000 7f78d6740640 1 -- 172.21.15.88:0/3021129997 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f78b80039e0 msgr2=0x7f78b8003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:09.122 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:09.113+0000 7f78d6740640 1 --2- 172.21.15.88:0/3021129997 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f78b80039e0 0x7f78b8003dc0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f78c400c210 tx=0x7f78b8005830 comp rx=0 tx=0).stop 2024-04-26T23:41:09.122 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:09.113+0000 7f78d4cdd640 1 -- 172.21.15.88:0/3021129997 reap_dead start 2024-04-26T23:41:09.122 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:09.113+0000 7f78d6740640 1 -- 172.21.15.88:0/3021129997 shutdown_connections 2024-04-26T23:41:09.122 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:09.113+0000 7f78d6740640 1 -- 172.21.15.88:0/3021129997 >> 172.21.15.88:0/3021129997 conn(0x7f78d00c8c40 msgr2=0x7f78d00c9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:09.122 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:09.113+0000 7f78d6740640 1 -- 172.21.15.88:0/3021129997 shutdown_connections 2024-04-26T23:41:09.122 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:09.113+0000 7f78d6740640 1 -- 172.21.15.88:0/3021129997 wait complete. 2024-04-26T23:41:09.123 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:09.114+0000 7f78d6740640 1 Processor -- start 2024-04-26T23:41:09.123 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:09.115+0000 7f78d6740640 1 -- start start 2024-04-26T23:41:09.123 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:09.115+0000 7f78d6740640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f78b80039e0 0x7f78d0071e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:09.123 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:09.115+0000 7f78d6740640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f78d01589d0 0x7f78d014a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:09.123 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:09.115+0000 7f78d6740640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f78d014ad20 0x7f78d014c270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:09.123 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:09.115+0000 7f78d6740640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f78d00c8450 con 0x7f78d014ad20 2024-04-26T23:41:09.123 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:09.115+0000 7f78d6740640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f78d01521d0 con 0x7f78d01589d0 2024-04-26T23:41:09.123 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:09.115+0000 7f78d6740640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f78d00c85d0 con 0x7f78b80039e0 2024-04-26T23:41:09.123 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:09.115+0000 7f78d4cdd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f78d014ad20 0x7f78d014c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:09.123 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:09.115+0000 7f78d4cdd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f78d014ad20 0x7f78d014c270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:34510/0 (socket says 172.21.15.88:34510) 2024-04-26T23:41:09.123 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:09.115+0000 7f78d4cdd640 1 -- 172.21.15.88:0/2948960043 learned_addr learned my addr 172.21.15.88:0/2948960043 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:41:09.123 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:09.115+0000 7f78cffff640 1 --2- 172.21.15.88:0/2948960043 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f78b80039e0 0x7f78d0071e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:09.123 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:09.115+0000 7f78cf7fe640 1 --2- 172.21.15.88:0/2948960043 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f78d01589d0 0x7f78d014a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:09.123 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:09.116+0000 7f78d4cdd640 1 -- 172.21.15.88:0/2948960043 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f78b80039e0 msgr2=0x7f78d0071e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:09.124 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:09.116+0000 7f78d4cdd640 1 --2- 172.21.15.88:0/2948960043 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f78b80039e0 0x7f78d0071e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:09.124 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:09.116+0000 7f78d4cdd640 1 -- 172.21.15.88:0/2948960043 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f78d01589d0 msgr2=0x7f78d014a7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:09.124 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:09.116+0000 7f78d4cdd640 1 --2- 172.21.15.88:0/2948960043 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f78d01589d0 0x7f78d014a7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:09.124 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:09.116+0000 7f78d4cdd640 1 -- 172.21.15.88:0/2948960043 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78d0154260 con 0x7f78d014ad20 2024-04-26T23:41:09.124 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:09.116+0000 7f78d4cdd640 1 --2- 172.21.15.88:0/2948960043 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f78d014ad20 0x7f78d014c270 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f78d00c2b60 tx=0x7f78c800f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:09.124 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:09.116+0000 7f78ccff9640 1 -- 172.21.15.88:0/2948960043 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78c8015430 con 0x7f78d014ad20 2024-04-26T23:41:09.124 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:09.116+0000 7f78ccff9640 1 -- 172.21.15.88:0/2948960043 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78c80155d0 con 0x7f78d014ad20 2024-04-26T23:41:09.124 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:09.116+0000 7f78d6740640 1 -- 172.21.15.88:0/2948960043 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78d0154540 con 0x7f78d014ad20 2024-04-26T23:41:09.124 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:09.116+0000 7f78ccff9640 1 -- 172.21.15.88:0/2948960043 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78c80159c0 con 0x7f78d014ad20 2024-04-26T23:41:09.124 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:09.116+0000 7f78d6740640 1 -- 172.21.15.88:0/2948960043 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78d0072850 con 0x7f78d014ad20 2024-04-26T23:41:09.124 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:09.117+0000 7f78d6740640 1 --2- 172.21.15.88:0/2948960043 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f78d014c7b0 0x7f78d0152a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:09.124 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:09.117+0000 7f78d6740640 1 -- 172.21.15.88:0/2948960043 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f78d0152790 con 0x7f78d014c7b0 2024-04-26T23:41:09.124 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:09.117+0000 7f78cffff640 1 --2- 172.21.15.88:0/2948960043 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f78d014c7b0 0x7f78d0152a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:09.124 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:09.117+0000 7f78cffff640 1 -- 172.21.15.88:0/2948960043 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f78d00a86f0 con 0x7f78d014c7b0 2024-04-26T23:41:09.125 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:09.117+0000 7f78cffff640 1 --2- 172.21.15.88:0/2948960043 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f78d014c7b0 0x7f78d0152a70 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f78d00c4ab0 tx=0x7f78d0155210 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:09.125 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:09.118+0000 7f78ccff9640 1 -- 172.21.15.88:0/2948960043 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f78c8015b60 con 0x7f78d014ad20 2024-04-26T23:41:09.125 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:09.118+0000 7f78ccff9640 1 --2- 172.21.15.88:0/2948960043 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f78bc06c8f0 0x7f78bc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:09.125 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:09.118+0000 7f78ccff9640 1 -- 172.21.15.88:0/2948960043 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7f78c808cab0 con 0x7f78d014ad20 2024-04-26T23:41:09.125 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:09.118+0000 7f78cf7fe640 1 --2- 172.21.15.88:0/2948960043 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f78bc06c8f0 0x7f78bc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:09.125 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:09.118+0000 7f78ccff9640 1 -- 172.21.15.88:0/2948960043 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78c4043020 con 0x7f78d014c7b0 2024-04-26T23:41:09.125 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:09.118+0000 7f78ccff9640 1 -- 172.21.15.88:0/2948960043 <== mon.1 v2:172.21.15.175:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f78c4005ba0 con 0x7f78d014c7b0 2024-04-26T23:41:09.125 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:09.118+0000 7f78ccff9640 1 -- 172.21.15.88:0/2948960043 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f78d014c7b0 msgr2=0x7f78d0152a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:09.125 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:09.118+0000 7f78ccff9640 1 --2- 172.21.15.88:0/2948960043 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f78d014c7b0 0x7f78d0152a70 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f78d00c4ab0 tx=0x7f78d0155210 comp rx=0 tx=0).stop 2024-04-26T23:41:09.125 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:09.118+0000 7f78ccff9640 1 -- 172.21.15.88:0/2948960043 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f78d014c7b0 msgr2=0x7f78d0152a70 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:41:09.125 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:09.118+0000 7f78ccff9640 1 --2- 172.21.15.88:0/2948960043 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f78d014c7b0 0x7f78d0152a70 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:09.125 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:09.118+0000 7f78cf7fe640 1 --2- 172.21.15.88:0/2948960043 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f78bc06c8f0 0x7f78bc06edb0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f78c0000c00 tx=0x7f78c0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:09.127 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:09.125+0000 7f78d6740640 1 --2- 172.21.15.88:0/2948960043 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f78d0152fb0 0x7f78d01edc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:09.128 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:09.125+0000 7f78d6740640 1 -- 172.21.15.88:0/2948960043 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f78d00a7df0 con 0x7f78d0152fb0 2024-04-26T23:41:09.128 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:09.125+0000 7f78cffff640 1 --2- 172.21.15.88:0/2948960043 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f78d0152fb0 0x7f78d01edc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:09.128 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:09.125+0000 7f78cffff640 1 -- 172.21.15.88:0/2948960043 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f78d00507a0 con 0x7f78d0152fb0 2024-04-26T23:41:09.129 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:09.125+0000 7f78cffff640 1 --2- 172.21.15.88:0/2948960043 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f78d0152fb0 0x7f78d01edc00 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f78d0068e50 tx=0x7f78c402e000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:09.129 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:09.125+0000 7f78ccff9640 1 -- 172.21.15.88:0/2948960043 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78c4043040 con 0x7f78d0152fb0 2024-04-26T23:41:09.129 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:09.126+0000 7f78ccff9640 1 -- 172.21.15.88:0/2948960043 <== mon.1 v2:172.21.15.175:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4894 (secure 0 0 0) 0x7f78c4007690 con 0x7f78d0152fb0 2024-04-26T23:41:09.129 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:09.126+0000 7f78ccff9640 1 -- 172.21.15.88:0/2948960043 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f78d0152fb0 msgr2=0x7f78d01edc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:09.129 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:09.126+0000 7f78ccff9640 1 --2- 172.21.15.88:0/2948960043 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f78d0152fb0 0x7f78d01edc00 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f78d0068e50 tx=0x7f78c402e000 comp rx=0 tx=0).stop 2024-04-26T23:41:09.129 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:09.126+0000 7f78ccff9640 1 -- 172.21.15.88:0/2948960043 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f78d0152fb0 msgr2=0x7f78d01edc00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:41:09.129 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:09.126+0000 7f78ccff9640 1 --2- 172.21.15.88:0/2948960043 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f78d0152fb0 0x7f78d01edc00 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:09.129 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-04-26T23:41:09.129 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2024-04-26T23:41:09.129 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2024-04-26T23:41:09.129 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "peon", 2024-04-26T23:41:09.130 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 4, 2024-04-26T23:41:09.130 INFO:teuthology.orchestra.run.smithi088.stdout: "uptime": 61469, 2024-04-26T23:41:09.130 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2024-04-26T23:41:09.130 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2024-04-26T23:41:09.130 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2024-04-26T23:41:09.130 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2024-04-26T23:41:09.130 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:41:09.130 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 61, 2024-04-26T23:41:09.130 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2024-04-26T23:41:09.130 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2450521708007866372", 2024-04-26T23:41:09.130 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2024-04-26T23:41:09.130 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-04-26T23:41:09.130 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-04-26T23:41:09.130 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-04-26T23:41:09.130 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-04-26T23:41:09.131 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-04-26T23:41:09.131 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-04-26T23:41:09.131 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-04-26T23:41:09.131 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-04-26T23:41:09.131 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-04-26T23:41:09.131 INFO:teuthology.orchestra.run.smithi088.stdout: "reef", 2024-04-26T23:41:09.131 INFO:teuthology.orchestra.run.smithi088.stdout: "squid" 2024-04-26T23:41:09.131 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:41:09.131 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540701547738038271", 2024-04-26T23:41:09.131 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2024-04-26T23:41:09.131 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-04-26T23:41:09.131 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-04-26T23:41:09.131 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-04-26T23:41:09.131 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-04-26T23:41:09.131 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-04-26T23:41:09.131 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-04-26T23:41:09.131 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-04-26T23:41:09.132 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-04-26T23:41:09.132 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-04-26T23:41:09.132 INFO:teuthology.orchestra.run.smithi088.stdout: "reef", 2024-04-26T23:41:09.132 INFO:teuthology.orchestra.run.smithi088.stdout: "squid" 2024-04-26T23:41:09.132 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:41:09.132 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:41:09.132 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2024-04-26T23:41:09.132 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2024-04-26T23:41:09.132 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2024-04-26T23:41:09.132 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2024-04-26T23:41:09.132 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2024-04-26T23:41:09.132 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "555255e9-7ef9-4454-8dc9-35e96b70035c", 2024-04-26T23:41:09.132 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2024-04-26T23:39:34.291658Z", 2024-04-26T23:41:09.132 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2024-04-26T23:39:34.291658Z", 2024-04-26T23:41:09.132 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 19, 2024-04-26T23:41:09.132 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "squid", 2024-04-26T23:41:09.133 INFO:teuthology.orchestra.run.smithi088.stdout: "election_strategy": 1, 2024-04-26T23:41:09.133 INFO:teuthology.orchestra.run.smithi088.stdout: "disallowed_leaders: ": "", 2024-04-26T23:41:09.133 INFO:teuthology.orchestra.run.smithi088.stdout: "stretch_mode": false, 2024-04-26T23:41:09.133 INFO:teuthology.orchestra.run.smithi088.stdout: "tiebreaker_mon": "", 2024-04-26T23:41:09.133 INFO:teuthology.orchestra.run.smithi088.stdout: "removed_ranks: ": "", 2024-04-26T23:41:09.133 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2024-04-26T23:41:09.133 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2024-04-26T23:41:09.133 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-04-26T23:41:09.133 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-04-26T23:41:09.133 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-04-26T23:41:09.133 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-04-26T23:41:09.133 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-04-26T23:41:09.133 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-04-26T23:41:09.133 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-04-26T23:41:09.133 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-04-26T23:41:09.133 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-04-26T23:41:09.134 INFO:teuthology.orchestra.run.smithi088.stdout: "reef", 2024-04-26T23:41:09.134 INFO:teuthology.orchestra.run.smithi088.stdout: "squid" 2024-04-26T23:41:09.134 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:41:09.134 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2024-04-26T23:41:09.134 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:41:09.134 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2024-04-26T23:41:09.134 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:41:09.134 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2024-04-26T23:41:09.134 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2024-04-26T23:41:09.134 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-04-26T23:41:09.134 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-04-26T23:41:09.134 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:41:09.134 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-04-26T23:41:09.134 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2024-04-26T23:41:09.135 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:41:09.135 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:41:09.135 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:41:09.135 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-04-26T23:41:09.135 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2024-04-26T23:41:09.135 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:41:09.135 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:41:09.135 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:41:09.135 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:41:09.135 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2024-04-26T23:41:09.135 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2024-04-26T23:41:09.135 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-04-26T23:41:09.135 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-04-26T23:41:09.135 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-04-26T23:41:09.135 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:41:09.135 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:41:09.135 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2024-04-26T23:41:09.136 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2024-04-26T23:41:09.136 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-04-26T23:41:09.136 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-04-26T23:41:09.136 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:41:09.136 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-04-26T23:41:09.136 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:3300", 2024-04-26T23:41:09.136 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:41:09.136 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:41:09.136 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:41:09.136 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-04-26T23:41:09.136 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6789", 2024-04-26T23:41:09.136 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:41:09.136 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:41:09.136 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:41:09.136 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:41:09.137 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6789/0", 2024-04-26T23:41:09.137 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.175:6789/0", 2024-04-26T23:41:09.137 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-04-26T23:41:09.137 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-04-26T23:41:09.137 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-04-26T23:41:09.137 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:41:09.137 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:41:09.137 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2024-04-26T23:41:09.137 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2024-04-26T23:41:09.137 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-04-26T23:41:09.137 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-04-26T23:41:09.137 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:41:09.137 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-04-26T23:41:09.137 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:3301", 2024-04-26T23:41:09.137 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:41:09.138 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:41:09.138 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:41:09.138 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-04-26T23:41:09.138 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6790", 2024-04-26T23:41:09.138 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:41:09.138 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:41:09.138 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:41:09.138 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:41:09.138 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6790/0", 2024-04-26T23:41:09.138 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.175:6790/0", 2024-04-26T23:41:09.138 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-04-26T23:41:09.138 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-04-26T23:41:09.138 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-04-26T23:41:09.138 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:41:09.138 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:41:09.139 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:41:09.139 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2024-04-26T23:41:09.139 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2024-04-26T23:41:09.139 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:41:09.139 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:41:09.139 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:41:09.139 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2024-04-26T23:41:09.139 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:41:09.139 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:41:09.139 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": [ 2024-04-26T23:41:09.139 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:41:09.139 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:41:09.139 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:41:09.139 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2024-04-26T23:41:09.139 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:41:09.140 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:41:09.140 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": [ 2024-04-26T23:41:09.140 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:41:09.140 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:41:09.140 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:41:09.140 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2024-04-26T23:41:09.140 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:41:09.140 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:41:09.140 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2024-04-26T23:41:09.140 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:41:09.140 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:41:09.140 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:41:09.140 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2024-04-26T23:41:09.140 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:41:09.140 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:41:09.141 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:41:09.141 INFO:teuthology.orchestra.run.smithi088.stdout: "stretch_mode": false 2024-04-26T23:41:09.141 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-04-26T23:41:09.142 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:09.126+0000 7f78d6740640 1 -- 172.21.15.88:0/2948960043 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f78bc06c8f0 msgr2=0x7f78bc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:09.142 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:09.126+0000 7f78d6740640 1 --2- 172.21.15.88:0/2948960043 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f78bc06c8f0 0x7f78bc06edb0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f78c0000c00 tx=0x7f78c0009040 comp rx=0 tx=0).stop 2024-04-26T23:41:09.142 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:09.126+0000 7f78d6740640 1 -- 172.21.15.88:0/2948960043 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f78d014ad20 msgr2=0x7f78d014c270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:09.142 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:09.126+0000 7f78d6740640 1 --2- 172.21.15.88:0/2948960043 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f78d014ad20 0x7f78d014c270 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f78d00c2b60 tx=0x7f78c800f580 comp rx=0 tx=0).stop 2024-04-26T23:41:09.142 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:09.126+0000 7f78d4cdd640 1 -- 172.21.15.88:0/2948960043 reap_dead start 2024-04-26T23:41:09.142 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:09.126+0000 7f78d4cdd640 1 -- 172.21.15.88:0/2948960043 reap_dead start 2024-04-26T23:41:09.142 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:09.126+0000 7f78d6740640 1 -- 172.21.15.88:0/2948960043 shutdown_connections 2024-04-26T23:41:09.142 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:09.126+0000 7f78d6740640 1 -- 172.21.15.88:0/2948960043 >> 172.21.15.88:0/2948960043 conn(0x7f78d00c8c40 msgr2=0x7f78d00c4ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:09.142 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:09.126+0000 7f78d6740640 1 -- 172.21.15.88:0/2948960043 shutdown_connections 2024-04-26T23:41:09.143 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:09.126+0000 7f78d6740640 1 -- 172.21.15.88:0/2948960043 wait complete. 2024-04-26T23:41:09.143 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-04-26T23:41:09.143 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-04-26T23:41:09.143 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-04-26T23:41:09.241 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:09.238+0000 7f8ab8283640 1 Processor -- start 2024-04-26T23:41:09.241 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:09.238+0000 7f8ab8283640 1 -- start start 2024-04-26T23:41:09.244 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:09.239+0000 7f8ab8283640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8ab01523e0 0x7f8ab01554c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:09.244 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:09.239+0000 7f8ab8283640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f8ab006f920 0x7f8ab00abd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:09.244 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:09.239+0000 7f8ab8283640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8ab0070670 con 0x7f8ab0073aa0 2024-04-26T23:41:09.244 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:09.239+0000 7f8ab8283640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f8ab00ab8f0 con 0x7f8ab006f920 2024-04-26T23:41:09.244 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:09.239+0000 7f8ab8283640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f8ab00700b0 con 0x7f8ab01523e0 2024-04-26T23:41:09.244 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:09.239+0000 7f8ab6820640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f8ab006f920 0x7f8ab00abd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:09.244 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:09.239+0000 7f8ab601f640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f8ab0073aa0 0x7f8ab0151cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:39880/0 (socket says 172.21.15.88:39880) 2024-04-26T23:41:09.244 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:09.239+0000 7f8ab6820640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f8ab006f920 0x7f8ab00abd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:34516/0 (socket says 172.21.15.88:34516) 2024-04-26T23:41:09.244 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:09.239+0000 7f8ab601f640 1 -- 172.21.15.88:0/2724689839 learned_addr learned my addr 172.21.15.88:0/2724689839 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-26T23:41:09.244 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:09.239+0000 7f8ab581e640 1 --2- 172.21.15.88:0/2724689839 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8ab01523e0 0x7f8ab01554c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:09.244 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:09.239+0000 7f8ab6820640 1 -- 172.21.15.88:0/2724689839 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8ab01523e0 msgr2=0x7f8ab01554c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:41:09.245 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:09.239+0000 7f8ab6820640 1 --2- 172.21.15.88:0/2724689839 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8ab01523e0 0x7f8ab01554c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:09.245 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:09.239+0000 7f8ab6820640 1 -- 172.21.15.88:0/2724689839 >> v1:172.21.15.88:6789/0 conn(0x7f8ab0073aa0 legacy=0x7f8ab0151cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:09.245 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:09.239+0000 7f8ab6820640 1 -- 172.21.15.88:0/2724689839 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ab0070390 con 0x7f8ab006f920 2024-04-26T23:41:09.245 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:09.239+0000 7f8ab501d640 1 -- 172.21.15.88:0/2724689839 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 824718296 0 0) 0x7f8ab0070670 con 0x7f8ab0073aa0 2024-04-26T23:41:09.245 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:09.240+0000 7f8ab6820640 1 --2- 172.21.15.88:0/2724689839 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8ab006f920 0x7f8ab00abd80 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f8aa8009d90 tx=0x7f8aa802a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71bfa0ff70c90547 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:09.245 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:09.240+0000 7f8ab501d640 1 -- 172.21.15.88:0/2724689839 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8aa8007740 con 0x7f8ab006f920 2024-04-26T23:41:09.245 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:09.240+0000 7f8ab501d640 1 -- 172.21.15.88:0/2724689839 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8aa80078e0 con 0x7f8ab006f920 2024-04-26T23:41:09.245 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:09.240+0000 7f8ab501d640 1 -- 172.21.15.88:0/2724689839 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8aa8007cb0 con 0x7f8ab006f920 2024-04-26T23:41:09.245 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:09.240+0000 7f8ab8283640 1 -- 172.21.15.88:0/2724689839 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8ab006f920 msgr2=0x7f8ab00abd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:09.245 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:09.241+0000 7f8ab8283640 1 --2- 172.21.15.88:0/2724689839 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8ab006f920 0x7f8ab00abd80 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f8aa8009d90 tx=0x7f8aa802a660 comp rx=0 tx=0).stop 2024-04-26T23:41:09.245 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:09.241+0000 7f8ab8283640 1 -- 172.21.15.88:0/2724689839 shutdown_connections 2024-04-26T23:41:09.245 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:09.241+0000 7f8ab8283640 1 --2- 172.21.15.88:0/2724689839 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8ab006f920 0x7f8ab00abd80 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:09.245 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:09.241+0000 7f8ab8283640 1 --2- 172.21.15.88:0/2724689839 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8ab01523e0 0x7f8ab01554c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:09.245 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:09.241+0000 7f8ab8283640 1 -- 172.21.15.88:0/2724689839 >> 172.21.15.88:0/2724689839 conn(0x7f8ab00c6ed0 msgr2=0x7f8ab00c72b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:09.245 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:09.241+0000 7f8ab8283640 1 -- 172.21.15.88:0/2724689839 shutdown_connections 2024-04-26T23:41:09.245 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:09.241+0000 7f8ab8283640 1 -- 172.21.15.88:0/2724689839 wait complete. 2024-04-26T23:41:09.251 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:09.242+0000 7f8ab8283640 1 Processor -- start 2024-04-26T23:41:09.251 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:09.242+0000 7f8ab8283640 1 -- start start 2024-04-26T23:41:09.252 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:09.242+0000 7f8ab8283640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8ab006f920 0x7f8ab00af490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:09.252 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:09.242+0000 7f8ab8283640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8ab0073aa0 0x7f8ab00c3a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:09.252 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:09.242+0000 7f8ab8283640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8ab01523e0 0x7f8ab01ec9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:09.252 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:09.242+0000 7f8ab8283640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f8ab0073e80 con 0x7f8ab01523e0 2024-04-26T23:41:09.252 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:09.242+0000 7f8ab8283640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f8ab006fdd0 con 0x7f8ab006f920 2024-04-26T23:41:09.252 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:09.242+0000 7f8ab8283640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f8ab0074000 con 0x7f8ab0073aa0 2024-04-26T23:41:09.252 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:09.242+0000 7f8ab6820640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8ab01523e0 0x7f8ab01ec9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:09.252 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:09.242+0000 7f8ab6820640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8ab01523e0 0x7f8ab01ec9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:34528/0 (socket says 172.21.15.88:34528) 2024-04-26T23:41:09.252 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:09.242+0000 7f8ab6820640 1 -- 172.21.15.88:0/789135113 learned_addr learned my addr 172.21.15.88:0/789135113 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:41:09.252 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:09.243+0000 7f8ab601f640 1 --2- 172.21.15.88:0/789135113 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8ab006f920 0x7f8ab00af490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:09.252 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:09.243+0000 7f8ab581e640 1 --2- 172.21.15.88:0/789135113 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8ab0073aa0 0x7f8ab00c3a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:09.252 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:09.243+0000 7f8ab6820640 1 -- 172.21.15.88:0/789135113 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8ab0073aa0 msgr2=0x7f8ab00c3a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:09.252 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:09.243+0000 7f8ab6820640 1 --2- 172.21.15.88:0/789135113 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8ab0073aa0 0x7f8ab00c3a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:09.253 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:09.243+0000 7f8ab6820640 1 -- 172.21.15.88:0/789135113 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8ab006f920 msgr2=0x7f8ab00af490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:09.253 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:09.243+0000 7f8ab6820640 1 --2- 172.21.15.88:0/789135113 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8ab006f920 0x7f8ab00af490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:09.253 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:09.243+0000 7f8ab6820640 1 -- 172.21.15.88:0/789135113 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ab006da00 con 0x7f8ab01523e0 2024-04-26T23:41:09.253 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:09.243+0000 7f8ab6820640 1 --2- 172.21.15.88:0/789135113 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8ab01523e0 0x7f8ab01ec9d0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f8aa802ac50 tx=0x7f8aa8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:09.253 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:09.243+0000 7f8aa6ffd640 1 -- 172.21.15.88:0/789135113 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8aa8040070 con 0x7f8ab01523e0 2024-04-26T23:41:09.253 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:09.243+0000 7f8aa6ffd640 1 -- 172.21.15.88:0/789135113 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8aa8031bc0 con 0x7f8ab01523e0 2024-04-26T23:41:09.253 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:09.243+0000 7f8ab8283640 1 -- 172.21.15.88:0/789135113 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ab006dce0 con 0x7f8ab01523e0 2024-04-26T23:41:09.253 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:09.243+0000 7f8aa6ffd640 1 -- 172.21.15.88:0/789135113 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8aa8009450 con 0x7f8ab01523e0 2024-04-26T23:41:09.253 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:09.243+0000 7f8ab8283640 1 -- 172.21.15.88:0/789135113 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ab006e2a0 con 0x7f8ab01523e0 2024-04-26T23:41:09.253 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:09.244+0000 7f8ab8283640 1 --2- 172.21.15.88:0/789135113 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8ab006c310 0x7f8ab01ecf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:09.253 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:09.244+0000 7f8ab8283640 1 -- 172.21.15.88:0/789135113 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f8ab0150e40 con 0x7f8ab006c310 2024-04-26T23:41:09.253 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:09.244+0000 7f8ab601f640 1 --2- 172.21.15.88:0/789135113 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8ab006c310 0x7f8ab01ecf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:09.253 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:09.244+0000 7f8aa6ffd640 1 -- 172.21.15.88:0/789135113 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8aa8039040 con 0x7f8ab01523e0 2024-04-26T23:41:09.253 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:09.245+0000 7f8ab601f640 1 -- 172.21.15.88:0/789135113 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8ab00507a0 con 0x7f8ab006c310 2024-04-26T23:41:09.253 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:09.245+0000 7f8ab601f640 1 --2- 172.21.15.88:0/789135113 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8ab006c310 0x7f8ab01ecf10 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f8ab014fbb0 tx=0x7f8aac001990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:09.253 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:09.245+0000 7f8aa6ffd640 1 --2- 172.21.15.88:0/789135113 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f8a9406c920 0x7f8a9406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:09.253 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:09.245+0000 7f8aa6ffd640 1 -- 172.21.15.88:0/789135113 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7f8aa80ad4d0 con 0x7f8ab01523e0 2024-04-26T23:41:09.254 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:09.245+0000 7f8ab581e640 1 --2- 172.21.15.88:0/789135113 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f8a9406c920 0x7f8a9406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:09.254 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:09.245+0000 7f8aa6ffd640 1 -- 172.21.15.88:0/789135113 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8aac00f5e0 con 0x7f8ab006c310 2024-04-26T23:41:09.254 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:09.245+0000 7f8aa6ffd640 1 -- 172.21.15.88:0/789135113 <== mon.2 v2:172.21.15.175:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f8aac018070 con 0x7f8ab006c310 2024-04-26T23:41:09.254 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:09.245+0000 7f8aa6ffd640 1 -- 172.21.15.88:0/789135113 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8ab006c310 msgr2=0x7f8ab01ecf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:09.254 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:09.245+0000 7f8aa6ffd640 1 --2- 172.21.15.88:0/789135113 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8ab006c310 0x7f8ab01ecf10 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f8ab014fbb0 tx=0x7f8aac001990 comp rx=0 tx=0).stop 2024-04-26T23:41:09.254 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:09.245+0000 7f8aa6ffd640 1 -- 172.21.15.88:0/789135113 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8ab006c310 msgr2=0x7f8ab01ecf10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:41:09.254 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:09.245+0000 7f8aa6ffd640 1 --2- 172.21.15.88:0/789135113 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8ab006c310 0x7f8ab01ecf10 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:09.254 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:09.245+0000 7f8ab581e640 1 --2- 172.21.15.88:0/789135113 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f8a9406c920 0x7f8a9406ede0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f8ab0151500 tx=0x7f8aa0009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:09.255 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:09.252+0000 7f8ab8283640 1 --2- 172.21.15.88:0/789135113 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8ab0068a30 0x7f8ab006cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:09.255 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:09.252+0000 7f8ab8283640 1 -- 172.21.15.88:0/789135113 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f8ab0152100 con 0x7f8ab0068a30 2024-04-26T23:41:09.255 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:09.252+0000 7f8ab601f640 1 --2- 172.21.15.88:0/789135113 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8ab0068a30 0x7f8ab006cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:09.255 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:09.252+0000 7f8ab601f640 1 -- 172.21.15.88:0/789135113 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f8ab0151e20 con 0x7f8ab0068a30 2024-04-26T23:41:09.255 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:09.252+0000 7f8ab601f640 1 --2- 172.21.15.88:0/789135113 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8ab0068a30 0x7f8ab006cb40 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f8ab014fbb0 tx=0x7f8aac001080 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:09.255 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:09.253+0000 7f8aa6ffd640 1 -- 172.21.15.88:0/789135113 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8aac00fe60 con 0x7f8ab0068a30 2024-04-26T23:41:09.256 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:09.253+0000 7f8aa6ffd640 1 -- 172.21.15.88:0/789135113 <== mon.2 v2:172.21.15.175:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5207 (secure 0 0 0) 0x7f8aac00fe60 con 0x7f8ab0068a30 2024-04-26T23:41:09.256 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:09.253+0000 7f8aa6ffd640 1 -- 172.21.15.88:0/789135113 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8ab0068a30 msgr2=0x7f8ab006cb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:09.256 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:09.253+0000 7f8aa6ffd640 1 --2- 172.21.15.88:0/789135113 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8ab0068a30 0x7f8ab006cb40 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f8ab014fbb0 tx=0x7f8aac001080 comp rx=0 tx=0).stop 2024-04-26T23:41:09.256 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:09.253+0000 7f8aa6ffd640 1 -- 172.21.15.88:0/789135113 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8ab0068a30 msgr2=0x7f8ab006cb40 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:41:09.256 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:09.253+0000 7f8aa6ffd640 1 --2- 172.21.15.88:0/789135113 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8ab0068a30 0x7f8ab006cb40 secure :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f8ab014fbb0 tx=0x7f8aac001080 comp rx=0 tx=0).stop 2024-04-26T23:41:09.256 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-04-26T23:41:09.257 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2024-04-26T23:41:09.257 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2024-04-26T23:41:09.257 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "peon", 2024-04-26T23:41:09.257 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 4, 2024-04-26T23:41:09.257 INFO:teuthology.orchestra.run.smithi088.stdout: "uptime": 61596, 2024-04-26T23:41:09.257 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2024-04-26T23:41:09.257 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2024-04-26T23:41:09.257 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2024-04-26T23:41:09.257 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2024-04-26T23:41:09.257 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:41:09.257 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 61, 2024-04-26T23:41:09.257 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2024-04-26T23:41:09.257 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2450521708007866372", 2024-04-26T23:41:09.257 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2024-04-26T23:41:09.257 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-04-26T23:41:09.258 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-04-26T23:41:09.258 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-04-26T23:41:09.258 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-04-26T23:41:09.258 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-04-26T23:41:09.258 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-04-26T23:41:09.258 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-04-26T23:41:09.258 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-04-26T23:41:09.258 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-04-26T23:41:09.258 INFO:teuthology.orchestra.run.smithi088.stdout: "reef", 2024-04-26T23:41:09.258 INFO:teuthology.orchestra.run.smithi088.stdout: "squid" 2024-04-26T23:41:09.258 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:41:09.258 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540701547738038271", 2024-04-26T23:41:09.258 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2024-04-26T23:41:09.258 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-04-26T23:41:09.258 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-04-26T23:41:09.259 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-04-26T23:41:09.259 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-04-26T23:41:09.259 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-04-26T23:41:09.259 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-04-26T23:41:09.259 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-04-26T23:41:09.259 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-04-26T23:41:09.259 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-04-26T23:41:09.259 INFO:teuthology.orchestra.run.smithi088.stdout: "reef", 2024-04-26T23:41:09.259 INFO:teuthology.orchestra.run.smithi088.stdout: "squid" 2024-04-26T23:41:09.259 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:41:09.259 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:41:09.259 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2024-04-26T23:41:09.259 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2024-04-26T23:41:09.260 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2024-04-26T23:41:09.260 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2024-04-26T23:41:09.260 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2024-04-26T23:41:09.260 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "555255e9-7ef9-4454-8dc9-35e96b70035c", 2024-04-26T23:41:09.260 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2024-04-26T23:39:34.291658Z", 2024-04-26T23:41:09.260 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2024-04-26T23:39:34.291658Z", 2024-04-26T23:41:09.260 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 19, 2024-04-26T23:41:09.260 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "squid", 2024-04-26T23:41:09.260 INFO:teuthology.orchestra.run.smithi088.stdout: "election_strategy": 1, 2024-04-26T23:41:09.260 INFO:teuthology.orchestra.run.smithi088.stdout: "disallowed_leaders: ": "", 2024-04-26T23:41:09.260 INFO:teuthology.orchestra.run.smithi088.stdout: "stretch_mode": false, 2024-04-26T23:41:09.260 INFO:teuthology.orchestra.run.smithi088.stdout: "tiebreaker_mon": "", 2024-04-26T23:41:09.260 INFO:teuthology.orchestra.run.smithi088.stdout: "removed_ranks: ": "", 2024-04-26T23:41:09.260 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2024-04-26T23:41:09.260 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2024-04-26T23:41:09.261 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-04-26T23:41:09.261 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-04-26T23:41:09.261 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-04-26T23:41:09.261 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-04-26T23:41:09.261 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-04-26T23:41:09.261 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-04-26T23:41:09.261 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-04-26T23:41:09.261 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-04-26T23:41:09.261 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-04-26T23:41:09.261 INFO:teuthology.orchestra.run.smithi088.stdout: "reef", 2024-04-26T23:41:09.261 INFO:teuthology.orchestra.run.smithi088.stdout: "squid" 2024-04-26T23:41:09.261 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:41:09.261 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2024-04-26T23:41:09.261 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:41:09.261 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2024-04-26T23:41:09.261 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:41:09.262 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2024-04-26T23:41:09.262 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2024-04-26T23:41:09.262 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-04-26T23:41:09.262 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-04-26T23:41:09.262 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:41:09.262 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-04-26T23:41:09.262 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2024-04-26T23:41:09.262 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:41:09.262 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:41:09.262 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:41:09.262 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-04-26T23:41:09.262 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2024-04-26T23:41:09.262 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:41:09.262 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:41:09.262 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:41:09.263 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:41:09.263 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2024-04-26T23:41:09.263 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2024-04-26T23:41:09.263 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-04-26T23:41:09.263 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-04-26T23:41:09.263 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-04-26T23:41:09.263 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:41:09.263 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:41:09.263 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2024-04-26T23:41:09.263 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2024-04-26T23:41:09.263 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-04-26T23:41:09.263 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-04-26T23:41:09.263 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:41:09.263 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-04-26T23:41:09.264 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:3300", 2024-04-26T23:41:09.264 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:41:09.264 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:41:09.264 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:41:09.264 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-04-26T23:41:09.264 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6789", 2024-04-26T23:41:09.264 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:41:09.264 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:41:09.264 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:41:09.264 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:41:09.264 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6789/0", 2024-04-26T23:41:09.264 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.175:6789/0", 2024-04-26T23:41:09.264 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-04-26T23:41:09.264 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-04-26T23:41:09.265 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-04-26T23:41:09.265 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:41:09.265 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:41:09.265 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2024-04-26T23:41:09.265 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2024-04-26T23:41:09.265 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-04-26T23:41:09.265 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-04-26T23:41:09.265 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:41:09.265 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-04-26T23:41:09.265 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:3301", 2024-04-26T23:41:09.265 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:41:09.265 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:41:09.265 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:41:09.265 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-04-26T23:41:09.265 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6790", 2024-04-26T23:41:09.265 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:41:09.266 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:41:09.266 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:41:09.266 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:41:09.266 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6790/0", 2024-04-26T23:41:09.266 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.175:6790/0", 2024-04-26T23:41:09.266 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-04-26T23:41:09.266 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-04-26T23:41:09.266 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-04-26T23:41:09.266 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:41:09.266 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:41:09.266 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:41:09.266 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2024-04-26T23:41:09.266 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2024-04-26T23:41:09.266 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:41:09.266 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:41:09.267 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:41:09.267 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2024-04-26T23:41:09.267 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:41:09.267 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:41:09.267 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": [ 2024-04-26T23:41:09.267 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:41:09.267 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:41:09.267 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:41:09.267 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2024-04-26T23:41:09.267 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:41:09.267 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:41:09.267 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": [ 2024-04-26T23:41:09.267 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:41:09.267 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:41:09.267 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:41:09.267 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 3 2024-04-26T23:41:09.268 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:41:09.268 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:41:09.268 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2024-04-26T23:41:09.268 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:41:09.268 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x2f018fb87aa4aafe", 2024-04-26T23:41:09.268 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:41:09.268 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2024-04-26T23:41:09.268 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:41:09.268 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:41:09.268 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:41:09.268 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:41:09.268 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2024-04-26T23:41:09.268 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:41:09.268 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:41:09.268 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": [ 2024-04-26T23:41:09.268 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:41:09.268 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:41:09.269 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:41:09.269 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2024-04-26T23:41:09.269 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:41:09.269 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:41:09.269 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:41:09.269 INFO:teuthology.orchestra.run.smithi088.stdout: "stretch_mode": false 2024-04-26T23:41:09.269 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-04-26T23:41:09.270 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:09.253+0000 7f8ab8283640 1 -- 172.21.15.88:0/789135113 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f8a9406c920 msgr2=0x7f8a9406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:09.270 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:09.253+0000 7f8ab8283640 1 --2- 172.21.15.88:0/789135113 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f8a9406c920 0x7f8a9406ede0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f8ab0151500 tx=0x7f8aa0009190 comp rx=0 tx=0).stop 2024-04-26T23:41:09.270 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:09.253+0000 7f8ab8283640 1 -- 172.21.15.88:0/789135113 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8ab01523e0 msgr2=0x7f8ab01ec9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:09.270 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:09.253+0000 7f8ab8283640 1 --2- 172.21.15.88:0/789135113 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8ab01523e0 0x7f8ab01ec9d0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f8aa802ac50 tx=0x7f8aa8004a40 comp rx=0 tx=0).stop 2024-04-26T23:41:09.271 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:09.253+0000 7f8ab6820640 1 -- 172.21.15.88:0/789135113 reap_dead start 2024-04-26T23:41:09.271 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:09.253+0000 7f8ab6820640 1 -- 172.21.15.88:0/789135113 reap_dead start 2024-04-26T23:41:09.271 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:09.253+0000 7f8ab8283640 1 -- 172.21.15.88:0/789135113 shutdown_connections 2024-04-26T23:41:09.271 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:09.253+0000 7f8ab8283640 1 -- 172.21.15.88:0/789135113 >> 172.21.15.88:0/789135113 conn(0x7f8ab00c6ed0 msgr2=0x7f8ab00c5ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:09.271 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:09.253+0000 7f8ab8283640 1 -- 172.21.15.88:0/789135113 shutdown_connections 2024-04-26T23:41:09.271 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:09.253+0000 7f8ab8283640 1 -- 172.21.15.88:0/789135113 wait complete. 2024-04-26T23:41:09.271 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-04-26T23:41:09.271 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['a'] 2024-04-26T23:41:09.272 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: ['c'] 2024-04-26T23:41:09.272 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.a 2024-04-26T23:41:09.272 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2024-04-26T23:41:09.272 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-04-26T23:41:09.272 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T23:41:09.286 INFO:tasks.ceph.mon.a:Stopped 2024-04-26T23:41:09.286 INFO:tasks.mon_thrash:Sending STOP to mon c 2024-04-26T23:41:09.286 INFO:tasks.ceph.mon.c:Sent signal 19 2024-04-26T23:41:09.286 INFO:tasks.mon_thrash.mon_thrasher:waiting for 15.0 secs to unfreeze mons 2024-04-26T23:41:24.287 INFO:tasks.mon_thrash:Sending CONT to mon c 2024-04-26T23:41:24.288 INFO:tasks.ceph.mon.c:Sent signal 18 2024-04-26T23:41:24.288 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2024-04-26T23:41:24.288 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-04-26T23:41:24.399 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:24.392+0000 7f113d493640 1 Processor -- start 2024-04-26T23:41:24.399 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:24.392+0000 7f113d493640 1 -- start start 2024-04-26T23:41:24.399 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:24.393+0000 7f113d493640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f1138156bb0 0x7f113815a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:24.399 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:24.393+0000 7f113d493640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f11380c8df0 con 0x7f11380ca5a0 2024-04-26T23:41:24.400 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:24.393+0000 7f113d493640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1138154540 con 0x7f1138154160 2024-04-26T23:41:24.400 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:24.393+0000 7f113d493640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f113815a6e0 con 0x7f1138156bb0 2024-04-26T23:41:24.400 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:24.393+0000 7f11377fe640 1 -- >> v2:172.21.15.88:3300/0 conn(0x7f1138156bb0 msgr2=0x7f113815a1a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.88:3300/0 2024-04-26T23:41:24.400 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:24.393+0000 7f11367fc640 1 -- >> v1:172.21.15.88:6789/0 conn(0x7f11380ca5a0 legacy=0x7f11380c9590 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.88:6789/0 2024-04-26T23:41:24.400 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:24.393+0000 7f11377fe640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f1138156bb0 0x7f113815a1a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:41:24.400 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:24.393+0000 7f1136ffd640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f1138154160 0x7f11380c6e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.88:43448/0 (socket says 172.21.15.88:43448) 2024-04-26T23:41:24.400 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:24.393+0000 7f1136ffd640 1 -- 172.21.15.88:0/2236357863 learned_addr learned my addr 172.21.15.88:0/2236357863 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-26T23:41:24.597 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:24.594+0000 7f11367fc640 1 -- 172.21.15.88:0/2236357863 >> v1:172.21.15.88:6789/0 conn(0x7f11380ca5a0 legacy=0x7f11380c9590 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.88:6789/0 2024-04-26T23:41:24.598 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:24.594+0000 7f11377fe640 1 -- 172.21.15.88:0/2236357863 >> v2:172.21.15.88:3300/0 conn(0x7f1138156bb0 msgr2=0x7f113815a1a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.88:3300/0 2024-04-26T23:41:24.598 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:24.594+0000 7f11377fe640 1 --2- 172.21.15.88:0/2236357863 >> v2:172.21.15.88:3300/0 conn(0x7f1138156bb0 0x7f113815a1a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-26T23:41:24.998 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:24.995+0000 7f11367fc640 1 -- 172.21.15.88:0/2236357863 >> v1:172.21.15.88:6789/0 conn(0x7f11380ca5a0 legacy=0x7f11380c9590 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.88:6789/0 2024-04-26T23:41:24.999 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:24.995+0000 7f11377fe640 1 -- 172.21.15.88:0/2236357863 >> v2:172.21.15.88:3300/0 conn(0x7f1138156bb0 msgr2=0x7f113815a1a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.88:3300/0 2024-04-26T23:41:24.999 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:24.995+0000 7f11377fe640 1 --2- 172.21.15.88:0/2236357863 >> v2:172.21.15.88:3300/0 conn(0x7f1138156bb0 0x7f113815a1a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-26T23:41:25.799 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:25.796+0000 7f11367fc640 1 -- 172.21.15.88:0/2236357863 >> v1:172.21.15.88:6789/0 conn(0x7f11380ca5a0 legacy=0x7f11380c9590 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.88:6789/0 2024-04-26T23:41:25.800 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:25.796+0000 7f11377fe640 1 -- 172.21.15.88:0/2236357863 >> v2:172.21.15.88:3300/0 conn(0x7f1138156bb0 msgr2=0x7f113815a1a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.88:3300/0 2024-04-26T23:41:25.800 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:25.796+0000 7f11377fe640 1 --2- 172.21.15.88:0/2236357863 >> v2:172.21.15.88:3300/0 conn(0x7f1138156bb0 0x7f113815a1a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-26T23:41:27.397 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:27.393+0000 7f1134ff9640 1 -- 172.21.15.88:0/2236357863 >> v2:172.21.15.88:3300/0 conn(0x7f1138156bb0 msgr2=0x7f113815a1a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T23:41:27.398 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:27.393+0000 7f1134ff9640 1 --2- 172.21.15.88:0/2236357863 >> v2:172.21.15.88:3300/0 conn(0x7f1138156bb0 0x7f113815a1a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:27.398 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:27.393+0000 7f1134ff9640 1 -- 172.21.15.88:0/2236357863 >> v1:172.21.15.175:6789/0 conn(0x7f1138154160 legacy=0x7f11380c6e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:27.398 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:27.393+0000 7f1134ff9640 1 -- 172.21.15.88:0/2236357863 >> v1:172.21.15.88:6789/0 conn(0x7f11380ca5a0 legacy=0x7f11380c9590 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T23:41:27.398 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:27.393+0000 7f1134ff9640 1 --2- 172.21.15.88:0/2236357863 >> v2:172.21.15.175:3300/0 conn(0x7f11240036c0 0x7f1124005b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:27.398 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:27.393+0000 7f1134ff9640 1 --2- 172.21.15.88:0/2236357863 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1124006130 0x7f11240085d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:27.398 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:27.393+0000 7f1134ff9640 1 -- 172.21.15.88:0/2236357863 --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f1124008cc0 con 0x7f11240036c0 2024-04-26T23:41:27.398 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:27.393+0000 7f1134ff9640 1 -- 172.21.15.88:0/2236357863 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f1124008e70 con 0x7f1124006130 2024-04-26T23:41:27.398 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:27.393+0000 7f1136ffd640 1 --2- 172.21.15.88:0/2236357863 >> v2:172.21.15.175:3300/0 conn(0x7f11240036c0 0x7f1124005b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:27.398 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:27.393+0000 7f11367fc640 1 --2- 172.21.15.88:0/2236357863 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1124006130 0x7f11240085d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:27.398 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:27.393+0000 7f11367fc640 1 -- 172.21.15.88:0/2236357863 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1124006130 msgr2=0x7f11240085d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-26T23:41:27.398 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:27.393+0000 7f1136ffd640 1 -- 172.21.15.88:0/2236357863 >> v2:172.21.15.175:3300/0 conn(0x7f11240036c0 msgr2=0x7f1124005b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-26T23:41:27.398 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:27.393+0000 7f11367fc640 1 -- 172.21.15.88:0/2236357863 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1124006130 msgr2=0x7f11240085d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T23:41:27.398 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:27.393+0000 7f1136ffd640 1 -- 172.21.15.88:0/2236357863 >> v2:172.21.15.175:3300/0 conn(0x7f11240036c0 msgr2=0x7f1124005b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T23:41:27.398 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:27.393+0000 7f11367fc640 1 --2- 172.21.15.88:0/2236357863 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1124006130 0x7f11240085d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:41:27.398 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:27.393+0000 7f1136ffd640 1 --2- 172.21.15.88:0/2236357863 >> v2:172.21.15.175:3300/0 conn(0x7f11240036c0 0x7f1124005b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:41:27.399 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:27.393+0000 7f11367fc640 1 --2- 172.21.15.88:0/2236357863 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1124006130 0x7f11240085d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:41:27.399 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:27.393+0000 7f1136ffd640 1 --2- 172.21.15.88:0/2236357863 >> v2:172.21.15.175:3300/0 conn(0x7f11240036c0 0x7f1124005b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:41:27.598 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:27.594+0000 7f1136ffd640 1 --2- 172.21.15.88:0/2236357863 >> v2:172.21.15.175:3300/0 conn(0x7f11240036c0 0x7f1124005b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:27.599 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:27.594+0000 7f11367fc640 1 --2- 172.21.15.88:0/2236357863 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1124006130 0x7f11240085d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:27.599 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:27.594+0000 7f11367fc640 1 -- 172.21.15.88:0/2236357863 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1124006130 msgr2=0x7f11240085d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-26T23:41:27.599 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:27.594+0000 7f11367fc640 1 -- 172.21.15.88:0/2236357863 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1124006130 msgr2=0x7f11240085d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T23:41:27.599 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:27.594+0000 7f11367fc640 1 --2- 172.21.15.88:0/2236357863 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1124006130 0x7f11240085d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:41:27.599 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:27.594+0000 7f11367fc640 1 --2- 172.21.15.88:0/2236357863 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1124006130 0x7f11240085d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-26T23:41:27.599 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:27.594+0000 7f1136ffd640 1 -- 172.21.15.88:0/2236357863 >> v2:172.21.15.175:3300/0 conn(0x7f11240036c0 msgr2=0x7f1124005b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-26T23:41:27.599 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:27.594+0000 7f1136ffd640 1 -- 172.21.15.88:0/2236357863 >> v2:172.21.15.175:3300/0 conn(0x7f11240036c0 msgr2=0x7f1124005b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T23:41:27.599 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:27.594+0000 7f1136ffd640 1 --2- 172.21.15.88:0/2236357863 >> v2:172.21.15.175:3300/0 conn(0x7f11240036c0 0x7f1124005b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:41:27.599 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:27.594+0000 7f1136ffd640 1 --2- 172.21.15.88:0/2236357863 >> v2:172.21.15.175:3300/0 conn(0x7f11240036c0 0x7f1124005b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-26T23:41:27.999 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:27.995+0000 7f1136ffd640 1 --2- 172.21.15.88:0/2236357863 >> v2:172.21.15.175:3300/0 conn(0x7f11240036c0 0x7f1124005b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:28.000 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:27.995+0000 7f11367fc640 1 --2- 172.21.15.88:0/2236357863 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1124006130 0x7f11240085d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:28.000 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:27.995+0000 7f11367fc640 1 -- 172.21.15.88:0/2236357863 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1124006130 msgr2=0x7f11240085d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-26T23:41:28.000 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:27.995+0000 7f11367fc640 1 -- 172.21.15.88:0/2236357863 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1124006130 msgr2=0x7f11240085d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T23:41:28.000 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:27.995+0000 7f11367fc640 1 --2- 172.21.15.88:0/2236357863 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1124006130 0x7f11240085d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:41:28.000 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:27.995+0000 7f1136ffd640 1 -- 172.21.15.88:0/2236357863 >> v2:172.21.15.175:3300/0 conn(0x7f11240036c0 msgr2=0x7f1124005b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-26T23:41:28.000 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:27.995+0000 7f1136ffd640 1 -- 172.21.15.88:0/2236357863 >> v2:172.21.15.175:3300/0 conn(0x7f11240036c0 msgr2=0x7f1124005b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T23:41:28.000 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:27.995+0000 7f1136ffd640 1 --2- 172.21.15.88:0/2236357863 >> v2:172.21.15.175:3300/0 conn(0x7f11240036c0 0x7f1124005b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:41:28.000 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:27.995+0000 7f11367fc640 1 --2- 172.21.15.88:0/2236357863 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1124006130 0x7f11240085d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-26T23:41:28.000 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:27.995+0000 7f1136ffd640 1 --2- 172.21.15.88:0/2236357863 >> v2:172.21.15.175:3300/0 conn(0x7f11240036c0 0x7f1124005b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-26T23:41:28.801 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:28.797+0000 7f1136ffd640 1 --2- 172.21.15.88:0/2236357863 >> v2:172.21.15.175:3300/0 conn(0x7f11240036c0 0x7f1124005b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:28.801 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:28.797+0000 7f11367fc640 1 --2- 172.21.15.88:0/2236357863 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1124006130 0x7f11240085d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:28.801 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:28.797+0000 7f1136ffd640 1 -- 172.21.15.88:0/2236357863 >> v2:172.21.15.175:3300/0 conn(0x7f11240036c0 msgr2=0x7f1124005b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-26T23:41:28.802 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:28.797+0000 7f11367fc640 1 -- 172.21.15.88:0/2236357863 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1124006130 msgr2=0x7f11240085d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-26T23:41:28.802 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:28.797+0000 7f11367fc640 1 -- 172.21.15.88:0/2236357863 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1124006130 msgr2=0x7f11240085d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T23:41:28.802 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:28.797+0000 7f1136ffd640 1 -- 172.21.15.88:0/2236357863 >> v2:172.21.15.175:3300/0 conn(0x7f11240036c0 msgr2=0x7f1124005b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T23:41:28.802 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:28.797+0000 7f11367fc640 1 --2- 172.21.15.88:0/2236357863 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1124006130 0x7f11240085d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:41:28.802 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:28.797+0000 7f1136ffd640 1 --2- 172.21.15.88:0/2236357863 >> v2:172.21.15.175:3300/0 conn(0x7f11240036c0 0x7f1124005b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:41:28.802 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:28.797+0000 7f11367fc640 1 --2- 172.21.15.88:0/2236357863 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1124006130 0x7f11240085d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-26T23:41:28.802 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:28.797+0000 7f1136ffd640 1 --2- 172.21.15.88:0/2236357863 >> v2:172.21.15.175:3300/0 conn(0x7f11240036c0 0x7f1124005b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-26T23:41:30.398 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.393+0000 7f1134ff9640 1 -- 172.21.15.88:0/2236357863 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1124006130 msgr2=0x7f11240085d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T23:41:30.398 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.393+0000 7f1134ff9640 1 --2- 172.21.15.88:0/2236357863 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1124006130 0x7f11240085d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:30.398 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.393+0000 7f1134ff9640 1 -- 172.21.15.88:0/2236357863 >> v2:172.21.15.175:3300/0 conn(0x7f11240036c0 msgr2=0x7f1124005b40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T23:41:30.398 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.393+0000 7f1134ff9640 1 --2- 172.21.15.88:0/2236357863 >> v2:172.21.15.175:3300/0 conn(0x7f11240036c0 0x7f1124005b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:30.398 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.393+0000 7f11377fe640 1 -- 172.21.15.88:0/2236357863 reap_dead start 2024-04-26T23:41:30.398 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.393+0000 7f1134ff9640 1 --2- 172.21.15.88:0/2236357863 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1124006130 0x7f11240101b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:30.398 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.393+0000 7f1134ff9640 1 -- 172.21.15.88:0/2236357863 --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f113815a910 con 0x7f11380ca5a0 2024-04-26T23:41:30.398 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.393+0000 7f1134ff9640 1 -- 172.21.15.88:0/2236357863 --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f11240086e0 con 0x7f1138154160 2024-04-26T23:41:30.398 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.393+0000 7f1134ff9640 1 -- 172.21.15.88:0/2236357863 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f1124008cc0 con 0x7f1124006130 2024-04-26T23:41:30.398 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.393+0000 7f11367fc640 1 -- 172.21.15.88:0/2236357863 >> v1:172.21.15.88:6789/0 conn(0x7f11380ca5a0 legacy=0x7f112400ea90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.88:6789/0 2024-04-26T23:41:30.399 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.393+0000 7f11377fe640 1 --2- 172.21.15.88:0/2236357863 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1124006130 0x7f11240101b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:30.399 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.394+0000 7f1135ffb640 1 -- 172.21.15.88:0/2236357863 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4005557548 0 0) 0x7f11240086e0 con 0x7f1138154160 2024-04-26T23:41:30.399 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.394+0000 7f1135ffb640 1 -- 172.21.15.88:0/2236357863 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1120003520 con 0x7f1138154160 2024-04-26T23:41:30.399 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.394+0000 7f11377fe640 1 -- 172.21.15.88:0/2236357863 >> v1:172.21.15.175:6789/0 conn(0x7f1138154160 legacy=0x7f112400b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:30.399 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.394+0000 7f11377fe640 1 -- 172.21.15.88:0/2236357863 >> v1:172.21.15.88:6789/0 conn(0x7f11380ca5a0 legacy=0x7f112400ea90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T23:41:30.399 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.394+0000 7f11377fe640 1 -- 172.21.15.88:0/2236357863 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11240088b0 con 0x7f1124006130 2024-04-26T23:41:30.400 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.395+0000 7f11377fe640 1 --2- 172.21.15.88:0/2236357863 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1124006130 0x7f11240101b0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f113808e690 tx=0x7f113002a850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4e779eeee4e9952c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:30.400 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.395+0000 7f1135ffb640 1 -- 172.21.15.88:0/2236357863 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1130033630 con 0x7f1124006130 2024-04-26T23:41:30.400 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.395+0000 7f1135ffb640 1 -- 172.21.15.88:0/2236357863 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11300337f0 con 0x7f1124006130 2024-04-26T23:41:30.400 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.395+0000 7f1135ffb640 1 -- 172.21.15.88:0/2236357863 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1130033be0 con 0x7f1124006130 2024-04-26T23:41:30.400 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.396+0000 7f113d493640 1 -- 172.21.15.88:0/2236357863 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1124006130 msgr2=0x7f11240101b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:30.400 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.396+0000 7f113d493640 1 --2- 172.21.15.88:0/2236357863 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1124006130 0x7f11240101b0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f113808e690 tx=0x7f113002a850 comp rx=0 tx=0).stop 2024-04-26T23:41:30.400 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.396+0000 7f113d493640 1 -- 172.21.15.88:0/2236357863 shutdown_connections 2024-04-26T23:41:30.401 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.396+0000 7f113d493640 1 --2- 172.21.15.88:0/2236357863 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1124006130 0x7f11240101b0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:30.401 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.396+0000 7f113d493640 1 -- 172.21.15.88:0/2236357863 >> 172.21.15.88:0/2236357863 conn(0x7f11380ae010 msgr2=0x7f11380ae3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:30.401 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.396+0000 7f113d493640 1 -- 172.21.15.88:0/2236357863 shutdown_connections 2024-04-26T23:41:30.401 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.396+0000 7f113d493640 1 -- 172.21.15.88:0/2236357863 wait complete. 2024-04-26T23:41:30.401 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.397+0000 7f113d493640 1 Processor -- start 2024-04-26T23:41:30.401 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.397+0000 7f113d493640 1 -- start start 2024-04-26T23:41:30.404 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.398+0000 7f113d493640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1124006130 0x7f113814d250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:30.404 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.398+0000 7f113d493640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f11380ca5a0 0x7f1138158ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:30.404 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.398+0000 7f113d493640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1138154160 0x7f1138151d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:30.404 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.398+0000 7f113d493640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f113815aed0 con 0x7f1124006130 2024-04-26T23:41:30.404 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.398+0000 7f113d493640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f11380c9100 con 0x7f1138154160 2024-04-26T23:41:30.404 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.398+0000 7f113d493640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f113815a1a0 con 0x7f11380ca5a0 2024-04-26T23:41:30.404 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.398+0000 7f1136ffd640 1 -- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1124006130 msgr2=0x7f113814d250 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.88:3300/0 2024-04-26T23:41:30.404 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.398+0000 7f1136ffd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1124006130 0x7f113814d250 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:41:30.404 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.399+0000 7f11377fe640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1138154160 0x7f1138151d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:30.404 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.399+0000 7f11367fc640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f11380ca5a0 0x7f1138158ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:30.404 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.399+0000 7f11377fe640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1138154160 0x7f1138151d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.88:49358/0 (socket says 172.21.15.88:49358) 2024-04-26T23:41:30.404 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.399+0000 7f11377fe640 1 -- 172.21.15.88:0/223983269 learned_addr learned my addr 172.21.15.88:0/223983269 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:41:30.405 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.399+0000 7f11367fc640 1 -- 172.21.15.88:0/223983269 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1138154160 msgr2=0x7f1138151d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:30.405 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.399+0000 7f11367fc640 1 --2- 172.21.15.88:0/223983269 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1138154160 0x7f1138151d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:30.405 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.399+0000 7f11367fc640 1 -- 172.21.15.88:0/223983269 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1124006130 msgr2=0x7f113814d250 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T23:41:30.405 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.399+0000 7f11367fc640 1 --2- 172.21.15.88:0/223983269 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1124006130 0x7f113814d250 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:30.405 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.399+0000 7f11367fc640 1 -- 172.21.15.88:0/223983269 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11381ece70 con 0x7f11380ca5a0 2024-04-26T23:41:30.405 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.399+0000 7f11377fe640 1 --2- 172.21.15.88:0/223983269 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1138154160 0x7f1138151d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:41:30.405 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.399+0000 7f11367fc640 1 --2- 172.21.15.88:0/223983269 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f11380ca5a0 0x7f1138158ff0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f112c000ea0 tx=0x7f112c005420 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:30.405 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.399+0000 7f111f7fe640 1 -- 172.21.15.88:0/223983269 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f112c017680 con 0x7f11380ca5a0 2024-04-26T23:41:30.405 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.399+0000 7f111f7fe640 1 -- 172.21.15.88:0/223983269 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f112c017820 con 0x7f11380ca5a0 2024-04-26T23:41:30.405 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.399+0000 7f113d493640 1 -- 172.21.15.88:0/223983269 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11381ed150 con 0x7f11380ca5a0 2024-04-26T23:41:30.405 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.399+0000 7f111f7fe640 1 -- 172.21.15.88:0/223983269 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f112c017c10 con 0x7f11380ca5a0 2024-04-26T23:41:30.406 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.399+0000 7f113d493640 1 -- 172.21.15.88:0/223983269 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f11381ed710 con 0x7f11380ca5a0 2024-04-26T23:41:30.407 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.401+0000 7f113d493640 1 -- 172.21.15.88:0/223983269 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1138076650 con 0x7f11380ca5a0 2024-04-26T23:41:30.407 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.401+0000 7f111f7fe640 1 -- 172.21.15.88:0/223983269 <== mon.2 v2:172.21.15.175:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f112c020400 con 0x7f11380ca5a0 2024-04-26T23:41:30.407 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.401+0000 7f111f7fe640 1 --2- 172.21.15.88:0/223983269 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f112406d800 0x7f112406fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:30.407 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.401+0000 7f111f7fe640 1 -- 172.21.15.88:0/223983269 <== mon.2 v2:172.21.15.175:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6666+0+0 (secure 0 0 0) 0x7f112c08d360 con 0x7f11380ca5a0 2024-04-26T23:41:30.407 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.401+0000 7f1136ffd640 1 --2- 172.21.15.88:0/223983269 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f112406d800 0x7f112406fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:30.407 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.402+0000 7f1136ffd640 1 --2- 172.21.15.88:0/223983269 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f112406d800 0x7f112406fcc0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f1128009010 tx=0x7f1128009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:30.410 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.406+0000 7f111f7fe640 1 -- 172.21.15.88:0/223983269 <== mon.2 v2:172.21.15.175:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f112c012050 con 0x7f11380ca5a0 2024-04-26T23:41:30.661 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.657+0000 7f113d493640 1 -- 172.21.15.88:0/223983269 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f11381ed910 con 0x7f11380ca5a0 2024-04-26T23:41:30.662 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.658+0000 7f111f7fe640 1 -- 172.21.15.88:0/223983269 <== mon.2 v2:172.21.15.175:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1557 (secure 0 0 0) 0x7f112c05b3c0 con 0x7f11380ca5a0 2024-04-26T23:41:30.662 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":6,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":1,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"555255e9-7ef9-4454-8dc9-35e96b70035c","modified":"2024-04-26T23:39:34.291658Z","created":"2024-04-26T23:39:34.291658Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:3300","nonce":0},{"type":"v1","addr":"172.21.15.175:6789","nonce":0}]},"addr":"172.21.15.175:6789/0","public_addr":"172.21.15.175:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:3301","nonce":0},{"type":"v1","addr":"172.21.15.175:6790","nonce":0}]},"addr":"172.21.15.175:6790/0","public_addr":"172.21.15.175:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-04-26T23:41:30.664 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.660+0000 7f113d493640 1 -- 172.21.15.88:0/223983269 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f112406d800 msgr2=0x7f112406fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:30.664 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.660+0000 7f113d493640 1 --2- 172.21.15.88:0/223983269 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f112406d800 0x7f112406fcc0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f1128009010 tx=0x7f1128009040 comp rx=0 tx=0).stop 2024-04-26T23:41:30.664 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.660+0000 7f113d493640 1 -- 172.21.15.88:0/223983269 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f11380ca5a0 msgr2=0x7f1138158ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:30.664 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.660+0000 7f113d493640 1 --2- 172.21.15.88:0/223983269 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f11380ca5a0 0x7f1138158ff0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f112c000ea0 tx=0x7f112c005420 comp rx=0 tx=0).stop 2024-04-26T23:41:30.664 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.660+0000 7f113d493640 1 -- 172.21.15.88:0/223983269 shutdown_connections 2024-04-26T23:41:30.665 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.660+0000 7f113d493640 1 --2- 172.21.15.88:0/223983269 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f112406d800 0x7f112406fcc0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:30.665 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.660+0000 7f113d493640 1 --2- 172.21.15.88:0/223983269 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f11380ca5a0 0x7f1138158ff0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:30.665 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.660+0000 7f113d493640 1 --2- 172.21.15.88:0/223983269 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1138154160 0x7f1138151d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:30.665 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.660+0000 7f113d493640 1 --2- 172.21.15.88:0/223983269 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1124006130 0x7f113814d250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:30.665 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.660+0000 7f113d493640 1 -- 172.21.15.88:0/223983269 >> 172.21.15.88:0/223983269 conn(0x7f11380ae010 msgr2=0x7f11380c9490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:30.665 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.660+0000 7f113d493640 1 -- 172.21.15.88:0/223983269 shutdown_connections 2024-04-26T23:41:30.665 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.660+0000 7f113d493640 1 -- 172.21.15.88:0/223983269 wait complete. 2024-04-26T23:41:30.675 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2024-04-26T23:41:30.675 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon b 2024-04-26T23:41:30.676 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-04-26T23:41:30.774 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.770+0000 7f27b94d1640 1 Processor -- start 2024-04-26T23:41:30.774 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.770+0000 7f27b94d1640 1 -- start start 2024-04-26T23:41:30.775 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.771+0000 7f27b94d1640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f27b413feb0 0x7f27b41576d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:30.775 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.771+0000 7f27b94d1640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f27b4156c10 con 0x7f27b40c5050 2024-04-26T23:41:30.775 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.771+0000 7f27b94d1640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f27b40c5570 con 0x7f27b40c2b80 2024-04-26T23:41:30.775 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.771+0000 7f27b94d1640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f27b415a8b0 con 0x7f27b413feb0 2024-04-26T23:41:30.775 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.771+0000 7f27abfff640 1 -- >> v1:172.21.15.88:6789/0 conn(0x7f27b40c5050 legacy=0x7f27b415a1a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.88:6789/0 2024-04-26T23:41:30.776 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.771+0000 7f27b2ffd640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f27b413feb0 0x7f27b41576d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:30.776 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.771+0000 7f27b2ffd640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f27b413feb0 0x7f27b41576d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.88:49374/0 (socket says 172.21.15.88:49374) 2024-04-26T23:41:30.776 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.771+0000 7f27b2ffd640 1 -- 172.21.15.88:0/3442462707 learned_addr learned my addr 172.21.15.88:0/3442462707 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:41:30.776 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.771+0000 7f27b2ffd640 1 -- 172.21.15.88:0/3442462707 >> v1:172.21.15.175:6789/0 conn(0x7f27b40c2b80 legacy=0x7f27b406d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:30.776 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.771+0000 7f27b2ffd640 1 -- 172.21.15.88:0/3442462707 >> v1:172.21.15.88:6789/0 conn(0x7f27b40c5050 legacy=0x7f27b415a1a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T23:41:30.776 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.771+0000 7f27b2ffd640 1 -- 172.21.15.88:0/3442462707 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27b40c5850 con 0x7f27b413feb0 2024-04-26T23:41:30.777 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.772+0000 7f27b2ffd640 1 --2- 172.21.15.88:0/3442462707 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f27b413feb0 0x7f27b41576d0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f27a4009870 tx=0x7f27a402a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=20d3bf31d80c3dc7 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:30.777 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.772+0000 7f27b27fc640 1 -- 172.21.15.88:0/3442462707 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27a4037070 con 0x7f27b413feb0 2024-04-26T23:41:30.777 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.772+0000 7f27b27fc640 1 -- 172.21.15.88:0/3442462707 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27a4032440 con 0x7f27b413feb0 2024-04-26T23:41:30.777 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.772+0000 7f27b27fc640 1 -- 172.21.15.88:0/3442462707 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27a4032810 con 0x7f27b413feb0 2024-04-26T23:41:30.778 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.773+0000 7f27b94d1640 1 -- 172.21.15.88:0/3442462707 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f27b413feb0 msgr2=0x7f27b41576d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:30.778 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.773+0000 7f27b94d1640 1 --2- 172.21.15.88:0/3442462707 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f27b413feb0 0x7f27b41576d0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f27a4009870 tx=0x7f27a402a180 comp rx=0 tx=0).stop 2024-04-26T23:41:30.778 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.773+0000 7f27b94d1640 1 -- 172.21.15.88:0/3442462707 shutdown_connections 2024-04-26T23:41:30.778 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.773+0000 7f27b94d1640 1 --2- 172.21.15.88:0/3442462707 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f27b413feb0 0x7f27b41576d0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:30.778 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.773+0000 7f27b94d1640 1 -- 172.21.15.88:0/3442462707 >> 172.21.15.88:0/3442462707 conn(0x7f27b40c5ce0 msgr2=0x7f27b40c60c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:30.778 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.773+0000 7f27b94d1640 1 -- 172.21.15.88:0/3442462707 shutdown_connections 2024-04-26T23:41:30.778 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.773+0000 7f27b94d1640 1 -- 172.21.15.88:0/3442462707 wait complete. 2024-04-26T23:41:30.782 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.774+0000 7f27b94d1640 1 Processor -- start 2024-04-26T23:41:30.782 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.774+0000 7f27b94d1640 1 -- start start 2024-04-26T23:41:30.782 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.775+0000 7f27b94d1640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f27b40c2b80 0x7f27b41ed220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:30.782 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.775+0000 7f27b94d1640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f27b40c5050 0x7f27b4153dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:30.782 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.775+0000 7f27b94d1640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f27b413feb0 0x7f27b4140290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:30.782 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.775+0000 7f27b94d1640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f27b406da30 con 0x7f27b40c5050 2024-04-26T23:41:30.782 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.775+0000 7f27b94d1640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f27b4157240 con 0x7f27b40c2b80 2024-04-26T23:41:30.783 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.775+0000 7f27b94d1640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f27b406dbb0 con 0x7f27b413feb0 2024-04-26T23:41:30.783 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.775+0000 7f27abfff640 1 -- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f27b40c5050 msgr2=0x7f27b4153dd0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.88:3300/0 2024-04-26T23:41:30.783 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.775+0000 7f27abfff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f27b40c5050 0x7f27b4153dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:41:30.783 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.775+0000 7f27b2ffd640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f27b40c2b80 0x7f27b41ed220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:30.783 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.775+0000 7f27b37fe640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f27b413feb0 0x7f27b4140290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:30.783 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.775+0000 7f27b2ffd640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f27b40c2b80 0x7f27b41ed220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.88:49378/0 (socket says 172.21.15.88:49378) 2024-04-26T23:41:30.783 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.775+0000 7f27b37fe640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f27b413feb0 0x7f27b4140290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.88:39254/0 (socket says 172.21.15.88:39254) 2024-04-26T23:41:30.783 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.775+0000 7f27b2ffd640 1 -- 172.21.15.88:0/619864192 learned_addr learned my addr 172.21.15.88:0/619864192 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:41:30.783 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.775+0000 7f27b2ffd640 1 -- 172.21.15.88:0/619864192 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f27b413feb0 msgr2=0x7f27b4140290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:30.783 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.775+0000 7f27b2ffd640 1 --2- 172.21.15.88:0/619864192 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f27b413feb0 0x7f27b4140290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:30.783 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.775+0000 7f27b2ffd640 1 -- 172.21.15.88:0/619864192 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f27b40c5050 msgr2=0x7f27b4153dd0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T23:41:30.783 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.775+0000 7f27b2ffd640 1 --2- 172.21.15.88:0/619864192 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f27b40c5050 0x7f27b4153dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:30.784 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.775+0000 7f27b2ffd640 1 -- 172.21.15.88:0/619864192 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27b4154310 con 0x7f27b40c2b80 2024-04-26T23:41:30.784 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.776+0000 7f27b2ffd640 1 --2- 172.21.15.88:0/619864192 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f27b40c2b80 0x7f27b41ed220 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f27a40097c0 tx=0x7f27a40046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:30.784 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.776+0000 7f27ab7fe640 1 -- 172.21.15.88:0/619864192 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27a4041070 con 0x7f27b40c2b80 2024-04-26T23:41:30.784 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.776+0000 7f27ab7fe640 1 -- 172.21.15.88:0/619864192 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27a40308d0 con 0x7f27b40c2b80 2024-04-26T23:41:30.784 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.776+0000 7f27ab7fe640 1 -- 172.21.15.88:0/619864192 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27a4037040 con 0x7f27b40c2b80 2024-04-26T23:41:30.784 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.776+0000 7f27b94d1640 1 -- 172.21.15.88:0/619864192 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27b413cee0 con 0x7f27b40c2b80 2024-04-26T23:41:30.784 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.776+0000 7f27b94d1640 1 -- 172.21.15.88:0/619864192 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27b40ac670 con 0x7f27b40c2b80 2024-04-26T23:41:30.784 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.777+0000 7f27b94d1640 1 --2- 172.21.15.88:0/619864192 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f27b41407d0 0x7f27b40ad290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:30.784 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.777+0000 7f27b94d1640 1 -- 172.21.15.88:0/619864192 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f27b40507a0 con 0x7f27b41407d0 2024-04-26T23:41:30.784 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.777+0000 7f27abfff640 1 --2- 172.21.15.88:0/619864192 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f27b41407d0 0x7f27b40ad290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:30.784 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.777+0000 7f27abfff640 1 -- 172.21.15.88:0/619864192 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f27b4069630 con 0x7f27b41407d0 2024-04-26T23:41:30.784 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.777+0000 7f27abfff640 1 --2- 172.21.15.88:0/619864192 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f27b41407d0 0x7f27b40ad290 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f27b413cbd0 tx=0x7f279c00b8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:30.784 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.777+0000 7f27ab7fe640 1 -- 172.21.15.88:0/619864192 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f27a4044070 con 0x7f27b40c2b80 2024-04-26T23:41:30.785 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.778+0000 7f27ab7fe640 1 --2- 172.21.15.88:0/619864192 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f279406c8a0 0x7f279406ed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:30.785 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.778+0000 7f27ab7fe640 1 -- 172.21.15.88:0/619864192 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6666+0+0 (secure 0 0 0) 0x7f27a40aca70 con 0x7f27b40c2b80 2024-04-26T23:41:30.785 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.778+0000 7f27b37fe640 1 --2- 172.21.15.88:0/619864192 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f279406c8a0 0x7f279406ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:30.785 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.778+0000 7f27ab7fe640 1 -- 172.21.15.88:0/619864192 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f279c003e10 con 0x7f27b41407d0 2024-04-26T23:41:30.785 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.778+0000 7f27ab7fe640 1 -- 172.21.15.88:0/619864192 <== mon.1 v2:172.21.15.175:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f279c015070 con 0x7f27b41407d0 2024-04-26T23:41:30.785 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.778+0000 7f27ab7fe640 1 -- 172.21.15.88:0/619864192 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f27b41407d0 msgr2=0x7f27b40ad290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:30.785 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.778+0000 7f27ab7fe640 1 --2- 172.21.15.88:0/619864192 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f27b41407d0 0x7f27b40ad290 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f27b413cbd0 tx=0x7f279c00b8c0 comp rx=0 tx=0).stop 2024-04-26T23:41:30.785 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.778+0000 7f27ab7fe640 1 -- 172.21.15.88:0/619864192 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f27b41407d0 msgr2=0x7f27b40ad290 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:41:30.785 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.778+0000 7f27ab7fe640 1 --2- 172.21.15.88:0/619864192 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f27b41407d0 0x7f27b40ad290 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:30.785 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.778+0000 7f27b37fe640 1 --2- 172.21.15.88:0/619864192 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f279406c8a0 0x7f279406ed60 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f27ac0012e0 tx=0x7f27ac009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:30.788 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.784+0000 7f27b94d1640 1 --2- 172.21.15.88:0/619864192 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f27b40ac840 0x7f27b40ad950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:30.789 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.784+0000 7f27b94d1640 1 -- 172.21.15.88:0/619864192 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f27b406dd30 con 0x7f27b40ac840 2024-04-26T23:41:30.789 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.785+0000 7f27abfff640 1 --2- 172.21.15.88:0/619864192 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f27b40ac840 0x7f27b40ad950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:30.789 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.785+0000 7f27abfff640 1 -- 172.21.15.88:0/619864192 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f27b406a350 con 0x7f27b40ac840 2024-04-26T23:41:30.790 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.785+0000 7f27abfff640 1 --2- 172.21.15.88:0/619864192 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f27b40ac840 0x7f27b40ad950 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f279c006fd0 tx=0x7f279c005a20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:30.790 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.785+0000 7f27ab7fe640 1 -- 172.21.15.88:0/619864192 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f279c005820 con 0x7f27b40ac840 2024-04-26T23:41:30.790 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.786+0000 7f27ab7fe640 1 -- 172.21.15.88:0/619864192 <== mon.1 v2:172.21.15.175:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5054 (secure 0 0 0) 0x7f279c005820 con 0x7f27b40ac840 2024-04-26T23:41:30.790 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.786+0000 7f27ab7fe640 1 -- 172.21.15.88:0/619864192 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f27b40ac840 msgr2=0x7f27b40ad950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:30.790 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.786+0000 7f27ab7fe640 1 --2- 172.21.15.88:0/619864192 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f27b40ac840 0x7f27b40ad950 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f279c006fd0 tx=0x7f279c005a20 comp rx=0 tx=0).stop 2024-04-26T23:41:30.790 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.786+0000 7f27ab7fe640 1 -- 172.21.15.88:0/619864192 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f27b40ac840 msgr2=0x7f27b40ad950 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:41:30.790 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.786+0000 7f27ab7fe640 1 --2- 172.21.15.88:0/619864192 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f27b40ac840 0x7f27b40ad950 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:30.791 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-04-26T23:41:30.791 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2024-04-26T23:41:30.791 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2024-04-26T23:41:30.791 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "leader", 2024-04-26T23:41:30.791 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 6, 2024-04-26T23:41:30.791 INFO:teuthology.orchestra.run.smithi088.stdout: "uptime": 83129, 2024-04-26T23:41:30.791 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2024-04-26T23:41:30.791 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2024-04-26T23:41:30.791 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2024-04-26T23:41:30.791 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:41:30.791 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 1, 2024-04-26T23:41:30.791 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2024-04-26T23:41:30.792 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2450521708007866372", 2024-04-26T23:41:30.792 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2024-04-26T23:41:30.792 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-04-26T23:41:30.792 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-04-26T23:41:30.792 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-04-26T23:41:30.792 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-04-26T23:41:30.792 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-04-26T23:41:30.792 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-04-26T23:41:30.792 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-04-26T23:41:30.792 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-04-26T23:41:30.792 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-04-26T23:41:30.792 INFO:teuthology.orchestra.run.smithi088.stdout: "reef", 2024-04-26T23:41:30.792 INFO:teuthology.orchestra.run.smithi088.stdout: "squid" 2024-04-26T23:41:30.792 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:41:30.793 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540701547738038271", 2024-04-26T23:41:30.793 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2024-04-26T23:41:30.793 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-04-26T23:41:30.793 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-04-26T23:41:30.793 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-04-26T23:41:30.793 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-04-26T23:41:30.793 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-04-26T23:41:30.793 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-04-26T23:41:30.793 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-04-26T23:41:30.793 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-04-26T23:41:30.793 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-04-26T23:41:30.793 INFO:teuthology.orchestra.run.smithi088.stdout: "reef", 2024-04-26T23:41:30.793 INFO:teuthology.orchestra.run.smithi088.stdout: "squid" 2024-04-26T23:41:30.793 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:41:30.793 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:41:30.794 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2024-04-26T23:41:30.794 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2024-04-26T23:41:30.794 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2024-04-26T23:41:30.794 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2024-04-26T23:41:30.794 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2024-04-26T23:41:30.794 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "555255e9-7ef9-4454-8dc9-35e96b70035c", 2024-04-26T23:41:30.794 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2024-04-26T23:39:34.291658Z", 2024-04-26T23:41:30.794 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2024-04-26T23:39:34.291658Z", 2024-04-26T23:41:30.794 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 19, 2024-04-26T23:41:30.794 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "squid", 2024-04-26T23:41:30.794 INFO:teuthology.orchestra.run.smithi088.stdout: "election_strategy": 1, 2024-04-26T23:41:30.794 INFO:teuthology.orchestra.run.smithi088.stdout: "disallowed_leaders: ": "", 2024-04-26T23:41:30.794 INFO:teuthology.orchestra.run.smithi088.stdout: "stretch_mode": false, 2024-04-26T23:41:30.794 INFO:teuthology.orchestra.run.smithi088.stdout: "tiebreaker_mon": "", 2024-04-26T23:41:30.795 INFO:teuthology.orchestra.run.smithi088.stdout: "removed_ranks: ": "", 2024-04-26T23:41:30.795 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2024-04-26T23:41:30.795 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2024-04-26T23:41:30.795 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-04-26T23:41:30.795 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-04-26T23:41:30.795 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-04-26T23:41:30.795 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-04-26T23:41:30.795 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-04-26T23:41:30.795 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-04-26T23:41:30.795 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-04-26T23:41:30.795 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-04-26T23:41:30.795 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-04-26T23:41:30.795 INFO:teuthology.orchestra.run.smithi088.stdout: "reef", 2024-04-26T23:41:30.795 INFO:teuthology.orchestra.run.smithi088.stdout: "squid" 2024-04-26T23:41:30.795 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:41:30.796 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2024-04-26T23:41:30.796 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:41:30.796 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2024-04-26T23:41:30.796 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:41:30.796 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2024-04-26T23:41:30.796 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2024-04-26T23:41:30.796 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-04-26T23:41:30.796 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-04-26T23:41:30.796 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:41:30.796 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-04-26T23:41:30.796 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2024-04-26T23:41:30.796 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:41:30.796 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:41:30.796 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:41:30.797 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-04-26T23:41:30.797 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2024-04-26T23:41:30.797 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:41:30.797 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:41:30.797 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:41:30.797 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:41:30.797 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2024-04-26T23:41:30.797 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2024-04-26T23:41:30.797 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-04-26T23:41:30.797 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-04-26T23:41:30.797 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-04-26T23:41:30.797 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:41:30.797 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:41:30.797 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2024-04-26T23:41:30.797 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2024-04-26T23:41:30.798 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-04-26T23:41:30.798 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-04-26T23:41:30.798 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:41:30.798 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-04-26T23:41:30.798 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:3300", 2024-04-26T23:41:30.798 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:41:30.798 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:41:30.798 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:41:30.798 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-04-26T23:41:30.798 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6789", 2024-04-26T23:41:30.798 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:41:30.798 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:41:30.798 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:41:30.798 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:41:30.799 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6789/0", 2024-04-26T23:41:30.799 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.175:6789/0", 2024-04-26T23:41:30.799 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-04-26T23:41:30.799 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-04-26T23:41:30.799 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-04-26T23:41:30.799 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:41:30.799 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:41:30.799 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2024-04-26T23:41:30.799 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2024-04-26T23:41:30.799 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-04-26T23:41:30.799 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-04-26T23:41:30.799 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:41:30.799 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-04-26T23:41:30.799 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:3301", 2024-04-26T23:41:30.799 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:41:30.800 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:41:30.800 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:41:30.800 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-04-26T23:41:30.800 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6790", 2024-04-26T23:41:30.800 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:41:30.800 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:41:30.800 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:41:30.800 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:41:30.800 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6790/0", 2024-04-26T23:41:30.800 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.175:6790/0", 2024-04-26T23:41:30.800 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-04-26T23:41:30.800 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-04-26T23:41:30.800 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-04-26T23:41:30.800 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:41:30.801 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:41:30.801 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:41:30.801 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2024-04-26T23:41:30.801 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2024-04-26T23:41:30.801 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:41:30.801 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:41:30.801 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:41:30.801 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2024-04-26T23:41:30.801 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:41:30.801 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:41:30.801 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": [ 2024-04-26T23:41:30.801 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:41:30.801 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:41:30.801 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:41:30.802 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 3 2024-04-26T23:41:30.802 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:41:30.802 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:41:30.802 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": [ 2024-04-26T23:41:30.802 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:41:30.802 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:41:30.802 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:41:30.802 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2024-04-26T23:41:30.802 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:41:30.802 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:41:30.802 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2024-04-26T23:41:30.802 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:41:30.802 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:41:30.803 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:41:30.803 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 3 2024-04-26T23:41:30.803 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:41:30.803 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:41:30.803 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": [ 2024-04-26T23:41:30.803 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:41:30.803 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:41:30.803 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:41:30.803 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2024-04-26T23:41:30.803 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:41:30.803 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:41:30.803 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:41:30.803 INFO:teuthology.orchestra.run.smithi088.stdout: "stretch_mode": false 2024-04-26T23:41:30.803 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-04-26T23:41:30.805 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.786+0000 7f27b94d1640 1 -- 172.21.15.88:0/619864192 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f279406c8a0 msgr2=0x7f279406ed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:30.805 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.786+0000 7f27b94d1640 1 --2- 172.21.15.88:0/619864192 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f279406c8a0 0x7f279406ed60 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f27ac0012e0 tx=0x7f27ac009040 comp rx=0 tx=0).stop 2024-04-26T23:41:30.805 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.786+0000 7f27b94d1640 1 -- 172.21.15.88:0/619864192 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f27b40c2b80 msgr2=0x7f27b41ed220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:30.805 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.786+0000 7f27b94d1640 1 --2- 172.21.15.88:0/619864192 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f27b40c2b80 0x7f27b41ed220 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f27a40097c0 tx=0x7f27a40046c0 comp rx=0 tx=0).stop 2024-04-26T23:41:30.805 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.786+0000 7f27b37fe640 1 -- 172.21.15.88:0/619864192 reap_dead start 2024-04-26T23:41:30.805 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.786+0000 7f27b37fe640 1 -- 172.21.15.88:0/619864192 reap_dead start 2024-04-26T23:41:30.805 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.786+0000 7f27b94d1640 1 -- 172.21.15.88:0/619864192 shutdown_connections 2024-04-26T23:41:30.805 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.786+0000 7f27b94d1640 1 -- 172.21.15.88:0/619864192 >> 172.21.15.88:0/619864192 conn(0x7f27b40c5ce0 msgr2=0x7f27b406d0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:30.805 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.786+0000 7f27b94d1640 1 -- 172.21.15.88:0/619864192 shutdown_connections 2024-04-26T23:41:30.805 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.786+0000 7f27b94d1640 1 -- 172.21.15.88:0/619864192 wait complete. 2024-04-26T23:41:30.806 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-04-26T23:41:30.806 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon c 2024-04-26T23:41:30.806 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-04-26T23:41:30.904 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.900+0000 7fb8e55ec640 1 Processor -- start 2024-04-26T23:41:30.904 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.900+0000 7fb8e55ec640 1 -- start start 2024-04-26T23:41:30.907 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.901+0000 7fb8e55ec640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fb8e0154160 0x7fb8e0156bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:30.907 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.901+0000 7fb8e55ec640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fb8e015a1a0 0x7fb8e00c9590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:30.907 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.901+0000 7fb8e55ec640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb8e00c8df0 con 0x7fb8e00ca5a0 2024-04-26T23:41:30.907 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.901+0000 7fb8e55ec640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7fb8e00c9100 con 0x7fb8e015a1a0 2024-04-26T23:41:30.907 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.901+0000 7fb8e55ec640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7fb8e0154540 con 0x7fb8e0154160 2024-04-26T23:41:30.907 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.901+0000 7fb8df7fe640 1 -- >> v2:172.21.15.88:3300/0 conn(0x7fb8e015a1a0 msgr2=0x7fb8e00c9590 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.88:3300/0 2024-04-26T23:41:30.907 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.901+0000 7fb8de7fc640 1 -- >> v1:172.21.15.88:6789/0 conn(0x7fb8e00ca5a0 legacy=0x7fb8e00c6e00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.88:6789/0 2024-04-26T23:41:30.907 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.901+0000 7fb8df7fe640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fb8e015a1a0 0x7fb8e00c9590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:41:30.908 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.901+0000 7fb8deffd640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fb8e0154160 0x7fb8e0156bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:30.908 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.901+0000 7fb8deffd640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fb8e0154160 0x7fb8e0156bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.88:49404/0 (socket says 172.21.15.88:49404) 2024-04-26T23:41:30.908 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.901+0000 7fb8deffd640 1 -- 172.21.15.88:0/834468309 learned_addr learned my addr 172.21.15.88:0/834468309 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:41:30.908 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.901+0000 7fb8deffd640 1 -- 172.21.15.88:0/834468309 >> v2:172.21.15.88:3300/0 conn(0x7fb8e015a1a0 msgr2=0x7fb8e00c9590 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T23:41:30.908 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.901+0000 7fb8deffd640 1 --2- 172.21.15.88:0/834468309 >> v2:172.21.15.88:3300/0 conn(0x7fb8e015a1a0 0x7fb8e00c9590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:30.908 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.901+0000 7fb8deffd640 1 -- 172.21.15.88:0/834468309 >> v1:172.21.15.88:6789/0 conn(0x7fb8e00ca5a0 legacy=0x7fb8e00c6e00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T23:41:30.908 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.901+0000 7fb8deffd640 1 -- 172.21.15.88:0/834468309 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8e015a910 con 0x7fb8e0154160 2024-04-26T23:41:30.908 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.902+0000 7fb8deffd640 1 --2- 172.21.15.88:0/834468309 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb8e0154160 0x7fb8e0156bb0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fb8e00c9280 tx=0x7fb8d002a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9e22876d614a9be7 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:30.908 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.902+0000 7fb8ddffb640 1 -- 172.21.15.88:0/834468309 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8d0037070 con 0x7fb8e0154160 2024-04-26T23:41:30.908 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.902+0000 7fb8ddffb640 1 -- 172.21.15.88:0/834468309 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8d0032440 con 0x7fb8e0154160 2024-04-26T23:41:30.908 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.902+0000 7fb8ddffb640 1 -- 172.21.15.88:0/834468309 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8d0032810 con 0x7fb8e0154160 2024-04-26T23:41:30.908 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.903+0000 7fb8e55ec640 1 -- 172.21.15.88:0/834468309 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb8e0154160 msgr2=0x7fb8e0156bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:30.908 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.903+0000 7fb8e55ec640 1 --2- 172.21.15.88:0/834468309 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb8e0154160 0x7fb8e0156bb0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fb8e00c9280 tx=0x7fb8d002a230 comp rx=0 tx=0).stop 2024-04-26T23:41:30.909 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.903+0000 7fb8e55ec640 1 -- 172.21.15.88:0/834468309 shutdown_connections 2024-04-26T23:41:30.909 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.903+0000 7fb8e55ec640 1 --2- 172.21.15.88:0/834468309 >> v2:172.21.15.88:3300/0 conn(0x7fb8e015a1a0 0x7fb8e00c9590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:30.909 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.903+0000 7fb8e55ec640 1 --2- 172.21.15.88:0/834468309 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb8e0154160 0x7fb8e0156bb0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:30.909 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.903+0000 7fb8e55ec640 1 -- 172.21.15.88:0/834468309 >> 172.21.15.88:0/834468309 conn(0x7fb8e00ae010 msgr2=0x7fb8e00ae3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:30.909 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.903+0000 7fb8e55ec640 1 -- 172.21.15.88:0/834468309 shutdown_connections 2024-04-26T23:41:30.909 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.903+0000 7fb8e55ec640 1 -- 172.21.15.88:0/834468309 wait complete. 2024-04-26T23:41:30.913 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.904+0000 7fb8e55ec640 1 Processor -- start 2024-04-26T23:41:30.913 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.904+0000 7fb8e55ec640 1 -- start start 2024-04-26T23:41:30.913 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.905+0000 7fb8e55ec640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb8e00ca5a0 0x7fb8e0156670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:30.913 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.905+0000 7fb8e55ec640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb8e0154160 0x7fb8e0149800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:30.913 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.905+0000 7fb8e55ec640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb8e015a1a0 0x7fb8e0149d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:30.913 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.905+0000 7fb8e55ec640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fb8e015a5b0 con 0x7fb8e00ca5a0 2024-04-26T23:41:30.913 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.905+0000 7fb8e55ec640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fb8e015aed0 con 0x7fb8e0154160 2024-04-26T23:41:30.913 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.905+0000 7fb8e55ec640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fb8e00c7510 con 0x7fb8e015a1a0 2024-04-26T23:41:30.913 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.905+0000 7fb8deffd640 1 -- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb8e00ca5a0 msgr2=0x7fb8e0156670 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.88:3300/0 2024-04-26T23:41:30.913 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.905+0000 7fb8deffd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb8e00ca5a0 0x7fb8e0156670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:41:30.913 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.905+0000 7fb8de7fc640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb8e0154160 0x7fb8e0149800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:30.913 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.905+0000 7fb8df7fe640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb8e015a1a0 0x7fb8e0149d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:30.913 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.905+0000 7fb8de7fc640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb8e0154160 0x7fb8e0149800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.88:49416/0 (socket says 172.21.15.88:49416) 2024-04-26T23:41:30.914 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.905+0000 7fb8df7fe640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb8e015a1a0 0x7fb8e0149d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.88:39260/0 (socket says 172.21.15.88:39260) 2024-04-26T23:41:30.914 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.905+0000 7fb8de7fc640 1 -- 172.21.15.88:0/205369607 learned_addr learned my addr 172.21.15.88:0/205369607 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:41:30.914 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.906+0000 7fb8de7fc640 1 -- 172.21.15.88:0/205369607 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb8e015a1a0 msgr2=0x7fb8e0149d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:30.914 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.906+0000 7fb8de7fc640 1 --2- 172.21.15.88:0/205369607 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb8e015a1a0 0x7fb8e0149d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:30.914 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.906+0000 7fb8de7fc640 1 -- 172.21.15.88:0/205369607 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb8e00ca5a0 msgr2=0x7fb8e0156670 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T23:41:30.914 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.906+0000 7fb8de7fc640 1 --2- 172.21.15.88:0/205369607 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb8e00ca5a0 0x7fb8e0156670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:30.914 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.906+0000 7fb8de7fc640 1 -- 172.21.15.88:0/205369607 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8e01eff20 con 0x7fb8e0154160 2024-04-26T23:41:30.914 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.906+0000 7fb8de7fc640 1 --2- 172.21.15.88:0/205369607 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb8e0154160 0x7fb8e0149800 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fb8d400b550 tx=0x7fb8d400ba10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:30.914 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.906+0000 7fb8c77fe640 1 -- 172.21.15.88:0/205369607 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8d4003cf0 con 0x7fb8e0154160 2024-04-26T23:41:30.914 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.906+0000 7fb8c77fe640 1 -- 172.21.15.88:0/205369607 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8d4015070 con 0x7fb8e0154160 2024-04-26T23:41:30.914 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.906+0000 7fb8e55ec640 1 -- 172.21.15.88:0/205369607 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8e01f0200 con 0x7fb8e0154160 2024-04-26T23:41:30.914 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.906+0000 7fb8c77fe640 1 -- 172.21.15.88:0/205369607 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8d40052b0 con 0x7fb8e0154160 2024-04-26T23:41:30.914 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.906+0000 7fb8e55ec640 1 -- 172.21.15.88:0/205369607 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8e01f07c0 con 0x7fb8e0154160 2024-04-26T23:41:30.915 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.907+0000 7fb8e55ec640 1 --2- 172.21.15.88:0/205369607 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb8e014de10 0x7fb8e01ecc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:30.915 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.907+0000 7fb8e55ec640 1 -- 172.21.15.88:0/205369607 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fb8e00699d0 con 0x7fb8e014de10 2024-04-26T23:41:30.915 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.907+0000 7fb8deffd640 1 --2- 172.21.15.88:0/205369607 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb8e014de10 0x7fb8e01ecc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:30.915 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.907+0000 7fb8deffd640 1 -- 172.21.15.88:0/205369607 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb8e0076650 con 0x7fb8e014de10 2024-04-26T23:41:30.915 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.907+0000 7fb8deffd640 1 --2- 172.21.15.88:0/205369607 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb8e014de10 0x7fb8e01ecc00 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fb8e0069220 tx=0x7fb8d00046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:30.915 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.907+0000 7fb8c77fe640 1 -- 172.21.15.88:0/205369607 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb8d4005450 con 0x7fb8e0154160 2024-04-26T23:41:30.915 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.908+0000 7fb8c77fe640 1 --2- 172.21.15.88:0/205369607 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fb8cc06c8a0 0x7fb8cc06ed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:30.915 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.908+0000 7fb8df7fe640 1 --2- 172.21.15.88:0/205369607 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fb8cc06c8a0 0x7fb8cc06ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:30.915 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.908+0000 7fb8c77fe640 1 -- 172.21.15.88:0/205369607 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6666+0+0 (secure 0 0 0) 0x7fb8d408bbd0 con 0x7fb8e0154160 2024-04-26T23:41:30.915 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.908+0000 7fb8c77fe640 1 -- 172.21.15.88:0/205369607 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8d0037040 con 0x7fb8e014de10 2024-04-26T23:41:30.915 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.908+0000 7fb8c77fe640 1 -- 172.21.15.88:0/205369607 <== mon.2 v2:172.21.15.175:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fb8d0004020 con 0x7fb8e014de10 2024-04-26T23:41:30.915 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.908+0000 7fb8c77fe640 1 -- 172.21.15.88:0/205369607 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb8e014de10 msgr2=0x7fb8e01ecc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:30.915 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.908+0000 7fb8c77fe640 1 --2- 172.21.15.88:0/205369607 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb8e014de10 0x7fb8e01ecc00 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fb8e0069220 tx=0x7fb8d00046c0 comp rx=0 tx=0).stop 2024-04-26T23:41:30.915 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.908+0000 7fb8c77fe640 1 -- 172.21.15.88:0/205369607 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb8e014de10 msgr2=0x7fb8e01ecc00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:41:30.915 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.908+0000 7fb8c77fe640 1 --2- 172.21.15.88:0/205369607 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb8e014de10 0x7fb8e01ecc00 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:41:30.915 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.908+0000 7fb8df7fe640 1 --2- 172.21.15.88:0/205369607 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fb8cc06c8a0 0x7fb8cc06ed60 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fb8d8003cb0 tx=0x7fb8d800d040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:30.919 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.915+0000 7fb8e55ec640 1 --2- 172.21.15.88:0/205369607 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb8e01f0990 0x7fb8e01ed140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:41:30.919 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.915+0000 7fb8e55ec640 1 -- 172.21.15.88:0/205369607 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fb8e01eca20 con 0x7fb8e01f0990 2024-04-26T23:41:30.919 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.915+0000 7fb8deffd640 1 --2- 172.21.15.88:0/205369607 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb8e01f0990 0x7fb8e01ed140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:41:30.919 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.915+0000 7fb8deffd640 1 -- 172.21.15.88:0/205369607 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fb8e00507a0 con 0x7fb8e01f0990 2024-04-26T23:41:30.919 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.916+0000 7fb8deffd640 1 --2- 172.21.15.88:0/205369607 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb8e01f0990 0x7fb8e01ed140 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fb8d0000c00 tx=0x7fb8d0009240 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:41:30.920 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.916+0000 7fb8c77fe640 1 -- 172.21.15.88:0/205369607 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8d004d070 con 0x7fb8e01f0990 2024-04-26T23:41:30.920 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.916+0000 7fb8c77fe640 1 -- 172.21.15.88:0/205369607 <== mon.2 v2:172.21.15.175:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5195 (secure 0 0 0) 0x7fb8d004b070 con 0x7fb8e01f0990 2024-04-26T23:41:30.920 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.916+0000 7fb8c77fe640 1 -- 172.21.15.88:0/205369607 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb8e01f0990 msgr2=0x7fb8e01ed140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:30.920 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.916+0000 7fb8c77fe640 1 --2- 172.21.15.88:0/205369607 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb8e01f0990 0x7fb8e01ed140 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fb8d0000c00 tx=0x7fb8d0009240 comp rx=0 tx=0).stop 2024-04-26T23:41:30.921 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.916+0000 7fb8c77fe640 1 -- 172.21.15.88:0/205369607 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb8e01f0990 msgr2=0x7fb8e01ed140 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:41:30.921 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.916+0000 7fb8c77fe640 1 --2- 172.21.15.88:0/205369607 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb8e01f0990 0x7fb8e01ed140 secure :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fb8d0000c00 tx=0x7fb8d0009240 comp rx=0 tx=0).stop 2024-04-26T23:41:30.921 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-04-26T23:41:30.921 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2024-04-26T23:41:30.921 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2024-04-26T23:41:30.921 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "peon", 2024-04-26T23:41:30.921 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 6, 2024-04-26T23:41:30.921 INFO:teuthology.orchestra.run.smithi088.stdout: "uptime": 83259, 2024-04-26T23:41:30.921 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2024-04-26T23:41:30.921 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2024-04-26T23:41:30.921 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2024-04-26T23:41:30.922 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:41:30.922 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 1, 2024-04-26T23:41:30.922 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2024-04-26T23:41:30.922 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2450521708007866372", 2024-04-26T23:41:30.922 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2024-04-26T23:41:30.922 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-04-26T23:41:30.922 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-04-26T23:41:30.922 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-04-26T23:41:30.922 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-04-26T23:41:30.922 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-04-26T23:41:30.922 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-04-26T23:41:30.922 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-04-26T23:41:30.922 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-04-26T23:41:30.922 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-04-26T23:41:30.923 INFO:teuthology.orchestra.run.smithi088.stdout: "reef", 2024-04-26T23:41:30.923 INFO:teuthology.orchestra.run.smithi088.stdout: "squid" 2024-04-26T23:41:30.923 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:41:30.923 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540701547738038271", 2024-04-26T23:41:30.923 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2024-04-26T23:41:30.923 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-04-26T23:41:30.923 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-04-26T23:41:30.923 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-04-26T23:41:30.923 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-04-26T23:41:30.923 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-04-26T23:41:30.923 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-04-26T23:41:30.923 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-04-26T23:41:30.923 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-04-26T23:41:30.923 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-04-26T23:41:30.923 INFO:teuthology.orchestra.run.smithi088.stdout: "reef", 2024-04-26T23:41:30.924 INFO:teuthology.orchestra.run.smithi088.stdout: "squid" 2024-04-26T23:41:30.924 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:41:30.924 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:41:30.924 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2024-04-26T23:41:30.924 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2024-04-26T23:41:30.924 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2024-04-26T23:41:30.924 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2024-04-26T23:41:30.924 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2024-04-26T23:41:30.924 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "555255e9-7ef9-4454-8dc9-35e96b70035c", 2024-04-26T23:41:30.924 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2024-04-26T23:39:34.291658Z", 2024-04-26T23:41:30.924 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2024-04-26T23:39:34.291658Z", 2024-04-26T23:41:30.924 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 19, 2024-04-26T23:41:30.924 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "squid", 2024-04-26T23:41:30.924 INFO:teuthology.orchestra.run.smithi088.stdout: "election_strategy": 1, 2024-04-26T23:41:30.924 INFO:teuthology.orchestra.run.smithi088.stdout: "disallowed_leaders: ": "", 2024-04-26T23:41:30.925 INFO:teuthology.orchestra.run.smithi088.stdout: "stretch_mode": false, 2024-04-26T23:41:30.925 INFO:teuthology.orchestra.run.smithi088.stdout: "tiebreaker_mon": "", 2024-04-26T23:41:30.925 INFO:teuthology.orchestra.run.smithi088.stdout: "removed_ranks: ": "", 2024-04-26T23:41:30.925 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2024-04-26T23:41:30.925 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2024-04-26T23:41:30.925 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-04-26T23:41:30.925 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-04-26T23:41:30.925 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-04-26T23:41:30.925 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-04-26T23:41:30.925 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-04-26T23:41:30.925 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-04-26T23:41:30.925 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-04-26T23:41:30.925 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-04-26T23:41:30.925 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-04-26T23:41:30.925 INFO:teuthology.orchestra.run.smithi088.stdout: "reef", 2024-04-26T23:41:30.925 INFO:teuthology.orchestra.run.smithi088.stdout: "squid" 2024-04-26T23:41:30.926 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:41:30.926 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2024-04-26T23:41:30.926 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:41:30.926 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2024-04-26T23:41:30.926 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:41:30.926 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2024-04-26T23:41:30.926 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2024-04-26T23:41:30.926 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-04-26T23:41:30.926 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-04-26T23:41:30.926 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:41:30.926 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-04-26T23:41:30.926 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2024-04-26T23:41:30.926 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:41:30.926 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:41:30.926 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:41:30.927 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-04-26T23:41:30.927 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2024-04-26T23:41:30.927 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:41:30.927 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:41:30.927 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:41:30.927 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:41:30.927 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2024-04-26T23:41:30.927 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2024-04-26T23:41:30.927 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-04-26T23:41:30.927 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-04-26T23:41:30.927 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-04-26T23:41:30.927 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:41:30.927 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:41:30.927 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2024-04-26T23:41:30.927 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2024-04-26T23:41:30.927 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-04-26T23:41:30.928 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-04-26T23:41:30.928 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:41:30.928 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-04-26T23:41:30.928 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:3300", 2024-04-26T23:41:30.928 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:41:30.928 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:41:30.928 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:41:30.928 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-04-26T23:41:30.928 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6789", 2024-04-26T23:41:30.928 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:41:30.928 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:41:30.928 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:41:30.928 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:41:30.929 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6789/0", 2024-04-26T23:41:30.929 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.175:6789/0", 2024-04-26T23:41:30.929 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-04-26T23:41:30.929 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-04-26T23:41:30.929 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-04-26T23:41:30.929 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:41:30.929 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:41:30.929 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2024-04-26T23:41:30.929 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2024-04-26T23:41:30.929 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-04-26T23:41:30.929 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-04-26T23:41:30.929 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:41:30.929 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-04-26T23:41:30.929 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:3301", 2024-04-26T23:41:30.929 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:41:30.929 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:41:30.930 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:41:30.930 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-04-26T23:41:30.930 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6790", 2024-04-26T23:41:30.930 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:41:30.930 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:41:30.930 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:41:30.931 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:41:30.931 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6790/0", 2024-04-26T23:41:30.931 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.175:6790/0", 2024-04-26T23:41:30.931 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-04-26T23:41:30.931 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-04-26T23:41:30.931 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-04-26T23:41:30.931 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:41:30.931 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:41:30.931 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:41:30.931 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2024-04-26T23:41:30.931 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2024-04-26T23:41:30.931 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:41:30.931 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:41:30.931 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:41:30.931 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2024-04-26T23:41:30.931 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:41:30.932 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:41:30.932 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": [ 2024-04-26T23:41:30.932 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:41:30.932 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:41:30.932 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:41:30.932 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2024-04-26T23:41:30.932 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:41:30.932 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:41:30.932 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": [ 2024-04-26T23:41:30.932 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:41:30.932 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:41:30.932 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:41:30.932 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 7 2024-04-26T23:41:30.932 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:41:30.932 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:41:30.933 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2024-04-26T23:41:30.933 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:41:30.933 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x2f018fb87aa4aafe", 2024-04-26T23:41:30.933 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:41:30.933 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2024-04-26T23:41:30.933 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:41:30.933 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:41:30.933 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:41:30.933 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:41:30.933 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 4 2024-04-26T23:41:30.933 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:41:30.933 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:41:30.933 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": [ 2024-04-26T23:41:30.933 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:41:30.933 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:41:30.933 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:41:30.934 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2024-04-26T23:41:30.934 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:41:30.934 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:41:30.934 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:41:30.934 INFO:teuthology.orchestra.run.smithi088.stdout: "stretch_mode": false 2024-04-26T23:41:30.934 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-04-26T23:41:30.935 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.916+0000 7fb8e55ec640 1 -- 172.21.15.88:0/205369607 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fb8cc06c8a0 msgr2=0x7fb8cc06ed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:30.935 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.916+0000 7fb8e55ec640 1 --2- 172.21.15.88:0/205369607 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fb8cc06c8a0 0x7fb8cc06ed60 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fb8d8003cb0 tx=0x7fb8d800d040 comp rx=0 tx=0).stop 2024-04-26T23:41:30.935 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.916+0000 7fb8e55ec640 1 -- 172.21.15.88:0/205369607 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb8e0154160 msgr2=0x7fb8e0149800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:41:30.935 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.916+0000 7fb8e55ec640 1 --2- 172.21.15.88:0/205369607 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb8e0154160 0x7fb8e0149800 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fb8d400b550 tx=0x7fb8d400ba10 comp rx=0 tx=0).stop 2024-04-26T23:41:30.935 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.916+0000 7fb8df7fe640 1 -- 172.21.15.88:0/205369607 reap_dead start 2024-04-26T23:41:30.935 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.916+0000 7fb8df7fe640 1 -- 172.21.15.88:0/205369607 reap_dead start 2024-04-26T23:41:30.936 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.916+0000 7fb8e55ec640 1 -- 172.21.15.88:0/205369607 shutdown_connections 2024-04-26T23:41:30.936 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.916+0000 7fb8e55ec640 1 -- 172.21.15.88:0/205369607 >> 172.21.15.88:0/205369607 conn(0x7fb8e00ae010 msgr2=0x7fb8e00ae3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:41:30.936 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.917+0000 7fb8e55ec640 1 -- 172.21.15.88:0/205369607 shutdown_connections 2024-04-26T23:41:30.936 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:41:30.917+0000 7fb8e55ec640 1 -- 172.21.15.88:0/205369607 wait complete. 2024-04-26T23:41:30.936 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-04-26T23:41:30.936 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2024-04-26T23:41:32.700 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:41:32.704 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:41:50.937 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2024-04-26T23:41:50.937 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.a 2024-04-26T23:41:50.937 INFO:tasks.ceph.mon.a:Restarting daemon 2024-04-26T23:41:50.937 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-04-26T23:41:50.940 INFO:tasks.ceph.mon.a:Started 2024-04-26T23:41:50.941 INFO:tasks.mon_thrash:Sending STOP to mon c 2024-04-26T23:41:50.941 INFO:tasks.ceph.mon.c:Sent signal 19 2024-04-26T23:41:50.941 INFO:tasks.mon_thrash.mon_thrasher:waiting for 15.0 secs to unfreeze mons 2024-04-26T23:42:02.846 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:42:02.849 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:42:05.942 INFO:tasks.mon_thrash:Sending CONT to mon c 2024-04-26T23:42:05.943 INFO:tasks.ceph.mon.c:Sent signal 18 2024-04-26T23:42:05.943 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-04-26T23:42:05.943 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-04-26T23:42:06.043 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.040+0000 7fa2fcb46640 1 Processor -- start 2024-04-26T23:42:06.043 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.040+0000 7fa2fcb46640 1 -- start start 2024-04-26T23:42:06.046 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.041+0000 7fa2fcb46640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fa2f813fe20 0x7fa2f80c5430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:06.046 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.041+0000 7fa2fcb46640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa2f80c3c70 0x7fa2f806d320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:06.046 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.041+0000 7fa2fcb46640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa2f806d860 0x7fa2f8157010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:06.046 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.041+0000 7fa2fcb46640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7fa2f80c39b0 con 0x7fa2f80c3c70 2024-04-26T23:42:06.046 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.041+0000 7fa2fcb46640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7fa2f815b120 con 0x7fa2f813fe20 2024-04-26T23:42:06.046 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.041+0000 7fa2fcb46640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fa2f815a230 con 0x7fa2f806d860 2024-04-26T23:42:06.047 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.041+0000 7fa2effff640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa2f80c3c70 0x7fa2f806d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:06.047 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.041+0000 7fa2effff640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa2f80c3c70 0x7fa2f806d320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:50874/0 (socket says 172.21.15.88:50874) 2024-04-26T23:42:06.047 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.041+0000 7fa2effff640 1 -- 172.21.15.88:0/2612290212 learned_addr learned my addr 172.21.15.88:0/2612290212 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:42:06.047 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.041+0000 7fa2f6d9d640 1 --2- 172.21.15.88:0/2612290212 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa2f806d860 0x7fa2f8157010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:06.047 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.041+0000 7fa2f659c640 1 --2- 172.21.15.88:0/2612290212 >> v2:172.21.15.175:3300/0 conn(0x7fa2f813fe20 0x7fa2f80c5430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:06.047 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.041+0000 7fa2effff640 1 -- 172.21.15.88:0/2612290212 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa2f806d860 msgr2=0x7fa2f8157010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:42:06.047 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.041+0000 7fa2effff640 1 --2- 172.21.15.88:0/2612290212 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa2f806d860 0x7fa2f8157010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:06.047 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.041+0000 7fa2effff640 1 -- 172.21.15.88:0/2612290212 >> v2:172.21.15.175:3300/0 conn(0x7fa2f813fe20 msgr2=0x7fa2f80c5430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:42:06.047 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.041+0000 7fa2effff640 1 --2- 172.21.15.88:0/2612290212 >> v2:172.21.15.175:3300/0 conn(0x7fa2f813fe20 0x7fa2f80c5430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:06.047 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.041+0000 7fa2effff640 1 -- 172.21.15.88:0/2612290212 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2f815a510 con 0x7fa2f80c3c70 2024-04-26T23:42:06.048 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.042+0000 7fa2effff640 1 --2- 172.21.15.88:0/2612290212 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa2f80c3c70 0x7fa2f806d320 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fa2f80c2750 tx=0x7fa2e002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2274b92d308034a6 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:06.048 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.042+0000 7fa2f5d9b640 1 -- 172.21.15.88:0/2612290212 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2e0037070 con 0x7fa2f80c3c70 2024-04-26T23:42:06.048 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.042+0000 7fa2f5d9b640 1 -- 172.21.15.88:0/2612290212 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2e0032440 con 0x7fa2f80c3c70 2024-04-26T23:42:06.048 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.042+0000 7fa2f5d9b640 1 -- 172.21.15.88:0/2612290212 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2e0032810 con 0x7fa2f80c3c70 2024-04-26T23:42:06.048 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.043+0000 7fa2fcb46640 1 -- 172.21.15.88:0/2612290212 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa2f80c3c70 msgr2=0x7fa2f806d320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:06.048 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.043+0000 7fa2fcb46640 1 --2- 172.21.15.88:0/2612290212 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa2f80c3c70 0x7fa2f806d320 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fa2f80c2750 tx=0x7fa2e002a1e0 comp rx=0 tx=0).stop 2024-04-26T23:42:06.048 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.043+0000 7fa2fcb46640 1 -- 172.21.15.88:0/2612290212 shutdown_connections 2024-04-26T23:42:06.048 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.043+0000 7fa2fcb46640 1 --2- 172.21.15.88:0/2612290212 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa2f806d860 0x7fa2f8157010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:06.048 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.043+0000 7fa2fcb46640 1 --2- 172.21.15.88:0/2612290212 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa2f80c3c70 0x7fa2f806d320 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:06.048 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.043+0000 7fa2fcb46640 1 --2- 172.21.15.88:0/2612290212 >> v2:172.21.15.175:3300/0 conn(0x7fa2f813fe20 0x7fa2f80c5430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:06.048 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.043+0000 7fa2fcb46640 1 -- 172.21.15.88:0/2612290212 >> 172.21.15.88:0/2612290212 conn(0x7fa2f80c5d70 msgr2=0x7fa2f80c6180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:06.048 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.043+0000 7fa2fcb46640 1 -- 172.21.15.88:0/2612290212 shutdown_connections 2024-04-26T23:42:06.048 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.043+0000 7fa2fcb46640 1 -- 172.21.15.88:0/2612290212 wait complete. 2024-04-26T23:42:06.051 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.044+0000 7fa2fcb46640 1 Processor -- start 2024-04-26T23:42:06.052 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.044+0000 7fa2fcb46640 1 -- start start 2024-04-26T23:42:06.052 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.045+0000 7fa2fcb46640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa2f806d860 0x7fa2f81592f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:06.052 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.045+0000 7fa2fcb46640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa2f80c3c70 0x7fa2f80ac440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:06.052 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.045+0000 7fa2fcb46640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa2f813fe20 0x7fa2f80ac980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:06.052 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.045+0000 7fa2fcb46640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fa2f815adb0 con 0x7fa2f813fe20 2024-04-26T23:42:06.052 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.045+0000 7fa2fcb46640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fa2f815aad0 con 0x7fa2f806d860 2024-04-26T23:42:06.052 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.045+0000 7fa2fcb46640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fa2f8140200 con 0x7fa2f80c3c70 2024-04-26T23:42:06.052 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.045+0000 7fa2f6d9d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa2f813fe20 0x7fa2f80ac980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:06.052 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.045+0000 7fa2f6d9d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa2f813fe20 0x7fa2f80ac980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:50878/0 (socket says 172.21.15.88:50878) 2024-04-26T23:42:06.052 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.045+0000 7fa2f6d9d640 1 -- 172.21.15.88:0/1705061237 learned_addr learned my addr 172.21.15.88:0/1705061237 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:42:06.052 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.045+0000 7fa2f659c640 1 --2- 172.21.15.88:0/1705061237 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa2f806d860 0x7fa2f81592f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:06.052 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.045+0000 7fa2effff640 1 --2- 172.21.15.88:0/1705061237 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa2f80c3c70 0x7fa2f80ac440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:06.052 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.045+0000 7fa2f6d9d640 1 -- 172.21.15.88:0/1705061237 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa2f80c3c70 msgr2=0x7fa2f80ac440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:06.052 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.045+0000 7fa2f6d9d640 1 --2- 172.21.15.88:0/1705061237 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa2f80c3c70 0x7fa2f80ac440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:06.053 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.045+0000 7fa2f6d9d640 1 -- 172.21.15.88:0/1705061237 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa2f806d860 msgr2=0x7fa2f81592f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:06.053 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.045+0000 7fa2f6d9d640 1 --2- 172.21.15.88:0/1705061237 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa2f806d860 0x7fa2f81592f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:06.053 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.045+0000 7fa2f6d9d640 1 -- 172.21.15.88:0/1705061237 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2f81ed000 con 0x7fa2f813fe20 2024-04-26T23:42:06.053 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.045+0000 7fa2f6d9d640 1 --2- 172.21.15.88:0/1705061237 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa2f813fe20 0x7fa2f80ac980 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fa2f000eed0 tx=0x7fa2f000b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:06.053 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.046+0000 7fa2eeffd640 1 -- 172.21.15.88:0/1705061237 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2f0018020 con 0x7fa2f813fe20 2024-04-26T23:42:06.053 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.046+0000 7fa2eeffd640 1 -- 172.21.15.88:0/1705061237 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2f000bd20 con 0x7fa2f813fe20 2024-04-26T23:42:06.053 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.046+0000 7fa2fcb46640 1 -- 172.21.15.88:0/1705061237 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2f81ed2e0 con 0x7fa2f813fe20 2024-04-26T23:42:06.053 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.046+0000 7fa2eeffd640 1 -- 172.21.15.88:0/1705061237 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2f0014640 con 0x7fa2f813fe20 2024-04-26T23:42:06.053 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.046+0000 7fa2fcb46640 1 -- 172.21.15.88:0/1705061237 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2f80ad760 con 0x7fa2f813fe20 2024-04-26T23:42:06.053 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.047+0000 7fa2fcb46640 1 -- 172.21.15.88:0/1705061237 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa2f80507a0 con 0x7fa2f813fe20 2024-04-26T23:42:06.053 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.047+0000 7fa2eeffd640 1 -- 172.21.15.88:0/1705061237 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa2f0005d10 con 0x7fa2f813fe20 2024-04-26T23:42:06.053 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.048+0000 7fa2eeffd640 1 --2- 172.21.15.88:0/1705061237 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fa2d806c8f0 0x7fa2d806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:06.053 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.048+0000 7fa2f659c640 1 --2- 172.21.15.88:0/1705061237 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fa2d806c8f0 0x7fa2d806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:06.053 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.048+0000 7fa2eeffd640 1 -- 172.21.15.88:0/1705061237 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6666+0+0 (secure 0 0 0) 0x7fa2f008c5f0 con 0x7fa2f813fe20 2024-04-26T23:42:06.053 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.048+0000 7fa2f659c640 1 --2- 172.21.15.88:0/1705061237 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fa2d806c8f0 0x7fa2d806edb0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fa2e8009b40 tx=0x7fa2e8009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:06.055 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.052+0000 7fa2eeffd640 1 -- 172.21.15.88:0/1705061237 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fa2f0022030 con 0x7fa2f813fe20 2024-04-26T23:42:06.335 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.332+0000 7fa2fcb46640 1 -- 172.21.15.88:0/1705061237 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fa2f80c2bf0 con 0x7fa2f813fe20 2024-04-26T23:42:06.335 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.332+0000 7fa2eeffd640 1 -- 172.21.15.88:0/1705061237 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1564 (secure 0 0 0) 0x7fa2f005a0a0 con 0x7fa2f813fe20 2024-04-26T23:42:06.335 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":12,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"555255e9-7ef9-4454-8dc9-35e96b70035c","modified":"2024-04-26T23:39:34.291658Z","created":"2024-04-26T23:39:34.291658Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:3300","nonce":0},{"type":"v1","addr":"172.21.15.175:6789","nonce":0}]},"addr":"172.21.15.175:6789/0","public_addr":"172.21.15.175:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:3301","nonce":0},{"type":"v1","addr":"172.21.15.175:6790","nonce":0}]},"addr":"172.21.15.175:6790/0","public_addr":"172.21.15.175:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-04-26T23:42:06.338 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.334+0000 7fa2fcb46640 1 -- 172.21.15.88:0/1705061237 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fa2d806c8f0 msgr2=0x7fa2d806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:06.338 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.334+0000 7fa2fcb46640 1 --2- 172.21.15.88:0/1705061237 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fa2d806c8f0 0x7fa2d806edb0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fa2e8009b40 tx=0x7fa2e8009190 comp rx=0 tx=0).stop 2024-04-26T23:42:06.338 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.334+0000 7fa2fcb46640 1 -- 172.21.15.88:0/1705061237 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa2f813fe20 msgr2=0x7fa2f80ac980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:06.338 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.334+0000 7fa2fcb46640 1 --2- 172.21.15.88:0/1705061237 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa2f813fe20 0x7fa2f80ac980 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fa2f000eed0 tx=0x7fa2f000b480 comp rx=0 tx=0).stop 2024-04-26T23:42:06.338 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.335+0000 7fa2fcb46640 1 -- 172.21.15.88:0/1705061237 shutdown_connections 2024-04-26T23:42:06.338 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.335+0000 7fa2fcb46640 1 --2- 172.21.15.88:0/1705061237 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fa2d806c8f0 0x7fa2d806edb0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:06.338 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.335+0000 7fa2fcb46640 1 --2- 172.21.15.88:0/1705061237 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa2f80c3c70 0x7fa2f80ac440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:06.338 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.335+0000 7fa2fcb46640 1 --2- 172.21.15.88:0/1705061237 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa2f813fe20 0x7fa2f80ac980 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:06.338 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.335+0000 7fa2fcb46640 1 --2- 172.21.15.88:0/1705061237 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa2f806d860 0x7fa2f81592f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:06.338 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.335+0000 7fa2fcb46640 1 -- 172.21.15.88:0/1705061237 >> 172.21.15.88:0/1705061237 conn(0x7fa2f80c5d70 msgr2=0x7fa2f806fc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:06.339 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.335+0000 7fa2fcb46640 1 -- 172.21.15.88:0/1705061237 shutdown_connections 2024-04-26T23:42:06.339 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.335+0000 7fa2fcb46640 1 -- 172.21.15.88:0/1705061237 wait complete. 2024-04-26T23:42:06.349 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-04-26T23:42:06.349 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-04-26T23:42:06.349 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-04-26T23:42:06.455 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.452+0000 7f5ac4f22640 1 Processor -- start 2024-04-26T23:42:06.455 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.452+0000 7f5ac4f22640 1 -- start start 2024-04-26T23:42:06.457 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.453+0000 7f5ac4f22640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f5ac014ecd0 0x7f5ac01555a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:06.457 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.453+0000 7f5ac4f22640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5ac014f0b0 con 0x7f5ac0073690 2024-04-26T23:42:06.457 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.453+0000 7f5ac4f22640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5ac0074c90 con 0x7f5ac00ac710 2024-04-26T23:42:06.457 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.453+0000 7f5ac4f22640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f5ac00c6400 con 0x7f5ac014ecd0 2024-04-26T23:42:06.457 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.453+0000 7f5abe59c640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f5ac014ecd0 0x7f5ac01555a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:06.457 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.453+0000 7f5abe59c640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f5ac014ecd0 0x7f5ac01555a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:50884/0 (socket says 172.21.15.88:50884) 2024-04-26T23:42:06.457 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.453+0000 7f5abe59c640 1 -- 172.21.15.88:0/305489088 learned_addr learned my addr 172.21.15.88:0/305489088 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:42:06.457 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.453+0000 7f5abe59c640 1 -- 172.21.15.88:0/305489088 >> v1:172.21.15.175:6789/0 conn(0x7f5ac00ac710 legacy=0x7f5ac00ab470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:06.457 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.453+0000 7f5abe59c640 1 -- 172.21.15.88:0/305489088 >> v1:172.21.15.88:6789/0 conn(0x7f5ac0073690 legacy=0x7f5ac015f330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:06.457 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.453+0000 7f5abe59c640 1 -- 172.21.15.88:0/305489088 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ac00c66e0 con 0x7f5ac014ecd0 2024-04-26T23:42:06.457 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.454+0000 7f5abe59c640 1 --2- 172.21.15.88:0/305489088 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5ac014ecd0 0x7f5ac01555a0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f5ab0009870 tx=0x7f5ab002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=accd05b9dd349435 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:06.457 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.454+0000 7f5abdd9b640 1 -- 172.21.15.88:0/305489088 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ab0037070 con 0x7f5ac014ecd0 2024-04-26T23:42:06.458 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.454+0000 7f5abdd9b640 1 -- 172.21.15.88:0/305489088 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ab0032440 con 0x7f5ac014ecd0 2024-04-26T23:42:06.458 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.454+0000 7f5abdd9b640 1 -- 172.21.15.88:0/305489088 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ab0032810 con 0x7f5ac014ecd0 2024-04-26T23:42:06.459 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.454+0000 7f5ac4f22640 1 -- 172.21.15.88:0/305489088 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5ac014ecd0 msgr2=0x7f5ac01555a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:06.459 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.454+0000 7f5ac4f22640 1 --2- 172.21.15.88:0/305489088 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5ac014ecd0 0x7f5ac01555a0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f5ab0009870 tx=0x7f5ab002a1e0 comp rx=0 tx=0).stop 2024-04-26T23:42:06.459 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.455+0000 7f5ac4f22640 1 -- 172.21.15.88:0/305489088 shutdown_connections 2024-04-26T23:42:06.459 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.455+0000 7f5ac4f22640 1 --2- 172.21.15.88:0/305489088 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5ac014ecd0 0x7f5ac01555a0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:06.459 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.455+0000 7f5ac4f22640 1 -- 172.21.15.88:0/305489088 >> 172.21.15.88:0/305489088 conn(0x7f5ac00c6d80 msgr2=0x7f5ac00c7160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:06.459 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.455+0000 7f5ac4f22640 1 -- 172.21.15.88:0/305489088 shutdown_connections 2024-04-26T23:42:06.459 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.455+0000 7f5ac4f22640 1 -- 172.21.15.88:0/305489088 wait complete. 2024-04-26T23:42:06.459 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.456+0000 7f5ac4f22640 1 Processor -- start 2024-04-26T23:42:06.459 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.456+0000 7f5ac4f22640 1 -- start start 2024-04-26T23:42:06.463 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.456+0000 7f5ac4f22640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5ac0073690 0x7f5ac00ae650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:06.463 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.456+0000 7f5ac4f22640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5ac00ac710 0x7f5ac01ee220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:06.463 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.456+0000 7f5ac4f22640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5ac014ecd0 0x7f5ac00ad3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:06.463 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.457+0000 7f5ac4f22640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f5ac0155080 con 0x7f5ac0073690 2024-04-26T23:42:06.463 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.457+0000 7f5ac4f22640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f5ac0154da0 con 0x7f5ac014ecd0 2024-04-26T23:42:06.463 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.457+0000 7f5ac4f22640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f5ac00c69c0 con 0x7f5ac00ac710 2024-04-26T23:42:06.463 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.457+0000 7f5abe59c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5ac0073690 0x7f5ac00ae650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:06.463 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.457+0000 7f5abe59c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5ac0073690 0x7f5ac00ae650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:50888/0 (socket says 172.21.15.88:50888) 2024-04-26T23:42:06.464 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.457+0000 7f5abe59c640 1 -- 172.21.15.88:0/2072018847 learned_addr learned my addr 172.21.15.88:0/2072018847 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:42:06.464 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.457+0000 7f5abed9d640 1 --2- 172.21.15.88:0/2072018847 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5ac014ecd0 0x7f5ac00ad3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:06.464 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.457+0000 7f5ab7fff640 1 --2- 172.21.15.88:0/2072018847 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5ac00ac710 0x7f5ac01ee220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:06.464 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.457+0000 7f5abe59c640 1 -- 172.21.15.88:0/2072018847 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5ac00ac710 msgr2=0x7f5ac01ee220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:06.464 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.457+0000 7f5abe59c640 1 --2- 172.21.15.88:0/2072018847 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5ac00ac710 0x7f5ac01ee220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:06.464 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.457+0000 7f5abe59c640 1 -- 172.21.15.88:0/2072018847 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5ac014ecd0 msgr2=0x7f5ac00ad3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:06.464 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.457+0000 7f5abe59c640 1 --2- 172.21.15.88:0/2072018847 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5ac014ecd0 0x7f5ac00ad3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:06.464 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.457+0000 7f5abe59c640 1 -- 172.21.15.88:0/2072018847 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ac0158980 con 0x7f5ac0073690 2024-04-26T23:42:06.464 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.457+0000 7f5abe59c640 1 --2- 172.21.15.88:0/2072018847 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5ac0073690 0x7f5ac00ae650 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f5ab0009870 tx=0x7f5ab00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:06.464 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.457+0000 7f5ab6ffd640 1 -- 172.21.15.88:0/2072018847 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ab0041070 con 0x7f5ac0073690 2024-04-26T23:42:06.464 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.457+0000 7f5ab6ffd640 1 -- 172.21.15.88:0/2072018847 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ab003c890 con 0x7f5ac0073690 2024-04-26T23:42:06.464 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.457+0000 7f5ac4f22640 1 -- 172.21.15.88:0/2072018847 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ac0158c20 con 0x7f5ac0073690 2024-04-26T23:42:06.464 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.457+0000 7f5ab6ffd640 1 -- 172.21.15.88:0/2072018847 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ab0037040 con 0x7f5ac0073690 2024-04-26T23:42:06.464 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.457+0000 7f5ac4f22640 1 -- 172.21.15.88:0/2072018847 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ac014c9e0 con 0x7f5ac0073690 2024-04-26T23:42:06.465 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.458+0000 7f5ac4f22640 1 --2- 172.21.15.88:0/2072018847 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5ac00c9030 0x7f5ac00ad8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:06.465 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.458+0000 7f5ac4f22640 1 -- 172.21.15.88:0/2072018847 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f5ac01edb40 con 0x7f5ac00c9030 2024-04-26T23:42:06.465 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.458+0000 7f5ab7fff640 1 --2- 172.21.15.88:0/2072018847 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5ac00c9030 0x7f5ac00ad8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:06.465 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.459+0000 7f5ab7fff640 1 -- 172.21.15.88:0/2072018847 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5ac0076650 con 0x7f5ac00c9030 2024-04-26T23:42:06.465 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.459+0000 7f5ab7fff640 1 --2- 172.21.15.88:0/2072018847 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5ac00c9030 0x7f5ac00ad8e0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f5ac0074550 tx=0x7f5aa800f9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:06.465 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.459+0000 7f5ab6ffd640 1 -- 172.21.15.88:0/2072018847 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5aa8019070 con 0x7f5ac00c9030 2024-04-26T23:42:06.465 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.459+0000 7f5ab6ffd640 1 -- 172.21.15.88:0/2072018847 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f5ab0044070 con 0x7f5ac0073690 2024-04-26T23:42:06.465 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.459+0000 7f5ab6ffd640 1 --2- 172.21.15.88:0/2072018847 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f5aa006c7f0 0x7f5aa006ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:06.465 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.460+0000 7f5abed9d640 1 --2- 172.21.15.88:0/2072018847 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f5aa006c7f0 0x7f5aa006ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:06.465 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.460+0000 7f5ab6ffd640 1 -- 172.21.15.88:0/2072018847 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6666+0+0 (secure 0 0 0) 0x7f5ab00acb10 con 0x7f5ac0073690 2024-04-26T23:42:06.465 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.460+0000 7f5ab6ffd640 1 -- 172.21.15.88:0/2072018847 <== mon.0 v2:172.21.15.88:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f5aa8005320 con 0x7f5ac00c9030 2024-04-26T23:42:06.465 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.460+0000 7f5ab6ffd640 1 -- 172.21.15.88:0/2072018847 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5ac00c9030 msgr2=0x7f5ac00ad8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:06.465 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.460+0000 7f5ab6ffd640 1 --2- 172.21.15.88:0/2072018847 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5ac00c9030 0x7f5ac00ad8e0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f5ac0074550 tx=0x7f5aa800f9d0 comp rx=0 tx=0).stop 2024-04-26T23:42:06.465 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.460+0000 7f5ab6ffd640 1 -- 172.21.15.88:0/2072018847 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5ac00c9030 msgr2=0x7f5ac00ad8e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:42:06.465 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.460+0000 7f5ab6ffd640 1 --2- 172.21.15.88:0/2072018847 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5ac00c9030 0x7f5ac00ad8e0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:06.466 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.460+0000 7f5abed9d640 1 --2- 172.21.15.88:0/2072018847 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f5aa006c7f0 0x7f5aa006ecb0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f5ac01edd40 tx=0x7f5ab8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:06.469 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.466+0000 7f5ac4f22640 1 --2- 172.21.15.88:0/2072018847 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5ac014ac90 0x7f5ac00ade20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:06.469 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.466+0000 7f5ac4f22640 1 -- 172.21.15.88:0/2072018847 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f5ac00507a0 con 0x7f5ac014ac90 2024-04-26T23:42:06.469 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.466+0000 7f5ab7fff640 1 --2- 172.21.15.88:0/2072018847 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5ac014ac90 0x7f5ac00ade20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:06.470 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.466+0000 7f5ab7fff640 1 -- 172.21.15.88:0/2072018847 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f5ac0158df0 con 0x7f5ac014ac90 2024-04-26T23:42:06.470 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.467+0000 7f5ab7fff640 1 --2- 172.21.15.88:0/2072018847 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5ac014ac90 0x7f5ac00ade20 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f5ac0074550 tx=0x7f5aa8000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:06.470 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.467+0000 7f5ab6ffd640 1 -- 172.21.15.88:0/2072018847 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5aa801c2a0 con 0x7f5ac014ac90 2024-04-26T23:42:06.470 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.467+0000 7f5ab6ffd640 1 -- 172.21.15.88:0/2072018847 <== mon.0 v2:172.21.15.88:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4556 (secure 0 0 0) 0x7f5aa801c2a0 con 0x7f5ac014ac90 2024-04-26T23:42:06.470 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.467+0000 7f5ab6ffd640 1 -- 172.21.15.88:0/2072018847 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5ac014ac90 msgr2=0x7f5ac00ade20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:06.471 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.467+0000 7f5ab6ffd640 1 --2- 172.21.15.88:0/2072018847 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5ac014ac90 0x7f5ac00ade20 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f5ac0074550 tx=0x7f5aa8000ed0 comp rx=0 tx=0).stop 2024-04-26T23:42:06.471 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.467+0000 7f5ab6ffd640 1 -- 172.21.15.88:0/2072018847 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5ac014ac90 msgr2=0x7f5ac00ade20 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:42:06.471 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.467+0000 7f5ab6ffd640 1 --2- 172.21.15.88:0/2072018847 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5ac014ac90 0x7f5ac00ade20 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:06.471 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-04-26T23:42:06.471 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2024-04-26T23:42:06.471 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2024-04-26T23:42:06.471 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "leader", 2024-04-26T23:42:06.471 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 12, 2024-04-26T23:42:06.471 INFO:teuthology.orchestra.run.smithi088.stdout: "uptime": 15439, 2024-04-26T23:42:06.471 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2024-04-26T23:42:06.471 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2024-04-26T23:42:06.472 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2024-04-26T23:42:06.472 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2024-04-26T23:42:06.472 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:42:06.472 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 0, 2024-04-26T23:42:06.472 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2024-04-26T23:42:06.472 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2450521708007866372", 2024-04-26T23:42:06.472 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2024-04-26T23:42:06.472 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-04-26T23:42:06.472 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-04-26T23:42:06.472 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-04-26T23:42:06.472 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-04-26T23:42:06.472 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-04-26T23:42:06.472 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-04-26T23:42:06.472 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-04-26T23:42:06.473 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-04-26T23:42:06.473 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-04-26T23:42:06.473 INFO:teuthology.orchestra.run.smithi088.stdout: "reef", 2024-04-26T23:42:06.473 INFO:teuthology.orchestra.run.smithi088.stdout: "squid" 2024-04-26T23:42:06.473 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:42:06.473 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540701547738038271", 2024-04-26T23:42:06.473 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2024-04-26T23:42:06.473 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-04-26T23:42:06.473 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-04-26T23:42:06.473 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-04-26T23:42:06.473 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-04-26T23:42:06.473 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-04-26T23:42:06.473 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-04-26T23:42:06.473 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-04-26T23:42:06.474 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-04-26T23:42:06.474 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-04-26T23:42:06.474 INFO:teuthology.orchestra.run.smithi088.stdout: "reef", 2024-04-26T23:42:06.474 INFO:teuthology.orchestra.run.smithi088.stdout: "squid" 2024-04-26T23:42:06.474 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:42:06.474 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:42:06.474 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2024-04-26T23:42:06.474 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2024-04-26T23:42:06.474 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2024-04-26T23:42:06.474 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2024-04-26T23:42:06.474 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2024-04-26T23:42:06.474 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "555255e9-7ef9-4454-8dc9-35e96b70035c", 2024-04-26T23:42:06.474 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2024-04-26T23:39:34.291658Z", 2024-04-26T23:42:06.474 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2024-04-26T23:39:34.291658Z", 2024-04-26T23:42:06.474 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 19, 2024-04-26T23:42:06.475 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "squid", 2024-04-26T23:42:06.475 INFO:teuthology.orchestra.run.smithi088.stdout: "election_strategy": 1, 2024-04-26T23:42:06.475 INFO:teuthology.orchestra.run.smithi088.stdout: "disallowed_leaders: ": "", 2024-04-26T23:42:06.475 INFO:teuthology.orchestra.run.smithi088.stdout: "stretch_mode": false, 2024-04-26T23:42:06.475 INFO:teuthology.orchestra.run.smithi088.stdout: "tiebreaker_mon": "", 2024-04-26T23:42:06.475 INFO:teuthology.orchestra.run.smithi088.stdout: "removed_ranks: ": "", 2024-04-26T23:42:06.475 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2024-04-26T23:42:06.475 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2024-04-26T23:42:06.475 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-04-26T23:42:06.475 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-04-26T23:42:06.475 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-04-26T23:42:06.475 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-04-26T23:42:06.475 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-04-26T23:42:06.475 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-04-26T23:42:06.476 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-04-26T23:42:06.476 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-04-26T23:42:06.476 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-04-26T23:42:06.476 INFO:teuthology.orchestra.run.smithi088.stdout: "reef", 2024-04-26T23:42:06.476 INFO:teuthology.orchestra.run.smithi088.stdout: "squid" 2024-04-26T23:42:06.476 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:42:06.476 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2024-04-26T23:42:06.476 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:42:06.476 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2024-04-26T23:42:06.476 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:42:06.476 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2024-04-26T23:42:06.476 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2024-04-26T23:42:06.476 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-04-26T23:42:06.476 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-04-26T23:42:06.476 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:42:06.477 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-04-26T23:42:06.477 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2024-04-26T23:42:06.477 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:42:06.477 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:42:06.477 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:42:06.477 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-04-26T23:42:06.477 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2024-04-26T23:42:06.477 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:42:06.477 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:42:06.477 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:42:06.477 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:42:06.477 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2024-04-26T23:42:06.477 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2024-04-26T23:42:06.477 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-04-26T23:42:06.478 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-04-26T23:42:06.478 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-04-26T23:42:06.478 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:42:06.478 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:42:06.478 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2024-04-26T23:42:06.478 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2024-04-26T23:42:06.478 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-04-26T23:42:06.478 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-04-26T23:42:06.478 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:42:06.478 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-04-26T23:42:06.478 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:3300", 2024-04-26T23:42:06.478 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:42:06.478 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:42:06.478 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:42:06.479 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-04-26T23:42:06.479 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6789", 2024-04-26T23:42:06.479 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:42:06.479 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:42:06.479 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:42:06.479 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:42:06.479 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6789/0", 2024-04-26T23:42:06.479 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.175:6789/0", 2024-04-26T23:42:06.479 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-04-26T23:42:06.479 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-04-26T23:42:06.479 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-04-26T23:42:06.479 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:42:06.479 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:42:06.479 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2024-04-26T23:42:06.480 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2024-04-26T23:42:06.480 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-04-26T23:42:06.480 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-04-26T23:42:06.480 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:42:06.480 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-04-26T23:42:06.480 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:3301", 2024-04-26T23:42:06.480 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:42:06.480 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:42:06.480 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:42:06.480 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-04-26T23:42:06.480 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6790", 2024-04-26T23:42:06.480 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:42:06.480 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:42:06.480 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:42:06.480 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:42:06.481 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6790/0", 2024-04-26T23:42:06.481 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.175:6790/0", 2024-04-26T23:42:06.481 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-04-26T23:42:06.481 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-04-26T23:42:06.481 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-04-26T23:42:06.481 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:42:06.481 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:42:06.481 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:42:06.481 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2024-04-26T23:42:06.481 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2024-04-26T23:42:06.481 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:42:06.481 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:42:06.481 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:42:06.481 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2024-04-26T23:42:06.481 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:42:06.481 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:42:06.482 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2024-04-26T23:42:06.482 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:42:06.482 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:42:06.482 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:42:06.482 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2024-04-26T23:42:06.482 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:42:06.482 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:42:06.482 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:42:06.482 INFO:teuthology.orchestra.run.smithi088.stdout: "stretch_mode": false 2024-04-26T23:42:06.482 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-04-26T23:42:06.483 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.467+0000 7f5ac4f22640 1 -- 172.21.15.88:0/2072018847 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f5aa006c7f0 msgr2=0x7f5aa006ecb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:06.483 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.467+0000 7f5ac4f22640 1 --2- 172.21.15.88:0/2072018847 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f5aa006c7f0 0x7f5aa006ecb0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f5ac01edd40 tx=0x7f5ab8009040 comp rx=0 tx=0).stop 2024-04-26T23:42:06.483 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.467+0000 7f5ac4f22640 1 -- 172.21.15.88:0/2072018847 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5ac0073690 msgr2=0x7f5ac00ae650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:06.484 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.467+0000 7f5ac4f22640 1 --2- 172.21.15.88:0/2072018847 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5ac0073690 0x7f5ac00ae650 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f5ab0009870 tx=0x7f5ab00046c0 comp rx=0 tx=0).stop 2024-04-26T23:42:06.484 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.467+0000 7f5abed9d640 1 -- 172.21.15.88:0/2072018847 reap_dead start 2024-04-26T23:42:06.484 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.467+0000 7f5abed9d640 1 -- 172.21.15.88:0/2072018847 reap_dead start 2024-04-26T23:42:06.484 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.467+0000 7f5ac4f22640 1 -- 172.21.15.88:0/2072018847 shutdown_connections 2024-04-26T23:42:06.484 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.467+0000 7f5ac4f22640 1 -- 172.21.15.88:0/2072018847 >> 172.21.15.88:0/2072018847 conn(0x7f5ac00c6d80 msgr2=0x7f5ac0153a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:06.484 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.467+0000 7f5ac4f22640 1 -- 172.21.15.88:0/2072018847 shutdown_connections 2024-04-26T23:42:06.484 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.467+0000 7f5ac4f22640 1 -- 172.21.15.88:0/2072018847 wait complete. 2024-04-26T23:42:06.484 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-04-26T23:42:06.484 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-04-26T23:42:06.484 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-04-26T23:42:06.583 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.580+0000 7fa83b0d1640 1 Processor -- start 2024-04-26T23:42:06.584 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.580+0000 7fa83b0d1640 1 -- start start 2024-04-26T23:42:06.585 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.581+0000 7fa83b0d1640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa83413ff20 0x7fa83415a280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:06.585 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.581+0000 7fa83b0d1640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fa8340c46c0 0x7fa83415a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:06.585 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.581+0000 7fa83b0d1640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa8341577b0 con 0x7fa83415ad00 2024-04-26T23:42:06.585 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.581+0000 7fa83b0d1640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7fa834157560 con 0x7fa83413ff20 2024-04-26T23:42:06.585 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.581+0000 7fa83b0d1640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7fa8340ab960 con 0x7fa8340c46c0 2024-04-26T23:42:06.586 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.581+0000 7fa838e6d640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa83413ff20 0x7fa83415a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:06.586 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.581+0000 7fa83966e640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fa83415ad00 0x7fa8340c3720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:58946/0 (socket says 172.21.15.88:58946) 2024-04-26T23:42:06.586 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.581+0000 7fa83966e640 1 -- 172.21.15.88:0/943334679 learned_addr learned my addr 172.21.15.88:0/943334679 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-26T23:42:06.586 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.581+0000 7fa833fff640 1 --2- 172.21.15.88:0/943334679 >> v2:172.21.15.175:3300/0 conn(0x7fa8340c46c0 0x7fa83415a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:06.586 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.581+0000 7fa838e6d640 1 -- 172.21.15.88:0/943334679 >> v2:172.21.15.175:3300/0 conn(0x7fa8340c46c0 msgr2=0x7fa83415a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:42:06.586 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.581+0000 7fa838e6d640 1 --2- 172.21.15.88:0/943334679 >> v2:172.21.15.175:3300/0 conn(0x7fa8340c46c0 0x7fa83415a7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:06.586 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.581+0000 7fa838e6d640 1 -- 172.21.15.88:0/943334679 >> v1:172.21.15.88:6789/0 conn(0x7fa83415ad00 legacy=0x7fa8340c3720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:06.586 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.581+0000 7fa838e6d640 1 -- 172.21.15.88:0/943334679 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8340ab5f0 con 0x7fa83413ff20 2024-04-26T23:42:06.586 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.582+0000 7fa838e6d640 1 --2- 172.21.15.88:0/943334679 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa83413ff20 0x7fa83415a280 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fa8340af910 tx=0x7fa82802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa17d17ffb1ae1ab server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:06.586 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.582+0000 7fa8337fe640 1 -- 172.21.15.88:0/943334679 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa828037070 con 0x7fa83413ff20 2024-04-26T23:42:06.586 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.582+0000 7fa8337fe640 1 -- 172.21.15.88:0/943334679 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa828032440 con 0x7fa83413ff20 2024-04-26T23:42:06.587 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.582+0000 7fa8337fe640 1 -- 172.21.15.88:0/943334679 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa828032810 con 0x7fa83413ff20 2024-04-26T23:42:06.590 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.583+0000 7fa83b0d1640 1 -- 172.21.15.88:0/943334679 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa83413ff20 msgr2=0x7fa83415a280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:06.590 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.583+0000 7fa83b0d1640 1 --2- 172.21.15.88:0/943334679 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa83413ff20 0x7fa83415a280 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fa8340af910 tx=0x7fa82802a1a0 comp rx=0 tx=0).stop 2024-04-26T23:42:06.590 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.583+0000 7fa83b0d1640 1 -- 172.21.15.88:0/943334679 shutdown_connections 2024-04-26T23:42:06.590 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.583+0000 7fa83b0d1640 1 --2- 172.21.15.88:0/943334679 >> v2:172.21.15.175:3300/0 conn(0x7fa8340c46c0 0x7fa83415a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:06.590 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.583+0000 7fa83b0d1640 1 --2- 172.21.15.88:0/943334679 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa83413ff20 0x7fa83415a280 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:06.590 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.583+0000 7fa83b0d1640 1 -- 172.21.15.88:0/943334679 >> 172.21.15.88:0/943334679 conn(0x7fa8340ca2f0 msgr2=0x7fa8340ca700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:06.590 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.583+0000 7fa83b0d1640 1 -- 172.21.15.88:0/943334679 shutdown_connections 2024-04-26T23:42:06.590 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.583+0000 7fa83b0d1640 1 -- 172.21.15.88:0/943334679 wait complete. 2024-04-26T23:42:06.590 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.584+0000 7fa83b0d1640 1 Processor -- start 2024-04-26T23:42:06.590 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.584+0000 7fa83b0d1640 1 -- start start 2024-04-26T23:42:06.590 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.585+0000 7fa83b0d1640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa83413ff20 0x7fa83413e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:06.590 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.585+0000 7fa83b0d1640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa83415ad00 0x7fa8341e36e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:06.591 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.585+0000 7fa83b0d1640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa83413c4e0 0x7fa8341e3c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:06.591 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.585+0000 7fa83b0d1640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fa834074c50 con 0x7fa83415ad00 2024-04-26T23:42:06.591 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.585+0000 7fa83b0d1640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fa8340ac710 con 0x7fa83413ff20 2024-04-26T23:42:06.591 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.585+0000 7fa83b0d1640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fa834074dd0 con 0x7fa83413c4e0 2024-04-26T23:42:06.591 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.585+0000 7fa833fff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa83415ad00 0x7fa8341e36e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:06.591 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.585+0000 7fa833fff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa83415ad00 0x7fa8341e36e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:50908/0 (socket says 172.21.15.88:50908) 2024-04-26T23:42:06.591 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.585+0000 7fa833fff640 1 -- 172.21.15.88:0/1186125233 learned_addr learned my addr 172.21.15.88:0/1186125233 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:42:06.591 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.585+0000 7fa838e6d640 1 --2- 172.21.15.88:0/1186125233 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa83413ff20 0x7fa83413e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:06.591 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.585+0000 7fa83966e640 1 --2- 172.21.15.88:0/1186125233 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa83413c4e0 0x7fa8341e3c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:06.591 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.585+0000 7fa833fff640 1 -- 172.21.15.88:0/1186125233 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa83413c4e0 msgr2=0x7fa8341e3c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:06.591 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.585+0000 7fa833fff640 1 --2- 172.21.15.88:0/1186125233 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa83413c4e0 0x7fa8341e3c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:06.591 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.585+0000 7fa833fff640 1 -- 172.21.15.88:0/1186125233 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa83413ff20 msgr2=0x7fa83413e2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:06.591 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.585+0000 7fa833fff640 1 --2- 172.21.15.88:0/1186125233 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa83413ff20 0x7fa83413e2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:06.591 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.585+0000 7fa833fff640 1 -- 172.21.15.88:0/1186125233 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8340af2b0 con 0x7fa83415ad00 2024-04-26T23:42:06.591 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.585+0000 7fa83966e640 1 --2- 172.21.15.88:0/1186125233 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa83413c4e0 0x7fa8341e3c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:42:06.592 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.585+0000 7fa833fff640 1 --2- 172.21.15.88:0/1186125233 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa83415ad00 0x7fa8341e36e0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fa82000d800 tx=0x7fa82000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:06.592 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.586+0000 7fa8317fa640 1 -- 172.21.15.88:0/1186125233 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa82000b6c0 con 0x7fa83415ad00 2024-04-26T23:42:06.592 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.586+0000 7fa8317fa640 1 -- 172.21.15.88:0/1186125233 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa820019070 con 0x7fa83415ad00 2024-04-26T23:42:06.592 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.586+0000 7fa83b0d1640 1 -- 172.21.15.88:0/1186125233 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8340aefd0 con 0x7fa83415ad00 2024-04-26T23:42:06.592 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.586+0000 7fa8317fa640 1 -- 172.21.15.88:0/1186125233 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa82000ba80 con 0x7fa83415ad00 2024-04-26T23:42:06.592 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.586+0000 7fa83b0d1640 1 -- 172.21.15.88:0/1186125233 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa83413e830 con 0x7fa83415ad00 2024-04-26T23:42:06.592 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.587+0000 7fa83b0d1640 1 --2- 172.21.15.88:0/1186125233 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa8340c4640 0x7fa83413b820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:06.592 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.587+0000 7fa83b0d1640 1 -- 172.21.15.88:0/1186125233 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fa8341f08e0 con 0x7fa8340c4640 2024-04-26T23:42:06.592 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.587+0000 7fa838e6d640 1 --2- 172.21.15.88:0/1186125233 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa8340c4640 0x7fa83413b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:06.592 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.587+0000 7fa838e6d640 1 -- 172.21.15.88:0/1186125233 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa8340aed80 con 0x7fa8340c4640 2024-04-26T23:42:06.594 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.587+0000 7fa838e6d640 1 --2- 172.21.15.88:0/1186125233 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa8340c4640 0x7fa83413b820 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fa83415b1c0 tx=0x7fa8280046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:06.594 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.588+0000 7fa8317fa640 1 -- 172.21.15.88:0/1186125233 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa828043070 con 0x7fa8340c4640 2024-04-26T23:42:06.594 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.588+0000 7fa8317fa640 1 -- 172.21.15.88:0/1186125233 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa82000bc20 con 0x7fa83415ad00 2024-04-26T23:42:06.594 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.588+0000 7fa8317fa640 1 --2- 172.21.15.88:0/1186125233 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fa81806c7f0 0x7fa81806ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:06.594 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.588+0000 7fa83966e640 1 --2- 172.21.15.88:0/1186125233 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fa81806c7f0 0x7fa81806ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:06.594 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.588+0000 7fa8317fa640 1 -- 172.21.15.88:0/1186125233 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6666+0+0 (secure 0 0 0) 0x7fa82008c310 con 0x7fa83415ad00 2024-04-26T23:42:06.594 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.588+0000 7fa8317fa640 1 -- 172.21.15.88:0/1186125233 <== mon.1 v2:172.21.15.175:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fa8280093c0 con 0x7fa8340c4640 2024-04-26T23:42:06.594 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.588+0000 7fa8317fa640 1 -- 172.21.15.88:0/1186125233 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa8340c4640 msgr2=0x7fa83413b820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:06.594 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.588+0000 7fa8317fa640 1 --2- 172.21.15.88:0/1186125233 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa8340c4640 0x7fa83413b820 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fa83415b1c0 tx=0x7fa8280046c0 comp rx=0 tx=0).stop 2024-04-26T23:42:06.594 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.588+0000 7fa8317fa640 1 -- 172.21.15.88:0/1186125233 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa8340c4640 msgr2=0x7fa83413b820 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:42:06.594 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.588+0000 7fa8317fa640 1 --2- 172.21.15.88:0/1186125233 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa8340c4640 0x7fa83413b820 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:06.594 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.588+0000 7fa83966e640 1 --2- 172.21.15.88:0/1186125233 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fa81806c7f0 0x7fa81806ecb0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fa82c0012e0 tx=0x7fa82c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:06.598 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.595+0000 7fa83b0d1640 1 --2- 172.21.15.88:0/1186125233 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa8340c7ee0 0x7fa83413bd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:06.598 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.595+0000 7fa83b0d1640 1 -- 172.21.15.88:0/1186125233 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fa8340766c0 con 0x7fa8340c7ee0 2024-04-26T23:42:06.598 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.595+0000 7fa838e6d640 1 --2- 172.21.15.88:0/1186125233 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa8340c7ee0 0x7fa83413bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:06.599 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.595+0000 7fa838e6d640 1 -- 172.21.15.88:0/1186125233 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fa8340507a0 con 0x7fa8340c7ee0 2024-04-26T23:42:06.599 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.595+0000 7fa838e6d640 1 --2- 172.21.15.88:0/1186125233 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa8340c7ee0 0x7fa83413bd60 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fa82802a1e0 tx=0x7fa828008030 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:06.599 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.596+0000 7fa8317fa640 1 -- 172.21.15.88:0/1186125233 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa828037040 con 0x7fa8340c7ee0 2024-04-26T23:42:06.599 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.596+0000 7fa8317fa640 1 -- 172.21.15.88:0/1186125233 <== mon.1 v2:172.21.15.175:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5065 (secure 0 0 0) 0x7fa828049e50 con 0x7fa8340c7ee0 2024-04-26T23:42:06.599 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.596+0000 7fa8317fa640 1 -- 172.21.15.88:0/1186125233 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa8340c7ee0 msgr2=0x7fa83413bd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:06.599 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.596+0000 7fa8317fa640 1 --2- 172.21.15.88:0/1186125233 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa8340c7ee0 0x7fa83413bd60 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fa82802a1e0 tx=0x7fa828008030 comp rx=0 tx=0).stop 2024-04-26T23:42:06.599 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.596+0000 7fa8317fa640 1 -- 172.21.15.88:0/1186125233 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa8340c7ee0 msgr2=0x7fa83413bd60 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:42:06.599 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.596+0000 7fa8317fa640 1 --2- 172.21.15.88:0/1186125233 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa8340c7ee0 0x7fa83413bd60 secure :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fa82802a1e0 tx=0x7fa828008030 comp rx=0 tx=0).stop 2024-04-26T23:42:06.600 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-04-26T23:42:06.600 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2024-04-26T23:42:06.600 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2024-04-26T23:42:06.600 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "peon", 2024-04-26T23:42:06.600 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 12, 2024-04-26T23:42:06.600 INFO:teuthology.orchestra.run.smithi088.stdout: "uptime": 118939, 2024-04-26T23:42:06.600 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2024-04-26T23:42:06.600 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2024-04-26T23:42:06.600 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2024-04-26T23:42:06.600 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2024-04-26T23:42:06.601 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:42:06.601 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 0, 2024-04-26T23:42:06.601 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2024-04-26T23:42:06.601 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2450521708007866372", 2024-04-26T23:42:06.601 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2024-04-26T23:42:06.601 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-04-26T23:42:06.601 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-04-26T23:42:06.601 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-04-26T23:42:06.601 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-04-26T23:42:06.601 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-04-26T23:42:06.601 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-04-26T23:42:06.601 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-04-26T23:42:06.601 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-04-26T23:42:06.601 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-04-26T23:42:06.602 INFO:teuthology.orchestra.run.smithi088.stdout: "reef", 2024-04-26T23:42:06.602 INFO:teuthology.orchestra.run.smithi088.stdout: "squid" 2024-04-26T23:42:06.602 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:42:06.602 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540701547738038271", 2024-04-26T23:42:06.602 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2024-04-26T23:42:06.602 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-04-26T23:42:06.602 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-04-26T23:42:06.602 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-04-26T23:42:06.602 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-04-26T23:42:06.602 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-04-26T23:42:06.602 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-04-26T23:42:06.602 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-04-26T23:42:06.602 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-04-26T23:42:06.602 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-04-26T23:42:06.603 INFO:teuthology.orchestra.run.smithi088.stdout: "reef", 2024-04-26T23:42:06.603 INFO:teuthology.orchestra.run.smithi088.stdout: "squid" 2024-04-26T23:42:06.603 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:42:06.603 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:42:06.603 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2024-04-26T23:42:06.603 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2024-04-26T23:42:06.603 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2024-04-26T23:42:06.603 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2024-04-26T23:42:06.603 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2024-04-26T23:42:06.603 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "555255e9-7ef9-4454-8dc9-35e96b70035c", 2024-04-26T23:42:06.603 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2024-04-26T23:39:34.291658Z", 2024-04-26T23:42:06.603 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2024-04-26T23:39:34.291658Z", 2024-04-26T23:42:06.603 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 19, 2024-04-26T23:42:06.603 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "squid", 2024-04-26T23:42:06.604 INFO:teuthology.orchestra.run.smithi088.stdout: "election_strategy": 1, 2024-04-26T23:42:06.604 INFO:teuthology.orchestra.run.smithi088.stdout: "disallowed_leaders: ": "", 2024-04-26T23:42:06.604 INFO:teuthology.orchestra.run.smithi088.stdout: "stretch_mode": false, 2024-04-26T23:42:06.604 INFO:teuthology.orchestra.run.smithi088.stdout: "tiebreaker_mon": "", 2024-04-26T23:42:06.604 INFO:teuthology.orchestra.run.smithi088.stdout: "removed_ranks: ": "", 2024-04-26T23:42:06.604 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2024-04-26T23:42:06.604 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2024-04-26T23:42:06.604 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-04-26T23:42:06.604 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-04-26T23:42:06.604 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-04-26T23:42:06.604 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-04-26T23:42:06.604 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-04-26T23:42:06.604 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-04-26T23:42:06.604 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-04-26T23:42:06.604 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-04-26T23:42:06.605 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-04-26T23:42:06.605 INFO:teuthology.orchestra.run.smithi088.stdout: "reef", 2024-04-26T23:42:06.605 INFO:teuthology.orchestra.run.smithi088.stdout: "squid" 2024-04-26T23:42:06.605 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:42:06.605 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2024-04-26T23:42:06.605 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:42:06.605 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2024-04-26T23:42:06.605 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:42:06.605 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2024-04-26T23:42:06.605 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2024-04-26T23:42:06.605 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-04-26T23:42:06.605 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-04-26T23:42:06.606 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:42:06.606 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-04-26T23:42:06.606 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2024-04-26T23:42:06.606 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:42:06.606 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:42:06.606 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:42:06.606 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-04-26T23:42:06.606 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2024-04-26T23:42:06.606 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:42:06.606 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:42:06.606 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:42:06.606 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:42:06.606 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2024-04-26T23:42:06.606 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2024-04-26T23:42:06.607 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-04-26T23:42:06.607 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-04-26T23:42:06.607 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-04-26T23:42:06.607 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:42:06.607 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:42:06.607 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2024-04-26T23:42:06.607 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2024-04-26T23:42:06.607 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-04-26T23:42:06.607 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-04-26T23:42:06.607 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:42:06.607 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-04-26T23:42:06.607 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:3300", 2024-04-26T23:42:06.607 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:42:06.607 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:42:06.607 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:42:06.608 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-04-26T23:42:06.608 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6789", 2024-04-26T23:42:06.608 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:42:06.608 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:42:06.608 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:42:06.608 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:42:06.608 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6789/0", 2024-04-26T23:42:06.608 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.175:6789/0", 2024-04-26T23:42:06.608 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-04-26T23:42:06.608 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-04-26T23:42:06.608 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-04-26T23:42:06.608 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:42:06.608 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:42:06.608 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2024-04-26T23:42:06.608 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2024-04-26T23:42:06.609 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-04-26T23:42:06.609 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-04-26T23:42:06.609 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:42:06.609 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-04-26T23:42:06.609 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:3301", 2024-04-26T23:42:06.609 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:42:06.609 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:42:06.609 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:42:06.609 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-04-26T23:42:06.609 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6790", 2024-04-26T23:42:06.609 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:42:06.609 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:42:06.609 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:42:06.609 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:42:06.609 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6790/0", 2024-04-26T23:42:06.610 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.175:6790/0", 2024-04-26T23:42:06.610 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-04-26T23:42:06.610 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-04-26T23:42:06.610 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-04-26T23:42:06.610 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:42:06.610 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:42:06.610 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:42:06.610 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2024-04-26T23:42:06.610 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2024-04-26T23:42:06.610 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:42:06.610 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:42:06.610 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:42:06.610 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2024-04-26T23:42:06.610 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:42:06.611 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:42:06.611 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": [ 2024-04-26T23:42:06.611 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:42:06.611 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:42:06.611 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:42:06.611 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 3 2024-04-26T23:42:06.611 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:42:06.611 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:42:06.611 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": [ 2024-04-26T23:42:06.611 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:42:06.611 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:42:06.611 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:42:06.612 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2024-04-26T23:42:06.612 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:42:06.612 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:42:06.612 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2024-04-26T23:42:06.612 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:42:06.612 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:42:06.612 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:42:06.612 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2024-04-26T23:42:06.612 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:42:06.612 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:42:06.612 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": [ 2024-04-26T23:42:06.612 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:42:06.612 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:42:06.612 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:42:06.613 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2024-04-26T23:42:06.613 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:42:06.613 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:42:06.613 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:42:06.613 INFO:teuthology.orchestra.run.smithi088.stdout: "stretch_mode": false 2024-04-26T23:42:06.613 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-04-26T23:42:06.614 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.596+0000 7fa83b0d1640 1 -- 172.21.15.88:0/1186125233 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fa81806c7f0 msgr2=0x7fa81806ecb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:06.614 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.596+0000 7fa83b0d1640 1 --2- 172.21.15.88:0/1186125233 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fa81806c7f0 0x7fa81806ecb0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fa82c0012e0 tx=0x7fa82c009040 comp rx=0 tx=0).stop 2024-04-26T23:42:06.614 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.596+0000 7fa83b0d1640 1 -- 172.21.15.88:0/1186125233 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa83415ad00 msgr2=0x7fa8341e36e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:06.614 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.596+0000 7fa83b0d1640 1 --2- 172.21.15.88:0/1186125233 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa83415ad00 0x7fa8341e36e0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fa82000d800 tx=0x7fa82000dcc0 comp rx=0 tx=0).stop 2024-04-26T23:42:06.615 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.596+0000 7fa83966e640 1 -- 172.21.15.88:0/1186125233 reap_dead start 2024-04-26T23:42:06.615 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.596+0000 7fa83b0d1640 1 -- 172.21.15.88:0/1186125233 shutdown_connections 2024-04-26T23:42:06.615 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.596+0000 7fa83b0d1640 1 --2- 172.21.15.88:0/1186125233 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa83415ad00 0x7fa8341e36e0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:06.615 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.596+0000 7fa83b0d1640 1 -- 172.21.15.88:0/1186125233 >> 172.21.15.88:0/1186125233 conn(0x7fa8340ca2f0 msgr2=0x7fa8340ca6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:06.615 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.596+0000 7fa83b0d1640 1 -- 172.21.15.88:0/1186125233 shutdown_connections 2024-04-26T23:42:06.615 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.596+0000 7fa83b0d1640 1 -- 172.21.15.88:0/1186125233 wait complete. 2024-04-26T23:42:06.615 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-04-26T23:42:06.615 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-04-26T23:42:06.615 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-04-26T23:42:06.718 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.715+0000 7f211bf5f640 1 Processor -- start 2024-04-26T23:42:06.718 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.715+0000 7f211bf5f640 1 -- start start 2024-04-26T23:42:06.720 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.715+0000 7f211bf5f640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f21141510c0 0x7f2114072f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:06.720 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.715+0000 7f211bf5f640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f21140734d0 0x7f211406d320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:06.720 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.715+0000 7f211bf5f640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f21140c4b50 con 0x7f21140c4160 2024-04-26T23:42:06.720 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.715+0000 7f211bf5f640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f21140c50d0 con 0x7f21141510c0 2024-04-26T23:42:06.720 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.715+0000 7f211bf5f640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f21141514a0 con 0x7f21140734d0 2024-04-26T23:42:06.720 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.716+0000 7f2119cfb640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f21141510c0 0x7f2114072f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:06.720 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.716+0000 7f2119cfb640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f21141510c0 0x7f2114072f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:50914/0 (socket says 172.21.15.88:50914) 2024-04-26T23:42:06.720 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.716+0000 7f2119cfb640 1 -- 172.21.15.88:0/2873478809 learned_addr learned my addr 172.21.15.88:0/2873478809 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:42:06.720 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.716+0000 7f21194fa640 1 --2- 172.21.15.88:0/2873478809 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f21140734d0 0x7f211406d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:06.721 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.716+0000 7f2119cfb640 1 -- 172.21.15.88:0/2873478809 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f21140734d0 msgr2=0x7f211406d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:42:06.721 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.716+0000 7f2119cfb640 1 --2- 172.21.15.88:0/2873478809 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f21140734d0 0x7f211406d320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:06.721 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.716+0000 7f2119cfb640 1 -- 172.21.15.88:0/2873478809 >> v1:172.21.15.175:6789/0 conn(0x7f21140c4160 legacy=0x7f2114157070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:06.721 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.716+0000 7f2119cfb640 1 -- 172.21.15.88:0/2873478809 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2114154920 con 0x7f21141510c0 2024-04-26T23:42:06.721 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.717+0000 7f2119cfb640 1 --2- 172.21.15.88:0/2873478809 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f21141510c0 0x7f2114072f90 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f21140c5250 tx=0x7f211002a130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62e399428d390267 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:06.721 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.717+0000 7f2118cf9640 1 -- 172.21.15.88:0/2873478809 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2110037070 con 0x7f21141510c0 2024-04-26T23:42:06.721 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.717+0000 7f2118cf9640 1 -- 172.21.15.88:0/2873478809 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2110032440 con 0x7f21141510c0 2024-04-26T23:42:06.721 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.717+0000 7f2118cf9640 1 -- 172.21.15.88:0/2873478809 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2110032810 con 0x7f21141510c0 2024-04-26T23:42:06.722 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.718+0000 7f211bf5f640 1 -- 172.21.15.88:0/2873478809 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f21141510c0 msgr2=0x7f2114072f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:06.722 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.718+0000 7f211bf5f640 1 --2- 172.21.15.88:0/2873478809 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f21141510c0 0x7f2114072f90 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f21140c5250 tx=0x7f211002a130 comp rx=0 tx=0).stop 2024-04-26T23:42:06.722 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.718+0000 7f211bf5f640 1 -- 172.21.15.88:0/2873478809 shutdown_connections 2024-04-26T23:42:06.722 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.718+0000 7f211bf5f640 1 --2- 172.21.15.88:0/2873478809 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f21140734d0 0x7f211406d320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:06.722 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.718+0000 7f211bf5f640 1 --2- 172.21.15.88:0/2873478809 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f21141510c0 0x7f2114072f90 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:06.722 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.718+0000 7f211bf5f640 1 -- 172.21.15.88:0/2873478809 >> 172.21.15.88:0/2873478809 conn(0x7f21140c5ce0 msgr2=0x7f21140c60f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:06.722 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.718+0000 7f211bf5f640 1 -- 172.21.15.88:0/2873478809 shutdown_connections 2024-04-26T23:42:06.722 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.718+0000 7f211bf5f640 1 -- 172.21.15.88:0/2873478809 wait complete. 2024-04-26T23:42:06.723 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.720+0000 7f211bf5f640 1 Processor -- start 2024-04-26T23:42:06.723 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.720+0000 7f211bf5f640 1 -- start start 2024-04-26T23:42:06.727 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.721+0000 7f211bf5f640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f21140c4160 0x7f2114155650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:06.727 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.721+0000 7f211bf5f640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f21141510c0 0x7f2114155fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:06.727 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.721+0000 7f211bf5f640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2114154e70 0x7f2114146bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:06.727 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.721+0000 7f211bf5f640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f21140c5920 con 0x7f21140c4160 2024-04-26T23:42:06.727 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.721+0000 7f211bf5f640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f21140c5400 con 0x7f21141510c0 2024-04-26T23:42:06.727 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.721+0000 7f211bf5f640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f211406f500 con 0x7f2114154e70 2024-04-26T23:42:06.727 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.721+0000 7f2119cfb640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f21140c4160 0x7f2114155650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:06.727 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.721+0000 7f2119cfb640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f21140c4160 0x7f2114155650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:50916/0 (socket says 172.21.15.88:50916) 2024-04-26T23:42:06.728 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.721+0000 7f2119cfb640 1 -- 172.21.15.88:0/2208105787 learned_addr learned my addr 172.21.15.88:0/2208105787 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:42:06.728 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.721+0000 7f21194fa640 1 --2- 172.21.15.88:0/2208105787 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f21141510c0 0x7f2114155fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:06.728 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.721+0000 7f211a4fc640 1 --2- 172.21.15.88:0/2208105787 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2114154e70 0x7f2114146bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:06.728 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.721+0000 7f2119cfb640 1 -- 172.21.15.88:0/2208105787 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2114154e70 msgr2=0x7f2114146bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:06.728 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.721+0000 7f2119cfb640 1 --2- 172.21.15.88:0/2208105787 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2114154e70 0x7f2114146bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:06.728 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.721+0000 7f2119cfb640 1 -- 172.21.15.88:0/2208105787 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f21141510c0 msgr2=0x7f2114155fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:06.728 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.721+0000 7f2119cfb640 1 --2- 172.21.15.88:0/2208105787 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f21141510c0 0x7f2114155fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:06.728 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.721+0000 7f2119cfb640 1 -- 172.21.15.88:0/2208105787 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2114155370 con 0x7f21140c4160 2024-04-26T23:42:06.728 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.721+0000 7f211a4fc640 1 --2- 172.21.15.88:0/2208105787 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2114154e70 0x7f2114146bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:42:06.728 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.721+0000 7f2119cfb640 1 --2- 172.21.15.88:0/2208105787 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f21140c4160 0x7f2114155650 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f211002a170 tx=0x7f21100046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:06.728 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.721+0000 7f210a7fc640 1 -- 172.21.15.88:0/2208105787 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2110037040 con 0x7f21140c4160 2024-04-26T23:42:06.728 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.721+0000 7f210a7fc640 1 -- 172.21.15.88:0/2208105787 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2110042070 con 0x7f21140c4160 2024-04-26T23:42:06.728 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.722+0000 7f210a7fc640 1 -- 172.21.15.88:0/2208105787 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2110030880 con 0x7f21140c4160 2024-04-26T23:42:06.729 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.722+0000 7f211bf5f640 1 -- 172.21.15.88:0/2208105787 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21141eced0 con 0x7f21140c4160 2024-04-26T23:42:06.729 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.722+0000 7f211bf5f640 1 -- 172.21.15.88:0/2208105787 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21141ed490 con 0x7f21140c4160 2024-04-26T23:42:06.729 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.722+0000 7f211bf5f640 1 --2- 172.21.15.88:0/2208105787 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f21140734d0 0x7f21141e96b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:06.729 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.722+0000 7f211bf5f640 1 -- 172.21.15.88:0/2208105787 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f21141ed6d0 con 0x7f21140734d0 2024-04-26T23:42:06.729 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.723+0000 7f21194fa640 1 --2- 172.21.15.88:0/2208105787 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f21140734d0 0x7f21141e96b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:06.729 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.723+0000 7f21194fa640 1 -- 172.21.15.88:0/2208105787 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2114068dc0 con 0x7f21140734d0 2024-04-26T23:42:06.729 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.723+0000 7f210a7fc640 1 -- 172.21.15.88:0/2208105787 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2110030a20 con 0x7f21140c4160 2024-04-26T23:42:06.729 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.723+0000 7f21194fa640 1 --2- 172.21.15.88:0/2208105787 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f21140734d0 0x7f21141e96b0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f21040118b0 tx=0x7f2104011d70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:06.729 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.723+0000 7f210a7fc640 1 --2- 172.21.15.88:0/2208105787 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f20f806c8f0 0x7f20f806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:06.729 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.724+0000 7f210a7fc640 1 -- 172.21.15.88:0/2208105787 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6666+0+0 (secure 0 0 0) 0x7f21100ac670 con 0x7f21140c4160 2024-04-26T23:42:06.729 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.724+0000 7f211a4fc640 1 --2- 172.21.15.88:0/2208105787 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f20f806c8f0 0x7f20f806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:06.729 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.724+0000 7f210a7fc640 1 -- 172.21.15.88:0/2208105787 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2104019070 con 0x7f21140734d0 2024-04-26T23:42:06.729 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.724+0000 7f210a7fc640 1 -- 172.21.15.88:0/2208105787 <== mon.2 v2:172.21.15.175:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f2104004300 con 0x7f21140734d0 2024-04-26T23:42:06.729 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.724+0000 7f210a7fc640 1 -- 172.21.15.88:0/2208105787 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f21140734d0 msgr2=0x7f21141e96b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:06.730 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.724+0000 7f210a7fc640 1 --2- 172.21.15.88:0/2208105787 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f21140734d0 0x7f21141e96b0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f21040118b0 tx=0x7f2104011d70 comp rx=0 tx=0).stop 2024-04-26T23:42:06.730 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.724+0000 7f210a7fc640 1 -- 172.21.15.88:0/2208105787 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f21140734d0 msgr2=0x7f21141e96b0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:42:06.730 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.724+0000 7f210a7fc640 1 --2- 172.21.15.88:0/2208105787 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f21140734d0 0x7f21141e96b0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:06.730 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.724+0000 7f211a4fc640 1 --2- 172.21.15.88:0/2208105787 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f20f806c8f0 0x7f20f806edb0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f21141552a0 tx=0x7f210c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:06.735 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.732+0000 7f211bf5f640 1 --2- 172.21.15.88:0/2208105787 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2114147110 0x7f21141e9bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:06.735 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.732+0000 7f211bf5f640 1 -- 172.21.15.88:0/2208105787 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f21140507a0 con 0x7f2114147110 2024-04-26T23:42:06.735 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.732+0000 7f21194fa640 1 --2- 172.21.15.88:0/2208105787 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2114147110 0x7f21141e9bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:06.736 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.732+0000 7f21194fa640 1 -- 172.21.15.88:0/2208105787 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f21140c3ed0 con 0x7f2114147110 2024-04-26T23:42:06.736 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.733+0000 7f21194fa640 1 --2- 172.21.15.88:0/2208105787 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2114147110 0x7f21141e9bf0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f21040118b0 tx=0x7f21040046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:06.736 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.733+0000 7f210a7fc640 1 -- 172.21.15.88:0/2208105787 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2104019040 con 0x7f2114147110 2024-04-26T23:42:06.736 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.733+0000 7f210a7fc640 1 -- 172.21.15.88:0/2208105787 <== mon.2 v2:172.21.15.175:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5208 (secure 0 0 0) 0x7f210401e450 con 0x7f2114147110 2024-04-26T23:42:06.736 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.733+0000 7f210a7fc640 1 -- 172.21.15.88:0/2208105787 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2114147110 msgr2=0x7f21141e9bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:06.736 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.733+0000 7f210a7fc640 1 --2- 172.21.15.88:0/2208105787 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2114147110 0x7f21141e9bf0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f21040118b0 tx=0x7f21040046c0 comp rx=0 tx=0).stop 2024-04-26T23:42:06.736 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.733+0000 7f210a7fc640 1 -- 172.21.15.88:0/2208105787 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2114147110 msgr2=0x7f21141e9bf0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:42:06.736 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.733+0000 7f210a7fc640 1 --2- 172.21.15.88:0/2208105787 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2114147110 0x7f21141e9bf0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:06.737 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-04-26T23:42:06.737 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2024-04-26T23:42:06.737 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2024-04-26T23:42:06.737 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "peon", 2024-04-26T23:42:06.737 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 12, 2024-04-26T23:42:06.737 INFO:teuthology.orchestra.run.smithi088.stdout: "uptime": 119076, 2024-04-26T23:42:06.737 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2024-04-26T23:42:06.737 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2024-04-26T23:42:06.737 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2024-04-26T23:42:06.737 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2024-04-26T23:42:06.737 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:42:06.738 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 0, 2024-04-26T23:42:06.738 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2024-04-26T23:42:06.738 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2450521708007866372", 2024-04-26T23:42:06.738 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2024-04-26T23:42:06.738 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-04-26T23:42:06.738 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-04-26T23:42:06.738 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-04-26T23:42:06.738 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-04-26T23:42:06.738 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-04-26T23:42:06.738 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-04-26T23:42:06.738 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-04-26T23:42:06.738 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-04-26T23:42:06.738 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-04-26T23:42:06.739 INFO:teuthology.orchestra.run.smithi088.stdout: "reef", 2024-04-26T23:42:06.739 INFO:teuthology.orchestra.run.smithi088.stdout: "squid" 2024-04-26T23:42:06.739 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:42:06.739 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540701547738038271", 2024-04-26T23:42:06.739 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2024-04-26T23:42:06.739 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-04-26T23:42:06.739 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-04-26T23:42:06.739 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-04-26T23:42:06.739 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-04-26T23:42:06.739 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-04-26T23:42:06.739 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-04-26T23:42:06.739 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-04-26T23:42:06.739 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-04-26T23:42:06.739 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-04-26T23:42:06.739 INFO:teuthology.orchestra.run.smithi088.stdout: "reef", 2024-04-26T23:42:06.740 INFO:teuthology.orchestra.run.smithi088.stdout: "squid" 2024-04-26T23:42:06.740 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:42:06.740 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:42:06.740 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2024-04-26T23:42:06.740 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2024-04-26T23:42:06.740 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2024-04-26T23:42:06.740 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2024-04-26T23:42:06.740 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2024-04-26T23:42:06.740 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "555255e9-7ef9-4454-8dc9-35e96b70035c", 2024-04-26T23:42:06.740 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2024-04-26T23:39:34.291658Z", 2024-04-26T23:42:06.740 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2024-04-26T23:39:34.291658Z", 2024-04-26T23:42:06.740 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 19, 2024-04-26T23:42:06.740 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "squid", 2024-04-26T23:42:06.740 INFO:teuthology.orchestra.run.smithi088.stdout: "election_strategy": 1, 2024-04-26T23:42:06.740 INFO:teuthology.orchestra.run.smithi088.stdout: "disallowed_leaders: ": "", 2024-04-26T23:42:06.741 INFO:teuthology.orchestra.run.smithi088.stdout: "stretch_mode": false, 2024-04-26T23:42:06.741 INFO:teuthology.orchestra.run.smithi088.stdout: "tiebreaker_mon": "", 2024-04-26T23:42:06.741 INFO:teuthology.orchestra.run.smithi088.stdout: "removed_ranks: ": "", 2024-04-26T23:42:06.741 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2024-04-26T23:42:06.741 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2024-04-26T23:42:06.741 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-04-26T23:42:06.741 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-04-26T23:42:06.741 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-04-26T23:42:06.741 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-04-26T23:42:06.741 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-04-26T23:42:06.741 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-04-26T23:42:06.741 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-04-26T23:42:06.741 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-04-26T23:42:06.741 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-04-26T23:42:06.741 INFO:teuthology.orchestra.run.smithi088.stdout: "reef", 2024-04-26T23:42:06.742 INFO:teuthology.orchestra.run.smithi088.stdout: "squid" 2024-04-26T23:42:06.742 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:42:06.742 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2024-04-26T23:42:06.742 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:42:06.742 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2024-04-26T23:42:06.742 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:42:06.742 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2024-04-26T23:42:06.742 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2024-04-26T23:42:06.742 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-04-26T23:42:06.742 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-04-26T23:42:06.742 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:42:06.742 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-04-26T23:42:06.742 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2024-04-26T23:42:06.742 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:42:06.743 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:42:06.743 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:42:06.743 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-04-26T23:42:06.743 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2024-04-26T23:42:06.743 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:42:06.743 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:42:06.743 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:42:06.743 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:42:06.743 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2024-04-26T23:42:06.743 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2024-04-26T23:42:06.743 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-04-26T23:42:06.743 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-04-26T23:42:06.743 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-04-26T23:42:06.743 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:42:06.743 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:42:06.744 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2024-04-26T23:42:06.744 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2024-04-26T23:42:06.744 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-04-26T23:42:06.744 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-04-26T23:42:06.744 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:42:06.744 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-04-26T23:42:06.744 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:3300", 2024-04-26T23:42:06.744 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:42:06.744 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:42:06.744 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:42:06.744 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-04-26T23:42:06.744 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6789", 2024-04-26T23:42:06.744 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:42:06.744 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:42:06.745 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:42:06.745 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:42:06.745 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6789/0", 2024-04-26T23:42:06.745 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.175:6789/0", 2024-04-26T23:42:06.745 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-04-26T23:42:06.745 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-04-26T23:42:06.745 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-04-26T23:42:06.745 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:42:06.745 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:42:06.745 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2024-04-26T23:42:06.745 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2024-04-26T23:42:06.745 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-04-26T23:42:06.745 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-04-26T23:42:06.745 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:42:06.745 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-04-26T23:42:06.746 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:3301", 2024-04-26T23:42:06.746 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:42:06.746 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:42:06.746 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:42:06.746 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-04-26T23:42:06.746 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6790", 2024-04-26T23:42:06.746 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:42:06.746 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:42:06.746 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:42:06.746 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:42:06.746 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6790/0", 2024-04-26T23:42:06.746 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.175:6790/0", 2024-04-26T23:42:06.746 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-04-26T23:42:06.747 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-04-26T23:42:06.747 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-04-26T23:42:06.749 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:42:06.749 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:42:06.749 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:42:06.749 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2024-04-26T23:42:06.749 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2024-04-26T23:42:06.749 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:42:06.749 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:42:06.749 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:42:06.750 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2024-04-26T23:42:06.750 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:42:06.750 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:42:06.750 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": [ 2024-04-26T23:42:06.750 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:42:06.750 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:42:06.750 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:42:06.750 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2024-04-26T23:42:06.750 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:42:06.750 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:42:06.750 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": [ 2024-04-26T23:42:06.750 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:42:06.750 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:42:06.751 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:42:06.751 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 7 2024-04-26T23:42:06.751 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:42:06.751 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:42:06.751 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2024-04-26T23:42:06.751 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:42:06.751 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x2f018fb87aa4aafe", 2024-04-26T23:42:06.751 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:42:06.751 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2024-04-26T23:42:06.751 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:42:06.751 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:42:06.751 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:42:06.751 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:42:06.751 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 4 2024-04-26T23:42:06.751 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:42:06.751 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:42:06.752 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": [ 2024-04-26T23:42:06.752 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:42:06.752 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:42:06.752 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:42:06.752 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2024-04-26T23:42:06.752 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:42:06.752 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:42:06.752 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:42:06.752 INFO:teuthology.orchestra.run.smithi088.stdout: "stretch_mode": false 2024-04-26T23:42:06.752 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-04-26T23:42:06.753 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.733+0000 7f211bf5f640 1 -- 172.21.15.88:0/2208105787 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f20f806c8f0 msgr2=0x7f20f806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:06.754 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.733+0000 7f211bf5f640 1 --2- 172.21.15.88:0/2208105787 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f20f806c8f0 0x7f20f806edb0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f21141552a0 tx=0x7f210c009040 comp rx=0 tx=0).stop 2024-04-26T23:42:06.754 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.733+0000 7f211bf5f640 1 -- 172.21.15.88:0/2208105787 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f21140c4160 msgr2=0x7f2114155650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:06.754 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.733+0000 7f211bf5f640 1 --2- 172.21.15.88:0/2208105787 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f21140c4160 0x7f2114155650 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f211002a170 tx=0x7f21100046c0 comp rx=0 tx=0).stop 2024-04-26T23:42:06.754 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.733+0000 7f211a4fc640 1 -- 172.21.15.88:0/2208105787 reap_dead start 2024-04-26T23:42:06.754 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.733+0000 7f211a4fc640 1 -- 172.21.15.88:0/2208105787 reap_dead start 2024-04-26T23:42:06.754 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.733+0000 7f211bf5f640 1 -- 172.21.15.88:0/2208105787 shutdown_connections 2024-04-26T23:42:06.754 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.733+0000 7f211bf5f640 1 -- 172.21.15.88:0/2208105787 >> 172.21.15.88:0/2208105787 conn(0x7f21140c5ce0 msgr2=0x7f2114150120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:06.754 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.733+0000 7f211bf5f640 1 -- 172.21.15.88:0/2208105787 shutdown_connections 2024-04-26T23:42:06.754 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.733+0000 7f211bf5f640 1 -- 172.21.15.88:0/2208105787 wait complete. 2024-04-26T23:42:06.754 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-04-26T23:42:06.755 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2024-04-26T23:42:06.755 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2024-04-26T23:42:06.853 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.850+0000 7f993df38640 1 Processor -- start 2024-04-26T23:42:06.854 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.850+0000 7f993df38640 1 -- start start 2024-04-26T23:42:06.857 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.851+0000 7f993df38640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9938074c10 0x7f99380c4280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:06.858 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.851+0000 7f993df38640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f9938073700 0x7f9938073bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:06.858 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.851+0000 7f993df38640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f99381579d0 con 0x7f993813ffb0 2024-04-26T23:42:06.858 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.851+0000 7f993df38640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f9938070880 con 0x7f9938073700 2024-04-26T23:42:06.858 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.851+0000 7f993df38640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f99380ab680 con 0x7f9938074c10 2024-04-26T23:42:06.858 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.851+0000 7f9936ffd640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9938074c10 0x7f99380c4280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:06.858 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.851+0000 7f9937fff640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f9938073700 0x7f9938073bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:06.858 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.851+0000 7f9936ffd640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9938074c10 0x7f99380c4280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.88:46218/0 (socket says 172.21.15.88:46218) 2024-04-26T23:42:06.859 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.851+0000 7f9936ffd640 1 -- 172.21.15.88:0/4003626978 learned_addr learned my addr 172.21.15.88:0/4003626978 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:42:06.859 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.851+0000 7f99377fe640 1 --1- 172.21.15.88:0/4003626978 >> v1:172.21.15.175:6789/0 conn(0x7f993813ffb0 0x7f99380c3b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.88:36696/0 (socket says 172.21.15.88:36696) 2024-04-26T23:42:06.859 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.852+0000 7f9936ffd640 1 -- 172.21.15.88:0/4003626978 >> v2:172.21.15.175:3300/0 conn(0x7f9938073700 msgr2=0x7f9938073bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:42:06.859 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.852+0000 7f9936ffd640 1 --2- 172.21.15.88:0/4003626978 >> v2:172.21.15.175:3300/0 conn(0x7f9938073700 0x7f9938073bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:06.859 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.852+0000 7f9936ffd640 1 -- 172.21.15.88:0/4003626978 >> v1:172.21.15.175:6789/0 conn(0x7f993813ffb0 legacy=0x7f99380c3b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:06.859 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.852+0000 7f9936ffd640 1 -- 172.21.15.88:0/4003626978 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99380ab960 con 0x7f9938074c10 2024-04-26T23:42:06.859 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.852+0000 7f9936ffd640 1 --2- 172.21.15.88:0/4003626978 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9938074c10 0x7f99380c4280 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f992c009870 tx=0x7f992c02a270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4cb4267e5bc6efc server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:06.859 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.852+0000 7f99367fc640 1 -- 172.21.15.88:0/4003626978 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f992c037070 con 0x7f9938074c10 2024-04-26T23:42:06.859 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.852+0000 7f99367fc640 1 -- 172.21.15.88:0/4003626978 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f992c032440 con 0x7f9938074c10 2024-04-26T23:42:06.860 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.853+0000 7f99367fc640 1 -- 172.21.15.88:0/4003626978 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f992c032810 con 0x7f9938074c10 2024-04-26T23:42:06.860 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.853+0000 7f993df38640 1 -- 172.21.15.88:0/4003626978 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9938074c10 msgr2=0x7f99380c4280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:06.860 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.853+0000 7f993df38640 1 --2- 172.21.15.88:0/4003626978 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9938074c10 0x7f99380c4280 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f992c009870 tx=0x7f992c02a270 comp rx=0 tx=0).stop 2024-04-26T23:42:06.860 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.853+0000 7f993df38640 1 -- 172.21.15.88:0/4003626978 shutdown_connections 2024-04-26T23:42:06.860 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.853+0000 7f993df38640 1 --2- 172.21.15.88:0/4003626978 >> v2:172.21.15.175:3300/0 conn(0x7f9938073700 0x7f9938073bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:06.860 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.853+0000 7f993df38640 1 --2- 172.21.15.88:0/4003626978 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9938074c10 0x7f99380c4280 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:06.860 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.853+0000 7f993df38640 1 -- 172.21.15.88:0/4003626978 >> 172.21.15.88:0/4003626978 conn(0x7f99380ca2f0 msgr2=0x7f99380ca6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:06.860 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.853+0000 7f993df38640 1 -- 172.21.15.88:0/4003626978 shutdown_connections 2024-04-26T23:42:06.860 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.853+0000 7f993df38640 1 -- 172.21.15.88:0/4003626978 wait complete. 2024-04-26T23:42:06.860 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.854+0000 7f993df38640 1 Processor -- start 2024-04-26T23:42:06.860 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.854+0000 7f993df38640 1 -- start start 2024-04-26T23:42:06.863 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.855+0000 7f993df38640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9938073700 0x7f99381f0000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:06.863 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.855+0000 7f993df38640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9938074c10 0x7f99380c4fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:06.863 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.855+0000 7f993df38640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f993813ffb0 0x7f99380c54e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:06.863 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.855+0000 7f993df38640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f9938157660 con 0x7f9938073700 2024-04-26T23:42:06.863 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.855+0000 7f993df38640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f9938140390 con 0x7f993813ffb0 2024-04-26T23:42:06.863 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.855+0000 7f993df38640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f99380740f0 con 0x7f9938074c10 2024-04-26T23:42:06.863 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.855+0000 7f99377fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9938073700 0x7f99381f0000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:06.863 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.855+0000 7f99377fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9938073700 0x7f99381f0000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:50920/0 (socket says 172.21.15.88:50920) 2024-04-26T23:42:06.863 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.855+0000 7f99377fe640 1 -- 172.21.15.88:0/2944586524 learned_addr learned my addr 172.21.15.88:0/2944586524 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:42:06.864 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.855+0000 7f9936ffd640 1 --2- 172.21.15.88:0/2944586524 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9938074c10 0x7f99380c4fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:06.864 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.855+0000 7f9937fff640 1 --2- 172.21.15.88:0/2944586524 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f993813ffb0 0x7f99380c54e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:06.864 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.856+0000 7f99377fe640 1 -- 172.21.15.88:0/2944586524 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9938074c10 msgr2=0x7f99380c4fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:06.864 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.856+0000 7f99377fe640 1 --2- 172.21.15.88:0/2944586524 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9938074c10 0x7f99380c4fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:06.864 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.856+0000 7f99377fe640 1 -- 172.21.15.88:0/2944586524 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f993813ffb0 msgr2=0x7f99380c54e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:06.864 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.856+0000 7f99377fe640 1 --2- 172.21.15.88:0/2944586524 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f993813ffb0 0x7f99380c54e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:06.864 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.856+0000 7f99377fe640 1 -- 172.21.15.88:0/2944586524 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99381f0c60 con 0x7f9938073700 2024-04-26T23:42:06.864 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.856+0000 7f99377fe640 1 --2- 172.21.15.88:0/2944586524 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9938073700 0x7f99381f0000 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f992800c3f0 tx=0x7f992800c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:06.864 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.856+0000 7f991ffff640 1 -- 172.21.15.88:0/2944586524 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99280074e0 con 0x7f9938073700 2024-04-26T23:42:06.864 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.856+0000 7f991ffff640 1 -- 172.21.15.88:0/2944586524 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9928007680 con 0x7f9938073700 2024-04-26T23:42:06.864 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.856+0000 7f993df38640 1 -- 172.21.15.88:0/2944586524 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99381f0980 con 0x7f9938073700 2024-04-26T23:42:06.864 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.856+0000 7f991ffff640 1 -- 172.21.15.88:0/2944586524 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9928004a00 con 0x7f9938073700 2024-04-26T23:42:06.864 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.856+0000 7f993df38640 1 -- 172.21.15.88:0/2944586524 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9938153580 con 0x7f9938073700 2024-04-26T23:42:06.864 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.857+0000 7f993df38640 1 -- 172.21.15.88:0/2944586524 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9938069ee0 con 0x7f9938073700 2024-04-26T23:42:06.865 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.857+0000 7f991ffff640 1 -- 172.21.15.88:0/2944586524 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f992801a020 con 0x7f9938073700 2024-04-26T23:42:06.865 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.858+0000 7f991ffff640 1 --2- 172.21.15.88:0/2944586524 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f992406c8f0 0x7f992406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:06.865 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.858+0000 7f991ffff640 1 -- 172.21.15.88:0/2944586524 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6666+0+0 (secure 0 0 0) 0x7f992808b4f0 con 0x7f9938073700 2024-04-26T23:42:06.865 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.858+0000 7f9936ffd640 1 --2- 172.21.15.88:0/2944586524 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f992406c8f0 0x7f992406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:06.865 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.858+0000 7f9936ffd640 1 --2- 172.21.15.88:0/2944586524 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f992406c8f0 0x7f992406edb0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f992c034000 tx=0x7f992c02e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:06.869 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:06.866+0000 7f991ffff640 1 -- 172.21.15.88:0/2944586524 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f9938069ee0 con 0x7f9938073700 2024-04-26T23:42:07.141 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:07.138+0000 7f993df38640 1 -- 172.21.15.88:0/2944586524 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7f99380507a0 con 0x7f9938073700 2024-04-26T23:42:07.142 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:07.139+0000 7f991ffff640 1 -- 172.21.15.88:0/2944586524 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (secure 0 0 0) 0x7f9928058fa0 con 0x7f9938073700 2024-04-26T23:42:07.146 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:07.142+0000 7f993df38640 1 -- 172.21.15.88:0/2944586524 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f992406c8f0 msgr2=0x7f992406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:07.146 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:07.142+0000 7f993df38640 1 --2- 172.21.15.88:0/2944586524 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f992406c8f0 0x7f992406edb0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f992c034000 tx=0x7f992c02e000 comp rx=0 tx=0).stop 2024-04-26T23:42:07.146 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:07.142+0000 7f993df38640 1 -- 172.21.15.88:0/2944586524 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9938073700 msgr2=0x7f99381f0000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:07.146 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:07.142+0000 7f993df38640 1 --2- 172.21.15.88:0/2944586524 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9938073700 0x7f99381f0000 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f992800c3f0 tx=0x7f992800c8b0 comp rx=0 tx=0).stop 2024-04-26T23:42:07.147 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:07.142+0000 7f993df38640 1 -- 172.21.15.88:0/2944586524 shutdown_connections 2024-04-26T23:42:07.147 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:07.142+0000 7f993df38640 1 --2- 172.21.15.88:0/2944586524 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f992406c8f0 0x7f992406edb0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:07.147 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:07.142+0000 7f993df38640 1 --2- 172.21.15.88:0/2944586524 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9938074c10 0x7f99380c4fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:07.147 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:07.142+0000 7f993df38640 1 --2- 172.21.15.88:0/2944586524 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f993813ffb0 0x7f99380c54e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:07.147 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:07.142+0000 7f993df38640 1 --2- 172.21.15.88:0/2944586524 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9938073700 0x7f99381f0000 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:07.147 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:07.142+0000 7f993df38640 1 -- 172.21.15.88:0/2944586524 >> 172.21.15.88:0/2944586524 conn(0x7f99380ca2f0 msgr2=0x7f99380c9480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:07.147 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:07.143+0000 7f993df38640 1 -- 172.21.15.88:0/2944586524 shutdown_connections 2024-04-26T23:42:07.147 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:07.143+0000 7f993df38640 1 -- 172.21.15.88:0/2944586524 wait complete. 2024-04-26T23:42:07.157 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2024-04-26T23:42:17.157 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-04-26T23:42:17.158 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-04-26T23:42:17.256 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:17.252+0000 7f028d55f640 1 Processor -- start 2024-04-26T23:42:17.257 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:17.252+0000 7f028d55f640 1 -- start start 2024-04-26T23:42:17.257 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:17.252+0000 7f028d55f640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0288154160 0x7f0288156bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:17.257 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:17.252+0000 7f028d55f640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f02880c8df0 con 0x7f028815a1a0 2024-04-26T23:42:17.257 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:17.252+0000 7f028d55f640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0288154540 con 0x7f02880ca5a0 2024-04-26T23:42:17.257 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:17.252+0000 7f028d55f640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f02880c9100 con 0x7f0288154160 2024-04-26T23:42:17.257 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:17.253+0000 7f02877fe640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f028815a1a0 0x7f02880c9590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:37084/0 (socket says 172.21.15.88:37084) 2024-04-26T23:42:17.257 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:17.253+0000 7f02877fe640 1 -- 172.21.15.88:0/1316385629 learned_addr learned my addr 172.21.15.88:0/1316385629 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-26T23:42:17.257 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:17.253+0000 7f0286ffd640 1 --2- 172.21.15.88:0/1316385629 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0288154160 0x7f0288156bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:17.259 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:17.253+0000 7f0285ffb640 1 -- 172.21.15.88:0/1316385629 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4250564484 0 0) 0x7f0280001490 con 0x7f028815a1a0 2024-04-26T23:42:17.259 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:17.253+0000 7f0286ffd640 1 -- 172.21.15.88:0/1316385629 >> v1:172.21.15.175:6789/0 conn(0x7f02880ca5a0 legacy=0x7f02880c6e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:17.259 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:17.253+0000 7f0286ffd640 1 -- 172.21.15.88:0/1316385629 >> v1:172.21.15.88:6789/0 conn(0x7f028815a1a0 legacy=0x7f02880c9590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:17.259 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:17.253+0000 7f0286ffd640 1 -- 172.21.15.88:0/1316385629 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f028815a910 con 0x7f0288154160 2024-04-26T23:42:17.259 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:17.254+0000 7f0286ffd640 1 --2- 172.21.15.88:0/1316385629 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0288154160 0x7f0288156bb0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f0278009750 tx=0x7f027802a0a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aa7ada91255e1cf9 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:17.259 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:17.254+0000 7f0285ffb640 1 -- 172.21.15.88:0/1316385629 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0278037070 con 0x7f0288154160 2024-04-26T23:42:17.259 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:17.254+0000 7f0285ffb640 1 -- 172.21.15.88:0/1316385629 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f027802adb0 con 0x7f0288154160 2024-04-26T23:42:17.259 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:17.254+0000 7f0285ffb640 1 -- 172.21.15.88:0/1316385629 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0278032660 con 0x7f0288154160 2024-04-26T23:42:17.259 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:17.254+0000 7f028d55f640 1 -- 172.21.15.88:0/1316385629 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0288154160 msgr2=0x7f0288156bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:17.259 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:17.254+0000 7f028d55f640 1 --2- 172.21.15.88:0/1316385629 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0288154160 0x7f0288156bb0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f0278009750 tx=0x7f027802a0a0 comp rx=0 tx=0).stop 2024-04-26T23:42:17.260 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:17.255+0000 7f028d55f640 1 -- 172.21.15.88:0/1316385629 shutdown_connections 2024-04-26T23:42:17.260 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:17.255+0000 7f028d55f640 1 --2- 172.21.15.88:0/1316385629 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0288154160 0x7f0288156bb0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:17.260 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:17.255+0000 7f028d55f640 1 -- 172.21.15.88:0/1316385629 >> 172.21.15.88:0/1316385629 conn(0x7f02880ae010 msgr2=0x7f02880ae3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:17.260 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:17.255+0000 7f028d55f640 1 -- 172.21.15.88:0/1316385629 shutdown_connections 2024-04-26T23:42:17.260 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:17.255+0000 7f028d55f640 1 -- 172.21.15.88:0/1316385629 wait complete. 2024-04-26T23:42:17.260 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:17.256+0000 7f028d55f640 1 Processor -- start 2024-04-26T23:42:17.260 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:17.256+0000 7f028d55f640 1 -- start start 2024-04-26T23:42:17.262 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:17.257+0000 7f028d55f640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f02880ca5a0 0x7f02881527d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:17.262 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:17.257+0000 7f028d55f640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0288154160 0x7f02881f0290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:17.263 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:17.258+0000 7f028d55f640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f028815a1a0 0x7f02880c4030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:17.263 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:17.258+0000 7f028d55f640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f028815a630 con 0x7f028815a1a0 2024-04-26T23:42:17.263 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:17.258+0000 7f028d55f640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f028815aed0 con 0x7f02880ca5a0 2024-04-26T23:42:17.263 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:17.258+0000 7f028d55f640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f02880c7510 con 0x7f0288154160 2024-04-26T23:42:17.263 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:17.258+0000 7f0286ffd640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f02880ca5a0 0x7f02881527d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:17.263 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:17.258+0000 7f02867fc640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0288154160 0x7f02881f0290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:17.263 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:17.258+0000 7f02867fc640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0288154160 0x7f02881f0290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.88:36090/0 (socket says 172.21.15.88:36090) 2024-04-26T23:42:17.263 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:17.258+0000 7f0286ffd640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f02880ca5a0 0x7f02881527d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.88:54514/0 (socket says 172.21.15.88:54514) 2024-04-26T23:42:17.263 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:17.258+0000 7f02867fc640 1 -- 172.21.15.88:0/3768795073 learned_addr learned my addr 172.21.15.88:0/3768795073 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:42:17.263 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:17.258+0000 7f02877fe640 1 --2- 172.21.15.88:0/3768795073 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f028815a1a0 0x7f02880c4030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:17.263 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:17.258+0000 7f02867fc640 1 -- 172.21.15.88:0/3768795073 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f02880ca5a0 msgr2=0x7f02881527d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:17.263 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:17.258+0000 7f02867fc640 1 --2- 172.21.15.88:0/3768795073 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f02880ca5a0 0x7f02881527d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:17.263 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:17.258+0000 7f02867fc640 1 -- 172.21.15.88:0/3768795073 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f028815a1a0 msgr2=0x7f02880c4030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:17.263 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:17.258+0000 7f02867fc640 1 --2- 172.21.15.88:0/3768795073 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f028815a1a0 0x7f02880c4030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:17.264 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:17.258+0000 7f02867fc640 1 -- 172.21.15.88:0/3768795073 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02880ad0f0 con 0x7f0288154160 2024-04-26T23:42:17.264 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:17.258+0000 7f0286ffd640 1 --2- 172.21.15.88:0/3768795073 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f02880ca5a0 0x7f02881527d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:42:17.264 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:17.258+0000 7f02867fc640 1 --2- 172.21.15.88:0/3768795073 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0288154160 0x7f02881f0290 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f027c00c5a0 tx=0x7f027c00ca60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:17.264 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:17.258+0000 7f026f7fe640 1 -- 172.21.15.88:0/3768795073 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f027c017070 con 0x7f0288154160 2024-04-26T23:42:17.264 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:17.259+0000 7f026f7fe640 1 -- 172.21.15.88:0/3768795073 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f027c0035f0 con 0x7f0288154160 2024-04-26T23:42:17.264 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:17.259+0000 7f026f7fe640 1 -- 172.21.15.88:0/3768795073 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f027c0039e0 con 0x7f0288154160 2024-04-26T23:42:17.264 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:17.259+0000 7f028d55f640 1 -- 172.21.15.88:0/3768795073 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02881f0b60 con 0x7f0288154160 2024-04-26T23:42:17.264 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:17.259+0000 7f028d55f640 1 -- 172.21.15.88:0/3768795073 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f0288151fd0 con 0x7f0288154160 2024-04-26T23:42:17.265 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:17.260+0000 7f028d55f640 1 -- 172.21.15.88:0/3768795073 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0288076650 con 0x7f0288154160 2024-04-26T23:42:17.265 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:17.261+0000 7f026f7fe640 1 -- 172.21.15.88:0/3768795073 <== mon.2 v2:172.21.15.175:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f027c01a070 con 0x7f0288154160 2024-04-26T23:42:17.265 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:17.261+0000 7f026f7fe640 1 --2- 172.21.15.88:0/3768795073 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f027406c8f0 0x7f027406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:17.265 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:17.261+0000 7f026f7fe640 1 -- 172.21.15.88:0/3768795073 <== mon.2 v2:172.21.15.175:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6666+0+0 (secure 0 0 0) 0x7f027c08b270 con 0x7f0288154160 2024-04-26T23:42:17.265 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:17.261+0000 7f0286ffd640 1 --2- 172.21.15.88:0/3768795073 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f027406c8f0 0x7f027406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:17.266 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:17.262+0000 7f0286ffd640 1 --2- 172.21.15.88:0/3768795073 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f027406c8f0 0x7f027406edb0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f0278034000 tx=0x7f027802e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:17.274 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:17.270+0000 7f026f7fe640 1 -- 172.21.15.88:0/3768795073 <== mon.2 v2:172.21.15.175:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f027c058d20 con 0x7f0288154160 2024-04-26T23:42:17.786 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:17.781+0000 7f028d55f640 1 -- 172.21.15.88:0/3768795073 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f02880ca380 con 0x7f0288154160 2024-04-26T23:42:17.786 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:17.782+0000 7f026f7fe640 1 -- 172.21.15.88:0/3768795073 <== mon.2 v2:172.21.15.175:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1565 (secure 0 0 0) 0x7f027c05f020 con 0x7f0288154160 2024-04-26T23:42:17.786 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":12,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":11,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"555255e9-7ef9-4454-8dc9-35e96b70035c","modified":"2024-04-26T23:39:34.291658Z","created":"2024-04-26T23:39:34.291658Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:3300","nonce":0},{"type":"v1","addr":"172.21.15.175:6789","nonce":0}]},"addr":"172.21.15.175:6789/0","public_addr":"172.21.15.175:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:3301","nonce":0},{"type":"v1","addr":"172.21.15.175:6790","nonce":0}]},"addr":"172.21.15.175:6790/0","public_addr":"172.21.15.175:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-04-26T23:42:17.789 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:17.785+0000 7f028d55f640 1 -- 172.21.15.88:0/3768795073 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f027406c8f0 msgr2=0x7f027406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:17.789 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:17.785+0000 7f028d55f640 1 --2- 172.21.15.88:0/3768795073 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f027406c8f0 0x7f027406edb0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f0278034000 tx=0x7f027802e000 comp rx=0 tx=0).stop 2024-04-26T23:42:17.790 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:17.785+0000 7f028d55f640 1 -- 172.21.15.88:0/3768795073 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0288154160 msgr2=0x7f02881f0290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:17.790 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:17.785+0000 7f028d55f640 1 --2- 172.21.15.88:0/3768795073 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0288154160 0x7f02881f0290 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f027c00c5a0 tx=0x7f027c00ca60 comp rx=0 tx=0).stop 2024-04-26T23:42:17.790 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:17.785+0000 7f028d55f640 1 -- 172.21.15.88:0/3768795073 shutdown_connections 2024-04-26T23:42:17.790 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:17.785+0000 7f028d55f640 1 --2- 172.21.15.88:0/3768795073 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f027406c8f0 0x7f027406edb0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:17.790 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:17.785+0000 7f028d55f640 1 --2- 172.21.15.88:0/3768795073 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0288154160 0x7f02881f0290 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:17.790 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:17.785+0000 7f028d55f640 1 --2- 172.21.15.88:0/3768795073 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f028815a1a0 0x7f02880c4030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:17.790 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:17.785+0000 7f028d55f640 1 --2- 172.21.15.88:0/3768795073 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f02880ca5a0 0x7f02881527d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:17.790 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:17.785+0000 7f028d55f640 1 -- 172.21.15.88:0/3768795073 >> 172.21.15.88:0/3768795073 conn(0x7f02880ae010 msgr2=0x7f02880cc480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:17.790 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:17.785+0000 7f028d55f640 1 -- 172.21.15.88:0/3768795073 shutdown_connections 2024-04-26T23:42:17.790 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:17.785+0000 7f028d55f640 1 -- 172.21.15.88:0/3768795073 wait complete. 2024-04-26T23:42:17.804 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-04-26T23:42:17.804 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2024-04-26T23:42:17.804 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-04-26T23:42:17.804 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-04-26T23:42:17.957 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:17.953+0000 7faeb90f1640 1 Processor -- start 2024-04-26T23:42:17.957 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:17.953+0000 7faeb90f1640 1 -- start start 2024-04-26T23:42:17.958 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:17.954+0000 7faeb90f1640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7faeb40c6180 0x7faeb4073700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:17.959 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:17.954+0000 7faeb90f1640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faeb415b090 con 0x7faeb4071c50 2024-04-26T23:42:17.959 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:17.954+0000 7faeb90f1640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faeb40c6780 con 0x7faeb4155180 2024-04-26T23:42:17.959 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:17.954+0000 7faeb90f1640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7faeb40c6a60 con 0x7faeb40c6180 2024-04-26T23:42:17.959 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:17.954+0000 7faeb259c640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7faeb4071c50 0x7faeb4070740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:37100/0 (socket says 172.21.15.88:37100) 2024-04-26T23:42:17.959 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:17.954+0000 7faeb259c640 1 -- 172.21.15.88:0/2479119560 learned_addr learned my addr 172.21.15.88:0/2479119560 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-26T23:42:17.959 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:17.954+0000 7faeb359e640 1 --2- 172.21.15.88:0/2479119560 >> v2:172.21.15.175:3300/0 conn(0x7faeb40c6180 0x7faeb4073700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:17.959 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:17.954+0000 7faeb1d9b640 1 -- 172.21.15.88:0/2479119560 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3926007814 0 0) 0x7faea8001110 con 0x7faeb4071c50 2024-04-26T23:42:17.959 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:17.954+0000 7faeb1d9b640 1 -- 172.21.15.88:0/2479119560 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fae9c003520 con 0x7faeb4071c50 2024-04-26T23:42:17.959 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:17.954+0000 7faeb359e640 1 -- 172.21.15.88:0/2479119560 >> v1:172.21.15.175:6789/0 conn(0x7faeb4155180 legacy=0x7faeb415bb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:17.959 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:17.954+0000 7faeb359e640 1 -- 172.21.15.88:0/2479119560 >> v1:172.21.15.88:6789/0 conn(0x7faeb4071c50 legacy=0x7faeb4070740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:17.959 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:17.954+0000 7faeb359e640 1 -- 172.21.15.88:0/2479119560 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faeb415b310 con 0x7faeb40c6180 2024-04-26T23:42:17.960 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:17.954+0000 7faeb1d9b640 1 -- 172.21.15.88:0/2479119560 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1778426075 0 0) 0x7faeb40c6780 con 0x7faeb4155180 2024-04-26T23:42:17.961 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:17.955+0000 7faeb359e640 1 --2- 172.21.15.88:0/2479119560 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faeb40c6180 0x7faeb4073700 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7faeac009d90 tx=0x7faeac02a6f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a2eea739b8917770 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:17.961 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:17.956+0000 7faeb1d9b640 1 -- 172.21.15.88:0/2479119560 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faeac007740 con 0x7faeb40c6180 2024-04-26T23:42:17.962 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:17.956+0000 7faeb1d9b640 1 -- 172.21.15.88:0/2479119560 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faeac0078e0 con 0x7faeb40c6180 2024-04-26T23:42:17.962 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:17.956+0000 7faeb1d9b640 1 -- 172.21.15.88:0/2479119560 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faeac007cb0 con 0x7faeb40c6180 2024-04-26T23:42:17.962 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:17.956+0000 7faeb90f1640 1 -- 172.21.15.88:0/2479119560 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faeb40c6180 msgr2=0x7faeb4073700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:17.962 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:17.956+0000 7faeb90f1640 1 --2- 172.21.15.88:0/2479119560 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faeb40c6180 0x7faeb4073700 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7faeac009d90 tx=0x7faeac02a6f0 comp rx=0 tx=0).stop 2024-04-26T23:42:17.962 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:17.956+0000 7faeb90f1640 1 -- 172.21.15.88:0/2479119560 shutdown_connections 2024-04-26T23:42:17.962 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:17.956+0000 7faeb90f1640 1 --2- 172.21.15.88:0/2479119560 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faeb40c6180 0x7faeb4073700 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:17.962 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:17.956+0000 7faeb90f1640 1 -- 172.21.15.88:0/2479119560 >> 172.21.15.88:0/2479119560 conn(0x7faeb40ca2f0 msgr2=0x7faeb40ca6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:17.962 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:17.956+0000 7faeb90f1640 1 -- 172.21.15.88:0/2479119560 shutdown_connections 2024-04-26T23:42:17.962 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:17.956+0000 7faeb90f1640 1 -- 172.21.15.88:0/2479119560 wait complete. 2024-04-26T23:42:17.963 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:17.958+0000 7faeb90f1640 1 Processor -- start 2024-04-26T23:42:17.963 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:17.958+0000 7faeb90f1640 1 -- start start 2024-04-26T23:42:17.966 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:17.959+0000 7faeb90f1640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faeb4071c50 0x7faeb41e6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:17.966 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:17.959+0000 7faeb90f1640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faeb40c6180 0x7faeb414fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:17.966 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:17.959+0000 7faeb90f1640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faeb4155180 0x7faeb4150250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:17.966 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:17.959+0000 7faeb90f1640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7faeb4074b00 con 0x7faeb4071c50 2024-04-26T23:42:17.966 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:17.960+0000 7faeb90f1640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7faeb4155560 con 0x7faeb40c6180 2024-04-26T23:42:17.966 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:17.960+0000 7faeb90f1640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7faeb4074c80 con 0x7faeb4155180 2024-04-26T23:42:17.966 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:17.960+0000 7faeb2d9d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faeb4071c50 0x7faeb41e6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:17.967 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:17.960+0000 7faeb2d9d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faeb4071c50 0x7faeb41e6bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:49002/0 (socket says 172.21.15.88:49002) 2024-04-26T23:42:17.967 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:17.960+0000 7faeb2d9d640 1 -- 172.21.15.88:0/1250158616 learned_addr learned my addr 172.21.15.88:0/1250158616 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:42:17.967 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:17.960+0000 7faeb359e640 1 --2- 172.21.15.88:0/1250158616 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faeb4155180 0x7faeb4150250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:17.967 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:17.960+0000 7faeb259c640 1 --2- 172.21.15.88:0/1250158616 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faeb40c6180 0x7faeb414fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:17.967 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:17.960+0000 7faeb2d9d640 1 -- 172.21.15.88:0/1250158616 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faeb4155180 msgr2=0x7faeb4150250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:17.967 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:17.960+0000 7faeb2d9d640 1 --2- 172.21.15.88:0/1250158616 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faeb4155180 0x7faeb4150250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:17.967 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:17.960+0000 7faeb2d9d640 1 -- 172.21.15.88:0/1250158616 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faeb40c6180 msgr2=0x7faeb414fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:17.967 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:17.960+0000 7faeb2d9d640 1 --2- 172.21.15.88:0/1250158616 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faeb40c6180 0x7faeb414fd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:17.967 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:17.960+0000 7faeb2d9d640 1 -- 172.21.15.88:0/1250158616 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faeb41511d0 con 0x7faeb4071c50 2024-04-26T23:42:17.967 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:17.960+0000 7faeb2d9d640 1 --2- 172.21.15.88:0/1250158616 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faeb4071c50 0x7faeb41e6bf0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7faea400c4b0 tx=0x7faea400c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:17.967 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:17.960+0000 7fae9b7fe640 1 -- 172.21.15.88:0/1250158616 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faea4017070 con 0x7faeb4071c50 2024-04-26T23:42:17.967 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:17.960+0000 7fae9b7fe640 1 -- 172.21.15.88:0/1250158616 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faea4005480 con 0x7faeb4071c50 2024-04-26T23:42:17.967 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:17.960+0000 7faeb90f1640 1 -- 172.21.15.88:0/1250158616 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faeb414e6d0 con 0x7faeb4071c50 2024-04-26T23:42:17.968 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:17.960+0000 7faeb90f1640 1 -- 172.21.15.88:0/1250158616 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faeb41e4e00 con 0x7faeb4071c50 2024-04-26T23:42:17.968 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:17.961+0000 7fae9b7fe640 1 -- 172.21.15.88:0/1250158616 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faea4003830 con 0x7faeb4071c50 2024-04-26T23:42:17.968 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:17.961+0000 7faeb90f1640 1 --2- 172.21.15.88:0/1250158616 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faeb415c480 0x7faeb41f4370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:17.968 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:17.961+0000 7faeb90f1640 1 -- 172.21.15.88:0/1250158616 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7faeb414e480 con 0x7faeb415c480 2024-04-26T23:42:17.968 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:17.962+0000 7faeb259c640 1 --2- 172.21.15.88:0/1250158616 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faeb415c480 0x7faeb41f4370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:17.968 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:17.962+0000 7faeb259c640 1 -- 172.21.15.88:0/1250158616 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7faeb41f52a0 con 0x7faeb415c480 2024-04-26T23:42:17.968 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:17.962+0000 7faeb259c640 1 --2- 172.21.15.88:0/1250158616 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faeb415c480 0x7faeb41f4370 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7faeb4154030 tx=0x7faea800e8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:17.968 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:17.962+0000 7fae9b7fe640 1 -- 172.21.15.88:0/1250158616 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7faea401a070 con 0x7faeb4071c50 2024-04-26T23:42:17.969 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:17.963+0000 7fae9b7fe640 1 --2- 172.21.15.88:0/1250158616 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7faea006c8f0 0x7faea006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:17.969 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:17.963+0000 7faeb359e640 1 --2- 172.21.15.88:0/1250158616 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7faea006c8f0 0x7faea006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:17.969 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:17.963+0000 7fae9b7fe640 1 -- 172.21.15.88:0/1250158616 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6666+0+0 (secure 0 0 0) 0x7faea408b180 con 0x7faeb4071c50 2024-04-26T23:42:17.969 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:17.963+0000 7fae9b7fe640 1 -- 172.21.15.88:0/1250158616 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faea8019070 con 0x7faeb415c480 2024-04-26T23:42:17.969 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:17.963+0000 7fae9b7fe640 1 -- 172.21.15.88:0/1250158616 <== mon.0 v2:172.21.15.88:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7faea8005ac0 con 0x7faeb415c480 2024-04-26T23:42:17.969 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:17.963+0000 7fae9b7fe640 1 -- 172.21.15.88:0/1250158616 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faeb415c480 msgr2=0x7faeb41f4370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:17.969 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:17.963+0000 7fae9b7fe640 1 --2- 172.21.15.88:0/1250158616 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faeb415c480 0x7faeb41f4370 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7faeb4154030 tx=0x7faea800e8f0 comp rx=0 tx=0).stop 2024-04-26T23:42:17.969 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:17.963+0000 7fae9b7fe640 1 -- 172.21.15.88:0/1250158616 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faeb415c480 msgr2=0x7faeb41f4370 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:42:17.970 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:17.963+0000 7fae9b7fe640 1 --2- 172.21.15.88:0/1250158616 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faeb415c480 0x7faeb41f4370 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:17.970 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:17.964+0000 7faeb359e640 1 --2- 172.21.15.88:0/1250158616 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7faea006c8f0 0x7faea006edb0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7faeac034000 tx=0x7faeac02f000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:17.979 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:17.975+0000 7faeb90f1640 1 --2- 172.21.15.88:0/1250158616 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faeb414e9b0 0x7faeb41f48b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:17.980 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:17.975+0000 7faeb90f1640 1 -- 172.21.15.88:0/1250158616 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7faeb41e4760 con 0x7faeb414e9b0 2024-04-26T23:42:17.980 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:17.975+0000 7faeb259c640 1 --2- 172.21.15.88:0/1250158616 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faeb414e9b0 0x7faeb41f48b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:17.980 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:17.976+0000 7faeb259c640 1 -- 172.21.15.88:0/1250158616 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7faeb40af660 con 0x7faeb414e9b0 2024-04-26T23:42:17.980 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:17.976+0000 7faeb259c640 1 --2- 172.21.15.88:0/1250158616 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faeb414e9b0 0x7faeb41f48b0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7faeb414e600 tx=0x7faea8001320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:17.980 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:17.976+0000 7fae9b7fe640 1 -- 172.21.15.88:0/1250158616 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faea8019030 con 0x7faeb414e9b0 2024-04-26T23:42:17.980 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:17.976+0000 7fae9b7fe640 1 -- 172.21.15.88:0/1250158616 <== mon.0 v2:172.21.15.88:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4557 (secure 0 0 0) 0x7faea801c2a0 con 0x7faeb414e9b0 2024-04-26T23:42:17.981 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:17.976+0000 7fae9b7fe640 1 -- 172.21.15.88:0/1250158616 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faeb414e9b0 msgr2=0x7faeb41f48b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:17.981 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:17.976+0000 7fae9b7fe640 1 --2- 172.21.15.88:0/1250158616 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faeb414e9b0 0x7faeb41f48b0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7faeb414e600 tx=0x7faea8001320 comp rx=0 tx=0).stop 2024-04-26T23:42:17.981 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-04-26T23:42:17.981 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2024-04-26T23:42:17.982 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2024-04-26T23:42:17.982 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "leader", 2024-04-26T23:42:17.982 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 12, 2024-04-26T23:42:17.982 INFO:teuthology.orchestra.run.smithi088.stdout: "uptime": 26949, 2024-04-26T23:42:17.982 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2024-04-26T23:42:17.982 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2024-04-26T23:42:17.982 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2024-04-26T23:42:17.982 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2024-04-26T23:42:17.982 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:42:17.982 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 12, 2024-04-26T23:42:17.982 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2024-04-26T23:42:17.982 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2450521708007866372", 2024-04-26T23:42:17.983 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2024-04-26T23:42:17.983 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-04-26T23:42:17.983 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-04-26T23:42:17.983 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-04-26T23:42:17.983 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-04-26T23:42:17.983 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-04-26T23:42:17.983 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-04-26T23:42:17.983 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-04-26T23:42:17.983 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-04-26T23:42:17.983 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-04-26T23:42:17.983 INFO:teuthology.orchestra.run.smithi088.stdout: "reef", 2024-04-26T23:42:17.983 INFO:teuthology.orchestra.run.smithi088.stdout: "squid" 2024-04-26T23:42:17.983 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:42:17.983 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540701547738038271", 2024-04-26T23:42:17.984 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2024-04-26T23:42:17.984 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-04-26T23:42:17.984 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-04-26T23:42:17.984 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-04-26T23:42:17.984 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-04-26T23:42:17.984 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-04-26T23:42:17.984 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-04-26T23:42:17.984 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-04-26T23:42:17.984 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-04-26T23:42:17.984 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-04-26T23:42:17.984 INFO:teuthology.orchestra.run.smithi088.stdout: "reef", 2024-04-26T23:42:17.985 INFO:teuthology.orchestra.run.smithi088.stdout: "squid" 2024-04-26T23:42:17.985 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:42:17.985 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:42:17.985 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2024-04-26T23:42:17.985 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2024-04-26T23:42:17.985 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2024-04-26T23:42:17.985 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2024-04-26T23:42:17.985 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2024-04-26T23:42:17.985 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "555255e9-7ef9-4454-8dc9-35e96b70035c", 2024-04-26T23:42:17.985 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2024-04-26T23:39:34.291658Z", 2024-04-26T23:42:17.985 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2024-04-26T23:39:34.291658Z", 2024-04-26T23:42:17.985 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 19, 2024-04-26T23:42:17.985 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "squid", 2024-04-26T23:42:17.985 INFO:teuthology.orchestra.run.smithi088.stdout: "election_strategy": 1, 2024-04-26T23:42:17.986 INFO:teuthology.orchestra.run.smithi088.stdout: "disallowed_leaders: ": "", 2024-04-26T23:42:17.986 INFO:teuthology.orchestra.run.smithi088.stdout: "stretch_mode": false, 2024-04-26T23:42:17.986 INFO:teuthology.orchestra.run.smithi088.stdout: "tiebreaker_mon": "", 2024-04-26T23:42:17.986 INFO:teuthology.orchestra.run.smithi088.stdout: "removed_ranks: ": "", 2024-04-26T23:42:17.986 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2024-04-26T23:42:17.986 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2024-04-26T23:42:17.986 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-04-26T23:42:17.986 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-04-26T23:42:17.986 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-04-26T23:42:17.986 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-04-26T23:42:17.986 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-04-26T23:42:17.986 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-04-26T23:42:17.986 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-04-26T23:42:17.986 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-04-26T23:42:17.987 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-04-26T23:42:17.987 INFO:teuthology.orchestra.run.smithi088.stdout: "reef", 2024-04-26T23:42:17.987 INFO:teuthology.orchestra.run.smithi088.stdout: "squid" 2024-04-26T23:42:17.987 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:42:17.987 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2024-04-26T23:42:17.987 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:42:17.987 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2024-04-26T23:42:17.987 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:42:17.987 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2024-04-26T23:42:17.987 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2024-04-26T23:42:17.987 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-04-26T23:42:17.988 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-04-26T23:42:17.988 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:42:17.989 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-04-26T23:42:17.989 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2024-04-26T23:42:17.989 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:42:17.989 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:42:17.990 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:42:17.990 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-04-26T23:42:17.990 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2024-04-26T23:42:17.990 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:42:17.990 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:42:17.990 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:42:17.990 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:42:17.990 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2024-04-26T23:42:17.990 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2024-04-26T23:42:17.990 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-04-26T23:42:17.990 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-04-26T23:42:17.990 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-04-26T23:42:17.991 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:42:17.991 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:42:17.991 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2024-04-26T23:42:17.991 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2024-04-26T23:42:17.991 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-04-26T23:42:17.991 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-04-26T23:42:17.991 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:42:17.991 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-04-26T23:42:17.991 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:3300", 2024-04-26T23:42:17.991 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:42:17.991 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:42:17.991 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:42:17.991 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-04-26T23:42:17.991 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6789", 2024-04-26T23:42:17.992 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:42:17.992 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:42:17.992 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:42:17.992 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:42:17.992 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6789/0", 2024-04-26T23:42:17.992 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.175:6789/0", 2024-04-26T23:42:17.992 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-04-26T23:42:17.992 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-04-26T23:42:17.992 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-04-26T23:42:17.992 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:42:17.992 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:42:17.992 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2024-04-26T23:42:17.992 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2024-04-26T23:42:17.992 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-04-26T23:42:17.992 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-04-26T23:42:17.992 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:42:17.993 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-04-26T23:42:17.993 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:3301", 2024-04-26T23:42:17.993 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:42:17.993 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:42:17.993 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:42:17.993 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-04-26T23:42:17.993 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6790", 2024-04-26T23:42:17.993 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:42:17.993 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:42:17.993 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:42:17.993 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:42:17.993 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6790/0", 2024-04-26T23:42:17.993 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.175:6790/0", 2024-04-26T23:42:17.993 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-04-26T23:42:17.993 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-04-26T23:42:17.994 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-04-26T23:42:17.994 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:42:17.994 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:42:17.994 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:42:17.994 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2024-04-26T23:42:17.994 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2024-04-26T23:42:17.994 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:42:17.994 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:42:17.994 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:42:17.994 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2024-04-26T23:42:17.994 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:42:17.994 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:42:17.994 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2024-04-26T23:42:17.995 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:42:17.995 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:42:17.995 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:42:17.995 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2024-04-26T23:42:17.995 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:42:17.995 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:42:17.995 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:42:17.995 INFO:teuthology.orchestra.run.smithi088.stdout: "stretch_mode": false 2024-04-26T23:42:17.995 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-04-26T23:42:17.996 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:17.976+0000 7fae9b7fe640 1 -- 172.21.15.88:0/1250158616 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faeb414e9b0 msgr2=0x7faeb41f48b0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:42:17.996 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:17.976+0000 7fae9b7fe640 1 --2- 172.21.15.88:0/1250158616 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faeb414e9b0 0x7faeb41f48b0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:17.996 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:17.977+0000 7faeb90f1640 1 -- 172.21.15.88:0/1250158616 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7faea006c8f0 msgr2=0x7faea006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:17.997 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:17.977+0000 7faeb90f1640 1 --2- 172.21.15.88:0/1250158616 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7faea006c8f0 0x7faea006edb0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7faeac034000 tx=0x7faeac02f000 comp rx=0 tx=0).stop 2024-04-26T23:42:17.997 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:17.977+0000 7faeb90f1640 1 -- 172.21.15.88:0/1250158616 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faeb4071c50 msgr2=0x7faeb41e6bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:17.997 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:17.977+0000 7faeb90f1640 1 --2- 172.21.15.88:0/1250158616 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faeb4071c50 0x7faeb41e6bf0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7faea400c4b0 tx=0x7faea400c970 comp rx=0 tx=0).stop 2024-04-26T23:42:17.997 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:17.977+0000 7faeb359e640 1 -- 172.21.15.88:0/1250158616 reap_dead start 2024-04-26T23:42:17.997 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:17.977+0000 7faeb90f1640 1 -- 172.21.15.88:0/1250158616 shutdown_connections 2024-04-26T23:42:17.997 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:17.977+0000 7faeb90f1640 1 --2- 172.21.15.88:0/1250158616 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faeb4071c50 0x7faeb41e6bf0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:17.997 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:17.977+0000 7faeb90f1640 1 -- 172.21.15.88:0/1250158616 >> 172.21.15.88:0/1250158616 conn(0x7faeb40ca2f0 msgr2=0x7faeb415a3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:17.997 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:17.977+0000 7faeb90f1640 1 -- 172.21.15.88:0/1250158616 shutdown_connections 2024-04-26T23:42:17.997 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:17.977+0000 7faeb90f1640 1 -- 172.21.15.88:0/1250158616 wait complete. 2024-04-26T23:42:17.997 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-04-26T23:42:17.998 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-04-26T23:42:17.998 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-04-26T23:42:18.130 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.126+0000 7fe31f899640 1 Processor -- start 2024-04-26T23:42:18.131 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.127+0000 7fe31f899640 1 -- start start 2024-04-26T23:42:18.133 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.128+0000 7fe31f899640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe318154160 0x7fe318156bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:18.133 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.128+0000 7fe31f899640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe3180c8df0 con 0x7fe31815a1a0 2024-04-26T23:42:18.133 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.128+0000 7fe31f899640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe318154540 con 0x7fe3180ca5a0 2024-04-26T23:42:18.133 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.128+0000 7fe31de36640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fe31815a1a0 0x7fe3180c9590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:37112/0 (socket says 172.21.15.88:37112) 2024-04-26T23:42:18.133 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.128+0000 7fe31de36640 1 -- 172.21.15.88:0/1340684343 learned_addr learned my addr 172.21.15.88:0/1340684343 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-26T23:42:18.133 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.128+0000 7fe31d635640 1 --2- 172.21.15.88:0/1340684343 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe318154160 0x7fe318156bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:18.133 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.128+0000 7fe31f899640 1 -- 172.21.15.88:0/1340684343 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fe3180c9100 con 0x7fe318154160 2024-04-26T23:42:18.133 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.128+0000 7fe30bfff640 1 -- 172.21.15.88:0/1340684343 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3578063007 0 0) 0x7fe310001490 con 0x7fe31815a1a0 2024-04-26T23:42:18.133 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.128+0000 7fe30bfff640 1 -- 172.21.15.88:0/1340684343 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe304003520 con 0x7fe31815a1a0 2024-04-26T23:42:18.133 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.128+0000 7fe30bfff640 1 -- 172.21.15.88:0/1340684343 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1024799805 0 0) 0x7fe318154540 con 0x7fe3180ca5a0 2024-04-26T23:42:18.133 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.128+0000 7fe30bfff640 1 -- 172.21.15.88:0/1340684343 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe310001490 con 0x7fe3180ca5a0 2024-04-26T23:42:18.133 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.129+0000 7fe30bfff640 1 -- 172.21.15.88:0/1340684343 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1149287740 0 0) 0x7fe304003520 con 0x7fe31815a1a0 2024-04-26T23:42:18.133 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.129+0000 7fe31d635640 1 -- 172.21.15.88:0/1340684343 >> v1:172.21.15.175:6789/0 conn(0x7fe3180ca5a0 legacy=0x7fe3180c6e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:18.134 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.129+0000 7fe31d635640 1 -- 172.21.15.88:0/1340684343 >> v1:172.21.15.88:6789/0 conn(0x7fe31815a1a0 legacy=0x7fe3180c9590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:18.134 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.129+0000 7fe31d635640 1 -- 172.21.15.88:0/1340684343 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe31815a910 con 0x7fe318154160 2024-04-26T23:42:18.135 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.129+0000 7fe31d635640 1 --2- 172.21.15.88:0/1340684343 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe318154160 0x7fe318156bb0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fe3140097d0 tx=0x7fe31402a1a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a87f97007f29a1ac server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:18.135 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.130+0000 7fe30bfff640 1 -- 172.21.15.88:0/1340684343 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe314037070 con 0x7fe318154160 2024-04-26T23:42:18.135 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.130+0000 7fe30bfff640 1 -- 172.21.15.88:0/1340684343 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe31402ac30 con 0x7fe318154160 2024-04-26T23:42:18.135 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.130+0000 7fe30bfff640 1 -- 172.21.15.88:0/1340684343 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe310001bc0 con 0x7fe318154160 2024-04-26T23:42:18.135 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.130+0000 7fe31f899640 1 -- 172.21.15.88:0/1340684343 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe318154160 msgr2=0x7fe318156bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:18.135 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.130+0000 7fe31f899640 1 --2- 172.21.15.88:0/1340684343 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe318154160 0x7fe318156bb0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fe3140097d0 tx=0x7fe31402a1a0 comp rx=0 tx=0).stop 2024-04-26T23:42:18.135 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.130+0000 7fe31f899640 1 -- 172.21.15.88:0/1340684343 shutdown_connections 2024-04-26T23:42:18.135 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.130+0000 7fe31f899640 1 --2- 172.21.15.88:0/1340684343 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe318154160 0x7fe318156bb0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:18.136 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.130+0000 7fe31f899640 1 -- 172.21.15.88:0/1340684343 >> 172.21.15.88:0/1340684343 conn(0x7fe3180ae010 msgr2=0x7fe3180ae3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:18.136 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.131+0000 7fe31f899640 1 -- 172.21.15.88:0/1340684343 shutdown_connections 2024-04-26T23:42:18.136 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.131+0000 7fe31f899640 1 -- 172.21.15.88:0/1340684343 wait complete. 2024-04-26T23:42:18.136 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.132+0000 7fe31f899640 1 Processor -- start 2024-04-26T23:42:18.136 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.132+0000 7fe31f899640 1 -- start start 2024-04-26T23:42:18.139 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.133+0000 7fe31f899640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe3180ca5a0 0x7fe3181f0040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:18.139 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.133+0000 7fe31d635640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe3180ca5a0 0x7fe3181f0040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:18.139 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.133+0000 7fe31d635640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe3180ca5a0 0x7fe3181f0040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:49022/0 (socket says 172.21.15.88:49022) 2024-04-26T23:42:18.139 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.133+0000 7fe31d635640 1 -- 172.21.15.88:0/2954673214 learned_addr learned my addr 172.21.15.88:0/2954673214 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:42:18.139 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.134+0000 7fe31f899640 1 --2- 172.21.15.88:0/2954673214 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe318154160 0x7fe3181ee950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:18.139 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.134+0000 7fe31f899640 1 --2- 172.21.15.88:0/2954673214 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe31815a1a0 0x7fe3181eee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:18.139 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.134+0000 7fe31ce34640 1 --2- 172.21.15.88:0/2954673214 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe318154160 0x7fe3181ee950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:18.139 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.134+0000 7fe31f899640 1 -- 172.21.15.88:0/2954673214 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fe31815a630 con 0x7fe3180ca5a0 2024-04-26T23:42:18.139 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.134+0000 7fe31de36640 1 --2- 172.21.15.88:0/2954673214 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe31815a1a0 0x7fe3181eee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:18.139 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.134+0000 7fe31f899640 1 -- 172.21.15.88:0/2954673214 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fe31815aed0 con 0x7fe318154160 2024-04-26T23:42:18.139 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.134+0000 7fe31f899640 1 -- 172.21.15.88:0/2954673214 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fe3180c7510 con 0x7fe31815a1a0 2024-04-26T23:42:18.139 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.134+0000 7fe31d635640 1 -- 172.21.15.88:0/2954673214 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe31815a1a0 msgr2=0x7fe3181eee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:18.139 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.134+0000 7fe31d635640 1 --2- 172.21.15.88:0/2954673214 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe31815a1a0 0x7fe3181eee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:18.140 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.134+0000 7fe31d635640 1 -- 172.21.15.88:0/2954673214 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe318154160 msgr2=0x7fe3181ee950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:18.140 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.134+0000 7fe31d635640 1 --2- 172.21.15.88:0/2954673214 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe318154160 0x7fe3181ee950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:18.140 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.134+0000 7fe31d635640 1 -- 172.21.15.88:0/2954673214 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3181f0910 con 0x7fe3180ca5a0 2024-04-26T23:42:18.140 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.135+0000 7fe31d635640 1 --2- 172.21.15.88:0/2954673214 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe3180ca5a0 0x7fe3181f0040 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fe314035040 tx=0x7fe3140046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:18.140 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.135+0000 7fe309ffb640 1 -- 172.21.15.88:0/2954673214 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe314041070 con 0x7fe3180ca5a0 2024-04-26T23:42:18.140 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.135+0000 7fe309ffb640 1 -- 172.21.15.88:0/2954673214 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe31403c680 con 0x7fe3180ca5a0 2024-04-26T23:42:18.140 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.135+0000 7fe31f899640 1 -- 172.21.15.88:0/2954673214 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3181ede70 con 0x7fe3180ca5a0 2024-04-26T23:42:18.142 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.135+0000 7fe309ffb640 1 -- 172.21.15.88:0/2954673214 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe31404b060 con 0x7fe3180ca5a0 2024-04-26T23:42:18.142 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.136+0000 7fe31f899640 1 -- 172.21.15.88:0/2954673214 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3180c3280 con 0x7fe3180ca5a0 2024-04-26T23:42:18.142 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.136+0000 7fe309ffb640 1 -- 172.21.15.88:0/2954673214 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe314044070 con 0x7fe3180ca5a0 2024-04-26T23:42:18.142 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.137+0000 7fe309ffb640 1 --2- 172.21.15.88:0/2954673214 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fe2fc06c920 0x7fe2fc06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:18.142 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.137+0000 7fe31f899640 1 --2- 172.21.15.88:0/2954673214 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe3181ef3d0 0x7fe3181516f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:18.142 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.137+0000 7fe31f899640 1 -- 172.21.15.88:0/2954673214 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fe3181edcd0 con 0x7fe3181ef3d0 2024-04-26T23:42:18.142 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.137+0000 7fe309ffb640 1 -- 172.21.15.88:0/2954673214 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6666+0+0 (secure 0 0 0) 0x7fe3140b1060 con 0x7fe3180ca5a0 2024-04-26T23:42:18.142 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.137+0000 7fe31ce34640 1 --2- 172.21.15.88:0/2954673214 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fe2fc06c920 0x7fe2fc06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:18.142 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.137+0000 7fe31de36640 1 --2- 172.21.15.88:0/2954673214 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe3181ef3d0 0x7fe3181516f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:18.142 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.137+0000 7fe31ce34640 1 --2- 172.21.15.88:0/2954673214 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fe2fc06c920 0x7fe2fc06ede0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fe31814d530 tx=0x7fe30c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:18.142 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.138+0000 7fe31de36640 1 -- 172.21.15.88:0/2954673214 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe318076650 con 0x7fe3181ef3d0 2024-04-26T23:42:18.142 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.138+0000 7fe31de36640 1 --2- 172.21.15.88:0/2954673214 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe3181ef3d0 0x7fe3181516f0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fe3181555c0 tx=0x7fe31000d520 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:18.143 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.138+0000 7fe309ffb640 1 -- 172.21.15.88:0/2954673214 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3100070d0 con 0x7fe3181ef3d0 2024-04-26T23:42:18.143 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.138+0000 7fe309ffb640 1 -- 172.21.15.88:0/2954673214 <== mon.1 v2:172.21.15.175:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fe310018070 con 0x7fe3181ef3d0 2024-04-26T23:42:18.143 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.138+0000 7fe309ffb640 1 -- 172.21.15.88:0/2954673214 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe3181ef3d0 msgr2=0x7fe3181516f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:18.143 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.138+0000 7fe309ffb640 1 --2- 172.21.15.88:0/2954673214 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe3181ef3d0 0x7fe3181516f0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fe3181555c0 tx=0x7fe31000d520 comp rx=0 tx=0).stop 2024-04-26T23:42:18.144 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.138+0000 7fe309ffb640 1 -- 172.21.15.88:0/2954673214 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe3181ef3d0 msgr2=0x7fe3181516f0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:42:18.144 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.138+0000 7fe309ffb640 1 --2- 172.21.15.88:0/2954673214 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe3181ef3d0 0x7fe3181516f0 secure :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fe3181555c0 tx=0x7fe31000d520 comp rx=0 tx=0).stop 2024-04-26T23:42:18.149 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.145+0000 7fe31f899640 1 --2- 172.21.15.88:0/2954673214 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe318147280 0x7fe318147690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:18.149 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.145+0000 7fe31f899640 1 -- 172.21.15.88:0/2954673214 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fe3180ca380 con 0x7fe318147280 2024-04-26T23:42:18.149 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.145+0000 7fe31de36640 1 --2- 172.21.15.88:0/2954673214 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe318147280 0x7fe318147690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:18.149 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.145+0000 7fe31de36640 1 -- 172.21.15.88:0/2954673214 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fe3180bfc00 con 0x7fe318147280 2024-04-26T23:42:18.149 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.145+0000 7fe31de36640 1 --2- 172.21.15.88:0/2954673214 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe318147280 0x7fe318147690 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fe310017000 tx=0x7fe310005b70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:18.150 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.146+0000 7fe309ffb640 1 -- 172.21.15.88:0/2954673214 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe310007420 con 0x7fe318147280 2024-04-26T23:42:18.150 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-04-26T23:42:18.150 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2024-04-26T23:42:18.150 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2024-04-26T23:42:18.150 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "peon", 2024-04-26T23:42:18.150 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 12, 2024-04-26T23:42:18.150 INFO:teuthology.orchestra.run.smithi088.stdout: "uptime": 130489, 2024-04-26T23:42:18.151 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2024-04-26T23:42:18.151 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2024-04-26T23:42:18.151 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2024-04-26T23:42:18.151 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2024-04-26T23:42:18.151 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:42:18.151 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 12, 2024-04-26T23:42:18.151 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2024-04-26T23:42:18.151 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2450521708007866372", 2024-04-26T23:42:18.151 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2024-04-26T23:42:18.151 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-04-26T23:42:18.151 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-04-26T23:42:18.151 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-04-26T23:42:18.151 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-04-26T23:42:18.151 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-04-26T23:42:18.151 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-04-26T23:42:18.152 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-04-26T23:42:18.152 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-04-26T23:42:18.152 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-04-26T23:42:18.152 INFO:teuthology.orchestra.run.smithi088.stdout: "reef", 2024-04-26T23:42:18.152 INFO:teuthology.orchestra.run.smithi088.stdout: "squid" 2024-04-26T23:42:18.152 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:42:18.152 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540701547738038271", 2024-04-26T23:42:18.152 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2024-04-26T23:42:18.152 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-04-26T23:42:18.152 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-04-26T23:42:18.152 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-04-26T23:42:18.152 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-04-26T23:42:18.152 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-04-26T23:42:18.152 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-04-26T23:42:18.152 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-04-26T23:42:18.152 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-04-26T23:42:18.153 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-04-26T23:42:18.153 INFO:teuthology.orchestra.run.smithi088.stdout: "reef", 2024-04-26T23:42:18.153 INFO:teuthology.orchestra.run.smithi088.stdout: "squid" 2024-04-26T23:42:18.153 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:42:18.153 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:42:18.153 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2024-04-26T23:42:18.153 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2024-04-26T23:42:18.153 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2024-04-26T23:42:18.153 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2024-04-26T23:42:18.153 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2024-04-26T23:42:18.153 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "555255e9-7ef9-4454-8dc9-35e96b70035c", 2024-04-26T23:42:18.153 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2024-04-26T23:39:34.291658Z", 2024-04-26T23:42:18.153 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2024-04-26T23:39:34.291658Z", 2024-04-26T23:42:18.153 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 19, 2024-04-26T23:42:18.153 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "squid", 2024-04-26T23:42:18.154 INFO:teuthology.orchestra.run.smithi088.stdout: "election_strategy": 1, 2024-04-26T23:42:18.154 INFO:teuthology.orchestra.run.smithi088.stdout: "disallowed_leaders: ": "", 2024-04-26T23:42:18.154 INFO:teuthology.orchestra.run.smithi088.stdout: "stretch_mode": false, 2024-04-26T23:42:18.154 INFO:teuthology.orchestra.run.smithi088.stdout: "tiebreaker_mon": "", 2024-04-26T23:42:18.154 INFO:teuthology.orchestra.run.smithi088.stdout: "removed_ranks: ": "", 2024-04-26T23:42:18.154 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2024-04-26T23:42:18.154 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2024-04-26T23:42:18.154 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-04-26T23:42:18.154 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-04-26T23:42:18.154 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-04-26T23:42:18.154 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-04-26T23:42:18.154 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-04-26T23:42:18.154 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-04-26T23:42:18.154 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-04-26T23:42:18.155 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-04-26T23:42:18.155 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-04-26T23:42:18.155 INFO:teuthology.orchestra.run.smithi088.stdout: "reef", 2024-04-26T23:42:18.155 INFO:teuthology.orchestra.run.smithi088.stdout: "squid" 2024-04-26T23:42:18.155 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:42:18.155 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2024-04-26T23:42:18.155 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:42:18.155 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2024-04-26T23:42:18.155 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:42:18.155 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2024-04-26T23:42:18.155 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2024-04-26T23:42:18.155 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-04-26T23:42:18.155 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-04-26T23:42:18.155 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:42:18.156 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-04-26T23:42:18.156 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2024-04-26T23:42:18.156 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:42:18.156 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:42:18.156 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:42:18.156 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-04-26T23:42:18.156 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2024-04-26T23:42:18.156 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:42:18.156 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:42:18.156 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:42:18.156 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:42:18.156 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2024-04-26T23:42:18.156 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2024-04-26T23:42:18.156 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-04-26T23:42:18.156 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-04-26T23:42:18.157 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-04-26T23:42:18.157 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:42:18.157 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:42:18.157 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2024-04-26T23:42:18.157 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2024-04-26T23:42:18.157 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-04-26T23:42:18.157 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-04-26T23:42:18.157 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:42:18.157 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-04-26T23:42:18.157 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:3300", 2024-04-26T23:42:18.157 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:42:18.157 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:42:18.157 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:42:18.157 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-04-26T23:42:18.157 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6789", 2024-04-26T23:42:18.157 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:42:18.157 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:42:18.158 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:42:18.158 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:42:18.158 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6789/0", 2024-04-26T23:42:18.158 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.175:6789/0", 2024-04-26T23:42:18.158 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-04-26T23:42:18.158 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-04-26T23:42:18.158 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-04-26T23:42:18.158 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:42:18.158 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:42:18.158 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2024-04-26T23:42:18.158 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2024-04-26T23:42:18.159 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-04-26T23:42:18.159 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-04-26T23:42:18.159 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:42:18.159 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-04-26T23:42:18.159 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:3301", 2024-04-26T23:42:18.159 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:42:18.159 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:42:18.159 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:42:18.159 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-04-26T23:42:18.159 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6790", 2024-04-26T23:42:18.159 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:42:18.159 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:42:18.159 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:42:18.159 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:42:18.159 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6790/0", 2024-04-26T23:42:18.160 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.175:6790/0", 2024-04-26T23:42:18.160 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-04-26T23:42:18.160 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-04-26T23:42:18.160 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-04-26T23:42:18.160 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:42:18.160 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:42:18.160 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:42:18.160 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2024-04-26T23:42:18.160 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2024-04-26T23:42:18.160 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:42:18.160 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:42:18.160 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:42:18.160 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2024-04-26T23:42:18.160 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:42:18.160 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:42:18.160 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": [ 2024-04-26T23:42:18.160 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:42:18.161 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:42:18.161 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:42:18.161 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 3 2024-04-26T23:42:18.161 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:42:18.161 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:42:18.161 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": [ 2024-04-26T23:42:18.161 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:42:18.161 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:42:18.161 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:42:18.161 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2024-04-26T23:42:18.161 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:42:18.161 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:42:18.161 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2024-04-26T23:42:18.161 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:42:18.161 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:42:18.161 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:42:18.162 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2024-04-26T23:42:18.162 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:42:18.162 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:42:18.162 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": [ 2024-04-26T23:42:18.162 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:42:18.162 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:42:18.162 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:42:18.162 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2024-04-26T23:42:18.162 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:42:18.162 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:42:18.162 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:42:18.162 INFO:teuthology.orchestra.run.smithi088.stdout: "stretch_mode": false 2024-04-26T23:42:18.162 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-04-26T23:42:18.164 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.146+0000 7fe309ffb640 1 -- 172.21.15.88:0/2954673214 <== mon.1 v2:172.21.15.175:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5066 (secure 0 0 0) 0x7fe310007420 con 0x7fe318147280 2024-04-26T23:42:18.164 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.146+0000 7fe309ffb640 1 -- 172.21.15.88:0/2954673214 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe318147280 msgr2=0x7fe318147690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:18.164 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.146+0000 7fe309ffb640 1 --2- 172.21.15.88:0/2954673214 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe318147280 0x7fe318147690 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fe310017000 tx=0x7fe310005b70 comp rx=0 tx=0).stop 2024-04-26T23:42:18.164 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.146+0000 7fe309ffb640 1 -- 172.21.15.88:0/2954673214 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe318147280 msgr2=0x7fe318147690 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:42:18.164 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.146+0000 7fe309ffb640 1 --2- 172.21.15.88:0/2954673214 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe318147280 0x7fe318147690 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:18.165 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.147+0000 7fe31f899640 1 -- 172.21.15.88:0/2954673214 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fe2fc06c920 msgr2=0x7fe2fc06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:18.165 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.147+0000 7fe31f899640 1 --2- 172.21.15.88:0/2954673214 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fe2fc06c920 0x7fe2fc06ede0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fe31814d530 tx=0x7fe30c009040 comp rx=0 tx=0).stop 2024-04-26T23:42:18.165 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.147+0000 7fe31f899640 1 -- 172.21.15.88:0/2954673214 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe3180ca5a0 msgr2=0x7fe3181f0040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:18.165 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.147+0000 7fe31f899640 1 --2- 172.21.15.88:0/2954673214 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe3180ca5a0 0x7fe3181f0040 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fe314035040 tx=0x7fe3140046c0 comp rx=0 tx=0).stop 2024-04-26T23:42:18.165 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.147+0000 7fe31de36640 1 -- 172.21.15.88:0/2954673214 reap_dead start 2024-04-26T23:42:18.165 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.147+0000 7fe31f899640 1 -- 172.21.15.88:0/2954673214 shutdown_connections 2024-04-26T23:42:18.165 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.147+0000 7fe31f899640 1 -- 172.21.15.88:0/2954673214 >> 172.21.15.88:0/2954673214 conn(0x7fe3180ae010 msgr2=0x7fe318150640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:18.165 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.147+0000 7fe31f899640 1 -- 172.21.15.88:0/2954673214 shutdown_connections 2024-04-26T23:42:18.165 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.147+0000 7fe31f899640 1 -- 172.21.15.88:0/2954673214 wait complete. 2024-04-26T23:42:18.165 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-04-26T23:42:18.165 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-04-26T23:42:18.166 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-04-26T23:42:18.265 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.261+0000 7f1cef493640 1 Processor -- start 2024-04-26T23:42:18.266 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.261+0000 7f1cef493640 1 -- start start 2024-04-26T23:42:18.267 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.262+0000 7f1cef493640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1ce8154160 0x7f1ce8156bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:18.267 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.262+0000 7f1cef493640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1ce80c8df0 con 0x7f1ce815a1a0 2024-04-26T23:42:18.267 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.262+0000 7f1cef493640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1ce8154540 con 0x7f1ce80ca5a0 2024-04-26T23:42:18.267 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.262+0000 7f1cef493640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f1ce80c9100 con 0x7f1ce8154160 2024-04-26T23:42:18.267 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.262+0000 7f1ceda30640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f1ce815a1a0 0x7f1ce80c9590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:37122/0 (socket says 172.21.15.88:37122) 2024-04-26T23:42:18.267 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.262+0000 7f1ceda30640 1 -- 172.21.15.88:0/489594232 learned_addr learned my addr 172.21.15.88:0/489594232 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-26T23:42:18.267 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.262+0000 7f1ced22f640 1 --2- 172.21.15.88:0/489594232 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1ce8154160 0x7f1ce8156bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:18.267 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.263+0000 7f1cdffff640 1 -- 172.21.15.88:0/489594232 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1262105766 0 0) 0x7f1ce8154540 con 0x7f1ce80ca5a0 2024-04-26T23:42:18.267 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.263+0000 7f1cdffff640 1 -- 172.21.15.88:0/489594232 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1cd4003520 con 0x7f1ce80ca5a0 2024-04-26T23:42:18.268 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.263+0000 7f1cdffff640 1 -- 172.21.15.88:0/489594232 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3820052795 0 0) 0x7f1ce0001490 con 0x7f1ce815a1a0 2024-04-26T23:42:18.268 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.263+0000 7f1cdffff640 1 -- 172.21.15.88:0/489594232 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1ce8154540 con 0x7f1ce815a1a0 2024-04-26T23:42:18.268 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.263+0000 7f1ced22f640 1 -- 172.21.15.88:0/489594232 >> v1:172.21.15.175:6789/0 conn(0x7f1ce80ca5a0 legacy=0x7f1ce80c6e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:18.268 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.263+0000 7f1ced22f640 1 -- 172.21.15.88:0/489594232 >> v1:172.21.15.88:6789/0 conn(0x7f1ce815a1a0 legacy=0x7f1ce80c9590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:18.268 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.263+0000 7f1ced22f640 1 -- 172.21.15.88:0/489594232 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ce815a910 con 0x7f1ce8154160 2024-04-26T23:42:18.269 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.264+0000 7f1ced22f640 1 --2- 172.21.15.88:0/489594232 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1ce8154160 0x7f1ce8156bb0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f1ce40097d0 tx=0x7f1ce402a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ca32f8f18822ea34 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:18.269 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.264+0000 7f1cdffff640 1 -- 172.21.15.88:0/489594232 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ce4037070 con 0x7f1ce8154160 2024-04-26T23:42:18.269 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.264+0000 7f1cdffff640 1 -- 172.21.15.88:0/489594232 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ce4032440 con 0x7f1ce8154160 2024-04-26T23:42:18.269 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.264+0000 7f1cdffff640 1 -- 172.21.15.88:0/489594232 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ce40327f0 con 0x7f1ce8154160 2024-04-26T23:42:18.269 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.265+0000 7f1cef493640 1 -- 172.21.15.88:0/489594232 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1ce8154160 msgr2=0x7f1ce8156bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:18.270 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.265+0000 7f1cef493640 1 --2- 172.21.15.88:0/489594232 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1ce8154160 0x7f1ce8156bb0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f1ce40097d0 tx=0x7f1ce402a210 comp rx=0 tx=0).stop 2024-04-26T23:42:18.270 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.265+0000 7f1cef493640 1 -- 172.21.15.88:0/489594232 shutdown_connections 2024-04-26T23:42:18.270 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.265+0000 7f1cef493640 1 --2- 172.21.15.88:0/489594232 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1ce8154160 0x7f1ce8156bb0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:18.270 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.265+0000 7f1cef493640 1 -- 172.21.15.88:0/489594232 >> 172.21.15.88:0/489594232 conn(0x7f1ce80ae010 msgr2=0x7f1ce80ae3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:18.270 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.265+0000 7f1cef493640 1 -- 172.21.15.88:0/489594232 shutdown_connections 2024-04-26T23:42:18.270 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.265+0000 7f1cef493640 1 -- 172.21.15.88:0/489594232 wait complete. 2024-04-26T23:42:18.270 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.267+0000 7f1cef493640 1 Processor -- start 2024-04-26T23:42:18.271 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.267+0000 7f1cef493640 1 -- start start 2024-04-26T23:42:18.273 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.268+0000 7f1cef493640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1ce80ca5a0 0x7f1ce81f0130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:18.273 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.268+0000 7f1cef493640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1ce8154160 0x7f1ce80ccc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:18.273 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.268+0000 7f1cef493640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1ce815a1a0 0x7f1ce8154d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:18.273 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.268+0000 7f1cef493640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f1ce815a630 con 0x7f1ce80ca5a0 2024-04-26T23:42:18.273 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.268+0000 7f1cef493640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f1ce815aed0 con 0x7f1ce815a1a0 2024-04-26T23:42:18.273 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.268+0000 7f1cef493640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f1ce80c7510 con 0x7f1ce8154160 2024-04-26T23:42:18.273 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.268+0000 7f1ceca2e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1ce8154160 0x7f1ce80ccc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:18.274 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.268+0000 7f1ced22f640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1ce80ca5a0 0x7f1ce81f0130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:18.274 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.268+0000 7f1ced22f640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1ce80ca5a0 0x7f1ce81f0130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:49036/0 (socket says 172.21.15.88:49036) 2024-04-26T23:42:18.274 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.268+0000 7f1ceca2e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1ce8154160 0x7f1ce80ccc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.88:36120/0 (socket says 172.21.15.88:36120) 2024-04-26T23:42:18.274 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.268+0000 7f1ced22f640 1 -- 172.21.15.88:0/1893131214 learned_addr learned my addr 172.21.15.88:0/1893131214 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:42:18.274 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.268+0000 7f1ceda30640 1 --2- 172.21.15.88:0/1893131214 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1ce815a1a0 0x7f1ce8154d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:18.274 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.268+0000 7f1ceca2e640 1 -- 172.21.15.88:0/1893131214 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1ce815a1a0 msgr2=0x7f1ce8154d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:18.274 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.268+0000 7f1ceca2e640 1 --2- 172.21.15.88:0/1893131214 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1ce815a1a0 0x7f1ce8154d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:18.274 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.268+0000 7f1ceca2e640 1 -- 172.21.15.88:0/1893131214 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1ce80ca5a0 msgr2=0x7f1ce81f0130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:18.274 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.268+0000 7f1ceca2e640 1 --2- 172.21.15.88:0/1893131214 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1ce80ca5a0 0x7f1ce81f0130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:18.274 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.268+0000 7f1ceca2e640 1 -- 172.21.15.88:0/1893131214 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ce8153990 con 0x7f1ce8154160 2024-04-26T23:42:18.274 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.268+0000 7f1ced22f640 1 --2- 172.21.15.88:0/1893131214 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1ce80ca5a0 0x7f1ce81f0130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:42:18.274 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.269+0000 7f1ceca2e640 1 --2- 172.21.15.88:0/1893131214 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1ce8154160 0x7f1ce80ccc90 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f1cd800c400 tx=0x7f1cd800c8c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:18.274 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.269+0000 7f1cddffb640 1 -- 172.21.15.88:0/1893131214 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cd8017070 con 0x7f1ce8154160 2024-04-26T23:42:18.275 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.269+0000 7f1cddffb640 1 -- 172.21.15.88:0/1893131214 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1cd8005310 con 0x7f1ce8154160 2024-04-26T23:42:18.275 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.269+0000 7f1cddffb640 1 -- 172.21.15.88:0/1893131214 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cd8003830 con 0x7f1ce8154160 2024-04-26T23:42:18.275 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.269+0000 7f1cef493640 1 -- 172.21.15.88:0/1893131214 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ce81527b0 con 0x7f1ce8154160 2024-04-26T23:42:18.275 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.269+0000 7f1cef493640 1 -- 172.21.15.88:0/1893131214 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ce81536b0 con 0x7f1ce8154160 2024-04-26T23:42:18.277 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.270+0000 7f1cef493640 1 --2- 172.21.15.88:0/1893131214 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1ce81552d0 0x7f1ce814d840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:18.277 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.270+0000 7f1cef493640 1 -- 172.21.15.88:0/1893131214 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f1ce8154ab0 con 0x7f1ce81552d0 2024-04-26T23:42:18.277 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.270+0000 7f1ced22f640 1 --2- 172.21.15.88:0/1893131214 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1ce81552d0 0x7f1ce814d840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:18.277 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.271+0000 7f1ced22f640 1 -- 172.21.15.88:0/1893131214 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1ce80c7b00 con 0x7f1ce81552d0 2024-04-26T23:42:18.277 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.271+0000 7f1ced22f640 1 --2- 172.21.15.88:0/1893131214 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1ce81552d0 0x7f1ce814d840 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f1ce4000c00 tx=0x7f1ce40046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:18.277 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.271+0000 7f1cddffb640 1 -- 172.21.15.88:0/1893131214 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ce4043070 con 0x7f1ce81552d0 2024-04-26T23:42:18.277 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.271+0000 7f1cddffb640 1 -- 172.21.15.88:0/1893131214 <== mon.2 v2:172.21.15.175:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f1cd801a070 con 0x7f1ce8154160 2024-04-26T23:42:18.277 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.272+0000 7f1cddffb640 1 --2- 172.21.15.88:0/1893131214 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f1ccc06c7f0 0x7f1ccc06ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:18.277 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.272+0000 7f1cddffb640 1 -- 172.21.15.88:0/1893131214 <== mon.2 v2:172.21.15.175:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6666+0+0 (secure 0 0 0) 0x7f1cd808b150 con 0x7f1ce8154160 2024-04-26T23:42:18.277 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.272+0000 7f1ceda30640 1 --2- 172.21.15.88:0/1893131214 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f1ccc06c7f0 0x7f1ccc06ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:18.277 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.272+0000 7f1cddffb640 1 -- 172.21.15.88:0/1893131214 <== mon.2 v2:172.21.15.175:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f1ce4032440 con 0x7f1ce81552d0 2024-04-26T23:42:18.277 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.272+0000 7f1cddffb640 1 -- 172.21.15.88:0/1893131214 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1ce81552d0 msgr2=0x7f1ce814d840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:18.277 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.272+0000 7f1cddffb640 1 --2- 172.21.15.88:0/1893131214 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1ce81552d0 0x7f1ce814d840 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f1ce4000c00 tx=0x7f1ce40046c0 comp rx=0 tx=0).stop 2024-04-26T23:42:18.277 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.272+0000 7f1cddffb640 1 -- 172.21.15.88:0/1893131214 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1ce81552d0 msgr2=0x7f1ce814d840 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:42:18.278 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.272+0000 7f1cddffb640 1 --2- 172.21.15.88:0/1893131214 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1ce81552d0 0x7f1ce814d840 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:18.278 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.273+0000 7f1ceda30640 1 --2- 172.21.15.88:0/1893131214 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f1ccc06c7f0 0x7f1ccc06ecb0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f1ce0005c00 tx=0x7f1ce0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:18.282 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.278+0000 7f1cef493640 1 --2- 172.21.15.88:0/1893131214 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1ce814dd80 0x7f1ce8157fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:18.283 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.278+0000 7f1cef493640 1 -- 172.21.15.88:0/1893131214 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f1ce8076650 con 0x7f1ce814dd80 2024-04-26T23:42:18.283 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.279+0000 7f1ced22f640 1 --2- 172.21.15.88:0/1893131214 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1ce814dd80 0x7f1ce8157fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:18.283 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.279+0000 7f1ced22f640 1 -- 172.21.15.88:0/1893131214 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f1ce80507a0 con 0x7f1ce814dd80 2024-04-26T23:42:18.284 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.279+0000 7f1ced22f640 1 --2- 172.21.15.88:0/1893131214 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1ce814dd80 0x7f1ce8157fa0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f1ce81590d0 tx=0x7f1ce4008030 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:18.284 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.279+0000 7f1cddffb640 1 -- 172.21.15.88:0/1893131214 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ce4037040 con 0x7f1ce814dd80 2024-04-26T23:42:18.284 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.280+0000 7f1cddffb640 1 -- 172.21.15.88:0/1893131214 <== mon.2 v2:172.21.15.175:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5209 (secure 0 0 0) 0x7f1ce4003960 con 0x7f1ce814dd80 2024-04-26T23:42:18.284 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.280+0000 7f1cddffb640 1 -- 172.21.15.88:0/1893131214 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1ce814dd80 msgr2=0x7f1ce8157fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:18.284 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.280+0000 7f1cddffb640 1 --2- 172.21.15.88:0/1893131214 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1ce814dd80 0x7f1ce8157fa0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f1ce81590d0 tx=0x7f1ce4008030 comp rx=0 tx=0).stop 2024-04-26T23:42:18.284 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.280+0000 7f1cddffb640 1 -- 172.21.15.88:0/1893131214 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1ce814dd80 msgr2=0x7f1ce8157fa0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:42:18.284 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.280+0000 7f1cddffb640 1 --2- 172.21.15.88:0/1893131214 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1ce814dd80 0x7f1ce8157fa0 secure :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f1ce81590d0 tx=0x7f1ce4008030 comp rx=0 tx=0).stop 2024-04-26T23:42:18.284 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-04-26T23:42:18.285 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2024-04-26T23:42:18.285 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2024-04-26T23:42:18.285 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "peon", 2024-04-26T23:42:18.285 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 12, 2024-04-26T23:42:18.285 INFO:teuthology.orchestra.run.smithi088.stdout: "uptime": 130623, 2024-04-26T23:42:18.285 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2024-04-26T23:42:18.285 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2024-04-26T23:42:18.285 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2024-04-26T23:42:18.285 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2024-04-26T23:42:18.285 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:42:18.285 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 12, 2024-04-26T23:42:18.285 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2024-04-26T23:42:18.285 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2450521708007866372", 2024-04-26T23:42:18.285 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2024-04-26T23:42:18.286 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-04-26T23:42:18.286 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-04-26T23:42:18.286 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-04-26T23:42:18.286 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-04-26T23:42:18.286 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-04-26T23:42:18.286 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-04-26T23:42:18.286 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-04-26T23:42:18.286 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-04-26T23:42:18.286 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-04-26T23:42:18.286 INFO:teuthology.orchestra.run.smithi088.stdout: "reef", 2024-04-26T23:42:18.286 INFO:teuthology.orchestra.run.smithi088.stdout: "squid" 2024-04-26T23:42:18.286 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:42:18.286 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540701547738038271", 2024-04-26T23:42:18.286 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2024-04-26T23:42:18.286 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-04-26T23:42:18.286 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-04-26T23:42:18.287 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-04-26T23:42:18.287 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-04-26T23:42:18.287 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-04-26T23:42:18.287 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-04-26T23:42:18.287 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-04-26T23:42:18.287 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-04-26T23:42:18.287 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-04-26T23:42:18.287 INFO:teuthology.orchestra.run.smithi088.stdout: "reef", 2024-04-26T23:42:18.287 INFO:teuthology.orchestra.run.smithi088.stdout: "squid" 2024-04-26T23:42:18.287 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:42:18.287 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:42:18.287 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2024-04-26T23:42:18.287 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2024-04-26T23:42:18.287 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2024-04-26T23:42:18.288 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2024-04-26T23:42:18.288 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2024-04-26T23:42:18.288 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "555255e9-7ef9-4454-8dc9-35e96b70035c", 2024-04-26T23:42:18.288 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2024-04-26T23:39:34.291658Z", 2024-04-26T23:42:18.288 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2024-04-26T23:39:34.291658Z", 2024-04-26T23:42:18.288 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 19, 2024-04-26T23:42:18.288 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "squid", 2024-04-26T23:42:18.288 INFO:teuthology.orchestra.run.smithi088.stdout: "election_strategy": 1, 2024-04-26T23:42:18.288 INFO:teuthology.orchestra.run.smithi088.stdout: "disallowed_leaders: ": "", 2024-04-26T23:42:18.288 INFO:teuthology.orchestra.run.smithi088.stdout: "stretch_mode": false, 2024-04-26T23:42:18.288 INFO:teuthology.orchestra.run.smithi088.stdout: "tiebreaker_mon": "", 2024-04-26T23:42:18.288 INFO:teuthology.orchestra.run.smithi088.stdout: "removed_ranks: ": "", 2024-04-26T23:42:18.288 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2024-04-26T23:42:18.288 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2024-04-26T23:42:18.289 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-04-26T23:42:18.289 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-04-26T23:42:18.289 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-04-26T23:42:18.289 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-04-26T23:42:18.289 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-04-26T23:42:18.289 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-04-26T23:42:18.289 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-04-26T23:42:18.289 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-04-26T23:42:18.289 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-04-26T23:42:18.289 INFO:teuthology.orchestra.run.smithi088.stdout: "reef", 2024-04-26T23:42:18.289 INFO:teuthology.orchestra.run.smithi088.stdout: "squid" 2024-04-26T23:42:18.289 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:42:18.289 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2024-04-26T23:42:18.289 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:42:18.289 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2024-04-26T23:42:18.289 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:42:18.290 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2024-04-26T23:42:18.290 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2024-04-26T23:42:18.290 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-04-26T23:42:18.290 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-04-26T23:42:18.290 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:42:18.290 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-04-26T23:42:18.290 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2024-04-26T23:42:18.290 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:42:18.290 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:42:18.290 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:42:18.290 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-04-26T23:42:18.290 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2024-04-26T23:42:18.290 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:42:18.290 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:42:18.291 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:42:18.291 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:42:18.291 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2024-04-26T23:42:18.291 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2024-04-26T23:42:18.291 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-04-26T23:42:18.291 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-04-26T23:42:18.291 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-04-26T23:42:18.291 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:42:18.291 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:42:18.291 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2024-04-26T23:42:18.291 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2024-04-26T23:42:18.291 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-04-26T23:42:18.291 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-04-26T23:42:18.291 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:42:18.291 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-04-26T23:42:18.292 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:3300", 2024-04-26T23:42:18.292 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:42:18.292 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:42:18.292 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:42:18.292 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-04-26T23:42:18.292 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6789", 2024-04-26T23:42:18.292 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:42:18.292 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:42:18.292 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:42:18.292 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:42:18.292 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6789/0", 2024-04-26T23:42:18.292 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.175:6789/0", 2024-04-26T23:42:18.292 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-04-26T23:42:18.292 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-04-26T23:42:18.292 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-04-26T23:42:18.292 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:42:18.293 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:42:18.293 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2024-04-26T23:42:18.293 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2024-04-26T23:42:18.293 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-04-26T23:42:18.293 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-04-26T23:42:18.293 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:42:18.293 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-04-26T23:42:18.293 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:3301", 2024-04-26T23:42:18.293 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:42:18.293 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:42:18.293 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:42:18.293 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-04-26T23:42:18.293 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6790", 2024-04-26T23:42:18.293 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:42:18.293 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:42:18.294 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:42:18.294 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:42:18.294 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6790/0", 2024-04-26T23:42:18.294 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.175:6790/0", 2024-04-26T23:42:18.294 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-04-26T23:42:18.294 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-04-26T23:42:18.294 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-04-26T23:42:18.294 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:42:18.294 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:42:18.294 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:42:18.294 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2024-04-26T23:42:18.294 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2024-04-26T23:42:18.294 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:42:18.294 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:42:18.295 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:42:18.295 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2024-04-26T23:42:18.295 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:42:18.295 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:42:18.295 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": [ 2024-04-26T23:42:18.295 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:42:18.295 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:42:18.295 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:42:18.295 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2024-04-26T23:42:18.295 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:42:18.295 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:42:18.295 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": [ 2024-04-26T23:42:18.295 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:42:18.295 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:42:18.295 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:42:18.296 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 7 2024-04-26T23:42:18.296 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:42:18.296 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:42:18.296 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2024-04-26T23:42:18.296 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:42:18.296 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x2f018fb87aa4aafe", 2024-04-26T23:42:18.296 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:42:18.296 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2024-04-26T23:42:18.296 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:42:18.296 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:42:18.296 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:42:18.296 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:42:18.296 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 5 2024-04-26T23:42:18.296 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:42:18.296 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:42:18.297 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": [ 2024-04-26T23:42:18.297 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:42:18.297 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:42:18.297 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:42:18.297 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2024-04-26T23:42:18.297 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:42:18.297 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:42:18.297 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:42:18.297 INFO:teuthology.orchestra.run.smithi088.stdout: "stretch_mode": false 2024-04-26T23:42:18.297 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-04-26T23:42:18.298 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.280+0000 7f1cef493640 1 -- 172.21.15.88:0/1893131214 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f1ccc06c7f0 msgr2=0x7f1ccc06ecb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:18.299 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.280+0000 7f1cef493640 1 --2- 172.21.15.88:0/1893131214 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f1ccc06c7f0 0x7f1ccc06ecb0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f1ce0005c00 tx=0x7f1ce0009040 comp rx=0 tx=0).stop 2024-04-26T23:42:18.299 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.280+0000 7f1cef493640 1 -- 172.21.15.88:0/1893131214 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1ce8154160 msgr2=0x7f1ce80ccc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:18.299 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.280+0000 7f1cef493640 1 --2- 172.21.15.88:0/1893131214 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1ce8154160 0x7f1ce80ccc90 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f1cd800c400 tx=0x7f1cd800c8c0 comp rx=0 tx=0).stop 2024-04-26T23:42:18.299 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.280+0000 7f1ceda30640 1 -- 172.21.15.88:0/1893131214 reap_dead start 2024-04-26T23:42:18.299 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.280+0000 7f1cef493640 1 -- 172.21.15.88:0/1893131214 shutdown_connections 2024-04-26T23:42:18.299 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.280+0000 7f1cef493640 1 --2- 172.21.15.88:0/1893131214 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1ce8154160 0x7f1ce80ccc90 secure :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f1cd800c400 tx=0x7f1cd800c8c0 comp rx=0 tx=0).stop 2024-04-26T23:42:18.299 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.280+0000 7f1cef493640 1 -- 172.21.15.88:0/1893131214 >> 172.21.15.88:0/1893131214 conn(0x7f1ce80ae010 msgr2=0x7f1ce814f810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:18.299 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.280+0000 7f1cef493640 1 -- 172.21.15.88:0/1893131214 shutdown_connections 2024-04-26T23:42:18.299 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.280+0000 7f1cef493640 1 -- 172.21.15.88:0/1893131214 wait complete. 2024-04-26T23:42:18.299 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-04-26T23:42:18.300 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['c'] 2024-04-26T23:42:18.300 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2024-04-26T23:42:18.300 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.c 2024-04-26T23:42:18.300 INFO:tasks.mon_thrash.mon_thrasher:killing mon.c 2024-04-26T23:42:18.300 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-04-26T23:42:18.300 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T23:42:18.316 INFO:tasks.ceph.mon.c:Stopped 2024-04-26T23:42:18.316 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2024-04-26T23:42:18.316 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-04-26T23:42:18.424 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.420+0000 7f4367cda640 1 Processor -- start 2024-04-26T23:42:18.424 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.420+0000 7f4367cda640 1 -- start start 2024-04-26T23:42:18.428 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.421+0000 7f4367cda640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f4360154160 0x7f4360156bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:18.428 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.421+0000 7f4367cda640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f436015a1a0 0x7f43600c9590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:18.428 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.421+0000 7f4367cda640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f43600c8df0 con 0x7f43600ca5a0 2024-04-26T23:42:18.428 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.421+0000 7f4367cda640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f43600c9100 con 0x7f4360154160 2024-04-26T23:42:18.428 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.421+0000 7f4367cda640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f4360154540 con 0x7f436015a1a0 2024-04-26T23:42:18.428 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.421+0000 7f4366277640 1 -- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f436015a1a0 msgr2=0x7f43600c9590 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.175:3301/0 2024-04-26T23:42:18.428 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.421+0000 7f4366277640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f436015a1a0 0x7f43600c9590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:42:18.428 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.421+0000 7f4365275640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f43600ca5a0 0x7f43600c6e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:37130/0 (socket says 172.21.15.88:37130) 2024-04-26T23:42:18.428 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.421+0000 7f4365275640 1 -- 172.21.15.88:0/2115808470 learned_addr learned my addr 172.21.15.88:0/2115808470 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-26T23:42:18.428 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.421+0000 7f4365a76640 1 --2- 172.21.15.88:0/2115808470 >> v2:172.21.15.175:3300/0 conn(0x7f4360154160 0x7f4360156bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:18.429 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.421+0000 7f4364a74640 1 -- 172.21.15.88:0/2115808470 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1896108230 0 0) 0x7f4350001110 con 0x7f43600ca5a0 2024-04-26T23:42:18.429 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.421+0000 7f4364a74640 1 -- 172.21.15.88:0/2115808470 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f434c003520 con 0x7f43600ca5a0 2024-04-26T23:42:18.429 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.421+0000 7f4365a76640 1 -- 172.21.15.88:0/2115808470 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f436015a1a0 msgr2=0x7f43600c9590 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T23:42:18.429 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.421+0000 7f4364a74640 1 -- 172.21.15.88:0/2115808470 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 676802953 0 0) 0x7f434c003520 con 0x7f43600ca5a0 2024-04-26T23:42:18.429 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.421+0000 7f4365a76640 1 --2- 172.21.15.88:0/2115808470 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f436015a1a0 0x7f43600c9590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:18.429 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.421+0000 7f4365a76640 1 -- 172.21.15.88:0/2115808470 >> v1:172.21.15.88:6789/0 conn(0x7f43600ca5a0 legacy=0x7f43600c6e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:18.429 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.421+0000 7f4365a76640 1 -- 172.21.15.88:0/2115808470 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f436015a910 con 0x7f4360154160 2024-04-26T23:42:18.429 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.422+0000 7f4365a76640 1 --2- 172.21.15.88:0/2115808470 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4360154160 0x7f4360156bb0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f435c0097a0 tx=0x7f435c02a130 comp rx=0 tx=0).ready entity=mon.1 client_cookie=56486bb6000ea3b6 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:18.429 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.423+0000 7f4364a74640 1 -- 172.21.15.88:0/2115808470 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f435c037070 con 0x7f4360154160 2024-04-26T23:42:18.429 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.423+0000 7f4364a74640 1 -- 172.21.15.88:0/2115808470 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f435c02abc0 con 0x7f4360154160 2024-04-26T23:42:18.429 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.423+0000 7f4364a74640 1 -- 172.21.15.88:0/2115808470 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4350001840 con 0x7f4360154160 2024-04-26T23:42:18.429 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.423+0000 7f4367cda640 1 -- 172.21.15.88:0/2115808470 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4360154160 msgr2=0x7f4360156bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:18.429 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.423+0000 7f4367cda640 1 --2- 172.21.15.88:0/2115808470 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4360154160 0x7f4360156bb0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f435c0097a0 tx=0x7f435c02a130 comp rx=0 tx=0).stop 2024-04-26T23:42:18.429 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.423+0000 7f4367cda640 1 -- 172.21.15.88:0/2115808470 shutdown_connections 2024-04-26T23:42:18.430 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.423+0000 7f4367cda640 1 --2- 172.21.15.88:0/2115808470 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f436015a1a0 0x7f43600c9590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:18.430 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.423+0000 7f4367cda640 1 --2- 172.21.15.88:0/2115808470 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4360154160 0x7f4360156bb0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:18.430 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.423+0000 7f4367cda640 1 -- 172.21.15.88:0/2115808470 >> 172.21.15.88:0/2115808470 conn(0x7f43600ae010 msgr2=0x7f43600ae3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:18.430 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.423+0000 7f4367cda640 1 -- 172.21.15.88:0/2115808470 shutdown_connections 2024-04-26T23:42:18.430 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.423+0000 7f4367cda640 1 -- 172.21.15.88:0/2115808470 wait complete. 2024-04-26T23:42:18.432 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.425+0000 7f4367cda640 1 Processor -- start 2024-04-26T23:42:18.433 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.425+0000 7f4367cda640 1 -- start start 2024-04-26T23:42:18.433 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.425+0000 7f4367cda640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f43600ca5a0 0x7f4360157fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:18.433 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.425+0000 7f4367cda640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4360154160 0x7f43601e1040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:18.433 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.425+0000 7f4367cda640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f436015a1a0 0x7f4360152c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:18.433 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.425+0000 7f4367cda640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f436015a5f0 con 0x7f4360154160 2024-04-26T23:42:18.433 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.425+0000 7f4367cda640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f436015aed0 con 0x7f436015a1a0 2024-04-26T23:42:18.433 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.425+0000 7f4367cda640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f43600c7510 con 0x7f43600ca5a0 2024-04-26T23:42:18.433 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.425+0000 7f4365a76640 1 -- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f43600ca5a0 msgr2=0x7f4360157fa0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.175:3301/0 2024-04-26T23:42:18.433 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.425+0000 7f4365275640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4360154160 0x7f43601e1040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:18.433 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.425+0000 7f4365a76640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f43600ca5a0 0x7f4360157fa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:42:18.433 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.425+0000 7f4365275640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4360154160 0x7f43601e1040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:49114/0 (socket says 172.21.15.88:49114) 2024-04-26T23:42:18.433 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.425+0000 7f4365275640 1 -- 172.21.15.88:0/273795891 learned_addr learned my addr 172.21.15.88:0/273795891 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:42:18.433 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.425+0000 7f4366277640 1 --2- 172.21.15.88:0/273795891 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f436015a1a0 0x7f4360152c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:18.433 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.426+0000 7f4365275640 1 -- 172.21.15.88:0/273795891 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f43600ca5a0 msgr2=0x7f4360157fa0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T23:42:18.433 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.426+0000 7f4365275640 1 --2- 172.21.15.88:0/273795891 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f43600ca5a0 0x7f4360157fa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:18.434 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.426+0000 7f4365275640 1 -- 172.21.15.88:0/273795891 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f436015a1a0 msgr2=0x7f4360152c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:18.434 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.426+0000 7f4365275640 1 --2- 172.21.15.88:0/273795891 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f436015a1a0 0x7f4360152c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:18.434 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.426+0000 7f4365275640 1 -- 172.21.15.88:0/273795891 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43600b1f80 con 0x7f4360154160 2024-04-26T23:42:18.434 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.426+0000 7f4365275640 1 --2- 172.21.15.88:0/273795891 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4360154160 0x7f43601e1040 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f4350001eb0 tx=0x7f435000cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:18.434 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.426+0000 7f43567fc640 1 -- 172.21.15.88:0/273795891 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4350017070 con 0x7f4360154160 2024-04-26T23:42:18.434 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.426+0000 7f43567fc640 1 -- 172.21.15.88:0/273795891 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4350005ad0 con 0x7f4360154160 2024-04-26T23:42:18.434 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.426+0000 7f4367cda640 1 -- 172.21.15.88:0/273795891 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43600b1ca0 con 0x7f4360154160 2024-04-26T23:42:18.434 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.426+0000 7f43567fc640 1 -- 172.21.15.88:0/273795891 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4350007070 con 0x7f4360154160 2024-04-26T23:42:18.434 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.426+0000 7f4367cda640 1 -- 172.21.15.88:0/273795891 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4360152450 con 0x7f4360154160 2024-04-26T23:42:18.434 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.427+0000 7f4367cda640 1 -- 172.21.15.88:0/273795891 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4360076650 con 0x7f4360154160 2024-04-26T23:42:18.434 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.428+0000 7f43567fc640 1 -- 172.21.15.88:0/273795891 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f435001a070 con 0x7f4360154160 2024-04-26T23:42:18.434 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.428+0000 7f43567fc640 1 --2- 172.21.15.88:0/273795891 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f434406c8a0 0x7f434406ed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:18.434 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.428+0000 7f43567fc640 1 -- 172.21.15.88:0/273795891 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6666+0+0 (secure 0 0 0) 0x7f435008b2f0 con 0x7f4360154160 2024-04-26T23:42:18.435 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.429+0000 7f4365a76640 1 --2- 172.21.15.88:0/273795891 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f434406c8a0 0x7f434406ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:18.435 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.429+0000 7f4365a76640 1 --2- 172.21.15.88:0/273795891 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f434406c8a0 0x7f434406ed60 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f435c034000 tx=0x7f435c02e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:18.441 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.437+0000 7f43567fc640 1 -- 172.21.15.88:0/273795891 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f43600c8df0 con 0x7f4360154160 2024-04-26T23:42:18.697 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.693+0000 7f4367cda640 1 -- 172.21.15.88:0/273795891 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f43600507a0 con 0x7f4360154160 2024-04-26T23:42:18.697 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.693+0000 7f43567fc640 1 -- 172.21.15.88:0/273795891 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1565 (secure 0 0 0) 0x7f4350058da0 con 0x7f4360154160 2024-04-26T23:42:18.698 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":12,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":12,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"555255e9-7ef9-4454-8dc9-35e96b70035c","modified":"2024-04-26T23:39:34.291658Z","created":"2024-04-26T23:39:34.291658Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:3300","nonce":0},{"type":"v1","addr":"172.21.15.175:6789","nonce":0}]},"addr":"172.21.15.175:6789/0","public_addr":"172.21.15.175:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:3301","nonce":0},{"type":"v1","addr":"172.21.15.175:6790","nonce":0}]},"addr":"172.21.15.175:6790/0","public_addr":"172.21.15.175:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-04-26T23:42:18.700 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.695+0000 7f4367cda640 1 -- 172.21.15.88:0/273795891 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f434406c8a0 msgr2=0x7f434406ed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:18.700 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.695+0000 7f4367cda640 1 --2- 172.21.15.88:0/273795891 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f434406c8a0 0x7f434406ed60 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f435c034000 tx=0x7f435c02e000 comp rx=0 tx=0).stop 2024-04-26T23:42:18.700 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.695+0000 7f4367cda640 1 -- 172.21.15.88:0/273795891 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4360154160 msgr2=0x7f43601e1040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:18.700 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.695+0000 7f4367cda640 1 --2- 172.21.15.88:0/273795891 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4360154160 0x7f43601e1040 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f4350001eb0 tx=0x7f435000cb90 comp rx=0 tx=0).stop 2024-04-26T23:42:18.700 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.695+0000 7f4367cda640 1 -- 172.21.15.88:0/273795891 shutdown_connections 2024-04-26T23:42:18.700 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.695+0000 7f4367cda640 1 --2- 172.21.15.88:0/273795891 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f434406c8a0 0x7f434406ed60 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:18.700 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.695+0000 7f4367cda640 1 --2- 172.21.15.88:0/273795891 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f436015a1a0 0x7f4360152c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:18.700 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.695+0000 7f4367cda640 1 --2- 172.21.15.88:0/273795891 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4360154160 0x7f43601e1040 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:18.700 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.695+0000 7f4367cda640 1 --2- 172.21.15.88:0/273795891 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f43600ca5a0 0x7f4360157fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:18.700 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.695+0000 7f4367cda640 1 -- 172.21.15.88:0/273795891 >> 172.21.15.88:0/273795891 conn(0x7f43600ae010 msgr2=0x7f43600c92b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:18.700 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.696+0000 7f4367cda640 1 -- 172.21.15.88:0/273795891 shutdown_connections 2024-04-26T23:42:18.701 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:18.696+0000 7f4367cda640 1 -- 172.21.15.88:0/273795891 wait complete. 2024-04-26T23:42:21.712 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-04-26T23:42:21.860 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:21.855+0000 7f448c6c8640 1 Processor -- start 2024-04-26T23:42:21.860 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:21.855+0000 7f448c6c8640 1 -- start start 2024-04-26T23:42:21.865 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:21.857+0000 7f448c6c8640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f4484156bb0 0x7f448415a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:21.865 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:21.857+0000 7f448c6c8640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44840c8df0 con 0x7f44840ca5a0 2024-04-26T23:42:21.865 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:21.857+0000 7f448c6c8640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4484154540 con 0x7f4484154160 2024-04-26T23:42:21.866 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:21.857+0000 7f4489c63640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f44840ca5a0 0x7f44840c9590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:48116/0 (socket says 172.21.15.88:48116) 2024-04-26T23:42:21.866 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:21.857+0000 7f4489c63640 1 -- 172.21.15.88:0/1543372894 learned_addr learned my addr 172.21.15.88:0/1543372894 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-26T23:42:21.866 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:21.857+0000 7f448ac65640 1 --2- 172.21.15.88:0/1543372894 >> v2:172.21.15.88:3300/0 conn(0x7f4484156bb0 0x7f448415a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:21.866 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:21.857+0000 7f448c6c8640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f448415a6e0 con 0x7f4484156bb0 2024-04-26T23:42:21.866 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:21.857+0000 7f4489462640 1 -- 172.21.15.88:0/1543372894 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2776332621 0 0) 0x7f4474001110 con 0x7f44840ca5a0 2024-04-26T23:42:21.866 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:21.857+0000 7f4489462640 1 -- 172.21.15.88:0/1543372894 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4470003520 con 0x7f44840ca5a0 2024-04-26T23:42:21.867 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:21.857+0000 7f448ac65640 1 -- 172.21.15.88:0/1543372894 >> v1:172.21.15.175:6789/0 conn(0x7f4484154160 legacy=0x7f44840c6e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:21.867 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:21.858+0000 7f448ac65640 1 -- 172.21.15.88:0/1543372894 >> v1:172.21.15.88:6789/0 conn(0x7f44840ca5a0 legacy=0x7f44840c9590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:21.867 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:21.858+0000 7f448ac65640 1 -- 172.21.15.88:0/1543372894 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f448415a910 con 0x7f4484156bb0 2024-04-26T23:42:21.867 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:21.858+0000 7f448ac65640 1 --2- 172.21.15.88:0/1543372894 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4484156bb0 0x7f448415a1a0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f447c009d90 tx=0x7f447c02a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aed6d28af7d8bdb6 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:21.867 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:21.859+0000 7f4489462640 1 -- 172.21.15.88:0/1543372894 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f447c007740 con 0x7f4484156bb0 2024-04-26T23:42:21.867 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:21.859+0000 7f4489462640 1 -- 172.21.15.88:0/1543372894 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f447c0078e0 con 0x7f4484156bb0 2024-04-26T23:42:21.868 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:21.859+0000 7f4489462640 1 -- 172.21.15.88:0/1543372894 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f447c007c90 con 0x7f4484156bb0 2024-04-26T23:42:21.868 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:21.859+0000 7f448c6c8640 1 -- 172.21.15.88:0/1543372894 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4484156bb0 msgr2=0x7f448415a1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:21.868 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:21.859+0000 7f448c6c8640 1 --2- 172.21.15.88:0/1543372894 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4484156bb0 0x7f448415a1a0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f447c009d90 tx=0x7f447c02a6f0 comp rx=0 tx=0).stop 2024-04-26T23:42:21.868 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:21.860+0000 7f448c6c8640 1 -- 172.21.15.88:0/1543372894 shutdown_connections 2024-04-26T23:42:21.868 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:21.860+0000 7f448c6c8640 1 --2- 172.21.15.88:0/1543372894 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4484156bb0 0x7f448415a1a0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:21.868 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:21.860+0000 7f448c6c8640 1 -- 172.21.15.88:0/1543372894 >> 172.21.15.88:0/1543372894 conn(0x7f44840ae010 msgr2=0x7f44840ae3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:21.868 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:21.860+0000 7f448c6c8640 1 -- 172.21.15.88:0/1543372894 shutdown_connections 2024-04-26T23:42:21.869 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:21.860+0000 7f448c6c8640 1 -- 172.21.15.88:0/1543372894 wait complete. 2024-04-26T23:42:21.869 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:21.861+0000 7f448c6c8640 1 Processor -- start 2024-04-26T23:42:21.869 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:21.861+0000 7f448c6c8640 1 -- start start 2024-04-26T23:42:21.874 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:21.862+0000 7f448c6c8640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f44840ca5a0 0x7f4484159520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:21.874 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:21.862+0000 7f448c6c8640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4484154160 0x7f448414a880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:21.874 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:21.863+0000 7f448c6c8640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4484156bb0 0x7f448414adc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:21.874 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:21.863+0000 7f448c6c8640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f448415aed0 con 0x7f4484156bb0 2024-04-26T23:42:21.874 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:21.863+0000 7f448c6c8640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f44840c9100 con 0x7f44840ca5a0 2024-04-26T23:42:21.875 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:21.863+0000 7f448c6c8640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f44840c7510 con 0x7f4484154160 2024-04-26T23:42:21.875 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:21.863+0000 7f4489c63640 1 -- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4484154160 msgr2=0x7f448414a880 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.175:3301/0 2024-04-26T23:42:21.875 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:21.863+0000 7f4489c63640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4484154160 0x7f448414a880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:42:21.875 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:21.863+0000 7f448a464640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f44840ca5a0 0x7f4484159520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:21.875 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:21.863+0000 7f448a464640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f44840ca5a0 0x7f4484159520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.88:49976/0 (socket says 172.21.15.88:49976) 2024-04-26T23:42:21.875 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:21.863+0000 7f448a464640 1 -- 172.21.15.88:0/557221227 learned_addr learned my addr 172.21.15.88:0/557221227 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:42:21.875 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:21.863+0000 7f448ac65640 1 --2- 172.21.15.88:0/557221227 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4484156bb0 0x7f448414adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:21.876 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:21.863+0000 7f448a464640 1 -- 172.21.15.88:0/557221227 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4484154160 msgr2=0x7f448414a880 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T23:42:21.876 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:21.863+0000 7f448a464640 1 --2- 172.21.15.88:0/557221227 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4484154160 0x7f448414a880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:21.876 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:21.863+0000 7f448a464640 1 -- 172.21.15.88:0/557221227 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4484156bb0 msgr2=0x7f448414adc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:21.876 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:21.863+0000 7f448a464640 1 --2- 172.21.15.88:0/557221227 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4484156bb0 0x7f448414adc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:21.876 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:21.863+0000 7f448a464640 1 -- 172.21.15.88:0/557221227 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44840c0680 con 0x7f44840ca5a0 2024-04-26T23:42:21.876 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:21.863+0000 7f448ac65640 1 --2- 172.21.15.88:0/557221227 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4484156bb0 0x7f448414adc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:42:21.876 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:21.863+0000 7f448a464640 1 --2- 172.21.15.88:0/557221227 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f44840ca5a0 0x7f4484159520 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f448000c4d0 tx=0x7f448000c990 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:21.876 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:21.864+0000 7f447affd640 1 -- 172.21.15.88:0/557221227 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4480017070 con 0x7f44840ca5a0 2024-04-26T23:42:21.877 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:21.864+0000 7f447affd640 1 -- 172.21.15.88:0/557221227 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f44800052d0 con 0x7f44840ca5a0 2024-04-26T23:42:21.877 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:21.864+0000 7f447affd640 1 -- 172.21.15.88:0/557221227 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4480003830 con 0x7f44840ca5a0 2024-04-26T23:42:21.877 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:21.864+0000 7f448c6c8640 1 -- 172.21.15.88:0/557221227 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44841537f0 con 0x7f44840ca5a0 2024-04-26T23:42:21.877 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:21.864+0000 7f448c6c8640 1 -- 172.21.15.88:0/557221227 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4484151ba0 con 0x7f44840ca5a0 2024-04-26T23:42:21.877 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:21.866+0000 7f448c6c8640 1 -- 172.21.15.88:0/557221227 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f44841539c0 con 0x7f44840ca5a0 2024-04-26T23:42:21.877 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:21.867+0000 7f447affd640 1 -- 172.21.15.88:0/557221227 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f448001a070 con 0x7f44840ca5a0 2024-04-26T23:42:21.877 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:21.867+0000 7f447affd640 1 --2- 172.21.15.88:0/557221227 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f446806c8a0 0x7f446806ed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:21.878 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:21.867+0000 7f447affd640 1 -- 172.21.15.88:0/557221227 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6666+0+0 (secure 0 0 0) 0x7f448008b1a0 con 0x7f44840ca5a0 2024-04-26T23:42:21.878 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:21.867+0000 7f4489c63640 1 --2- 172.21.15.88:0/557221227 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f446806c8a0 0x7f446806ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:21.878 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:21.868+0000 7f4489c63640 1 --2- 172.21.15.88:0/557221227 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f446806c8a0 0x7f446806ed60 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f4474007fd0 tx=0x7f4474001190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:21.880 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:21.876+0000 7f447affd640 1 -- 172.21.15.88:0/557221227 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f44841539c0 con 0x7f44840ca5a0 2024-04-26T23:42:22.379 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:22.375+0000 7f448c6c8640 1 -- 172.21.15.88:0/557221227 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f44841527c0 con 0x7f44840ca5a0 2024-04-26T23:42:22.380 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:22.376+0000 7f447affd640 1 -- 172.21.15.88:0/557221227 <== mon.1 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1565 (secure 0 0 0) 0x7f4480058ba0 con 0x7f44840ca5a0 2024-04-26T23:42:22.380 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":12,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":16,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"555255e9-7ef9-4454-8dc9-35e96b70035c","modified":"2024-04-26T23:39:34.291658Z","created":"2024-04-26T23:39:34.291658Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:3300","nonce":0},{"type":"v1","addr":"172.21.15.175:6789","nonce":0}]},"addr":"172.21.15.175:6789/0","public_addr":"172.21.15.175:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:3301","nonce":0},{"type":"v1","addr":"172.21.15.175:6790","nonce":0}]},"addr":"172.21.15.175:6790/0","public_addr":"172.21.15.175:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-04-26T23:42:22.383 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:22.378+0000 7f448c6c8640 1 -- 172.21.15.88:0/557221227 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f446806c8a0 msgr2=0x7f446806ed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:22.383 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:22.378+0000 7f448c6c8640 1 --2- 172.21.15.88:0/557221227 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f446806c8a0 0x7f446806ed60 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f4474007fd0 tx=0x7f4474001190 comp rx=0 tx=0).stop 2024-04-26T23:42:22.383 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:22.378+0000 7f448c6c8640 1 -- 172.21.15.88:0/557221227 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f44840ca5a0 msgr2=0x7f4484159520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:22.383 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:22.378+0000 7f448c6c8640 1 --2- 172.21.15.88:0/557221227 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f44840ca5a0 0x7f4484159520 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f448000c4d0 tx=0x7f448000c990 comp rx=0 tx=0).stop 2024-04-26T23:42:22.383 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:22.378+0000 7f448c6c8640 1 -- 172.21.15.88:0/557221227 shutdown_connections 2024-04-26T23:42:22.383 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:22.378+0000 7f448c6c8640 1 --2- 172.21.15.88:0/557221227 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f446806c8a0 0x7f446806ed60 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:22.384 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:22.378+0000 7f448c6c8640 1 --2- 172.21.15.88:0/557221227 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4484154160 0x7f448414a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:22.384 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:22.378+0000 7f448c6c8640 1 --2- 172.21.15.88:0/557221227 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4484156bb0 0x7f448414adc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:22.384 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:22.378+0000 7f448c6c8640 1 --2- 172.21.15.88:0/557221227 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f44840ca5a0 0x7f4484159520 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:22.384 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:22.378+0000 7f448c6c8640 1 -- 172.21.15.88:0/557221227 >> 172.21.15.88:0/557221227 conn(0x7f44840ae010 msgr2=0x7f44840c9590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:22.384 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:22.379+0000 7f448c6c8640 1 -- 172.21.15.88:0/557221227 shutdown_connections 2024-04-26T23:42:22.385 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:22.379+0000 7f448c6c8640 1 -- 172.21.15.88:0/557221227 wait complete. 2024-04-26T23:42:25.395 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-04-26T23:42:25.500 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:25.496+0000 7ff9d4d78640 1 Processor -- start 2024-04-26T23:42:25.501 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:25.496+0000 7ff9d4d78640 1 -- start start 2024-04-26T23:42:25.502 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:25.497+0000 7ff9d4d78640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ff9d0154160 0x7ff9d0156bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:25.502 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:25.497+0000 7ff9d4d78640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7ff9d00ca5a0 0x7ff9d015a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:25.502 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:25.497+0000 7ff9d4d78640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff9d00c8df0 con 0x7ff9d00c6e00 2024-04-26T23:42:25.502 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:25.497+0000 7ff9d4d78640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7ff9d015a6e0 con 0x7ff9d0154160 2024-04-26T23:42:25.502 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:25.497+0000 7ff9d4d78640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7ff9d00c9100 con 0x7ff9d00ca5a0 2024-04-26T23:42:25.502 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:25.497+0000 7ff9ced9d640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7ff9d00c6e00 0x7ff9d00c9590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:48118/0 (socket says 172.21.15.88:48118) 2024-04-26T23:42:25.503 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:25.497+0000 7ff9ced9d640 1 -- 172.21.15.88:0/3586850104 learned_addr learned my addr 172.21.15.88:0/3586850104 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-26T23:42:25.503 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:25.498+0000 7ff9cdd9b640 1 --2- 172.21.15.88:0/3586850104 >> v2:172.21.15.175:3300/0 conn(0x7ff9d00ca5a0 0x7ff9d015a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:25.503 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:25.498+0000 7ff9ce59c640 1 --2- 172.21.15.88:0/3586850104 >> v2:172.21.15.88:3300/0 conn(0x7ff9d0154160 0x7ff9d0156bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:25.503 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:25.498+0000 7ff9ce59c640 1 -- 172.21.15.88:0/3586850104 >> v2:172.21.15.175:3300/0 conn(0x7ff9d00ca5a0 msgr2=0x7ff9d015a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:42:25.503 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:25.498+0000 7ff9ce59c640 1 --2- 172.21.15.88:0/3586850104 >> v2:172.21.15.175:3300/0 conn(0x7ff9d00ca5a0 0x7ff9d015a1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:25.503 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:25.498+0000 7ff9ce59c640 1 -- 172.21.15.88:0/3586850104 >> v1:172.21.15.88:6789/0 conn(0x7ff9d00c6e00 legacy=0x7ff9d00c9590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:25.503 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:25.498+0000 7ff9ce59c640 1 -- 172.21.15.88:0/3586850104 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9d0154540 con 0x7ff9d0154160 2024-04-26T23:42:25.504 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:25.499+0000 7ff9ce59c640 1 --2- 172.21.15.88:0/3586850104 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff9d0154160 0x7ff9d0156bb0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7ff9d00c9280 tx=0x7ff9c002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e677f0c27ee2de43 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:25.504 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:25.499+0000 7ff9cd59a640 1 -- 172.21.15.88:0/3586850104 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9c0037070 con 0x7ff9d0154160 2024-04-26T23:42:25.504 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:25.499+0000 7ff9cd59a640 1 -- 172.21.15.88:0/3586850104 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9c0032440 con 0x7ff9d0154160 2024-04-26T23:42:25.505 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:25.499+0000 7ff9cd59a640 1 -- 172.21.15.88:0/3586850104 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9c0037070 con 0x7ff9d0154160 2024-04-26T23:42:25.505 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:25.500+0000 7ff9d4d78640 1 -- 172.21.15.88:0/3586850104 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff9d0154160 msgr2=0x7ff9d0156bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:25.505 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:25.500+0000 7ff9d4d78640 1 --2- 172.21.15.88:0/3586850104 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff9d0154160 0x7ff9d0156bb0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7ff9d00c9280 tx=0x7ff9c002a1a0 comp rx=0 tx=0).stop 2024-04-26T23:42:25.505 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:25.500+0000 7ff9d4d78640 1 -- 172.21.15.88:0/3586850104 shutdown_connections 2024-04-26T23:42:25.505 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:25.500+0000 7ff9d4d78640 1 --2- 172.21.15.88:0/3586850104 >> v2:172.21.15.175:3300/0 conn(0x7ff9d00ca5a0 0x7ff9d015a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:25.505 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:25.500+0000 7ff9d4d78640 1 --2- 172.21.15.88:0/3586850104 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff9d0154160 0x7ff9d0156bb0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:25.505 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:25.500+0000 7ff9d4d78640 1 -- 172.21.15.88:0/3586850104 >> 172.21.15.88:0/3586850104 conn(0x7ff9d00ae010 msgr2=0x7ff9d00ae3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:25.505 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:25.500+0000 7ff9d4d78640 1 -- 172.21.15.88:0/3586850104 shutdown_connections 2024-04-26T23:42:25.505 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:25.500+0000 7ff9d4d78640 1 -- 172.21.15.88:0/3586850104 wait complete. 2024-04-26T23:42:25.506 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:25.502+0000 7ff9d4d78640 1 Processor -- start 2024-04-26T23:42:25.506 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:25.502+0000 7ff9d4d78640 1 -- start start 2024-04-26T23:42:25.508 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:25.503+0000 7ff9d4d78640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff9d00c6e00 0x7ff9d0151c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:25.508 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:25.503+0000 7ff9d4d78640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff9d00ca5a0 0x7ff9d00bf430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:25.508 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:25.503+0000 7ff9d4d78640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff9d0154160 0x7ff9d0159eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:25.509 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:25.503+0000 7ff9cdd9b640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff9d00ca5a0 0x7ff9d00bf430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:25.509 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:25.503+0000 7ff9cdd9b640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff9d00ca5a0 0x7ff9d00bf430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:43412/0 (socket says 172.21.15.88:43412) 2024-04-26T23:42:25.509 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:25.503+0000 7ff9cdd9b640 1 -- 172.21.15.88:0/2596245857 learned_addr learned my addr 172.21.15.88:0/2596245857 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:42:25.509 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:25.503+0000 7ff9ce59c640 1 --2- 172.21.15.88:0/2596245857 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff9d00c6e00 0x7ff9d0151c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:25.509 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:25.503+0000 7ff9d4d78640 1 -- 172.21.15.88:0/2596245857 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7ff9d015aed0 con 0x7ff9d00ca5a0 2024-04-26T23:42:25.509 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:25.503+0000 7ff9d4d78640 1 -- 172.21.15.88:0/2596245857 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff9d015abf0 con 0x7ff9d00c6e00 2024-04-26T23:42:25.509 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:25.503+0000 7ff9d4d78640 1 -- 172.21.15.88:0/2596245857 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7ff9d00c9ca0 con 0x7ff9d0154160 2024-04-26T23:42:25.509 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:25.503+0000 7ff9ced9d640 1 -- 172.21.15.88:0/2596245857 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff9d0154160 msgr2=0x7ff9d0159eb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.175:3301/0 2024-04-26T23:42:25.509 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:25.503+0000 7ff9ced9d640 1 --2- 172.21.15.88:0/2596245857 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff9d0154160 0x7ff9d0159eb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:42:25.509 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:25.504+0000 7ff9ce59c640 1 -- 172.21.15.88:0/2596245857 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff9d0154160 msgr2=0x7ff9d0159eb0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T23:42:25.509 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:25.504+0000 7ff9ce59c640 1 --2- 172.21.15.88:0/2596245857 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff9d0154160 0x7ff9d0159eb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:25.509 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:25.504+0000 7ff9ce59c640 1 -- 172.21.15.88:0/2596245857 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff9d00ca5a0 msgr2=0x7ff9d00bf430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:25.509 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:25.504+0000 7ff9ce59c640 1 --2- 172.21.15.88:0/2596245857 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff9d00ca5a0 0x7ff9d00bf430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:25.509 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:25.504+0000 7ff9ce59c640 1 -- 172.21.15.88:0/2596245857 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9d00c61e0 con 0x7ff9d00c6e00 2024-04-26T23:42:25.509 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:25.504+0000 7ff9cdd9b640 1 --2- 172.21.15.88:0/2596245857 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff9d00ca5a0 0x7ff9d00bf430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:42:25.510 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:25.504+0000 7ff9ce59c640 1 --2- 172.21.15.88:0/2596245857 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff9d00c6e00 0x7ff9d0151c20 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7ff9c0031000 tx=0x7ff9c00046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:25.510 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:25.504+0000 7ff9beffd640 1 -- 172.21.15.88:0/2596245857 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9c0037040 con 0x7ff9d00c6e00 2024-04-26T23:42:25.510 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:25.504+0000 7ff9beffd640 1 -- 172.21.15.88:0/2596245857 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9c0003d40 con 0x7ff9d00c6e00 2024-04-26T23:42:25.510 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:25.504+0000 7ff9d4d78640 1 -- 172.21.15.88:0/2596245857 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9d0158c60 con 0x7ff9d00c6e00 2024-04-26T23:42:25.510 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:25.504+0000 7ff9d4d78640 1 -- 172.21.15.88:0/2596245857 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9d015a3f0 con 0x7ff9d00c6e00 2024-04-26T23:42:25.511 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:25.504+0000 7ff9beffd640 1 -- 172.21.15.88:0/2596245857 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9c0006e10 con 0x7ff9d00c6e00 2024-04-26T23:42:25.511 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:25.505+0000 7ff9d4d78640 1 -- 172.21.15.88:0/2596245857 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff9b4005290 con 0x7ff9d00c6e00 2024-04-26T23:42:25.511 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:25.507+0000 7ff9beffd640 1 -- 172.21.15.88:0/2596245857 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff9c0044020 con 0x7ff9d00c6e00 2024-04-26T23:42:25.511 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:25.507+0000 7ff9beffd640 1 --2- 172.21.15.88:0/2596245857 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7ff9b006c8a0 0x7ff9b006ed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:25.511 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:25.507+0000 7ff9beffd640 1 -- 172.21.15.88:0/2596245857 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6666+0+0 (secure 0 0 0) 0x7ff9c00ac340 con 0x7ff9d00c6e00 2024-04-26T23:42:25.511 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:25.507+0000 7ff9cdd9b640 1 --2- 172.21.15.88:0/2596245857 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7ff9b006c8a0 0x7ff9b006ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:25.511 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:25.507+0000 7ff9cdd9b640 1 --2- 172.21.15.88:0/2596245857 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7ff9b006c8a0 0x7ff9b006ed60 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7ff9d014e540 tx=0x7ff9c4009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:25.518 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:25.515+0000 7ff9beffd640 1 -- 172.21.15.88:0/2596245857 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7ff9c007a5b0 con 0x7ff9d00c6e00 2024-04-26T23:42:25.915 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:25.911+0000 7ff9d4d78640 1 -- 172.21.15.88:0/2596245857 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7ff9b4005580 con 0x7ff9d00c6e00 2024-04-26T23:42:25.915 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:25.911+0000 7ff9beffd640 1 -- 172.21.15.88:0/2596245857 <== mon.1 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1565 (secure 0 0 0) 0x7ff9c0079eb0 con 0x7ff9d00c6e00 2024-04-26T23:42:25.915 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":12,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":19,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"555255e9-7ef9-4454-8dc9-35e96b70035c","modified":"2024-04-26T23:39:34.291658Z","created":"2024-04-26T23:39:34.291658Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:3300","nonce":0},{"type":"v1","addr":"172.21.15.175:6789","nonce":0}]},"addr":"172.21.15.175:6789/0","public_addr":"172.21.15.175:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:3301","nonce":0},{"type":"v1","addr":"172.21.15.175:6790","nonce":0}]},"addr":"172.21.15.175:6790/0","public_addr":"172.21.15.175:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-04-26T23:42:25.919 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:25.914+0000 7ff9d4d78640 1 -- 172.21.15.88:0/2596245857 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7ff9b006c8a0 msgr2=0x7ff9b006ed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:25.919 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:25.914+0000 7ff9d4d78640 1 --2- 172.21.15.88:0/2596245857 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7ff9b006c8a0 0x7ff9b006ed60 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7ff9d014e540 tx=0x7ff9c4009190 comp rx=0 tx=0).stop 2024-04-26T23:42:25.919 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:25.914+0000 7ff9d4d78640 1 -- 172.21.15.88:0/2596245857 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff9d00c6e00 msgr2=0x7ff9d0151c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:25.919 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:25.914+0000 7ff9d4d78640 1 --2- 172.21.15.88:0/2596245857 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff9d00c6e00 0x7ff9d0151c20 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7ff9c0031000 tx=0x7ff9c00046c0 comp rx=0 tx=0).stop 2024-04-26T23:42:25.919 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:25.914+0000 7ff9d4d78640 1 -- 172.21.15.88:0/2596245857 shutdown_connections 2024-04-26T23:42:25.919 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:25.914+0000 7ff9d4d78640 1 --2- 172.21.15.88:0/2596245857 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7ff9b006c8a0 0x7ff9b006ed60 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:25.919 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:25.914+0000 7ff9d4d78640 1 --2- 172.21.15.88:0/2596245857 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff9d0154160 0x7ff9d0159eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:25.919 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:25.914+0000 7ff9d4d78640 1 --2- 172.21.15.88:0/2596245857 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff9d00ca5a0 0x7ff9d00bf430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:25.919 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:25.914+0000 7ff9d4d78640 1 --2- 172.21.15.88:0/2596245857 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff9d00c6e00 0x7ff9d0151c20 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:25.919 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:25.914+0000 7ff9d4d78640 1 -- 172.21.15.88:0/2596245857 >> 172.21.15.88:0/2596245857 conn(0x7ff9d00ae010 msgr2=0x7ff9d014e620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:25.919 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:25.914+0000 7ff9d4d78640 1 -- 172.21.15.88:0/2596245857 shutdown_connections 2024-04-26T23:42:25.919 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:25.914+0000 7ff9d4d78640 1 -- 172.21.15.88:0/2596245857 wait complete. 2024-04-26T23:42:28.933 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-04-26T23:42:29.038 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:29.034+0000 7fb20e338640 1 Processor -- start 2024-04-26T23:42:29.038 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:29.034+0000 7fb20e338640 1 -- start start 2024-04-26T23:42:29.039 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:29.035+0000 7fb20e338640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb208154160 0x7fb208156bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:29.039 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:29.035+0000 7fb20e338640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb2080c8df0 con 0x7fb20815a1a0 2024-04-26T23:42:29.039 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:29.035+0000 7fb20e338640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb208154540 con 0x7fb2080ca5a0 2024-04-26T23:42:29.039 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:29.035+0000 7fb20e338640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fb2080c9100 con 0x7fb208154160 2024-04-26T23:42:29.039 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:29.035+0000 7fb20c8d5640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fb20815a1a0 0x7fb2080c9590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:34604/0 (socket says 172.21.15.88:34604) 2024-04-26T23:42:29.039 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:29.035+0000 7fb20c8d5640 1 -- 172.21.15.88:0/3533724082 learned_addr learned my addr 172.21.15.88:0/3533724082 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-26T23:42:29.040 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:29.035+0000 7fb207fff640 1 -- 172.21.15.88:0/3533724082 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb208154160 msgr2=0x7fb208156bb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.175:3301/0 2024-04-26T23:42:29.040 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:29.035+0000 7fb207fff640 1 --2- 172.21.15.88:0/3533724082 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb208154160 0x7fb208156bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:42:29.240 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:29.236+0000 7fb207fff640 1 -- 172.21.15.88:0/3533724082 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb208154160 msgr2=0x7fb208156bb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.175:3301/0 2024-04-26T23:42:29.240 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:29.236+0000 7fb207fff640 1 --2- 172.21.15.88:0/3533724082 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb208154160 0x7fb208156bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-26T23:42:29.641 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:29.637+0000 7fb207fff640 1 -- 172.21.15.88:0/3533724082 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb208154160 msgr2=0x7fb208156bb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.175:3301/0 2024-04-26T23:42:29.641 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:29.637+0000 7fb207fff640 1 --2- 172.21.15.88:0/3533724082 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb208154160 0x7fb208156bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-26T23:42:30.442 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:30.438+0000 7fb207fff640 1 -- 172.21.15.88:0/3533724082 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb208154160 msgr2=0x7fb208156bb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.175:3301/0 2024-04-26T23:42:30.442 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:30.438+0000 7fb207fff640 1 --2- 172.21.15.88:0/3533724082 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb208154160 0x7fb208156bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-26T23:42:32.040 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:32.035+0000 7fb205ffb640 1 -- 172.21.15.88:0/3533724082 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb208154160 msgr2=0x7fb208156bb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T23:42:32.040 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:32.035+0000 7fb205ffb640 1 --2- 172.21.15.88:0/3533724082 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb208154160 0x7fb208156bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:32.040 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:32.035+0000 7fb205ffb640 1 -- 172.21.15.88:0/3533724082 >> v1:172.21.15.175:6789/0 conn(0x7fb2080ca5a0 legacy=0x7fb2080c6e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:32.040 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:32.035+0000 7fb205ffb640 1 -- 172.21.15.88:0/3533724082 >> v1:172.21.15.88:6789/0 conn(0x7fb20815a1a0 legacy=0x7fb2080c9590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:32.040 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:32.035+0000 7fb205ffb640 1 --2- 172.21.15.88:0/3533724082 >> v2:172.21.15.175:3300/0 conn(0x7fb1f40036d0 0x7fb1f4005b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:32.040 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:32.035+0000 7fb205ffb640 1 --2- 172.21.15.88:0/3533724082 >> v2:172.21.15.88:3300/0 conn(0x7fb1f40061a0 0x7fb1f4008660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:32.040 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:32.035+0000 7fb205ffb640 1 -- 172.21.15.88:0/3533724082 --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7fb2080c9100 con 0x7fb1f40061a0 2024-04-26T23:42:32.040 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:32.035+0000 7fb205ffb640 1 -- 172.21.15.88:0/3533724082 --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7fb1f4008d10 con 0x7fb1f40036d0 2024-04-26T23:42:32.040 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:32.035+0000 7fb2077fe640 1 --2- 172.21.15.88:0/3533724082 >> v2:172.21.15.88:3300/0 conn(0x7fb1f40061a0 0x7fb1f4008660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:32.040 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:32.035+0000 7fb2077fe640 1 -- 172.21.15.88:0/3533724082 >> v2:172.21.15.88:3300/0 conn(0x7fb1f40061a0 msgr2=0x7fb1f4008660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-26T23:42:32.040 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:32.035+0000 7fb2077fe640 1 -- 172.21.15.88:0/3533724082 >> v2:172.21.15.88:3300/0 conn(0x7fb1f40061a0 msgr2=0x7fb1f4008660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T23:42:32.040 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:32.035+0000 7fb2077fe640 1 --2- 172.21.15.88:0/3533724082 >> v2:172.21.15.88:3300/0 conn(0x7fb1f40061a0 0x7fb1f4008660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:42:32.040 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:32.035+0000 7fb2077fe640 1 --2- 172.21.15.88:0/3533724082 >> v2:172.21.15.88:3300/0 conn(0x7fb1f40061a0 0x7fb1f4008660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:42:32.041 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:32.035+0000 7fb207fff640 1 --2- 172.21.15.88:0/3533724082 >> v2:172.21.15.175:3300/0 conn(0x7fb1f40036d0 0x7fb1f4005b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:32.041 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:32.035+0000 7fb207fff640 1 -- 172.21.15.88:0/3533724082 >> v2:172.21.15.175:3300/0 conn(0x7fb1f40036d0 msgr2=0x7fb1f4005b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-26T23:42:32.041 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:32.035+0000 7fb207fff640 1 -- 172.21.15.88:0/3533724082 >> v2:172.21.15.175:3300/0 conn(0x7fb1f40036d0 msgr2=0x7fb1f4005b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T23:42:32.041 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:32.036+0000 7fb207fff640 1 --2- 172.21.15.88:0/3533724082 >> v2:172.21.15.175:3300/0 conn(0x7fb1f40036d0 0x7fb1f4005b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:42:32.041 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:32.036+0000 7fb207fff640 1 --2- 172.21.15.88:0/3533724082 >> v2:172.21.15.175:3300/0 conn(0x7fb1f40036d0 0x7fb1f4005b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:42:32.240 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:32.236+0000 7fb2077fe640 1 --2- 172.21.15.88:0/3533724082 >> v2:172.21.15.88:3300/0 conn(0x7fb1f40061a0 0x7fb1f4008660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:32.240 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:32.236+0000 7fb2077fe640 1 -- 172.21.15.88:0/3533724082 >> v2:172.21.15.88:3300/0 conn(0x7fb1f40061a0 msgr2=0x7fb1f4008660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-26T23:42:32.240 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:32.236+0000 7fb2077fe640 1 -- 172.21.15.88:0/3533724082 >> v2:172.21.15.88:3300/0 conn(0x7fb1f40061a0 msgr2=0x7fb1f4008660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T23:42:32.240 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:32.236+0000 7fb2077fe640 1 --2- 172.21.15.88:0/3533724082 >> v2:172.21.15.88:3300/0 conn(0x7fb1f40061a0 0x7fb1f4008660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:42:32.240 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:32.236+0000 7fb2077fe640 1 --2- 172.21.15.88:0/3533724082 >> v2:172.21.15.88:3300/0 conn(0x7fb1f40061a0 0x7fb1f4008660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-26T23:42:32.241 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:32.237+0000 7fb207fff640 1 --2- 172.21.15.88:0/3533724082 >> v2:172.21.15.175:3300/0 conn(0x7fb1f40036d0 0x7fb1f4005b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:32.241 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:32.237+0000 7fb207fff640 1 -- 172.21.15.88:0/3533724082 >> v2:172.21.15.175:3300/0 conn(0x7fb1f40036d0 msgr2=0x7fb1f4005b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-26T23:42:32.241 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:32.237+0000 7fb207fff640 1 -- 172.21.15.88:0/3533724082 >> v2:172.21.15.175:3300/0 conn(0x7fb1f40036d0 msgr2=0x7fb1f4005b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T23:42:32.241 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:32.237+0000 7fb207fff640 1 --2- 172.21.15.88:0/3533724082 >> v2:172.21.15.175:3300/0 conn(0x7fb1f40036d0 0x7fb1f4005b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:42:32.241 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:32.237+0000 7fb207fff640 1 --2- 172.21.15.88:0/3533724082 >> v2:172.21.15.175:3300/0 conn(0x7fb1f40036d0 0x7fb1f4005b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-26T23:42:32.641 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:32.637+0000 7fb2077fe640 1 --2- 172.21.15.88:0/3533724082 >> v2:172.21.15.88:3300/0 conn(0x7fb1f40061a0 0x7fb1f4008660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:32.641 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:32.637+0000 7fb2077fe640 1 -- 172.21.15.88:0/3533724082 >> v2:172.21.15.88:3300/0 conn(0x7fb1f40061a0 msgr2=0x7fb1f4008660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-26T23:42:32.641 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:32.637+0000 7fb2077fe640 1 -- 172.21.15.88:0/3533724082 >> v2:172.21.15.88:3300/0 conn(0x7fb1f40061a0 msgr2=0x7fb1f4008660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T23:42:32.641 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:32.637+0000 7fb2077fe640 1 --2- 172.21.15.88:0/3533724082 >> v2:172.21.15.88:3300/0 conn(0x7fb1f40061a0 0x7fb1f4008660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:42:32.641 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:32.637+0000 7fb2077fe640 1 --2- 172.21.15.88:0/3533724082 >> v2:172.21.15.88:3300/0 conn(0x7fb1f40061a0 0x7fb1f4008660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-26T23:42:32.642 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:32.638+0000 7fb207fff640 1 --2- 172.21.15.88:0/3533724082 >> v2:172.21.15.175:3300/0 conn(0x7fb1f40036d0 0x7fb1f4005b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:32.642 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:32.638+0000 7fb207fff640 1 -- 172.21.15.88:0/3533724082 >> v2:172.21.15.175:3300/0 conn(0x7fb1f40036d0 msgr2=0x7fb1f4005b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-26T23:42:32.642 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:32.638+0000 7fb207fff640 1 -- 172.21.15.88:0/3533724082 >> v2:172.21.15.175:3300/0 conn(0x7fb1f40036d0 msgr2=0x7fb1f4005b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T23:42:32.642 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:32.638+0000 7fb207fff640 1 --2- 172.21.15.88:0/3533724082 >> v2:172.21.15.175:3300/0 conn(0x7fb1f40036d0 0x7fb1f4005b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:42:32.642 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:32.638+0000 7fb207fff640 1 --2- 172.21.15.88:0/3533724082 >> v2:172.21.15.175:3300/0 conn(0x7fb1f40036d0 0x7fb1f4005b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-26T23:42:32.951 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:42:32.955 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:42:33.442 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:33.438+0000 7fb2077fe640 1 --2- 172.21.15.88:0/3533724082 >> v2:172.21.15.88:3300/0 conn(0x7fb1f40061a0 0x7fb1f4008660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:33.442 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:33.438+0000 7fb2077fe640 1 -- 172.21.15.88:0/3533724082 >> v2:172.21.15.175:3300/0 conn(0x7fb1f40036d0 msgr2=0x7fb1f4005b50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T23:42:33.442 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:33.438+0000 7fb2077fe640 1 --2- 172.21.15.88:0/3533724082 >> v2:172.21.15.175:3300/0 conn(0x7fb1f40036d0 0x7fb1f4005b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:33.442 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:33.438+0000 7fb2077fe640 1 -- 172.21.15.88:0/3533724082 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb20815a910 con 0x7fb1f40061a0 2024-04-26T23:42:33.443 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:33.439+0000 7fb2077fe640 1 --2- 172.21.15.88:0/3533724082 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb1f40061a0 0x7fb1f4008660 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fb1f4003680 tx=0x7fb1fc02a7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a027c383248d3e56 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:33.443 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:33.439+0000 7fb206ffd640 1 -- 172.21.15.88:0/3533724082 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1fc036070 con 0x7fb1f40061a0 2024-04-26T23:42:33.443 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:33.439+0000 7fb206ffd640 1 -- 172.21.15.88:0/3533724082 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1fc0053a0 con 0x7fb1f40061a0 2024-04-26T23:42:33.444 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:33.440+0000 7fb20e338640 1 -- 172.21.15.88:0/3533724082 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb1f40061a0 msgr2=0x7fb1f4008660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:33.444 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:33.440+0000 7fb20e338640 1 --2- 172.21.15.88:0/3533724082 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb1f40061a0 0x7fb1f4008660 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fb1f4003680 tx=0x7fb1fc02a7b0 comp rx=0 tx=0).stop 2024-04-26T23:42:33.444 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:33.440+0000 7fb20c8d5640 1 -- 172.21.15.88:0/3533724082 reap_dead start 2024-04-26T23:42:33.445 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:33.440+0000 7fb20e338640 1 -- 172.21.15.88:0/3533724082 shutdown_connections 2024-04-26T23:42:33.445 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:33.440+0000 7fb20e338640 1 --2- 172.21.15.88:0/3533724082 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb1f40061a0 0x7fb1f4008660 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:33.445 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:33.440+0000 7fb20e338640 1 -- 172.21.15.88:0/3533724082 >> 172.21.15.88:0/3533724082 conn(0x7fb2080ae010 msgr2=0x7fb2080ae3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:33.445 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:33.440+0000 7fb20e338640 1 -- 172.21.15.88:0/3533724082 shutdown_connections 2024-04-26T23:42:33.445 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:33.440+0000 7fb20e338640 1 -- 172.21.15.88:0/3533724082 wait complete. 2024-04-26T23:42:33.446 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:33.442+0000 7fb20e338640 1 Processor -- start 2024-04-26T23:42:33.446 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:33.442+0000 7fb20e338640 1 -- start start 2024-04-26T23:42:33.450 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:33.443+0000 7fb20e338640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb1f40061a0 0x7fb2080c6130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:33.450 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:33.443+0000 7fb20e338640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb208151fe0 0x7fb2080cabf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:33.450 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:33.443+0000 7fb20e338640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb2080cb130 0x7fb2081f0380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:33.450 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:33.444+0000 7fb20e338640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fb20815a630 con 0x7fb1f40061a0 2024-04-26T23:42:33.450 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:33.444+0000 7fb20e338640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fb20815aed0 con 0x7fb2080cb130 2024-04-26T23:42:33.451 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:33.444+0000 7fb20e338640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fb2080c7510 con 0x7fb208151fe0 2024-04-26T23:42:33.451 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:33.444+0000 7fb207fff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb1f40061a0 0x7fb2080c6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:33.451 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:33.444+0000 7fb207fff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb1f40061a0 0x7fb2080c6130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:33776/0 (socket says 172.21.15.88:33776) 2024-04-26T23:42:33.451 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:33.444+0000 7fb2077fe640 1 -- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb208151fe0 msgr2=0x7fb2080cabf0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.175:3301/0 2024-04-26T23:42:33.451 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:33.444+0000 7fb207fff640 1 -- 172.21.15.88:0/464499592 learned_addr learned my addr 172.21.15.88:0/464499592 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:42:33.451 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:33.444+0000 7fb2077fe640 1 --2- 172.21.15.88:0/464499592 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb208151fe0 0x7fb2080cabf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:42:33.451 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:33.444+0000 7fb20c8d5640 1 --2- 172.21.15.88:0/464499592 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb2080cb130 0x7fb2081f0380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:33.451 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:33.444+0000 7fb207fff640 1 -- 172.21.15.88:0/464499592 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb208151fe0 msgr2=0x7fb2080cabf0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T23:42:33.451 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:33.444+0000 7fb207fff640 1 --2- 172.21.15.88:0/464499592 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb208151fe0 0x7fb2080cabf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:33.451 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:33.444+0000 7fb207fff640 1 -- 172.21.15.88:0/464499592 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb2080cb130 msgr2=0x7fb2081f0380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:33.451 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:33.444+0000 7fb207fff640 1 --2- 172.21.15.88:0/464499592 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb2080cb130 0x7fb2081f0380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:33.451 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:33.444+0000 7fb207fff640 1 -- 172.21.15.88:0/464499592 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb20814be00 con 0x7fb1f40061a0 2024-04-26T23:42:33.451 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:33.444+0000 7fb20c8d5640 1 --2- 172.21.15.88:0/464499592 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb2080cb130 0x7fb2081f0380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:42:33.451 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:33.444+0000 7fb207fff640 1 --2- 172.21.15.88:0/464499592 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb1f40061a0 0x7fb2080c6130 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fb1f800bb30 tx=0x7fb1f80050b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:33.452 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:33.444+0000 7fb204ff9640 1 -- 172.21.15.88:0/464499592 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1f8016410 con 0x7fb1f40061a0 2024-04-26T23:42:33.452 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:33.444+0000 7fb204ff9640 1 -- 172.21.15.88:0/464499592 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1f801b070 con 0x7fb1f40061a0 2024-04-26T23:42:33.452 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:33.444+0000 7fb20e338640 1 -- 172.21.15.88:0/464499592 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb208158280 con 0x7fb1f40061a0 2024-04-26T23:42:33.452 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:33.444+0000 7fb204ff9640 1 -- 172.21.15.88:0/464499592 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1f8016850 con 0x7fb1f40061a0 2024-04-26T23:42:33.452 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:33.445+0000 7fb20e338640 1 -- 172.21.15.88:0/464499592 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb208158840 con 0x7fb1f40061a0 2024-04-26T23:42:33.452 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:33.446+0000 7fb20e338640 1 -- 172.21.15.88:0/464499592 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb2080c7b00 con 0x7fb1f40061a0 2024-04-26T23:42:33.453 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:33.447+0000 7fb204ff9640 1 -- 172.21.15.88:0/464499592 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb1f80169f0 con 0x7fb1f40061a0 2024-04-26T23:42:33.453 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:33.448+0000 7fb204ff9640 1 --2- 172.21.15.88:0/464499592 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fb1f406d650 0x7fb1f406fb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:33.453 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:33.448+0000 7fb204ff9640 1 -- 172.21.15.88:0/464499592 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6666+0+0 (secure 0 0 0) 0x7fb1f808cbf0 con 0x7fb1f40061a0 2024-04-26T23:42:33.453 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:33.448+0000 7fb2077fe640 1 --2- 172.21.15.88:0/464499592 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fb1f406d650 0x7fb1f406fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:33.453 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:33.448+0000 7fb2077fe640 1 --2- 172.21.15.88:0/464499592 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fb1f406d650 0x7fb1f406fb10 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fb1f4006170 tx=0x7fb1fc011040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:33.460 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:33.456+0000 7fb204ff9640 1 -- 172.21.15.88:0/464499592 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fb2080c7b00 con 0x7fb1f40061a0 2024-04-26T23:42:33.965 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:33.961+0000 7fb20e338640 1 -- 172.21.15.88:0/464499592 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fb208076650 con 0x7fb1f40061a0 2024-04-26T23:42:33.965 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:33.961+0000 7fb204ff9640 1 -- 172.21.15.88:0/464499592 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1558 (secure 0 0 0) 0x7fb20814be00 con 0x7fb1f40061a0 2024-04-26T23:42:33.965 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":16,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"555255e9-7ef9-4454-8dc9-35e96b70035c","modified":"2024-04-26T23:39:34.291658Z","created":"2024-04-26T23:39:34.291658Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:3300","nonce":0},{"type":"v1","addr":"172.21.15.175:6789","nonce":0}]},"addr":"172.21.15.175:6789/0","public_addr":"172.21.15.175:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:3301","nonce":0},{"type":"v1","addr":"172.21.15.175:6790","nonce":0}]},"addr":"172.21.15.175:6790/0","public_addr":"172.21.15.175:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-04-26T23:42:33.968 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:33.964+0000 7fb20e338640 1 -- 172.21.15.88:0/464499592 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fb1f406d650 msgr2=0x7fb1f406fb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:33.968 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:33.964+0000 7fb20e338640 1 --2- 172.21.15.88:0/464499592 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fb1f406d650 0x7fb1f406fb10 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fb1f4006170 tx=0x7fb1fc011040 comp rx=0 tx=0).stop 2024-04-26T23:42:33.968 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:33.964+0000 7fb20e338640 1 -- 172.21.15.88:0/464499592 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb1f40061a0 msgr2=0x7fb2080c6130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:33.969 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:33.964+0000 7fb20e338640 1 --2- 172.21.15.88:0/464499592 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb1f40061a0 0x7fb2080c6130 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fb1f800bb30 tx=0x7fb1f80050b0 comp rx=0 tx=0).stop 2024-04-26T23:42:33.969 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:33.964+0000 7fb20e338640 1 -- 172.21.15.88:0/464499592 shutdown_connections 2024-04-26T23:42:33.969 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:33.964+0000 7fb20e338640 1 --2- 172.21.15.88:0/464499592 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fb1f406d650 0x7fb1f406fb10 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:33.969 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:33.964+0000 7fb20e338640 1 --2- 172.21.15.88:0/464499592 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb208151fe0 0x7fb2080cabf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:33.969 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:33.964+0000 7fb20e338640 1 --2- 172.21.15.88:0/464499592 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb2080cb130 0x7fb2081f0380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:33.969 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:33.964+0000 7fb20e338640 1 --2- 172.21.15.88:0/464499592 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb1f40061a0 0x7fb2080c6130 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:33.969 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:33.964+0000 7fb20e338640 1 -- 172.21.15.88:0/464499592 >> 172.21.15.88:0/464499592 conn(0x7fb2080ae010 msgr2=0x7fb208157130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:33.969 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:33.964+0000 7fb20e338640 1 -- 172.21.15.88:0/464499592 shutdown_connections 2024-04-26T23:42:33.969 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:33.964+0000 7fb20e338640 1 -- 172.21.15.88:0/464499592 wait complete. 2024-04-26T23:42:33.983 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2024-04-26T23:42:33.983 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon a 2024-04-26T23:42:33.983 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-04-26T23:42:34.136 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:34.132+0000 7f7f4082a640 1 Processor -- start 2024-04-26T23:42:34.136 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:34.132+0000 7f7f4082a640 1 -- start start 2024-04-26T23:42:34.138 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:34.133+0000 7f7f4082a640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7f3c154160 0x7f7f3c156bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:34.138 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:34.133+0000 7f7f4082a640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f7f3c0ca5a0 0x7f7f3c15a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:34.138 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:34.133+0000 7f7f4082a640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7f3c0c8df0 con 0x7f7f3c0c6e00 2024-04-26T23:42:34.138 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:34.133+0000 7f7f4082a640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f7f3c15a6e0 con 0x7f7f3c0ca5a0 2024-04-26T23:42:34.138 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:34.133+0000 7f7f4082a640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f7f3c0c9100 con 0x7f7f3c154160 2024-04-26T23:42:34.138 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:34.133+0000 7f7f3a59c640 1 -- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7f3c154160 msgr2=0x7f7f3c156bb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.175:3301/0 2024-04-26T23:42:34.138 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:34.133+0000 7f7f3a59c640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7f3c154160 0x7f7f3c156bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:42:34.138 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:34.134+0000 7f7f33fff640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f7f3c0ca5a0 0x7f7f3c15a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:34.138 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:34.134+0000 7f7f3ad9d640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f7f3c0c6e00 0x7f7f3c0c9590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.88:47058/0 (socket says 172.21.15.88:47058) 2024-04-26T23:42:34.138 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:34.134+0000 7f7f3ad9d640 1 -- 172.21.15.88:0/3124947449 learned_addr learned my addr 172.21.15.88:0/3124947449 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-26T23:42:34.139 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:34.134+0000 7f7f33fff640 1 -- 172.21.15.88:0/3124947449 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7f3c154160 msgr2=0x7f7f3c156bb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T23:42:34.139 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:34.134+0000 7f7f33fff640 1 --2- 172.21.15.88:0/3124947449 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7f3c154160 0x7f7f3c156bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:34.139 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:34.134+0000 7f7f33fff640 1 -- 172.21.15.88:0/3124947449 >> v1:172.21.15.175:6789/0 conn(0x7f7f3c0c6e00 legacy=0x7f7f3c0c9590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:34.139 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:34.134+0000 7f7f33fff640 1 -- 172.21.15.88:0/3124947449 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f3c154540 con 0x7f7f3c0ca5a0 2024-04-26T23:42:34.139 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:34.135+0000 7f7f33fff640 1 --2- 172.21.15.88:0/3124947449 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7f3c0ca5a0 0x7f7f3c15a1a0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f7f240097a0 tx=0x7f7f2402a1a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=58abfd462453ab6f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:34.140 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:34.135+0000 7f7f39d9b640 1 -- 172.21.15.88:0/3124947449 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f24037070 con 0x7f7f3c0ca5a0 2024-04-26T23:42:34.140 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:34.135+0000 7f7f39d9b640 1 -- 172.21.15.88:0/3124947449 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f24032440 con 0x7f7f3c0ca5a0 2024-04-26T23:42:34.140 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:34.135+0000 7f7f39d9b640 1 -- 172.21.15.88:0/3124947449 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f24032810 con 0x7f7f3c0ca5a0 2024-04-26T23:42:34.140 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:34.136+0000 7f7f4082a640 1 -- 172.21.15.88:0/3124947449 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7f3c0ca5a0 msgr2=0x7f7f3c15a1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:34.141 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:34.136+0000 7f7f4082a640 1 --2- 172.21.15.88:0/3124947449 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7f3c0ca5a0 0x7f7f3c15a1a0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f7f240097a0 tx=0x7f7f2402a1a0 comp rx=0 tx=0).stop 2024-04-26T23:42:34.141 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:34.136+0000 7f7f4082a640 1 -- 172.21.15.88:0/3124947449 shutdown_connections 2024-04-26T23:42:34.141 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:34.136+0000 7f7f4082a640 1 --2- 172.21.15.88:0/3124947449 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7f3c0ca5a0 0x7f7f3c15a1a0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:34.141 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:34.136+0000 7f7f4082a640 1 --2- 172.21.15.88:0/3124947449 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7f3c154160 0x7f7f3c156bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:34.141 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:34.136+0000 7f7f4082a640 1 -- 172.21.15.88:0/3124947449 >> 172.21.15.88:0/3124947449 conn(0x7f7f3c0ae010 msgr2=0x7f7f3c0ae3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:34.141 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:34.136+0000 7f7f4082a640 1 -- 172.21.15.88:0/3124947449 shutdown_connections 2024-04-26T23:42:34.141 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:34.136+0000 7f7f4082a640 1 -- 172.21.15.88:0/3124947449 wait complete. 2024-04-26T23:42:34.142 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:34.138+0000 7f7f4082a640 1 Processor -- start 2024-04-26T23:42:34.142 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:34.138+0000 7f7f4082a640 1 -- start start 2024-04-26T23:42:34.145 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:34.139+0000 7f7f4082a640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7f3c0c6e00 0x7f7f3c14bed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:34.145 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:34.139+0000 7f7f4082a640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7f3c0ca5a0 0x7f7f3c1f0050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:34.145 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:34.139+0000 7f7f4082a640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7f3c154160 0x7f7f3c1f0590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:34.145 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:34.139+0000 7f7f33fff640 1 -- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7f3c0ca5a0 msgr2=0x7f7f3c1f0050 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.175:3301/0 2024-04-26T23:42:34.145 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:34.139+0000 7f7f33fff640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7f3c0ca5a0 0x7f7f3c1f0050 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:42:34.145 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:34.139+0000 7f7f4082a640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f7f3c15aed0 con 0x7f7f3c0c6e00 2024-04-26T23:42:34.145 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:34.139+0000 7f7f4082a640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f7f3c15abf0 con 0x7f7f3c154160 2024-04-26T23:42:34.146 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:34.139+0000 7f7f4082a640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f7f3c0c9ca0 con 0x7f7f3c0ca5a0 2024-04-26T23:42:34.146 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:34.139+0000 7f7f3ad9d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7f3c154160 0x7f7f3c1f0590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:34.146 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:34.139+0000 7f7f3a59c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7f3c0c6e00 0x7f7f3c14bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:34.146 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:34.139+0000 7f7f3ad9d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7f3c154160 0x7f7f3c1f0590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.88:35536/0 (socket says 172.21.15.88:35536) 2024-04-26T23:42:34.146 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:34.139+0000 7f7f3ad9d640 1 -- 172.21.15.88:0/1669402682 learned_addr learned my addr 172.21.15.88:0/1669402682 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:42:34.146 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:34.140+0000 7f7f3ad9d640 1 -- 172.21.15.88:0/1669402682 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7f3c0ca5a0 msgr2=0x7f7f3c1f0050 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T23:42:34.146 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:34.140+0000 7f7f3ad9d640 1 --2- 172.21.15.88:0/1669402682 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7f3c0ca5a0 0x7f7f3c1f0050 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:34.146 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:34.140+0000 7f7f3ad9d640 1 -- 172.21.15.88:0/1669402682 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7f3c0c6e00 msgr2=0x7f7f3c14bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:34.146 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:34.140+0000 7f7f3ad9d640 1 --2- 172.21.15.88:0/1669402682 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7f3c0c6e00 0x7f7f3c14bed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:34.146 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:34.140+0000 7f7f3ad9d640 1 -- 172.21.15.88:0/1669402682 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f3c1efb50 con 0x7f7f3c154160 2024-04-26T23:42:34.146 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:34.140+0000 7f7f3ad9d640 1 --2- 172.21.15.88:0/1669402682 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7f3c154160 0x7f7f3c1f0590 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f7f3400cbf0 tx=0x7f7f3400a430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:34.146 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:34.140+0000 7f7f32ffd640 1 -- 172.21.15.88:0/1669402682 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f34017070 con 0x7f7f3c154160 2024-04-26T23:42:34.146 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:34.140+0000 7f7f32ffd640 1 -- 172.21.15.88:0/1669402682 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f3400ad40 con 0x7f7f3c154160 2024-04-26T23:42:34.146 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:34.140+0000 7f7f4082a640 1 -- 172.21.15.88:0/1669402682 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f3c1485e0 con 0x7f7f3c154160 2024-04-26T23:42:34.147 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:34.141+0000 7f7f32ffd640 1 -- 172.21.15.88:0/1669402682 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f34012600 con 0x7f7f3c154160 2024-04-26T23:42:34.147 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:34.141+0000 7f7f4082a640 1 -- 172.21.15.88:0/1669402682 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f3c14c410 con 0x7f7f3c154160 2024-04-26T23:42:34.148 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:34.142+0000 7f7f4082a640 1 --2- 172.21.15.88:0/1669402682 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7f3c148d50 0x7f7f3c149130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:34.149 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:34.142+0000 7f7f4082a640 1 -- 172.21.15.88:0/1669402682 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f7f3c1efd20 con 0x7f7f3c148d50 2024-04-26T23:42:34.149 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:34.142+0000 7f7f3a59c640 1 --2- 172.21.15.88:0/1669402682 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7f3c148d50 0x7f7f3c149130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:34.149 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:34.142+0000 7f7f32ffd640 1 -- 172.21.15.88:0/1669402682 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f7f3401a070 con 0x7f7f3c154160 2024-04-26T23:42:34.149 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:34.142+0000 7f7f3a59c640 1 -- 172.21.15.88:0/1669402682 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7f3c076650 con 0x7f7f3c148d50 2024-04-26T23:42:34.149 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:34.143+0000 7f7f32ffd640 1 --2- 172.21.15.88:0/1669402682 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f7f1c06c8a0 0x7f7f1c06ed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:34.149 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:34.143+0000 7f7f32ffd640 1 -- 172.21.15.88:0/1669402682 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6666+0+0 (secure 0 0 0) 0x7f7f3408bb90 con 0x7f7f3c154160 2024-04-26T23:42:34.149 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:34.143+0000 7f7f3a59c640 1 --2- 172.21.15.88:0/1669402682 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7f3c148d50 0x7f7f3c149130 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f7f2c003930 tx=0x7f7f2c009b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:34.149 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:34.143+0000 7f7f33fff640 1 --2- 172.21.15.88:0/1669402682 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f7f1c06c8a0 0x7f7f1c06ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:34.149 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:34.143+0000 7f7f32ffd640 1 -- 172.21.15.88:0/1669402682 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f2c016070 con 0x7f7f3c148d50 2024-04-26T23:42:34.149 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:34.144+0000 7f7f33fff640 1 --2- 172.21.15.88:0/1669402682 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f7f1c06c8a0 0x7f7f1c06ed60 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f7f24034000 tx=0x7f7f2402e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:34.149 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:34.144+0000 7f7f32ffd640 1 -- 172.21.15.88:0/1669402682 <== mon.0 v2:172.21.15.88:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f7f2c012600 con 0x7f7f3c148d50 2024-04-26T23:42:34.149 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:34.144+0000 7f7f32ffd640 1 -- 172.21.15.88:0/1669402682 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7f3c148d50 msgr2=0x7f7f3c149130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:34.150 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:34.144+0000 7f7f32ffd640 1 --2- 172.21.15.88:0/1669402682 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7f3c148d50 0x7f7f3c149130 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f7f2c003930 tx=0x7f7f2c009b00 comp rx=0 tx=0).stop 2024-04-26T23:42:34.150 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:34.144+0000 7f7f32ffd640 1 -- 172.21.15.88:0/1669402682 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7f3c148d50 msgr2=0x7f7f3c149130 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:42:34.150 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:34.144+0000 7f7f32ffd640 1 --2- 172.21.15.88:0/1669402682 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7f3c148d50 0x7f7f3c149130 secure :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f7f2c003930 tx=0x7f7f2c009b00 comp rx=0 tx=0).stop 2024-04-26T23:42:34.160 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:34.156+0000 7f7f4082a640 1 --2- 172.21.15.88:0/1669402682 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7f3c149670 0x7f7f3c151980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:34.160 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:34.156+0000 7f7f4082a640 1 -- 172.21.15.88:0/1669402682 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f7f3c149a50 con 0x7f7f3c149670 2024-04-26T23:42:34.160 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:34.156+0000 7f7f3a59c640 1 --2- 172.21.15.88:0/1669402682 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7f3c149670 0x7f7f3c151980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:34.161 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:34.157+0000 7f7f3a59c640 1 -- 172.21.15.88:0/1669402682 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f7f3c0507a0 con 0x7f7f3c149670 2024-04-26T23:42:34.161 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:34.157+0000 7f7f3a59c640 1 --2- 172.21.15.88:0/1669402682 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7f3c149670 0x7f7f3c151980 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f7f2c018000 tx=0x7f7f2c0059d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:34.161 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:34.157+0000 7f7f32ffd640 1 -- 172.21.15.88:0/1669402682 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f2c016040 con 0x7f7f3c149670 2024-04-26T23:42:34.162 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-04-26T23:42:34.162 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2024-04-26T23:42:34.162 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2024-04-26T23:42:34.162 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "leader", 2024-04-26T23:42:34.162 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 16, 2024-04-26T23:42:34.162 INFO:teuthology.orchestra.run.smithi088.stdout: "uptime": 43130, 2024-04-26T23:42:34.162 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2024-04-26T23:42:34.162 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2024-04-26T23:42:34.162 INFO:teuthology.orchestra.run.smithi088.stdout: 1 2024-04-26T23:42:34.163 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:42:34.163 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 1, 2024-04-26T23:42:34.163 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2024-04-26T23:42:34.163 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2450521708007866372", 2024-04-26T23:42:34.163 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2024-04-26T23:42:34.163 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-04-26T23:42:34.163 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-04-26T23:42:34.163 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-04-26T23:42:34.163 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-04-26T23:42:34.163 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-04-26T23:42:34.163 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-04-26T23:42:34.163 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-04-26T23:42:34.163 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-04-26T23:42:34.164 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-04-26T23:42:34.164 INFO:teuthology.orchestra.run.smithi088.stdout: "reef", 2024-04-26T23:42:34.164 INFO:teuthology.orchestra.run.smithi088.stdout: "squid" 2024-04-26T23:42:34.164 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:42:34.164 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540701547738038271", 2024-04-26T23:42:34.164 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2024-04-26T23:42:34.164 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-04-26T23:42:34.164 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-04-26T23:42:34.164 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-04-26T23:42:34.164 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-04-26T23:42:34.164 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-04-26T23:42:34.164 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-04-26T23:42:34.164 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-04-26T23:42:34.164 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-04-26T23:42:34.164 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-04-26T23:42:34.165 INFO:teuthology.orchestra.run.smithi088.stdout: "reef", 2024-04-26T23:42:34.165 INFO:teuthology.orchestra.run.smithi088.stdout: "squid" 2024-04-26T23:42:34.165 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:42:34.165 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:42:34.165 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2024-04-26T23:42:34.165 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2024-04-26T23:42:34.165 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2024-04-26T23:42:34.165 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2024-04-26T23:42:34.165 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2024-04-26T23:42:34.165 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "555255e9-7ef9-4454-8dc9-35e96b70035c", 2024-04-26T23:42:34.165 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2024-04-26T23:39:34.291658Z", 2024-04-26T23:42:34.165 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2024-04-26T23:39:34.291658Z", 2024-04-26T23:42:34.166 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 19, 2024-04-26T23:42:34.166 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "squid", 2024-04-26T23:42:34.166 INFO:teuthology.orchestra.run.smithi088.stdout: "election_strategy": 1, 2024-04-26T23:42:34.166 INFO:teuthology.orchestra.run.smithi088.stdout: "disallowed_leaders: ": "", 2024-04-26T23:42:34.166 INFO:teuthology.orchestra.run.smithi088.stdout: "stretch_mode": false, 2024-04-26T23:42:34.166 INFO:teuthology.orchestra.run.smithi088.stdout: "tiebreaker_mon": "", 2024-04-26T23:42:34.166 INFO:teuthology.orchestra.run.smithi088.stdout: "removed_ranks: ": "", 2024-04-26T23:42:34.166 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2024-04-26T23:42:34.166 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2024-04-26T23:42:34.166 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-04-26T23:42:34.166 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-04-26T23:42:34.166 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-04-26T23:42:34.166 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-04-26T23:42:34.166 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-04-26T23:42:34.167 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-04-26T23:42:34.167 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-04-26T23:42:34.167 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-04-26T23:42:34.167 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-04-26T23:42:34.167 INFO:teuthology.orchestra.run.smithi088.stdout: "reef", 2024-04-26T23:42:34.169 INFO:teuthology.orchestra.run.smithi088.stdout: "squid" 2024-04-26T23:42:34.169 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:42:34.169 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2024-04-26T23:42:34.169 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:42:34.169 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2024-04-26T23:42:34.170 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:42:34.170 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2024-04-26T23:42:34.170 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2024-04-26T23:42:34.170 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-04-26T23:42:34.170 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-04-26T23:42:34.170 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:42:34.170 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-04-26T23:42:34.170 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2024-04-26T23:42:34.170 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:42:34.170 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:42:34.170 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:42:34.170 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-04-26T23:42:34.170 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2024-04-26T23:42:34.171 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:42:34.171 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:42:34.171 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:42:34.171 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:42:34.171 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2024-04-26T23:42:34.171 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2024-04-26T23:42:34.171 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-04-26T23:42:34.171 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-04-26T23:42:34.171 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-04-26T23:42:34.171 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:42:34.171 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:42:34.171 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2024-04-26T23:42:34.171 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2024-04-26T23:42:34.171 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-04-26T23:42:34.171 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-04-26T23:42:34.172 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:42:34.172 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-04-26T23:42:34.172 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:3300", 2024-04-26T23:42:34.172 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:42:34.172 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:42:34.172 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:42:34.172 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-04-26T23:42:34.172 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6789", 2024-04-26T23:42:34.172 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:42:34.172 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:42:34.172 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:42:34.172 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:42:34.172 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6789/0", 2024-04-26T23:42:34.172 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.175:6789/0", 2024-04-26T23:42:34.172 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-04-26T23:42:34.172 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-04-26T23:42:34.173 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-04-26T23:42:34.173 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:42:34.173 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:42:34.173 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2024-04-26T23:42:34.173 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2024-04-26T23:42:34.173 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-04-26T23:42:34.173 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-04-26T23:42:34.173 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:42:34.173 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-04-26T23:42:34.173 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:3301", 2024-04-26T23:42:34.173 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:42:34.173 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:42:34.173 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:42:34.173 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-04-26T23:42:34.173 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6790", 2024-04-26T23:42:34.173 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:42:34.174 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:42:34.174 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:42:34.174 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:42:34.174 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6790/0", 2024-04-26T23:42:34.174 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.175:6790/0", 2024-04-26T23:42:34.174 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-04-26T23:42:34.174 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-04-26T23:42:34.174 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-04-26T23:42:34.174 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:42:34.174 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:42:34.174 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:42:34.174 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2024-04-26T23:42:34.174 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2024-04-26T23:42:34.174 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:42:34.174 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:42:34.175 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:42:34.175 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2024-04-26T23:42:34.175 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:42:34.175 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:42:34.175 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": [ 2024-04-26T23:42:34.175 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:42:34.175 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:42:34.175 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:42:34.175 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 3 2024-04-26T23:42:34.175 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:42:34.175 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:42:34.175 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2024-04-26T23:42:34.175 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:42:34.175 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x2f018fb87aa4aafe", 2024-04-26T23:42:34.175 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:42:34.175 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2024-04-26T23:42:34.176 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:42:34.176 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:42:34.176 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:42:34.176 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:42:34.176 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2024-04-26T23:42:34.176 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:42:34.176 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:42:34.176 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:42:34.176 INFO:teuthology.orchestra.run.smithi088.stdout: "stretch_mode": false 2024-04-26T23:42:34.176 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-04-26T23:42:34.178 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:34.157+0000 7f7f32ffd640 1 -- 172.21.15.88:0/1669402682 <== mon.0 v2:172.21.15.88:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4858 (secure 0 0 0) 0x7f7f2c01b450 con 0x7f7f3c149670 2024-04-26T23:42:34.178 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:34.157+0000 7f7f32ffd640 1 -- 172.21.15.88:0/1669402682 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7f3c149670 msgr2=0x7f7f3c151980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:34.178 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:34.157+0000 7f7f32ffd640 1 --2- 172.21.15.88:0/1669402682 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7f3c149670 0x7f7f3c151980 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f7f2c018000 tx=0x7f7f2c0059d0 comp rx=0 tx=0).stop 2024-04-26T23:42:34.178 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:34.157+0000 7f7f32ffd640 1 -- 172.21.15.88:0/1669402682 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7f3c149670 msgr2=0x7f7f3c151980 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:42:34.179 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:34.157+0000 7f7f32ffd640 1 --2- 172.21.15.88:0/1669402682 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7f3c149670 0x7f7f3c151980 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:34.179 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:34.158+0000 7f7f4082a640 1 -- 172.21.15.88:0/1669402682 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f7f1c06c8a0 msgr2=0x7f7f1c06ed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:34.179 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:34.158+0000 7f7f4082a640 1 --2- 172.21.15.88:0/1669402682 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f7f1c06c8a0 0x7f7f1c06ed60 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f7f24034000 tx=0x7f7f2402e000 comp rx=0 tx=0).stop 2024-04-26T23:42:34.179 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:34.158+0000 7f7f4082a640 1 -- 172.21.15.88:0/1669402682 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7f3c154160 msgr2=0x7f7f3c1f0590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:34.179 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:34.158+0000 7f7f4082a640 1 --2- 172.21.15.88:0/1669402682 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7f3c154160 0x7f7f3c1f0590 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f7f3400cbf0 tx=0x7f7f3400a430 comp rx=0 tx=0).stop 2024-04-26T23:42:34.179 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:34.158+0000 7f7f3ad9d640 1 -- 172.21.15.88:0/1669402682 reap_dead start 2024-04-26T23:42:34.179 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:34.158+0000 7f7f3ad9d640 1 -- 172.21.15.88:0/1669402682 reap_dead start 2024-04-26T23:42:34.179 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:34.158+0000 7f7f4082a640 1 -- 172.21.15.88:0/1669402682 shutdown_connections 2024-04-26T23:42:34.179 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:34.158+0000 7f7f4082a640 1 -- 172.21.15.88:0/1669402682 >> 172.21.15.88:0/1669402682 conn(0x7f7f3c0ae010 msgr2=0x7f7f3c14e590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:34.179 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:34.158+0000 7f7f4082a640 1 -- 172.21.15.88:0/1669402682 shutdown_connections 2024-04-26T23:42:34.179 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:34.158+0000 7f7f4082a640 1 -- 172.21.15.88:0/1669402682 wait complete. 2024-04-26T23:42:34.180 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-04-26T23:42:34.180 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon b 2024-04-26T23:42:34.180 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-04-26T23:42:34.325 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:34.321+0000 7fc03539e640 1 Processor -- start 2024-04-26T23:42:34.325 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:34.321+0000 7fc03539e640 1 -- start start 2024-04-26T23:42:34.326 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:34.322+0000 7fc03539e640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc030155450 0x7fc0300abb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:34.326 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:34.322+0000 7fc03539e640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc0301558e0 con 0x7fc0300c6300 2024-04-26T23:42:34.326 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:34.322+0000 7fc03539e640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc0300c4ee0 con 0x7fc0300bf2a0 2024-04-26T23:42:34.326 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:34.322+0000 7fc03539e640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7fc0300bfdc0 con 0x7fc030155450 2024-04-26T23:42:34.326 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:34.322+0000 7fc02ffff640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fc0300c6300 0x7fc030151dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:34610/0 (socket says 172.21.15.88:34610) 2024-04-26T23:42:34.327 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:34.322+0000 7fc02ffff640 1 -- 172.21.15.88:0/3696683466 learned_addr learned my addr 172.21.15.88:0/3696683466 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-26T23:42:34.327 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:34.322+0000 7fc034b9d640 1 --2- 172.21.15.88:0/3696683466 >> v2:172.21.15.88:3300/0 conn(0x7fc030155450 0x7fc0300abb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:34.327 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:34.322+0000 7fc034b9d640 1 -- 172.21.15.88:0/3696683466 >> v1:172.21.15.175:6789/0 conn(0x7fc0300bf2a0 legacy=0x7fc0300ab470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:34.327 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:34.322+0000 7fc034b9d640 1 -- 172.21.15.88:0/3696683466 >> v1:172.21.15.88:6789/0 conn(0x7fc0300c6300 legacy=0x7fc030151dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:34.327 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:34.322+0000 7fc034b9d640 1 -- 172.21.15.88:0/3696683466 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0300c51c0 con 0x7fc030155450 2024-04-26T23:42:34.328 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:34.323+0000 7fc034b9d640 1 --2- 172.21.15.88:0/3696683466 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc030155450 0x7fc0300abb80 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fc0300bff40 tx=0x7fc02802a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6782eb4dea739be server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:34.328 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:34.323+0000 7fc02effd640 1 -- 172.21.15.88:0/3696683466 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc028007740 con 0x7fc030155450 2024-04-26T23:42:34.328 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:34.323+0000 7fc02effd640 1 -- 172.21.15.88:0/3696683466 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0280078e0 con 0x7fc030155450 2024-04-26T23:42:34.328 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:34.323+0000 7fc02effd640 1 -- 172.21.15.88:0/3696683466 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc028007cb0 con 0x7fc030155450 2024-04-26T23:42:34.328 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:34.324+0000 7fc03539e640 1 -- 172.21.15.88:0/3696683466 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc030155450 msgr2=0x7fc0300abb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:34.328 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:34.324+0000 7fc03539e640 1 --2- 172.21.15.88:0/3696683466 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc030155450 0x7fc0300abb80 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fc0300bff40 tx=0x7fc02802a6f0 comp rx=0 tx=0).stop 2024-04-26T23:42:34.328 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:34.324+0000 7fc03539e640 1 -- 172.21.15.88:0/3696683466 shutdown_connections 2024-04-26T23:42:34.328 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:34.324+0000 7fc03539e640 1 --2- 172.21.15.88:0/3696683466 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc030155450 0x7fc0300abb80 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:34.328 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:34.324+0000 7fc03539e640 1 -- 172.21.15.88:0/3696683466 >> 172.21.15.88:0/3696683466 conn(0x7fc0300caa20 msgr2=0x7fc0300c6cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:34.328 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:34.324+0000 7fc03539e640 1 -- 172.21.15.88:0/3696683466 shutdown_connections 2024-04-26T23:42:34.328 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:34.324+0000 7fc03539e640 1 -- 172.21.15.88:0/3696683466 wait complete. 2024-04-26T23:42:34.329 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:34.325+0000 7fc03539e640 1 Processor -- start 2024-04-26T23:42:34.329 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:34.325+0000 7fc03539e640 1 -- start start 2024-04-26T23:42:34.332 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:34.326+0000 7fc03539e640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc0300bf2a0 0x7fc030153b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:34.332 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:34.326+0000 7fc03539e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc0300c6300 0x7fc0301585f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:34.332 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:34.326+0000 7fc03539e640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc0300c3b90 0x7fc03014b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:34.332 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:34.326+0000 7fc03539e640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fc030152660 con 0x7fc0300c3b90 2024-04-26T23:42:34.332 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:34.326+0000 7fc03539e640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc0301524e0 con 0x7fc0300bf2a0 2024-04-26T23:42:34.332 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:34.326+0000 7fc03539e640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fc0300c66e0 con 0x7fc0300c6300 2024-04-26T23:42:34.332 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:34.326+0000 7fc034b9d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc0300c3b90 0x7fc03014b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:34.332 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:34.326+0000 7fc02f7fe640 1 -- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc0300c6300 msgr2=0x7fc0301585f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.175:3301/0 2024-04-26T23:42:34.332 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:34.326+0000 7fc02f7fe640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc0300c6300 0x7fc0301585f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:42:34.332 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:34.326+0000 7fc034b9d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc0300c3b90 0x7fc03014b1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:33844/0 (socket says 172.21.15.88:33844) 2024-04-26T23:42:34.332 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:34.326+0000 7fc034b9d640 1 -- 172.21.15.88:0/1817523274 learned_addr learned my addr 172.21.15.88:0/1817523274 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:42:34.332 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:34.326+0000 7fc02ffff640 1 --2- 172.21.15.88:0/1817523274 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc0300bf2a0 0x7fc030153b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:34.332 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:34.327+0000 7fc02ffff640 1 -- 172.21.15.88:0/1817523274 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc0300c6300 msgr2=0x7fc0301585f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T23:42:34.333 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:34.327+0000 7fc02ffff640 1 --2- 172.21.15.88:0/1817523274 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc0300c6300 0x7fc0301585f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:34.333 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:34.327+0000 7fc02ffff640 1 -- 172.21.15.88:0/1817523274 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc0300c3b90 msgr2=0x7fc03014b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:34.333 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:34.327+0000 7fc02ffff640 1 --2- 172.21.15.88:0/1817523274 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc0300c3b90 0x7fc03014b1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:34.333 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:34.327+0000 7fc02ffff640 1 -- 172.21.15.88:0/1817523274 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0300c15f0 con 0x7fc0300bf2a0 2024-04-26T23:42:34.333 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:34.327+0000 7fc034b9d640 1 --2- 172.21.15.88:0/1817523274 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc0300c3b90 0x7fc03014b1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:42:34.333 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:34.327+0000 7fc02ffff640 1 --2- 172.21.15.88:0/1817523274 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc0300bf2a0 0x7fc030153b00 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fc02000c3a0 tx=0x7fc02000c860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:34.333 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:34.327+0000 7fc02cff9640 1 -- 172.21.15.88:0/1817523274 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc020017070 con 0x7fc0300bf2a0 2024-04-26T23:42:34.333 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:34.327+0000 7fc02cff9640 1 -- 172.21.15.88:0/1817523274 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc020005ce0 con 0x7fc0300bf2a0 2024-04-26T23:42:34.333 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:34.328+0000 7fc02cff9640 1 -- 172.21.15.88:0/1817523274 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc020007310 con 0x7fc0300bf2a0 2024-04-26T23:42:34.333 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:34.328+0000 7fc03539e640 1 -- 172.21.15.88:0/1817523274 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0300c18d0 con 0x7fc0300bf2a0 2024-04-26T23:42:34.333 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:34.328+0000 7fc03539e640 1 -- 172.21.15.88:0/1817523274 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0300c2030 con 0x7fc0300bf2a0 2024-04-26T23:42:34.335 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:34.329+0000 7fc03539e640 1 --2- 172.21.15.88:0/1817523274 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc030155450 0x7fc0300c2230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:34.335 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:34.329+0000 7fc03539e640 1 -- 172.21.15.88:0/1817523274 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc0300699d0 con 0x7fc030155450 2024-04-26T23:42:34.335 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:34.329+0000 7fc02f7fe640 1 --2- 172.21.15.88:0/1817523274 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc030155450 0x7fc0300c2230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:34.335 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:34.329+0000 7fc02cff9640 1 -- 172.21.15.88:0/1817523274 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc02001a070 con 0x7fc0300bf2a0 2024-04-26T23:42:34.335 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:34.329+0000 7fc02f7fe640 1 -- 172.21.15.88:0/1817523274 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc0300506c0 con 0x7fc030155450 2024-04-26T23:42:34.336 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:34.329+0000 7fc02f7fe640 1 --2- 172.21.15.88:0/1817523274 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc030155450 0x7fc0300c2230 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fc024001030 tx=0x7fc02400c810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:34.336 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:34.330+0000 7fc02cff9640 1 --2- 172.21.15.88:0/1817523274 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fc01c06c8d0 0x7fc01c06ed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:34.336 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:34.330+0000 7fc02cff9640 1 -- 172.21.15.88:0/1817523274 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6666+0+0 (secure 0 0 0) 0x7fc02008b140 con 0x7fc0300bf2a0 2024-04-26T23:42:34.336 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:34.330+0000 7fc02cff9640 1 -- 172.21.15.88:0/1817523274 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0240074e0 con 0x7fc030155450 2024-04-26T23:42:34.336 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:34.330+0000 7fc034b9d640 1 --2- 172.21.15.88:0/1817523274 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fc01c06c8d0 0x7fc01c06ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:34.336 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:34.330+0000 7fc02cff9640 1 -- 172.21.15.88:0/1817523274 <== mon.1 v2:172.21.15.175:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fc0240074e0 con 0x7fc030155450 2024-04-26T23:42:34.336 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:34.330+0000 7fc02cff9640 1 -- 172.21.15.88:0/1817523274 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc030155450 msgr2=0x7fc0300c2230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:34.336 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:34.330+0000 7fc02cff9640 1 --2- 172.21.15.88:0/1817523274 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc030155450 0x7fc0300c2230 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fc024001030 tx=0x7fc02400c810 comp rx=0 tx=0).stop 2024-04-26T23:42:34.336 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:34.330+0000 7fc02cff9640 1 -- 172.21.15.88:0/1817523274 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc030155450 msgr2=0x7fc0300c2230 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:42:34.336 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:34.330+0000 7fc02cff9640 1 --2- 172.21.15.88:0/1817523274 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc030155450 0x7fc0300c2230 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:34.336 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:34.331+0000 7fc034b9d640 1 --2- 172.21.15.88:0/1817523274 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fc01c06c8d0 0x7fc01c06ed90 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fc028009bd0 tx=0x7fc02802f000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:34.341 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:34.337+0000 7fc03539e640 1 --2- 172.21.15.88:0/1817523274 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc03014bda0 0x7fc03014b700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:34.341 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:34.337+0000 7fc03539e640 1 -- 172.21.15.88:0/1817523274 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc0300c8890 con 0x7fc03014bda0 2024-04-26T23:42:34.341 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:34.337+0000 7fc02f7fe640 1 --2- 172.21.15.88:0/1817523274 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc03014bda0 0x7fc03014b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:34.342 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:34.337+0000 7fc02f7fe640 1 -- 172.21.15.88:0/1817523274 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fc0300c9bb0 con 0x7fc03014bda0 2024-04-26T23:42:34.342 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:34.338+0000 7fc02f7fe640 1 --2- 172.21.15.88:0/1817523274 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc03014bda0 0x7fc03014b700 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fc024011000 tx=0x7fc024001150 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:34.342 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:34.338+0000 7fc02cff9640 1 -- 172.21.15.88:0/1817523274 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc02401abe0 con 0x7fc03014bda0 2024-04-26T23:42:34.342 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:34.338+0000 7fc02cff9640 1 -- 172.21.15.88:0/1817523274 <== mon.1 v2:172.21.15.175:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5054 (secure 0 0 0) 0x7fc024023470 con 0x7fc03014bda0 2024-04-26T23:42:34.342 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:34.338+0000 7fc02cff9640 1 -- 172.21.15.88:0/1817523274 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc03014bda0 msgr2=0x7fc03014b700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:34.343 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-04-26T23:42:34.343 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2024-04-26T23:42:34.343 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2024-04-26T23:42:34.343 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "peon", 2024-04-26T23:42:34.343 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 16, 2024-04-26T23:42:34.343 INFO:teuthology.orchestra.run.smithi088.stdout: "uptime": 146681, 2024-04-26T23:42:34.343 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2024-04-26T23:42:34.343 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2024-04-26T23:42:34.343 INFO:teuthology.orchestra.run.smithi088.stdout: 1 2024-04-26T23:42:34.343 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:42:34.343 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 1, 2024-04-26T23:42:34.343 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2024-04-26T23:42:34.344 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2450521708007866372", 2024-04-26T23:42:34.344 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2024-04-26T23:42:34.344 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-04-26T23:42:34.344 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-04-26T23:42:34.344 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-04-26T23:42:34.344 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-04-26T23:42:34.344 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-04-26T23:42:34.344 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-04-26T23:42:34.344 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-04-26T23:42:34.344 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-04-26T23:42:34.344 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-04-26T23:42:34.344 INFO:teuthology.orchestra.run.smithi088.stdout: "reef", 2024-04-26T23:42:34.344 INFO:teuthology.orchestra.run.smithi088.stdout: "squid" 2024-04-26T23:42:34.344 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:42:34.344 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540701547738038271", 2024-04-26T23:42:34.345 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2024-04-26T23:42:34.345 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-04-26T23:42:34.345 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-04-26T23:42:34.345 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-04-26T23:42:34.345 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-04-26T23:42:34.345 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-04-26T23:42:34.345 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-04-26T23:42:34.345 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-04-26T23:42:34.345 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-04-26T23:42:34.345 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-04-26T23:42:34.345 INFO:teuthology.orchestra.run.smithi088.stdout: "reef", 2024-04-26T23:42:34.345 INFO:teuthology.orchestra.run.smithi088.stdout: "squid" 2024-04-26T23:42:34.345 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:42:34.345 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:42:34.346 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2024-04-26T23:42:34.346 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2024-04-26T23:42:34.346 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2024-04-26T23:42:34.346 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2024-04-26T23:42:34.346 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2024-04-26T23:42:34.346 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "555255e9-7ef9-4454-8dc9-35e96b70035c", 2024-04-26T23:42:34.346 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2024-04-26T23:39:34.291658Z", 2024-04-26T23:42:34.346 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2024-04-26T23:39:34.291658Z", 2024-04-26T23:42:34.346 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 19, 2024-04-26T23:42:34.346 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "squid", 2024-04-26T23:42:34.346 INFO:teuthology.orchestra.run.smithi088.stdout: "election_strategy": 1, 2024-04-26T23:42:34.346 INFO:teuthology.orchestra.run.smithi088.stdout: "disallowed_leaders: ": "", 2024-04-26T23:42:34.347 INFO:teuthology.orchestra.run.smithi088.stdout: "stretch_mode": false, 2024-04-26T23:42:34.347 INFO:teuthology.orchestra.run.smithi088.stdout: "tiebreaker_mon": "", 2024-04-26T23:42:34.347 INFO:teuthology.orchestra.run.smithi088.stdout: "removed_ranks: ": "", 2024-04-26T23:42:34.347 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2024-04-26T23:42:34.347 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2024-04-26T23:42:34.347 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-04-26T23:42:34.347 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-04-26T23:42:34.347 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-04-26T23:42:34.347 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-04-26T23:42:34.347 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-04-26T23:42:34.347 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-04-26T23:42:34.347 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-04-26T23:42:34.347 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-04-26T23:42:34.347 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-04-26T23:42:34.347 INFO:teuthology.orchestra.run.smithi088.stdout: "reef", 2024-04-26T23:42:34.347 INFO:teuthology.orchestra.run.smithi088.stdout: "squid" 2024-04-26T23:42:34.348 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:42:34.348 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2024-04-26T23:42:34.348 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:42:34.348 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2024-04-26T23:42:34.348 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:42:34.348 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2024-04-26T23:42:34.348 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2024-04-26T23:42:34.348 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-04-26T23:42:34.348 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-04-26T23:42:34.348 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:42:34.348 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-04-26T23:42:34.348 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2024-04-26T23:42:34.348 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:42:34.348 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:42:34.349 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:42:34.349 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-04-26T23:42:34.349 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2024-04-26T23:42:34.349 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:42:34.349 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:42:34.349 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:42:34.349 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:42:34.349 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2024-04-26T23:42:34.349 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2024-04-26T23:42:34.350 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-04-26T23:42:34.350 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-04-26T23:42:34.350 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-04-26T23:42:34.350 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:42:34.350 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:42:34.350 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2024-04-26T23:42:34.350 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2024-04-26T23:42:34.351 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-04-26T23:42:34.351 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-04-26T23:42:34.351 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:42:34.351 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-04-26T23:42:34.351 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:3300", 2024-04-26T23:42:34.351 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:42:34.351 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:42:34.351 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:42:34.351 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-04-26T23:42:34.352 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6789", 2024-04-26T23:42:34.352 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:42:34.352 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:42:34.352 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:42:34.352 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:42:34.352 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6789/0", 2024-04-26T23:42:34.352 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.175:6789/0", 2024-04-26T23:42:34.352 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-04-26T23:42:34.352 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-04-26T23:42:34.353 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-04-26T23:42:34.353 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:42:34.353 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:42:34.353 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2024-04-26T23:42:34.353 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2024-04-26T23:42:34.353 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-04-26T23:42:34.353 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-04-26T23:42:34.353 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:42:34.353 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-04-26T23:42:34.354 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:3301", 2024-04-26T23:42:34.354 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:42:34.354 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:42:34.354 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:42:34.354 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-04-26T23:42:34.354 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6790", 2024-04-26T23:42:34.355 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:42:34.355 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:42:34.355 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:42:34.355 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:42:34.355 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6790/0", 2024-04-26T23:42:34.355 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.175:6790/0", 2024-04-26T23:42:34.355 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-04-26T23:42:34.355 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-04-26T23:42:34.356 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-04-26T23:42:34.356 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:42:34.356 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:42:34.356 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:42:34.356 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2024-04-26T23:42:34.356 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2024-04-26T23:42:34.356 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:42:34.357 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:42:34.357 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:42:34.357 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2024-04-26T23:42:34.357 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:42:34.357 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:42:34.357 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": [ 2024-04-26T23:42:34.357 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:42:34.357 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:42:34.358 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:42:34.358 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 4 2024-04-26T23:42:34.358 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:42:34.358 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:42:34.358 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": [ 2024-04-26T23:42:34.358 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:42:34.358 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:42:34.359 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:42:34.359 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 5 2024-04-26T23:42:34.359 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:42:34.359 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:42:34.359 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2024-04-26T23:42:34.359 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:42:34.359 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:42:34.359 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:42:34.359 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 5 2024-04-26T23:42:34.359 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:42:34.359 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:42:34.360 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": [ 2024-04-26T23:42:34.360 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:42:34.360 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:42:34.360 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:42:34.360 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2024-04-26T23:42:34.360 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:42:34.360 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:42:34.360 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:42:34.360 INFO:teuthology.orchestra.run.smithi088.stdout: "stretch_mode": false 2024-04-26T23:42:34.360 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-04-26T23:42:34.362 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:34.338+0000 7fc02cff9640 1 --2- 172.21.15.88:0/1817523274 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc03014bda0 0x7fc03014b700 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fc024011000 tx=0x7fc024001150 comp rx=0 tx=0).stop 2024-04-26T23:42:34.362 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:34.338+0000 7fc02cff9640 1 -- 172.21.15.88:0/1817523274 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc03014bda0 msgr2=0x7fc03014b700 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:42:34.362 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:34.338+0000 7fc02cff9640 1 --2- 172.21.15.88:0/1817523274 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc03014bda0 0x7fc03014b700 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:34.362 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:34.338+0000 7fc03539e640 1 -- 172.21.15.88:0/1817523274 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fc01c06c8d0 msgr2=0x7fc01c06ed90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:34.363 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:34.338+0000 7fc03539e640 1 --2- 172.21.15.88:0/1817523274 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fc01c06c8d0 0x7fc01c06ed90 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fc028009bd0 tx=0x7fc02802f000 comp rx=0 tx=0).stop 2024-04-26T23:42:34.363 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:34.338+0000 7fc03539e640 1 -- 172.21.15.88:0/1817523274 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc0300bf2a0 msgr2=0x7fc030153b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:34.363 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:34.338+0000 7fc03539e640 1 --2- 172.21.15.88:0/1817523274 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc0300bf2a0 0x7fc030153b00 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fc02000c3a0 tx=0x7fc02000c860 comp rx=0 tx=0).stop 2024-04-26T23:42:34.363 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:34.338+0000 7fc034b9d640 1 -- 172.21.15.88:0/1817523274 reap_dead start 2024-04-26T23:42:34.363 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:34.339+0000 7fc034b9d640 1 -- 172.21.15.88:0/1817523274 reap_dead start 2024-04-26T23:42:34.363 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:34.339+0000 7fc03539e640 1 -- 172.21.15.88:0/1817523274 shutdown_connections 2024-04-26T23:42:34.363 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:34.339+0000 7fc03539e640 1 -- 172.21.15.88:0/1817523274 >> 172.21.15.88:0/1817523274 conn(0x7fc0300caa20 msgr2=0x7fc0300c7de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:34.363 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:34.339+0000 7fc03539e640 1 -- 172.21.15.88:0/1817523274 shutdown_connections 2024-04-26T23:42:34.363 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:34.339+0000 7fc03539e640 1 -- 172.21.15.88:0/1817523274 wait complete. 2024-04-26T23:42:34.363 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-04-26T23:42:34.363 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2024-04-26T23:42:37.337 INFO:tasks.workunit.client.1.smithi175.stderr:Note: switching to 'bc612ffb9c1d5bc27536bc917a705262a36d4387'. 2024-04-26T23:42:37.337 INFO:tasks.workunit.client.1.smithi175.stderr: 2024-04-26T23:42:37.337 INFO:tasks.workunit.client.1.smithi175.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-04-26T23:42:37.337 INFO:tasks.workunit.client.1.smithi175.stderr:changes and commit them, and you can discard any commits you make in this 2024-04-26T23:42:37.337 INFO:tasks.workunit.client.1.smithi175.stderr:state without impacting any branches by switching back to a branch. 2024-04-26T23:42:37.337 INFO:tasks.workunit.client.1.smithi175.stderr: 2024-04-26T23:42:37.337 INFO:tasks.workunit.client.1.smithi175.stderr:If you want to create a new branch to retain commits you create, you may 2024-04-26T23:42:37.338 INFO:tasks.workunit.client.1.smithi175.stderr:do so (now or later) by using -c with the switch command. Example: 2024-04-26T23:42:37.338 INFO:tasks.workunit.client.1.smithi175.stderr: 2024-04-26T23:42:37.338 INFO:tasks.workunit.client.1.smithi175.stderr: git switch -c 2024-04-26T23:42:37.338 INFO:tasks.workunit.client.1.smithi175.stderr: 2024-04-26T23:42:37.338 INFO:tasks.workunit.client.1.smithi175.stderr:Or undo this operation with: 2024-04-26T23:42:37.338 INFO:tasks.workunit.client.1.smithi175.stderr: 2024-04-26T23:42:37.338 INFO:tasks.workunit.client.1.smithi175.stderr: git switch - 2024-04-26T23:42:37.338 INFO:tasks.workunit.client.1.smithi175.stderr: 2024-04-26T23:42:37.338 INFO:tasks.workunit.client.1.smithi175.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-04-26T23:42:37.338 INFO:tasks.workunit.client.1.smithi175.stderr: 2024-04-26T23:42:37.338 INFO:tasks.workunit.client.1.smithi175.stderr:HEAD is now at bc612ffb9c1 Merge PR #55144 into wip-rishabh-testing-20240426.111959 2024-04-26T23:42:37.343 DEBUG:teuthology.orchestra.run.smithi175:> cd -- /home/ubuntu/cephtest/clone.client.1/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.1 2024-04-26T23:42:37.389 INFO:tasks.workunit.client.1.smithi175.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-04-26T23:42:37.391 INFO:tasks.workunit.client.1.smithi175.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2024-04-26T23:42:37.391 INFO:tasks.workunit.client.1.smithi175.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-04-26T23:42:37.943 INFO:tasks.workunit.client.1.smithi175.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-04-26T23:42:38.000 INFO:tasks.workunit.client.1.smithi175.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-04-26T23:42:38.040 INFO:tasks.workunit.client.1.smithi175.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2024-04-26T23:42:38.042 INFO:tasks.workunit.client.1.smithi175.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2024-04-26T23:42:38.042 INFO:tasks.workunit.client.1.smithi175.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-04-26T23:42:38.080 INFO:tasks.workunit.client.1.smithi175.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2024-04-26T23:42:38.083 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-26T23:42:38.084 DEBUG:teuthology.orchestra.run.smithi175:> dd if=/home/ubuntu/cephtest/workunits.list.client.1 of=/dev/stdout 2024-04-26T23:42:38.098 INFO:tasks.workunit:Running workunits matching suites/ffsb.sh on client.1... 2024-04-26T23:42:38.099 INFO:tasks.workunit:Running workunit suites/ffsb.sh... 2024-04-26T23:42:38.100 DEBUG:teuthology.orchestra.run.smithi175:workunit test suites/ffsb.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && cd -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bc612ffb9c1d5bc27536bc917a705262a36d4387 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="1" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.1 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.1 CEPH_MNT=/home/ubuntu/cephtest/mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.1/qa/workunits/suites/ffsb.sh 2024-04-26T23:42:38.159 INFO:tasks.workunit.client.1.smithi175.stderr:++ dirname /home/ubuntu/cephtest/clone.client.1/qa/workunits/suites/ffsb.sh 2024-04-26T23:42:38.160 INFO:tasks.workunit.client.1.smithi175.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.1/qa/workunits/suites 2024-04-26T23:42:38.160 INFO:tasks.workunit.client.1.smithi175.stderr:+ trap -- retry EXIT 2024-04-26T23:42:38.160 INFO:tasks.workunit.client.1.smithi175.stderr:+ rm -rf ffsb 2024-04-26T23:42:38.160 INFO:tasks.workunit.client.1.smithi175.stderr:+ timeout 1800 git clone https://git.ceph.com/ffsb.git --depth 1 2024-04-26T23:42:38.163 INFO:tasks.workunit.client.1.smithi175.stderr:Cloning into 'ffsb'... 2024-04-26T23:42:38.977 INFO:tasks.workunit.client.1.smithi175.stderr:+ trap - EXIT 2024-04-26T23:42:38.977 INFO:tasks.workunit.client.1.smithi175.stderr:+ cd ffsb 2024-04-26T23:42:38.977 INFO:tasks.workunit.client.1.smithi175.stderr:+ ./configure 2024-04-26T23:42:39.101 INFO:tasks.workunit.client.1.smithi175.stdout:checking for a BSD-compatible install... /usr/bin/install -c 2024-04-26T23:42:39.117 INFO:tasks.workunit.client.0.smithi088.stderr:Note: switching to 'bc612ffb9c1d5bc27536bc917a705262a36d4387'. 2024-04-26T23:42:39.117 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-04-26T23:42:39.117 INFO:tasks.workunit.client.0.smithi088.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-04-26T23:42:39.117 INFO:tasks.workunit.client.0.smithi088.stderr:changes and commit them, and you can discard any commits you make in this 2024-04-26T23:42:39.117 INFO:tasks.workunit.client.0.smithi088.stderr:state without impacting any branches by switching back to a branch. 2024-04-26T23:42:39.117 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-04-26T23:42:39.117 INFO:tasks.workunit.client.0.smithi088.stderr:If you want to create a new branch to retain commits you create, you may 2024-04-26T23:42:39.117 INFO:tasks.workunit.client.0.smithi088.stderr:do so (now or later) by using -c with the switch command. Example: 2024-04-26T23:42:39.117 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-04-26T23:42:39.118 INFO:tasks.workunit.client.0.smithi088.stderr: git switch -c 2024-04-26T23:42:39.118 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-04-26T23:42:39.118 INFO:tasks.workunit.client.0.smithi088.stderr:Or undo this operation with: 2024-04-26T23:42:39.118 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-04-26T23:42:39.118 INFO:tasks.workunit.client.0.smithi088.stderr: git switch - 2024-04-26T23:42:39.118 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-04-26T23:42:39.118 INFO:tasks.workunit.client.0.smithi088.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-04-26T23:42:39.118 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-04-26T23:42:39.118 INFO:tasks.workunit.client.0.smithi088.stderr:HEAD is now at bc612ffb9c1 Merge PR #55144 into wip-rishabh-testing-20240426.111959 2024-04-26T23:42:39.122 DEBUG:teuthology.orchestra.run.smithi088:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-04-26T23:42:39.158 INFO:tasks.workunit.client.0.smithi088.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-04-26T23:42:39.160 INFO:tasks.workunit.client.0.smithi088.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-04-26T23:42:39.160 INFO:tasks.workunit.client.0.smithi088.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-04-26T23:42:39.728 INFO:tasks.workunit.client.0.smithi088.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-04-26T23:42:39.784 INFO:tasks.workunit.client.0.smithi088.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-04-26T23:42:39.824 INFO:tasks.workunit.client.0.smithi088.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-04-26T23:42:39.826 INFO:tasks.workunit.client.0.smithi088.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-04-26T23:42:39.826 INFO:tasks.workunit.client.0.smithi088.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-04-26T23:42:39.865 INFO:tasks.workunit.client.0.smithi088.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-04-26T23:42:39.868 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-04-26T23:42:39.868 DEBUG:teuthology.orchestra.run.smithi088:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-04-26T23:42:39.923 INFO:tasks.workunit:Running workunits matching suites/ffsb.sh on client.0... 2024-04-26T23:42:39.924 INFO:tasks.workunit:Running workunit suites/ffsb.sh... 2024-04-26T23:42:39.924 DEBUG:teuthology.orchestra.run.smithi088:workunit test suites/ffsb.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bc612ffb9c1d5bc27536bc917a705262a36d4387 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/ffsb.sh 2024-04-26T23:42:39.984 INFO:tasks.workunit.client.0.smithi088.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/ffsb.sh 2024-04-26T23:42:39.985 INFO:tasks.workunit.client.0.smithi088.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.0/qa/workunits/suites 2024-04-26T23:42:39.985 INFO:tasks.workunit.client.0.smithi088.stderr:+ trap -- retry EXIT 2024-04-26T23:42:39.985 INFO:tasks.workunit.client.0.smithi088.stderr:+ rm -rf ffsb 2024-04-26T23:42:39.985 INFO:tasks.workunit.client.0.smithi088.stderr:+ timeout 1800 git clone https://git.ceph.com/ffsb.git --depth 1 2024-04-26T23:42:39.988 INFO:tasks.workunit.client.0.smithi088.stderr:Cloning into 'ffsb'... 2024-04-26T23:42:40.108 INFO:tasks.workunit.client.1.smithi175.stdout:checking whether build environment is sane... yes 2024-04-26T23:42:40.115 INFO:tasks.workunit.client.1.smithi175.stdout:checking for a thread-safe mkdir -p... /usr/bin/mkdir -p 2024-04-26T23:42:40.115 INFO:tasks.workunit.client.1.smithi175.stdout:checking for gawk... gawk 2024-04-26T23:42:40.128 INFO:tasks.workunit.client.1.smithi175.stdout:checking whether make sets $(MAKE)... yes 2024-04-26T23:42:40.157 INFO:tasks.workunit.client.1.smithi175.stdout:checking build system type... x86_64-unknown-linux-gnu 2024-04-26T23:42:40.157 INFO:tasks.workunit.client.1.smithi175.stdout:checking host system type... x86_64-unknown-linux-gnu 2024-04-26T23:42:40.166 INFO:tasks.workunit.client.1.smithi175.stdout:checking for style of include used by make... GNU 2024-04-26T23:42:40.170 INFO:tasks.workunit.client.1.smithi175.stdout:checking for gcc... gcc 2024-04-26T23:42:40.217 INFO:tasks.workunit.client.1.smithi175.stdout:checking for C compiler default output file name... a.out 2024-04-26T23:42:40.219 INFO:tasks.workunit.client.1.smithi175.stdout:checking whether the C compiler works... yes 2024-04-26T23:42:40.221 INFO:tasks.workunit.client.1.smithi175.stdout:checking whether we are cross compiling... no 2024-04-26T23:42:40.255 INFO:tasks.workunit.client.1.smithi175.stdout:checking for suffix of executables... 2024-04-26T23:42:40.285 INFO:tasks.workunit.client.1.smithi175.stdout:checking for suffix of object files... o 2024-04-26T23:42:40.313 INFO:tasks.workunit.client.1.smithi175.stdout:checking whether we are using the GNU C compiler... yes 2024-04-26T23:42:40.340 INFO:tasks.workunit.client.1.smithi175.stdout:checking whether gcc accepts -g... yes 2024-04-26T23:42:40.531 INFO:tasks.workunit.client.1.smithi175.stdout:checking for gcc option to accept ISO C89... none needed 2024-04-26T23:42:40.620 INFO:tasks.workunit.client.1.smithi175.stdout:checking dependency style of gcc... gcc3 2024-04-26T23:42:40.678 INFO:tasks.workunit.client.1.smithi175.stdout:checking how to run the C preprocessor... gcc -E 2024-04-26T23:42:40.716 INFO:tasks.workunit.client.1.smithi175.stdout:checking for grep that handles long lines and -e... /usr/bin/grep 2024-04-26T23:42:40.717 INFO:tasks.workunit.client.1.smithi175.stdout:checking for egrep... /usr/bin/grep -E 2024-04-26T23:42:40.726 INFO:tasks.workunit.client.1.smithi175.stdout:checking for AIX... no 2024-04-26T23:42:40.742 INFO:tasks.workunit.client.1.smithi175.stdout:checking for gcc... (cached) gcc 2024-04-26T23:42:40.750 INFO:tasks.workunit.client.1.smithi175.stdout:checking whether we are using the GNU C compiler... (cached) yes 2024-04-26T23:42:40.750 INFO:tasks.workunit.client.1.smithi175.stdout:checking whether gcc accepts -g... (cached) yes 2024-04-26T23:42:40.750 INFO:tasks.workunit.client.1.smithi175.stdout:checking for gcc option to accept ISO C89... (cached) none needed 2024-04-26T23:42:40.750 INFO:tasks.workunit.client.1.smithi175.stdout:checking dependency style of gcc... (cached) gcc3 2024-04-26T23:42:40.794 INFO:tasks.workunit.client.1.smithi175.stdout:checking for main in -lm... yes 2024-04-26T23:42:40.815 INFO:tasks.workunit.client.0.smithi088.stderr:+ trap - EXIT 2024-04-26T23:42:40.816 INFO:tasks.workunit.client.0.smithi088.stderr:+ cd ffsb 2024-04-26T23:42:40.816 INFO:tasks.workunit.client.0.smithi088.stderr:+ ./configure 2024-04-26T23:42:40.840 INFO:tasks.workunit.client.1.smithi175.stdout:checking for main in -lpthread... yes 2024-04-26T23:42:40.942 INFO:tasks.workunit.client.0.smithi088.stdout:checking for a BSD-compatible install... /usr/bin/install -c 2024-04-26T23:42:41.041 INFO:tasks.workunit.client.1.smithi175.stdout:checking for ANSI C header files... yes 2024-04-26T23:42:41.091 INFO:tasks.workunit.client.1.smithi175.stdout:checking for sys/wait.h that is POSIX.1 compatible... yes 2024-04-26T23:42:41.132 INFO:tasks.workunit.client.1.smithi175.stdout:checking for sys/types.h... yes 2024-04-26T23:42:41.174 INFO:tasks.workunit.client.1.smithi175.stdout:checking for sys/stat.h... yes 2024-04-26T23:42:41.215 INFO:tasks.workunit.client.1.smithi175.stdout:checking for stdlib.h... yes 2024-04-26T23:42:41.259 INFO:tasks.workunit.client.1.smithi175.stdout:checking for string.h... yes 2024-04-26T23:42:41.310 INFO:tasks.workunit.client.1.smithi175.stdout:checking for memory.h... yes 2024-04-26T23:42:41.353 INFO:tasks.workunit.client.1.smithi175.stdout:checking for strings.h... yes 2024-04-26T23:42:41.397 INFO:tasks.workunit.client.1.smithi175.stdout:checking for inttypes.h... yes 2024-04-26T23:42:41.441 INFO:tasks.workunit.client.1.smithi175.stdout:checking for stdint.h... yes 2024-04-26T23:42:41.486 INFO:tasks.workunit.client.1.smithi175.stdout:checking for unistd.h... yes 2024-04-26T23:42:41.536 INFO:tasks.workunit.client.1.smithi175.stdout:checking pthread.h usability... yes 2024-04-26T23:42:41.556 INFO:tasks.workunit.client.1.smithi175.stdout:checking pthread.h presence... yes 2024-04-26T23:42:41.557 INFO:tasks.workunit.client.1.smithi175.stdout:checking for pthread.h... yes 2024-04-26T23:42:41.604 INFO:tasks.workunit.client.1.smithi175.stdout:checking fcntl.h usability... yes 2024-04-26T23:42:41.623 INFO:tasks.workunit.client.1.smithi175.stdout:checking fcntl.h presence... yes 2024-04-26T23:42:41.623 INFO:tasks.workunit.client.1.smithi175.stdout:checking for fcntl.h... yes 2024-04-26T23:42:41.671 INFO:tasks.workunit.client.1.smithi175.stdout:checking limits.h usability... yes 2024-04-26T23:42:41.690 INFO:tasks.workunit.client.1.smithi175.stdout:checking limits.h presence... yes 2024-04-26T23:42:41.690 INFO:tasks.workunit.client.1.smithi175.stdout:checking for limits.h... yes 2024-04-26T23:42:41.704 INFO:tasks.workunit.client.1.smithi175.stdout:checking for stdint.h... (cached) yes 2024-04-26T23:42:41.743 INFO:tasks.workunit.client.1.smithi175.stdout:checking sys/time.h usability... yes 2024-04-26T23:42:41.762 INFO:tasks.workunit.client.1.smithi175.stdout:checking sys/time.h presence... yes 2024-04-26T23:42:41.762 INFO:tasks.workunit.client.1.smithi175.stdout:checking for sys/time.h... yes 2024-04-26T23:42:41.774 INFO:tasks.workunit.client.1.smithi175.stdout:checking for unistd.h... (cached) yes 2024-04-26T23:42:41.823 INFO:tasks.workunit.client.1.smithi175.stdout:checking sys/vfs.h usability... yes 2024-04-26T23:42:41.842 INFO:tasks.workunit.client.1.smithi175.stdout:checking sys/vfs.h presence... yes 2024-04-26T23:42:41.842 INFO:tasks.workunit.client.1.smithi175.stdout:checking for sys/vfs.h... yes 2024-04-26T23:42:41.886 INFO:tasks.workunit.client.1.smithi175.stdout:checking sys/limits.h usability... no 2024-04-26T23:42:41.906 INFO:tasks.workunit.client.1.smithi175.stdout:checking sys/limits.h presence... no 2024-04-26T23:42:41.906 INFO:tasks.workunit.client.1.smithi175.stdout:checking for sys/limits.h... no 2024-04-26T23:42:41.938 INFO:tasks.workunit.client.1.smithi175.stdout:checking for an ANSI C-conforming const... yes 2024-04-26T23:42:41.948 INFO:tasks.workunit.client.0.smithi088.stdout:checking whether build environment is sane... yes 2024-04-26T23:42:41.955 INFO:tasks.workunit.client.0.smithi088.stdout:checking for a thread-safe mkdir -p... /usr/bin/mkdir -p 2024-04-26T23:42:41.955 INFO:tasks.workunit.client.0.smithi088.stdout:checking for gawk... gawk 2024-04-26T23:42:41.967 INFO:tasks.workunit.client.0.smithi088.stdout:checking whether make sets $(MAKE)... yes 2024-04-26T23:42:41.969 INFO:tasks.workunit.client.1.smithi175.stdout:checking whether time.h and sys/time.h may both be included... yes 2024-04-26T23:42:41.970 INFO:tasks.workunit.client.1.smithi175.stdout:checking for function prototypes... yes 2024-04-26T23:42:41.993 INFO:tasks.workunit.client.0.smithi088.stdout:checking build system type... x86_64-unknown-linux-gnu 2024-04-26T23:42:41.993 INFO:tasks.workunit.client.0.smithi088.stdout:checking host system type... x86_64-unknown-linux-gnu 2024-04-26T23:42:41.995 INFO:tasks.workunit.client.1.smithi175.stdout:checking whether setvbuf arguments are reversed... no 2024-04-26T23:42:42.002 INFO:tasks.workunit.client.0.smithi088.stdout:checking for style of include used by make... GNU 2024-04-26T23:42:42.005 INFO:tasks.workunit.client.0.smithi088.stdout:checking for gcc... gcc 2024-04-26T23:42:42.053 INFO:tasks.workunit.client.0.smithi088.stdout:checking for C compiler default output file name... a.out 2024-04-26T23:42:42.054 INFO:tasks.workunit.client.0.smithi088.stdout:checking whether the C compiler works... yes 2024-04-26T23:42:42.057 INFO:tasks.workunit.client.0.smithi088.stdout:checking whether we are cross compiling... no 2024-04-26T23:42:42.063 INFO:tasks.workunit.client.1.smithi175.stdout:checking for system... yes 2024-04-26T23:42:42.092 INFO:tasks.workunit.client.0.smithi088.stdout:checking for suffix of executables... 2024-04-26T23:42:42.123 INFO:tasks.workunit.client.1.smithi175.stdout:checking for gettimeofday... yes 2024-04-26T23:42:42.123 INFO:tasks.workunit.client.0.smithi088.stdout:checking for suffix of object files... o 2024-04-26T23:42:42.153 INFO:tasks.workunit.client.0.smithi088.stdout:checking whether we are using the GNU C compiler... yes 2024-04-26T23:42:42.181 INFO:tasks.workunit.client.0.smithi088.stdout:checking whether gcc accepts -g... yes 2024-04-26T23:42:42.184 INFO:tasks.workunit.client.1.smithi175.stdout:checking for mkdir... yes 2024-04-26T23:42:42.235 INFO:tasks.workunit.client.0.smithi088.stdout:checking for gcc option to accept ISO C89... none needed 2024-04-26T23:42:42.245 INFO:tasks.workunit.client.1.smithi175.stdout:checking for strerror... yes 2024-04-26T23:42:42.303 INFO:tasks.workunit.client.1.smithi175.stdout:checking for open64... yes 2024-04-26T23:42:42.362 INFO:tasks.workunit.client.1.smithi175.stdout:checking for stat64... yes 2024-04-26T23:42:42.423 INFO:tasks.workunit.client.0.smithi088.stdout:checking dependency style of gcc... gcc3 2024-04-26T23:42:42.427 INFO:tasks.workunit.client.1.smithi175.stdout:checking for fseeko64... yes 2024-04-26T23:42:42.480 INFO:tasks.workunit.client.0.smithi088.stdout:checking how to run the C preprocessor... gcc -E 2024-04-26T23:42:42.484 INFO:tasks.workunit.client.1.smithi175.stdout:checking for lrand48_r... yes 2024-04-26T23:42:42.518 INFO:tasks.workunit.client.0.smithi088.stdout:checking for grep that handles long lines and -e... /usr/bin/grep 2024-04-26T23:42:42.519 INFO:tasks.workunit.client.0.smithi088.stdout:checking for egrep... /usr/bin/grep -E 2024-04-26T23:42:42.527 INFO:tasks.workunit.client.0.smithi088.stdout:checking for AIX... no 2024-04-26T23:42:42.541 INFO:tasks.workunit.client.1.smithi175.stdout:checking for srand48_r... yes 2024-04-26T23:42:42.551 INFO:tasks.workunit.client.0.smithi088.stdout:checking for gcc... (cached) gcc 2024-04-26T23:42:42.558 INFO:tasks.workunit.client.0.smithi088.stdout:checking whether we are using the GNU C compiler... (cached) yes 2024-04-26T23:42:42.560 INFO:tasks.workunit.client.0.smithi088.stdout:checking whether gcc accepts -g... (cached) yes 2024-04-26T23:42:42.560 INFO:tasks.workunit.client.0.smithi088.stdout:checking for gcc option to accept ISO C89... (cached) none needed 2024-04-26T23:42:42.560 INFO:tasks.workunit.client.0.smithi088.stdout:checking dependency style of gcc... (cached) gcc3 2024-04-26T23:42:42.561 INFO:tasks.workunit.client.1.smithi175.stdout:configure: creating ./config.status 2024-04-26T23:42:42.606 INFO:tasks.workunit.client.0.smithi088.stdout:checking for main in -lm... yes 2024-04-26T23:42:42.650 INFO:tasks.workunit.client.1.smithi175.stdout:config.status: creating Makefile 2024-04-26T23:42:42.652 INFO:tasks.workunit.client.0.smithi088.stdout:checking for main in -lpthread... yes 2024-04-26T23:42:42.662 INFO:tasks.workunit.client.1.smithi175.stdout:config.status: creating config.h 2024-04-26T23:42:42.678 INFO:tasks.workunit.client.1.smithi175.stdout:config.status: executing depfiles commands 2024-04-26T23:42:42.724 INFO:tasks.workunit.client.1.smithi175.stdout:config.status: executing default commands 2024-04-26T23:42:42.767 INFO:tasks.workunit.client.1.smithi175.stderr:+ make 2024-04-26T23:42:42.773 INFO:tasks.workunit.client.1.smithi175.stdout:cd . && /bin/sh /home/ubuntu/cephtest/mnt.1/client.1/tmp/ffsb/missing --run aclocal-1.10 2024-04-26T23:42:42.775 INFO:tasks.workunit.client.1.smithi175.stderr:/home/ubuntu/cephtest/mnt.1/client.1/tmp/ffsb/missing: line 46: aclocal-1.10: command not found 2024-04-26T23:42:42.776 INFO:tasks.workunit.client.1.smithi175.stderr:WARNING: `aclocal-1.10' is missing on your system. You should only need it if 2024-04-26T23:42:42.776 INFO:tasks.workunit.client.1.smithi175.stderr: you modified `acinclude.m4' or `configure.in'. You might want 2024-04-26T23:42:42.776 INFO:tasks.workunit.client.1.smithi175.stderr: to install the `Automake' and `Perl' packages. Grab them from 2024-04-26T23:42:42.776 INFO:tasks.workunit.client.1.smithi175.stderr: any GNU archive site. 2024-04-26T23:42:42.778 INFO:tasks.workunit.client.1.smithi175.stdout: cd . && /bin/sh /home/ubuntu/cephtest/mnt.1/client.1/tmp/ffsb/missing --run automake-1.10 --gnu 2024-04-26T23:42:42.779 INFO:tasks.workunit.client.1.smithi175.stderr:/home/ubuntu/cephtest/mnt.1/client.1/tmp/ffsb/missing: line 46: automake-1.10: command not found 2024-04-26T23:42:42.780 INFO:tasks.workunit.client.1.smithi175.stderr:WARNING: `automake-1.10' is missing on your system. You should only need it if 2024-04-26T23:42:42.780 INFO:tasks.workunit.client.1.smithi175.stderr: you modified `Makefile.am', `acinclude.m4' or `configure.in'. 2024-04-26T23:42:42.780 INFO:tasks.workunit.client.1.smithi175.stderr: You might want to install the `Automake' and `Perl' packages. 2024-04-26T23:42:42.780 INFO:tasks.workunit.client.1.smithi175.stderr: Grab them from any GNU archive site. 2024-04-26T23:42:42.810 INFO:tasks.workunit.client.0.smithi088.stdout:checking for ANSI C header files... yes 2024-04-26T23:42:42.836 INFO:tasks.workunit.client.1.smithi175.stdout:cd . && /bin/sh /home/ubuntu/cephtest/mnt.1/client.1/tmp/ffsb/missing --run autoconf 2024-04-26T23:42:42.854 INFO:tasks.workunit.client.0.smithi088.stdout:checking for sys/wait.h that is POSIX.1 compatible... yes 2024-04-26T23:42:42.895 INFO:tasks.workunit.client.0.smithi088.stdout:checking for sys/types.h... yes 2024-04-26T23:42:42.938 INFO:tasks.workunit.client.0.smithi088.stdout:checking for sys/stat.h... yes 2024-04-26T23:42:42.979 INFO:tasks.workunit.client.0.smithi088.stdout:checking for stdlib.h... yes 2024-04-26T23:42:43.022 INFO:tasks.workunit.client.0.smithi088.stdout:checking for string.h... yes 2024-04-26T23:42:43.066 INFO:tasks.workunit.client.0.smithi088.stdout:checking for memory.h... yes 2024-04-26T23:42:43.104 INFO:tasks.workunit.client.1.smithi175.stderr:aclocal.m4:16: warning: this file was generated for autoconf 2.61. 2024-04-26T23:42:43.104 INFO:tasks.workunit.client.1.smithi175.stderr:You have another version of autoconf. It may work, but is not guaranteed to. 2024-04-26T23:42:43.104 INFO:tasks.workunit.client.1.smithi175.stderr:If you have problems, you may need to regenerate the build system entirely. 2024-04-26T23:42:43.104 INFO:tasks.workunit.client.1.smithi175.stderr:To do so, use the procedure documented by the package, typically `autoreconf'. 2024-04-26T23:42:43.108 INFO:tasks.workunit.client.0.smithi088.stdout:checking for strings.h... yes 2024-04-26T23:42:43.152 INFO:tasks.workunit.client.0.smithi088.stdout:checking for inttypes.h... yes 2024-04-26T23:42:43.196 INFO:tasks.workunit.client.0.smithi088.stdout:checking for stdint.h... yes 2024-04-26T23:42:43.223 INFO:tasks.workunit.client.1.smithi175.stdout:/bin/sh ./config.status --recheck 2024-04-26T23:42:43.243 INFO:tasks.workunit.client.0.smithi088.stdout:checking for unistd.h... yes 2024-04-26T23:42:43.269 INFO:tasks.workunit.client.1.smithi175.stdout:running CONFIG_SHELL=/bin/sh /bin/sh ./configure --no-create --no-recursion 2024-04-26T23:42:43.296 INFO:tasks.workunit.client.0.smithi088.stdout:checking pthread.h usability... yes 2024-04-26T23:42:43.317 INFO:tasks.workunit.client.0.smithi088.stdout:checking pthread.h presence... yes 2024-04-26T23:42:43.317 INFO:tasks.workunit.client.0.smithi088.stdout:checking for pthread.h... yes 2024-04-26T23:42:43.364 INFO:tasks.workunit.client.1.smithi175.stdout:checking for a BSD-compatible install... /usr/bin/install -c 2024-04-26T23:42:43.371 INFO:tasks.workunit.client.0.smithi088.stdout:checking fcntl.h usability... yes 2024-04-26T23:42:43.390 INFO:tasks.workunit.client.0.smithi088.stdout:checking fcntl.h presence... yes 2024-04-26T23:42:43.390 INFO:tasks.workunit.client.0.smithi088.stdout:checking for fcntl.h... yes 2024-04-26T23:42:43.438 INFO:tasks.workunit.client.0.smithi088.stdout:checking limits.h usability... yes 2024-04-26T23:42:43.458 INFO:tasks.workunit.client.0.smithi088.stdout:checking limits.h presence... yes 2024-04-26T23:42:43.458 INFO:tasks.workunit.client.0.smithi088.stdout:checking for limits.h... yes 2024-04-26T23:42:43.470 INFO:tasks.workunit.client.0.smithi088.stdout:checking for stdint.h... (cached) yes 2024-04-26T23:42:43.535 INFO:tasks.workunit.client.0.smithi088.stdout:checking sys/time.h usability... yes 2024-04-26T23:42:43.556 INFO:tasks.workunit.client.0.smithi088.stdout:checking sys/time.h presence... yes 2024-04-26T23:42:43.556 INFO:tasks.workunit.client.0.smithi088.stdout:checking for sys/time.h... yes 2024-04-26T23:42:43.570 INFO:tasks.workunit.client.0.smithi088.stdout:checking for unistd.h... (cached) yes 2024-04-26T23:42:43.621 INFO:tasks.workunit.client.0.smithi088.stdout:checking sys/vfs.h usability... yes 2024-04-26T23:42:43.642 INFO:tasks.workunit.client.0.smithi088.stdout:checking sys/vfs.h presence... yes 2024-04-26T23:42:43.642 INFO:tasks.workunit.client.0.smithi088.stdout:checking for sys/vfs.h... yes 2024-04-26T23:42:43.690 INFO:tasks.workunit.client.0.smithi088.stdout:checking sys/limits.h usability... no 2024-04-26T23:42:43.712 INFO:tasks.workunit.client.0.smithi088.stdout:checking sys/limits.h presence... no 2024-04-26T23:42:43.712 INFO:tasks.workunit.client.0.smithi088.stdout:checking for sys/limits.h... no 2024-04-26T23:42:43.750 INFO:tasks.workunit.client.0.smithi088.stdout:checking for an ANSI C-conforming const... yes 2024-04-26T23:42:43.791 INFO:tasks.workunit.client.0.smithi088.stdout:checking whether time.h and sys/time.h may both be included... yes 2024-04-26T23:42:43.792 INFO:tasks.workunit.client.0.smithi088.stdout:checking for function prototypes... yes 2024-04-26T23:42:43.817 INFO:tasks.workunit.client.0.smithi088.stdout:checking whether setvbuf arguments are reversed... no 2024-04-26T23:42:43.883 INFO:tasks.workunit.client.0.smithi088.stdout:checking for system... yes 2024-04-26T23:42:43.941 INFO:tasks.workunit.client.0.smithi088.stdout:checking for gettimeofday... yes 2024-04-26T23:42:44.000 INFO:tasks.workunit.client.0.smithi088.stdout:checking for mkdir... yes 2024-04-26T23:42:44.058 INFO:tasks.workunit.client.0.smithi088.stdout:checking for strerror... yes 2024-04-26T23:42:44.116 INFO:tasks.workunit.client.0.smithi088.stdout:checking for open64... yes 2024-04-26T23:42:44.174 INFO:tasks.workunit.client.0.smithi088.stdout:checking for stat64... yes 2024-04-26T23:42:44.232 INFO:tasks.workunit.client.0.smithi088.stdout:checking for fseeko64... yes 2024-04-26T23:42:44.291 INFO:tasks.workunit.client.0.smithi088.stdout:checking for lrand48_r... yes 2024-04-26T23:42:44.349 INFO:tasks.workunit.client.0.smithi088.stdout:checking for srand48_r... yes 2024-04-26T23:42:44.370 INFO:tasks.workunit.client.1.smithi175.stdout:checking whether build environment is sane... yes 2024-04-26T23:42:44.370 INFO:tasks.workunit.client.0.smithi088.stdout:configure: creating ./config.status 2024-04-26T23:42:44.374 INFO:tasks.workunit.client.1.smithi175.stdout:checking for a thread-safe mkdir -p... /usr/bin/mkdir -p 2024-04-26T23:42:44.374 INFO:tasks.workunit.client.1.smithi175.stdout:checking for gawk... gawk 2024-04-26T23:42:44.399 INFO:tasks.workunit.client.1.smithi175.stdout:checking whether make sets $(MAKE)... yes 2024-04-26T23:42:44.425 INFO:tasks.workunit.client.1.smithi175.stdout:checking build system type... x86_64-unknown-linux-gnu 2024-04-26T23:42:44.425 INFO:tasks.workunit.client.1.smithi175.stdout:checking host system type... x86_64-unknown-linux-gnu 2024-04-26T23:42:44.435 INFO:tasks.workunit.client.1.smithi175.stdout:checking for style of include used by make... GNU 2024-04-26T23:42:44.438 INFO:tasks.workunit.client.1.smithi175.stdout:checking for gcc... gcc 2024-04-26T23:42:44.455 INFO:tasks.workunit.client.0.smithi088.stdout:config.status: creating Makefile 2024-04-26T23:42:44.468 INFO:tasks.workunit.client.0.smithi088.stdout:config.status: creating config.h 2024-04-26T23:42:44.483 INFO:tasks.workunit.client.0.smithi088.stdout:config.status: executing depfiles commands 2024-04-26T23:42:44.522 INFO:tasks.workunit.client.1.smithi175.stdout:checking whether the C compiler works... yes 2024-04-26T23:42:44.522 INFO:tasks.workunit.client.1.smithi175.stdout:checking for C compiler default output file name... a.out 2024-04-26T23:42:44.524 INFO:tasks.workunit.client.0.smithi088.stdout:config.status: executing default commands 2024-04-26T23:42:44.563 INFO:tasks.workunit.client.1.smithi175.stdout:checking for suffix of executables... 2024-04-26T23:42:44.571 INFO:tasks.workunit.client.0.smithi088.stderr:+ make 2024-04-26T23:42:44.577 INFO:tasks.workunit.client.0.smithi088.stdout:cd . && /bin/sh /home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb/missing --run aclocal-1.10 2024-04-26T23:42:44.579 INFO:tasks.workunit.client.0.smithi088.stderr:/home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb/missing: line 46: aclocal-1.10: command not found 2024-04-26T23:42:44.580 INFO:tasks.workunit.client.0.smithi088.stderr:WARNING: `aclocal-1.10' is missing on your system. You should only need it if 2024-04-26T23:42:44.580 INFO:tasks.workunit.client.0.smithi088.stderr: you modified `acinclude.m4' or `configure.in'. You might want 2024-04-26T23:42:44.580 INFO:tasks.workunit.client.0.smithi088.stderr: to install the `Automake' and `Perl' packages. Grab them from 2024-04-26T23:42:44.580 INFO:tasks.workunit.client.0.smithi088.stderr: any GNU archive site. 2024-04-26T23:42:44.581 INFO:tasks.workunit.client.0.smithi088.stdout: cd . && /bin/sh /home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb/missing --run automake-1.10 --gnu 2024-04-26T23:42:44.582 INFO:tasks.workunit.client.0.smithi088.stderr:/home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb/missing: line 46: automake-1.10: command not found 2024-04-26T23:42:44.583 INFO:tasks.workunit.client.0.smithi088.stderr:WARNING: `automake-1.10' is missing on your system. You should only need it if 2024-04-26T23:42:44.583 INFO:tasks.workunit.client.0.smithi088.stderr: you modified `Makefile.am', `acinclude.m4' or `configure.in'. 2024-04-26T23:42:44.584 INFO:tasks.workunit.client.0.smithi088.stderr: You might want to install the `Automake' and `Perl' packages. 2024-04-26T23:42:44.584 INFO:tasks.workunit.client.0.smithi088.stderr: Grab them from any GNU archive site. 2024-04-26T23:42:44.598 INFO:tasks.workunit.client.1.smithi175.stdout:checking whether we are cross compiling... no 2024-04-26T23:42:44.616 INFO:tasks.workunit.client.0.smithi088.stdout:cd . && /bin/sh /home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb/missing --run autoconf 2024-04-26T23:42:44.629 INFO:tasks.workunit.client.1.smithi175.stdout:checking for suffix of object files... o 2024-04-26T23:42:44.651 INFO:tasks.workunit.client.1.smithi175.stdout:checking whether we are using the GNU C compiler... yes 2024-04-26T23:42:44.673 INFO:tasks.workunit.client.1.smithi175.stdout:checking whether gcc accepts -g... yes 2024-04-26T23:42:44.716 INFO:tasks.workunit.client.1.smithi175.stdout:checking for gcc option to accept ISO C89... none needed 2024-04-26T23:42:44.800 INFO:tasks.workunit.client.1.smithi175.stdout:checking dependency style of gcc... gcc3 2024-04-26T23:42:44.841 INFO:tasks.workunit.client.1.smithi175.stdout:checking how to run the C preprocessor... gcc -E 2024-04-26T23:42:44.883 INFO:tasks.workunit.client.1.smithi175.stdout:checking for grep that handles long lines and -e... /usr/bin/grep 2024-04-26T23:42:44.884 INFO:tasks.workunit.client.1.smithi175.stdout:checking for egrep... /usr/bin/grep -E 2024-04-26T23:42:44.954 INFO:tasks.workunit.client.0.smithi088.stderr:aclocal.m4:16: warning: this file was generated for autoconf 2.61. 2024-04-26T23:42:44.954 INFO:tasks.workunit.client.0.smithi088.stderr:You have another version of autoconf. It may work, but is not guaranteed to. 2024-04-26T23:42:44.954 INFO:tasks.workunit.client.0.smithi088.stderr:If you have problems, you may need to regenerate the build system entirely. 2024-04-26T23:42:44.954 INFO:tasks.workunit.client.0.smithi088.stderr:To do so, use the procedure documented by the package, typically `autoreconf'. 2024-04-26T23:42:45.000 INFO:tasks.workunit.client.1.smithi175.stdout:checking for ANSI C header files... yes 2024-04-26T23:42:45.032 INFO:tasks.workunit.client.1.smithi175.stdout:checking for sys/types.h... yes 2024-04-26T23:42:45.067 INFO:tasks.workunit.client.1.smithi175.stdout:checking for sys/stat.h... yes 2024-04-26T23:42:45.070 INFO:tasks.workunit.client.0.smithi088.stdout:/bin/sh ./config.status --recheck 2024-04-26T23:42:45.101 INFO:tasks.workunit.client.1.smithi175.stdout:checking for stdlib.h... yes 2024-04-26T23:42:45.123 INFO:tasks.workunit.client.0.smithi088.stdout:running CONFIG_SHELL=/bin/sh /bin/sh ./configure --no-create --no-recursion 2024-04-26T23:42:45.140 INFO:tasks.workunit.client.1.smithi175.stdout:checking for string.h... yes 2024-04-26T23:42:45.179 INFO:tasks.workunit.client.1.smithi175.stdout:checking for memory.h... yes 2024-04-26T23:42:45.219 INFO:tasks.workunit.client.1.smithi175.stdout:checking for strings.h... yes 2024-04-26T23:42:45.222 INFO:tasks.workunit.client.0.smithi088.stdout:checking for a BSD-compatible install... /usr/bin/install -c 2024-04-26T23:42:45.261 INFO:tasks.workunit.client.1.smithi175.stdout:checking for inttypes.h... yes 2024-04-26T23:42:45.301 INFO:tasks.workunit.client.1.smithi175.stdout:checking for stdint.h... yes 2024-04-26T23:42:45.341 INFO:tasks.workunit.client.1.smithi175.stdout:checking for unistd.h... yes 2024-04-26T23:42:45.407 INFO:tasks.workunit.client.1.smithi175.stdout:checking minix/config.h usability... no 2024-04-26T23:42:45.434 INFO:tasks.workunit.client.1.smithi175.stdout:checking minix/config.h presence... no 2024-04-26T23:42:45.434 INFO:tasks.workunit.client.1.smithi175.stdout:checking for minix/config.h... no 2024-04-26T23:42:45.467 INFO:tasks.workunit.client.1.smithi175.stdout:checking whether it is safe to define __EXTENSIONS__... yes 2024-04-26T23:42:45.468 INFO:tasks.workunit.client.1.smithi175.stdout:checking for gcc... (cached) gcc 2024-04-26T23:42:45.498 INFO:tasks.workunit.client.1.smithi175.stdout:checking whether we are using the GNU C compiler... (cached) yes 2024-04-26T23:42:45.498 INFO:tasks.workunit.client.1.smithi175.stdout:checking whether gcc accepts -g... (cached) yes 2024-04-26T23:42:45.498 INFO:tasks.workunit.client.1.smithi175.stdout:checking for gcc option to accept ISO C89... (cached) none needed 2024-04-26T23:42:45.499 INFO:tasks.workunit.client.1.smithi175.stdout:checking dependency style of gcc... (cached) gcc3 2024-04-26T23:42:45.536 INFO:tasks.workunit.client.1.smithi175.stdout:checking for main in -lm... yes 2024-04-26T23:42:45.578 INFO:tasks.workunit.client.1.smithi175.stdout:checking for main in -lpthread... yes 2024-04-26T23:42:45.579 INFO:tasks.workunit.client.1.smithi175.stdout:checking for ANSI C header files... (cached) yes 2024-04-26T23:42:45.610 INFO:tasks.workunit.client.1.smithi175.stdout:checking for sys/wait.h that is POSIX.1 compatible... yes 2024-04-26T23:42:45.662 INFO:tasks.workunit.client.1.smithi175.stdout:checking pthread.h usability... yes 2024-04-26T23:42:45.687 INFO:tasks.workunit.client.1.smithi175.stdout:checking pthread.h presence... yes 2024-04-26T23:42:45.687 INFO:tasks.workunit.client.1.smithi175.stdout:checking for pthread.h... yes 2024-04-26T23:42:45.746 INFO:tasks.workunit.client.1.smithi175.stdout:checking fcntl.h usability... yes 2024-04-26T23:42:45.762 INFO:tasks.workunit.client.1.smithi175.stdout:checking fcntl.h presence... yes 2024-04-26T23:42:45.762 INFO:tasks.workunit.client.1.smithi175.stdout:checking for fcntl.h... yes 2024-04-26T23:42:45.806 INFO:tasks.workunit.client.1.smithi175.stdout:checking limits.h usability... yes 2024-04-26T23:42:45.821 INFO:tasks.workunit.client.1.smithi175.stdout:checking limits.h presence... yes 2024-04-26T23:42:45.821 INFO:tasks.workunit.client.1.smithi175.stdout:checking for limits.h... yes 2024-04-26T23:42:45.834 INFO:tasks.workunit.client.1.smithi175.stdout:checking for stdint.h... (cached) yes 2024-04-26T23:42:45.869 INFO:tasks.workunit.client.1.smithi175.stdout:checking sys/time.h usability... yes 2024-04-26T23:42:45.884 INFO:tasks.workunit.client.1.smithi175.stdout:checking sys/time.h presence... yes 2024-04-26T23:42:45.884 INFO:tasks.workunit.client.1.smithi175.stdout:checking for sys/time.h... yes 2024-04-26T23:42:45.896 INFO:tasks.workunit.client.1.smithi175.stdout:checking for unistd.h... (cached) yes 2024-04-26T23:42:45.931 INFO:tasks.workunit.client.1.smithi175.stdout:checking sys/vfs.h usability... yes 2024-04-26T23:42:45.945 INFO:tasks.workunit.client.1.smithi175.stdout:checking sys/vfs.h presence... yes 2024-04-26T23:42:45.946 INFO:tasks.workunit.client.1.smithi175.stdout:checking for sys/vfs.h... yes 2024-04-26T23:42:45.992 INFO:tasks.workunit.client.1.smithi175.stdout:checking sys/limits.h usability... no 2024-04-26T23:42:46.017 INFO:tasks.workunit.client.1.smithi175.stdout:checking sys/limits.h presence... no 2024-04-26T23:42:46.017 INFO:tasks.workunit.client.1.smithi175.stdout:checking for sys/limits.h... no 2024-04-26T23:42:46.041 INFO:tasks.workunit.client.1.smithi175.stdout:checking for an ANSI C-conforming const... yes 2024-04-26T23:42:46.069 INFO:tasks.workunit.client.1.smithi175.stdout:checking whether time.h and sys/time.h may both be included... yes 2024-04-26T23:42:46.123 INFO:tasks.workunit.client.1.smithi175.stdout:checking for system... yes 2024-04-26T23:42:46.175 INFO:tasks.workunit.client.1.smithi175.stdout:checking for gettimeofday... yes 2024-04-26T23:42:46.226 INFO:tasks.workunit.client.1.smithi175.stdout:checking for mkdir... yes 2024-04-26T23:42:46.227 INFO:tasks.workunit.client.0.smithi088.stdout:checking whether build environment is sane... yes 2024-04-26T23:42:46.232 INFO:tasks.workunit.client.0.smithi088.stdout:checking for a thread-safe mkdir -p... /usr/bin/mkdir -p 2024-04-26T23:42:46.232 INFO:tasks.workunit.client.0.smithi088.stdout:checking for gawk... gawk 2024-04-26T23:42:46.251 INFO:tasks.workunit.client.0.smithi088.stdout:checking whether make sets $(MAKE)... yes 2024-04-26T23:42:46.278 INFO:tasks.workunit.client.1.smithi175.stdout:checking for strerror... yes 2024-04-26T23:42:46.278 INFO:tasks.workunit.client.0.smithi088.stdout:checking build system type... x86_64-unknown-linux-gnu 2024-04-26T23:42:46.278 INFO:tasks.workunit.client.0.smithi088.stdout:checking host system type... x86_64-unknown-linux-gnu 2024-04-26T23:42:46.288 INFO:tasks.workunit.client.0.smithi088.stdout:checking for style of include used by make... GNU 2024-04-26T23:42:46.293 INFO:tasks.workunit.client.0.smithi088.stdout:checking for gcc... gcc 2024-04-26T23:42:46.330 INFO:tasks.workunit.client.1.smithi175.stdout:checking for open64... yes 2024-04-26T23:42:46.374 INFO:tasks.workunit.client.0.smithi088.stdout:checking whether the C compiler works... yes 2024-04-26T23:42:46.374 INFO:tasks.workunit.client.0.smithi088.stdout:checking for C compiler default output file name... a.out 2024-04-26T23:42:46.384 INFO:tasks.workunit.client.1.smithi175.stdout:checking for stat64... yes 2024-04-26T23:42:46.415 INFO:tasks.workunit.client.0.smithi088.stdout:checking for suffix of executables... 2024-04-26T23:42:46.439 INFO:tasks.workunit.client.1.smithi175.stdout:checking for fseeko64... yes 2024-04-26T23:42:46.452 INFO:tasks.workunit.client.0.smithi088.stdout:checking whether we are cross compiling... no 2024-04-26T23:42:46.488 INFO:tasks.workunit.client.0.smithi088.stdout:checking for suffix of object files... o 2024-04-26T23:42:46.496 INFO:tasks.workunit.client.1.smithi175.stdout:checking for lrand48_r... yes 2024-04-26T23:42:46.512 INFO:tasks.workunit.client.0.smithi088.stdout:checking whether we are using the GNU C compiler... yes 2024-04-26T23:42:46.534 INFO:tasks.workunit.client.0.smithi088.stdout:checking whether gcc accepts -g... yes 2024-04-26T23:42:46.551 INFO:tasks.workunit.client.1.smithi175.stdout:checking for srand48_r... yes 2024-04-26T23:42:46.572 INFO:tasks.workunit.client.1.smithi175.stdout:configure: creating ./config.status 2024-04-26T23:42:46.577 INFO:tasks.workunit.client.0.smithi088.stdout:checking for gcc option to accept ISO C89... none needed 2024-04-26T23:42:46.628 INFO:tasks.workunit.client.1.smithi175.stdout: /bin/sh ./config.status 2024-04-26T23:42:46.667 INFO:tasks.workunit.client.0.smithi088.stdout:checking dependency style of gcc... gcc3 2024-04-26T23:42:46.669 INFO:tasks.workunit.client.1.smithi175.stdout:config.status: creating Makefile 2024-04-26T23:42:46.679 INFO:tasks.workunit.client.1.smithi175.stdout:config.status: creating config.h 2024-04-26T23:42:46.700 INFO:tasks.workunit.client.1.smithi175.stdout:config.status: executing depfiles commands 2024-04-26T23:42:46.708 INFO:tasks.workunit.client.0.smithi088.stdout:checking how to run the C preprocessor... gcc -E 2024-04-26T23:42:46.710 INFO:tasks.workunit.client.1.smithi175.stdout:config.status: executing default commands 2024-04-26T23:42:46.734 INFO:tasks.workunit.client.1.smithi175.stdout:cd . && /bin/sh /home/ubuntu/cephtest/mnt.1/client.1/tmp/ffsb/missing --run autoheader 2024-04-26T23:42:46.752 INFO:tasks.workunit.client.0.smithi088.stdout:checking for grep that handles long lines and -e... /usr/bin/grep 2024-04-26T23:42:46.753 INFO:tasks.workunit.client.0.smithi088.stdout:checking for egrep... /usr/bin/grep -E 2024-04-26T23:42:46.867 INFO:tasks.workunit.client.1.smithi175.stdout:rm -f stamp-h1 2024-04-26T23:42:46.868 INFO:tasks.workunit.client.1.smithi175.stdout:touch config.h.in 2024-04-26T23:42:46.870 INFO:tasks.workunit.client.1.smithi175.stdout:cd . && /bin/sh ./config.status config.h 2024-04-26T23:42:46.873 INFO:tasks.workunit.client.0.smithi088.stdout:checking for ANSI C header files... yes 2024-04-26T23:42:46.905 INFO:tasks.workunit.client.1.smithi175.stdout:config.status: creating config.h 2024-04-26T23:42:46.906 INFO:tasks.workunit.client.0.smithi088.stdout:checking for sys/types.h... yes 2024-04-26T23:42:46.930 INFO:tasks.workunit.client.1.smithi175.stdout:make all-am 2024-04-26T23:42:46.937 INFO:tasks.workunit.client.1.smithi175.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/mnt.1/client.1/tmp/ffsb' 2024-04-26T23:42:46.937 INFO:tasks.workunit.client.1.smithi175.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT fileops.o -MD -MP -MF .deps/fileops.Tpo -c -o fileops.o fileops.c 2024-04-26T23:42:46.942 INFO:tasks.workunit.client.0.smithi088.stdout:checking for sys/stat.h... yes 2024-04-26T23:42:46.977 INFO:tasks.workunit.client.0.smithi088.stdout:checking for stdlib.h... yes 2024-04-26T23:42:47.012 INFO:tasks.workunit.client.0.smithi088.stdout:checking for string.h... yes 2024-04-26T23:42:47.049 INFO:tasks.workunit.client.0.smithi088.stdout:checking for memory.h... yes 2024-04-26T23:42:47.085 INFO:tasks.workunit.client.0.smithi088.stdout:checking for strings.h... yes 2024-04-26T23:42:47.106 INFO:tasks.workunit.client.1.smithi175.stdout:mv -f .deps/fileops.Tpo .deps/fileops.Po 2024-04-26T23:42:47.110 INFO:tasks.workunit.client.1.smithi175.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT rand.o -MD -MP -MF .deps/rand.Tpo -c -o rand.o rand.c 2024-04-26T23:42:47.123 INFO:tasks.workunit.client.0.smithi088.stdout:checking for inttypes.h... yes 2024-04-26T23:42:47.160 INFO:tasks.workunit.client.0.smithi088.stdout:checking for stdint.h... yes 2024-04-26T23:42:47.195 INFO:tasks.workunit.client.1.smithi175.stdout:mv -f .deps/rand.Tpo .deps/rand.Po 2024-04-26T23:42:47.197 INFO:tasks.workunit.client.1.smithi175.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT main.o -MD -MP -MF .deps/main.Tpo -c -o main.o main.c 2024-04-26T23:42:47.198 INFO:tasks.workunit.client.0.smithi088.stdout:checking for unistd.h... yes 2024-04-26T23:42:47.243 INFO:tasks.workunit.client.0.smithi088.stdout:checking minix/config.h usability... no 2024-04-26T23:42:47.268 INFO:tasks.workunit.client.0.smithi088.stdout:checking minix/config.h presence... no 2024-04-26T23:42:47.268 INFO:tasks.workunit.client.0.smithi088.stdout:checking for minix/config.h... no 2024-04-26T23:42:47.277 INFO:tasks.workunit.client.1.smithi175.stdout:mv -f .deps/main.Tpo .deps/main.Po 2024-04-26T23:42:47.280 INFO:tasks.workunit.client.1.smithi175.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT fh.o -MD -MP -MF .deps/fh.Tpo -c -o fh.o fh.c 2024-04-26T23:42:47.304 INFO:tasks.workunit.client.0.smithi088.stdout:checking whether it is safe to define __EXTENSIONS__... yes 2024-04-26T23:42:47.304 INFO:tasks.workunit.client.0.smithi088.stdout:checking for gcc... (cached) gcc 2024-04-26T23:42:47.344 INFO:tasks.workunit.client.0.smithi088.stdout:checking whether we are using the GNU C compiler... (cached) yes 2024-04-26T23:42:47.344 INFO:tasks.workunit.client.0.smithi088.stdout:checking whether gcc accepts -g... (cached) yes 2024-04-26T23:42:47.345 INFO:tasks.workunit.client.0.smithi088.stdout:checking for gcc option to accept ISO C89... (cached) none needed 2024-04-26T23:42:47.345 INFO:tasks.workunit.client.0.smithi088.stdout:checking dependency style of gcc... (cached) gcc3 2024-04-26T23:42:47.368 INFO:tasks.workunit.client.1.smithi175.stdout:mv -f .deps/fh.Tpo .deps/fh.Po 2024-04-26T23:42:47.371 INFO:tasks.workunit.client.1.smithi175.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT filelist.o -MD -MP -MF .deps/filelist.Tpo -c -o filelist.o filelist.c 2024-04-26T23:42:47.386 INFO:tasks.workunit.client.0.smithi088.stdout:checking for main in -lm... yes 2024-04-26T23:42:47.429 INFO:tasks.workunit.client.0.smithi088.stdout:checking for main in -lpthread... yes 2024-04-26T23:42:47.431 INFO:tasks.workunit.client.0.smithi088.stdout:checking for ANSI C header files... (cached) yes 2024-04-26T23:42:47.464 INFO:tasks.workunit.client.0.smithi088.stdout:checking for sys/wait.h that is POSIX.1 compatible... yes 2024-04-26T23:42:47.484 INFO:tasks.workunit.client.1.smithi175.stdout:mv -f .deps/filelist.Tpo .deps/filelist.Po 2024-04-26T23:42:47.487 INFO:tasks.workunit.client.1.smithi175.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT metaops.o -MD -MP -MF .deps/metaops.Tpo -c -o metaops.o metaops.c 2024-04-26T23:42:47.512 INFO:tasks.workunit.client.0.smithi088.stdout:checking pthread.h usability... yes 2024-04-26T23:42:47.531 INFO:tasks.workunit.client.0.smithi088.stdout:checking pthread.h presence... yes 2024-04-26T23:42:47.531 INFO:tasks.workunit.client.0.smithi088.stdout:checking for pthread.h... yes 2024-04-26T23:42:47.533 INFO:tasks.workunit.client.1.smithi175.stdout:mv -f .deps/metaops.Tpo .deps/metaops.Po 2024-04-26T23:42:47.535 INFO:tasks.workunit.client.1.smithi175.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT rwlock.o -MD -MP -MF .deps/rwlock.Tpo -c -o rwlock.o rwlock.c 2024-04-26T23:42:47.576 INFO:tasks.workunit.client.1.smithi175.stdout:mv -f .deps/rwlock.Tpo .deps/rwlock.Po 2024-04-26T23:42:47.577 INFO:tasks.workunit.client.0.smithi088.stdout:checking fcntl.h usability... yes 2024-04-26T23:42:47.579 INFO:tasks.workunit.client.1.smithi175.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT cirlist.o -MD -MP -MF .deps/cirlist.Tpo -c -o cirlist.o cirlist.c 2024-04-26T23:42:47.593 INFO:tasks.workunit.client.0.smithi088.stdout:checking fcntl.h presence... yes 2024-04-26T23:42:47.593 INFO:tasks.workunit.client.0.smithi088.stdout:checking for fcntl.h... yes 2024-04-26T23:42:47.625 INFO:tasks.workunit.client.1.smithi175.stdout:mv -f .deps/cirlist.Tpo .deps/cirlist.Po 2024-04-26T23:42:47.627 INFO:tasks.workunit.client.1.smithi175.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT rbt.o -MD -MP -MF .deps/rbt.Tpo -c -o rbt.o rbt.c 2024-04-26T23:42:47.638 INFO:tasks.workunit.client.0.smithi088.stdout:checking limits.h usability... yes 2024-04-26T23:42:47.653 INFO:tasks.workunit.client.0.smithi088.stdout:checking limits.h presence... yes 2024-04-26T23:42:47.653 INFO:tasks.workunit.client.0.smithi088.stdout:checking for limits.h... yes 2024-04-26T23:42:47.667 INFO:tasks.workunit.client.0.smithi088.stdout:checking for stdint.h... (cached) yes 2024-04-26T23:42:47.702 INFO:tasks.workunit.client.0.smithi088.stdout:checking sys/time.h usability... yes 2024-04-26T23:42:47.717 INFO:tasks.workunit.client.0.smithi088.stdout:checking sys/time.h presence... yes 2024-04-26T23:42:47.717 INFO:tasks.workunit.client.0.smithi088.stdout:checking for sys/time.h... yes 2024-04-26T23:42:47.733 INFO:tasks.workunit.client.0.smithi088.stdout:checking for unistd.h... (cached) yes 2024-04-26T23:42:47.771 INFO:tasks.workunit.client.0.smithi088.stdout:checking sys/vfs.h usability... yes 2024-04-26T23:42:47.789 INFO:tasks.workunit.client.0.smithi088.stdout:checking sys/vfs.h presence... yes 2024-04-26T23:42:47.790 INFO:tasks.workunit.client.0.smithi088.stdout:checking for sys/vfs.h... yes 2024-04-26T23:42:47.831 INFO:tasks.workunit.client.1.smithi175.stdout:mv -f .deps/rbt.Tpo .deps/rbt.Po 2024-04-26T23:42:47.834 INFO:tasks.workunit.client.1.smithi175.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_tg.o -MD -MP -MF .deps/ffsb_tg.Tpo -c -o ffsb_tg.o ffsb_tg.c 2024-04-26T23:42:47.837 INFO:tasks.workunit.client.0.smithi088.stdout:checking sys/limits.h usability... no 2024-04-26T23:42:47.864 INFO:tasks.workunit.client.0.smithi088.stdout:checking sys/limits.h presence... no 2024-04-26T23:42:47.865 INFO:tasks.workunit.client.0.smithi088.stdout:checking for sys/limits.h... no 2024-04-26T23:42:47.890 INFO:tasks.workunit.client.0.smithi088.stdout:checking for an ANSI C-conforming const... yes 2024-04-26T23:42:47.916 INFO:tasks.workunit.client.0.smithi088.stdout:checking whether time.h and sys/time.h may both be included... yes 2024-04-26T23:42:47.961 INFO:tasks.workunit.client.1.smithi175.stdout:mv -f .deps/ffsb_tg.Tpo .deps/ffsb_tg.Po 2024-04-26T23:42:47.963 INFO:tasks.workunit.client.1.smithi175.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_fs.o -MD -MP -MF .deps/ffsb_fs.Tpo -c -o ffsb_fs.o ffsb_fs.c 2024-04-26T23:42:47.976 INFO:tasks.workunit.client.0.smithi088.stdout:checking for system... yes 2024-04-26T23:42:48.029 INFO:tasks.workunit.client.0.smithi088.stdout:checking for gettimeofday... yes 2024-04-26T23:42:48.086 INFO:tasks.workunit.client.0.smithi088.stdout:checking for mkdir... yes 2024-04-26T23:42:48.104 INFO:tasks.workunit.client.1.smithi175.stdout:mv -f .deps/ffsb_fs.Tpo .deps/ffsb_fs.Po 2024-04-26T23:42:48.107 INFO:tasks.workunit.client.1.smithi175.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_thread.o -MD -MP -MF .deps/ffsb_thread.Tpo -c -o ffsb_thread.o ffsb_thread.c 2024-04-26T23:42:48.138 INFO:tasks.workunit.client.0.smithi088.stdout:checking for strerror... yes 2024-04-26T23:42:48.174 INFO:tasks.workunit.client.1.smithi175.stdout:mv -f .deps/ffsb_thread.Tpo .deps/ffsb_thread.Po 2024-04-26T23:42:48.177 INFO:tasks.workunit.client.1.smithi175.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_op.o -MD -MP -MF .deps/ffsb_op.Tpo -c -o ffsb_op.o ffsb_op.c 2024-04-26T23:42:48.198 INFO:tasks.workunit.client.0.smithi088.stdout:checking for open64... yes 2024-04-26T23:42:48.244 INFO:tasks.workunit.client.1.smithi175.stdout:mv -f .deps/ffsb_op.Tpo .deps/ffsb_op.Po 2024-04-26T23:42:48.246 INFO:tasks.workunit.client.1.smithi175.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT util.o -MD -MP -MF .deps/util.Tpo -c -o util.o util.c 2024-04-26T23:42:48.256 INFO:tasks.workunit.client.0.smithi088.stdout:checking for stat64... yes 2024-04-26T23:42:48.315 INFO:tasks.workunit.client.0.smithi088.stdout:checking for fseeko64... yes 2024-04-26T23:42:48.348 INFO:tasks.workunit.client.1.smithi175.stdout:mv -f .deps/util.Tpo .deps/util.Po 2024-04-26T23:42:48.350 INFO:tasks.workunit.client.1.smithi175.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT parser.o -MD -MP -MF .deps/parser.Tpo -c -o parser.o parser.c 2024-04-26T23:42:48.373 INFO:tasks.workunit.client.0.smithi088.stdout:checking for lrand48_r... yes 2024-04-26T23:42:48.378 INFO:tasks.workunit.client.1.smithi175.stderr:In file included from parser.h:22, 2024-04-26T23:42:48.379 INFO:tasks.workunit.client.1.smithi175.stderr: from parser.c:25: 2024-04-26T23:42:48.379 INFO:tasks.workunit.client.1.smithi175.stderr:parser.c: In function ‘init_filesys’: 2024-04-26T23:42:48.379 INFO:tasks.workunit.client.1.smithi175.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-04-26T23:42:48.379 INFO:tasks.workunit.client.1.smithi175.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-04-26T23:42:48.379 INFO:tasks.workunit.client.1.smithi175.stderr: | ^ 2024-04-26T23:42:48.379 INFO:tasks.workunit.client.1.smithi175.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-04-26T23:42:48.379 INFO:tasks.workunit.client.1.smithi175.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-04-26T23:42:48.379 INFO:tasks.workunit.client.1.smithi175.stderr: | ^~~~~~~~ 2024-04-26T23:42:48.379 INFO:tasks.workunit.client.1.smithi175.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-04-26T23:42:48.379 INFO:tasks.workunit.client.1.smithi175.stderr: 36 | container_of(ptr, type, member) 2024-04-26T23:42:48.379 INFO:tasks.workunit.client.1.smithi175.stderr: | ^~~~~~~~~~~~ 2024-04-26T23:42:48.379 INFO:tasks.workunit.client.1.smithi175.stderr:list.h:39:20: note: in expansion of macro ‘list_entry’ 2024-04-26T23:42:48.379 INFO:tasks.workunit.client.1.smithi175.stderr: 39 | for (pos = list_entry((head)->next, typeof(*pos), member); \ 2024-04-26T23:42:48.380 INFO:tasks.workunit.client.1.smithi175.stderr: | ^~~~~~~~~~ 2024-04-26T23:42:48.380 INFO:tasks.workunit.client.1.smithi175.stderr:parser.c:934:17: note: in expansion of macro ‘list_for_each_entry’ 2024-04-26T23:42:48.380 INFO:tasks.workunit.client.1.smithi175.stderr: 934 | list_for_each_entry(tmp_list, &list_head->list, list) 2024-04-26T23:42:48.380 INFO:tasks.workunit.client.1.smithi175.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-04-26T23:42:48.380 INFO:tasks.workunit.client.1.smithi175.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-04-26T23:42:48.380 INFO:tasks.workunit.client.1.smithi175.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-04-26T23:42:48.380 INFO:tasks.workunit.client.1.smithi175.stderr: | ^ 2024-04-26T23:42:48.380 INFO:tasks.workunit.client.1.smithi175.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-04-26T23:42:48.380 INFO:tasks.workunit.client.1.smithi175.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-04-26T23:42:48.380 INFO:tasks.workunit.client.1.smithi175.stderr: | ^~~~~~~~ 2024-04-26T23:42:48.380 INFO:tasks.workunit.client.1.smithi175.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-04-26T23:42:48.380 INFO:tasks.workunit.client.1.smithi175.stderr: 36 | container_of(ptr, type, member) 2024-04-26T23:42:48.380 INFO:tasks.workunit.client.1.smithi175.stderr: | ^~~~~~~~~~~~ 2024-04-26T23:42:48.380 INFO:tasks.workunit.client.1.smithi175.stderr:list.h:41:20: note: in expansion of macro ‘list_entry’ 2024-04-26T23:42:48.381 INFO:tasks.workunit.client.1.smithi175.stderr: 41 | pos = list_entry(pos->member.next, typeof(*pos), member)) 2024-04-26T23:42:48.381 INFO:tasks.workunit.client.1.smithi175.stderr: | ^~~~~~~~~~ 2024-04-26T23:42:48.381 INFO:tasks.workunit.client.1.smithi175.stderr:parser.c:934:17: note: in expansion of macro ‘list_for_each_entry’ 2024-04-26T23:42:48.381 INFO:tasks.workunit.client.1.smithi175.stderr: 934 | list_for_each_entry(tmp_list, &list_head->list, list) 2024-04-26T23:42:48.381 INFO:tasks.workunit.client.1.smithi175.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-04-26T23:42:48.381 INFO:tasks.workunit.client.1.smithi175.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-04-26T23:42:48.381 INFO:tasks.workunit.client.1.smithi175.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-04-26T23:42:48.381 INFO:tasks.workunit.client.1.smithi175.stderr: | ^ 2024-04-26T23:42:48.381 INFO:tasks.workunit.client.1.smithi175.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-04-26T23:42:48.381 INFO:tasks.workunit.client.1.smithi175.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-04-26T23:42:48.381 INFO:tasks.workunit.client.1.smithi175.stderr: | ^~~~~~~~ 2024-04-26T23:42:48.381 INFO:tasks.workunit.client.1.smithi175.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-04-26T23:42:48.381 INFO:tasks.workunit.client.1.smithi175.stderr: 36 | container_of(ptr, type, member) 2024-04-26T23:42:48.381 INFO:tasks.workunit.client.1.smithi175.stderr: | ^~~~~~~~~~~~ 2024-04-26T23:42:48.381 INFO:tasks.workunit.client.1.smithi175.stderr:list.h:39:20: note: in expansion of macro ‘list_entry’ 2024-04-26T23:42:48.382 INFO:tasks.workunit.client.1.smithi175.stderr: 39 | for (pos = list_entry((head)->next, typeof(*pos), member); \ 2024-04-26T23:42:48.382 INFO:tasks.workunit.client.1.smithi175.stderr: | ^~~~~~~~~~ 2024-04-26T23:42:48.382 INFO:tasks.workunit.client.1.smithi175.stderr:parser.c:941:17: note: in expansion of macro ‘list_for_each_entry’ 2024-04-26T23:42:48.382 INFO:tasks.workunit.client.1.smithi175.stderr: 941 | list_for_each_entry(tmp_list, &list_head->list, list) { 2024-04-26T23:42:48.382 INFO:tasks.workunit.client.1.smithi175.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-04-26T23:42:48.382 INFO:tasks.workunit.client.1.smithi175.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-04-26T23:42:48.382 INFO:tasks.workunit.client.1.smithi175.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-04-26T23:42:48.382 INFO:tasks.workunit.client.1.smithi175.stderr: | ^ 2024-04-26T23:42:48.382 INFO:tasks.workunit.client.1.smithi175.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-04-26T23:42:48.382 INFO:tasks.workunit.client.1.smithi175.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-04-26T23:42:48.382 INFO:tasks.workunit.client.1.smithi175.stderr: | ^~~~~~~~ 2024-04-26T23:42:48.382 INFO:tasks.workunit.client.1.smithi175.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-04-26T23:42:48.382 INFO:tasks.workunit.client.1.smithi175.stderr: 36 | container_of(ptr, type, member) 2024-04-26T23:42:48.382 INFO:tasks.workunit.client.1.smithi175.stderr: | ^~~~~~~~~~~~ 2024-04-26T23:42:48.383 INFO:tasks.workunit.client.1.smithi175.stderr:list.h:41:20: note: in expansion of macro ‘list_entry’ 2024-04-26T23:42:48.383 INFO:tasks.workunit.client.1.smithi175.stderr: 41 | pos = list_entry(pos->member.next, typeof(*pos), member)) 2024-04-26T23:42:48.383 INFO:tasks.workunit.client.1.smithi175.stderr: | ^~~~~~~~~~ 2024-04-26T23:42:48.383 INFO:tasks.workunit.client.1.smithi175.stderr:parser.c:941:17: note: in expansion of macro ‘list_for_each_entry’ 2024-04-26T23:42:48.383 INFO:tasks.workunit.client.1.smithi175.stderr: 941 | list_for_each_entry(tmp_list, &list_head->list, list) { 2024-04-26T23:42:48.383 INFO:tasks.workunit.client.1.smithi175.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-04-26T23:42:48.383 INFO:tasks.workunit.client.1.smithi175.stderr:parser.c: In function ‘init_tg_stats’: 2024-04-26T23:42:48.383 INFO:tasks.workunit.client.1.smithi175.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-04-26T23:42:48.383 INFO:tasks.workunit.client.1.smithi175.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-04-26T23:42:48.383 INFO:tasks.workunit.client.1.smithi175.stderr: | ^ 2024-04-26T23:42:48.383 INFO:tasks.workunit.client.1.smithi175.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-04-26T23:42:48.384 INFO:tasks.workunit.client.1.smithi175.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-04-26T23:42:48.384 INFO:tasks.workunit.client.1.smithi175.stderr: | ^~~~~~~~ 2024-04-26T23:42:48.384 INFO:tasks.workunit.client.1.smithi175.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-04-26T23:42:48.384 INFO:tasks.workunit.client.1.smithi175.stderr: 36 | container_of(ptr, type, member) 2024-04-26T23:42:48.384 INFO:tasks.workunit.client.1.smithi175.stderr: | ^~~~~~~~~~~~ 2024-04-26T23:42:48.384 INFO:tasks.workunit.client.1.smithi175.stderr:list.h:39:20: note: in expansion of macro ‘list_entry’ 2024-04-26T23:42:48.384 INFO:tasks.workunit.client.1.smithi175.stderr: 39 | for (pos = list_entry((head)->next, typeof(*pos), member); \ 2024-04-26T23:42:48.384 INFO:tasks.workunit.client.1.smithi175.stderr: | ^~~~~~~~~~ 2024-04-26T23:42:48.384 INFO:tasks.workunit.client.1.smithi175.stderr:parser.c:971:41: note: in expansion of macro ‘list_for_each_entry’ 2024-04-26T23:42:48.384 INFO:tasks.workunit.client.1.smithi175.stderr: 971 | list_for_each_entry(tmp_list, 2024-04-26T23:42:48.384 INFO:tasks.workunit.client.1.smithi175.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-04-26T23:42:48.384 INFO:tasks.workunit.client.1.smithi175.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-04-26T23:42:48.384 INFO:tasks.workunit.client.1.smithi175.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-04-26T23:42:48.384 INFO:tasks.workunit.client.1.smithi175.stderr: | ^ 2024-04-26T23:42:48.384 INFO:tasks.workunit.client.1.smithi175.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-04-26T23:42:48.385 INFO:tasks.workunit.client.1.smithi175.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-04-26T23:42:48.385 INFO:tasks.workunit.client.1.smithi175.stderr: | ^~~~~~~~ 2024-04-26T23:42:48.385 INFO:tasks.workunit.client.1.smithi175.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-04-26T23:42:48.385 INFO:tasks.workunit.client.1.smithi175.stderr: 36 | container_of(ptr, type, member) 2024-04-26T23:42:48.385 INFO:tasks.workunit.client.1.smithi175.stderr: | ^~~~~~~~~~~~ 2024-04-26T23:42:48.385 INFO:tasks.workunit.client.1.smithi175.stderr:list.h:41:20: note: in expansion of macro ‘list_entry’ 2024-04-26T23:42:48.385 INFO:tasks.workunit.client.1.smithi175.stderr: 41 | pos = list_entry(pos->member.next, typeof(*pos), member)) 2024-04-26T23:42:48.385 INFO:tasks.workunit.client.1.smithi175.stderr: | ^~~~~~~~~~ 2024-04-26T23:42:48.385 INFO:tasks.workunit.client.1.smithi175.stderr:parser.c:971:41: note: in expansion of macro ‘list_for_each_entry’ 2024-04-26T23:42:48.385 INFO:tasks.workunit.client.1.smithi175.stderr: 971 | list_for_each_entry(tmp_list, 2024-04-26T23:42:48.385 INFO:tasks.workunit.client.1.smithi175.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-04-26T23:42:48.385 INFO:tasks.workunit.client.1.smithi175.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-04-26T23:42:48.385 INFO:tasks.workunit.client.1.smithi175.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-04-26T23:42:48.385 INFO:tasks.workunit.client.1.smithi175.stderr: | ^ 2024-04-26T23:42:48.386 INFO:tasks.workunit.client.1.smithi175.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-04-26T23:42:48.386 INFO:tasks.workunit.client.1.smithi175.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-04-26T23:42:48.386 INFO:tasks.workunit.client.1.smithi175.stderr: | ^~~~~~~~ 2024-04-26T23:42:48.386 INFO:tasks.workunit.client.1.smithi175.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-04-26T23:42:48.386 INFO:tasks.workunit.client.1.smithi175.stderr: 36 | container_of(ptr, type, member) 2024-04-26T23:42:48.386 INFO:tasks.workunit.client.1.smithi175.stderr: | ^~~~~~~~~~~~ 2024-04-26T23:42:48.386 INFO:tasks.workunit.client.1.smithi175.stderr:list.h:39:20: note: in expansion of macro ‘list_entry’ 2024-04-26T23:42:48.386 INFO:tasks.workunit.client.1.smithi175.stderr: 39 | for (pos = list_entry((head)->next, typeof(*pos), member); \ 2024-04-26T23:42:48.386 INFO:tasks.workunit.client.1.smithi175.stderr: | ^~~~~~~~~~ 2024-04-26T23:42:48.386 INFO:tasks.workunit.client.1.smithi175.stderr:parser.c:980:41: note: in expansion of macro ‘list_for_each_entry’ 2024-04-26T23:42:48.386 INFO:tasks.workunit.client.1.smithi175.stderr: 980 | list_for_each_entry(tmp_list, 2024-04-26T23:42:48.386 INFO:tasks.workunit.client.1.smithi175.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-04-26T23:42:48.386 INFO:tasks.workunit.client.1.smithi175.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-04-26T23:42:48.386 INFO:tasks.workunit.client.1.smithi175.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-04-26T23:42:48.387 INFO:tasks.workunit.client.1.smithi175.stderr: | ^ 2024-04-26T23:42:48.387 INFO:tasks.workunit.client.1.smithi175.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-04-26T23:42:48.387 INFO:tasks.workunit.client.1.smithi175.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-04-26T23:42:48.387 INFO:tasks.workunit.client.1.smithi175.stderr: | ^~~~~~~~ 2024-04-26T23:42:48.387 INFO:tasks.workunit.client.1.smithi175.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-04-26T23:42:48.387 INFO:tasks.workunit.client.1.smithi175.stderr: 36 | container_of(ptr, type, member) 2024-04-26T23:42:48.387 INFO:tasks.workunit.client.1.smithi175.stderr: | ^~~~~~~~~~~~ 2024-04-26T23:42:48.387 INFO:tasks.workunit.client.1.smithi175.stderr:list.h:41:20: note: in expansion of macro ‘list_entry’ 2024-04-26T23:42:48.387 INFO:tasks.workunit.client.1.smithi175.stderr: 41 | pos = list_entry(pos->member.next, typeof(*pos), member)) 2024-04-26T23:42:48.387 INFO:tasks.workunit.client.1.smithi175.stderr: | ^~~~~~~~~~ 2024-04-26T23:42:48.387 INFO:tasks.workunit.client.1.smithi175.stderr:parser.c:980:41: note: in expansion of macro ‘list_for_each_entry’ 2024-04-26T23:42:48.387 INFO:tasks.workunit.client.1.smithi175.stderr: 980 | list_for_each_entry(tmp_list, 2024-04-26T23:42:48.388 INFO:tasks.workunit.client.1.smithi175.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-04-26T23:42:48.425 INFO:tasks.workunit.client.1.smithi175.stderr:parser.c: In function ‘get_optstr’: 2024-04-26T23:42:48.425 INFO:tasks.workunit.client.1.smithi175.stderr:parser.c:206:23: warning: ‘strnlen’ specified bound 4095 exceeds source size 1024 [-Wstringop-overread] 2024-04-26T23:42:48.425 INFO:tasks.workunit.client.1.smithi175.stderr: 206 | len = strnlen(temp, 4095) + 1; 2024-04-26T23:42:48.426 INFO:tasks.workunit.client.1.smithi175.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-04-26T23:42:48.426 INFO:tasks.workunit.client.1.smithi175.stderr:parser.c:200:14: note: source object declared here 2024-04-26T23:42:48.426 INFO:tasks.workunit.client.1.smithi175.stderr: 200 | char temp[BUFSIZE]; 2024-04-26T23:42:48.426 INFO:tasks.workunit.client.1.smithi175.stderr: | ^~~~ 2024-04-26T23:42:48.430 INFO:tasks.workunit.client.0.smithi088.stdout:checking for srand48_r... yes 2024-04-26T23:42:48.432 INFO:tasks.workunit.client.1.smithi175.stderr:parser.c: In function ‘size64_convert’: 2024-04-26T23:42:48.432 INFO:tasks.workunit.client.1.smithi175.stderr:parser.c:119:9: warning: ‘memcpy’ reading 3 bytes from a region of size 2 [-Wstringop-overread] 2024-04-26T23:42:48.432 INFO:tasks.workunit.client.1.smithi175.stderr: 119 | memcpy(unit, "\0", 3); 2024-04-26T23:42:48.432 INFO:tasks.workunit.client.1.smithi175.stderr: | ^~~~~~~~~~~~~~~~~~~~~ 2024-04-26T23:42:48.455 INFO:tasks.workunit.client.0.smithi088.stdout:configure: creating ./config.status 2024-04-26T23:42:48.518 INFO:tasks.workunit.client.0.smithi088.stdout: /bin/sh ./config.status 2024-04-26T23:42:48.565 INFO:tasks.workunit.client.0.smithi088.stdout:config.status: creating Makefile 2024-04-26T23:42:48.577 INFO:tasks.workunit.client.0.smithi088.stdout:config.status: creating config.h 2024-04-26T23:42:48.599 INFO:tasks.workunit.client.0.smithi088.stdout:config.status: executing depfiles commands 2024-04-26T23:42:48.609 INFO:tasks.workunit.client.0.smithi088.stdout:config.status: executing default commands 2024-04-26T23:42:48.630 INFO:tasks.workunit.client.0.smithi088.stdout:cd . && /bin/sh /home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb/missing --run autoheader 2024-04-26T23:42:48.731 INFO:tasks.workunit.client.1.smithi175.stdout:mv -f .deps/parser.Tpo .deps/parser.Po 2024-04-26T23:42:48.734 INFO:tasks.workunit.client.1.smithi175.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_fc.o -MD -MP -MF .deps/ffsb_fc.Tpo -c -o ffsb_fc.o ffsb_fc.c 2024-04-26T23:42:48.780 INFO:tasks.workunit.client.0.smithi088.stdout:rm -f stamp-h1 2024-04-26T23:42:48.782 INFO:tasks.workunit.client.0.smithi088.stdout:touch config.h.in 2024-04-26T23:42:48.783 INFO:tasks.workunit.client.0.smithi088.stdout:cd . && /bin/sh ./config.status config.h 2024-04-26T23:42:48.795 INFO:tasks.workunit.client.1.smithi175.stdout:mv -f .deps/ffsb_fc.Tpo .deps/ffsb_fc.Po 2024-04-26T23:42:48.797 INFO:tasks.workunit.client.1.smithi175.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_stats.o -MD -MP -MF .deps/ffsb_stats.Tpo -c -o ffsb_stats.o ffsb_stats.c 2024-04-26T23:42:48.821 INFO:tasks.workunit.client.0.smithi088.stdout:config.status: creating config.h 2024-04-26T23:42:48.847 INFO:tasks.workunit.client.0.smithi088.stdout:make all-am 2024-04-26T23:42:48.853 INFO:tasks.workunit.client.0.smithi088.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb' 2024-04-26T23:42:48.853 INFO:tasks.workunit.client.0.smithi088.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT fileops.o -MD -MP -MF .deps/fileops.Tpo -c -o fileops.o fileops.c 2024-04-26T23:42:48.886 INFO:tasks.workunit.client.1.smithi175.stdout:mv -f .deps/ffsb_stats.Tpo .deps/ffsb_stats.Po 2024-04-26T23:42:48.888 INFO:tasks.workunit.client.1.smithi175.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT list.o -MD -MP -MF .deps/list.Tpo -c -o list.o list.c 2024-04-26T23:42:48.918 INFO:tasks.workunit.client.1.smithi175.stdout:mv -f .deps/list.Tpo .deps/list.Po 2024-04-26T23:42:48.922 INFO:tasks.workunit.client.1.smithi175.stdout:gcc -D_GNU_SOURCE -g -O2 -D_REENTRANT -o ffsb fileops.o rand.o main.o fh.o filelist.o metaops.o rwlock.o cirlist.o rbt.o ffsb_tg.o ffsb_fs.o ffsb_thread.o ffsb_op.o util.o parser.o ffsb_fc.o ffsb_stats.o list.o -lpthread -lm 2024-04-26T23:42:48.954 INFO:tasks.workunit.client.1.smithi175.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/mnt.1/client.1/tmp/ffsb' 2024-04-26T23:42:48.955 INFO:tasks.workunit.client.1.smithi175.stderr:+ cd .. 2024-04-26T23:42:48.955 INFO:tasks.workunit.client.1.smithi175.stderr:+ mkdir tmp 2024-04-26T23:42:48.957 INFO:tasks.workunit.client.1.smithi175.stderr:+ cd tmp 2024-04-26T23:42:48.957 INFO:tasks.workunit.client.1.smithi175.stderr:+ for f in $mydir/*.ffsb 2024-04-26T23:42:48.957 INFO:tasks.workunit.client.1.smithi175.stderr:+ ../ffsb/ffsb /home/ubuntu/cephtest/clone.client.1/qa/workunits/suites/random_write.32.ffsb 2024-04-26T23:42:48.957 INFO:tasks.workunit.client.1.smithi175.stdout:FFSB version 6.0-RC2 started 2024-04-26T23:42:48.958 INFO:tasks.workunit.client.1.smithi175.stdout: 2024-04-26T23:42:48.960 INFO:tasks.workunit.client.1.smithi175.stdout:benchmark time = 300 2024-04-26T23:42:48.960 INFO:tasks.workunit.client.1.smithi175.stdout:ThreadGroup 0 2024-04-26T23:42:48.960 INFO:tasks.workunit.client.1.smithi175.stdout:================ 2024-04-26T23:42:48.960 INFO:tasks.workunit.client.1.smithi175.stdout: num_threads = 32 2024-04-26T23:42:48.960 INFO:tasks.workunit.client.1.smithi175.stdout: 2024-04-26T23:42:48.960 INFO:tasks.workunit.client.1.smithi175.stdout: read_random = off 2024-04-26T23:42:48.961 INFO:tasks.workunit.client.1.smithi175.stdout: read_size = 0 (0B) 2024-04-26T23:42:48.961 INFO:tasks.workunit.client.1.smithi175.stdout: read_blocksize = 0 (0B) 2024-04-26T23:42:48.961 INFO:tasks.workunit.client.1.smithi175.stdout: read_skip = off 2024-04-26T23:42:48.961 INFO:tasks.workunit.client.1.smithi175.stdout: read_skipsize = 0 (0B) 2024-04-26T23:42:48.961 INFO:tasks.workunit.client.1.smithi175.stdout: 2024-04-26T23:42:48.961 INFO:tasks.workunit.client.1.smithi175.stdout: write_random = on 2024-04-26T23:42:48.961 INFO:tasks.workunit.client.1.smithi175.stdout: write_size = 5242880 (5MB) 2024-04-26T23:42:48.961 INFO:tasks.workunit.client.1.smithi175.stdout: fsync_file = 0 2024-04-26T23:42:48.961 INFO:tasks.workunit.client.1.smithi175.stdout: write_blocksize = 4096 (4KB) 2024-04-26T23:42:48.961 INFO:tasks.workunit.client.1.smithi175.stdout: wait time = 0 2024-04-26T23:42:48.961 INFO:tasks.workunit.client.1.smithi175.stdout: 2024-04-26T23:42:48.961 INFO:tasks.workunit.client.1.smithi175.stdout: op weights 2024-04-26T23:42:48.961 INFO:tasks.workunit.client.1.smithi175.stdout: read = 0 (0.00%) 2024-04-26T23:42:48.961 INFO:tasks.workunit.client.1.smithi175.stdout: readall = 0 (0.00%) 2024-04-26T23:42:48.961 INFO:tasks.workunit.client.1.smithi175.stdout: write = 1 (100.00%) 2024-04-26T23:42:48.962 INFO:tasks.workunit.client.1.smithi175.stdout: create = 0 (0.00%) 2024-04-26T23:42:48.962 INFO:tasks.workunit.client.1.smithi175.stdout: append = 0 (0.00%) 2024-04-26T23:42:48.962 INFO:tasks.workunit.client.1.smithi175.stdout: delete = 0 (0.00%) 2024-04-26T23:42:48.962 INFO:tasks.workunit.client.1.smithi175.stdout: metaop = 0 (0.00%) 2024-04-26T23:42:48.962 INFO:tasks.workunit.client.1.smithi175.stdout: createdir = 0 (0.00%) 2024-04-26T23:42:48.962 INFO:tasks.workunit.client.1.smithi175.stdout: stat = 0 (0.00%) 2024-04-26T23:42:48.962 INFO:tasks.workunit.client.1.smithi175.stdout: writeall = 0 (0.00%) 2024-04-26T23:42:48.962 INFO:tasks.workunit.client.1.smithi175.stdout: writeall_fsync = 0 (0.00%) 2024-04-26T23:42:48.962 INFO:tasks.workunit.client.1.smithi175.stdout: open_close = 0 (0.00%) 2024-04-26T23:42:48.962 INFO:tasks.workunit.client.1.smithi175.stdout: write_fsync = 0 (0.00%) 2024-04-26T23:42:48.962 INFO:tasks.workunit.client.1.smithi175.stdout: create_fsync = 0 (0.00%) 2024-04-26T23:42:48.962 INFO:tasks.workunit.client.1.smithi175.stdout: append_fsync = 0 (0.00%) 2024-04-26T23:42:48.962 INFO:tasks.workunit.client.1.smithi175.stdout: 2024-04-26T23:42:48.962 INFO:tasks.workunit.client.1.smithi175.stdout:FileSystem . 2024-04-26T23:42:48.963 INFO:tasks.workunit.client.1.smithi175.stdout:========== 2024-04-26T23:42:48.963 INFO:tasks.workunit.client.1.smithi175.stdout: num_dirs = 0 2024-04-26T23:42:48.963 INFO:tasks.workunit.client.1.smithi175.stdout: starting files = 128 2024-04-26T23:42:48.963 INFO:tasks.workunit.client.1.smithi175.stdout: 2024-04-26T23:42:48.963 INFO:tasks.workunit.client.1.smithi175.stdout: min file size = 104857600 (100MB) 2024-04-26T23:42:48.963 INFO:tasks.workunit.client.1.smithi175.stdout: max file size = 104857600 (100MB) 2024-04-26T23:42:48.963 INFO:tasks.workunit.client.1.smithi175.stdout: directio = off 2024-04-26T23:42:48.963 INFO:tasks.workunit.client.1.smithi175.stdout: alignedio = on 2024-04-26T23:42:48.963 INFO:tasks.workunit.client.1.smithi175.stdout: bufferedio = off 2024-04-26T23:42:48.963 INFO:tasks.workunit.client.1.smithi175.stdout: 2024-04-26T23:42:48.963 INFO:tasks.workunit.client.1.smithi175.stdout: aging is off 2024-04-26T23:42:48.963 INFO:tasks.workunit.client.1.smithi175.stdout: current utilization = 0.00% 2024-04-26T23:42:48.963 INFO:tasks.workunit.client.1.smithi175.stdout: 2024-04-26T23:42:48.963 INFO:tasks.workunit.client.1.smithi175.stdout:checking existing fs: . 2024-04-26T23:42:48.964 INFO:tasks.workunit.client.1.smithi175.stdout:recreating new fileset 2024-04-26T23:42:48.964 INFO:tasks.workunit.client.1.smithi175.stderr:opendir: No such file or directory 2024-04-26T23:42:49.015 INFO:tasks.workunit.client.0.smithi088.stdout:mv -f .deps/fileops.Tpo .deps/fileops.Po 2024-04-26T23:42:49.019 INFO:tasks.workunit.client.0.smithi088.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT rand.o -MD -MP -MF .deps/rand.Tpo -c -o rand.o rand.c 2024-04-26T23:42:49.111 INFO:tasks.workunit.client.0.smithi088.stdout:mv -f .deps/rand.Tpo .deps/rand.Po 2024-04-26T23:42:49.114 INFO:tasks.workunit.client.0.smithi088.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT main.o -MD -MP -MF .deps/main.Tpo -c -o main.o main.c 2024-04-26T23:42:49.197 INFO:tasks.workunit.client.0.smithi088.stdout:mv -f .deps/main.Tpo .deps/main.Po 2024-04-26T23:42:49.200 INFO:tasks.workunit.client.0.smithi088.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT fh.o -MD -MP -MF .deps/fh.Tpo -c -o fh.o fh.c 2024-04-26T23:42:49.292 INFO:tasks.workunit.client.0.smithi088.stdout:mv -f .deps/fh.Tpo .deps/fh.Po 2024-04-26T23:42:49.295 INFO:tasks.workunit.client.0.smithi088.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT filelist.o -MD -MP -MF .deps/filelist.Tpo -c -o filelist.o filelist.c 2024-04-26T23:42:49.412 INFO:tasks.workunit.client.0.smithi088.stdout:mv -f .deps/filelist.Tpo .deps/filelist.Po 2024-04-26T23:42:49.415 INFO:tasks.workunit.client.0.smithi088.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT metaops.o -MD -MP -MF .deps/metaops.Tpo -c -o metaops.o metaops.c 2024-04-26T23:42:49.464 INFO:tasks.workunit.client.0.smithi088.stdout:mv -f .deps/metaops.Tpo .deps/metaops.Po 2024-04-26T23:42:49.466 INFO:tasks.workunit.client.0.smithi088.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT rwlock.o -MD -MP -MF .deps/rwlock.Tpo -c -o rwlock.o rwlock.c 2024-04-26T23:42:49.507 INFO:tasks.workunit.client.0.smithi088.stdout:mv -f .deps/rwlock.Tpo .deps/rwlock.Po 2024-04-26T23:42:49.511 INFO:tasks.workunit.client.0.smithi088.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT cirlist.o -MD -MP -MF .deps/cirlist.Tpo -c -o cirlist.o cirlist.c 2024-04-26T23:42:49.557 INFO:tasks.workunit.client.0.smithi088.stdout:mv -f .deps/cirlist.Tpo .deps/cirlist.Po 2024-04-26T23:42:49.561 INFO:tasks.workunit.client.0.smithi088.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT rbt.o -MD -MP -MF .deps/rbt.Tpo -c -o rbt.o rbt.c 2024-04-26T23:42:49.836 INFO:tasks.workunit.client.0.smithi088.stdout:mv -f .deps/rbt.Tpo .deps/rbt.Po 2024-04-26T23:42:49.838 INFO:tasks.workunit.client.0.smithi088.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_tg.o -MD -MP -MF .deps/ffsb_tg.Tpo -c -o ffsb_tg.o ffsb_tg.c 2024-04-26T23:42:49.973 INFO:tasks.workunit.client.0.smithi088.stdout:mv -f .deps/ffsb_tg.Tpo .deps/ffsb_tg.Po 2024-04-26T23:42:49.975 INFO:tasks.workunit.client.0.smithi088.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_fs.o -MD -MP -MF .deps/ffsb_fs.Tpo -c -o ffsb_fs.o ffsb_fs.c 2024-04-26T23:42:50.126 INFO:tasks.workunit.client.0.smithi088.stdout:mv -f .deps/ffsb_fs.Tpo .deps/ffsb_fs.Po 2024-04-26T23:42:50.128 INFO:tasks.workunit.client.0.smithi088.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_thread.o -MD -MP -MF .deps/ffsb_thread.Tpo -c -o ffsb_thread.o ffsb_thread.c 2024-04-26T23:42:50.195 INFO:tasks.workunit.client.0.smithi088.stdout:mv -f .deps/ffsb_thread.Tpo .deps/ffsb_thread.Po 2024-04-26T23:42:50.197 INFO:tasks.workunit.client.0.smithi088.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_op.o -MD -MP -MF .deps/ffsb_op.Tpo -c -o ffsb_op.o ffsb_op.c 2024-04-26T23:42:50.270 INFO:tasks.workunit.client.0.smithi088.stdout:mv -f .deps/ffsb_op.Tpo .deps/ffsb_op.Po 2024-04-26T23:42:50.274 INFO:tasks.workunit.client.0.smithi088.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT util.o -MD -MP -MF .deps/util.Tpo -c -o util.o util.c 2024-04-26T23:42:50.381 INFO:tasks.workunit.client.0.smithi088.stdout:mv -f .deps/util.Tpo .deps/util.Po 2024-04-26T23:42:50.385 INFO:tasks.workunit.client.0.smithi088.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT parser.o -MD -MP -MF .deps/parser.Tpo -c -o parser.o parser.c 2024-04-26T23:42:50.412 INFO:tasks.workunit.client.0.smithi088.stderr:In file included from parser.h:22, 2024-04-26T23:42:50.412 INFO:tasks.workunit.client.0.smithi088.stderr: from parser.c:25: 2024-04-26T23:42:50.413 INFO:tasks.workunit.client.0.smithi088.stderr:parser.c: In function ‘init_filesys’: 2024-04-26T23:42:50.413 INFO:tasks.workunit.client.0.smithi088.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-04-26T23:42:50.413 INFO:tasks.workunit.client.0.smithi088.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-04-26T23:42:50.413 INFO:tasks.workunit.client.0.smithi088.stderr: | ^ 2024-04-26T23:42:50.413 INFO:tasks.workunit.client.0.smithi088.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-04-26T23:42:50.413 INFO:tasks.workunit.client.0.smithi088.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-04-26T23:42:50.413 INFO:tasks.workunit.client.0.smithi088.stderr: | ^~~~~~~~ 2024-04-26T23:42:50.413 INFO:tasks.workunit.client.0.smithi088.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-04-26T23:42:50.413 INFO:tasks.workunit.client.0.smithi088.stderr: 36 | container_of(ptr, type, member) 2024-04-26T23:42:50.413 INFO:tasks.workunit.client.0.smithi088.stderr: | ^~~~~~~~~~~~ 2024-04-26T23:42:50.413 INFO:tasks.workunit.client.0.smithi088.stderr:list.h:39:20: note: in expansion of macro ‘list_entry’ 2024-04-26T23:42:50.413 INFO:tasks.workunit.client.0.smithi088.stderr: 39 | for (pos = list_entry((head)->next, typeof(*pos), member); \ 2024-04-26T23:42:50.413 INFO:tasks.workunit.client.0.smithi088.stderr: | ^~~~~~~~~~ 2024-04-26T23:42:50.414 INFO:tasks.workunit.client.0.smithi088.stderr:parser.c:934:17: note: in expansion of macro ‘list_for_each_entry’ 2024-04-26T23:42:50.414 INFO:tasks.workunit.client.0.smithi088.stderr: 934 | list_for_each_entry(tmp_list, &list_head->list, list) 2024-04-26T23:42:50.414 INFO:tasks.workunit.client.0.smithi088.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-04-26T23:42:50.414 INFO:tasks.workunit.client.0.smithi088.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-04-26T23:42:50.414 INFO:tasks.workunit.client.0.smithi088.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-04-26T23:42:50.414 INFO:tasks.workunit.client.0.smithi088.stderr: | ^ 2024-04-26T23:42:50.414 INFO:tasks.workunit.client.0.smithi088.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-04-26T23:42:50.414 INFO:tasks.workunit.client.0.smithi088.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-04-26T23:42:50.414 INFO:tasks.workunit.client.0.smithi088.stderr: | ^~~~~~~~ 2024-04-26T23:42:50.414 INFO:tasks.workunit.client.0.smithi088.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-04-26T23:42:50.414 INFO:tasks.workunit.client.0.smithi088.stderr: 36 | container_of(ptr, type, member) 2024-04-26T23:42:50.414 INFO:tasks.workunit.client.0.smithi088.stderr: | ^~~~~~~~~~~~ 2024-04-26T23:42:50.414 INFO:tasks.workunit.client.0.smithi088.stderr:list.h:41:20: note: in expansion of macro ‘list_entry’ 2024-04-26T23:42:50.414 INFO:tasks.workunit.client.0.smithi088.stderr: 41 | pos = list_entry(pos->member.next, typeof(*pos), member)) 2024-04-26T23:42:50.415 INFO:tasks.workunit.client.0.smithi088.stderr: | ^~~~~~~~~~ 2024-04-26T23:42:50.415 INFO:tasks.workunit.client.0.smithi088.stderr:parser.c:934:17: note: in expansion of macro ‘list_for_each_entry’ 2024-04-26T23:42:50.415 INFO:tasks.workunit.client.0.smithi088.stderr: 934 | list_for_each_entry(tmp_list, &list_head->list, list) 2024-04-26T23:42:50.415 INFO:tasks.workunit.client.0.smithi088.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-04-26T23:42:50.415 INFO:tasks.workunit.client.0.smithi088.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-04-26T23:42:50.415 INFO:tasks.workunit.client.0.smithi088.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-04-26T23:42:50.415 INFO:tasks.workunit.client.0.smithi088.stderr: | ^ 2024-04-26T23:42:50.415 INFO:tasks.workunit.client.0.smithi088.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-04-26T23:42:50.415 INFO:tasks.workunit.client.0.smithi088.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-04-26T23:42:50.415 INFO:tasks.workunit.client.0.smithi088.stderr: | ^~~~~~~~ 2024-04-26T23:42:50.415 INFO:tasks.workunit.client.0.smithi088.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-04-26T23:42:50.415 INFO:tasks.workunit.client.0.smithi088.stderr: 36 | container_of(ptr, type, member) 2024-04-26T23:42:50.415 INFO:tasks.workunit.client.0.smithi088.stderr: | ^~~~~~~~~~~~ 2024-04-26T23:42:50.416 INFO:tasks.workunit.client.0.smithi088.stderr:list.h:39:20: note: in expansion of macro ‘list_entry’ 2024-04-26T23:42:50.416 INFO:tasks.workunit.client.0.smithi088.stderr: 39 | for (pos = list_entry((head)->next, typeof(*pos), member); \ 2024-04-26T23:42:50.416 INFO:tasks.workunit.client.0.smithi088.stderr: | ^~~~~~~~~~ 2024-04-26T23:42:50.416 INFO:tasks.workunit.client.0.smithi088.stderr:parser.c:941:17: note: in expansion of macro ‘list_for_each_entry’ 2024-04-26T23:42:50.416 INFO:tasks.workunit.client.0.smithi088.stderr: 941 | list_for_each_entry(tmp_list, &list_head->list, list) { 2024-04-26T23:42:50.416 INFO:tasks.workunit.client.0.smithi088.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-04-26T23:42:50.416 INFO:tasks.workunit.client.0.smithi088.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-04-26T23:42:50.416 INFO:tasks.workunit.client.0.smithi088.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-04-26T23:42:50.416 INFO:tasks.workunit.client.0.smithi088.stderr: | ^ 2024-04-26T23:42:50.416 INFO:tasks.workunit.client.0.smithi088.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-04-26T23:42:50.416 INFO:tasks.workunit.client.0.smithi088.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-04-26T23:42:50.416 INFO:tasks.workunit.client.0.smithi088.stderr: | ^~~~~~~~ 2024-04-26T23:42:50.416 INFO:tasks.workunit.client.0.smithi088.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-04-26T23:42:50.416 INFO:tasks.workunit.client.0.smithi088.stderr: 36 | container_of(ptr, type, member) 2024-04-26T23:42:50.417 INFO:tasks.workunit.client.0.smithi088.stderr: | ^~~~~~~~~~~~ 2024-04-26T23:42:50.417 INFO:tasks.workunit.client.0.smithi088.stderr:list.h:41:20: note: in expansion of macro ‘list_entry’ 2024-04-26T23:42:50.417 INFO:tasks.workunit.client.0.smithi088.stderr: 41 | pos = list_entry(pos->member.next, typeof(*pos), member)) 2024-04-26T23:42:50.417 INFO:tasks.workunit.client.0.smithi088.stderr: | ^~~~~~~~~~ 2024-04-26T23:42:50.417 INFO:tasks.workunit.client.0.smithi088.stderr:parser.c:941:17: note: in expansion of macro ‘list_for_each_entry’ 2024-04-26T23:42:50.417 INFO:tasks.workunit.client.0.smithi088.stderr: 941 | list_for_each_entry(tmp_list, &list_head->list, list) { 2024-04-26T23:42:50.417 INFO:tasks.workunit.client.0.smithi088.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-04-26T23:42:50.417 INFO:tasks.workunit.client.0.smithi088.stderr:parser.c: In function ‘init_tg_stats’: 2024-04-26T23:42:50.417 INFO:tasks.workunit.client.0.smithi088.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-04-26T23:42:50.417 INFO:tasks.workunit.client.0.smithi088.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-04-26T23:42:50.417 INFO:tasks.workunit.client.0.smithi088.stderr: | ^ 2024-04-26T23:42:50.417 INFO:tasks.workunit.client.0.smithi088.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-04-26T23:42:50.417 INFO:tasks.workunit.client.0.smithi088.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-04-26T23:42:50.417 INFO:tasks.workunit.client.0.smithi088.stderr: | ^~~~~~~~ 2024-04-26T23:42:50.418 INFO:tasks.workunit.client.0.smithi088.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-04-26T23:42:50.418 INFO:tasks.workunit.client.0.smithi088.stderr: 36 | container_of(ptr, type, member) 2024-04-26T23:42:50.418 INFO:tasks.workunit.client.0.smithi088.stderr: | ^~~~~~~~~~~~ 2024-04-26T23:42:50.418 INFO:tasks.workunit.client.0.smithi088.stderr:list.h:39:20: note: in expansion of macro ‘list_entry’ 2024-04-26T23:42:50.418 INFO:tasks.workunit.client.0.smithi088.stderr: 39 | for (pos = list_entry((head)->next, typeof(*pos), member); \ 2024-04-26T23:42:50.418 INFO:tasks.workunit.client.0.smithi088.stderr: | ^~~~~~~~~~ 2024-04-26T23:42:50.418 INFO:tasks.workunit.client.0.smithi088.stderr:parser.c:971:41: note: in expansion of macro ‘list_for_each_entry’ 2024-04-26T23:42:50.418 INFO:tasks.workunit.client.0.smithi088.stderr: 971 | list_for_each_entry(tmp_list, 2024-04-26T23:42:50.418 INFO:tasks.workunit.client.0.smithi088.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-04-26T23:42:50.418 INFO:tasks.workunit.client.0.smithi088.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-04-26T23:42:50.418 INFO:tasks.workunit.client.0.smithi088.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-04-26T23:42:50.418 INFO:tasks.workunit.client.0.smithi088.stderr: | ^ 2024-04-26T23:42:50.418 INFO:tasks.workunit.client.0.smithi088.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-04-26T23:42:50.418 INFO:tasks.workunit.client.0.smithi088.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-04-26T23:42:50.419 INFO:tasks.workunit.client.0.smithi088.stderr: | ^~~~~~~~ 2024-04-26T23:42:50.419 INFO:tasks.workunit.client.0.smithi088.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-04-26T23:42:50.419 INFO:tasks.workunit.client.0.smithi088.stderr: 36 | container_of(ptr, type, member) 2024-04-26T23:42:50.419 INFO:tasks.workunit.client.0.smithi088.stderr: | ^~~~~~~~~~~~ 2024-04-26T23:42:50.419 INFO:tasks.workunit.client.0.smithi088.stderr:list.h:41:20: note: in expansion of macro ‘list_entry’ 2024-04-26T23:42:50.419 INFO:tasks.workunit.client.0.smithi088.stderr: 41 | pos = list_entry(pos->member.next, typeof(*pos), member)) 2024-04-26T23:42:50.419 INFO:tasks.workunit.client.0.smithi088.stderr: | ^~~~~~~~~~ 2024-04-26T23:42:50.419 INFO:tasks.workunit.client.0.smithi088.stderr:parser.c:971:41: note: in expansion of macro ‘list_for_each_entry’ 2024-04-26T23:42:50.419 INFO:tasks.workunit.client.0.smithi088.stderr: 971 | list_for_each_entry(tmp_list, 2024-04-26T23:42:50.419 INFO:tasks.workunit.client.0.smithi088.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-04-26T23:42:50.419 INFO:tasks.workunit.client.0.smithi088.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-04-26T23:42:50.419 INFO:tasks.workunit.client.0.smithi088.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-04-26T23:42:50.419 INFO:tasks.workunit.client.0.smithi088.stderr: | ^ 2024-04-26T23:42:50.419 INFO:tasks.workunit.client.0.smithi088.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-04-26T23:42:50.420 INFO:tasks.workunit.client.0.smithi088.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-04-26T23:42:50.420 INFO:tasks.workunit.client.0.smithi088.stderr: | ^~~~~~~~ 2024-04-26T23:42:50.420 INFO:tasks.workunit.client.0.smithi088.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-04-26T23:42:50.420 INFO:tasks.workunit.client.0.smithi088.stderr: 36 | container_of(ptr, type, member) 2024-04-26T23:42:50.420 INFO:tasks.workunit.client.0.smithi088.stderr: | ^~~~~~~~~~~~ 2024-04-26T23:42:50.420 INFO:tasks.workunit.client.0.smithi088.stderr:list.h:39:20: note: in expansion of macro ‘list_entry’ 2024-04-26T23:42:50.420 INFO:tasks.workunit.client.0.smithi088.stderr: 39 | for (pos = list_entry((head)->next, typeof(*pos), member); \ 2024-04-26T23:42:50.420 INFO:tasks.workunit.client.0.smithi088.stderr: | ^~~~~~~~~~ 2024-04-26T23:42:50.420 INFO:tasks.workunit.client.0.smithi088.stderr:parser.c:980:41: note: in expansion of macro ‘list_for_each_entry’ 2024-04-26T23:42:50.420 INFO:tasks.workunit.client.0.smithi088.stderr: 980 | list_for_each_entry(tmp_list, 2024-04-26T23:42:50.420 INFO:tasks.workunit.client.0.smithi088.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-04-26T23:42:50.420 INFO:tasks.workunit.client.0.smithi088.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-04-26T23:42:50.420 INFO:tasks.workunit.client.0.smithi088.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-04-26T23:42:50.420 INFO:tasks.workunit.client.0.smithi088.stderr: | ^ 2024-04-26T23:42:50.421 INFO:tasks.workunit.client.0.smithi088.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-04-26T23:42:50.421 INFO:tasks.workunit.client.0.smithi088.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-04-26T23:42:50.421 INFO:tasks.workunit.client.0.smithi088.stderr: | ^~~~~~~~ 2024-04-26T23:42:50.421 INFO:tasks.workunit.client.0.smithi088.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-04-26T23:42:50.421 INFO:tasks.workunit.client.0.smithi088.stderr: 36 | container_of(ptr, type, member) 2024-04-26T23:42:50.421 INFO:tasks.workunit.client.0.smithi088.stderr: | ^~~~~~~~~~~~ 2024-04-26T23:42:50.421 INFO:tasks.workunit.client.0.smithi088.stderr:list.h:41:20: note: in expansion of macro ‘list_entry’ 2024-04-26T23:42:50.421 INFO:tasks.workunit.client.0.smithi088.stderr: 41 | pos = list_entry(pos->member.next, typeof(*pos), member)) 2024-04-26T23:42:50.421 INFO:tasks.workunit.client.0.smithi088.stderr: | ^~~~~~~~~~ 2024-04-26T23:42:50.421 INFO:tasks.workunit.client.0.smithi088.stderr:parser.c:980:41: note: in expansion of macro ‘list_for_each_entry’ 2024-04-26T23:42:50.421 INFO:tasks.workunit.client.0.smithi088.stderr: 980 | list_for_each_entry(tmp_list, 2024-04-26T23:42:50.421 INFO:tasks.workunit.client.0.smithi088.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-04-26T23:42:50.463 INFO:tasks.workunit.client.0.smithi088.stderr:parser.c: In function ‘get_optstr’: 2024-04-26T23:42:50.463 INFO:tasks.workunit.client.0.smithi088.stderr:parser.c:206:23: warning: ‘strnlen’ specified bound 4095 exceeds source size 1024 [-Wstringop-overread] 2024-04-26T23:42:50.463 INFO:tasks.workunit.client.0.smithi088.stderr: 206 | len = strnlen(temp, 4095) + 1; 2024-04-26T23:42:50.463 INFO:tasks.workunit.client.0.smithi088.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-04-26T23:42:50.463 INFO:tasks.workunit.client.0.smithi088.stderr:parser.c:200:14: note: source object declared here 2024-04-26T23:42:50.464 INFO:tasks.workunit.client.0.smithi088.stderr: 200 | char temp[BUFSIZE]; 2024-04-26T23:42:50.464 INFO:tasks.workunit.client.0.smithi088.stderr: | ^~~~ 2024-04-26T23:42:50.470 INFO:tasks.workunit.client.0.smithi088.stderr:parser.c: In function ‘size64_convert’: 2024-04-26T23:42:50.470 INFO:tasks.workunit.client.0.smithi088.stderr:parser.c:119:9: warning: ‘memcpy’ reading 3 bytes from a region of size 2 [-Wstringop-overread] 2024-04-26T23:42:50.470 INFO:tasks.workunit.client.0.smithi088.stderr: 119 | memcpy(unit, "\0", 3); 2024-04-26T23:42:50.470 INFO:tasks.workunit.client.0.smithi088.stderr: | ^~~~~~~~~~~~~~~~~~~~~ 2024-04-26T23:42:50.820 INFO:tasks.workunit.client.0.smithi088.stdout:mv -f .deps/parser.Tpo .deps/parser.Po 2024-04-26T23:42:50.824 INFO:tasks.workunit.client.0.smithi088.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_fc.o -MD -MP -MF .deps/ffsb_fc.Tpo -c -o ffsb_fc.o ffsb_fc.c 2024-04-26T23:42:50.891 INFO:tasks.workunit.client.0.smithi088.stdout:mv -f .deps/ffsb_fc.Tpo .deps/ffsb_fc.Po 2024-04-26T23:42:50.894 INFO:tasks.workunit.client.0.smithi088.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_stats.o -MD -MP -MF .deps/ffsb_stats.Tpo -c -o ffsb_stats.o ffsb_stats.c 2024-04-26T23:42:50.998 INFO:tasks.workunit.client.0.smithi088.stdout:mv -f .deps/ffsb_stats.Tpo .deps/ffsb_stats.Po 2024-04-26T23:42:51.002 INFO:tasks.workunit.client.0.smithi088.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT list.o -MD -MP -MF .deps/list.Tpo -c -o list.o list.c 2024-04-26T23:42:51.036 INFO:tasks.workunit.client.0.smithi088.stdout:mv -f .deps/list.Tpo .deps/list.Po 2024-04-26T23:42:51.041 INFO:tasks.workunit.client.0.smithi088.stdout:gcc -D_GNU_SOURCE -g -O2 -D_REENTRANT -o ffsb fileops.o rand.o main.o fh.o filelist.o metaops.o rwlock.o cirlist.o rbt.o ffsb_tg.o ffsb_fs.o ffsb_thread.o ffsb_op.o util.o parser.o ffsb_fc.o ffsb_stats.o list.o -lpthread -lm 2024-04-26T23:42:51.085 INFO:tasks.workunit.client.0.smithi088.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb' 2024-04-26T23:42:51.086 INFO:tasks.workunit.client.0.smithi088.stderr:+ cd .. 2024-04-26T23:42:51.086 INFO:tasks.workunit.client.0.smithi088.stderr:+ mkdir tmp 2024-04-26T23:42:51.088 INFO:tasks.workunit.client.0.smithi088.stderr:+ cd tmp 2024-04-26T23:42:51.088 INFO:tasks.workunit.client.0.smithi088.stderr:+ for f in $mydir/*.ffsb 2024-04-26T23:42:51.088 INFO:tasks.workunit.client.0.smithi088.stderr:+ ../ffsb/ffsb /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/random_write.32.ffsb 2024-04-26T23:42:51.088 INFO:tasks.workunit.client.0.smithi088.stdout:FFSB version 6.0-RC2 started 2024-04-26T23:42:51.088 INFO:tasks.workunit.client.0.smithi088.stdout: 2024-04-26T23:42:51.091 INFO:tasks.workunit.client.0.smithi088.stdout:benchmark time = 300 2024-04-26T23:42:51.091 INFO:tasks.workunit.client.0.smithi088.stdout:ThreadGroup 0 2024-04-26T23:42:51.091 INFO:tasks.workunit.client.0.smithi088.stdout:================ 2024-04-26T23:42:51.091 INFO:tasks.workunit.client.0.smithi088.stdout: num_threads = 32 2024-04-26T23:42:51.092 INFO:tasks.workunit.client.0.smithi088.stdout: 2024-04-26T23:42:51.092 INFO:tasks.workunit.client.0.smithi088.stdout: read_random = off 2024-04-26T23:42:51.092 INFO:tasks.workunit.client.0.smithi088.stdout: read_size = 0 (0B) 2024-04-26T23:42:51.092 INFO:tasks.workunit.client.0.smithi088.stdout: read_blocksize = 0 (0B) 2024-04-26T23:42:51.092 INFO:tasks.workunit.client.0.smithi088.stdout: read_skip = off 2024-04-26T23:42:51.092 INFO:tasks.workunit.client.0.smithi088.stdout: read_skipsize = 0 (0B) 2024-04-26T23:42:51.092 INFO:tasks.workunit.client.0.smithi088.stdout: 2024-04-26T23:42:51.092 INFO:tasks.workunit.client.0.smithi088.stdout: write_random = on 2024-04-26T23:42:51.092 INFO:tasks.workunit.client.0.smithi088.stdout: write_size = 5242880 (5MB) 2024-04-26T23:42:51.092 INFO:tasks.workunit.client.0.smithi088.stdout: fsync_file = 0 2024-04-26T23:42:51.092 INFO:tasks.workunit.client.0.smithi088.stdout: write_blocksize = 4096 (4KB) 2024-04-26T23:42:51.093 INFO:tasks.workunit.client.0.smithi088.stdout: wait time = 0 2024-04-26T23:42:51.093 INFO:tasks.workunit.client.0.smithi088.stdout: 2024-04-26T23:42:51.093 INFO:tasks.workunit.client.0.smithi088.stdout: op weights 2024-04-26T23:42:51.093 INFO:tasks.workunit.client.0.smithi088.stdout: read = 0 (0.00%) 2024-04-26T23:42:51.093 INFO:tasks.workunit.client.0.smithi088.stdout: readall = 0 (0.00%) 2024-04-26T23:42:51.093 INFO:tasks.workunit.client.0.smithi088.stdout: write = 1 (100.00%) 2024-04-26T23:42:51.093 INFO:tasks.workunit.client.0.smithi088.stdout: create = 0 (0.00%) 2024-04-26T23:42:51.093 INFO:tasks.workunit.client.0.smithi088.stdout: append = 0 (0.00%) 2024-04-26T23:42:51.093 INFO:tasks.workunit.client.0.smithi088.stdout: delete = 0 (0.00%) 2024-04-26T23:42:51.093 INFO:tasks.workunit.client.0.smithi088.stdout: metaop = 0 (0.00%) 2024-04-26T23:42:51.093 INFO:tasks.workunit.client.0.smithi088.stdout: createdir = 0 (0.00%) 2024-04-26T23:42:51.094 INFO:tasks.workunit.client.0.smithi088.stdout: stat = 0 (0.00%) 2024-04-26T23:42:51.094 INFO:tasks.workunit.client.0.smithi088.stdout: writeall = 0 (0.00%) 2024-04-26T23:42:51.094 INFO:tasks.workunit.client.0.smithi088.stdout: writeall_fsync = 0 (0.00%) 2024-04-26T23:42:51.094 INFO:tasks.workunit.client.0.smithi088.stdout: open_close = 0 (0.00%) 2024-04-26T23:42:51.094 INFO:tasks.workunit.client.0.smithi088.stdout: write_fsync = 0 (0.00%) 2024-04-26T23:42:51.094 INFO:tasks.workunit.client.0.smithi088.stdout: create_fsync = 0 (0.00%) 2024-04-26T23:42:51.094 INFO:tasks.workunit.client.0.smithi088.stdout: append_fsync = 0 (0.00%) 2024-04-26T23:42:51.094 INFO:tasks.workunit.client.0.smithi088.stdout: 2024-04-26T23:42:51.094 INFO:tasks.workunit.client.0.smithi088.stdout:FileSystem . 2024-04-26T23:42:51.094 INFO:tasks.workunit.client.0.smithi088.stdout:========== 2024-04-26T23:42:51.094 INFO:tasks.workunit.client.0.smithi088.stdout: num_dirs = 0 2024-04-26T23:42:51.094 INFO:tasks.workunit.client.0.smithi088.stdout: starting files = 128 2024-04-26T23:42:51.095 INFO:tasks.workunit.client.0.smithi088.stdout: 2024-04-26T23:42:51.095 INFO:tasks.workunit.client.0.smithi088.stdout: min file size = 104857600 (100MB) 2024-04-26T23:42:51.095 INFO:tasks.workunit.client.0.smithi088.stdout: max file size = 104857600 (100MB) 2024-04-26T23:42:51.095 INFO:tasks.workunit.client.0.smithi088.stdout: directio = off 2024-04-26T23:42:51.095 INFO:tasks.workunit.client.0.smithi088.stdout: alignedio = on 2024-04-26T23:42:51.095 INFO:tasks.workunit.client.0.smithi088.stdout: bufferedio = off 2024-04-26T23:42:51.095 INFO:tasks.workunit.client.0.smithi088.stdout: 2024-04-26T23:42:51.095 INFO:tasks.workunit.client.0.smithi088.stdout: aging is off 2024-04-26T23:42:51.095 INFO:tasks.workunit.client.0.smithi088.stdout: current utilization = 0.00% 2024-04-26T23:42:51.095 INFO:tasks.workunit.client.0.smithi088.stdout: 2024-04-26T23:42:51.095 INFO:tasks.workunit.client.0.smithi088.stdout:checking existing fs: . 2024-04-26T23:42:51.096 INFO:tasks.workunit.client.0.smithi088.stdout:recreating new fileset 2024-04-26T23:42:51.096 INFO:tasks.workunit.client.0.smithi088.stderr:opendir: No such file or directory 2024-04-26T23:42:54.364 INFO:tasks.mon_thrash.mon_thrasher:killing mon.c 2024-04-26T23:42:54.365 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.c 2024-04-26T23:42:54.365 INFO:tasks.ceph.mon.c:Restarting daemon 2024-04-26T23:42:54.365 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-04-26T23:42:54.368 INFO:tasks.ceph.mon.c:Started 2024-04-26T23:42:54.368 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-04-26T23:42:54.368 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-04-26T23:42:54.517 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:54.514+0000 7fe1d169c640 1 Processor -- start 2024-04-26T23:42:54.517 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:54.514+0000 7fe1d169c640 1 -- start start 2024-04-26T23:42:54.519 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:54.515+0000 7fe1d169c640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe1cc13ddd0 0x7fe1cc154b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:54.519 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:54.515+0000 7fe1d169c640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fe1cc070f70 0x7fe1cc0713e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:54.519 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:54.515+0000 7fe1d169c640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe1cc0707e0 con 0x7fe1cc071cc0 2024-04-26T23:42:54.519 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:54.515+0000 7fe1d169c640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7fe1cc071920 con 0x7fe1cc070f70 2024-04-26T23:42:54.519 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:54.515+0000 7fe1d169c640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fe1cc155450 con 0x7fe1cc13ddd0 2024-04-26T23:42:54.519 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:54.515+0000 7fe1cb7fe640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fe1cc070f70 0x7fe1cc0713e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:54.519 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:54.515+0000 7fe1cb7fe640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fe1cc070f70 0x7fe1cc0713e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:45740/0 (socket says 172.21.15.88:45740) 2024-04-26T23:42:54.519 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:54.515+0000 7fe1cb7fe640 1 -- 172.21.15.88:0/4242219516 learned_addr learned my addr 172.21.15.88:0/4242219516 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:42:54.519 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:54.515+0000 7fe1caffd640 1 --2- 172.21.15.88:0/4242219516 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe1cc13ddd0 0x7fe1cc154b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:54.519 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:54.515+0000 7fe1caffd640 1 -- 172.21.15.88:0/4242219516 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe1cc13ddd0 msgr2=0x7fe1cc154b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-26T23:42:54.519 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:54.515+0000 7fe1caffd640 1 -- 172.21.15.88:0/4242219516 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe1cc13ddd0 msgr2=0x7fe1cc154b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T23:42:54.520 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:54.515+0000 7fe1caffd640 1 --2- 172.21.15.88:0/4242219516 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe1cc13ddd0 0x7fe1cc154b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:42:54.520 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:54.515+0000 7fe1caffd640 1 --2- 172.21.15.88:0/4242219516 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe1cc13ddd0 0x7fe1cc154b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:42:54.520 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:54.515+0000 7fe1cb7fe640 1 -- 172.21.15.88:0/4242219516 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe1cc13ddd0 msgr2=0x7fe1cc154b00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T23:42:54.520 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:54.515+0000 7fe1cb7fe640 1 --2- 172.21.15.88:0/4242219516 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe1cc13ddd0 0x7fe1cc154b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:54.520 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:54.515+0000 7fe1cb7fe640 1 -- 172.21.15.88:0/4242219516 >> v1:172.21.15.88:6789/0 conn(0x7fe1cc071cc0 legacy=0x7fe1cc073700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:54.520 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:54.515+0000 7fe1cb7fe640 1 -- 172.21.15.88:0/4242219516 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1cc155730 con 0x7fe1cc070f70 2024-04-26T23:42:54.521 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:54.516+0000 7fe1cb7fe640 1 --2- 172.21.15.88:0/4242219516 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe1cc070f70 0x7fe1cc0713e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fe1c4009e50 tx=0x7fe1c402a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=529df4073589bc03 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:54.521 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:54.517+0000 7fe1ca7fc640 1 -- 172.21.15.88:0/4242219516 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1c4036070 con 0x7fe1cc070f70 2024-04-26T23:42:54.521 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:54.517+0000 7fe1ca7fc640 1 -- 172.21.15.88:0/4242219516 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1c4031600 con 0x7fe1cc070f70 2024-04-26T23:42:54.521 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:54.517+0000 7fe1ca7fc640 1 -- 172.21.15.88:0/4242219516 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1c40319d0 con 0x7fe1cc070f70 2024-04-26T23:42:54.522 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:54.517+0000 7fe1d169c640 1 -- 172.21.15.88:0/4242219516 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe1cc070f70 msgr2=0x7fe1cc0713e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:54.522 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:54.517+0000 7fe1d169c640 1 --2- 172.21.15.88:0/4242219516 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe1cc070f70 0x7fe1cc0713e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fe1c4009e50 tx=0x7fe1c402a680 comp rx=0 tx=0).stop 2024-04-26T23:42:54.522 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:54.517+0000 7fe1d169c640 1 -- 172.21.15.88:0/4242219516 shutdown_connections 2024-04-26T23:42:54.522 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:54.517+0000 7fe1d169c640 1 --2- 172.21.15.88:0/4242219516 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe1cc070f70 0x7fe1cc0713e0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:54.522 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:54.517+0000 7fe1d169c640 1 --2- 172.21.15.88:0/4242219516 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe1cc13ddd0 0x7fe1cc154b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:54.522 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:54.517+0000 7fe1d169c640 1 -- 172.21.15.88:0/4242219516 >> 172.21.15.88:0/4242219516 conn(0x7fe1cc0ca2f0 msgr2=0x7fe1cc0ca6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:54.522 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:54.518+0000 7fe1d169c640 1 -- 172.21.15.88:0/4242219516 shutdown_connections 2024-04-26T23:42:54.522 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:54.518+0000 7fe1d169c640 1 -- 172.21.15.88:0/4242219516 wait complete. 2024-04-26T23:42:54.525 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:54.519+0000 7fe1d169c640 1 Processor -- start 2024-04-26T23:42:54.525 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:54.519+0000 7fe1d169c640 1 -- start start 2024-04-26T23:42:54.525 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:54.520+0000 7fe1d169c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe1cc070f70 0x7fe1cc151c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:54.526 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:54.520+0000 7fe1d169c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe1cc071cc0 0x7fe1cc152150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:54.526 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:54.520+0000 7fe1d169c640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe1cc13ddd0 0x7fe1cc0ae430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:54.526 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:54.520+0000 7fe1d169c640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fe1cc073f90 con 0x7fe1cc071cc0 2024-04-26T23:42:54.526 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:54.520+0000 7fe1d169c640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fe1cc073e10 con 0x7fe1cc070f70 2024-04-26T23:42:54.526 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:54.520+0000 7fe1d169c640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fe1cc13e1b0 con 0x7fe1cc13ddd0 2024-04-26T23:42:54.526 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:54.520+0000 7fe1c27fc640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe1cc071cc0 0x7fe1cc152150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:54.526 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:54.520+0000 7fe1c27fc640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe1cc071cc0 0x7fe1cc152150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:45754/0 (socket says 172.21.15.88:45754) 2024-04-26T23:42:54.526 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:54.520+0000 7fe1c27fc640 1 -- 172.21.15.88:0/4075020679 learned_addr learned my addr 172.21.15.88:0/4075020679 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:42:54.526 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:54.520+0000 7fe1cb7fe640 1 --2- 172.21.15.88:0/4075020679 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe1cc13ddd0 0x7fe1cc0ae430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:54.526 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:54.520+0000 7fe1caffd640 1 --2- 172.21.15.88:0/4075020679 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe1cc070f70 0x7fe1cc151c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:54.526 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:54.520+0000 7fe1cb7fe640 1 -- 172.21.15.88:0/4075020679 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe1cc13ddd0 msgr2=0x7fe1cc0ae430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2024-04-26T23:42:54.526 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:54.520+0000 7fe1cb7fe640 1 -- 172.21.15.88:0/4075020679 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe1cc13ddd0 msgr2=0x7fe1cc0ae430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-26T23:42:54.526 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:54.520+0000 7fe1cb7fe640 1 --2- 172.21.15.88:0/4075020679 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe1cc13ddd0 0x7fe1cc0ae430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:42:54.527 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:54.520+0000 7fe1cb7fe640 1 --2- 172.21.15.88:0/4075020679 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe1cc13ddd0 0x7fe1cc0ae430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:42:54.527 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:54.520+0000 7fe1c27fc640 1 -- 172.21.15.88:0/4075020679 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe1cc13ddd0 msgr2=0x7fe1cc0ae430 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T23:42:54.527 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:54.520+0000 7fe1c27fc640 1 --2- 172.21.15.88:0/4075020679 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe1cc13ddd0 0x7fe1cc0ae430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:54.527 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:54.520+0000 7fe1c27fc640 1 -- 172.21.15.88:0/4075020679 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe1cc070f70 msgr2=0x7fe1cc151c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:54.527 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:54.520+0000 7fe1c27fc640 1 --2- 172.21.15.88:0/4075020679 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe1cc070f70 0x7fe1cc151c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:54.527 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:54.520+0000 7fe1c27fc640 1 -- 172.21.15.88:0/4075020679 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1cc1573c0 con 0x7fe1cc071cc0 2024-04-26T23:42:54.527 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:54.520+0000 7fe1c27fc640 1 --2- 172.21.15.88:0/4075020679 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe1cc071cc0 0x7fe1cc152150 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fe1b400c440 tx=0x7fe1b4001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:54.527 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:54.521+0000 7fe1c3fff640 1 -- 172.21.15.88:0/4075020679 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1b40052d0 con 0x7fe1cc071cc0 2024-04-26T23:42:54.527 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:54.521+0000 7fe1d169c640 1 -- 172.21.15.88:0/4075020679 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1cc1ecfe0 con 0x7fe1cc071cc0 2024-04-26T23:42:54.527 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:54.521+0000 7fe1c3fff640 1 -- 172.21.15.88:0/4075020679 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1b4005470 con 0x7fe1cc071cc0 2024-04-26T23:42:54.527 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:54.521+0000 7fe1c3fff640 1 -- 172.21.15.88:0/4075020679 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1b4007260 con 0x7fe1cc071cc0 2024-04-26T23:42:54.527 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:54.521+0000 7fe1d169c640 1 -- 172.21.15.88:0/4075020679 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1cc155ef0 con 0x7fe1cc071cc0 2024-04-26T23:42:54.527 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:54.521+0000 7fe1d169c640 1 -- 172.21.15.88:0/4075020679 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe1cc06cd70 con 0x7fe1cc071cc0 2024-04-26T23:42:54.527 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:54.522+0000 7fe1c3fff640 1 -- 172.21.15.88:0/4075020679 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe1b4007400 con 0x7fe1cc071cc0 2024-04-26T23:42:54.528 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:54.522+0000 7fe1c3fff640 1 --2- 172.21.15.88:0/4075020679 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fe1ac06c8f0 0x7fe1ac06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:42:54.528 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:54.522+0000 7fe1c3fff640 1 -- 172.21.15.88:0/4075020679 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6666+0+0 (secure 0 0 0) 0x7fe1b408b410 con 0x7fe1cc071cc0 2024-04-26T23:42:54.528 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:54.522+0000 7fe1caffd640 1 --2- 172.21.15.88:0/4075020679 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fe1ac06c8f0 0x7fe1ac06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:42:54.528 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:54.523+0000 7fe1caffd640 1 --2- 172.21.15.88:0/4075020679 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fe1ac06c8f0 0x7fe1ac06edb0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fe1bc006fd0 tx=0x7fe1bc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:42:54.530 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:54.527+0000 7fe1c3fff640 1 -- 172.21.15.88:0/4075020679 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fe1b4058db0 con 0x7fe1cc071cc0 2024-04-26T23:42:54.865 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:54.862+0000 7fe1d169c640 1 -- 172.21.15.88:0/4075020679 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fe1cc0507a0 con 0x7fe1cc071cc0 2024-04-26T23:42:59.894 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":20,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"555255e9-7ef9-4454-8dc9-35e96b70035c","modified":"2024-04-26T23:39:34.291658Z","created":"2024-04-26T23:39:34.291658Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:3300","nonce":0},{"type":"v1","addr":"172.21.15.175:6789","nonce":0}]},"addr":"172.21.15.175:6789/0","public_addr":"172.21.15.175:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:3301","nonce":0},{"type":"v1","addr":"172.21.15.175:6790","nonce":0}]},"addr":"172.21.15.175:6790/0","public_addr":"172.21.15.175:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-04-26T23:42:59.895 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:59.889+0000 7fe1c3fff640 1 -- 172.21.15.88:0/4075020679 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1558 (secure 0 0 0) 0x7fe1b405d0b0 con 0x7fe1cc071cc0 2024-04-26T23:42:59.897 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:59.892+0000 7fe1d169c640 1 -- 172.21.15.88:0/4075020679 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fe1ac06c8f0 msgr2=0x7fe1ac06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:59.897 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:59.892+0000 7fe1d169c640 1 --2- 172.21.15.88:0/4075020679 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fe1ac06c8f0 0x7fe1ac06edb0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fe1bc006fd0 tx=0x7fe1bc008040 comp rx=0 tx=0).stop 2024-04-26T23:42:59.897 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:59.892+0000 7fe1d169c640 1 -- 172.21.15.88:0/4075020679 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe1cc071cc0 msgr2=0x7fe1cc152150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:42:59.897 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:59.892+0000 7fe1d169c640 1 --2- 172.21.15.88:0/4075020679 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe1cc071cc0 0x7fe1cc152150 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fe1b400c440 tx=0x7fe1b4001e70 comp rx=0 tx=0).stop 2024-04-26T23:42:59.897 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:59.893+0000 7fe1d169c640 1 -- 172.21.15.88:0/4075020679 shutdown_connections 2024-04-26T23:42:59.897 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:59.893+0000 7fe1d169c640 1 --2- 172.21.15.88:0/4075020679 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fe1ac06c8f0 0x7fe1ac06edb0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:59.897 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:59.893+0000 7fe1d169c640 1 --2- 172.21.15.88:0/4075020679 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe1cc13ddd0 0x7fe1cc0ae430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:59.898 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:59.893+0000 7fe1d169c640 1 --2- 172.21.15.88:0/4075020679 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe1cc071cc0 0x7fe1cc152150 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:59.898 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:59.893+0000 7fe1d169c640 1 --2- 172.21.15.88:0/4075020679 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe1cc070f70 0x7fe1cc151c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:42:59.898 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:59.893+0000 7fe1d169c640 1 -- 172.21.15.88:0/4075020679 >> 172.21.15.88:0/4075020679 conn(0x7fe1cc0ca2f0 msgr2=0x7fe1cc0c7ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:42:59.898 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:59.893+0000 7fe1d169c640 1 -- 172.21.15.88:0/4075020679 shutdown_connections 2024-04-26T23:42:59.898 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:42:59.893+0000 7fe1d169c640 1 -- 172.21.15.88:0/4075020679 wait complete. 2024-04-26T23:43:02.911 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-04-26T23:43:03.044 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.040+0000 7f675542a640 1 Processor -- start 2024-04-26T23:43:03.044 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.040+0000 7f675542a640 1 -- start start 2024-04-26T23:43:03.047 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.041+0000 7f675542a640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f675015a360 0x7f675006d320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:03.047 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.041+0000 7f675542a640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f67500c3d10 con 0x7f6750150d20 2024-04-26T23:43:03.047 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.041+0000 7f675542a640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f675015a780 con 0x7f675006f790 2024-04-26T23:43:03.047 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.041+0000 7f675542a640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f6750157d90 con 0x7f675015a360 2024-04-26T23:43:03.047 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.041+0000 7f674effd640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f6750150d20 0x7f67500c32e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:49594/0 (socket says 172.21.15.88:49594) 2024-04-26T23:43:03.047 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.041+0000 7f674effd640 1 -- 172.21.15.88:0/2583152866 learned_addr learned my addr 172.21.15.88:0/2583152866 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-26T23:43:03.047 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.041+0000 7f674f7fe640 1 --2- 172.21.15.88:0/2583152866 >> v2:172.21.15.175:3300/0 conn(0x7f675015a360 0x7f675006d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:03.047 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.041+0000 7f674dffb640 1 -- 172.21.15.88:0/2583152866 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3478849068 0 0) 0x7f67500c3d10 con 0x7f6750150d20 2024-04-26T23:43:03.048 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.041+0000 7f674dffb640 1 -- 172.21.15.88:0/2583152866 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6738003520 con 0x7f6750150d20 2024-04-26T23:43:03.048 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.041+0000 7f674dffb640 1 -- 172.21.15.88:0/2583152866 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3706234064 0 0) 0x7f675015a780 con 0x7f675006f790 2024-04-26T23:43:03.048 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.041+0000 7f674dffb640 1 -- 172.21.15.88:0/2583152866 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f67500c3d10 con 0x7f675006f790 2024-04-26T23:43:03.048 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.041+0000 7f674dffb640 1 -- 172.21.15.88:0/2583152866 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3672329507 0 0) 0x7f6738003520 con 0x7f6750150d20 2024-04-26T23:43:03.048 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.041+0000 7f674dffb640 1 -- 172.21.15.88:0/2583152866 >> v2:172.21.15.175:3300/0 conn(0x7f675015a360 msgr2=0x7f675006d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:43:03.048 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.041+0000 7f674dffb640 1 --2- 172.21.15.88:0/2583152866 >> v2:172.21.15.175:3300/0 conn(0x7f675015a360 0x7f675006d320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:03.048 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.041+0000 7f674dffb640 1 -- 172.21.15.88:0/2583152866 >> v1:172.21.15.175:6789/0 conn(0x7f675006f790 legacy=0x7f6750157680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:03.048 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.041+0000 7f674dffb640 1 -- 172.21.15.88:0/2583152866 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67500c4290 con 0x7f6750150d20 2024-04-26T23:43:03.048 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.041+0000 7f674dffb640 1 -- 172.21.15.88:0/2583152866 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 356324787 0 0) 0x7f6740001670 con 0x7f6750150d20 2024-04-26T23:43:03.048 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.041+0000 7f674dffb640 1 -- 172.21.15.88:0/2583152866 >> v1:172.21.15.88:6789/0 conn(0x7f6750150d20 legacy=0x7f67500c32e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:03.048 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.041+0000 7f674dffb640 1 --2- 172.21.15.88:0/2583152866 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6738003b40 0x7f6738003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:03.048 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.042+0000 7f674dffb640 1 --2- 172.21.15.88:0/2583152866 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6738004800 0x7f6738004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:03.048 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.042+0000 7f674dffb640 1 --2- 172.21.15.88:0/2583152866 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f67380051c0 0x7f673800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:03.048 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.042+0000 7f674dffb640 1 -- 172.21.15.88:0/2583152866 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f6750157d90 con 0x7f6738003b40 2024-04-26T23:43:03.049 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.042+0000 7f674dffb640 1 -- 172.21.15.88:0/2583152866 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f673800c0f0 con 0x7f67380051c0 2024-04-26T23:43:03.049 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.042+0000 7f674dffb640 1 -- 172.21.15.88:0/2583152866 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f673800c2f0 con 0x7f6738004800 2024-04-26T23:43:03.049 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.042+0000 7f674effd640 1 --2- 172.21.15.88:0/2583152866 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6738003b40 0x7f6738003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:03.049 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.042+0000 7f674effd640 1 -- 172.21.15.88:0/2583152866 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6738004800 msgr2=0x7f6738004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:43:03.049 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.042+0000 7f674effd640 1 --2- 172.21.15.88:0/2583152866 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6738004800 0x7f6738004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:03.049 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.042+0000 7f674effd640 1 -- 172.21.15.88:0/2583152866 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f67380051c0 msgr2=0x7f673800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:43:03.049 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.042+0000 7f674effd640 1 --2- 172.21.15.88:0/2583152866 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f67380051c0 0x7f673800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:03.049 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.042+0000 7f674effd640 1 -- 172.21.15.88:0/2583152866 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6738003520 con 0x7f6738003b40 2024-04-26T23:43:03.049 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.042+0000 7f674f7fe640 1 -- 172.21.15.88:0/2583152866 reap_dead start 2024-04-26T23:43:03.049 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.043+0000 7f674effd640 1 --2- 172.21.15.88:0/2583152866 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6738003b40 0x7f6738003f40 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f674000c190 tx=0x7f6738005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5333cd000ee19df1 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:03.049 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.043+0000 7f674dffb640 1 -- 172.21.15.88:0/2583152866 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6740007cc0 con 0x7f6738003b40 2024-04-26T23:43:03.049 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.043+0000 7f674dffb640 1 -- 172.21.15.88:0/2583152866 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6740005af0 con 0x7f6738003b40 2024-04-26T23:43:03.049 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.043+0000 7f674dffb640 1 -- 172.21.15.88:0/2583152866 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6740007070 con 0x7f6738003b40 2024-04-26T23:43:03.050 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.044+0000 7f675542a640 1 -- 172.21.15.88:0/2583152866 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6738003b40 msgr2=0x7f6738003f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:03.050 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.044+0000 7f675542a640 1 --2- 172.21.15.88:0/2583152866 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6738003b40 0x7f6738003f40 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f674000c190 tx=0x7f6738005830 comp rx=0 tx=0).stop 2024-04-26T23:43:03.050 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.044+0000 7f675542a640 1 -- 172.21.15.88:0/2583152866 shutdown_connections 2024-04-26T23:43:03.051 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.044+0000 7f675542a640 1 --2- 172.21.15.88:0/2583152866 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6738003b40 0x7f6738003f40 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:03.051 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.044+0000 7f675542a640 1 -- 172.21.15.88:0/2583152866 >> 172.21.15.88:0/2583152866 conn(0x7f67500c5ce0 msgr2=0x7f67500c60f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:43:03.051 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.044+0000 7f675542a640 1 -- 172.21.15.88:0/2583152866 shutdown_connections 2024-04-26T23:43:03.051 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.044+0000 7f675542a640 1 -- 172.21.15.88:0/2583152866 wait complete. 2024-04-26T23:43:03.051 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.045+0000 7f675542a640 1 Processor -- start 2024-04-26T23:43:03.051 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.046+0000 7f675542a640 1 -- start start 2024-04-26T23:43:03.053 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.047+0000 7f675542a640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6738003b40 0x7f67500c8090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:03.053 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.047+0000 7f675542a640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f67500c8ba0 0x7f67501ec810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:03.053 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.047+0000 7f675542a640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f67501ecd50 0x7f6750072770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:03.053 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.047+0000 7f675542a640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f6750157160 con 0x7f6738003b40 2024-04-26T23:43:03.054 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.047+0000 7f675542a640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f6750156e80 con 0x7f67500c8ba0 2024-04-26T23:43:03.054 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.047+0000 7f675542a640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f6750151100 con 0x7f67501ecd50 2024-04-26T23:43:03.054 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.047+0000 7f674effd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6738003b40 0x7f67500c8090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:03.054 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.047+0000 7f674effd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6738003b40 0x7f67500c8090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:46166/0 (socket says 172.21.15.88:46166) 2024-04-26T23:43:03.054 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.047+0000 7f674effd640 1 -- 172.21.15.88:0/175541441 learned_addr learned my addr 172.21.15.88:0/175541441 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:43:03.054 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.047+0000 7f674e7fc640 1 --2- 172.21.15.88:0/175541441 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f67500c8ba0 0x7f67501ec810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:03.054 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.047+0000 7f674f7fe640 1 --2- 172.21.15.88:0/175541441 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f67501ecd50 0x7f6750072770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:03.054 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.047+0000 7f674effd640 1 -- 172.21.15.88:0/175541441 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f67501ecd50 msgr2=0x7f6750072770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:03.054 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.047+0000 7f674effd640 1 --2- 172.21.15.88:0/175541441 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f67501ecd50 0x7f6750072770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:03.054 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.047+0000 7f674effd640 1 -- 172.21.15.88:0/175541441 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f67500c8ba0 msgr2=0x7f67501ec810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:03.054 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.047+0000 7f674effd640 1 --2- 172.21.15.88:0/175541441 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f67500c8ba0 0x7f67501ec810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:03.054 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.047+0000 7f674effd640 1 -- 172.21.15.88:0/175541441 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67501f0830 con 0x7f6738003b40 2024-04-26T23:43:03.054 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.048+0000 7f674effd640 1 --2- 172.21.15.88:0/175541441 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6738003b40 0x7f67500c8090 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f674000c1f0 tx=0x7f6750156d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:03.055 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.048+0000 7f67377fe640 1 -- 172.21.15.88:0/175541441 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6740040030 con 0x7f6738003b40 2024-04-26T23:43:03.055 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.048+0000 7f67377fe640 1 -- 172.21.15.88:0/175541441 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6740005da0 con 0x7f6738003b40 2024-04-26T23:43:03.055 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.048+0000 7f67377fe640 1 -- 172.21.15.88:0/175541441 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6740037040 con 0x7f6738003b40 2024-04-26T23:43:03.055 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.048+0000 7f675542a640 1 -- 172.21.15.88:0/175541441 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6750074010 con 0x7f6738003b40 2024-04-26T23:43:03.055 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.048+0000 7f675542a640 1 -- 172.21.15.88:0/175541441 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67501f0ad0 con 0x7f6738003b40 2024-04-26T23:43:03.056 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.050+0000 7f675542a640 1 -- 172.21.15.88:0/175541441 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f67501573a0 con 0x7f6738003b40 2024-04-26T23:43:03.056 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.050+0000 7f67377fe640 1 -- 172.21.15.88:0/175541441 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6740043070 con 0x7f6738003b40 2024-04-26T23:43:03.056 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.051+0000 7f67377fe640 1 --2- 172.21.15.88:0/175541441 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f673c06c920 0x7f673c06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:03.056 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.051+0000 7f674e7fc640 1 --2- 172.21.15.88:0/175541441 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f673c06c920 0x7f673c06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:03.056 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.052+0000 7f67377fe640 1 -- 172.21.15.88:0/175541441 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6666+0+0 (secure 0 0 0) 0x7f67400ab520 con 0x7f6738003b40 2024-04-26T23:43:03.056 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.052+0000 7f674e7fc640 1 --2- 172.21.15.88:0/175541441 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f673c06c920 0x7f673c06ede0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f6750150300 tx=0x7f6744009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:03.061 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.058+0000 7f67377fe640 1 -- 172.21.15.88:0/175541441 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f67501573a0 con 0x7f6738003b40 2024-04-26T23:43:03.223 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:43:03.226 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:43:03.409 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.404+0000 7f675542a640 1 -- 172.21.15.88:0/175541441 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f67500507a0 con 0x7f6738003b40 2024-04-26T23:43:03.409 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.405+0000 7f67377fe640 1 -- 172.21.15.88:0/175541441 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1564 (secure 0 0 0) 0x7f6740079620 con 0x7f6738003b40 2024-04-26T23:43:03.409 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":22,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":2,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"555255e9-7ef9-4454-8dc9-35e96b70035c","modified":"2024-04-26T23:39:34.291658Z","created":"2024-04-26T23:39:34.291658Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:3300","nonce":0},{"type":"v1","addr":"172.21.15.175:6789","nonce":0}]},"addr":"172.21.15.175:6789/0","public_addr":"172.21.15.175:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:3301","nonce":0},{"type":"v1","addr":"172.21.15.175:6790","nonce":0}]},"addr":"172.21.15.175:6790/0","public_addr":"172.21.15.175:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-04-26T23:43:03.411 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.407+0000 7f675542a640 1 -- 172.21.15.88:0/175541441 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f673c06c920 msgr2=0x7f673c06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:03.411 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.407+0000 7f675542a640 1 --2- 172.21.15.88:0/175541441 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f673c06c920 0x7f673c06ede0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f6750150300 tx=0x7f6744009040 comp rx=0 tx=0).stop 2024-04-26T23:43:03.411 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.407+0000 7f675542a640 1 -- 172.21.15.88:0/175541441 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6738003b40 msgr2=0x7f67500c8090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:03.411 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.407+0000 7f675542a640 1 --2- 172.21.15.88:0/175541441 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6738003b40 0x7f67500c8090 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f674000c1f0 tx=0x7f6750156d70 comp rx=0 tx=0).stop 2024-04-26T23:43:03.411 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.407+0000 7f675542a640 1 -- 172.21.15.88:0/175541441 shutdown_connections 2024-04-26T23:43:03.412 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.407+0000 7f675542a640 1 --2- 172.21.15.88:0/175541441 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f673c06c920 0x7f673c06ede0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:03.412 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.407+0000 7f675542a640 1 --2- 172.21.15.88:0/175541441 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f67501ecd50 0x7f6750072770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:03.412 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.407+0000 7f675542a640 1 --2- 172.21.15.88:0/175541441 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f67500c8ba0 0x7f67501ec810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:03.412 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.407+0000 7f675542a640 1 --2- 172.21.15.88:0/175541441 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6738003b40 0x7f67500c8090 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:03.412 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.407+0000 7f675542a640 1 -- 172.21.15.88:0/175541441 >> 172.21.15.88:0/175541441 conn(0x7f67500c5ce0 msgr2=0x7f67501561d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:43:03.412 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.407+0000 7f675542a640 1 -- 172.21.15.88:0/175541441 shutdown_connections 2024-04-26T23:43:03.412 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.407+0000 7f675542a640 1 -- 172.21.15.88:0/175541441 wait complete. 2024-04-26T23:43:03.423 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-04-26T23:43:03.423 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-04-26T23:43:03.423 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-04-26T23:43:03.601 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.597+0000 7fef42610640 1 Processor -- start 2024-04-26T23:43:03.603 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.599+0000 7fef42610640 1 -- start start 2024-04-26T23:43:03.607 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.602+0000 7fef42610640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fef3c154130 0x7fef3c156ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:03.608 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.602+0000 7fef42610640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fef3c159f80 0x7fef3c15a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:03.608 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.602+0000 7fef42610640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fef3c157930 con 0x7fef3c0ab170 2024-04-26T23:43:03.608 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.602+0000 7fef42610640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7fef3c06d630 con 0x7fef3c159f80 2024-04-26T23:43:03.608 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.602+0000 7fef42610640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7fef3c0ad070 con 0x7fef3c154130 2024-04-26T23:43:03.608 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.602+0000 7fef41e0f640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fef3c159f80 0x7fef3c15a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:03.608 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.602+0000 7fef41e0f640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fef3c159f80 0x7fef3c15a3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:46176/0 (socket says 172.21.15.88:46176) 2024-04-26T23:43:03.608 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.602+0000 7fef41e0f640 1 -- 172.21.15.88:0/2867809240 learned_addr learned my addr 172.21.15.88:0/2867809240 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:43:03.608 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.603+0000 7fef4160e640 1 --2- 172.21.15.88:0/2867809240 >> v2:172.21.15.175:3300/0 conn(0x7fef3c154130 0x7fef3c156ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:03.608 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.604+0000 7fef41e0f640 1 -- 172.21.15.88:0/2867809240 >> v2:172.21.15.175:3300/0 conn(0x7fef3c154130 msgr2=0x7fef3c156ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:43:03.609 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.604+0000 7fef41e0f640 1 --2- 172.21.15.88:0/2867809240 >> v2:172.21.15.175:3300/0 conn(0x7fef3c154130 0x7fef3c156ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:03.609 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.604+0000 7fef41e0f640 1 -- 172.21.15.88:0/2867809240 >> v1:172.21.15.175:6789/0 conn(0x7fef3c0ab170 legacy=0x7fef3c157220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:43:03.609 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.604+0000 7fef41e0f640 1 -- 172.21.15.88:0/2867809240 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef3c0ac880 con 0x7fef3c159f80 2024-04-26T23:43:03.609 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.605+0000 7fef41e0f640 1 --2- 172.21.15.88:0/2867809240 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fef3c159f80 0x7fef3c15a3d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fef3c076b90 tx=0x7fef3402a840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=195a478a86b4e931 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:03.610 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.606+0000 7fef33fff640 1 -- 172.21.15.88:0/2867809240 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef34037070 con 0x7fef3c159f80 2024-04-26T23:43:03.612 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.606+0000 7fef33fff640 1 -- 172.21.15.88:0/2867809240 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef340323f0 con 0x7fef3c159f80 2024-04-26T23:43:03.612 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.606+0000 7fef33fff640 1 -- 172.21.15.88:0/2867809240 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef34032800 con 0x7fef3c159f80 2024-04-26T23:43:03.612 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.607+0000 7fef42610640 1 -- 172.21.15.88:0/2867809240 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fef3c159f80 msgr2=0x7fef3c15a3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:03.613 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.607+0000 7fef42610640 1 --2- 172.21.15.88:0/2867809240 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fef3c159f80 0x7fef3c15a3d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fef3c076b90 tx=0x7fef3402a840 comp rx=0 tx=0).stop 2024-04-26T23:43:03.613 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.608+0000 7fef42610640 1 -- 172.21.15.88:0/2867809240 shutdown_connections 2024-04-26T23:43:03.614 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.608+0000 7fef42610640 1 --2- 172.21.15.88:0/2867809240 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fef3c159f80 0x7fef3c15a3d0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:03.614 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.608+0000 7fef42610640 1 --2- 172.21.15.88:0/2867809240 >> v2:172.21.15.175:3300/0 conn(0x7fef3c154130 0x7fef3c156ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:03.614 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.608+0000 7fef42610640 1 -- 172.21.15.88:0/2867809240 >> 172.21.15.88:0/2867809240 conn(0x7fef3c0c4bc0 msgr2=0x7fef3c0c4fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:43:03.614 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.608+0000 7fef42610640 1 -- 172.21.15.88:0/2867809240 shutdown_connections 2024-04-26T23:43:03.614 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.609+0000 7fef42610640 1 -- 172.21.15.88:0/2867809240 wait complete. 2024-04-26T23:43:03.619 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.612+0000 7fef42610640 1 Processor -- start 2024-04-26T23:43:03.619 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.613+0000 7fef42610640 1 -- start start 2024-04-26T23:43:03.619 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.614+0000 7fef42610640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fef3c0ab170 0x7fef3c1f9310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:03.619 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.614+0000 7fef42610640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fef3c154130 0x7fef3c1f9850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:03.619 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.614+0000 7fef42610640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fef3c159f80 0x7fef3c1dfdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:03.620 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.614+0000 7fef42610640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fef3c0ad610 con 0x7fef3c154130 2024-04-26T23:43:03.620 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.614+0000 7fef42610640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fef3c0ad330 con 0x7fef3c0ab170 2024-04-26T23:43:03.620 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.614+0000 7fef42610640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fef3c154510 con 0x7fef3c159f80 2024-04-26T23:43:03.620 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.614+0000 7fef40e0d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fef3c154130 0x7fef3c1f9850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:03.620 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.614+0000 7fef40e0d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fef3c154130 0x7fef3c1f9850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:46192/0 (socket says 172.21.15.88:46192) 2024-04-26T23:43:03.620 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.614+0000 7fef40e0d640 1 -- 172.21.15.88:0/3482339883 learned_addr learned my addr 172.21.15.88:0/3482339883 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:43:03.620 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.615+0000 7fef40e0d640 1 -- 172.21.15.88:0/3482339883 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fef3c159f80 msgr2=0x7fef3c1dfdd0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-26T23:43:03.620 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.615+0000 7fef40e0d640 1 --2- 172.21.15.88:0/3482339883 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fef3c159f80 0x7fef3c1dfdd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:03.620 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.615+0000 7fef40e0d640 1 -- 172.21.15.88:0/3482339883 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fef3c0ab170 msgr2=0x7fef3c1f9310 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-26T23:43:03.620 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.615+0000 7fef40e0d640 1 --2- 172.21.15.88:0/3482339883 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fef3c0ab170 0x7fef3c1f9310 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:03.620 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.615+0000 7fef40e0d640 1 -- 172.21.15.88:0/3482339883 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef3c1e1740 con 0x7fef3c154130 2024-04-26T23:43:03.620 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.615+0000 7fef40e0d640 1 --2- 172.21.15.88:0/3482339883 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fef3c154130 0x7fef3c1f9850 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fef3800c430 tx=0x7fef3800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:03.621 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.615+0000 7fef31ffb640 1 -- 172.21.15.88:0/3482339883 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef38011790 con 0x7fef3c154130 2024-04-26T23:43:03.621 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.615+0000 7fef31ffb640 1 -- 172.21.15.88:0/3482339883 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef38017070 con 0x7fef3c154130 2024-04-26T23:43:03.621 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.615+0000 7fef31ffb640 1 -- 172.21.15.88:0/3482339883 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef38011bb0 con 0x7fef3c154130 2024-04-26T23:43:03.621 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.616+0000 7fef42610640 1 -- 172.21.15.88:0/3482339883 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef3c0c67f0 con 0x7fef3c154130 2024-04-26T23:43:03.621 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.616+0000 7fef42610640 1 -- 172.21.15.88:0/3482339883 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef3c1f9d90 con 0x7fef3c154130 2024-04-26T23:43:03.622 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.618+0000 7fef42610640 1 --2- 172.21.15.88:0/3482339883 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fef3c1e0310 0x7fef3c1e06f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:03.622 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.618+0000 7fef42610640 1 -- 172.21.15.88:0/3482339883 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fef3c0506c0 con 0x7fef3c1e0310 2024-04-26T23:43:03.622 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.619+0000 7fef4160e640 1 --2- 172.21.15.88:0/3482339883 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fef3c1e0310 0x7fef3c1e06f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:03.623 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.619+0000 7fef4160e640 1 -- 172.21.15.88:0/3482339883 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fef3c06d410 con 0x7fef3c1e0310 2024-04-26T23:43:03.624 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.619+0000 7fef31ffb640 1 -- 172.21.15.88:0/3482339883 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fef3801c460 con 0x7fef3c154130 2024-04-26T23:43:03.624 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.619+0000 7fef4160e640 1 --2- 172.21.15.88:0/3482339883 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fef3c1e0310 0x7fef3c1e06f0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fef2c00e7a0 tx=0x7fef2c00ec60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:03.625 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.621+0000 7fef31ffb640 1 --2- 172.21.15.88:0/3482339883 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fef2006c8f0 0x7fef2006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:03.626 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.621+0000 7fef31ffb640 1 -- 172.21.15.88:0/3482339883 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef2c017070 con 0x7fef3c1e0310 2024-04-26T23:43:03.626 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.621+0000 7fef31ffb640 1 -- 172.21.15.88:0/3482339883 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6666+0+0 (secure 0 0 0) 0x7fef3808bc90 con 0x7fef3c154130 2024-04-26T23:43:03.626 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.621+0000 7fef31ffb640 1 -- 172.21.15.88:0/3482339883 <== mon.0 v2:172.21.15.88:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fef2c004020 con 0x7fef3c1e0310 2024-04-26T23:43:03.626 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.621+0000 7fef31ffb640 1 -- 172.21.15.88:0/3482339883 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fef3c1e0310 msgr2=0x7fef3c1e06f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:03.626 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.621+0000 7fef31ffb640 1 --2- 172.21.15.88:0/3482339883 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fef3c1e0310 0x7fef3c1e06f0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fef2c00e7a0 tx=0x7fef2c00ec60 comp rx=0 tx=0).stop 2024-04-26T23:43:03.626 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.621+0000 7fef31ffb640 1 -- 172.21.15.88:0/3482339883 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fef3c1e0310 msgr2=0x7fef3c1e06f0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:43:03.627 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.621+0000 7fef31ffb640 1 --2- 172.21.15.88:0/3482339883 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fef3c1e0310 0x7fef3c1e06f0 secure :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fef2c00e7a0 tx=0x7fef2c00ec60 comp rx=0 tx=0).stop 2024-04-26T23:43:03.627 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.623+0000 7fef41e0f640 1 --2- 172.21.15.88:0/3482339883 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fef2006c8f0 0x7fef2006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:03.627 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.623+0000 7fef41e0f640 1 --2- 172.21.15.88:0/3482339883 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fef2006c8f0 0x7fef2006edb0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fef34034000 tx=0x7fef34009000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:03.641 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.637+0000 7fef42610640 1 --2- 172.21.15.88:0/3482339883 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fef3c0c69c0 0x7fef3c1fc5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:03.641 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.637+0000 7fef42610640 1 -- 172.21.15.88:0/3482339883 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fef3c1e1180 con 0x7fef3c0c69c0 2024-04-26T23:43:03.641 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.637+0000 7fef4160e640 1 --2- 172.21.15.88:0/3482339883 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fef3c0c69c0 0x7fef3c1fc5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:03.642 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.638+0000 7fef4160e640 1 -- 172.21.15.88:0/3482339883 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fef3c1e1460 con 0x7fef3c0c69c0 2024-04-26T23:43:03.642 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.638+0000 7fef4160e640 1 --2- 172.21.15.88:0/3482339883 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fef3c0c69c0 0x7fef3c1fc5a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fef2c00e7a0 tx=0x7fef2c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:03.642 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.639+0000 7fef31ffb640 1 -- 172.21.15.88:0/3482339883 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef2c017040 con 0x7fef3c0c69c0 2024-04-26T23:43:03.643 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.639+0000 7fef31ffb640 1 -- 172.21.15.88:0/3482339883 <== mon.0 v2:172.21.15.88:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4869 (secure 0 0 0) 0x7fef2c005ba0 con 0x7fef3c0c69c0 2024-04-26T23:43:03.643 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-04-26T23:43:03.643 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2024-04-26T23:43:03.643 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2024-04-26T23:43:03.643 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "leader", 2024-04-26T23:43:03.644 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 22, 2024-04-26T23:43:03.644 INFO:teuthology.orchestra.run.smithi088.stdout: "uptime": 72612, 2024-04-26T23:43:03.644 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2024-04-26T23:43:03.644 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2024-04-26T23:43:03.644 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2024-04-26T23:43:03.644 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2024-04-26T23:43:03.644 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:43:03.644 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 2, 2024-04-26T23:43:03.644 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2024-04-26T23:43:03.644 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2450521708007866372", 2024-04-26T23:43:03.644 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2024-04-26T23:43:03.644 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-04-26T23:43:03.644 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-04-26T23:43:03.644 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-04-26T23:43:03.644 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-04-26T23:43:03.645 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-04-26T23:43:03.645 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-04-26T23:43:03.645 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-04-26T23:43:03.645 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-04-26T23:43:03.645 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-04-26T23:43:03.645 INFO:teuthology.orchestra.run.smithi088.stdout: "reef", 2024-04-26T23:43:03.645 INFO:teuthology.orchestra.run.smithi088.stdout: "squid" 2024-04-26T23:43:03.645 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:43:03.645 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540701547738038271", 2024-04-26T23:43:03.645 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2024-04-26T23:43:03.645 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-04-26T23:43:03.645 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-04-26T23:43:03.645 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-04-26T23:43:03.645 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-04-26T23:43:03.645 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-04-26T23:43:03.646 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-04-26T23:43:03.646 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-04-26T23:43:03.646 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-04-26T23:43:03.646 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-04-26T23:43:03.646 INFO:teuthology.orchestra.run.smithi088.stdout: "reef", 2024-04-26T23:43:03.646 INFO:teuthology.orchestra.run.smithi088.stdout: "squid" 2024-04-26T23:43:03.646 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:43:03.646 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:43:03.646 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2024-04-26T23:43:03.646 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2024-04-26T23:43:03.646 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2024-04-26T23:43:03.646 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2024-04-26T23:43:03.646 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2024-04-26T23:43:03.646 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "555255e9-7ef9-4454-8dc9-35e96b70035c", 2024-04-26T23:43:03.647 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2024-04-26T23:39:34.291658Z", 2024-04-26T23:43:03.647 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2024-04-26T23:39:34.291658Z", 2024-04-26T23:43:03.647 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 19, 2024-04-26T23:43:03.647 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "squid", 2024-04-26T23:43:03.647 INFO:teuthology.orchestra.run.smithi088.stdout: "election_strategy": 1, 2024-04-26T23:43:03.647 INFO:teuthology.orchestra.run.smithi088.stdout: "disallowed_leaders: ": "", 2024-04-26T23:43:03.647 INFO:teuthology.orchestra.run.smithi088.stdout: "stretch_mode": false, 2024-04-26T23:43:03.647 INFO:teuthology.orchestra.run.smithi088.stdout: "tiebreaker_mon": "", 2024-04-26T23:43:03.647 INFO:teuthology.orchestra.run.smithi088.stdout: "removed_ranks: ": "", 2024-04-26T23:43:03.647 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2024-04-26T23:43:03.647 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2024-04-26T23:43:03.647 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-04-26T23:43:03.647 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-04-26T23:43:03.647 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-04-26T23:43:03.648 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-04-26T23:43:03.648 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-04-26T23:43:03.648 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-04-26T23:43:03.648 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-04-26T23:43:03.648 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-04-26T23:43:03.648 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-04-26T23:43:03.648 INFO:teuthology.orchestra.run.smithi088.stdout: "reef", 2024-04-26T23:43:03.648 INFO:teuthology.orchestra.run.smithi088.stdout: "squid" 2024-04-26T23:43:03.648 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:43:03.648 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2024-04-26T23:43:03.648 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:43:03.648 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2024-04-26T23:43:03.648 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:43:03.648 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2024-04-26T23:43:03.649 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2024-04-26T23:43:03.649 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-04-26T23:43:03.649 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-04-26T23:43:03.649 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:43:03.649 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-04-26T23:43:03.649 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2024-04-26T23:43:03.649 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:43:03.649 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:43:03.649 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:43:03.649 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-04-26T23:43:03.649 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2024-04-26T23:43:03.649 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:43:03.649 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:43:03.649 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:43:03.649 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:43:03.650 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2024-04-26T23:43:03.650 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2024-04-26T23:43:03.650 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-04-26T23:43:03.650 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-04-26T23:43:03.650 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-04-26T23:43:03.650 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:43:03.650 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:43:03.650 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2024-04-26T23:43:03.650 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2024-04-26T23:43:03.650 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-04-26T23:43:03.650 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-04-26T23:43:03.650 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:43:03.650 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-04-26T23:43:03.650 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:3300", 2024-04-26T23:43:03.651 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:43:03.651 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:43:03.651 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:43:03.651 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-04-26T23:43:03.651 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6789", 2024-04-26T23:43:03.651 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:43:03.651 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:43:03.651 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:43:03.651 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:43:03.651 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6789/0", 2024-04-26T23:43:03.651 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.175:6789/0", 2024-04-26T23:43:03.651 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-04-26T23:43:03.651 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-04-26T23:43:03.651 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-04-26T23:43:03.652 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:43:03.652 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:43:03.652 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2024-04-26T23:43:03.652 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2024-04-26T23:43:03.652 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-04-26T23:43:03.652 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-04-26T23:43:03.652 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:43:03.652 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-04-26T23:43:03.652 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:3301", 2024-04-26T23:43:03.652 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:43:03.652 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:43:03.652 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:43:03.652 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-04-26T23:43:03.652 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6790", 2024-04-26T23:43:03.652 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:43:03.653 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:43:03.653 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:43:03.653 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:43:03.653 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6790/0", 2024-04-26T23:43:03.653 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.175:6790/0", 2024-04-26T23:43:03.653 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-04-26T23:43:03.653 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-04-26T23:43:03.653 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-04-26T23:43:03.653 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:43:03.653 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:43:03.653 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:43:03.653 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2024-04-26T23:43:03.653 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2024-04-26T23:43:03.653 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:43:03.653 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:43:03.654 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:43:03.654 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2024-04-26T23:43:03.654 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:43:03.654 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:43:03.654 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": [ 2024-04-26T23:43:03.654 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:43:03.654 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:43:03.654 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:43:03.654 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 3 2024-04-26T23:43:03.654 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:43:03.654 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:43:03.654 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2024-04-26T23:43:03.654 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:43:03.654 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x2f018fb87aa4aafe", 2024-04-26T23:43:03.654 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:43:03.655 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2024-04-26T23:43:03.655 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:43:03.655 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:43:03.655 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:43:03.655 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:43:03.655 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 3 2024-04-26T23:43:03.655 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:43:03.655 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:43:03.655 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:43:03.655 INFO:teuthology.orchestra.run.smithi088.stdout: "stretch_mode": false 2024-04-26T23:43:03.655 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-04-26T23:43:03.656 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.639+0000 7fef31ffb640 1 -- 172.21.15.88:0/3482339883 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fef3c0c69c0 msgr2=0x7fef3c1fc5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:03.656 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.639+0000 7fef31ffb640 1 --2- 172.21.15.88:0/3482339883 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fef3c0c69c0 0x7fef3c1fc5a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fef2c00e7a0 tx=0x7fef2c004730 comp rx=0 tx=0).stop 2024-04-26T23:43:03.657 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.639+0000 7fef31ffb640 1 -- 172.21.15.88:0/3482339883 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fef3c0c69c0 msgr2=0x7fef3c1fc5a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:43:03.657 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.639+0000 7fef31ffb640 1 --2- 172.21.15.88:0/3482339883 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fef3c0c69c0 0x7fef3c1fc5a0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:03.657 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.640+0000 7fef42610640 1 -- 172.21.15.88:0/3482339883 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fef2006c8f0 msgr2=0x7fef2006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:03.657 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.640+0000 7fef42610640 1 --2- 172.21.15.88:0/3482339883 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fef2006c8f0 0x7fef2006edb0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fef34034000 tx=0x7fef34009000 comp rx=0 tx=0).stop 2024-04-26T23:43:03.657 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.640+0000 7fef42610640 1 -- 172.21.15.88:0/3482339883 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fef3c154130 msgr2=0x7fef3c1f9850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:03.657 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.640+0000 7fef42610640 1 --2- 172.21.15.88:0/3482339883 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fef3c154130 0x7fef3c1f9850 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fef3800c430 tx=0x7fef3800c8f0 comp rx=0 tx=0).stop 2024-04-26T23:43:03.657 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.640+0000 7fef41e0f640 1 -- 172.21.15.88:0/3482339883 reap_dead start 2024-04-26T23:43:03.657 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.640+0000 7fef41e0f640 1 -- 172.21.15.88:0/3482339883 reap_dead start 2024-04-26T23:43:03.657 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.640+0000 7fef42610640 1 -- 172.21.15.88:0/3482339883 shutdown_connections 2024-04-26T23:43:03.657 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.640+0000 7fef42610640 1 -- 172.21.15.88:0/3482339883 >> 172.21.15.88:0/3482339883 conn(0x7fef3c0c4bc0 msgr2=0x7fef3c156b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:43:03.657 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.640+0000 7fef42610640 1 -- 172.21.15.88:0/3482339883 shutdown_connections 2024-04-26T23:43:03.657 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.640+0000 7fef42610640 1 -- 172.21.15.88:0/3482339883 wait complete. 2024-04-26T23:43:03.676 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-04-26T23:43:03.676 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-04-26T23:43:03.676 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-04-26T23:43:03.807 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.803+0000 7f6368c2a640 1 Processor -- start 2024-04-26T23:43:03.807 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.803+0000 7f6368c2a640 1 -- start start 2024-04-26T23:43:03.809 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.804+0000 7f6368c2a640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f6364154160 0x7f6364156bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:03.810 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.804+0000 7f6368c2a640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f63640ca5a0 0x7f636415a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:03.810 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.804+0000 7f6368c2a640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f63640c6e00 0x7f63640c7250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:03.810 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.804+0000 7f6368c2a640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f636415a6e0 con 0x7f63640ca5a0 2024-04-26T23:43:03.810 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.804+0000 7f6368c2a640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f63640c9100 con 0x7f6364154160 2024-04-26T23:43:03.810 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.804+0000 7f6368c2a640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f63640c8df0 con 0x7f63640c6e00 2024-04-26T23:43:03.810 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.804+0000 7f6361d9b640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f63640ca5a0 0x7f636415a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:03.810 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.804+0000 7f6361d9b640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f63640ca5a0 0x7f636415a1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:46224/0 (socket says 172.21.15.88:46224) 2024-04-26T23:43:03.810 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.804+0000 7f6361d9b640 1 -- 172.21.15.88:0/2206179824 learned_addr learned my addr 172.21.15.88:0/2206179824 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:43:03.810 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.804+0000 7f636259c640 1 --2- 172.21.15.88:0/2206179824 >> v2:172.21.15.175:3300/0 conn(0x7f6364154160 0x7f6364156bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:03.810 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.804+0000 7f6362d9d640 1 --2- 172.21.15.88:0/2206179824 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f63640c6e00 0x7f63640c7250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:03.811 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.804+0000 7f6362d9d640 1 -- 172.21.15.88:0/2206179824 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f63640c6e00 msgr2=0x7f63640c7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-26T23:43:03.811 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.804+0000 7f6362d9d640 1 -- 172.21.15.88:0/2206179824 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f63640c6e00 msgr2=0x7f63640c7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T23:43:03.811 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.804+0000 7f6362d9d640 1 --2- 172.21.15.88:0/2206179824 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f63640c6e00 0x7f63640c7250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:43:03.811 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.804+0000 7f6362d9d640 1 --2- 172.21.15.88:0/2206179824 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f63640c6e00 0x7f63640c7250 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:43:03.811 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.804+0000 7f6361d9b640 1 -- 172.21.15.88:0/2206179824 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f63640c6e00 msgr2=0x7f63640c7250 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T23:43:03.811 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.804+0000 7f6361d9b640 1 --2- 172.21.15.88:0/2206179824 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f63640c6e00 0x7f63640c7250 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:03.811 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.804+0000 7f6361d9b640 1 -- 172.21.15.88:0/2206179824 >> v2:172.21.15.175:3300/0 conn(0x7f6364154160 msgr2=0x7f6364156bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:43:03.811 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.804+0000 7f6361d9b640 1 --2- 172.21.15.88:0/2206179824 >> v2:172.21.15.175:3300/0 conn(0x7f6364154160 0x7f6364156bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:03.811 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.804+0000 7f6361d9b640 1 -- 172.21.15.88:0/2206179824 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6364154540 con 0x7f63640ca5a0 2024-04-26T23:43:03.811 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.805+0000 7f6361d9b640 1 --2- 172.21.15.88:0/2206179824 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f63640ca5a0 0x7f636415a1a0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f636406da80 tx=0x7f634c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2ae66bd44ff1db1 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:03.811 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.805+0000 7f636159a640 1 -- 172.21.15.88:0/2206179824 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f634c037070 con 0x7f63640ca5a0 2024-04-26T23:43:03.812 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.806+0000 7f636159a640 1 -- 172.21.15.88:0/2206179824 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f634c032440 con 0x7f63640ca5a0 2024-04-26T23:43:03.812 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.806+0000 7f636159a640 1 -- 172.21.15.88:0/2206179824 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f634c032810 con 0x7f63640ca5a0 2024-04-26T23:43:03.815 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.806+0000 7f6368c2a640 1 -- 172.21.15.88:0/2206179824 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f63640ca5a0 msgr2=0x7f636415a1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:03.815 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.806+0000 7f6368c2a640 1 --2- 172.21.15.88:0/2206179824 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f63640ca5a0 0x7f636415a1a0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f636406da80 tx=0x7f634c02a1e0 comp rx=0 tx=0).stop 2024-04-26T23:43:03.815 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.806+0000 7f6368c2a640 1 -- 172.21.15.88:0/2206179824 shutdown_connections 2024-04-26T23:43:03.815 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.806+0000 7f6368c2a640 1 --2- 172.21.15.88:0/2206179824 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f63640c6e00 0x7f63640c7250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:03.815 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.806+0000 7f6368c2a640 1 --2- 172.21.15.88:0/2206179824 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f63640ca5a0 0x7f636415a1a0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:03.815 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.806+0000 7f6368c2a640 1 --2- 172.21.15.88:0/2206179824 >> v2:172.21.15.175:3300/0 conn(0x7f6364154160 0x7f6364156bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:03.815 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.806+0000 7f6368c2a640 1 -- 172.21.15.88:0/2206179824 >> 172.21.15.88:0/2206179824 conn(0x7f63640ae010 msgr2=0x7f63640ae3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:43:03.815 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.806+0000 7f6368c2a640 1 -- 172.21.15.88:0/2206179824 shutdown_connections 2024-04-26T23:43:03.816 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.806+0000 7f6368c2a640 1 -- 172.21.15.88:0/2206179824 wait complete. 2024-04-26T23:43:03.816 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.808+0000 7f6368c2a640 1 Processor -- start 2024-04-26T23:43:03.816 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.808+0000 7f6368c2a640 1 -- start start 2024-04-26T23:43:03.816 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.809+0000 7f6368c2a640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f63640c6e00 0x7f63640c45b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:03.816 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.809+0000 7f6368c2a640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f63640ca5a0 0x7f63641f08c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:03.816 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.809+0000 7f6368c2a640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6364154160 0x7f63640ad790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:03.816 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.809+0000 7f6368c2a640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f636415aed0 con 0x7f6364154160 2024-04-26T23:43:03.816 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.809+0000 7f6368c2a640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f636415abf0 con 0x7f63640c6e00 2024-04-26T23:43:03.816 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.809+0000 7f6368c2a640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f63640c9590 con 0x7f63640ca5a0 2024-04-26T23:43:03.816 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.809+0000 7f6362d9d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6364154160 0x7f63640ad790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:03.816 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.809+0000 7f6362d9d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6364154160 0x7f63640ad790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:46236/0 (socket says 172.21.15.88:46236) 2024-04-26T23:43:03.816 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.809+0000 7f6362d9d640 1 -- 172.21.15.88:0/2480831510 learned_addr learned my addr 172.21.15.88:0/2480831510 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:43:03.816 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.809+0000 7f6362d9d640 1 -- 172.21.15.88:0/2480831510 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f63640ca5a0 msgr2=0x7f63641f08c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:03.816 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.809+0000 7f636259c640 1 --2- 172.21.15.88:0/2480831510 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f63640c6e00 0x7f63640c45b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:03.817 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.809+0000 7f6362d9d640 1 --2- 172.21.15.88:0/2480831510 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f63640ca5a0 0x7f63641f08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:03.817 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.809+0000 7f6362d9d640 1 -- 172.21.15.88:0/2480831510 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f63640c6e00 msgr2=0x7f63640c45b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:03.817 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.809+0000 7f6362d9d640 1 --2- 172.21.15.88:0/2480831510 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f63640c6e00 0x7f63640c45b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:03.817 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.809+0000 7f6362d9d640 1 -- 172.21.15.88:0/2480831510 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63641f0e00 con 0x7f6364154160 2024-04-26T23:43:03.817 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.810+0000 7f6362d9d640 1 --2- 172.21.15.88:0/2480831510 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6364154160 0x7f63640ad790 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f635c007e30 tx=0x7f635c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:03.817 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.810+0000 7f635affd640 1 -- 172.21.15.88:0/2480831510 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f635c014420 con 0x7f6364154160 2024-04-26T23:43:03.817 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.810+0000 7f635affd640 1 -- 172.21.15.88:0/2480831510 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f635c019070 con 0x7f6364154160 2024-04-26T23:43:03.817 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.810+0000 7f635affd640 1 -- 172.21.15.88:0/2480831510 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f635c014820 con 0x7f6364154160 2024-04-26T23:43:03.817 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.810+0000 7f6368c2a640 1 -- 172.21.15.88:0/2480831510 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63640c60c0 con 0x7f6364154160 2024-04-26T23:43:03.817 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.810+0000 7f6368c2a640 1 -- 172.21.15.88:0/2480831510 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63641f00c0 con 0x7f6364154160 2024-04-26T23:43:03.817 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.811+0000 7f6368c2a640 1 --2- 172.21.15.88:0/2480831510 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f63641f02c0 0x7f63641ec9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:03.817 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.811+0000 7f6368c2a640 1 -- 172.21.15.88:0/2480831510 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f63641f06a0 con 0x7f63641f02c0 2024-04-26T23:43:03.817 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.811+0000 7f636259c640 1 --2- 172.21.15.88:0/2480831510 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f63641f02c0 0x7f63641ec9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:03.817 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.811+0000 7f635affd640 1 -- 172.21.15.88:0/2480831510 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f635c0149c0 con 0x7f6364154160 2024-04-26T23:43:03.819 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.812+0000 7f636259c640 1 -- 172.21.15.88:0/2480831510 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f63640c65e0 con 0x7f63641f02c0 2024-04-26T23:43:03.819 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.812+0000 7f635affd640 1 --2- 172.21.15.88:0/2480831510 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f634406c8f0 0x7f634406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:03.819 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.812+0000 7f6361d9b640 1 --2- 172.21.15.88:0/2480831510 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f634406c8f0 0x7f634406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:03.819 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.812+0000 7f635affd640 1 -- 172.21.15.88:0/2480831510 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6666+0+0 (secure 0 0 0) 0x7f635c08c7b0 con 0x7f6364154160 2024-04-26T23:43:03.819 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.812+0000 7f636259c640 1 --2- 172.21.15.88:0/2480831510 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f63641f02c0 0x7f63641ec9b0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f6354010540 tx=0x7f6354010a00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:03.819 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.812+0000 7f635affd640 1 -- 172.21.15.88:0/2480831510 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f635400f040 con 0x7f63641f02c0 2024-04-26T23:43:03.819 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.812+0000 7f6361d9b640 1 --2- 172.21.15.88:0/2480831510 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f634406c8f0 0x7f634406edb0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f634c034000 tx=0x7f634c02c000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:03.819 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.813+0000 7f635affd640 1 -- 172.21.15.88:0/2480831510 <== mon.1 v2:172.21.15.175:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f635401c400 con 0x7f63641f02c0 2024-04-26T23:43:03.819 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.813+0000 7f635affd640 1 -- 172.21.15.88:0/2480831510 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f63641f02c0 msgr2=0x7f63641ec9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:03.820 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.813+0000 7f635affd640 1 --2- 172.21.15.88:0/2480831510 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f63641f02c0 0x7f63641ec9b0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f6354010540 tx=0x7f6354010a00 comp rx=0 tx=0).stop 2024-04-26T23:43:03.820 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.813+0000 7f635affd640 1 -- 172.21.15.88:0/2480831510 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f63641f02c0 msgr2=0x7f63641ec9b0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:43:03.820 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.813+0000 7f635affd640 1 --2- 172.21.15.88:0/2480831510 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f63641f02c0 0x7f63641ec9b0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:03.823 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.819+0000 7f6368c2a640 1 --2- 172.21.15.88:0/2480831510 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f63640c3550 0x7f6364152660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:03.823 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.819+0000 7f6368c2a640 1 -- 172.21.15.88:0/2480831510 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f6364076650 con 0x7f63640c3550 2024-04-26T23:43:03.823 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.820+0000 7f636259c640 1 --2- 172.21.15.88:0/2480831510 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f63640c3550 0x7f6364152660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:03.825 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.820+0000 7f636259c640 1 -- 172.21.15.88:0/2480831510 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f6364157b50 con 0x7f63640c3550 2024-04-26T23:43:03.825 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.820+0000 7f636259c640 1 --2- 172.21.15.88:0/2480831510 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f63640c3550 0x7f6364152660 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f6354010540 tx=0x7f63540046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:03.825 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.820+0000 7f635affd640 1 -- 172.21.15.88:0/2480831510 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f635401cdc0 con 0x7f63640c3550 2024-04-26T23:43:03.825 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.821+0000 7f635affd640 1 -- 172.21.15.88:0/2480831510 <== mon.1 v2:172.21.15.175:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5065 (secure 0 0 0) 0x7f6354021570 con 0x7f63640c3550 2024-04-26T23:43:03.825 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.821+0000 7f635affd640 1 -- 172.21.15.88:0/2480831510 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f63640c3550 msgr2=0x7f6364152660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:03.825 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.821+0000 7f635affd640 1 --2- 172.21.15.88:0/2480831510 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f63640c3550 0x7f6364152660 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f6354010540 tx=0x7f63540046c0 comp rx=0 tx=0).stop 2024-04-26T23:43:03.825 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.821+0000 7f635affd640 1 -- 172.21.15.88:0/2480831510 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f63640c3550 msgr2=0x7f6364152660 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:43:03.825 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.821+0000 7f635affd640 1 --2- 172.21.15.88:0/2480831510 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f63640c3550 0x7f6364152660 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:03.825 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-04-26T23:43:03.826 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2024-04-26T23:43:03.826 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2024-04-26T23:43:03.826 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "peon", 2024-04-26T23:43:03.826 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 22, 2024-04-26T23:43:03.826 INFO:teuthology.orchestra.run.smithi088.stdout: "uptime": 176165, 2024-04-26T23:43:03.826 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2024-04-26T23:43:03.826 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2024-04-26T23:43:03.826 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2024-04-26T23:43:03.826 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2024-04-26T23:43:03.826 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:43:03.826 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 2, 2024-04-26T23:43:03.826 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2024-04-26T23:43:03.826 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2450521708007866372", 2024-04-26T23:43:03.827 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2024-04-26T23:43:03.827 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-04-26T23:43:03.827 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-04-26T23:43:03.827 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-04-26T23:43:03.827 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-04-26T23:43:03.827 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-04-26T23:43:03.827 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-04-26T23:43:03.827 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-04-26T23:43:03.827 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-04-26T23:43:03.827 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-04-26T23:43:03.827 INFO:teuthology.orchestra.run.smithi088.stdout: "reef", 2024-04-26T23:43:03.827 INFO:teuthology.orchestra.run.smithi088.stdout: "squid" 2024-04-26T23:43:03.828 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:43:03.828 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540701547738038271", 2024-04-26T23:43:03.828 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2024-04-26T23:43:03.828 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-04-26T23:43:03.828 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-04-26T23:43:03.828 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-04-26T23:43:03.829 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-04-26T23:43:03.829 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-04-26T23:43:03.829 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-04-26T23:43:03.829 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-04-26T23:43:03.829 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-04-26T23:43:03.829 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-04-26T23:43:03.829 INFO:teuthology.orchestra.run.smithi088.stdout: "reef", 2024-04-26T23:43:03.829 INFO:teuthology.orchestra.run.smithi088.stdout: "squid" 2024-04-26T23:43:03.829 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:43:03.829 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:43:03.830 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2024-04-26T23:43:03.830 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2024-04-26T23:43:03.830 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2024-04-26T23:43:03.830 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2024-04-26T23:43:03.830 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2024-04-26T23:43:03.830 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "555255e9-7ef9-4454-8dc9-35e96b70035c", 2024-04-26T23:43:03.830 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2024-04-26T23:39:34.291658Z", 2024-04-26T23:43:03.830 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2024-04-26T23:39:34.291658Z", 2024-04-26T23:43:03.830 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 19, 2024-04-26T23:43:03.831 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "squid", 2024-04-26T23:43:03.831 INFO:teuthology.orchestra.run.smithi088.stdout: "election_strategy": 1, 2024-04-26T23:43:03.831 INFO:teuthology.orchestra.run.smithi088.stdout: "disallowed_leaders: ": "", 2024-04-26T23:43:03.831 INFO:teuthology.orchestra.run.smithi088.stdout: "stretch_mode": false, 2024-04-26T23:43:03.831 INFO:teuthology.orchestra.run.smithi088.stdout: "tiebreaker_mon": "", 2024-04-26T23:43:03.831 INFO:teuthology.orchestra.run.smithi088.stdout: "removed_ranks: ": "", 2024-04-26T23:43:03.831 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2024-04-26T23:43:03.831 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2024-04-26T23:43:03.831 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-04-26T23:43:03.831 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-04-26T23:43:03.832 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-04-26T23:43:03.832 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-04-26T23:43:03.832 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-04-26T23:43:03.832 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-04-26T23:43:03.832 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-04-26T23:43:03.832 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-04-26T23:43:03.832 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-04-26T23:43:03.832 INFO:teuthology.orchestra.run.smithi088.stdout: "reef", 2024-04-26T23:43:03.832 INFO:teuthology.orchestra.run.smithi088.stdout: "squid" 2024-04-26T23:43:03.833 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:43:03.833 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2024-04-26T23:43:03.833 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:43:03.833 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2024-04-26T23:43:03.833 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:43:03.833 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2024-04-26T23:43:03.833 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2024-04-26T23:43:03.833 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-04-26T23:43:03.833 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-04-26T23:43:03.834 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:43:03.834 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-04-26T23:43:03.834 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2024-04-26T23:43:03.834 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:43:03.834 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:43:03.834 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:43:03.834 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-04-26T23:43:03.834 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2024-04-26T23:43:03.834 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:43:03.835 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:43:03.835 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:43:03.835 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:43:03.835 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2024-04-26T23:43:03.835 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2024-04-26T23:43:03.835 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-04-26T23:43:03.835 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-04-26T23:43:03.835 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-04-26T23:43:03.835 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:43:03.835 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:43:03.835 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2024-04-26T23:43:03.835 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2024-04-26T23:43:03.836 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-04-26T23:43:03.836 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-04-26T23:43:03.836 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:43:03.836 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-04-26T23:43:03.836 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:3300", 2024-04-26T23:43:03.836 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:43:03.836 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:43:03.836 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:43:03.836 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-04-26T23:43:03.836 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6789", 2024-04-26T23:43:03.836 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:43:03.836 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:43:03.837 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:43:03.837 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:43:03.837 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6789/0", 2024-04-26T23:43:03.837 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.175:6789/0", 2024-04-26T23:43:03.837 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-04-26T23:43:03.837 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-04-26T23:43:03.837 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-04-26T23:43:03.837 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:43:03.837 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:43:03.837 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2024-04-26T23:43:03.837 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2024-04-26T23:43:03.838 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-04-26T23:43:03.838 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-04-26T23:43:03.838 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:43:03.838 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-04-26T23:43:03.838 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:3301", 2024-04-26T23:43:03.838 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:43:03.838 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:43:03.838 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:43:03.838 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-04-26T23:43:03.838 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6790", 2024-04-26T23:43:03.839 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:43:03.839 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:43:03.839 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:43:03.839 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:43:03.839 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6790/0", 2024-04-26T23:43:03.839 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.175:6790/0", 2024-04-26T23:43:03.839 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-04-26T23:43:03.839 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-04-26T23:43:03.839 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-04-26T23:43:03.839 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:43:03.840 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:43:03.840 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:43:03.840 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2024-04-26T23:43:03.840 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2024-04-26T23:43:03.840 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:43:03.840 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:43:03.840 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:43:03.840 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2024-04-26T23:43:03.840 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:43:03.840 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:43:03.840 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": [ 2024-04-26T23:43:03.841 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:43:03.841 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:43:03.841 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:43:03.841 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 4 2024-04-26T23:43:03.841 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:43:03.841 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:43:03.841 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": [ 2024-04-26T23:43:03.841 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:43:03.841 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:43:03.841 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:43:03.841 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 5 2024-04-26T23:43:03.842 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:43:03.842 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:43:03.842 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2024-04-26T23:43:03.842 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:43:03.842 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:43:03.842 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:43:03.842 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 4 2024-04-26T23:43:03.842 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:43:03.842 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:43:03.842 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": [ 2024-04-26T23:43:03.842 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:43:03.843 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:43:03.843 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:43:03.843 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2024-04-26T23:43:03.843 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:43:03.843 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:43:03.843 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:43:03.843 INFO:teuthology.orchestra.run.smithi088.stdout: "stretch_mode": false 2024-04-26T23:43:03.843 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-04-26T23:43:03.845 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.821+0000 7f6368c2a640 1 -- 172.21.15.88:0/2480831510 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f634406c8f0 msgr2=0x7f634406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:03.845 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.821+0000 7f6368c2a640 1 --2- 172.21.15.88:0/2480831510 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f634406c8f0 0x7f634406edb0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f634c034000 tx=0x7f634c02c000 comp rx=0 tx=0).stop 2024-04-26T23:43:03.845 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.821+0000 7f6368c2a640 1 -- 172.21.15.88:0/2480831510 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6364154160 msgr2=0x7f63640ad790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:03.845 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.821+0000 7f6368c2a640 1 --2- 172.21.15.88:0/2480831510 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6364154160 0x7f63640ad790 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f635c007e30 tx=0x7f635c00e4b0 comp rx=0 tx=0).stop 2024-04-26T23:43:03.845 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.821+0000 7f6362d9d640 1 -- 172.21.15.88:0/2480831510 reap_dead start 2024-04-26T23:43:03.846 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.821+0000 7f6362d9d640 1 -- 172.21.15.88:0/2480831510 reap_dead start 2024-04-26T23:43:03.846 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.821+0000 7f6368c2a640 1 -- 172.21.15.88:0/2480831510 shutdown_connections 2024-04-26T23:43:03.846 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.821+0000 7f6368c2a640 1 -- 172.21.15.88:0/2480831510 >> 172.21.15.88:0/2480831510 conn(0x7f63640ae010 msgr2=0x7f636414ee20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:43:03.846 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.821+0000 7f6368c2a640 1 -- 172.21.15.88:0/2480831510 shutdown_connections 2024-04-26T23:43:03.846 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.821+0000 7f6368c2a640 1 -- 172.21.15.88:0/2480831510 wait complete. 2024-04-26T23:43:03.846 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-04-26T23:43:03.846 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-04-26T23:43:03.847 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-04-26T23:43:03.956 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.951+0000 7f635a9bf640 1 Processor -- start 2024-04-26T23:43:03.956 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.952+0000 7f635a9bf640 1 -- start start 2024-04-26T23:43:03.961 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.952+0000 7f635a9bf640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f635413ff20 0x7f635415a280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:03.961 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.952+0000 7f635a9bf640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63541577b0 con 0x7f63540c46c0 2024-04-26T23:43:03.961 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.952+0000 7f635a9bf640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63540ab5f0 con 0x7f63540c3720 2024-04-26T23:43:03.961 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.952+0000 7f635a9bf640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f6354157560 con 0x7f635413ff20 2024-04-26T23:43:03.961 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.952+0000 7f63537fe640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f63540c46c0 0x7f635415a7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:49600/0 (socket says 172.21.15.88:49600) 2024-04-26T23:43:03.962 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.952+0000 7f63537fe640 1 -- 172.21.15.88:0/996637736 learned_addr learned my addr 172.21.15.88:0/996637736 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-26T23:43:03.962 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.953+0000 7f6353fff640 1 --2- 172.21.15.88:0/996637736 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f635413ff20 0x7f635415a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:03.962 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.953+0000 7f6353fff640 1 -- 172.21.15.88:0/996637736 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f635413ff20 msgr2=0x7f635415a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-26T23:43:03.962 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.953+0000 7f6353fff640 1 -- 172.21.15.88:0/996637736 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f635413ff20 msgr2=0x7f635415a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T23:43:03.962 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.953+0000 7f6353fff640 1 --2- 172.21.15.88:0/996637736 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f635413ff20 0x7f635415a280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:43:03.962 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.953+0000 7f6353fff640 1 --2- 172.21.15.88:0/996637736 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f635413ff20 0x7f635415a280 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:43:03.962 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.953+0000 7f6352ffd640 1 -- 172.21.15.88:0/996637736 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3920154431 0 0) 0x7f63541577b0 con 0x7f63540c46c0 2024-04-26T23:43:03.962 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.953+0000 7f6352ffd640 1 -- 172.21.15.88:0/996637736 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f633c003520 con 0x7f63540c46c0 2024-04-26T23:43:03.962 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.953+0000 7f6352ffd640 1 -- 172.21.15.88:0/996637736 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3696886709 0 0) 0x7f63540ab5f0 con 0x7f63540c3720 2024-04-26T23:43:03.962 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.953+0000 7f6352ffd640 1 -- 172.21.15.88:0/996637736 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f63541577b0 con 0x7f63540c3720 2024-04-26T23:43:03.962 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.953+0000 7f6352ffd640 1 -- 172.21.15.88:0/996637736 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1998566563 0 0) 0x7f633c003520 con 0x7f63540c46c0 2024-04-26T23:43:03.962 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.953+0000 7f6352ffd640 1 -- 172.21.15.88:0/996637736 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f635413ff20 msgr2=0x7f635415a280 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T23:43:03.962 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.953+0000 7f6352ffd640 1 --2- 172.21.15.88:0/996637736 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f635413ff20 0x7f635415a280 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:03.963 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.953+0000 7f6352ffd640 1 -- 172.21.15.88:0/996637736 >> v1:172.21.15.175:6789/0 conn(0x7f63540c3720 legacy=0x7f63540c3bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:03.963 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.953+0000 7f6352ffd640 1 -- 172.21.15.88:0/996637736 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f635415aed0 con 0x7f63540c46c0 2024-04-26T23:43:03.963 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.953+0000 7f6352ffd640 1 -- 172.21.15.88:0/996637736 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 356324787 0 0) 0x7f6348001670 con 0x7f63540c46c0 2024-04-26T23:43:03.963 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.953+0000 7f6352ffd640 1 -- 172.21.15.88:0/996637736 >> v1:172.21.15.88:6789/0 conn(0x7f63540c46c0 legacy=0x7f635415a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:03.963 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.953+0000 7f6352ffd640 1 --2- 172.21.15.88:0/996637736 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f633c004c00 0x7f633c004fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:03.963 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.953+0000 7f6352ffd640 1 --2- 172.21.15.88:0/996637736 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f635413ff20 0x7f633c0037a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:03.963 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.953+0000 7f6352ffd640 1 --2- 172.21.15.88:0/996637736 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f633c003ce0 0x7f633c004160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:03.963 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.953+0000 7f6352ffd640 1 -- 172.21.15.88:0/996637736 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f6354157560 con 0x7f633c003ce0 2024-04-26T23:43:03.963 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.953+0000 7f6352ffd640 1 -- 172.21.15.88:0/996637736 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f633c00baa0 con 0x7f633c004c00 2024-04-26T23:43:03.963 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.953+0000 7f6352ffd640 1 -- 172.21.15.88:0/996637736 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f633c00bca0 con 0x7f635413ff20 2024-04-26T23:43:03.964 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.953+0000 7f6353fff640 1 --2- 172.21.15.88:0/996637736 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f633c004c00 0x7f633c004fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:03.964 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.953+0000 7f6358f5c640 1 --2- 172.21.15.88:0/996637736 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f633c003ce0 0x7f633c004160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:03.964 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.953+0000 7f63537fe640 1 --2- 172.21.15.88:0/996637736 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f635413ff20 0x7f633c0037a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:03.964 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.954+0000 7f6353fff640 1 -- 172.21.15.88:0/996637736 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f635413ff20 msgr2=0x7f633c0037a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:43:03.964 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.954+0000 7f6353fff640 1 --2- 172.21.15.88:0/996637736 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f635413ff20 0x7f633c0037a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:03.964 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.954+0000 7f6353fff640 1 -- 172.21.15.88:0/996637736 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f633c003ce0 msgr2=0x7f633c004160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:43:03.964 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.954+0000 7f6353fff640 1 --2- 172.21.15.88:0/996637736 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f633c003ce0 0x7f633c004160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:03.964 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.954+0000 7f6353fff640 1 -- 172.21.15.88:0/996637736 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f633c003520 con 0x7f633c004c00 2024-04-26T23:43:03.964 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.954+0000 7f6353fff640 1 --2- 172.21.15.88:0/996637736 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f633c004c00 0x7f633c004fe0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f6344006fd0 tx=0x7f633c005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=659ae22ba083538a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:03.964 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.955+0000 7f6352ffd640 1 -- 172.21.15.88:0/996637736 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6344030070 con 0x7f633c004c00 2024-04-26T23:43:03.964 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.955+0000 7f6352ffd640 1 -- 172.21.15.88:0/996637736 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f634402ad70 con 0x7f633c004c00 2024-04-26T23:43:03.964 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.955+0000 7f6352ffd640 1 -- 172.21.15.88:0/996637736 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f634400b5e0 con 0x7f633c004c00 2024-04-26T23:43:03.964 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.956+0000 7f635a9bf640 1 -- 172.21.15.88:0/996637736 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f633c004c00 msgr2=0x7f633c004fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:03.964 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.956+0000 7f635a9bf640 1 --2- 172.21.15.88:0/996637736 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f633c004c00 0x7f633c004fe0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f6344006fd0 tx=0x7f633c005830 comp rx=0 tx=0).stop 2024-04-26T23:43:03.965 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.956+0000 7f6358f5c640 1 -- 172.21.15.88:0/996637736 reap_dead start 2024-04-26T23:43:03.965 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.956+0000 7f635a9bf640 1 -- 172.21.15.88:0/996637736 shutdown_connections 2024-04-26T23:43:03.965 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.956+0000 7f635a9bf640 1 -- 172.21.15.88:0/996637736 >> 172.21.15.88:0/996637736 conn(0x7f63540ca2f0 msgr2=0x7f63540ca700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:43:03.965 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.956+0000 7f635a9bf640 1 -- 172.21.15.88:0/996637736 shutdown_connections 2024-04-26T23:43:03.965 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.956+0000 7f635a9bf640 1 -- 172.21.15.88:0/996637736 wait complete. 2024-04-26T23:43:03.968 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.958+0000 7f635a9bf640 1 Processor -- start 2024-04-26T23:43:03.968 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.958+0000 7f635a9bf640 1 -- start start 2024-04-26T23:43:03.969 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.959+0000 7f635a9bf640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f633c004c00 0x7f63541f0540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:03.969 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.959+0000 7f635a9bf640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f63540c9b50 0x7f63540ae790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:03.969 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.959+0000 7f635a9bf640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f635413abd0 0x7f635413b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:03.969 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.959+0000 7f635a9bf640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f63540ac710 con 0x7f63540c9b50 2024-04-26T23:43:03.969 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.959+0000 7f635a9bf640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f63540ab960 con 0x7f633c004c00 2024-04-26T23:43:03.969 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.959+0000 7f635a9bf640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f63540c42c0 con 0x7f635413abd0 2024-04-26T23:43:03.969 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.959+0000 7f6353fff640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f633c004c00 0x7f63541f0540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:03.969 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.959+0000 7f6353fff640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f633c004c00 0x7f63541f0540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.88:56316/0 (socket says 172.21.15.88:56316) 2024-04-26T23:43:03.969 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.959+0000 7f6353fff640 1 -- 172.21.15.88:0/2385420167 learned_addr learned my addr 172.21.15.88:0/2385420167 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:43:03.969 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.959+0000 7f6358f5c640 1 --2- 172.21.15.88:0/2385420167 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f635413abd0 0x7f635413b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:03.969 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.959+0000 7f6358f5c640 1 -- 172.21.15.88:0/2385420167 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f635413abd0 msgr2=0x7f635413b050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2024-04-26T23:43:03.969 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.959+0000 7f6358f5c640 1 -- 172.21.15.88:0/2385420167 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f635413abd0 msgr2=0x7f635413b050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-26T23:43:03.969 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.959+0000 7f6358f5c640 1 --2- 172.21.15.88:0/2385420167 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f635413abd0 0x7f635413b050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:43:03.969 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.959+0000 7f6358f5c640 1 --2- 172.21.15.88:0/2385420167 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f635413abd0 0x7f635413b050 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:43:03.969 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.959+0000 7f63537fe640 1 --2- 172.21.15.88:0/2385420167 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f63540c9b50 0x7f63540ae790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:03.970 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.960+0000 7f6353fff640 1 -- 172.21.15.88:0/2385420167 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f635413abd0 msgr2=0x7f635413b050 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T23:43:03.970 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.960+0000 7f6353fff640 1 --2- 172.21.15.88:0/2385420167 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f635413abd0 0x7f635413b050 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:03.970 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.960+0000 7f6353fff640 1 -- 172.21.15.88:0/2385420167 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f63540c9b50 msgr2=0x7f63540ae790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:03.970 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.960+0000 7f6353fff640 1 --2- 172.21.15.88:0/2385420167 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f63540c9b50 0x7f63540ae790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:03.970 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.960+0000 7f6353fff640 1 -- 172.21.15.88:0/2385420167 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6354158be0 con 0x7f633c004c00 2024-04-26T23:43:03.970 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.960+0000 7f63537fe640 1 --2- 172.21.15.88:0/2385420167 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f63540c9b50 0x7f63540ae790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:43:03.970 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.960+0000 7f6353fff640 1 --2- 172.21.15.88:0/2385420167 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f633c004c00 0x7f63541f0540 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f634402a860 tx=0x7f6344004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:03.970 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.960+0000 7f6350ff9640 1 -- 172.21.15.88:0/2385420167 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6344043020 con 0x7f633c004c00 2024-04-26T23:43:03.970 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.960+0000 7f6350ff9640 1 -- 172.21.15.88:0/2385420167 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f634403f680 con 0x7f633c004c00 2024-04-26T23:43:03.970 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.960+0000 7f635a9bf640 1 -- 172.21.15.88:0/2385420167 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6354158620 con 0x7f633c004c00 2024-04-26T23:43:03.970 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.960+0000 7f6350ff9640 1 -- 172.21.15.88:0/2385420167 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f634400b5e0 con 0x7f633c004c00 2024-04-26T23:43:03.970 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.960+0000 7f635a9bf640 1 -- 172.21.15.88:0/2385420167 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63541590b0 con 0x7f633c004c00 2024-04-26T23:43:03.970 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.961+0000 7f635a9bf640 1 --2- 172.21.15.88:0/2385420167 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f63541ec5f0 0x7f63541ec9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:03.970 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.962+0000 7f635a9bf640 1 -- 172.21.15.88:0/2385420167 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f63541f0a80 con 0x7f63541ec5f0 2024-04-26T23:43:03.971 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.962+0000 7f63537fe640 1 --2- 172.21.15.88:0/2385420167 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f63541ec5f0 0x7f63541ec9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:03.971 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.962+0000 7f63537fe640 1 -- 172.21.15.88:0/2385420167 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f63541ec5f0 msgr2=0x7f63541ec9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 20 2024-04-26T23:43:03.971 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.962+0000 7f63537fe640 1 -- 172.21.15.88:0/2385420167 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f63541ec5f0 msgr2=0x7f63541ec9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-26T23:43:03.971 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.962+0000 7f63537fe640 1 --2- 172.21.15.88:0/2385420167 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f63541ec5f0 0x7f63541ec9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:43:03.971 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.962+0000 7f63537fe640 1 --2- 172.21.15.88:0/2385420167 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f63541ec5f0 0x7f63541ec9d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:43:03.971 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.962+0000 7f6350ff9640 1 -- 172.21.15.88:0/2385420167 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6344046020 con 0x7f633c004c00 2024-04-26T23:43:03.971 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.962+0000 7f6350ff9640 1 --2- 172.21.15.88:0/2385420167 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f634006c8f0 0x7f634006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:03.971 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.963+0000 7f6350ff9640 1 -- 172.21.15.88:0/2385420167 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6666+0+0 (secure 0 0 0) 0x7f63440ace50 con 0x7f633c004c00 2024-04-26T23:43:03.971 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.963+0000 7f6358f5c640 1 --2- 172.21.15.88:0/2385420167 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f634006c8f0 0x7f634006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:03.971 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:03.963+0000 7f6358f5c640 1 --2- 172.21.15.88:0/2385420167 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f634006c8f0 0x7f634006edb0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f63540cb1a0 tx=0x7f634c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:04.169 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:04.165+0000 7f63537fe640 1 --2- 172.21.15.88:0/2385420167 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f63541ec5f0 0x7f63541ec9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:04.171 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:04.167+0000 7f63537fe640 1 -- 172.21.15.88:0/2385420167 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f63541ec5f0 msgr2=0x7f63541ec9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 21 2024-04-26T23:43:04.171 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:04.167+0000 7f63537fe640 1 -- 172.21.15.88:0/2385420167 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f63541ec5f0 msgr2=0x7f63541ec9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-26T23:43:04.171 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:04.167+0000 7f63537fe640 1 --2- 172.21.15.88:0/2385420167 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f63541ec5f0 0x7f63541ec9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:43:04.172 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:04.167+0000 7f63537fe640 1 --2- 172.21.15.88:0/2385420167 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f63541ec5f0 0x7f63541ec9d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-26T23:43:04.576 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:04.571+0000 7f63537fe640 1 --2- 172.21.15.88:0/2385420167 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f63541ec5f0 0x7f63541ec9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:04.578 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:04.574+0000 7f63537fe640 1 -- 172.21.15.88:0/2385420167 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6354072100 con 0x7f63541ec5f0 2024-04-26T23:43:04.581 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:04.578+0000 7f63537fe640 1 --2- 172.21.15.88:0/2385420167 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f63541ec5f0 0x7f63541ec9d0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f63480072f0 tx=0x7f63480077b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:04.584 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:04.580+0000 7f6350ff9640 1 -- 172.21.15.88:0/2385420167 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f634801b070 con 0x7f63541ec5f0 2024-04-26T23:43:04.584 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:04.580+0000 7f6350ff9640 1 -- 172.21.15.88:0/2385420167 <== mon.2 v2:172.21.15.175:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f6348015b30 con 0x7f63541ec5f0 2024-04-26T23:43:04.584 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:04.580+0000 7f6350ff9640 1 -- 172.21.15.88:0/2385420167 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f63541ec5f0 msgr2=0x7f63541ec9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:04.584 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:04.580+0000 7f6350ff9640 1 --2- 172.21.15.88:0/2385420167 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f63541ec5f0 0x7f63541ec9d0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f63480072f0 tx=0x7f63480077b0 comp rx=0 tx=0).stop 2024-04-26T23:43:04.584 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:04.580+0000 7f6350ff9640 1 -- 172.21.15.88:0/2385420167 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f63541ec5f0 msgr2=0x7f63541ec9d0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:43:04.585 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:04.580+0000 7f6350ff9640 1 --2- 172.21.15.88:0/2385420167 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f63541ec5f0 0x7f63541ec9d0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:04.599 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:04.595+0000 7f635a9bf640 1 --2- 172.21.15.88:0/2385420167 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f63541ecf10 0x7f635406d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:04.599 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:04.595+0000 7f635a9bf640 1 -- 172.21.15.88:0/2385420167 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f6354159280 con 0x7f63541ecf10 2024-04-26T23:43:04.600 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:04.596+0000 7f63537fe640 1 --2- 172.21.15.88:0/2385420167 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f63541ecf10 0x7f635406d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:04.602 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:04.598+0000 7f63537fe640 1 -- 172.21.15.88:0/2385420167 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f63540766c0 con 0x7f63541ecf10 2024-04-26T23:43:04.606 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:04.602+0000 7f63537fe640 1 --2- 172.21.15.88:0/2385420167 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f63541ecf10 0x7f635406d360 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f63480072f0 tx=0x7f63480019c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:04.608 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:04.604+0000 7f6350ff9640 1 -- 172.21.15.88:0/2385420167 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6348017840 con 0x7f63541ecf10 2024-04-26T23:43:04.608 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:04.604+0000 7f6350ff9640 1 -- 172.21.15.88:0/2385420167 <== mon.2 v2:172.21.15.175:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4554 (secure 0 0 0) 0x7f63480179e0 con 0x7f63541ecf10 2024-04-26T23:43:04.608 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:04.604+0000 7f6350ff9640 1 -- 172.21.15.88:0/2385420167 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f63541ecf10 msgr2=0x7f635406d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:04.608 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:04.604+0000 7f6350ff9640 1 --2- 172.21.15.88:0/2385420167 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f63541ecf10 0x7f635406d360 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f63480072f0 tx=0x7f63480019c0 comp rx=0 tx=0).stop 2024-04-26T23:43:04.608 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:04.604+0000 7f6350ff9640 1 -- 172.21.15.88:0/2385420167 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f63541ecf10 msgr2=0x7f635406d360 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:43:04.609 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:04.604+0000 7f6350ff9640 1 --2- 172.21.15.88:0/2385420167 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f63541ecf10 0x7f635406d360 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:04.609 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-04-26T23:43:04.609 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2024-04-26T23:43:04.609 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2024-04-26T23:43:04.609 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "peon", 2024-04-26T23:43:04.609 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 22, 2024-04-26T23:43:04.609 INFO:teuthology.orchestra.run.smithi088.stdout: "uptime": 10116, 2024-04-26T23:43:04.609 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2024-04-26T23:43:04.609 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2024-04-26T23:43:04.610 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2024-04-26T23:43:04.610 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2024-04-26T23:43:04.610 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:43:04.610 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 3, 2024-04-26T23:43:04.610 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2024-04-26T23:43:04.610 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2450521708007866372", 2024-04-26T23:43:04.610 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2024-04-26T23:43:04.610 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-04-26T23:43:04.610 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-04-26T23:43:04.610 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-04-26T23:43:04.610 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-04-26T23:43:04.610 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-04-26T23:43:04.611 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-04-26T23:43:04.611 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-04-26T23:43:04.611 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-04-26T23:43:04.611 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-04-26T23:43:04.611 INFO:teuthology.orchestra.run.smithi088.stdout: "reef", 2024-04-26T23:43:04.611 INFO:teuthology.orchestra.run.smithi088.stdout: "squid" 2024-04-26T23:43:04.611 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:43:04.611 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540701547738038271", 2024-04-26T23:43:04.611 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2024-04-26T23:43:04.611 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-04-26T23:43:04.611 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-04-26T23:43:04.611 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-04-26T23:43:04.611 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-04-26T23:43:04.612 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-04-26T23:43:04.612 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-04-26T23:43:04.612 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-04-26T23:43:04.612 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-04-26T23:43:04.612 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-04-26T23:43:04.612 INFO:teuthology.orchestra.run.smithi088.stdout: "reef", 2024-04-26T23:43:04.612 INFO:teuthology.orchestra.run.smithi088.stdout: "squid" 2024-04-26T23:43:04.612 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:43:04.612 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:43:04.612 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2024-04-26T23:43:04.612 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2024-04-26T23:43:04.612 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2024-04-26T23:43:04.612 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2024-04-26T23:43:04.613 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2024-04-26T23:43:04.613 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "555255e9-7ef9-4454-8dc9-35e96b70035c", 2024-04-26T23:43:04.613 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2024-04-26T23:39:34.291658Z", 2024-04-26T23:43:04.613 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2024-04-26T23:39:34.291658Z", 2024-04-26T23:43:04.613 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 19, 2024-04-26T23:43:04.613 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "squid", 2024-04-26T23:43:04.613 INFO:teuthology.orchestra.run.smithi088.stdout: "election_strategy": 1, 2024-04-26T23:43:04.613 INFO:teuthology.orchestra.run.smithi088.stdout: "disallowed_leaders: ": "", 2024-04-26T23:43:04.613 INFO:teuthology.orchestra.run.smithi088.stdout: "stretch_mode": false, 2024-04-26T23:43:04.613 INFO:teuthology.orchestra.run.smithi088.stdout: "tiebreaker_mon": "", 2024-04-26T23:43:04.613 INFO:teuthology.orchestra.run.smithi088.stdout: "removed_ranks: ": "", 2024-04-26T23:43:04.613 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2024-04-26T23:43:04.614 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2024-04-26T23:43:04.614 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-04-26T23:43:04.614 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-04-26T23:43:04.614 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-04-26T23:43:04.614 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-04-26T23:43:04.614 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-04-26T23:43:04.614 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-04-26T23:43:04.614 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-04-26T23:43:04.614 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-04-26T23:43:04.614 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-04-26T23:43:04.614 INFO:teuthology.orchestra.run.smithi088.stdout: "reef", 2024-04-26T23:43:04.614 INFO:teuthology.orchestra.run.smithi088.stdout: "squid" 2024-04-26T23:43:04.614 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:43:04.615 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2024-04-26T23:43:04.615 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:43:04.615 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2024-04-26T23:43:04.615 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:43:04.615 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2024-04-26T23:43:04.615 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2024-04-26T23:43:04.615 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-04-26T23:43:04.615 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-04-26T23:43:04.615 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:43:04.615 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-04-26T23:43:04.615 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2024-04-26T23:43:04.615 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:43:04.616 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:43:04.616 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:43:04.616 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-04-26T23:43:04.616 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2024-04-26T23:43:04.616 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:43:04.616 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:43:04.616 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:43:04.616 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:43:04.616 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2024-04-26T23:43:04.616 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2024-04-26T23:43:04.616 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-04-26T23:43:04.616 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-04-26T23:43:04.616 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-04-26T23:43:04.617 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:43:04.617 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:43:04.617 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2024-04-26T23:43:04.617 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2024-04-26T23:43:04.617 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-04-26T23:43:04.617 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-04-26T23:43:04.617 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:43:04.617 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-04-26T23:43:04.617 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:3300", 2024-04-26T23:43:04.617 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:43:04.617 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:43:04.618 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:43:04.618 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-04-26T23:43:04.618 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6789", 2024-04-26T23:43:04.618 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:43:04.618 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:43:04.618 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:43:04.618 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:43:04.618 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6789/0", 2024-04-26T23:43:04.618 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.175:6789/0", 2024-04-26T23:43:04.618 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-04-26T23:43:04.618 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-04-26T23:43:04.618 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-04-26T23:43:04.618 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:43:04.618 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:43:04.619 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2024-04-26T23:43:04.619 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2024-04-26T23:43:04.619 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-04-26T23:43:04.619 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-04-26T23:43:04.619 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:43:04.619 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-04-26T23:43:04.619 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:3301", 2024-04-26T23:43:04.619 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:43:04.619 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:43:04.619 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:43:04.619 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-04-26T23:43:04.619 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6790", 2024-04-26T23:43:04.619 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:43:04.619 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:43:04.620 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:43:04.620 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:43:04.620 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6790/0", 2024-04-26T23:43:04.620 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.175:6790/0", 2024-04-26T23:43:04.620 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-04-26T23:43:04.620 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-04-26T23:43:04.620 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-04-26T23:43:04.620 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:43:04.620 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:43:04.620 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:43:04.620 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2024-04-26T23:43:04.620 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2024-04-26T23:43:04.620 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:43:04.620 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:43:04.620 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:43:04.621 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2024-04-26T23:43:04.621 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:43:04.621 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:43:04.621 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2024-04-26T23:43:04.621 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:43:04.621 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:43:04.621 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:43:04.621 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2024-04-26T23:43:04.621 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:43:04.621 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:43:04.621 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:43:04.621 INFO:teuthology.orchestra.run.smithi088.stdout: "stretch_mode": false 2024-04-26T23:43:04.621 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-04-26T23:43:04.622 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:04.605+0000 7f635a9bf640 1 -- 172.21.15.88:0/2385420167 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f634006c8f0 msgr2=0x7f634006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:04.622 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:04.605+0000 7f635a9bf640 1 --2- 172.21.15.88:0/2385420167 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f634006c8f0 0x7f634006edb0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f63540cb1a0 tx=0x7f634c009040 comp rx=0 tx=0).stop 2024-04-26T23:43:04.622 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:04.605+0000 7f635a9bf640 1 -- 172.21.15.88:0/2385420167 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f633c004c00 msgr2=0x7f63541f0540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:04.622 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:04.605+0000 7f6358f5c640 1 -- 172.21.15.88:0/2385420167 reap_dead start 2024-04-26T23:43:04.622 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:04.605+0000 7f635a9bf640 1 --2- 172.21.15.88:0/2385420167 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f633c004c00 0x7f63541f0540 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f634402a860 tx=0x7f6344004730 comp rx=0 tx=0).stop 2024-04-26T23:43:04.622 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:04.605+0000 7f635a9bf640 1 -- 172.21.15.88:0/2385420167 shutdown_connections 2024-04-26T23:43:04.623 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:04.605+0000 7f635a9bf640 1 --2- 172.21.15.88:0/2385420167 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f633c004c00 0x7f63541f0540 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:04.623 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:04.605+0000 7f635a9bf640 1 -- 172.21.15.88:0/2385420167 >> 172.21.15.88:0/2385420167 conn(0x7f63540ca2f0 msgr2=0x7f63540c3bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:43:04.623 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:04.605+0000 7f635a9bf640 1 -- 172.21.15.88:0/2385420167 shutdown_connections 2024-04-26T23:43:04.623 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:04.606+0000 7f635a9bf640 1 -- 172.21.15.88:0/2385420167 wait complete. 2024-04-26T23:43:04.631 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-04-26T23:43:04.631 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2024-04-26T23:43:04.631 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2024-04-26T23:43:04.760 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:04.756+0000 7ff38f66d640 1 Processor -- start 2024-04-26T23:43:04.761 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:04.756+0000 7ff38f66d640 1 -- start start 2024-04-26T23:43:04.764 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:04.757+0000 7ff38f66d640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff388150e90 0x7ff388074370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:04.764 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:04.757+0000 7ff38f66d640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7ff3880c3c70 0x7ff388070c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:04.764 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:04.757+0000 7ff38f66d640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff388072e60 con 0x7ff38806f540 2024-04-26T23:43:04.764 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:04.757+0000 7ff38f66d640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7ff388154580 con 0x7ff3880c3c70 2024-04-26T23:43:04.764 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:04.757+0000 7ff38f66d640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7ff388072810 con 0x7ff388150e90 2024-04-26T23:43:04.764 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:04.757+0000 7ff38dc0a640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7ff38806f540 0x7ff38806d320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:49606/0 (socket says 172.21.15.88:49606) 2024-04-26T23:43:04.764 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:04.757+0000 7ff38dc0a640 1 -- 172.21.15.88:0/3950983033 learned_addr learned my addr 172.21.15.88:0/3950983033 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-26T23:43:04.764 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:04.757+0000 7ff38d409640 1 --2- 172.21.15.88:0/3950983033 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff388150e90 0x7ff388074370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:04.764 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:04.758+0000 7ff38cc08640 1 --2- 172.21.15.88:0/3950983033 >> v2:172.21.15.175:3300/0 conn(0x7ff3880c3c70 0x7ff388070c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:04.764 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:04.758+0000 7ff37ffff640 1 -- 172.21.15.88:0/3950983033 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1029512779 0 0) 0x7ff388072e60 con 0x7ff38806f540 2024-04-26T23:43:04.764 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:04.758+0000 7ff37ffff640 1 -- 172.21.15.88:0/3950983033 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff374003520 con 0x7ff38806f540 2024-04-26T23:43:04.764 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:04.758+0000 7ff37ffff640 1 -- 172.21.15.88:0/3950983033 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2481591239 0 0) 0x7ff374003520 con 0x7ff38806f540 2024-04-26T23:43:04.764 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:04.758+0000 7ff38d409640 1 -- 172.21.15.88:0/3950983033 >> v2:172.21.15.175:3300/0 conn(0x7ff3880c3c70 msgr2=0x7ff388070c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:43:04.765 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:04.758+0000 7ff38d409640 1 --2- 172.21.15.88:0/3950983033 >> v2:172.21.15.175:3300/0 conn(0x7ff3880c3c70 0x7ff388070c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:04.765 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:04.758+0000 7ff38d409640 1 -- 172.21.15.88:0/3950983033 >> v1:172.21.15.88:6789/0 conn(0x7ff38806f540 legacy=0x7ff38806d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:04.765 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:04.758+0000 7ff38d409640 1 -- 172.21.15.88:0/3950983033 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff388072af0 con 0x7ff388150e90 2024-04-26T23:43:04.765 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:04.758+0000 7ff38cc08640 1 --2- 172.21.15.88:0/3950983033 >> v2:172.21.15.175:3300/0 conn(0x7ff3880c3c70 0x7ff388070c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:43:04.765 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:04.759+0000 7ff38d409640 1 --2- 172.21.15.88:0/3950983033 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff388150e90 0x7ff388074370 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7ff3840097a0 tx=0x7ff38402a000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=df2e86bd526c32e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:04.765 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:04.759+0000 7ff37ffff640 1 -- 172.21.15.88:0/3950983033 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff384037070 con 0x7ff388150e90 2024-04-26T23:43:04.765 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:04.759+0000 7ff37ffff640 1 -- 172.21.15.88:0/3950983033 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff38402aa90 con 0x7ff388150e90 2024-04-26T23:43:04.765 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:04.759+0000 7ff37ffff640 1 -- 172.21.15.88:0/3950983033 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3800019f0 con 0x7ff388150e90 2024-04-26T23:43:04.765 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:04.759+0000 7ff38f66d640 1 -- 172.21.15.88:0/3950983033 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff388150e90 msgr2=0x7ff388074370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:04.765 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:04.759+0000 7ff38f66d640 1 --2- 172.21.15.88:0/3950983033 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff388150e90 0x7ff388074370 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7ff3840097a0 tx=0x7ff38402a000 comp rx=0 tx=0).stop 2024-04-26T23:43:04.765 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:04.759+0000 7ff38f66d640 1 -- 172.21.15.88:0/3950983033 shutdown_connections 2024-04-26T23:43:04.765 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:04.759+0000 7ff38f66d640 1 --2- 172.21.15.88:0/3950983033 >> v2:172.21.15.175:3300/0 conn(0x7ff3880c3c70 0x7ff388070c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:04.766 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:04.759+0000 7ff38f66d640 1 --2- 172.21.15.88:0/3950983033 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff388150e90 0x7ff388074370 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:04.766 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:04.759+0000 7ff38f66d640 1 -- 172.21.15.88:0/3950983033 >> 172.21.15.88:0/3950983033 conn(0x7ff3880c5d70 msgr2=0x7ff3880c6180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:43:04.766 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:04.760+0000 7ff38f66d640 1 -- 172.21.15.88:0/3950983033 shutdown_connections 2024-04-26T23:43:04.766 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:04.760+0000 7ff38f66d640 1 -- 172.21.15.88:0/3950983033 wait complete. 2024-04-26T23:43:04.768 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:04.761+0000 7ff38f66d640 1 Processor -- start 2024-04-26T23:43:04.768 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:04.761+0000 7ff38f66d640 1 -- start start 2024-04-26T23:43:04.769 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:04.762+0000 7ff38f66d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff38806f540 0x7ff388152a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:04.769 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:04.762+0000 7ff38f66d640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff3880c3c70 0x7ff3881ea570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:04.769 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:04.762+0000 7ff38f66d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff388150e90 0x7ff3881eaab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:04.769 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:04.762+0000 7ff38f66d640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7ff38806dbb0 con 0x7ff388150e90 2024-04-26T23:43:04.769 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:04.762+0000 7ff38f66d640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff38806da30 con 0x7ff38806f540 2024-04-26T23:43:04.769 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:04.762+0000 7ff38f66d640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7ff388151270 con 0x7ff3880c3c70 2024-04-26T23:43:04.769 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:04.762+0000 7ff38dc0a640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff388150e90 0x7ff3881eaab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:04.769 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:04.762+0000 7ff38dc0a640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff388150e90 0x7ff3881eaab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:46266/0 (socket says 172.21.15.88:46266) 2024-04-26T23:43:04.769 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:04.762+0000 7ff38dc0a640 1 -- 172.21.15.88:0/222141444 learned_addr learned my addr 172.21.15.88:0/222141444 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:43:04.769 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:04.762+0000 7ff38cc08640 1 --2- 172.21.15.88:0/222141444 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff3880c3c70 0x7ff3881ea570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:04.769 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:04.762+0000 7ff38d409640 1 --2- 172.21.15.88:0/222141444 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff38806f540 0x7ff388152a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:04.769 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:04.762+0000 7ff38dc0a640 1 -- 172.21.15.88:0/222141444 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff3880c3c70 msgr2=0x7ff3881ea570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:04.770 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:04.762+0000 7ff38dc0a640 1 --2- 172.21.15.88:0/222141444 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff3880c3c70 0x7ff3881ea570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:04.770 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:04.762+0000 7ff38dc0a640 1 -- 172.21.15.88:0/222141444 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff38806f540 msgr2=0x7ff388152a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:04.770 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:04.762+0000 7ff38dc0a640 1 --2- 172.21.15.88:0/222141444 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff38806f540 0x7ff388152a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:04.770 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:04.762+0000 7ff38dc0a640 1 -- 172.21.15.88:0/222141444 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3881edaa0 con 0x7ff388150e90 2024-04-26T23:43:04.770 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:04.762+0000 7ff38d409640 1 --2- 172.21.15.88:0/222141444 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff38806f540 0x7ff388152a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:43:04.770 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:04.762+0000 7ff38dc0a640 1 --2- 172.21.15.88:0/222141444 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff388150e90 0x7ff3881eaab0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7ff380001b60 tx=0x7ff38000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:04.770 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:04.763+0000 7ff37dffb640 1 -- 172.21.15.88:0/222141444 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff380017070 con 0x7ff388150e90 2024-04-26T23:43:04.770 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:04.763+0000 7ff37dffb640 1 -- 172.21.15.88:0/222141444 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff380012400 con 0x7ff388150e90 2024-04-26T23:43:04.770 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:04.763+0000 7ff38f66d640 1 -- 172.21.15.88:0/222141444 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3881edd80 con 0x7ff388150e90 2024-04-26T23:43:04.770 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:04.763+0000 7ff37dffb640 1 -- 172.21.15.88:0/222141444 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3800127b0 con 0x7ff388150e90 2024-04-26T23:43:04.770 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:04.763+0000 7ff38f66d640 1 -- 172.21.15.88:0/222141444 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3881ee340 con 0x7ff388150e90 2024-04-26T23:43:04.770 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:04.764+0000 7ff37dffb640 1 -- 172.21.15.88:0/222141444 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff38001a070 con 0x7ff388150e90 2024-04-26T23:43:04.770 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:04.764+0000 7ff38f66d640 1 -- 172.21.15.88:0/222141444 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff3880aed50 con 0x7ff388150e90 2024-04-26T23:43:04.771 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:04.765+0000 7ff37dffb640 1 --2- 172.21.15.88:0/222141444 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7ff36c06c8f0 0x7ff36c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:04.771 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:04.765+0000 7ff37dffb640 1 -- 172.21.15.88:0/222141444 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6666+0+0 (secure 0 0 0) 0x7ff38008bcb0 con 0x7ff388150e90 2024-04-26T23:43:04.771 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:04.765+0000 7ff38d409640 1 --2- 172.21.15.88:0/222141444 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7ff36c06c8f0 0x7ff36c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:04.771 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:04.766+0000 7ff38d409640 1 --2- 172.21.15.88:0/222141444 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7ff36c06c8f0 0x7ff36c06edb0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7ff384034000 tx=0x7ff38402e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:04.775 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:04.771+0000 7ff37dffb640 1 -- 172.21.15.88:0/222141444 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7ff380059760 con 0x7ff388150e90 2024-04-26T23:43:05.111 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:05.107+0000 7ff38f66d640 1 -- 172.21.15.88:0/222141444 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7ff3880507a0 con 0x7ff388150e90 2024-04-26T23:43:05.112 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:05.108+0000 7ff37dffb640 1 -- 172.21.15.88:0/222141444 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (secure 0 0 0) 0x7ff38005da60 con 0x7ff388150e90 2024-04-26T23:43:05.114 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:05.110+0000 7ff38f66d640 1 -- 172.21.15.88:0/222141444 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7ff36c06c8f0 msgr2=0x7ff36c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:05.115 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:05.110+0000 7ff38f66d640 1 --2- 172.21.15.88:0/222141444 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7ff36c06c8f0 0x7ff36c06edb0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7ff384034000 tx=0x7ff38402e000 comp rx=0 tx=0).stop 2024-04-26T23:43:05.115 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:05.110+0000 7ff38f66d640 1 -- 172.21.15.88:0/222141444 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff388150e90 msgr2=0x7ff3881eaab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:05.115 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:05.110+0000 7ff38f66d640 1 --2- 172.21.15.88:0/222141444 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff388150e90 0x7ff3881eaab0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7ff380001b60 tx=0x7ff38000a430 comp rx=0 tx=0).stop 2024-04-26T23:43:05.115 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:05.110+0000 7ff38f66d640 1 -- 172.21.15.88:0/222141444 shutdown_connections 2024-04-26T23:43:05.115 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:05.110+0000 7ff38f66d640 1 --2- 172.21.15.88:0/222141444 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7ff36c06c8f0 0x7ff36c06edb0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:05.115 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:05.110+0000 7ff38f66d640 1 --2- 172.21.15.88:0/222141444 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff3880c3c70 0x7ff3881ea570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:05.115 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:05.110+0000 7ff38f66d640 1 --2- 172.21.15.88:0/222141444 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff388150e90 0x7ff3881eaab0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:05.115 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:05.110+0000 7ff38f66d640 1 --2- 172.21.15.88:0/222141444 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff38806f540 0x7ff388152a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:05.116 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:05.110+0000 7ff38f66d640 1 -- 172.21.15.88:0/222141444 >> 172.21.15.88:0/222141444 conn(0x7ff3880c5d70 msgr2=0x7ff38806f9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:43:05.116 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:05.110+0000 7ff38f66d640 1 -- 172.21.15.88:0/222141444 shutdown_connections 2024-04-26T23:43:05.116 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:05.110+0000 7ff38f66d640 1 -- 172.21.15.88:0/222141444 wait complete. 2024-04-26T23:43:05.131 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2024-04-26T23:43:12.397 INFO:tasks.workunit.client.1.smithi175.stdout:fs setup took 23 secs 2024-04-26T23:43:15.131 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-04-26T23:43:15.132 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-04-26T23:43:15.261 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.257+0000 7f8a0d020640 1 Processor -- start 2024-04-26T23:43:15.261 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.257+0000 7f8a0d020640 1 -- start start 2024-04-26T23:43:15.262 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.259+0000 7f8a0d020640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8a080c6e20 0x7f8a080c7200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:15.263 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.259+0000 7f8a0d020640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f8a080740e0 0x7f8a08156f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:15.263 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.259+0000 7f8a0d020640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8a0815a530 con 0x7f8a080ca3a0 2024-04-26T23:43:15.263 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.259+0000 7f8a0d020640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f8a08072930 con 0x7f8a080740e0 2024-04-26T23:43:15.263 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.259+0000 7f8a0d020640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f8a0815a810 con 0x7f8a080c6e20 2024-04-26T23:43:15.263 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.259+0000 7f8a0659c640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f8a080740e0 0x7f8a08156f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:15.263 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.259+0000 7f8a0659c640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f8a080740e0 0x7f8a08156f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:36578/0 (socket says 172.21.15.88:36578) 2024-04-26T23:43:15.264 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.259+0000 7f8a0659c640 1 -- 172.21.15.88:0/3106733358 learned_addr learned my addr 172.21.15.88:0/3106733358 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:43:15.264 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.259+0000 7f8a06d9d640 1 --2- 172.21.15.88:0/3106733358 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8a080c6e20 0x7f8a080c7200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:15.264 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.259+0000 7f8a0659c640 1 -- 172.21.15.88:0/3106733358 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8a080c6e20 msgr2=0x7f8a080c7200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:43:15.264 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.259+0000 7f8a0659c640 1 --2- 172.21.15.88:0/3106733358 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8a080c6e20 0x7f8a080c7200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:15.264 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.259+0000 7f8a0659c640 1 -- 172.21.15.88:0/3106733358 >> v1:172.21.15.175:6789/0 conn(0x7f8a080ca3a0 legacy=0x7f8a08157460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:43:15.265 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.259+0000 7f8a0659c640 1 -- 172.21.15.88:0/3106733358 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a0815aaf0 con 0x7f8a080740e0 2024-04-26T23:43:15.265 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.260+0000 7f8a0659c640 1 --2- 172.21.15.88:0/3106733358 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8a080740e0 0x7f8a08156f20 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f89fc009870 tx=0x7f89fc02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bacaa510310df510 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:15.265 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.261+0000 7f8a05d9b640 1 -- 172.21.15.88:0/3106733358 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89fc037070 con 0x7f8a080740e0 2024-04-26T23:43:15.265 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.261+0000 7f8a05d9b640 1 -- 172.21.15.88:0/3106733358 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89fc032440 con 0x7f8a080740e0 2024-04-26T23:43:15.265 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.261+0000 7f8a05d9b640 1 -- 172.21.15.88:0/3106733358 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89fc032810 con 0x7f8a080740e0 2024-04-26T23:43:15.266 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.261+0000 7f8a0d020640 1 -- 172.21.15.88:0/3106733358 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8a080740e0 msgr2=0x7f8a08156f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:15.266 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.261+0000 7f8a0d020640 1 --2- 172.21.15.88:0/3106733358 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8a080740e0 0x7f8a08156f20 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f89fc009870 tx=0x7f89fc02a180 comp rx=0 tx=0).stop 2024-04-26T23:43:15.266 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.261+0000 7f8a0d020640 1 -- 172.21.15.88:0/3106733358 shutdown_connections 2024-04-26T23:43:15.266 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.261+0000 7f8a0d020640 1 --2- 172.21.15.88:0/3106733358 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8a080740e0 0x7f8a08156f20 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:15.266 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.261+0000 7f8a0d020640 1 --2- 172.21.15.88:0/3106733358 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8a080c6e20 0x7f8a080c7200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:15.266 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.261+0000 7f8a0d020640 1 -- 172.21.15.88:0/3106733358 >> 172.21.15.88:0/3106733358 conn(0x7f8a080ae0b0 msgr2=0x7f8a080ae490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:43:15.266 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.262+0000 7f8a0d020640 1 -- 172.21.15.88:0/3106733358 shutdown_connections 2024-04-26T23:43:15.266 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.262+0000 7f8a0d020640 1 -- 172.21.15.88:0/3106733358 wait complete. 2024-04-26T23:43:15.267 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.263+0000 7f8a0d020640 1 Processor -- start 2024-04-26T23:43:15.267 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.263+0000 7f8a0d020640 1 -- start start 2024-04-26T23:43:15.269 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.264+0000 7f8a0d020640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8a080740e0 0x7f8a08158b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:15.270 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.264+0000 7f8a0d020640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8a080c6e20 0x7f8a08146be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:15.270 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.264+0000 7f8a0d020640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8a080ca3a0 0x7f8a08147120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:15.270 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.264+0000 7f8a0d020640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f8a08154540 con 0x7f8a080740e0 2024-04-26T23:43:15.270 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.264+0000 7f8a0d020640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f8a081543c0 con 0x7f8a080ca3a0 2024-04-26T23:43:15.270 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.264+0000 7f8a0d020640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f8a0815a0c0 con 0x7f8a080c6e20 2024-04-26T23:43:15.270 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.264+0000 7f8a06d9d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8a080740e0 0x7f8a08158b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:15.270 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.264+0000 7f8a06d9d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8a080740e0 0x7f8a08158b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:36590/0 (socket says 172.21.15.88:36590) 2024-04-26T23:43:15.270 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.264+0000 7f8a06d9d640 1 -- 172.21.15.88:0/1361480947 learned_addr learned my addr 172.21.15.88:0/1361480947 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:43:15.270 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.264+0000 7f8a0659c640 1 --2- 172.21.15.88:0/1361480947 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8a080c6e20 0x7f8a08146be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:15.270 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.264+0000 7f8a0759e640 1 --2- 172.21.15.88:0/1361480947 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8a080ca3a0 0x7f8a08147120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:15.270 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.264+0000 7f8a06d9d640 1 -- 172.21.15.88:0/1361480947 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8a080c6e20 msgr2=0x7f8a08146be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:15.270 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.264+0000 7f8a06d9d640 1 --2- 172.21.15.88:0/1361480947 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8a080c6e20 0x7f8a08146be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:15.270 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.264+0000 7f8a06d9d640 1 -- 172.21.15.88:0/1361480947 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8a080ca3a0 msgr2=0x7f8a08147120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:15.271 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.264+0000 7f8a06d9d640 1 --2- 172.21.15.88:0/1361480947 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8a080ca3a0 0x7f8a08147120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:15.271 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.264+0000 7f8a06d9d640 1 -- 172.21.15.88:0/1361480947 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a08147c80 con 0x7f8a080740e0 2024-04-26T23:43:15.271 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.264+0000 7f8a06d9d640 1 --2- 172.21.15.88:0/1361480947 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8a080740e0 0x7f8a08158b40 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f89f800d800 tx=0x7f89f800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:15.271 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.265+0000 7f89ef7fe640 1 -- 172.21.15.88:0/1361480947 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89f800b6c0 con 0x7f8a080740e0 2024-04-26T23:43:15.271 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.265+0000 7f89ef7fe640 1 -- 172.21.15.88:0/1361480947 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89f8019070 con 0x7f8a080740e0 2024-04-26T23:43:15.271 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.265+0000 7f8a0d020640 1 -- 172.21.15.88:0/1361480947 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a080c3160 con 0x7f8a080740e0 2024-04-26T23:43:15.271 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.265+0000 7f89ef7fe640 1 -- 172.21.15.88:0/1361480947 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89f800ba80 con 0x7f8a080740e0 2024-04-26T23:43:15.271 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.265+0000 7f8a0d020640 1 -- 172.21.15.88:0/1361480947 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a08159080 con 0x7f8a080740e0 2024-04-26T23:43:15.271 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.266+0000 7f8a0d020640 1 -- 172.21.15.88:0/1361480947 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a080766c0 con 0x7f8a080740e0 2024-04-26T23:43:15.272 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.266+0000 7f89ef7fe640 1 -- 172.21.15.88:0/1361480947 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f89f800bc20 con 0x7f8a080740e0 2024-04-26T23:43:15.272 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.266+0000 7f89ef7fe640 1 --2- 172.21.15.88:0/1361480947 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f89f406c8f0 0x7f89f406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:15.272 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.267+0000 7f8a0659c640 1 --2- 172.21.15.88:0/1361480947 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f89f406c8f0 0x7f89f406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:15.272 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.267+0000 7f89ef7fe640 1 -- 172.21.15.88:0/1361480947 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6666+0+0 (secure 0 0 0) 0x7f89f808c1d0 con 0x7f8a080740e0 2024-04-26T23:43:15.272 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.267+0000 7f8a0659c640 1 --2- 172.21.15.88:0/1361480947 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f89f406c8f0 0x7f89f406edb0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f89fc034000 tx=0x7f89fc02e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:15.275 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.271+0000 7f89ef7fe640 1 -- 172.21.15.88:0/1361480947 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f89f8059c80 con 0x7f8a080740e0 2024-04-26T23:43:15.557 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.553+0000 7f8a0d020640 1 -- 172.21.15.88:0/1361480947 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f8a081ec6c0 con 0x7f8a080740e0 2024-04-26T23:43:15.557 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.553+0000 7f89ef7fe640 1 -- 172.21.15.88:0/1361480947 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1565 (secure 0 0 0) 0x7f89f805df80 con 0x7f8a080740e0 2024-04-26T23:43:15.558 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":22,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":14,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"555255e9-7ef9-4454-8dc9-35e96b70035c","modified":"2024-04-26T23:39:34.291658Z","created":"2024-04-26T23:39:34.291658Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:3300","nonce":0},{"type":"v1","addr":"172.21.15.175:6789","nonce":0}]},"addr":"172.21.15.175:6789/0","public_addr":"172.21.15.175:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:3301","nonce":0},{"type":"v1","addr":"172.21.15.175:6790","nonce":0}]},"addr":"172.21.15.175:6790/0","public_addr":"172.21.15.175:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-04-26T23:43:15.560 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.555+0000 7f8a0d020640 1 -- 172.21.15.88:0/1361480947 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f89f406c8f0 msgr2=0x7f89f406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:15.560 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.555+0000 7f8a0d020640 1 --2- 172.21.15.88:0/1361480947 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f89f406c8f0 0x7f89f406edb0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f89fc034000 tx=0x7f89fc02e000 comp rx=0 tx=0).stop 2024-04-26T23:43:15.560 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.555+0000 7f8a0d020640 1 -- 172.21.15.88:0/1361480947 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8a080740e0 msgr2=0x7f8a08158b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:15.560 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.555+0000 7f8a0d020640 1 --2- 172.21.15.88:0/1361480947 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8a080740e0 0x7f8a08158b40 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f89f800d800 tx=0x7f89f800dcc0 comp rx=0 tx=0).stop 2024-04-26T23:43:15.560 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.556+0000 7f8a0d020640 1 -- 172.21.15.88:0/1361480947 shutdown_connections 2024-04-26T23:43:15.560 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.556+0000 7f8a0d020640 1 --2- 172.21.15.88:0/1361480947 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f89f406c8f0 0x7f89f406edb0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:15.560 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.556+0000 7f8a0d020640 1 --2- 172.21.15.88:0/1361480947 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8a080c6e20 0x7f8a08146be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:15.560 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.556+0000 7f8a0d020640 1 --2- 172.21.15.88:0/1361480947 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8a080ca3a0 0x7f8a08147120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:15.560 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.556+0000 7f8a0d020640 1 --2- 172.21.15.88:0/1361480947 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8a080740e0 0x7f8a08158b40 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:15.561 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.556+0000 7f8a0d020640 1 -- 172.21.15.88:0/1361480947 >> 172.21.15.88:0/1361480947 conn(0x7f8a080ae0b0 msgr2=0x7f8a080c9850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:43:15.561 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.556+0000 7f8a0d020640 1 -- 172.21.15.88:0/1361480947 shutdown_connections 2024-04-26T23:43:15.561 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.556+0000 7f8a0d020640 1 -- 172.21.15.88:0/1361480947 wait complete. 2024-04-26T23:43:15.573 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-04-26T23:43:15.573 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2024-04-26T23:43:15.573 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-04-26T23:43:15.574 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-04-26T23:43:15.638 INFO:tasks.workunit.client.1.smithi175.stdout:Syncing()...3 sec 2024-04-26T23:43:15.639 INFO:tasks.workunit.client.1.smithi175.stdout:Starting Actual Benchmark At: Fri Apr 26 23:43:15 2024 2024-04-26T23:43:15.639 INFO:tasks.workunit.client.1.smithi175.stdout: 2024-04-26T23:43:15.752 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.746+0000 7f415de99640 1 Processor -- start 2024-04-26T23:43:15.752 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.746+0000 7f415de99640 1 -- start start 2024-04-26T23:43:15.752 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.747+0000 7f415de99640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f415814ecd0 0x7f41581555a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:15.752 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.747+0000 7f415de99640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f41580ac710 0x7f41580ab470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:15.752 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.747+0000 7f415de99640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f415814f0b0 con 0x7f4158073690 2024-04-26T23:43:15.752 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.747+0000 7f415de99640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f4158074c90 con 0x7f415814ecd0 2024-04-26T23:43:15.752 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.747+0000 7f415de99640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f41580c6400 con 0x7f41580ac710 2024-04-26T23:43:15.753 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.747+0000 7f41577fe640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f415814ecd0 0x7f41581555a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:15.753 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.747+0000 7f41577fe640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f415814ecd0 0x7f41581555a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:36606/0 (socket says 172.21.15.88:36606) 2024-04-26T23:43:15.753 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.747+0000 7f41577fe640 1 -- 172.21.15.88:0/2827242028 learned_addr learned my addr 172.21.15.88:0/2827242028 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:43:15.753 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.748+0000 7f41577fe640 1 -- 172.21.15.88:0/2827242028 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f41580ac710 msgr2=0x7f41580ab470 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-26T23:43:15.753 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.748+0000 7f41577fe640 1 --2- 172.21.15.88:0/2827242028 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f41580ac710 0x7f41580ab470 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:15.753 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.748+0000 7f41577fe640 1 -- 172.21.15.88:0/2827242028 >> v1:172.21.15.88:6789/0 conn(0x7f4158073690 legacy=0x7f4158157fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:15.753 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.748+0000 7f41577fe640 1 -- 172.21.15.88:0/2827242028 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41580c66e0 con 0x7f415814ecd0 2024-04-26T23:43:15.755 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.748+0000 7f41577fe640 1 --2- 172.21.15.88:0/2827242028 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f415814ecd0 0x7f41581555a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f4148009870 tx=0x7f414802a150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df964a818995856a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:15.755 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.749+0000 7f41567fc640 1 -- 172.21.15.88:0/2827242028 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4148037070 con 0x7f415814ecd0 2024-04-26T23:43:15.755 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.749+0000 7f41567fc640 1 -- 172.21.15.88:0/2827242028 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4148032440 con 0x7f415814ecd0 2024-04-26T23:43:15.755 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.749+0000 7f41567fc640 1 -- 172.21.15.88:0/2827242028 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4148032810 con 0x7f415814ecd0 2024-04-26T23:43:15.755 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.750+0000 7f415de99640 1 -- 172.21.15.88:0/2827242028 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f415814ecd0 msgr2=0x7f41581555a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:15.755 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.750+0000 7f415de99640 1 --2- 172.21.15.88:0/2827242028 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f415814ecd0 0x7f41581555a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f4148009870 tx=0x7f414802a150 comp rx=0 tx=0).stop 2024-04-26T23:43:15.755 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.750+0000 7f415de99640 1 -- 172.21.15.88:0/2827242028 shutdown_connections 2024-04-26T23:43:15.755 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.750+0000 7f415de99640 1 --2- 172.21.15.88:0/2827242028 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f41580ac710 0x7f41580ab470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:15.755 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.750+0000 7f415de99640 1 --2- 172.21.15.88:0/2827242028 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f415814ecd0 0x7f41581555a0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:15.755 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.750+0000 7f415de99640 1 -- 172.21.15.88:0/2827242028 >> 172.21.15.88:0/2827242028 conn(0x7f41580c6d80 msgr2=0x7f41580c7160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:43:15.755 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.750+0000 7f415de99640 1 -- 172.21.15.88:0/2827242028 shutdown_connections 2024-04-26T23:43:15.756 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.750+0000 7f415de99640 1 -- 172.21.15.88:0/2827242028 wait complete. 2024-04-26T23:43:15.758 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.751+0000 7f415de99640 1 Processor -- start 2024-04-26T23:43:15.758 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.752+0000 7f415de99640 1 -- start start 2024-04-26T23:43:15.758 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.752+0000 7f415de99640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4158073690 0x7f41581ee500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:15.758 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.752+0000 7f415de99640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f41580ac710 0x7f41581edc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:15.758 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.752+0000 7f415de99640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f415814ecd0 0x7f41580ae520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:15.758 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.752+0000 7f415de99640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f4158155080 con 0x7f415814ecd0 2024-04-26T23:43:15.758 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.752+0000 7f415de99640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f4158154da0 con 0x7f41580ac710 2024-04-26T23:43:15.758 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.752+0000 7f415de99640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f41580c69c0 con 0x7f4158073690 2024-04-26T23:43:15.759 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.753+0000 7f4157fff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f415814ecd0 0x7f41580ae520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:15.759 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.753+0000 7f4157fff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f415814ecd0 0x7f41580ae520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:36612/0 (socket says 172.21.15.88:36612) 2024-04-26T23:43:15.759 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.753+0000 7f4157fff640 1 -- 172.21.15.88:0/908418417 learned_addr learned my addr 172.21.15.88:0/908418417 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:43:15.759 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.753+0000 7f4157fff640 1 -- 172.21.15.88:0/908418417 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4158073690 msgr2=0x7f41581ee500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:15.759 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.753+0000 7f4157fff640 1 --2- 172.21.15.88:0/908418417 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4158073690 0x7f41581ee500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:15.759 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.753+0000 7f4157fff640 1 -- 172.21.15.88:0/908418417 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f41580ac710 msgr2=0x7f41581edc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:15.759 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.753+0000 7f4157fff640 1 --2- 172.21.15.88:0/908418417 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f41580ac710 0x7f41581edc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:15.759 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.753+0000 7f4157fff640 1 -- 172.21.15.88:0/908418417 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41581de4a0 con 0x7f415814ecd0 2024-04-26T23:43:15.759 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.753+0000 7f4157fff640 1 --2- 172.21.15.88:0/908418417 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f415814ecd0 0x7f41580ae520 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f415000c6e0 tx=0x7f415000cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:15.759 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.754+0000 7f413ffff640 1 -- 172.21.15.88:0/908418417 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4150003b70 con 0x7f415814ecd0 2024-04-26T23:43:15.759 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.754+0000 7f413ffff640 1 -- 172.21.15.88:0/908418417 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4150003d30 con 0x7f415814ecd0 2024-04-26T23:43:15.759 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.754+0000 7f413ffff640 1 -- 172.21.15.88:0/908418417 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4150005310 con 0x7f415814ecd0 2024-04-26T23:43:15.759 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.754+0000 7f415de99640 1 -- 172.21.15.88:0/908418417 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41580af330 con 0x7f415814ecd0 2024-04-26T23:43:15.760 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.754+0000 7f415de99640 1 -- 172.21.15.88:0/908418417 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41581ee1c0 con 0x7f415814ecd0 2024-04-26T23:43:15.760 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.755+0000 7f415de99640 1 --2- 172.21.15.88:0/908418417 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f41581de010 0x7f41580aea60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:15.760 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.755+0000 7f415de99640 1 -- 172.21.15.88:0/908418417 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f41580af850 con 0x7f41581de010 2024-04-26T23:43:15.761 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.756+0000 7f41577fe640 1 --2- 172.21.15.88:0/908418417 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f41581de010 0x7f41580aea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:15.761 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.756+0000 7f413ffff640 1 -- 172.21.15.88:0/908418417 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f41500054b0 con 0x7f415814ecd0 2024-04-26T23:43:15.761 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.756+0000 7f41577fe640 1 -- 172.21.15.88:0/908418417 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4158076650 con 0x7f41581de010 2024-04-26T23:43:15.761 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.757+0000 7f413ffff640 1 --2- 172.21.15.88:0/908418417 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f414406c9f0 0x7f414406eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:15.761 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.757+0000 7f413ffff640 1 -- 172.21.15.88:0/908418417 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6666+0+0 (secure 0 0 0) 0x7f415008bd50 con 0x7f415814ecd0 2024-04-26T23:43:15.761 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.757+0000 7f41577fe640 1 --2- 172.21.15.88:0/908418417 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f41581de010 0x7f41580aea60 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f41580c4a00 tx=0x7f4148032e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:15.761 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.757+0000 7f413ffff640 1 -- 172.21.15.88:0/908418417 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4148041030 con 0x7f41581de010 2024-04-26T23:43:15.762 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.758+0000 7f413ffff640 1 -- 172.21.15.88:0/908418417 <== mon.0 v2:172.21.15.88:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f414803d420 con 0x7f41581de010 2024-04-26T23:43:15.762 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.758+0000 7f413ffff640 1 -- 172.21.15.88:0/908418417 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f41581de010 msgr2=0x7f41580aea60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:15.762 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.758+0000 7f413ffff640 1 --2- 172.21.15.88:0/908418417 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f41581de010 0x7f41580aea60 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f41580c4a00 tx=0x7f4148032e50 comp rx=0 tx=0).stop 2024-04-26T23:43:15.762 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.758+0000 7f413ffff640 1 -- 172.21.15.88:0/908418417 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f41581de010 msgr2=0x7f41580aea60 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:43:15.762 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.758+0000 7f413ffff640 1 --2- 172.21.15.88:0/908418417 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f41581de010 0x7f41580aea60 secure :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f41580c4a00 tx=0x7f4148032e50 comp rx=0 tx=0).stop 2024-04-26T23:43:15.764 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.759+0000 7f4156ffd640 1 --2- 172.21.15.88:0/908418417 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f414406c9f0 0x7f414406eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:15.764 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.760+0000 7f4156ffd640 1 --2- 172.21.15.88:0/908418417 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f414406c9f0 0x7f414406eeb0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f41580c9ac0 tx=0x7f414c006c40 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:15.773 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.769+0000 7f415de99640 1 --2- 172.21.15.88:0/908418417 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4158148d20 0x7f4158149130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:15.773 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.769+0000 7f415de99640 1 -- 172.21.15.88:0/908418417 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f41580507a0 con 0x7f4158148d20 2024-04-26T23:43:15.774 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.770+0000 7f41577fe640 1 --2- 172.21.15.88:0/908418417 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4158148d20 0x7f4158149130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:15.775 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.770+0000 7f41577fe640 1 -- 172.21.15.88:0/908418417 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f4158073f70 con 0x7f4158148d20 2024-04-26T23:43:15.775 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.770+0000 7f41577fe640 1 --2- 172.21.15.88:0/908418417 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4158148d20 0x7f4158149130 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f4148009870 tx=0x7f4148008030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:15.775 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.770+0000 7f413ffff640 1 -- 172.21.15.88:0/908418417 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4148041040 con 0x7f4158148d20 2024-04-26T23:43:15.775 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.771+0000 7f413ffff640 1 -- 172.21.15.88:0/908418417 <== mon.0 v2:172.21.15.88:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4870 (secure 0 0 0) 0x7f4148003df0 con 0x7f4158148d20 2024-04-26T23:43:15.775 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.771+0000 7f413ffff640 1 -- 172.21.15.88:0/908418417 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4158148d20 msgr2=0x7f4158149130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:15.775 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.771+0000 7f413ffff640 1 --2- 172.21.15.88:0/908418417 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4158148d20 0x7f4158149130 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f4148009870 tx=0x7f4148008030 comp rx=0 tx=0).stop 2024-04-26T23:43:15.775 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.771+0000 7f413ffff640 1 -- 172.21.15.88:0/908418417 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4158148d20 msgr2=0x7f4158149130 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:43:15.775 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.771+0000 7f413ffff640 1 --2- 172.21.15.88:0/908418417 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4158148d20 0x7f4158149130 secure :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f4148009870 tx=0x7f4148008030 comp rx=0 tx=0).stop 2024-04-26T23:43:15.776 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-04-26T23:43:15.776 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2024-04-26T23:43:15.776 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2024-04-26T23:43:15.776 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "leader", 2024-04-26T23:43:15.776 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 22, 2024-04-26T23:43:15.776 INFO:teuthology.orchestra.run.smithi088.stdout: "uptime": 84743, 2024-04-26T23:43:15.776 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2024-04-26T23:43:15.776 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2024-04-26T23:43:15.776 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2024-04-26T23:43:15.776 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2024-04-26T23:43:15.776 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:43:15.776 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 14, 2024-04-26T23:43:15.776 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2024-04-26T23:43:15.777 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2450521708007866372", 2024-04-26T23:43:15.777 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2024-04-26T23:43:15.777 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-04-26T23:43:15.777 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-04-26T23:43:15.777 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-04-26T23:43:15.777 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-04-26T23:43:15.777 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-04-26T23:43:15.777 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-04-26T23:43:15.777 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-04-26T23:43:15.777 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-04-26T23:43:15.777 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-04-26T23:43:15.777 INFO:teuthology.orchestra.run.smithi088.stdout: "reef", 2024-04-26T23:43:15.777 INFO:teuthology.orchestra.run.smithi088.stdout: "squid" 2024-04-26T23:43:15.777 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:43:15.777 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540701547738038271", 2024-04-26T23:43:15.778 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2024-04-26T23:43:15.778 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-04-26T23:43:15.778 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-04-26T23:43:15.778 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-04-26T23:43:15.778 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-04-26T23:43:15.778 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-04-26T23:43:15.778 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-04-26T23:43:15.778 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-04-26T23:43:15.778 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-04-26T23:43:15.778 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-04-26T23:43:15.778 INFO:teuthology.orchestra.run.smithi088.stdout: "reef", 2024-04-26T23:43:15.778 INFO:teuthology.orchestra.run.smithi088.stdout: "squid" 2024-04-26T23:43:15.778 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:43:15.779 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:43:15.779 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2024-04-26T23:43:15.779 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2024-04-26T23:43:15.779 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2024-04-26T23:43:15.779 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2024-04-26T23:43:15.779 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2024-04-26T23:43:15.779 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "555255e9-7ef9-4454-8dc9-35e96b70035c", 2024-04-26T23:43:15.779 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2024-04-26T23:39:34.291658Z", 2024-04-26T23:43:15.779 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2024-04-26T23:39:34.291658Z", 2024-04-26T23:43:15.779 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 19, 2024-04-26T23:43:15.779 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "squid", 2024-04-26T23:43:15.779 INFO:teuthology.orchestra.run.smithi088.stdout: "election_strategy": 1, 2024-04-26T23:43:15.779 INFO:teuthology.orchestra.run.smithi088.stdout: "disallowed_leaders: ": "", 2024-04-26T23:43:15.779 INFO:teuthology.orchestra.run.smithi088.stdout: "stretch_mode": false, 2024-04-26T23:43:15.779 INFO:teuthology.orchestra.run.smithi088.stdout: "tiebreaker_mon": "", 2024-04-26T23:43:15.780 INFO:teuthology.orchestra.run.smithi088.stdout: "removed_ranks: ": "", 2024-04-26T23:43:15.780 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2024-04-26T23:43:15.780 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2024-04-26T23:43:15.780 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-04-26T23:43:15.780 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-04-26T23:43:15.780 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-04-26T23:43:15.780 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-04-26T23:43:15.780 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-04-26T23:43:15.780 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-04-26T23:43:15.780 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-04-26T23:43:15.780 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-04-26T23:43:15.780 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-04-26T23:43:15.780 INFO:teuthology.orchestra.run.smithi088.stdout: "reef", 2024-04-26T23:43:15.780 INFO:teuthology.orchestra.run.smithi088.stdout: "squid" 2024-04-26T23:43:15.780 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:43:15.781 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2024-04-26T23:43:15.781 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:43:15.781 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2024-04-26T23:43:15.781 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:43:15.781 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2024-04-26T23:43:15.781 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2024-04-26T23:43:15.781 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-04-26T23:43:15.781 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-04-26T23:43:15.781 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:43:15.781 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-04-26T23:43:15.781 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2024-04-26T23:43:15.781 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:43:15.781 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:43:15.781 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:43:15.782 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-04-26T23:43:15.782 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2024-04-26T23:43:15.782 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:43:15.782 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:43:15.782 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:43:15.782 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:43:15.782 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2024-04-26T23:43:15.782 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2024-04-26T23:43:15.782 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-04-26T23:43:15.782 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-04-26T23:43:15.782 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-04-26T23:43:15.782 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:43:15.782 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:43:15.782 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2024-04-26T23:43:15.783 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2024-04-26T23:43:15.783 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-04-26T23:43:15.783 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-04-26T23:43:15.783 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:43:15.783 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-04-26T23:43:15.783 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:3300", 2024-04-26T23:43:15.783 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:43:15.783 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:43:15.783 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:43:15.783 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-04-26T23:43:15.783 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6789", 2024-04-26T23:43:15.783 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:43:15.783 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:43:15.783 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:43:15.784 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:43:15.784 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6789/0", 2024-04-26T23:43:15.784 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.175:6789/0", 2024-04-26T23:43:15.784 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-04-26T23:43:15.784 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-04-26T23:43:15.784 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-04-26T23:43:15.784 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:43:15.784 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:43:15.784 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2024-04-26T23:43:15.784 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2024-04-26T23:43:15.784 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-04-26T23:43:15.784 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-04-26T23:43:15.784 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:43:15.784 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-04-26T23:43:15.784 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:3301", 2024-04-26T23:43:15.785 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:43:15.785 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:43:15.785 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:43:15.785 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-04-26T23:43:15.785 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6790", 2024-04-26T23:43:15.785 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:43:15.785 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:43:15.785 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:43:15.785 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:43:15.785 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6790/0", 2024-04-26T23:43:15.785 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.175:6790/0", 2024-04-26T23:43:15.785 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-04-26T23:43:15.785 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-04-26T23:43:15.785 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-04-26T23:43:15.786 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:43:15.786 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:43:15.786 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:43:15.786 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2024-04-26T23:43:15.786 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2024-04-26T23:43:15.786 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:43:15.786 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:43:15.786 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:43:15.786 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2024-04-26T23:43:15.786 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:43:15.786 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:43:15.786 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": [ 2024-04-26T23:43:15.786 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:43:15.786 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:43:15.787 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:43:15.787 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 3 2024-04-26T23:43:15.787 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:43:15.787 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:43:15.787 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2024-04-26T23:43:15.787 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:43:15.787 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x2f018fb87aa4aafe", 2024-04-26T23:43:15.787 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:43:15.787 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2024-04-26T23:43:15.787 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:43:15.787 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:43:15.787 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:43:15.787 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:43:15.787 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 3 2024-04-26T23:43:15.787 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:43:15.788 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:43:15.788 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:43:15.788 INFO:teuthology.orchestra.run.smithi088.stdout: "stretch_mode": false 2024-04-26T23:43:15.788 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-04-26T23:43:15.789 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.771+0000 7f415de99640 1 -- 172.21.15.88:0/908418417 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f414406c9f0 msgr2=0x7f414406eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:15.789 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.771+0000 7f415de99640 1 --2- 172.21.15.88:0/908418417 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f414406c9f0 0x7f414406eeb0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f41580c9ac0 tx=0x7f414c006c40 comp rx=0 tx=0).stop 2024-04-26T23:43:15.789 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.771+0000 7f415de99640 1 -- 172.21.15.88:0/908418417 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f415814ecd0 msgr2=0x7f41580ae520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:15.789 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.771+0000 7f415de99640 1 --2- 172.21.15.88:0/908418417 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f415814ecd0 0x7f41580ae520 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f415000c6e0 tx=0x7f415000cba0 comp rx=0 tx=0).stop 2024-04-26T23:43:15.789 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.771+0000 7f4157fff640 1 -- 172.21.15.88:0/908418417 reap_dead start 2024-04-26T23:43:15.789 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.771+0000 7f4157fff640 1 -- 172.21.15.88:0/908418417 reap_dead start 2024-04-26T23:43:15.789 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.771+0000 7f415de99640 1 -- 172.21.15.88:0/908418417 shutdown_connections 2024-04-26T23:43:15.789 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.771+0000 7f415de99640 1 -- 172.21.15.88:0/908418417 >> 172.21.15.88:0/908418417 conn(0x7f41580c6d80 msgr2=0x7f41580c7160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:43:15.789 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.772+0000 7f415de99640 1 -- 172.21.15.88:0/908418417 shutdown_connections 2024-04-26T23:43:15.790 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.772+0000 7f415de99640 1 -- 172.21.15.88:0/908418417 wait complete. 2024-04-26T23:43:15.790 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-04-26T23:43:15.790 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-04-26T23:43:15.790 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-04-26T23:43:15.908 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.904+0000 7f5a6d4cf640 1 Processor -- start 2024-04-26T23:43:15.909 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.904+0000 7f5a6d4cf640 1 -- start start 2024-04-26T23:43:15.910 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.905+0000 7f5a6d4cf640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5a6813ffb0 0x7f5a680c3b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:15.911 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.905+0000 7f5a6d4cf640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f5a68074c10 0x7f5a680c40b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:15.911 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.905+0000 7f5a6d4cf640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f5a680c45f0 0x7f5a68073700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:15.911 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.905+0000 7f5a6d4cf640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f5a68070880 con 0x7f5a680c45f0 2024-04-26T23:43:15.911 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.905+0000 7f5a6d4cf640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f5a681579d0 con 0x7f5a68074c10 2024-04-26T23:43:15.911 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.905+0000 7f5a6d4cf640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f5a680ab680 con 0x7f5a6813ffb0 2024-04-26T23:43:15.911 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.905+0000 7f5a677fe640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f5a680c45f0 0x7f5a68073700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:15.911 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.905+0000 7f5a677fe640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f5a680c45f0 0x7f5a68073700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:36654/0 (socket says 172.21.15.88:36654) 2024-04-26T23:43:15.911 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.905+0000 7f5a677fe640 1 -- 172.21.15.88:0/1847888546 learned_addr learned my addr 172.21.15.88:0/1847888546 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:43:15.911 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.905+0000 7f5a66ffd640 1 --2- 172.21.15.88:0/1847888546 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5a6813ffb0 0x7f5a680c3b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:15.911 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.905+0000 7f5a667fc640 1 --2- 172.21.15.88:0/1847888546 >> v2:172.21.15.175:3300/0 conn(0x7f5a68074c10 0x7f5a680c40b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:15.911 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.906+0000 7f5a677fe640 1 -- 172.21.15.88:0/1847888546 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5a6813ffb0 msgr2=0x7f5a680c3b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:43:15.911 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.906+0000 7f5a677fe640 1 --2- 172.21.15.88:0/1847888546 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5a6813ffb0 0x7f5a680c3b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:15.912 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.906+0000 7f5a677fe640 1 -- 172.21.15.88:0/1847888546 >> v2:172.21.15.175:3300/0 conn(0x7f5a68074c10 msgr2=0x7f5a680c40b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:43:15.912 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.906+0000 7f5a677fe640 1 --2- 172.21.15.88:0/1847888546 >> v2:172.21.15.175:3300/0 conn(0x7f5a68074c10 0x7f5a680c40b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:15.912 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.906+0000 7f5a677fe640 1 -- 172.21.15.88:0/1847888546 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a680ab960 con 0x7f5a680c45f0 2024-04-26T23:43:15.912 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.906+0000 7f5a677fe640 1 --2- 172.21.15.88:0/1847888546 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5a680c45f0 0x7f5a68073700 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f5a680706f0 tx=0x7f5a6002a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2043a4a1f0ccdf93 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:15.912 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.906+0000 7f5a65ffb640 1 -- 172.21.15.88:0/1847888546 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a60036070 con 0x7f5a680c45f0 2024-04-26T23:43:15.912 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.906+0000 7f5a65ffb640 1 -- 172.21.15.88:0/1847888546 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a60031600 con 0x7f5a680c45f0 2024-04-26T23:43:15.912 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.906+0000 7f5a65ffb640 1 -- 172.21.15.88:0/1847888546 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a600319d0 con 0x7f5a680c45f0 2024-04-26T23:43:15.915 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.907+0000 7f5a6d4cf640 1 -- 172.21.15.88:0/1847888546 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5a680c45f0 msgr2=0x7f5a68073700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:15.915 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.907+0000 7f5a6d4cf640 1 --2- 172.21.15.88:0/1847888546 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5a680c45f0 0x7f5a68073700 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f5a680706f0 tx=0x7f5a6002a6a0 comp rx=0 tx=0).stop 2024-04-26T23:43:15.915 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.907+0000 7f5a6d4cf640 1 -- 172.21.15.88:0/1847888546 shutdown_connections 2024-04-26T23:43:15.915 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.907+0000 7f5a6d4cf640 1 --2- 172.21.15.88:0/1847888546 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5a680c45f0 0x7f5a68073700 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:15.916 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.907+0000 7f5a6d4cf640 1 --2- 172.21.15.88:0/1847888546 >> v2:172.21.15.175:3300/0 conn(0x7f5a68074c10 0x7f5a680c40b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:15.916 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.907+0000 7f5a6d4cf640 1 --2- 172.21.15.88:0/1847888546 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5a6813ffb0 0x7f5a680c3b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:15.916 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.907+0000 7f5a6d4cf640 1 -- 172.21.15.88:0/1847888546 >> 172.21.15.88:0/1847888546 conn(0x7f5a680ca2f0 msgr2=0x7f5a680ca6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:43:15.916 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.907+0000 7f5a6d4cf640 1 -- 172.21.15.88:0/1847888546 shutdown_connections 2024-04-26T23:43:15.916 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.907+0000 7f5a6d4cf640 1 -- 172.21.15.88:0/1847888546 wait complete. 2024-04-26T23:43:15.916 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.908+0000 7f5a6d4cf640 1 Processor -- start 2024-04-26T23:43:15.916 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.909+0000 7f5a6d4cf640 1 -- start start 2024-04-26T23:43:15.916 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.909+0000 7f5a6d4cf640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5a68074c10 0x7f5a6813cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:15.916 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.909+0000 7f5a6d4cf640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5a680c45f0 0x7f5a681efd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:15.916 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.909+0000 7f5a6d4cf640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5a6813ffb0 0x7f5a680c5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:15.916 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.909+0000 7f5a6d4cf640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f5a68073c40 con 0x7f5a6813ffb0 2024-04-26T23:43:15.916 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.909+0000 7f5a6d4cf640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f5a68157660 con 0x7f5a68074c10 2024-04-26T23:43:15.916 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.909+0000 7f5a6d4cf640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f5a68073dc0 con 0x7f5a680c45f0 2024-04-26T23:43:15.916 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.909+0000 7f5a677fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5a6813ffb0 0x7f5a680c5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:15.917 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.909+0000 7f5a677fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5a6813ffb0 0x7f5a680c5700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:36658/0 (socket says 172.21.15.88:36658) 2024-04-26T23:43:15.917 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.909+0000 7f5a677fe640 1 -- 172.21.15.88:0/3965890450 learned_addr learned my addr 172.21.15.88:0/3965890450 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:43:15.917 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.909+0000 7f5a66ffd640 1 --2- 172.21.15.88:0/3965890450 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5a68074c10 0x7f5a6813cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:15.917 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.910+0000 7f5a667fc640 1 --2- 172.21.15.88:0/3965890450 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5a680c45f0 0x7f5a681efd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:15.917 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.910+0000 7f5a677fe640 1 -- 172.21.15.88:0/3965890450 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5a680c45f0 msgr2=0x7f5a681efd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:15.917 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.910+0000 7f5a677fe640 1 --2- 172.21.15.88:0/3965890450 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5a680c45f0 0x7f5a681efd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:15.917 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.910+0000 7f5a677fe640 1 -- 172.21.15.88:0/3965890450 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5a68074c10 msgr2=0x7f5a6813cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:15.917 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.910+0000 7f5a677fe640 1 --2- 172.21.15.88:0/3965890450 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5a68074c10 0x7f5a6813cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:15.917 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.910+0000 7f5a677fe640 1 -- 172.21.15.88:0/3965890450 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a681f05a0 con 0x7f5a6813ffb0 2024-04-26T23:43:15.917 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.910+0000 7f5a667fc640 1 --2- 172.21.15.88:0/3965890450 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5a680c45f0 0x7f5a681efd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:43:15.917 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.910+0000 7f5a677fe640 1 --2- 172.21.15.88:0/3965890450 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5a6813ffb0 0x7f5a680c5700 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f5a60009f40 tx=0x7f5a60004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:15.917 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.910+0000 7f5a4f7fe640 1 -- 172.21.15.88:0/3965890450 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a60036050 con 0x7f5a6813ffb0 2024-04-26T23:43:15.917 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.910+0000 7f5a4f7fe640 1 -- 172.21.15.88:0/3965890450 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a60042070 con 0x7f5a6813ffb0 2024-04-26T23:43:15.918 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.910+0000 7f5a6d4cf640 1 -- 172.21.15.88:0/3965890450 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a681f0880 con 0x7f5a6813ffb0 2024-04-26T23:43:15.918 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.910+0000 7f5a4f7fe640 1 -- 172.21.15.88:0/3965890450 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a60009510 con 0x7f5a6813ffb0 2024-04-26T23:43:15.918 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.910+0000 7f5a6d4cf640 1 -- 172.21.15.88:0/3965890450 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a681f02a0 con 0x7f5a6813ffb0 2024-04-26T23:43:15.918 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.911+0000 7f5a6d4cf640 1 --2- 172.21.15.88:0/3965890450 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5a680c5c40 0x7f5a680c6020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:15.918 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.911+0000 7f5a6d4cf640 1 -- 172.21.15.88:0/3965890450 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f5a6815aea0 con 0x7f5a680c5c40 2024-04-26T23:43:15.918 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.912+0000 7f5a66ffd640 1 --2- 172.21.15.88:0/3965890450 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5a680c5c40 0x7f5a680c6020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:15.919 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.912+0000 7f5a4f7fe640 1 -- 172.21.15.88:0/3965890450 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f5a60007bd0 con 0x7f5a6813ffb0 2024-04-26T23:43:15.920 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.912+0000 7f5a66ffd640 1 -- 172.21.15.88:0/3965890450 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5a6815b070 con 0x7f5a680c5c40 2024-04-26T23:43:15.920 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.912+0000 7f5a4f7fe640 1 --2- 172.21.15.88:0/3965890450 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f5a5406c8f0 0x7f5a5406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:15.920 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.913+0000 7f5a4f7fe640 1 -- 172.21.15.88:0/3965890450 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6666+0+0 (secure 0 0 0) 0x7f5a600acf20 con 0x7f5a6813ffb0 2024-04-26T23:43:15.920 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.913+0000 7f5a667fc640 1 --2- 172.21.15.88:0/3965890450 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f5a5406c8f0 0x7f5a5406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:15.920 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.913+0000 7f5a66ffd640 1 --2- 172.21.15.88:0/3965890450 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5a680c5c40 0x7f5a680c6020 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f5a5800bfd0 tx=0x7f5a5800f8a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:15.920 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.913+0000 7f5a4f7fe640 1 -- 172.21.15.88:0/3965890450 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a58019030 con 0x7f5a680c5c40 2024-04-26T23:43:15.921 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.913+0000 7f5a667fc640 1 --2- 172.21.15.88:0/3965890450 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f5a5406c8f0 0x7f5a5406edb0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f5a5c006fd0 tx=0x7f5a5c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:15.921 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.913+0000 7f5a4f7fe640 1 -- 172.21.15.88:0/3965890450 <== mon.1 v2:172.21.15.175:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f5a58004020 con 0x7f5a680c5c40 2024-04-26T23:43:15.921 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.913+0000 7f5a4f7fe640 1 -- 172.21.15.88:0/3965890450 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5a680c5c40 msgr2=0x7f5a680c6020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:15.921 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.913+0000 7f5a4f7fe640 1 --2- 172.21.15.88:0/3965890450 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5a680c5c40 0x7f5a680c6020 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f5a5800bfd0 tx=0x7f5a5800f8a0 comp rx=0 tx=0).stop 2024-04-26T23:43:15.921 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.913+0000 7f5a4f7fe640 1 -- 172.21.15.88:0/3965890450 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5a680c5c40 msgr2=0x7f5a680c6020 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:43:15.921 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.913+0000 7f5a4f7fe640 1 --2- 172.21.15.88:0/3965890450 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5a680c5c40 0x7f5a680c6020 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:15.924 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.920+0000 7f5a6d4cf640 1 --2- 172.21.15.88:0/3965890450 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5a6813bcb0 0x7f5a6813c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:15.924 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.920+0000 7f5a6d4cf640 1 -- 172.21.15.88:0/3965890450 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f5a680507a0 con 0x7f5a6813bcb0 2024-04-26T23:43:15.924 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.920+0000 7f5a66ffd640 1 --2- 172.21.15.88:0/3965890450 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5a6813bcb0 0x7f5a6813c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:15.925 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.921+0000 7f5a66ffd640 1 -- 172.21.15.88:0/3965890450 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f5a68076650 con 0x7f5a6813bcb0 2024-04-26T23:43:15.925 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.921+0000 7f5a66ffd640 1 --2- 172.21.15.88:0/3965890450 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5a6813bcb0 0x7f5a6813c0c0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f5a5800bfd0 tx=0x7f5a580046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:15.926 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.922+0000 7f5a4f7fe640 1 -- 172.21.15.88:0/3965890450 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a58003610 con 0x7f5a6813bcb0 2024-04-26T23:43:15.926 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.922+0000 7f5a4f7fe640 1 -- 172.21.15.88:0/3965890450 <== mon.1 v2:172.21.15.175:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5066 (secure 0 0 0) 0x7f5a580037b0 con 0x7f5a6813bcb0 2024-04-26T23:43:15.927 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.922+0000 7f5a4f7fe640 1 -- 172.21.15.88:0/3965890450 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5a6813bcb0 msgr2=0x7f5a6813c0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:15.927 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.922+0000 7f5a4f7fe640 1 --2- 172.21.15.88:0/3965890450 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5a6813bcb0 0x7f5a6813c0c0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f5a5800bfd0 tx=0x7f5a580046c0 comp rx=0 tx=0).stop 2024-04-26T23:43:15.927 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.922+0000 7f5a4f7fe640 1 -- 172.21.15.88:0/3965890450 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5a6813bcb0 msgr2=0x7f5a6813c0c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:43:15.927 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.922+0000 7f5a4f7fe640 1 --2- 172.21.15.88:0/3965890450 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5a6813bcb0 0x7f5a6813c0c0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:15.927 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-04-26T23:43:15.927 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2024-04-26T23:43:15.927 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2024-04-26T23:43:15.927 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "peon", 2024-04-26T23:43:15.927 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 22, 2024-04-26T23:43:15.927 INFO:teuthology.orchestra.run.smithi088.stdout: "uptime": 188265, 2024-04-26T23:43:15.928 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2024-04-26T23:43:15.928 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2024-04-26T23:43:15.928 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2024-04-26T23:43:15.928 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2024-04-26T23:43:15.928 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:43:15.928 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 15, 2024-04-26T23:43:15.928 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2024-04-26T23:43:15.928 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2450521708007866372", 2024-04-26T23:43:15.928 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2024-04-26T23:43:15.928 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-04-26T23:43:15.928 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-04-26T23:43:15.929 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-04-26T23:43:15.929 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-04-26T23:43:15.929 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-04-26T23:43:15.929 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-04-26T23:43:15.929 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-04-26T23:43:15.929 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-04-26T23:43:15.929 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-04-26T23:43:15.929 INFO:teuthology.orchestra.run.smithi088.stdout: "reef", 2024-04-26T23:43:15.929 INFO:teuthology.orchestra.run.smithi088.stdout: "squid" 2024-04-26T23:43:15.929 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:43:15.929 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540701547738038271", 2024-04-26T23:43:15.930 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2024-04-26T23:43:15.930 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-04-26T23:43:15.930 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-04-26T23:43:15.930 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-04-26T23:43:15.930 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-04-26T23:43:15.930 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-04-26T23:43:15.930 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-04-26T23:43:15.930 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-04-26T23:43:15.930 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-04-26T23:43:15.930 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-04-26T23:43:15.930 INFO:teuthology.orchestra.run.smithi088.stdout: "reef", 2024-04-26T23:43:15.930 INFO:teuthology.orchestra.run.smithi088.stdout: "squid" 2024-04-26T23:43:15.930 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:43:15.930 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:43:15.931 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2024-04-26T23:43:15.931 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2024-04-26T23:43:15.931 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2024-04-26T23:43:15.931 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2024-04-26T23:43:15.931 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2024-04-26T23:43:15.931 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "555255e9-7ef9-4454-8dc9-35e96b70035c", 2024-04-26T23:43:15.931 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2024-04-26T23:39:34.291658Z", 2024-04-26T23:43:15.931 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2024-04-26T23:39:34.291658Z", 2024-04-26T23:43:15.931 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 19, 2024-04-26T23:43:15.931 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "squid", 2024-04-26T23:43:15.931 INFO:teuthology.orchestra.run.smithi088.stdout: "election_strategy": 1, 2024-04-26T23:43:15.931 INFO:teuthology.orchestra.run.smithi088.stdout: "disallowed_leaders: ": "", 2024-04-26T23:43:15.931 INFO:teuthology.orchestra.run.smithi088.stdout: "stretch_mode": false, 2024-04-26T23:43:15.931 INFO:teuthology.orchestra.run.smithi088.stdout: "tiebreaker_mon": "", 2024-04-26T23:43:15.931 INFO:teuthology.orchestra.run.smithi088.stdout: "removed_ranks: ": "", 2024-04-26T23:43:15.931 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2024-04-26T23:43:15.932 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2024-04-26T23:43:15.932 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-04-26T23:43:15.932 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-04-26T23:43:15.932 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-04-26T23:43:15.932 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-04-26T23:43:15.932 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-04-26T23:43:15.932 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-04-26T23:43:15.932 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-04-26T23:43:15.932 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-04-26T23:43:15.932 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-04-26T23:43:15.932 INFO:teuthology.orchestra.run.smithi088.stdout: "reef", 2024-04-26T23:43:15.932 INFO:teuthology.orchestra.run.smithi088.stdout: "squid" 2024-04-26T23:43:15.932 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:43:15.933 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2024-04-26T23:43:15.933 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:43:15.933 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2024-04-26T23:43:15.933 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:43:15.933 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2024-04-26T23:43:15.933 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2024-04-26T23:43:15.933 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-04-26T23:43:15.933 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-04-26T23:43:15.933 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:43:15.933 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-04-26T23:43:15.934 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2024-04-26T23:43:15.934 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:43:15.934 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:43:15.934 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:43:15.934 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-04-26T23:43:15.934 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2024-04-26T23:43:15.934 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:43:15.934 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:43:15.934 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:43:15.934 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:43:15.934 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2024-04-26T23:43:15.934 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2024-04-26T23:43:15.934 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-04-26T23:43:15.934 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-04-26T23:43:15.934 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-04-26T23:43:15.935 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:43:15.935 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:43:15.935 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2024-04-26T23:43:15.935 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2024-04-26T23:43:15.935 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-04-26T23:43:15.935 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-04-26T23:43:15.935 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:43:15.935 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-04-26T23:43:15.935 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:3300", 2024-04-26T23:43:15.935 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:43:15.935 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:43:15.935 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:43:15.935 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-04-26T23:43:15.935 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6789", 2024-04-26T23:43:15.935 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:43:15.936 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:43:15.936 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:43:15.936 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:43:15.936 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6789/0", 2024-04-26T23:43:15.936 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.175:6789/0", 2024-04-26T23:43:15.936 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-04-26T23:43:15.936 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-04-26T23:43:15.936 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-04-26T23:43:15.936 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:43:15.936 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:43:15.936 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2024-04-26T23:43:15.936 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2024-04-26T23:43:15.936 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-04-26T23:43:15.936 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-04-26T23:43:15.937 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:43:15.937 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-04-26T23:43:15.937 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:3301", 2024-04-26T23:43:15.937 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:43:15.937 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:43:15.937 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:43:15.937 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-04-26T23:43:15.937 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6790", 2024-04-26T23:43:15.937 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:43:15.937 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:43:15.937 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:43:15.938 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:43:15.938 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6790/0", 2024-04-26T23:43:15.938 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.175:6790/0", 2024-04-26T23:43:15.938 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-04-26T23:43:15.938 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-04-26T23:43:15.938 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-04-26T23:43:15.938 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:43:15.938 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:43:15.938 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:43:15.938 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2024-04-26T23:43:15.938 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2024-04-26T23:43:15.938 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:43:15.938 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:43:15.938 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:43:15.939 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2024-04-26T23:43:15.939 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:43:15.939 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:43:15.939 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": [ 2024-04-26T23:43:15.939 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:43:15.939 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:43:15.939 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:43:15.939 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 4 2024-04-26T23:43:15.939 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:43:15.939 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:43:15.939 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": [ 2024-04-26T23:43:15.940 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:43:15.940 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:43:15.940 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:43:15.940 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 5 2024-04-26T23:43:15.940 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:43:15.940 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:43:15.940 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2024-04-26T23:43:15.940 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:43:15.940 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:43:15.940 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:43:15.940 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 4 2024-04-26T23:43:15.940 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:43:15.940 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:43:15.940 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": [ 2024-04-26T23:43:15.941 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:43:15.941 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:43:15.941 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:43:15.941 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2024-04-26T23:43:15.941 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:43:15.941 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:43:15.941 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:43:15.941 INFO:teuthology.orchestra.run.smithi088.stdout: "stretch_mode": false 2024-04-26T23:43:15.941 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-04-26T23:43:15.942 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.922+0000 7f5a6d4cf640 1 -- 172.21.15.88:0/3965890450 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f5a5406c8f0 msgr2=0x7f5a5406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:15.943 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.922+0000 7f5a6d4cf640 1 --2- 172.21.15.88:0/3965890450 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f5a5406c8f0 0x7f5a5406edb0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f5a5c006fd0 tx=0x7f5a5c008040 comp rx=0 tx=0).stop 2024-04-26T23:43:15.943 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.922+0000 7f5a6d4cf640 1 -- 172.21.15.88:0/3965890450 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5a6813ffb0 msgr2=0x7f5a680c5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:15.943 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.922+0000 7f5a6d4cf640 1 --2- 172.21.15.88:0/3965890450 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5a6813ffb0 0x7f5a680c5700 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f5a60009f40 tx=0x7f5a60004a40 comp rx=0 tx=0).stop 2024-04-26T23:43:15.943 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.922+0000 7f5a677fe640 1 -- 172.21.15.88:0/3965890450 reap_dead start 2024-04-26T23:43:15.943 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.922+0000 7f5a677fe640 1 -- 172.21.15.88:0/3965890450 reap_dead start 2024-04-26T23:43:15.943 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.923+0000 7f5a6d4cf640 1 -- 172.21.15.88:0/3965890450 shutdown_connections 2024-04-26T23:43:15.943 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.923+0000 7f5a6d4cf640 1 -- 172.21.15.88:0/3965890450 >> 172.21.15.88:0/3965890450 conn(0x7f5a680ca2f0 msgr2=0x7f5a6813e0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:43:15.943 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.923+0000 7f5a6d4cf640 1 -- 172.21.15.88:0/3965890450 shutdown_connections 2024-04-26T23:43:15.943 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:15.923+0000 7f5a6d4cf640 1 -- 172.21.15.88:0/3965890450 wait complete. 2024-04-26T23:43:15.943 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-04-26T23:43:15.944 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-04-26T23:43:15.944 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-04-26T23:43:16.067 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:16.063+0000 7fcc85609640 1 Processor -- start 2024-04-26T23:43:16.067 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:16.063+0000 7fcc85609640 1 -- start start 2024-04-26T23:43:16.069 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:16.064+0000 7fcc85609640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fcc8006e640 0x7fcc800ab380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:16.069 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:16.064+0000 7fcc85609640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcc800c4720 0x7fcc801500b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:16.069 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:16.064+0000 7fcc85609640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcc80153d90 con 0x7fcc8006f760 2024-04-26T23:43:16.069 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:16.064+0000 7fcc85609640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7fcc800c2e50 con 0x7fcc8006e640 2024-04-26T23:43:16.069 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:16.064+0000 7fcc85609640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fcc800c3130 con 0x7fcc800c4720 2024-04-26T23:43:16.069 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:16.064+0000 7fcc7f7fe640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcc800c4720 0x7fcc801500b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:16.069 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:16.064+0000 7fcc7f7fe640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcc800c4720 0x7fcc801500b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.88:37102/0 (socket says 172.21.15.88:37102) 2024-04-26T23:43:16.070 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:16.064+0000 7fcc7f7fe640 1 -- 172.21.15.88:0/868734138 learned_addr learned my addr 172.21.15.88:0/868734138 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:43:16.070 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:16.064+0000 7fcc7effd640 1 --2- 172.21.15.88:0/868734138 >> v2:172.21.15.175:3300/0 conn(0x7fcc8006e640 0x7fcc800ab380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:16.070 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:16.065+0000 7fcc7f7fe640 1 -- 172.21.15.88:0/868734138 >> v2:172.21.15.175:3300/0 conn(0x7fcc8006e640 msgr2=0x7fcc800ab380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:43:16.070 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:16.065+0000 7fcc7f7fe640 1 --2- 172.21.15.88:0/868734138 >> v2:172.21.15.175:3300/0 conn(0x7fcc8006e640 0x7fcc800ab380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:16.070 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:16.065+0000 7fcc7f7fe640 1 -- 172.21.15.88:0/868734138 >> v1:172.21.15.175:6789/0 conn(0x7fcc8006f760 legacy=0x7fcc800c3930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:16.070 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:16.065+0000 7fcc7f7fe640 1 -- 172.21.15.88:0/868734138 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc800c3410 con 0x7fcc800c4720 2024-04-26T23:43:16.070 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:16.065+0000 7fcc7effd640 1 --2- 172.21.15.88:0/868734138 >> v2:172.21.15.175:3300/0 conn(0x7fcc8006e640 0x7fcc800ab380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:43:16.071 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:16.067+0000 7fcc7f7fe640 1 --2- 172.21.15.88:0/868734138 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcc800c4720 0x7fcc801500b0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fcc78009e50 tx=0x7fcc7802a4f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bc77aa9a36e72eac server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:16.071 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:16.067+0000 7fcc7dffb640 1 -- 172.21.15.88:0/868734138 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc78036070 con 0x7fcc800c4720 2024-04-26T23:43:16.071 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:16.067+0000 7fcc7dffb640 1 -- 172.21.15.88:0/868734138 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc78031600 con 0x7fcc800c4720 2024-04-26T23:43:16.071 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:16.067+0000 7fcc7dffb640 1 -- 172.21.15.88:0/868734138 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc780319d0 con 0x7fcc800c4720 2024-04-26T23:43:16.072 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:16.068+0000 7fcc85609640 1 -- 172.21.15.88:0/868734138 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcc800c4720 msgr2=0x7fcc801500b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:16.072 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:16.068+0000 7fcc85609640 1 --2- 172.21.15.88:0/868734138 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcc800c4720 0x7fcc801500b0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fcc78009e50 tx=0x7fcc7802a4f0 comp rx=0 tx=0).stop 2024-04-26T23:43:16.072 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:16.068+0000 7fcc85609640 1 -- 172.21.15.88:0/868734138 shutdown_connections 2024-04-26T23:43:16.072 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:16.068+0000 7fcc85609640 1 --2- 172.21.15.88:0/868734138 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcc800c4720 0x7fcc801500b0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:16.072 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:16.068+0000 7fcc85609640 1 --2- 172.21.15.88:0/868734138 >> v2:172.21.15.175:3300/0 conn(0x7fcc8006e640 0x7fcc800ab380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:16.072 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:16.068+0000 7fcc85609640 1 -- 172.21.15.88:0/868734138 >> 172.21.15.88:0/868734138 conn(0x7fcc8006c310 msgr2=0x7fcc8006c6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:43:16.073 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:16.068+0000 7fcc85609640 1 -- 172.21.15.88:0/868734138 shutdown_connections 2024-04-26T23:43:16.073 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:16.068+0000 7fcc85609640 1 -- 172.21.15.88:0/868734138 wait complete. 2024-04-26T23:43:16.074 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:16.070+0000 7fcc85609640 1 Processor -- start 2024-04-26T23:43:16.074 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:16.070+0000 7fcc85609640 1 -- start start 2024-04-26T23:43:16.076 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:16.071+0000 7fcc85609640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcc8006e640 0x7fcc800bdfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:16.076 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:16.071+0000 7fcc85609640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcc8006f760 0x7fcc800c6130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:16.076 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:16.071+0000 7fcc85609640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcc800c4720 0x7fcc80156c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:16.076 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:16.071+0000 7fcc85609640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fcc8006eba0 con 0x7fcc8006f760 2024-04-26T23:43:16.076 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:16.071+0000 7fcc85609640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fcc8006ea20 con 0x7fcc800c4720 2024-04-26T23:43:16.078 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:16.071+0000 7fcc85609640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fcc801505f0 con 0x7fcc8006e640 2024-04-26T23:43:16.078 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:16.072+0000 7fcc7e7fc640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcc8006f760 0x7fcc800c6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:16.078 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:16.072+0000 7fcc7e7fc640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcc8006f760 0x7fcc800c6130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:36670/0 (socket says 172.21.15.88:36670) 2024-04-26T23:43:16.078 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:16.072+0000 7fcc7e7fc640 1 -- 172.21.15.88:0/1528326591 learned_addr learned my addr 172.21.15.88:0/1528326591 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:43:16.078 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:16.072+0000 7fcc7e7fc640 1 -- 172.21.15.88:0/1528326591 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcc8006e640 msgr2=0x7fcc800bdfd0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-26T23:43:16.078 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:16.072+0000 7fcc7e7fc640 1 --2- 172.21.15.88:0/1528326591 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcc8006e640 0x7fcc800bdfd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:16.079 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:16.072+0000 7fcc7e7fc640 1 -- 172.21.15.88:0/1528326591 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcc800c4720 msgr2=0x7fcc80156c80 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-26T23:43:16.079 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:16.072+0000 7fcc7e7fc640 1 --2- 172.21.15.88:0/1528326591 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcc800c4720 0x7fcc80156c80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:16.079 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:16.072+0000 7fcc7e7fc640 1 -- 172.21.15.88:0/1528326591 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc800bd2f0 con 0x7fcc8006f760 2024-04-26T23:43:16.079 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:16.072+0000 7fcc7e7fc640 1 --2- 172.21.15.88:0/1528326591 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcc8006f760 0x7fcc800c6130 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fcc7400c7b0 tx=0x7fcc7400cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:16.079 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:16.072+0000 7fcc677fe640 1 -- 172.21.15.88:0/1528326591 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc740052d0 con 0x7fcc8006f760 2024-04-26T23:43:16.079 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:16.072+0000 7fcc677fe640 1 -- 172.21.15.88:0/1528326591 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc74005470 con 0x7fcc8006f760 2024-04-26T23:43:16.079 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:16.072+0000 7fcc677fe640 1 -- 172.21.15.88:0/1528326591 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc7400a880 con 0x7fcc8006f760 2024-04-26T23:43:16.079 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:16.072+0000 7fcc85609640 1 -- 172.21.15.88:0/1528326591 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc80154b80 con 0x7fcc8006f760 2024-04-26T23:43:16.079 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:16.072+0000 7fcc85609640 1 -- 172.21.15.88:0/1528326591 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc80156480 con 0x7fcc8006f760 2024-04-26T23:43:16.079 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:16.073+0000 7fcc85609640 1 --2- 172.21.15.88:0/1528326591 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcc80068a70 0x7fcc80146260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:16.079 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:16.073+0000 7fcc85609640 1 -- 172.21.15.88:0/1528326591 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fcc80074d50 con 0x7fcc80068a70 2024-04-26T23:43:16.079 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:16.074+0000 7fcc7effd640 1 --2- 172.21.15.88:0/1528326591 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcc80068a70 0x7fcc80146260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:16.080 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:16.075+0000 7fcc677fe640 1 -- 172.21.15.88:0/1528326591 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fcc7400aa20 con 0x7fcc8006f760 2024-04-26T23:43:16.080 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:16.075+0000 7fcc7effd640 1 -- 172.21.15.88:0/1528326591 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fcc800507a0 con 0x7fcc80068a70 2024-04-26T23:43:16.081 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:16.075+0000 7fcc677fe640 1 --2- 172.21.15.88:0/1528326591 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fcc6c06c8f0 0x7fcc6c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:16.081 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:16.075+0000 7fcc677fe640 1 -- 172.21.15.88:0/1528326591 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6666+0+0 (secure 0 0 0) 0x7fcc7408bbe0 con 0x7fcc8006f760 2024-04-26T23:43:16.081 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:16.075+0000 7fcc7f7fe640 1 --2- 172.21.15.88:0/1528326591 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fcc6c06c8f0 0x7fcc6c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:16.081 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:16.076+0000 7fcc7effd640 1 --2- 172.21.15.88:0/1528326591 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcc80068a70 0x7fcc80146260 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fcc801472c0 tx=0x7fcc7000cb80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:16.081 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:16.076+0000 7fcc7f7fe640 1 --2- 172.21.15.88:0/1528326591 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fcc6c06c8f0 0x7fcc6c06edb0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fcc78033000 tx=0x7fcc78009000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:16.082 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:16.077+0000 7fcc677fe640 1 -- 172.21.15.88:0/1528326591 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc70015070 con 0x7fcc80068a70 2024-04-26T23:43:16.082 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:16.077+0000 7fcc677fe640 1 -- 172.21.15.88:0/1528326591 <== mon.2 v2:172.21.15.175:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fcc70007890 con 0x7fcc80068a70 2024-04-26T23:43:16.082 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:16.077+0000 7fcc677fe640 1 -- 172.21.15.88:0/1528326591 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcc80068a70 msgr2=0x7fcc80146260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:16.082 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:16.077+0000 7fcc677fe640 1 --2- 172.21.15.88:0/1528326591 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcc80068a70 0x7fcc80146260 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fcc801472c0 tx=0x7fcc7000cb80 comp rx=0 tx=0).stop 2024-04-26T23:43:16.082 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:16.077+0000 7fcc677fe640 1 -- 172.21.15.88:0/1528326591 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcc80068a70 msgr2=0x7fcc80146260 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:43:16.082 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:16.077+0000 7fcc677fe640 1 --2- 172.21.15.88:0/1528326591 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcc80068a70 0x7fcc80146260 secure :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fcc801472c0 tx=0x7fcc7000cb80 comp rx=0 tx=0).stop 2024-04-26T23:43:16.101 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:16.094+0000 7fcc85609640 1 --2- 172.21.15.88:0/1528326591 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcc80156680 0x7fcc801467a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:16.101 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:16.094+0000 7fcc85609640 1 -- 172.21.15.88:0/1528326591 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fcc801533a0 con 0x7fcc80156680 2024-04-26T23:43:16.101 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:16.097+0000 7fcc7effd640 1 --2- 172.21.15.88:0/1528326591 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcc80156680 0x7fcc801467a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:16.106 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:16.102+0000 7fcc7effd640 1 -- 172.21.15.88:0/1528326591 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fcc800c27b0 con 0x7fcc80156680 2024-04-26T23:43:16.110 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:16.106+0000 7fcc7effd640 1 --2- 172.21.15.88:0/1528326591 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcc80156680 0x7fcc801467a0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fcc8006aef0 tx=0x7fcc70004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:16.118 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:16.114+0000 7fcc677fe640 1 -- 172.21.15.88:0/1528326591 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc70028020 con 0x7fcc80156680 2024-04-26T23:43:16.119 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:16.114+0000 7fcc677fe640 1 -- 172.21.15.88:0/1528326591 <== mon.2 v2:172.21.15.175:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4555 (secure 0 0 0) 0x7fcc7001acb0 con 0x7fcc80156680 2024-04-26T23:43:16.119 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:16.114+0000 7fcc677fe640 1 -- 172.21.15.88:0/1528326591 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcc80156680 msgr2=0x7fcc801467a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:16.119 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:16.114+0000 7fcc677fe640 1 --2- 172.21.15.88:0/1528326591 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcc80156680 0x7fcc801467a0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fcc8006aef0 tx=0x7fcc70004730 comp rx=0 tx=0).stop 2024-04-26T23:43:16.119 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:16.114+0000 7fcc677fe640 1 -- 172.21.15.88:0/1528326591 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcc80156680 msgr2=0x7fcc801467a0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:43:16.119 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:16.114+0000 7fcc677fe640 1 --2- 172.21.15.88:0/1528326591 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcc80156680 0x7fcc801467a0 secure :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fcc8006aef0 tx=0x7fcc70004730 comp rx=0 tx=0).stop 2024-04-26T23:43:16.121 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-04-26T23:43:16.121 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2024-04-26T23:43:16.121 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2024-04-26T23:43:16.121 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "peon", 2024-04-26T23:43:16.121 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 22, 2024-04-26T23:43:16.121 INFO:teuthology.orchestra.run.smithi088.stdout: "uptime": 21623, 2024-04-26T23:43:16.121 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2024-04-26T23:43:16.121 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2024-04-26T23:43:16.121 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2024-04-26T23:43:16.121 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2024-04-26T23:43:16.121 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:43:16.122 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 15, 2024-04-26T23:43:16.122 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2024-04-26T23:43:16.122 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2450521708007866372", 2024-04-26T23:43:16.122 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2024-04-26T23:43:16.122 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-04-26T23:43:16.122 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-04-26T23:43:16.122 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-04-26T23:43:16.122 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-04-26T23:43:16.122 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-04-26T23:43:16.122 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-04-26T23:43:16.122 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-04-26T23:43:16.122 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-04-26T23:43:16.122 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-04-26T23:43:16.123 INFO:teuthology.orchestra.run.smithi088.stdout: "reef", 2024-04-26T23:43:16.123 INFO:teuthology.orchestra.run.smithi088.stdout: "squid" 2024-04-26T23:43:16.123 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:43:16.123 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540701547738038271", 2024-04-26T23:43:16.123 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2024-04-26T23:43:16.123 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-04-26T23:43:16.123 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-04-26T23:43:16.123 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-04-26T23:43:16.123 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-04-26T23:43:16.123 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-04-26T23:43:16.123 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-04-26T23:43:16.123 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-04-26T23:43:16.123 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-04-26T23:43:16.123 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-04-26T23:43:16.123 INFO:teuthology.orchestra.run.smithi088.stdout: "reef", 2024-04-26T23:43:16.124 INFO:teuthology.orchestra.run.smithi088.stdout: "squid" 2024-04-26T23:43:16.124 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:43:16.124 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:43:16.124 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2024-04-26T23:43:16.124 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2024-04-26T23:43:16.124 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2024-04-26T23:43:16.124 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2024-04-26T23:43:16.124 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2024-04-26T23:43:16.124 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "555255e9-7ef9-4454-8dc9-35e96b70035c", 2024-04-26T23:43:16.124 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2024-04-26T23:39:34.291658Z", 2024-04-26T23:43:16.124 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2024-04-26T23:39:34.291658Z", 2024-04-26T23:43:16.124 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 19, 2024-04-26T23:43:16.124 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "squid", 2024-04-26T23:43:16.124 INFO:teuthology.orchestra.run.smithi088.stdout: "election_strategy": 1, 2024-04-26T23:43:16.125 INFO:teuthology.orchestra.run.smithi088.stdout: "disallowed_leaders: ": "", 2024-04-26T23:43:16.125 INFO:teuthology.orchestra.run.smithi088.stdout: "stretch_mode": false, 2024-04-26T23:43:16.125 INFO:teuthology.orchestra.run.smithi088.stdout: "tiebreaker_mon": "", 2024-04-26T23:43:16.125 INFO:teuthology.orchestra.run.smithi088.stdout: "removed_ranks: ": "", 2024-04-26T23:43:16.125 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2024-04-26T23:43:16.125 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2024-04-26T23:43:16.125 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-04-26T23:43:16.125 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-04-26T23:43:16.125 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-04-26T23:43:16.125 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-04-26T23:43:16.125 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-04-26T23:43:16.125 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-04-26T23:43:16.125 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-04-26T23:43:16.125 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-04-26T23:43:16.126 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-04-26T23:43:16.126 INFO:teuthology.orchestra.run.smithi088.stdout: "reef", 2024-04-26T23:43:16.126 INFO:teuthology.orchestra.run.smithi088.stdout: "squid" 2024-04-26T23:43:16.126 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:43:16.126 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2024-04-26T23:43:16.126 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:43:16.126 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2024-04-26T23:43:16.126 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:43:16.126 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2024-04-26T23:43:16.126 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2024-04-26T23:43:16.126 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-04-26T23:43:16.126 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-04-26T23:43:16.126 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:43:16.126 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-04-26T23:43:16.127 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2024-04-26T23:43:16.127 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:43:16.127 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:43:16.127 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:43:16.127 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-04-26T23:43:16.127 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2024-04-26T23:43:16.127 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:43:16.127 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:43:16.127 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:43:16.127 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:43:16.127 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2024-04-26T23:43:16.127 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2024-04-26T23:43:16.127 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-04-26T23:43:16.128 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-04-26T23:43:16.128 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-04-26T23:43:16.128 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:43:16.128 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:43:16.128 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2024-04-26T23:43:16.128 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2024-04-26T23:43:16.128 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-04-26T23:43:16.128 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-04-26T23:43:16.128 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:43:16.128 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-04-26T23:43:16.128 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:3300", 2024-04-26T23:43:16.128 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:43:16.128 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:43:16.128 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:43:16.128 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-04-26T23:43:16.129 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6789", 2024-04-26T23:43:16.129 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:43:16.129 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:43:16.129 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:43:16.129 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:43:16.129 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6789/0", 2024-04-26T23:43:16.129 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.175:6789/0", 2024-04-26T23:43:16.129 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-04-26T23:43:16.129 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-04-26T23:43:16.129 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-04-26T23:43:16.129 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:43:16.129 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:43:16.129 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2024-04-26T23:43:16.130 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2024-04-26T23:43:16.130 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-04-26T23:43:16.130 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-04-26T23:43:16.130 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:43:16.130 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-04-26T23:43:16.130 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:3301", 2024-04-26T23:43:16.130 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:43:16.130 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:43:16.130 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:43:16.130 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-04-26T23:43:16.130 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6790", 2024-04-26T23:43:16.130 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:43:16.130 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:43:16.131 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:43:16.131 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:43:16.131 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6790/0", 2024-04-26T23:43:16.131 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.175:6790/0", 2024-04-26T23:43:16.131 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-04-26T23:43:16.131 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-04-26T23:43:16.131 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-04-26T23:43:16.131 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:43:16.131 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:43:16.131 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:43:16.131 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2024-04-26T23:43:16.131 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2024-04-26T23:43:16.131 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:43:16.131 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:43:16.131 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:43:16.132 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2024-04-26T23:43:16.132 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:43:16.132 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:43:16.132 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2024-04-26T23:43:16.132 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:43:16.132 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:43:16.132 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:43:16.132 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2024-04-26T23:43:16.132 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:43:16.132 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:43:16.132 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:43:16.132 INFO:teuthology.orchestra.run.smithi088.stdout: "stretch_mode": false 2024-04-26T23:43:16.132 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-04-26T23:43:16.133 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:16.117+0000 7fcc85609640 1 -- 172.21.15.88:0/1528326591 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fcc6c06c8f0 msgr2=0x7fcc6c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:16.133 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:16.117+0000 7fcc85609640 1 --2- 172.21.15.88:0/1528326591 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fcc6c06c8f0 0x7fcc6c06edb0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fcc78033000 tx=0x7fcc78009000 comp rx=0 tx=0).stop 2024-04-26T23:43:16.133 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:16.117+0000 7fcc85609640 1 -- 172.21.15.88:0/1528326591 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcc8006f760 msgr2=0x7fcc800c6130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:16.133 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:16.117+0000 7fcc85609640 1 --2- 172.21.15.88:0/1528326591 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcc8006f760 0x7fcc800c6130 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fcc7400c7b0 tx=0x7fcc7400cc70 comp rx=0 tx=0).stop 2024-04-26T23:43:16.133 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:16.117+0000 7fcc7f7fe640 1 -- 172.21.15.88:0/1528326591 reap_dead start 2024-04-26T23:43:16.133 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:16.117+0000 7fcc85609640 1 -- 172.21.15.88:0/1528326591 shutdown_connections 2024-04-26T23:43:16.133 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:16.117+0000 7fcc85609640 1 --2- 172.21.15.88:0/1528326591 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcc8006f760 0x7fcc800c6130 secure :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fcc7400c7b0 tx=0x7fcc7400cc70 comp rx=0 tx=0).stop 2024-04-26T23:43:16.133 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:16.117+0000 7fcc85609640 1 -- 172.21.15.88:0/1528326591 >> 172.21.15.88:0/1528326591 conn(0x7fcc8006c310 msgr2=0x7fcc80147b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:43:16.133 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:16.117+0000 7fcc85609640 1 -- 172.21.15.88:0/1528326591 shutdown_connections 2024-04-26T23:43:16.133 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:16.118+0000 7fcc85609640 1 -- 172.21.15.88:0/1528326591 wait complete. 2024-04-26T23:43:16.141 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-04-26T23:43:16.142 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['c'] 2024-04-26T23:43:16.142 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2024-04-26T23:43:16.142 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.c 2024-04-26T23:43:16.142 INFO:tasks.mon_thrash.mon_thrasher:killing mon.c 2024-04-26T23:43:16.142 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-04-26T23:43:16.142 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T23:43:16.173 INFO:tasks.ceph.mon.c:Stopped 2024-04-26T23:43:16.173 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2024-04-26T23:43:16.173 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-04-26T23:43:16.286 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:16.282+0000 7f42d82a9640 1 Processor -- start 2024-04-26T23:43:16.286 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:16.282+0000 7f42d82a9640 1 -- start start 2024-04-26T23:43:16.288 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:16.283+0000 7f42d82a9640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f42d015e170 0x7f42d015e660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:16.288 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:16.283+0000 7f42d82a9640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42d015edd0 con 0x7f42d00c3750 2024-04-26T23:43:16.288 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:16.283+0000 7f42d82a9640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42d015f0b0 con 0x7f42d00abfc0 2024-04-26T23:43:16.288 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:16.283+0000 7f42d82a9640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f42d015eba0 con 0x7f42d015e170 2024-04-26T23:43:16.288 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:16.284+0000 7f42d6846640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f42d00c3750 0x7f42d006eb40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:52040/0 (socket says 172.21.15.88:52040) 2024-04-26T23:43:16.289 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:16.284+0000 7f42d6846640 1 -- 172.21.15.88:0/1121431534 learned_addr learned my addr 172.21.15.88:0/1121431534 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-26T23:43:16.289 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:16.284+0000 7f42d5844640 1 --2- 172.21.15.88:0/1121431534 >> v2:172.21.15.175:3300/0 conn(0x7f42d015e170 0x7f42d015e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:16.289 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:16.284+0000 7f42d5043640 1 -- 172.21.15.88:0/1121431534 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3220464070 0 0) 0x7f42d015edd0 con 0x7f42d00c3750 2024-04-26T23:43:16.289 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:16.284+0000 7f42d5043640 1 -- 172.21.15.88:0/1121431534 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f42bc003520 con 0x7f42d00c3750 2024-04-26T23:43:16.289 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:16.285+0000 7f42d5844640 1 -- 172.21.15.88:0/1121431534 >> v1:172.21.15.175:6789/0 conn(0x7f42d00abfc0 legacy=0x7f42d015da60 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-26T23:43:16.289 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:16.285+0000 7f42d5844640 1 -- 172.21.15.88:0/1121431534 >> v1:172.21.15.88:6789/0 conn(0x7f42d00c3750 legacy=0x7f42d006eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:16.289 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:16.285+0000 7f42d5844640 1 -- 172.21.15.88:0/1121431534 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42d015f390 con 0x7f42d015e170 2024-04-26T23:43:16.290 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:16.286+0000 7f42d5844640 1 --2- 172.21.15.88:0/1121431534 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f42d015e170 0x7f42d015e660 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f42cc0097a0 tx=0x7f42cc02a1e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=158c975bac182c5a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:16.290 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:16.287+0000 7f42d5043640 1 -- 172.21.15.88:0/1121431534 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42cc037070 con 0x7f42d015e170 2024-04-26T23:43:16.292 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:16.287+0000 7f42d5043640 1 -- 172.21.15.88:0/1121431534 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42cc032440 con 0x7f42d015e170 2024-04-26T23:43:16.292 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:16.287+0000 7f42d5043640 1 -- 172.21.15.88:0/1121431534 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42cc037070 con 0x7f42d015e170 2024-04-26T23:43:16.292 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:16.288+0000 7f42d82a9640 1 -- 172.21.15.88:0/1121431534 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f42d015e170 msgr2=0x7f42d015e660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:16.292 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:16.288+0000 7f42d82a9640 1 --2- 172.21.15.88:0/1121431534 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f42d015e170 0x7f42d015e660 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f42cc0097a0 tx=0x7f42cc02a1e0 comp rx=0 tx=0).stop 2024-04-26T23:43:16.292 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:16.288+0000 7f42d82a9640 1 -- 172.21.15.88:0/1121431534 shutdown_connections 2024-04-26T23:43:16.292 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:16.288+0000 7f42d82a9640 1 --2- 172.21.15.88:0/1121431534 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f42d015e170 0x7f42d015e660 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:16.292 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:16.288+0000 7f42d82a9640 1 -- 172.21.15.88:0/1121431534 >> 172.21.15.88:0/1121431534 conn(0x7f42d006c310 msgr2=0x7f42d006c6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:43:16.293 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:16.289+0000 7f42d82a9640 1 -- 172.21.15.88:0/1121431534 shutdown_connections 2024-04-26T23:43:16.295 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:16.290+0000 7f42d82a9640 1 -- 172.21.15.88:0/1121431534 wait complete. 2024-04-26T23:43:16.295 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:16.291+0000 7f42d82a9640 1 Processor -- start 2024-04-26T23:43:16.295 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:16.292+0000 7f42d82a9640 1 -- start start 2024-04-26T23:43:16.297 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:16.293+0000 7f42d82a9640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f42d00abfc0 0x7f42d00a71f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:16.297 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:16.293+0000 7f42d82a9640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f42d00c3750 0x7f42d0074690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:16.297 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:16.293+0000 7f42d82a9640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f42d015e170 0x7f42d0157540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:16.297 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:16.293+0000 7f42d82a9640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f42d015c560 con 0x7f42d00abfc0 2024-04-26T23:43:16.297 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:16.293+0000 7f42d82a9640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f42d006e3d0 con 0x7f42d00c3750 2024-04-26T23:43:16.297 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:16.293+0000 7f42d82a9640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f42d00ac3a0 con 0x7f42d015e170 2024-04-26T23:43:16.297 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:16.293+0000 7f42d6846640 1 -- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f42d015e170 msgr2=0x7f42d0157540 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.175:3301/0 2024-04-26T23:43:16.297 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:16.293+0000 7f42d6846640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f42d015e170 0x7f42d0157540 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:43:16.298 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:16.294+0000 7f42d6045640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f42d00abfc0 0x7f42d00a71f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:16.298 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:16.294+0000 7f42d6045640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f42d00abfc0 0x7f42d00a71f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:36672/0 (socket says 172.21.15.88:36672) 2024-04-26T23:43:16.298 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:16.294+0000 7f42d6045640 1 -- 172.21.15.88:0/1259929641 learned_addr learned my addr 172.21.15.88:0/1259929641 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:43:16.299 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:16.295+0000 7f42d6045640 1 -- 172.21.15.88:0/1259929641 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f42d015e170 msgr2=0x7f42d0157540 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T23:43:16.299 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:16.295+0000 7f42d6045640 1 --2- 172.21.15.88:0/1259929641 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f42d015e170 0x7f42d0157540 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:16.299 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:16.295+0000 7f42d6045640 1 -- 172.21.15.88:0/1259929641 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f42d00c3750 msgr2=0x7f42d0074690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:16.300 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:16.295+0000 7f42d5844640 1 --2- 172.21.15.88:0/1259929641 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f42d00c3750 0x7f42d0074690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:16.300 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:16.295+0000 7f42d6045640 1 --2- 172.21.15.88:0/1259929641 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f42d00c3750 0x7f42d0074690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:16.300 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:16.295+0000 7f42d6045640 1 -- 172.21.15.88:0/1259929641 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42d00a9f20 con 0x7f42d00abfc0 2024-04-26T23:43:16.300 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:16.295+0000 7f42d5844640 1 --2- 172.21.15.88:0/1259929641 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f42d00c3750 0x7f42d0074690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:43:16.300 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:16.295+0000 7f42d6045640 1 --2- 172.21.15.88:0/1259929641 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f42d00abfc0 0x7f42d00a71f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f42c000b450 tx=0x7f42c000b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:16.302 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:16.298+0000 7f42c6ffd640 1 -- 172.21.15.88:0/1259929641 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42c0015020 con 0x7f42d00abfc0 2024-04-26T23:43:16.302 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:16.298+0000 7f42c6ffd640 1 -- 172.21.15.88:0/1259929641 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42c00118b0 con 0x7f42d00abfc0 2024-04-26T23:43:16.302 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:16.298+0000 7f42c6ffd640 1 -- 172.21.15.88:0/1259929641 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42c0011ca0 con 0x7f42d00abfc0 2024-04-26T23:43:16.303 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:16.300+0000 7f42d82a9640 1 -- 172.21.15.88:0/1259929641 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42d00a7730 con 0x7f42d00abfc0 2024-04-26T23:43:16.305 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:16.301+0000 7f42d82a9640 1 -- 172.21.15.88:0/1259929641 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42d00a60f0 con 0x7f42d00abfc0 2024-04-26T23:43:16.309 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:16.305+0000 7f42d82a9640 1 -- 172.21.15.88:0/1259929641 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42d00507a0 con 0x7f42d00abfc0 2024-04-26T23:43:16.322 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:16.318+0000 7f42c6ffd640 1 -- 172.21.15.88:0/1259929641 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f42c0018020 con 0x7f42d00abfc0 2024-04-26T23:43:16.323 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:16.319+0000 7f42c6ffd640 1 --2- 172.21.15.88:0/1259929641 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f42b406c8f0 0x7f42b406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:16.323 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:16.319+0000 7f42c6ffd640 1 -- 172.21.15.88:0/1259929641 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6666+0+0 (secure 0 0 0) 0x7f42c008c020 con 0x7f42d00abfc0 2024-04-26T23:43:16.323 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:16.319+0000 7f42c6ffd640 1 -- 172.21.15.88:0/1259929641 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f42c001f020 con 0x7f42d00abfc0 2024-04-26T23:43:16.324 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:16.320+0000 7f42d5844640 1 --2- 172.21.15.88:0/1259929641 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f42b406c8f0 0x7f42b406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:16.325 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:16.322+0000 7f42d5844640 1 --2- 172.21.15.88:0/1259929641 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f42b406c8f0 0x7f42b406edb0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f42cc034000 tx=0x7f42cc02e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:16.929 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:16.925+0000 7f42d82a9640 1 -- 172.21.15.88:0/1259929641 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f42d015c0e0 con 0x7f42d00abfc0 2024-04-26T23:43:16.930 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:16.926+0000 7f42c6ffd640 1 -- 172.21.15.88:0/1259929641 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1565 (secure 0 0 0) 0x7f42c000d040 con 0x7f42d00abfc0 2024-04-26T23:43:16.930 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":22,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":16,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"555255e9-7ef9-4454-8dc9-35e96b70035c","modified":"2024-04-26T23:39:34.291658Z","created":"2024-04-26T23:39:34.291658Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:3300","nonce":0},{"type":"v1","addr":"172.21.15.175:6789","nonce":0}]},"addr":"172.21.15.175:6789/0","public_addr":"172.21.15.175:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:3301","nonce":0},{"type":"v1","addr":"172.21.15.175:6790","nonce":0}]},"addr":"172.21.15.175:6790/0","public_addr":"172.21.15.175:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-04-26T23:43:16.935 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:16.930+0000 7f42d82a9640 1 -- 172.21.15.88:0/1259929641 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f42b406c8f0 msgr2=0x7f42b406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:16.935 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:16.930+0000 7f42d82a9640 1 --2- 172.21.15.88:0/1259929641 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f42b406c8f0 0x7f42b406edb0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f42cc034000 tx=0x7f42cc02e000 comp rx=0 tx=0).stop 2024-04-26T23:43:16.935 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:16.930+0000 7f42d82a9640 1 -- 172.21.15.88:0/1259929641 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f42d00abfc0 msgr2=0x7f42d00a71f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:16.935 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:16.930+0000 7f42d82a9640 1 --2- 172.21.15.88:0/1259929641 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f42d00abfc0 0x7f42d00a71f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f42c000b450 tx=0x7f42c000b910 comp rx=0 tx=0).stop 2024-04-26T23:43:16.935 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:16.931+0000 7f42d82a9640 1 -- 172.21.15.88:0/1259929641 shutdown_connections 2024-04-26T23:43:16.935 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:16.931+0000 7f42d82a9640 1 --2- 172.21.15.88:0/1259929641 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f42b406c8f0 0x7f42b406edb0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:16.935 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:16.931+0000 7f42d82a9640 1 --2- 172.21.15.88:0/1259929641 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f42d015e170 0x7f42d0157540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:16.936 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:16.931+0000 7f42d82a9640 1 --2- 172.21.15.88:0/1259929641 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f42d00c3750 0x7f42d0074690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:16.936 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:16.931+0000 7f42d82a9640 1 --2- 172.21.15.88:0/1259929641 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f42d00abfc0 0x7f42d00a71f0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:16.936 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:16.931+0000 7f42d82a9640 1 -- 172.21.15.88:0/1259929641 >> 172.21.15.88:0/1259929641 conn(0x7f42d006c310 msgr2=0x7f42d015d9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:43:16.936 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:16.931+0000 7f42d82a9640 1 -- 172.21.15.88:0/1259929641 shutdown_connections 2024-04-26T23:43:16.936 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:16.932+0000 7f42d82a9640 1 -- 172.21.15.88:0/1259929641 wait complete. 2024-04-26T23:43:19.962 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-04-26T23:43:20.207 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:20.140+0000 7f9ca0146640 1 Processor -- start 2024-04-26T23:43:20.207 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:20.141+0000 7f9ca0146640 1 -- start start 2024-04-26T23:43:20.207 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:20.141+0000 7f9ca0146640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f9c980c35d0 0x7f9c9806fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:20.207 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:20.141+0000 7f9ca0146640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f9c980c4630 0x7f9c980718e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:20.207 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:20.141+0000 7f9ca0146640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9c98071e20 0x7f9c981674d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:20.207 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:20.141+0000 7f9ca0146640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f9c980c4a50 con 0x7f9c980c4630 2024-04-26T23:43:20.207 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:20.141+0000 7f9ca0146640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f9c9806f830 con 0x7f9c980c35d0 2024-04-26T23:43:20.207 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:20.141+0000 7f9ca0146640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f9c980c4210 con 0x7f9c98071e20 2024-04-26T23:43:20.207 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:20.141+0000 7f9c9e6e3640 1 -- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9c98071e20 msgr2=0x7f9c981674d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.175:3301/0 2024-04-26T23:43:20.207 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:20.141+0000 7f9c9e6e3640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9c98071e20 0x7f9c981674d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:43:20.208 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:20.141+0000 7f9c9d6e1640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f9c980c4630 0x7f9c980718e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:20.208 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:20.203+0000 7f9c9d6e1640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f9c980c4630 0x7f9c980718e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:58636/0 (socket says 172.21.15.88:58636) 2024-04-26T23:43:20.208 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:20.203+0000 7f9c9d6e1640 1 -- 172.21.15.88:0/2408504266 learned_addr learned my addr 172.21.15.88:0/2408504266 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:43:20.208 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:20.203+0000 7f9c9d6e1640 1 -- 172.21.15.88:0/2408504266 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9c98071e20 msgr2=0x7f9c981674d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T23:43:20.208 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:20.203+0000 7f9c9d6e1640 1 --2- 172.21.15.88:0/2408504266 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9c98071e20 0x7f9c981674d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:20.208 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:20.203+0000 7f9c9d6e1640 1 -- 172.21.15.88:0/2408504266 >> v2:172.21.15.175:3300/0 conn(0x7f9c980c35d0 msgr2=0x7f9c9806fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:43:20.210 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:20.142+0000 7f9c9dee2640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f9c980c35d0 0x7f9c9806fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:20.211 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:20.206+0000 7f9c9d6e1640 1 --2- 172.21.15.88:0/2408504266 >> v2:172.21.15.175:3300/0 conn(0x7f9c980c35d0 0x7f9c9806fcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:20.212 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:20.206+0000 7f9c9d6e1640 1 -- 172.21.15.88:0/2408504266 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c9806ef00 con 0x7f9c980c4630 2024-04-26T23:43:20.212 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:20.208+0000 7f9c9d6e1640 1 --2- 172.21.15.88:0/2408504266 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9c980c4630 0x7f9c980718e0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f9c98068970 tx=0x7f9c8802b470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f84c4a7bd02eccac server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:20.212 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:20.208+0000 7f9c9dee2640 1 --2- 172.21.15.88:0/2408504266 >> v2:172.21.15.175:3300/0 conn(0x7f9c980c35d0 0x7f9c9806fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:43:20.217 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:20.213+0000 7f9c9cee0640 1 -- 172.21.15.88:0/2408504266 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c88037070 con 0x7f9c980c4630 2024-04-26T23:43:20.217 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:20.213+0000 7f9c9cee0640 1 -- 172.21.15.88:0/2408504266 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c8800a0d0 con 0x7f9c980c4630 2024-04-26T23:43:20.217 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:20.213+0000 7f9c9cee0640 1 -- 172.21.15.88:0/2408504266 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c8800a4c0 con 0x7f9c980c4630 2024-04-26T23:43:20.219 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:20.215+0000 7f9ca0146640 1 -- 172.21.15.88:0/2408504266 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9c980c4630 msgr2=0x7f9c980718e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:20.219 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:20.215+0000 7f9ca0146640 1 --2- 172.21.15.88:0/2408504266 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9c980c4630 0x7f9c980718e0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f9c98068970 tx=0x7f9c8802b470 comp rx=0 tx=0).stop 2024-04-26T23:43:20.220 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:20.215+0000 7f9ca0146640 1 -- 172.21.15.88:0/2408504266 shutdown_connections 2024-04-26T23:43:20.220 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:20.216+0000 7f9ca0146640 1 --2- 172.21.15.88:0/2408504266 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9c98071e20 0x7f9c981674d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:20.220 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:20.216+0000 7f9ca0146640 1 --2- 172.21.15.88:0/2408504266 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9c980c4630 0x7f9c980718e0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:20.220 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:20.216+0000 7f9ca0146640 1 --2- 172.21.15.88:0/2408504266 >> v2:172.21.15.175:3300/0 conn(0x7f9c980c35d0 0x7f9c9806fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:20.220 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:20.216+0000 7f9ca0146640 1 -- 172.21.15.88:0/2408504266 >> 172.21.15.88:0/2408504266 conn(0x7f9c980c82d0 msgr2=0x7f9c980c86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:43:20.221 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:20.217+0000 7f9ca0146640 1 -- 172.21.15.88:0/2408504266 shutdown_connections 2024-04-26T23:43:20.224 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:20.217+0000 7f9ca0146640 1 -- 172.21.15.88:0/2408504266 wait complete. 2024-04-26T23:43:20.224 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:20.221+0000 7f9ca0146640 1 Processor -- start 2024-04-26T23:43:20.226 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:20.222+0000 7f9ca0146640 1 -- start start 2024-04-26T23:43:20.227 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:20.223+0000 7f9ca0146640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9c98071e20 0x7f9c981fce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:20.228 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:20.223+0000 7f9ca0146640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9c980c35d0 0x7f9c981fd390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:20.228 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:20.224+0000 7f9ca0146640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9c980c4630 0x7f9c980bd940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:20.228 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:20.224+0000 7f9c9d6e1640 1 -- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9c980c35d0 msgr2=0x7f9c981fd390 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.175:3301/0 2024-04-26T23:43:20.229 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:20.224+0000 7f9c9d6e1640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9c980c35d0 0x7f9c981fd390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:43:20.229 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:20.224+0000 7f9c9e6e3640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9c980c4630 0x7f9c980bd940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:20.229 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:20.224+0000 7f9c9e6e3640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9c980c4630 0x7f9c980bd940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:58652/0 (socket says 172.21.15.88:58652) 2024-04-26T23:43:20.229 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:20.225+0000 7f9c9e6e3640 1 -- 172.21.15.88:0/3403680367 learned_addr learned my addr 172.21.15.88:0/3403680367 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:43:20.229 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:20.225+0000 7f9ca0146640 1 -- 172.21.15.88:0/3403680367 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f9c980c39b0 con 0x7f9c980c4630 2024-04-26T23:43:20.229 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:20.225+0000 7f9ca0146640 1 -- 172.21.15.88:0/3403680367 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f9c9806f4c0 con 0x7f9c98071e20 2024-04-26T23:43:20.229 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:20.225+0000 7f9ca0146640 1 -- 172.21.15.88:0/3403680367 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f9c980c3b30 con 0x7f9c980c35d0 2024-04-26T23:43:20.230 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:20.225+0000 7f9c9e6e3640 1 -- 172.21.15.88:0/3403680367 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9c980c35d0 msgr2=0x7f9c981fd390 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T23:43:20.230 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:20.225+0000 7f9c9e6e3640 1 --2- 172.21.15.88:0/3403680367 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9c980c35d0 0x7f9c981fd390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:20.230 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:20.225+0000 7f9c9e6e3640 1 -- 172.21.15.88:0/3403680367 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9c98071e20 msgr2=0x7f9c981fce50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T23:43:20.231 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:20.225+0000 7f9c9e6e3640 1 --2- 172.21.15.88:0/3403680367 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9c98071e20 0x7f9c981fce50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:20.231 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:20.225+0000 7f9c9e6e3640 1 -- 172.21.15.88:0/3403680367 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c981f08b0 con 0x7f9c980c4630 2024-04-26T23:43:20.231 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:20.226+0000 7f9c9e6e3640 1 --2- 172.21.15.88:0/3403680367 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9c980c4630 0x7f9c980bd940 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f9c9000bfc0 tx=0x7f9c9000c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:20.231 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:20.227+0000 7f9c8e7fc640 1 -- 172.21.15.88:0/3403680367 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c90016430 con 0x7f9c980c4630 2024-04-26T23:43:20.231 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:20.227+0000 7f9ca0146640 1 -- 172.21.15.88:0/3403680367 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c981fd9d0 con 0x7f9c980c4630 2024-04-26T23:43:20.234 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:20.230+0000 7f9ca0146640 1 -- 172.21.15.88:0/3403680367 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c980bf8e0 con 0x7f9c980c4630 2024-04-26T23:43:20.235 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:20.231+0000 7f9c8e7fc640 1 -- 172.21.15.88:0/3403680367 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c90010030 con 0x7f9c980c4630 2024-04-26T23:43:20.235 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:20.231+0000 7f9c8e7fc640 1 -- 172.21.15.88:0/3403680367 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c90016810 con 0x7f9c980c4630 2024-04-26T23:43:20.235 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:20.231+0000 7f9c8e7fc640 1 -- 172.21.15.88:0/3403680367 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f9c900060d0 con 0x7f9c980c4630 2024-04-26T23:43:20.235 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:20.232+0000 7f9c8e7fc640 1 --2- 172.21.15.88:0/3403680367 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f9c7c06c9f0 0x7f9c7c06eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:20.236 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:20.232+0000 7f9c8e7fc640 1 -- 172.21.15.88:0/3403680367 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6666+0+0 (secure 0 0 0) 0x7f9c9008b590 con 0x7f9c980c4630 2024-04-26T23:43:20.237 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:20.232+0000 7f9c9dee2640 1 --2- 172.21.15.88:0/3403680367 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f9c7c06c9f0 0x7f9c7c06eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:20.238 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:20.234+0000 7f9ca0146640 1 -- 172.21.15.88:0/3403680367 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c9806e630 con 0x7f9c980c4630 2024-04-26T23:43:20.242 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:20.235+0000 7f9c9dee2640 1 --2- 172.21.15.88:0/3403680367 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f9c7c06c9f0 0x7f9c7c06eeb0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f9c9400a8b0 tx=0x7f9c94008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:20.248 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:20.244+0000 7f9c8e7fc640 1 -- 172.21.15.88:0/3403680367 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f9c9806e630 con 0x7f9c980c4630 2024-04-26T23:43:20.794 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:20.790+0000 7f9ca0146640 1 -- 172.21.15.88:0/3403680367 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f9c980bd450 con 0x7f9c980c4630 2024-04-26T23:43:20.797 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:20.793+0000 7f9c8e7fc640 1 -- 172.21.15.88:0/3403680367 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1565 (secure 0 0 0) 0x7f9c900596d0 con 0x7f9c980c4630 2024-04-26T23:43:20.798 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":22,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":19,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"555255e9-7ef9-4454-8dc9-35e96b70035c","modified":"2024-04-26T23:39:34.291658Z","created":"2024-04-26T23:39:34.291658Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:3300","nonce":0},{"type":"v1","addr":"172.21.15.175:6789","nonce":0}]},"addr":"172.21.15.175:6789/0","public_addr":"172.21.15.175:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:3301","nonce":0},{"type":"v1","addr":"172.21.15.175:6790","nonce":0}]},"addr":"172.21.15.175:6790/0","public_addr":"172.21.15.175:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-04-26T23:43:20.801 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:20.797+0000 7f9ca0146640 1 -- 172.21.15.88:0/3403680367 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f9c7c06c9f0 msgr2=0x7f9c7c06eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:20.801 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:20.797+0000 7f9ca0146640 1 --2- 172.21.15.88:0/3403680367 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f9c7c06c9f0 0x7f9c7c06eeb0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f9c9400a8b0 tx=0x7f9c94008040 comp rx=0 tx=0).stop 2024-04-26T23:43:20.802 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:20.797+0000 7f9ca0146640 1 -- 172.21.15.88:0/3403680367 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9c980c4630 msgr2=0x7f9c980bd940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:20.802 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:20.797+0000 7f9ca0146640 1 --2- 172.21.15.88:0/3403680367 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9c980c4630 0x7f9c980bd940 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f9c9000bfc0 tx=0x7f9c9000c4d0 comp rx=0 tx=0).stop 2024-04-26T23:43:20.802 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:20.797+0000 7f9ca0146640 1 -- 172.21.15.88:0/3403680367 shutdown_connections 2024-04-26T23:43:20.802 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:20.797+0000 7f9ca0146640 1 --2- 172.21.15.88:0/3403680367 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f9c7c06c9f0 0x7f9c7c06eeb0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:20.802 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:20.797+0000 7f9ca0146640 1 --2- 172.21.15.88:0/3403680367 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9c980c35d0 0x7f9c981fd390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:20.802 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:20.797+0000 7f9ca0146640 1 --2- 172.21.15.88:0/3403680367 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9c980c4630 0x7f9c980bd940 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:20.803 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:20.797+0000 7f9ca0146640 1 --2- 172.21.15.88:0/3403680367 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9c98071e20 0x7f9c981fce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:20.803 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:20.797+0000 7f9ca0146640 1 -- 172.21.15.88:0/3403680367 >> 172.21.15.88:0/3403680367 conn(0x7f9c980c82d0 msgr2=0x7f9c980c86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:43:20.803 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:20.799+0000 7f9ca0146640 1 -- 172.21.15.88:0/3403680367 shutdown_connections 2024-04-26T23:43:20.803 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:20.799+0000 7f9ca0146640 1 -- 172.21.15.88:0/3403680367 wait complete. 2024-04-26T23:43:23.828 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-04-26T23:43:24.012 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:24.008+0000 7ff1edec5640 1 Processor -- start 2024-04-26T23:43:24.012 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:24.008+0000 7ff1edec5640 1 -- start start 2024-04-26T23:43:24.014 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:24.009+0000 7ff1edec5640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ff1e00d14b0 0x7ff1e004c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:24.014 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:24.009+0000 7ff1edec5640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff1e004ae70 0x7ff1e000b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:24.014 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:24.010+0000 7ff1edec5640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff1e004d7d0 con 0x7ff1e0047260 2024-04-26T23:43:24.014 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:24.010+0000 7ff1edec5640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7ff1e00d7f70 con 0x7ff1e00d14b0 2024-04-26T23:43:24.014 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:24.010+0000 7ff1e6ffd640 1 -- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff1e004ae70 msgr2=0x7ff1e000b1d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.175:3301/0 2024-04-26T23:43:24.014 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:24.010+0000 7ff1e6ffd640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff1e004ae70 0x7ff1e000b1d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:43:24.014 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:24.010+0000 7ff1edec5640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7ff1e004b6c0 con 0x7ff1e004ae70 2024-04-26T23:43:24.015 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:24.010+0000 7ff1e7fff640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7ff1e0047260 0x7ff1e00da800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.88:52044/0 (socket says 172.21.15.88:52044) 2024-04-26T23:43:24.015 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:24.010+0000 7ff1e7fff640 1 -- 172.21.15.88:0/467915239 learned_addr learned my addr 172.21.15.88:0/467915239 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-26T23:43:24.015 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:24.011+0000 7ff1e77fe640 1 --2- 172.21.15.88:0/467915239 >> v2:172.21.15.88:3300/0 conn(0x7ff1e00d14b0 0x7ff1e004c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:24.016 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:24.012+0000 7ff1e77fe640 1 -- 172.21.15.88:0/467915239 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff1e004ae70 msgr2=0x7ff1e000b1d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T23:43:24.016 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:24.012+0000 7ff1e77fe640 1 --2- 172.21.15.88:0/467915239 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff1e004ae70 0x7ff1e000b1d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:24.016 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:24.012+0000 7ff1e77fe640 1 -- 172.21.15.88:0/467915239 >> v1:172.21.15.175:6789/0 conn(0x7ff1e0047260 legacy=0x7ff1e00da800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:24.016 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:24.012+0000 7ff1e77fe640 1 -- 172.21.15.88:0/467915239 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1e004b9a0 con 0x7ff1e00d14b0 2024-04-26T23:43:24.017 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:24.013+0000 7ff1e77fe640 1 --2- 172.21.15.88:0/467915239 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff1e00d14b0 0x7ff1e004c1a0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7ff1d40097a0 tx=0x7ff1d402a080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3268a3d41e158e49 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:24.019 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:24.014+0000 7ff1e67fc640 1 -- 172.21.15.88:0/467915239 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1d4037070 con 0x7ff1e00d14b0 2024-04-26T23:43:24.019 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:24.014+0000 7ff1e67fc640 1 -- 172.21.15.88:0/467915239 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1d402add0 con 0x7ff1e00d14b0 2024-04-26T23:43:24.019 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:24.014+0000 7ff1e67fc640 1 -- 172.21.15.88:0/467915239 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1d4032660 con 0x7ff1e00d14b0 2024-04-26T23:43:24.020 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:24.015+0000 7ff1edec5640 1 -- 172.21.15.88:0/467915239 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff1e00d14b0 msgr2=0x7ff1e004c1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:24.020 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:24.015+0000 7ff1edec5640 1 --2- 172.21.15.88:0/467915239 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff1e00d14b0 0x7ff1e004c1a0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7ff1d40097a0 tx=0x7ff1d402a080 comp rx=0 tx=0).stop 2024-04-26T23:43:24.024 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:24.020+0000 7ff1edec5640 1 -- 172.21.15.88:0/467915239 shutdown_connections 2024-04-26T23:43:24.024 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:24.020+0000 7ff1edec5640 1 --2- 172.21.15.88:0/467915239 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff1e004ae70 0x7ff1e000b1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:24.024 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:24.020+0000 7ff1edec5640 1 --2- 172.21.15.88:0/467915239 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff1e00d14b0 0x7ff1e004c1a0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:24.024 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:24.020+0000 7ff1edec5640 1 -- 172.21.15.88:0/467915239 >> 172.21.15.88:0/467915239 conn(0x7ff1e004c8e0 msgr2=0x7ff1e004ccf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:43:24.025 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:24.020+0000 7ff1edec5640 1 -- 172.21.15.88:0/467915239 shutdown_connections 2024-04-26T23:43:24.026 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:24.020+0000 7ff1edec5640 1 -- 172.21.15.88:0/467915239 wait complete. 2024-04-26T23:43:24.026 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:24.022+0000 7ff1edec5640 1 Processor -- start 2024-04-26T23:43:24.027 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:24.023+0000 7ff1edec5640 1 -- start start 2024-04-26T23:43:24.028 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:24.024+0000 7ff1edec5640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff1e0047260 0x7ff1e01712e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:24.033 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:24.024+0000 7ff1e77fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff1e0047260 0x7ff1e01712e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:24.033 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:24.024+0000 7ff1e77fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff1e0047260 0x7ff1e01712e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:58674/0 (socket says 172.21.15.88:58674) 2024-04-26T23:43:24.033 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:24.025+0000 7ff1e77fe640 1 -- 172.21.15.88:0/362829516 learned_addr learned my addr 172.21.15.88:0/362829516 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:43:24.033 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:24.025+0000 7ff1edec5640 1 --2- 172.21.15.88:0/362829516 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff1e004ae70 0x7ff1e0171820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:24.033 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:24.025+0000 7ff1edec5640 1 --2- 172.21.15.88:0/362829516 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff1e00d14b0 0x7ff1e0041dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:24.034 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:24.025+0000 7ff1edec5640 1 -- 172.21.15.88:0/362829516 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7ff1e0040090 con 0x7ff1e0047260 2024-04-26T23:43:24.034 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:24.025+0000 7ff1e7fff640 1 -- 172.21.15.88:0/362829516 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff1e00d14b0 msgr2=0x7ff1e0041dc0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.175:3301/0 2024-04-26T23:43:24.034 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:24.025+0000 7ff1e7fff640 1 --2- 172.21.15.88:0/362829516 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff1e00d14b0 0x7ff1e0041dc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:43:24.034 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:24.025+0000 7ff1e6ffd640 1 --2- 172.21.15.88:0/362829516 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff1e004ae70 0x7ff1e0171820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:24.034 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:24.025+0000 7ff1edec5640 1 -- 172.21.15.88:0/362829516 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff1e00d7c60 con 0x7ff1e004ae70 2024-04-26T23:43:24.034 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:24.025+0000 7ff1edec5640 1 -- 172.21.15.88:0/362829516 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7ff1e0040210 con 0x7ff1e00d14b0 2024-04-26T23:43:24.034 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:24.026+0000 7ff1e6ffd640 1 -- 172.21.15.88:0/362829516 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff1e00d14b0 msgr2=0x7ff1e0041dc0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T23:43:24.034 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:24.026+0000 7ff1e6ffd640 1 --2- 172.21.15.88:0/362829516 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff1e00d14b0 0x7ff1e0041dc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:24.035 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:24.026+0000 7ff1e6ffd640 1 -- 172.21.15.88:0/362829516 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff1e0047260 msgr2=0x7ff1e01712e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:24.035 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:24.026+0000 7ff1e6ffd640 1 --2- 172.21.15.88:0/362829516 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff1e0047260 0x7ff1e01712e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:24.035 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:24.026+0000 7ff1e6ffd640 1 -- 172.21.15.88:0/362829516 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1e0040c00 con 0x7ff1e004ae70 2024-04-26T23:43:24.035 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:24.026+0000 7ff1e77fe640 1 --2- 172.21.15.88:0/362829516 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff1e0047260 0x7ff1e01712e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:43:24.035 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:24.026+0000 7ff1e6ffd640 1 --2- 172.21.15.88:0/362829516 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff1e004ae70 0x7ff1e0171820 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7ff1dc003930 tx=0x7ff1dc00b9b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:24.035 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:24.027+0000 7ff1d3fff640 1 -- 172.21.15.88:0/362829516 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1dc003dc0 con 0x7ff1e004ae70 2024-04-26T23:43:24.035 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:24.027+0000 7ff1d3fff640 1 -- 172.21.15.88:0/362829516 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1dc015070 con 0x7ff1e004ae70 2024-04-26T23:43:24.035 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:24.027+0000 7ff1d3fff640 1 -- 172.21.15.88:0/362829516 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1dc005290 con 0x7ff1e004ae70 2024-04-26T23:43:24.035 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:24.028+0000 7ff1edec5640 1 -- 172.21.15.88:0/362829516 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1e0040ee0 con 0x7ff1e004ae70 2024-04-26T23:43:24.035 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:24.028+0000 7ff1edec5640 1 -- 172.21.15.88:0/362829516 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1e0044920 con 0x7ff1e004ae70 2024-04-26T23:43:24.037 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:24.030+0000 7ff1edec5640 1 -- 172.21.15.88:0/362829516 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff1e0005390 con 0x7ff1e004ae70 2024-04-26T23:43:24.037 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:24.033+0000 7ff1d3fff640 1 -- 172.21.15.88:0/362829516 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff1dc00f070 con 0x7ff1e004ae70 2024-04-26T23:43:24.038 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:24.034+0000 7ff1d3fff640 1 --2- 172.21.15.88:0/362829516 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7ff1cc06c8a0 0x7ff1cc06ed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:24.038 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:24.034+0000 7ff1d3fff640 1 -- 172.21.15.88:0/362829516 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6666+0+0 (secure 0 0 0) 0x7ff1dc08b660 con 0x7ff1e004ae70 2024-04-26T23:43:24.038 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:24.034+0000 7ff1e77fe640 1 --2- 172.21.15.88:0/362829516 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7ff1cc06c8a0 0x7ff1cc06ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:24.039 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:24.035+0000 7ff1e77fe640 1 --2- 172.21.15.88:0/362829516 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7ff1cc06c8a0 0x7ff1cc06ed60 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7ff1d4009560 tx=0x7ff1d403e040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:24.047 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:24.043+0000 7ff1d3fff640 1 -- 172.21.15.88:0/362829516 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7ff1dc00d040 con 0x7ff1e004ae70 2024-04-26T23:43:24.586 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:24.582+0000 7ff1edec5640 1 -- 172.21.15.88:0/362829516 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7ff1e004d540 con 0x7ff1e004ae70 2024-04-26T23:43:24.589 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:24.585+0000 7ff1d3fff640 1 -- 172.21.15.88:0/362829516 <== mon.1 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1565 (secure 0 0 0) 0x7ff1dc059740 con 0x7ff1e004ae70 2024-04-26T23:43:24.589 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":22,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":23,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"555255e9-7ef9-4454-8dc9-35e96b70035c","modified":"2024-04-26T23:39:34.291658Z","created":"2024-04-26T23:39:34.291658Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:3300","nonce":0},{"type":"v1","addr":"172.21.15.175:6789","nonce":0}]},"addr":"172.21.15.175:6789/0","public_addr":"172.21.15.175:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:3301","nonce":0},{"type":"v1","addr":"172.21.15.175:6790","nonce":0}]},"addr":"172.21.15.175:6790/0","public_addr":"172.21.15.175:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-04-26T23:43:24.593 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:24.588+0000 7ff1d1ffb640 1 -- 172.21.15.88:0/362829516 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7ff1cc06c8a0 msgr2=0x7ff1cc06ed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:24.593 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:24.589+0000 7ff1d1ffb640 1 --2- 172.21.15.88:0/362829516 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7ff1cc06c8a0 0x7ff1cc06ed60 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7ff1d4009560 tx=0x7ff1d403e040 comp rx=0 tx=0).stop 2024-04-26T23:43:24.593 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:24.589+0000 7ff1d1ffb640 1 -- 172.21.15.88:0/362829516 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff1e004ae70 msgr2=0x7ff1e0171820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:24.593 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:24.589+0000 7ff1d1ffb640 1 --2- 172.21.15.88:0/362829516 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff1e004ae70 0x7ff1e0171820 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7ff1dc003930 tx=0x7ff1dc00b9b0 comp rx=0 tx=0).stop 2024-04-26T23:43:24.593 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:24.589+0000 7ff1d1ffb640 1 -- 172.21.15.88:0/362829516 shutdown_connections 2024-04-26T23:43:24.594 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:24.589+0000 7ff1d1ffb640 1 --2- 172.21.15.88:0/362829516 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7ff1cc06c8a0 0x7ff1cc06ed60 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:24.594 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:24.589+0000 7ff1d1ffb640 1 --2- 172.21.15.88:0/362829516 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff1e00d14b0 0x7ff1e0041dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:24.594 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:24.589+0000 7ff1d1ffb640 1 --2- 172.21.15.88:0/362829516 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff1e004ae70 0x7ff1e0171820 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:24.594 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:24.589+0000 7ff1d1ffb640 1 --2- 172.21.15.88:0/362829516 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff1e0047260 0x7ff1e01712e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:24.594 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:24.589+0000 7ff1d1ffb640 1 -- 172.21.15.88:0/362829516 >> 172.21.15.88:0/362829516 conn(0x7ff1e004c8e0 msgr2=0x7ff1e000bfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:43:24.594 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:24.589+0000 7ff1d1ffb640 1 -- 172.21.15.88:0/362829516 shutdown_connections 2024-04-26T23:43:24.594 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:24.590+0000 7ff1d1ffb640 1 -- 172.21.15.88:0/362829516 wait complete. 2024-04-26T23:43:27.616 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-04-26T23:43:27.812 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:27.808+0000 7f0461cda640 1 Processor -- start 2024-04-26T23:43:27.813 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:27.808+0000 7f0461cda640 1 -- start start 2024-04-26T23:43:27.813 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:27.809+0000 7f0461cda640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f045404b110 0x7f0454006ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:27.813 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:27.809+0000 7f0461cda640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f04540073e0 0x7f04540d6710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:27.813 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:27.809+0000 7f0461cda640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f04540d9c60 con 0x7f04540d3b40 2024-04-26T23:43:27.813 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:27.809+0000 7f0461cda640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f04540d9f40 con 0x7f04540073e0 2024-04-26T23:43:27.813 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:27.809+0000 7f0461cda640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f04540da220 con 0x7f045404b110 2024-04-26T23:43:27.813 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:27.810+0000 7f045affd640 1 -- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f045404b110 msgr2=0x7f0454006ea0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.175:3301/0 2024-04-26T23:43:27.813 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:27.810+0000 7f045affd640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f045404b110 0x7f0454006ea0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:43:27.814 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:27.810+0000 7f045b7fe640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f04540d3b40 0x7f0454046b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.88:52060/0 (socket says 172.21.15.88:52060) 2024-04-26T23:43:27.814 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:27.810+0000 7f045b7fe640 1 -- 172.21.15.88:0/3410846240 learned_addr learned my addr 172.21.15.88:0/3410846240 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-26T23:43:27.814 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:27.811+0000 7f045bfff640 1 --2- 172.21.15.88:0/3410846240 >> v2:172.21.15.175:3300/0 conn(0x7f04540073e0 0x7f04540d6710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:27.816 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:27.813+0000 7f045bfff640 1 -- 172.21.15.88:0/3410846240 >> v2:172.21.15.175:3300/0 conn(0x7f04540073e0 msgr2=0x7f04540d6710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-26T23:43:27.816 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:27.813+0000 7f045bfff640 1 -- 172.21.15.88:0/3410846240 >> v2:172.21.15.175:3300/0 conn(0x7f04540073e0 msgr2=0x7f04540d6710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T23:43:27.816 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:27.813+0000 7f045bfff640 1 --2- 172.21.15.88:0/3410846240 >> v2:172.21.15.175:3300/0 conn(0x7f04540073e0 0x7f04540d6710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:43:27.816 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:27.813+0000 7f045bfff640 1 --2- 172.21.15.88:0/3410846240 >> v2:172.21.15.175:3300/0 conn(0x7f04540073e0 0x7f04540d6710 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:43:28.014 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:28.011+0000 7f045affd640 1 -- 172.21.15.88:0/3410846240 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f045404b110 msgr2=0x7f0454006ea0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.175:3301/0 2024-04-26T23:43:28.014 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:28.011+0000 7f045affd640 1 --2- 172.21.15.88:0/3410846240 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f045404b110 0x7f0454006ea0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-26T23:43:28.017 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:28.014+0000 7f045bfff640 1 --2- 172.21.15.88:0/3410846240 >> v2:172.21.15.175:3300/0 conn(0x7f04540073e0 0x7f04540d6710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:28.017 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:28.014+0000 7f045bfff640 1 -- 172.21.15.88:0/3410846240 >> v2:172.21.15.175:3300/0 conn(0x7f04540073e0 msgr2=0x7f04540d6710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-26T23:43:28.017 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:28.014+0000 7f045bfff640 1 -- 172.21.15.88:0/3410846240 >> v2:172.21.15.175:3300/0 conn(0x7f04540073e0 msgr2=0x7f04540d6710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T23:43:28.017 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:28.014+0000 7f045bfff640 1 --2- 172.21.15.88:0/3410846240 >> v2:172.21.15.175:3300/0 conn(0x7f04540073e0 0x7f04540d6710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:43:28.017 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:28.014+0000 7f045bfff640 1 --2- 172.21.15.88:0/3410846240 >> v2:172.21.15.175:3300/0 conn(0x7f04540073e0 0x7f04540d6710 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-26T23:43:28.415 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:28.412+0000 7f045affd640 1 -- 172.21.15.88:0/3410846240 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f045404b110 msgr2=0x7f0454006ea0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.175:3301/0 2024-04-26T23:43:28.415 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:28.412+0000 7f045affd640 1 --2- 172.21.15.88:0/3410846240 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f045404b110 0x7f0454006ea0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-26T23:43:28.418 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:28.415+0000 7f045bfff640 1 --2- 172.21.15.88:0/3410846240 >> v2:172.21.15.175:3300/0 conn(0x7f04540073e0 0x7f04540d6710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:28.418 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:28.415+0000 7f045bfff640 1 -- 172.21.15.88:0/3410846240 >> v2:172.21.15.175:3300/0 conn(0x7f04540073e0 msgr2=0x7f04540d6710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-26T23:43:28.418 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:28.415+0000 7f045bfff640 1 -- 172.21.15.88:0/3410846240 >> v2:172.21.15.175:3300/0 conn(0x7f04540073e0 msgr2=0x7f04540d6710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T23:43:28.418 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:28.415+0000 7f045bfff640 1 --2- 172.21.15.88:0/3410846240 >> v2:172.21.15.175:3300/0 conn(0x7f04540073e0 0x7f04540d6710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:43:28.418 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:28.415+0000 7f045bfff640 1 --2- 172.21.15.88:0/3410846240 >> v2:172.21.15.175:3300/0 conn(0x7f04540073e0 0x7f04540d6710 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-26T23:43:29.216 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:29.213+0000 7f045affd640 1 -- 172.21.15.88:0/3410846240 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f045404b110 msgr2=0x7f0454006ea0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.175:3301/0 2024-04-26T23:43:29.216 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:29.213+0000 7f045affd640 1 --2- 172.21.15.88:0/3410846240 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f045404b110 0x7f0454006ea0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-26T23:43:29.219 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:29.216+0000 7f045bfff640 1 --2- 172.21.15.88:0/3410846240 >> v2:172.21.15.175:3300/0 conn(0x7f04540073e0 0x7f04540d6710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:29.220 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:29.217+0000 7f045bfff640 1 -- 172.21.15.88:0/3410846240 >> v2:172.21.15.175:3300/0 conn(0x7f04540073e0 msgr2=0x7f04540d6710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-26T23:43:29.220 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:29.217+0000 7f045bfff640 1 -- 172.21.15.88:0/3410846240 >> v2:172.21.15.175:3300/0 conn(0x7f04540073e0 msgr2=0x7f04540d6710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T23:43:29.220 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:29.217+0000 7f045bfff640 1 --2- 172.21.15.88:0/3410846240 >> v2:172.21.15.175:3300/0 conn(0x7f04540073e0 0x7f04540d6710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:43:29.220 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:29.217+0000 7f045bfff640 1 --2- 172.21.15.88:0/3410846240 >> v2:172.21.15.175:3300/0 conn(0x7f04540073e0 0x7f04540d6710 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-26T23:43:30.321 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:30.318+0000 7f045a7fc640 1 -- 172.21.15.88:0/3410846240 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 383507174 0 0) 0x7f04540d9c60 con 0x7f04540d3b40 2024-04-26T23:43:30.321 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:30.318+0000 7f045a7fc640 1 -- 172.21.15.88:0/3410846240 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f044c003520 con 0x7f04540d3b40 2024-04-26T23:43:30.331 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:30.327+0000 7f045a7fc640 1 -- 172.21.15.88:0/3410846240 <== mon.1 v1:172.21.15.175:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 839666602 0 0) 0x7f044c003520 con 0x7f04540d3b40 2024-04-26T23:43:30.331 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:30.327+0000 7f045a7fc640 1 -- 172.21.15.88:0/3410846240 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f045404b110 msgr2=0x7f0454006ea0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T23:43:30.331 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:30.327+0000 7f045a7fc640 1 --2- 172.21.15.88:0/3410846240 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f045404b110 0x7f0454006ea0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:30.331 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:30.327+0000 7f045a7fc640 1 -- 172.21.15.88:0/3410846240 >> v2:172.21.15.175:3300/0 conn(0x7f04540073e0 msgr2=0x7f04540d6710 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T23:43:30.332 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:30.327+0000 7f045a7fc640 1 --2- 172.21.15.88:0/3410846240 >> v2:172.21.15.175:3300/0 conn(0x7f04540073e0 0x7f04540d6710 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:30.332 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:30.327+0000 7f045a7fc640 1 -- 172.21.15.88:0/3410846240 --> v1:172.21.15.175:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04540da500 con 0x7f04540d3b40 2024-04-26T23:43:30.332 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:30.327+0000 7f045a7fc640 1 -- 172.21.15.88:0/3410846240 <== mon.1 v1:172.21.15.175:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 356324787 0 0) 0x7f0450001650 con 0x7f04540d3b40 2024-04-26T23:43:30.332 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:30.327+0000 7f045a7fc640 1 -- 172.21.15.88:0/3410846240 >> v1:172.21.15.175:6789/0 conn(0x7f04540d3b40 legacy=0x7f0454046b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:30.332 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:30.327+0000 7f045a7fc640 1 --2- 172.21.15.88:0/3410846240 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f044c0039b0 0x7f044c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:30.332 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:30.327+0000 7f045a7fc640 1 --2- 172.21.15.88:0/3410846240 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f045404b110 0x7f044c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:30.332 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:30.327+0000 7f045a7fc640 1 --2- 172.21.15.88:0/3410846240 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f044c004d40 0x7f044c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:30.332 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:30.327+0000 7f045a7fc640 1 -- 172.21.15.88:0/3410846240 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f04540d9f40 con 0x7f044c004d40 2024-04-26T23:43:30.332 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:30.327+0000 7f045a7fc640 1 -- 172.21.15.88:0/3410846240 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f04540da220 con 0x7f044c0039b0 2024-04-26T23:43:30.332 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:30.327+0000 7f045a7fc640 1 -- 172.21.15.88:0/3410846240 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f044c00ba90 con 0x7f045404b110 2024-04-26T23:43:30.332 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:30.328+0000 7f045bfff640 1 --2- 172.21.15.88:0/3410846240 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f044c004d40 0x7f044c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:30.332 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:30.328+0000 7f045affd640 1 -- 172.21.15.88:0/3410846240 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f045404b110 msgr2=0x7f044c004800 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.175:3301/0 2024-04-26T23:43:30.332 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:30.328+0000 7f045affd640 1 --2- 172.21.15.88:0/3410846240 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f045404b110 0x7f044c004800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:43:30.332 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:30.328+0000 7f045b7fe640 1 --2- 172.21.15.88:0/3410846240 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f044c0039b0 0x7f044c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:30.333 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:30.328+0000 7f045bfff640 1 -- 172.21.15.88:0/3410846240 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f045404b110 msgr2=0x7f044c004800 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T23:43:30.333 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:30.328+0000 7f045bfff640 1 --2- 172.21.15.88:0/3410846240 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f045404b110 0x7f044c004800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:30.333 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:30.328+0000 7f045bfff640 1 -- 172.21.15.88:0/3410846240 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f044c0039b0 msgr2=0x7f044c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:43:30.333 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:30.328+0000 7f045bfff640 1 --2- 172.21.15.88:0/3410846240 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f044c0039b0 0x7f044c003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:30.333 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:30.328+0000 7f045bfff640 1 -- 172.21.15.88:0/3410846240 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04540da500 con 0x7f044c004d40 2024-04-26T23:43:30.333 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:30.330+0000 7f045bfff640 1 --2- 172.21.15.88:0/3410846240 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f044c004d40 0x7f044c0051c0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f0448006fd0 tx=0x7f044c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=452b31bf18f26bc2 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:30.335 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:30.331+0000 7f045a7fc640 1 -- 172.21.15.88:0/3410846240 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f044803c070 con 0x7f044c004d40 2024-04-26T23:43:30.335 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:30.331+0000 7f045a7fc640 1 -- 172.21.15.88:0/3410846240 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f044802fdb0 con 0x7f044c004d40 2024-04-26T23:43:30.335 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:30.332+0000 7f0461cda640 1 -- 172.21.15.88:0/3410846240 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f044c004d40 msgr2=0x7f044c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:30.335 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:30.332+0000 7f0461cda640 1 --2- 172.21.15.88:0/3410846240 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f044c004d40 0x7f044c0051c0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f0448006fd0 tx=0x7f044c005830 comp rx=0 tx=0).stop 2024-04-26T23:43:30.335 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:30.332+0000 7f045bfff640 1 -- 172.21.15.88:0/3410846240 reap_dead start 2024-04-26T23:43:30.335 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:30.332+0000 7f0461cda640 1 -- 172.21.15.88:0/3410846240 shutdown_connections 2024-04-26T23:43:30.335 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:30.332+0000 7f0461cda640 1 -- 172.21.15.88:0/3410846240 >> 172.21.15.88:0/3410846240 conn(0x7f0454048250 msgr2=0x7f0454048660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:43:30.338 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:30.332+0000 7f0461cda640 1 -- 172.21.15.88:0/3410846240 shutdown_connections 2024-04-26T23:43:30.338 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:30.332+0000 7f0461cda640 1 -- 172.21.15.88:0/3410846240 wait complete. 2024-04-26T23:43:30.339 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:30.334+0000 7f0461cda640 1 Processor -- start 2024-04-26T23:43:30.339 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:30.334+0000 7f0461cda640 1 -- start start 2024-04-26T23:43:30.342 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:30.335+0000 7f0461cda640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f045402fcc0 0x7f045418d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:30.342 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:30.335+0000 7f0461cda640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0454030a60 0x7f0454040770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:30.342 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:30.335+0000 7f0461cda640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0454040cb0 0x7f04540d8970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:30.342 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:30.335+0000 7f0461cda640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f04540d3f20 con 0x7f0454030a60 2024-04-26T23:43:30.342 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:30.335+0000 7f0461cda640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f04540d9930 con 0x7f045402fcc0 2024-04-26T23:43:30.342 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:30.335+0000 7f0461cda640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f0454041160 con 0x7f0454040cb0 2024-04-26T23:43:30.342 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:30.336+0000 7f045bfff640 1 -- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0454040cb0 msgr2=0x7f04540d8970 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.175:3301/0 2024-04-26T23:43:30.342 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:30.336+0000 7f045bfff640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0454040cb0 0x7f04540d8970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:43:30.343 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:30.336+0000 7f045affd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0454030a60 0x7f0454040770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:30.344 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:30.336+0000 7f045affd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0454030a60 0x7f0454040770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:35502/0 (socket says 172.21.15.88:35502) 2024-04-26T23:43:30.344 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:30.336+0000 7f045affd640 1 -- 172.21.15.88:0/1715491115 learned_addr learned my addr 172.21.15.88:0/1715491115 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:43:30.344 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:30.337+0000 7f045b7fe640 1 --2- 172.21.15.88:0/1715491115 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f045402fcc0 0x7f045418d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:30.345 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:30.337+0000 7f045affd640 1 -- 172.21.15.88:0/1715491115 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0454040cb0 msgr2=0x7f04540d8970 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T23:43:30.345 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:30.337+0000 7f045affd640 1 --2- 172.21.15.88:0/1715491115 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0454040cb0 0x7f04540d8970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:30.345 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:30.337+0000 7f045affd640 1 -- 172.21.15.88:0/1715491115 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f045402fcc0 msgr2=0x7f045418d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:30.345 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:30.337+0000 7f045affd640 1 --2- 172.21.15.88:0/1715491115 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f045402fcc0 0x7f045418d2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:30.345 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:30.337+0000 7f045affd640 1 -- 172.21.15.88:0/1715491115 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0454191790 con 0x7f0454030a60 2024-04-26T23:43:30.345 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:30.338+0000 7f045affd640 1 --2- 172.21.15.88:0/1715491115 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0454030a60 0x7f0454040770 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f045c02e060 tx=0x7f045c06a050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:30.345 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:30.338+0000 7f045b7fe640 1 --2- 172.21.15.88:0/1715491115 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f045402fcc0 0x7f045418d2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:43:30.345 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:30.338+0000 7f0447fff640 1 -- 172.21.15.88:0/1715491115 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f045c089070 con 0x7f0454030a60 2024-04-26T23:43:30.345 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:30.338+0000 7f0447fff640 1 -- 172.21.15.88:0/1715491115 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f045c085d30 con 0x7f0454030a60 2024-04-26T23:43:30.345 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:30.338+0000 7f0447fff640 1 -- 172.21.15.88:0/1715491115 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f045c06f650 con 0x7f0454030a60 2024-04-26T23:43:30.345 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:30.339+0000 7f0461cda640 1 -- 172.21.15.88:0/1715491115 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0454190c10 con 0x7f0454030a60 2024-04-26T23:43:30.345 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:30.339+0000 7f0461cda640 1 -- 172.21.15.88:0/1715491115 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04541911d0 con 0x7f0454030a60 2024-04-26T23:43:30.347 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:30.343+0000 7f0447fff640 1 -- 172.21.15.88:0/1715491115 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f045c0853a0 con 0x7f0454030a60 2024-04-26T23:43:30.349 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:30.343+0000 7f0447fff640 1 --2- 172.21.15.88:0/1715491115 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f044007d900 0x7f044007fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:30.349 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:30.344+0000 7f0447fff640 1 -- 172.21.15.88:0/1715491115 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6666+0+0 (secure 0 0 0) 0x7f045c0f7460 con 0x7f0454030a60 2024-04-26T23:43:30.349 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:30.344+0000 7f045b7fe640 1 --2- 172.21.15.88:0/1715491115 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f044007d900 0x7f044007fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:30.349 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:30.345+0000 7f0461cda640 1 -- 172.21.15.88:0/1715491115 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f043c005290 con 0x7f0454030a60 2024-04-26T23:43:30.349 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:30.345+0000 7f045b7fe640 1 --2- 172.21.15.88:0/1715491115 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f044007d900 0x7f044007fdc0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f0450001050 tx=0x7f0450000ed0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:30.361 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:30.355+0000 7f0447fff640 1 -- 172.21.15.88:0/1715491115 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f045c0c5540 con 0x7f0454030a60 2024-04-26T23:43:30.920 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:30.917+0000 7f0461cda640 1 -- 172.21.15.88:0/1715491115 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f043c005580 con 0x7f0454030a60 2024-04-26T23:43:30.922 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:30.919+0000 7f0447fff640 1 -- 172.21.15.88:0/1715491115 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1558 (secure 0 0 0) 0x7f045c0c4e40 con 0x7f0454030a60 2024-04-26T23:43:30.922 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":26,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"555255e9-7ef9-4454-8dc9-35e96b70035c","modified":"2024-04-26T23:39:34.291658Z","created":"2024-04-26T23:39:34.291658Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:3300","nonce":0},{"type":"v1","addr":"172.21.15.175:6789","nonce":0}]},"addr":"172.21.15.175:6789/0","public_addr":"172.21.15.175:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:3301","nonce":0},{"type":"v1","addr":"172.21.15.175:6790","nonce":0}]},"addr":"172.21.15.175:6790/0","public_addr":"172.21.15.175:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-04-26T23:43:30.925 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:30.922+0000 7f0445ffb640 1 -- 172.21.15.88:0/1715491115 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f044007d900 msgr2=0x7f044007fdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:30.926 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:30.922+0000 7f0445ffb640 1 --2- 172.21.15.88:0/1715491115 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f044007d900 0x7f044007fdc0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f0450001050 tx=0x7f0450000ed0 comp rx=0 tx=0).stop 2024-04-26T23:43:30.926 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:30.923+0000 7f0445ffb640 1 -- 172.21.15.88:0/1715491115 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0454030a60 msgr2=0x7f0454040770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:30.926 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:30.923+0000 7f0445ffb640 1 --2- 172.21.15.88:0/1715491115 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0454030a60 0x7f0454040770 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f045c02e060 tx=0x7f045c06a050 comp rx=0 tx=0).stop 2024-04-26T23:43:30.926 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:30.924+0000 7f0445ffb640 1 -- 172.21.15.88:0/1715491115 shutdown_connections 2024-04-26T23:43:30.927 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:30.924+0000 7f0445ffb640 1 --2- 172.21.15.88:0/1715491115 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f044007d900 0x7f044007fdc0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:30.927 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:30.924+0000 7f0445ffb640 1 --2- 172.21.15.88:0/1715491115 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0454040cb0 0x7f04540d8970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:30.927 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:30.924+0000 7f0445ffb640 1 --2- 172.21.15.88:0/1715491115 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0454030a60 0x7f0454040770 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:30.927 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:30.924+0000 7f0445ffb640 1 --2- 172.21.15.88:0/1715491115 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f045402fcc0 0x7f045418d2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:30.927 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:30.924+0000 7f0445ffb640 1 -- 172.21.15.88:0/1715491115 >> 172.21.15.88:0/1715491115 conn(0x7f0454048250 msgr2=0x7f04540d6610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:43:30.927 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:30.924+0000 7f0445ffb640 1 -- 172.21.15.88:0/1715491115 shutdown_connections 2024-04-26T23:43:30.927 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:30.924+0000 7f0445ffb640 1 -- 172.21.15.88:0/1715491115 wait complete. 2024-04-26T23:43:30.948 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2024-04-26T23:43:30.948 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon a 2024-04-26T23:43:30.949 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-04-26T23:43:31.154 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:31.149+0000 7f8e5f124640 1 Processor -- start 2024-04-26T23:43:31.154 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:31.149+0000 7f8e5f124640 1 -- start start 2024-04-26T23:43:31.154 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:31.150+0000 7f8e5f124640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8e58157be0 0x7f8e581539a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:31.154 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:31.150+0000 7f8e5f124640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f8e580c5560 0x7f8e58150cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:31.154 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:31.150+0000 7f8e5f124640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8e58153ff0 con 0x7f8e5806d590 2024-04-26T23:43:31.155 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:31.150+0000 7f8e5f124640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f8e581542d0 con 0x7f8e580c5560 2024-04-26T23:43:31.155 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:31.150+0000 7f8e5f124640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f8e581545b0 con 0x7f8e58157be0 2024-04-26T23:43:31.155 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:31.150+0000 7f8e57fff640 1 -- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8e58157be0 msgr2=0x7f8e581539a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.175:3301/0 2024-04-26T23:43:31.155 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:31.150+0000 7f8e57fff640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8e58157be0 0x7f8e581539a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:43:31.155 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:31.150+0000 7f8e5d6c1640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f8e580c5560 0x7f8e58150cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:31.155 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:31.151+0000 7f8e5d6c1640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f8e580c5560 0x7f8e58150cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:35518/0 (socket says 172.21.15.88:35518) 2024-04-26T23:43:31.155 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:31.151+0000 7f8e5d6c1640 1 -- 172.21.15.88:0/1067544643 learned_addr learned my addr 172.21.15.88:0/1067544643 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:43:31.157 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:31.151+0000 7f8e5d6c1640 1 -- 172.21.15.88:0/1067544643 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8e58157be0 msgr2=0x7f8e581539a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T23:43:31.157 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:31.151+0000 7f8e5d6c1640 1 --2- 172.21.15.88:0/1067544643 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8e58157be0 0x7f8e581539a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:31.157 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:31.151+0000 7f8e5d6c1640 1 -- 172.21.15.88:0/1067544643 >> v1:172.21.15.175:6789/0 conn(0x7f8e5806d590 legacy=0x7f8e581574d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:43:31.157 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:31.151+0000 7f8e5d6c1640 1 -- 172.21.15.88:0/1067544643 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e58154890 con 0x7f8e580c5560 2024-04-26T23:43:31.157 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:31.152+0000 7f8e5d6c1640 1 --2- 172.21.15.88:0/1067544643 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8e580c5560 0x7f8e58150cc0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f8e5000b1a0 tx=0x7f8e5002a8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b0ceb8d2e463f46 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:31.157 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:31.153+0000 7f8e577fe640 1 -- 172.21.15.88:0/1067544643 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e50037070 con 0x7f8e580c5560 2024-04-26T23:43:31.157 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:31.153+0000 7f8e577fe640 1 -- 172.21.15.88:0/1067544643 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e50032460 con 0x7f8e580c5560 2024-04-26T23:43:31.158 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:31.154+0000 7f8e5f124640 1 -- 172.21.15.88:0/1067544643 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8e580c5560 msgr2=0x7f8e58150cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:31.158 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:31.154+0000 7f8e5f124640 1 --2- 172.21.15.88:0/1067544643 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8e580c5560 0x7f8e58150cc0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f8e5000b1a0 tx=0x7f8e5002a8b0 comp rx=0 tx=0).stop 2024-04-26T23:43:31.159 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:31.156+0000 7f8e5f124640 1 -- 172.21.15.88:0/1067544643 shutdown_connections 2024-04-26T23:43:31.159 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:31.156+0000 7f8e5f124640 1 --2- 172.21.15.88:0/1067544643 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8e580c5560 0x7f8e58150cc0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:31.159 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:31.156+0000 7f8e5f124640 1 --2- 172.21.15.88:0/1067544643 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8e58157be0 0x7f8e581539a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:31.159 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:31.156+0000 7f8e5f124640 1 -- 172.21.15.88:0/1067544643 >> 172.21.15.88:0/1067544643 conn(0x7f8e580c5ce0 msgr2=0x7f8e580c60c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:43:31.159 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:31.156+0000 7f8e5f124640 1 -- 172.21.15.88:0/1067544643 shutdown_connections 2024-04-26T23:43:31.161 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:31.156+0000 7f8e5f124640 1 -- 172.21.15.88:0/1067544643 wait complete. 2024-04-26T23:43:31.162 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:31.158+0000 7f8e5f124640 1 Processor -- start 2024-04-26T23:43:31.163 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:31.159+0000 7f8e5f124640 1 -- start start 2024-04-26T23:43:31.164 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:31.160+0000 7f8e5f124640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8e5806d590 0x7f8e581fc2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:31.165 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:31.161+0000 7f8e5cec0640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8e5806d590 0x7f8e581fc2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:31.165 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:31.161+0000 7f8e5cec0640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8e5806d590 0x7f8e581fc2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:35522/0 (socket says 172.21.15.88:35522) 2024-04-26T23:43:31.165 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:31.162+0000 7f8e5cec0640 1 -- 172.21.15.88:0/2576413369 learned_addr learned my addr 172.21.15.88:0/2576413369 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:43:31.165 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:31.162+0000 7f8e5f124640 1 --2- 172.21.15.88:0/2576413369 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8e580c5560 0x7f8e58151ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:31.165 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:31.162+0000 7f8e5f124640 1 --2- 172.21.15.88:0/2576413369 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8e58157be0 0x7f8e58153820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:31.169 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:31.162+0000 7f8e5f124640 1 -- 172.21.15.88:0/2576413369 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f8e580c3c70 con 0x7f8e5806d590 2024-04-26T23:43:31.169 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:31.162+0000 7f8e5f124640 1 -- 172.21.15.88:0/2576413369 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f8e58074b30 con 0x7f8e580c5560 2024-04-26T23:43:31.169 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:31.162+0000 7f8e5f124640 1 -- 172.21.15.88:0/2576413369 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f8e580c3df0 con 0x7f8e58157be0 2024-04-26T23:43:31.169 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:31.162+0000 7f8e57fff640 1 --2- 172.21.15.88:0/2576413369 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8e580c5560 0x7f8e58151ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:31.169 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:31.163+0000 7f8e5cec0640 1 -- 172.21.15.88:0/2576413369 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8e58157be0 msgr2=0x7f8e58153820 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-26T23:43:31.169 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:31.163+0000 7f8e5cec0640 1 --2- 172.21.15.88:0/2576413369 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8e58157be0 0x7f8e58153820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:31.169 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:31.163+0000 7f8e5cec0640 1 -- 172.21.15.88:0/2576413369 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8e580c5560 msgr2=0x7f8e58151ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:31.169 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:31.163+0000 7f8e5cec0640 1 --2- 172.21.15.88:0/2576413369 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8e580c5560 0x7f8e58151ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:31.169 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:31.163+0000 7f8e5cec0640 1 -- 172.21.15.88:0/2576413369 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e581fc830 con 0x7f8e5806d590 2024-04-26T23:43:31.170 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:31.164+0000 7f8e5cec0640 1 --2- 172.21.15.88:0/2576413369 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8e5806d590 0x7f8e581fc2f0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f8e4c00c7b0 tx=0x7f8e4c00cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:31.170 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:31.165+0000 7f8e557fa640 1 -- 172.21.15.88:0/2576413369 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e4c017070 con 0x7f8e5806d590 2024-04-26T23:43:31.170 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:31.166+0000 7f8e5f124640 1 -- 172.21.15.88:0/2576413369 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e581ed2f0 con 0x7f8e5806d590 2024-04-26T23:43:31.171 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:31.167+0000 7f8e557fa640 1 -- 172.21.15.88:0/2576413369 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e4c005290 con 0x7f8e5806d590 2024-04-26T23:43:31.173 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:31.170+0000 7f8e557fa640 1 -- 172.21.15.88:0/2576413369 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e4c00ce60 con 0x7f8e5806d590 2024-04-26T23:43:31.173 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:31.170+0000 7f8e5f124640 1 -- 172.21.15.88:0/2576413369 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e5814eca0 con 0x7f8e5806d590 2024-04-26T23:43:31.174 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:31.171+0000 7f8e557fa640 1 -- 172.21.15.88:0/2576413369 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8e4c01a070 con 0x7f8e5806d590 2024-04-26T23:43:31.175 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:31.171+0000 7f8e557fa640 1 --2- 172.21.15.88:0/2576413369 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f8e4406c970 0x7f8e4406ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:31.180 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:31.172+0000 7f8e57fff640 1 --2- 172.21.15.88:0/2576413369 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f8e4406c970 0x7f8e4406ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:31.180 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:31.172+0000 7f8e557fa640 1 -- 172.21.15.88:0/2576413369 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6666+0+0 (secure 0 0 0) 0x7f8e4c08aed0 con 0x7f8e5806d590 2024-04-26T23:43:31.180 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:31.172+0000 7f8e5f124640 1 --2- 172.21.15.88:0/2576413369 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8e58154d10 0x7f8e58070cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:31.181 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:31.172+0000 7f8e5f124640 1 -- 172.21.15.88:0/2576413369 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f8e581517d0 con 0x7f8e58154d10 2024-04-26T23:43:31.181 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:31.173+0000 7f8e57fff640 1 --2- 172.21.15.88:0/2576413369 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f8e4406c970 0x7f8e4406ee30 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f8e5814f8a0 tx=0x7f8e48009360 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:31.181 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:31.173+0000 7f8e5d6c1640 1 --2- 172.21.15.88:0/2576413369 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8e58154d10 0x7f8e58070cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:31.181 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:31.174+0000 7f8e5d6c1640 1 -- 172.21.15.88:0/2576413369 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8e580696c0 con 0x7f8e58154d10 2024-04-26T23:43:31.181 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:31.175+0000 7f8e5d6c1640 1 --2- 172.21.15.88:0/2576413369 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8e58154d10 0x7f8e58070cd0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f8e580c69c0 tx=0x7f8e50004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:31.181 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:31.176+0000 7f8e557fa640 1 -- 172.21.15.88:0/2576413369 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e50041070 con 0x7f8e58154d10 2024-04-26T23:43:31.182 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:31.176+0000 7f8e557fa640 1 -- 172.21.15.88:0/2576413369 <== mon.0 v2:172.21.15.88:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f8e5003d670 con 0x7f8e58154d10 2024-04-26T23:43:31.182 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:31.176+0000 7f8e557fa640 1 -- 172.21.15.88:0/2576413369 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8e58154d10 msgr2=0x7f8e58070cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:31.182 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:31.177+0000 7f8e557fa640 1 --2- 172.21.15.88:0/2576413369 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8e58154d10 0x7f8e58070cd0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f8e580c69c0 tx=0x7f8e50004a40 comp rx=0 tx=0).stop 2024-04-26T23:43:31.182 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:31.177+0000 7f8e557fa640 1 -- 172.21.15.88:0/2576413369 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8e58154d10 msgr2=0x7f8e58070cd0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:43:31.182 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:31.177+0000 7f8e557fa640 1 --2- 172.21.15.88:0/2576413369 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8e58154d10 0x7f8e58070cd0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:31.194 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:31.191+0000 7f8e5f124640 1 --2- 172.21.15.88:0/2576413369 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8e5814eee0 0x7f8e5814dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:31.196 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:31.193+0000 7f8e5f124640 1 -- 172.21.15.88:0/2576413369 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f8e58151ff0 con 0x7f8e5814eee0 2024-04-26T23:43:31.201 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:31.193+0000 7f8e5d6c1640 1 --2- 172.21.15.88:0/2576413369 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8e5814eee0 0x7f8e5814dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:31.202 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:31.199+0000 7f8e5d6c1640 1 -- 172.21.15.88:0/2576413369 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f8e580c4390 con 0x7f8e5814eee0 2024-04-26T23:43:31.203 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:31.200+0000 7f8e5d6c1640 1 --2- 172.21.15.88:0/2576413369 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8e5814eee0 0x7f8e5814dfb0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f8e5002a8f0 tx=0x7f8e50009810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:31.203 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:31.200+0000 7f8e557fa640 1 -- 172.21.15.88:0/2576413369 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e50037040 con 0x7f8e5814eee0 2024-04-26T23:43:31.204 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:31.201+0000 7f8e557fa640 1 -- 172.21.15.88:0/2576413369 <== mon.0 v2:172.21.15.88:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4859 (secure 0 0 0) 0x7f8e50046230 con 0x7f8e5814eee0 2024-04-26T23:43:31.204 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:31.201+0000 7f8e557fa640 1 -- 172.21.15.88:0/2576413369 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8e5814eee0 msgr2=0x7f8e5814dfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:31.204 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:31.201+0000 7f8e557fa640 1 --2- 172.21.15.88:0/2576413369 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8e5814eee0 0x7f8e5814dfb0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f8e5002a8f0 tx=0x7f8e50009810 comp rx=0 tx=0).stop 2024-04-26T23:43:31.204 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:31.201+0000 7f8e557fa640 1 -- 172.21.15.88:0/2576413369 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8e5814eee0 msgr2=0x7f8e5814dfb0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:43:31.204 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:31.201+0000 7f8e557fa640 1 --2- 172.21.15.88:0/2576413369 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8e5814eee0 0x7f8e5814dfb0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:31.205 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-04-26T23:43:31.205 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2024-04-26T23:43:31.205 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2024-04-26T23:43:31.205 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "leader", 2024-04-26T23:43:31.205 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 26, 2024-04-26T23:43:31.205 INFO:teuthology.orchestra.run.smithi088.stdout: "uptime": 100172, 2024-04-26T23:43:31.205 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2024-04-26T23:43:31.205 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2024-04-26T23:43:31.205 INFO:teuthology.orchestra.run.smithi088.stdout: 1 2024-04-26T23:43:31.205 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:43:31.206 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 0, 2024-04-26T23:43:31.206 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2024-04-26T23:43:31.206 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2450521708007866372", 2024-04-26T23:43:31.206 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2024-04-26T23:43:31.206 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-04-26T23:43:31.206 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-04-26T23:43:31.206 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-04-26T23:43:31.206 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-04-26T23:43:31.206 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-04-26T23:43:31.206 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-04-26T23:43:31.206 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-04-26T23:43:31.206 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-04-26T23:43:31.206 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-04-26T23:43:31.207 INFO:teuthology.orchestra.run.smithi088.stdout: "reef", 2024-04-26T23:43:31.207 INFO:teuthology.orchestra.run.smithi088.stdout: "squid" 2024-04-26T23:43:31.207 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:43:31.207 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540701547738038271", 2024-04-26T23:43:31.207 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2024-04-26T23:43:31.207 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-04-26T23:43:31.207 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-04-26T23:43:31.207 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-04-26T23:43:31.207 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-04-26T23:43:31.207 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-04-26T23:43:31.207 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-04-26T23:43:31.207 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-04-26T23:43:31.207 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-04-26T23:43:31.208 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-04-26T23:43:31.208 INFO:teuthology.orchestra.run.smithi088.stdout: "reef", 2024-04-26T23:43:31.208 INFO:teuthology.orchestra.run.smithi088.stdout: "squid" 2024-04-26T23:43:31.208 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:43:31.208 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:43:31.208 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2024-04-26T23:43:31.208 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2024-04-26T23:43:31.208 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2024-04-26T23:43:31.209 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2024-04-26T23:43:31.209 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2024-04-26T23:43:31.209 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "555255e9-7ef9-4454-8dc9-35e96b70035c", 2024-04-26T23:43:31.209 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2024-04-26T23:39:34.291658Z", 2024-04-26T23:43:31.209 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2024-04-26T23:39:34.291658Z", 2024-04-26T23:43:31.209 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 19, 2024-04-26T23:43:31.209 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "squid", 2024-04-26T23:43:31.209 INFO:teuthology.orchestra.run.smithi088.stdout: "election_strategy": 1, 2024-04-26T23:43:31.209 INFO:teuthology.orchestra.run.smithi088.stdout: "disallowed_leaders: ": "", 2024-04-26T23:43:31.209 INFO:teuthology.orchestra.run.smithi088.stdout: "stretch_mode": false, 2024-04-26T23:43:31.209 INFO:teuthology.orchestra.run.smithi088.stdout: "tiebreaker_mon": "", 2024-04-26T23:43:31.209 INFO:teuthology.orchestra.run.smithi088.stdout: "removed_ranks: ": "", 2024-04-26T23:43:31.209 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2024-04-26T23:43:31.210 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2024-04-26T23:43:31.210 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-04-26T23:43:31.210 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-04-26T23:43:31.210 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-04-26T23:43:31.210 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-04-26T23:43:31.210 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-04-26T23:43:31.210 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-04-26T23:43:31.210 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-04-26T23:43:31.211 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-04-26T23:43:31.211 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-04-26T23:43:31.211 INFO:teuthology.orchestra.run.smithi088.stdout: "reef", 2024-04-26T23:43:31.211 INFO:teuthology.orchestra.run.smithi088.stdout: "squid" 2024-04-26T23:43:31.211 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:43:31.211 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2024-04-26T23:43:31.211 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:43:31.211 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2024-04-26T23:43:31.211 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:43:31.211 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2024-04-26T23:43:31.211 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2024-04-26T23:43:31.211 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-04-26T23:43:31.211 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-04-26T23:43:31.212 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:43:31.212 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-04-26T23:43:31.212 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2024-04-26T23:43:31.212 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:43:31.212 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:43:31.212 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:43:31.212 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-04-26T23:43:31.212 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2024-04-26T23:43:31.212 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:43:31.212 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:43:31.212 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:43:31.212 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:43:31.212 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2024-04-26T23:43:31.213 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2024-04-26T23:43:31.213 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-04-26T23:43:31.213 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-04-26T23:43:31.213 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-04-26T23:43:31.213 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:43:31.213 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:43:31.213 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2024-04-26T23:43:31.213 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2024-04-26T23:43:31.213 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-04-26T23:43:31.213 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-04-26T23:43:31.213 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:43:31.213 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-04-26T23:43:31.213 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:3300", 2024-04-26T23:43:31.214 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:43:31.214 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:43:31.214 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:43:31.214 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-04-26T23:43:31.214 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6789", 2024-04-26T23:43:31.214 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:43:31.214 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:43:31.214 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:43:31.214 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:43:31.214 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6789/0", 2024-04-26T23:43:31.214 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.175:6789/0", 2024-04-26T23:43:31.214 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-04-26T23:43:31.215 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-04-26T23:43:31.215 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-04-26T23:43:31.215 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:43:31.215 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:43:31.215 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2024-04-26T23:43:31.215 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2024-04-26T23:43:31.215 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-04-26T23:43:31.215 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-04-26T23:43:31.215 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:43:31.215 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-04-26T23:43:31.216 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:3301", 2024-04-26T23:43:31.216 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:43:31.216 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:43:31.216 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:43:31.216 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-04-26T23:43:31.216 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6790", 2024-04-26T23:43:31.216 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:43:31.216 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:43:31.216 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:43:31.216 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:43:31.216 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6790/0", 2024-04-26T23:43:31.216 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.175:6790/0", 2024-04-26T23:43:31.216 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-04-26T23:43:31.217 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-04-26T23:43:31.217 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-04-26T23:43:31.217 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:43:31.217 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:43:31.217 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:43:31.217 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2024-04-26T23:43:31.217 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2024-04-26T23:43:31.217 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:43:31.217 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:43:31.217 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:43:31.217 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2024-04-26T23:43:31.218 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:43:31.218 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:43:31.218 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": [ 2024-04-26T23:43:31.218 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:43:31.218 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:43:31.218 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:43:31.218 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 3 2024-04-26T23:43:31.218 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:43:31.218 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:43:31.218 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2024-04-26T23:43:31.218 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:43:31.218 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x2f018fb87aa4aafe", 2024-04-26T23:43:31.219 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:43:31.219 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2024-04-26T23:43:31.219 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:43:31.219 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:43:31.219 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:43:31.219 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:43:31.219 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 3 2024-04-26T23:43:31.219 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:43:31.219 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:43:31.219 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:43:31.220 INFO:teuthology.orchestra.run.smithi088.stdout: "stretch_mode": false 2024-04-26T23:43:31.220 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-04-26T23:43:31.220 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:31.210+0000 7f8e3effd640 1 -- 172.21.15.88:0/2576413369 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f8e4406c970 msgr2=0x7f8e4406ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:31.220 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:31.210+0000 7f8e3effd640 1 --2- 172.21.15.88:0/2576413369 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f8e4406c970 0x7f8e4406ee30 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f8e5814f8a0 tx=0x7f8e48009360 comp rx=0 tx=0).stop 2024-04-26T23:43:31.220 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:31.210+0000 7f8e5d6c1640 1 -- 172.21.15.88:0/2576413369 reap_dead start 2024-04-26T23:43:31.221 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:31.210+0000 7f8e3effd640 1 -- 172.21.15.88:0/2576413369 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8e5806d590 msgr2=0x7f8e581fc2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:31.221 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:31.210+0000 7f8e3effd640 1 --2- 172.21.15.88:0/2576413369 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8e5806d590 0x7f8e581fc2f0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f8e4c00c7b0 tx=0x7f8e4c00cc70 comp rx=0 tx=0).stop 2024-04-26T23:43:31.221 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:31.210+0000 7f8e3effd640 1 -- 172.21.15.88:0/2576413369 shutdown_connections 2024-04-26T23:43:31.221 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:31.210+0000 7f8e3effd640 1 --2- 172.21.15.88:0/2576413369 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8e5806d590 0x7f8e581fc2f0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:31.221 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:31.210+0000 7f8e3effd640 1 -- 172.21.15.88:0/2576413369 >> 172.21.15.88:0/2576413369 conn(0x7f8e580c5ce0 msgr2=0x7f8e580c7980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:43:31.221 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:31.211+0000 7f8e3effd640 1 -- 172.21.15.88:0/2576413369 shutdown_connections 2024-04-26T23:43:31.221 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:31.211+0000 7f8e3effd640 1 -- 172.21.15.88:0/2576413369 wait complete. 2024-04-26T23:43:31.244 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-04-26T23:43:31.245 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon b 2024-04-26T23:43:31.245 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-04-26T23:43:31.441 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:31.438+0000 7ff2951ec640 1 Processor -- start 2024-04-26T23:43:31.441 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:31.438+0000 7ff2951ec640 1 -- start start 2024-04-26T23:43:31.442 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:31.439+0000 7ff2951ec640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff2900c8dc0 0x7ff2900ac140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:31.442 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:31.439+0000 7ff2951ec640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7ff2900ac680 0x7ff2901533b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:31.442 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:31.439+0000 7ff2951ec640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff29006ff20 con 0x7ff2900c2cd0 2024-04-26T23:43:31.444 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:31.439+0000 7ff2951ec640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7ff2900c4bd0 con 0x7ff2900ac680 2024-04-26T23:43:31.444 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:31.439+0000 7ff2951ec640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7ff29006f4e0 con 0x7ff2900c8dc0 2024-04-26T23:43:31.444 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:31.439+0000 7ff287fff640 1 -- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff2900c8dc0 msgr2=0x7ff2900ac140 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.175:3301/0 2024-04-26T23:43:31.444 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:31.439+0000 7ff287fff640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff2900c8dc0 0x7ff2900ac140 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:43:31.444 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:31.440+0000 7ff28f59e640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7ff2900ac680 0x7ff2901533b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:31.444 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:31.440+0000 7ff28f59e640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7ff2900ac680 0x7ff2901533b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.88:40734/0 (socket says 172.21.15.88:40734) 2024-04-26T23:43:31.444 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:31.440+0000 7ff28f59e640 1 -- 172.21.15.88:0/1597058808 learned_addr learned my addr 172.21.15.88:0/1597058808 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:43:31.444 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:31.440+0000 7ff28f59e640 1 -- 172.21.15.88:0/1597058808 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff2900c8dc0 msgr2=0x7ff2900ac140 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T23:43:31.445 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:31.440+0000 7ff28f59e640 1 --2- 172.21.15.88:0/1597058808 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff2900c8dc0 0x7ff2900ac140 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:31.445 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:31.440+0000 7ff28f59e640 1 -- 172.21.15.88:0/1597058808 >> v1:172.21.15.175:6789/0 conn(0x7ff2900c2cd0 legacy=0x7ff290150200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:31.445 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:31.440+0000 7ff28f59e640 1 -- 172.21.15.88:0/1597058808 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2900c48f0 con 0x7ff2900ac680 2024-04-26T23:43:31.445 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:31.442+0000 7ff28f59e640 1 --2- 172.21.15.88:0/1597058808 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff2900ac680 0x7ff2901533b0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7ff288009ed0 tx=0x7ff288032ef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=879b66a5b874b2fb server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:31.446 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:31.443+0000 7ff28e59c640 1 -- 172.21.15.88:0/1597058808 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2880339f0 con 0x7ff2900ac680 2024-04-26T23:43:31.446 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:31.444+0000 7ff28e59c640 1 -- 172.21.15.88:0/1597058808 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff288033b90 con 0x7ff2900ac680 2024-04-26T23:43:31.447 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:31.444+0000 7ff28e59c640 1 -- 172.21.15.88:0/1597058808 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff28803b3f0 con 0x7ff2900ac680 2024-04-26T23:43:31.449 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:31.445+0000 7ff2951ec640 1 -- 172.21.15.88:0/1597058808 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff2900ac680 msgr2=0x7ff2901533b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:31.449 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:31.445+0000 7ff2951ec640 1 --2- 172.21.15.88:0/1597058808 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff2900ac680 0x7ff2901533b0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7ff288009ed0 tx=0x7ff288032ef0 comp rx=0 tx=0).stop 2024-04-26T23:43:31.449 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:31.445+0000 7ff2951ec640 1 -- 172.21.15.88:0/1597058808 shutdown_connections 2024-04-26T23:43:31.449 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:31.445+0000 7ff2951ec640 1 --2- 172.21.15.88:0/1597058808 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff2900ac680 0x7ff2901533b0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:31.449 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:31.445+0000 7ff2951ec640 1 --2- 172.21.15.88:0/1597058808 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff2900c8dc0 0x7ff2900ac140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:31.449 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:31.445+0000 7ff2951ec640 1 -- 172.21.15.88:0/1597058808 >> 172.21.15.88:0/1597058808 conn(0x7ff2900c82d0 msgr2=0x7ff2900c86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:43:31.450 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:31.447+0000 7ff2951ec640 1 -- 172.21.15.88:0/1597058808 shutdown_connections 2024-04-26T23:43:31.452 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:31.449+0000 7ff2951ec640 1 -- 172.21.15.88:0/1597058808 wait complete. 2024-04-26T23:43:31.455 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:31.451+0000 7ff2951ec640 1 Processor -- start 2024-04-26T23:43:31.455 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:31.451+0000 7ff2951ec640 1 -- start start 2024-04-26T23:43:31.459 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:31.452+0000 7ff2951ec640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff2900ac680 0x7ff29014ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:31.459 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:31.452+0000 7ff2951ec640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff2900c2cd0 0x7ff2901eba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:31.459 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:31.452+0000 7ff2951ec640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff2900c8dc0 0x7ff2901ebfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:31.459 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:31.452+0000 7ff2951ec640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7ff2900ab820 con 0x7ff2900c8dc0 2024-04-26T23:43:31.459 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:31.452+0000 7ff2951ec640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff2900ab6a0 con 0x7ff2900c2cd0 2024-04-26T23:43:31.459 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:31.452+0000 7ff2951ec640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7ff2900ab9a0 con 0x7ff2900ac680 2024-04-26T23:43:31.459 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:31.453+0000 7ff28ed9d640 1 -- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff2900ac680 msgr2=0x7ff29014ebf0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.175:3301/0 2024-04-26T23:43:31.459 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:31.453+0000 7ff28f59e640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff2900c8dc0 0x7ff2901ebfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:31.459 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:31.453+0000 7ff28ed9d640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff2900ac680 0x7ff29014ebf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:43:31.459 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:31.454+0000 7ff28f59e640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff2900c8dc0 0x7ff2901ebfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:35540/0 (socket says 172.21.15.88:35540) 2024-04-26T23:43:31.459 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:31.454+0000 7ff28f59e640 1 -- 172.21.15.88:0/3590689441 learned_addr learned my addr 172.21.15.88:0/3590689441 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:43:31.460 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:31.454+0000 7ff28f59e640 1 -- 172.21.15.88:0/3590689441 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff2900ac680 msgr2=0x7ff29014ebf0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T23:43:31.460 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:31.454+0000 7ff28f59e640 1 --2- 172.21.15.88:0/3590689441 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff2900ac680 0x7ff29014ebf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:31.460 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:31.454+0000 7ff28f59e640 1 -- 172.21.15.88:0/3590689441 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff2900c2cd0 msgr2=0x7ff2901eba90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T23:43:31.460 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:31.454+0000 7ff28f59e640 1 --2- 172.21.15.88:0/3590689441 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff2900c2cd0 0x7ff2901eba90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:31.460 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:31.454+0000 7ff28f59e640 1 -- 172.21.15.88:0/3590689441 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff290074920 con 0x7ff2900c8dc0 2024-04-26T23:43:31.460 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:31.454+0000 7ff28f59e640 1 --2- 172.21.15.88:0/3590689441 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff2900c8dc0 0x7ff2901ebfd0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ff288009e20 tx=0x7ff288004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:31.460 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:31.457+0000 7ff2877fe640 1 -- 172.21.15.88:0/3590689441 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff28804a020 con 0x7ff2900c8dc0 2024-04-26T23:43:31.464 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:31.457+0000 7ff2877fe640 1 -- 172.21.15.88:0/3590689441 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff288045450 con 0x7ff2900c8dc0 2024-04-26T23:43:31.467 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:31.457+0000 7ff2877fe640 1 -- 172.21.15.88:0/3590689441 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff288045820 con 0x7ff2900c8dc0 2024-04-26T23:43:31.469 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:31.457+0000 7ff2951ec640 1 -- 172.21.15.88:0/3590689441 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff290074080 con 0x7ff2900c8dc0 2024-04-26T23:43:31.469 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:31.457+0000 7ff2951ec640 1 -- 172.21.15.88:0/3590689441 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff290074640 con 0x7ff2900c8dc0 2024-04-26T23:43:31.469 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:31.459+0000 7ff2951ec640 1 --2- 172.21.15.88:0/3590689441 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff290073bd0 0x7ff290142420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:31.469 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:31.459+0000 7ff2951ec640 1 -- 172.21.15.88:0/3590689441 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff2900507a0 con 0x7ff290073bd0 2024-04-26T23:43:31.469 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:31.459+0000 7ff28ed9d640 1 --2- 172.21.15.88:0/3590689441 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff290073bd0 0x7ff290142420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:31.469 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:31.460+0000 7ff28ed9d640 1 -- 172.21.15.88:0/3590689441 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff29006fb70 con 0x7ff290073bd0 2024-04-26T23:43:31.469 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:31.461+0000 7ff28ed9d640 1 --2- 172.21.15.88:0/3590689441 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff290073bd0 0x7ff290142420 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7ff280001030 tx=0x7ff28000c810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:31.470 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:31.461+0000 7ff2877fe640 1 -- 172.21.15.88:0/3590689441 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2800074e0 con 0x7ff290073bd0 2024-04-26T23:43:31.470 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:31.461+0000 7ff2877fe640 1 -- 172.21.15.88:0/3590689441 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff28804d020 con 0x7ff2900c8dc0 2024-04-26T23:43:31.470 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:31.462+0000 7ff2877fe640 1 --2- 172.21.15.88:0/3590689441 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7ff27006c820 0x7ff27006ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:31.470 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:31.463+0000 7ff287fff640 1 --2- 172.21.15.88:0/3590689441 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7ff27006c820 0x7ff27006ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:31.470 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:31.464+0000 7ff287fff640 1 --2- 172.21.15.88:0/3590689441 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7ff27006c820 0x7ff27006ece0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7ff290145fe0 tx=0x7ff278006c80 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:31.470 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:31.464+0000 7ff2877fe640 1 -- 172.21.15.88:0/3590689441 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6666+0+0 (secure 0 0 0) 0x7ff2880b5760 con 0x7ff2900c8dc0 2024-04-26T23:43:31.480 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:31.473+0000 7ff2877fe640 1 -- 172.21.15.88:0/3590689441 <== mon.1 v2:172.21.15.175:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7ff280004020 con 0x7ff290073bd0 2024-04-26T23:43:31.481 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:31.473+0000 7ff2877fe640 1 -- 172.21.15.88:0/3590689441 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff290073bd0 msgr2=0x7ff290142420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:31.481 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:31.473+0000 7ff2877fe640 1 --2- 172.21.15.88:0/3590689441 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff290073bd0 0x7ff290142420 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7ff280001030 tx=0x7ff28000c810 comp rx=0 tx=0).stop 2024-04-26T23:43:31.481 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:31.473+0000 7ff2877fe640 1 -- 172.21.15.88:0/3590689441 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff290073bd0 msgr2=0x7ff290142420 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:43:31.481 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:31.473+0000 7ff2877fe640 1 --2- 172.21.15.88:0/3590689441 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff290073bd0 0x7ff290142420 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:31.507 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:31.504+0000 7ff2951ec640 1 --2- 172.21.15.88:0/3590689441 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff2901515e0 0x7ff290142960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:31.507 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:31.504+0000 7ff2951ec640 1 -- 172.21.15.88:0/3590689441 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff290142ea0 con 0x7ff2901515e0 2024-04-26T23:43:31.509 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:31.506+0000 7ff28ed9d640 1 --2- 172.21.15.88:0/3590689441 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff2901515e0 0x7ff290142960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:31.511 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:31.508+0000 7ff28ed9d640 1 -- 172.21.15.88:0/3590689441 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7ff29014f130 con 0x7ff2901515e0 2024-04-26T23:43:31.515 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:31.512+0000 7ff28ed9d640 1 --2- 172.21.15.88:0/3590689441 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff2901515e0 0x7ff290142960 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7ff280001eb0 tx=0x7ff280000ed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:31.516 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:31.512+0000 7ff2877fe640 1 -- 172.21.15.88:0/3590689441 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff280019880 con 0x7ff2901515e0 2024-04-26T23:43:31.516 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:31.513+0000 7ff2877fe640 1 -- 172.21.15.88:0/3590689441 <== mon.1 v2:172.21.15.175:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5054 (secure 0 0 0) 0x7ff280019880 con 0x7ff2901515e0 2024-04-26T23:43:31.516 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:31.513+0000 7ff2877fe640 1 -- 172.21.15.88:0/3590689441 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff2901515e0 msgr2=0x7ff290142960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:31.516 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:31.513+0000 7ff2877fe640 1 --2- 172.21.15.88:0/3590689441 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff2901515e0 0x7ff290142960 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7ff280001eb0 tx=0x7ff280000ed0 comp rx=0 tx=0).stop 2024-04-26T23:43:31.516 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:31.513+0000 7ff2877fe640 1 -- 172.21.15.88:0/3590689441 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff2901515e0 msgr2=0x7ff290142960 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:43:31.516 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:31.513+0000 7ff2877fe640 1 --2- 172.21.15.88:0/3590689441 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff2901515e0 0x7ff290142960 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:31.517 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-04-26T23:43:31.517 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2024-04-26T23:43:31.517 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2024-04-26T23:43:31.517 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "peon", 2024-04-26T23:43:31.518 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 26, 2024-04-26T23:43:31.518 INFO:teuthology.orchestra.run.smithi088.stdout: "uptime": 203855, 2024-04-26T23:43:31.518 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2024-04-26T23:43:31.518 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2024-04-26T23:43:31.518 INFO:teuthology.orchestra.run.smithi088.stdout: 1 2024-04-26T23:43:31.518 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:43:31.518 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 1, 2024-04-26T23:43:31.518 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2024-04-26T23:43:31.518 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2450521708007866372", 2024-04-26T23:43:31.518 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2024-04-26T23:43:31.518 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-04-26T23:43:31.518 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-04-26T23:43:31.519 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-04-26T23:43:31.519 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-04-26T23:43:31.519 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-04-26T23:43:31.519 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-04-26T23:43:31.519 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-04-26T23:43:31.519 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-04-26T23:43:31.519 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-04-26T23:43:31.519 INFO:teuthology.orchestra.run.smithi088.stdout: "reef", 2024-04-26T23:43:31.519 INFO:teuthology.orchestra.run.smithi088.stdout: "squid" 2024-04-26T23:43:31.519 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:43:31.519 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540701547738038271", 2024-04-26T23:43:31.519 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2024-04-26T23:43:31.519 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-04-26T23:43:31.520 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-04-26T23:43:31.520 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-04-26T23:43:31.520 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-04-26T23:43:31.520 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-04-26T23:43:31.520 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-04-26T23:43:31.520 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-04-26T23:43:31.520 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-04-26T23:43:31.520 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-04-26T23:43:31.520 INFO:teuthology.orchestra.run.smithi088.stdout: "reef", 2024-04-26T23:43:31.520 INFO:teuthology.orchestra.run.smithi088.stdout: "squid" 2024-04-26T23:43:31.520 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:43:31.520 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:43:31.520 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2024-04-26T23:43:31.520 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2024-04-26T23:43:31.520 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2024-04-26T23:43:31.521 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2024-04-26T23:43:31.521 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2024-04-26T23:43:31.521 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "555255e9-7ef9-4454-8dc9-35e96b70035c", 2024-04-26T23:43:31.521 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2024-04-26T23:39:34.291658Z", 2024-04-26T23:43:31.521 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2024-04-26T23:39:34.291658Z", 2024-04-26T23:43:31.521 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 19, 2024-04-26T23:43:31.521 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "squid", 2024-04-26T23:43:31.521 INFO:teuthology.orchestra.run.smithi088.stdout: "election_strategy": 1, 2024-04-26T23:43:31.521 INFO:teuthology.orchestra.run.smithi088.stdout: "disallowed_leaders: ": "", 2024-04-26T23:43:31.521 INFO:teuthology.orchestra.run.smithi088.stdout: "stretch_mode": false, 2024-04-26T23:43:31.521 INFO:teuthology.orchestra.run.smithi088.stdout: "tiebreaker_mon": "", 2024-04-26T23:43:31.521 INFO:teuthology.orchestra.run.smithi088.stdout: "removed_ranks: ": "", 2024-04-26T23:43:31.521 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2024-04-26T23:43:31.521 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2024-04-26T23:43:31.522 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-04-26T23:43:31.522 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-04-26T23:43:31.522 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-04-26T23:43:31.522 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-04-26T23:43:31.522 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-04-26T23:43:31.522 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-04-26T23:43:31.522 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-04-26T23:43:31.522 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-04-26T23:43:31.522 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-04-26T23:43:31.522 INFO:teuthology.orchestra.run.smithi088.stdout: "reef", 2024-04-26T23:43:31.522 INFO:teuthology.orchestra.run.smithi088.stdout: "squid" 2024-04-26T23:43:31.522 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:43:31.522 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2024-04-26T23:43:31.523 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:43:31.523 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2024-04-26T23:43:31.523 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:43:31.523 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2024-04-26T23:43:31.523 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2024-04-26T23:43:31.523 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-04-26T23:43:31.523 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-04-26T23:43:31.523 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:43:31.524 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-04-26T23:43:31.524 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2024-04-26T23:43:31.524 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:43:31.524 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:43:31.524 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:43:31.524 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-04-26T23:43:31.524 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2024-04-26T23:43:31.524 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:43:31.524 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:43:31.524 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:43:31.524 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:43:31.524 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2024-04-26T23:43:31.524 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2024-04-26T23:43:31.524 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-04-26T23:43:31.525 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-04-26T23:43:31.525 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-04-26T23:43:31.525 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:43:31.525 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:43:31.525 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2024-04-26T23:43:31.525 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2024-04-26T23:43:31.525 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-04-26T23:43:31.525 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-04-26T23:43:31.525 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:43:31.525 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-04-26T23:43:31.525 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:3300", 2024-04-26T23:43:31.525 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:43:31.525 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:43:31.526 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:43:31.526 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-04-26T23:43:31.526 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6789", 2024-04-26T23:43:31.526 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:43:31.526 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:43:31.526 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:43:31.526 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:43:31.526 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6789/0", 2024-04-26T23:43:31.526 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.175:6789/0", 2024-04-26T23:43:31.526 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-04-26T23:43:31.526 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-04-26T23:43:31.526 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-04-26T23:43:31.526 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:43:31.527 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:43:31.527 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2024-04-26T23:43:31.527 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2024-04-26T23:43:31.527 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-04-26T23:43:31.527 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-04-26T23:43:31.527 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:43:31.527 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-04-26T23:43:31.527 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:3301", 2024-04-26T23:43:31.527 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:43:31.527 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:43:31.527 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:43:31.527 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-04-26T23:43:31.527 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6790", 2024-04-26T23:43:31.527 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:43:31.527 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:43:31.528 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:43:31.528 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:43:31.528 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6790/0", 2024-04-26T23:43:31.528 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.175:6790/0", 2024-04-26T23:43:31.528 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-04-26T23:43:31.528 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-04-26T23:43:31.528 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-04-26T23:43:31.528 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:43:31.528 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:43:31.528 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:43:31.528 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2024-04-26T23:43:31.529 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2024-04-26T23:43:31.529 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:43:31.529 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:43:31.529 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:43:31.529 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2024-04-26T23:43:31.529 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:43:31.529 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:43:31.529 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": [ 2024-04-26T23:43:31.529 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:43:31.529 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:43:31.529 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:43:31.529 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 4 2024-04-26T23:43:31.529 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:43:31.530 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:43:31.530 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": [ 2024-04-26T23:43:31.530 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:43:31.530 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:43:31.530 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:43:31.530 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 5 2024-04-26T23:43:31.530 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:43:31.530 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:43:31.531 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2024-04-26T23:43:31.531 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:43:31.531 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:43:31.531 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:43:31.531 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 4 2024-04-26T23:43:31.531 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:43:31.531 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:43:31.531 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": [ 2024-04-26T23:43:31.532 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:43:31.532 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:43:31.532 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:43:31.532 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2024-04-26T23:43:31.532 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:43:31.533 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:43:31.533 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:43:31.533 INFO:teuthology.orchestra.run.smithi088.stdout: "stretch_mode": false 2024-04-26T23:43:31.533 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-04-26T23:43:31.535 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:31.515+0000 7ff2857fa640 1 -- 172.21.15.88:0/3590689441 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7ff27006c820 msgr2=0x7ff27006ece0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:31.535 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:31.515+0000 7ff2857fa640 1 --2- 172.21.15.88:0/3590689441 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7ff27006c820 0x7ff27006ece0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7ff290145fe0 tx=0x7ff278006c80 comp rx=0 tx=0).stop 2024-04-26T23:43:31.535 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:31.515+0000 7ff28f59e640 1 -- 172.21.15.88:0/3590689441 reap_dead start 2024-04-26T23:43:31.535 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:31.516+0000 7ff2857fa640 1 -- 172.21.15.88:0/3590689441 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff2900c8dc0 msgr2=0x7ff2901ebfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:31.535 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:31.516+0000 7ff2857fa640 1 --2- 172.21.15.88:0/3590689441 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff2900c8dc0 0x7ff2901ebfd0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ff288009e20 tx=0x7ff288004a40 comp rx=0 tx=0).stop 2024-04-26T23:43:31.535 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:31.516+0000 7ff2857fa640 1 -- 172.21.15.88:0/3590689441 shutdown_connections 2024-04-26T23:43:31.535 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:31.516+0000 7ff2857fa640 1 --2- 172.21.15.88:0/3590689441 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff2900c8dc0 0x7ff2901ebfd0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:31.535 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:31.516+0000 7ff2857fa640 1 -- 172.21.15.88:0/3590689441 >> 172.21.15.88:0/3590689441 conn(0x7ff2900c82d0 msgr2=0x7ff290149a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:43:31.535 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:31.517+0000 7ff2857fa640 1 -- 172.21.15.88:0/3590689441 shutdown_connections 2024-04-26T23:43:31.536 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:31.517+0000 7ff2857fa640 1 -- 172.21.15.88:0/3590689441 wait complete. 2024-04-26T23:43:31.540 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-04-26T23:43:31.540 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2024-04-26T23:43:33.301 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:43:33.304 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:43:37.354 INFO:tasks.workunit.client.0.smithi088.stdout:fs setup took 46 secs 2024-04-26T23:43:45.015 INFO:tasks.workunit.client.0.smithi088.stdout:Syncing()...7 sec 2024-04-26T23:43:45.018 INFO:tasks.workunit.client.0.smithi088.stdout:Starting Actual Benchmark At: Fri Apr 26 23:43:45 2024 2024-04-26T23:43:45.018 INFO:tasks.workunit.client.0.smithi088.stdout: 2024-04-26T23:43:51.542 INFO:tasks.mon_thrash.mon_thrasher:killing mon.c 2024-04-26T23:43:51.542 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.c 2024-04-26T23:43:51.542 INFO:tasks.ceph.mon.c:Restarting daemon 2024-04-26T23:43:51.543 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-04-26T23:43:51.548 INFO:tasks.ceph.mon.c:Started 2024-04-26T23:43:51.549 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-04-26T23:43:51.549 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-04-26T23:43:51.728 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:51.724+0000 7f3868114640 1 Processor -- start 2024-04-26T23:43:51.729 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:51.725+0000 7f3868114640 1 -- start start 2024-04-26T23:43:51.731 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:51.726+0000 7f3868114640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f38601589e0 0x7f386006d320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:51.731 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:51.726+0000 7f3868114640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f38600c4960 con 0x7f386006f300 2024-04-26T23:43:51.731 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:51.726+0000 7f3868114640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f38600c4c40 con 0x7f38600c42e0 2024-04-26T23:43:51.731 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:51.726+0000 7f3868114640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f38600c4f20 con 0x7f38601589e0 2024-04-26T23:43:51.731 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:51.727+0000 7f38666b1640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f38600c42e0 0x7f386015ee00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.88:51374/0 (socket says 172.21.15.88:51374) 2024-04-26T23:43:51.731 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:51.727+0000 7f38666b1640 1 -- 172.21.15.88:0/547612343 learned_addr learned my addr 172.21.15.88:0/547612343 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-26T23:43:51.732 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:51.728+0000 7f3864eae640 1 -- 172.21.15.88:0/547612343 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3836007565 0 0) 0x7f38600c4960 con 0x7f386006f300 2024-04-26T23:43:51.733 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:51.728+0000 7f3864eae640 1 -- 172.21.15.88:0/547612343 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f384c003520 con 0x7f386006f300 2024-04-26T23:43:51.733 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:51.728+0000 7f3864eae640 1 -- 172.21.15.88:0/547612343 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 802484054 0 0) 0x7f38600c4c40 con 0x7f38600c42e0 2024-04-26T23:43:51.734 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:51.728+0000 7f3864eae640 1 -- 172.21.15.88:0/547612343 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f38600c4960 con 0x7f38600c42e0 2024-04-26T23:43:51.734 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:51.728+0000 7f3865eb0640 1 --2- 172.21.15.88:0/547612343 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f38601589e0 0x7f386006d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:51.734 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:51.728+0000 7f3864eae640 1 -- 172.21.15.88:0/547612343 <== mon.1 v1:172.21.15.175:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3096971388 0 0) 0x7f38600c4960 con 0x7f38600c42e0 2024-04-26T23:43:51.734 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:51.728+0000 7f3864eae640 1 -- 172.21.15.88:0/547612343 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f38601589e0 msgr2=0x7f386006d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:43:51.734 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:51.728+0000 7f3864eae640 1 --2- 172.21.15.88:0/547612343 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f38601589e0 0x7f386006d320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:51.734 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:51.728+0000 7f3864eae640 1 -- 172.21.15.88:0/547612343 >> v1:172.21.15.88:6789/0 conn(0x7f386006f300 legacy=0x7f386015e6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:51.734 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:51.728+0000 7f3864eae640 1 -- 172.21.15.88:0/547612343 --> v1:172.21.15.175:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f386006d860 con 0x7f38600c42e0 2024-04-26T23:43:51.734 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:51.728+0000 7f3864eae640 1 -- 172.21.15.88:0/547612343 <== mon.1 v1:172.21.15.175:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 356324787 0 0) 0x7f38580019f0 con 0x7f38600c42e0 2024-04-26T23:43:51.734 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:51.728+0000 7f3864eae640 1 -- 172.21.15.88:0/547612343 >> v1:172.21.15.175:6789/0 conn(0x7f38600c42e0 legacy=0x7f386015ee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:51.734 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:51.728+0000 7f3864eae640 1 --2- 172.21.15.88:0/547612343 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f384c004bd0 0x7f384c004fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:51.734 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:51.729+0000 7f3864eae640 1 --2- 172.21.15.88:0/547612343 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f384c0037a0 0x7f384c003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:51.734 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:51.729+0000 7f3864eae640 1 --2- 172.21.15.88:0/547612343 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f38601589e0 0x7f384c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:51.734 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:51.729+0000 7f3864eae640 1 -- 172.21.15.88:0/547612343 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f38600c4f20 con 0x7f384c004bd0 2024-04-26T23:43:51.734 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:51.729+0000 7f3864eae640 1 -- 172.21.15.88:0/547612343 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f384c0044c0 con 0x7f384c0037a0 2024-04-26T23:43:51.735 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:51.729+0000 7f3864eae640 1 -- 172.21.15.88:0/547612343 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f384c00bf00 con 0x7f38601589e0 2024-04-26T23:43:51.735 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:51.729+0000 7f3865eb0640 1 --2- 172.21.15.88:0/547612343 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f384c004bd0 0x7f384c004fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:51.735 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:51.729+0000 7f38656af640 1 --2- 172.21.15.88:0/547612343 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f384c0037a0 0x7f384c003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:51.735 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:51.729+0000 7f38666b1640 1 --2- 172.21.15.88:0/547612343 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f38601589e0 0x7f384c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:51.736 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:51.730+0000 7f3865eb0640 1 -- 172.21.15.88:0/547612343 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f38601589e0 msgr2=0x7f384c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:43:51.736 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:51.730+0000 7f3865eb0640 1 --2- 172.21.15.88:0/547612343 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f38601589e0 0x7f384c00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:51.736 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:51.730+0000 7f3865eb0640 1 -- 172.21.15.88:0/547612343 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f384c0037a0 msgr2=0x7f384c003c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:43:51.736 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:51.730+0000 7f3865eb0640 1 --2- 172.21.15.88:0/547612343 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f384c0037a0 0x7f384c003c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:51.736 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:51.730+0000 7f3865eb0640 1 -- 172.21.15.88:0/547612343 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f386006d860 con 0x7f384c004bd0 2024-04-26T23:43:51.736 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:51.731+0000 7f3865eb0640 1 --2- 172.21.15.88:0/547612343 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f384c004bd0 0x7f384c004fb0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f385c00ba30 tx=0x7f384c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6718d5a182bd9d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:51.738 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:51.732+0000 7f3864eae640 1 -- 172.21.15.88:0/547612343 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f385c030070 con 0x7f384c004bd0 2024-04-26T23:43:51.738 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:51.732+0000 7f3864eae640 1 -- 172.21.15.88:0/547612343 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f385c02ae30 con 0x7f384c004bd0 2024-04-26T23:43:51.738 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:51.732+0000 7f3864eae640 1 -- 172.21.15.88:0/547612343 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f385c00b600 con 0x7f384c004bd0 2024-04-26T23:43:51.738 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:51.733+0000 7f3868114640 1 -- 172.21.15.88:0/547612343 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f384c004bd0 msgr2=0x7f384c004fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:51.738 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:51.733+0000 7f3868114640 1 --2- 172.21.15.88:0/547612343 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f384c004bd0 0x7f384c004fb0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f385c00ba30 tx=0x7f384c005830 comp rx=0 tx=0).stop 2024-04-26T23:43:51.738 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:51.733+0000 7f38666b1640 1 -- 172.21.15.88:0/547612343 reap_dead start 2024-04-26T23:43:51.739 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:51.733+0000 7f3868114640 1 -- 172.21.15.88:0/547612343 shutdown_connections 2024-04-26T23:43:51.739 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:51.733+0000 7f3868114640 1 -- 172.21.15.88:0/547612343 >> 172.21.15.88:0/547612343 conn(0x7f38600c5ce0 msgr2=0x7f38600c60c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:43:51.739 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:51.733+0000 7f3868114640 1 -- 172.21.15.88:0/547612343 shutdown_connections 2024-04-26T23:43:51.739 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:51.733+0000 7f3868114640 1 -- 172.21.15.88:0/547612343 wait complete. 2024-04-26T23:43:51.744 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:51.735+0000 7f3868114640 1 Processor -- start 2024-04-26T23:43:51.744 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:51.735+0000 7f3868114640 1 -- start start 2024-04-26T23:43:51.744 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:51.736+0000 7f3868114640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f386015dde0 0x7f38601f9f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:51.744 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:51.736+0000 7f3868114640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f386012a5f0 0x7f38600ac180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:51.744 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:51.736+0000 7f3868114640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f386015b4d0 0x7f386015b950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:51.744 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:51.737+0000 7f3865eb0640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f386015dde0 0x7f38601f9f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:51.744 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:51.737+0000 7f3865eb0640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f386015dde0 0x7f38601f9f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:44686/0 (socket says 172.21.15.88:44686) 2024-04-26T23:43:51.744 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:51.737+0000 7f3865eb0640 1 -- 172.21.15.88:0/771550954 learned_addr learned my addr 172.21.15.88:0/771550954 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:43:51.744 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:51.737+0000 7f3868114640 1 -- 172.21.15.88:0/771550954 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f3860074710 con 0x7f386015dde0 2024-04-26T23:43:51.744 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:51.737+0000 7f3868114640 1 -- 172.21.15.88:0/771550954 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f3860074590 con 0x7f386015b4d0 2024-04-26T23:43:51.745 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:51.737+0000 7f3868114640 1 -- 172.21.15.88:0/771550954 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f3860074890 con 0x7f386012a5f0 2024-04-26T23:43:51.745 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:51.737+0000 7f38666b1640 1 --2- 172.21.15.88:0/771550954 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f386015b4d0 0x7f386015b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:51.745 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:51.738+0000 7f3865eb0640 1 -- 172.21.15.88:0/771550954 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f386012a5f0 msgr2=0x7f38600ac180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:51.745 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:51.738+0000 7f3865eb0640 1 --2- 172.21.15.88:0/771550954 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f386012a5f0 0x7f38600ac180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:51.745 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:51.738+0000 7f3865eb0640 1 -- 172.21.15.88:0/771550954 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f386015b4d0 msgr2=0x7f386015b950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:51.745 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:51.738+0000 7f3865eb0640 1 --2- 172.21.15.88:0/771550954 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f386015b4d0 0x7f386015b950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:51.745 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:51.738+0000 7f3865eb0640 1 -- 172.21.15.88:0/771550954 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38601fa450 con 0x7f386015dde0 2024-04-26T23:43:51.745 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:51.738+0000 7f3865eb0640 1 --2- 172.21.15.88:0/771550954 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f386015dde0 0x7f38601f9f10 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f385c00bb20 tx=0x7f385c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:51.745 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:51.738+0000 7f38567fc640 1 -- 172.21.15.88:0/771550954 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f385c043030 con 0x7f386015dde0 2024-04-26T23:43:51.745 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:51.738+0000 7f38567fc640 1 -- 172.21.15.88:0/771550954 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f385c02ac30 con 0x7f386015dde0 2024-04-26T23:43:51.745 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:51.738+0000 7f38567fc640 1 -- 172.21.15.88:0/771550954 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f385c043030 con 0x7f386015dde0 2024-04-26T23:43:51.745 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:51.738+0000 7f3868114640 1 -- 172.21.15.88:0/771550954 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38600ac6c0 con 0x7f386015dde0 2024-04-26T23:43:51.745 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:51.739+0000 7f3868114640 1 -- 172.21.15.88:0/771550954 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38600adab0 con 0x7f386015dde0 2024-04-26T23:43:51.749 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:51.742+0000 7f38567fc640 1 -- 172.21.15.88:0/771550954 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f385c046070 con 0x7f386015dde0 2024-04-26T23:43:51.749 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:51.743+0000 7f38567fc640 1 --2- 172.21.15.88:0/771550954 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f384406ccf0 0x7f384406f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:43:51.749 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:51.743+0000 7f38656af640 1 --2- 172.21.15.88:0/771550954 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f384406ccf0 0x7f384406f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:43:51.749 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:51.744+0000 7f38567fc640 1 -- 172.21.15.88:0/771550954 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6666+0+0 (secure 0 0 0) 0x7f385c044070 con 0x7f386015dde0 2024-04-26T23:43:51.749 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:51.744+0000 7f38656af640 1 --2- 172.21.15.88:0/771550954 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f384406ccf0 0x7f384406f1b0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f38500010e0 tx=0x7f3850009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:43:51.749 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:51.744+0000 7f3843fff640 1 -- 172.21.15.88:0/771550954 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f38600c4960 con 0x7f386015dde0 2024-04-26T23:43:51.758 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:51.754+0000 7f38567fc640 1 -- 172.21.15.88:0/771550954 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f38600c4960 con 0x7f386015dde0 2024-04-26T23:43:52.334 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:52.330+0000 7f3843fff640 1 -- 172.21.15.88:0/771550954 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f38600c39c0 con 0x7f386015dde0 2024-04-26T23:43:56.956 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:56.952+0000 7f38567fc640 1 -- 172.21.15.88:0/771550954 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1558 (secure 0 0 0) 0x7f38600c4960 con 0x7f386015dde0 2024-04-26T23:43:56.957 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":30,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"555255e9-7ef9-4454-8dc9-35e96b70035c","modified":"2024-04-26T23:39:34.291658Z","created":"2024-04-26T23:39:34.291658Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:3300","nonce":0},{"type":"v1","addr":"172.21.15.175:6789","nonce":0}]},"addr":"172.21.15.175:6789/0","public_addr":"172.21.15.175:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:3301","nonce":0},{"type":"v1","addr":"172.21.15.175:6790","nonce":0}]},"addr":"172.21.15.175:6790/0","public_addr":"172.21.15.175:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-04-26T23:43:56.964 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:56.960+0000 7f3843fff640 1 -- 172.21.15.88:0/771550954 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f384406ccf0 msgr2=0x7f384406f1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:56.964 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:56.960+0000 7f3843fff640 1 --2- 172.21.15.88:0/771550954 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f384406ccf0 0x7f384406f1b0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f38500010e0 tx=0x7f3850009040 comp rx=0 tx=0).stop 2024-04-26T23:43:56.965 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:56.960+0000 7f3843fff640 1 -- 172.21.15.88:0/771550954 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f386015dde0 msgr2=0x7f38601f9f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:43:56.965 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:56.960+0000 7f3843fff640 1 --2- 172.21.15.88:0/771550954 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f386015dde0 0x7f38601f9f10 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f385c00bb20 tx=0x7f385c004730 comp rx=0 tx=0).stop 2024-04-26T23:43:56.965 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:56.960+0000 7f3843fff640 1 -- 172.21.15.88:0/771550954 shutdown_connections 2024-04-26T23:43:56.965 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:56.960+0000 7f3843fff640 1 --2- 172.21.15.88:0/771550954 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f384406ccf0 0x7f384406f1b0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:56.965 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:56.960+0000 7f3843fff640 1 --2- 172.21.15.88:0/771550954 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f386012a5f0 0x7f38600ac180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:56.965 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:56.960+0000 7f3843fff640 1 --2- 172.21.15.88:0/771550954 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f386015b4d0 0x7f386015b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:56.965 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:56.960+0000 7f3843fff640 1 --2- 172.21.15.88:0/771550954 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f386015dde0 0x7f38601f9f10 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:43:56.965 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:56.960+0000 7f3843fff640 1 -- 172.21.15.88:0/771550954 >> 172.21.15.88:0/771550954 conn(0x7f38600c5ce0 msgr2=0x7f38600c60c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:43:56.965 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:56.961+0000 7f3843fff640 1 -- 172.21.15.88:0/771550954 shutdown_connections 2024-04-26T23:43:56.965 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:43:56.961+0000 7f3843fff640 1 -- 172.21.15.88:0/771550954 wait complete. 2024-04-26T23:43:59.986 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-04-26T23:44:00.183 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:00.178+0000 7fca1b59e640 1 Processor -- start 2024-04-26T23:44:00.183 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:00.178+0000 7fca1b59e640 1 -- start start 2024-04-26T23:44:00.185 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:00.180+0000 7fca1b59e640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fca140484a0 0x7fca140474d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:00.185 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:00.180+0000 7fca1b59e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fca14006640 0x7fca140e2700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:00.185 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:00.180+0000 7fca1b59e640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fca140df7d0 con 0x7fca1403f030 2024-04-26T23:44:00.185 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:00.180+0000 7fca1b59e640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7fca140dc2e0 con 0x7fca140484a0 2024-04-26T23:44:00.185 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:00.180+0000 7fca1b59e640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fca140df2a0 con 0x7fca14006640 2024-04-26T23:44:00.185 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:00.180+0000 7fca1a59c640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fca140484a0 0x7fca140474d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:00.185 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:00.180+0000 7fca19d9b640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fca14006640 0x7fca140e2700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:00.186 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:00.180+0000 7fca1a59c640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fca140484a0 0x7fca140474d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:57954/0 (socket says 172.21.15.88:57954) 2024-04-26T23:44:00.186 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:00.180+0000 7fca19d9b640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fca14006640 0x7fca140e2700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.88:56302/0 (socket says 172.21.15.88:56302) 2024-04-26T23:44:00.186 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:00.180+0000 7fca1a59c640 1 -- 172.21.15.88:0/4026688986 learned_addr learned my addr 172.21.15.88:0/4026688986 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:44:00.186 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:00.180+0000 7fca1a59c640 1 -- 172.21.15.88:0/4026688986 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fca14006640 msgr2=0x7fca140e2700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:44:00.186 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:00.180+0000 7fca1a59c640 1 --2- 172.21.15.88:0/4026688986 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fca14006640 0x7fca140e2700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:00.186 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:00.180+0000 7fca1a59c640 1 -- 172.21.15.88:0/4026688986 >> v1:172.21.15.88:6789/0 conn(0x7fca1403f030 legacy=0x7fca14007ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:00.186 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:00.180+0000 7fca1a59c640 1 -- 172.21.15.88:0/4026688986 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca140e1f40 con 0x7fca140484a0 2024-04-26T23:44:00.188 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:00.182+0000 7fca1a59c640 1 --2- 172.21.15.88:0/4026688986 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fca140484a0 0x7fca140474d0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fca0c009870 tx=0x7fca0c02a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1493f57ca964023f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:00.188 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:00.182+0000 7fca1959a640 1 -- 172.21.15.88:0/4026688986 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca0c037070 con 0x7fca140484a0 2024-04-26T23:44:00.188 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:00.182+0000 7fca1959a640 1 -- 172.21.15.88:0/4026688986 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca0c032440 con 0x7fca140484a0 2024-04-26T23:44:00.188 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:00.182+0000 7fca1959a640 1 -- 172.21.15.88:0/4026688986 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca0c032810 con 0x7fca140484a0 2024-04-26T23:44:00.188 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:00.183+0000 7fca1b59e640 1 -- 172.21.15.88:0/4026688986 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fca140484a0 msgr2=0x7fca140474d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:00.188 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:00.183+0000 7fca1b59e640 1 --2- 172.21.15.88:0/4026688986 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fca140484a0 0x7fca140474d0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fca0c009870 tx=0x7fca0c02a140 comp rx=0 tx=0).stop 2024-04-26T23:44:00.188 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:00.183+0000 7fca1b59e640 1 -- 172.21.15.88:0/4026688986 shutdown_connections 2024-04-26T23:44:00.188 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:00.183+0000 7fca1b59e640 1 --2- 172.21.15.88:0/4026688986 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fca14006640 0x7fca140e2700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:00.188 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:00.183+0000 7fca1b59e640 1 --2- 172.21.15.88:0/4026688986 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fca140484a0 0x7fca140474d0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:00.189 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:00.183+0000 7fca1b59e640 1 -- 172.21.15.88:0/4026688986 >> 172.21.15.88:0/4026688986 conn(0x7fca1402db90 msgr2=0x7fca1402df70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:44:00.189 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:00.184+0000 7fca1b59e640 1 -- 172.21.15.88:0/4026688986 shutdown_connections 2024-04-26T23:44:00.189 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:00.184+0000 7fca1b59e640 1 -- 172.21.15.88:0/4026688986 wait complete. 2024-04-26T23:44:00.190 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:00.185+0000 7fca1b59e640 1 Processor -- start 2024-04-26T23:44:00.190 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:00.186+0000 7fca1b59e640 1 -- start start 2024-04-26T23:44:00.191 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:00.186+0000 7fca1b59e640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fca14006640 0x7fca140454a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:00.191 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:00.186+0000 7fca1b59e640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fca1403f030 0x7fca140daf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:00.191 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:00.186+0000 7fca1b59e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fca140484a0 0x7fca14174540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:00.191 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:00.186+0000 7fca1b59e640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fca140e21e0 con 0x7fca14006640 2024-04-26T23:44:00.191 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:00.186+0000 7fca1b59e640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fca14047a10 con 0x7fca1403f030 2024-04-26T23:44:00.191 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:00.186+0000 7fca1b59e640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fca140081f0 con 0x7fca140484a0 2024-04-26T23:44:00.191 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:00.187+0000 7fca1a59c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fca14006640 0x7fca140454a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:00.191 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:00.187+0000 7fca1a59c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fca14006640 0x7fca140454a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:57958/0 (socket says 172.21.15.88:57958) 2024-04-26T23:44:00.191 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:00.187+0000 7fca1a59c640 1 -- 172.21.15.88:0/2864878697 learned_addr learned my addr 172.21.15.88:0/2864878697 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:44:00.192 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:00.187+0000 7fca19d9b640 1 --2- 172.21.15.88:0/2864878697 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fca1403f030 0x7fca140daf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:00.192 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:00.187+0000 7fca1a59c640 1 -- 172.21.15.88:0/2864878697 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fca140484a0 msgr2=0x7fca14174540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:00.192 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:00.187+0000 7fca1a59c640 1 --2- 172.21.15.88:0/2864878697 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fca140484a0 0x7fca14174540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:00.193 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:00.187+0000 7fca1a59c640 1 -- 172.21.15.88:0/2864878697 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fca1403f030 msgr2=0x7fca140daf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:00.193 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:00.187+0000 7fca1a59c640 1 --2- 172.21.15.88:0/2864878697 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fca1403f030 0x7fca140daf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:00.193 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:00.187+0000 7fca1a59c640 1 -- 172.21.15.88:0/2864878697 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca141784c0 con 0x7fca14006640 2024-04-26T23:44:00.193 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:00.187+0000 7fca19d9b640 1 --2- 172.21.15.88:0/2864878697 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fca1403f030 0x7fca140daf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:44:00.193 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:00.187+0000 7fca1a59c640 1 --2- 172.21.15.88:0/2864878697 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fca14006640 0x7fca140454a0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fca0c000c00 tx=0x7fca0c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:00.193 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:00.188+0000 7fca0affd640 1 -- 172.21.15.88:0/2864878697 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca0c041020 con 0x7fca14006640 2024-04-26T23:44:00.193 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:00.188+0000 7fca1b59e640 1 -- 172.21.15.88:0/2864878697 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca14045c50 con 0x7fca14006640 2024-04-26T23:44:00.193 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:00.188+0000 7fca0affd640 1 -- 172.21.15.88:0/2864878697 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca0c0306c0 con 0x7fca14006640 2024-04-26T23:44:00.193 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:00.188+0000 7fca1b59e640 1 -- 172.21.15.88:0/2864878697 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca14178760 con 0x7fca14006640 2024-04-26T23:44:00.194 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:00.188+0000 7fca0affd640 1 -- 172.21.15.88:0/2864878697 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca0c037040 con 0x7fca14006640 2024-04-26T23:44:00.194 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:00.189+0000 7fca1b59e640 1 -- 172.21.15.88:0/2864878697 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fca140057e0 con 0x7fca14006640 2024-04-26T23:44:00.195 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:00.191+0000 7fca0affd640 1 -- 172.21.15.88:0/2864878697 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fca0c044020 con 0x7fca14006640 2024-04-26T23:44:00.196 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:00.191+0000 7fca0affd640 1 --2- 172.21.15.88:0/2864878697 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fc9fc06c8f0 0x7fc9fc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:00.196 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:00.192+0000 7fca0affd640 1 -- 172.21.15.88:0/2864878697 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6666+0+0 (secure 0 0 0) 0x7fca0c0ac520 con 0x7fca14006640 2024-04-26T23:44:00.196 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:00.192+0000 7fca19d9b640 1 --2- 172.21.15.88:0/2864878697 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fc9fc06c8f0 0x7fc9fc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:00.197 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:00.192+0000 7fca19d9b640 1 --2- 172.21.15.88:0/2864878697 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fc9fc06c8f0 0x7fc9fc06edb0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fca1c069b60 tx=0x7fca1c076870 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:00.203 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:00.199+0000 7fca0affd640 1 -- 172.21.15.88:0/2864878697 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fca0c04b030 con 0x7fca14006640 2024-04-26T23:44:00.704 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:00.699+0000 7fca1b59e640 1 -- 172.21.15.88:0/2864878697 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fca14031fe0 con 0x7fca14006640 2024-04-26T23:44:00.705 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":32,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":2,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"555255e9-7ef9-4454-8dc9-35e96b70035c","modified":"2024-04-26T23:39:34.291658Z","created":"2024-04-26T23:39:34.291658Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:3300","nonce":0},{"type":"v1","addr":"172.21.15.175:6789","nonce":0}]},"addr":"172.21.15.175:6789/0","public_addr":"172.21.15.175:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:3301","nonce":0},{"type":"v1","addr":"172.21.15.175:6790","nonce":0}]},"addr":"172.21.15.175:6790/0","public_addr":"172.21.15.175:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-04-26T23:44:00.705 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:00.701+0000 7fca0affd640 1 -- 172.21.15.88:0/2864878697 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1564 (secure 0 0 0) 0x7fca0c07a500 con 0x7fca14006640 2024-04-26T23:44:00.708 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:00.704+0000 7fca1b59e640 1 -- 172.21.15.88:0/2864878697 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fc9fc06c8f0 msgr2=0x7fc9fc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:00.708 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:00.704+0000 7fca1b59e640 1 --2- 172.21.15.88:0/2864878697 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fc9fc06c8f0 0x7fc9fc06edb0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fca1c069b60 tx=0x7fca1c076870 comp rx=0 tx=0).stop 2024-04-26T23:44:00.708 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:00.704+0000 7fca1b59e640 1 -- 172.21.15.88:0/2864878697 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fca14006640 msgr2=0x7fca140454a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:00.708 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:00.704+0000 7fca1b59e640 1 --2- 172.21.15.88:0/2864878697 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fca14006640 0x7fca140454a0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fca0c000c00 tx=0x7fca0c0046c0 comp rx=0 tx=0).stop 2024-04-26T23:44:00.708 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:00.704+0000 7fca1b59e640 1 -- 172.21.15.88:0/2864878697 shutdown_connections 2024-04-26T23:44:00.708 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:00.704+0000 7fca1b59e640 1 --2- 172.21.15.88:0/2864878697 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fc9fc06c8f0 0x7fc9fc06edb0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:00.709 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:00.704+0000 7fca1b59e640 1 --2- 172.21.15.88:0/2864878697 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fca140484a0 0x7fca14174540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:00.709 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:00.704+0000 7fca1b59e640 1 --2- 172.21.15.88:0/2864878697 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fca1403f030 0x7fca140daf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:00.709 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:00.704+0000 7fca1b59e640 1 --2- 172.21.15.88:0/2864878697 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fca14006640 0x7fca140454a0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:00.709 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:00.704+0000 7fca1b59e640 1 -- 172.21.15.88:0/2864878697 >> 172.21.15.88:0/2864878697 conn(0x7fca1402db90 msgr2=0x7fca140059f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:44:00.709 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:00.705+0000 7fca1b59e640 1 -- 172.21.15.88:0/2864878697 shutdown_connections 2024-04-26T23:44:00.709 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:00.705+0000 7fca1b59e640 1 -- 172.21.15.88:0/2864878697 wait complete. 2024-04-26T23:44:00.732 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-04-26T23:44:00.732 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-04-26T23:44:00.732 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-04-26T23:44:00.931 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:00.927+0000 7fa4e6f5f640 1 Processor -- start 2024-04-26T23:44:00.931 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:00.927+0000 7fa4e6f5f640 1 -- start start 2024-04-26T23:44:00.935 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:00.928+0000 7fa4e6f5f640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa4d80d3d40 0x7fa4d8007b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:00.935 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:00.928+0000 7fa4e6f5f640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fa4d8008060 0x7fa4d800abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:00.935 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:00.928+0000 7fa4e6f5f640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4d800c390 con 0x7fa4d8049f60 2024-04-26T23:44:00.935 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:00.928+0000 7fa4e6f5f640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7fa4d8006990 con 0x7fa4d8008060 2024-04-26T23:44:00.935 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:00.928+0000 7fa4e6f5f640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fa4d80471d0 con 0x7fa4d80d3d40 2024-04-26T23:44:00.935 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:00.929+0000 7fa4e5f5d640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fa4d8049f60 0x7fa4d8006280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:53920/0 (socket says 172.21.15.88:53920) 2024-04-26T23:44:00.935 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:00.929+0000 7fa4e5f5d640 1 -- 172.21.15.88:0/1850195563 learned_addr learned my addr 172.21.15.88:0/1850195563 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-26T23:44:00.937 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:00.931+0000 7fa4e4f5b640 1 -- 172.21.15.88:0/1850195563 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 174106453 0 0) 0x7fa4d800c390 con 0x7fa4d8049f60 2024-04-26T23:44:00.937 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:00.931+0000 7fa4e4f5b640 1 -- 172.21.15.88:0/1850195563 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa4cc003520 con 0x7fa4d8049f60 2024-04-26T23:44:00.937 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:00.931+0000 7fa4e4f5b640 1 -- 172.21.15.88:0/1850195563 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2783870826 0 0) 0x7fa4cc003520 con 0x7fa4d8049f60 2024-04-26T23:44:00.938 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:00.931+0000 7fa4e4f5b640 1 -- 172.21.15.88:0/1850195563 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa4d80d3d40 msgr2=0x7fa4d8007b20 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-26T23:44:00.938 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:00.931+0000 7fa4e4f5b640 1 --2- 172.21.15.88:0/1850195563 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa4d80d3d40 0x7fa4d8007b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:00.938 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:00.931+0000 7fa4e4f5b640 1 -- 172.21.15.88:0/1850195563 >> v2:172.21.15.175:3300/0 conn(0x7fa4d8008060 msgr2=0x7fa4d800abd0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-26T23:44:00.938 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:00.931+0000 7fa4e4f5b640 1 --2- 172.21.15.88:0/1850195563 >> v2:172.21.15.175:3300/0 conn(0x7fa4d8008060 0x7fa4d800abd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:00.938 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:00.931+0000 7fa4e4f5b640 1 -- 172.21.15.88:0/1850195563 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4d80d74c0 con 0x7fa4d8049f60 2024-04-26T23:44:00.938 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:00.931+0000 7fa4e4f5b640 1 -- 172.21.15.88:0/1850195563 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 356324787 0 0) 0x7fa4d0001670 con 0x7fa4d8049f60 2024-04-26T23:44:00.938 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:00.931+0000 7fa4e4f5b640 1 -- 172.21.15.88:0/1850195563 >> v1:172.21.15.88:6789/0 conn(0x7fa4d8049f60 legacy=0x7fa4d8006280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:00.938 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:00.931+0000 7fa4e4f5b640 1 --2- 172.21.15.88:0/1850195563 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa4cc0039b0 0x7fa4cc003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:00.938 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:00.931+0000 7fa4e4f5b640 1 --2- 172.21.15.88:0/1850195563 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa4cc004800 0x7fa4cc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:00.938 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:00.931+0000 7fa4e4f5b640 1 --2- 172.21.15.88:0/1850195563 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa4cc0052e0 0x7fa4cc00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:00.938 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:00.931+0000 7fa4e4f5b640 1 -- 172.21.15.88:0/1850195563 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fa4d8006990 con 0x7fa4cc0039b0 2024-04-26T23:44:00.938 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:00.931+0000 7fa4e4f5b640 1 -- 172.21.15.88:0/1850195563 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fa4d80471d0 con 0x7fa4cc004800 2024-04-26T23:44:00.938 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:00.931+0000 7fa4e4f5b640 1 -- 172.21.15.88:0/1850195563 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fa4cc00c1c0 con 0x7fa4cc0052e0 2024-04-26T23:44:00.939 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:00.932+0000 7fa4e675e640 1 --2- 172.21.15.88:0/1850195563 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa4cc0052e0 0x7fa4cc00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:00.939 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:00.933+0000 7fa4e5f5d640 1 --2- 172.21.15.88:0/1850195563 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa4cc0039b0 0x7fa4cc003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:00.939 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:00.933+0000 7fa4e5f5d640 1 -- 172.21.15.88:0/1850195563 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa4cc0052e0 msgr2=0x7fa4cc00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:44:00.939 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:00.933+0000 7fa4e5f5d640 1 --2- 172.21.15.88:0/1850195563 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa4cc0052e0 0x7fa4cc00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:00.939 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:00.933+0000 7fa4e5f5d640 1 -- 172.21.15.88:0/1850195563 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa4cc004800 msgr2=0x7fa4cc004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:44:00.940 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:00.933+0000 7fa4e5f5d640 1 --2- 172.21.15.88:0/1850195563 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa4cc004800 0x7fa4cc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:00.940 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:00.933+0000 7fa4e5f5d640 1 -- 172.21.15.88:0/1850195563 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4d80d74c0 con 0x7fa4cc0039b0 2024-04-26T23:44:00.940 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:00.936+0000 7fa4e5f5d640 1 --2- 172.21.15.88:0/1850195563 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa4cc0039b0 0x7fa4cc003dd0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fa4d000c5a0 tx=0x7fa4cc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24670dc2c1d52a5c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:00.941 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:00.937+0000 7fa4e4f5b640 1 -- 172.21.15.88:0/1850195563 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4d0031070 con 0x7fa4cc0039b0 2024-04-26T23:44:00.942 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:00.937+0000 7fa4e4f5b640 1 -- 172.21.15.88:0/1850195563 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4d0005ad0 con 0x7fa4cc0039b0 2024-04-26T23:44:00.942 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:00.938+0000 7fa4e6f5f640 1 -- 172.21.15.88:0/1850195563 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa4cc0039b0 msgr2=0x7fa4cc003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:00.942 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:00.938+0000 7fa4e4f5b640 1 -- 172.21.15.88:0/1850195563 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4d0031070 con 0x7fa4cc0039b0 2024-04-26T23:44:00.942 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:00.938+0000 7fa4e6f5f640 1 --2- 172.21.15.88:0/1850195563 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa4cc0039b0 0x7fa4cc003dd0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fa4d000c5a0 tx=0x7fa4cc005830 comp rx=0 tx=0).stop 2024-04-26T23:44:00.945 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:00.940+0000 7fa4e675e640 1 -- 172.21.15.88:0/1850195563 reap_dead start 2024-04-26T23:44:00.945 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:00.940+0000 7fa4e6f5f640 1 -- 172.21.15.88:0/1850195563 shutdown_connections 2024-04-26T23:44:00.946 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:00.940+0000 7fa4e6f5f640 1 -- 172.21.15.88:0/1850195563 >> 172.21.15.88:0/1850195563 conn(0x7fa4d802db90 msgr2=0x7fa4d802df70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:44:00.946 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:00.940+0000 7fa4e6f5f640 1 -- 172.21.15.88:0/1850195563 shutdown_connections 2024-04-26T23:44:00.946 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:00.940+0000 7fa4e6f5f640 1 -- 172.21.15.88:0/1850195563 wait complete. 2024-04-26T23:44:00.946 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:00.942+0000 7fa4e6f5f640 1 Processor -- start 2024-04-26T23:44:00.948 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:00.942+0000 7fa4e6f5f640 1 -- start start 2024-04-26T23:44:00.948 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:00.943+0000 7fa4e6f5f640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa4d802d250 0x7fa4d80cffb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:00.948 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:00.943+0000 7fa4e6f5f640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa4d8043ab0 0x7fa4d80d04f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:00.948 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:00.943+0000 7fa4e6f5f640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa4d80d0a30 0x7fa4d803e080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:00.948 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:00.943+0000 7fa4e6f5f640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fa4d8046e60 con 0x7fa4d8043ab0 2024-04-26T23:44:00.948 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:00.943+0000 7fa4e6f5f640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fa4d80d41a0 con 0x7fa4d802d250 2024-04-26T23:44:00.948 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:00.943+0000 7fa4e6f5f640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fa4d80d7190 con 0x7fa4d80d0a30 2024-04-26T23:44:00.950 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:00.944+0000 7fa4e5f5d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa4d802d250 0x7fa4d80cffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:00.950 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:00.944+0000 7fa4e575c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa4d8043ab0 0x7fa4d80d04f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:00.950 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:00.944+0000 7fa4e5f5d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa4d802d250 0x7fa4d80cffb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.88:41606/0 (socket says 172.21.15.88:41606) 2024-04-26T23:44:00.950 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:00.944+0000 7fa4e5f5d640 1 -- 172.21.15.88:0/510284929 learned_addr learned my addr 172.21.15.88:0/510284929 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:44:00.950 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:00.944+0000 7fa4e575c640 1 -- 172.21.15.88:0/510284929 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa4d80d0a30 msgr2=0x7fa4d803e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:00.950 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:00.944+0000 7fa4e575c640 1 --2- 172.21.15.88:0/510284929 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa4d80d0a30 0x7fa4d803e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:00.950 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:00.944+0000 7fa4e575c640 1 -- 172.21.15.88:0/510284929 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa4d802d250 msgr2=0x7fa4d80cffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:00.950 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:00.944+0000 7fa4e575c640 1 --2- 172.21.15.88:0/510284929 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa4d802d250 0x7fa4d80cffb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:00.950 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:00.944+0000 7fa4e575c640 1 -- 172.21.15.88:0/510284929 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4d8044270 con 0x7fa4d8043ab0 2024-04-26T23:44:00.950 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:00.945+0000 7fa4e575c640 1 --2- 172.21.15.88:0/510284929 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa4d8043ab0 0x7fa4d80d04f0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fa4dc00b540 tx=0x7fa4dc00ba00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:00.950 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:00.946+0000 7fa4d67fc640 1 -- 172.21.15.88:0/510284929 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4dc014070 con 0x7fa4d8043ab0 2024-04-26T23:44:00.951 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:00.946+0000 7fa4d67fc640 1 -- 172.21.15.88:0/510284929 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4dc0106c0 con 0x7fa4d8043ab0 2024-04-26T23:44:00.951 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:00.946+0000 7fa4d67fc640 1 -- 172.21.15.88:0/510284929 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4dc010ab0 con 0x7fa4d8043ab0 2024-04-26T23:44:00.951 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:00.946+0000 7fa4e6f5f640 1 -- 172.21.15.88:0/510284929 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4d8043f40 con 0x7fa4d8043ab0 2024-04-26T23:44:00.952 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:00.946+0000 7fa4e6f5f640 1 -- 172.21.15.88:0/510284929 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4d8044810 con 0x7fa4d8043ab0 2024-04-26T23:44:00.953 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:00.949+0000 7fa4e6f5f640 1 --2- 172.21.15.88:0/510284929 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa4d802d630 0x7fa4d803e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:00.953 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:00.949+0000 7fa4e6f5f640 1 -- 172.21.15.88:0/510284929 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fa4d8044bb0 con 0x7fa4d802d630 2024-04-26T23:44:00.953 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:00.949+0000 7fa4e5f5d640 1 --2- 172.21.15.88:0/510284929 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa4d802d630 0x7fa4d803e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:00.956 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:00.951+0000 7fa4e5f5d640 1 -- 172.21.15.88:0/510284929 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa4d80057e0 con 0x7fa4d802d630 2024-04-26T23:44:00.956 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:00.951+0000 7fa4e5f5d640 1 --2- 172.21.15.88:0/510284929 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa4d802d630 0x7fa4d803e5c0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fa4d000c5a0 tx=0x7fa4d0000fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:00.956 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:00.952+0000 7fa4d67fc640 1 -- 172.21.15.88:0/510284929 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa4dc017070 con 0x7fa4d8043ab0 2024-04-26T23:44:00.956 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:00.952+0000 7fa4d67fc640 1 --2- 172.21.15.88:0/510284929 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fa4c406c920 0x7fa4c406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:00.957 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:00.953+0000 7fa4d67fc640 1 -- 172.21.15.88:0/510284929 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4d0031040 con 0x7fa4d802d630 2024-04-26T23:44:00.957 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:00.953+0000 7fa4d67fc640 1 -- 172.21.15.88:0/510284929 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6666+0+0 (secure 0 0 0) 0x7fa4dc08bbc0 con 0x7fa4d8043ab0 2024-04-26T23:44:00.962 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:00.953+0000 7fa4d67fc640 1 -- 172.21.15.88:0/510284929 <== mon.0 v2:172.21.15.88:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fa4d0007270 con 0x7fa4d802d630 2024-04-26T23:44:00.962 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:00.953+0000 7fa4d67fc640 1 -- 172.21.15.88:0/510284929 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa4d802d630 msgr2=0x7fa4d803e5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:00.962 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:00.953+0000 7fa4d67fc640 1 --2- 172.21.15.88:0/510284929 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa4d802d630 0x7fa4d803e5c0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fa4d000c5a0 tx=0x7fa4d0000fe0 comp rx=0 tx=0).stop 2024-04-26T23:44:00.962 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:00.953+0000 7fa4d67fc640 1 -- 172.21.15.88:0/510284929 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa4d802d630 msgr2=0x7fa4d803e5c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:44:00.962 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:00.953+0000 7fa4d67fc640 1 --2- 172.21.15.88:0/510284929 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa4d802d630 0x7fa4d803e5c0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:00.964 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:00.960+0000 7fa4e675e640 1 --2- 172.21.15.88:0/510284929 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fa4c406c920 0x7fa4c406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:00.971 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:00.967+0000 7fa4e675e640 1 --2- 172.21.15.88:0/510284929 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fa4c406c920 0x7fa4c406ede0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fa4e0051470 tx=0x7fa4e006bca0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:00.975 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:00.969+0000 7fa4e6f5f640 1 --2- 172.21.15.88:0/510284929 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa4d80d2060 0x7fa4d803eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:00.975 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:00.969+0000 7fa4e6f5f640 1 -- 172.21.15.88:0/510284929 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fa4d80cfd10 con 0x7fa4d80d2060 2024-04-26T23:44:00.975 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:00.969+0000 7fa4e5f5d640 1 --2- 172.21.15.88:0/510284929 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa4d80d2060 0x7fa4d803eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:00.975 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:00.970+0000 7fa4e5f5d640 1 -- 172.21.15.88:0/510284929 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fa4d8046390 con 0x7fa4d80d2060 2024-04-26T23:44:00.976 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:00.970+0000 7fa4e5f5d640 1 --2- 172.21.15.88:0/510284929 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa4d80d2060 0x7fa4d803eb00 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fa4d0000c00 tx=0x7fa4d002e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:00.976 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:00.972+0000 7fa4d67fc640 1 -- 172.21.15.88:0/510284929 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4d0047040 con 0x7fa4d80d2060 2024-04-26T23:44:00.977 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:00.973+0000 7fa4d67fc640 1 -- 172.21.15.88:0/510284929 <== mon.0 v2:172.21.15.88:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4870 (secure 0 0 0) 0x7fa4d0036450 con 0x7fa4d80d2060 2024-04-26T23:44:00.977 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:00.973+0000 7fa4d67fc640 1 -- 172.21.15.88:0/510284929 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa4d80d2060 msgr2=0x7fa4d803eb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:00.977 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:00.973+0000 7fa4d67fc640 1 --2- 172.21.15.88:0/510284929 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa4d80d2060 0x7fa4d803eb00 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fa4d0000c00 tx=0x7fa4d002e000 comp rx=0 tx=0).stop 2024-04-26T23:44:00.977 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:00.973+0000 7fa4d67fc640 1 -- 172.21.15.88:0/510284929 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa4d80d2060 msgr2=0x7fa4d803eb00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:44:00.977 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:00.973+0000 7fa4d67fc640 1 --2- 172.21.15.88:0/510284929 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa4d80d2060 0x7fa4d803eb00 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:00.977 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-04-26T23:44:00.978 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2024-04-26T23:44:00.978 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2024-04-26T23:44:00.978 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "leader", 2024-04-26T23:44:00.978 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 32, 2024-04-26T23:44:00.978 INFO:teuthology.orchestra.run.smithi088.stdout: "uptime": 129945, 2024-04-26T23:44:00.978 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2024-04-26T23:44:00.978 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2024-04-26T23:44:00.978 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2024-04-26T23:44:00.978 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2024-04-26T23:44:00.978 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:44:00.978 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 3, 2024-04-26T23:44:00.978 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2024-04-26T23:44:00.978 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2450521708007866372", 2024-04-26T23:44:00.979 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2024-04-26T23:44:00.979 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-04-26T23:44:00.979 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-04-26T23:44:00.979 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-04-26T23:44:00.979 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-04-26T23:44:00.979 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-04-26T23:44:00.979 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-04-26T23:44:00.979 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-04-26T23:44:00.979 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-04-26T23:44:00.979 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-04-26T23:44:00.979 INFO:teuthology.orchestra.run.smithi088.stdout: "reef", 2024-04-26T23:44:00.979 INFO:teuthology.orchestra.run.smithi088.stdout: "squid" 2024-04-26T23:44:00.979 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:44:00.979 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540701547738038271", 2024-04-26T23:44:00.979 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2024-04-26T23:44:00.979 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-04-26T23:44:00.980 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-04-26T23:44:00.980 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-04-26T23:44:00.980 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-04-26T23:44:00.980 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-04-26T23:44:00.980 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-04-26T23:44:00.980 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-04-26T23:44:00.980 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-04-26T23:44:00.980 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-04-26T23:44:00.980 INFO:teuthology.orchestra.run.smithi088.stdout: "reef", 2024-04-26T23:44:00.980 INFO:teuthology.orchestra.run.smithi088.stdout: "squid" 2024-04-26T23:44:00.980 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:44:00.980 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:44:00.980 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2024-04-26T23:44:00.980 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2024-04-26T23:44:00.981 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2024-04-26T23:44:00.981 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2024-04-26T23:44:00.981 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2024-04-26T23:44:00.981 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "555255e9-7ef9-4454-8dc9-35e96b70035c", 2024-04-26T23:44:00.981 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2024-04-26T23:39:34.291658Z", 2024-04-26T23:44:00.981 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2024-04-26T23:39:34.291658Z", 2024-04-26T23:44:00.981 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 19, 2024-04-26T23:44:00.981 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "squid", 2024-04-26T23:44:00.981 INFO:teuthology.orchestra.run.smithi088.stdout: "election_strategy": 1, 2024-04-26T23:44:00.981 INFO:teuthology.orchestra.run.smithi088.stdout: "disallowed_leaders: ": "", 2024-04-26T23:44:00.981 INFO:teuthology.orchestra.run.smithi088.stdout: "stretch_mode": false, 2024-04-26T23:44:00.981 INFO:teuthology.orchestra.run.smithi088.stdout: "tiebreaker_mon": "", 2024-04-26T23:44:00.981 INFO:teuthology.orchestra.run.smithi088.stdout: "removed_ranks: ": "", 2024-04-26T23:44:00.981 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2024-04-26T23:44:00.981 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2024-04-26T23:44:00.982 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-04-26T23:44:00.982 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-04-26T23:44:00.982 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-04-26T23:44:00.982 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-04-26T23:44:00.982 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-04-26T23:44:00.982 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-04-26T23:44:00.982 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-04-26T23:44:00.982 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-04-26T23:44:00.982 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-04-26T23:44:00.982 INFO:teuthology.orchestra.run.smithi088.stdout: "reef", 2024-04-26T23:44:00.982 INFO:teuthology.orchestra.run.smithi088.stdout: "squid" 2024-04-26T23:44:00.982 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:44:00.982 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2024-04-26T23:44:00.982 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:44:00.983 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2024-04-26T23:44:00.983 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:44:00.983 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2024-04-26T23:44:00.983 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2024-04-26T23:44:00.983 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-04-26T23:44:00.983 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-04-26T23:44:00.983 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:44:00.983 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-04-26T23:44:00.983 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2024-04-26T23:44:00.983 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:44:00.983 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:44:00.983 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:44:00.983 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-04-26T23:44:00.983 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2024-04-26T23:44:00.983 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:44:00.984 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:44:00.984 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:44:00.984 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:44:00.984 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2024-04-26T23:44:00.984 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2024-04-26T23:44:00.984 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-04-26T23:44:00.984 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-04-26T23:44:00.984 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-04-26T23:44:00.984 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:44:00.984 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:44:00.984 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2024-04-26T23:44:00.984 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2024-04-26T23:44:00.984 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-04-26T23:44:00.984 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-04-26T23:44:00.984 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:44:00.985 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-04-26T23:44:00.985 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:3300", 2024-04-26T23:44:00.985 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:44:00.985 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:44:00.985 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:44:00.985 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-04-26T23:44:00.985 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6789", 2024-04-26T23:44:00.985 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:44:00.985 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:44:00.985 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:44:00.985 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:44:00.985 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6789/0", 2024-04-26T23:44:00.985 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.175:6789/0", 2024-04-26T23:44:00.985 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-04-26T23:44:00.985 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-04-26T23:44:00.986 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-04-26T23:44:00.986 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:44:00.986 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:44:00.986 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2024-04-26T23:44:00.986 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2024-04-26T23:44:00.986 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-04-26T23:44:00.986 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-04-26T23:44:00.986 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:44:00.986 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-04-26T23:44:00.986 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:3301", 2024-04-26T23:44:00.986 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:44:00.986 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:44:00.986 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:44:00.986 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-04-26T23:44:00.987 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6790", 2024-04-26T23:44:00.987 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:44:00.987 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:44:00.987 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:44:00.987 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:44:00.987 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6790/0", 2024-04-26T23:44:00.987 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.175:6790/0", 2024-04-26T23:44:00.987 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-04-26T23:44:00.987 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-04-26T23:44:00.987 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-04-26T23:44:00.987 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:44:00.987 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:44:00.987 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:44:00.987 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2024-04-26T23:44:00.987 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2024-04-26T23:44:00.988 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:44:00.988 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:44:00.988 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:44:00.988 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2024-04-26T23:44:00.988 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:44:00.988 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:44:00.988 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": [ 2024-04-26T23:44:00.988 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:44:00.988 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:44:00.988 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:44:00.988 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 3 2024-04-26T23:44:00.988 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:44:00.988 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:44:00.988 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2024-04-26T23:44:00.988 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:44:00.989 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x2f018fb87aa4aafe", 2024-04-26T23:44:00.989 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:44:00.989 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2024-04-26T23:44:00.989 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:44:00.989 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:44:00.989 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:44:00.989 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:44:00.989 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 3 2024-04-26T23:44:00.989 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:44:00.989 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:44:00.989 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:44:00.989 INFO:teuthology.orchestra.run.smithi088.stdout: "stretch_mode": false 2024-04-26T23:44:00.989 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-04-26T23:44:00.990 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:00.976+0000 7fa4e6f5f640 1 -- 172.21.15.88:0/510284929 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fa4c406c920 msgr2=0x7fa4c406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:00.991 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:00.976+0000 7fa4e6f5f640 1 --2- 172.21.15.88:0/510284929 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fa4c406c920 0x7fa4c406ede0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fa4e0051470 tx=0x7fa4e006bca0 comp rx=0 tx=0).stop 2024-04-26T23:44:00.991 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:00.976+0000 7fa4e675e640 1 -- 172.21.15.88:0/510284929 reap_dead start 2024-04-26T23:44:00.991 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:00.976+0000 7fa4e6f5f640 1 -- 172.21.15.88:0/510284929 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa4d8043ab0 msgr2=0x7fa4d80d04f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:00.991 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:00.976+0000 7fa4e6f5f640 1 --2- 172.21.15.88:0/510284929 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa4d8043ab0 0x7fa4d80d04f0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fa4dc00b540 tx=0x7fa4dc00ba00 comp rx=0 tx=0).stop 2024-04-26T23:44:00.991 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:00.977+0000 7fa4e6f5f640 1 -- 172.21.15.88:0/510284929 shutdown_connections 2024-04-26T23:44:00.991 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:00.977+0000 7fa4e6f5f640 1 --2- 172.21.15.88:0/510284929 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa4d8043ab0 0x7fa4d80d04f0 secure :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fa4dc00b540 tx=0x7fa4dc00ba00 comp rx=0 tx=0).stop 2024-04-26T23:44:00.991 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:00.977+0000 7fa4e6f5f640 1 -- 172.21.15.88:0/510284929 >> 172.21.15.88:0/510284929 conn(0x7fa4d802db90 msgr2=0x7fa4d80d5e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:44:00.991 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:00.980+0000 7fa4e6f5f640 1 -- 172.21.15.88:0/510284929 shutdown_connections 2024-04-26T23:44:00.991 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:00.981+0000 7fa4e6f5f640 1 -- 172.21.15.88:0/510284929 wait complete. 2024-04-26T23:44:01.020 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-04-26T23:44:01.021 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-04-26T23:44:01.021 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-04-26T23:44:01.206 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:01.201+0000 7f1cec7b4640 1 Processor -- start 2024-04-26T23:44:01.207 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:01.202+0000 7f1cec7b4640 1 -- start start 2024-04-26T23:44:01.207 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:01.203+0000 7f1cea550640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f1ce4154160 0x7f1ce40c6e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:53930/0 (socket says 172.21.15.88:53930) 2024-04-26T23:44:01.208 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:01.204+0000 7f1cea550640 1 -- 172.21.15.88:0/3624379810 learned_addr learned my addr 172.21.15.88:0/3624379810 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-26T23:44:01.209 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:01.204+0000 7f1cec7b4640 1 --2- 172.21.15.88:0/3624379810 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1ce40ca5a0 0x7f1ce4156bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:01.209 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:01.204+0000 7f1cec7b4640 1 --2- 172.21.15.88:0/3624379810 >> v2:172.21.15.88:3300/0 conn(0x7f1ce415a1a0 0x7f1ce40c9590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:01.209 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:01.204+0000 7f1cec7b4640 1 -- 172.21.15.88:0/3624379810 --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1ce40c8df0 con 0x7f1ce4154160 2024-04-26T23:44:01.209 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:01.204+0000 7f1cead51640 1 --2- 172.21.15.88:0/3624379810 >> v2:172.21.15.88:3300/0 conn(0x7f1ce415a1a0 0x7f1ce40c9590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:01.209 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:01.204+0000 7f1ce9d4f640 1 --2- 172.21.15.88:0/3624379810 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1ce40ca5a0 0x7f1ce4156bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:01.209 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:01.204+0000 7f1cec7b4640 1 -- 172.21.15.88:0/3624379810 --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f1ce40c9100 con 0x7f1ce415a1a0 2024-04-26T23:44:01.210 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:01.205+0000 7f1cec7b4640 1 -- 172.21.15.88:0/3624379810 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f1ce4154540 con 0x7f1ce40ca5a0 2024-04-26T23:44:01.210 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:01.205+0000 7f1ce954e640 1 -- 172.21.15.88:0/3624379810 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 588848782 0 0) 0x7f1ce0001110 con 0x7f1ce4154160 2024-04-26T23:44:01.210 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:01.205+0000 7f1ce954e640 1 -- 172.21.15.88:0/3624379810 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1cd0003520 con 0x7f1ce4154160 2024-04-26T23:44:01.210 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:01.205+0000 7f1ce9d4f640 1 -- 172.21.15.88:0/3624379810 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1ce40ca5a0 msgr2=0x7f1ce4156bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-26T23:44:01.210 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:01.205+0000 7f1ce9d4f640 1 -- 172.21.15.88:0/3624379810 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1ce40ca5a0 msgr2=0x7f1ce4156bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T23:44:01.210 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:01.205+0000 7f1ce9d4f640 1 --2- 172.21.15.88:0/3624379810 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1ce40ca5a0 0x7f1ce4156bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:44:01.210 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:01.205+0000 7f1ce9d4f640 1 --2- 172.21.15.88:0/3624379810 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1ce40ca5a0 0x7f1ce4156bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:44:01.211 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:01.205+0000 7f1ce954e640 1 -- 172.21.15.88:0/3624379810 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3518829304 0 0) 0x7f1cd0003520 con 0x7f1ce4154160 2024-04-26T23:44:01.211 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:01.205+0000 7f1cead51640 1 -- 172.21.15.88:0/3624379810 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1ce40ca5a0 msgr2=0x7f1ce4156bb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T23:44:01.211 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:01.205+0000 7f1cead51640 1 --2- 172.21.15.88:0/3624379810 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1ce40ca5a0 0x7f1ce4156bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:01.211 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:01.205+0000 7f1cead51640 1 -- 172.21.15.88:0/3624379810 >> v1:172.21.15.88:6789/0 conn(0x7f1ce4154160 legacy=0x7f1ce40c6e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:01.211 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:01.205+0000 7f1cead51640 1 -- 172.21.15.88:0/3624379810 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ce415a910 con 0x7f1ce415a1a0 2024-04-26T23:44:01.214 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:01.207+0000 7f1cead51640 1 --2- 172.21.15.88:0/3624379810 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1ce415a1a0 0x7f1ce40c9590 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f1cdc009d90 tx=0x7f1cdc02a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f8566085fc84721 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:01.214 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:01.207+0000 7f1ce954e640 1 -- 172.21.15.88:0/3624379810 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ce0001840 con 0x7f1ce415a1a0 2024-04-26T23:44:01.214 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:01.207+0000 7f1ce954e640 1 -- 172.21.15.88:0/3624379810 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1cdc007540 con 0x7f1ce415a1a0 2024-04-26T23:44:01.214 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:01.207+0000 7f1ce954e640 1 -- 172.21.15.88:0/3624379810 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cdc007910 con 0x7f1ce415a1a0 2024-04-26T23:44:01.214 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:01.208+0000 7f1cec7b4640 1 -- 172.21.15.88:0/3624379810 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1ce415a1a0 msgr2=0x7f1ce40c9590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:01.215 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:01.208+0000 7f1cec7b4640 1 --2- 172.21.15.88:0/3624379810 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1ce415a1a0 0x7f1ce40c9590 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f1cdc009d90 tx=0x7f1cdc02a610 comp rx=0 tx=0).stop 2024-04-26T23:44:01.215 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:01.209+0000 7f1cec7b4640 1 -- 172.21.15.88:0/3624379810 shutdown_connections 2024-04-26T23:44:01.215 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:01.209+0000 7f1cec7b4640 1 --2- 172.21.15.88:0/3624379810 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1ce415a1a0 0x7f1ce40c9590 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:01.215 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:01.209+0000 7f1cec7b4640 1 --2- 172.21.15.88:0/3624379810 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1ce40ca5a0 0x7f1ce4156bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:01.215 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:01.209+0000 7f1cec7b4640 1 -- 172.21.15.88:0/3624379810 >> 172.21.15.88:0/3624379810 conn(0x7f1ce40ae010 msgr2=0x7f1ce40ae3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:44:01.217 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:01.211+0000 7f1cec7b4640 1 -- 172.21.15.88:0/3624379810 shutdown_connections 2024-04-26T23:44:01.217 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:01.211+0000 7f1cec7b4640 1 -- 172.21.15.88:0/3624379810 wait complete. 2024-04-26T23:44:01.218 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:01.213+0000 7f1cec7b4640 1 Processor -- start 2024-04-26T23:44:01.218 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:01.213+0000 7f1cec7b4640 1 -- start start 2024-04-26T23:44:01.220 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:01.214+0000 7f1cec7b4640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1ce40ca5a0 0x7f1ce41f4880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:01.235 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:01.228+0000 7f1cec7b4640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1ce4154160 0x7f1ce41f4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:01.236 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:01.228+0000 7f1cec7b4640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1ce415a1a0 0x7f1ce4148430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:01.236 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:01.228+0000 7f1cec7b4640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f1ce415a630 con 0x7f1ce40ca5a0 2024-04-26T23:44:01.236 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:01.228+0000 7f1cec7b4640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f1ce415aed0 con 0x7f1ce4154160 2024-04-26T23:44:01.236 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:01.228+0000 7f1cec7b4640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f1ce40c7510 con 0x7f1ce415a1a0 2024-04-26T23:44:01.236 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:01.228+0000 7f1cea550640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1ce40ca5a0 0x7f1ce41f4880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:01.236 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:01.228+0000 7f1cea550640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1ce40ca5a0 0x7f1ce41f4880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:58010/0 (socket says 172.21.15.88:58010) 2024-04-26T23:44:01.236 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:01.228+0000 7f1cea550640 1 -- 172.21.15.88:0/3823733722 learned_addr learned my addr 172.21.15.88:0/3823733722 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:44:01.237 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:01.228+0000 7f1ce9d4f640 1 --2- 172.21.15.88:0/3823733722 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1ce4154160 0x7f1ce41f4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:01.237 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:01.229+0000 7f1cea550640 1 -- 172.21.15.88:0/3823733722 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1ce415a1a0 msgr2=0x7f1ce4148430 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-26T23:44:01.237 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:01.229+0000 7f1cea550640 1 --2- 172.21.15.88:0/3823733722 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1ce415a1a0 0x7f1ce4148430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:01.237 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:01.229+0000 7f1cea550640 1 -- 172.21.15.88:0/3823733722 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1ce4154160 msgr2=0x7f1ce41f4dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:01.237 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:01.229+0000 7f1cea550640 1 --2- 172.21.15.88:0/3823733722 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1ce4154160 0x7f1ce41f4dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:01.237 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:01.229+0000 7f1cea550640 1 -- 172.21.15.88:0/3823733722 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ce41f5300 con 0x7f1ce40ca5a0 2024-04-26T23:44:01.238 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:01.229+0000 7f1ce9d4f640 1 --2- 172.21.15.88:0/3823733722 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1ce4154160 0x7f1ce41f4dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:44:01.238 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:01.229+0000 7f1cea550640 1 --2- 172.21.15.88:0/3823733722 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1ce40ca5a0 0x7f1ce41f4880 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f1ce000c6d0 tx=0x7f1ce000cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:01.239 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:01.230+0000 7f1cdaffd640 1 -- 172.21.15.88:0/3823733722 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ce0017070 con 0x7f1ce40ca5a0 2024-04-26T23:44:01.239 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:01.230+0000 7f1cdaffd640 1 -- 172.21.15.88:0/3823733722 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ce0005ad0 con 0x7f1ce40ca5a0 2024-04-26T23:44:01.239 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:01.230+0000 7f1cdaffd640 1 -- 172.21.15.88:0/3823733722 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ce0007070 con 0x7f1ce40ca5a0 2024-04-26T23:44:01.239 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:01.230+0000 7f1cec7b4640 1 -- 172.21.15.88:0/3823733722 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ce41533b0 con 0x7f1ce40ca5a0 2024-04-26T23:44:01.240 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:01.233+0000 7f1cec7b4640 1 -- 172.21.15.88:0/3823733722 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ce41e57f0 con 0x7f1ce40ca5a0 2024-04-26T23:44:01.241 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:01.233+0000 7f1cdaffd640 1 -- 172.21.15.88:0/3823733722 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f1ce001a070 con 0x7f1ce40ca5a0 2024-04-26T23:44:01.241 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:01.234+0000 7f1cdaffd640 1 --2- 172.21.15.88:0/3823733722 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f1cc806c970 0x7f1cc806ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:01.241 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:01.235+0000 7f1ce9d4f640 1 --2- 172.21.15.88:0/3823733722 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f1cc806c970 0x7f1cc806ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:01.241 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:01.235+0000 7f1cdaffd640 1 -- 172.21.15.88:0/3823733722 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6666+0+0 (secure 0 0 0) 0x7f1ce008af90 con 0x7f1ce40ca5a0 2024-04-26T23:44:01.243 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:01.237+0000 7f1cec7b4640 1 --2- 172.21.15.88:0/3823733722 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1ce4148970 0x7f1ce4148d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:01.243 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:01.237+0000 7f1cec7b4640 1 -- 172.21.15.88:0/3823733722 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f1ce41e5b20 con 0x7f1ce4148970 2024-04-26T23:44:01.243 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:01.237+0000 7f1ce9d4f640 1 --2- 172.21.15.88:0/3823733722 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f1cc806c970 0x7f1cc806ee30 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f1ce4151830 tx=0x7f1cd4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:01.243 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:01.237+0000 7f1cead51640 1 --2- 172.21.15.88:0/3823733722 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1ce4148970 0x7f1ce4148d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:01.245 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:01.241+0000 7f1cead51640 1 -- 172.21.15.88:0/3823733722 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1ce41538d0 con 0x7f1ce4148970 2024-04-26T23:44:01.248 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:01.244+0000 7f1cead51640 1 --2- 172.21.15.88:0/3823733722 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1ce4148970 0x7f1ce4148d50 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f1ce406da80 tx=0x7f1cdc004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:01.249 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:01.245+0000 7f1cdaffd640 1 -- 172.21.15.88:0/3823733722 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cdc03f070 con 0x7f1ce4148970 2024-04-26T23:44:01.250 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:01.245+0000 7f1cdaffd640 1 -- 172.21.15.88:0/3823733722 <== mon.1 v2:172.21.15.175:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f1cdc009a10 con 0x7f1ce4148970 2024-04-26T23:44:01.250 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:01.246+0000 7f1cdaffd640 1 -- 172.21.15.88:0/3823733722 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1ce4148970 msgr2=0x7f1ce4148d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:01.250 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:01.246+0000 7f1cdaffd640 1 --2- 172.21.15.88:0/3823733722 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1ce4148970 0x7f1ce4148d50 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f1ce406da80 tx=0x7f1cdc004a40 comp rx=0 tx=0).stop 2024-04-26T23:44:01.250 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:01.246+0000 7f1cdaffd640 1 -- 172.21.15.88:0/3823733722 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1ce4148970 msgr2=0x7f1ce4148d50 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:44:01.250 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:01.246+0000 7f1cdaffd640 1 --2- 172.21.15.88:0/3823733722 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1ce4148970 0x7f1ce4148d50 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:01.278 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:01.273+0000 7f1cec7b4640 1 --2- 172.21.15.88:0/3823733722 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1ce41e5ff0 0x7f1ce41e6400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:01.278 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:01.273+0000 7f1cec7b4640 1 -- 172.21.15.88:0/3823733722 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f1ce40c6f90 con 0x7f1ce41e5ff0 2024-04-26T23:44:01.279 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:01.275+0000 7f1cead51640 1 --2- 172.21.15.88:0/3823733722 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1ce41e5ff0 0x7f1ce41e6400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:01.281 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:01.275+0000 7f1cead51640 1 -- 172.21.15.88:0/3823733722 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f1ce40507a0 con 0x7f1ce41e5ff0 2024-04-26T23:44:01.281 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:01.276+0000 7f1cead51640 1 --2- 172.21.15.88:0/3823733722 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1ce41e5ff0 0x7f1ce41e6400 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f1cdc009790 tx=0x7f1cdc02a610 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:01.281 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:01.276+0000 7f1cdaffd640 1 -- 172.21.15.88:0/3823733722 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cdc004370 con 0x7f1ce41e5ff0 2024-04-26T23:44:01.281 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-04-26T23:44:01.282 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2024-04-26T23:44:01.282 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2024-04-26T23:44:01.282 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "peon", 2024-04-26T23:44:01.282 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 32, 2024-04-26T23:44:01.282 INFO:teuthology.orchestra.run.smithi088.stdout: "uptime": 233621, 2024-04-26T23:44:01.282 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2024-04-26T23:44:01.282 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2024-04-26T23:44:01.282 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2024-04-26T23:44:01.282 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2024-04-26T23:44:01.282 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:44:01.282 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 3, 2024-04-26T23:44:01.282 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2024-04-26T23:44:01.282 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2450521708007866372", 2024-04-26T23:44:01.282 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2024-04-26T23:44:01.283 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-04-26T23:44:01.283 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-04-26T23:44:01.283 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-04-26T23:44:01.283 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-04-26T23:44:01.283 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-04-26T23:44:01.283 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-04-26T23:44:01.283 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-04-26T23:44:01.283 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-04-26T23:44:01.283 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-04-26T23:44:01.283 INFO:teuthology.orchestra.run.smithi088.stdout: "reef", 2024-04-26T23:44:01.283 INFO:teuthology.orchestra.run.smithi088.stdout: "squid" 2024-04-26T23:44:01.283 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:44:01.283 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540701547738038271", 2024-04-26T23:44:01.283 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2024-04-26T23:44:01.283 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-04-26T23:44:01.284 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-04-26T23:44:01.284 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-04-26T23:44:01.284 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-04-26T23:44:01.284 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-04-26T23:44:01.284 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-04-26T23:44:01.284 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-04-26T23:44:01.284 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-04-26T23:44:01.284 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-04-26T23:44:01.284 INFO:teuthology.orchestra.run.smithi088.stdout: "reef", 2024-04-26T23:44:01.284 INFO:teuthology.orchestra.run.smithi088.stdout: "squid" 2024-04-26T23:44:01.284 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:44:01.284 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:44:01.284 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2024-04-26T23:44:01.284 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2024-04-26T23:44:01.284 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2024-04-26T23:44:01.285 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2024-04-26T23:44:01.285 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2024-04-26T23:44:01.285 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "555255e9-7ef9-4454-8dc9-35e96b70035c", 2024-04-26T23:44:01.285 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2024-04-26T23:39:34.291658Z", 2024-04-26T23:44:01.285 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2024-04-26T23:39:34.291658Z", 2024-04-26T23:44:01.285 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 19, 2024-04-26T23:44:01.285 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "squid", 2024-04-26T23:44:01.285 INFO:teuthology.orchestra.run.smithi088.stdout: "election_strategy": 1, 2024-04-26T23:44:01.285 INFO:teuthology.orchestra.run.smithi088.stdout: "disallowed_leaders: ": "", 2024-04-26T23:44:01.285 INFO:teuthology.orchestra.run.smithi088.stdout: "stretch_mode": false, 2024-04-26T23:44:01.285 INFO:teuthology.orchestra.run.smithi088.stdout: "tiebreaker_mon": "", 2024-04-26T23:44:01.285 INFO:teuthology.orchestra.run.smithi088.stdout: "removed_ranks: ": "", 2024-04-26T23:44:01.285 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2024-04-26T23:44:01.285 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2024-04-26T23:44:01.286 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-04-26T23:44:01.286 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-04-26T23:44:01.286 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-04-26T23:44:01.286 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-04-26T23:44:01.286 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-04-26T23:44:01.286 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-04-26T23:44:01.286 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-04-26T23:44:01.286 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-04-26T23:44:01.286 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-04-26T23:44:01.286 INFO:teuthology.orchestra.run.smithi088.stdout: "reef", 2024-04-26T23:44:01.286 INFO:teuthology.orchestra.run.smithi088.stdout: "squid" 2024-04-26T23:44:01.286 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:44:01.287 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2024-04-26T23:44:01.287 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:44:01.287 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2024-04-26T23:44:01.287 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:44:01.287 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2024-04-26T23:44:01.287 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2024-04-26T23:44:01.287 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-04-26T23:44:01.287 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-04-26T23:44:01.287 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:44:01.287 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-04-26T23:44:01.287 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2024-04-26T23:44:01.287 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:44:01.287 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:44:01.287 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:44:01.288 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-04-26T23:44:01.288 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2024-04-26T23:44:01.288 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:44:01.288 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:44:01.288 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:44:01.288 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:44:01.288 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2024-04-26T23:44:01.288 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2024-04-26T23:44:01.288 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-04-26T23:44:01.288 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-04-26T23:44:01.288 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-04-26T23:44:01.288 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:44:01.288 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:44:01.288 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2024-04-26T23:44:01.288 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2024-04-26T23:44:01.289 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-04-26T23:44:01.289 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-04-26T23:44:01.289 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:44:01.289 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-04-26T23:44:01.289 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:3300", 2024-04-26T23:44:01.289 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:44:01.289 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:44:01.289 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:44:01.289 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-04-26T23:44:01.289 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6789", 2024-04-26T23:44:01.289 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:44:01.289 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:44:01.289 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:44:01.289 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:44:01.289 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6789/0", 2024-04-26T23:44:01.290 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.175:6789/0", 2024-04-26T23:44:01.290 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-04-26T23:44:01.290 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-04-26T23:44:01.290 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-04-26T23:44:01.290 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:44:01.290 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:44:01.290 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2024-04-26T23:44:01.290 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2024-04-26T23:44:01.290 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-04-26T23:44:01.290 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-04-26T23:44:01.290 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:44:01.290 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-04-26T23:44:01.290 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:3301", 2024-04-26T23:44:01.290 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:44:01.291 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:44:01.291 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:44:01.291 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-04-26T23:44:01.291 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6790", 2024-04-26T23:44:01.291 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:44:01.291 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:44:01.291 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:44:01.291 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:44:01.291 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6790/0", 2024-04-26T23:44:01.291 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.175:6790/0", 2024-04-26T23:44:01.292 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-04-26T23:44:01.292 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-04-26T23:44:01.292 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-04-26T23:44:01.292 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:44:01.293 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:44:01.293 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:44:01.293 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2024-04-26T23:44:01.294 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2024-04-26T23:44:01.294 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:44:01.294 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:44:01.295 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:44:01.295 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2024-04-26T23:44:01.295 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:44:01.295 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:44:01.295 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": [ 2024-04-26T23:44:01.295 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:44:01.295 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:44:01.296 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:44:01.296 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 4 2024-04-26T23:44:01.296 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:44:01.296 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:44:01.296 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": [ 2024-04-26T23:44:01.296 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:44:01.297 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:44:01.297 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:44:01.297 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 5 2024-04-26T23:44:01.297 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:44:01.298 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:44:01.298 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2024-04-26T23:44:01.298 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:44:01.298 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:44:01.298 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:44:01.299 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 4 2024-04-26T23:44:01.299 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:44:01.299 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:44:01.299 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": [ 2024-04-26T23:44:01.299 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:44:01.299 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:44:01.299 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:44:01.299 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2024-04-26T23:44:01.299 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:44:01.299 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:44:01.299 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:44:01.299 INFO:teuthology.orchestra.run.smithi088.stdout: "stretch_mode": false 2024-04-26T23:44:01.299 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-04-26T23:44:01.300 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:01.277+0000 7f1cdaffd640 1 -- 172.21.15.88:0/3823733722 <== mon.1 v2:172.21.15.175:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5065 (secure 0 0 0) 0x7f1cdc004370 con 0x7f1ce41e5ff0 2024-04-26T23:44:01.300 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:01.277+0000 7f1cdaffd640 1 -- 172.21.15.88:0/3823733722 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1ce41e5ff0 msgr2=0x7f1ce41e6400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:01.300 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:01.277+0000 7f1cdaffd640 1 --2- 172.21.15.88:0/3823733722 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1ce41e5ff0 0x7f1ce41e6400 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f1cdc009790 tx=0x7f1cdc02a610 comp rx=0 tx=0).stop 2024-04-26T23:44:01.300 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:01.277+0000 7f1cdaffd640 1 -- 172.21.15.88:0/3823733722 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1ce41e5ff0 msgr2=0x7f1ce41e6400 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:44:01.300 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:01.277+0000 7f1cdaffd640 1 --2- 172.21.15.88:0/3823733722 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1ce41e5ff0 0x7f1ce41e6400 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:01.300 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:01.280+0000 7f1cd8ff9640 1 -- 172.21.15.88:0/3823733722 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f1cc806c970 msgr2=0x7f1cc806ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:01.301 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:01.280+0000 7f1cd8ff9640 1 --2- 172.21.15.88:0/3823733722 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f1cc806c970 0x7f1cc806ee30 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f1ce4151830 tx=0x7f1cd4008040 comp rx=0 tx=0).stop 2024-04-26T23:44:01.301 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:01.280+0000 7f1cd8ff9640 1 -- 172.21.15.88:0/3823733722 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1ce40ca5a0 msgr2=0x7f1ce41f4880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:01.301 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:01.280+0000 7f1cd8ff9640 1 --2- 172.21.15.88:0/3823733722 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1ce40ca5a0 0x7f1ce41f4880 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f1ce000c6d0 tx=0x7f1ce000cb90 comp rx=0 tx=0).stop 2024-04-26T23:44:01.301 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:01.280+0000 7f1cead51640 1 -- 172.21.15.88:0/3823733722 reap_dead start 2024-04-26T23:44:01.301 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:01.282+0000 7f1cd8ff9640 1 -- 172.21.15.88:0/3823733722 shutdown_connections 2024-04-26T23:44:01.301 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:01.282+0000 7f1cd8ff9640 1 -- 172.21.15.88:0/3823733722 >> 172.21.15.88:0/3823733722 conn(0x7f1ce40ae010 msgr2=0x7f1ce40cc460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:44:01.301 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:01.284+0000 7f1cd8ff9640 1 -- 172.21.15.88:0/3823733722 shutdown_connections 2024-04-26T23:44:01.301 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:01.284+0000 7f1cd8ff9640 1 -- 172.21.15.88:0/3823733722 wait complete. 2024-04-26T23:44:01.315 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-04-26T23:44:01.315 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-04-26T23:44:01.315 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-04-26T23:44:01.486 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:01.481+0000 7efd8471c640 1 Processor -- start 2024-04-26T23:44:01.486 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:01.481+0000 7efd8471c640 1 -- start start 2024-04-26T23:44:01.487 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:01.483+0000 7efd8471c640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7efd7c1555a0 0x7efd7c160340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:01.487 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:01.483+0000 7efd8471c640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efd7c14f0b0 con 0x7efd7c0ac710 2024-04-26T23:44:01.488 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:01.483+0000 7efd8471c640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efd7c074c90 con 0x7efd7c14ecd0 2024-04-26T23:44:01.488 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:01.483+0000 7efd8471c640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7efd7c0c6400 con 0x7efd7c1555a0 2024-04-26T23:44:01.488 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:01.483+0000 7efd82cb9640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7efd7c1555a0 0x7efd7c160340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:01.488 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:01.483+0000 7efd82cb9640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7efd7c1555a0 0x7efd7c160340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:58024/0 (socket says 172.21.15.88:58024) 2024-04-26T23:44:01.488 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:01.483+0000 7efd82cb9640 1 -- 172.21.15.88:0/4186941908 learned_addr learned my addr 172.21.15.88:0/4186941908 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:44:01.488 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:01.483+0000 7efd82cb9640 1 -- 172.21.15.88:0/4186941908 >> v1:172.21.15.175:6789/0 conn(0x7efd7c14ecd0 legacy=0x7efd7c0ab470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:01.488 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:01.483+0000 7efd82cb9640 1 -- 172.21.15.88:0/4186941908 >> v1:172.21.15.88:6789/0 conn(0x7efd7c0ac710 legacy=0x7efd7c073690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:01.488 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:01.483+0000 7efd82cb9640 1 -- 172.21.15.88:0/4186941908 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd7c0c66e0 con 0x7efd7c1555a0 2024-04-26T23:44:01.488 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:01.484+0000 7efd82cb9640 1 --2- 172.21.15.88:0/4186941908 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efd7c1555a0 0x7efd7c160340 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7efd74009e50 tx=0x7efd7402a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9197b21eb63bf11 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:01.489 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:01.485+0000 7efd814b6640 1 -- 172.21.15.88:0/4186941908 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd74036070 con 0x7efd7c1555a0 2024-04-26T23:44:01.489 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:01.485+0000 7efd814b6640 1 -- 172.21.15.88:0/4186941908 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd74031600 con 0x7efd7c1555a0 2024-04-26T23:44:01.490 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:01.485+0000 7efd814b6640 1 -- 172.21.15.88:0/4186941908 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd740319d0 con 0x7efd7c1555a0 2024-04-26T23:44:01.491 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:01.486+0000 7efd8471c640 1 -- 172.21.15.88:0/4186941908 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efd7c1555a0 msgr2=0x7efd7c160340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:01.491 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:01.486+0000 7efd8471c640 1 --2- 172.21.15.88:0/4186941908 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efd7c1555a0 0x7efd7c160340 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7efd74009e50 tx=0x7efd7402a730 comp rx=0 tx=0).stop 2024-04-26T23:44:01.491 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:01.487+0000 7efd8471c640 1 -- 172.21.15.88:0/4186941908 shutdown_connections 2024-04-26T23:44:01.491 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:01.487+0000 7efd8471c640 1 --2- 172.21.15.88:0/4186941908 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efd7c1555a0 0x7efd7c160340 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:01.491 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:01.487+0000 7efd8471c640 1 -- 172.21.15.88:0/4186941908 >> 172.21.15.88:0/4186941908 conn(0x7efd7c0c6d80 msgr2=0x7efd7c0c7160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:44:01.492 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:01.487+0000 7efd8471c640 1 -- 172.21.15.88:0/4186941908 shutdown_connections 2024-04-26T23:44:01.492 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:01.488+0000 7efd8471c640 1 -- 172.21.15.88:0/4186941908 wait complete. 2024-04-26T23:44:01.494 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:01.490+0000 7efd8471c640 1 Processor -- start 2024-04-26T23:44:01.494 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:01.490+0000 7efd8471c640 1 -- start start 2024-04-26T23:44:01.496 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:01.491+0000 7efd8471c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efd7c0ac710 0x7efd7c152070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:01.496 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:01.491+0000 7efd8471c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efd7c14ecd0 0x7efd7c14fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:01.496 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:01.491+0000 7efd8471c640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efd7c1555a0 0x7efd7c1501f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:01.496 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:01.491+0000 7efd8471c640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7efd7c155080 con 0x7efd7c14ecd0 2024-04-26T23:44:01.496 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:01.491+0000 7efd8471c640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7efd7c154da0 con 0x7efd7c0ac710 2024-04-26T23:44:01.496 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:01.491+0000 7efd8471c640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7efd7c0c69c0 con 0x7efd7c1555a0 2024-04-26T23:44:01.496 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:01.491+0000 7efd81cb7640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efd7c14ecd0 0x7efd7c14fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:01.496 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:01.491+0000 7efd81cb7640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efd7c14ecd0 0x7efd7c14fcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:58028/0 (socket says 172.21.15.88:58028) 2024-04-26T23:44:01.496 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:01.491+0000 7efd81cb7640 1 -- 172.21.15.88:0/727918157 learned_addr learned my addr 172.21.15.88:0/727918157 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:44:01.496 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:01.492+0000 7efd824b8640 1 --2- 172.21.15.88:0/727918157 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efd7c0ac710 0x7efd7c152070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:01.496 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:01.492+0000 7efd82cb9640 1 --2- 172.21.15.88:0/727918157 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efd7c1555a0 0x7efd7c1501f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:01.498 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:01.492+0000 7efd81cb7640 1 -- 172.21.15.88:0/727918157 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efd7c1555a0 msgr2=0x7efd7c1501f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:01.498 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:01.492+0000 7efd81cb7640 1 --2- 172.21.15.88:0/727918157 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efd7c1555a0 0x7efd7c1501f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:01.498 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:01.492+0000 7efd81cb7640 1 -- 172.21.15.88:0/727918157 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efd7c0ac710 msgr2=0x7efd7c152070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:01.498 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:01.492+0000 7efd81cb7640 1 --2- 172.21.15.88:0/727918157 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efd7c0ac710 0x7efd7c152070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:01.498 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:01.492+0000 7efd81cb7640 1 -- 172.21.15.88:0/727918157 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd7c153fa0 con 0x7efd7c14ecd0 2024-04-26T23:44:01.498 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:01.492+0000 7efd81cb7640 1 --2- 172.21.15.88:0/727918157 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efd7c14ecd0 0x7efd7c14fcb0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7efd6c00c430 tx=0x7efd6c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:01.498 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:01.492+0000 7efd72ffd640 1 -- 172.21.15.88:0/727918157 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd6c017070 con 0x7efd7c14ecd0 2024-04-26T23:44:01.498 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:01.493+0000 7efd72ffd640 1 -- 172.21.15.88:0/727918157 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd6c0052d0 con 0x7efd7c14ecd0 2024-04-26T23:44:01.498 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:01.493+0000 7efd72ffd640 1 -- 172.21.15.88:0/727918157 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd6c0037f0 con 0x7efd7c14ecd0 2024-04-26T23:44:01.499 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:01.493+0000 7efd82cb9640 1 --2- 172.21.15.88:0/727918157 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efd7c1555a0 0x7efd7c1501f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:44:01.499 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:01.493+0000 7efd8471c640 1 -- 172.21.15.88:0/727918157 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd7c1f5240 con 0x7efd7c14ecd0 2024-04-26T23:44:01.499 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:01.493+0000 7efd8471c640 1 -- 172.21.15.88:0/727918157 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd7c144e50 con 0x7efd7c14ecd0 2024-04-26T23:44:01.500 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:01.494+0000 7efd8471c640 1 --2- 172.21.15.88:0/727918157 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efd7c0c32e0 0x7efd7c0c36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:01.500 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:01.494+0000 7efd8471c640 1 -- 172.21.15.88:0/727918157 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7efd7c1533d0 con 0x7efd7c0c32e0 2024-04-26T23:44:01.500 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:01.495+0000 7efd824b8640 1 --2- 172.21.15.88:0/727918157 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efd7c0c32e0 0x7efd7c0c36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:01.500 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:01.495+0000 7efd824b8640 1 -- 172.21.15.88:0/727918157 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efd7c0c32e0 msgr2=0x7efd7c0c36c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 20 2024-04-26T23:44:01.500 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:01.495+0000 7efd824b8640 1 -- 172.21.15.88:0/727918157 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efd7c0c32e0 msgr2=0x7efd7c0c36c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-26T23:44:01.500 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:01.495+0000 7efd824b8640 1 --2- 172.21.15.88:0/727918157 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efd7c0c32e0 0x7efd7c0c36c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:44:01.500 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:01.495+0000 7efd824b8640 1 --2- 172.21.15.88:0/727918157 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efd7c0c32e0 0x7efd7c0c36c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:44:01.500 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:01.496+0000 7efd72ffd640 1 -- 172.21.15.88:0/727918157 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7efd6c01a070 con 0x7efd7c14ecd0 2024-04-26T23:44:01.501 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:01.497+0000 7efd72ffd640 1 --2- 172.21.15.88:0/727918157 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7efd6006c9c0 0x7efd6006ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:01.501 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:01.497+0000 7efd72ffd640 1 -- 172.21.15.88:0/727918157 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6666+0+0 (secure 0 0 0) 0x7efd6c08b1a0 con 0x7efd7c14ecd0 2024-04-26T23:44:01.501 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:01.498+0000 7efd82cb9640 1 --2- 172.21.15.88:0/727918157 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7efd6006c9c0 0x7efd6006ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:01.502 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:01.498+0000 7efd82cb9640 1 --2- 172.21.15.88:0/727918157 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7efd6006c9c0 0x7efd6006ee80 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7efd74033000 tx=0x7efd74009000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:01.700 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:01.696+0000 7efd824b8640 1 --2- 172.21.15.88:0/727918157 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efd7c0c32e0 0x7efd7c0c36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:01.700 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:01.696+0000 7efd824b8640 1 -- 172.21.15.88:0/727918157 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efd7c0c32e0 msgr2=0x7efd7c0c36c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 21 2024-04-26T23:44:01.700 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:01.696+0000 7efd824b8640 1 -- 172.21.15.88:0/727918157 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efd7c0c32e0 msgr2=0x7efd7c0c36c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-26T23:44:01.701 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:01.696+0000 7efd824b8640 1 --2- 172.21.15.88:0/727918157 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efd7c0c32e0 0x7efd7c0c36c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:44:01.701 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:01.696+0000 7efd824b8640 1 --2- 172.21.15.88:0/727918157 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efd7c0c32e0 0x7efd7c0c36c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-26T23:44:02.101 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:02.097+0000 7efd824b8640 1 --2- 172.21.15.88:0/727918157 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efd7c0c32e0 0x7efd7c0c36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:02.102 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:02.098+0000 7efd824b8640 1 -- 172.21.15.88:0/727918157 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7efd7c076650 con 0x7efd7c0c32e0 2024-04-26T23:44:02.102 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:02.098+0000 7efd824b8640 1 --2- 172.21.15.88:0/727918157 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efd7c0c32e0 0x7efd7c0c36c0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7efd780115c0 tx=0x7efd78011a80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:02.104 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:02.101+0000 7efd72ffd640 1 -- 172.21.15.88:0/727918157 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd780052e0 con 0x7efd7c0c32e0 2024-04-26T23:44:02.108 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:02.101+0000 7efd72ffd640 1 -- 172.21.15.88:0/727918157 <== mon.2 v2:172.21.15.175:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7efd780052e0 con 0x7efd7c0c32e0 2024-04-26T23:44:02.108 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:02.101+0000 7efd72ffd640 1 -- 172.21.15.88:0/727918157 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efd7c0c32e0 msgr2=0x7efd7c0c36c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:02.108 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:02.101+0000 7efd72ffd640 1 --2- 172.21.15.88:0/727918157 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efd7c0c32e0 0x7efd7c0c36c0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7efd780115c0 tx=0x7efd78011a80 comp rx=0 tx=0).stop 2024-04-26T23:44:02.109 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:02.101+0000 7efd72ffd640 1 -- 172.21.15.88:0/727918157 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efd7c0c32e0 msgr2=0x7efd7c0c36c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:44:02.109 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:02.101+0000 7efd72ffd640 1 --2- 172.21.15.88:0/727918157 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efd7c0c32e0 0x7efd7c0c36c0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:02.119 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:02.115+0000 7efd8471c640 1 --2- 172.21.15.88:0/727918157 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efd7c1f4490 0x7efd7c1f4870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:02.119 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:02.115+0000 7efd8471c640 1 -- 172.21.15.88:0/727918157 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7efd7c0707e0 con 0x7efd7c1f4490 2024-04-26T23:44:02.119 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:02.115+0000 7efd824b8640 1 --2- 172.21.15.88:0/727918157 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efd7c1f4490 0x7efd7c1f4870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:02.121 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:02.117+0000 7efd824b8640 1 -- 172.21.15.88:0/727918157 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7efd7c0cb0c0 con 0x7efd7c1f4490 2024-04-26T23:44:02.121 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:02.118+0000 7efd824b8640 1 --2- 172.21.15.88:0/727918157 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efd7c1f4490 0x7efd7c1f4870 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7efd780115c0 tx=0x7efd78000ed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:02.123 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:02.119+0000 7efd72ffd640 1 -- 172.21.15.88:0/727918157 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd78005490 con 0x7efd7c1f4490 2024-04-26T23:44:02.123 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-04-26T23:44:02.123 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2024-04-26T23:44:02.124 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2024-04-26T23:44:02.124 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "peon", 2024-04-26T23:44:02.124 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 32, 2024-04-26T23:44:02.124 INFO:teuthology.orchestra.run.smithi088.stdout: "uptime": 10405, 2024-04-26T23:44:02.124 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2024-04-26T23:44:02.124 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2024-04-26T23:44:02.124 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2024-04-26T23:44:02.124 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2024-04-26T23:44:02.124 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:44:02.124 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 4, 2024-04-26T23:44:02.124 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2024-04-26T23:44:02.124 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2450521708007866372", 2024-04-26T23:44:02.124 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2024-04-26T23:44:02.124 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-04-26T23:44:02.125 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-04-26T23:44:02.125 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-04-26T23:44:02.125 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-04-26T23:44:02.125 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-04-26T23:44:02.125 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-04-26T23:44:02.125 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-04-26T23:44:02.125 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-04-26T23:44:02.125 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-04-26T23:44:02.125 INFO:teuthology.orchestra.run.smithi088.stdout: "reef", 2024-04-26T23:44:02.125 INFO:teuthology.orchestra.run.smithi088.stdout: "squid" 2024-04-26T23:44:02.125 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:44:02.125 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540701547738038271", 2024-04-26T23:44:02.125 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2024-04-26T23:44:02.125 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-04-26T23:44:02.125 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-04-26T23:44:02.126 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-04-26T23:44:02.126 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-04-26T23:44:02.126 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-04-26T23:44:02.126 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-04-26T23:44:02.126 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-04-26T23:44:02.126 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-04-26T23:44:02.126 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-04-26T23:44:02.126 INFO:teuthology.orchestra.run.smithi088.stdout: "reef", 2024-04-26T23:44:02.126 INFO:teuthology.orchestra.run.smithi088.stdout: "squid" 2024-04-26T23:44:02.126 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:44:02.126 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:44:02.126 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2024-04-26T23:44:02.126 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2024-04-26T23:44:02.126 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2024-04-26T23:44:02.127 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2024-04-26T23:44:02.127 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2024-04-26T23:44:02.127 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "555255e9-7ef9-4454-8dc9-35e96b70035c", 2024-04-26T23:44:02.127 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2024-04-26T23:39:34.291658Z", 2024-04-26T23:44:02.127 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2024-04-26T23:39:34.291658Z", 2024-04-26T23:44:02.127 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 19, 2024-04-26T23:44:02.127 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "squid", 2024-04-26T23:44:02.127 INFO:teuthology.orchestra.run.smithi088.stdout: "election_strategy": 1, 2024-04-26T23:44:02.127 INFO:teuthology.orchestra.run.smithi088.stdout: "disallowed_leaders: ": "", 2024-04-26T23:44:02.127 INFO:teuthology.orchestra.run.smithi088.stdout: "stretch_mode": false, 2024-04-26T23:44:02.127 INFO:teuthology.orchestra.run.smithi088.stdout: "tiebreaker_mon": "", 2024-04-26T23:44:02.127 INFO:teuthology.orchestra.run.smithi088.stdout: "removed_ranks: ": "", 2024-04-26T23:44:02.127 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2024-04-26T23:44:02.128 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2024-04-26T23:44:02.128 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-04-26T23:44:02.128 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-04-26T23:44:02.128 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-04-26T23:44:02.128 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-04-26T23:44:02.128 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-04-26T23:44:02.128 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-04-26T23:44:02.128 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-04-26T23:44:02.128 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-04-26T23:44:02.128 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-04-26T23:44:02.128 INFO:teuthology.orchestra.run.smithi088.stdout: "reef", 2024-04-26T23:44:02.128 INFO:teuthology.orchestra.run.smithi088.stdout: "squid" 2024-04-26T23:44:02.128 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:44:02.128 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2024-04-26T23:44:02.128 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:44:02.129 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2024-04-26T23:44:02.129 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:44:02.129 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2024-04-26T23:44:02.129 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2024-04-26T23:44:02.129 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-04-26T23:44:02.129 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-04-26T23:44:02.129 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:44:02.129 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-04-26T23:44:02.129 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2024-04-26T23:44:02.129 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:44:02.129 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:44:02.129 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:44:02.129 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-04-26T23:44:02.129 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2024-04-26T23:44:02.129 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:44:02.130 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:44:02.130 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:44:02.130 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:44:02.130 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2024-04-26T23:44:02.130 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2024-04-26T23:44:02.130 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-04-26T23:44:02.130 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-04-26T23:44:02.130 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-04-26T23:44:02.130 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:44:02.130 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:44:02.130 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2024-04-26T23:44:02.130 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2024-04-26T23:44:02.130 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-04-26T23:44:02.130 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-04-26T23:44:02.130 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:44:02.131 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-04-26T23:44:02.131 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:3300", 2024-04-26T23:44:02.131 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:44:02.131 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:44:02.131 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:44:02.131 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-04-26T23:44:02.131 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6789", 2024-04-26T23:44:02.131 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:44:02.131 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:44:02.131 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:44:02.131 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:44:02.131 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6789/0", 2024-04-26T23:44:02.131 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.175:6789/0", 2024-04-26T23:44:02.131 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-04-26T23:44:02.131 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-04-26T23:44:02.132 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-04-26T23:44:02.132 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:44:02.132 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:44:02.132 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2024-04-26T23:44:02.132 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2024-04-26T23:44:02.132 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-04-26T23:44:02.132 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-04-26T23:44:02.132 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:44:02.132 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-04-26T23:44:02.132 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:3301", 2024-04-26T23:44:02.132 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:44:02.132 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:44:02.132 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:44:02.132 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-04-26T23:44:02.132 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6790", 2024-04-26T23:44:02.133 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:44:02.133 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:44:02.133 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:44:02.133 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:44:02.133 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6790/0", 2024-04-26T23:44:02.133 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.175:6790/0", 2024-04-26T23:44:02.133 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-04-26T23:44:02.133 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-04-26T23:44:02.133 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-04-26T23:44:02.133 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:44:02.133 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:44:02.133 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:44:02.133 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2024-04-26T23:44:02.133 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2024-04-26T23:44:02.133 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:44:02.134 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:44:02.134 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:44:02.134 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2024-04-26T23:44:02.134 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:44:02.134 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:44:02.134 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2024-04-26T23:44:02.134 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:44:02.134 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:44:02.134 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:44:02.134 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2024-04-26T23:44:02.134 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:44:02.134 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:44:02.134 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:44:02.134 INFO:teuthology.orchestra.run.smithi088.stdout: "stretch_mode": false 2024-04-26T23:44:02.134 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-04-26T23:44:02.136 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:02.119+0000 7efd72ffd640 1 -- 172.21.15.88:0/727918157 <== mon.2 v2:172.21.15.175:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4554 (secure 0 0 0) 0x7efd7801e770 con 0x7efd7c1f4490 2024-04-26T23:44:02.136 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:02.119+0000 7efd72ffd640 1 -- 172.21.15.88:0/727918157 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efd7c1f4490 msgr2=0x7efd7c1f4870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:02.136 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:02.119+0000 7efd72ffd640 1 --2- 172.21.15.88:0/727918157 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efd7c1f4490 0x7efd7c1f4870 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7efd780115c0 tx=0x7efd78000ed0 comp rx=0 tx=0).stop 2024-04-26T23:44:02.136 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:02.119+0000 7efd72ffd640 1 -- 172.21.15.88:0/727918157 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efd7c1f4490 msgr2=0x7efd7c1f4870 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:44:02.136 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:02.119+0000 7efd72ffd640 1 --2- 172.21.15.88:0/727918157 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efd7c1f4490 0x7efd7c1f4870 secure :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7efd780115c0 tx=0x7efd78000ed0 comp rx=0 tx=0).stop 2024-04-26T23:44:02.136 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:02.120+0000 7efd8471c640 1 -- 172.21.15.88:0/727918157 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7efd6006c9c0 msgr2=0x7efd6006ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:02.136 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:02.120+0000 7efd8471c640 1 --2- 172.21.15.88:0/727918157 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7efd6006c9c0 0x7efd6006ee80 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7efd74033000 tx=0x7efd74009000 comp rx=0 tx=0).stop 2024-04-26T23:44:02.136 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:02.120+0000 7efd8471c640 1 -- 172.21.15.88:0/727918157 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efd7c14ecd0 msgr2=0x7efd7c14fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:02.136 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:02.120+0000 7efd8471c640 1 --2- 172.21.15.88:0/727918157 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efd7c14ecd0 0x7efd7c14fcb0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7efd6c00c430 tx=0x7efd6c00c8f0 comp rx=0 tx=0).stop 2024-04-26T23:44:02.137 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:02.121+0000 7efd82cb9640 1 -- 172.21.15.88:0/727918157 reap_dead start 2024-04-26T23:44:02.137 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:02.121+0000 7efd82cb9640 1 -- 172.21.15.88:0/727918157 reap_dead start 2024-04-26T23:44:02.137 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:02.121+0000 7efd8471c640 1 -- 172.21.15.88:0/727918157 shutdown_connections 2024-04-26T23:44:02.137 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:02.121+0000 7efd8471c640 1 -- 172.21.15.88:0/727918157 >> 172.21.15.88:0/727918157 conn(0x7efd7c0c6d80 msgr2=0x7efd7c0c85e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:44:02.137 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:02.121+0000 7efd8471c640 1 -- 172.21.15.88:0/727918157 shutdown_connections 2024-04-26T23:44:02.137 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:02.122+0000 7efd8471c640 1 -- 172.21.15.88:0/727918157 wait complete. 2024-04-26T23:44:02.144 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-04-26T23:44:02.144 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2024-04-26T23:44:02.145 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2024-04-26T23:44:02.322 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:02.316+0000 7fb44e178640 1 Processor -- start 2024-04-26T23:44:02.322 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:02.316+0000 7fb44e178640 1 -- start start 2024-04-26T23:44:02.322 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:02.317+0000 7fb44e178640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fb4480c2bd0 0x7fb44815bb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:02.323 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:02.317+0000 7fb44e178640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb4480aa9e0 0x7fb4481584f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:02.323 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:02.317+0000 7fb44e178640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb44806db80 con 0x7fb4480abbe0 2024-04-26T23:44:02.323 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:02.317+0000 7fb44e178640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7fb44815c0d0 con 0x7fb4480c2bd0 2024-04-26T23:44:02.323 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:02.317+0000 7fb44e178640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fb44806de60 con 0x7fb4480aa9e0 2024-04-26T23:44:02.323 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:02.318+0000 7fb44d977640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb4480aa9e0 0x7fb4481584f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:02.323 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:02.318+0000 7fb44d977640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb4480aa9e0 0x7fb4481584f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.88:56442/0 (socket says 172.21.15.88:56442) 2024-04-26T23:44:02.324 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:02.318+0000 7fb44d977640 1 -- 172.21.15.88:0/2110325650 learned_addr learned my addr 172.21.15.88:0/2110325650 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:44:02.324 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:02.318+0000 7fb44c975640 1 --2- 172.21.15.88:0/2110325650 >> v2:172.21.15.175:3300/0 conn(0x7fb4480c2bd0 0x7fb44815bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:02.324 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:02.318+0000 7fb44d977640 1 -- 172.21.15.88:0/2110325650 >> v2:172.21.15.175:3300/0 conn(0x7fb4480c2bd0 msgr2=0x7fb44815bb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:44:02.324 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:02.318+0000 7fb44d977640 1 --2- 172.21.15.88:0/2110325650 >> v2:172.21.15.175:3300/0 conn(0x7fb4480c2bd0 0x7fb44815bb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:02.324 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:02.318+0000 7fb44d977640 1 -- 172.21.15.88:0/2110325650 >> v1:172.21.15.88:6789/0 conn(0x7fb4480abbe0 legacy=0x7fb44806ce40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T23:44:02.324 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:02.318+0000 7fb44d977640 1 -- 172.21.15.88:0/2110325650 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb44806e140 con 0x7fb4480aa9e0 2024-04-26T23:44:02.324 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:02.319+0000 7fb44d977640 1 --2- 172.21.15.88:0/2110325650 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb4480aa9e0 0x7fb4481584f0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fb440009e50 tx=0x7fb44002a6f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=709fed2764977fb0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:02.325 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:02.320+0000 7fb43ffff640 1 -- 172.21.15.88:0/2110325650 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb440036070 con 0x7fb4480aa9e0 2024-04-26T23:44:02.325 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:02.320+0000 7fb43ffff640 1 -- 172.21.15.88:0/2110325650 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb440031600 con 0x7fb4480aa9e0 2024-04-26T23:44:02.325 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:02.321+0000 7fb44e178640 1 -- 172.21.15.88:0/2110325650 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb4480aa9e0 msgr2=0x7fb4481584f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:02.325 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:02.321+0000 7fb43ffff640 1 -- 172.21.15.88:0/2110325650 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4400319b0 con 0x7fb4480aa9e0 2024-04-26T23:44:02.325 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:02.321+0000 7fb44e178640 1 --2- 172.21.15.88:0/2110325650 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb4480aa9e0 0x7fb4481584f0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fb440009e50 tx=0x7fb44002a6f0 comp rx=0 tx=0).stop 2024-04-26T23:44:02.328 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:02.324+0000 7fb44e178640 1 -- 172.21.15.88:0/2110325650 shutdown_connections 2024-04-26T23:44:02.328 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:02.324+0000 7fb44e178640 1 --2- 172.21.15.88:0/2110325650 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb4480aa9e0 0x7fb4481584f0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:02.328 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:02.324+0000 7fb44e178640 1 --2- 172.21.15.88:0/2110325650 >> v2:172.21.15.175:3300/0 conn(0x7fb4480c2bd0 0x7fb44815bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:02.328 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:02.324+0000 7fb44e178640 1 -- 172.21.15.88:0/2110325650 >> 172.21.15.88:0/2110325650 conn(0x7fb4480c4cd0 msgr2=0x7fb4480c50e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:44:02.332 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:02.327+0000 7fb44e178640 1 -- 172.21.15.88:0/2110325650 shutdown_connections 2024-04-26T23:44:02.332 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:02.328+0000 7fb44e178640 1 -- 172.21.15.88:0/2110325650 wait complete. 2024-04-26T23:44:02.333 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:02.329+0000 7fb44e178640 1 Processor -- start 2024-04-26T23:44:02.333 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:02.329+0000 7fb44e178640 1 -- start start 2024-04-26T23:44:02.338 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:02.330+0000 7fb44e178640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb4480aa9e0 0x7fb4481434c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:02.338 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:02.330+0000 7fb44e178640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb4480abbe0 0x7fb448143a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:02.338 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:02.330+0000 7fb44e178640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb4480c2bd0 0x7fb4480c71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:02.338 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:02.330+0000 7fb44e178640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fb44806d6d0 con 0x7fb4480c2bd0 2024-04-26T23:44:02.338 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:02.330+0000 7fb44e178640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fb44806d550 con 0x7fb4480aa9e0 2024-04-26T23:44:02.338 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:02.330+0000 7fb44e178640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fb4480abfc0 con 0x7fb4480abbe0 2024-04-26T23:44:02.338 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:02.331+0000 7fb44d977640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb4480c2bd0 0x7fb4480c71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:02.338 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:02.331+0000 7fb44c975640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb4480abbe0 0x7fb448143a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:02.338 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:02.331+0000 7fb44d977640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb4480c2bd0 0x7fb4480c71b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:58038/0 (socket says 172.21.15.88:58038) 2024-04-26T23:44:02.338 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:02.331+0000 7fb44d977640 1 -- 172.21.15.88:0/415500033 learned_addr learned my addr 172.21.15.88:0/415500033 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:44:02.338 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:02.331+0000 7fb44d176640 1 --2- 172.21.15.88:0/415500033 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb4480aa9e0 0x7fb4481434c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:02.339 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:02.331+0000 7fb44d977640 1 -- 172.21.15.88:0/415500033 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb4480abbe0 msgr2=0x7fb448143a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:02.339 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:02.331+0000 7fb44d977640 1 --2- 172.21.15.88:0/415500033 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb4480abbe0 0x7fb448143a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:02.339 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:02.331+0000 7fb44d977640 1 -- 172.21.15.88:0/415500033 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb4480aa9e0 msgr2=0x7fb4481434c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:02.339 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:02.331+0000 7fb44d977640 1 --2- 172.21.15.88:0/415500033 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb4480aa9e0 0x7fb4481434c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:02.339 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:02.331+0000 7fb44d977640 1 -- 172.21.15.88:0/415500033 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb448072670 con 0x7fb4480c2bd0 2024-04-26T23:44:02.339 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:02.332+0000 7fb44d977640 1 --2- 172.21.15.88:0/415500033 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb4480c2bd0 0x7fb4480c71b0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fb440009e50 tx=0x7fb440004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:02.340 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:02.333+0000 7fb43dffb640 1 -- 172.21.15.88:0/415500033 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb440040030 con 0x7fb4480c2bd0 2024-04-26T23:44:02.340 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:02.333+0000 7fb43dffb640 1 -- 172.21.15.88:0/415500033 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb440037040 con 0x7fb4480c2bd0 2024-04-26T23:44:02.340 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:02.333+0000 7fb43dffb640 1 -- 172.21.15.88:0/415500033 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb440036030 con 0x7fb4480c2bd0 2024-04-26T23:44:02.340 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:02.333+0000 7fb44e178640 1 -- 172.21.15.88:0/415500033 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4480748a0 con 0x7fb4480c2bd0 2024-04-26T23:44:02.340 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:02.333+0000 7fb44e178640 1 -- 172.21.15.88:0/415500033 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb448072390 con 0x7fb4480c2bd0 2024-04-26T23:44:02.340 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:02.336+0000 7fb43dffb640 1 -- 172.21.15.88:0/415500033 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb440043070 con 0x7fb4480c2bd0 2024-04-26T23:44:02.342 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:02.338+0000 7fb43dffb640 1 --2- 172.21.15.88:0/415500033 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fb42c06c9f0 0x7fb42c06eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:02.343 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:02.339+0000 7fb43dffb640 1 -- 172.21.15.88:0/415500033 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6666+0+0 (secure 0 0 0) 0x7fb4400ac680 con 0x7fb4480c2bd0 2024-04-26T23:44:02.343 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:02.339+0000 7fb44d176640 1 --2- 172.21.15.88:0/415500033 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fb42c06c9f0 0x7fb42c06eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:02.344 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:02.340+0000 7fb44d176640 1 --2- 172.21.15.88:0/415500033 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fb42c06c9f0 0x7fb42c06eeb0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fb444006fd0 tx=0x7fb444008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:02.350 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:02.346+0000 7fb44e178640 1 -- 172.21.15.88:0/415500033 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb428005290 con 0x7fb4480c2bd0 2024-04-26T23:44:02.359 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:02.355+0000 7fb43dffb640 1 -- 172.21.15.88:0/415500033 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fb44002f300 con 0x7fb4480c2bd0 2024-04-26T23:44:02.914 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:02.910+0000 7fb44e178640 1 -- 172.21.15.88:0/415500033 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7fb428005d90 con 0x7fb4480c2bd0 2024-04-26T23:44:02.915 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:02.912+0000 7fb43dffb640 1 -- 172.21.15.88:0/415500033 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (secure 0 0 0) 0x7fb44007a760 con 0x7fb4480c2bd0 2024-04-26T23:44:02.921 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:02.917+0000 7fb44e178640 1 -- 172.21.15.88:0/415500033 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fb42c06c9f0 msgr2=0x7fb42c06eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:02.922 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:02.917+0000 7fb44e178640 1 --2- 172.21.15.88:0/415500033 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fb42c06c9f0 0x7fb42c06eeb0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fb444006fd0 tx=0x7fb444008040 comp rx=0 tx=0).stop 2024-04-26T23:44:02.922 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:02.918+0000 7fb44e178640 1 -- 172.21.15.88:0/415500033 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb4480c2bd0 msgr2=0x7fb4480c71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:02.922 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:02.918+0000 7fb44e178640 1 --2- 172.21.15.88:0/415500033 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb4480c2bd0 0x7fb4480c71b0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fb440009e50 tx=0x7fb440004a40 comp rx=0 tx=0).stop 2024-04-26T23:44:02.925 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:02.921+0000 7fb44e178640 1 -- 172.21.15.88:0/415500033 shutdown_connections 2024-04-26T23:44:02.925 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:02.921+0000 7fb44e178640 1 --2- 172.21.15.88:0/415500033 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fb42c06c9f0 0x7fb42c06eeb0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:02.926 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:02.921+0000 7fb44e178640 1 --2- 172.21.15.88:0/415500033 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb4480abbe0 0x7fb448143a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:02.926 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:02.921+0000 7fb44e178640 1 --2- 172.21.15.88:0/415500033 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb4480c2bd0 0x7fb4480c71b0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:02.926 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:02.921+0000 7fb44e178640 1 --2- 172.21.15.88:0/415500033 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb4480aa9e0 0x7fb4481434c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:02.926 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:02.922+0000 7fb44e178640 1 -- 172.21.15.88:0/415500033 >> 172.21.15.88:0/415500033 conn(0x7fb4480c4cd0 msgr2=0x7fb44806ce40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:44:02.929 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:02.925+0000 7fb44e178640 1 -- 172.21.15.88:0/415500033 shutdown_connections 2024-04-26T23:44:02.929 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:02.925+0000 7fb44e178640 1 -- 172.21.15.88:0/415500033 wait complete. 2024-04-26T23:44:02.959 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2024-04-26T23:44:03.480 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:44:03.485 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:44:12.960 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-04-26T23:44:12.960 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-04-26T23:44:13.087 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:13.083+0000 7f04b8437640 1 Processor -- start 2024-04-26T23:44:13.087 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:13.083+0000 7f04b8437640 1 -- start start 2024-04-26T23:44:13.089 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:13.084+0000 7f04b8437640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f04b006ede0 0x7f04b015a270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:13.089 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:13.084+0000 7f04b8437640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f04b0154780 con 0x7f04b00c4b80 2024-04-26T23:44:13.089 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:13.084+0000 7f04b8437640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f04b00c7430 con 0x7f04b01543a0 2024-04-26T23:44:13.089 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:13.084+0000 7f04b8437640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f04b00c5480 con 0x7f04b006ede0 2024-04-26T23:44:13.089 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:13.084+0000 7f04b59d2640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f04b006ede0 0x7f04b015a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:13.089 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:13.084+0000 7f04b69d4640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f04b00c4b80 0x7f04b015a7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:41040/0 (socket says 172.21.15.88:41040) 2024-04-26T23:44:13.089 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:13.084+0000 7f04b69d4640 1 -- 172.21.15.88:0/3360537200 learned_addr learned my addr 172.21.15.88:0/3360537200 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-26T23:44:13.089 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:13.084+0000 7f04b59d2640 1 --2- 172.21.15.88:0/3360537200 >> v2:172.21.15.88:3300/0 conn(0x7f04b006ede0 0x7f04b015a270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:59198/0 (socket says 172.21.15.88:59198) 2024-04-26T23:44:13.089 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:13.085+0000 7f04b59d2640 1 -- 172.21.15.88:0/3360537200 >> v1:172.21.15.175:6789/0 conn(0x7f04b01543a0 legacy=0x7f04b006f2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:13.089 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:13.085+0000 7f04b59d2640 1 -- 172.21.15.88:0/3360537200 >> v1:172.21.15.88:6789/0 conn(0x7f04b00c4b80 legacy=0x7f04b015a7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:13.090 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:13.085+0000 7f04b59d2640 1 -- 172.21.15.88:0/3360537200 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04b00c7710 con 0x7f04b006ede0 2024-04-26T23:44:13.091 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:13.086+0000 7f04b59d2640 1 --2- 172.21.15.88:0/3360537200 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f04b006ede0 0x7f04b015a270 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f04a00097a0 tx=0x7f04a002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5050352dc2674247 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:13.091 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:13.086+0000 7f04b51d1640 1 -- 172.21.15.88:0/3360537200 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04a0037070 con 0x7f04b006ede0 2024-04-26T23:44:13.091 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:13.086+0000 7f04b51d1640 1 -- 172.21.15.88:0/3360537200 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04a0032440 con 0x7f04b006ede0 2024-04-26T23:44:13.091 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:13.086+0000 7f04b51d1640 1 -- 172.21.15.88:0/3360537200 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04a002ae60 con 0x7f04b006ede0 2024-04-26T23:44:13.091 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:13.087+0000 7f04b8437640 1 -- 172.21.15.88:0/3360537200 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f04b006ede0 msgr2=0x7f04b015a270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:13.091 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:13.087+0000 7f04b8437640 1 --2- 172.21.15.88:0/3360537200 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f04b006ede0 0x7f04b015a270 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f04a00097a0 tx=0x7f04a002a110 comp rx=0 tx=0).stop 2024-04-26T23:44:13.091 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:13.087+0000 7f04b8437640 1 -- 172.21.15.88:0/3360537200 shutdown_connections 2024-04-26T23:44:13.091 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:13.087+0000 7f04b8437640 1 --2- 172.21.15.88:0/3360537200 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f04b006ede0 0x7f04b015a270 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:13.092 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:13.087+0000 7f04b8437640 1 -- 172.21.15.88:0/3360537200 >> 172.21.15.88:0/3360537200 conn(0x7f04b00c89f0 msgr2=0x7f04b00c8dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:44:13.092 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:13.087+0000 7f04b8437640 1 -- 172.21.15.88:0/3360537200 shutdown_connections 2024-04-26T23:44:13.092 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:13.087+0000 7f04b8437640 1 -- 172.21.15.88:0/3360537200 wait complete. 2024-04-26T23:44:13.092 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:13.088+0000 7f04b8437640 1 Processor -- start 2024-04-26T23:44:13.092 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:13.088+0000 7f04b8437640 1 -- start start 2024-04-26T23:44:13.094 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:13.089+0000 7f04b8437640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f04b006ede0 0x7f04b0151150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:13.095 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:13.089+0000 7f04b8437640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f04b00c4b80 0x7f04b01f0160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:13.095 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:13.089+0000 7f04b8437640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f04b01543a0 0x7f04b01500d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:13.095 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:13.089+0000 7f04b8437640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f04b015aec0 con 0x7f04b006ede0 2024-04-26T23:44:13.095 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:13.089+0000 7f04b8437640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f04b00c5a40 con 0x7f04b00c4b80 2024-04-26T23:44:13.095 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:13.089+0000 7f04b8437640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f04b00c70e0 con 0x7f04b01543a0 2024-04-26T23:44:13.095 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:13.089+0000 7f04b61d3640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f04b006ede0 0x7f04b0151150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:13.095 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:13.089+0000 7f04b61d3640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f04b006ede0 0x7f04b0151150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:59204/0 (socket says 172.21.15.88:59204) 2024-04-26T23:44:13.095 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:13.089+0000 7f04b61d3640 1 -- 172.21.15.88:0/950768915 learned_addr learned my addr 172.21.15.88:0/950768915 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:44:13.095 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:13.089+0000 7f04b69d4640 1 --2- 172.21.15.88:0/950768915 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f04b01543a0 0x7f04b01500d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:13.095 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:13.090+0000 7f04b61d3640 1 -- 172.21.15.88:0/950768915 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f04b01543a0 msgr2=0x7f04b01500d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:13.095 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:13.090+0000 7f04b61d3640 1 --2- 172.21.15.88:0/950768915 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f04b01543a0 0x7f04b01500d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:13.095 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:13.090+0000 7f04b61d3640 1 -- 172.21.15.88:0/950768915 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f04b00c4b80 msgr2=0x7f04b01f0160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:13.096 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:13.090+0000 7f04b61d3640 1 --2- 172.21.15.88:0/950768915 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f04b00c4b80 0x7f04b01f0160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:13.096 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:13.090+0000 7f04b61d3640 1 -- 172.21.15.88:0/950768915 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04b01f0be0 con 0x7f04b006ede0 2024-04-26T23:44:13.096 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:13.090+0000 7f04b61d3640 1 --2- 172.21.15.88:0/950768915 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f04b006ede0 0x7f04b0151150 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f04ac00c430 tx=0x7f04ac00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:13.096 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:13.090+0000 7f04a6ffd640 1 -- 172.21.15.88:0/950768915 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04ac0052d0 con 0x7f04b006ede0 2024-04-26T23:44:13.096 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:13.090+0000 7f04a6ffd640 1 -- 172.21.15.88:0/950768915 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04ac005490 con 0x7f04b006ede0 2024-04-26T23:44:13.096 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:13.090+0000 7f04a6ffd640 1 -- 172.21.15.88:0/950768915 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04ac007260 con 0x7f04b006ede0 2024-04-26T23:44:13.096 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:13.090+0000 7f04b8437640 1 -- 172.21.15.88:0/950768915 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04b00abad0 con 0x7f04b006ede0 2024-04-26T23:44:13.096 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:13.090+0000 7f04b8437640 1 -- 172.21.15.88:0/950768915 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04b01e26c0 con 0x7f04b006ede0 2024-04-26T23:44:13.097 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:13.091+0000 7f04b8437640 1 -- 172.21.15.88:0/950768915 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f04b00a8930 con 0x7f04b006ede0 2024-04-26T23:44:13.097 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:13.092+0000 7f04a6ffd640 1 -- 172.21.15.88:0/950768915 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f04ac007400 con 0x7f04b006ede0 2024-04-26T23:44:13.097 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:13.092+0000 7f04a6ffd640 1 --2- 172.21.15.88:0/950768915 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f049406c8f0 0x7f049406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:13.097 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:13.093+0000 7f04a6ffd640 1 -- 172.21.15.88:0/950768915 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6666+0+0 (secure 0 0 0) 0x7f04ac08b3b0 con 0x7f04b006ede0 2024-04-26T23:44:13.097 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:13.093+0000 7f04b59d2640 1 --2- 172.21.15.88:0/950768915 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f049406c8f0 0x7f049406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:13.097 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:13.093+0000 7f04b59d2640 1 --2- 172.21.15.88:0/950768915 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f049406c8f0 0x7f049406edb0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f04a0034000 tx=0x7f04a002c000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:13.102 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:13.098+0000 7f04a6ffd640 1 -- 172.21.15.88:0/950768915 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f04b00a8930 con 0x7f04b006ede0 2024-04-26T23:44:13.651 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:13.647+0000 7f04b8437640 1 -- 172.21.15.88:0/950768915 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f04b00abff0 con 0x7f04b006ede0 2024-04-26T23:44:13.652 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:13.648+0000 7f04a6ffd640 1 -- 172.21.15.88:0/950768915 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1565 (secure 0 0 0) 0x7f04b00abff0 con 0x7f04b006ede0 2024-04-26T23:44:13.653 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":32,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":15,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"555255e9-7ef9-4454-8dc9-35e96b70035c","modified":"2024-04-26T23:39:34.291658Z","created":"2024-04-26T23:39:34.291658Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:3300","nonce":0},{"type":"v1","addr":"172.21.15.175:6789","nonce":0}]},"addr":"172.21.15.175:6789/0","public_addr":"172.21.15.175:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:3301","nonce":0},{"type":"v1","addr":"172.21.15.175:6790","nonce":0}]},"addr":"172.21.15.175:6790/0","public_addr":"172.21.15.175:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-04-26T23:44:13.658 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:13.652+0000 7f04a4ff9640 1 -- 172.21.15.88:0/950768915 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f049406c8f0 msgr2=0x7f049406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:13.658 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:13.652+0000 7f04a4ff9640 1 --2- 172.21.15.88:0/950768915 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f049406c8f0 0x7f049406edb0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f04a0034000 tx=0x7f04a002c000 comp rx=0 tx=0).stop 2024-04-26T23:44:13.659 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:13.653+0000 7f04a4ff9640 1 -- 172.21.15.88:0/950768915 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f04b006ede0 msgr2=0x7f04b0151150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:13.659 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:13.653+0000 7f04a4ff9640 1 --2- 172.21.15.88:0/950768915 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f04b006ede0 0x7f04b0151150 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f04ac00c430 tx=0x7f04ac00c8f0 comp rx=0 tx=0).stop 2024-04-26T23:44:13.659 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:13.653+0000 7f04a4ff9640 1 -- 172.21.15.88:0/950768915 shutdown_connections 2024-04-26T23:44:13.659 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:13.653+0000 7f04a4ff9640 1 --2- 172.21.15.88:0/950768915 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f049406c8f0 0x7f049406edb0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:13.659 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:13.653+0000 7f04a4ff9640 1 --2- 172.21.15.88:0/950768915 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f04b01543a0 0x7f04b01500d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:13.659 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:13.653+0000 7f04a4ff9640 1 --2- 172.21.15.88:0/950768915 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f04b00c4b80 0x7f04b01f0160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:13.659 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:13.653+0000 7f04a4ff9640 1 --2- 172.21.15.88:0/950768915 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f04b006ede0 0x7f04b0151150 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:13.659 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:13.653+0000 7f04a4ff9640 1 -- 172.21.15.88:0/950768915 >> 172.21.15.88:0/950768915 conn(0x7f04b00c89f0 msgr2=0x7f04b00c39b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:44:13.660 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:13.655+0000 7f04a4ff9640 1 -- 172.21.15.88:0/950768915 shutdown_connections 2024-04-26T23:44:13.660 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:13.655+0000 7f04a4ff9640 1 -- 172.21.15.88:0/950768915 wait complete. 2024-04-26T23:44:13.689 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-04-26T23:44:13.689 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2024-04-26T23:44:13.689 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-04-26T23:44:13.689 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-04-26T23:44:13.892 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:13.886+0000 7fc4cffff640 1 Processor -- start 2024-04-26T23:44:13.893 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:13.886+0000 7fc4cffff640 1 -- start start 2024-04-26T23:44:13.893 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:13.888+0000 7fc4cffff640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fc4d01505d0 0x7fc4d00c55c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:13.893 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:13.888+0000 7fc4cffff640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc4d01509b0 0x7fc4d0156490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:13.893 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:13.888+0000 7fc4cffff640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc4d00c7ff0 con 0x7fc4d00c5b00 2024-04-26T23:44:13.893 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:13.888+0000 7fc4cffff640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7fc4d00c8260 con 0x7fc4d01509b0 2024-04-26T23:44:13.893 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:13.888+0000 7fc4cffff640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7fc4d00ab8f0 con 0x7fc4d01505d0 2024-04-26T23:44:13.893 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:13.888+0000 7fc4cf7fe640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fc4d00c5b00 0x7fc4d00c3130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:41050/0 (socket says 172.21.15.88:41050) 2024-04-26T23:44:13.893 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:13.888+0000 7fc4cf7fe640 1 -- 172.21.15.88:0/3953072950 learned_addr learned my addr 172.21.15.88:0/3953072950 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-26T23:44:13.893 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:13.888+0000 7fc4ce7fc640 1 --2- 172.21.15.88:0/3953072950 >> v2:172.21.15.88:3300/0 conn(0x7fc4d01509b0 0x7fc4d0156490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:13.893 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:13.888+0000 7fc4ceffd640 1 --2- 172.21.15.88:0/3953072950 >> v2:172.21.15.175:3300/0 conn(0x7fc4d01505d0 0x7fc4d00c55c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:13.894 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:13.889+0000 7fc4ce7fc640 1 -- 172.21.15.88:0/3953072950 >> v2:172.21.15.175:3300/0 conn(0x7fc4d01505d0 msgr2=0x7fc4d00c55c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:44:13.894 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:13.889+0000 7fc4ce7fc640 1 --2- 172.21.15.88:0/3953072950 >> v2:172.21.15.175:3300/0 conn(0x7fc4d01505d0 0x7fc4d00c55c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:13.894 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:13.889+0000 7fc4ce7fc640 1 -- 172.21.15.88:0/3953072950 >> v1:172.21.15.88:6789/0 conn(0x7fc4d00c5b00 legacy=0x7fc4d00c3130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:13.894 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:13.889+0000 7fc4ce7fc640 1 -- 172.21.15.88:0/3953072950 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4d00c8540 con 0x7fc4d01509b0 2024-04-26T23:44:13.897 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:13.890+0000 7fc4ce7fc640 1 --2- 172.21.15.88:0/3953072950 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc4d01509b0 0x7fc4d0156490 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fc4d0070f90 tx=0x7fc4c002c350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d893fac45420d50 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:13.898 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:13.894+0000 7fc4cdffb640 1 -- 172.21.15.88:0/3953072950 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4c0039070 con 0x7fc4d01509b0 2024-04-26T23:44:13.898 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:13.894+0000 7fc4cdffb640 1 -- 172.21.15.88:0/3953072950 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4c0034440 con 0x7fc4d01509b0 2024-04-26T23:44:13.898 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:13.894+0000 7fc4cdffb640 1 -- 172.21.15.88:0/3953072950 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4c00347f0 con 0x7fc4d01509b0 2024-04-26T23:44:13.899 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:13.895+0000 7fc4cffff640 1 -- 172.21.15.88:0/3953072950 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc4d01509b0 msgr2=0x7fc4d0156490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:13.899 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:13.895+0000 7fc4cffff640 1 --2- 172.21.15.88:0/3953072950 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc4d01509b0 0x7fc4d0156490 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fc4d0070f90 tx=0x7fc4c002c350 comp rx=0 tx=0).stop 2024-04-26T23:44:13.899 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:13.895+0000 7fc4cffff640 1 -- 172.21.15.88:0/3953072950 shutdown_connections 2024-04-26T23:44:13.899 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:13.895+0000 7fc4cffff640 1 --2- 172.21.15.88:0/3953072950 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc4d01509b0 0x7fc4d0156490 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:13.900 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:13.895+0000 7fc4cffff640 1 --2- 172.21.15.88:0/3953072950 >> v2:172.21.15.175:3300/0 conn(0x7fc4d01505d0 0x7fc4d00c55c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:13.900 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:13.895+0000 7fc4cffff640 1 -- 172.21.15.88:0/3953072950 >> 172.21.15.88:0/3953072950 conn(0x7fc4d00aa8d0 msgr2=0x7fc4d00aace0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:44:13.904 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:13.899+0000 7fc4cffff640 1 -- 172.21.15.88:0/3953072950 shutdown_connections 2024-04-26T23:44:13.904 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:13.899+0000 7fc4cffff640 1 -- 172.21.15.88:0/3953072950 wait complete. 2024-04-26T23:44:13.908 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:13.902+0000 7fc4cffff640 1 Processor -- start 2024-04-26T23:44:13.909 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:13.902+0000 7fc4cffff640 1 -- start start 2024-04-26T23:44:13.909 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:13.903+0000 7fc4cffff640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc4d00c5b00 0x7fc4d00bd750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:13.909 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:13.903+0000 7fc4cffff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc4d01505d0 0x7fc4d01eb450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:13.909 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:13.903+0000 7fc4ceffd640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc4d00c5b00 0x7fc4d00bd750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:13.909 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:13.904+0000 7fc4ceffd640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc4d00c5b00 0x7fc4d00bd750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.88:53126/0 (socket says 172.21.15.88:53126) 2024-04-26T23:44:13.909 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:13.904+0000 7fc4ce7fc640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc4d01505d0 0x7fc4d01eb450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:13.909 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:13.904+0000 7fc4ce7fc640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc4d01505d0 0x7fc4d01eb450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:59228/0 (socket says 172.21.15.88:59228) 2024-04-26T23:44:13.909 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:13.904+0000 7fc4cffff640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc4d01509b0 0x7fc4d014aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:13.909 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:13.904+0000 7fc4cffff640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fc4d00ac3d0 con 0x7fc4d01505d0 2024-04-26T23:44:13.909 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:13.904+0000 7fc4ceffd640 1 -- 172.21.15.88:0/3722795912 learned_addr learned my addr 172.21.15.88:0/3722795912 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:44:13.909 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:13.904+0000 7fc4cffff640 1 -- 172.21.15.88:0/3722795912 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc4d00c79a0 con 0x7fc4d01509b0 2024-04-26T23:44:13.909 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:13.904+0000 7fc4cf7fe640 1 --2- 172.21.15.88:0/3722795912 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc4d01509b0 0x7fc4d014aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:13.910 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:13.905+0000 7fc4cffff640 1 -- 172.21.15.88:0/3722795912 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fc4d00ab110 con 0x7fc4d00c5b00 2024-04-26T23:44:13.912 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:13.908+0000 7fc4ceffd640 1 -- 172.21.15.88:0/3722795912 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc4d01509b0 msgr2=0x7fc4d014aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:13.912 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:13.908+0000 7fc4ceffd640 1 --2- 172.21.15.88:0/3722795912 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc4d01509b0 0x7fc4d014aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:13.912 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:13.908+0000 7fc4ceffd640 1 -- 172.21.15.88:0/3722795912 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc4d01505d0 msgr2=0x7fc4d01eb450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:13.912 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:13.908+0000 7fc4ceffd640 1 --2- 172.21.15.88:0/3722795912 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc4d01505d0 0x7fc4d01eb450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:13.912 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:13.908+0000 7fc4ceffd640 1 -- 172.21.15.88:0/3722795912 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4d01500c0 con 0x7fc4d00c5b00 2024-04-26T23:44:13.913 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:13.910+0000 7fc4ceffd640 1 --2- 172.21.15.88:0/3722795912 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc4d00c5b00 0x7fc4d00bd750 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fc4c400d800 tx=0x7fc4c400dcc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:13.914 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:13.910+0000 7fc4b77fe640 1 -- 172.21.15.88:0/3722795912 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4c400b6c0 con 0x7fc4d00c5b00 2024-04-26T23:44:13.914 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:13.910+0000 7fc4b77fe640 1 -- 172.21.15.88:0/3722795912 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4c4019070 con 0x7fc4d00c5b00 2024-04-26T23:44:13.917 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:13.911+0000 7fc4cffff640 1 -- 172.21.15.88:0/3722795912 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4d00bdc90 con 0x7fc4d00c5b00 2024-04-26T23:44:13.917 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:13.911+0000 7fc4cffff640 1 -- 172.21.15.88:0/3722795912 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4d00a8bd0 con 0x7fc4d00c5b00 2024-04-26T23:44:13.917 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:13.911+0000 7fc4b77fe640 1 -- 172.21.15.88:0/3722795912 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4c400ba80 con 0x7fc4d00c5b00 2024-04-26T23:44:13.920 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:13.914+0000 7fc4cffff640 1 --2- 172.21.15.88:0/3722795912 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc4d01e9aa0 0x7fc4d014af70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:13.920 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:13.914+0000 7fc4cffff640 1 -- 172.21.15.88:0/3722795912 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fc4d014ff40 con 0x7fc4d01e9aa0 2024-04-26T23:44:13.920 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:13.915+0000 7fc4b77fe640 1 -- 172.21.15.88:0/3722795912 <== mon.2 v2:172.21.15.175:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc4c400bc20 con 0x7fc4d00c5b00 2024-04-26T23:44:13.920 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:13.916+0000 7fc4b77fe640 1 --2- 172.21.15.88:0/3722795912 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fc4bc06c8f0 0x7fc4bc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:13.920 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:13.916+0000 7fc4b77fe640 1 -- 172.21.15.88:0/3722795912 <== mon.2 v2:172.21.15.175:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6666+0+0 (secure 0 0 0) 0x7fc4c408c3a0 con 0x7fc4d00c5b00 2024-04-26T23:44:13.921 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:13.917+0000 7fc4cf7fe640 1 --2- 172.21.15.88:0/3722795912 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fc4bc06c8f0 0x7fc4bc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:13.921 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:13.917+0000 7fc4ce7fc640 1 --2- 172.21.15.88:0/3722795912 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc4d01e9aa0 0x7fc4d014af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:13.922 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:13.918+0000 7fc4ce7fc640 1 -- 172.21.15.88:0/3722795912 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc4d00a8f20 con 0x7fc4d01e9aa0 2024-04-26T23:44:13.922 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:13.918+0000 7fc4cf7fe640 1 --2- 172.21.15.88:0/3722795912 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fc4bc06c8f0 0x7fc4bc06edb0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fc4c80012e0 tx=0x7fc4c8005b70 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:13.922 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:13.918+0000 7fc4ce7fc640 1 --2- 172.21.15.88:0/3722795912 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc4d01e9aa0 0x7fc4d014af70 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fc4d00c6150 tx=0x7fc4c00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:13.924 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:13.919+0000 7fc4b77fe640 1 -- 172.21.15.88:0/3722795912 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4c0042020 con 0x7fc4d01e9aa0 2024-04-26T23:44:13.924 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:13.919+0000 7fc4b77fe640 1 -- 172.21.15.88:0/3722795912 <== mon.0 v2:172.21.15.88:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fc4c003a040 con 0x7fc4d01e9aa0 2024-04-26T23:44:13.924 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:13.920+0000 7fc4b77fe640 1 -- 172.21.15.88:0/3722795912 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc4d01e9aa0 msgr2=0x7fc4d014af70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:13.924 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:13.920+0000 7fc4b77fe640 1 --2- 172.21.15.88:0/3722795912 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc4d01e9aa0 0x7fc4d014af70 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fc4d00c6150 tx=0x7fc4c00046c0 comp rx=0 tx=0).stop 2024-04-26T23:44:13.924 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:13.920+0000 7fc4b77fe640 1 -- 172.21.15.88:0/3722795912 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc4d01e9aa0 msgr2=0x7fc4d014af70 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:44:13.924 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:13.920+0000 7fc4b77fe640 1 --2- 172.21.15.88:0/3722795912 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc4d01e9aa0 0x7fc4d014af70 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:13.947 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:13.943+0000 7fc4cffff640 1 --2- 172.21.15.88:0/3722795912 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc4d01eb990 0x7fc4d01e7c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:13.947 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:13.943+0000 7fc4cffff640 1 -- 172.21.15.88:0/3722795912 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fc4d014f000 con 0x7fc4d01eb990 2024-04-26T23:44:13.948 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:13.944+0000 7fc4ce7fc640 1 --2- 172.21.15.88:0/3722795912 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc4d01eb990 0x7fc4d01e7c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:13.948 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:13.944+0000 7fc4ce7fc640 1 -- 172.21.15.88:0/3722795912 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fc4d00506c0 con 0x7fc4d01eb990 2024-04-26T23:44:13.949 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:13.945+0000 7fc4ce7fc640 1 --2- 172.21.15.88:0/3722795912 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc4d01eb990 0x7fc4d01e7c70 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fc4c0000c00 tx=0x7fc4c0008030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:13.950 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:13.946+0000 7fc4b77fe640 1 -- 172.21.15.88:0/3722795912 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4c0042030 con 0x7fc4d01eb990 2024-04-26T23:44:13.950 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:13.946+0000 7fc4b77fe640 1 -- 172.21.15.88:0/3722795912 <== mon.0 v2:172.21.15.88:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4871 (secure 0 0 0) 0x7fc4c00093e0 con 0x7fc4d01eb990 2024-04-26T23:44:13.950 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:13.946+0000 7fc4b77fe640 1 -- 172.21.15.88:0/3722795912 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc4d01eb990 msgr2=0x7fc4d01e7c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:13.950 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:13.946+0000 7fc4b77fe640 1 --2- 172.21.15.88:0/3722795912 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc4d01eb990 0x7fc4d01e7c70 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fc4c0000c00 tx=0x7fc4c0008030 comp rx=0 tx=0).stop 2024-04-26T23:44:13.950 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:13.946+0000 7fc4b77fe640 1 -- 172.21.15.88:0/3722795912 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc4d01eb990 msgr2=0x7fc4d01e7c70 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:44:13.950 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:13.946+0000 7fc4b77fe640 1 --2- 172.21.15.88:0/3722795912 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc4d01eb990 0x7fc4d01e7c70 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:13.952 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-04-26T23:44:13.952 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2024-04-26T23:44:13.952 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2024-04-26T23:44:13.952 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "leader", 2024-04-26T23:44:13.953 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 32, 2024-04-26T23:44:13.953 INFO:teuthology.orchestra.run.smithi088.stdout: "uptime": 142917, 2024-04-26T23:44:13.953 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2024-04-26T23:44:13.953 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2024-04-26T23:44:13.953 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2024-04-26T23:44:13.953 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2024-04-26T23:44:13.953 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:44:13.953 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 15, 2024-04-26T23:44:13.953 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2024-04-26T23:44:13.953 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2450521708007866372", 2024-04-26T23:44:13.953 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2024-04-26T23:44:13.953 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-04-26T23:44:13.953 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-04-26T23:44:13.953 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-04-26T23:44:13.954 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-04-26T23:44:13.954 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-04-26T23:44:13.954 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-04-26T23:44:13.954 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-04-26T23:44:13.954 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-04-26T23:44:13.954 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-04-26T23:44:13.954 INFO:teuthology.orchestra.run.smithi088.stdout: "reef", 2024-04-26T23:44:13.954 INFO:teuthology.orchestra.run.smithi088.stdout: "squid" 2024-04-26T23:44:13.954 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:44:13.954 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540701547738038271", 2024-04-26T23:44:13.954 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2024-04-26T23:44:13.954 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-04-26T23:44:13.954 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-04-26T23:44:13.954 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-04-26T23:44:13.955 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-04-26T23:44:13.955 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-04-26T23:44:13.955 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-04-26T23:44:13.955 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-04-26T23:44:13.955 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-04-26T23:44:13.955 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-04-26T23:44:13.955 INFO:teuthology.orchestra.run.smithi088.stdout: "reef", 2024-04-26T23:44:13.955 INFO:teuthology.orchestra.run.smithi088.stdout: "squid" 2024-04-26T23:44:13.955 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:44:13.955 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:44:13.955 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2024-04-26T23:44:13.955 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2024-04-26T23:44:13.955 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2024-04-26T23:44:13.955 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2024-04-26T23:44:13.955 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2024-04-26T23:44:13.956 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "555255e9-7ef9-4454-8dc9-35e96b70035c", 2024-04-26T23:44:13.956 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2024-04-26T23:39:34.291658Z", 2024-04-26T23:44:13.956 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2024-04-26T23:39:34.291658Z", 2024-04-26T23:44:13.956 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 19, 2024-04-26T23:44:13.956 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "squid", 2024-04-26T23:44:13.956 INFO:teuthology.orchestra.run.smithi088.stdout: "election_strategy": 1, 2024-04-26T23:44:13.956 INFO:teuthology.orchestra.run.smithi088.stdout: "disallowed_leaders: ": "", 2024-04-26T23:44:13.956 INFO:teuthology.orchestra.run.smithi088.stdout: "stretch_mode": false, 2024-04-26T23:44:13.956 INFO:teuthology.orchestra.run.smithi088.stdout: "tiebreaker_mon": "", 2024-04-26T23:44:13.956 INFO:teuthology.orchestra.run.smithi088.stdout: "removed_ranks: ": "", 2024-04-26T23:44:13.956 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2024-04-26T23:44:13.956 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2024-04-26T23:44:13.956 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-04-26T23:44:13.956 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-04-26T23:44:13.956 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-04-26T23:44:13.957 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-04-26T23:44:13.957 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-04-26T23:44:13.957 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-04-26T23:44:13.957 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-04-26T23:44:13.957 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-04-26T23:44:13.957 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-04-26T23:44:13.957 INFO:teuthology.orchestra.run.smithi088.stdout: "reef", 2024-04-26T23:44:13.957 INFO:teuthology.orchestra.run.smithi088.stdout: "squid" 2024-04-26T23:44:13.957 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:44:13.957 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2024-04-26T23:44:13.957 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:44:13.957 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2024-04-26T23:44:13.957 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:44:13.957 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2024-04-26T23:44:13.958 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2024-04-26T23:44:13.958 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-04-26T23:44:13.958 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-04-26T23:44:13.958 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:44:13.958 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-04-26T23:44:13.958 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2024-04-26T23:44:13.958 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:44:13.958 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:44:13.958 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:44:13.958 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-04-26T23:44:13.958 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2024-04-26T23:44:13.958 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:44:13.958 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:44:13.958 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:44:13.958 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:44:13.959 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2024-04-26T23:44:13.959 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2024-04-26T23:44:13.959 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-04-26T23:44:13.959 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-04-26T23:44:13.959 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-04-26T23:44:13.959 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:44:13.959 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:44:13.959 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2024-04-26T23:44:13.959 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2024-04-26T23:44:13.959 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-04-26T23:44:13.959 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-04-26T23:44:13.959 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:44:13.959 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-04-26T23:44:13.959 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:3300", 2024-04-26T23:44:13.960 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:44:13.960 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:44:13.960 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:44:13.960 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-04-26T23:44:13.960 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6789", 2024-04-26T23:44:13.960 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:44:13.960 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:44:13.960 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:44:13.960 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:44:13.960 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6789/0", 2024-04-26T23:44:13.960 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.175:6789/0", 2024-04-26T23:44:13.960 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-04-26T23:44:13.960 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-04-26T23:44:13.960 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-04-26T23:44:13.960 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:44:13.961 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:44:13.961 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2024-04-26T23:44:13.961 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2024-04-26T23:44:13.961 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-04-26T23:44:13.961 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-04-26T23:44:13.961 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:44:13.961 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-04-26T23:44:13.961 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:3301", 2024-04-26T23:44:13.961 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:44:13.961 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:44:13.961 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:44:13.961 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-04-26T23:44:13.961 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6790", 2024-04-26T23:44:13.961 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:44:13.961 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:44:13.962 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:44:13.962 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:44:13.962 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6790/0", 2024-04-26T23:44:13.962 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.175:6790/0", 2024-04-26T23:44:13.962 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-04-26T23:44:13.962 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-04-26T23:44:13.962 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-04-26T23:44:13.962 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:44:13.962 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:44:13.962 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:44:13.962 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2024-04-26T23:44:13.962 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2024-04-26T23:44:13.962 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:44:13.963 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:44:13.963 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:44:13.963 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2024-04-26T23:44:13.963 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:44:13.963 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:44:13.963 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": [ 2024-04-26T23:44:13.963 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:44:13.963 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:44:13.963 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:44:13.963 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 3 2024-04-26T23:44:13.963 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:44:13.963 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:44:13.963 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2024-04-26T23:44:13.964 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:44:13.964 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x2f018fb87aa4aafe", 2024-04-26T23:44:13.964 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:44:13.964 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2024-04-26T23:44:13.964 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:44:13.964 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:44:13.964 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:44:13.964 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:44:13.964 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2024-04-26T23:44:13.964 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:44:13.964 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:44:13.964 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:44:13.964 INFO:teuthology.orchestra.run.smithi088.stdout: "stretch_mode": false 2024-04-26T23:44:13.964 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-04-26T23:44:13.965 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:13.949+0000 7fc4cffff640 1 -- 172.21.15.88:0/3722795912 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fc4bc06c8f0 msgr2=0x7fc4bc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:13.965 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:13.949+0000 7fc4cffff640 1 --2- 172.21.15.88:0/3722795912 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fc4bc06c8f0 0x7fc4bc06edb0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fc4c80012e0 tx=0x7fc4c8005b70 comp rx=0 tx=0).stop 2024-04-26T23:44:13.965 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:13.949+0000 7fc4cf7fe640 1 -- 172.21.15.88:0/3722795912 reap_dead start 2024-04-26T23:44:13.965 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:13.949+0000 7fc4cffff640 1 -- 172.21.15.88:0/3722795912 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc4d00c5b00 msgr2=0x7fc4d00bd750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:13.965 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:13.949+0000 7fc4cffff640 1 --2- 172.21.15.88:0/3722795912 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc4d00c5b00 0x7fc4d00bd750 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fc4c400d800 tx=0x7fc4c400dcc0 comp rx=0 tx=0).stop 2024-04-26T23:44:13.965 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:13.949+0000 7fc4cffff640 1 -- 172.21.15.88:0/3722795912 shutdown_connections 2024-04-26T23:44:13.965 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:13.949+0000 7fc4cffff640 1 --2- 172.21.15.88:0/3722795912 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc4d00c5b00 0x7fc4d00bd750 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:13.965 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:13.949+0000 7fc4cffff640 1 -- 172.21.15.88:0/3722795912 >> 172.21.15.88:0/3722795912 conn(0x7fc4d00aa8d0 msgr2=0x7fc4d00a97c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:44:13.965 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:13.949+0000 7fc4cffff640 1 -- 172.21.15.88:0/3722795912 shutdown_connections 2024-04-26T23:44:13.966 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:13.949+0000 7fc4cffff640 1 -- 172.21.15.88:0/3722795912 wait complete. 2024-04-26T23:44:13.979 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-04-26T23:44:13.979 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-04-26T23:44:13.979 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-04-26T23:44:14.191 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:14.187+0000 7f9592e62640 1 Processor -- start 2024-04-26T23:44:14.191 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:14.187+0000 7f9592e62640 1 -- start start 2024-04-26T23:44:14.193 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:14.188+0000 7f9592e62640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f958c15e170 0x7f958c15e660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:14.193 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:14.188+0000 7f9592e62640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f958c0c3750 0x7f958c06eb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:14.193 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:14.188+0000 7f9592e62640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f958c15edd0 con 0x7f958c0abfc0 2024-04-26T23:44:14.193 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:14.188+0000 7f9592e62640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f958c15eba0 con 0x7f958c0c3750 2024-04-26T23:44:14.193 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:14.188+0000 7f9592e62640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f958c06e3d0 con 0x7f958c15e170 2024-04-26T23:44:14.193 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:14.189+0000 7f95913ff640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f958c0c3750 0x7f958c06eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:14.193 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:14.189+0000 7f95913ff640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f958c0c3750 0x7f958c06eb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:59258/0 (socket says 172.21.15.88:59258) 2024-04-26T23:44:14.194 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:14.189+0000 7f95913ff640 1 -- 172.21.15.88:0/652217452 learned_addr learned my addr 172.21.15.88:0/652217452 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:44:14.194 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:14.189+0000 7f958bfff640 1 --2- 172.21.15.88:0/652217452 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f958c15e170 0x7f958c15e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:14.194 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:14.190+0000 7f95913ff640 1 -- 172.21.15.88:0/652217452 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f958c15e170 msgr2=0x7f958c15e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:44:14.194 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:14.190+0000 7f95913ff640 1 --2- 172.21.15.88:0/652217452 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f958c15e170 0x7f958c15e660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:14.195 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:14.190+0000 7f95913ff640 1 -- 172.21.15.88:0/652217452 >> v1:172.21.15.88:6789/0 conn(0x7f958c0abfc0 legacy=0x7f958c15da60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:44:14.195 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:14.190+0000 7f95913ff640 1 -- 172.21.15.88:0/652217452 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f958c15f0b0 con 0x7f958c0c3750 2024-04-26T23:44:14.196 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:14.192+0000 7f95913ff640 1 --2- 172.21.15.88:0/652217452 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f958c0c3750 0x7f958c06eb40 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f958400b1a0 tx=0x7f958402a920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f1d2d696cad8528 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:14.197 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:14.193+0000 7f958b7fe640 1 -- 172.21.15.88:0/652217452 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f958402d070 con 0x7f958c0c3750 2024-04-26T23:44:14.197 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:14.193+0000 7f958b7fe640 1 -- 172.21.15.88:0/652217452 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9584031430 con 0x7f958c0c3750 2024-04-26T23:44:14.197 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:14.193+0000 7f958b7fe640 1 -- 172.21.15.88:0/652217452 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9584031800 con 0x7f958c0c3750 2024-04-26T23:44:14.198 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:14.194+0000 7f9592e62640 1 -- 172.21.15.88:0/652217452 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f958c0c3750 msgr2=0x7f958c06eb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:14.199 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:14.194+0000 7f9592e62640 1 --2- 172.21.15.88:0/652217452 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f958c0c3750 0x7f958c06eb40 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f958400b1a0 tx=0x7f958402a920 comp rx=0 tx=0).stop 2024-04-26T23:44:14.199 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:14.194+0000 7f9592e62640 1 -- 172.21.15.88:0/652217452 shutdown_connections 2024-04-26T23:44:14.199 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:14.194+0000 7f9592e62640 1 --2- 172.21.15.88:0/652217452 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f958c0c3750 0x7f958c06eb40 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:14.199 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:14.194+0000 7f9592e62640 1 --2- 172.21.15.88:0/652217452 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f958c15e170 0x7f958c15e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:14.199 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:14.194+0000 7f9592e62640 1 -- 172.21.15.88:0/652217452 >> 172.21.15.88:0/652217452 conn(0x7f958c06c310 msgr2=0x7f958c06c6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:44:14.200 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:14.196+0000 7f9592e62640 1 -- 172.21.15.88:0/652217452 shutdown_connections 2024-04-26T23:44:14.200 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:14.196+0000 7f9592e62640 1 -- 172.21.15.88:0/652217452 wait complete. 2024-04-26T23:44:14.202 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:14.199+0000 7f9592e62640 1 Processor -- start 2024-04-26T23:44:14.208 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:14.200+0000 7f9592e62640 1 -- start start 2024-04-26T23:44:14.208 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:14.202+0000 7f9592e62640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f958c0abfc0 0x7f958c0a56a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:14.208 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:14.202+0000 7f9592e62640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f958c0c3750 0x7f958c071840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:14.208 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:14.202+0000 7f9592e62640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f958c15e170 0x7f958c071d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:14.208 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:14.202+0000 7f95913ff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f958c15e170 0x7f958c071d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:14.208 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:14.203+0000 7f95913ff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f958c15e170 0x7f958c071d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:59266/0 (socket says 172.21.15.88:59266) 2024-04-26T23:44:14.208 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:14.203+0000 7f9590bfe640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f958c0abfc0 0x7f958c0a56a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:14.208 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:14.203+0000 7f958bfff640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f958c0c3750 0x7f958c071840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:14.209 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:14.203+0000 7f95913ff640 1 -- 172.21.15.88:0/3110572036 learned_addr learned my addr 172.21.15.88:0/3110572036 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:44:14.209 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:14.203+0000 7f9592e62640 1 -- 172.21.15.88:0/3110572036 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f958c15c560 con 0x7f958c15e170 2024-04-26T23:44:14.209 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:14.203+0000 7f9592e62640 1 -- 172.21.15.88:0/3110572036 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f958c06e620 con 0x7f958c0abfc0 2024-04-26T23:44:14.209 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:14.203+0000 7f9592e62640 1 -- 172.21.15.88:0/3110572036 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f958c0ac3a0 con 0x7f958c0c3750 2024-04-26T23:44:14.209 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:14.203+0000 7f95913ff640 1 -- 172.21.15.88:0/3110572036 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f958c0c3750 msgr2=0x7f958c071840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:14.209 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:14.203+0000 7f95913ff640 1 --2- 172.21.15.88:0/3110572036 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f958c0c3750 0x7f958c071840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:14.209 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:14.203+0000 7f95913ff640 1 -- 172.21.15.88:0/3110572036 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f958c0abfc0 msgr2=0x7f958c0a56a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:14.209 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:14.203+0000 7f95913ff640 1 --2- 172.21.15.88:0/3110572036 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f958c0abfc0 0x7f958c0a56a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:14.210 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:14.203+0000 7f95913ff640 1 -- 172.21.15.88:0/3110572036 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f958c074b30 con 0x7f958c15e170 2024-04-26T23:44:14.210 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:14.204+0000 7f95913ff640 1 --2- 172.21.15.88:0/3110572036 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f958c15e170 0x7f958c071d80 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f958400b2c0 tx=0x7f9584004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:14.211 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:14.206+0000 7f95897fa640 1 -- 172.21.15.88:0/3110572036 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95840315e0 con 0x7f958c15e170 2024-04-26T23:44:14.211 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:14.206+0000 7f95897fa640 1 -- 172.21.15.88:0/3110572036 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9584031780 con 0x7f958c15e170 2024-04-26T23:44:14.211 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:14.206+0000 7f95897fa640 1 -- 172.21.15.88:0/3110572036 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9584031b30 con 0x7f958c15e170 2024-04-26T23:44:14.214 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:14.207+0000 7f9592e62640 1 -- 172.21.15.88:0/3110572036 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f958c1f0980 con 0x7f958c15e170 2024-04-26T23:44:14.218 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:14.208+0000 7f9592e62640 1 -- 172.21.15.88:0/3110572036 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f958c1f0f40 con 0x7f958c15e170 2024-04-26T23:44:14.218 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:14.213+0000 7f95897fa640 1 -- 172.21.15.88:0/3110572036 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f9584031cd0 con 0x7f958c15e170 2024-04-26T23:44:14.218 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:14.213+0000 7f95897fa640 1 --2- 172.21.15.88:0/3110572036 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f957806c970 0x7f957806ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:14.218 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:14.213+0000 7f9592e62640 1 --2- 172.21.15.88:0/3110572036 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f958c1f1460 0x7f958c154800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:14.218 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:14.213+0000 7f9592e62640 1 -- 172.21.15.88:0/3110572036 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f958c0a68c0 con 0x7f958c1f1460 2024-04-26T23:44:14.218 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:14.213+0000 7f95897fa640 1 -- 172.21.15.88:0/3110572036 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6666+0+0 (secure 0 0 0) 0x7f95840acc30 con 0x7f958c15e170 2024-04-26T23:44:14.218 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:14.214+0000 7f9590bfe640 1 --2- 172.21.15.88:0/3110572036 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f957806c970 0x7f957806ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:14.219 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:14.214+0000 7f9590bfe640 1 --2- 172.21.15.88:0/3110572036 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f957806c970 0x7f957806ee30 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f958000a730 tx=0x7f9580008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:14.220 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:14.216+0000 7f958bfff640 1 --2- 172.21.15.88:0/3110572036 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f958c1f1460 0x7f958c154800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:14.221 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:14.217+0000 7f958bfff640 1 -- 172.21.15.88:0/3110572036 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f958c1f07a0 con 0x7f958c1f1460 2024-04-26T23:44:14.222 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:14.218+0000 7f958bfff640 1 --2- 172.21.15.88:0/3110572036 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f958c1f1460 0x7f958c154800 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f958c15e5c0 tx=0x7f957c00eba0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:14.222 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:14.219+0000 7f95897fa640 1 -- 172.21.15.88:0/3110572036 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f957c017070 con 0x7f958c1f1460 2024-04-26T23:44:14.224 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:14.219+0000 7f95897fa640 1 -- 172.21.15.88:0/3110572036 <== mon.1 v2:172.21.15.175:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f957c00c740 con 0x7f958c1f1460 2024-04-26T23:44:14.224 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:14.219+0000 7f95897fa640 1 -- 172.21.15.88:0/3110572036 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f958c1f1460 msgr2=0x7f958c154800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:14.224 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:14.219+0000 7f95897fa640 1 --2- 172.21.15.88:0/3110572036 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f958c1f1460 0x7f958c154800 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f958c15e5c0 tx=0x7f957c00eba0 comp rx=0 tx=0).stop 2024-04-26T23:44:14.224 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:14.219+0000 7f95897fa640 1 -- 172.21.15.88:0/3110572036 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f958c1f1460 msgr2=0x7f958c154800 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:44:14.224 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:14.219+0000 7f95897fa640 1 --2- 172.21.15.88:0/3110572036 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f958c1f1460 0x7f958c154800 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:14.243 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:14.238+0000 7f9592e62640 1 --2- 172.21.15.88:0/3110572036 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f958c068a70 0x7f958c154d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:14.243 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:14.238+0000 7f9592e62640 1 -- 172.21.15.88:0/3110572036 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f958c1f1140 con 0x7f958c068a70 2024-04-26T23:44:14.244 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:14.240+0000 7f958bfff640 1 --2- 172.21.15.88:0/3110572036 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f958c068a70 0x7f958c154d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:14.246 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:14.242+0000 7f958bfff640 1 -- 172.21.15.88:0/3110572036 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f958c0507a0 con 0x7f958c068a70 2024-04-26T23:44:14.248 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:14.244+0000 7f958bfff640 1 --2- 172.21.15.88:0/3110572036 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f958c068a70 0x7f958c154d40 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f958c15e5c0 tx=0x7f957c004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:14.250 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:14.246+0000 7f95897fa640 1 -- 172.21.15.88:0/3110572036 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f957c00f040 con 0x7f958c068a70 2024-04-26T23:44:14.250 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:14.246+0000 7f95897fa640 1 -- 172.21.15.88:0/3110572036 <== mon.1 v2:172.21.15.175:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5066 (secure 0 0 0) 0x7f957c013410 con 0x7f958c068a70 2024-04-26T23:44:14.250 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:14.246+0000 7f95897fa640 1 -- 172.21.15.88:0/3110572036 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f958c068a70 msgr2=0x7f958c154d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:14.250 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:14.246+0000 7f95897fa640 1 --2- 172.21.15.88:0/3110572036 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f958c068a70 0x7f958c154d40 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f958c15e5c0 tx=0x7f957c004730 comp rx=0 tx=0).stop 2024-04-26T23:44:14.250 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:14.246+0000 7f95897fa640 1 -- 172.21.15.88:0/3110572036 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f958c068a70 msgr2=0x7f958c154d40 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:44:14.251 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:14.246+0000 7f95897fa640 1 --2- 172.21.15.88:0/3110572036 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f958c068a70 0x7f958c154d40 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:14.257 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-04-26T23:44:14.257 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2024-04-26T23:44:14.257 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2024-04-26T23:44:14.257 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "peon", 2024-04-26T23:44:14.257 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 32, 2024-04-26T23:44:14.257 INFO:teuthology.orchestra.run.smithi088.stdout: "uptime": 246589, 2024-04-26T23:44:14.257 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2024-04-26T23:44:14.257 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2024-04-26T23:44:14.257 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2024-04-26T23:44:14.257 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2024-04-26T23:44:14.257 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:44:14.257 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 16, 2024-04-26T23:44:14.257 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2024-04-26T23:44:14.258 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2450521708007866372", 2024-04-26T23:44:14.258 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2024-04-26T23:44:14.258 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-04-26T23:44:14.258 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-04-26T23:44:14.258 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-04-26T23:44:14.258 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-04-26T23:44:14.258 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-04-26T23:44:14.258 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-04-26T23:44:14.258 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-04-26T23:44:14.258 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-04-26T23:44:14.258 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-04-26T23:44:14.258 INFO:teuthology.orchestra.run.smithi088.stdout: "reef", 2024-04-26T23:44:14.258 INFO:teuthology.orchestra.run.smithi088.stdout: "squid" 2024-04-26T23:44:14.258 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:44:14.259 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540701547738038271", 2024-04-26T23:44:14.259 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2024-04-26T23:44:14.259 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-04-26T23:44:14.259 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-04-26T23:44:14.259 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-04-26T23:44:14.259 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-04-26T23:44:14.259 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-04-26T23:44:14.259 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-04-26T23:44:14.259 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-04-26T23:44:14.259 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-04-26T23:44:14.259 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-04-26T23:44:14.259 INFO:teuthology.orchestra.run.smithi088.stdout: "reef", 2024-04-26T23:44:14.259 INFO:teuthology.orchestra.run.smithi088.stdout: "squid" 2024-04-26T23:44:14.259 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:44:14.259 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:44:14.260 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2024-04-26T23:44:14.260 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2024-04-26T23:44:14.260 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2024-04-26T23:44:14.260 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2024-04-26T23:44:14.260 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2024-04-26T23:44:14.260 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "555255e9-7ef9-4454-8dc9-35e96b70035c", 2024-04-26T23:44:14.260 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2024-04-26T23:39:34.291658Z", 2024-04-26T23:44:14.260 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2024-04-26T23:39:34.291658Z", 2024-04-26T23:44:14.260 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 19, 2024-04-26T23:44:14.260 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "squid", 2024-04-26T23:44:14.260 INFO:teuthology.orchestra.run.smithi088.stdout: "election_strategy": 1, 2024-04-26T23:44:14.260 INFO:teuthology.orchestra.run.smithi088.stdout: "disallowed_leaders: ": "", 2024-04-26T23:44:14.260 INFO:teuthology.orchestra.run.smithi088.stdout: "stretch_mode": false, 2024-04-26T23:44:14.260 INFO:teuthology.orchestra.run.smithi088.stdout: "tiebreaker_mon": "", 2024-04-26T23:44:14.261 INFO:teuthology.orchestra.run.smithi088.stdout: "removed_ranks: ": "", 2024-04-26T23:44:14.261 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2024-04-26T23:44:14.261 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2024-04-26T23:44:14.261 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-04-26T23:44:14.261 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-04-26T23:44:14.261 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-04-26T23:44:14.261 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-04-26T23:44:14.261 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-04-26T23:44:14.261 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-04-26T23:44:14.261 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-04-26T23:44:14.261 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-04-26T23:44:14.261 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-04-26T23:44:14.261 INFO:teuthology.orchestra.run.smithi088.stdout: "reef", 2024-04-26T23:44:14.261 INFO:teuthology.orchestra.run.smithi088.stdout: "squid" 2024-04-26T23:44:14.261 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:44:14.262 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2024-04-26T23:44:14.262 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:44:14.262 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2024-04-26T23:44:14.262 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:44:14.262 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2024-04-26T23:44:14.262 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2024-04-26T23:44:14.262 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-04-26T23:44:14.262 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-04-26T23:44:14.262 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:44:14.262 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-04-26T23:44:14.262 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2024-04-26T23:44:14.262 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:44:14.262 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:44:14.262 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:44:14.263 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-04-26T23:44:14.263 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2024-04-26T23:44:14.263 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:44:14.263 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:44:14.263 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:44:14.263 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:44:14.263 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2024-04-26T23:44:14.263 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2024-04-26T23:44:14.263 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-04-26T23:44:14.263 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-04-26T23:44:14.263 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-04-26T23:44:14.263 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:44:14.263 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:44:14.263 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2024-04-26T23:44:14.263 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2024-04-26T23:44:14.263 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-04-26T23:44:14.264 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-04-26T23:44:14.264 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:44:14.264 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-04-26T23:44:14.264 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:3300", 2024-04-26T23:44:14.264 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:44:14.264 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:44:14.264 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:44:14.264 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-04-26T23:44:14.264 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6789", 2024-04-26T23:44:14.264 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:44:14.264 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:44:14.264 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:44:14.264 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:44:14.264 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6789/0", 2024-04-26T23:44:14.265 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.175:6789/0", 2024-04-26T23:44:14.265 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-04-26T23:44:14.265 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-04-26T23:44:14.265 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-04-26T23:44:14.265 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:44:14.265 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:44:14.265 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2024-04-26T23:44:14.265 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2024-04-26T23:44:14.265 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-04-26T23:44:14.265 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-04-26T23:44:14.265 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:44:14.265 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-04-26T23:44:14.265 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:3301", 2024-04-26T23:44:14.265 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:44:14.265 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:44:14.266 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:44:14.266 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-04-26T23:44:14.266 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6790", 2024-04-26T23:44:14.266 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:44:14.266 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:44:14.266 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:44:14.266 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:44:14.266 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6790/0", 2024-04-26T23:44:14.266 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.175:6790/0", 2024-04-26T23:44:14.266 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-04-26T23:44:14.266 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-04-26T23:44:14.266 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-04-26T23:44:14.266 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:44:14.267 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:44:14.267 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:44:14.267 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2024-04-26T23:44:14.267 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2024-04-26T23:44:14.267 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:44:14.267 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:44:14.267 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:44:14.267 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2024-04-26T23:44:14.267 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:44:14.267 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:44:14.267 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": [ 2024-04-26T23:44:14.267 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:44:14.267 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:44:14.267 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:44:14.267 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 4 2024-04-26T23:44:14.267 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:44:14.268 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:44:14.268 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": [ 2024-04-26T23:44:14.268 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:44:14.268 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:44:14.268 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:44:14.268 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 5 2024-04-26T23:44:14.268 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:44:14.268 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:44:14.268 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2024-04-26T23:44:14.268 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:44:14.268 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:44:14.268 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:44:14.268 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 4 2024-04-26T23:44:14.268 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:44:14.269 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:44:14.269 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": [ 2024-04-26T23:44:14.269 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:44:14.269 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:44:14.269 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:44:14.269 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2024-04-26T23:44:14.269 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:44:14.269 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:44:14.269 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:44:14.269 INFO:teuthology.orchestra.run.smithi088.stdout: "stretch_mode": false 2024-04-26T23:44:14.269 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-04-26T23:44:14.270 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:14.260+0000 7f9572ffd640 1 -- 172.21.15.88:0/3110572036 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f957806c970 msgr2=0x7f957806ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:14.270 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:14.260+0000 7f9572ffd640 1 --2- 172.21.15.88:0/3110572036 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f957806c970 0x7f957806ee30 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f958000a730 tx=0x7f9580008040 comp rx=0 tx=0).stop 2024-04-26T23:44:14.270 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:14.260+0000 7f9572ffd640 1 -- 172.21.15.88:0/3110572036 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f958c15e170 msgr2=0x7f958c071d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:14.270 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:14.260+0000 7f9572ffd640 1 --2- 172.21.15.88:0/3110572036 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f958c15e170 0x7f958c071d80 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f958400b2c0 tx=0x7f9584004a40 comp rx=0 tx=0).stop 2024-04-26T23:44:14.270 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:14.261+0000 7f95913ff640 1 -- 172.21.15.88:0/3110572036 reap_dead start 2024-04-26T23:44:14.270 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:14.261+0000 7f95913ff640 1 -- 172.21.15.88:0/3110572036 reap_dead start 2024-04-26T23:44:14.270 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:14.261+0000 7f9572ffd640 1 -- 172.21.15.88:0/3110572036 shutdown_connections 2024-04-26T23:44:14.271 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:14.261+0000 7f9572ffd640 1 -- 172.21.15.88:0/3110572036 >> 172.21.15.88:0/3110572036 conn(0x7f958c06c310 msgr2=0x7f958c0c5ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:44:14.271 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:14.265+0000 7f9572ffd640 1 -- 172.21.15.88:0/3110572036 shutdown_connections 2024-04-26T23:44:14.271 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:14.265+0000 7f9572ffd640 1 -- 172.21.15.88:0/3110572036 wait complete. 2024-04-26T23:44:14.296 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-04-26T23:44:14.297 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-04-26T23:44:14.297 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-04-26T23:44:14.497 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:14.490+0000 7eff3de10640 1 Processor -- start 2024-04-26T23:44:14.497 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:14.490+0000 7eff3de10640 1 -- start start 2024-04-26T23:44:14.497 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:14.491+0000 7eff3de10640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7eff300dbfe0 0x7eff3003e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:14.497 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:14.491+0000 7eff3de10640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7eff3003ece0 0x7eff300069b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:14.498 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:14.491+0000 7eff3de10640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff30031170 con 0x7eff3000b0d0 2024-04-26T23:44:14.498 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:14.491+0000 7eff3de10640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7eff30007600 con 0x7eff300dbfe0 2024-04-26T23:44:14.498 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:14.491+0000 7eff3de10640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7eff3004aa70 con 0x7eff3003ece0 2024-04-26T23:44:14.498 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:14.493+0000 7eff37fff640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7eff3003ece0 0x7eff300069b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:14.498 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:14.493+0000 7eff37fff640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7eff3003ece0 0x7eff300069b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.88:53158/0 (socket says 172.21.15.88:53158) 2024-04-26T23:44:14.498 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:14.493+0000 7eff37fff640 1 -- 172.21.15.88:0/364626555 learned_addr learned my addr 172.21.15.88:0/364626555 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:44:14.499 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:14.493+0000 7eff37fff640 1 -- 172.21.15.88:0/364626555 >> v2:172.21.15.175:3300/0 conn(0x7eff300dbfe0 msgr2=0x7eff3003e7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:44:14.499 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:14.493+0000 7eff37fff640 1 --2- 172.21.15.88:0/364626555 >> v2:172.21.15.175:3300/0 conn(0x7eff300dbfe0 0x7eff3003e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:14.499 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:14.493+0000 7eff37fff640 1 -- 172.21.15.88:0/364626555 >> v1:172.21.15.88:6789/0 conn(0x7eff3000b0d0 legacy=0x7eff30006ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:44:14.499 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:14.493+0000 7eff37fff640 1 -- 172.21.15.88:0/364626555 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff30031430 con 0x7eff3003ece0 2024-04-26T23:44:14.499 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:14.495+0000 7eff37fff640 1 --2- 172.21.15.88:0/364626555 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7eff3003ece0 0x7eff300069b0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7eff2c009870 tx=0x7eff2c02a1a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c9c761375a64e002 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:14.499 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:14.495+0000 7eff377fe640 1 -- 172.21.15.88:0/364626555 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff2c037070 con 0x7eff3003ece0 2024-04-26T23:44:14.500 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:14.495+0000 7eff377fe640 1 -- 172.21.15.88:0/364626555 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff2c032440 con 0x7eff3003ece0 2024-04-26T23:44:14.501 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:14.495+0000 7eff377fe640 1 -- 172.21.15.88:0/364626555 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff2c032810 con 0x7eff3003ece0 2024-04-26T23:44:14.501 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:14.496+0000 7eff3de10640 1 -- 172.21.15.88:0/364626555 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7eff3003ece0 msgr2=0x7eff300069b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:14.501 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:14.496+0000 7eff3de10640 1 --2- 172.21.15.88:0/364626555 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7eff3003ece0 0x7eff300069b0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7eff2c009870 tx=0x7eff2c02a1a0 comp rx=0 tx=0).stop 2024-04-26T23:44:14.503 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:14.499+0000 7eff3de10640 1 -- 172.21.15.88:0/364626555 shutdown_connections 2024-04-26T23:44:14.503 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:14.499+0000 7eff3de10640 1 --2- 172.21.15.88:0/364626555 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7eff3003ece0 0x7eff300069b0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:14.503 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:14.499+0000 7eff3de10640 1 --2- 172.21.15.88:0/364626555 >> v2:172.21.15.175:3300/0 conn(0x7eff300dbfe0 0x7eff3003e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:14.503 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:14.499+0000 7eff3de10640 1 -- 172.21.15.88:0/364626555 >> 172.21.15.88:0/364626555 conn(0x7eff30005e90 msgr2=0x7eff300062a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:44:14.506 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:14.503+0000 7eff3de10640 1 -- 172.21.15.88:0/364626555 shutdown_connections 2024-04-26T23:44:14.508 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:14.503+0000 7eff3de10640 1 -- 172.21.15.88:0/364626555 wait complete. 2024-04-26T23:44:14.511 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:14.507+0000 7eff3de10640 1 Processor -- start 2024-04-26T23:44:14.511 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:14.507+0000 7eff3de10640 1 -- start start 2024-04-26T23:44:14.512 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:14.508+0000 7eff3de10640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7eff3000b0d0 0x7eff3002b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:14.512 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:14.508+0000 7eff3de10640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7eff3003ece0 0x7eff30044400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:14.512 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:14.508+0000 7eff3de10640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7eff300dbfe0 0x7eff30044940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:14.512 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:14.508+0000 7eff3de10640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7eff300096a0 con 0x7eff300dbfe0 2024-04-26T23:44:14.512 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:14.508+0000 7eff3de10640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7eff3004b3d0 con 0x7eff3003ece0 2024-04-26T23:44:14.512 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:14.508+0000 7eff3de10640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7eff300dc3c0 con 0x7eff3000b0d0 2024-04-26T23:44:14.513 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:14.509+0000 7eff3d60f640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7eff300dbfe0 0x7eff30044940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:14.513 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:14.509+0000 7eff3d60f640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7eff300dbfe0 0x7eff30044940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:59276/0 (socket says 172.21.15.88:59276) 2024-04-26T23:44:14.513 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:14.509+0000 7eff3d60f640 1 -- 172.21.15.88:0/1656122439 learned_addr learned my addr 172.21.15.88:0/1656122439 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:44:14.514 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:14.509+0000 7eff37fff640 1 --2- 172.21.15.88:0/1656122439 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7eff3003ece0 0x7eff30044400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:14.515 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:14.509+0000 7eff37fff640 1 -- 172.21.15.88:0/1656122439 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7eff3000b0d0 msgr2=0x7eff3002b6e0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-26T23:44:14.515 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:14.509+0000 7eff37fff640 1 --2- 172.21.15.88:0/1656122439 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7eff3000b0d0 0x7eff3002b6e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:14.515 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:14.509+0000 7eff37fff640 1 -- 172.21.15.88:0/1656122439 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7eff300dbfe0 msgr2=0x7eff30044940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:14.515 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:14.509+0000 7eff37fff640 1 --2- 172.21.15.88:0/1656122439 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7eff300dbfe0 0x7eff30044940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:14.515 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:14.509+0000 7eff37fff640 1 -- 172.21.15.88:0/1656122439 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff300dded0 con 0x7eff3003ece0 2024-04-26T23:44:14.515 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:14.510+0000 7eff3d60f640 1 --2- 172.21.15.88:0/1656122439 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7eff300dbfe0 0x7eff30044940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:44:14.515 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:14.510+0000 7eff37fff640 1 --2- 172.21.15.88:0/1656122439 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7eff3003ece0 0x7eff30044400 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7eff300df940 tx=0x7eff2c0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:14.518 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:14.514+0000 7eff357fa640 1 -- 172.21.15.88:0/1656122439 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff2c041070 con 0x7eff3003ece0 2024-04-26T23:44:14.518 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:14.514+0000 7eff357fa640 1 -- 172.21.15.88:0/1656122439 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff2c03c950 con 0x7eff3003ece0 2024-04-26T23:44:14.518 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:14.514+0000 7eff3de10640 1 -- 172.21.15.88:0/1656122439 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff300ca740 con 0x7eff3003ece0 2024-04-26T23:44:14.518 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:14.514+0000 7eff357fa640 1 -- 172.21.15.88:0/1656122439 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff2c037040 con 0x7eff3003ece0 2024-04-26T23:44:14.518 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:14.514+0000 7eff3de10640 1 -- 172.21.15.88:0/1656122439 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff300cb460 con 0x7eff3003ece0 2024-04-26T23:44:14.519 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:14.516+0000 7eff3de10640 1 --2- 172.21.15.88:0/1656122439 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7eff18002a70 0x7eff18004f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:14.520 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:14.516+0000 7eff3de10640 1 -- 172.21.15.88:0/1656122439 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7eff18007ec0 con 0x7eff18002a70 2024-04-26T23:44:14.521 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:14.516+0000 7eff3ce0e640 1 --2- 172.21.15.88:0/1656122439 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7eff18002a70 0x7eff18004f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:14.521 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:14.516+0000 7eff357fa640 1 -- 172.21.15.88:0/1656122439 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7eff2c03a070 con 0x7eff3003ece0 2024-04-26T23:44:14.522 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:14.517+0000 7eff3ce0e640 1 -- 172.21.15.88:0/1656122439 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7eff180080c0 con 0x7eff18002a70 2024-04-26T23:44:14.522 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:14.517+0000 7eff357fa640 1 --2- 172.21.15.88:0/1656122439 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7eff1c06c9f0 0x7eff1c06eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:14.522 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:14.517+0000 7eff357fa640 1 -- 172.21.15.88:0/1656122439 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6666+0+0 (secure 0 0 0) 0x7eff2c0abeb0 con 0x7eff3003ece0 2024-04-26T23:44:14.522 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:14.518+0000 7eff3ce0e640 1 --2- 172.21.15.88:0/1656122439 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7eff18002a70 0x7eff18004f30 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7eff3806bac0 tx=0x7eff38063eb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:14.523 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:14.519+0000 7eff357fa640 1 -- 172.21.15.88:0/1656122439 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff38091020 con 0x7eff18002a70 2024-04-26T23:44:14.524 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:14.519+0000 7eff357fa640 1 -- 172.21.15.88:0/1656122439 <== mon.2 v2:172.21.15.175:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7eff3806f640 con 0x7eff18002a70 2024-04-26T23:44:14.524 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:14.520+0000 7eff357fa640 1 -- 172.21.15.88:0/1656122439 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7eff18002a70 msgr2=0x7eff18004f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:14.524 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:14.520+0000 7eff357fa640 1 --2- 172.21.15.88:0/1656122439 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7eff18002a70 0x7eff18004f30 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7eff3806bac0 tx=0x7eff38063eb0 comp rx=0 tx=0).stop 2024-04-26T23:44:14.525 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:14.520+0000 7eff357fa640 1 -- 172.21.15.88:0/1656122439 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7eff18002a70 msgr2=0x7eff18004f30 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:44:14.525 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:14.520+0000 7eff357fa640 1 --2- 172.21.15.88:0/1656122439 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7eff18002a70 0x7eff18004f30 secure :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7eff3806bac0 tx=0x7eff38063eb0 comp rx=0 tx=0).stop 2024-04-26T23:44:14.525 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:14.521+0000 7eff3d60f640 1 --2- 172.21.15.88:0/1656122439 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7eff1c06c9f0 0x7eff1c06eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:14.538 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:14.528+0000 7eff3d60f640 1 --2- 172.21.15.88:0/1656122439 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7eff1c06c9f0 0x7eff1c06eeb0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7eff24009d70 tx=0x7eff24009060 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:14.549 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:14.544+0000 7eff3de10640 1 --2- 172.21.15.88:0/1656122439 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7eff18006f30 0x7eff180073c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:14.549 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:14.545+0000 7eff3de10640 1 -- 172.21.15.88:0/1656122439 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7eff1800a4a0 con 0x7eff18006f30 2024-04-26T23:44:14.549 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:14.545+0000 7eff3ce0e640 1 --2- 172.21.15.88:0/1656122439 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7eff18006f30 0x7eff180073c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:14.550 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:14.546+0000 7eff3ce0e640 1 -- 172.21.15.88:0/1656122439 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7eff18007900 con 0x7eff18006f30 2024-04-26T23:44:14.550 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:14.546+0000 7eff3ce0e640 1 --2- 172.21.15.88:0/1656122439 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7eff18006f30 0x7eff180073c0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7eff38075230 tx=0x7eff3806b850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:14.551 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:14.546+0000 7eff357fa640 1 -- 172.21.15.88:0/1656122439 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff38091050 con 0x7eff18006f30 2024-04-26T23:44:14.552 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:14.547+0000 7eff357fa640 1 -- 172.21.15.88:0/1656122439 <== mon.2 v2:172.21.15.175:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4555 (secure 0 0 0) 0x7eff38098110 con 0x7eff18006f30 2024-04-26T23:44:14.552 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:14.547+0000 7eff357fa640 1 -- 172.21.15.88:0/1656122439 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7eff18006f30 msgr2=0x7eff180073c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:14.552 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:14.547+0000 7eff357fa640 1 --2- 172.21.15.88:0/1656122439 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7eff18006f30 0x7eff180073c0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7eff38075230 tx=0x7eff3806b850 comp rx=0 tx=0).stop 2024-04-26T23:44:14.552 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:14.547+0000 7eff357fa640 1 -- 172.21.15.88:0/1656122439 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7eff18006f30 msgr2=0x7eff180073c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:44:14.552 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:14.547+0000 7eff357fa640 1 --2- 172.21.15.88:0/1656122439 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7eff18006f30 0x7eff180073c0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:14.553 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-04-26T23:44:14.553 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2024-04-26T23:44:14.553 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2024-04-26T23:44:14.553 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "peon", 2024-04-26T23:44:14.554 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 32, 2024-04-26T23:44:14.554 INFO:teuthology.orchestra.run.smithi088.stdout: "uptime": 22834, 2024-04-26T23:44:14.554 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2024-04-26T23:44:14.554 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2024-04-26T23:44:14.554 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2024-04-26T23:44:14.554 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2024-04-26T23:44:14.555 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:44:14.555 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 16, 2024-04-26T23:44:14.555 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2024-04-26T23:44:14.555 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2450521708007866372", 2024-04-26T23:44:14.555 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2024-04-26T23:44:14.555 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-04-26T23:44:14.555 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-04-26T23:44:14.555 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-04-26T23:44:14.555 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-04-26T23:44:14.555 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-04-26T23:44:14.555 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-04-26T23:44:14.555 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-04-26T23:44:14.556 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-04-26T23:44:14.556 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-04-26T23:44:14.556 INFO:teuthology.orchestra.run.smithi088.stdout: "reef", 2024-04-26T23:44:14.556 INFO:teuthology.orchestra.run.smithi088.stdout: "squid" 2024-04-26T23:44:14.556 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:44:14.556 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540701547738038271", 2024-04-26T23:44:14.556 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2024-04-26T23:44:14.556 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-04-26T23:44:14.556 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-04-26T23:44:14.556 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-04-26T23:44:14.556 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-04-26T23:44:14.556 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-04-26T23:44:14.556 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-04-26T23:44:14.556 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-04-26T23:44:14.557 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-04-26T23:44:14.557 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-04-26T23:44:14.557 INFO:teuthology.orchestra.run.smithi088.stdout: "reef", 2024-04-26T23:44:14.557 INFO:teuthology.orchestra.run.smithi088.stdout: "squid" 2024-04-26T23:44:14.557 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:44:14.557 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:44:14.557 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2024-04-26T23:44:14.557 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2024-04-26T23:44:14.557 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2024-04-26T23:44:14.557 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2024-04-26T23:44:14.557 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2024-04-26T23:44:14.557 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "555255e9-7ef9-4454-8dc9-35e96b70035c", 2024-04-26T23:44:14.557 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2024-04-26T23:39:34.291658Z", 2024-04-26T23:44:14.557 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2024-04-26T23:39:34.291658Z", 2024-04-26T23:44:14.557 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 19, 2024-04-26T23:44:14.558 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "squid", 2024-04-26T23:44:14.558 INFO:teuthology.orchestra.run.smithi088.stdout: "election_strategy": 1, 2024-04-26T23:44:14.558 INFO:teuthology.orchestra.run.smithi088.stdout: "disallowed_leaders: ": "", 2024-04-26T23:44:14.558 INFO:teuthology.orchestra.run.smithi088.stdout: "stretch_mode": false, 2024-04-26T23:44:14.558 INFO:teuthology.orchestra.run.smithi088.stdout: "tiebreaker_mon": "", 2024-04-26T23:44:14.558 INFO:teuthology.orchestra.run.smithi088.stdout: "removed_ranks: ": "", 2024-04-26T23:44:14.558 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2024-04-26T23:44:14.558 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2024-04-26T23:44:14.558 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-04-26T23:44:14.558 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-04-26T23:44:14.558 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-04-26T23:44:14.559 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-04-26T23:44:14.559 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-04-26T23:44:14.559 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-04-26T23:44:14.559 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-04-26T23:44:14.559 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-04-26T23:44:14.559 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-04-26T23:44:14.559 INFO:teuthology.orchestra.run.smithi088.stdout: "reef", 2024-04-26T23:44:14.559 INFO:teuthology.orchestra.run.smithi088.stdout: "squid" 2024-04-26T23:44:14.559 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:44:14.559 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2024-04-26T23:44:14.559 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:44:14.559 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2024-04-26T23:44:14.559 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:44:14.559 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2024-04-26T23:44:14.560 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2024-04-26T23:44:14.560 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-04-26T23:44:14.560 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-04-26T23:44:14.560 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:44:14.560 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-04-26T23:44:14.560 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2024-04-26T23:44:14.560 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:44:14.560 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:44:14.560 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:44:14.560 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-04-26T23:44:14.560 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2024-04-26T23:44:14.560 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:44:14.561 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:44:14.561 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:44:14.561 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:44:14.561 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2024-04-26T23:44:14.561 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2024-04-26T23:44:14.561 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-04-26T23:44:14.561 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-04-26T23:44:14.561 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-04-26T23:44:14.561 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:44:14.561 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:44:14.561 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2024-04-26T23:44:14.561 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2024-04-26T23:44:14.561 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-04-26T23:44:14.562 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-04-26T23:44:14.562 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:44:14.562 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-04-26T23:44:14.562 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:3300", 2024-04-26T23:44:14.562 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:44:14.562 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:44:14.562 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:44:14.562 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-04-26T23:44:14.562 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6789", 2024-04-26T23:44:14.562 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:44:14.562 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:44:14.562 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:44:14.563 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:44:14.563 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6789/0", 2024-04-26T23:44:14.563 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.175:6789/0", 2024-04-26T23:44:14.563 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-04-26T23:44:14.563 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-04-26T23:44:14.563 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-04-26T23:44:14.563 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:44:14.563 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:44:14.563 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2024-04-26T23:44:14.563 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2024-04-26T23:44:14.563 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-04-26T23:44:14.563 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-04-26T23:44:14.563 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:44:14.564 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-04-26T23:44:14.564 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:3301", 2024-04-26T23:44:14.564 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:44:14.564 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:44:14.564 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:44:14.564 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-04-26T23:44:14.564 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6790", 2024-04-26T23:44:14.564 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:44:14.564 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:44:14.564 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:44:14.564 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:44:14.564 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6790/0", 2024-04-26T23:44:14.564 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.175:6790/0", 2024-04-26T23:44:14.565 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-04-26T23:44:14.565 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-04-26T23:44:14.565 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-04-26T23:44:14.565 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:44:14.565 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:44:14.565 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:44:14.565 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2024-04-26T23:44:14.565 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2024-04-26T23:44:14.565 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:44:14.565 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:44:14.565 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:44:14.565 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2024-04-26T23:44:14.566 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:44:14.566 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:44:14.566 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2024-04-26T23:44:14.566 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:44:14.566 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:44:14.566 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:44:14.566 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2024-04-26T23:44:14.566 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:44:14.566 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:44:14.566 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:44:14.566 INFO:teuthology.orchestra.run.smithi088.stdout: "stretch_mode": false 2024-04-26T23:44:14.566 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-04-26T23:44:14.567 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:14.548+0000 7eff3de10640 1 -- 172.21.15.88:0/1656122439 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7eff1c06c9f0 msgr2=0x7eff1c06eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:14.567 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:14.548+0000 7eff3de10640 1 --2- 172.21.15.88:0/1656122439 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7eff1c06c9f0 0x7eff1c06eeb0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7eff24009d70 tx=0x7eff24009060 comp rx=0 tx=0).stop 2024-04-26T23:44:14.567 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:14.548+0000 7eff3de10640 1 -- 172.21.15.88:0/1656122439 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7eff3003ece0 msgr2=0x7eff30044400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:14.567 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:14.548+0000 7eff3de10640 1 --2- 172.21.15.88:0/1656122439 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7eff3003ece0 0x7eff30044400 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7eff300df940 tx=0x7eff2c0046c0 comp rx=0 tx=0).stop 2024-04-26T23:44:14.568 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:14.548+0000 7eff3d60f640 1 -- 172.21.15.88:0/1656122439 reap_dead start 2024-04-26T23:44:14.568 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:14.548+0000 7eff3d60f640 1 -- 172.21.15.88:0/1656122439 reap_dead start 2024-04-26T23:44:14.568 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:14.551+0000 7eff3de10640 1 -- 172.21.15.88:0/1656122439 shutdown_connections 2024-04-26T23:44:14.568 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:14.551+0000 7eff3de10640 1 -- 172.21.15.88:0/1656122439 >> 172.21.15.88:0/1656122439 conn(0x7eff30005e90 msgr2=0x7eff3003e2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:44:14.568 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:14.552+0000 7eff3de10640 1 -- 172.21.15.88:0/1656122439 shutdown_connections 2024-04-26T23:44:14.568 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:14.552+0000 7eff3de10640 1 -- 172.21.15.88:0/1656122439 wait complete. 2024-04-26T23:44:14.575 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-04-26T23:44:14.575 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['a'] 2024-04-26T23:44:14.575 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2024-04-26T23:44:14.575 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.a 2024-04-26T23:44:14.575 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2024-04-26T23:44:14.575 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-04-26T23:44:14.576 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T23:44:14.593 INFO:tasks.ceph.mon.a:Stopped 2024-04-26T23:44:14.593 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2024-04-26T23:44:14.593 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-04-26T23:44:14.820 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:14.815+0000 7f12b96ea640 1 Processor -- start 2024-04-26T23:44:14.820 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:14.816+0000 7f12b96ea640 1 -- start start 2024-04-26T23:44:14.821 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:14.817+0000 7f12b96ea640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f12b4158870 0x7f12b4074750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:14.822 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:14.817+0000 7f12b96ea640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f12b40742b0 0x7f12b406d320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:14.822 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:14.817+0000 7f12b96ea640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f12b4158c50 con 0x7f12b4070330 2024-04-26T23:44:14.822 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:14.817+0000 7f12b96ea640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f12b4070a80 con 0x7f12b4158870 2024-04-26T23:44:14.822 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:14.817+0000 7f12b96ea640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f12b4070d60 con 0x7f12b40742b0 2024-04-26T23:44:14.823 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:14.818+0000 7f12b37fe640 1 -- >> v1:172.21.15.88:6789/0 conn(0x7f12b4070330 legacy=0x7f12b415b230 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.88:6789/0 2024-04-26T23:44:14.823 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:14.819+0000 7f12b27fc640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f12b40742b0 0x7f12b406d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:14.823 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:14.819+0000 7f12b2ffd640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f12b4158870 0x7f12b4074750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:14.823 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:14.819+0000 7f12b27fc640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f12b40742b0 0x7f12b406d320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.88:53220/0 (socket says 172.21.15.88:53220) 2024-04-26T23:44:14.823 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:14.819+0000 7f12b27fc640 1 -- 172.21.15.88:0/963402424 learned_addr learned my addr 172.21.15.88:0/963402424 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:44:14.825 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:14.820+0000 7f12b27fc640 1 -- 172.21.15.88:0/963402424 >> v2:172.21.15.175:3300/0 conn(0x7f12b4158870 msgr2=0x7f12b4074750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:44:14.825 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:14.820+0000 7f12b27fc640 1 --2- 172.21.15.88:0/963402424 >> v2:172.21.15.175:3300/0 conn(0x7f12b4158870 0x7f12b4074750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:14.825 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:14.820+0000 7f12b27fc640 1 -- 172.21.15.88:0/963402424 >> v1:172.21.15.88:6789/0 conn(0x7f12b4070330 legacy=0x7f12b415b230 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T23:44:14.825 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:14.820+0000 7f12b27fc640 1 -- 172.21.15.88:0/963402424 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12b4071040 con 0x7f12b40742b0 2024-04-26T23:44:14.825 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:14.821+0000 7f12b27fc640 1 --2- 172.21.15.88:0/963402424 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f12b40742b0 0x7f12b406d320 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f12ac009e50 tx=0x7f12ac02a5d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cd385fe2ab6001f7 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:14.825 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:14.821+0000 7f12b1ffb640 1 -- 172.21.15.88:0/963402424 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12ac036070 con 0x7f12b40742b0 2024-04-26T23:44:14.827 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:14.822+0000 7f12b1ffb640 1 -- 172.21.15.88:0/963402424 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12ac031600 con 0x7f12b40742b0 2024-04-26T23:44:14.827 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:14.823+0000 7f12b96ea640 1 -- 172.21.15.88:0/963402424 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f12b40742b0 msgr2=0x7f12b406d320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:14.827 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:14.823+0000 7f12b1ffb640 1 -- 172.21.15.88:0/963402424 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12ac036070 con 0x7f12b40742b0 2024-04-26T23:44:14.827 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:14.823+0000 7f12b96ea640 1 --2- 172.21.15.88:0/963402424 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f12b40742b0 0x7f12b406d320 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f12ac009e50 tx=0x7f12ac02a5d0 comp rx=0 tx=0).stop 2024-04-26T23:44:14.828 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:14.823+0000 7f12b96ea640 1 -- 172.21.15.88:0/963402424 shutdown_connections 2024-04-26T23:44:14.828 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:14.823+0000 7f12b96ea640 1 --2- 172.21.15.88:0/963402424 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f12b40742b0 0x7f12b406d320 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:14.828 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:14.823+0000 7f12b96ea640 1 --2- 172.21.15.88:0/963402424 >> v2:172.21.15.175:3300/0 conn(0x7f12b4158870 0x7f12b4074750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:14.828 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:14.823+0000 7f12b96ea640 1 -- 172.21.15.88:0/963402424 >> 172.21.15.88:0/963402424 conn(0x7f12b40c91e0 msgr2=0x7f12b40c95c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:44:14.829 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:14.825+0000 7f12b96ea640 1 -- 172.21.15.88:0/963402424 shutdown_connections 2024-04-26T23:44:14.830 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:14.826+0000 7f12b96ea640 1 -- 172.21.15.88:0/963402424 wait complete. 2024-04-26T23:44:14.832 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:14.828+0000 7f12b96ea640 1 Processor -- start 2024-04-26T23:44:14.833 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:14.828+0000 7f12b96ea640 1 -- start start 2024-04-26T23:44:14.836 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:14.831+0000 7f12b96ea640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f12b4070330 0x7f12b4155430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:14.836 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:14.831+0000 7f12b96ea640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f12b40742b0 0x7f12b40ad440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:14.836 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:14.831+0000 7f12b96ea640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f12b4158870 0x7f12b41e4a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:14.836 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:14.831+0000 7f12b96ea640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f12b406fe10 con 0x7f12b40742b0 2024-04-26T23:44:14.837 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:14.831+0000 7f12b96ea640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f12b406fb30 con 0x7f12b4070330 2024-04-26T23:44:14.837 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:14.831+0000 7f12b96ea640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f12b415b940 con 0x7f12b4158870 2024-04-26T23:44:14.837 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:14.833+0000 7f12b37fe640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f12b4158870 0x7f12b41e4a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:14.837 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:14.833+0000 7f12b37fe640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f12b4158870 0x7f12b41e4a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.88:53236/0 (socket says 172.21.15.88:53236) 2024-04-26T23:44:14.837 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:14.833+0000 7f12b37fe640 1 -- 172.21.15.88:0/407051481 learned_addr learned my addr 172.21.15.88:0/407051481 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:44:14.838 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:14.834+0000 7f12b37fe640 1 -- 172.21.15.88:0/407051481 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f12b4070330 msgr2=0x7f12b4155430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:14.838 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:14.834+0000 7f12b37fe640 1 --2- 172.21.15.88:0/407051481 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f12b4070330 0x7f12b4155430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:14.838 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:14.834+0000 7f12b37fe640 1 -- 172.21.15.88:0/407051481 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f12b40742b0 msgr2=0x7f12b40ad440 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T23:44:14.838 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:14.834+0000 7f12b37fe640 1 --2- 172.21.15.88:0/407051481 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f12b40742b0 0x7f12b40ad440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:14.839 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:14.834+0000 7f12b37fe640 1 -- 172.21.15.88:0/407051481 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12b41f0ba0 con 0x7f12b4158870 2024-04-26T23:44:14.842 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:14.838+0000 7f12b37fe640 1 --2- 172.21.15.88:0/407051481 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f12b4158870 0x7f12b41e4a00 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f12a800b410 tx=0x7f12a800b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:14.847 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:14.843+0000 7f129b7fe640 1 -- 172.21.15.88:0/407051481 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12a8017070 con 0x7f12b4158870 2024-04-26T23:44:14.847 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:14.843+0000 7f129b7fe640 1 -- 172.21.15.88:0/407051481 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12a8003de0 con 0x7f12b4158870 2024-04-26T23:44:14.847 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:14.843+0000 7f12b96ea640 1 -- 172.21.15.88:0/407051481 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12b41f0e60 con 0x7f12b4158870 2024-04-26T23:44:14.847 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:14.843+0000 7f12b96ea640 1 -- 172.21.15.88:0/407051481 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f12b41f1420 con 0x7f12b4158870 2024-04-26T23:44:14.848 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:14.843+0000 7f129b7fe640 1 -- 172.21.15.88:0/407051481 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12a8006310 con 0x7f12b4158870 2024-04-26T23:44:14.853 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:14.847+0000 7f129b7fe640 1 -- 172.21.15.88:0/407051481 <== mon.2 v2:172.21.15.175:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f12a801a070 con 0x7f12b4158870 2024-04-26T23:44:14.853 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:14.847+0000 7f129b7fe640 1 --2- 172.21.15.88:0/407051481 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f12a006c9c0 0x7f12a006ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:14.853 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:14.848+0000 7f129b7fe640 1 -- 172.21.15.88:0/407051481 <== mon.2 v2:172.21.15.175:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6666+0+0 (secure 0 0 0) 0x7f12a808b1c0 con 0x7f12b4158870 2024-04-26T23:44:14.853 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:14.848+0000 7f12b96ea640 1 -- 172.21.15.88:0/407051481 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f12b40696c0 con 0x7f12b4158870 2024-04-26T23:44:14.853 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:14.848+0000 7f12b2ffd640 1 --2- 172.21.15.88:0/407051481 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f12a006c9c0 0x7f12a006ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:14.853 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:14.849+0000 7f12b2ffd640 1 --2- 172.21.15.88:0/407051481 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f12a006c9c0 0x7f12a006ee80 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f12a4006a90 tx=0x7f12a4006a20 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:14.863 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:14.859+0000 7f129b7fe640 1 -- 172.21.15.88:0/407051481 <== mon.2 v2:172.21.15.175:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f12a80592a0 con 0x7f12b4158870 2024-04-26T23:44:15.406 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:15.403+0000 7f12b96ea640 1 -- 172.21.15.88:0/407051481 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f12b406f590 con 0x7f12b4158870 2024-04-26T23:44:15.407 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:15.404+0000 7f129b7fe640 1 -- 172.21.15.88:0/407051481 <== mon.2 v2:172.21.15.175:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1565 (secure 0 0 0) 0x7f12a8058ba0 con 0x7f12b4158870 2024-04-26T23:44:15.408 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":32,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":17,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"555255e9-7ef9-4454-8dc9-35e96b70035c","modified":"2024-04-26T23:39:34.291658Z","created":"2024-04-26T23:39:34.291658Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:3300","nonce":0},{"type":"v1","addr":"172.21.15.175:6789","nonce":0}]},"addr":"172.21.15.175:6789/0","public_addr":"172.21.15.175:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:3301","nonce":0},{"type":"v1","addr":"172.21.15.175:6790","nonce":0}]},"addr":"172.21.15.175:6790/0","public_addr":"172.21.15.175:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-04-26T23:44:15.412 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:15.408+0000 7f12b96ea640 1 -- 172.21.15.88:0/407051481 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f12a006c9c0 msgr2=0x7f12a006ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:15.412 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:15.408+0000 7f12b96ea640 1 --2- 172.21.15.88:0/407051481 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f12a006c9c0 0x7f12a006ee80 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f12a4006a90 tx=0x7f12a4006a20 comp rx=0 tx=0).stop 2024-04-26T23:44:15.412 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:15.408+0000 7f12b96ea640 1 -- 172.21.15.88:0/407051481 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f12b4158870 msgr2=0x7f12b41e4a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:15.412 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:15.408+0000 7f12b96ea640 1 --2- 172.21.15.88:0/407051481 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f12b4158870 0x7f12b41e4a00 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f12a800b410 tx=0x7f12a800b8d0 comp rx=0 tx=0).stop 2024-04-26T23:44:15.412 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:15.408+0000 7f12b96ea640 1 -- 172.21.15.88:0/407051481 shutdown_connections 2024-04-26T23:44:15.412 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:15.408+0000 7f12b96ea640 1 --2- 172.21.15.88:0/407051481 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f12a006c9c0 0x7f12a006ee80 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:15.412 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:15.408+0000 7f12b96ea640 1 --2- 172.21.15.88:0/407051481 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f12b4158870 0x7f12b41e4a00 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:15.412 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:15.408+0000 7f12b96ea640 1 --2- 172.21.15.88:0/407051481 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f12b40742b0 0x7f12b40ad440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:15.413 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:15.408+0000 7f12b96ea640 1 --2- 172.21.15.88:0/407051481 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f12b4070330 0x7f12b4155430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:15.413 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:15.408+0000 7f12b96ea640 1 -- 172.21.15.88:0/407051481 >> 172.21.15.88:0/407051481 conn(0x7f12b40c91e0 msgr2=0x7f12b4074730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:44:15.413 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:15.409+0000 7f12b96ea640 1 -- 172.21.15.88:0/407051481 shutdown_connections 2024-04-26T23:44:15.413 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:15.409+0000 7f12b96ea640 1 -- 172.21.15.88:0/407051481 wait complete. 2024-04-26T23:44:18.435 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-04-26T23:44:18.609 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:18.604+0000 7f2c5831c640 1 Processor -- start 2024-04-26T23:44:18.610 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:18.604+0000 7f2c5831c640 1 -- start start 2024-04-26T23:44:18.610 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:18.606+0000 7f2c5831c640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2c500c4630 0x7f2c501674d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:18.610 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:18.606+0000 7f2c5831c640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2c500c4210 con 0x7f2c5006fcc0 2024-04-26T23:44:18.610 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:18.606+0000 7f2c5831c640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2c5006ef00 con 0x7f2c500ac490 2024-04-26T23:44:18.610 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:18.606+0000 7f2c5831c640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f2c5006f830 con 0x7f2c500c4630 2024-04-26T23:44:18.610 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:18.606+0000 7f2c558b7640 1 -- >> v1:172.21.15.88:6789/0 conn(0x7f2c5006fcc0 legacy=0x7f2c500718e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.88:6789/0 2024-04-26T23:44:18.610 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:18.606+0000 7f2c560b8640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f2c500ac490 0x7f2c500c3540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.88:35594/0 (socket says 172.21.15.88:35594) 2024-04-26T23:44:18.610 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:18.606+0000 7f2c560b8640 1 -- 172.21.15.88:0/1508809723 learned_addr learned my addr 172.21.15.88:0/1508809723 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-26T23:44:18.610 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:18.606+0000 7f2c568b9640 1 --2- 172.21.15.88:0/1508809723 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2c500c4630 0x7f2c501674d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:18.611 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:18.607+0000 7f2c550b6640 1 -- 172.21.15.88:0/1508809723 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2924474040 0 0) 0x7f2c5006ef00 con 0x7f2c500ac490 2024-04-26T23:44:18.611 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:18.607+0000 7f2c550b6640 1 -- 172.21.15.88:0/1508809723 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2c3c003520 con 0x7f2c500ac490 2024-04-26T23:44:18.611 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:18.607+0000 7f2c568b9640 1 -- 172.21.15.88:0/1508809723 >> v1:172.21.15.175:6789/0 conn(0x7f2c500ac490 legacy=0x7f2c500c3540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:18.611 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:18.607+0000 7f2c568b9640 1 -- 172.21.15.88:0/1508809723 >> v1:172.21.15.88:6789/0 conn(0x7f2c5006fcc0 legacy=0x7f2c500718e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T23:44:18.611 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:18.607+0000 7f2c568b9640 1 -- 172.21.15.88:0/1508809723 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c5006f1e0 con 0x7f2c500c4630 2024-04-26T23:44:18.614 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:18.611+0000 7f2c568b9640 1 --2- 172.21.15.88:0/1508809723 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2c500c4630 0x7f2c501674d0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f2c400097d0 tx=0x7f2c4002a250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7ef1238696e4247b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:18.619 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:18.615+0000 7f2c550b6640 1 -- 172.21.15.88:0/1508809723 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c40037070 con 0x7f2c500c4630 2024-04-26T23:44:18.619 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:18.615+0000 7f2c550b6640 1 -- 172.21.15.88:0/1508809723 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c40032440 con 0x7f2c500c4630 2024-04-26T23:44:18.619 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:18.616+0000 7f2c5831c640 1 -- 172.21.15.88:0/1508809723 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2c500c4630 msgr2=0x7f2c501674d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:18.619 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:18.616+0000 7f2c5831c640 1 --2- 172.21.15.88:0/1508809723 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2c500c4630 0x7f2c501674d0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f2c400097d0 tx=0x7f2c4002a250 comp rx=0 tx=0).stop 2024-04-26T23:44:18.620 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:18.616+0000 7f2c5831c640 1 -- 172.21.15.88:0/1508809723 shutdown_connections 2024-04-26T23:44:18.620 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:18.616+0000 7f2c5831c640 1 --2- 172.21.15.88:0/1508809723 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2c500c4630 0x7f2c501674d0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:18.620 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:18.616+0000 7f2c5831c640 1 -- 172.21.15.88:0/1508809723 >> 172.21.15.88:0/1508809723 conn(0x7f2c500c82d0 msgr2=0x7f2c500c86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:44:18.620 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:18.617+0000 7f2c5831c640 1 -- 172.21.15.88:0/1508809723 shutdown_connections 2024-04-26T23:44:18.622 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:18.617+0000 7f2c5831c640 1 -- 172.21.15.88:0/1508809723 wait complete. 2024-04-26T23:44:18.622 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:18.619+0000 7f2c5831c640 1 Processor -- start 2024-04-26T23:44:18.624 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:18.620+0000 7f2c5831c640 1 -- start start 2024-04-26T23:44:18.624 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:18.621+0000 7f2c5831c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2c5006fcc0 0x7f2c50073ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:18.624 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:18.621+0000 7f2c5831c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2c500ac490 0x7f2c500743e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:18.624 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:18.621+0000 7f2c5831c640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2c500c4630 0x7f2c5007e740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:18.625 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:18.621+0000 7f2c5831c640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f2c50167a10 con 0x7f2c500ac490 2024-04-26T23:44:18.625 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:18.621+0000 7f2c5831c640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f2c50071ff0 con 0x7f2c5006fcc0 2024-04-26T23:44:18.625 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:18.621+0000 7f2c5831c640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f2c50167b90 con 0x7f2c500c4630 2024-04-26T23:44:18.625 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:18.621+0000 7f2c558b7640 1 -- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2c500ac490 msgr2=0x7f2c500743e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.88:3300/0 2024-04-26T23:44:18.625 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:18.621+0000 7f2c558b7640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2c500ac490 0x7f2c500743e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:44:18.625 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:18.622+0000 7f2c568b9640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2c500c4630 0x7f2c5007e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:18.625 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:18.622+0000 7f2c568b9640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2c500c4630 0x7f2c5007e740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.88:56860/0 (socket says 172.21.15.88:56860) 2024-04-26T23:44:18.626 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:18.622+0000 7f2c568b9640 1 -- 172.21.15.88:0/2887897146 learned_addr learned my addr 172.21.15.88:0/2887897146 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:44:18.626 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:18.622+0000 7f2c560b8640 1 --2- 172.21.15.88:0/2887897146 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2c5006fcc0 0x7f2c50073ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:18.626 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:18.623+0000 7f2c568b9640 1 -- 172.21.15.88:0/2887897146 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2c5006fcc0 msgr2=0x7f2c50073ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:18.626 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:18.623+0000 7f2c568b9640 1 --2- 172.21.15.88:0/2887897146 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2c5006fcc0 0x7f2c50073ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:18.627 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:18.623+0000 7f2c568b9640 1 -- 172.21.15.88:0/2887897146 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2c500ac490 msgr2=0x7f2c500743e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T23:44:18.627 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:18.623+0000 7f2c568b9640 1 --2- 172.21.15.88:0/2887897146 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2c500ac490 0x7f2c500743e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:18.627 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:18.623+0000 7f2c568b9640 1 -- 172.21.15.88:0/2887897146 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c5006e600 con 0x7f2c500c4630 2024-04-26T23:44:18.627 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:18.624+0000 7f2c568b9640 1 --2- 172.21.15.88:0/2887897146 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2c500c4630 0x7f2c5007e740 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f2c400098f0 tx=0x7f2c400046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:18.628 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:18.624+0000 7f2c46ffd640 1 -- 172.21.15.88:0/2887897146 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c40037050 con 0x7f2c500c4630 2024-04-26T23:44:18.628 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:18.624+0000 7f2c5831c640 1 -- 172.21.15.88:0/2887897146 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c502013a0 con 0x7f2c500c4630 2024-04-26T23:44:18.628 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:18.624+0000 7f2c5831c640 1 -- 172.21.15.88:0/2887897146 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c500722a0 con 0x7f2c500c4630 2024-04-26T23:44:18.628 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:18.625+0000 7f2c46ffd640 1 -- 172.21.15.88:0/2887897146 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c40043070 con 0x7f2c500c4630 2024-04-26T23:44:18.628 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:18.625+0000 7f2c46ffd640 1 -- 172.21.15.88:0/2887897146 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c40032810 con 0x7f2c500c4630 2024-04-26T23:44:18.630 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:18.627+0000 7f2c46ffd640 1 -- 172.21.15.88:0/2887897146 <== mon.2 v2:172.21.15.175:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2c40032440 con 0x7f2c500c4630 2024-04-26T23:44:18.631 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:18.628+0000 7f2c46ffd640 1 --2- 172.21.15.88:0/2887897146 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f2c3406c8d0 0x7f2c3406ed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:18.631 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:18.628+0000 7f2c46ffd640 1 -- 172.21.15.88:0/2887897146 <== mon.2 v2:172.21.15.175:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6666+0+0 (secure 0 0 0) 0x7f2c400acca0 con 0x7f2c500c4630 2024-04-26T23:44:18.632 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:18.628+0000 7f2c5831c640 1 -- 172.21.15.88:0/2887897146 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c38005290 con 0x7f2c500c4630 2024-04-26T23:44:18.632 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:18.628+0000 7f2c560b8640 1 --2- 172.21.15.88:0/2887897146 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f2c3406c8d0 0x7f2c3406ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:18.632 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:18.629+0000 7f2c560b8640 1 --2- 172.21.15.88:0/2887897146 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f2c3406c8d0 0x7f2c3406ed90 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f2c4c0011e0 tx=0x7f2c4c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:18.646 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:18.643+0000 7f2c46ffd640 1 -- 172.21.15.88:0/2887897146 <== mon.2 v2:172.21.15.175:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f2c5006e600 con 0x7f2c500c4630 2024-04-26T23:44:19.129 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:19.126+0000 7f2c5831c640 1 -- 172.21.15.88:0/2887897146 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f2c38005580 con 0x7f2c500c4630 2024-04-26T23:44:19.130 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:19.127+0000 7f2c46ffd640 1 -- 172.21.15.88:0/2887897146 <== mon.2 v2:172.21.15.175:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1565 (secure 0 0 0) 0x7f2c4007ad00 con 0x7f2c500c4630 2024-04-26T23:44:19.130 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":32,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":21,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"555255e9-7ef9-4454-8dc9-35e96b70035c","modified":"2024-04-26T23:39:34.291658Z","created":"2024-04-26T23:39:34.291658Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:3300","nonce":0},{"type":"v1","addr":"172.21.15.175:6789","nonce":0}]},"addr":"172.21.15.175:6789/0","public_addr":"172.21.15.175:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:3301","nonce":0},{"type":"v1","addr":"172.21.15.175:6790","nonce":0}]},"addr":"172.21.15.175:6790/0","public_addr":"172.21.15.175:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-04-26T23:44:19.134 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:19.130+0000 7f2c5831c640 1 -- 172.21.15.88:0/2887897146 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f2c3406c8d0 msgr2=0x7f2c3406ed90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:19.134 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:19.130+0000 7f2c5831c640 1 --2- 172.21.15.88:0/2887897146 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f2c3406c8d0 0x7f2c3406ed90 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f2c4c0011e0 tx=0x7f2c4c009040 comp rx=0 tx=0).stop 2024-04-26T23:44:19.134 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:19.130+0000 7f2c5831c640 1 -- 172.21.15.88:0/2887897146 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2c500c4630 msgr2=0x7f2c5007e740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:19.134 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:19.130+0000 7f2c5831c640 1 --2- 172.21.15.88:0/2887897146 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2c500c4630 0x7f2c5007e740 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f2c400098f0 tx=0x7f2c400046c0 comp rx=0 tx=0).stop 2024-04-26T23:44:19.134 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:19.130+0000 7f2c5831c640 1 -- 172.21.15.88:0/2887897146 shutdown_connections 2024-04-26T23:44:19.134 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:19.130+0000 7f2c5831c640 1 --2- 172.21.15.88:0/2887897146 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f2c3406c8d0 0x7f2c3406ed90 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:19.134 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:19.130+0000 7f2c5831c640 1 --2- 172.21.15.88:0/2887897146 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2c500c4630 0x7f2c5007e740 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:19.134 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:19.130+0000 7f2c5831c640 1 --2- 172.21.15.88:0/2887897146 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2c500ac490 0x7f2c500743e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:19.135 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:19.130+0000 7f2c5831c640 1 --2- 172.21.15.88:0/2887897146 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2c5006fcc0 0x7f2c50073ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:19.135 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:19.130+0000 7f2c5831c640 1 -- 172.21.15.88:0/2887897146 >> 172.21.15.88:0/2887897146 conn(0x7f2c500c82d0 msgr2=0x7f2c5006e8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:44:19.135 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:19.130+0000 7f2c5831c640 1 -- 172.21.15.88:0/2887897146 shutdown_connections 2024-04-26T23:44:19.135 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:19.130+0000 7f2c5831c640 1 -- 172.21.15.88:0/2887897146 wait complete. 2024-04-26T23:44:22.148 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-04-26T23:44:22.351 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:22.348+0000 7fafa3f71640 1 Processor -- start 2024-04-26T23:44:22.354 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:22.349+0000 7fafa3f71640 1 -- start start 2024-04-26T23:44:22.356 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:22.352+0000 7fafa3f71640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7faf9c0ab6a0 0x7faf9c15e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:22.356 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:22.352+0000 7fafa3f71640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf9c06ff20 con 0x7faf9c150200 2024-04-26T23:44:22.357 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:22.352+0000 7fafa3f71640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf9c06f4e0 con 0x7faf9c0c2cd0 2024-04-26T23:44:22.357 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:22.352+0000 7fafa3f71640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7faf9c0c4bd0 con 0x7faf9c0ab6a0 2024-04-26T23:44:22.357 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:22.352+0000 7fafa250e640 1 -- >> v2:172.21.15.88:3300/0 conn(0x7faf9c0ab6a0 msgr2=0x7faf9c15e5a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.88:3300/0 2024-04-26T23:44:22.357 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:22.352+0000 7fafa250e640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7faf9c0ab6a0 0x7faf9c15e5a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:44:22.357 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:22.352+0000 7fafa1d0d640 1 -- >> v1:172.21.15.88:6789/0 conn(0x7faf9c150200 legacy=0x7faf9c0ac140 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.88:6789/0 2024-04-26T23:44:22.357 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:22.353+0000 7fafa150c640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7faf9c0c2cd0 0x7faf9c1533b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.88:35598/0 (socket says 172.21.15.88:35598) 2024-04-26T23:44:22.357 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:22.353+0000 7fafa150c640 1 -- 172.21.15.88:0/2504118344 learned_addr learned my addr 172.21.15.88:0/2504118344 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-26T23:44:22.556 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:22.553+0000 7fafa1d0d640 1 -- 172.21.15.88:0/2504118344 >> v1:172.21.15.88:6789/0 conn(0x7faf9c150200 legacy=0x7faf9c0ac140 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.88:6789/0 2024-04-26T23:44:22.556 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:22.553+0000 7fafa250e640 1 -- 172.21.15.88:0/2504118344 >> v2:172.21.15.88:3300/0 conn(0x7faf9c0ab6a0 msgr2=0x7faf9c15e5a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.88:3300/0 2024-04-26T23:44:22.556 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:22.553+0000 7fafa250e640 1 --2- 172.21.15.88:0/2504118344 >> v2:172.21.15.88:3300/0 conn(0x7faf9c0ab6a0 0x7faf9c15e5a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-26T23:44:22.957 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:22.954+0000 7fafa250e640 1 -- 172.21.15.88:0/2504118344 >> v2:172.21.15.88:3300/0 conn(0x7faf9c0ab6a0 msgr2=0x7faf9c15e5a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.88:3300/0 2024-04-26T23:44:22.957 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:22.954+0000 7fafa250e640 1 --2- 172.21.15.88:0/2504118344 >> v2:172.21.15.88:3300/0 conn(0x7faf9c0ab6a0 0x7faf9c15e5a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-26T23:44:22.957 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:22.954+0000 7fafa1d0d640 1 -- 172.21.15.88:0/2504118344 >> v1:172.21.15.88:6789/0 conn(0x7faf9c150200 legacy=0x7faf9c0ac140 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.88:6789/0 2024-04-26T23:44:23.759 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:23.755+0000 7fafa1d0d640 1 -- 172.21.15.88:0/2504118344 >> v1:172.21.15.88:6789/0 conn(0x7faf9c150200 legacy=0x7faf9c0ac140 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.88:6789/0 2024-04-26T23:44:23.759 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:23.755+0000 7fafa250e640 1 -- 172.21.15.88:0/2504118344 >> v2:172.21.15.88:3300/0 conn(0x7faf9c0ab6a0 msgr2=0x7faf9c15e5a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.88:3300/0 2024-04-26T23:44:23.759 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:23.755+0000 7fafa250e640 1 --2- 172.21.15.88:0/2504118344 >> v2:172.21.15.88:3300/0 conn(0x7faf9c0ab6a0 0x7faf9c15e5a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-26T23:44:25.356 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:25.352+0000 7faf937fe640 1 -- 172.21.15.88:0/2504118344 >> v2:172.21.15.88:3300/0 conn(0x7faf9c0ab6a0 msgr2=0x7faf9c15e5a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T23:44:25.356 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:25.352+0000 7faf937fe640 1 --2- 172.21.15.88:0/2504118344 >> v2:172.21.15.88:3300/0 conn(0x7faf9c0ab6a0 0x7faf9c15e5a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:25.356 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:25.352+0000 7faf937fe640 1 -- 172.21.15.88:0/2504118344 >> v1:172.21.15.175:6789/0 conn(0x7faf9c0c2cd0 legacy=0x7faf9c1533b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:25.356 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:25.352+0000 7faf937fe640 1 -- 172.21.15.88:0/2504118344 >> v1:172.21.15.88:6789/0 conn(0x7faf9c150200 legacy=0x7faf9c0ac140 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T23:44:25.357 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:25.352+0000 7faf937fe640 1 --2- 172.21.15.88:0/2504118344 >> v2:172.21.15.175:3300/0 conn(0x7faf800036c0 0x7faf80005b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:25.357 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:25.352+0000 7faf937fe640 1 --2- 172.21.15.88:0/2504118344 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faf80006130 0x7faf800085f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:25.357 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:25.352+0000 7faf937fe640 1 -- 172.21.15.88:0/2504118344 --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7faf9c0c4bd0 con 0x7faf800036c0 2024-04-26T23:44:25.357 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:25.352+0000 7faf937fe640 1 -- 172.21.15.88:0/2504118344 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7faf80008d20 con 0x7faf80006130 2024-04-26T23:44:25.357 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:25.352+0000 7fafa1d0d640 1 --2- 172.21.15.88:0/2504118344 >> v2:172.21.15.175:3300/0 conn(0x7faf800036c0 0x7faf80005b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:25.357 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:25.353+0000 7fafa150c640 1 --2- 172.21.15.88:0/2504118344 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faf80006130 0x7faf800085f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:25.357 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:25.353+0000 7fafa1d0d640 1 -- 172.21.15.88:0/2504118344 >> v2:172.21.15.175:3300/0 conn(0x7faf800036c0 msgr2=0x7faf80005b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-26T23:44:25.357 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:25.353+0000 7fafa1d0d640 1 -- 172.21.15.88:0/2504118344 >> v2:172.21.15.175:3300/0 conn(0x7faf800036c0 msgr2=0x7faf80005b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T23:44:25.357 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:25.353+0000 7fafa1d0d640 1 --2- 172.21.15.88:0/2504118344 >> v2:172.21.15.175:3300/0 conn(0x7faf800036c0 0x7faf80005b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:44:25.357 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:25.353+0000 7fafa1d0d640 1 --2- 172.21.15.88:0/2504118344 >> v2:172.21.15.175:3300/0 conn(0x7faf800036c0 0x7faf80005b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:44:25.357 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:25.353+0000 7fafa150c640 1 -- 172.21.15.88:0/2504118344 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faf80006130 msgr2=0x7faf800085f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-26T23:44:25.357 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:25.353+0000 7fafa150c640 1 -- 172.21.15.88:0/2504118344 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faf80006130 msgr2=0x7faf800085f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T23:44:25.357 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:25.353+0000 7fafa150c640 1 --2- 172.21.15.88:0/2504118344 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faf80006130 0x7faf800085f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:44:25.357 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:25.353+0000 7fafa150c640 1 --2- 172.21.15.88:0/2504118344 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faf80006130 0x7faf800085f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:44:25.558 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:25.554+0000 7fafa150c640 1 --2- 172.21.15.88:0/2504118344 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faf80006130 0x7faf800085f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:25.558 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:25.554+0000 7fafa150c640 1 -- 172.21.15.88:0/2504118344 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faf80006130 msgr2=0x7faf800085f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-26T23:44:25.558 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:25.554+0000 7fafa150c640 1 -- 172.21.15.88:0/2504118344 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faf80006130 msgr2=0x7faf800085f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T23:44:25.558 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:25.554+0000 7fafa150c640 1 --2- 172.21.15.88:0/2504118344 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faf80006130 0x7faf800085f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:44:25.558 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:25.554+0000 7fafa150c640 1 --2- 172.21.15.88:0/2504118344 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faf80006130 0x7faf800085f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-26T23:44:25.559 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:25.556+0000 7fafa1d0d640 1 --2- 172.21.15.88:0/2504118344 >> v2:172.21.15.175:3300/0 conn(0x7faf800036c0 0x7faf80005b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:25.560 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:25.557+0000 7fafa1d0d640 1 -- 172.21.15.88:0/2504118344 >> v2:172.21.15.175:3300/0 conn(0x7faf800036c0 msgr2=0x7faf80005b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-26T23:44:25.560 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:25.557+0000 7fafa1d0d640 1 -- 172.21.15.88:0/2504118344 >> v2:172.21.15.175:3300/0 conn(0x7faf800036c0 msgr2=0x7faf80005b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T23:44:25.560 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:25.557+0000 7fafa1d0d640 1 --2- 172.21.15.88:0/2504118344 >> v2:172.21.15.175:3300/0 conn(0x7faf800036c0 0x7faf80005b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:44:25.560 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:25.557+0000 7fafa1d0d640 1 --2- 172.21.15.88:0/2504118344 >> v2:172.21.15.175:3300/0 conn(0x7faf800036c0 0x7faf80005b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-26T23:44:25.960 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:25.955+0000 7fafa150c640 1 --2- 172.21.15.88:0/2504118344 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faf80006130 0x7faf800085f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:25.960 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:25.956+0000 7fafa150c640 1 -- 172.21.15.88:0/2504118344 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faf80006130 msgr2=0x7faf800085f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-26T23:44:25.960 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:25.956+0000 7fafa150c640 1 -- 172.21.15.88:0/2504118344 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faf80006130 msgr2=0x7faf800085f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T23:44:25.960 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:25.956+0000 7fafa150c640 1 --2- 172.21.15.88:0/2504118344 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faf80006130 0x7faf800085f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:44:25.960 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:25.956+0000 7fafa150c640 1 --2- 172.21.15.88:0/2504118344 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faf80006130 0x7faf800085f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-26T23:44:25.962 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:25.959+0000 7fafa1d0d640 1 --2- 172.21.15.88:0/2504118344 >> v2:172.21.15.175:3300/0 conn(0x7faf800036c0 0x7faf80005b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:25.962 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:25.959+0000 7fafa1d0d640 1 -- 172.21.15.88:0/2504118344 >> v2:172.21.15.175:3300/0 conn(0x7faf800036c0 msgr2=0x7faf80005b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-26T23:44:25.962 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:25.959+0000 7fafa1d0d640 1 -- 172.21.15.88:0/2504118344 >> v2:172.21.15.175:3300/0 conn(0x7faf800036c0 msgr2=0x7faf80005b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T23:44:25.962 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:25.959+0000 7fafa1d0d640 1 --2- 172.21.15.88:0/2504118344 >> v2:172.21.15.175:3300/0 conn(0x7faf800036c0 0x7faf80005b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:44:25.962 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:25.959+0000 7fafa1d0d640 1 --2- 172.21.15.88:0/2504118344 >> v2:172.21.15.175:3300/0 conn(0x7faf800036c0 0x7faf80005b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-26T23:44:26.760 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:26.757+0000 7fafa150c640 1 --2- 172.21.15.88:0/2504118344 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faf80006130 0x7faf800085f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:26.760 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:26.757+0000 7fafa150c640 1 -- 172.21.15.88:0/2504118344 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faf80006130 msgr2=0x7faf800085f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-26T23:44:26.760 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:26.757+0000 7fafa150c640 1 -- 172.21.15.88:0/2504118344 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faf80006130 msgr2=0x7faf800085f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T23:44:26.761 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:26.757+0000 7fafa150c640 1 --2- 172.21.15.88:0/2504118344 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faf80006130 0x7faf800085f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:44:26.761 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:26.757+0000 7fafa150c640 1 --2- 172.21.15.88:0/2504118344 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faf80006130 0x7faf800085f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-26T23:44:26.763 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:26.760+0000 7fafa1d0d640 1 --2- 172.21.15.88:0/2504118344 >> v2:172.21.15.175:3300/0 conn(0x7faf800036c0 0x7faf80005b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:26.763 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:26.760+0000 7fafa1d0d640 1 -- 172.21.15.88:0/2504118344 >> v2:172.21.15.175:3300/0 conn(0x7faf800036c0 msgr2=0x7faf80005b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-26T23:44:26.763 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:26.760+0000 7fafa1d0d640 1 -- 172.21.15.88:0/2504118344 >> v2:172.21.15.175:3300/0 conn(0x7faf800036c0 msgr2=0x7faf80005b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T23:44:26.764 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:26.760+0000 7fafa1d0d640 1 --2- 172.21.15.88:0/2504118344 >> v2:172.21.15.175:3300/0 conn(0x7faf800036c0 0x7faf80005b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:44:26.764 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:26.760+0000 7fafa1d0d640 1 --2- 172.21.15.88:0/2504118344 >> v2:172.21.15.175:3300/0 conn(0x7faf800036c0 0x7faf80005b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-26T23:44:28.357 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:28.353+0000 7faf937fe640 1 -- 172.21.15.88:0/2504118344 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faf80006130 msgr2=0x7faf800085f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T23:44:28.357 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:28.353+0000 7faf937fe640 1 --2- 172.21.15.88:0/2504118344 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faf80006130 0x7faf800085f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:28.357 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:28.353+0000 7faf937fe640 1 -- 172.21.15.88:0/2504118344 >> v2:172.21.15.175:3300/0 conn(0x7faf800036c0 msgr2=0x7faf80005b40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T23:44:28.357 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:28.353+0000 7faf937fe640 1 --2- 172.21.15.88:0/2504118344 >> v2:172.21.15.175:3300/0 conn(0x7faf800036c0 0x7faf80005b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:28.358 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:28.353+0000 7faf937fe640 1 --2- 172.21.15.88:0/2504118344 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faf800091e0 0x7faf8000b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:28.358 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:28.353+0000 7faf937fe640 1 --2- 172.21.15.88:0/2504118344 >> v2:172.21.15.175:3300/0 conn(0x7faf800036c0 0x7faf80003b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:28.358 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:28.353+0000 7faf937fe640 1 --2- 172.21.15.88:0/2504118344 >> v2:172.21.15.88:3300/0 conn(0x7faf9c0ab6a0 0x7faf80005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:28.358 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:28.353+0000 7faf937fe640 1 -- 172.21.15.88:0/2504118344 --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7faf9c0c4bd0 con 0x7faf9c0ab6a0 2024-04-26T23:44:28.358 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:28.353+0000 7faf937fe640 1 -- 172.21.15.88:0/2504118344 --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7faf80008d20 con 0x7faf800036c0 2024-04-26T23:44:28.358 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:28.353+0000 7faf937fe640 1 -- 172.21.15.88:0/2504118344 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7faf800087f0 con 0x7faf800091e0 2024-04-26T23:44:28.358 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:28.353+0000 7fafa250e640 1 -- 172.21.15.88:0/2504118344 reap_dead start 2024-04-26T23:44:28.358 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:28.354+0000 7fafa250e640 1 -- 172.21.15.88:0/2504118344 >> v2:172.21.15.88:3300/0 conn(0x7faf9c0ab6a0 msgr2=0x7faf80005180 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.88:3300/0 2024-04-26T23:44:28.358 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:28.354+0000 7fafa250e640 1 --2- 172.21.15.88:0/2504118344 >> v2:172.21.15.88:3300/0 conn(0x7faf9c0ab6a0 0x7faf80005180 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:44:28.358 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:28.354+0000 7fafa1d0d640 1 --2- 172.21.15.88:0/2504118344 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faf800091e0 0x7faf8000b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:28.358 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:28.354+0000 7fafa150c640 1 --2- 172.21.15.88:0/2504118344 >> v2:172.21.15.175:3300/0 conn(0x7faf800036c0 0x7faf80003b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:28.358 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:28.354+0000 7fafa1d0d640 1 -- 172.21.15.88:0/2504118344 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faf800091e0 msgr2=0x7faf8000b5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-26T23:44:28.359 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:28.354+0000 7fafa150c640 1 -- 172.21.15.88:0/2504118344 >> v2:172.21.15.175:3300/0 conn(0x7faf800036c0 msgr2=0x7faf80003b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-26T23:44:28.359 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:28.354+0000 7fafa150c640 1 -- 172.21.15.88:0/2504118344 >> v2:172.21.15.175:3300/0 conn(0x7faf800036c0 msgr2=0x7faf80003b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T23:44:28.359 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:28.354+0000 7fafa150c640 1 --2- 172.21.15.88:0/2504118344 >> v2:172.21.15.175:3300/0 conn(0x7faf800036c0 0x7faf80003b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:44:28.359 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:28.354+0000 7fafa1d0d640 1 -- 172.21.15.88:0/2504118344 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faf800091e0 msgr2=0x7faf8000b5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T23:44:28.359 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:28.354+0000 7fafa1d0d640 1 --2- 172.21.15.88:0/2504118344 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faf800091e0 0x7faf8000b5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:44:28.359 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:28.354+0000 7fafa1d0d640 1 --2- 172.21.15.88:0/2504118344 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faf800091e0 0x7faf8000b5d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:44:28.359 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:28.354+0000 7fafa150c640 1 --2- 172.21.15.88:0/2504118344 >> v2:172.21.15.175:3300/0 conn(0x7faf800036c0 0x7faf80003b30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:44:28.558 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:28.555+0000 7fafa250e640 1 -- 172.21.15.88:0/2504118344 >> v2:172.21.15.88:3300/0 conn(0x7faf9c0ab6a0 msgr2=0x7faf80005180 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.88:3300/0 2024-04-26T23:44:28.558 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:28.555+0000 7fafa250e640 1 --2- 172.21.15.88:0/2504118344 >> v2:172.21.15.88:3300/0 conn(0x7faf9c0ab6a0 0x7faf80005180 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-26T23:44:28.559 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:28.555+0000 7fafa1d0d640 1 --2- 172.21.15.88:0/2504118344 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faf800091e0 0x7faf8000b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:28.559 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:28.555+0000 7fafa150c640 1 --2- 172.21.15.88:0/2504118344 >> v2:172.21.15.175:3300/0 conn(0x7faf800036c0 0x7faf80003b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:28.559 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:28.556+0000 7fafa1d0d640 1 -- 172.21.15.88:0/2504118344 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faf800091e0 msgr2=0x7faf8000b5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-26T23:44:28.559 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:28.556+0000 7fafa1d0d640 1 -- 172.21.15.88:0/2504118344 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faf800091e0 msgr2=0x7faf8000b5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T23:44:28.559 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:28.556+0000 7fafa1d0d640 1 --2- 172.21.15.88:0/2504118344 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faf800091e0 0x7faf8000b5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:44:28.560 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:28.556+0000 7fafa1d0d640 1 --2- 172.21.15.88:0/2504118344 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faf800091e0 0x7faf8000b5d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-26T23:44:28.560 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:28.556+0000 7fafa150c640 1 -- 172.21.15.88:0/2504118344 >> v2:172.21.15.175:3300/0 conn(0x7faf800036c0 msgr2=0x7faf80003b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-26T23:44:28.560 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:28.556+0000 7fafa150c640 1 -- 172.21.15.88:0/2504118344 >> v2:172.21.15.175:3300/0 conn(0x7faf800036c0 msgr2=0x7faf80003b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T23:44:28.560 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:28.556+0000 7fafa150c640 1 --2- 172.21.15.88:0/2504118344 >> v2:172.21.15.175:3300/0 conn(0x7faf800036c0 0x7faf80003b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:44:28.560 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:28.556+0000 7fafa150c640 1 --2- 172.21.15.88:0/2504118344 >> v2:172.21.15.175:3300/0 conn(0x7faf800036c0 0x7faf80003b30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-26T23:44:28.959 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:28.956+0000 7fafa250e640 1 -- 172.21.15.88:0/2504118344 >> v2:172.21.15.88:3300/0 conn(0x7faf9c0ab6a0 msgr2=0x7faf80005180 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.88:3300/0 2024-04-26T23:44:28.959 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:28.956+0000 7fafa250e640 1 --2- 172.21.15.88:0/2504118344 >> v2:172.21.15.88:3300/0 conn(0x7faf9c0ab6a0 0x7faf80005180 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-26T23:44:28.961 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:28.957+0000 7fafa1d0d640 1 --2- 172.21.15.88:0/2504118344 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faf800091e0 0x7faf8000b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:28.961 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:28.957+0000 7fafa150c640 1 --2- 172.21.15.88:0/2504118344 >> v2:172.21.15.175:3300/0 conn(0x7faf800036c0 0x7faf80003b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:28.961 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:28.957+0000 7fafa150c640 1 -- 172.21.15.88:0/2504118344 >> v2:172.21.15.175:3300/0 conn(0x7faf800036c0 msgr2=0x7faf80003b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-26T23:44:28.961 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:28.957+0000 7fafa150c640 1 -- 172.21.15.88:0/2504118344 >> v2:172.21.15.175:3300/0 conn(0x7faf800036c0 msgr2=0x7faf80003b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T23:44:28.961 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:28.957+0000 7fafa150c640 1 --2- 172.21.15.88:0/2504118344 >> v2:172.21.15.175:3300/0 conn(0x7faf800036c0 0x7faf80003b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:44:28.961 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:28.957+0000 7fafa150c640 1 --2- 172.21.15.88:0/2504118344 >> v2:172.21.15.175:3300/0 conn(0x7faf800036c0 0x7faf80003b30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-26T23:44:28.962 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:28.957+0000 7fafa1d0d640 1 -- 172.21.15.88:0/2504118344 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faf800091e0 msgr2=0x7faf8000b5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-26T23:44:28.962 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:28.957+0000 7fafa1d0d640 1 -- 172.21.15.88:0/2504118344 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faf800091e0 msgr2=0x7faf8000b5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T23:44:28.962 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:28.957+0000 7fafa1d0d640 1 --2- 172.21.15.88:0/2504118344 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faf800091e0 0x7faf8000b5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:44:28.962 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:28.957+0000 7fafa1d0d640 1 --2- 172.21.15.88:0/2504118344 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faf800091e0 0x7faf8000b5d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-26T23:44:29.760 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:29.757+0000 7fafa250e640 1 -- 172.21.15.88:0/2504118344 >> v2:172.21.15.88:3300/0 conn(0x7faf9c0ab6a0 msgr2=0x7faf80005180 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.88:3300/0 2024-04-26T23:44:29.760 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:29.757+0000 7fafa250e640 1 --2- 172.21.15.88:0/2504118344 >> v2:172.21.15.88:3300/0 conn(0x7faf9c0ab6a0 0x7faf80005180 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-26T23:44:29.761 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:29.758+0000 7fafa1d0d640 1 --2- 172.21.15.88:0/2504118344 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faf800091e0 0x7faf8000b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:29.761 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:29.758+0000 7fafa150c640 1 --2- 172.21.15.88:0/2504118344 >> v2:172.21.15.175:3300/0 conn(0x7faf800036c0 0x7faf80003b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:29.762 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:29.758+0000 7fafa1d0d640 1 -- 172.21.15.88:0/2504118344 >> v2:172.21.15.175:3300/0 conn(0x7faf800036c0 msgr2=0x7faf80003b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:44:29.762 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:29.758+0000 7fafa1d0d640 1 --2- 172.21.15.88:0/2504118344 >> v2:172.21.15.175:3300/0 conn(0x7faf800036c0 0x7faf80003b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:29.762 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:29.758+0000 7fafa1d0d640 1 -- 172.21.15.88:0/2504118344 >> v2:172.21.15.88:3300/0 conn(0x7faf9c0ab6a0 msgr2=0x7faf80005180 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T23:44:29.762 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:29.758+0000 7fafa1d0d640 1 --2- 172.21.15.88:0/2504118344 >> v2:172.21.15.88:3300/0 conn(0x7faf9c0ab6a0 0x7faf80005180 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:29.762 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:29.758+0000 7fafa1d0d640 1 -- 172.21.15.88:0/2504118344 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf9c0c48f0 con 0x7faf800091e0 2024-04-26T23:44:29.762 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:29.759+0000 7fafa150c640 1 --2- 172.21.15.88:0/2504118344 >> v2:172.21.15.175:3300/0 conn(0x7faf800036c0 0x7faf80003b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:44:29.763 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:29.760+0000 7fafa1d0d640 1 --2- 172.21.15.88:0/2504118344 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faf800091e0 0x7faf8000b5d0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7faf9c0ab610 tx=0x7faf9802c4d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cdb1bd35e936b717 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:29.763 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:29.760+0000 7fafa0d0b640 1 -- 172.21.15.88:0/2504118344 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf98032480 con 0x7faf800091e0 2024-04-26T23:44:29.765 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:29.760+0000 7fafa0d0b640 1 -- 172.21.15.88:0/2504118344 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf98032620 con 0x7faf800091e0 2024-04-26T23:44:29.765 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:29.761+0000 7fafa3f71640 1 -- 172.21.15.88:0/2504118344 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faf800091e0 msgr2=0x7faf8000b5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:29.765 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:29.761+0000 7fafa3f71640 1 --2- 172.21.15.88:0/2504118344 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faf800091e0 0x7faf8000b5d0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7faf9c0ab610 tx=0x7faf9802c4d0 comp rx=0 tx=0).stop 2024-04-26T23:44:29.765 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:29.762+0000 7fafa3f71640 1 -- 172.21.15.88:0/2504118344 shutdown_connections 2024-04-26T23:44:29.765 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:29.762+0000 7fafa3f71640 1 --2- 172.21.15.88:0/2504118344 >> v2:172.21.15.88:3300/0 conn(0x7faf9c0ab6a0 0x7faf80005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:29.765 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:29.762+0000 7fafa3f71640 1 --2- 172.21.15.88:0/2504118344 >> v2:172.21.15.175:3300/0 conn(0x7faf800036c0 0x7faf80003b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:29.765 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:29.762+0000 7fafa3f71640 1 --2- 172.21.15.88:0/2504118344 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faf800091e0 0x7faf8000b5d0 secure :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7faf9c0ab610 tx=0x7faf9802c4d0 comp rx=0 tx=0).stop 2024-04-26T23:44:29.765 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:29.762+0000 7fafa3f71640 1 -- 172.21.15.88:0/2504118344 >> 172.21.15.88:0/2504118344 conn(0x7faf9c0c82d0 msgr2=0x7faf9c0c86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:44:29.766 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:29.762+0000 7fafa3f71640 1 -- 172.21.15.88:0/2504118344 shutdown_connections 2024-04-26T23:44:29.766 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:29.762+0000 7fafa3f71640 1 -- 172.21.15.88:0/2504118344 wait complete. 2024-04-26T23:44:29.767 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:29.764+0000 7fafa3f71640 1 Processor -- start 2024-04-26T23:44:29.769 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:29.764+0000 7fafa3f71640 1 -- start start 2024-04-26T23:44:29.769 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:29.765+0000 7fafa3f71640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faf800036c0 0x7faf9c0c72b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:29.769 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:29.765+0000 7fafa3f71640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faf9c0ab6a0 0x7faf9c1f1310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:29.769 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:29.765+0000 7fafa3f71640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faf9c1f4b60 0x7faf9c147400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:29.770 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:29.765+0000 7fafa3f71640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7faf9c150760 con 0x7faf800036c0 2024-04-26T23:44:29.770 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:29.765+0000 7fafa3f71640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7faf9c1505e0 con 0x7faf9c1f4b60 2024-04-26T23:44:29.770 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:29.765+0000 7fafa3f71640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7faf9c0c8dc0 con 0x7faf9c0ab6a0 2024-04-26T23:44:29.770 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:29.765+0000 7fafa150c640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faf9c0ab6a0 0x7faf9c1f1310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:29.770 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:29.765+0000 7fafa150c640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faf9c0ab6a0 0x7faf9c1f1310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.88:47918/0 (socket says 172.21.15.88:47918) 2024-04-26T23:44:29.770 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:29.765+0000 7fafa150c640 1 -- 172.21.15.88:0/1811135742 learned_addr learned my addr 172.21.15.88:0/1811135742 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:44:29.770 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:29.766+0000 7fafa250e640 1 --2- 172.21.15.88:0/1811135742 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faf9c1f4b60 0x7faf9c147400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:29.770 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:29.766+0000 7fafa1d0d640 1 -- 172.21.15.88:0/1811135742 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faf800036c0 msgr2=0x7faf9c0c72b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.88:3300/0 2024-04-26T23:44:29.770 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:29.766+0000 7fafa1d0d640 1 --2- 172.21.15.88:0/1811135742 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faf800036c0 0x7faf9c0c72b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:44:29.771 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:29.766+0000 7fafa250e640 1 -- 172.21.15.88:0/1811135742 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faf9c0ab6a0 msgr2=0x7faf9c1f1310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:29.771 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:29.768+0000 7fafa250e640 1 --2- 172.21.15.88:0/1811135742 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faf9c0ab6a0 0x7faf9c1f1310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:29.771 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:29.768+0000 7fafa250e640 1 -- 172.21.15.88:0/1811135742 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faf800036c0 msgr2=0x7faf9c0c72b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T23:44:29.771 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:29.768+0000 7fafa250e640 1 --2- 172.21.15.88:0/1811135742 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faf800036c0 0x7faf9c0c72b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:29.771 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:29.768+0000 7fafa250e640 1 -- 172.21.15.88:0/1811135742 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf9c074900 con 0x7faf9c1f4b60 2024-04-26T23:44:29.771 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:29.768+0000 7fafa150c640 1 --2- 172.21.15.88:0/1811135742 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faf9c0ab6a0 0x7faf9c1f1310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:44:29.773 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:29.770+0000 7fafa250e640 1 --2- 172.21.15.88:0/1811135742 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faf9c1f4b60 0x7faf9c147400 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7faf9c06b6a0 tx=0x7faf9400cde0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:29.776 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:29.771+0000 7faf927fc640 1 -- 172.21.15.88:0/1811135742 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf9400b040 con 0x7faf9c1f4b60 2024-04-26T23:44:29.776 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:29.771+0000 7fafa3f71640 1 -- 172.21.15.88:0/1811135742 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf9c074be0 con 0x7faf9c1f4b60 2024-04-26T23:44:29.776 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:29.772+0000 7fafa3f71640 1 -- 172.21.15.88:0/1811135742 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf9c0c77f0 con 0x7faf9c1f4b60 2024-04-26T23:44:29.776 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:29.772+0000 7faf927fc640 1 -- 172.21.15.88:0/1811135742 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf94015020 con 0x7faf9c1f4b60 2024-04-26T23:44:29.776 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:29.772+0000 7faf927fc640 1 -- 172.21.15.88:0/1811135742 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf9400ac30 con 0x7faf9c1f4b60 2024-04-26T23:44:29.776 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:29.773+0000 7fafa3f71640 1 -- 172.21.15.88:0/1811135742 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf84005290 con 0x7faf9c1f4b60 2024-04-26T23:44:29.778 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:29.774+0000 7faf927fc640 1 -- 172.21.15.88:0/1811135742 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7faf94010410 con 0x7faf9c1f4b60 2024-04-26T23:44:29.778 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:29.775+0000 7faf927fc640 1 --2- 172.21.15.88:0/1811135742 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7faf8806c9f0 0x7faf8806eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:29.778 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:29.775+0000 7faf927fc640 1 -- 172.21.15.88:0/1811135742 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6666+0+0 (secure 0 0 0) 0x7faf9408c190 con 0x7faf9c1f4b60 2024-04-26T23:44:29.779 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:29.775+0000 7fafa1d0d640 1 --2- 172.21.15.88:0/1811135742 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7faf8806c9f0 0x7faf8806eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:29.779 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:29.776+0000 7fafa1d0d640 1 --2- 172.21.15.88:0/1811135742 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7faf8806c9f0 0x7faf8806eeb0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7faf98036000 tx=0x7faf98005040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:29.790 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:29.785+0000 7faf927fc640 1 -- 172.21.15.88:0/1811135742 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7faf9401f030 con 0x7faf9c1f4b60 2024-04-26T23:44:30.267 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:30.264+0000 7fafa3f71640 1 -- 172.21.15.88:0/1811135742 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7faf84005580 con 0x7faf9c1f4b60 2024-04-26T23:44:30.273 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:30.270+0000 7faf927fc640 1 -- 172.21.15.88:0/1811135742 <== mon.1 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1558 (secure 0 0 0) 0x7faf940202b0 con 0x7faf9c1f4b60 2024-04-26T23:44:30.273 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":34,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":1,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"555255e9-7ef9-4454-8dc9-35e96b70035c","modified":"2024-04-26T23:39:34.291658Z","created":"2024-04-26T23:39:34.291658Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:3300","nonce":0},{"type":"v1","addr":"172.21.15.175:6789","nonce":0}]},"addr":"172.21.15.175:6789/0","public_addr":"172.21.15.175:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:3301","nonce":0},{"type":"v1","addr":"172.21.15.175:6790","nonce":0}]},"addr":"172.21.15.175:6790/0","public_addr":"172.21.15.175:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-04-26T23:44:30.277 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:30.274+0000 7fafa3f71640 1 -- 172.21.15.88:0/1811135742 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7faf8806c9f0 msgr2=0x7faf8806eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:30.278 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:30.274+0000 7fafa3f71640 1 --2- 172.21.15.88:0/1811135742 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7faf8806c9f0 0x7faf8806eeb0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7faf98036000 tx=0x7faf98005040 comp rx=0 tx=0).stop 2024-04-26T23:44:30.278 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:30.274+0000 7fafa3f71640 1 -- 172.21.15.88:0/1811135742 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faf9c1f4b60 msgr2=0x7faf9c147400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:30.278 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:30.274+0000 7fafa3f71640 1 --2- 172.21.15.88:0/1811135742 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faf9c1f4b60 0x7faf9c147400 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7faf9c06b6a0 tx=0x7faf9400cde0 comp rx=0 tx=0).stop 2024-04-26T23:44:30.278 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:30.275+0000 7fafa3f71640 1 -- 172.21.15.88:0/1811135742 shutdown_connections 2024-04-26T23:44:30.278 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:30.275+0000 7fafa3f71640 1 --2- 172.21.15.88:0/1811135742 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7faf8806c9f0 0x7faf8806eeb0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:30.279 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:30.275+0000 7fafa3f71640 1 --2- 172.21.15.88:0/1811135742 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faf9c0ab6a0 0x7faf9c1f1310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:30.279 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:30.275+0000 7fafa3f71640 1 --2- 172.21.15.88:0/1811135742 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faf9c1f4b60 0x7faf9c147400 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:30.279 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:30.275+0000 7fafa3f71640 1 --2- 172.21.15.88:0/1811135742 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faf800036c0 0x7faf9c0c72b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:30.279 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:30.275+0000 7fafa3f71640 1 -- 172.21.15.88:0/1811135742 >> 172.21.15.88:0/1811135742 conn(0x7faf9c0c82d0 msgr2=0x7faf9c0ac230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:44:30.279 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:30.275+0000 7fafa3f71640 1 -- 172.21.15.88:0/1811135742 shutdown_connections 2024-04-26T23:44:30.279 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:30.275+0000 7fafa3f71640 1 -- 172.21.15.88:0/1811135742 wait complete. 2024-04-26T23:44:30.297 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2024-04-26T23:44:30.297 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon b 2024-04-26T23:44:30.297 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-04-26T23:44:30.466 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:30.458+0000 7f5056f97640 1 Processor -- start 2024-04-26T23:44:30.467 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:30.458+0000 7f5056f97640 1 -- start start 2024-04-26T23:44:30.467 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:30.459+0000 7f5056f97640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f505014ecd0 0x7f50501555a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:30.467 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:30.459+0000 7f5056f97640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f50500ac710 0x7f50500ab470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:30.467 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:30.459+0000 7f5056f97640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f505014f0b0 con 0x7f5050073690 2024-04-26T23:44:30.467 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:30.460+0000 7f5056f97640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f5050074c90 con 0x7f505014ecd0 2024-04-26T23:44:30.467 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:30.460+0000 7f5056f97640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f50500c6400 con 0x7f50500ac710 2024-04-26T23:44:30.467 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:30.461+0000 7f5055534640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f5050073690 0x7f5050157fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.88:35350/0 (socket says 172.21.15.88:35350) 2024-04-26T23:44:30.467 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:30.461+0000 7f5055534640 1 -- 172.21.15.88:0/4263935005 learned_addr learned my addr 172.21.15.88:0/4263935005 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-26T23:44:30.467 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:30.461+0000 7f504ffff640 1 --2- 172.21.15.88:0/4263935005 >> v2:172.21.15.175:3300/0 conn(0x7f50500ac710 0x7f50500ab470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:30.467 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:30.461+0000 7f504ffff640 1 -- 172.21.15.88:0/4263935005 >> v2:172.21.15.88:3300/0 conn(0x7f505014ecd0 msgr2=0x7f50501555a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T23:44:30.467 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:30.461+0000 7f504ffff640 1 --2- 172.21.15.88:0/4263935005 >> v2:172.21.15.88:3300/0 conn(0x7f505014ecd0 0x7f50501555a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:30.467 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:30.462+0000 7f504ffff640 1 -- 172.21.15.88:0/4263935005 >> v1:172.21.15.175:6789/0 conn(0x7f5050073690 legacy=0x7f5050157fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:30.468 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:30.462+0000 7f504ffff640 1 -- 172.21.15.88:0/4263935005 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50500c66e0 con 0x7f50500ac710 2024-04-26T23:44:30.468 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:30.463+0000 7f504ffff640 1 --2- 172.21.15.88:0/4263935005 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f50500ac710 0x7f50500ab470 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f50500c7c80 tx=0x7f504402a0d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5217f4757d062545 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:30.468 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:30.463+0000 7f504f7fe640 1 -- 172.21.15.88:0/4263935005 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5044037070 con 0x7f50500ac710 2024-04-26T23:44:30.468 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:30.463+0000 7f504f7fe640 1 -- 172.21.15.88:0/4263935005 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f504402ae20 con 0x7f50500ac710 2024-04-26T23:44:30.468 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:30.463+0000 7f504f7fe640 1 -- 172.21.15.88:0/4263935005 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5044032660 con 0x7f50500ac710 2024-04-26T23:44:30.470 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:30.464+0000 7f5056f97640 1 -- 172.21.15.88:0/4263935005 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f50500ac710 msgr2=0x7f50500ab470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:30.470 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:30.464+0000 7f5056f97640 1 --2- 172.21.15.88:0/4263935005 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f50500ac710 0x7f50500ab470 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f50500c7c80 tx=0x7f504402a0d0 comp rx=0 tx=0).stop 2024-04-26T23:44:30.474 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:30.469+0000 7f5056f97640 1 -- 172.21.15.88:0/4263935005 shutdown_connections 2024-04-26T23:44:30.474 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:30.469+0000 7f5056f97640 1 --2- 172.21.15.88:0/4263935005 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f50500ac710 0x7f50500ab470 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:30.475 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:30.469+0000 7f5056f97640 1 --2- 172.21.15.88:0/4263935005 >> v2:172.21.15.88:3300/0 conn(0x7f505014ecd0 0x7f50501555a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:30.475 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:30.469+0000 7f5056f97640 1 -- 172.21.15.88:0/4263935005 >> 172.21.15.88:0/4263935005 conn(0x7f50500c6d80 msgr2=0x7f50500c7160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:44:30.475 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:30.472+0000 7f5056f97640 1 -- 172.21.15.88:0/4263935005 shutdown_connections 2024-04-26T23:44:30.477 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:30.472+0000 7f5056f97640 1 -- 172.21.15.88:0/4263935005 wait complete. 2024-04-26T23:44:30.477 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:30.474+0000 7f5056f97640 1 Processor -- start 2024-04-26T23:44:30.479 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:30.474+0000 7f5056f97640 1 -- start start 2024-04-26T23:44:30.479 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:30.476+0000 7f5056f97640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5050073690 0x7f5050158ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:30.480 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:30.476+0000 7f5056f97640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f50500ac710 0x7f505014b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:30.480 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:30.476+0000 7f5056f97640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f505014ecd0 0x7f5050150970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:30.480 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:30.476+0000 7f5056f97640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f5050155080 con 0x7f50500ac710 2024-04-26T23:44:30.480 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:30.476+0000 7f5056f97640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f5050154da0 con 0x7f505014ecd0 2024-04-26T23:44:30.480 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:30.476+0000 7f5056f97640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f50500c69c0 con 0x7f5050073690 2024-04-26T23:44:30.480 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:30.476+0000 7f504ffff640 1 -- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f50500ac710 msgr2=0x7f505014b7a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.88:3300/0 2024-04-26T23:44:30.480 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:30.476+0000 7f5055534640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f505014ecd0 0x7f5050150970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:30.480 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:30.476+0000 7f5055534640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f505014ecd0 0x7f5050150970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.88:45490/0 (socket says 172.21.15.88:45490) 2024-04-26T23:44:30.480 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:30.476+0000 7f5055534640 1 -- 172.21.15.88:0/535334023 learned_addr learned my addr 172.21.15.88:0/535334023 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:44:30.483 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:30.476+0000 7f5054d33640 1 --2- 172.21.15.88:0/535334023 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5050073690 0x7f5050158ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:30.483 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:30.478+0000 7f5054d33640 1 -- 172.21.15.88:0/535334023 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f505014ecd0 msgr2=0x7f5050150970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:30.483 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:30.478+0000 7f5054d33640 1 --2- 172.21.15.88:0/535334023 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f505014ecd0 0x7f5050150970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:30.484 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:30.478+0000 7f5054d33640 1 -- 172.21.15.88:0/535334023 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f50500ac710 msgr2=0x7f505014b7a0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-26T23:44:30.484 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:30.480+0000 7f504ffff640 1 --2- 172.21.15.88:0/535334023 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f50500ac710 0x7f505014b7a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:44:30.484 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:30.481+0000 7f5054d33640 1 --2- 172.21.15.88:0/535334023 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f50500ac710 0x7f505014b7a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:30.484 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:30.481+0000 7f5054d33640 1 -- 172.21.15.88:0/535334023 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f505014c130 con 0x7f5050073690 2024-04-26T23:44:30.484 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:30.481+0000 7f5054d33640 1 --2- 172.21.15.88:0/535334023 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5050073690 0x7f5050158ab0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f503c009fd0 tx=0x7f503c00b870 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:30.485 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:30.482+0000 7f504d7fa640 1 -- 172.21.15.88:0/535334023 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f503c015020 con 0x7f5050073690 2024-04-26T23:44:30.487 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:30.482+0000 7f5056f97640 1 -- 172.21.15.88:0/535334023 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f505014be50 con 0x7f5050073690 2024-04-26T23:44:30.487 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:30.482+0000 7f5056f97640 1 -- 172.21.15.88:0/535334023 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f5050151f10 con 0x7f5050073690 2024-04-26T23:44:30.487 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:30.483+0000 7f504d7fa640 1 -- 172.21.15.88:0/535334023 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f503c011850 con 0x7f5050073690 2024-04-26T23:44:30.487 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:30.483+0000 7f5056f97640 1 --2- 172.21.15.88:0/535334023 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f505014c380 0x7f50501582b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:30.487 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:30.484+0000 7f5056f97640 1 -- 172.21.15.88:0/535334023 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f50501587f0 con 0x7f505014c380 2024-04-26T23:44:30.487 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:30.484+0000 7f504d7fa640 1 -- 172.21.15.88:0/535334023 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f503c011c80 con 0x7f5050073690 2024-04-26T23:44:30.487 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:30.484+0000 7f504ffff640 1 --2- 172.21.15.88:0/535334023 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f505014c380 0x7f50501582b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:30.488 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:30.485+0000 7f504ffff640 1 -- 172.21.15.88:0/535334023 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f50500507a0 con 0x7f505014c380 2024-04-26T23:44:30.489 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:30.486+0000 7f504d7fa640 1 -- 172.21.15.88:0/535334023 <== mon.2 v2:172.21.15.175:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f503c018020 con 0x7f5050073690 2024-04-26T23:44:30.490 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:30.487+0000 7f504d7fa640 1 --2- 172.21.15.88:0/535334023 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f503406c8a0 0x7f503406ed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:30.491 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:30.487+0000 7f5055534640 1 --2- 172.21.15.88:0/535334023 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f503406c8a0 0x7f503406ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:30.491 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:30.488+0000 7f5055534640 1 --2- 172.21.15.88:0/535334023 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f503406c8a0 0x7f503406ed60 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f5048001e60 tx=0x7f50480019a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:30.491 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:30.488+0000 7f504ffff640 1 --2- 172.21.15.88:0/535334023 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f505014c380 0x7f50501582b0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f5050074bb0 tx=0x7f50440046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:30.491 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:30.488+0000 7f504d7fa640 1 -- 172.21.15.88:0/535334023 <== mon.2 v2:172.21.15.175:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6666+0+0 (secure 0 0 0) 0x7f503c08bf90 con 0x7f5050073690 2024-04-26T23:44:30.492 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:30.488+0000 7f504d7fa640 1 -- 172.21.15.88:0/535334023 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5044037040 con 0x7f505014c380 2024-04-26T23:44:30.493 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:30.490+0000 7f504d7fa640 1 -- 172.21.15.88:0/535334023 <== mon.1 v2:172.21.15.175:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f5044032d10 con 0x7f505014c380 2024-04-26T23:44:30.493 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:30.490+0000 7f504d7fa640 1 -- 172.21.15.88:0/535334023 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f505014c380 msgr2=0x7f50501582b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:30.493 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:30.490+0000 7f504d7fa640 1 --2- 172.21.15.88:0/535334023 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f505014c380 0x7f50501582b0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f5050074bb0 tx=0x7f50440046c0 comp rx=0 tx=0).stop 2024-04-26T23:44:30.493 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:30.490+0000 7f504d7fa640 1 -- 172.21.15.88:0/535334023 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f505014c380 msgr2=0x7f50501582b0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:44:30.493 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:30.490+0000 7f504d7fa640 1 --2- 172.21.15.88:0/535334023 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f505014c380 0x7f50501582b0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:30.534 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:30.530+0000 7f5056f97640 1 --2- 172.21.15.88:0/535334023 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f50500ae3f0 0x7f50500ae800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:30.534 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:30.530+0000 7f5056f97640 1 -- 172.21.15.88:0/535334023 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f5050076650 con 0x7f50500ae3f0 2024-04-26T23:44:30.534 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:30.531+0000 7f504ffff640 1 --2- 172.21.15.88:0/535334023 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f50500ae3f0 0x7f50500ae800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:30.535 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:30.531+0000 7f504ffff640 1 -- 172.21.15.88:0/535334023 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f5050152e80 con 0x7f50500ae3f0 2024-04-26T23:44:30.535 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:30.532+0000 7f504ffff640 1 --2- 172.21.15.88:0/535334023 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f50500ae3f0 0x7f50500ae800 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f5044000c00 tx=0x7f5044009190 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:30.535 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:30.532+0000 7f504d7fa640 1 -- 172.21.15.88:0/535334023 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5044037040 con 0x7f50500ae3f0 2024-04-26T23:44:30.536 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-04-26T23:44:30.537 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2024-04-26T23:44:30.537 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2024-04-26T23:44:30.537 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "leader", 2024-04-26T23:44:30.537 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 34, 2024-04-26T23:44:30.537 INFO:teuthology.orchestra.run.smithi088.stdout: "uptime": 262875, 2024-04-26T23:44:30.537 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2024-04-26T23:44:30.537 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2024-04-26T23:44:30.537 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2024-04-26T23:44:30.537 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:44:30.537 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 1, 2024-04-26T23:44:30.537 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2024-04-26T23:44:30.537 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2450521708007866372", 2024-04-26T23:44:30.537 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2024-04-26T23:44:30.538 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-04-26T23:44:30.538 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-04-26T23:44:30.538 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-04-26T23:44:30.538 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-04-26T23:44:30.538 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-04-26T23:44:30.538 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-04-26T23:44:30.538 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-04-26T23:44:30.538 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-04-26T23:44:30.538 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-04-26T23:44:30.538 INFO:teuthology.orchestra.run.smithi088.stdout: "reef", 2024-04-26T23:44:30.538 INFO:teuthology.orchestra.run.smithi088.stdout: "squid" 2024-04-26T23:44:30.538 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:44:30.538 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540701547738038271", 2024-04-26T23:44:30.539 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2024-04-26T23:44:30.539 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-04-26T23:44:30.539 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-04-26T23:44:30.539 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-04-26T23:44:30.539 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-04-26T23:44:30.539 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-04-26T23:44:30.539 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-04-26T23:44:30.539 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-04-26T23:44:30.539 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-04-26T23:44:30.539 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-04-26T23:44:30.539 INFO:teuthology.orchestra.run.smithi088.stdout: "reef", 2024-04-26T23:44:30.539 INFO:teuthology.orchestra.run.smithi088.stdout: "squid" 2024-04-26T23:44:30.539 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:44:30.540 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:44:30.540 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2024-04-26T23:44:30.540 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2024-04-26T23:44:30.540 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2024-04-26T23:44:30.540 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2024-04-26T23:44:30.540 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2024-04-26T23:44:30.540 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "555255e9-7ef9-4454-8dc9-35e96b70035c", 2024-04-26T23:44:30.540 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2024-04-26T23:39:34.291658Z", 2024-04-26T23:44:30.540 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2024-04-26T23:39:34.291658Z", 2024-04-26T23:44:30.540 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 19, 2024-04-26T23:44:30.540 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "squid", 2024-04-26T23:44:30.540 INFO:teuthology.orchestra.run.smithi088.stdout: "election_strategy": 1, 2024-04-26T23:44:30.540 INFO:teuthology.orchestra.run.smithi088.stdout: "disallowed_leaders: ": "", 2024-04-26T23:44:30.540 INFO:teuthology.orchestra.run.smithi088.stdout: "stretch_mode": false, 2024-04-26T23:44:30.541 INFO:teuthology.orchestra.run.smithi088.stdout: "tiebreaker_mon": "", 2024-04-26T23:44:30.541 INFO:teuthology.orchestra.run.smithi088.stdout: "removed_ranks: ": "", 2024-04-26T23:44:30.541 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2024-04-26T23:44:30.541 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2024-04-26T23:44:30.541 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-04-26T23:44:30.541 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-04-26T23:44:30.541 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-04-26T23:44:30.541 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-04-26T23:44:30.541 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-04-26T23:44:30.541 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-04-26T23:44:30.541 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-04-26T23:44:30.541 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-04-26T23:44:30.541 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-04-26T23:44:30.542 INFO:teuthology.orchestra.run.smithi088.stdout: "reef", 2024-04-26T23:44:30.542 INFO:teuthology.orchestra.run.smithi088.stdout: "squid" 2024-04-26T23:44:30.542 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:44:30.542 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2024-04-26T23:44:30.542 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:44:30.542 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2024-04-26T23:44:30.542 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:44:30.542 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2024-04-26T23:44:30.542 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2024-04-26T23:44:30.542 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-04-26T23:44:30.542 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-04-26T23:44:30.542 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:44:30.542 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-04-26T23:44:30.543 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2024-04-26T23:44:30.543 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:44:30.543 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:44:30.543 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:44:30.543 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-04-26T23:44:30.543 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2024-04-26T23:44:30.543 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:44:30.543 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:44:30.543 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:44:30.543 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:44:30.543 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2024-04-26T23:44:30.543 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2024-04-26T23:44:30.543 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-04-26T23:44:30.543 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-04-26T23:44:30.544 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-04-26T23:44:30.544 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:44:30.544 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:44:30.544 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2024-04-26T23:44:30.544 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2024-04-26T23:44:30.544 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-04-26T23:44:30.544 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-04-26T23:44:30.544 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:44:30.544 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-04-26T23:44:30.544 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:3300", 2024-04-26T23:44:30.544 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:44:30.544 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:44:30.544 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:44:30.545 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-04-26T23:44:30.545 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6789", 2024-04-26T23:44:30.545 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:44:30.545 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:44:30.545 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:44:30.545 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:44:30.545 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6789/0", 2024-04-26T23:44:30.545 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.175:6789/0", 2024-04-26T23:44:30.545 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-04-26T23:44:30.545 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-04-26T23:44:30.545 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-04-26T23:44:30.545 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:44:30.545 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:44:30.545 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2024-04-26T23:44:30.545 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2024-04-26T23:44:30.546 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-04-26T23:44:30.546 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-04-26T23:44:30.546 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:44:30.546 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-04-26T23:44:30.546 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:3301", 2024-04-26T23:44:30.546 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:44:30.546 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:44:30.546 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:44:30.546 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-04-26T23:44:30.546 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6790", 2024-04-26T23:44:30.546 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:44:30.546 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:44:30.546 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:44:30.546 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:44:30.547 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6790/0", 2024-04-26T23:44:30.547 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.175:6790/0", 2024-04-26T23:44:30.547 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-04-26T23:44:30.547 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-04-26T23:44:30.547 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-04-26T23:44:30.547 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:44:30.547 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:44:30.547 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:44:30.547 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2024-04-26T23:44:30.547 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2024-04-26T23:44:30.547 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:44:30.547 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:44:30.547 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:44:30.547 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2024-04-26T23:44:30.548 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:44:30.548 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:44:30.548 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": [ 2024-04-26T23:44:30.548 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:44:30.548 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:44:30.548 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:44:30.548 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 4 2024-04-26T23:44:30.548 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:44:30.548 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:44:30.548 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": [ 2024-04-26T23:44:30.548 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:44:30.548 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:44:30.548 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:44:30.548 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 7 2024-04-26T23:44:30.549 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:44:30.549 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:44:30.549 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2024-04-26T23:44:30.549 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:44:30.549 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x2f018fb87aa4aafe", 2024-04-26T23:44:30.549 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:44:30.549 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2024-04-26T23:44:30.549 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:44:30.549 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:44:30.549 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:44:30.549 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:44:30.549 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 5 2024-04-26T23:44:30.549 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:44:30.549 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:44:30.549 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": [ 2024-04-26T23:44:30.550 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:44:30.550 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:44:30.550 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:44:30.550 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2024-04-26T23:44:30.550 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:44:30.550 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:44:30.550 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:44:30.550 INFO:teuthology.orchestra.run.smithi088.stdout: "stretch_mode": false 2024-04-26T23:44:30.550 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-04-26T23:44:30.551 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:30.533+0000 7f504d7fa640 1 -- 172.21.15.88:0/535334023 <== mon.1 v2:172.21.15.175:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5199 (secure 0 0 0) 0x7f50440477f0 con 0x7f50500ae3f0 2024-04-26T23:44:30.551 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:30.533+0000 7f504d7fa640 1 -- 172.21.15.88:0/535334023 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f50500ae3f0 msgr2=0x7f50500ae800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:30.551 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:30.533+0000 7f504d7fa640 1 --2- 172.21.15.88:0/535334023 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f50500ae3f0 0x7f50500ae800 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f5044000c00 tx=0x7f5044009190 comp rx=0 tx=0).stop 2024-04-26T23:44:30.551 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:30.533+0000 7f504d7fa640 1 -- 172.21.15.88:0/535334023 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f50500ae3f0 msgr2=0x7f50500ae800 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:44:30.551 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:30.533+0000 7f504d7fa640 1 --2- 172.21.15.88:0/535334023 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f50500ae3f0 0x7f50500ae800 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:30.551 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:30.537+0000 7f5056f97640 1 -- 172.21.15.88:0/535334023 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f503406c8a0 msgr2=0x7f503406ed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:30.551 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:30.537+0000 7f5056f97640 1 --2- 172.21.15.88:0/535334023 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f503406c8a0 0x7f503406ed60 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f5048001e60 tx=0x7f50480019a0 comp rx=0 tx=0).stop 2024-04-26T23:44:30.551 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:30.537+0000 7f5056f97640 1 -- 172.21.15.88:0/535334023 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5050073690 msgr2=0x7f5050158ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:30.552 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:30.537+0000 7f5056f97640 1 --2- 172.21.15.88:0/535334023 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5050073690 0x7f5050158ab0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f503c009fd0 tx=0x7f503c00b870 comp rx=0 tx=0).stop 2024-04-26T23:44:30.552 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:30.537+0000 7f5055534640 1 -- 172.21.15.88:0/535334023 reap_dead start 2024-04-26T23:44:30.552 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:30.537+0000 7f5056f97640 1 -- 172.21.15.88:0/535334023 shutdown_connections 2024-04-26T23:44:30.552 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:30.537+0000 7f5056f97640 1 --2- 172.21.15.88:0/535334023 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5050073690 0x7f5050158ab0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:30.552 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:30.537+0000 7f5056f97640 1 -- 172.21.15.88:0/535334023 >> 172.21.15.88:0/535334023 conn(0x7f50500c6d80 msgr2=0x7f5050153b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:44:30.552 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:30.537+0000 7f5056f97640 1 -- 172.21.15.88:0/535334023 shutdown_connections 2024-04-26T23:44:30.552 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:30.537+0000 7f5056f97640 1 -- 172.21.15.88:0/535334023 wait complete. 2024-04-26T23:44:30.569 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-04-26T23:44:30.569 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon c 2024-04-26T23:44:30.569 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-04-26T23:44:30.751 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:30.748+0000 7f1c1b247640 1 Processor -- start 2024-04-26T23:44:30.751 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:30.748+0000 7f1c1b247640 1 -- start start 2024-04-26T23:44:30.753 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:30.750+0000 7f1c1b247640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f1c14074770 0x7f1c140c4690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:30.753 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:30.750+0000 7f1c13fff640 1 -- >> v1:172.21.15.88:6789/0 conn(0x7f1c140c3510 legacy=0x7f1c14073ae0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.88:6789/0 2024-04-26T23:44:30.753 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:30.750+0000 7f1c1b247640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1c14154b00 con 0x7f1c140c3510 2024-04-26T23:44:30.754 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:30.750+0000 7f1c1b247640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1c140c2e00 con 0x7f1c14074b50 2024-04-26T23:44:30.754 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:30.750+0000 7f1c1b247640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f1c141550f0 con 0x7f1c14074770 2024-04-26T23:44:30.754 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:30.751+0000 7f1c197e4640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f1c14074b50 0x7f1c14071bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.88:35364/0 (socket says 172.21.15.88:35364) 2024-04-26T23:44:30.754 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:30.751+0000 7f1c197e4640 1 -- 172.21.15.88:0/250144902 learned_addr learned my addr 172.21.15.88:0/250144902 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-26T23:44:30.755 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:30.751+0000 7f1c18fe3640 1 --2- 172.21.15.88:0/250144902 >> v2:172.21.15.175:3300/0 conn(0x7f1c14074770 0x7f1c140c4690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:30.755 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:30.752+0000 7f1c18fe3640 1 -- 172.21.15.88:0/250144902 >> v1:172.21.15.175:6789/0 conn(0x7f1c14074b50 legacy=0x7f1c14071bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:30.755 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:30.752+0000 7f1c18fe3640 1 -- 172.21.15.88:0/250144902 >> v1:172.21.15.88:6789/0 conn(0x7f1c140c3510 legacy=0x7f1c14073ae0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T23:44:30.755 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:30.752+0000 7f1c18fe3640 1 -- 172.21.15.88:0/250144902 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c140c30e0 con 0x7f1c14074770 2024-04-26T23:44:30.756 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:30.753+0000 7f1c18fe3640 1 --2- 172.21.15.88:0/250144902 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1c14074770 0x7f1c140c4690 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f1c080097a0 tx=0x7f1c0802a140 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b1124dc00d167c52 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:30.757 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:30.754+0000 7f1c137fe640 1 -- 172.21.15.88:0/250144902 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c08037070 con 0x7f1c14074770 2024-04-26T23:44:30.757 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:30.754+0000 7f1c137fe640 1 -- 172.21.15.88:0/250144902 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c0802ae50 con 0x7f1c14074770 2024-04-26T23:44:30.758 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:30.754+0000 7f1c137fe640 1 -- 172.21.15.88:0/250144902 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c08037070 con 0x7f1c14074770 2024-04-26T23:44:30.759 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:30.755+0000 7f1c1b247640 1 -- 172.21.15.88:0/250144902 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1c14074770 msgr2=0x7f1c140c4690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:30.759 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:30.756+0000 7f1c1b247640 1 --2- 172.21.15.88:0/250144902 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1c14074770 0x7f1c140c4690 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f1c080097a0 tx=0x7f1c0802a140 comp rx=0 tx=0).stop 2024-04-26T23:44:30.759 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:30.756+0000 7f1c1b247640 1 -- 172.21.15.88:0/250144902 shutdown_connections 2024-04-26T23:44:30.759 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:30.756+0000 7f1c1b247640 1 --2- 172.21.15.88:0/250144902 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1c14074770 0x7f1c140c4690 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:30.759 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:30.756+0000 7f1c1b247640 1 -- 172.21.15.88:0/250144902 >> 172.21.15.88:0/250144902 conn(0x7f1c140c82d0 msgr2=0x7f1c140c86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:44:30.760 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:30.757+0000 7f1c1b247640 1 -- 172.21.15.88:0/250144902 shutdown_connections 2024-04-26T23:44:30.760 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:30.757+0000 7f1c1b247640 1 -- 172.21.15.88:0/250144902 wait complete. 2024-04-26T23:44:30.762 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:30.759+0000 7f1c1b247640 1 Processor -- start 2024-04-26T23:44:30.762 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:30.759+0000 7f1c1b247640 1 -- start start 2024-04-26T23:44:30.764 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:30.760+0000 7f1c1b247640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1c14074770 0x7f1c14158630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:30.764 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:30.760+0000 7f1c1b247640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1c14074b50 0x7f1c141567e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:30.764 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:30.761+0000 7f1c13fff640 1 -- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1c14074b50 msgr2=0x7f1c141567e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.88:3300/0 2024-04-26T23:44:30.765 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:30.761+0000 7f1c13fff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1c14074b50 0x7f1c141567e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:44:30.765 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:30.761+0000 7f1c18fe3640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1c14074770 0x7f1c14158630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:30.765 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:30.761+0000 7f1c18fe3640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1c14074770 0x7f1c14158630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.88:45526/0 (socket says 172.21.15.88:45526) 2024-04-26T23:44:30.765 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:30.761+0000 7f1c1b247640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1c140c3510 0x7f1c1414c780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:30.765 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:30.761+0000 7f1c1b247640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f1c140722d0 con 0x7f1c14074b50 2024-04-26T23:44:30.765 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:30.761+0000 7f1c18fe3640 1 -- 172.21.15.88:0/3683153058 learned_addr learned my addr 172.21.15.88:0/3683153058 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:44:30.765 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:30.761+0000 7f1c1b247640 1 -- 172.21.15.88:0/3683153058 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f1c14152700 con 0x7f1c14074770 2024-04-26T23:44:30.765 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:30.761+0000 7f1c197e4640 1 --2- 172.21.15.88:0/3683153058 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1c140c3510 0x7f1c1414c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:30.765 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:30.761+0000 7f1c1b247640 1 -- 172.21.15.88:0/3683153058 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f1c14072450 con 0x7f1c140c3510 2024-04-26T23:44:30.766 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:30.763+0000 7f1c18fe3640 1 -- 172.21.15.88:0/3683153058 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1c140c3510 msgr2=0x7f1c1414c780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:30.766 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:30.763+0000 7f1c18fe3640 1 --2- 172.21.15.88:0/3683153058 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1c140c3510 0x7f1c1414c780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:30.767 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:30.763+0000 7f1c18fe3640 1 -- 172.21.15.88:0/3683153058 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1c14074b50 msgr2=0x7f1c141567e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T23:44:30.767 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:30.763+0000 7f1c18fe3640 1 --2- 172.21.15.88:0/3683153058 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1c14074b50 0x7f1c141567e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:30.767 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:30.763+0000 7f1c18fe3640 1 -- 172.21.15.88:0/3683153058 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c141571a0 con 0x7f1c14074770 2024-04-26T23:44:30.767 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:30.763+0000 7f1c197e4640 1 --2- 172.21.15.88:0/3683153058 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1c140c3510 0x7f1c1414c780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:44:30.768 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:30.764+0000 7f1c18fe3640 1 --2- 172.21.15.88:0/3683153058 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1c14074770 0x7f1c14158630 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f1c0802a180 tx=0x7f1c080046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:30.768 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:30.764+0000 7f1c117fa640 1 -- 172.21.15.88:0/3683153058 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c08043070 con 0x7f1c14074770 2024-04-26T23:44:30.768 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:30.764+0000 7f1c1b247640 1 -- 172.21.15.88:0/3683153058 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c14157480 con 0x7f1c14074770 2024-04-26T23:44:30.768 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:30.765+0000 7f1c117fa640 1 -- 172.21.15.88:0/3683153058 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c0803c680 con 0x7f1c14074770 2024-04-26T23:44:30.768 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:30.765+0000 7f1c1b247640 1 -- 172.21.15.88:0/3683153058 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c14157a40 con 0x7f1c14074770 2024-04-26T23:44:30.769 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:30.765+0000 7f1c117fa640 1 -- 172.21.15.88:0/3683153058 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c0804d060 con 0x7f1c14074770 2024-04-26T23:44:30.769 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:30.765+0000 7f1bfeffd640 1 --2- 172.21.15.88:0/3683153058 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1bf4002a70 0x7f1bf4004f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:30.769 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:30.766+0000 7f1bfeffd640 1 -- 172.21.15.88:0/3683153058 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f1bf4007ec0 con 0x7f1bf4002a70 2024-04-26T23:44:30.769 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:30.766+0000 7f1c13fff640 1 --2- 172.21.15.88:0/3683153058 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1bf4002a70 0x7f1bf4004f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:30.770 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:30.767+0000 7f1c13fff640 1 -- 172.21.15.88:0/3683153058 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1bf40080c0 con 0x7f1bf4002a70 2024-04-26T23:44:30.770 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:30.767+0000 7f1c117fa640 1 -- 172.21.15.88:0/3683153058 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f1c08046070 con 0x7f1c14074770 2024-04-26T23:44:30.770 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:30.767+0000 7f1c13fff640 1 --2- 172.21.15.88:0/3683153058 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1bf4002a70 0x7f1bf4004f30 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f1c140aae10 tx=0x7f1c0000b8c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:30.772 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:30.768+0000 7f1c117fa640 1 --2- 172.21.15.88:0/3683153058 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f1bf806c8d0 0x7f1bf806ed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:30.772 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:30.768+0000 7f1c117fa640 1 -- 172.21.15.88:0/3683153058 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6666+0+0 (secure 0 0 0) 0x7f1c080ac7f0 con 0x7f1c14074770 2024-04-26T23:44:30.772 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:30.768+0000 7f1c197e4640 1 --2- 172.21.15.88:0/3683153058 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f1bf806c8d0 0x7f1bf806ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:30.772 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:30.768+0000 7f1c117fa640 1 -- 172.21.15.88:0/3683153058 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c00003e10 con 0x7f1bf4002a70 2024-04-26T23:44:30.772 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:30.768+0000 7f1c117fa640 1 -- 172.21.15.88:0/3683153058 <== mon.2 v2:172.21.15.175:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f1c00015070 con 0x7f1bf4002a70 2024-04-26T23:44:30.772 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:30.768+0000 7f1c117fa640 1 -- 172.21.15.88:0/3683153058 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1bf4002a70 msgr2=0x7f1bf4004f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:30.772 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:30.768+0000 7f1c117fa640 1 --2- 172.21.15.88:0/3683153058 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1bf4002a70 0x7f1bf4004f30 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f1c140aae10 tx=0x7f1c0000b8c0 comp rx=0 tx=0).stop 2024-04-26T23:44:30.772 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:30.768+0000 7f1c117fa640 1 -- 172.21.15.88:0/3683153058 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1bf4002a70 msgr2=0x7f1bf4004f30 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:44:30.772 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:30.768+0000 7f1c117fa640 1 --2- 172.21.15.88:0/3683153058 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1bf4002a70 0x7f1bf4004f30 secure :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f1c140aae10 tx=0x7f1c0000b8c0 comp rx=0 tx=0).stop 2024-04-26T23:44:30.772 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:30.769+0000 7f1c197e4640 1 --2- 172.21.15.88:0/3683153058 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f1bf806c8d0 0x7f1bf806ed90 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f1c0c0012e0 tx=0x7f1c0c0019b0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:30.781 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:30.778+0000 7f1bfeffd640 1 --2- 172.21.15.88:0/3683153058 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1bf4006eb0 0x7f1bf4007340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:30.781 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:30.778+0000 7f1bfeffd640 1 -- 172.21.15.88:0/3683153058 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f1bf400a4a0 con 0x7f1bf4006eb0 2024-04-26T23:44:30.782 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:30.778+0000 7f1c13fff640 1 --2- 172.21.15.88:0/3683153058 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1bf4006eb0 0x7f1bf4007340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:30.782 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:30.779+0000 7f1c13fff640 1 -- 172.21.15.88:0/3683153058 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f1bf4007880 con 0x7f1bf4006eb0 2024-04-26T23:44:30.782 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:30.779+0000 7f1c13fff640 1 --2- 172.21.15.88:0/3683153058 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1bf4006eb0 0x7f1bf4007340 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f1c00011000 tx=0x7f1c00005a20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:30.783 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:30.780+0000 7f1c117fa640 1 -- 172.21.15.88:0/3683153058 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c0001ae00 con 0x7f1bf4006eb0 2024-04-26T23:44:30.783 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:30.780+0000 7f1c117fa640 1 -- 172.21.15.88:0/3683153058 <== mon.2 v2:172.21.15.175:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4856 (secure 0 0 0) 0x7f1c00010400 con 0x7f1bf4006eb0 2024-04-26T23:44:30.783 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:30.780+0000 7f1c117fa640 1 -- 172.21.15.88:0/3683153058 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1bf4006eb0 msgr2=0x7f1bf4007340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:30.784 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:30.780+0000 7f1c117fa640 1 --2- 172.21.15.88:0/3683153058 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1bf4006eb0 0x7f1bf4007340 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f1c00011000 tx=0x7f1c00005a20 comp rx=0 tx=0).stop 2024-04-26T23:44:30.784 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:30.780+0000 7f1c117fa640 1 -- 172.21.15.88:0/3683153058 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1bf4006eb0 msgr2=0x7f1bf4007340 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:44:30.784 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:30.780+0000 7f1c117fa640 1 --2- 172.21.15.88:0/3683153058 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1bf4006eb0 0x7f1bf4007340 secure :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f1c00011000 tx=0x7f1c00005a20 comp rx=0 tx=0).stop 2024-04-26T23:44:30.784 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-04-26T23:44:30.784 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2024-04-26T23:44:30.784 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2024-04-26T23:44:30.784 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "peon", 2024-04-26T23:44:30.784 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 34, 2024-04-26T23:44:30.784 INFO:teuthology.orchestra.run.smithi088.stdout: "uptime": 39066, 2024-04-26T23:44:30.785 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2024-04-26T23:44:30.785 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2024-04-26T23:44:30.785 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2024-04-26T23:44:30.785 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:44:30.785 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 1, 2024-04-26T23:44:30.785 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2024-04-26T23:44:30.785 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2450521708007866372", 2024-04-26T23:44:30.785 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2024-04-26T23:44:30.785 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-04-26T23:44:30.785 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-04-26T23:44:30.785 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-04-26T23:44:30.785 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-04-26T23:44:30.785 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-04-26T23:44:30.785 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-04-26T23:44:30.785 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-04-26T23:44:30.786 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-04-26T23:44:30.786 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-04-26T23:44:30.786 INFO:teuthology.orchestra.run.smithi088.stdout: "reef", 2024-04-26T23:44:30.786 INFO:teuthology.orchestra.run.smithi088.stdout: "squid" 2024-04-26T23:44:30.786 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:44:30.786 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540701547738038271", 2024-04-26T23:44:30.786 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2024-04-26T23:44:30.786 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-04-26T23:44:30.786 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-04-26T23:44:30.786 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-04-26T23:44:30.786 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-04-26T23:44:30.786 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-04-26T23:44:30.786 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-04-26T23:44:30.787 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-04-26T23:44:30.787 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-04-26T23:44:30.787 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-04-26T23:44:30.787 INFO:teuthology.orchestra.run.smithi088.stdout: "reef", 2024-04-26T23:44:30.787 INFO:teuthology.orchestra.run.smithi088.stdout: "squid" 2024-04-26T23:44:30.787 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:44:30.787 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:44:30.787 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2024-04-26T23:44:30.787 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2024-04-26T23:44:30.787 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2024-04-26T23:44:30.787 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2024-04-26T23:44:30.787 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2024-04-26T23:44:30.787 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "555255e9-7ef9-4454-8dc9-35e96b70035c", 2024-04-26T23:44:30.787 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2024-04-26T23:39:34.291658Z", 2024-04-26T23:44:30.787 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2024-04-26T23:39:34.291658Z", 2024-04-26T23:44:30.788 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 19, 2024-04-26T23:44:30.788 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "squid", 2024-04-26T23:44:30.788 INFO:teuthology.orchestra.run.smithi088.stdout: "election_strategy": 1, 2024-04-26T23:44:30.788 INFO:teuthology.orchestra.run.smithi088.stdout: "disallowed_leaders: ": "", 2024-04-26T23:44:30.788 INFO:teuthology.orchestra.run.smithi088.stdout: "stretch_mode": false, 2024-04-26T23:44:30.788 INFO:teuthology.orchestra.run.smithi088.stdout: "tiebreaker_mon": "", 2024-04-26T23:44:30.788 INFO:teuthology.orchestra.run.smithi088.stdout: "removed_ranks: ": "", 2024-04-26T23:44:30.788 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2024-04-26T23:44:30.788 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2024-04-26T23:44:30.788 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-04-26T23:44:30.788 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-04-26T23:44:30.788 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-04-26T23:44:30.788 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-04-26T23:44:30.788 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-04-26T23:44:30.789 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-04-26T23:44:30.789 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-04-26T23:44:30.789 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-04-26T23:44:30.789 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-04-26T23:44:30.789 INFO:teuthology.orchestra.run.smithi088.stdout: "reef", 2024-04-26T23:44:30.789 INFO:teuthology.orchestra.run.smithi088.stdout: "squid" 2024-04-26T23:44:30.789 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:44:30.789 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2024-04-26T23:44:30.789 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:44:30.789 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2024-04-26T23:44:30.789 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:44:30.789 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2024-04-26T23:44:30.789 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2024-04-26T23:44:30.789 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-04-26T23:44:30.790 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-04-26T23:44:30.790 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:44:30.790 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-04-26T23:44:30.790 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2024-04-26T23:44:30.790 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:44:30.790 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:44:30.790 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:44:30.790 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-04-26T23:44:30.790 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2024-04-26T23:44:30.790 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:44:30.790 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:44:30.790 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:44:30.791 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:44:30.791 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2024-04-26T23:44:30.791 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2024-04-26T23:44:30.791 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-04-26T23:44:30.791 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-04-26T23:44:30.791 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-04-26T23:44:30.791 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:44:30.791 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:44:30.791 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2024-04-26T23:44:30.791 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2024-04-26T23:44:30.791 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-04-26T23:44:30.791 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-04-26T23:44:30.791 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:44:30.791 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-04-26T23:44:30.792 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:3300", 2024-04-26T23:44:30.792 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:44:30.792 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:44:30.792 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:44:30.792 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-04-26T23:44:30.792 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6789", 2024-04-26T23:44:30.792 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:44:30.792 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:44:30.792 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:44:30.792 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:44:30.792 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6789/0", 2024-04-26T23:44:30.792 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.175:6789/0", 2024-04-26T23:44:30.792 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-04-26T23:44:30.792 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-04-26T23:44:30.792 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-04-26T23:44:30.793 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:44:30.793 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:44:30.793 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2024-04-26T23:44:30.793 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2024-04-26T23:44:30.793 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-04-26T23:44:30.793 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-04-26T23:44:30.793 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:44:30.793 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-04-26T23:44:30.793 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:3301", 2024-04-26T23:44:30.793 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:44:30.793 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:44:30.793 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:44:30.793 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-04-26T23:44:30.794 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6790", 2024-04-26T23:44:30.794 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:44:30.794 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:44:30.794 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:44:30.794 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:44:30.794 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6790/0", 2024-04-26T23:44:30.794 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.175:6790/0", 2024-04-26T23:44:30.794 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-04-26T23:44:30.794 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-04-26T23:44:30.794 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-04-26T23:44:30.794 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:44:30.794 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:44:30.794 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:44:30.794 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2024-04-26T23:44:30.795 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2024-04-26T23:44:30.795 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:44:30.795 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:44:30.795 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:44:30.795 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2024-04-26T23:44:30.795 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:44:30.795 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:44:30.795 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": [ 2024-04-26T23:44:30.795 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:44:30.795 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:44:30.795 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:44:30.795 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2024-04-26T23:44:30.795 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:44:30.796 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:44:30.796 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2024-04-26T23:44:30.796 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:44:30.796 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x2f018fb87aa4aafe", 2024-04-26T23:44:30.796 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:44:30.796 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2024-04-26T23:44:30.796 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:44:30.796 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:44:30.796 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:44:30.796 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:44:30.796 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2024-04-26T23:44:30.796 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:44:30.796 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:44:30.796 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:44:30.796 INFO:teuthology.orchestra.run.smithi088.stdout: "stretch_mode": false 2024-04-26T23:44:30.797 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-04-26T23:44:30.799 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:30.781+0000 7f1bfeffd640 1 -- 172.21.15.88:0/3683153058 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f1bf806c8d0 msgr2=0x7f1bf806ed90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:30.799 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:30.781+0000 7f1bfeffd640 1 --2- 172.21.15.88:0/3683153058 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f1bf806c8d0 0x7f1bf806ed90 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f1c0c0012e0 tx=0x7f1c0c0019b0 comp rx=0 tx=0).stop 2024-04-26T23:44:30.799 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:30.781+0000 7f1bfeffd640 1 -- 172.21.15.88:0/3683153058 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1c14074770 msgr2=0x7f1c14158630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:30.799 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:30.781+0000 7f1bfeffd640 1 --2- 172.21.15.88:0/3683153058 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1c14074770 0x7f1c14158630 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f1c0802a180 tx=0x7f1c080046c0 comp rx=0 tx=0).stop 2024-04-26T23:44:30.799 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:30.781+0000 7f1c197e4640 1 -- 172.21.15.88:0/3683153058 reap_dead start 2024-04-26T23:44:30.800 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:30.781+0000 7f1c197e4640 1 -- 172.21.15.88:0/3683153058 reap_dead start 2024-04-26T23:44:30.800 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:30.781+0000 7f1bfeffd640 1 -- 172.21.15.88:0/3683153058 shutdown_connections 2024-04-26T23:44:30.800 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:30.781+0000 7f1bfeffd640 1 -- 172.21.15.88:0/3683153058 >> 172.21.15.88:0/3683153058 conn(0x7f1c140c82d0 msgr2=0x7f1c14071b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:44:30.800 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:30.781+0000 7f1bfeffd640 1 -- 172.21.15.88:0/3683153058 shutdown_connections 2024-04-26T23:44:30.800 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:30.781+0000 7f1bfeffd640 1 -- 172.21.15.88:0/3683153058 wait complete. 2024-04-26T23:44:30.801 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-04-26T23:44:30.801 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2024-04-26T23:44:33.651 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:44:33.654 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:44:50.802 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2024-04-26T23:44:50.803 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.a 2024-04-26T23:44:50.803 INFO:tasks.ceph.mon.a:Restarting daemon 2024-04-26T23:44:50.803 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-04-26T23:44:50.808 INFO:tasks.ceph.mon.a:Started 2024-04-26T23:44:50.808 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-04-26T23:44:50.808 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-04-26T23:44:50.971 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:50.966+0000 7f3573d5f640 1 Processor -- start 2024-04-26T23:44:50.971 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:50.967+0000 7f3573d5f640 1 -- start start 2024-04-26T23:44:50.974 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:50.968+0000 7f3573d5f640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f356c0ab990 0x7f356c154410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:50.974 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:50.968+0000 7f3573d5f640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f356c0ac910 con 0x7f356c0c4c40 2024-04-26T23:44:50.974 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:50.968+0000 7f3573d5f640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f356c156e10 con 0x7f356c0c5300 2024-04-26T23:44:50.974 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:50.968+0000 7f3573d5f640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f356c153f80 con 0x7f356c0ab990 2024-04-26T23:44:50.974 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:50.968+0000 7f35722fc640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f356c0c4c40 0x7f356c15e1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:42600/0 (socket says 172.21.15.88:42600) 2024-04-26T23:44:50.974 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:50.968+0000 7f35722fc640 1 -- 172.21.15.88:0/1726366830 learned_addr learned my addr 172.21.15.88:0/1726366830 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-26T23:44:50.974 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:50.968+0000 7f35712fa640 1 --2- 172.21.15.88:0/1726366830 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f356c0ab990 0x7f356c154410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:50.975 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:50.969+0000 7f35712fa640 1 -- 172.21.15.88:0/1726366830 >> v1:172.21.15.175:6789/0 conn(0x7f356c0c5300 legacy=0x7f356c0ac200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:50.975 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:50.969+0000 7f35712fa640 1 -- 172.21.15.88:0/1726366830 >> v1:172.21.15.88:6789/0 conn(0x7f356c0c4c40 legacy=0x7f356c15e1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:50.975 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:50.969+0000 7f35712fa640 1 -- 172.21.15.88:0/1726366830 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f356c1570b0 con 0x7f356c0ab990 2024-04-26T23:44:50.978 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:50.970+0000 7f35712fa640 1 --2- 172.21.15.88:0/1726366830 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f356c0ab990 0x7f356c154410 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f35680097d0 tx=0x7f356802c310 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a7ae92234d40e04e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:50.978 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:50.970+0000 7f3570af9640 1 -- 172.21.15.88:0/1726366830 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3568039070 con 0x7f356c0ab990 2024-04-26T23:44:50.978 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:50.970+0000 7f3570af9640 1 -- 172.21.15.88:0/1726366830 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3568034640 con 0x7f356c0ab990 2024-04-26T23:44:50.978 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:50.970+0000 7f3570af9640 1 -- 172.21.15.88:0/1726366830 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f356802ce60 con 0x7f356c0ab990 2024-04-26T23:44:50.978 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:50.971+0000 7f3573d5f640 1 -- 172.21.15.88:0/1726366830 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f356c0ab990 msgr2=0x7f356c154410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:50.978 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:50.971+0000 7f3573d5f640 1 --2- 172.21.15.88:0/1726366830 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f356c0ab990 0x7f356c154410 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f35680097d0 tx=0x7f356802c310 comp rx=0 tx=0).stop 2024-04-26T23:44:50.978 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:50.971+0000 7f3573d5f640 1 -- 172.21.15.88:0/1726366830 shutdown_connections 2024-04-26T23:44:50.979 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:50.971+0000 7f3573d5f640 1 --2- 172.21.15.88:0/1726366830 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f356c0ab990 0x7f356c154410 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:50.979 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:50.971+0000 7f3573d5f640 1 -- 172.21.15.88:0/1726366830 >> 172.21.15.88:0/1726366830 conn(0x7f356c0c89b0 msgr2=0x7f356c0c8dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:44:50.979 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:50.972+0000 7f3573d5f640 1 -- 172.21.15.88:0/1726366830 shutdown_connections 2024-04-26T23:44:50.979 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:50.972+0000 7f3573d5f640 1 -- 172.21.15.88:0/1726366830 wait complete. 2024-04-26T23:44:50.979 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:50.973+0000 7f3573d5f640 1 Processor -- start 2024-04-26T23:44:50.979 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:50.973+0000 7f3573d5f640 1 -- start start 2024-04-26T23:44:50.984 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:50.974+0000 7f3573d5f640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f356c0c4c40 0x7f356c149640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:50.984 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:50.975+0000 7f3573d5f640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f356c0c5300 0x7f356c155d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:50.984 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:50.975+0000 7f3573d5f640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f356c1562c0 0x7f356c146f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:50.985 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:50.975+0000 7f35712fa640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f356c0c5300 0x7f356c155d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:50.985 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:50.975+0000 7f35712fa640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f356c0c5300 0x7f356c155d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:58466/0 (socket says 172.21.15.88:58466) 2024-04-26T23:44:50.985 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:50.975+0000 7f3571afb640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f356c0c4c40 0x7f356c149640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:50.985 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:50.975+0000 7f3571afb640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f356c0c4c40 0x7f356c149640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.88:55558/0 (socket says 172.21.15.88:55558) 2024-04-26T23:44:50.985 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:50.975+0000 7f35712fa640 1 -- 172.21.15.88:0/2117631406 learned_addr learned my addr 172.21.15.88:0/2117631406 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:44:50.985 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:50.975+0000 7f3573d5f640 1 -- 172.21.15.88:0/2117631406 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f356c14ddf0 con 0x7f356c0c5300 2024-04-26T23:44:50.985 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:50.975+0000 7f3573d5f640 1 -- 172.21.15.88:0/2117631406 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f356c153c10 con 0x7f356c0c4c40 2024-04-26T23:44:50.985 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:50.975+0000 7f3573d5f640 1 -- 172.21.15.88:0/2117631406 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f356c14df70 con 0x7f356c1562c0 2024-04-26T23:44:50.986 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:50.975+0000 7f35722fc640 1 --2- 172.21.15.88:0/2117631406 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f356c1562c0 0x7f356c146f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:50.986 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:50.975+0000 7f35712fa640 1 -- 172.21.15.88:0/2117631406 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f356c0c5300 msgr2=0x7f356c155d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2024-04-26T23:44:50.986 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:50.975+0000 7f35712fa640 1 -- 172.21.15.88:0/2117631406 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f356c0c5300 msgr2=0x7f356c155d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-26T23:44:50.986 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:50.975+0000 7f35712fa640 1 --2- 172.21.15.88:0/2117631406 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f356c0c5300 0x7f356c155d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:44:50.986 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:50.975+0000 7f35712fa640 1 --2- 172.21.15.88:0/2117631406 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f356c0c5300 0x7f356c155d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:44:50.987 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:50.975+0000 7f35722fc640 1 -- 172.21.15.88:0/2117631406 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f356c0c4c40 msgr2=0x7f356c149640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:44:50.987 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:50.975+0000 7f35722fc640 1 --2- 172.21.15.88:0/2117631406 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f356c0c4c40 0x7f356c149640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:50.987 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:50.975+0000 7f35722fc640 1 -- 172.21.15.88:0/2117631406 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f356c0c5300 msgr2=0x7f356c155d80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T23:44:50.987 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:50.975+0000 7f35722fc640 1 --2- 172.21.15.88:0/2117631406 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f356c0c5300 0x7f356c155d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:44:50.987 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:50.975+0000 7f35722fc640 1 -- 172.21.15.88:0/2117631406 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f356c149b80 con 0x7f356c1562c0 2024-04-26T23:44:50.987 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:50.976+0000 7f35722fc640 1 --2- 172.21.15.88:0/2117631406 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f356c1562c0 0x7f356c146f40 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f356400caa0 tx=0x7f356400cf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:50.987 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:50.976+0000 7f355e7fc640 1 -- 172.21.15.88:0/2117631406 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3564017070 con 0x7f356c1562c0 2024-04-26T23:44:50.987 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:50.976+0000 7f3573d5f640 1 -- 172.21.15.88:0/2117631406 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f356c156770 con 0x7f356c1562c0 2024-04-26T23:44:50.987 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:50.976+0000 7f3573d5f640 1 -- 172.21.15.88:0/2117631406 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f356c1552a0 con 0x7f356c1562c0 2024-04-26T23:44:50.987 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:50.976+0000 7f355e7fc640 1 -- 172.21.15.88:0/2117631406 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f356400ac00 con 0x7f356c1562c0 2024-04-26T23:44:50.987 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:50.976+0000 7f355e7fc640 1 -- 172.21.15.88:0/2117631406 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3564021060 con 0x7f356c1562c0 2024-04-26T23:44:50.987 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:50.977+0000 7f3573d5f640 1 -- 172.21.15.88:0/2117631406 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3554005290 con 0x7f356c1562c0 2024-04-26T23:44:50.988 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:50.978+0000 7f355e7fc640 1 -- 172.21.15.88:0/2117631406 <== mon.2 v2:172.21.15.175:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f356401a070 con 0x7f356c1562c0 2024-04-26T23:44:50.988 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:50.979+0000 7f355e7fc640 1 --2- 172.21.15.88:0/2117631406 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f355006c920 0x7f355006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:44:50.988 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:50.979+0000 7f355e7fc640 1 -- 172.21.15.88:0/2117631406 <== mon.2 v2:172.21.15.175:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6666+0+0 (secure 0 0 0) 0x7f356408ba10 con 0x7f356c1562c0 2024-04-26T23:44:50.988 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:50.979+0000 7f3571afb640 1 --2- 172.21.15.88:0/2117631406 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f355006c920 0x7f355006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:44:50.988 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:50.979+0000 7f3571afb640 1 --2- 172.21.15.88:0/2117631406 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f355006c920 0x7f355006ede0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f35600016e0 tx=0x7f3560009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:44:50.993 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:50.989+0000 7f355e7fc640 1 -- 172.21.15.88:0/2117631406 <== mon.2 v2:172.21.15.175:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f35640594c0 con 0x7f356c1562c0 2024-04-26T23:44:51.505 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:44:51.501+0000 7f3573d5f640 1 -- 172.21.15.88:0/2117631406 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f3554005580 con 0x7f356c1562c0 2024-04-26T23:45:01.733 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:01.724+0000 7f35722fc640 1 -- 172.21.15.88:0/2117631406 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f356c1562c0 msgr2=0x7f356c146f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2024-04-26T23:45:01.734 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:01.724+0000 7f35722fc640 1 -- 172.21.15.88:0/2117631406 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f356c1562c0 msgr2=0x7f356c146f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-26T23:45:01.734 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:01.724+0000 7f35722fc640 1 --2- 172.21.15.88:0/2117631406 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f356c1562c0 0x7f356c146f40 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f356400caa0 tx=0x7f356400cf60 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:45:01.734 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:01.724+0000 7f35722fc640 1 --2- 172.21.15.88:0/2117631406 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f356c1562c0 0x7f356c146f40 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f356400caa0 tx=0x7f356400cf60 comp rx=0 tx=0).stop 2024-04-26T23:45:01.734 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:01.724+0000 7f355e7fc640 1 -- 172.21.15.88:0/2117631406 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f356c1562c0 msgr2=0x7f356c146f40 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:45:01.734 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:01.724+0000 7f355e7fc640 1 --2- 172.21.15.88:0/2117631406 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f356c1562c0 0x7f356c146f40 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:01.734 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:01.724+0000 7f355e7fc640 1 --2- 172.21.15.88:0/2117631406 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f355007b4f0 0x7f355007d900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:01.734 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:01.724+0000 7f355e7fc640 1 --2- 172.21.15.88:0/2117631406 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f356c0c5300 0x7f35500801a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:01.734 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:01.724+0000 7f355e7fc640 1 --2- 172.21.15.88:0/2117631406 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f356c0c4c40 0x7f3550082c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:01.735 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:01.724+0000 7f355e7fc640 1 -- 172.21.15.88:0/2117631406 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f3550083680 con 0x7f356c0c5300 2024-04-26T23:45:01.735 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:01.724+0000 7f355e7fc640 1 -- 172.21.15.88:0/2117631406 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f35500770e0 con 0x7f356c0c4c40 2024-04-26T23:45:01.735 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:01.724+0000 7f355e7fc640 1 -- 172.21.15.88:0/2117631406 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f35500772b0 con 0x7f355007b4f0 2024-04-26T23:45:01.735 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:01.724+0000 7f3571afb640 1 --2- 172.21.15.88:0/2117631406 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f356c0c4c40 0x7f3550082c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:01.735 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:01.724+0000 7f35712fa640 1 --2- 172.21.15.88:0/2117631406 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f355007b4f0 0x7f355007d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:01.748 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:01.725+0000 7f35712fa640 1 -- 172.21.15.88:0/2117631406 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f356c0c4c40 msgr2=0x7f3550082c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:01.748 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:01.725+0000 7f35712fa640 1 --2- 172.21.15.88:0/2117631406 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f356c0c4c40 0x7f3550082c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:01.748 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:01.725+0000 7f35712fa640 1 -- 172.21.15.88:0/2117631406 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f356c0c5300 msgr2=0x7f35500801a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:01.748 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:01.725+0000 7f35712fa640 1 --2- 172.21.15.88:0/2117631406 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f356c0c5300 0x7f35500801a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:01.748 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:01.725+0000 7f35712fa640 1 -- 172.21.15.88:0/2117631406 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,mgrmap=0+,monmap=2+}) -- 0x7f3550077480 con 0x7f355007b4f0 2024-04-26T23:45:01.748 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:01.725+0000 7f35712fa640 1 -- 172.21.15.88:0/2117631406 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f356c1570b0 con 0x7f355007b4f0 2024-04-26T23:45:01.748 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:01.725+0000 7f35712fa640 1 --2- 172.21.15.88:0/2117631406 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f355007b4f0 0x7f355007d900 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f356802c900 tx=0x7f35640019f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:01.748 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:01.725+0000 7f355e7fc640 1 -- 172.21.15.88:0/2117631406 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f356802ce60 con 0x7f355007b4f0 2024-04-26T23:45:01.748 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:01.726+0000 7f355e7fc640 1 -- 172.21.15.88:0/2117631406 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3568044070 con 0x7f355007b4f0 2024-04-26T23:45:01.748 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:01.728+0000 7f355e7fc640 1 -- 172.21.15.88:0/2117631406 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f3568034980 con 0x7f355007b4f0 2024-04-26T23:45:04.001 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:45:04.005 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:45:06.730 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:06.726+0000 7f35712fa640 1 -- 172.21.15.88:0/2117631406 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f355007b4f0 msgr2=0x7f355007d900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 21 2024-04-26T23:45:06.731 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:06.726+0000 7f35712fa640 1 -- 172.21.15.88:0/2117631406 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f355007b4f0 msgr2=0x7f355007d900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-26T23:45:06.731 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:06.726+0000 7f35712fa640 1 --2- 172.21.15.88:0/2117631406 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f355007b4f0 0x7f355007d900 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f356802c900 tx=0x7f35640019f0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:45:06.731 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:06.726+0000 7f35712fa640 1 --2- 172.21.15.88:0/2117631406 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f355007b4f0 0x7f355007d900 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f356802c900 tx=0x7f35640019f0 comp rx=0 tx=0).stop 2024-04-26T23:45:06.731 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:06.726+0000 7f355e7fc640 1 -- 172.21.15.88:0/2117631406 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f355007b4f0 msgr2=0x7f355007d900 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:45:06.731 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:06.726+0000 7f355e7fc640 1 --2- 172.21.15.88:0/2117631406 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f355007b4f0 0x7f355007d900 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:06.731 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:06.726+0000 7f355e7fc640 1 --2- 172.21.15.88:0/2117631406 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f356c0c5300 0x7f3550080140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:06.731 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:06.726+0000 7f355e7fc640 1 --2- 172.21.15.88:0/2117631406 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f356c0c4c40 0x7f3550082c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:06.731 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:06.726+0000 7f355e7fc640 1 --2- 172.21.15.88:0/2117631406 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f356c1562c0 0x7f3550035b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:06.731 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:06.726+0000 7f355e7fc640 1 -- 172.21.15.88:0/2117631406 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f3550036140 con 0x7f356c0c5300 2024-04-26T23:45:06.731 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:06.726+0000 7f355e7fc640 1 -- 172.21.15.88:0/2117631406 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f35500362c0 con 0x7f356c0c4c40 2024-04-26T23:45:06.731 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:06.726+0000 7f355e7fc640 1 -- 172.21.15.88:0/2117631406 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f3550036440 con 0x7f356c1562c0 2024-04-26T23:45:06.731 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:06.726+0000 7f35712fa640 1 --2- 172.21.15.88:0/2117631406 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f356c0c5300 0x7f3550080140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:06.732 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:06.727+0000 7f3571afb640 1 --2- 172.21.15.88:0/2117631406 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f356c1562c0 0x7f3550035b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:06.732 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:06.727+0000 7f35722fc640 1 --2- 172.21.15.88:0/2117631406 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f356c0c4c40 0x7f3550082c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:06.732 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:06.727+0000 7f3571afb640 1 -- 172.21.15.88:0/2117631406 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f356c0c4c40 msgr2=0x7f3550082c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:06.732 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:06.727+0000 7f3571afb640 1 --2- 172.21.15.88:0/2117631406 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f356c0c4c40 0x7f3550082c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:06.732 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:06.727+0000 7f3571afb640 1 -- 172.21.15.88:0/2117631406 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f356c0c5300 msgr2=0x7f3550080140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:06.732 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:06.727+0000 7f3571afb640 1 --2- 172.21.15.88:0/2117631406 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f356c0c5300 0x7f3550080140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:06.732 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:06.727+0000 7f3571afb640 1 -- 172.21.15.88:0/2117631406 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,mgrmap=0+,monmap=2+}) -- 0x7f35500365f0 con 0x7f356c1562c0 2024-04-26T23:45:06.732 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:06.727+0000 7f3571afb640 1 -- 172.21.15.88:0/2117631406 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f356001c040 con 0x7f356c1562c0 2024-04-26T23:45:06.733 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:06.728+0000 7f3571afb640 1 --2- 172.21.15.88:0/2117631406 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f356c1562c0 0x7f3550035b30 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f356000fcc0 tx=0x7f3568030000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:06.733 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:06.728+0000 7f355e7fc640 1 -- 172.21.15.88:0/2117631406 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3560028070 con 0x7f356c1562c0 2024-04-26T23:45:06.733 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:06.728+0000 7f355e7fc640 1 -- 172.21.15.88:0/2117631406 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f356000fe90 con 0x7f356c1562c0 2024-04-26T23:45:06.734 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:06.730+0000 7f355e7fc640 1 -- 172.21.15.88:0/2117631406 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f3560007030 con 0x7f356c1562c0 2024-04-26T23:45:11.730 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:11.725+0000 7f3571afb640 1 -- 172.21.15.88:0/2117631406 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f356c1562c0 msgr2=0x7f3550035b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2024-04-26T23:45:11.730 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:11.725+0000 7f3571afb640 1 -- 172.21.15.88:0/2117631406 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f356c1562c0 msgr2=0x7f3550035b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-26T23:45:11.730 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:11.725+0000 7f3571afb640 1 --2- 172.21.15.88:0/2117631406 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f356c1562c0 0x7f3550035b30 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f356000fcc0 tx=0x7f3568030000 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:45:11.731 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:11.725+0000 7f3571afb640 1 --2- 172.21.15.88:0/2117631406 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f356c1562c0 0x7f3550035b30 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f356000fcc0 tx=0x7f3568030000 comp rx=0 tx=0).stop 2024-04-26T23:45:11.731 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:11.725+0000 7f355e7fc640 1 -- 172.21.15.88:0/2117631406 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f356c1562c0 msgr2=0x7f3550035b30 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:45:11.731 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:11.725+0000 7f355e7fc640 1 --2- 172.21.15.88:0/2117631406 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f356c1562c0 0x7f3550035b30 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:11.731 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:11.725+0000 7f355e7fc640 1 --2- 172.21.15.88:0/2117631406 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f355007b4f0 0x7f355001d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:11.731 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:11.725+0000 7f355e7fc640 1 --2- 172.21.15.88:0/2117631406 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f356c0c5300 0x7f3550080140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:11.731 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:11.725+0000 7f355e7fc640 1 --2- 172.21.15.88:0/2117631406 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f356c0c4c40 0x7f3550082c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:11.731 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:11.725+0000 7f355e7fc640 1 -- 172.21.15.88:0/2117631406 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f355008c010 con 0x7f356c0c5300 2024-04-26T23:45:11.731 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:11.725+0000 7f355e7fc640 1 -- 172.21.15.88:0/2117631406 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f355008c190 con 0x7f356c0c4c40 2024-04-26T23:45:11.731 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:11.725+0000 7f355e7fc640 1 -- 172.21.15.88:0/2117631406 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f355008c310 con 0x7f355007b4f0 2024-04-26T23:45:11.731 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:11.725+0000 7f35722fc640 1 --2- 172.21.15.88:0/2117631406 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f356c0c5300 0x7f3550080140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:11.731 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:11.725+0000 7f3571afb640 1 --2- 172.21.15.88:0/2117631406 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f356c0c4c40 0x7f3550082c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:11.731 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:11.726+0000 7f35712fa640 1 --2- 172.21.15.88:0/2117631406 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f355007b4f0 0x7f355001d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:11.731 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:11.726+0000 7f35722fc640 1 -- 172.21.15.88:0/2117631406 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f355007b4f0 msgr2=0x7f355001d5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:11.731 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:11.726+0000 7f35722fc640 1 --2- 172.21.15.88:0/2117631406 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f355007b4f0 0x7f355001d5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:11.731 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:11.726+0000 7f35722fc640 1 -- 172.21.15.88:0/2117631406 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f356c0c4c40 msgr2=0x7f3550082c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:11.732 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:11.726+0000 7f35722fc640 1 --2- 172.21.15.88:0/2117631406 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f356c0c4c40 0x7f3550082c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:11.732 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:11.726+0000 7f35722fc640 1 -- 172.21.15.88:0/2117631406 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,mgrmap=0+,monmap=2+}) -- 0x7f355008c490 con 0x7f356c0c5300 2024-04-26T23:45:11.732 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:11.726+0000 7f35722fc640 1 -- 172.21.15.88:0/2117631406 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f3554005580 con 0x7f356c0c5300 2024-04-26T23:45:11.732 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:11.726+0000 7f3571afb640 1 --2- 172.21.15.88:0/2117631406 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f356c0c4c40 0x7f3550082c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:45:11.732 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:11.726+0000 7f35722fc640 1 --2- 172.21.15.88:0/2117631406 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f356c0c5300 0x7f3550080140 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f3550005fa0 tx=0x7f356000a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:11.732 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:11.726+0000 7f355e7fc640 1 -- 172.21.15.88:0/2117631406 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3564017070 con 0x7f356c0c5300 2024-04-26T23:45:11.732 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:11.726+0000 7f355e7fc640 1 -- 172.21.15.88:0/2117631406 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3564056400 con 0x7f356c0c5300 2024-04-26T23:45:11.732 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:11.727+0000 7f355e7fc640 1 -- 172.21.15.88:0/2117631406 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f356408bd10 con 0x7f356c0c5300 2024-04-26T23:45:14.219 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:14.215+0000 7f355e7fc640 1 -- 172.21.15.88:0/2117631406 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1558 (secure 0 0 0) 0x7f356406de20 con 0x7f356c0c5300 2024-04-26T23:45:14.219 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":50,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"555255e9-7ef9-4454-8dc9-35e96b70035c","modified":"2024-04-26T23:39:34.291658Z","created":"2024-04-26T23:39:34.291658Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:3300","nonce":0},{"type":"v1","addr":"172.21.15.175:6789","nonce":0}]},"addr":"172.21.15.175:6789/0","public_addr":"172.21.15.175:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:3301","nonce":0},{"type":"v1","addr":"172.21.15.175:6790","nonce":0}]},"addr":"172.21.15.175:6790/0","public_addr":"172.21.15.175:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-04-26T23:45:14.228 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:14.225+0000 7f3573d5f640 1 -- 172.21.15.88:0/2117631406 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f355006c920 msgr2=0x7f355006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:14.228 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:14.225+0000 7f3573d5f640 1 --2- 172.21.15.88:0/2117631406 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f355006c920 0x7f355006ede0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f35600016e0 tx=0x7f3560009040 comp rx=0 tx=0).stop 2024-04-26T23:45:14.228 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:14.225+0000 7f3573d5f640 1 -- 172.21.15.88:0/2117631406 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f356c0c5300 msgr2=0x7f3550080140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:14.228 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:14.225+0000 7f3573d5f640 1 --2- 172.21.15.88:0/2117631406 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f356c0c5300 0x7f3550080140 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f3550005fa0 tx=0x7f356000a000 comp rx=0 tx=0).stop 2024-04-26T23:45:14.229 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:14.225+0000 7f3573d5f640 1 -- 172.21.15.88:0/2117631406 shutdown_connections 2024-04-26T23:45:14.229 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:14.225+0000 7f3573d5f640 1 --2- 172.21.15.88:0/2117631406 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f355007b4f0 0x7f355001d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:14.229 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:14.225+0000 7f3573d5f640 1 --2- 172.21.15.88:0/2117631406 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f355006c920 0x7f355006ede0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:14.229 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:14.225+0000 7f3573d5f640 1 --2- 172.21.15.88:0/2117631406 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f356c0c4c40 0x7f3550082c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:14.229 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:14.225+0000 7f3573d5f640 1 --2- 172.21.15.88:0/2117631406 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f356c0c5300 0x7f3550080140 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:14.229 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:14.225+0000 7f3573d5f640 1 -- 172.21.15.88:0/2117631406 >> 172.21.15.88:0/2117631406 conn(0x7f356c0c89b0 msgr2=0x7f356c0abe60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:14.229 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:14.226+0000 7f3573d5f640 1 -- 172.21.15.88:0/2117631406 shutdown_connections 2024-04-26T23:45:14.230 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:14.226+0000 7f3573d5f640 1 -- 172.21.15.88:0/2117631406 wait complete. 2024-04-26T23:45:17.264 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-04-26T23:45:17.474 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:17.471+0000 7f8fb57d1640 1 Processor -- start 2024-04-26T23:45:17.478 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:17.474+0000 7f8fb57d1640 1 -- start start 2024-04-26T23:45:17.481 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:17.475+0000 7f8fb57d1640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f8fa80cd2b0 0x7f8fa80469c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:17.481 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:17.475+0000 7f8fb57d1640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8fa803f740 0x7f8fa8030ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:17.481 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:17.475+0000 7f8fb57d1640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8fa8031b20 con 0x7f8fa8049f40 2024-04-26T23:45:17.481 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:17.475+0000 7f8fb57d1640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f8fa800b800 con 0x7f8fa80cd2b0 2024-04-26T23:45:17.481 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:17.475+0000 7f8fb57d1640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f8fa80cd690 con 0x7f8fa803f740 2024-04-26T23:45:17.481 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:17.476+0000 7f8faf7fe640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8fa803f740 0x7f8fa8030ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:17.481 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:17.476+0000 7f8faf7fe640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8fa803f740 0x7f8fa8030ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.88:59644/0 (socket says 172.21.15.88:59644) 2024-04-26T23:45:17.481 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:17.476+0000 7f8faf7fe640 1 -- 172.21.15.88:0/2271765094 learned_addr learned my addr 172.21.15.88:0/2271765094 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:45:17.481 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:17.476+0000 7f8faf7fe640 1 -- 172.21.15.88:0/2271765094 >> v2:172.21.15.175:3300/0 conn(0x7f8fa80cd2b0 msgr2=0x7f8fa80469c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:45:17.481 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:17.476+0000 7f8faf7fe640 1 --2- 172.21.15.88:0/2271765094 >> v2:172.21.15.175:3300/0 conn(0x7f8fa80cd2b0 0x7f8fa80469c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:17.481 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:17.476+0000 7f8faf7fe640 1 -- 172.21.15.88:0/2271765094 >> v1:172.21.15.175:6789/0 conn(0x7f8fa8049f40 legacy=0x7f8fa8031410 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T23:45:17.482 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:17.476+0000 7f8faf7fe640 1 -- 172.21.15.88:0/2271765094 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fa80d7720 con 0x7f8fa803f740 2024-04-26T23:45:17.482 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:17.477+0000 7f8faf7fe640 1 --2- 172.21.15.88:0/2271765094 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8fa803f740 0x7f8fa8030ed0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f8fa4009870 tx=0x7f8fa402a1a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e44f8a8c32e76ccb server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:17.483 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:17.480+0000 7f8faeffd640 1 -- 172.21.15.88:0/2271765094 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fa4037070 con 0x7f8fa803f740 2024-04-26T23:45:17.483 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:17.480+0000 7f8faeffd640 1 -- 172.21.15.88:0/2271765094 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8fa4032440 con 0x7f8fa803f740 2024-04-26T23:45:17.483 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:17.480+0000 7f8faeffd640 1 -- 172.21.15.88:0/2271765094 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fa4032850 con 0x7f8fa803f740 2024-04-26T23:45:17.484 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:17.481+0000 7f8fb57d1640 1 -- 172.21.15.88:0/2271765094 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8fa803f740 msgr2=0x7f8fa8030ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:17.484 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:17.481+0000 7f8fb57d1640 1 --2- 172.21.15.88:0/2271765094 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8fa803f740 0x7f8fa8030ed0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f8fa4009870 tx=0x7f8fa402a1a0 comp rx=0 tx=0).stop 2024-04-26T23:45:17.484 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:17.481+0000 7f8fb57d1640 1 -- 172.21.15.88:0/2271765094 shutdown_connections 2024-04-26T23:45:17.484 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:17.481+0000 7f8fb57d1640 1 --2- 172.21.15.88:0/2271765094 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8fa803f740 0x7f8fa8030ed0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:17.485 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:17.481+0000 7f8fb57d1640 1 --2- 172.21.15.88:0/2271765094 >> v2:172.21.15.175:3300/0 conn(0x7f8fa80cd2b0 0x7f8fa80469c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:17.485 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:17.481+0000 7f8fb57d1640 1 -- 172.21.15.88:0/2271765094 >> 172.21.15.88:0/2271765094 conn(0x7f8fa8048ac0 msgr2=0x7f8fa8048ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:17.485 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:17.481+0000 7f8fb57d1640 1 -- 172.21.15.88:0/2271765094 shutdown_connections 2024-04-26T23:45:17.486 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:17.481+0000 7f8fb57d1640 1 -- 172.21.15.88:0/2271765094 wait complete. 2024-04-26T23:45:17.486 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:17.483+0000 7f8fb57d1640 1 Processor -- start 2024-04-26T23:45:17.490 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:17.483+0000 7f8fb57d1640 1 -- start start 2024-04-26T23:45:17.490 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:17.484+0000 7f8fb57d1640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8fa803f740 0x7f8fa8173ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:17.490 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:17.484+0000 7f8fb57d1640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8fa8049f40 0x7f8fa8044e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:17.491 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:17.484+0000 7f8fb57d1640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8fa80cd2b0 0x7f8fa816f230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:17.491 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:17.484+0000 7f8fb57d1640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f8fa800b490 con 0x7f8fa8049f40 2024-04-26T23:45:17.491 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:17.484+0000 7f8fb57d1640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f8fa800b1b0 con 0x7f8fa803f740 2024-04-26T23:45:17.491 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:17.484+0000 7f8fb57d1640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f8fa800c220 con 0x7f8fa80cd2b0 2024-04-26T23:45:17.491 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:17.485+0000 7f8faf7fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8fa8049f40 0x7f8fa8044e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:17.491 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:17.485+0000 7f8faf7fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8fa8049f40 0x7f8fa8044e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:42408/0 (socket says 172.21.15.88:42408) 2024-04-26T23:45:17.500 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:17.485+0000 7f8faf7fe640 1 -- 172.21.15.88:0/627257005 learned_addr learned my addr 172.21.15.88:0/627257005 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:45:17.501 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:17.485+0000 7f8faf7fe640 1 -- 172.21.15.88:0/627257005 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8fa80cd2b0 msgr2=0x7f8fa816f230 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T23:45:17.501 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:17.485+0000 7f8faf7fe640 1 --2- 172.21.15.88:0/627257005 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8fa80cd2b0 0x7f8fa816f230 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:17.501 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:17.485+0000 7f8faf7fe640 1 -- 172.21.15.88:0/627257005 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8fa803f740 msgr2=0x7f8fa8173ef0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T23:45:17.501 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:17.485+0000 7f8faf7fe640 1 --2- 172.21.15.88:0/627257005 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8fa803f740 0x7f8fa8173ef0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:17.501 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:17.485+0000 7f8faf7fe640 1 -- 172.21.15.88:0/627257005 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fa8030940 con 0x7f8fa8049f40 2024-04-26T23:45:17.501 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:17.486+0000 7f8faf7fe640 1 --2- 172.21.15.88:0/627257005 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8fa8049f40 0x7f8fa8044e90 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f8fa4009870 tx=0x7f8fa40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:17.501 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:17.487+0000 7f8facff9640 1 -- 172.21.15.88:0/627257005 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fa4041020 con 0x7f8fa8049f40 2024-04-26T23:45:17.501 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:17.487+0000 7f8facff9640 1 -- 172.21.15.88:0/627257005 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8fa4030a30 con 0x7f8fa8049f40 2024-04-26T23:45:17.501 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:17.487+0000 7f8facff9640 1 -- 172.21.15.88:0/627257005 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fa4037040 con 0x7f8fa8049f40 2024-04-26T23:45:17.501 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:17.487+0000 7f8fb57d1640 1 -- 172.21.15.88:0/627257005 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8fa8174430 con 0x7f8fa8049f40 2024-04-26T23:45:17.501 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:17.487+0000 7f8fb57d1640 1 -- 172.21.15.88:0/627257005 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8fa8043e10 con 0x7f8fa8049f40 2024-04-26T23:45:17.501 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:17.489+0000 7f8f9a7fc640 1 -- 172.21.15.88:0/627257005 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8fa80057e0 con 0x7f8fa8049f40 2024-04-26T23:45:17.503 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:17.499+0000 7f8facff9640 1 -- 172.21.15.88:0/627257005 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8fa4044020 con 0x7f8fa8049f40 2024-04-26T23:45:17.503 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:17.499+0000 7f8facff9640 1 --2- 172.21.15.88:0/627257005 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f8f9406c9c0 0x7f8f9406ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:17.503 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:17.500+0000 7f8facff9640 1 -- 172.21.15.88:0/627257005 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6666+0+0 (secure 0 0 0) 0x7f8fa40acd80 con 0x7f8fa8049f40 2024-04-26T23:45:17.503 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:17.500+0000 7f8facff9640 1 -- 172.21.15.88:0/627257005 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f8fa404b030 con 0x7f8fa8049f40 2024-04-26T23:45:17.506 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:17.503+0000 7f8faffff640 1 --2- 172.21.15.88:0/627257005 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f8f9406c9c0 0x7f8f9406ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:17.507 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:17.504+0000 7f8faffff640 1 --2- 172.21.15.88:0/627257005 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f8f9406c9c0 0x7f8f9406ee80 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f8f9c0096b0 tx=0x7f8f9c006c20 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:18.060 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.057+0000 7f8f9a7fc640 1 -- 172.21.15.88:0/627257005 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f8fa80071b0 con 0x7f8fa8049f40 2024-04-26T23:45:18.061 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.058+0000 7f8facff9640 1 -- 172.21.15.88:0/627257005 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1564 (secure 0 0 0) 0x7f8fa407af80 con 0x7f8fa8049f40 2024-04-26T23:45:18.061 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":54,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"555255e9-7ef9-4454-8dc9-35e96b70035c","modified":"2024-04-26T23:39:34.291658Z","created":"2024-04-26T23:39:34.291658Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:3300","nonce":0},{"type":"v1","addr":"172.21.15.175:6789","nonce":0}]},"addr":"172.21.15.175:6789/0","public_addr":"172.21.15.175:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:3301","nonce":0},{"type":"v1","addr":"172.21.15.175:6790","nonce":0}]},"addr":"172.21.15.175:6790/0","public_addr":"172.21.15.175:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-04-26T23:45:18.068 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.065+0000 7f8f9a7fc640 1 -- 172.21.15.88:0/627257005 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f8f9406c9c0 msgr2=0x7f8f9406ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:18.068 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.065+0000 7f8f9a7fc640 1 --2- 172.21.15.88:0/627257005 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f8f9406c9c0 0x7f8f9406ee80 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f8f9c0096b0 tx=0x7f8f9c006c20 comp rx=0 tx=0).stop 2024-04-26T23:45:18.069 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.066+0000 7f8f9a7fc640 1 -- 172.21.15.88:0/627257005 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8fa8049f40 msgr2=0x7f8fa8044e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:18.069 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.066+0000 7f8f9a7fc640 1 --2- 172.21.15.88:0/627257005 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8fa8049f40 0x7f8fa8044e90 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f8fa4009870 tx=0x7f8fa40046c0 comp rx=0 tx=0).stop 2024-04-26T23:45:18.069 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.066+0000 7f8f9a7fc640 1 -- 172.21.15.88:0/627257005 shutdown_connections 2024-04-26T23:45:18.069 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.066+0000 7f8f9a7fc640 1 --2- 172.21.15.88:0/627257005 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f8f9406c9c0 0x7f8f9406ee80 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:18.069 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.066+0000 7f8f9a7fc640 1 --2- 172.21.15.88:0/627257005 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8fa80cd2b0 0x7f8fa816f230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:18.070 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.066+0000 7f8f9a7fc640 1 --2- 172.21.15.88:0/627257005 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8fa8049f40 0x7f8fa8044e90 secure :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f8fa4009870 tx=0x7f8fa40046c0 comp rx=0 tx=0).stop 2024-04-26T23:45:18.070 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.066+0000 7f8f9a7fc640 1 --2- 172.21.15.88:0/627257005 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8fa803f740 0x7f8fa8173ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:18.070 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.066+0000 7f8f9a7fc640 1 -- 172.21.15.88:0/627257005 >> 172.21.15.88:0/627257005 conn(0x7f8fa8048ac0 msgr2=0x7f8fa804a450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:18.071 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.068+0000 7f8f9a7fc640 1 -- 172.21.15.88:0/627257005 shutdown_connections 2024-04-26T23:45:18.071 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.068+0000 7f8f9a7fc640 1 -- 172.21.15.88:0/627257005 wait complete. 2024-04-26T23:45:18.095 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-04-26T23:45:18.096 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-04-26T23:45:18.096 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-04-26T23:45:18.283 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.280+0000 7f634e9d5640 1 Processor -- start 2024-04-26T23:45:18.284 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.281+0000 7f634e9d5640 1 -- start start 2024-04-26T23:45:18.287 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.283+0000 7f634d9d3640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f63480c6300 0x7f6348151dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:38120/0 (socket says 172.21.15.88:38120) 2024-04-26T23:45:18.287 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.283+0000 7f634e9d5640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f6348155450 0x7f63480abb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:18.287 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.283+0000 7f634d1d2640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f63480bf2a0 0x7f63480ab470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.88:58562/0 (socket says 172.21.15.88:58562) 2024-04-26T23:45:18.287 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.284+0000 7f634e9d5640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63481558e0 con 0x7f63480c6300 2024-04-26T23:45:18.287 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.284+0000 7f634e9d5640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63480c4ee0 con 0x7f63480bf2a0 2024-04-26T23:45:18.287 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.284+0000 7f634e9d5640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f63480bfdc0 con 0x7f6348155450 2024-04-26T23:45:18.291 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.284+0000 7f634d9d3640 1 -- 172.21.15.88:0/2419257022 learned_addr learned my addr 172.21.15.88:0/2419257022 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-26T23:45:18.291 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.285+0000 7f634c9d1640 1 -- 172.21.15.88:0/2419257022 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3733384847 0 0) 0x7f63481558e0 con 0x7f63480c6300 2024-04-26T23:45:18.291 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.285+0000 7f634c9d1640 1 -- 172.21.15.88:0/2419257022 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6330003520 con 0x7f63480c6300 2024-04-26T23:45:18.291 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.285+0000 7f634c9d1640 1 -- 172.21.15.88:0/2419257022 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3801887669 0 0) 0x7f6330003520 con 0x7f63480c6300 2024-04-26T23:45:18.291 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.285+0000 7f634c9d1640 1 -- 172.21.15.88:0/2419257022 >> v2:172.21.15.88:3300/0 conn(0x7f6348155450 msgr2=0x7f63480abb80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T23:45:18.291 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.285+0000 7f634c9d1640 1 --2- 172.21.15.88:0/2419257022 >> v2:172.21.15.88:3300/0 conn(0x7f6348155450 0x7f63480abb80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:18.291 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.285+0000 7f634c9d1640 1 -- 172.21.15.88:0/2419257022 >> v1:172.21.15.175:6789/0 conn(0x7f63480bf2a0 legacy=0x7f63480ab470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:45:18.291 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.285+0000 7f634c9d1640 1 -- 172.21.15.88:0/2419257022 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63480c51c0 con 0x7f63480c6300 2024-04-26T23:45:18.291 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.285+0000 7f634c9d1640 1 -- 172.21.15.88:0/2419257022 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 356324787 0 0) 0x7f6338001670 con 0x7f63480c6300 2024-04-26T23:45:18.291 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.285+0000 7f634c9d1640 1 -- 172.21.15.88:0/2419257022 >> v1:172.21.15.88:6789/0 conn(0x7f63480c6300 legacy=0x7f6348151dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:18.291 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.286+0000 7f634c9d1640 1 --2- 172.21.15.88:0/2419257022 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f63300039b0 0x7f6330003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:18.291 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.286+0000 7f634c9d1640 1 --2- 172.21.15.88:0/2419257022 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6330004800 0x7f6330004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:18.292 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.286+0000 7f634c9d1640 1 --2- 172.21.15.88:0/2419257022 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f63300051c0 0x7f63300145c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:18.292 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.286+0000 7f634c9d1640 1 -- 172.21.15.88:0/2419257022 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f63480bfdc0 con 0x7f63300051c0 2024-04-26T23:45:18.292 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.286+0000 7f634c9d1640 1 -- 172.21.15.88:0/2419257022 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f6330009ce0 con 0x7f63300039b0 2024-04-26T23:45:18.292 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.286+0000 7f634c9d1640 1 -- 172.21.15.88:0/2419257022 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f6330009ee0 con 0x7f6330004800 2024-04-26T23:45:18.292 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.286+0000 7f634d1d2640 1 --1- 172.21.15.88:0/2419257022 >> v1:172.21.15.175:6789/0 conn(0x7f63480bf2a0 0x7f63480ab470 :-1 s=CLOSED pgs=0 cs=0 l=0).handle_server_banner_and_identify state changed while learned_addr, mark_down or replacing must be happened just now 2024-04-26T23:45:18.292 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.287+0000 7f634d9d3640 1 --2- 172.21.15.88:0/2419257022 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f63300039b0 0x7f6330003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:18.292 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.287+0000 7f634e1d4640 1 --2- 172.21.15.88:0/2419257022 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f63300051c0 0x7f63300145c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:18.292 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.287+0000 7f634d1d2640 1 --2- 172.21.15.88:0/2419257022 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6330004800 0x7f6330004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:18.297 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.287+0000 7f634e1d4640 1 -- 172.21.15.88:0/2419257022 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6330004800 msgr2=0x7f6330004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:45:18.298 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.287+0000 7f634e1d4640 1 --2- 172.21.15.88:0/2419257022 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6330004800 0x7f6330004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:18.298 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.287+0000 7f634e1d4640 1 -- 172.21.15.88:0/2419257022 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f63300039b0 msgr2=0x7f6330003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:45:18.298 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.287+0000 7f634e1d4640 1 --2- 172.21.15.88:0/2419257022 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f63300039b0 0x7f6330003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:18.298 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.287+0000 7f634e1d4640 1 -- 172.21.15.88:0/2419257022 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63480c51c0 con 0x7f63300051c0 2024-04-26T23:45:18.298 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.289+0000 7f634e1d4640 1 --2- 172.21.15.88:0/2419257022 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f63300051c0 0x7f63300145c0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f6340009e80 tx=0x7f6330005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bcc02116e08f251 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:18.298 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.289+0000 7f634e1d4640 1 -- 172.21.15.88:0/2419257022 reap_dead start 2024-04-26T23:45:18.298 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.289+0000 7f634c9d1640 1 -- 172.21.15.88:0/2419257022 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6340033070 con 0x7f63300051c0 2024-04-26T23:45:18.298 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.289+0000 7f634c9d1640 1 -- 172.21.15.88:0/2419257022 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f634002f6a0 con 0x7f63300051c0 2024-04-26T23:45:18.298 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.289+0000 7f634c9d1640 1 -- 172.21.15.88:0/2419257022 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6340009a50 con 0x7f63300051c0 2024-04-26T23:45:18.299 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.295+0000 7f634e9d5640 1 -- 172.21.15.88:0/2419257022 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f63300051c0 msgr2=0x7f63300145c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:18.299 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.295+0000 7f634e9d5640 1 --2- 172.21.15.88:0/2419257022 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f63300051c0 0x7f63300145c0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f6340009e80 tx=0x7f6330005830 comp rx=0 tx=0).stop 2024-04-26T23:45:18.301 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.298+0000 7f634e9d5640 1 -- 172.21.15.88:0/2419257022 shutdown_connections 2024-04-26T23:45:18.301 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.298+0000 7f634e9d5640 1 --2- 172.21.15.88:0/2419257022 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f63300051c0 0x7f63300145c0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:18.301 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.298+0000 7f634e9d5640 1 -- 172.21.15.88:0/2419257022 >> 172.21.15.88:0/2419257022 conn(0x7f63480caa20 msgr2=0x7f63480c6cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:18.305 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.302+0000 7f634e9d5640 1 -- 172.21.15.88:0/2419257022 shutdown_connections 2024-04-26T23:45:18.305 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.302+0000 7f634e9d5640 1 -- 172.21.15.88:0/2419257022 wait complete. 2024-04-26T23:45:18.310 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.304+0000 7f634e9d5640 1 Processor -- start 2024-04-26T23:45:18.310 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.304+0000 7f634e9d5640 1 -- start start 2024-04-26T23:45:18.311 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.305+0000 7f634e9d5640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f63300051c0 0x7f63480ab6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:18.311 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.305+0000 7f634e9d5640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6348148f60 0x7f63481493e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:18.311 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.305+0000 7f634e9d5640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f634813f910 0x7f634813fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:18.311 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.305+0000 7f634e9d5640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f63480c6860 con 0x7f63300051c0 2024-04-26T23:45:18.311 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.305+0000 7f634e9d5640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f63480c66e0 con 0x7f634813f910 2024-04-26T23:45:18.311 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.305+0000 7f634e9d5640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f63480c5ac0 con 0x7f6348148f60 2024-04-26T23:45:18.311 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.306+0000 7f634d1d2640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6348148f60 0x7f63481493e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:18.311 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.306+0000 7f634d1d2640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6348148f60 0x7f63481493e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.88:59664/0 (socket says 172.21.15.88:59664) 2024-04-26T23:45:18.311 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.306+0000 7f634d1d2640 1 -- 172.21.15.88:0/149670914 learned_addr learned my addr 172.21.15.88:0/149670914 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:45:18.311 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.306+0000 7f634d9d3640 1 --2- 172.21.15.88:0/149670914 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f63300051c0 0x7f63480ab6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:18.311 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.307+0000 7f634d1d2640 1 -- 172.21.15.88:0/149670914 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f634813f910 msgr2=0x7f634813fd90 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-26T23:45:18.311 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.307+0000 7f634d1d2640 1 --2- 172.21.15.88:0/149670914 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f634813f910 0x7f634813fd90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:18.311 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.307+0000 7f634d1d2640 1 -- 172.21.15.88:0/149670914 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f63300051c0 msgr2=0x7f63480ab6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:18.312 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.307+0000 7f634d1d2640 1 --2- 172.21.15.88:0/149670914 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f63300051c0 0x7f63480ab6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:18.312 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.307+0000 7f634d1d2640 1 -- 172.21.15.88:0/149670914 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6348154980 con 0x7f6348148f60 2024-04-26T23:45:18.312 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.307+0000 7f634d9d3640 1 --2- 172.21.15.88:0/149670914 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f63300051c0 0x7f63480ab6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:45:18.312 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.308+0000 7f634d1d2640 1 --2- 172.21.15.88:0/149670914 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6348148f60 0x7f63481493e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f633c0013a0 tx=0x7f633c001860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:18.312 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.309+0000 7f63467fc640 1 -- 172.21.15.88:0/149670914 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f633c019070 con 0x7f6348148f60 2024-04-26T23:45:18.312 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.309+0000 7f634e9d5640 1 -- 172.21.15.88:0/149670914 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f634814aa20 con 0x7f6348148f60 2024-04-26T23:45:18.313 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.309+0000 7f634e9d5640 1 -- 172.21.15.88:0/149670914 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f634814a740 con 0x7f6348148f60 2024-04-26T23:45:18.313 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.309+0000 7f63467fc640 1 -- 172.21.15.88:0/149670914 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f633c0047e0 con 0x7f6348148f60 2024-04-26T23:45:18.313 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.309+0000 7f63467fc640 1 -- 172.21.15.88:0/149670914 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f633c004bb0 con 0x7f6348148f60 2024-04-26T23:45:18.315 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.311+0000 7f63467fc640 1 -- 172.21.15.88:0/149670914 <== mon.2 v2:172.21.15.175:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f633c01c070 con 0x7f6348148f60 2024-04-26T23:45:18.315 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.312+0000 7f63467fc640 1 --2- 172.21.15.88:0/149670914 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f633406c8f0 0x7f633406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:18.316 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.313+0000 7f63467fc640 1 -- 172.21.15.88:0/149670914 <== mon.2 v2:172.21.15.175:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6666+0+0 (secure 0 0 0) 0x7f633c08b290 con 0x7f6348148f60 2024-04-26T23:45:18.316 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.313+0000 7f634d9d3640 1 --2- 172.21.15.88:0/149670914 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f633406c8f0 0x7f633406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:18.316 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.313+0000 7f634e9d5640 1 --2- 172.21.15.88:0/149670914 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6328002a70 0x7f6328004f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:18.316 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.313+0000 7f634e9d5640 1 -- 172.21.15.88:0/149670914 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f6328007ec0 con 0x7f6328002a70 2024-04-26T23:45:18.316 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.313+0000 7f634e1d4640 1 --2- 172.21.15.88:0/149670914 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6328002a70 0x7f6328004f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:18.317 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.314+0000 7f634e1d4640 1 -- 172.21.15.88:0/149670914 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f63280080c0 con 0x7f6328002a70 2024-04-26T23:45:18.317 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.314+0000 7f634e1d4640 1 --2- 172.21.15.88:0/149670914 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6328002a70 0x7f6328004f30 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f63480ad110 tx=0x7f6340004a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:18.318 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.315+0000 7f63467fc640 1 -- 172.21.15.88:0/149670914 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6340048070 con 0x7f6328002a70 2024-04-26T23:45:18.318 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.315+0000 7f634d9d3640 1 --2- 172.21.15.88:0/149670914 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f633406c8f0 0x7f633406edb0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f6338007fd0 tx=0x7f6338001b30 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:18.320 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.317+0000 7f63467fc640 1 -- 172.21.15.88:0/149670914 <== mon.0 v2:172.21.15.88:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f634002f460 con 0x7f6328002a70 2024-04-26T23:45:18.321 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.317+0000 7f63467fc640 1 -- 172.21.15.88:0/149670914 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6328002a70 msgr2=0x7f6328004f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:18.321 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.317+0000 7f63467fc640 1 --2- 172.21.15.88:0/149670914 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6328002a70 0x7f6328004f30 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f63480ad110 tx=0x7f6340004a80 comp rx=0 tx=0).stop 2024-04-26T23:45:18.321 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.317+0000 7f63467fc640 1 -- 172.21.15.88:0/149670914 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6328002a70 msgr2=0x7f6328004f30 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:45:18.321 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.317+0000 7f63467fc640 1 --2- 172.21.15.88:0/149670914 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6328002a70 0x7f6328004f30 secure :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f63480ad110 tx=0x7f6340004a80 comp rx=0 tx=0).stop 2024-04-26T23:45:18.338 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.333+0000 7f634e9d5640 1 --2- 172.21.15.88:0/149670914 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6328006f00 0x7f6328007390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:18.338 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.333+0000 7f634e9d5640 1 -- 172.21.15.88:0/149670914 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f632800a4a0 con 0x7f6328006f00 2024-04-26T23:45:18.338 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.334+0000 7f634e1d4640 1 --2- 172.21.15.88:0/149670914 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6328006f00 0x7f6328007390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:18.339 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.334+0000 7f634e1d4640 1 -- 172.21.15.88:0/149670914 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f63280078d0 con 0x7f6328006f00 2024-04-26T23:45:18.339 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.335+0000 7f634e1d4640 1 --2- 172.21.15.88:0/149670914 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6328006f00 0x7f6328007390 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f6328008090 tx=0x7f6340009540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:18.343 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-04-26T23:45:18.343 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2024-04-26T23:45:18.343 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2024-04-26T23:45:18.343 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "leader", 2024-04-26T23:45:18.343 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 54, 2024-04-26T23:45:18.343 INFO:teuthology.orchestra.run.smithi088.stdout: "uptime": 27388, 2024-04-26T23:45:18.343 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2024-04-26T23:45:18.343 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2024-04-26T23:45:18.344 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2024-04-26T23:45:18.344 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2024-04-26T23:45:18.344 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:45:18.344 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 1, 2024-04-26T23:45:18.344 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2024-04-26T23:45:18.344 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2450521708007866372", 2024-04-26T23:45:18.344 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2024-04-26T23:45:18.344 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-04-26T23:45:18.344 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-04-26T23:45:18.344 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-04-26T23:45:18.344 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-04-26T23:45:18.344 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-04-26T23:45:18.344 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-04-26T23:45:18.344 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-04-26T23:45:18.344 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-04-26T23:45:18.345 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-04-26T23:45:18.345 INFO:teuthology.orchestra.run.smithi088.stdout: "reef", 2024-04-26T23:45:18.345 INFO:teuthology.orchestra.run.smithi088.stdout: "squid" 2024-04-26T23:45:18.345 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:45:18.345 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540701547738038271", 2024-04-26T23:45:18.345 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2024-04-26T23:45:18.345 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-04-26T23:45:18.345 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-04-26T23:45:18.345 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-04-26T23:45:18.345 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-04-26T23:45:18.345 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-04-26T23:45:18.345 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-04-26T23:45:18.345 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-04-26T23:45:18.345 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-04-26T23:45:18.345 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-04-26T23:45:18.346 INFO:teuthology.orchestra.run.smithi088.stdout: "reef", 2024-04-26T23:45:18.346 INFO:teuthology.orchestra.run.smithi088.stdout: "squid" 2024-04-26T23:45:18.346 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:45:18.346 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:45:18.346 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2024-04-26T23:45:18.346 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2024-04-26T23:45:18.346 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2024-04-26T23:45:18.346 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2024-04-26T23:45:18.346 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2024-04-26T23:45:18.346 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "555255e9-7ef9-4454-8dc9-35e96b70035c", 2024-04-26T23:45:18.346 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2024-04-26T23:39:34.291658Z", 2024-04-26T23:45:18.346 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2024-04-26T23:39:34.291658Z", 2024-04-26T23:45:18.346 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 19, 2024-04-26T23:45:18.346 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "squid", 2024-04-26T23:45:18.346 INFO:teuthology.orchestra.run.smithi088.stdout: "election_strategy": 1, 2024-04-26T23:45:18.347 INFO:teuthology.orchestra.run.smithi088.stdout: "disallowed_leaders: ": "", 2024-04-26T23:45:18.347 INFO:teuthology.orchestra.run.smithi088.stdout: "stretch_mode": false, 2024-04-26T23:45:18.347 INFO:teuthology.orchestra.run.smithi088.stdout: "tiebreaker_mon": "", 2024-04-26T23:45:18.347 INFO:teuthology.orchestra.run.smithi088.stdout: "removed_ranks: ": "", 2024-04-26T23:45:18.347 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2024-04-26T23:45:18.347 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2024-04-26T23:45:18.347 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-04-26T23:45:18.347 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-04-26T23:45:18.347 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-04-26T23:45:18.347 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-04-26T23:45:18.347 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-04-26T23:45:18.347 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-04-26T23:45:18.347 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-04-26T23:45:18.347 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-04-26T23:45:18.347 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-04-26T23:45:18.348 INFO:teuthology.orchestra.run.smithi088.stdout: "reef", 2024-04-26T23:45:18.348 INFO:teuthology.orchestra.run.smithi088.stdout: "squid" 2024-04-26T23:45:18.348 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:45:18.348 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2024-04-26T23:45:18.348 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:45:18.348 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2024-04-26T23:45:18.348 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:45:18.348 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2024-04-26T23:45:18.348 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2024-04-26T23:45:18.348 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-04-26T23:45:18.348 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-04-26T23:45:18.348 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:45:18.348 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-04-26T23:45:18.348 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2024-04-26T23:45:18.349 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:45:18.349 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:45:18.349 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:45:18.349 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-04-26T23:45:18.349 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2024-04-26T23:45:18.349 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:45:18.349 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:45:18.349 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:45:18.349 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:45:18.349 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2024-04-26T23:45:18.349 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2024-04-26T23:45:18.349 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-04-26T23:45:18.349 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-04-26T23:45:18.349 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-04-26T23:45:18.349 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:45:18.349 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:45:18.350 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2024-04-26T23:45:18.350 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2024-04-26T23:45:18.350 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-04-26T23:45:18.350 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-04-26T23:45:18.350 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:45:18.350 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-04-26T23:45:18.350 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:3300", 2024-04-26T23:45:18.350 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:45:18.350 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:45:18.350 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:45:18.350 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-04-26T23:45:18.350 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6789", 2024-04-26T23:45:18.350 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:45:18.350 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:45:18.351 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:45:18.351 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:45:18.351 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6789/0", 2024-04-26T23:45:18.351 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.175:6789/0", 2024-04-26T23:45:18.351 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-04-26T23:45:18.351 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-04-26T23:45:18.351 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-04-26T23:45:18.351 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:45:18.351 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:45:18.351 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2024-04-26T23:45:18.351 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2024-04-26T23:45:18.351 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-04-26T23:45:18.351 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-04-26T23:45:18.351 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:45:18.351 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-04-26T23:45:18.352 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:3301", 2024-04-26T23:45:18.352 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:45:18.352 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:45:18.352 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:45:18.352 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-04-26T23:45:18.352 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6790", 2024-04-26T23:45:18.352 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:45:18.352 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:45:18.352 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:45:18.352 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:45:18.352 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6790/0", 2024-04-26T23:45:18.352 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.175:6790/0", 2024-04-26T23:45:18.352 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-04-26T23:45:18.352 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-04-26T23:45:18.352 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-04-26T23:45:18.353 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:45:18.353 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:45:18.353 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:45:18.353 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2024-04-26T23:45:18.353 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2024-04-26T23:45:18.353 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:45:18.353 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:45:18.353 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:45:18.353 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2024-04-26T23:45:18.353 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:45:18.353 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:45:18.353 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": [ 2024-04-26T23:45:18.353 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:45:18.353 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:45:18.353 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:45:18.354 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2024-04-26T23:45:18.354 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:45:18.354 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:45:18.354 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2024-04-26T23:45:18.354 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:45:18.354 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:45:18.354 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:45:18.354 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2024-04-26T23:45:18.354 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:45:18.354 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:45:18.354 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:45:18.354 INFO:teuthology.orchestra.run.smithi088.stdout: "stretch_mode": false 2024-04-26T23:45:18.354 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-04-26T23:45:18.355 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.339+0000 7f63467fc640 1 -- 172.21.15.88:0/149670914 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f634004e070 con 0x7f6328006f00 2024-04-26T23:45:18.355 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.339+0000 7f63467fc640 1 -- 172.21.15.88:0/149670914 <== mon.0 v2:172.21.15.88:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4726 (secure 0 0 0) 0x7f6340038900 con 0x7f6328006f00 2024-04-26T23:45:18.355 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.339+0000 7f63467fc640 1 -- 172.21.15.88:0/149670914 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6328006f00 msgr2=0x7f6328007390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:18.356 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.339+0000 7f63467fc640 1 --2- 172.21.15.88:0/149670914 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6328006f00 0x7f6328007390 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f6328008090 tx=0x7f6340009540 comp rx=0 tx=0).stop 2024-04-26T23:45:18.356 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.339+0000 7f63467fc640 1 -- 172.21.15.88:0/149670914 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6328006f00 msgr2=0x7f6328007390 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:45:18.356 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.339+0000 7f63467fc640 1 --2- 172.21.15.88:0/149670914 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6328006f00 0x7f6328007390 secure :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f6328008090 tx=0x7f6340009540 comp rx=0 tx=0).stop 2024-04-26T23:45:18.356 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.342+0000 7f634e9d5640 1 -- 172.21.15.88:0/149670914 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f633406c8f0 msgr2=0x7f633406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:18.356 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.342+0000 7f634e9d5640 1 --2- 172.21.15.88:0/149670914 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f633406c8f0 0x7f633406edb0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f6338007fd0 tx=0x7f6338001b30 comp rx=0 tx=0).stop 2024-04-26T23:45:18.356 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.342+0000 7f634e9d5640 1 -- 172.21.15.88:0/149670914 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6348148f60 msgr2=0x7f63481493e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:18.356 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.342+0000 7f634e9d5640 1 --2- 172.21.15.88:0/149670914 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6348148f60 0x7f63481493e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f633c0013a0 tx=0x7f633c001860 comp rx=0 tx=0).stop 2024-04-26T23:45:18.356 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.343+0000 7f634e1d4640 1 -- 172.21.15.88:0/149670914 reap_dead start 2024-04-26T23:45:18.356 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.343+0000 7f634e9d5640 1 -- 172.21.15.88:0/149670914 shutdown_connections 2024-04-26T23:45:18.356 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.343+0000 7f634e9d5640 1 -- 172.21.15.88:0/149670914 >> 172.21.15.88:0/149670914 conn(0x7f63480caa20 msgr2=0x7f6348144f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:18.356 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.348+0000 7f634e9d5640 1 -- 172.21.15.88:0/149670914 shutdown_connections 2024-04-26T23:45:18.356 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.349+0000 7f634e9d5640 1 -- 172.21.15.88:0/149670914 wait complete. 2024-04-26T23:45:18.372 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-04-26T23:45:18.373 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-04-26T23:45:18.373 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-04-26T23:45:18.568 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.565+0000 7fb9e2886640 1 Processor -- start 2024-04-26T23:45:18.568 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.565+0000 7fb9e2886640 1 -- start start 2024-04-26T23:45:18.569 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.566+0000 7fb9e2886640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fb9dc0ab380 0x7fb9dc152cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:18.570 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.566+0000 7fb9dbfff640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7fb9dc150300 0x7fb9dc0c3640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.88:49522/0 (socket says 172.21.15.88:49522) 2024-04-26T23:45:18.570 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.566+0000 7fb9db7fe640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fb9dc0ab380 0x7fb9dc152cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:18.571 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.567+0000 7fb9db7fe640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fb9dc0ab380 0x7fb9dc152cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:49386/0 (socket says 172.21.15.88:49386) 2024-04-26T23:45:18.571 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.567+0000 7fb9e2886640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fb9dc06f9c0 0x7fb9dc0c4c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:18.571 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.567+0000 7fb9db7fe640 1 -- 172.21.15.88:0/1847989393 learned_addr learned my addr 172.21.15.88:0/1847989393 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:45:18.571 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.567+0000 7fb9e2886640 1 -- 172.21.15.88:0/1847989393 --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb9dc0c3e00 con 0x7fb9dc150300 2024-04-26T23:45:18.571 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.567+0000 7fb9e2886640 1 -- 172.21.15.88:0/1847989393 --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7fb9dc06e3d0 con 0x7fb9dc0ab380 2024-04-26T23:45:18.571 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.567+0000 7fb9e2886640 1 -- 172.21.15.88:0/1847989393 --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7fb9dc06e6b0 con 0x7fb9dc06f9c0 2024-04-26T23:45:18.571 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.567+0000 7fb9e0e23640 1 --2- 172.21.15.88:0/1847989393 >> v2:172.21.15.175:3300/0 conn(0x7fb9dc06f9c0 0x7fb9dc0c4c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:18.575 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.568+0000 7fb9db7fe640 1 -- 172.21.15.88:0/1847989393 >> v2:172.21.15.175:3300/0 conn(0x7fb9dc06f9c0 msgr2=0x7fb9dc0c4c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:45:18.575 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.568+0000 7fb9db7fe640 1 --2- 172.21.15.88:0/1847989393 >> v2:172.21.15.175:3300/0 conn(0x7fb9dc06f9c0 0x7fb9dc0c4c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:18.575 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.568+0000 7fb9db7fe640 1 -- 172.21.15.88:0/1847989393 >> v1:172.21.15.175:6789/0 conn(0x7fb9dc150300 legacy=0x7fb9dc0c3640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:45:18.575 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.568+0000 7fb9db7fe640 1 -- 172.21.15.88:0/1847989393 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9dc0c40e0 con 0x7fb9dc0ab380 2024-04-26T23:45:18.575 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.569+0000 7fb9db7fe640 1 --2- 172.21.15.88:0/1847989393 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb9dc0ab380 0x7fb9dc152cf0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fb9dc0c8260 tx=0x7fb9cc02b530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=380b2ef36c42e9ac server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:18.575 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.571+0000 7fb9dbfff640 1 --1- 172.21.15.88:0/1847989393 >> v1:172.21.15.175:6789/0 conn(0x7fb9dc150300 0x7fb9dc0c3640 :-1 s=CLOSED pgs=0 cs=0 l=0).handle_server_banner_and_identify state changed while learned_addr, mark_down or replacing must be happened just now 2024-04-26T23:45:18.578 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.572+0000 7fb9daffd640 1 -- 172.21.15.88:0/1847989393 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9cc037070 con 0x7fb9dc0ab380 2024-04-26T23:45:18.578 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.572+0000 7fb9daffd640 1 -- 172.21.15.88:0/1847989393 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9cc009630 con 0x7fb9dc0ab380 2024-04-26T23:45:18.578 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.572+0000 7fb9daffd640 1 -- 172.21.15.88:0/1847989393 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9cc009a00 con 0x7fb9dc0ab380 2024-04-26T23:45:18.578 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.575+0000 7fb9e2886640 1 -- 172.21.15.88:0/1847989393 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb9dc0ab380 msgr2=0x7fb9dc152cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:18.578 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.575+0000 7fb9e2886640 1 --2- 172.21.15.88:0/1847989393 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb9dc0ab380 0x7fb9dc152cf0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fb9dc0c8260 tx=0x7fb9cc02b530 comp rx=0 tx=0).stop 2024-04-26T23:45:18.578 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.575+0000 7fb9e2886640 1 -- 172.21.15.88:0/1847989393 shutdown_connections 2024-04-26T23:45:18.578 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.575+0000 7fb9e2886640 1 --2- 172.21.15.88:0/1847989393 >> v2:172.21.15.175:3300/0 conn(0x7fb9dc06f9c0 0x7fb9dc0c4c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:18.578 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.575+0000 7fb9e2886640 1 --2- 172.21.15.88:0/1847989393 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb9dc0ab380 0x7fb9dc152cf0 secure :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fb9dc0c8260 tx=0x7fb9cc02b530 comp rx=0 tx=0).stop 2024-04-26T23:45:18.578 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.575+0000 7fb9e2886640 1 -- 172.21.15.88:0/1847989393 >> 172.21.15.88:0/1847989393 conn(0x7fb9dc06c310 msgr2=0x7fb9dc06c6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:18.579 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.576+0000 7fb9e2886640 1 -- 172.21.15.88:0/1847989393 shutdown_connections 2024-04-26T23:45:18.584 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.579+0000 7fb9e2886640 1 -- 172.21.15.88:0/1847989393 wait complete. 2024-04-26T23:45:18.584 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.581+0000 7fb9e2886640 1 Processor -- start 2024-04-26T23:45:18.584 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.581+0000 7fb9e2886640 1 -- start start 2024-04-26T23:45:18.587 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.583+0000 7fb9e2886640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb9dc06f9c0 0x7fb9dc1e80b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:18.587 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.583+0000 7fb9e2886640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb9dc150300 0x7fb9dc1e9520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:18.587 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.583+0000 7fb9e2886640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb9dc072f40 0x7fb9dc0742b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:18.587 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.583+0000 7fb9e2886640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fb9dc0c51d0 con 0x7fb9dc150300 2024-04-26T23:45:18.587 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.583+0000 7fb9e2886640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fb9dc1506e0 con 0x7fb9dc072f40 2024-04-26T23:45:18.587 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.583+0000 7fb9e2886640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fb9dc0c5350 con 0x7fb9dc06f9c0 2024-04-26T23:45:18.587 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.583+0000 7fb9e0e23640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb9dc072f40 0x7fb9dc0742b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:18.587 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.583+0000 7fb9e0e23640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb9dc072f40 0x7fb9dc0742b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.88:38344/0 (socket says 172.21.15.88:38344) 2024-04-26T23:45:18.588 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.584+0000 7fb9e0e23640 1 -- 172.21.15.88:0/3177971882 learned_addr learned my addr 172.21.15.88:0/3177971882 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:45:18.589 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.584+0000 7fb9dbfff640 1 --2- 172.21.15.88:0/3177971882 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb9dc06f9c0 0x7fb9dc1e80b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:18.589 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.585+0000 7fb9db7fe640 1 --2- 172.21.15.88:0/3177971882 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb9dc150300 0x7fb9dc1e9520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:18.589 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.585+0000 7fb9db7fe640 1 -- 172.21.15.88:0/3177971882 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb9dc06f9c0 msgr2=0x7fb9dc1e80b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:18.589 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.585+0000 7fb9db7fe640 1 --2- 172.21.15.88:0/3177971882 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb9dc06f9c0 0x7fb9dc1e80b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:18.589 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.585+0000 7fb9db7fe640 1 -- 172.21.15.88:0/3177971882 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb9dc072f40 msgr2=0x7fb9dc0742b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:18.589 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.585+0000 7fb9db7fe640 1 --2- 172.21.15.88:0/3177971882 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb9dc072f40 0x7fb9dc0742b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:18.589 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.585+0000 7fb9db7fe640 1 -- 172.21.15.88:0/3177971882 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9dc1e9a60 con 0x7fb9dc150300 2024-04-26T23:45:18.589 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.586+0000 7fb9db7fe640 1 --2- 172.21.15.88:0/3177971882 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb9dc150300 0x7fb9dc1e9520 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fb9cc0061f0 tx=0x7fb9cc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:18.590 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.587+0000 7fb9d8ff9640 1 -- 172.21.15.88:0/3177971882 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9cc037050 con 0x7fb9dc150300 2024-04-26T23:45:18.590 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.587+0000 7fb9d8ff9640 1 -- 172.21.15.88:0/3177971882 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9cc043070 con 0x7fb9dc150300 2024-04-26T23:45:18.590 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.587+0000 7fb9e2886640 1 -- 172.21.15.88:0/3177971882 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9dc14f100 con 0x7fb9dc150300 2024-04-26T23:45:18.590 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.587+0000 7fb9e2886640 1 -- 172.21.15.88:0/3177971882 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9dc072180 con 0x7fb9dc150300 2024-04-26T23:45:18.590 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.587+0000 7fb9d8ff9640 1 -- 172.21.15.88:0/3177971882 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9cc03ca10 con 0x7fb9dc150300 2024-04-26T23:45:18.594 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.591+0000 7fb9d8ff9640 1 -- 172.21.15.88:0/3177971882 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb9cc02bd10 con 0x7fb9dc150300 2024-04-26T23:45:18.594 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.591+0000 7fb9d8ff9640 1 --2- 172.21.15.88:0/3177971882 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fb9c806c9f0 0x7fb9c806eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:18.600 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.592+0000 7fb9dbfff640 1 --2- 172.21.15.88:0/3177971882 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fb9c806c9f0 0x7fb9c806eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:18.600 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.592+0000 7fb9d8ff9640 1 -- 172.21.15.88:0/3177971882 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6666+0+0 (secure 0 0 0) 0x7fb9cc0acaa0 con 0x7fb9dc150300 2024-04-26T23:45:18.601 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.598+0000 7fb9e2886640 1 --2- 172.21.15.88:0/3177971882 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb9bc002a70 0x7fb9bc004f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:18.601 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.598+0000 7fb9e2886640 1 -- 172.21.15.88:0/3177971882 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fb9bc007ec0 con 0x7fb9bc002a70 2024-04-26T23:45:18.606 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.601+0000 7fb9dbfff640 1 --2- 172.21.15.88:0/3177971882 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fb9c806c9f0 0x7fb9c806eeb0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fb9d4001af0 tx=0x7fb9d4001650 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:18.606 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.603+0000 7fb9e0e23640 1 --2- 172.21.15.88:0/3177971882 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb9bc002a70 0x7fb9bc004f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:18.612 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.609+0000 7fb9e0e23640 1 -- 172.21.15.88:0/3177971882 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb9bc0080c0 con 0x7fb9bc002a70 2024-04-26T23:45:18.612 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.609+0000 7fb9e0e23640 1 --2- 172.21.15.88:0/3177971882 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb9bc002a70 0x7fb9bc004f30 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fb9d00107f0 tx=0x7fb9d0010cb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:18.613 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.610+0000 7fb9d8ff9640 1 -- 172.21.15.88:0/3177971882 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9d0018070 con 0x7fb9bc002a70 2024-04-26T23:45:18.613 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.610+0000 7fb9d8ff9640 1 -- 172.21.15.88:0/3177971882 <== mon.1 v2:172.21.15.175:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fb9d000e9d0 con 0x7fb9bc002a70 2024-04-26T23:45:18.613 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.610+0000 7fb9d8ff9640 1 -- 172.21.15.88:0/3177971882 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb9bc002a70 msgr2=0x7fb9bc004f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:18.613 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.610+0000 7fb9d8ff9640 1 --2- 172.21.15.88:0/3177971882 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb9bc002a70 0x7fb9bc004f30 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fb9d00107f0 tx=0x7fb9d0010cb0 comp rx=0 tx=0).stop 2024-04-26T23:45:18.613 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.610+0000 7fb9d8ff9640 1 -- 172.21.15.88:0/3177971882 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb9bc002a70 msgr2=0x7fb9bc004f30 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:45:18.614 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.610+0000 7fb9d8ff9640 1 --2- 172.21.15.88:0/3177971882 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb9bc002a70 0x7fb9bc004f30 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:18.641 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.636+0000 7fb9e2886640 1 --2- 172.21.15.88:0/3177971882 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb9bc006ee0 0x7fb9bc007370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:18.641 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.636+0000 7fb9e2886640 1 -- 172.21.15.88:0/3177971882 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fb9bc00a4a0 con 0x7fb9bc006ee0 2024-04-26T23:45:18.641 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.639+0000 7fb9e0e23640 1 --2- 172.21.15.88:0/3177971882 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb9bc006ee0 0x7fb9bc007370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:18.643 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.640+0000 7fb9e0e23640 1 -- 172.21.15.88:0/3177971882 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fb9bc0078b0 con 0x7fb9bc006ee0 2024-04-26T23:45:18.643 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.640+0000 7fb9e0e23640 1 --2- 172.21.15.88:0/3177971882 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb9bc006ee0 0x7fb9bc007370 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fb9d001a000 tx=0x7fb9d00046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:18.645 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.641+0000 7fb9d8ff9640 1 -- 172.21.15.88:0/3177971882 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9d0014640 con 0x7fb9bc006ee0 2024-04-26T23:45:18.645 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.642+0000 7fb9d8ff9640 1 -- 172.21.15.88:0/3177971882 <== mon.1 v2:172.21.15.175:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5208 (secure 0 0 0) 0x7fb9d00147e0 con 0x7fb9bc006ee0 2024-04-26T23:45:18.645 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.642+0000 7fb9d8ff9640 1 -- 172.21.15.88:0/3177971882 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb9bc006ee0 msgr2=0x7fb9bc007370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:18.645 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.642+0000 7fb9d8ff9640 1 --2- 172.21.15.88:0/3177971882 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb9bc006ee0 0x7fb9bc007370 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fb9d001a000 tx=0x7fb9d00046c0 comp rx=0 tx=0).stop 2024-04-26T23:45:18.645 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.642+0000 7fb9d8ff9640 1 -- 172.21.15.88:0/3177971882 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb9bc006ee0 msgr2=0x7fb9bc007370 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:45:18.645 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.642+0000 7fb9d8ff9640 1 --2- 172.21.15.88:0/3177971882 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb9bc006ee0 0x7fb9bc007370 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:18.646 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-04-26T23:45:18.646 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2024-04-26T23:45:18.646 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2024-04-26T23:45:18.646 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "peon", 2024-04-26T23:45:18.646 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 54, 2024-04-26T23:45:18.646 INFO:teuthology.orchestra.run.smithi088.stdout: "uptime": 310984, 2024-04-26T23:45:18.646 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2024-04-26T23:45:18.647 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2024-04-26T23:45:18.647 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2024-04-26T23:45:18.647 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2024-04-26T23:45:18.647 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:45:18.647 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 2, 2024-04-26T23:45:18.647 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2024-04-26T23:45:18.647 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2450521708007866372", 2024-04-26T23:45:18.647 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2024-04-26T23:45:18.647 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-04-26T23:45:18.647 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-04-26T23:45:18.647 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-04-26T23:45:18.647 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-04-26T23:45:18.647 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-04-26T23:45:18.647 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-04-26T23:45:18.648 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-04-26T23:45:18.648 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-04-26T23:45:18.648 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-04-26T23:45:18.648 INFO:teuthology.orchestra.run.smithi088.stdout: "reef", 2024-04-26T23:45:18.648 INFO:teuthology.orchestra.run.smithi088.stdout: "squid" 2024-04-26T23:45:18.648 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:45:18.648 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540701547738038271", 2024-04-26T23:45:18.648 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2024-04-26T23:45:18.648 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-04-26T23:45:18.648 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-04-26T23:45:18.648 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-04-26T23:45:18.648 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-04-26T23:45:18.648 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-04-26T23:45:18.648 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-04-26T23:45:18.648 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-04-26T23:45:18.648 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-04-26T23:45:18.649 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-04-26T23:45:18.649 INFO:teuthology.orchestra.run.smithi088.stdout: "reef", 2024-04-26T23:45:18.649 INFO:teuthology.orchestra.run.smithi088.stdout: "squid" 2024-04-26T23:45:18.649 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:45:18.649 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:45:18.649 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2024-04-26T23:45:18.649 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2024-04-26T23:45:18.649 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2024-04-26T23:45:18.649 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2024-04-26T23:45:18.649 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2024-04-26T23:45:18.649 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "555255e9-7ef9-4454-8dc9-35e96b70035c", 2024-04-26T23:45:18.649 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2024-04-26T23:39:34.291658Z", 2024-04-26T23:45:18.649 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2024-04-26T23:39:34.291658Z", 2024-04-26T23:45:18.649 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 19, 2024-04-26T23:45:18.650 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "squid", 2024-04-26T23:45:18.650 INFO:teuthology.orchestra.run.smithi088.stdout: "election_strategy": 1, 2024-04-26T23:45:18.650 INFO:teuthology.orchestra.run.smithi088.stdout: "disallowed_leaders: ": "", 2024-04-26T23:45:18.650 INFO:teuthology.orchestra.run.smithi088.stdout: "stretch_mode": false, 2024-04-26T23:45:18.650 INFO:teuthology.orchestra.run.smithi088.stdout: "tiebreaker_mon": "", 2024-04-26T23:45:18.650 INFO:teuthology.orchestra.run.smithi088.stdout: "removed_ranks: ": "", 2024-04-26T23:45:18.650 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2024-04-26T23:45:18.650 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2024-04-26T23:45:18.650 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-04-26T23:45:18.650 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-04-26T23:45:18.650 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-04-26T23:45:18.650 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-04-26T23:45:18.650 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-04-26T23:45:18.651 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-04-26T23:45:18.651 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-04-26T23:45:18.651 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-04-26T23:45:18.651 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-04-26T23:45:18.651 INFO:teuthology.orchestra.run.smithi088.stdout: "reef", 2024-04-26T23:45:18.651 INFO:teuthology.orchestra.run.smithi088.stdout: "squid" 2024-04-26T23:45:18.651 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:45:18.651 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2024-04-26T23:45:18.651 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:45:18.651 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2024-04-26T23:45:18.651 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:45:18.651 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2024-04-26T23:45:18.651 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2024-04-26T23:45:18.651 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-04-26T23:45:18.651 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-04-26T23:45:18.652 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:45:18.652 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-04-26T23:45:18.652 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2024-04-26T23:45:18.652 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:45:18.652 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:45:18.652 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:45:18.652 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-04-26T23:45:18.652 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2024-04-26T23:45:18.652 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:45:18.652 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:45:18.652 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:45:18.652 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:45:18.652 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2024-04-26T23:45:18.652 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2024-04-26T23:45:18.653 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-04-26T23:45:18.653 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-04-26T23:45:18.653 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-04-26T23:45:18.653 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:45:18.653 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:45:18.653 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2024-04-26T23:45:18.653 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2024-04-26T23:45:18.653 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-04-26T23:45:18.653 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-04-26T23:45:18.653 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:45:18.653 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-04-26T23:45:18.653 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:3300", 2024-04-26T23:45:18.653 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:45:18.653 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:45:18.654 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:45:18.654 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-04-26T23:45:18.654 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6789", 2024-04-26T23:45:18.654 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:45:18.654 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:45:18.654 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:45:18.654 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:45:18.654 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6789/0", 2024-04-26T23:45:18.654 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.175:6789/0", 2024-04-26T23:45:18.654 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-04-26T23:45:18.654 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-04-26T23:45:18.654 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-04-26T23:45:18.654 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:45:18.654 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:45:18.655 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2024-04-26T23:45:18.655 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2024-04-26T23:45:18.655 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-04-26T23:45:18.655 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-04-26T23:45:18.655 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:45:18.655 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-04-26T23:45:18.655 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:3301", 2024-04-26T23:45:18.655 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:45:18.655 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:45:18.655 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:45:18.655 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-04-26T23:45:18.655 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6790", 2024-04-26T23:45:18.655 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:45:18.655 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:45:18.656 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:45:18.656 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:45:18.656 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6790/0", 2024-04-26T23:45:18.656 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.175:6790/0", 2024-04-26T23:45:18.656 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-04-26T23:45:18.656 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-04-26T23:45:18.656 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-04-26T23:45:18.656 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:45:18.656 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:45:18.656 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:45:18.656 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2024-04-26T23:45:18.656 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2024-04-26T23:45:18.656 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:45:18.656 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:45:18.656 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:45:18.657 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2024-04-26T23:45:18.657 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:45:18.657 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:45:18.657 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": [ 2024-04-26T23:45:18.657 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:45:18.657 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:45:18.657 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:45:18.657 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 4 2024-04-26T23:45:18.657 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:45:18.657 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:45:18.657 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": [ 2024-04-26T23:45:18.657 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:45:18.657 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:45:18.657 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:45:18.657 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 7 2024-04-26T23:45:18.658 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:45:18.658 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:45:18.658 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2024-04-26T23:45:18.658 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:45:18.658 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x2f018fb87aa4aafe", 2024-04-26T23:45:18.658 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:45:18.658 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2024-04-26T23:45:18.658 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:45:18.658 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:45:18.658 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:45:18.658 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:45:18.658 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 5 2024-04-26T23:45:18.658 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:45:18.659 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:45:18.659 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": [ 2024-04-26T23:45:18.659 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:45:18.659 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:45:18.659 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:45:18.659 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2024-04-26T23:45:18.659 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:45:18.659 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:45:18.659 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:45:18.659 INFO:teuthology.orchestra.run.smithi088.stdout: "stretch_mode": false 2024-04-26T23:45:18.659 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-04-26T23:45:18.660 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.647+0000 7fb9e2886640 1 -- 172.21.15.88:0/3177971882 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fb9c806c9f0 msgr2=0x7fb9c806eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:18.660 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.647+0000 7fb9e2886640 1 --2- 172.21.15.88:0/3177971882 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fb9c806c9f0 0x7fb9c806eeb0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fb9d4001af0 tx=0x7fb9d4001650 comp rx=0 tx=0).stop 2024-04-26T23:45:18.660 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.647+0000 7fb9e2886640 1 -- 172.21.15.88:0/3177971882 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb9dc150300 msgr2=0x7fb9dc1e9520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:18.660 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.647+0000 7fb9e2886640 1 --2- 172.21.15.88:0/3177971882 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb9dc150300 0x7fb9dc1e9520 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fb9cc0061f0 tx=0x7fb9cc0046c0 comp rx=0 tx=0).stop 2024-04-26T23:45:18.660 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.647+0000 7fb9e0e23640 1 -- 172.21.15.88:0/3177971882 reap_dead start 2024-04-26T23:45:18.660 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.647+0000 7fb9e2886640 1 -- 172.21.15.88:0/3177971882 shutdown_connections 2024-04-26T23:45:18.660 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.647+0000 7fb9e2886640 1 -- 172.21.15.88:0/3177971882 >> 172.21.15.88:0/3177971882 conn(0x7fb9dc06c310 msgr2=0x7fb9dc0c49c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:18.660 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.656+0000 7fb9e2886640 1 -- 172.21.15.88:0/3177971882 shutdown_connections 2024-04-26T23:45:18.661 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.657+0000 7fb9e2886640 1 -- 172.21.15.88:0/3177971882 wait complete. 2024-04-26T23:45:18.681 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-04-26T23:45:18.681 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-04-26T23:45:18.681 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-04-26T23:45:18.876 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.871+0000 7f418ceec640 1 Processor -- start 2024-04-26T23:45:18.876 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.871+0000 7f418ceec640 1 -- start start 2024-04-26T23:45:18.877 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.873+0000 7f418ceec640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f418000bd50 0x7f4180046b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:18.877 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.873+0000 7f418ceec640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f418004b110 0x7f41800d3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:18.877 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.873+0000 7f418ceec640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f4180006ea0 0x7f4180007330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:18.877 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.873+0000 7f418ceec640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f4180047050 con 0x7f4180006ea0 2024-04-26T23:45:18.878 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.873+0000 7f418ceec640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f41800d9c60 con 0x7f418004b110 2024-04-26T23:45:18.878 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.873+0000 7f418ceec640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f41800d9f40 con 0x7f418000bd50 2024-04-26T23:45:18.878 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.873+0000 7f4187fff640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f4180006ea0 0x7f4180007330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:18.878 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.873+0000 7f4187fff640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f4180006ea0 0x7f4180007330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:49396/0 (socket says 172.21.15.88:49396) 2024-04-26T23:45:18.878 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.873+0000 7f4187fff640 1 -- 172.21.15.88:0/3454310637 learned_addr learned my addr 172.21.15.88:0/3454310637 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:45:18.878 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.874+0000 7f4187fff640 1 -- 172.21.15.88:0/3454310637 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f418000bd50 msgr2=0x7f4180046b10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T23:45:18.879 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.874+0000 7f4187fff640 1 --2- 172.21.15.88:0/3454310637 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f418000bd50 0x7f4180046b10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:18.879 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.874+0000 7f4187fff640 1 -- 172.21.15.88:0/3454310637 >> v2:172.21.15.175:3300/0 conn(0x7f418004b110 msgr2=0x7f41800d3ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:45:18.879 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.874+0000 7f4187fff640 1 --2- 172.21.15.88:0/3454310637 >> v2:172.21.15.175:3300/0 conn(0x7f418004b110 0x7f41800d3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:18.879 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.874+0000 7f4187fff640 1 -- 172.21.15.88:0/3454310637 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41800da220 con 0x7f4180006ea0 2024-04-26T23:45:18.880 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.875+0000 7f4187fff640 1 --2- 172.21.15.88:0/3454310637 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4180006ea0 0x7f4180007330 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f4180048dc0 tx=0x7f417c02a470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78b5c4cfe8431830 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:18.880 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.875+0000 7f41867fc640 1 -- 172.21.15.88:0/3454310637 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f417c036070 con 0x7f4180006ea0 2024-04-26T23:45:18.881 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.875+0000 7f41867fc640 1 -- 172.21.15.88:0/3454310637 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f417c031600 con 0x7f4180006ea0 2024-04-26T23:45:18.881 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.876+0000 7f418ceec640 1 -- 172.21.15.88:0/3454310637 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4180006ea0 msgr2=0x7f4180007330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:18.881 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.876+0000 7f418ceec640 1 --2- 172.21.15.88:0/3454310637 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4180006ea0 0x7f4180007330 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f4180048dc0 tx=0x7f417c02a470 comp rx=0 tx=0).stop 2024-04-26T23:45:18.881 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.877+0000 7f418ceec640 1 -- 172.21.15.88:0/3454310637 shutdown_connections 2024-04-26T23:45:18.881 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.877+0000 7f418ceec640 1 --2- 172.21.15.88:0/3454310637 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4180006ea0 0x7f4180007330 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:18.882 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.877+0000 7f418ceec640 1 --2- 172.21.15.88:0/3454310637 >> v2:172.21.15.175:3300/0 conn(0x7f418004b110 0x7f41800d3ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:18.882 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.877+0000 7f418ceec640 1 --2- 172.21.15.88:0/3454310637 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f418000bd50 0x7f4180046b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:18.882 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.877+0000 7f418ceec640 1 -- 172.21.15.88:0/3454310637 >> 172.21.15.88:0/3454310637 conn(0x7f4180048250 msgr2=0x7f4180048660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:18.883 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.878+0000 7f418ceec640 1 -- 172.21.15.88:0/3454310637 shutdown_connections 2024-04-26T23:45:18.883 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.879+0000 7f418ceec640 1 -- 172.21.15.88:0/3454310637 wait complete. 2024-04-26T23:45:18.886 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.881+0000 7f418ceec640 1 Processor -- start 2024-04-26T23:45:18.890 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.882+0000 7f418ceec640 1 -- start start 2024-04-26T23:45:18.890 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.883+0000 7f418ceec640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4180006ea0 0x7f41800d5280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:18.890 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.883+0000 7f418ceec640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f418000bd50 0x7f4180044490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:18.890 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.883+0000 7f418ceec640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f418004b110 0x7f41800449d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:18.890 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.883+0000 7f418ceec640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f41800d3ff0 con 0x7f4180006ea0 2024-04-26T23:45:18.890 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.883+0000 7f418ceec640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f41800da7e0 con 0x7f418004b110 2024-04-26T23:45:18.890 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.883+0000 7f418ceec640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f41800d9930 con 0x7f418000bd50 2024-04-26T23:45:18.890 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.885+0000 7f4186ffd640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f418000bd50 0x7f4180044490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:18.890 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.885+0000 7f4187fff640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f418004b110 0x7f41800449d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:18.891 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.885+0000 7f4187fff640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f418004b110 0x7f41800449d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.88:38382/0 (socket says 172.21.15.88:38382) 2024-04-26T23:45:18.891 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.885+0000 7f4187fff640 1 -- 172.21.15.88:0/1069523387 learned_addr learned my addr 172.21.15.88:0/1069523387 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:45:18.891 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.885+0000 7f4187fff640 1 -- 172.21.15.88:0/1069523387 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f418000bd50 msgr2=0x7f4180044490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:18.891 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.885+0000 7f4187fff640 1 --2- 172.21.15.88:0/1069523387 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f418000bd50 0x7f4180044490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:18.891 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.885+0000 7f4187fff640 1 -- 172.21.15.88:0/1069523387 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4180006ea0 msgr2=0x7f41800d5280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:18.891 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.886+0000 7f41877fe640 1 --2- 172.21.15.88:0/1069523387 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4180006ea0 0x7f41800d5280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:18.891 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.886+0000 7f4187fff640 1 --2- 172.21.15.88:0/1069523387 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4180006ea0 0x7f41800d5280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:18.891 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.886+0000 7f4187fff640 1 -- 172.21.15.88:0/1069523387 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f418003fd20 con 0x7f418004b110 2024-04-26T23:45:18.891 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.886+0000 7f41877fe640 1 --2- 172.21.15.88:0/1069523387 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4180006ea0 0x7f41800d5280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:45:18.891 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.886+0000 7f4187fff640 1 --2- 172.21.15.88:0/1069523387 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f418004b110 0x7f41800449d0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f417c009bc0 tx=0x7f417c0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:18.892 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.887+0000 7f4173fff640 1 -- 172.21.15.88:0/1069523387 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f417c041020 con 0x7f418004b110 2024-04-26T23:45:18.892 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.887+0000 7f418ceec640 1 -- 172.21.15.88:0/1069523387 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4180040000 con 0x7f418004b110 2024-04-26T23:45:18.892 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.887+0000 7f4173fff640 1 -- 172.21.15.88:0/1069523387 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f417c0039c0 con 0x7f418004b110 2024-04-26T23:45:18.892 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.888+0000 7f4173fff640 1 -- 172.21.15.88:0/1069523387 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f417c036040 con 0x7f418004b110 2024-04-26T23:45:18.892 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.888+0000 7f418ceec640 1 -- 172.21.15.88:0/1069523387 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4180043f70 con 0x7f418004b110 2024-04-26T23:45:18.894 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.891+0000 7f418ceec640 1 --2- 172.21.15.88:0/1069523387 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4180044f10 0x7f4180042880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:18.894 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.891+0000 7f418ceec640 1 -- 172.21.15.88:0/1069523387 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f41800c5440 con 0x7f4180044f10 2024-04-26T23:45:18.896 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.892+0000 7f4173fff640 1 -- 172.21.15.88:0/1069523387 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f417c044020 con 0x7f418004b110 2024-04-26T23:45:18.897 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.893+0000 7f4173fff640 1 --2- 172.21.15.88:0/1069523387 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f416c06c8f0 0x7f416c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:18.897 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.893+0000 7f4173fff640 1 -- 172.21.15.88:0/1069523387 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6666+0+0 (secure 0 0 0) 0x7f417c0acab0 con 0x7f418004b110 2024-04-26T23:45:18.898 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.894+0000 7f4186ffd640 1 --2- 172.21.15.88:0/1069523387 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f416c06c8f0 0x7f416c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:18.898 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.895+0000 7f4186ffd640 1 --2- 172.21.15.88:0/1069523387 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f416c06c8f0 0x7f416c06edb0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f4188069b60 tx=0x7f418806ae60 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:18.900 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.896+0000 7f41877fe640 1 --2- 172.21.15.88:0/1069523387 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4180044f10 0x7f4180042880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:18.901 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.897+0000 7f41877fe640 1 -- 172.21.15.88:0/1069523387 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f41800441b0 con 0x7f4180044f10 2024-04-26T23:45:18.901 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.897+0000 7f41877fe640 1 --2- 172.21.15.88:0/1069523387 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4180044f10 0x7f4180042880 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f417400c510 tx=0x7f417400c9d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:18.901 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.898+0000 7f4173fff640 1 -- 172.21.15.88:0/1069523387 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4174015070 con 0x7f4180044f10 2024-04-26T23:45:18.905 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.898+0000 7f4173fff640 1 -- 172.21.15.88:0/1069523387 <== mon.2 v2:172.21.15.175:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f4174011800 con 0x7f4180044f10 2024-04-26T23:45:18.905 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.898+0000 7f4173fff640 1 -- 172.21.15.88:0/1069523387 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4180044f10 msgr2=0x7f4180042880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:18.910 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.898+0000 7f4173fff640 1 --2- 172.21.15.88:0/1069523387 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4180044f10 0x7f4180042880 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f417400c510 tx=0x7f417400c9d0 comp rx=0 tx=0).stop 2024-04-26T23:45:18.910 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.898+0000 7f4173fff640 1 -- 172.21.15.88:0/1069523387 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4180044f10 msgr2=0x7f4180042880 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:45:18.910 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.898+0000 7f4173fff640 1 --2- 172.21.15.88:0/1069523387 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4180044f10 0x7f4180042880 secure :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f417400c510 tx=0x7f417400c9d0 comp rx=0 tx=0).stop 2024-04-26T23:45:18.917 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.913+0000 7f418ceec640 1 --2- 172.21.15.88:0/1069523387 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4180042420 0x7f4180042dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:18.917 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.914+0000 7f418ceec640 1 -- 172.21.15.88:0/1069523387 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f4180005390 con 0x7f4180042420 2024-04-26T23:45:18.921 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.918+0000 7f41877fe640 1 --2- 172.21.15.88:0/1069523387 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4180042420 0x7f4180042dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:18.922 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.919+0000 7f41877fe640 1 -- 172.21.15.88:0/1069523387 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f418003f090 con 0x7f4180042420 2024-04-26T23:45:18.930 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.927+0000 7f41877fe640 1 --2- 172.21.15.88:0/1069523387 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4180042420 0x7f4180042dc0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f4174017000 tx=0x7f4174004770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:18.937 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.933+0000 7f4173fff640 1 -- 172.21.15.88:0/1069523387 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f417401ad80 con 0x7f4180042420 2024-04-26T23:45:18.938 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.933+0000 7f4173fff640 1 -- 172.21.15.88:0/1069523387 <== mon.2 v2:172.21.15.175:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4554 (secure 0 0 0) 0x7f41740243f0 con 0x7f4180042420 2024-04-26T23:45:18.938 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.933+0000 7f4173fff640 1 -- 172.21.15.88:0/1069523387 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4180042420 msgr2=0x7f4180042dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:18.938 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.933+0000 7f4173fff640 1 --2- 172.21.15.88:0/1069523387 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4180042420 0x7f4180042dc0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f4174017000 tx=0x7f4174004770 comp rx=0 tx=0).stop 2024-04-26T23:45:18.939 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.933+0000 7f4173fff640 1 -- 172.21.15.88:0/1069523387 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4180042420 msgr2=0x7f4180042dc0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:45:18.939 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.933+0000 7f4173fff640 1 --2- 172.21.15.88:0/1069523387 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4180042420 0x7f4180042dc0 secure :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f4174017000 tx=0x7f4174004770 comp rx=0 tx=0).stop 2024-04-26T23:45:18.939 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-04-26T23:45:18.939 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2024-04-26T23:45:18.940 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2024-04-26T23:45:18.940 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "peon", 2024-04-26T23:45:18.940 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 54, 2024-04-26T23:45:18.940 INFO:teuthology.orchestra.run.smithi088.stdout: "uptime": 87214, 2024-04-26T23:45:18.941 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2024-04-26T23:45:18.941 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2024-04-26T23:45:18.941 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2024-04-26T23:45:18.941 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2024-04-26T23:45:18.941 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:45:18.942 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 2, 2024-04-26T23:45:18.942 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2024-04-26T23:45:18.942 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2450521708007866372", 2024-04-26T23:45:18.942 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2024-04-26T23:45:18.942 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-04-26T23:45:18.942 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-04-26T23:45:18.942 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-04-26T23:45:18.943 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-04-26T23:45:18.943 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-04-26T23:45:18.943 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-04-26T23:45:18.943 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-04-26T23:45:18.943 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-04-26T23:45:18.943 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-04-26T23:45:18.944 INFO:teuthology.orchestra.run.smithi088.stdout: "reef", 2024-04-26T23:45:18.944 INFO:teuthology.orchestra.run.smithi088.stdout: "squid" 2024-04-26T23:45:18.944 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:45:18.944 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540701547738038271", 2024-04-26T23:45:18.944 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2024-04-26T23:45:18.944 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-04-26T23:45:18.944 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-04-26T23:45:18.945 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-04-26T23:45:18.945 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-04-26T23:45:18.945 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-04-26T23:45:18.945 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-04-26T23:45:18.945 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-04-26T23:45:18.945 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-04-26T23:45:18.945 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-04-26T23:45:18.946 INFO:teuthology.orchestra.run.smithi088.stdout: "reef", 2024-04-26T23:45:18.946 INFO:teuthology.orchestra.run.smithi088.stdout: "squid" 2024-04-26T23:45:18.946 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:45:18.946 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:45:18.946 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2024-04-26T23:45:18.946 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2024-04-26T23:45:18.946 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2024-04-26T23:45:18.946 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2024-04-26T23:45:18.947 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2024-04-26T23:45:18.947 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "555255e9-7ef9-4454-8dc9-35e96b70035c", 2024-04-26T23:45:18.947 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2024-04-26T23:39:34.291658Z", 2024-04-26T23:45:18.947 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2024-04-26T23:39:34.291658Z", 2024-04-26T23:45:18.947 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 19, 2024-04-26T23:45:18.947 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "squid", 2024-04-26T23:45:18.947 INFO:teuthology.orchestra.run.smithi088.stdout: "election_strategy": 1, 2024-04-26T23:45:18.947 INFO:teuthology.orchestra.run.smithi088.stdout: "disallowed_leaders: ": "", 2024-04-26T23:45:18.947 INFO:teuthology.orchestra.run.smithi088.stdout: "stretch_mode": false, 2024-04-26T23:45:18.948 INFO:teuthology.orchestra.run.smithi088.stdout: "tiebreaker_mon": "", 2024-04-26T23:45:18.948 INFO:teuthology.orchestra.run.smithi088.stdout: "removed_ranks: ": "", 2024-04-26T23:45:18.948 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2024-04-26T23:45:18.948 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2024-04-26T23:45:18.948 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-04-26T23:45:18.948 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-04-26T23:45:18.948 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-04-26T23:45:18.948 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-04-26T23:45:18.948 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-04-26T23:45:18.948 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-04-26T23:45:18.948 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-04-26T23:45:18.948 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-04-26T23:45:18.948 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-04-26T23:45:18.948 INFO:teuthology.orchestra.run.smithi088.stdout: "reef", 2024-04-26T23:45:18.948 INFO:teuthology.orchestra.run.smithi088.stdout: "squid" 2024-04-26T23:45:18.949 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:45:18.949 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2024-04-26T23:45:18.949 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:45:18.949 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2024-04-26T23:45:18.949 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:45:18.949 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2024-04-26T23:45:18.949 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2024-04-26T23:45:18.949 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-04-26T23:45:18.949 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-04-26T23:45:18.949 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:45:18.949 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-04-26T23:45:18.949 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2024-04-26T23:45:18.949 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:45:18.949 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:45:18.950 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:45:18.950 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-04-26T23:45:18.950 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2024-04-26T23:45:18.950 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:45:18.950 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:45:18.950 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:45:18.950 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:45:18.950 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2024-04-26T23:45:18.950 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2024-04-26T23:45:18.951 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-04-26T23:45:18.951 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-04-26T23:45:18.951 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-04-26T23:45:18.951 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:45:18.951 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:45:18.951 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2024-04-26T23:45:18.951 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2024-04-26T23:45:18.951 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-04-26T23:45:18.951 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-04-26T23:45:18.951 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:45:18.951 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-04-26T23:45:18.952 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:3300", 2024-04-26T23:45:18.952 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:45:18.952 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:45:18.952 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:45:18.952 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-04-26T23:45:18.952 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6789", 2024-04-26T23:45:18.952 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:45:18.952 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:45:18.952 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:45:18.952 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:45:18.952 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6789/0", 2024-04-26T23:45:18.952 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.175:6789/0", 2024-04-26T23:45:18.952 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-04-26T23:45:18.953 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-04-26T23:45:18.953 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-04-26T23:45:18.953 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:45:18.953 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:45:18.953 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2024-04-26T23:45:18.953 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2024-04-26T23:45:18.953 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-04-26T23:45:18.953 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-04-26T23:45:18.953 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:45:18.953 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-04-26T23:45:18.953 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:3301", 2024-04-26T23:45:18.953 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:45:18.954 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:45:18.954 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:45:18.954 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-04-26T23:45:18.954 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6790", 2024-04-26T23:45:18.954 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:45:18.954 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:45:18.954 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:45:18.954 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:45:18.954 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6790/0", 2024-04-26T23:45:18.954 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.175:6790/0", 2024-04-26T23:45:18.954 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-04-26T23:45:18.954 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-04-26T23:45:18.954 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-04-26T23:45:18.955 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:45:18.955 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:45:18.955 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:45:18.955 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2024-04-26T23:45:18.955 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2024-04-26T23:45:18.955 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:45:18.955 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:45:18.955 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:45:18.955 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2024-04-26T23:45:18.955 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:45:18.955 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:45:18.955 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2024-04-26T23:45:18.955 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:45:18.956 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:45:18.956 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:45:18.956 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2024-04-26T23:45:18.956 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:45:18.956 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:45:18.956 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:45:18.956 INFO:teuthology.orchestra.run.smithi088.stdout: "stretch_mode": false 2024-04-26T23:45:18.956 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-04-26T23:45:18.957 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.934+0000 7f4171ffb640 1 -- 172.21.15.88:0/1069523387 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f416c06c8f0 msgr2=0x7f416c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:18.957 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.934+0000 7f4171ffb640 1 --2- 172.21.15.88:0/1069523387 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f416c06c8f0 0x7f416c06edb0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f4188069b60 tx=0x7f418806ae60 comp rx=0 tx=0).stop 2024-04-26T23:45:18.958 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.934+0000 7f4187fff640 1 -- 172.21.15.88:0/1069523387 reap_dead start 2024-04-26T23:45:18.958 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.935+0000 7f4171ffb640 1 -- 172.21.15.88:0/1069523387 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f418004b110 msgr2=0x7f41800449d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:18.958 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.935+0000 7f4171ffb640 1 --2- 172.21.15.88:0/1069523387 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f418004b110 0x7f41800449d0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f417c009bc0 tx=0x7f417c0046c0 comp rx=0 tx=0).stop 2024-04-26T23:45:18.958 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.936+0000 7f4171ffb640 1 -- 172.21.15.88:0/1069523387 shutdown_connections 2024-04-26T23:45:18.958 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.936+0000 7f4171ffb640 1 --2- 172.21.15.88:0/1069523387 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f418004b110 0x7f41800449d0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:18.958 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.937+0000 7f4171ffb640 1 -- 172.21.15.88:0/1069523387 >> 172.21.15.88:0/1069523387 conn(0x7f4180048250 msgr2=0x7f418004a840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:18.958 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.937+0000 7f4171ffb640 1 -- 172.21.15.88:0/1069523387 shutdown_connections 2024-04-26T23:45:18.958 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:18.937+0000 7f4171ffb640 1 -- 172.21.15.88:0/1069523387 wait complete. 2024-04-26T23:45:18.969 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-04-26T23:45:18.970 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2024-04-26T23:45:18.970 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2024-04-26T23:45:19.161 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:19.158+0000 7ff448927640 1 Processor -- start 2024-04-26T23:45:19.162 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:19.158+0000 7ff448927640 1 -- start start 2024-04-26T23:45:19.164 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:19.159+0000 7ff448927640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7ff43c04a9e0 0x7ff43c007bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:19.164 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:19.159+0000 7ff448927640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ff43c047240 0x7ff43c04adc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:19.164 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:19.160+0000 7ff448927640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff43c04a250 con 0x7ff43c0db000 2024-04-26T23:45:19.164 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:19.160+0000 7ff448927640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7ff43c04ba30 con 0x7ff43c047240 2024-04-26T23:45:19.164 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:19.160+0000 7ff448927640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7ff43c04c5d0 con 0x7ff43c04a9e0 2024-04-26T23:45:19.165 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:19.160+0000 7ff442ffd640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ff43c047240 0x7ff43c04adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:19.165 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:19.160+0000 7ff442ffd640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ff43c047240 0x7ff43c04adc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:49416/0 (socket says 172.21.15.88:49416) 2024-04-26T23:45:19.165 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:19.160+0000 7ff442ffd640 1 -- 172.21.15.88:0/2507905126 learned_addr learned my addr 172.21.15.88:0/2507905126 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:45:19.165 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:19.160+0000 7ff4437fe640 1 --2- 172.21.15.88:0/2507905126 >> v2:172.21.15.175:3300/0 conn(0x7ff43c04a9e0 0x7ff43c007bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:19.165 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:19.161+0000 7ff442ffd640 1 -- 172.21.15.88:0/2507905126 >> v2:172.21.15.175:3300/0 conn(0x7ff43c04a9e0 msgr2=0x7ff43c007bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:45:19.165 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:19.161+0000 7ff442ffd640 1 --2- 172.21.15.88:0/2507905126 >> v2:172.21.15.175:3300/0 conn(0x7ff43c04a9e0 0x7ff43c007bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:19.165 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:19.161+0000 7ff442ffd640 1 -- 172.21.15.88:0/2507905126 >> v1:172.21.15.88:6789/0 conn(0x7ff43c0db000 legacy=0x7ff43c04bec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:19.166 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:19.161+0000 7ff442ffd640 1 -- 172.21.15.88:0/2507905126 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff43c0476d0 con 0x7ff43c047240 2024-04-26T23:45:19.166 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:19.162+0000 7ff4437fe640 1 --2- 172.21.15.88:0/2507905126 >> v2:172.21.15.175:3300/0 conn(0x7ff43c04a9e0 0x7ff43c007bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:45:19.166 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:19.162+0000 7ff442ffd640 1 --2- 172.21.15.88:0/2507905126 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff43c047240 0x7ff43c04adc0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7ff44406bd80 tx=0x7ff4440a9150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58a7d1cd00dfedcb server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:19.166 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:19.163+0000 7ff4427fc640 1 -- 172.21.15.88:0/2507905126 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4440a9a90 con 0x7ff43c047240 2024-04-26T23:45:19.166 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:19.163+0000 7ff4427fc640 1 -- 172.21.15.88:0/2507905126 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4440a9c70 con 0x7ff43c047240 2024-04-26T23:45:19.167 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:19.164+0000 7ff448927640 1 -- 172.21.15.88:0/2507905126 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff43c047240 msgr2=0x7ff43c04adc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:19.167 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:19.164+0000 7ff448927640 1 --2- 172.21.15.88:0/2507905126 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff43c047240 0x7ff43c04adc0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7ff44406bd80 tx=0x7ff4440a9150 comp rx=0 tx=0).stop 2024-04-26T23:45:19.171 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:19.167+0000 7ff448927640 1 -- 172.21.15.88:0/2507905126 shutdown_connections 2024-04-26T23:45:19.171 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:19.167+0000 7ff448927640 1 --2- 172.21.15.88:0/2507905126 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff43c047240 0x7ff43c04adc0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:19.171 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:19.167+0000 7ff448927640 1 --2- 172.21.15.88:0/2507905126 >> v2:172.21.15.175:3300/0 conn(0x7ff43c04a9e0 0x7ff43c007bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:19.171 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:19.167+0000 7ff448927640 1 -- 172.21.15.88:0/2507905126 >> 172.21.15.88:0/2507905126 conn(0x7ff43c049340 msgr2=0x7ff43c049750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:19.172 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:19.169+0000 7ff448927640 1 -- 172.21.15.88:0/2507905126 shutdown_connections 2024-04-26T23:45:19.175 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:19.169+0000 7ff448927640 1 -- 172.21.15.88:0/2507905126 wait complete. 2024-04-26T23:45:19.175 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:19.170+0000 7ff448927640 1 Processor -- start 2024-04-26T23:45:19.175 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:19.171+0000 7ff448927640 1 -- start start 2024-04-26T23:45:19.175 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:19.172+0000 7ff448927640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff43c04a9e0 0x7ff43c0072c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:19.175 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:19.172+0000 7ff448927640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff43c0db000 0x7ff43c0ca0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:19.175 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:19.172+0000 7ff448927640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff43c0ca630 0x7ff43c0d0420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:19.176 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:19.172+0000 7ff448927640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7ff43c047c90 con 0x7ff43c0ca630 2024-04-26T23:45:19.176 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:19.172+0000 7ff448927640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff43c04b6c0 con 0x7ff43c0db000 2024-04-26T23:45:19.176 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:19.172+0000 7ff448927640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7ff43c0db470 con 0x7ff43c04a9e0 2024-04-26T23:45:19.177 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:19.172+0000 7ff442ffd640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff43c0db000 0x7ff43c0ca0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:19.177 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:19.172+0000 7ff442ffd640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff43c0db000 0x7ff43c0ca0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.88:38400/0 (socket says 172.21.15.88:38400) 2024-04-26T23:45:19.177 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:19.172+0000 7ff442ffd640 1 -- 172.21.15.88:0/1458849220 learned_addr learned my addr 172.21.15.88:0/1458849220 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:45:19.177 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:19.172+0000 7ff4437fe640 1 --2- 172.21.15.88:0/1458849220 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff43c04a9e0 0x7ff43c0072c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:19.177 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:19.172+0000 7ff443fff640 1 --2- 172.21.15.88:0/1458849220 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff43c0ca630 0x7ff43c0d0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:19.177 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:19.173+0000 7ff442ffd640 1 -- 172.21.15.88:0/1458849220 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff43c04a9e0 msgr2=0x7ff43c0072c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:19.177 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:19.173+0000 7ff442ffd640 1 --2- 172.21.15.88:0/1458849220 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff43c04a9e0 0x7ff43c0072c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:19.177 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:19.173+0000 7ff442ffd640 1 -- 172.21.15.88:0/1458849220 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff43c0ca630 msgr2=0x7ff43c0d0420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:19.177 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:19.173+0000 7ff442ffd640 1 --2- 172.21.15.88:0/1458849220 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff43c0ca630 0x7ff43c0d0420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:19.177 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:19.173+0000 7ff442ffd640 1 -- 172.21.15.88:0/1458849220 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff43c0da550 con 0x7ff43c0db000 2024-04-26T23:45:19.178 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:19.173+0000 7ff442ffd640 1 --2- 172.21.15.88:0/1458849220 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff43c0db000 0x7ff43c0ca0f0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7ff444051fc0 tx=0x7ff44406b850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:19.179 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:19.174+0000 7ff42ffff640 1 -- 172.21.15.88:0/1458849220 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4440c0070 con 0x7ff43c0db000 2024-04-26T23:45:19.179 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:19.174+0000 7ff42ffff640 1 -- 172.21.15.88:0/1458849220 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4440b1870 con 0x7ff43c0db000 2024-04-26T23:45:19.179 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:19.174+0000 7ff42ffff640 1 -- 172.21.15.88:0/1458849220 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4440b7050 con 0x7ff43c0db000 2024-04-26T23:45:19.179 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:19.174+0000 7ff448927640 1 -- 172.21.15.88:0/1458849220 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff43c009390 con 0x7ff43c0db000 2024-04-26T23:45:19.179 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:19.174+0000 7ff448927640 1 -- 172.21.15.88:0/1458849220 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff43c174a70 con 0x7ff43c0db000 2024-04-26T23:45:19.180 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:19.177+0000 7ff42ffff640 1 -- 172.21.15.88:0/1458849220 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff4440b1c20 con 0x7ff43c0db000 2024-04-26T23:45:19.180 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:19.177+0000 7ff42ffff640 1 --2- 172.21.15.88:0/1458849220 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7ff42806c8f0 0x7ff42806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:19.182 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:19.178+0000 7ff42ffff640 1 -- 172.21.15.88:0/1458849220 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6666+0+0 (secure 0 0 0) 0x7ff444128db0 con 0x7ff43c0db000 2024-04-26T23:45:19.182 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:19.179+0000 7ff4437fe640 1 --2- 172.21.15.88:0/1458849220 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7ff42806c8f0 0x7ff42806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:19.182 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:19.179+0000 7ff448927640 1 -- 172.21.15.88:0/1458849220 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff43c0057e0 con 0x7ff43c0db000 2024-04-26T23:45:19.184 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:19.181+0000 7ff4437fe640 1 --2- 172.21.15.88:0/1458849220 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7ff42806c8f0 0x7ff42806edb0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7ff438006b10 tx=0x7ff438008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:19.194 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:19.191+0000 7ff42ffff640 1 -- 172.21.15.88:0/1458849220 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7ff4440a9e20 con 0x7ff43c0db000 2024-04-26T23:45:19.726 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:19.722+0000 7ff448927640 1 -- 172.21.15.88:0/1458849220 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7ff43c02c180 con 0x7ff43c0db000 2024-04-26T23:45:19.742 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:19.737+0000 7ff42ffff640 1 -- 172.21.15.88:0/1458849220 <== mon.1 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (secure 0 0 0) 0x7ff4440a9c40 con 0x7ff43c0db000 2024-04-26T23:45:19.746 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:19.742+0000 7ff448927640 1 -- 172.21.15.88:0/1458849220 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7ff42806c8f0 msgr2=0x7ff42806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:19.746 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:19.742+0000 7ff448927640 1 --2- 172.21.15.88:0/1458849220 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7ff42806c8f0 0x7ff42806edb0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7ff438006b10 tx=0x7ff438008040 comp rx=0 tx=0).stop 2024-04-26T23:45:19.746 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:19.742+0000 7ff448927640 1 -- 172.21.15.88:0/1458849220 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff43c0db000 msgr2=0x7ff43c0ca0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:19.746 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:19.742+0000 7ff448927640 1 --2- 172.21.15.88:0/1458849220 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff43c0db000 0x7ff43c0ca0f0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7ff444051fc0 tx=0x7ff44406b850 comp rx=0 tx=0).stop 2024-04-26T23:45:19.747 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:19.742+0000 7ff448927640 1 -- 172.21.15.88:0/1458849220 shutdown_connections 2024-04-26T23:45:19.747 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:19.742+0000 7ff448927640 1 --2- 172.21.15.88:0/1458849220 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7ff42806c8f0 0x7ff42806edb0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:19.747 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:19.742+0000 7ff448927640 1 --2- 172.21.15.88:0/1458849220 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff43c0ca630 0x7ff43c0d0420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:19.747 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:19.742+0000 7ff448927640 1 --2- 172.21.15.88:0/1458849220 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff43c0db000 0x7ff43c0ca0f0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:19.747 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:19.742+0000 7ff448927640 1 --2- 172.21.15.88:0/1458849220 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff43c04a9e0 0x7ff43c0072c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:19.747 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:19.742+0000 7ff448927640 1 -- 172.21.15.88:0/1458849220 >> 172.21.15.88:0/1458849220 conn(0x7ff43c049340 msgr2=0x7ff43c0ce020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:19.747 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:19.743+0000 7ff448927640 1 -- 172.21.15.88:0/1458849220 shutdown_connections 2024-04-26T23:45:19.747 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:19.743+0000 7ff448927640 1 -- 172.21.15.88:0/1458849220 wait complete. 2024-04-26T23:45:19.771 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2024-04-26T23:45:29.772 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-04-26T23:45:29.773 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-04-26T23:45:29.957 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:29.951+0000 7f6d0d78e640 1 Processor -- start 2024-04-26T23:45:29.957 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:29.951+0000 7f6d0d78e640 1 -- start start 2024-04-26T23:45:29.957 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:29.952+0000 7f6d0d78e640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f6d080b1b90 0x7f6d0815b890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:29.957 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:29.952+0000 7f6d0d78e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6d08073940 0x7f6d08073dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:29.957 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:29.952+0000 7f6d0d78e640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f6d080ca820 0x7f6d080cac70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:29.957 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:29.952+0000 7f6d0d78e640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f6d080c1b40 con 0x7f6d080b1b90 2024-04-26T23:45:29.958 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:29.952+0000 7f6d0d78e640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f6d0815bdd0 con 0x7f6d080ca820 2024-04-26T23:45:29.958 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:29.952+0000 7f6d0d78e640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f6d080c12a0 con 0x7f6d08073940 2024-04-26T23:45:29.958 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:29.952+0000 7f6d07fff640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f6d080b1b90 0x7f6d0815b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:29.958 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:29.953+0000 7f6d07fff640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f6d080b1b90 0x7f6d0815b890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:42240/0 (socket says 172.21.15.88:42240) 2024-04-26T23:45:29.958 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:29.953+0000 7f6d07fff640 1 -- 172.21.15.88:0/4261924969 learned_addr learned my addr 172.21.15.88:0/4261924969 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:45:29.958 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:29.953+0000 7f6d0cf8d640 1 --2- 172.21.15.88:0/4261924969 >> v2:172.21.15.175:3300/0 conn(0x7f6d080ca820 0x7f6d080cac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:29.958 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:29.953+0000 7f6d077fe640 1 --2- 172.21.15.88:0/4261924969 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6d08073940 0x7f6d08073dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:29.958 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:29.953+0000 7f6d07fff640 1 -- 172.21.15.88:0/4261924969 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6d08073940 msgr2=0x7f6d08073dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:45:29.958 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:29.953+0000 7f6d07fff640 1 --2- 172.21.15.88:0/4261924969 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6d08073940 0x7f6d08073dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:29.959 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:29.953+0000 7f6d07fff640 1 -- 172.21.15.88:0/4261924969 >> v2:172.21.15.175:3300/0 conn(0x7f6d080ca820 msgr2=0x7f6d080cac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:45:29.959 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:29.953+0000 7f6d07fff640 1 --2- 172.21.15.88:0/4261924969 >> v2:172.21.15.175:3300/0 conn(0x7f6d080ca820 0x7f6d080cac70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:29.959 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:29.953+0000 7f6d07fff640 1 -- 172.21.15.88:0/4261924969 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d080c1580 con 0x7f6d080b1b90 2024-04-26T23:45:29.959 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:29.954+0000 7f6d07fff640 1 --2- 172.21.15.88:0/4261924969 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6d080b1b90 0x7f6d0815b890 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f6d080c2e40 tx=0x7f6d0002a8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4e73b647e3f557c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:29.959 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:29.955+0000 7f6d06ffd640 1 -- 172.21.15.88:0/4261924969 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d000090d0 con 0x7f6d080b1b90 2024-04-26T23:45:29.960 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:29.955+0000 7f6d06ffd640 1 -- 172.21.15.88:0/4261924969 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d000313f0 con 0x7f6d080b1b90 2024-04-26T23:45:29.960 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:29.955+0000 7f6d06ffd640 1 -- 172.21.15.88:0/4261924969 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d00009270 con 0x7f6d080b1b90 2024-04-26T23:45:29.960 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:29.956+0000 7f6d0d78e640 1 -- 172.21.15.88:0/4261924969 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6d080b1b90 msgr2=0x7f6d0815b890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:29.961 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:29.956+0000 7f6d0d78e640 1 --2- 172.21.15.88:0/4261924969 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6d080b1b90 0x7f6d0815b890 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f6d080c2e40 tx=0x7f6d0002a8a0 comp rx=0 tx=0).stop 2024-04-26T23:45:29.962 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:29.958+0000 7f6d0d78e640 1 -- 172.21.15.88:0/4261924969 shutdown_connections 2024-04-26T23:45:29.962 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:29.958+0000 7f6d0d78e640 1 --2- 172.21.15.88:0/4261924969 >> v2:172.21.15.175:3300/0 conn(0x7f6d080ca820 0x7f6d080cac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:29.962 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:29.958+0000 7f6d0d78e640 1 --2- 172.21.15.88:0/4261924969 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6d08073940 0x7f6d08073dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:29.962 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:29.958+0000 7f6d0d78e640 1 --2- 172.21.15.88:0/4261924969 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6d080b1b90 0x7f6d0815b890 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:29.962 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:29.958+0000 7f6d0d78e640 1 -- 172.21.15.88:0/4261924969 >> 172.21.15.88:0/4261924969 conn(0x7f6d080c8de0 msgr2=0x7f6d080c91f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:29.962 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:29.958+0000 7f6d0d78e640 1 -- 172.21.15.88:0/4261924969 shutdown_connections 2024-04-26T23:45:29.963 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:29.958+0000 7f6d0d78e640 1 -- 172.21.15.88:0/4261924969 wait complete. 2024-04-26T23:45:29.966 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:29.961+0000 7f6d0d78e640 1 Processor -- start 2024-04-26T23:45:29.966 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:29.961+0000 7f6d0d78e640 1 -- start start 2024-04-26T23:45:29.966 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:29.962+0000 7f6d0d78e640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6d08073940 0x7f6d0815fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:29.967 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:29.962+0000 7f6d0d78e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6d080b1b90 0x7f6d08148270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:29.967 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:29.962+0000 7f6d0d78e640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6d080ca820 0x7f6d081fc5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:29.967 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:29.962+0000 7f6d0cf8d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6d080ca820 0x7f6d081fc5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:29.967 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:29.962+0000 7f6d07fff640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6d08073940 0x7f6d0815fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:29.967 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:29.962+0000 7f6d07fff640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6d08073940 0x7f6d0815fd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.88:42196/0 (socket says 172.21.15.88:42196) 2024-04-26T23:45:29.967 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:29.962+0000 7f6d0cf8d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6d080ca820 0x7f6d081fc5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:42244/0 (socket says 172.21.15.88:42244) 2024-04-26T23:45:29.967 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:29.962+0000 7f6d07fff640 1 -- 172.21.15.88:0/751363109 learned_addr learned my addr 172.21.15.88:0/751363109 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:45:29.967 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:29.962+0000 7f6d0d78e640 1 -- 172.21.15.88:0/751363109 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f6d080cb1b0 con 0x7f6d080ca820 2024-04-26T23:45:29.967 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:29.962+0000 7f6d0d78e640 1 -- 172.21.15.88:0/751363109 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f6d080ca300 con 0x7f6d08073940 2024-04-26T23:45:29.967 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:29.962+0000 7f6d077fe640 1 --2- 172.21.15.88:0/751363109 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6d080b1b90 0x7f6d08148270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:29.967 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:29.962+0000 7f6d0d78e640 1 -- 172.21.15.88:0/751363109 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f6d080cc0a0 con 0x7f6d080b1b90 2024-04-26T23:45:29.968 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:29.963+0000 7f6d0cf8d640 1 -- 172.21.15.88:0/751363109 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6d080b1b90 msgr2=0x7f6d08148270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:29.968 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:29.963+0000 7f6d0cf8d640 1 --2- 172.21.15.88:0/751363109 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6d080b1b90 0x7f6d08148270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:29.968 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:29.963+0000 7f6d0cf8d640 1 -- 172.21.15.88:0/751363109 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6d08073940 msgr2=0x7f6d0815fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:29.968 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:29.963+0000 7f6d0cf8d640 1 --2- 172.21.15.88:0/751363109 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6d08073940 0x7f6d0815fd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:29.968 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:29.963+0000 7f6d0cf8d640 1 -- 172.21.15.88:0/751363109 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d081fd150 con 0x7f6d080ca820 2024-04-26T23:45:29.968 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:29.964+0000 7f6d0cf8d640 1 --2- 172.21.15.88:0/751363109 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6d080ca820 0x7f6d081fc5a0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f6cf800d800 tx=0x7f6cf800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:29.970 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:29.966+0000 7f6d04ff9640 1 -- 172.21.15.88:0/751363109 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cf8004020 con 0x7f6d080ca820 2024-04-26T23:45:29.970 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:29.966+0000 7f6d04ff9640 1 -- 172.21.15.88:0/751363109 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6cf80041c0 con 0x7f6d080ca820 2024-04-26T23:45:29.970 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:29.966+0000 7f6d0d78e640 1 -- 172.21.15.88:0/751363109 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d081fd3f0 con 0x7f6d080ca820 2024-04-26T23:45:29.971 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:29.967+0000 7f6d0d78e640 1 -- 172.21.15.88:0/751363109 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d08164470 con 0x7f6d080ca820 2024-04-26T23:45:29.972 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:29.967+0000 7f6d04ff9640 1 -- 172.21.15.88:0/751363109 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cf8004390 con 0x7f6d080ca820 2024-04-26T23:45:29.974 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:29.970+0000 7f6d04ff9640 1 -- 172.21.15.88:0/751363109 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6cf801b020 con 0x7f6d080ca820 2024-04-26T23:45:29.975 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:29.971+0000 7f6d04ff9640 1 --2- 172.21.15.88:0/751363109 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f6cf406c940 0x7f6cf406ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:29.975 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:29.971+0000 7f6d04ff9640 1 -- 172.21.15.88:0/751363109 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6666+0+0 (secure 0 0 0) 0x7f6cf808b880 con 0x7f6d080ca820 2024-04-26T23:45:29.975 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:29.971+0000 7f6d0d78e640 1 -- 172.21.15.88:0/751363109 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ce8005290 con 0x7f6d080ca820 2024-04-26T23:45:29.976 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:29.971+0000 7f6d07fff640 1 --2- 172.21.15.88:0/751363109 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f6cf406c940 0x7f6cf406ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:29.977 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:29.973+0000 7f6d07fff640 1 --2- 172.21.15.88:0/751363109 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f6cf406c940 0x7f6cf406ee00 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f6d00009c90 tx=0x7f6d00009000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:29.987 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:29.983+0000 7f6d04ff9640 1 -- 172.21.15.88:0/751363109 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f6cf8059a60 con 0x7f6d080ca820 2024-04-26T23:45:30.550 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:30.545+0000 7f6d0d78e640 1 -- 172.21.15.88:0/751363109 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f6ce8005580 con 0x7f6d080ca820 2024-04-26T23:45:30.550 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:30.546+0000 7f6d04ff9640 1 -- 172.21.15.88:0/751363109 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1565 (secure 0 0 0) 0x7f6cf8059360 con 0x7f6d080ca820 2024-04-26T23:45:30.551 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":54,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":14,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"555255e9-7ef9-4454-8dc9-35e96b70035c","modified":"2024-04-26T23:39:34.291658Z","created":"2024-04-26T23:39:34.291658Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:3300","nonce":0},{"type":"v1","addr":"172.21.15.175:6789","nonce":0}]},"addr":"172.21.15.175:6789/0","public_addr":"172.21.15.175:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:3301","nonce":0},{"type":"v1","addr":"172.21.15.175:6790","nonce":0}]},"addr":"172.21.15.175:6790/0","public_addr":"172.21.15.175:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-04-26T23:45:30.555 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:30.550+0000 7f6d0d78e640 1 -- 172.21.15.88:0/751363109 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f6cf406c940 msgr2=0x7f6cf406ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:30.555 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:30.550+0000 7f6d0d78e640 1 --2- 172.21.15.88:0/751363109 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f6cf406c940 0x7f6cf406ee00 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f6d00009c90 tx=0x7f6d00009000 comp rx=0 tx=0).stop 2024-04-26T23:45:30.555 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:30.550+0000 7f6d0d78e640 1 -- 172.21.15.88:0/751363109 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6d080ca820 msgr2=0x7f6d081fc5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:30.555 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:30.550+0000 7f6d0d78e640 1 --2- 172.21.15.88:0/751363109 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6d080ca820 0x7f6d081fc5a0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f6cf800d800 tx=0x7f6cf800dcc0 comp rx=0 tx=0).stop 2024-04-26T23:45:30.555 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:30.550+0000 7f6d0d78e640 1 -- 172.21.15.88:0/751363109 shutdown_connections 2024-04-26T23:45:30.555 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:30.550+0000 7f6d0d78e640 1 --2- 172.21.15.88:0/751363109 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f6cf406c940 0x7f6cf406ee00 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:30.555 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:30.550+0000 7f6d0d78e640 1 --2- 172.21.15.88:0/751363109 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6d080b1b90 0x7f6d08148270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:30.555 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:30.550+0000 7f6d0d78e640 1 --2- 172.21.15.88:0/751363109 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6d080ca820 0x7f6d081fc5a0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:30.556 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:30.550+0000 7f6d0d78e640 1 --2- 172.21.15.88:0/751363109 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6d08073940 0x7f6d0815fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:30.556 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:30.550+0000 7f6d0d78e640 1 -- 172.21.15.88:0/751363109 >> 172.21.15.88:0/751363109 conn(0x7f6d080c8de0 msgr2=0x7f6d080acfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:30.556 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:30.551+0000 7f6d0d78e640 1 -- 172.21.15.88:0/751363109 shutdown_connections 2024-04-26T23:45:30.556 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:30.551+0000 7f6d0d78e640 1 -- 172.21.15.88:0/751363109 wait complete. 2024-04-26T23:45:30.570 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-04-26T23:45:30.570 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2024-04-26T23:45:30.570 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-04-26T23:45:30.570 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-04-26T23:45:30.737 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:30.733+0000 7f37c22a8640 1 Processor -- start 2024-04-26T23:45:30.740 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:30.734+0000 7f37c22a8640 1 -- start start 2024-04-26T23:45:30.741 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:30.735+0000 7f37c22a8640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f37bc06e0a0 0x7f37bc15ee70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:30.741 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:30.735+0000 7f37c22a8640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f37bc0709d0 0x7f37bc158180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:30.741 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:30.736+0000 7f37c22a8640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f37bc15e3b0 con 0x7f37bc06d0f0 2024-04-26T23:45:30.741 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:30.736+0000 7f37c22a8640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f37bc15b4d0 con 0x7f37bc06e0a0 2024-04-26T23:45:30.741 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:30.736+0000 7f37c22a8640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f37bc070e60 con 0x7f37bc0709d0 2024-04-26T23:45:30.741 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:30.736+0000 7f37c1aa7640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f37bc0709d0 0x7f37bc158180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:30.741 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:30.736+0000 7f37c1aa7640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f37bc0709d0 0x7f37bc158180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.88:42198/0 (socket says 172.21.15.88:42198) 2024-04-26T23:45:30.741 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:30.736+0000 7f37c1aa7640 1 -- 172.21.15.88:0/174225020 learned_addr learned my addr 172.21.15.88:0/174225020 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:45:30.741 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:30.736+0000 7f37c0aa5640 1 --2- 172.21.15.88:0/174225020 >> v2:172.21.15.88:3300/0 conn(0x7f37bc06e0a0 0x7f37bc15ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:30.742 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:30.737+0000 7f37c1aa7640 1 -- 172.21.15.88:0/174225020 >> v2:172.21.15.88:3300/0 conn(0x7f37bc06e0a0 msgr2=0x7f37bc15ee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:45:30.742 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:30.737+0000 7f37c1aa7640 1 --2- 172.21.15.88:0/174225020 >> v2:172.21.15.88:3300/0 conn(0x7f37bc06e0a0 0x7f37bc15ee70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:30.742 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:30.737+0000 7f37c1aa7640 1 -- 172.21.15.88:0/174225020 >> v1:172.21.15.88:6789/0 conn(0x7f37bc06d0f0 legacy=0x7f37bc15adc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:30.742 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:30.737+0000 7f37c1aa7640 1 -- 172.21.15.88:0/174225020 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37bc06e610 con 0x7f37bc0709d0 2024-04-26T23:45:30.742 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:30.738+0000 7f37c1aa7640 1 --2- 172.21.15.88:0/174225020 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f37bc0709d0 0x7f37bc158180 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f37bc06f5a0 tx=0x7f37b402a6b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=17be1db626295443 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:30.743 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:30.738+0000 7f37b3fff640 1 -- 172.21.15.88:0/174225020 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37b4036070 con 0x7f37bc0709d0 2024-04-26T23:45:30.743 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:30.738+0000 7f37b3fff640 1 -- 172.21.15.88:0/174225020 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37b4031600 con 0x7f37bc0709d0 2024-04-26T23:45:30.743 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:30.738+0000 7f37b3fff640 1 -- 172.21.15.88:0/174225020 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37b40319d0 con 0x7f37bc0709d0 2024-04-26T23:45:30.743 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:30.739+0000 7f37c22a8640 1 -- 172.21.15.88:0/174225020 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f37bc0709d0 msgr2=0x7f37bc158180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:30.743 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:30.739+0000 7f37c22a8640 1 --2- 172.21.15.88:0/174225020 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f37bc0709d0 0x7f37bc158180 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f37bc06f5a0 tx=0x7f37b402a6b0 comp rx=0 tx=0).stop 2024-04-26T23:45:30.744 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:30.740+0000 7f37c22a8640 1 -- 172.21.15.88:0/174225020 shutdown_connections 2024-04-26T23:45:30.744 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:30.740+0000 7f37c22a8640 1 --2- 172.21.15.88:0/174225020 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f37bc0709d0 0x7f37bc158180 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:30.744 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:30.740+0000 7f37c22a8640 1 --2- 172.21.15.88:0/174225020 >> v2:172.21.15.88:3300/0 conn(0x7f37bc06e0a0 0x7f37bc15ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:30.744 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:30.740+0000 7f37c22a8640 1 -- 172.21.15.88:0/174225020 >> 172.21.15.88:0/174225020 conn(0x7f37bc06c310 msgr2=0x7f37bc06c720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:30.745 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:30.741+0000 7f37c22a8640 1 -- 172.21.15.88:0/174225020 shutdown_connections 2024-04-26T23:45:30.745 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:30.741+0000 7f37c22a8640 1 -- 172.21.15.88:0/174225020 wait complete. 2024-04-26T23:45:30.747 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:30.743+0000 7f37c22a8640 1 Processor -- start 2024-04-26T23:45:30.747 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:30.743+0000 7f37c22a8640 1 -- start start 2024-04-26T23:45:30.749 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:30.744+0000 7f37c22a8640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f37bc06d0f0 0x7f37bc0adef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:30.749 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:30.744+0000 7f37c22a8640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f37bc06e0a0 0x7f37bc1581c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:30.749 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:30.744+0000 7f37c12a6640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f37bc06d0f0 0x7f37bc0adef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:30.749 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:30.744+0000 7f37c0aa5640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f37bc06e0a0 0x7f37bc1581c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:30.749 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:30.744+0000 7f37c0aa5640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f37bc06e0a0 0x7f37bc1581c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:42262/0 (socket says 172.21.15.88:42262) 2024-04-26T23:45:30.749 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:30.744+0000 7f37c0aa5640 1 -- 172.21.15.88:0/1274551941 learned_addr learned my addr 172.21.15.88:0/1274551941 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:45:30.749 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:30.745+0000 7f37c22a8640 1 --2- 172.21.15.88:0/1274551941 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f37bc0709d0 0x7f37bc1fca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:30.750 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:30.745+0000 7f37c22a8640 1 -- 172.21.15.88:0/1274551941 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f37bc15e950 con 0x7f37bc06e0a0 2024-04-26T23:45:30.750 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:30.745+0000 7f37c22a8640 1 -- 172.21.15.88:0/1274551941 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f37bc15e670 con 0x7f37bc0709d0 2024-04-26T23:45:30.750 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:30.745+0000 7f37c1aa7640 1 --2- 172.21.15.88:0/1274551941 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f37bc0709d0 0x7f37bc1fca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:30.750 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:30.745+0000 7f37c22a8640 1 -- 172.21.15.88:0/1274551941 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f37bc06d4d0 con 0x7f37bc06d0f0 2024-04-26T23:45:30.751 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:30.746+0000 7f37c0aa5640 1 -- 172.21.15.88:0/1274551941 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f37bc06d0f0 msgr2=0x7f37bc0adef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:30.751 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:30.746+0000 7f37c0aa5640 1 --2- 172.21.15.88:0/1274551941 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f37bc06d0f0 0x7f37bc0adef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:30.751 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:30.746+0000 7f37c0aa5640 1 -- 172.21.15.88:0/1274551941 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f37bc0709d0 msgr2=0x7f37bc1fca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:30.751 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:30.746+0000 7f37c0aa5640 1 --2- 172.21.15.88:0/1274551941 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f37bc0709d0 0x7f37bc1fca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:30.751 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:30.746+0000 7f37c0aa5640 1 -- 172.21.15.88:0/1274551941 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37bc15b0f0 con 0x7f37bc06e0a0 2024-04-26T23:45:30.751 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:30.746+0000 7f37c1aa7640 1 --2- 172.21.15.88:0/1274551941 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f37bc0709d0 0x7f37bc1fca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:45:30.751 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:30.746+0000 7f37c0aa5640 1 --2- 172.21.15.88:0/1274551941 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f37bc06e0a0 0x7f37bc1581c0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f37b800e9b0 tx=0x7f37b800ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:30.752 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:30.747+0000 7f37b1ffb640 1 -- 172.21.15.88:0/1274551941 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37b8017070 con 0x7f37bc06e0a0 2024-04-26T23:45:30.752 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:30.748+0000 7f37b1ffb640 1 -- 172.21.15.88:0/1274551941 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37b800c9a0 con 0x7f37bc06e0a0 2024-04-26T23:45:30.752 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:30.748+0000 7f37b1ffb640 1 -- 172.21.15.88:0/1274551941 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37b800cd90 con 0x7f37bc06e0a0 2024-04-26T23:45:30.752 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:30.748+0000 7f37c22a8640 1 -- 172.21.15.88:0/1274551941 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37bc0c3320 con 0x7f37bc06e0a0 2024-04-26T23:45:30.753 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:30.748+0000 7f37c22a8640 1 -- 172.21.15.88:0/1274551941 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37bc158700 con 0x7f37bc06e0a0 2024-04-26T23:45:30.753 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:30.749+0000 7f37c22a8640 1 --2- 172.21.15.88:0/1274551941 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f37bc0ad7f0 0x7f37bc13ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:30.754 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:30.749+0000 7f37c12a6640 1 --2- 172.21.15.88:0/1274551941 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f37bc0ad7f0 0x7f37bc13ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:30.754 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:30.750+0000 7f37c22a8640 1 -- 172.21.15.88:0/1274551941 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f37bc15ac00 con 0x7f37bc0ad7f0 2024-04-26T23:45:30.754 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:30.750+0000 7f37c12a6640 1 -- 172.21.15.88:0/1274551941 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f37bc0506c0 con 0x7f37bc0ad7f0 2024-04-26T23:45:30.755 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:30.751+0000 7f37c12a6640 1 --2- 172.21.15.88:0/1274551941 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f37bc0ad7f0 0x7f37bc13ebb0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f37ac00e400 tx=0x7f37ac00e8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:30.755 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:30.751+0000 7f37b1ffb640 1 -- 172.21.15.88:0/1274551941 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f37b801a070 con 0x7f37bc06e0a0 2024-04-26T23:45:30.755 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:30.751+0000 7f37b1ffb640 1 --2- 172.21.15.88:0/1274551941 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f37a006c940 0x7f37a006ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:30.755 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:30.751+0000 7f37c1aa7640 1 --2- 172.21.15.88:0/1274551941 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f37a006c940 0x7f37a006ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:30.757 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:30.752+0000 7f37b1ffb640 1 -- 172.21.15.88:0/1274551941 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6666+0+0 (secure 0 0 0) 0x7f37b808c1b0 con 0x7f37bc06e0a0 2024-04-26T23:45:30.757 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:30.752+0000 7f37c1aa7640 1 --2- 172.21.15.88:0/1274551941 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f37a006c940 0x7f37a006ee00 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f37b4033000 tx=0x7f37b4009000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:30.757 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:30.752+0000 7f37b1ffb640 1 -- 172.21.15.88:0/1274551941 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37ac018070 con 0x7f37bc0ad7f0 2024-04-26T23:45:30.757 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:30.752+0000 7f37b1ffb640 1 -- 172.21.15.88:0/1274551941 <== mon.0 v2:172.21.15.88:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f37ac0052e0 con 0x7f37bc0ad7f0 2024-04-26T23:45:30.757 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:30.753+0000 7f37b1ffb640 1 -- 172.21.15.88:0/1274551941 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f37bc0ad7f0 msgr2=0x7f37bc13ebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:30.757 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:30.753+0000 7f37b1ffb640 1 --2- 172.21.15.88:0/1274551941 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f37bc0ad7f0 0x7f37bc13ebb0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f37ac00e400 tx=0x7f37ac00e8c0 comp rx=0 tx=0).stop 2024-04-26T23:45:30.758 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:30.753+0000 7f37b1ffb640 1 -- 172.21.15.88:0/1274551941 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f37bc0ad7f0 msgr2=0x7f37bc13ebb0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:45:30.758 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:30.753+0000 7f37b1ffb640 1 --2- 172.21.15.88:0/1274551941 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f37bc0ad7f0 0x7f37bc13ebb0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:30.768 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:30.764+0000 7f37c22a8640 1 --2- 172.21.15.88:0/1274551941 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f37bc141c50 0x7f37bc13f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:30.768 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:30.764+0000 7f37c22a8640 1 -- 172.21.15.88:0/1274551941 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f37bc13f630 con 0x7f37bc141c50 2024-04-26T23:45:30.769 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:30.764+0000 7f37c12a6640 1 --2- 172.21.15.88:0/1274551941 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f37bc141c50 0x7f37bc13f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:30.769 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:30.765+0000 7f37c12a6640 1 -- 172.21.15.88:0/1274551941 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f37bc147a00 con 0x7f37bc141c50 2024-04-26T23:45:30.769 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:30.765+0000 7f37c12a6640 1 --2- 172.21.15.88:0/1274551941 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f37bc141c50 0x7f37bc13f0f0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f37ac00e400 tx=0x7f37ac001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:30.769 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:30.765+0000 7f37b1ffb640 1 -- 172.21.15.88:0/1274551941 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37ac018030 con 0x7f37bc141c50 2024-04-26T23:45:30.770 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:30.766+0000 7f37b1ffb640 1 -- 172.21.15.88:0/1274551941 <== mon.0 v2:172.21.15.88:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4727 (secure 0 0 0) 0x7f37ac0069e0 con 0x7f37bc141c50 2024-04-26T23:45:30.770 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:30.766+0000 7f37b1ffb640 1 -- 172.21.15.88:0/1274551941 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f37bc141c50 msgr2=0x7f37bc13f0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:30.770 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:30.766+0000 7f37b1ffb640 1 --2- 172.21.15.88:0/1274551941 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f37bc141c50 0x7f37bc13f0f0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f37ac00e400 tx=0x7f37ac001120 comp rx=0 tx=0).stop 2024-04-26T23:45:30.770 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:30.766+0000 7f37b1ffb640 1 -- 172.21.15.88:0/1274551941 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f37bc141c50 msgr2=0x7f37bc13f0f0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:45:30.770 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:30.766+0000 7f37b1ffb640 1 --2- 172.21.15.88:0/1274551941 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f37bc141c50 0x7f37bc13f0f0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:30.771 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-04-26T23:45:30.771 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2024-04-26T23:45:30.771 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2024-04-26T23:45:30.771 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "leader", 2024-04-26T23:45:30.771 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 54, 2024-04-26T23:45:30.771 INFO:teuthology.orchestra.run.smithi088.stdout: "uptime": 39819, 2024-04-26T23:45:30.771 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2024-04-26T23:45:30.771 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2024-04-26T23:45:30.771 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2024-04-26T23:45:30.772 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2024-04-26T23:45:30.772 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:45:30.772 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 14, 2024-04-26T23:45:30.772 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2024-04-26T23:45:30.772 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2450521708007866372", 2024-04-26T23:45:30.772 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2024-04-26T23:45:30.772 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-04-26T23:45:30.772 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-04-26T23:45:30.772 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-04-26T23:45:30.772 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-04-26T23:45:30.773 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-04-26T23:45:30.773 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-04-26T23:45:30.773 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-04-26T23:45:30.773 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-04-26T23:45:30.773 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-04-26T23:45:30.773 INFO:teuthology.orchestra.run.smithi088.stdout: "reef", 2024-04-26T23:45:30.773 INFO:teuthology.orchestra.run.smithi088.stdout: "squid" 2024-04-26T23:45:30.773 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:45:30.773 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540701547738038271", 2024-04-26T23:45:30.773 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2024-04-26T23:45:30.773 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-04-26T23:45:30.773 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-04-26T23:45:30.774 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-04-26T23:45:30.774 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-04-26T23:45:30.774 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-04-26T23:45:30.774 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-04-26T23:45:30.774 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-04-26T23:45:30.774 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-04-26T23:45:30.774 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-04-26T23:45:30.774 INFO:teuthology.orchestra.run.smithi088.stdout: "reef", 2024-04-26T23:45:30.774 INFO:teuthology.orchestra.run.smithi088.stdout: "squid" 2024-04-26T23:45:30.774 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:45:30.774 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:45:30.774 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2024-04-26T23:45:30.775 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2024-04-26T23:45:30.775 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2024-04-26T23:45:30.775 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2024-04-26T23:45:30.775 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2024-04-26T23:45:30.775 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "555255e9-7ef9-4454-8dc9-35e96b70035c", 2024-04-26T23:45:30.775 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2024-04-26T23:39:34.291658Z", 2024-04-26T23:45:30.775 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2024-04-26T23:39:34.291658Z", 2024-04-26T23:45:30.775 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 19, 2024-04-26T23:45:30.775 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "squid", 2024-04-26T23:45:30.775 INFO:teuthology.orchestra.run.smithi088.stdout: "election_strategy": 1, 2024-04-26T23:45:30.775 INFO:teuthology.orchestra.run.smithi088.stdout: "disallowed_leaders: ": "", 2024-04-26T23:45:30.776 INFO:teuthology.orchestra.run.smithi088.stdout: "stretch_mode": false, 2024-04-26T23:45:30.776 INFO:teuthology.orchestra.run.smithi088.stdout: "tiebreaker_mon": "", 2024-04-26T23:45:30.776 INFO:teuthology.orchestra.run.smithi088.stdout: "removed_ranks: ": "", 2024-04-26T23:45:30.776 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2024-04-26T23:45:30.776 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2024-04-26T23:45:30.776 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-04-26T23:45:30.776 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-04-26T23:45:30.776 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-04-26T23:45:30.776 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-04-26T23:45:30.776 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-04-26T23:45:30.776 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-04-26T23:45:30.776 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-04-26T23:45:30.777 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-04-26T23:45:30.777 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-04-26T23:45:30.777 INFO:teuthology.orchestra.run.smithi088.stdout: "reef", 2024-04-26T23:45:30.777 INFO:teuthology.orchestra.run.smithi088.stdout: "squid" 2024-04-26T23:45:30.777 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:45:30.777 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2024-04-26T23:45:30.777 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:45:30.777 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2024-04-26T23:45:30.777 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:45:30.778 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2024-04-26T23:45:30.778 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2024-04-26T23:45:30.779 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-04-26T23:45:30.779 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-04-26T23:45:30.779 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:45:30.779 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-04-26T23:45:30.779 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2024-04-26T23:45:30.779 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:45:30.780 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:45:30.780 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:45:30.780 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-04-26T23:45:30.780 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2024-04-26T23:45:30.780 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:45:30.780 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:45:30.780 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:45:30.780 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:45:30.780 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2024-04-26T23:45:30.780 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2024-04-26T23:45:30.780 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-04-26T23:45:30.780 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-04-26T23:45:30.781 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-04-26T23:45:30.781 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:45:30.781 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:45:30.781 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2024-04-26T23:45:30.781 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2024-04-26T23:45:30.781 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-04-26T23:45:30.781 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-04-26T23:45:30.781 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:45:30.781 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-04-26T23:45:30.781 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:3300", 2024-04-26T23:45:30.781 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:45:30.781 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:45:30.781 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:45:30.782 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-04-26T23:45:30.782 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6789", 2024-04-26T23:45:30.782 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:45:30.782 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:45:30.782 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:45:30.782 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:45:30.782 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6789/0", 2024-04-26T23:45:30.782 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.175:6789/0", 2024-04-26T23:45:30.782 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-04-26T23:45:30.782 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-04-26T23:45:30.782 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-04-26T23:45:30.783 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:45:30.783 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:45:30.783 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2024-04-26T23:45:30.783 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2024-04-26T23:45:30.783 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-04-26T23:45:30.783 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-04-26T23:45:30.783 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:45:30.783 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-04-26T23:45:30.783 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:3301", 2024-04-26T23:45:30.783 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:45:30.783 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:45:30.784 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:45:30.784 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-04-26T23:45:30.784 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6790", 2024-04-26T23:45:30.784 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:45:30.784 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:45:30.784 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:45:30.784 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:45:30.784 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6790/0", 2024-04-26T23:45:30.784 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.175:6790/0", 2024-04-26T23:45:30.784 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-04-26T23:45:30.784 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-04-26T23:45:30.784 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-04-26T23:45:30.784 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:45:30.785 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:45:30.785 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:45:30.785 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2024-04-26T23:45:30.785 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2024-04-26T23:45:30.785 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:45:30.785 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:45:30.785 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:45:30.785 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2024-04-26T23:45:30.785 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:45:30.785 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:45:30.785 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": [ 2024-04-26T23:45:30.785 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:45:30.785 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:45:30.786 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:45:30.786 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2024-04-26T23:45:30.786 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:45:30.786 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:45:30.786 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2024-04-26T23:45:30.786 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:45:30.786 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:45:30.786 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:45:30.786 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2024-04-26T23:45:30.786 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:45:30.786 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:45:30.786 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:45:30.787 INFO:teuthology.orchestra.run.smithi088.stdout: "stretch_mode": false 2024-04-26T23:45:30.787 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-04-26T23:45:30.788 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:30.766+0000 7f37c22a8640 1 -- 172.21.15.88:0/1274551941 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f37a006c940 msgr2=0x7f37a006ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:30.788 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:30.766+0000 7f37c22a8640 1 --2- 172.21.15.88:0/1274551941 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f37a006c940 0x7f37a006ee00 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f37b4033000 tx=0x7f37b4009000 comp rx=0 tx=0).stop 2024-04-26T23:45:30.788 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:30.766+0000 7f37c1aa7640 1 -- 172.21.15.88:0/1274551941 reap_dead start 2024-04-26T23:45:30.788 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:30.766+0000 7f37c22a8640 1 -- 172.21.15.88:0/1274551941 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f37bc06e0a0 msgr2=0x7f37bc1581c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:30.788 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:30.766+0000 7f37c22a8640 1 --2- 172.21.15.88:0/1274551941 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f37bc06e0a0 0x7f37bc1581c0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f37b800e9b0 tx=0x7f37b800ee70 comp rx=0 tx=0).stop 2024-04-26T23:45:30.788 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:30.766+0000 7f37c22a8640 1 -- 172.21.15.88:0/1274551941 shutdown_connections 2024-04-26T23:45:30.788 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:30.766+0000 7f37c22a8640 1 --2- 172.21.15.88:0/1274551941 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f37bc06e0a0 0x7f37bc1581c0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:30.788 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:30.766+0000 7f37c22a8640 1 -- 172.21.15.88:0/1274551941 >> 172.21.15.88:0/1274551941 conn(0x7f37bc06c310 msgr2=0x7f37bc148200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:30.788 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:30.766+0000 7f37c22a8640 1 -- 172.21.15.88:0/1274551941 shutdown_connections 2024-04-26T23:45:30.789 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:30.766+0000 7f37c22a8640 1 -- 172.21.15.88:0/1274551941 wait complete. 2024-04-26T23:45:30.789 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-04-26T23:45:30.789 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-04-26T23:45:30.789 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-04-26T23:45:30.906 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:30.901+0000 7f130241d640 1 Processor -- start 2024-04-26T23:45:30.906 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:30.901+0000 7f130241d640 1 -- start start 2024-04-26T23:45:30.907 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:30.902+0000 7f130241d640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f12fc1510c0 0x7f12fc072f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:30.907 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:30.902+0000 7f130241d640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f12fc0c4160 0x7f12fc15e400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:30.907 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:30.902+0000 7f130241d640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f12fc0c4b50 con 0x7f12fc0734d0 2024-04-26T23:45:30.907 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:30.902+0000 7f130241d640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f12fc0c50d0 con 0x7f12fc1510c0 2024-04-26T23:45:30.907 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:30.902+0000 7f130241d640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f12fc1514a0 con 0x7f12fc0c4160 2024-04-26T23:45:30.908 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:30.902+0000 7f12fbfff640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f12fc1510c0 0x7f12fc072f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:30.908 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:30.902+0000 7f12fb7fe640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f12fc0734d0 0x7f12fc06d320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:40116/0 (socket says 172.21.15.88:40116) 2024-04-26T23:45:30.908 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:30.902+0000 7f12fb7fe640 1 -- 172.21.15.88:0/1089347437 learned_addr learned my addr 172.21.15.88:0/1089347437 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-26T23:45:30.908 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:30.902+0000 7f13009ba640 1 --2- 172.21.15.88:0/1089347437 >> v2:172.21.15.175:3300/0 conn(0x7f12fc0c4160 0x7f12fc15e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:30.908 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:30.903+0000 7f12fbfff640 1 -- 172.21.15.88:0/1089347437 >> v2:172.21.15.175:3300/0 conn(0x7f12fc0c4160 msgr2=0x7f12fc15e400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:45:30.908 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:30.903+0000 7f12fbfff640 1 --2- 172.21.15.88:0/1089347437 >> v2:172.21.15.175:3300/0 conn(0x7f12fc0c4160 0x7f12fc15e400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:30.908 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:30.903+0000 7f12fbfff640 1 -- 172.21.15.88:0/1089347437 >> v1:172.21.15.88:6789/0 conn(0x7f12fc0734d0 legacy=0x7f12fc06d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:30.908 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:30.903+0000 7f12faffd640 1 -- 172.21.15.88:0/1089347437 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1131568126 0 0) 0x7f12fc0c4b50 con 0x7f12fc0734d0 2024-04-26T23:45:30.908 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:30.903+0000 7f12fbfff640 1 -- 172.21.15.88:0/1089347437 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12fc154920 con 0x7f12fc1510c0 2024-04-26T23:45:30.908 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:30.903+0000 7f12fbfff640 1 --2- 172.21.15.88:0/1089347437 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f12fc1510c0 0x7f12fc072f90 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f12fc0c5250 tx=0x7f12ec02a080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45cd356dafa9c859 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:30.909 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:30.903+0000 7f12faffd640 1 -- 172.21.15.88:0/1089347437 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12ec037070 con 0x7f12fc1510c0 2024-04-26T23:45:30.909 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:30.903+0000 7f12faffd640 1 -- 172.21.15.88:0/1089347437 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12ec02add0 con 0x7f12fc1510c0 2024-04-26T23:45:30.909 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:30.903+0000 7f12faffd640 1 -- 172.21.15.88:0/1089347437 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12ec032660 con 0x7f12fc1510c0 2024-04-26T23:45:30.909 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:30.904+0000 7f130241d640 1 -- 172.21.15.88:0/1089347437 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f12fc1510c0 msgr2=0x7f12fc072f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:30.910 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:30.904+0000 7f130241d640 1 --2- 172.21.15.88:0/1089347437 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f12fc1510c0 0x7f12fc072f90 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f12fc0c5250 tx=0x7f12ec02a080 comp rx=0 tx=0).stop 2024-04-26T23:45:30.910 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:30.904+0000 7f130241d640 1 -- 172.21.15.88:0/1089347437 shutdown_connections 2024-04-26T23:45:30.910 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:30.904+0000 7f130241d640 1 --2- 172.21.15.88:0/1089347437 >> v2:172.21.15.175:3300/0 conn(0x7f12fc0c4160 0x7f12fc15e400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:30.910 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:30.904+0000 7f130241d640 1 --2- 172.21.15.88:0/1089347437 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f12fc1510c0 0x7f12fc072f90 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:30.910 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:30.904+0000 7f130241d640 1 -- 172.21.15.88:0/1089347437 >> 172.21.15.88:0/1089347437 conn(0x7f12fc0c5ce0 msgr2=0x7f12fc0c60f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:30.910 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:30.904+0000 7f130241d640 1 -- 172.21.15.88:0/1089347437 shutdown_connections 2024-04-26T23:45:30.910 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:30.904+0000 7f130241d640 1 -- 172.21.15.88:0/1089347437 wait complete. 2024-04-26T23:45:30.911 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:30.906+0000 7f130241d640 1 Processor -- start 2024-04-26T23:45:30.911 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:30.906+0000 7f130241d640 1 -- start start 2024-04-26T23:45:30.911 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:30.907+0000 7f130241d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f12fc0c4160 0x7f12fc145720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:30.911 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:30.907+0000 7f130241d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f12fc1510c0 0x7f12fc1530b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:30.912 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:30.907+0000 7f130241d640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f12fc1535f0 0x7f12fc143590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:30.912 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:30.907+0000 7f12fbfff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f12fc0c4160 0x7f12fc145720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:30.912 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:30.907+0000 7f12fbfff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f12fc0c4160 0x7f12fc145720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:42310/0 (socket says 172.21.15.88:42310) 2024-04-26T23:45:30.912 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:30.907+0000 7f130241d640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f12fc0c5920 con 0x7f12fc0c4160 2024-04-26T23:45:30.912 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:30.907+0000 7f130241d640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f12fc0c5400 con 0x7f12fc1510c0 2024-04-26T23:45:30.912 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:30.907+0000 7f130241d640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f12fc06f500 con 0x7f12fc1535f0 2024-04-26T23:45:30.912 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:30.907+0000 7f12fbfff640 1 -- 172.21.15.88:0/3578873774 learned_addr learned my addr 172.21.15.88:0/3578873774 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:45:30.913 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:30.908+0000 7f13009ba640 1 --2- 172.21.15.88:0/3578873774 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f12fc1535f0 0x7f12fc143590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:30.913 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:30.908+0000 7f12fbfff640 1 -- 172.21.15.88:0/3578873774 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f12fc1535f0 msgr2=0x7f12fc143590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:30.913 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:30.908+0000 7f12fbfff640 1 --2- 172.21.15.88:0/3578873774 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f12fc1535f0 0x7f12fc143590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:30.913 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:30.908+0000 7f12fbfff640 1 -- 172.21.15.88:0/3578873774 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f12fc1510c0 msgr2=0x7f12fc1530b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:30.913 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:30.908+0000 7f12fbfff640 1 --2- 172.21.15.88:0/3578873774 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f12fc1510c0 0x7f12fc1530b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:30.913 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:30.908+0000 7f12fbfff640 1 -- 172.21.15.88:0/3578873774 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12fc1ed3e0 con 0x7f12fc0c4160 2024-04-26T23:45:30.914 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:30.908+0000 7f12fbfff640 1 --2- 172.21.15.88:0/3578873774 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f12fc0c4160 0x7f12fc145720 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f12ec035040 tx=0x7f12ec0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:30.914 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:30.909+0000 7f12f8ff9640 1 -- 172.21.15.88:0/3578873774 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12ec037050 con 0x7f12fc0c4160 2024-04-26T23:45:30.914 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:30.909+0000 7f130241d640 1 -- 172.21.15.88:0/3578873774 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12fc1ed680 con 0x7f12fc0c4160 2024-04-26T23:45:30.914 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:30.909+0000 7f12f8ff9640 1 -- 172.21.15.88:0/3578873774 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12ec038040 con 0x7f12fc0c4160 2024-04-26T23:45:30.914 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:30.909+0000 7f12f8ff9640 1 -- 172.21.15.88:0/3578873774 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12ec006e10 con 0x7f12fc0c4160 2024-04-26T23:45:30.914 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:30.909+0000 7f130241d640 1 -- 172.21.15.88:0/3578873774 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12fc1528b0 con 0x7f12fc0c4160 2024-04-26T23:45:30.916 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:30.910+0000 7f130241d640 1 --2- 172.21.15.88:0/3578873774 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f12fc0734d0 0x7f12fc143ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:30.917 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:30.910+0000 7f130241d640 1 -- 172.21.15.88:0/3578873774 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f12fc1461c0 con 0x7f12fc0734d0 2024-04-26T23:45:30.917 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:30.910+0000 7f12fb7fe640 1 --2- 172.21.15.88:0/3578873774 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f12fc0734d0 0x7f12fc143ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:30.917 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:30.911+0000 7f12fb7fe640 1 -- 172.21.15.88:0/3578873774 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f12fc1ed960 con 0x7f12fc0734d0 2024-04-26T23:45:30.917 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:30.911+0000 7f12f8ff9640 1 -- 172.21.15.88:0/3578873774 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f12ec004250 con 0x7f12fc0c4160 2024-04-26T23:45:30.917 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:30.911+0000 7f12fb7fe640 1 --2- 172.21.15.88:0/3578873774 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f12fc0734d0 0x7f12fc143ad0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f12f00011e0 tx=0x7f12f000c7f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:30.917 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:30.911+0000 7f12f8ff9640 1 --2- 172.21.15.88:0/3578873774 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f12e806c8f0 0x7f12e806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:30.917 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:30.911+0000 7f12f8ff9640 1 -- 172.21.15.88:0/3578873774 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6666+0+0 (secure 0 0 0) 0x7f12ec0ac600 con 0x7f12fc0c4160 2024-04-26T23:45:30.917 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:30.911+0000 7f13009ba640 1 --2- 172.21.15.88:0/3578873774 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f12e806c8f0 0x7f12e806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:30.917 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:30.912+0000 7f12f8ff9640 1 -- 172.21.15.88:0/3578873774 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12f00074e0 con 0x7f12fc0734d0 2024-04-26T23:45:30.917 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:30.912+0000 7f12f8ff9640 1 -- 172.21.15.88:0/3578873774 <== mon.1 v2:172.21.15.175:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f12f00074e0 con 0x7f12fc0734d0 2024-04-26T23:45:30.917 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:30.912+0000 7f12f8ff9640 1 -- 172.21.15.88:0/3578873774 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f12fc0734d0 msgr2=0x7f12fc143ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:30.917 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:30.912+0000 7f12f8ff9640 1 --2- 172.21.15.88:0/3578873774 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f12fc0734d0 0x7f12fc143ad0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f12f00011e0 tx=0x7f12f000c7f0 comp rx=0 tx=0).stop 2024-04-26T23:45:30.917 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:30.912+0000 7f12f8ff9640 1 -- 172.21.15.88:0/3578873774 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f12fc0734d0 msgr2=0x7f12fc143ad0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:45:30.918 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:30.912+0000 7f12f8ff9640 1 --2- 172.21.15.88:0/3578873774 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f12fc0734d0 0x7f12fc143ad0 secure :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f12f00011e0 tx=0x7f12f000c7f0 comp rx=0 tx=0).stop 2024-04-26T23:45:30.918 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:30.912+0000 7f13009ba640 1 --2- 172.21.15.88:0/3578873774 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f12e806c8f0 0x7f12e806edb0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f12f4009f80 tx=0x7f12f400b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:30.924 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:30.920+0000 7f130241d640 1 --2- 172.21.15.88:0/3578873774 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f12fc1442c0 0x7f12fc1eff20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:30.924 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:30.920+0000 7f130241d640 1 -- 172.21.15.88:0/3578873774 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f12fc0507a0 con 0x7f12fc1442c0 2024-04-26T23:45:30.924 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:30.920+0000 7f12fb7fe640 1 --2- 172.21.15.88:0/3578873774 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f12fc1442c0 0x7f12fc1eff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:30.924 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:30.920+0000 7f12fb7fe640 1 -- 172.21.15.88:0/3578873774 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f12fc0c3ed0 con 0x7f12fc1442c0 2024-04-26T23:45:30.926 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:30.921+0000 7f12fb7fe640 1 --2- 172.21.15.88:0/3578873774 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f12fc1442c0 0x7f12fc1eff20 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f12f0007fd0 tx=0x7f12f0001080 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:30.926 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:30.922+0000 7f12f8ff9640 1 -- 172.21.15.88:0/3578873774 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12f001b320 con 0x7f12fc1442c0 2024-04-26T23:45:30.926 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:30.922+0000 7f12f8ff9640 1 -- 172.21.15.88:0/3578873774 <== mon.1 v2:172.21.15.175:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5209 (secure 0 0 0) 0x7f12f0019040 con 0x7f12fc1442c0 2024-04-26T23:45:30.926 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:30.922+0000 7f12f8ff9640 1 -- 172.21.15.88:0/3578873774 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f12fc1442c0 msgr2=0x7f12fc1eff20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:30.927 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:30.922+0000 7f12f8ff9640 1 --2- 172.21.15.88:0/3578873774 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f12fc1442c0 0x7f12fc1eff20 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f12f0007fd0 tx=0x7f12f0001080 comp rx=0 tx=0).stop 2024-04-26T23:45:30.927 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:30.922+0000 7f12f8ff9640 1 -- 172.21.15.88:0/3578873774 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f12fc1442c0 msgr2=0x7f12fc1eff20 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:45:30.927 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:30.922+0000 7f12f8ff9640 1 --2- 172.21.15.88:0/3578873774 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f12fc1442c0 0x7f12fc1eff20 secure :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f12f0007fd0 tx=0x7f12f0001080 comp rx=0 tx=0).stop 2024-04-26T23:45:30.927 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-04-26T23:45:30.927 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2024-04-26T23:45:30.927 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2024-04-26T23:45:30.927 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "peon", 2024-04-26T23:45:30.927 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 54, 2024-04-26T23:45:30.927 INFO:teuthology.orchestra.run.smithi088.stdout: "uptime": 323265, 2024-04-26T23:45:30.927 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2024-04-26T23:45:30.928 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2024-04-26T23:45:30.928 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2024-04-26T23:45:30.928 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2024-04-26T23:45:30.928 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:45:30.928 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 14, 2024-04-26T23:45:30.928 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2024-04-26T23:45:30.928 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2450521708007866372", 2024-04-26T23:45:30.928 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2024-04-26T23:45:30.928 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-04-26T23:45:30.928 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-04-26T23:45:30.928 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-04-26T23:45:30.928 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-04-26T23:45:30.928 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-04-26T23:45:30.928 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-04-26T23:45:30.928 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-04-26T23:45:30.929 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-04-26T23:45:30.929 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-04-26T23:45:30.929 INFO:teuthology.orchestra.run.smithi088.stdout: "reef", 2024-04-26T23:45:30.929 INFO:teuthology.orchestra.run.smithi088.stdout: "squid" 2024-04-26T23:45:30.929 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:45:30.929 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540701547738038271", 2024-04-26T23:45:30.929 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2024-04-26T23:45:30.929 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-04-26T23:45:30.929 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-04-26T23:45:30.929 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-04-26T23:45:30.929 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-04-26T23:45:30.929 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-04-26T23:45:30.929 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-04-26T23:45:30.929 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-04-26T23:45:30.930 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-04-26T23:45:30.930 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-04-26T23:45:30.930 INFO:teuthology.orchestra.run.smithi088.stdout: "reef", 2024-04-26T23:45:30.930 INFO:teuthology.orchestra.run.smithi088.stdout: "squid" 2024-04-26T23:45:30.930 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:45:30.930 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:45:30.930 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2024-04-26T23:45:30.930 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2024-04-26T23:45:30.930 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2024-04-26T23:45:30.930 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2024-04-26T23:45:30.930 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2024-04-26T23:45:30.930 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "555255e9-7ef9-4454-8dc9-35e96b70035c", 2024-04-26T23:45:30.930 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2024-04-26T23:39:34.291658Z", 2024-04-26T23:45:30.930 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2024-04-26T23:39:34.291658Z", 2024-04-26T23:45:30.930 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 19, 2024-04-26T23:45:30.931 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "squid", 2024-04-26T23:45:30.931 INFO:teuthology.orchestra.run.smithi088.stdout: "election_strategy": 1, 2024-04-26T23:45:30.931 INFO:teuthology.orchestra.run.smithi088.stdout: "disallowed_leaders: ": "", 2024-04-26T23:45:30.931 INFO:teuthology.orchestra.run.smithi088.stdout: "stretch_mode": false, 2024-04-26T23:45:30.931 INFO:teuthology.orchestra.run.smithi088.stdout: "tiebreaker_mon": "", 2024-04-26T23:45:30.931 INFO:teuthology.orchestra.run.smithi088.stdout: "removed_ranks: ": "", 2024-04-26T23:45:30.931 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2024-04-26T23:45:30.931 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2024-04-26T23:45:30.931 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-04-26T23:45:30.931 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-04-26T23:45:30.931 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-04-26T23:45:30.931 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-04-26T23:45:30.931 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-04-26T23:45:30.931 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-04-26T23:45:30.932 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-04-26T23:45:30.932 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-04-26T23:45:30.932 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-04-26T23:45:30.932 INFO:teuthology.orchestra.run.smithi088.stdout: "reef", 2024-04-26T23:45:30.932 INFO:teuthology.orchestra.run.smithi088.stdout: "squid" 2024-04-26T23:45:30.932 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:45:30.932 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2024-04-26T23:45:30.932 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:45:30.932 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2024-04-26T23:45:30.932 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:45:30.932 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2024-04-26T23:45:30.932 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2024-04-26T23:45:30.932 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-04-26T23:45:30.932 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-04-26T23:45:30.933 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:45:30.933 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-04-26T23:45:30.933 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2024-04-26T23:45:30.933 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:45:30.933 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:45:30.933 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:45:30.933 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-04-26T23:45:30.933 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2024-04-26T23:45:30.933 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:45:30.933 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:45:30.933 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:45:30.933 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:45:30.933 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2024-04-26T23:45:30.933 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2024-04-26T23:45:30.933 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-04-26T23:45:30.934 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-04-26T23:45:30.934 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-04-26T23:45:30.934 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:45:30.934 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:45:30.934 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2024-04-26T23:45:30.934 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2024-04-26T23:45:30.934 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-04-26T23:45:30.934 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-04-26T23:45:30.934 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:45:30.934 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-04-26T23:45:30.934 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:3300", 2024-04-26T23:45:30.934 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:45:30.934 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:45:30.934 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:45:30.935 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-04-26T23:45:30.935 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6789", 2024-04-26T23:45:30.935 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:45:30.935 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:45:30.935 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:45:30.935 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:45:30.935 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6789/0", 2024-04-26T23:45:30.935 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.175:6789/0", 2024-04-26T23:45:30.935 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-04-26T23:45:30.935 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-04-26T23:45:30.935 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-04-26T23:45:30.935 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:45:30.935 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:45:30.935 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2024-04-26T23:45:30.936 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2024-04-26T23:45:30.936 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-04-26T23:45:30.936 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-04-26T23:45:30.936 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:45:30.936 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-04-26T23:45:30.936 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:3301", 2024-04-26T23:45:30.936 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:45:30.936 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:45:30.936 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:45:30.936 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-04-26T23:45:30.936 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6790", 2024-04-26T23:45:30.936 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:45:30.936 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:45:30.936 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:45:30.937 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:45:30.937 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6790/0", 2024-04-26T23:45:30.937 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.175:6790/0", 2024-04-26T23:45:30.937 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-04-26T23:45:30.937 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-04-26T23:45:30.937 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-04-26T23:45:30.937 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:45:30.937 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:45:30.937 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:45:30.937 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2024-04-26T23:45:30.937 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2024-04-26T23:45:30.937 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:45:30.937 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:45:30.937 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:45:30.937 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2024-04-26T23:45:30.938 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:45:30.938 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:45:30.938 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": [ 2024-04-26T23:45:30.938 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:45:30.938 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:45:30.938 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:45:30.938 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 4 2024-04-26T23:45:30.938 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:45:30.938 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:45:30.938 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": [ 2024-04-26T23:45:30.938 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:45:30.938 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:45:30.938 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:45:30.938 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 7 2024-04-26T23:45:30.939 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:45:30.939 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:45:30.939 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2024-04-26T23:45:30.939 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:45:30.939 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x2f018fb87aa4aafe", 2024-04-26T23:45:30.939 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:45:30.939 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2024-04-26T23:45:30.939 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:45:30.939 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:45:30.939 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:45:30.939 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:45:30.939 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 5 2024-04-26T23:45:30.939 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:45:30.939 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:45:30.939 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": [ 2024-04-26T23:45:30.940 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:45:30.940 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:45:30.940 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:45:30.940 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2024-04-26T23:45:30.940 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:45:30.940 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:45:30.940 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:45:30.940 INFO:teuthology.orchestra.run.smithi088.stdout: "stretch_mode": false 2024-04-26T23:45:30.940 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-04-26T23:45:30.941 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:30.923+0000 7f130241d640 1 -- 172.21.15.88:0/3578873774 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f12e806c8f0 msgr2=0x7f12e806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:30.941 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:30.923+0000 7f130241d640 1 --2- 172.21.15.88:0/3578873774 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f12e806c8f0 0x7f12e806edb0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f12f4009f80 tx=0x7f12f400b040 comp rx=0 tx=0).stop 2024-04-26T23:45:30.941 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:30.923+0000 7f13009ba640 1 -- 172.21.15.88:0/3578873774 reap_dead start 2024-04-26T23:45:30.941 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:30.923+0000 7f130241d640 1 -- 172.21.15.88:0/3578873774 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f12fc0c4160 msgr2=0x7f12fc145720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:30.941 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:30.923+0000 7f130241d640 1 --2- 172.21.15.88:0/3578873774 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f12fc0c4160 0x7f12fc145720 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f12ec035040 tx=0x7f12ec0046c0 comp rx=0 tx=0).stop 2024-04-26T23:45:30.941 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:30.923+0000 7f130241d640 1 -- 172.21.15.88:0/3578873774 shutdown_connections 2024-04-26T23:45:30.941 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:30.923+0000 7f130241d640 1 --2- 172.21.15.88:0/3578873774 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f12fc0c4160 0x7f12fc145720 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:30.942 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:30.923+0000 7f130241d640 1 -- 172.21.15.88:0/3578873774 >> 172.21.15.88:0/3578873774 conn(0x7f12fc0c5ce0 msgr2=0x7f12fc0c26a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:30.942 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:30.923+0000 7f130241d640 1 -- 172.21.15.88:0/3578873774 shutdown_connections 2024-04-26T23:45:30.942 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:30.923+0000 7f130241d640 1 -- 172.21.15.88:0/3578873774 wait complete. 2024-04-26T23:45:30.943 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-04-26T23:45:30.943 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-04-26T23:45:30.943 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-04-26T23:45:31.093 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:31.088+0000 7f2a8accc640 1 Processor -- start 2024-04-26T23:45:31.093 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:31.089+0000 7f2a8accc640 1 -- start start 2024-04-26T23:45:31.094 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:31.090+0000 7f2a8accc640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f2a840ca3b0 0x7f2a84156b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:31.094 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:31.090+0000 7f2a8accc640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2a840cc770 con 0x7f2a840bfb40 2024-04-26T23:45:31.094 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:31.090+0000 7f2a8accc640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2a84157780 con 0x7f2a841540b0 2024-04-26T23:45:31.094 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:31.090+0000 7f2a8accc640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f2a8415abd0 con 0x7f2a840ca3b0 2024-04-26T23:45:31.094 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:31.090+0000 7f2a88a68640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f2a841540b0 0x7f2a840c6e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.88:51004/0 (socket says 172.21.15.88:51004) 2024-04-26T23:45:31.094 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:31.090+0000 7f2a88a68640 1 -- 172.21.15.88:0/3269886167 learned_addr learned my addr 172.21.15.88:0/3269886167 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-26T23:45:31.095 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:31.090+0000 7f2a837fe640 1 -- 172.21.15.88:0/3269886167 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2367088398 0 0) 0x7f2a84157780 con 0x7f2a841540b0 2024-04-26T23:45:31.095 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:31.091+0000 7f2a837fe640 1 -- 172.21.15.88:0/3269886167 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2a6c003520 con 0x7f2a841540b0 2024-04-26T23:45:31.095 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:31.091+0000 7f2a83fff640 1 --2- 172.21.15.88:0/3269886167 >> v2:172.21.15.88:3300/0 conn(0x7f2a840ca3b0 0x7f2a84156b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:31.096 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:31.091+0000 7f2a837fe640 1 -- 172.21.15.88:0/3269886167 <== mon.1 v1:172.21.15.175:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2184706867 0 0) 0x7f2a6c003520 con 0x7f2a841540b0 2024-04-26T23:45:31.096 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:31.091+0000 7f2a837fe640 1 -- 172.21.15.88:0/3269886167 >> v2:172.21.15.88:3300/0 conn(0x7f2a840ca3b0 msgr2=0x7f2a84156b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:45:31.096 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:31.091+0000 7f2a837fe640 1 --2- 172.21.15.88:0/3269886167 >> v2:172.21.15.88:3300/0 conn(0x7f2a840ca3b0 0x7f2a84156b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:31.096 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:31.091+0000 7f2a837fe640 1 -- 172.21.15.88:0/3269886167 >> v1:172.21.15.88:6789/0 conn(0x7f2a840bfb40 legacy=0x7f2a84157070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:31.096 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:31.091+0000 7f2a837fe640 1 -- 172.21.15.88:0/3269886167 --> v1:172.21.15.175:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a8415aeb0 con 0x7f2a841540b0 2024-04-26T23:45:31.096 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:31.091+0000 7f2a837fe640 1 -- 172.21.15.88:0/3269886167 <== mon.1 v1:172.21.15.175:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 356324787 0 0) 0x7f2a74001670 con 0x7f2a841540b0 2024-04-26T23:45:31.096 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:31.091+0000 7f2a837fe640 1 -- 172.21.15.88:0/3269886167 >> v1:172.21.15.175:6789/0 conn(0x7f2a841540b0 legacy=0x7f2a840c6e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:31.096 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:31.092+0000 7f2a837fe640 1 --2- 172.21.15.88:0/3269886167 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2a6c0039b0 0x7f2a6c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:31.097 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:31.092+0000 7f2a837fe640 1 --2- 172.21.15.88:0/3269886167 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2a6c004800 0x7f2a6c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:31.097 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:31.092+0000 7f2a837fe640 1 --2- 172.21.15.88:0/3269886167 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2a6c0052e0 0x7f2a6c0141d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:31.097 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:31.092+0000 7f2a837fe640 1 -- 172.21.15.88:0/3269886167 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f2a8415abd0 con 0x7f2a6c0039b0 2024-04-26T23:45:31.097 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:31.092+0000 7f2a837fe640 1 -- 172.21.15.88:0/3269886167 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f2a6c0149c0 con 0x7f2a6c004800 2024-04-26T23:45:31.097 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:31.092+0000 7f2a837fe640 1 -- 172.21.15.88:0/3269886167 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f2a6c014bc0 con 0x7f2a6c0052e0 2024-04-26T23:45:31.098 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:31.092+0000 7f2a83fff640 1 --2- 172.21.15.88:0/3269886167 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2a6c004800 0x7f2a6c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:31.100 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:31.092+0000 7f2a88a68640 1 --2- 172.21.15.88:0/3269886167 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2a6c0039b0 0x7f2a6c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:31.100 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:31.092+0000 7f2a83fff640 1 -- 172.21.15.88:0/3269886167 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2a6c0052e0 msgr2=0x7f2a6c0141d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:45:31.100 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:31.092+0000 7f2a83fff640 1 --2- 172.21.15.88:0/3269886167 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2a6c0052e0 0x7f2a6c0141d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:31.100 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:31.092+0000 7f2a83fff640 1 -- 172.21.15.88:0/3269886167 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2a6c0039b0 msgr2=0x7f2a6c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:45:31.100 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:31.092+0000 7f2a83fff640 1 --2- 172.21.15.88:0/3269886167 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2a6c0039b0 0x7f2a6c003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:31.100 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:31.092+0000 7f2a83fff640 1 -- 172.21.15.88:0/3269886167 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a8415aeb0 con 0x7f2a6c004800 2024-04-26T23:45:31.100 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:31.092+0000 7f2a88a68640 1 --2- 172.21.15.88:0/3269886167 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2a6c0039b0 0x7f2a6c003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:45:31.100 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:31.092+0000 7f2a89269640 1 -- 172.21.15.88:0/3269886167 reap_dead start 2024-04-26T23:45:31.100 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:31.093+0000 7f2a83fff640 1 --2- 172.21.15.88:0/3269886167 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2a6c004800 0x7f2a6c004c80 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f2a78009a70 tx=0x7f2a6c005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7dd6ac143a1e04c0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:31.100 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:31.094+0000 7f2a837fe640 1 -- 172.21.15.88:0/3269886167 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a78036070 con 0x7f2a6c004800 2024-04-26T23:45:31.100 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:31.094+0000 7f2a837fe640 1 -- 172.21.15.88:0/3269886167 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a78031400 con 0x7f2a6c004800 2024-04-26T23:45:31.100 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:31.095+0000 7f2a837fe640 1 -- 172.21.15.88:0/3269886167 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a78009670 con 0x7f2a6c004800 2024-04-26T23:45:31.100 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:31.095+0000 7f2a8accc640 1 -- 172.21.15.88:0/3269886167 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2a6c004800 msgr2=0x7f2a6c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:31.101 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:31.095+0000 7f2a8accc640 1 --2- 172.21.15.88:0/3269886167 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2a6c004800 0x7f2a6c004c80 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f2a78009a70 tx=0x7f2a6c005830 comp rx=0 tx=0).stop 2024-04-26T23:45:31.101 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:31.095+0000 7f2a8accc640 1 -- 172.21.15.88:0/3269886167 shutdown_connections 2024-04-26T23:45:31.101 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:31.095+0000 7f2a8accc640 1 --2- 172.21.15.88:0/3269886167 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2a6c004800 0x7f2a6c004c80 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:31.101 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:31.095+0000 7f2a8accc640 1 -- 172.21.15.88:0/3269886167 >> 172.21.15.88:0/3269886167 conn(0x7f2a8406c4f0 msgr2=0x7f2a8406c900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:31.101 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:31.095+0000 7f2a8accc640 1 -- 172.21.15.88:0/3269886167 shutdown_connections 2024-04-26T23:45:31.101 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:31.095+0000 7f2a8accc640 1 -- 172.21.15.88:0/3269886167 wait complete. 2024-04-26T23:45:31.101 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:31.097+0000 7f2a8accc640 1 Processor -- start 2024-04-26T23:45:31.101 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:31.097+0000 7f2a8accc640 1 -- start start 2024-04-26T23:45:31.107 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:31.098+0000 7f2a8accc640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2a6c004800 0x7f2a840ae310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:31.107 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:31.098+0000 7f2a8accc640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2a840c71c0 0x7f2a841eba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:31.107 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:31.098+0000 7f2a8accc640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2a841ebfd0 0x7f2a8414f280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:31.107 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:31.098+0000 7f2a8accc640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f2a84154490 con 0x7f2a841ebfd0 2024-04-26T23:45:31.107 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:31.098+0000 7f2a8accc640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f2a840cccd0 con 0x7f2a6c004800 2024-04-26T23:45:31.108 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:31.098+0000 7f2a8accc640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f2a840c6e30 con 0x7f2a840c71c0 2024-04-26T23:45:31.108 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:31.098+0000 7f2a89269640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2a841ebfd0 0x7f2a8414f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:31.108 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:31.098+0000 7f2a89269640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2a841ebfd0 0x7f2a8414f280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:42336/0 (socket says 172.21.15.88:42336) 2024-04-26T23:45:31.108 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:31.098+0000 7f2a89269640 1 -- 172.21.15.88:0/2531115966 learned_addr learned my addr 172.21.15.88:0/2531115966 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:45:31.108 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:31.098+0000 7f2a88a68640 1 --2- 172.21.15.88:0/2531115966 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2a6c004800 0x7f2a840ae310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:31.108 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:31.098+0000 7f2a83fff640 1 --2- 172.21.15.88:0/2531115966 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2a840c71c0 0x7f2a841eba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:31.108 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:31.099+0000 7f2a89269640 1 -- 172.21.15.88:0/2531115966 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2a840c71c0 msgr2=0x7f2a841eba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:31.108 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:31.099+0000 7f2a89269640 1 --2- 172.21.15.88:0/2531115966 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2a840c71c0 0x7f2a841eba90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:31.108 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:31.099+0000 7f2a89269640 1 -- 172.21.15.88:0/2531115966 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2a6c004800 msgr2=0x7f2a840ae310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:31.108 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:31.099+0000 7f2a89269640 1 --2- 172.21.15.88:0/2531115966 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2a6c004800 0x7f2a840ae310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:31.108 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:31.099+0000 7f2a89269640 1 -- 172.21.15.88:0/2531115966 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a840c1170 con 0x7f2a841ebfd0 2024-04-26T23:45:31.108 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:31.099+0000 7f2a89269640 1 --2- 172.21.15.88:0/2531115966 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2a841ebfd0 0x7f2a8414f280 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f2a840c3530 tx=0x7f2a7c00cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:31.108 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:31.099+0000 7f2a817fa640 1 -- 172.21.15.88:0/2531115966 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a7c017070 con 0x7f2a841ebfd0 2024-04-26T23:45:31.108 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:31.100+0000 7f2a817fa640 1 -- 172.21.15.88:0/2531115966 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a7c005d60 con 0x7f2a841ebfd0 2024-04-26T23:45:31.109 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:31.100+0000 7f2a817fa640 1 -- 172.21.15.88:0/2531115966 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a7c00a850 con 0x7f2a841ebfd0 2024-04-26T23:45:31.109 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:31.100+0000 7f2a8accc640 1 -- 172.21.15.88:0/2531115966 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a840c4b10 con 0x7f2a841ebfd0 2024-04-26T23:45:31.109 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:31.100+0000 7f2a8accc640 1 -- 172.21.15.88:0/2531115966 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a840c03b0 con 0x7f2a841ebfd0 2024-04-26T23:45:31.109 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:31.101+0000 7f2a8accc640 1 --2- 172.21.15.88:0/2531115966 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2a841ec450 0x7f2a840c05f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:31.109 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:31.101+0000 7f2a8accc640 1 -- 172.21.15.88:0/2531115966 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f2a84072c60 con 0x7f2a841ec450 2024-04-26T23:45:31.110 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:31.103+0000 7f2a817fa640 1 -- 172.21.15.88:0/2531115966 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2a7c01a070 con 0x7f2a841ebfd0 2024-04-26T23:45:31.110 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:31.103+0000 7f2a817fa640 1 --2- 172.21.15.88:0/2531115966 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f2a7006c9c0 0x7f2a7006ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:31.110 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:31.103+0000 7f2a817fa640 1 -- 172.21.15.88:0/2531115966 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6666+0+0 (secure 0 0 0) 0x7f2a7c08afa0 con 0x7f2a841ebfd0 2024-04-26T23:45:31.110 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:31.104+0000 7f2a88a68640 1 --2- 172.21.15.88:0/2531115966 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2a841ec450 0x7f2a840c05f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:31.110 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:31.104+0000 7f2a83fff640 1 --2- 172.21.15.88:0/2531115966 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f2a7006c9c0 0x7f2a7006ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:31.110 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:31.105+0000 7f2a88a68640 1 -- 172.21.15.88:0/2531115966 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2a840507a0 con 0x7f2a841ec450 2024-04-26T23:45:31.110 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:31.105+0000 7f2a83fff640 1 --2- 172.21.15.88:0/2531115966 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f2a7006c9c0 0x7f2a7006ee80 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f2a78033000 tx=0x7f2a78008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:31.110 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:31.105+0000 7f2a88a68640 1 --2- 172.21.15.88:0/2531115966 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2a841ec450 0x7f2a840c05f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f2a840c23e0 tx=0x7f2a74010c10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:31.111 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:31.106+0000 7f2a817fa640 1 -- 172.21.15.88:0/2531115966 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a74018030 con 0x7f2a841ec450 2024-04-26T23:45:31.111 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:31.106+0000 7f2a817fa640 1 -- 172.21.15.88:0/2531115966 <== mon.2 v2:172.21.15.175:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f2a74005020 con 0x7f2a841ec450 2024-04-26T23:45:31.111 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:31.106+0000 7f2a817fa640 1 -- 172.21.15.88:0/2531115966 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2a841ec450 msgr2=0x7f2a840c05f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:31.111 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:31.106+0000 7f2a817fa640 1 --2- 172.21.15.88:0/2531115966 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2a841ec450 0x7f2a840c05f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f2a840c23e0 tx=0x7f2a74010c10 comp rx=0 tx=0).stop 2024-04-26T23:45:31.111 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:31.106+0000 7f2a817fa640 1 -- 172.21.15.88:0/2531115966 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2a841ec450 msgr2=0x7f2a840c05f0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:45:31.111 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:31.106+0000 7f2a817fa640 1 --2- 172.21.15.88:0/2531115966 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2a841ec450 0x7f2a840c05f0 secure :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f2a840c23e0 tx=0x7f2a74010c10 comp rx=0 tx=0).stop 2024-04-26T23:45:31.123 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:31.119+0000 7f2a8accc640 1 --2- 172.21.15.88:0/2531115966 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2a840c0b30 0x7f2a8414f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:31.124 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:31.119+0000 7f2a8accc640 1 -- 172.21.15.88:0/2531115966 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f2a840c3330 con 0x7f2a840c0b30 2024-04-26T23:45:31.124 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:31.120+0000 7f2a88a68640 1 --2- 172.21.15.88:0/2531115966 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2a840c0b30 0x7f2a8414f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:31.128 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:31.124+0000 7f2a88a68640 1 -- 172.21.15.88:0/2531115966 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f2a84073590 con 0x7f2a840c0b30 2024-04-26T23:45:31.138 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:31.132+0000 7f2a88a68640 1 --2- 172.21.15.88:0/2531115966 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2a840c0b30 0x7f2a8414f7c0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f2a74018000 tx=0x7f2a74001080 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:31.139 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-04-26T23:45:31.139 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2024-04-26T23:45:31.139 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2024-04-26T23:45:31.139 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "peon", 2024-04-26T23:45:31.139 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 54, 2024-04-26T23:45:31.139 INFO:teuthology.orchestra.run.smithi088.stdout: "uptime": 99420, 2024-04-26T23:45:31.139 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2024-04-26T23:45:31.140 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2024-04-26T23:45:31.140 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2024-04-26T23:45:31.140 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2024-04-26T23:45:31.140 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:45:31.140 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 14, 2024-04-26T23:45:31.140 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2024-04-26T23:45:31.140 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2450521708007866372", 2024-04-26T23:45:31.140 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2024-04-26T23:45:31.140 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-04-26T23:45:31.140 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-04-26T23:45:31.140 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-04-26T23:45:31.140 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-04-26T23:45:31.140 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-04-26T23:45:31.140 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-04-26T23:45:31.140 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-04-26T23:45:31.141 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-04-26T23:45:31.141 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-04-26T23:45:31.141 INFO:teuthology.orchestra.run.smithi088.stdout: "reef", 2024-04-26T23:45:31.141 INFO:teuthology.orchestra.run.smithi088.stdout: "squid" 2024-04-26T23:45:31.141 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:45:31.141 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540701547738038271", 2024-04-26T23:45:31.141 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2024-04-26T23:45:31.141 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-04-26T23:45:31.141 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-04-26T23:45:31.141 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-04-26T23:45:31.141 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-04-26T23:45:31.141 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-04-26T23:45:31.141 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-04-26T23:45:31.141 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-04-26T23:45:31.141 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-04-26T23:45:31.142 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-04-26T23:45:31.142 INFO:teuthology.orchestra.run.smithi088.stdout: "reef", 2024-04-26T23:45:31.142 INFO:teuthology.orchestra.run.smithi088.stdout: "squid" 2024-04-26T23:45:31.142 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:45:31.142 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:45:31.142 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2024-04-26T23:45:31.142 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2024-04-26T23:45:31.142 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2024-04-26T23:45:31.142 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2024-04-26T23:45:31.142 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2024-04-26T23:45:31.142 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "555255e9-7ef9-4454-8dc9-35e96b70035c", 2024-04-26T23:45:31.142 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2024-04-26T23:39:34.291658Z", 2024-04-26T23:45:31.142 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2024-04-26T23:39:34.291658Z", 2024-04-26T23:45:31.142 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 19, 2024-04-26T23:45:31.143 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "squid", 2024-04-26T23:45:31.143 INFO:teuthology.orchestra.run.smithi088.stdout: "election_strategy": 1, 2024-04-26T23:45:31.143 INFO:teuthology.orchestra.run.smithi088.stdout: "disallowed_leaders: ": "", 2024-04-26T23:45:31.143 INFO:teuthology.orchestra.run.smithi088.stdout: "stretch_mode": false, 2024-04-26T23:45:31.143 INFO:teuthology.orchestra.run.smithi088.stdout: "tiebreaker_mon": "", 2024-04-26T23:45:31.143 INFO:teuthology.orchestra.run.smithi088.stdout: "removed_ranks: ": "", 2024-04-26T23:45:31.143 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2024-04-26T23:45:31.143 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2024-04-26T23:45:31.143 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-04-26T23:45:31.143 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-04-26T23:45:31.143 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-04-26T23:45:31.143 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-04-26T23:45:31.143 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-04-26T23:45:31.143 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-04-26T23:45:31.144 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-04-26T23:45:31.144 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-04-26T23:45:31.144 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-04-26T23:45:31.144 INFO:teuthology.orchestra.run.smithi088.stdout: "reef", 2024-04-26T23:45:31.144 INFO:teuthology.orchestra.run.smithi088.stdout: "squid" 2024-04-26T23:45:31.144 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:45:31.144 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2024-04-26T23:45:31.144 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:45:31.144 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2024-04-26T23:45:31.144 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:45:31.144 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2024-04-26T23:45:31.144 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2024-04-26T23:45:31.144 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-04-26T23:45:31.145 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-04-26T23:45:31.145 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:45:31.145 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-04-26T23:45:31.145 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2024-04-26T23:45:31.145 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:45:31.145 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:45:31.145 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:45:31.145 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-04-26T23:45:31.145 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2024-04-26T23:45:31.145 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:45:31.145 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:45:31.145 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:45:31.145 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:45:31.145 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2024-04-26T23:45:31.146 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2024-04-26T23:45:31.146 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-04-26T23:45:31.146 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-04-26T23:45:31.146 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-04-26T23:45:31.146 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:45:31.146 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:45:31.146 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2024-04-26T23:45:31.146 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2024-04-26T23:45:31.146 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-04-26T23:45:31.146 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-04-26T23:45:31.146 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:45:31.146 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-04-26T23:45:31.146 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:3300", 2024-04-26T23:45:31.146 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:45:31.146 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:45:31.147 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:45:31.147 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-04-26T23:45:31.147 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6789", 2024-04-26T23:45:31.147 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:45:31.147 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:45:31.147 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:45:31.147 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:45:31.147 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6789/0", 2024-04-26T23:45:31.147 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.175:6789/0", 2024-04-26T23:45:31.147 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-04-26T23:45:31.147 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-04-26T23:45:31.147 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-04-26T23:45:31.147 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:45:31.147 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:45:31.148 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2024-04-26T23:45:31.148 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2024-04-26T23:45:31.148 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-04-26T23:45:31.148 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-04-26T23:45:31.148 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:45:31.148 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-04-26T23:45:31.148 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:3301", 2024-04-26T23:45:31.148 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:45:31.148 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:45:31.148 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:45:31.148 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-04-26T23:45:31.148 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6790", 2024-04-26T23:45:31.148 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:45:31.148 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:45:31.149 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:45:31.149 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:45:31.149 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6790/0", 2024-04-26T23:45:31.149 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.175:6790/0", 2024-04-26T23:45:31.149 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-04-26T23:45:31.149 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-04-26T23:45:31.149 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-04-26T23:45:31.149 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:45:31.149 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:45:31.149 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:45:31.149 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2024-04-26T23:45:31.149 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2024-04-26T23:45:31.149 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:45:31.149 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:45:31.149 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:45:31.150 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2024-04-26T23:45:31.150 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:45:31.150 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:45:31.150 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2024-04-26T23:45:31.150 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:45:31.150 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:45:31.150 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:45:31.150 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2024-04-26T23:45:31.150 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:45:31.150 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:45:31.150 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:45:31.150 INFO:teuthology.orchestra.run.smithi088.stdout: "stretch_mode": false 2024-04-26T23:45:31.150 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-04-26T23:45:31.151 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:31.134+0000 7f2a817fa640 1 -- 172.21.15.88:0/2531115966 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a74018030 con 0x7f2a840c0b30 2024-04-26T23:45:31.151 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:31.134+0000 7f2a817fa640 1 -- 172.21.15.88:0/2531115966 <== mon.2 v2:172.21.15.175:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4555 (secure 0 0 0) 0x7f2a740047e0 con 0x7f2a840c0b30 2024-04-26T23:45:31.151 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:31.134+0000 7f2a817fa640 1 -- 172.21.15.88:0/2531115966 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2a840c0b30 msgr2=0x7f2a8414f7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:31.152 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:31.134+0000 7f2a817fa640 1 --2- 172.21.15.88:0/2531115966 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2a840c0b30 0x7f2a8414f7c0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f2a74018000 tx=0x7f2a74001080 comp rx=0 tx=0).stop 2024-04-26T23:45:31.152 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:31.134+0000 7f2a817fa640 1 -- 172.21.15.88:0/2531115966 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2a840c0b30 msgr2=0x7f2a8414f7c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:45:31.152 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:31.134+0000 7f2a817fa640 1 --2- 172.21.15.88:0/2531115966 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2a840c0b30 0x7f2a8414f7c0 secure :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f2a74018000 tx=0x7f2a74001080 comp rx=0 tx=0).stop 2024-04-26T23:45:31.152 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:31.135+0000 7f2a6affd640 1 -- 172.21.15.88:0/2531115966 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f2a7006c9c0 msgr2=0x7f2a7006ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:31.152 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:31.135+0000 7f2a6affd640 1 --2- 172.21.15.88:0/2531115966 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f2a7006c9c0 0x7f2a7006ee80 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f2a78033000 tx=0x7f2a78008030 comp rx=0 tx=0).stop 2024-04-26T23:45:31.152 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:31.135+0000 7f2a6affd640 1 -- 172.21.15.88:0/2531115966 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2a841ebfd0 msgr2=0x7f2a8414f280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:31.152 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:31.135+0000 7f2a6affd640 1 --2- 172.21.15.88:0/2531115966 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2a841ebfd0 0x7f2a8414f280 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f2a840c3530 tx=0x7f2a7c00cb10 comp rx=0 tx=0).stop 2024-04-26T23:45:31.152 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:31.135+0000 7f2a89269640 1 -- 172.21.15.88:0/2531115966 reap_dead start 2024-04-26T23:45:31.152 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:31.135+0000 7f2a89269640 1 -- 172.21.15.88:0/2531115966 reap_dead start 2024-04-26T23:45:31.152 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:31.135+0000 7f2a6affd640 1 -- 172.21.15.88:0/2531115966 shutdown_connections 2024-04-26T23:45:31.152 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:31.135+0000 7f2a6affd640 1 -- 172.21.15.88:0/2531115966 >> 172.21.15.88:0/2531115966 conn(0x7f2a8406c4f0 msgr2=0x7f2a84153350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:31.152 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:31.136+0000 7f2a6affd640 1 -- 172.21.15.88:0/2531115966 shutdown_connections 2024-04-26T23:45:31.152 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:31.139+0000 7f2a6affd640 1 -- 172.21.15.88:0/2531115966 wait complete. 2024-04-26T23:45:31.180 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-04-26T23:45:31.180 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['b'] 2024-04-26T23:45:31.180 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2024-04-26T23:45:31.180 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.b 2024-04-26T23:45:31.180 INFO:tasks.mon_thrash.mon_thrasher:killing mon.b 2024-04-26T23:45:31.181 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-04-26T23:45:31.181 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T23:45:31.208 INFO:tasks.ceph.mon.b:Stopped 2024-04-26T23:45:31.208 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2024-04-26T23:45:31.208 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-04-26T23:45:31.393 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:31.387+0000 7f27c08e3640 1 Processor -- start 2024-04-26T23:45:31.393 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:31.387+0000 7f27c08e3640 1 -- start start 2024-04-26T23:45:31.393 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:31.388+0000 7f27c08e3640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f27bc0742f0 0x7f27bc15bc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:31.393 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:31.388+0000 7f27c08e3640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f27bc15e7d0 con 0x7f27bc0705c0 2024-04-26T23:45:31.393 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:31.388+0000 7f27c08e3640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f27bc070b40 con 0x7f27bc06d590 2024-04-26T23:45:31.393 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:31.388+0000 7f27c08e3640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f27bc0701f0 con 0x7f27bc0742f0 2024-04-26T23:45:31.394 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:31.389+0000 7f27ba59c640 1 -- >> v1:172.21.15.175:6789/0 conn(0x7f27bc06d590 legacy=0x7f27bc158320 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.175:6789/0 2024-04-26T23:45:31.394 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:31.389+0000 7f27bad9d640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f27bc0742f0 0x7f27bc15bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:31.394 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:31.389+0000 7f27b9d9b640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f27bc0705c0 0x7f27bc073be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:40142/0 (socket says 172.21.15.88:40142) 2024-04-26T23:45:31.394 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:31.389+0000 7f27b9d9b640 1 -- 172.21.15.88:0/1775122275 learned_addr learned my addr 172.21.15.88:0/1775122275 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-26T23:45:31.394 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:31.390+0000 7f27b959a640 1 -- 172.21.15.88:0/1775122275 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2726031240 0 0) 0x7f27bc15e7d0 con 0x7f27bc0705c0 2024-04-26T23:45:31.394 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:31.390+0000 7f27b959a640 1 -- 172.21.15.88:0/1775122275 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f27a4003520 con 0x7f27bc0705c0 2024-04-26T23:45:31.399 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:31.390+0000 7f27b959a640 1 -- 172.21.15.88:0/1775122275 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 606133707 0 0) 0x7f27a4003520 con 0x7f27bc0705c0 2024-04-26T23:45:31.399 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:31.390+0000 7f27b959a640 1 -- 172.21.15.88:0/1775122275 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f27bc0742f0 msgr2=0x7f27bc15bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:45:31.399 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:31.390+0000 7f27b959a640 1 --2- 172.21.15.88:0/1775122275 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f27bc0742f0 0x7f27bc15bc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:31.399 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:31.390+0000 7f27b959a640 1 -- 172.21.15.88:0/1775122275 >> v1:172.21.15.175:6789/0 conn(0x7f27bc06d590 legacy=0x7f27bc158320 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T23:45:31.399 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:31.390+0000 7f27b959a640 1 -- 172.21.15.88:0/1775122275 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27bc15ea70 con 0x7f27bc0705c0 2024-04-26T23:45:31.399 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:31.391+0000 7f27b959a640 1 -- 172.21.15.88:0/1775122275 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 356324787 0 0) 0x7f27ac001670 con 0x7f27bc0705c0 2024-04-26T23:45:31.399 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:31.391+0000 7f27b959a640 1 -- 172.21.15.88:0/1775122275 >> v1:172.21.15.88:6789/0 conn(0x7f27bc0705c0 legacy=0x7f27bc073be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:31.399 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:31.391+0000 7f27b959a640 1 --2- 172.21.15.88:0/1775122275 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f27a40039e0 0x7f27a4003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:31.399 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:31.391+0000 7f27b959a640 1 --2- 172.21.15.88:0/1775122275 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f27a4004800 0x7f27a4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:31.399 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:31.391+0000 7f27b959a640 1 --2- 172.21.15.88:0/1775122275 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f27a40051c0 0x7f27a400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:31.399 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:31.391+0000 7f27b959a640 1 -- 172.21.15.88:0/1775122275 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f27bc0701f0 con 0x7f27a4004800 2024-04-26T23:45:31.399 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:31.391+0000 7f27b959a640 1 -- 172.21.15.88:0/1775122275 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f27a400c090 con 0x7f27a40039e0 2024-04-26T23:45:31.399 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:31.391+0000 7f27b959a640 1 -- 172.21.15.88:0/1775122275 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f27a400c260 con 0x7f27a40051c0 2024-04-26T23:45:31.400 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:31.391+0000 7f27ba59c640 1 -- 172.21.15.88:0/1775122275 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f27a40039e0 msgr2=0x7f27a4003de0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.175:3300/0 2024-04-26T23:45:31.400 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:31.391+0000 7f27ba59c640 1 --2- 172.21.15.88:0/1775122275 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f27a40039e0 0x7f27a4003de0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:45:31.400 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:31.391+0000 7f27b9d9b640 1 --2- 172.21.15.88:0/1775122275 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f27a4004800 0x7f27a4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:31.400 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:31.391+0000 7f27b9d9b640 1 -- 172.21.15.88:0/1775122275 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f27a40051c0 msgr2=0x7f27a400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:45:31.400 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:31.392+0000 7f27b9d9b640 1 --2- 172.21.15.88:0/1775122275 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f27a40051c0 0x7f27a400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:31.400 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:31.392+0000 7f27b9d9b640 1 -- 172.21.15.88:0/1775122275 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f27a40039e0 msgr2=0x7f27a4003de0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T23:45:31.400 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:31.392+0000 7f27b9d9b640 1 --2- 172.21.15.88:0/1775122275 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f27a40039e0 0x7f27a4003de0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:31.400 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:31.392+0000 7f27b9d9b640 1 -- 172.21.15.88:0/1775122275 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27a4003520 con 0x7f27a4004800 2024-04-26T23:45:31.400 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:31.393+0000 7f27b9d9b640 1 --2- 172.21.15.88:0/1775122275 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f27a4004800 0x7f27a4004c80 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f27ac00c370 tx=0x7f27a4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ba9936a0575a1bb server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:31.400 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:31.393+0000 7f27b959a640 1 -- 172.21.15.88:0/1775122275 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27ac007c40 con 0x7f27a4004800 2024-04-26T23:45:31.400 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:31.393+0000 7f27b959a640 1 -- 172.21.15.88:0/1775122275 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27ac034070 con 0x7f27a4004800 2024-04-26T23:45:31.400 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:31.394+0000 7f27c08e3640 1 -- 172.21.15.88:0/1775122275 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f27a4004800 msgr2=0x7f27a4004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:31.400 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:31.394+0000 7f27c08e3640 1 --2- 172.21.15.88:0/1775122275 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f27a4004800 0x7f27a4004c80 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f27ac00c370 tx=0x7f27a4005830 comp rx=0 tx=0).stop 2024-04-26T23:45:31.401 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:31.394+0000 7f27bad9d640 1 -- 172.21.15.88:0/1775122275 reap_dead start 2024-04-26T23:45:31.404 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:31.396+0000 7f27c08e3640 1 -- 172.21.15.88:0/1775122275 shutdown_connections 2024-04-26T23:45:31.404 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:31.396+0000 7f27c08e3640 1 -- 172.21.15.88:0/1775122275 >> 172.21.15.88:0/1775122275 conn(0x7f27bc0c5ce0 msgr2=0x7f27bc0c60f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:31.404 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:31.400+0000 7f27c08e3640 1 -- 172.21.15.88:0/1775122275 shutdown_connections 2024-04-26T23:45:31.404 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:31.400+0000 7f27c08e3640 1 -- 172.21.15.88:0/1775122275 wait complete. 2024-04-26T23:45:31.409 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:31.402+0000 7f27c08e3640 1 Processor -- start 2024-04-26T23:45:31.409 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:31.402+0000 7f27c08e3640 1 -- start start 2024-04-26T23:45:31.409 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:31.403+0000 7f27c08e3640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f27a4004800 0x7f27bc13f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:31.409 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:31.403+0000 7f27c08e3640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f27bc0c7f80 0x7f27bc13fef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:31.409 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:31.403+0000 7f27c08e3640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f27bc0c4e10 0x7f27bc0c5290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:31.409 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:31.403+0000 7f27c08e3640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f27bc15f550 con 0x7f27a4004800 2024-04-26T23:45:31.409 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:31.403+0000 7f27c08e3640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f27bc15f0c0 con 0x7f27bc0c4e10 2024-04-26T23:45:31.410 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:31.403+0000 7f27c08e3640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f27bc0c8820 con 0x7f27bc0c7f80 2024-04-26T23:45:31.410 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:31.404+0000 7f27ba59c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f27a4004800 0x7f27bc13f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:31.410 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:31.404+0000 7f27bad9d640 1 -- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f27bc0c4e10 msgr2=0x7f27bc0c5290 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.175:3300/0 2024-04-26T23:45:31.410 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:31.404+0000 7f27bad9d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f27bc0c4e10 0x7f27bc0c5290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:45:31.410 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:31.404+0000 7f27ba59c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f27a4004800 0x7f27bc13f9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:42420/0 (socket says 172.21.15.88:42420) 2024-04-26T23:45:31.410 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:31.404+0000 7f27ba59c640 1 -- 172.21.15.88:0/4034891580 learned_addr learned my addr 172.21.15.88:0/4034891580 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:45:31.410 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:31.404+0000 7f27b9d9b640 1 --2- 172.21.15.88:0/4034891580 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f27bc0c7f80 0x7f27bc13fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:31.410 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:31.404+0000 7f27ba59c640 1 -- 172.21.15.88:0/4034891580 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f27bc0c7f80 msgr2=0x7f27bc13fef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:31.410 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:31.404+0000 7f27ba59c640 1 --2- 172.21.15.88:0/4034891580 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f27bc0c7f80 0x7f27bc13fef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:31.410 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:31.404+0000 7f27ba59c640 1 -- 172.21.15.88:0/4034891580 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f27bc0c4e10 msgr2=0x7f27bc0c5290 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T23:45:31.410 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:31.404+0000 7f27ba59c640 1 --2- 172.21.15.88:0/4034891580 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f27bc0c4e10 0x7f27bc0c5290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:31.410 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:31.404+0000 7f27ba59c640 1 -- 172.21.15.88:0/4034891580 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27bc0c7120 con 0x7f27a4004800 2024-04-26T23:45:31.410 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:31.405+0000 7f27ba59c640 1 --2- 172.21.15.88:0/4034891580 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f27a4004800 0x7f27bc13f9b0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f27b000b780 tx=0x7f27b000bc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:31.411 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:31.406+0000 7f27aaffd640 1 -- 172.21.15.88:0/4034891580 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27b0003bb0 con 0x7f27a4004800 2024-04-26T23:45:31.411 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:31.406+0000 7f27c08e3640 1 -- 172.21.15.88:0/4034891580 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27bc0c57d0 con 0x7f27a4004800 2024-04-26T23:45:31.411 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:31.406+0000 7f27c08e3640 1 -- 172.21.15.88:0/4034891580 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27bc0c8a70 con 0x7f27a4004800 2024-04-26T23:45:31.412 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:31.406+0000 7f27aaffd640 1 -- 172.21.15.88:0/4034891580 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27b0032070 con 0x7f27a4004800 2024-04-26T23:45:31.412 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:31.406+0000 7f27aaffd640 1 -- 172.21.15.88:0/4034891580 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27b0005070 con 0x7f27a4004800 2024-04-26T23:45:31.417 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:31.410+0000 7f27c08e3640 1 -- 172.21.15.88:0/4034891580 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f27a0005290 con 0x7f27a4004800 2024-04-26T23:45:31.423 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:31.419+0000 7f27aaffd640 1 -- 172.21.15.88:0/4034891580 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f27b0005210 con 0x7f27a4004800 2024-04-26T23:45:31.423 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:31.419+0000 7f27aaffd640 1 --2- 172.21.15.88:0/4034891580 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f279c06c9f0 0x7f279c06eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:31.424 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:31.420+0000 7f27aaffd640 1 -- 172.21.15.88:0/4034891580 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6666+0+0 (secure 0 0 0) 0x7f27b00ad470 con 0x7f27a4004800 2024-04-26T23:45:31.424 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:31.420+0000 7f27b9d9b640 1 --2- 172.21.15.88:0/4034891580 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f279c06c9f0 0x7f279c06eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:31.425 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:31.421+0000 7f27b9d9b640 1 --2- 172.21.15.88:0/4034891580 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f279c06c9f0 0x7f279c06eeb0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f27ac033000 tx=0x7f27ac009030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:31.431 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:31.423+0000 7f27aaffd640 1 -- 172.21.15.88:0/4034891580 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f27b007b550 con 0x7f27a4004800 2024-04-26T23:45:31.974 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:31.969+0000 7f27c08e3640 1 -- 172.21.15.88:0/4034891580 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f27a0005580 con 0x7f27a4004800 2024-04-26T23:45:31.974 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:31.970+0000 7f27aaffd640 1 -- 172.21.15.88:0/4034891580 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1565 (secure 0 0 0) 0x7f27b007ae50 con 0x7f27a4004800 2024-04-26T23:45:31.975 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":54,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":15,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"555255e9-7ef9-4454-8dc9-35e96b70035c","modified":"2024-04-26T23:39:34.291658Z","created":"2024-04-26T23:39:34.291658Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:3300","nonce":0},{"type":"v1","addr":"172.21.15.175:6789","nonce":0}]},"addr":"172.21.15.175:6789/0","public_addr":"172.21.15.175:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:3301","nonce":0},{"type":"v1","addr":"172.21.15.175:6790","nonce":0}]},"addr":"172.21.15.175:6790/0","public_addr":"172.21.15.175:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-04-26T23:45:31.978 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:31.974+0000 7f27c08e3640 1 -- 172.21.15.88:0/4034891580 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f279c06c9f0 msgr2=0x7f279c06eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:31.978 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:31.974+0000 7f27c08e3640 1 --2- 172.21.15.88:0/4034891580 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f279c06c9f0 0x7f279c06eeb0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f27ac033000 tx=0x7f27ac009030 comp rx=0 tx=0).stop 2024-04-26T23:45:31.978 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:31.974+0000 7f27c08e3640 1 -- 172.21.15.88:0/4034891580 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f27a4004800 msgr2=0x7f27bc13f9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:31.978 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:31.974+0000 7f27c08e3640 1 --2- 172.21.15.88:0/4034891580 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f27a4004800 0x7f27bc13f9b0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f27b000b780 tx=0x7f27b000bc40 comp rx=0 tx=0).stop 2024-04-26T23:45:31.979 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:31.974+0000 7f27c08e3640 1 -- 172.21.15.88:0/4034891580 shutdown_connections 2024-04-26T23:45:31.979 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:31.974+0000 7f27c08e3640 1 --2- 172.21.15.88:0/4034891580 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f279c06c9f0 0x7f279c06eeb0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:31.979 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:31.974+0000 7f27c08e3640 1 --2- 172.21.15.88:0/4034891580 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f27bc0c7f80 0x7f27bc13fef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:31.979 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:31.974+0000 7f27c08e3640 1 --2- 172.21.15.88:0/4034891580 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f27bc0c4e10 0x7f27bc0c5290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:31.979 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:31.974+0000 7f27c08e3640 1 --2- 172.21.15.88:0/4034891580 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f27a4004800 0x7f27bc13f9b0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:31.979 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:31.974+0000 7f27c08e3640 1 -- 172.21.15.88:0/4034891580 >> 172.21.15.88:0/4034891580 conn(0x7f27bc0c5ce0 msgr2=0x7f27bc0756f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:31.980 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:31.976+0000 7f27c08e3640 1 -- 172.21.15.88:0/4034891580 shutdown_connections 2024-04-26T23:45:31.981 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:31.977+0000 7f27c08e3640 1 -- 172.21.15.88:0/4034891580 wait complete. 2024-04-26T23:45:34.195 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:45:34.200 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:45:35.002 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-04-26T23:45:35.179 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:35.174+0000 7f378b59e640 1 Processor -- start 2024-04-26T23:45:35.179 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:35.175+0000 7f378b59e640 1 -- start start 2024-04-26T23:45:35.181 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:35.176+0000 7f378a59c640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f378c150170 0x7f378c1568f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:40150/0 (socket says 172.21.15.88:40150) 2024-04-26T23:45:35.181 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:35.176+0000 7f378a59c640 1 -- 172.21.15.88:0/2406251212 learned_addr learned my addr 172.21.15.88:0/2406251212 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-26T23:45:35.181 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:35.176+0000 7f378b59e640 1 --2- 172.21.15.88:0/2406251212 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f378c06d520 0x7f378c0abe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:35.182 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:35.176+0000 7f378b59e640 1 -- 172.21.15.88:0/2406251212 --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f378c157000 con 0x7f378c150170 2024-04-26T23:45:35.182 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:35.177+0000 7f378b59e640 1 -- 172.21.15.88:0/2406251212 --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f378c0ab420 con 0x7f378c0ac340 2024-04-26T23:45:35.182 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:35.177+0000 7f378b59e640 1 -- 172.21.15.88:0/2406251212 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f378c156180 con 0x7f378c06d520 2024-04-26T23:45:35.182 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:35.177+0000 7f378959a640 1 -- 172.21.15.88:0/2406251212 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 811138816 0 0) 0x7f378c157000 con 0x7f378c150170 2024-04-26T23:45:35.182 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:35.177+0000 7f378959a640 1 -- 172.21.15.88:0/2406251212 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3774003520 con 0x7f378c150170 2024-04-26T23:45:35.182 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:35.177+0000 7f378ad9d640 1 -- 172.21.15.88:0/2406251212 >> v1:172.21.15.175:6789/0 conn(0x7f378c0ac340 legacy=0x7f378c15d510 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.175:6789/0 2024-04-26T23:45:35.182 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:35.177+0000 7f3789d9b640 1 --2- 172.21.15.88:0/2406251212 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f378c06d520 0x7f378c0abe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:35.184 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:35.178+0000 7f378959a640 1 -- 172.21.15.88:0/2406251212 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 526053173 0 0) 0x7f3774003520 con 0x7f378c150170 2024-04-26T23:45:35.184 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:35.178+0000 7f378959a640 1 -- 172.21.15.88:0/2406251212 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f378c06d520 msgr2=0x7f378c0abe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:45:35.184 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:35.178+0000 7f378959a640 1 --2- 172.21.15.88:0/2406251212 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f378c06d520 0x7f378c0abe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:35.184 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:35.178+0000 7f378959a640 1 -- 172.21.15.88:0/2406251212 >> v1:172.21.15.175:6789/0 conn(0x7f378c0ac340 legacy=0x7f378c15d510 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T23:45:35.184 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:35.178+0000 7f378959a640 1 -- 172.21.15.88:0/2406251212 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f378c0ab700 con 0x7f378c150170 2024-04-26T23:45:35.184 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:35.178+0000 7f378959a640 1 -- 172.21.15.88:0/2406251212 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 356324787 0 0) 0x7f3780001670 con 0x7f378c150170 2024-04-26T23:45:35.184 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:35.178+0000 7f378959a640 1 -- 172.21.15.88:0/2406251212 >> v1:172.21.15.88:6789/0 conn(0x7f378c150170 legacy=0x7f378c1568f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:35.185 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:35.178+0000 7f378959a640 1 --2- 172.21.15.88:0/2406251212 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f37740039e0 0x7f3774003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:35.185 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:35.178+0000 7f378959a640 1 --2- 172.21.15.88:0/2406251212 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3774004800 0x7f3774004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:35.185 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:35.178+0000 7f378959a640 1 --2- 172.21.15.88:0/2406251212 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f37740052c0 0x7f37740079a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:35.185 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:35.178+0000 7f378959a640 1 -- 172.21.15.88:0/2406251212 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f378c156180 con 0x7f37740039e0 2024-04-26T23:45:35.185 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:35.178+0000 7f378959a640 1 -- 172.21.15.88:0/2406251212 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f3774008170 con 0x7f3774004800 2024-04-26T23:45:35.185 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:35.178+0000 7f378959a640 1 -- 172.21.15.88:0/2406251212 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f3774008370 con 0x7f37740052c0 2024-04-26T23:45:35.185 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:35.179+0000 7f378a59c640 1 --2- 172.21.15.88:0/2406251212 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f37740039e0 0x7f3774003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:35.185 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:35.179+0000 7f378ad9d640 1 --2- 172.21.15.88:0/2406251212 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f37740052c0 0x7f37740079a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:35.185 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:35.179+0000 7f3789d9b640 1 -- 172.21.15.88:0/2406251212 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3774004800 msgr2=0x7f3774004c80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.175:3300/0 2024-04-26T23:45:35.185 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:35.179+0000 7f3789d9b640 1 --2- 172.21.15.88:0/2406251212 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3774004800 0x7f3774004c80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:45:35.186 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:35.180+0000 7f378a59c640 1 -- 172.21.15.88:0/2406251212 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f37740052c0 msgr2=0x7f37740079a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:45:35.186 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:35.180+0000 7f378a59c640 1 --2- 172.21.15.88:0/2406251212 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f37740052c0 0x7f37740079a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:35.186 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:35.180+0000 7f378a59c640 1 -- 172.21.15.88:0/2406251212 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3774004800 msgr2=0x7f3774004c80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T23:45:35.186 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:35.180+0000 7f378a59c640 1 --2- 172.21.15.88:0/2406251212 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3774004800 0x7f3774004c80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:35.186 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:35.180+0000 7f378a59c640 1 -- 172.21.15.88:0/2406251212 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3774003520 con 0x7f37740039e0 2024-04-26T23:45:35.187 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:35.181+0000 7f378a59c640 1 --2- 172.21.15.88:0/2406251212 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f37740039e0 0x7f3774003de0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f378000c110 tx=0x7f3774005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b85fc64a4e49c7 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:35.187 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:35.183+0000 7f378959a640 1 -- 172.21.15.88:0/2406251212 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3780007c40 con 0x7f37740039e0 2024-04-26T23:45:35.187 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:35.183+0000 7f378959a640 1 -- 172.21.15.88:0/2406251212 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3780005ad0 con 0x7f37740039e0 2024-04-26T23:45:35.187 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:35.183+0000 7f378959a640 1 -- 172.21.15.88:0/2406251212 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3780007070 con 0x7f37740039e0 2024-04-26T23:45:35.188 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:35.184+0000 7f378b59e640 1 -- 172.21.15.88:0/2406251212 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f37740039e0 msgr2=0x7f3774003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:35.188 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:35.184+0000 7f378b59e640 1 --2- 172.21.15.88:0/2406251212 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f37740039e0 0x7f3774003de0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f378000c110 tx=0x7f3774005830 comp rx=0 tx=0).stop 2024-04-26T23:45:35.188 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:35.184+0000 7f378ad9d640 1 -- 172.21.15.88:0/2406251212 reap_dead start 2024-04-26T23:45:35.189 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:35.184+0000 7f378b59e640 1 -- 172.21.15.88:0/2406251212 shutdown_connections 2024-04-26T23:45:35.189 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:35.184+0000 7f378b59e640 1 -- 172.21.15.88:0/2406251212 >> 172.21.15.88:0/2406251212 conn(0x7f378c0c4cd0 msgr2=0x7f378c0c50b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:35.189 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:35.185+0000 7f378b59e640 1 -- 172.21.15.88:0/2406251212 shutdown_connections 2024-04-26T23:45:35.192 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:35.185+0000 7f378b59e640 1 -- 172.21.15.88:0/2406251212 wait complete. 2024-04-26T23:45:35.192 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:35.187+0000 7f378b59e640 1 Processor -- start 2024-04-26T23:45:35.192 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:35.187+0000 7f378b59e640 1 -- start start 2024-04-26T23:45:35.193 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:35.188+0000 7f378b59e640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f378c153410 0x7f378c072d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:35.194 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:35.188+0000 7f378b59e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f378c0732d0 0x7f378c150cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:35.194 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:35.188+0000 7f378b59e640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f378c073750 0x7f378c151200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:35.194 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:35.188+0000 7f378a59c640 1 -- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f378c153410 msgr2=0x7f378c072d90 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.175:3300/0 2024-04-26T23:45:35.194 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:35.188+0000 7f378a59c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f378c153410 0x7f378c072d90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:45:35.194 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:35.188+0000 7f378b59e640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f378c0ad6a0 con 0x7f378c073750 2024-04-26T23:45:35.194 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:35.189+0000 7f378b59e640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f378c156460 con 0x7f378c153410 2024-04-26T23:45:35.194 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:35.189+0000 7f378b59e640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f378c150550 con 0x7f378c0732d0 2024-04-26T23:45:35.194 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:35.189+0000 7f378ad9d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f378c073750 0x7f378c151200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:35.194 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:35.189+0000 7f378ad9d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f378c073750 0x7f378c151200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:42446/0 (socket says 172.21.15.88:42446) 2024-04-26T23:45:35.194 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:35.189+0000 7f3789d9b640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f378c0732d0 0x7f378c150cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:35.194 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:35.189+0000 7f3789d9b640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f378c0732d0 0x7f378c150cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.88:52354/0 (socket says 172.21.15.88:52354) 2024-04-26T23:45:35.194 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:35.189+0000 7f3789d9b640 1 -- 172.21.15.88:0/168605066 learned_addr learned my addr 172.21.15.88:0/168605066 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:45:35.196 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:35.190+0000 7f378ad9d640 1 -- 172.21.15.88:0/168605066 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f378c0732d0 msgr2=0x7f378c150cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:35.196 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:35.190+0000 7f378ad9d640 1 --2- 172.21.15.88:0/168605066 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f378c0732d0 0x7f378c150cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:35.196 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:35.190+0000 7f378ad9d640 1 -- 172.21.15.88:0/168605066 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f378c153410 msgr2=0x7f378c072d90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T23:45:35.196 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:35.190+0000 7f378ad9d640 1 --2- 172.21.15.88:0/168605066 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f378c153410 0x7f378c072d90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:35.196 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:35.190+0000 7f378ad9d640 1 -- 172.21.15.88:0/168605066 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f378c072760 con 0x7f378c073750 2024-04-26T23:45:35.196 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:35.191+0000 7f378ad9d640 1 --2- 172.21.15.88:0/168605066 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f378c073750 0x7f378c151200 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f378c0c5d70 tx=0x7f377c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:35.196 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:35.191+0000 7f377affd640 1 -- 172.21.15.88:0/168605066 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f377c00cd20 con 0x7f378c073750 2024-04-26T23:45:35.197 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:35.191+0000 7f378b59e640 1 -- 172.21.15.88:0/168605066 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f378c0c6860 con 0x7f378c073750 2024-04-26T23:45:35.197 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:35.191+0000 7f378b59e640 1 -- 172.21.15.88:0/168605066 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f378c0c7670 con 0x7f378c073750 2024-04-26T23:45:35.197 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:35.191+0000 7f377affd640 1 -- 172.21.15.88:0/168605066 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f377c017440 con 0x7f378c073750 2024-04-26T23:45:35.197 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:35.191+0000 7f377affd640 1 -- 172.21.15.88:0/168605066 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f377c00cd20 con 0x7f378c073750 2024-04-26T23:45:35.197 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:35.193+0000 7f378b59e640 1 -- 172.21.15.88:0/168605066 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3770005290 con 0x7f378c073750 2024-04-26T23:45:35.203 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:35.198+0000 7f377affd640 1 -- 172.21.15.88:0/168605066 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f377c0163e0 con 0x7f378c073750 2024-04-26T23:45:35.204 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:35.200+0000 7f377affd640 1 --2- 172.21.15.88:0/168605066 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f376c06caa0 0x7f376c06ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:35.204 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:35.200+0000 7f377affd640 1 -- 172.21.15.88:0/168605066 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6666+0+0 (secure 0 0 0) 0x7f377c08bc70 con 0x7f378c073750 2024-04-26T23:45:35.204 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:35.200+0000 7f378a59c640 1 --2- 172.21.15.88:0/168605066 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f376c06caa0 0x7f376c06ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:35.205 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:35.201+0000 7f378a59c640 1 --2- 172.21.15.88:0/168605066 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f376c06caa0 0x7f376c06ef60 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f3780032000 tx=0x7f3780007000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:35.213 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:35.209+0000 7f377affd640 1 -- 172.21.15.88:0/168605066 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f377c0596a0 con 0x7f378c073750 2024-04-26T23:45:35.756 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:35.752+0000 7f378b59e640 1 -- 172.21.15.88:0/168605066 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f3770005850 con 0x7f378c073750 2024-04-26T23:45:35.757 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:35.753+0000 7f377affd640 1 -- 172.21.15.88:0/168605066 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1565 (secure 0 0 0) 0x7f377c05d9a0 con 0x7f378c073750 2024-04-26T23:45:35.759 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":54,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":19,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"555255e9-7ef9-4454-8dc9-35e96b70035c","modified":"2024-04-26T23:39:34.291658Z","created":"2024-04-26T23:39:34.291658Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:3300","nonce":0},{"type":"v1","addr":"172.21.15.175:6789","nonce":0}]},"addr":"172.21.15.175:6789/0","public_addr":"172.21.15.175:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:3301","nonce":0},{"type":"v1","addr":"172.21.15.175:6790","nonce":0}]},"addr":"172.21.15.175:6790/0","public_addr":"172.21.15.175:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-04-26T23:45:35.764 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:35.759+0000 7f378b59e640 1 -- 172.21.15.88:0/168605066 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f376c06caa0 msgr2=0x7f376c06ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:35.764 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:35.759+0000 7f378b59e640 1 --2- 172.21.15.88:0/168605066 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f376c06caa0 0x7f376c06ef60 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f3780032000 tx=0x7f3780007000 comp rx=0 tx=0).stop 2024-04-26T23:45:35.764 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:35.759+0000 7f378b59e640 1 -- 172.21.15.88:0/168605066 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f378c073750 msgr2=0x7f378c151200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:35.764 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:35.759+0000 7f378b59e640 1 --2- 172.21.15.88:0/168605066 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f378c073750 0x7f378c151200 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f378c0c5d70 tx=0x7f377c00eeb0 comp rx=0 tx=0).stop 2024-04-26T23:45:35.767 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:35.762+0000 7f378b59e640 1 -- 172.21.15.88:0/168605066 shutdown_connections 2024-04-26T23:45:35.767 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:35.762+0000 7f378b59e640 1 --2- 172.21.15.88:0/168605066 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f376c06caa0 0x7f376c06ef60 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:35.767 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:35.762+0000 7f378b59e640 1 --2- 172.21.15.88:0/168605066 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f378c0732d0 0x7f378c150cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:35.767 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:35.762+0000 7f378b59e640 1 --2- 172.21.15.88:0/168605066 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f378c073750 0x7f378c151200 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:35.767 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:35.762+0000 7f378b59e640 1 --2- 172.21.15.88:0/168605066 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f378c153410 0x7f378c072d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:35.767 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:35.762+0000 7f378b59e640 1 -- 172.21.15.88:0/168605066 >> 172.21.15.88:0/168605066 conn(0x7f378c0c4cd0 msgr2=0x7f378c14cc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:35.767 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:35.763+0000 7f378b59e640 1 -- 172.21.15.88:0/168605066 shutdown_connections 2024-04-26T23:45:35.769 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:35.764+0000 7f378b59e640 1 -- 172.21.15.88:0/168605066 wait complete. 2024-04-26T23:45:38.799 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-04-26T23:45:38.979 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:38.972+0000 7f3c1314a640 1 Processor -- start 2024-04-26T23:45:38.980 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:38.972+0000 7f3c1314a640 1 -- start start 2024-04-26T23:45:38.980 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:38.974+0000 7f3c1314a640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f3c0c0cc5f0 0x7f3c0c15f010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:38.980 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:38.974+0000 7f3c1314a640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3c0c0cb830 0x7f3c0c158270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:38.980 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:38.974+0000 7f3c1314a640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f3c0c1587b0 0x7f3c0c0c90e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:38.980 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:38.974+0000 7f3c1314a640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f3c0c158c20 con 0x7f3c0c1587b0 2024-04-26T23:45:38.980 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:38.974+0000 7f3c1314a640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f3c0c0c8c40 con 0x7f3c0c0cc5f0 2024-04-26T23:45:38.980 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:38.974+0000 7f3c1314a640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f3c0c0cbd10 con 0x7f3c0c0cb830 2024-04-26T23:45:38.980 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:38.974+0000 7f3c12949640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f3c0c1587b0 0x7f3c0c0c90e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:38.980 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:38.974+0000 7f3c12148640 1 -- >> v2:172.21.15.175:3300/0 conn(0x7f3c0c0cc5f0 msgr2=0x7f3c0c15f010 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.175:3300/0 2024-04-26T23:45:38.980 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:38.975+0000 7f3c12148640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f3c0c0cc5f0 0x7f3c0c15f010 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:45:38.980 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:38.975+0000 7f3c12949640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f3c0c1587b0 0x7f3c0c0c90e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:55756/0 (socket says 172.21.15.88:55756) 2024-04-26T23:45:38.980 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:38.975+0000 7f3c12949640 1 -- 172.21.15.88:0/1914934348 learned_addr learned my addr 172.21.15.88:0/1914934348 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:45:38.981 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:38.975+0000 7f3c12949640 1 -- 172.21.15.88:0/1914934348 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3c0c0cb830 msgr2=0x7f3c0c158270 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-26T23:45:38.981 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:38.975+0000 7f3c12949640 1 --2- 172.21.15.88:0/1914934348 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3c0c0cb830 0x7f3c0c158270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:38.981 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:38.975+0000 7f3c12949640 1 -- 172.21.15.88:0/1914934348 >> v2:172.21.15.175:3300/0 conn(0x7f3c0c0cc5f0 msgr2=0x7f3c0c15f010 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T23:45:38.981 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:38.975+0000 7f3c12949640 1 --2- 172.21.15.88:0/1914934348 >> v2:172.21.15.175:3300/0 conn(0x7f3c0c0cc5f0 0x7f3c0c15f010 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:38.981 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:38.975+0000 7f3c12949640 1 -- 172.21.15.88:0/1914934348 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c0c0cac10 con 0x7f3c0c1587b0 2024-04-26T23:45:38.981 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:38.976+0000 7f3c12949640 1 --2- 172.21.15.88:0/1914934348 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3c0c1587b0 0x7f3c0c0c90e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f3c0c0ccef0 tx=0x7f3c0402a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8ae711a064fb9bb server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:38.981 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:38.977+0000 7f3c11146640 1 -- 172.21.15.88:0/1914934348 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c04036070 con 0x7f3c0c1587b0 2024-04-26T23:45:38.981 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:38.977+0000 7f3c11146640 1 -- 172.21.15.88:0/1914934348 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c04031600 con 0x7f3c0c1587b0 2024-04-26T23:45:38.981 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:38.977+0000 7f3c11146640 1 -- 172.21.15.88:0/1914934348 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c0402ae60 con 0x7f3c0c1587b0 2024-04-26T23:45:38.983 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:38.978+0000 7f3c1314a640 1 -- 172.21.15.88:0/1914934348 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3c0c1587b0 msgr2=0x7f3c0c0c90e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:38.984 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:38.978+0000 7f3c1314a640 1 --2- 172.21.15.88:0/1914934348 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3c0c1587b0 0x7f3c0c0c90e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f3c0c0ccef0 tx=0x7f3c0402a680 comp rx=0 tx=0).stop 2024-04-26T23:45:38.988 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:38.982+0000 7f3c1314a640 1 -- 172.21.15.88:0/1914934348 shutdown_connections 2024-04-26T23:45:38.988 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:38.982+0000 7f3c1314a640 1 --2- 172.21.15.88:0/1914934348 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3c0c1587b0 0x7f3c0c0c90e0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:38.988 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:38.982+0000 7f3c1314a640 1 --2- 172.21.15.88:0/1914934348 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3c0c0cb830 0x7f3c0c158270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:38.988 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:38.982+0000 7f3c1314a640 1 --2- 172.21.15.88:0/1914934348 >> v2:172.21.15.175:3300/0 conn(0x7f3c0c0cc5f0 0x7f3c0c15f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:38.988 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:38.982+0000 7f3c1314a640 1 -- 172.21.15.88:0/1914934348 >> 172.21.15.88:0/1914934348 conn(0x7f3c0c0ae180 msgr2=0x7f3c0c0ae590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:38.988 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:38.984+0000 7f3c1314a640 1 -- 172.21.15.88:0/1914934348 shutdown_connections 2024-04-26T23:45:38.994 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:38.984+0000 7f3c1314a640 1 -- 172.21.15.88:0/1914934348 wait complete. 2024-04-26T23:45:38.994 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:38.986+0000 7f3c1314a640 1 Processor -- start 2024-04-26T23:45:38.994 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:38.986+0000 7f3c1314a640 1 -- start start 2024-04-26T23:45:38.994 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:38.987+0000 7f3c1314a640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3c0c0cb830 0x7f3c0c141d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:38.994 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:38.987+0000 7f3c1314a640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3c0c0cc5f0 0x7f3c0c1429b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:38.994 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:38.987+0000 7f3c1314a640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3c0c1587b0 0x7f3c0c13de00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:38.994 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:38.987+0000 7f3c1314a640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f3c0c0bfad0 con 0x7f3c0c0cb830 2024-04-26T23:45:38.994 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:38.987+0000 7f3c1314a640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f3c0c0cb1d0 con 0x7f3c0c0cc5f0 2024-04-26T23:45:38.994 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:38.987+0000 7f3c1314a640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f3c0c0bfc50 con 0x7f3c0c1587b0 2024-04-26T23:45:38.994 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:38.988+0000 7f3c12949640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3c0c1587b0 0x7f3c0c13de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:38.994 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:38.988+0000 7f3c12949640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3c0c1587b0 0x7f3c0c13de00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.88:55872/0 (socket says 172.21.15.88:55872) 2024-04-26T23:45:38.995 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:38.988+0000 7f3c12949640 1 -- 172.21.15.88:0/1580676638 learned_addr learned my addr 172.21.15.88:0/1580676638 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:45:38.995 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:38.988+0000 7f3c12949640 1 -- 172.21.15.88:0/1580676638 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3c0c0cc5f0 msgr2=0x7f3c0c1429b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T23:45:38.995 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:38.988+0000 7f3c12949640 1 --2- 172.21.15.88:0/1580676638 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3c0c0cc5f0 0x7f3c0c1429b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:38.995 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:38.988+0000 7f3c12949640 1 -- 172.21.15.88:0/1580676638 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3c0c0cb830 msgr2=0x7f3c0c141d70 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T23:45:38.995 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:38.988+0000 7f3c12949640 1 --2- 172.21.15.88:0/1580676638 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3c0c0cb830 0x7f3c0c141d70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:38.995 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:38.988+0000 7f3c12949640 1 -- 172.21.15.88:0/1580676638 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c0c0b1f90 con 0x7f3c0c1587b0 2024-04-26T23:45:38.995 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:38.989+0000 7f3c12949640 1 --2- 172.21.15.88:0/1580676638 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3c0c1587b0 0x7f3c0c13de00 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f3c040093e0 tx=0x7f3c04004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:38.995 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:38.989+0000 7f3c02ffd640 1 -- 172.21.15.88:0/1580676638 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c04041020 con 0x7f3c0c1587b0 2024-04-26T23:45:38.995 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:38.989+0000 7f3c02ffd640 1 -- 172.21.15.88:0/1580676638 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c04037040 con 0x7f3c0c1587b0 2024-04-26T23:45:38.995 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:38.989+0000 7f3c1314a640 1 -- 172.21.15.88:0/1580676638 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c0c1430c0 con 0x7f3c0c1587b0 2024-04-26T23:45:38.995 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:38.989+0000 7f3c1314a640 1 -- 172.21.15.88:0/1580676638 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c0c0adbd0 con 0x7f3c0c1587b0 2024-04-26T23:45:38.995 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:38.990+0000 7f3c02ffd640 1 -- 172.21.15.88:0/1580676638 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c04036070 con 0x7f3c0c1587b0 2024-04-26T23:45:38.996 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:38.992+0000 7f3c02ffd640 1 -- 172.21.15.88:0/1580676638 <== mon.2 v2:172.21.15.175:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f3c04044020 con 0x7f3c0c1587b0 2024-04-26T23:45:38.997 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:38.993+0000 7f3c02ffd640 1 --2- 172.21.15.88:0/1580676638 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f3bf006c8f0 0x7f3bf006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:38.997 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:38.993+0000 7f3c02ffd640 1 -- 172.21.15.88:0/1580676638 <== mon.2 v2:172.21.15.175:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6666+0+0 (secure 0 0 0) 0x7f3c040aca50 con 0x7f3c0c1587b0 2024-04-26T23:45:38.997 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:38.993+0000 7f3c1314a640 1 -- 172.21.15.88:0/1580676638 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3bf4005290 con 0x7f3c0c1587b0 2024-04-26T23:45:38.998 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:38.994+0000 7f3c12148640 1 --2- 172.21.15.88:0/1580676638 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f3bf006c8f0 0x7f3bf006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:38.998 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:38.994+0000 7f3c12148640 1 --2- 172.21.15.88:0/1580676638 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f3bf006c8f0 0x7f3bf006edb0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f3c0c15e000 tx=0x7f3bfc006c80 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:39.007 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:39.002+0000 7f3c02ffd640 1 -- 172.21.15.88:0/1580676638 <== mon.2 v2:172.21.15.175:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f3c0404b030 con 0x7f3c0c1587b0 2024-04-26T23:45:39.546 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:39.541+0000 7f3c1314a640 1 -- 172.21.15.88:0/1580676638 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f3bf4005580 con 0x7f3c0c1587b0 2024-04-26T23:45:39.549 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:39.545+0000 7f3c02ffd640 1 -- 172.21.15.88:0/1580676638 <== mon.2 v2:172.21.15.175:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1565 (secure 0 0 0) 0x7f3c0407aaf0 con 0x7f3c0c1587b0 2024-04-26T23:45:39.554 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":54,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":23,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"555255e9-7ef9-4454-8dc9-35e96b70035c","modified":"2024-04-26T23:39:34.291658Z","created":"2024-04-26T23:39:34.291658Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:3300","nonce":0},{"type":"v1","addr":"172.21.15.175:6789","nonce":0}]},"addr":"172.21.15.175:6789/0","public_addr":"172.21.15.175:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:3301","nonce":0},{"type":"v1","addr":"172.21.15.175:6790","nonce":0}]},"addr":"172.21.15.175:6790/0","public_addr":"172.21.15.175:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-04-26T23:45:39.557 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:39.553+0000 7f3c1314a640 1 -- 172.21.15.88:0/1580676638 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f3bf006c8f0 msgr2=0x7f3bf006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:39.557 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:39.553+0000 7f3c1314a640 1 --2- 172.21.15.88:0/1580676638 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f3bf006c8f0 0x7f3bf006edb0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f3c0c15e000 tx=0x7f3bfc006c80 comp rx=0 tx=0).stop 2024-04-26T23:45:39.558 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:39.553+0000 7f3c1314a640 1 -- 172.21.15.88:0/1580676638 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3c0c1587b0 msgr2=0x7f3c0c13de00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:39.558 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:39.553+0000 7f3c1314a640 1 --2- 172.21.15.88:0/1580676638 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3c0c1587b0 0x7f3c0c13de00 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f3c040093e0 tx=0x7f3c04004a40 comp rx=0 tx=0).stop 2024-04-26T23:45:39.558 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:39.553+0000 7f3c1314a640 1 -- 172.21.15.88:0/1580676638 shutdown_connections 2024-04-26T23:45:39.558 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:39.553+0000 7f3c1314a640 1 --2- 172.21.15.88:0/1580676638 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f3bf006c8f0 0x7f3bf006edb0 secure :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f3c0c15e000 tx=0x7f3bfc006c80 comp rx=0 tx=0).stop 2024-04-26T23:45:39.558 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:39.553+0000 7f3c1314a640 1 --2- 172.21.15.88:0/1580676638 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3c0c1587b0 0x7f3c0c13de00 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:39.558 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:39.553+0000 7f3c1314a640 1 --2- 172.21.15.88:0/1580676638 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3c0c0cc5f0 0x7f3c0c1429b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:39.558 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:39.553+0000 7f3c1314a640 1 --2- 172.21.15.88:0/1580676638 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3c0c0cb830 0x7f3c0c141d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:39.558 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:39.553+0000 7f3c1314a640 1 -- 172.21.15.88:0/1580676638 >> 172.21.15.88:0/1580676638 conn(0x7f3c0c0ae180 msgr2=0x7f3c0c148030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:39.558 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:39.554+0000 7f3c1314a640 1 -- 172.21.15.88:0/1580676638 shutdown_connections 2024-04-26T23:45:39.559 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:39.554+0000 7f3c1314a640 1 -- 172.21.15.88:0/1580676638 wait complete. 2024-04-26T23:45:42.581 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-04-26T23:45:42.751 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:42.746+0000 7f5d24df0640 1 Processor -- start 2024-04-26T23:45:42.753 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:42.747+0000 7f5d24df0640 1 -- start start 2024-04-26T23:45:42.753 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:42.748+0000 7f5d24df0640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f5d200bfbb0 0x7f5d2015bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:42.753 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:42.748+0000 7f5d24df0640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f5d200c6e00 0x7f5d20158510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:42.753 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:42.748+0000 7f5d24df0640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5d200cbde0 con 0x7f5d200c90c0 2024-04-26T23:45:42.753 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:42.748+0000 7f5d24df0640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f5d2015c150 con 0x7f5d200bfbb0 2024-04-26T23:45:42.754 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:42.748+0000 7f5d24df0640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f5d200ca380 con 0x7f5d200c6e00 2024-04-26T23:45:42.754 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:42.748+0000 7f5d1e59c640 1 -- >> v1:172.21.15.175:6789/0 conn(0x7f5d200c90c0 legacy=0x7f5d200cadd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.175:6789/0 2024-04-26T23:45:42.754 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:42.749+0000 7f5d1dd9b640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f5d200bfbb0 0x7f5d2015bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:42.754 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:42.749+0000 7f5d1dd9b640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f5d200bfbb0 0x7f5d2015bc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:55770/0 (socket says 172.21.15.88:55770) 2024-04-26T23:45:42.754 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:42.749+0000 7f5d1dd9b640 1 -- 172.21.15.88:0/1480588464 learned_addr learned my addr 172.21.15.88:0/1480588464 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:45:42.754 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:42.749+0000 7f5d1ed9d640 1 -- 172.21.15.88:0/1480588464 >> v2:172.21.15.175:3300/0 conn(0x7f5d200c6e00 msgr2=0x7f5d20158510 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.175:3300/0 2024-04-26T23:45:42.754 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:42.749+0000 7f5d1ed9d640 1 --2- 172.21.15.88:0/1480588464 >> v2:172.21.15.175:3300/0 conn(0x7f5d200c6e00 0x7f5d20158510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:45:42.754 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:42.749+0000 7f5d1dd9b640 1 -- 172.21.15.88:0/1480588464 >> v2:172.21.15.88:3300/0 conn(0x7f5d200bfbb0 msgr2=0x7f5d2015bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-26T23:45:42.754 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:42.749+0000 7f5d1dd9b640 1 -- 172.21.15.88:0/1480588464 >> v2:172.21.15.88:3300/0 conn(0x7f5d200bfbb0 msgr2=0x7f5d2015bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T23:45:42.754 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:42.749+0000 7f5d1dd9b640 1 --2- 172.21.15.88:0/1480588464 >> v2:172.21.15.88:3300/0 conn(0x7f5d200bfbb0 0x7f5d2015bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:45:42.754 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:42.749+0000 7f5d1dd9b640 1 --2- 172.21.15.88:0/1480588464 >> v2:172.21.15.88:3300/0 conn(0x7f5d200bfbb0 0x7f5d2015bc10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:45:42.954 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:42.950+0000 7f5d1ed9d640 1 -- 172.21.15.88:0/1480588464 >> v2:172.21.15.175:3300/0 conn(0x7f5d200c6e00 msgr2=0x7f5d20158510 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.175:3300/0 2024-04-26T23:45:42.955 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:42.950+0000 7f5d1ed9d640 1 --2- 172.21.15.88:0/1480588464 >> v2:172.21.15.175:3300/0 conn(0x7f5d200c6e00 0x7f5d20158510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-26T23:45:42.955 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:42.950+0000 7f5d1dd9b640 1 --2- 172.21.15.88:0/1480588464 >> v2:172.21.15.88:3300/0 conn(0x7f5d200bfbb0 0x7f5d2015bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:42.955 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:42.950+0000 7f5d1dd9b640 1 -- 172.21.15.88:0/1480588464 >> v2:172.21.15.88:3300/0 conn(0x7f5d200bfbb0 msgr2=0x7f5d2015bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-26T23:45:42.955 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:42.950+0000 7f5d1dd9b640 1 -- 172.21.15.88:0/1480588464 >> v2:172.21.15.88:3300/0 conn(0x7f5d200bfbb0 msgr2=0x7f5d2015bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T23:45:42.955 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:42.950+0000 7f5d1dd9b640 1 --2- 172.21.15.88:0/1480588464 >> v2:172.21.15.88:3300/0 conn(0x7f5d200bfbb0 0x7f5d2015bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:45:42.955 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:42.950+0000 7f5d1dd9b640 1 --2- 172.21.15.88:0/1480588464 >> v2:172.21.15.88:3300/0 conn(0x7f5d200bfbb0 0x7f5d2015bc10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-26T23:45:42.955 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:42.950+0000 7f5d1e59c640 1 -- 172.21.15.88:0/1480588464 >> v1:172.21.15.175:6789/0 conn(0x7f5d200c90c0 legacy=0x7f5d200cadd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.175:6789/0 2024-04-26T23:45:43.355 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:43.351+0000 7f5d1ed9d640 1 -- 172.21.15.88:0/1480588464 >> v2:172.21.15.175:3300/0 conn(0x7f5d200c6e00 msgr2=0x7f5d20158510 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.175:3300/0 2024-04-26T23:45:43.356 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:43.351+0000 7f5d1ed9d640 1 --2- 172.21.15.88:0/1480588464 >> v2:172.21.15.175:3300/0 conn(0x7f5d200c6e00 0x7f5d20158510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-26T23:45:43.356 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:43.351+0000 7f5d1dd9b640 1 --2- 172.21.15.88:0/1480588464 >> v2:172.21.15.88:3300/0 conn(0x7f5d200bfbb0 0x7f5d2015bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:43.356 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:43.351+0000 7f5d1dd9b640 1 -- 172.21.15.88:0/1480588464 >> v2:172.21.15.88:3300/0 conn(0x7f5d200bfbb0 msgr2=0x7f5d2015bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-26T23:45:43.356 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:43.351+0000 7f5d1dd9b640 1 -- 172.21.15.88:0/1480588464 >> v2:172.21.15.88:3300/0 conn(0x7f5d200bfbb0 msgr2=0x7f5d2015bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T23:45:43.356 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:43.351+0000 7f5d1dd9b640 1 --2- 172.21.15.88:0/1480588464 >> v2:172.21.15.88:3300/0 conn(0x7f5d200bfbb0 0x7f5d2015bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:45:43.356 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:43.351+0000 7f5d1dd9b640 1 --2- 172.21.15.88:0/1480588464 >> v2:172.21.15.88:3300/0 conn(0x7f5d200bfbb0 0x7f5d2015bc10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-26T23:45:43.356 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:43.351+0000 7f5d1e59c640 1 -- 172.21.15.88:0/1480588464 >> v1:172.21.15.175:6789/0 conn(0x7f5d200c90c0 legacy=0x7f5d200cadd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.175:6789/0 2024-04-26T23:45:44.157 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:44.152+0000 7f5d1ed9d640 1 -- 172.21.15.88:0/1480588464 >> v2:172.21.15.175:3300/0 conn(0x7f5d200c6e00 msgr2=0x7f5d20158510 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.175:3300/0 2024-04-26T23:45:44.157 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:44.152+0000 7f5d1e59c640 1 -- 172.21.15.88:0/1480588464 >> v1:172.21.15.175:6789/0 conn(0x7f5d200c90c0 legacy=0x7f5d200cadd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.175:6789/0 2024-04-26T23:45:44.157 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:44.152+0000 7f5d1ed9d640 1 --2- 172.21.15.88:0/1480588464 >> v2:172.21.15.175:3300/0 conn(0x7f5d200c6e00 0x7f5d20158510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-26T23:45:44.157 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:44.152+0000 7f5d1dd9b640 1 --2- 172.21.15.88:0/1480588464 >> v2:172.21.15.88:3300/0 conn(0x7f5d200bfbb0 0x7f5d2015bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:44.157 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:44.152+0000 7f5d1dd9b640 1 -- 172.21.15.88:0/1480588464 >> v2:172.21.15.88:3300/0 conn(0x7f5d200bfbb0 msgr2=0x7f5d2015bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-26T23:45:44.158 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:44.152+0000 7f5d1dd9b640 1 -- 172.21.15.88:0/1480588464 >> v2:172.21.15.88:3300/0 conn(0x7f5d200bfbb0 msgr2=0x7f5d2015bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T23:45:44.158 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:44.152+0000 7f5d1dd9b640 1 --2- 172.21.15.88:0/1480588464 >> v2:172.21.15.88:3300/0 conn(0x7f5d200bfbb0 0x7f5d2015bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:45:44.158 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:44.152+0000 7f5d1dd9b640 1 --2- 172.21.15.88:0/1480588464 >> v2:172.21.15.88:3300/0 conn(0x7f5d200bfbb0 0x7f5d2015bc10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-26T23:45:45.753 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:45.748+0000 7f5d0ffff640 1 -- 172.21.15.88:0/1480588464 >> v2:172.21.15.175:3300/0 conn(0x7f5d200c6e00 msgr2=0x7f5d20158510 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T23:45:45.753 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:45.748+0000 7f5d0ffff640 1 --2- 172.21.15.88:0/1480588464 >> v2:172.21.15.175:3300/0 conn(0x7f5d200c6e00 0x7f5d20158510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:45.753 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:45.748+0000 7f5d0ffff640 1 -- 172.21.15.88:0/1480588464 >> v2:172.21.15.88:3300/0 conn(0x7f5d200bfbb0 msgr2=0x7f5d2015bc10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T23:45:45.753 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:45.748+0000 7f5d0ffff640 1 --2- 172.21.15.88:0/1480588464 >> v2:172.21.15.88:3300/0 conn(0x7f5d200bfbb0 0x7f5d2015bc10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:45.753 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:45.748+0000 7f5d0ffff640 1 -- 172.21.15.88:0/1480588464 >> v1:172.21.15.175:6789/0 conn(0x7f5d200c90c0 legacy=0x7f5d200cadd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T23:45:45.753 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:45.748+0000 7f5d0ffff640 1 --2- 172.21.15.88:0/1480588464 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5d00003690 0x7f5d00005ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:45.753 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:45.748+0000 7f5d0ffff640 1 -- 172.21.15.88:0/1480588464 --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5d200cc0c0 con 0x7f5d000061a0 2024-04-26T23:45:45.753 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:45.749+0000 7f5d0ffff640 1 -- 172.21.15.88:0/1480588464 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f5d2015c150 con 0x7f5d00003690 2024-04-26T23:45:45.755 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:45.749+0000 7f5d1d59a640 1 -- 172.21.15.88:0/1480588464 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 621126779 0 0) 0x7f5d200cc0c0 con 0x7f5d000061a0 2024-04-26T23:45:45.755 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:45.749+0000 7f5d1d59a640 1 -- 172.21.15.88:0/1480588464 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5d08003520 con 0x7f5d000061a0 2024-04-26T23:45:45.755 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:45.749+0000 7f5d1d59a640 1 -- 172.21.15.88:0/1480588464 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 360639478 0 0) 0x7f5d08003520 con 0x7f5d000061a0 2024-04-26T23:45:45.755 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:45.749+0000 7f5d1d59a640 1 -- 172.21.15.88:0/1480588464 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5d00003690 msgr2=0x7f5d00005ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:45:45.755 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:45.749+0000 7f5d1d59a640 1 --2- 172.21.15.88:0/1480588464 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5d00003690 0x7f5d00005ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:45.755 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:45.749+0000 7f5d1d59a640 1 -- 172.21.15.88:0/1480588464 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d200cbde0 con 0x7f5d000061a0 2024-04-26T23:45:45.755 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:45.750+0000 7f5d1d59a640 1 -- 172.21.15.88:0/1480588464 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 356324787 0 0) 0x7f5d1000f040 con 0x7f5d000061a0 2024-04-26T23:45:45.756 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:45.750+0000 7f5d1d59a640 1 -- 172.21.15.88:0/1480588464 >> v1:172.21.15.88:6789/0 conn(0x7f5d000061a0 legacy=0x7f5d00008660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:45.756 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:45.750+0000 7f5d1d59a640 1 --2- 172.21.15.88:0/1480588464 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5d080039b0 0x7f5d08003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:45.756 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:45.750+0000 7f5d1d59a640 1 --2- 172.21.15.88:0/1480588464 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5d08004800 0x7f5d08004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:45.756 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:45.750+0000 7f5d1d59a640 1 --2- 172.21.15.88:0/1480588464 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5d08005210 0x7f5d0800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:45.756 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:45.750+0000 7f5d1d59a640 1 -- 172.21.15.88:0/1480588464 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f5d2015c150 con 0x7f5d080039b0 2024-04-26T23:45:45.756 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:45.750+0000 7f5d1d59a640 1 -- 172.21.15.88:0/1480588464 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f5d0800c140 con 0x7f5d08005210 2024-04-26T23:45:45.756 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:45.750+0000 7f5d1d59a640 1 -- 172.21.15.88:0/1480588464 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f5d0800c340 con 0x7f5d08004800 2024-04-26T23:45:45.756 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:45.750+0000 7f5d1ed9d640 1 -- 172.21.15.88:0/1480588464 reap_dead start 2024-04-26T23:45:45.756 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:45.750+0000 7f5d1ed9d640 1 -- 172.21.15.88:0/1480588464 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5d08005210 msgr2=0x7f5d0800b9c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.175:3300/0 2024-04-26T23:45:45.756 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:45.750+0000 7f5d1ed9d640 1 --2- 172.21.15.88:0/1480588464 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5d08005210 0x7f5d0800b9c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:45:45.756 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:45.750+0000 7f5d1dd9b640 1 --2- 172.21.15.88:0/1480588464 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5d08004800 0x7f5d08004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:45.756 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:45.750+0000 7f5d1e59c640 1 --2- 172.21.15.88:0/1480588464 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5d080039b0 0x7f5d08003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:45.756 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:45.750+0000 7f5d1dd9b640 1 -- 172.21.15.88:0/1480588464 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5d08005210 msgr2=0x7f5d0800b9c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T23:45:45.757 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:45.750+0000 7f5d1dd9b640 1 --2- 172.21.15.88:0/1480588464 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5d08005210 0x7f5d0800b9c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:45.757 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:45.750+0000 7f5d1dd9b640 1 -- 172.21.15.88:0/1480588464 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5d080039b0 msgr2=0x7f5d08003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:45:45.757 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:45.750+0000 7f5d1dd9b640 1 --2- 172.21.15.88:0/1480588464 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5d080039b0 0x7f5d08003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:45.757 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:45.750+0000 7f5d1dd9b640 1 -- 172.21.15.88:0/1480588464 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d08003520 con 0x7f5d08004800 2024-04-26T23:45:45.757 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:45.751+0000 7f5d1e59c640 1 --2- 172.21.15.88:0/1480588464 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5d080039b0 0x7f5d08003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:45:45.757 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:45.752+0000 7f5d1dd9b640 1 --2- 172.21.15.88:0/1480588464 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5d08004800 0x7f5d08004c80 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f5d10014780 tx=0x7f5d08005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=58453481ede114b8 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:45.757 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:45.752+0000 7f5d1d59a640 1 -- 172.21.15.88:0/1480588464 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d10039070 con 0x7f5d08004800 2024-04-26T23:45:45.758 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:45.752+0000 7f5d1d59a640 1 -- 172.21.15.88:0/1480588464 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d10034410 con 0x7f5d08004800 2024-04-26T23:45:45.758 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:45.753+0000 7f5d24df0640 1 -- 172.21.15.88:0/1480588464 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5d08004800 msgr2=0x7f5d08004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:45.758 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:45.753+0000 7f5d24df0640 1 --2- 172.21.15.88:0/1480588464 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5d08004800 0x7f5d08004c80 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f5d10014780 tx=0x7f5d08005830 comp rx=0 tx=0).stop 2024-04-26T23:45:45.759 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:45.755+0000 7f5d24df0640 1 -- 172.21.15.88:0/1480588464 shutdown_connections 2024-04-26T23:45:45.759 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:45.755+0000 7f5d24df0640 1 --2- 172.21.15.88:0/1480588464 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5d08004800 0x7f5d08004c80 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:45.759 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:45.755+0000 7f5d24df0640 1 --2- 172.21.15.88:0/1480588464 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5d08005210 0x7f5d0800b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:45.759 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:45.755+0000 7f5d24df0640 1 --2- 172.21.15.88:0/1480588464 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5d080039b0 0x7f5d08003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:45.759 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:45.755+0000 7f5d24df0640 1 -- 172.21.15.88:0/1480588464 >> 172.21.15.88:0/1480588464 conn(0x7f5d200ae010 msgr2=0x7f5d200ae3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:45.760 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:45.755+0000 7f5d24df0640 1 -- 172.21.15.88:0/1480588464 shutdown_connections 2024-04-26T23:45:45.760 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:45.755+0000 7f5d24df0640 1 -- 172.21.15.88:0/1480588464 wait complete. 2024-04-26T23:45:45.762 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:45.757+0000 7f5d24df0640 1 Processor -- start 2024-04-26T23:45:45.762 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:45.757+0000 7f5d24df0640 1 -- start start 2024-04-26T23:45:45.762 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:45.758+0000 7f5d24df0640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5d080039b0 0x7f5d20144860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:45.765 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:45.758+0000 7f5d24df0640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5d08004800 0x7f5d200bdb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:45.765 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:45.758+0000 7f5d24df0640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5d08005210 0x7f5d200be0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:45.765 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:45.758+0000 7f5d24df0640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f5d200c9620 con 0x7f5d08005210 2024-04-26T23:45:45.765 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:45.758+0000 7f5d24df0640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f5d200c94a0 con 0x7f5d08004800 2024-04-26T23:45:45.765 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:45.758+0000 7f5d24df0640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f5d2015bc10 con 0x7f5d080039b0 2024-04-26T23:45:45.765 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:45.758+0000 7f5d1dd9b640 1 -- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5d08004800 msgr2=0x7f5d200bdb70 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.175:3300/0 2024-04-26T23:45:45.765 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:45.758+0000 7f5d1dd9b640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5d08004800 0x7f5d200bdb70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:45:45.765 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:45.759+0000 7f5d1e59c640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5d080039b0 0x7f5d20144860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:45.765 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:45.759+0000 7f5d1e59c640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5d080039b0 0x7f5d20144860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.88:55908/0 (socket says 172.21.15.88:55908) 2024-04-26T23:45:45.766 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:45.759+0000 7f5d1e59c640 1 -- 172.21.15.88:0/1383135142 learned_addr learned my addr 172.21.15.88:0/1383135142 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:45:45.766 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:45.760+0000 7f5d1e59c640 1 -- 172.21.15.88:0/1383135142 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5d08004800 msgr2=0x7f5d200bdb70 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T23:45:45.766 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:45.760+0000 7f5d1e59c640 1 --2- 172.21.15.88:0/1383135142 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5d08004800 0x7f5d200bdb70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:45.766 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:45.760+0000 7f5d1e59c640 1 -- 172.21.15.88:0/1383135142 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5d08005210 msgr2=0x7f5d200be0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:45.766 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:45.760+0000 7f5d1ed9d640 1 --2- 172.21.15.88:0/1383135142 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5d08005210 0x7f5d200be0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:45.766 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:45.760+0000 7f5d1e59c640 1 --2- 172.21.15.88:0/1383135142 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5d08005210 0x7f5d200be0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:45.766 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:45.760+0000 7f5d1e59c640 1 -- 172.21.15.88:0/1383135142 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d2015cdd0 con 0x7f5d080039b0 2024-04-26T23:45:45.766 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:45.760+0000 7f5d1ed9d640 1 --2- 172.21.15.88:0/1383135142 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5d08005210 0x7f5d200be0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:45:45.766 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:45.761+0000 7f5d1e59c640 1 --2- 172.21.15.88:0/1383135142 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5d080039b0 0x7f5d20144860 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f5d1800e850 tx=0x7f5d1800ed10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:45.767 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:45.761+0000 7f5d0effd640 1 -- 172.21.15.88:0/1383135142 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d1800cb30 con 0x7f5d080039b0 2024-04-26T23:45:45.767 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:45.762+0000 7f5d0effd640 1 -- 172.21.15.88:0/1383135142 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d18018070 con 0x7f5d080039b0 2024-04-26T23:45:45.767 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:45.762+0000 7f5d0effd640 1 -- 172.21.15.88:0/1383135142 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d18013480 con 0x7f5d080039b0 2024-04-26T23:45:45.767 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:45.762+0000 7f5d24df0640 1 -- 172.21.15.88:0/1383135142 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d200c6010 con 0x7f5d080039b0 2024-04-26T23:45:45.767 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:45.762+0000 7f5d24df0640 1 -- 172.21.15.88:0/1383135142 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d20145380 con 0x7f5d080039b0 2024-04-26T23:45:45.768 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:45.763+0000 7f5d24df0640 1 -- 172.21.15.88:0/1383135142 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5d20076650 con 0x7f5d080039b0 2024-04-26T23:45:45.768 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:45.764+0000 7f5d0effd640 1 -- 172.21.15.88:0/1383135142 <== mon.2 v2:172.21.15.175:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f5d18013620 con 0x7f5d080039b0 2024-04-26T23:45:45.769 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:45.765+0000 7f5d0effd640 1 --2- 172.21.15.88:0/1383135142 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f5d0006d430 0x7f5d0006f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:45.769 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:45.765+0000 7f5d0effd640 1 -- 172.21.15.88:0/1383135142 <== mon.2 v2:172.21.15.175:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6666+0+0 (secure 0 0 0) 0x7f5d1808c4e0 con 0x7f5d080039b0 2024-04-26T23:45:45.769 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:45.765+0000 7f5d1dd9b640 1 --2- 172.21.15.88:0/1383135142 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f5d0006d430 0x7f5d0006f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:45.770 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:45.766+0000 7f5d1dd9b640 1 --2- 172.21.15.88:0/1383135142 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f5d0006d430 0x7f5d0006f8f0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f5d10036000 tx=0x7f5d10030000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:45.778 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:45.774+0000 7f5d0effd640 1 -- 172.21.15.88:0/1383135142 <== mon.2 v2:172.21.15.175:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f5d1805a6c0 con 0x7f5d080039b0 2024-04-26T23:45:46.308 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:46.303+0000 7f5d24df0640 1 -- 172.21.15.88:0/1383135142 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f5d200507a0 con 0x7f5d080039b0 2024-04-26T23:45:46.308 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:46.304+0000 7f5d0effd640 1 -- 172.21.15.88:0/1383135142 <== mon.2 v2:172.21.15.175:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1558 (secure 0 0 0) 0x7f5d18059fc0 con 0x7f5d080039b0 2024-04-26T23:45:46.311 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":58,"quorum":[0,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"555255e9-7ef9-4454-8dc9-35e96b70035c","modified":"2024-04-26T23:39:34.291658Z","created":"2024-04-26T23:39:34.291658Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:3300","nonce":0},{"type":"v1","addr":"172.21.15.175:6789","nonce":0}]},"addr":"172.21.15.175:6789/0","public_addr":"172.21.15.175:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:3301","nonce":0},{"type":"v1","addr":"172.21.15.175:6790","nonce":0}]},"addr":"172.21.15.175:6790/0","public_addr":"172.21.15.175:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-04-26T23:45:46.317 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:46.311+0000 7f5d24df0640 1 -- 172.21.15.88:0/1383135142 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f5d0006d430 msgr2=0x7f5d0006f8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:46.317 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:46.311+0000 7f5d24df0640 1 --2- 172.21.15.88:0/1383135142 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f5d0006d430 0x7f5d0006f8f0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f5d10036000 tx=0x7f5d10030000 comp rx=0 tx=0).stop 2024-04-26T23:45:46.317 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:46.311+0000 7f5d24df0640 1 -- 172.21.15.88:0/1383135142 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5d080039b0 msgr2=0x7f5d20144860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:46.317 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:46.311+0000 7f5d24df0640 1 --2- 172.21.15.88:0/1383135142 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5d080039b0 0x7f5d20144860 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f5d1800e850 tx=0x7f5d1800ed10 comp rx=0 tx=0).stop 2024-04-26T23:45:46.317 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:46.312+0000 7f5d24df0640 1 -- 172.21.15.88:0/1383135142 shutdown_connections 2024-04-26T23:45:46.317 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:46.312+0000 7f5d24df0640 1 --2- 172.21.15.88:0/1383135142 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f5d0006d430 0x7f5d0006f8f0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:46.317 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:46.312+0000 7f5d24df0640 1 --2- 172.21.15.88:0/1383135142 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5d08005210 0x7f5d200be0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:46.317 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:46.312+0000 7f5d24df0640 1 --2- 172.21.15.88:0/1383135142 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5d08004800 0x7f5d200bdb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:46.318 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:46.312+0000 7f5d24df0640 1 --2- 172.21.15.88:0/1383135142 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5d080039b0 0x7f5d20144860 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:46.318 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:46.312+0000 7f5d24df0640 1 -- 172.21.15.88:0/1383135142 >> 172.21.15.88:0/1383135142 conn(0x7f5d200ae010 msgr2=0x7f5d200ace90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:46.318 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:46.313+0000 7f5d24df0640 1 -- 172.21.15.88:0/1383135142 shutdown_connections 2024-04-26T23:45:46.319 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:46.313+0000 7f5d24df0640 1 -- 172.21.15.88:0/1383135142 wait complete. 2024-04-26T23:45:46.337 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2024-04-26T23:45:46.337 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon a 2024-04-26T23:45:46.337 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-04-26T23:45:46.508 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:46.504+0000 7fc107a50640 1 Processor -- start 2024-04-26T23:45:46.509 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:46.504+0000 7fc107a50640 1 -- start start 2024-04-26T23:45:46.511 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:46.505+0000 7fc107a50640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc1000ca5a0 0x7fc100156bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:46.511 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:46.506+0000 7fc1057ec640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fc100154160 0x7fc1000c6e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:34454/0 (socket says 172.21.15.88:34454) 2024-04-26T23:45:46.511 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:46.506+0000 7fc104feb640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc1000ca5a0 0x7fc100156bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:46.511 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:46.506+0000 7fc104feb640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc1000ca5a0 0x7fc100156bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:55816/0 (socket says 172.21.15.88:55816) 2024-04-26T23:45:46.511 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:46.506+0000 7fc1057ec640 1 -- 172.21.15.88:0/4199325016 learned_addr learned my addr 172.21.15.88:0/4199325016 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-26T23:45:46.511 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:46.506+0000 7fc107a50640 1 --2- 172.21.15.88:0/4199325016 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc10015a1a0 0x7fc1000c9590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:46.511 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:46.506+0000 7fc107a50640 1 -- 172.21.15.88:0/4199325016 --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc1000c8df0 con 0x7fc100154160 2024-04-26T23:45:46.511 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:46.506+0000 7fc107a50640 1 -- 172.21.15.88:0/4199325016 --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7fc1000c9100 con 0x7fc1000ca5a0 2024-04-26T23:45:46.511 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:46.506+0000 7fc105fed640 1 --2- 172.21.15.88:0/4199325016 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc10015a1a0 0x7fc1000c9590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:46.511 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:46.506+0000 7fc107a50640 1 -- 172.21.15.88:0/4199325016 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fc100154540 con 0x7fc10015a1a0 2024-04-26T23:45:46.511 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:46.506+0000 7fc0f7fff640 1 -- 172.21.15.88:0/4199325016 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 189428957 0 0) 0x7fc0fc001110 con 0x7fc100154160 2024-04-26T23:45:46.511 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:46.506+0000 7fc0f7fff640 1 -- 172.21.15.88:0/4199325016 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc0ec003520 con 0x7fc100154160 2024-04-26T23:45:46.512 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:46.507+0000 7fc105fed640 1 -- 172.21.15.88:0/4199325016 >> v2:172.21.15.88:3300/0 conn(0x7fc1000ca5a0 msgr2=0x7fc100156bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:45:46.512 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:46.507+0000 7fc105fed640 1 --2- 172.21.15.88:0/4199325016 >> v2:172.21.15.88:3300/0 conn(0x7fc1000ca5a0 0x7fc100156bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:46.512 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:46.507+0000 7fc105fed640 1 -- 172.21.15.88:0/4199325016 >> v1:172.21.15.88:6789/0 conn(0x7fc100154160 legacy=0x7fc1000c6e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:46.512 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:46.507+0000 7fc105fed640 1 -- 172.21.15.88:0/4199325016 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc10015a910 con 0x7fc10015a1a0 2024-04-26T23:45:46.512 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:46.508+0000 7fc105fed640 1 --2- 172.21.15.88:0/4199325016 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc10015a1a0 0x7fc1000c9590 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fc0f8009d90 tx=0x7fc0f802a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6a57a14994e0fe5 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:46.513 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:46.509+0000 7fc0f7fff640 1 -- 172.21.15.88:0/4199325016 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0f8007740 con 0x7fc10015a1a0 2024-04-26T23:45:46.513 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:46.509+0000 7fc0f7fff640 1 -- 172.21.15.88:0/4199325016 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0f80078e0 con 0x7fc10015a1a0 2024-04-26T23:45:46.514 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:46.509+0000 7fc0f7fff640 1 -- 172.21.15.88:0/4199325016 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0f8007c90 con 0x7fc10015a1a0 2024-04-26T23:45:46.515 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:46.510+0000 7fc107a50640 1 -- 172.21.15.88:0/4199325016 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc10015a1a0 msgr2=0x7fc1000c9590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:46.515 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:46.510+0000 7fc107a50640 1 --2- 172.21.15.88:0/4199325016 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc10015a1a0 0x7fc1000c9590 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fc0f8009d90 tx=0x7fc0f802a660 comp rx=0 tx=0).stop 2024-04-26T23:45:46.515 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:46.510+0000 7fc107a50640 1 -- 172.21.15.88:0/4199325016 shutdown_connections 2024-04-26T23:45:46.515 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:46.510+0000 7fc107a50640 1 --2- 172.21.15.88:0/4199325016 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc10015a1a0 0x7fc1000c9590 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:46.515 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:46.510+0000 7fc107a50640 1 --2- 172.21.15.88:0/4199325016 >> v2:172.21.15.88:3300/0 conn(0x7fc1000ca5a0 0x7fc100156bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:46.515 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:46.510+0000 7fc107a50640 1 -- 172.21.15.88:0/4199325016 >> 172.21.15.88:0/4199325016 conn(0x7fc1000ae010 msgr2=0x7fc1000ae3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:46.515 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:46.511+0000 7fc107a50640 1 -- 172.21.15.88:0/4199325016 shutdown_connections 2024-04-26T23:45:46.515 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:46.511+0000 7fc107a50640 1 -- 172.21.15.88:0/4199325016 wait complete. 2024-04-26T23:45:46.516 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:46.512+0000 7fc107a50640 1 Processor -- start 2024-04-26T23:45:46.516 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:46.512+0000 7fc107a50640 1 -- start start 2024-04-26T23:45:46.517 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:46.513+0000 7fc107a50640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc1000ca5a0 0x7fc100152e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:46.517 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:46.513+0000 7fc107a50640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc100154160 0x7fc10014b710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:46.517 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:46.513+0000 7fc107a50640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc10015a1a0 0x7fc10014bc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:46.518 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:46.513+0000 7fc104feb640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc100154160 0x7fc10014b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:46.518 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:46.513+0000 7fc104feb640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc100154160 0x7fc10014b710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:55826/0 (socket says 172.21.15.88:55826) 2024-04-26T23:45:46.518 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:46.513+0000 7fc104feb640 1 -- 172.21.15.88:0/1442036319 learned_addr learned my addr 172.21.15.88:0/1442036319 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:45:46.518 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:46.513+0000 7fc107a50640 1 -- 172.21.15.88:0/1442036319 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fc10015a5f0 con 0x7fc100154160 2024-04-26T23:45:46.518 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:46.513+0000 7fc107a50640 1 -- 172.21.15.88:0/1442036319 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc10015aed0 con 0x7fc10015a1a0 2024-04-26T23:45:46.518 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:46.513+0000 7fc107a50640 1 -- 172.21.15.88:0/1442036319 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fc1000c7510 con 0x7fc1000ca5a0 2024-04-26T23:45:46.519 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:46.514+0000 7fc104feb640 1 -- 172.21.15.88:0/1442036319 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc1000ca5a0 msgr2=0x7fc100152e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:46.519 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:46.514+0000 7fc104feb640 1 --2- 172.21.15.88:0/1442036319 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc1000ca5a0 0x7fc100152e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:46.519 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:46.514+0000 7fc104feb640 1 -- 172.21.15.88:0/1442036319 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc10015a1a0 msgr2=0x7fc10014bc50 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-26T23:45:46.520 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:46.514+0000 7fc104feb640 1 --2- 172.21.15.88:0/1442036319 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc10015a1a0 0x7fc10014bc50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:46.520 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:46.514+0000 7fc104feb640 1 -- 172.21.15.88:0/1442036319 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc100159d20 con 0x7fc100154160 2024-04-26T23:45:46.520 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:46.514+0000 7fc104feb640 1 --2- 172.21.15.88:0/1442036319 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc100154160 0x7fc10014b710 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fc0f000e9b0 tx=0x7fc0f000ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:46.521 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:46.515+0000 7fc0f5ffb640 1 -- 172.21.15.88:0/1442036319 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0f0017070 con 0x7fc100154160 2024-04-26T23:45:46.521 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:46.515+0000 7fc0f5ffb640 1 -- 172.21.15.88:0/1442036319 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0f000c9a0 con 0x7fc100154160 2024-04-26T23:45:46.521 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:46.515+0000 7fc0f5ffb640 1 -- 172.21.15.88:0/1442036319 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0f000cd90 con 0x7fc100154160 2024-04-26T23:45:46.521 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:46.515+0000 7fc107a50640 1 -- 172.21.15.88:0/1442036319 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1001525e0 con 0x7fc100154160 2024-04-26T23:45:46.521 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:46.515+0000 7fc107a50640 1 -- 172.21.15.88:0/1442036319 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1001580d0 con 0x7fc100154160 2024-04-26T23:45:46.521 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:46.516+0000 7fc107a50640 1 --2- 172.21.15.88:0/1442036319 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc0e0002a70 0x7fc0e0004f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:46.521 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:46.516+0000 7fc107a50640 1 -- 172.21.15.88:0/1442036319 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fc0e0007ec0 con 0x7fc0e0002a70 2024-04-26T23:45:46.521 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:46.517+0000 7fc1057ec640 1 --2- 172.21.15.88:0/1442036319 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc0e0002a70 0x7fc0e0004f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:46.523 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:46.517+0000 7fc1057ec640 1 -- 172.21.15.88:0/1442036319 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc0e00080c0 con 0x7fc0e0002a70 2024-04-26T23:45:46.523 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:46.518+0000 7fc1057ec640 1 --2- 172.21.15.88:0/1442036319 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc0e0002a70 0x7fc0e0004f30 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fc0fc005880 tx=0x7fc0fc00cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:46.523 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:46.518+0000 7fc0f5ffb640 1 -- 172.21.15.88:0/1442036319 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc0f001a070 con 0x7fc100154160 2024-04-26T23:45:46.523 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:46.518+0000 7fc0f5ffb640 1 --2- 172.21.15.88:0/1442036319 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fc0e406c8f0 0x7fc0e406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:46.523 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:46.518+0000 7fc105fed640 1 --2- 172.21.15.88:0/1442036319 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fc0e406c8f0 0x7fc0e406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:46.523 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:46.518+0000 7fc0f5ffb640 1 -- 172.21.15.88:0/1442036319 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0fc017070 con 0x7fc0e0002a70 2024-04-26T23:45:46.523 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:46.518+0000 7fc0f5ffb640 1 -- 172.21.15.88:0/1442036319 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6666+0+0 (secure 0 0 0) 0x7fc0f008c2b0 con 0x7fc100154160 2024-04-26T23:45:46.523 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:46.519+0000 7fc0f5ffb640 1 -- 172.21.15.88:0/1442036319 <== mon.0 v2:172.21.15.88:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fc0fc00ce50 con 0x7fc0e0002a70 2024-04-26T23:45:46.523 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:46.519+0000 7fc0f5ffb640 1 -- 172.21.15.88:0/1442036319 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc0e0002a70 msgr2=0x7fc0e0004f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:46.523 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:46.519+0000 7fc0f5ffb640 1 --2- 172.21.15.88:0/1442036319 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc0e0002a70 0x7fc0e0004f30 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fc0fc005880 tx=0x7fc0fc00cb10 comp rx=0 tx=0).stop 2024-04-26T23:45:46.524 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:46.519+0000 7fc0f5ffb640 1 -- 172.21.15.88:0/1442036319 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc0e0002a70 msgr2=0x7fc0e0004f30 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:45:46.524 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:46.519+0000 7fc0f5ffb640 1 --2- 172.21.15.88:0/1442036319 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc0e0002a70 0x7fc0e0004f30 secure :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fc0fc005880 tx=0x7fc0fc00cb10 comp rx=0 tx=0).stop 2024-04-26T23:45:46.524 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:46.519+0000 7fc105fed640 1 --2- 172.21.15.88:0/1442036319 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fc0e406c8f0 0x7fc0e406edb0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fc0f8034000 tx=0x7fc0f802f000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:46.534 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:46.530+0000 7fc107a50640 1 --2- 172.21.15.88:0/1442036319 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc0e0006f50 0x7fc0e00073e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:46.535 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:46.530+0000 7fc107a50640 1 -- 172.21.15.88:0/1442036319 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fc0e000a4a0 con 0x7fc0e0006f50 2024-04-26T23:45:46.535 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:46.530+0000 7fc1057ec640 1 --2- 172.21.15.88:0/1442036319 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc0e0006f50 0x7fc0e00073e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:46.535 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:46.531+0000 7fc1057ec640 1 -- 172.21.15.88:0/1442036319 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fc0e0007920 con 0x7fc0e0006f50 2024-04-26T23:45:46.535 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:46.531+0000 7fc1057ec640 1 --2- 172.21.15.88:0/1442036319 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc0e0006f50 0x7fc0e00073e0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc0fc0012b0 tx=0x7fc0fc001320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:46.536 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:46.531+0000 7fc0f5ffb640 1 -- 172.21.15.88:0/1442036319 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0fc017040 con 0x7fc0e0006f50 2024-04-26T23:45:46.537 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:46.532+0000 7fc0f5ffb640 1 -- 172.21.15.88:0/1442036319 <== mon.0 v2:172.21.15.88:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5055 (secure 0 0 0) 0x7fc0fc01a6c0 con 0x7fc0e0006f50 2024-04-26T23:45:46.537 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:46.532+0000 7fc0f5ffb640 1 -- 172.21.15.88:0/1442036319 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc0e0006f50 msgr2=0x7fc0e00073e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:46.537 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:46.532+0000 7fc0f5ffb640 1 --2- 172.21.15.88:0/1442036319 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc0e0006f50 0x7fc0e00073e0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc0fc0012b0 tx=0x7fc0fc001320 comp rx=0 tx=0).stop 2024-04-26T23:45:46.537 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:46.532+0000 7fc0f5ffb640 1 -- 172.21.15.88:0/1442036319 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc0e0006f50 msgr2=0x7fc0e00073e0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:45:46.537 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:46.532+0000 7fc0f5ffb640 1 --2- 172.21.15.88:0/1442036319 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc0e0006f50 0x7fc0e00073e0 secure :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc0fc0012b0 tx=0x7fc0fc001320 comp rx=0 tx=0).stop 2024-04-26T23:45:46.537 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-04-26T23:45:46.537 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2024-04-26T23:45:46.537 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2024-04-26T23:45:46.537 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "leader", 2024-04-26T23:45:46.538 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 58, 2024-04-26T23:45:46.538 INFO:teuthology.orchestra.run.smithi088.stdout: "uptime": 55585, 2024-04-26T23:45:46.538 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2024-04-26T23:45:46.538 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2024-04-26T23:45:46.538 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2024-04-26T23:45:46.538 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:45:46.538 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 0, 2024-04-26T23:45:46.538 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2024-04-26T23:45:46.538 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2450521708007866372", 2024-04-26T23:45:46.538 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2024-04-26T23:45:46.538 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-04-26T23:45:46.538 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-04-26T23:45:46.538 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-04-26T23:45:46.538 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-04-26T23:45:46.539 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-04-26T23:45:46.539 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-04-26T23:45:46.539 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-04-26T23:45:46.539 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-04-26T23:45:46.539 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-04-26T23:45:46.539 INFO:teuthology.orchestra.run.smithi088.stdout: "reef", 2024-04-26T23:45:46.539 INFO:teuthology.orchestra.run.smithi088.stdout: "squid" 2024-04-26T23:45:46.539 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:45:46.539 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540701547738038271", 2024-04-26T23:45:46.539 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2024-04-26T23:45:46.539 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-04-26T23:45:46.539 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-04-26T23:45:46.539 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-04-26T23:45:46.539 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-04-26T23:45:46.540 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-04-26T23:45:46.540 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-04-26T23:45:46.540 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-04-26T23:45:46.540 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-04-26T23:45:46.540 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-04-26T23:45:46.540 INFO:teuthology.orchestra.run.smithi088.stdout: "reef", 2024-04-26T23:45:46.540 INFO:teuthology.orchestra.run.smithi088.stdout: "squid" 2024-04-26T23:45:46.540 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:45:46.540 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:45:46.540 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2024-04-26T23:45:46.540 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2024-04-26T23:45:46.540 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2024-04-26T23:45:46.540 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2024-04-26T23:45:46.540 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2024-04-26T23:45:46.540 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "555255e9-7ef9-4454-8dc9-35e96b70035c", 2024-04-26T23:45:46.541 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2024-04-26T23:39:34.291658Z", 2024-04-26T23:45:46.541 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2024-04-26T23:39:34.291658Z", 2024-04-26T23:45:46.541 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 19, 2024-04-26T23:45:46.541 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "squid", 2024-04-26T23:45:46.541 INFO:teuthology.orchestra.run.smithi088.stdout: "election_strategy": 1, 2024-04-26T23:45:46.541 INFO:teuthology.orchestra.run.smithi088.stdout: "disallowed_leaders: ": "", 2024-04-26T23:45:46.541 INFO:teuthology.orchestra.run.smithi088.stdout: "stretch_mode": false, 2024-04-26T23:45:46.541 INFO:teuthology.orchestra.run.smithi088.stdout: "tiebreaker_mon": "", 2024-04-26T23:45:46.541 INFO:teuthology.orchestra.run.smithi088.stdout: "removed_ranks: ": "", 2024-04-26T23:45:46.541 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2024-04-26T23:45:46.541 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2024-04-26T23:45:46.541 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-04-26T23:45:46.541 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-04-26T23:45:46.541 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-04-26T23:45:46.541 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-04-26T23:45:46.542 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-04-26T23:45:46.542 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-04-26T23:45:46.542 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-04-26T23:45:46.542 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-04-26T23:45:46.542 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-04-26T23:45:46.542 INFO:teuthology.orchestra.run.smithi088.stdout: "reef", 2024-04-26T23:45:46.542 INFO:teuthology.orchestra.run.smithi088.stdout: "squid" 2024-04-26T23:45:46.542 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:45:46.542 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2024-04-26T23:45:46.542 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:45:46.542 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2024-04-26T23:45:46.542 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:45:46.542 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2024-04-26T23:45:46.542 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2024-04-26T23:45:46.543 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-04-26T23:45:46.543 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-04-26T23:45:46.543 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:45:46.543 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-04-26T23:45:46.543 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2024-04-26T23:45:46.543 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:45:46.543 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:45:46.543 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:45:46.543 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-04-26T23:45:46.543 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2024-04-26T23:45:46.543 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:45:46.543 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:45:46.543 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:45:46.543 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:45:46.543 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2024-04-26T23:45:46.544 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2024-04-26T23:45:46.544 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-04-26T23:45:46.544 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-04-26T23:45:46.544 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-04-26T23:45:46.544 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:45:46.544 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:45:46.544 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2024-04-26T23:45:46.544 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2024-04-26T23:45:46.544 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-04-26T23:45:46.544 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-04-26T23:45:46.544 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:45:46.544 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-04-26T23:45:46.544 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:3300", 2024-04-26T23:45:46.544 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:45:46.544 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:45:46.545 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:45:46.545 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-04-26T23:45:46.545 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6789", 2024-04-26T23:45:46.545 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:45:46.545 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:45:46.545 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:45:46.545 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:45:46.545 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6789/0", 2024-04-26T23:45:46.545 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.175:6789/0", 2024-04-26T23:45:46.545 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-04-26T23:45:46.545 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-04-26T23:45:46.545 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-04-26T23:45:46.545 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:45:46.545 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:45:46.546 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2024-04-26T23:45:46.546 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2024-04-26T23:45:46.546 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-04-26T23:45:46.546 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-04-26T23:45:46.546 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:45:46.546 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-04-26T23:45:46.546 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:3301", 2024-04-26T23:45:46.546 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:45:46.546 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:45:46.546 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:45:46.546 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-04-26T23:45:46.546 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6790", 2024-04-26T23:45:46.546 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:45:46.546 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:45:46.546 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:45:46.547 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:45:46.547 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6790/0", 2024-04-26T23:45:46.547 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.175:6790/0", 2024-04-26T23:45:46.547 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-04-26T23:45:46.547 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-04-26T23:45:46.547 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-04-26T23:45:46.547 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:45:46.547 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:45:46.547 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:45:46.547 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2024-04-26T23:45:46.547 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2024-04-26T23:45:46.547 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:45:46.547 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:45:46.547 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:45:46.547 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2024-04-26T23:45:46.548 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:45:46.548 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:45:46.548 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": [ 2024-04-26T23:45:46.548 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:45:46.548 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:45:46.548 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:45:46.548 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 3 2024-04-26T23:45:46.548 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:45:46.548 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:45:46.548 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": [ 2024-04-26T23:45:46.548 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:45:46.548 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:45:46.548 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:45:46.548 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2024-04-26T23:45:46.548 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:45:46.549 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:45:46.549 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2024-04-26T23:45:46.549 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:45:46.549 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:45:46.549 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:45:46.549 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 3 2024-04-26T23:45:46.549 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:45:46.549 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:45:46.549 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": [ 2024-04-26T23:45:46.549 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:45:46.549 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:45:46.549 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:45:46.549 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2024-04-26T23:45:46.549 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:45:46.549 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:45:46.550 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:45:46.550 INFO:teuthology.orchestra.run.smithi088.stdout: "stretch_mode": false 2024-04-26T23:45:46.550 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-04-26T23:45:46.551 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:46.533+0000 7fc107a50640 1 -- 172.21.15.88:0/1442036319 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fc0e406c8f0 msgr2=0x7fc0e406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:46.551 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:46.533+0000 7fc107a50640 1 --2- 172.21.15.88:0/1442036319 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fc0e406c8f0 0x7fc0e406edb0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fc0f8034000 tx=0x7fc0f802f000 comp rx=0 tx=0).stop 2024-04-26T23:45:46.551 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:46.533+0000 7fc107a50640 1 -- 172.21.15.88:0/1442036319 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc100154160 msgr2=0x7fc10014b710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:46.551 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:46.533+0000 7fc107a50640 1 --2- 172.21.15.88:0/1442036319 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc100154160 0x7fc10014b710 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fc0f000e9b0 tx=0x7fc0f000ee70 comp rx=0 tx=0).stop 2024-04-26T23:45:46.551 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:46.533+0000 7fc105fed640 1 -- 172.21.15.88:0/1442036319 reap_dead start 2024-04-26T23:45:46.551 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:46.534+0000 7fc107a50640 1 -- 172.21.15.88:0/1442036319 shutdown_connections 2024-04-26T23:45:46.551 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:46.534+0000 7fc107a50640 1 --2- 172.21.15.88:0/1442036319 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc100154160 0x7fc10014b710 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:46.551 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:46.534+0000 7fc107a50640 1 -- 172.21.15.88:0/1442036319 >> 172.21.15.88:0/1442036319 conn(0x7fc1000ae010 msgr2=0x7fc10014e6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:46.551 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:46.535+0000 7fc107a50640 1 -- 172.21.15.88:0/1442036319 shutdown_connections 2024-04-26T23:45:46.551 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:46.535+0000 7fc107a50640 1 -- 172.21.15.88:0/1442036319 wait complete. 2024-04-26T23:45:46.558 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-04-26T23:45:46.558 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon c 2024-04-26T23:45:46.558 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-04-26T23:45:46.673 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:46.669+0000 7f53aa015640 1 Processor -- start 2024-04-26T23:45:46.673 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:46.669+0000 7f53aa015640 1 -- start start 2024-04-26T23:45:46.675 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:46.669+0000 7f53aa015640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f53a4154160 0x7f53a4156bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:46.675 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:46.669+0000 7f53aa015640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f53a40ca5a0 0x7f53a415a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:46.675 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:46.669+0000 7f53aa015640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f53a40c6e00 0x7f53a40c7290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:46.675 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:46.669+0000 7f53aa015640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f53a415a6e0 con 0x7f53a4154160 2024-04-26T23:45:46.675 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:46.670+0000 7f53aa015640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f53a40c9100 con 0x7f53a40c6e00 2024-04-26T23:45:46.675 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:46.670+0000 7f53aa015640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f53a40c8df0 con 0x7f53a40ca5a0 2024-04-26T23:45:46.675 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:46.670+0000 7f53a3fff640 1 -- >> v2:172.21.15.175:3300/0 conn(0x7f53a40c6e00 msgr2=0x7f53a40c7290 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.175:3300/0 2024-04-26T23:45:46.675 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:46.670+0000 7f53a3fff640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f53a40c6e00 0x7f53a40c7290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:45:46.676 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:46.670+0000 7f53a37fe640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f53a4154160 0x7f53a4156bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:46.676 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:46.670+0000 7f53a37fe640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f53a4154160 0x7f53a4156bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:55852/0 (socket says 172.21.15.88:55852) 2024-04-26T23:45:46.676 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:46.670+0000 7f53a37fe640 1 -- 172.21.15.88:0/694189771 learned_addr learned my addr 172.21.15.88:0/694189771 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:45:46.676 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:46.670+0000 7f53a2ffd640 1 --2- 172.21.15.88:0/694189771 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f53a40ca5a0 0x7f53a415a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:46.676 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:46.670+0000 7f53a37fe640 1 -- 172.21.15.88:0/694189771 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f53a40ca5a0 msgr2=0x7f53a415a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:45:46.676 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:46.670+0000 7f53a37fe640 1 --2- 172.21.15.88:0/694189771 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f53a40ca5a0 0x7f53a415a1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:46.676 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:46.670+0000 7f53a37fe640 1 -- 172.21.15.88:0/694189771 >> v2:172.21.15.175:3300/0 conn(0x7f53a40c6e00 msgr2=0x7f53a40c7290 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T23:45:46.676 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:46.670+0000 7f53a37fe640 1 --2- 172.21.15.88:0/694189771 >> v2:172.21.15.175:3300/0 conn(0x7f53a40c6e00 0x7f53a40c7290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:46.676 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:46.670+0000 7f53a37fe640 1 -- 172.21.15.88:0/694189771 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53a4154540 con 0x7f53a4154160 2024-04-26T23:45:46.676 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:46.671+0000 7f53a37fe640 1 --2- 172.21.15.88:0/694189771 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f53a4154160 0x7f53a4156bb0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f53a40aeb90 tx=0x7f539402a200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3caeb88bf2f1be03 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:46.676 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:46.671+0000 7f53a27fc640 1 -- 172.21.15.88:0/694189771 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5394037070 con 0x7f53a4154160 2024-04-26T23:45:46.676 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:46.671+0000 7f53a27fc640 1 -- 172.21.15.88:0/694189771 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5394032440 con 0x7f53a4154160 2024-04-26T23:45:46.676 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:46.671+0000 7f53a27fc640 1 -- 172.21.15.88:0/694189771 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5394032810 con 0x7f53a4154160 2024-04-26T23:45:46.677 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:46.671+0000 7f53aa015640 1 -- 172.21.15.88:0/694189771 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f53a4154160 msgr2=0x7f53a4156bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:46.677 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:46.671+0000 7f53aa015640 1 --2- 172.21.15.88:0/694189771 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f53a4154160 0x7f53a4156bb0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f53a40aeb90 tx=0x7f539402a200 comp rx=0 tx=0).stop 2024-04-26T23:45:46.678 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:46.671+0000 7f53aa015640 1 -- 172.21.15.88:0/694189771 shutdown_connections 2024-04-26T23:45:46.678 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:46.671+0000 7f53aa015640 1 --2- 172.21.15.88:0/694189771 >> v2:172.21.15.175:3300/0 conn(0x7f53a40c6e00 0x7f53a40c7290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:46.678 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:46.671+0000 7f53aa015640 1 --2- 172.21.15.88:0/694189771 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f53a40ca5a0 0x7f53a415a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:46.678 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:46.671+0000 7f53aa015640 1 --2- 172.21.15.88:0/694189771 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f53a4154160 0x7f53a4156bb0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:46.678 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:46.671+0000 7f53aa015640 1 -- 172.21.15.88:0/694189771 >> 172.21.15.88:0/694189771 conn(0x7f53a40ae010 msgr2=0x7f53a40ae3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:46.678 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:46.671+0000 7f53aa015640 1 -- 172.21.15.88:0/694189771 shutdown_connections 2024-04-26T23:45:46.678 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:46.671+0000 7f53aa015640 1 -- 172.21.15.88:0/694189771 wait complete. 2024-04-26T23:45:46.678 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:46.673+0000 7f53aa015640 1 Processor -- start 2024-04-26T23:45:46.678 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:46.673+0000 7f53aa015640 1 -- start start 2024-04-26T23:45:46.680 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:46.674+0000 7f53aa015640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f53a40c6e00 0x7f53a41ec8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:46.680 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:46.674+0000 7f53aa015640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f53a40ca5a0 0x7f53a41533f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:46.680 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:46.674+0000 7f53aa015640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f53a4154160 0x7f53a4149210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:46.681 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:46.674+0000 7f53aa015640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f53a415aed0 con 0x7f53a40ca5a0 2024-04-26T23:45:46.681 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:46.674+0000 7f53aa015640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f53a415abf0 con 0x7f53a40c6e00 2024-04-26T23:45:46.681 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:46.674+0000 7f53aa015640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f53a40c9590 con 0x7f53a4154160 2024-04-26T23:45:46.681 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:46.674+0000 7f53a37fe640 1 -- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f53a40c6e00 msgr2=0x7f53a41ec8a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.175:3300/0 2024-04-26T23:45:46.681 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:46.674+0000 7f53a2ffd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f53a40ca5a0 0x7f53a41533f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:46.681 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:46.674+0000 7f53a37fe640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f53a40c6e00 0x7f53a41ec8a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:45:46.681 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:46.674+0000 7f53a2ffd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f53a40ca5a0 0x7f53a41533f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:55856/0 (socket says 172.21.15.88:55856) 2024-04-26T23:45:46.681 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:46.674+0000 7f53a2ffd640 1 -- 172.21.15.88:0/149767002 learned_addr learned my addr 172.21.15.88:0/149767002 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:45:46.682 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:46.674+0000 7f53a3fff640 1 --2- 172.21.15.88:0/149767002 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f53a4154160 0x7f53a4149210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:46.682 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:46.674+0000 7f53a2ffd640 1 -- 172.21.15.88:0/149767002 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f53a4154160 msgr2=0x7f53a4149210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:46.682 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:46.674+0000 7f53a2ffd640 1 --2- 172.21.15.88:0/149767002 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f53a4154160 0x7f53a4149210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:46.682 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:46.674+0000 7f53a2ffd640 1 -- 172.21.15.88:0/149767002 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f53a40c6e00 msgr2=0x7f53a41ec8a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T23:45:46.682 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:46.674+0000 7f53a2ffd640 1 --2- 172.21.15.88:0/149767002 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f53a40c6e00 0x7f53a41ec8a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:46.682 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:46.674+0000 7f53a2ffd640 1 -- 172.21.15.88:0/149767002 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53a4158280 con 0x7f53a40ca5a0 2024-04-26T23:45:46.682 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:46.675+0000 7f53a2ffd640 1 --2- 172.21.15.88:0/149767002 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f53a40ca5a0 0x7f53a41533f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f539800e980 tx=0x7f539800ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:46.682 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:46.675+0000 7f538bfff640 1 -- 172.21.15.88:0/149767002 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5398017070 con 0x7f53a40ca5a0 2024-04-26T23:45:46.682 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:46.675+0000 7f538bfff640 1 -- 172.21.15.88:0/149767002 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f539800ca00 con 0x7f53a40ca5a0 2024-04-26T23:45:46.682 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:46.675+0000 7f53aa015640 1 -- 172.21.15.88:0/149767002 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53a4157fa0 con 0x7f53a40ca5a0 2024-04-26T23:45:46.682 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:46.675+0000 7f538bfff640 1 -- 172.21.15.88:0/149767002 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f539800cdd0 con 0x7f53a40ca5a0 2024-04-26T23:45:46.683 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:46.675+0000 7f53aa015640 1 -- 172.21.15.88:0/149767002 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53a41f08c0 con 0x7f53a40ca5a0 2024-04-26T23:45:46.683 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:46.676+0000 7f53aa015640 1 --2- 172.21.15.88:0/149767002 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f53a4149750 0x7f53a40acfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:46.683 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:46.676+0000 7f53aa015640 1 -- 172.21.15.88:0/149767002 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f53a41ecde0 con 0x7f53a4149750 2024-04-26T23:45:46.683 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:46.676+0000 7f53a37fe640 1 --2- 172.21.15.88:0/149767002 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f53a4149750 0x7f53a40acfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:46.683 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:46.676+0000 7f538bfff640 1 -- 172.21.15.88:0/149767002 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f539801a070 con 0x7f53a40ca5a0 2024-04-26T23:45:46.684 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:46.677+0000 7f53a37fe640 1 -- 172.21.15.88:0/149767002 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f53a4076650 con 0x7f53a4149750 2024-04-26T23:45:46.684 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:46.677+0000 7f538bfff640 1 --2- 172.21.15.88:0/149767002 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f539006c8a0 0x7f539006ed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:46.684 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:46.677+0000 7f538bfff640 1 -- 172.21.15.88:0/149767002 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6666+0+0 (secure 0 0 0) 0x7f539808bf00 con 0x7f53a40ca5a0 2024-04-26T23:45:46.684 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:46.677+0000 7f53a3fff640 1 --2- 172.21.15.88:0/149767002 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f539006c8a0 0x7f539006ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:46.685 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:46.677+0000 7f53a37fe640 1 --2- 172.21.15.88:0/149767002 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f53a4149750 0x7f53a40acfd0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f53a406da80 tx=0x7f53940046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:46.685 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:46.677+0000 7f538bfff640 1 -- 172.21.15.88:0/149767002 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5394042070 con 0x7f53a4149750 2024-04-26T23:45:46.685 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:46.677+0000 7f53a3fff640 1 --2- 172.21.15.88:0/149767002 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f539006c8a0 0x7f539006ed60 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f539c003cb0 tx=0x7f539c0093f0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:46.685 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:46.678+0000 7f538bfff640 1 -- 172.21.15.88:0/149767002 <== mon.2 v2:172.21.15.175:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f5394009490 con 0x7f53a4149750 2024-04-26T23:45:46.685 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:46.678+0000 7f538bfff640 1 -- 172.21.15.88:0/149767002 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f53a4149750 msgr2=0x7f53a40acfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:46.685 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:46.678+0000 7f538bfff640 1 --2- 172.21.15.88:0/149767002 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f53a4149750 0x7f53a40acfd0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f53a406da80 tx=0x7f53940046c0 comp rx=0 tx=0).stop 2024-04-26T23:45:46.685 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:46.678+0000 7f538bfff640 1 -- 172.21.15.88:0/149767002 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f53a4149750 msgr2=0x7f53a40acfd0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:45:46.685 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:46.678+0000 7f538bfff640 1 --2- 172.21.15.88:0/149767002 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f53a4149750 0x7f53a40acfd0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:46.689 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:46.685+0000 7f53aa015640 1 --2- 172.21.15.88:0/149767002 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f53a40c3420 0x7f53a4151980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:46.689 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:46.685+0000 7f53aa015640 1 -- 172.21.15.88:0/149767002 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f53a4153930 con 0x7f53a40c3420 2024-04-26T23:45:46.689 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:46.685+0000 7f53a37fe640 1 --2- 172.21.15.88:0/149767002 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f53a40c3420 0x7f53a4151980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:46.690 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:46.686+0000 7f53a37fe640 1 -- 172.21.15.88:0/149767002 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f53a4157b50 con 0x7f53a40c3420 2024-04-26T23:45:46.690 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:46.686+0000 7f53a37fe640 1 --2- 172.21.15.88:0/149767002 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f53a40c3420 0x7f53a4151980 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f5394000c00 tx=0x7f5394009240 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:46.691 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:46.686+0000 7f538bfff640 1 -- 172.21.15.88:0/149767002 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5394037040 con 0x7f53a40c3420 2024-04-26T23:45:46.691 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:46.687+0000 7f538bfff640 1 -- 172.21.15.88:0/149767002 <== mon.2 v2:172.21.15.175:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5197 (secure 0 0 0) 0x7f53940482c0 con 0x7f53a40c3420 2024-04-26T23:45:46.691 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:46.687+0000 7f538bfff640 1 -- 172.21.15.88:0/149767002 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f53a40c3420 msgr2=0x7f53a4151980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:46.691 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:46.687+0000 7f538bfff640 1 --2- 172.21.15.88:0/149767002 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f53a40c3420 0x7f53a4151980 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f5394000c00 tx=0x7f5394009240 comp rx=0 tx=0).stop 2024-04-26T23:45:46.692 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:46.687+0000 7f538bfff640 1 -- 172.21.15.88:0/149767002 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f53a40c3420 msgr2=0x7f53a4151980 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:45:46.692 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:46.687+0000 7f538bfff640 1 --2- 172.21.15.88:0/149767002 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f53a40c3420 0x7f53a4151980 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:46.692 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-04-26T23:45:46.692 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2024-04-26T23:45:46.692 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2024-04-26T23:45:46.692 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "peon", 2024-04-26T23:45:46.692 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 58, 2024-04-26T23:45:46.692 INFO:teuthology.orchestra.run.smithi088.stdout: "uptime": 114974, 2024-04-26T23:45:46.692 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2024-04-26T23:45:46.692 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2024-04-26T23:45:46.692 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2024-04-26T23:45:46.693 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:45:46.693 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 1, 2024-04-26T23:45:46.693 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2024-04-26T23:45:46.693 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2450521708007866372", 2024-04-26T23:45:46.693 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2024-04-26T23:45:46.693 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-04-26T23:45:46.693 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-04-26T23:45:46.693 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-04-26T23:45:46.693 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-04-26T23:45:46.693 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-04-26T23:45:46.693 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-04-26T23:45:46.693 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-04-26T23:45:46.693 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-04-26T23:45:46.693 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-04-26T23:45:46.693 INFO:teuthology.orchestra.run.smithi088.stdout: "reef", 2024-04-26T23:45:46.694 INFO:teuthology.orchestra.run.smithi088.stdout: "squid" 2024-04-26T23:45:46.694 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:45:46.694 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540701547738038271", 2024-04-26T23:45:46.694 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2024-04-26T23:45:46.694 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-04-26T23:45:46.694 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-04-26T23:45:46.694 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-04-26T23:45:46.694 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-04-26T23:45:46.694 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-04-26T23:45:46.694 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-04-26T23:45:46.694 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-04-26T23:45:46.694 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-04-26T23:45:46.694 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-04-26T23:45:46.694 INFO:teuthology.orchestra.run.smithi088.stdout: "reef", 2024-04-26T23:45:46.695 INFO:teuthology.orchestra.run.smithi088.stdout: "squid" 2024-04-26T23:45:46.695 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:45:46.695 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:45:46.695 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2024-04-26T23:45:46.695 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2024-04-26T23:45:46.695 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2024-04-26T23:45:46.695 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2024-04-26T23:45:46.695 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2024-04-26T23:45:46.695 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "555255e9-7ef9-4454-8dc9-35e96b70035c", 2024-04-26T23:45:46.695 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2024-04-26T23:39:34.291658Z", 2024-04-26T23:45:46.695 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2024-04-26T23:39:34.291658Z", 2024-04-26T23:45:46.695 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 19, 2024-04-26T23:45:46.695 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "squid", 2024-04-26T23:45:46.695 INFO:teuthology.orchestra.run.smithi088.stdout: "election_strategy": 1, 2024-04-26T23:45:46.695 INFO:teuthology.orchestra.run.smithi088.stdout: "disallowed_leaders: ": "", 2024-04-26T23:45:46.696 INFO:teuthology.orchestra.run.smithi088.stdout: "stretch_mode": false, 2024-04-26T23:45:46.696 INFO:teuthology.orchestra.run.smithi088.stdout: "tiebreaker_mon": "", 2024-04-26T23:45:46.696 INFO:teuthology.orchestra.run.smithi088.stdout: "removed_ranks: ": "", 2024-04-26T23:45:46.696 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2024-04-26T23:45:46.696 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2024-04-26T23:45:46.696 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-04-26T23:45:46.696 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-04-26T23:45:46.696 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-04-26T23:45:46.696 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-04-26T23:45:46.696 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-04-26T23:45:46.696 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-04-26T23:45:46.696 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-04-26T23:45:46.696 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-04-26T23:45:46.696 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-04-26T23:45:46.696 INFO:teuthology.orchestra.run.smithi088.stdout: "reef", 2024-04-26T23:45:46.697 INFO:teuthology.orchestra.run.smithi088.stdout: "squid" 2024-04-26T23:45:46.697 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:45:46.697 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2024-04-26T23:45:46.697 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:45:46.697 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2024-04-26T23:45:46.697 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:45:46.697 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2024-04-26T23:45:46.697 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2024-04-26T23:45:46.697 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-04-26T23:45:46.697 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-04-26T23:45:46.697 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:45:46.697 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-04-26T23:45:46.697 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2024-04-26T23:45:46.697 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:45:46.697 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:45:46.698 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:45:46.698 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-04-26T23:45:46.698 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2024-04-26T23:45:46.698 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:45:46.698 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:45:46.698 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:45:46.698 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:45:46.698 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2024-04-26T23:45:46.698 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2024-04-26T23:45:46.698 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-04-26T23:45:46.698 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-04-26T23:45:46.698 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-04-26T23:45:46.698 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:45:46.698 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:45:46.699 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2024-04-26T23:45:46.699 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2024-04-26T23:45:46.699 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-04-26T23:45:46.699 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-04-26T23:45:46.699 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:45:46.699 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-04-26T23:45:46.699 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:3300", 2024-04-26T23:45:46.699 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:45:46.699 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:45:46.699 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:45:46.699 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-04-26T23:45:46.699 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6789", 2024-04-26T23:45:46.699 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:45:46.699 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:45:46.699 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:45:46.700 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:45:46.700 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6789/0", 2024-04-26T23:45:46.700 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.175:6789/0", 2024-04-26T23:45:46.700 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-04-26T23:45:46.700 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-04-26T23:45:46.700 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-04-26T23:45:46.700 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:45:46.700 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:45:46.700 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2024-04-26T23:45:46.700 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2024-04-26T23:45:46.700 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-04-26T23:45:46.700 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-04-26T23:45:46.700 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:45:46.700 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-04-26T23:45:46.700 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:3301", 2024-04-26T23:45:46.701 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:45:46.701 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:45:46.701 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:45:46.701 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-04-26T23:45:46.701 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6790", 2024-04-26T23:45:46.701 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:45:46.701 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:45:46.701 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:45:46.701 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:45:46.701 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6790/0", 2024-04-26T23:45:46.701 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.175:6790/0", 2024-04-26T23:45:46.701 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-04-26T23:45:46.701 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-04-26T23:45:46.701 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-04-26T23:45:46.701 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:45:46.702 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:45:46.702 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:45:46.702 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2024-04-26T23:45:46.702 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2024-04-26T23:45:46.702 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:45:46.702 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:45:46.702 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:45:46.702 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2024-04-26T23:45:46.702 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:45:46.702 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:45:46.702 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": [ 2024-04-26T23:45:46.702 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:45:46.702 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:45:46.702 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:45:46.703 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2024-04-26T23:45:46.703 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:45:46.703 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:45:46.703 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": [ 2024-04-26T23:45:46.703 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:45:46.703 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:45:46.703 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:45:46.703 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 6 2024-04-26T23:45:46.703 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:45:46.703 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:45:46.703 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2024-04-26T23:45:46.703 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:45:46.703 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x2f018fb87aa4aafe", 2024-04-26T23:45:46.703 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:45:46.703 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2024-04-26T23:45:46.704 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:45:46.704 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:45:46.704 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:45:46.704 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:45:46.704 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 4 2024-04-26T23:45:46.704 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:45:46.704 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:45:46.704 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": [ 2024-04-26T23:45:46.704 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:45:46.704 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:45:46.704 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:45:46.704 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2024-04-26T23:45:46.704 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:45:46.704 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:45:46.704 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:45:46.705 INFO:teuthology.orchestra.run.smithi088.stdout: "stretch_mode": false 2024-04-26T23:45:46.705 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-04-26T23:45:46.706 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:46.687+0000 7f53aa015640 1 -- 172.21.15.88:0/149767002 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f539006c8a0 msgr2=0x7f539006ed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:46.706 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:46.687+0000 7f53aa015640 1 --2- 172.21.15.88:0/149767002 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f539006c8a0 0x7f539006ed60 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f539c003cb0 tx=0x7f539c0093f0 comp rx=0 tx=0).stop 2024-04-26T23:45:46.706 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:46.687+0000 7f53aa015640 1 -- 172.21.15.88:0/149767002 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f53a40ca5a0 msgr2=0x7f53a41533f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:46.706 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:46.687+0000 7f53aa015640 1 --2- 172.21.15.88:0/149767002 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f53a40ca5a0 0x7f53a41533f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f539800e980 tx=0x7f539800ee40 comp rx=0 tx=0).stop 2024-04-26T23:45:46.707 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:46.687+0000 7f53a3fff640 1 -- 172.21.15.88:0/149767002 reap_dead start 2024-04-26T23:45:46.707 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:46.687+0000 7f53a3fff640 1 -- 172.21.15.88:0/149767002 reap_dead start 2024-04-26T23:45:46.707 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:46.687+0000 7f53aa015640 1 -- 172.21.15.88:0/149767002 shutdown_connections 2024-04-26T23:45:46.707 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:46.687+0000 7f53aa015640 1 -- 172.21.15.88:0/149767002 >> 172.21.15.88:0/149767002 conn(0x7f53a40ae010 msgr2=0x7f53a41505b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:46.707 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:46.688+0000 7f53aa015640 1 -- 172.21.15.88:0/149767002 shutdown_connections 2024-04-26T23:45:46.707 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:45:46.688+0000 7f53aa015640 1 -- 172.21.15.88:0/149767002 wait complete. 2024-04-26T23:45:46.707 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-04-26T23:45:46.707 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2024-04-26T23:46:04.374 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:46:04.377 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:46:06.708 INFO:tasks.mon_thrash.mon_thrasher:killing mon.b 2024-04-26T23:46:06.708 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.b 2024-04-26T23:46:06.708 INFO:tasks.ceph.mon.b:Restarting daemon 2024-04-26T23:46:06.709 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-04-26T23:46:06.712 INFO:tasks.ceph.mon.b:Started 2024-04-26T23:46:06.712 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-04-26T23:46:06.712 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-04-26T23:46:06.887 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:06.883+0000 7fb2c0864640 1 Processor -- start 2024-04-26T23:46:06.887 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:06.883+0000 7fb2c0864640 1 -- start start 2024-04-26T23:46:06.890 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:06.885+0000 7fb2c0864640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fb2bc0c90c0 0x7fb2bc15bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:06.890 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:06.885+0000 7fb2c0864640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb2bc0cbde0 con 0x7fb2bc0c6e00 2024-04-26T23:46:06.890 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:06.885+0000 7fb2c0864640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb2bc0cc0c0 con 0x7fb2bc0bfbb0 2024-04-26T23:46:06.890 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:06.885+0000 7fb2c0864640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7fb2bc15c150 con 0x7fb2bc0c90c0 2024-04-26T23:46:06.890 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:06.885+0000 7fb2bad9d640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fb2bc0c6e00 0x7fb2bc158510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:47614/0 (socket says 172.21.15.88:47614) 2024-04-26T23:46:06.891 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:06.885+0000 7fb2bad9d640 1 -- 172.21.15.88:0/869748877 learned_addr learned my addr 172.21.15.88:0/869748877 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-26T23:46:06.891 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:06.885+0000 7fb2b1d9b640 1 -- 172.21.15.88:0/869748877 >> v1:172.21.15.175:6789/0 conn(0x7fb2bc0bfbb0 legacy=0x7fb2bc0cadd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.175:6789/0 2024-04-26T23:46:06.891 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:06.885+0000 7fb2ba59c640 1 -- 172.21.15.88:0/869748877 >> v2:172.21.15.175:3300/0 conn(0x7fb2bc0c90c0 msgr2=0x7fb2bc15bc10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.175:3300/0 2024-04-26T23:46:06.891 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:06.885+0000 7fb2ba59c640 1 --2- 172.21.15.88:0/869748877 >> v2:172.21.15.175:3300/0 conn(0x7fb2bc0c90c0 0x7fb2bc15bc10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:46:06.891 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:06.886+0000 7fb2b9d9b640 1 -- 172.21.15.88:0/869748877 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3221593697 0 0) 0x7fb2bc0cbde0 con 0x7fb2bc0c6e00 2024-04-26T23:46:06.891 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:06.886+0000 7fb2b9d9b640 1 -- 172.21.15.88:0/869748877 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb29c003520 con 0x7fb2bc0c6e00 2024-04-26T23:46:06.891 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:06.886+0000 7fb2b9d9b640 1 -- 172.21.15.88:0/869748877 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3112276134 0 0) 0x7fb29c003520 con 0x7fb2bc0c6e00 2024-04-26T23:46:06.891 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:06.886+0000 7fb2b9d9b640 1 -- 172.21.15.88:0/869748877 >> v2:172.21.15.175:3300/0 conn(0x7fb2bc0c90c0 msgr2=0x7fb2bc15bc10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T23:46:06.891 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:06.886+0000 7fb2b9d9b640 1 --2- 172.21.15.88:0/869748877 >> v2:172.21.15.175:3300/0 conn(0x7fb2bc0c90c0 0x7fb2bc15bc10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:06.891 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:06.886+0000 7fb2b9d9b640 1 -- 172.21.15.88:0/869748877 >> v1:172.21.15.175:6789/0 conn(0x7fb2bc0bfbb0 legacy=0x7fb2bc0cadd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T23:46:06.891 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:06.886+0000 7fb2b9d9b640 1 -- 172.21.15.88:0/869748877 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2bc0ca5d0 con 0x7fb2bc0c6e00 2024-04-26T23:46:06.891 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:06.886+0000 7fb2b9d9b640 1 -- 172.21.15.88:0/869748877 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 356324787 0 0) 0x7fb2b40019f0 con 0x7fb2bc0c6e00 2024-04-26T23:46:06.891 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:06.886+0000 7fb2b9d9b640 1 -- 172.21.15.88:0/869748877 >> v1:172.21.15.88:6789/0 conn(0x7fb2bc0c6e00 legacy=0x7fb2bc158510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:06.891 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:06.886+0000 7fb2b9d9b640 1 --2- 172.21.15.88:0/869748877 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb29c0039b0 0x7fb29c003db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:06.891 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:06.886+0000 7fb2b9d9b640 1 --2- 172.21.15.88:0/869748877 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb29c004800 0x7fb29c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:06.892 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:06.886+0000 7fb2b9d9b640 1 --2- 172.21.15.88:0/869748877 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb29c005370 0x7fb29c00b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:06.892 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:06.886+0000 7fb2b9d9b640 1 -- 172.21.15.88:0/869748877 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fb2bc15c150 con 0x7fb29c004800 2024-04-26T23:46:06.892 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:06.886+0000 7fb2b9d9b640 1 -- 172.21.15.88:0/869748877 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fb29c00c2c0 con 0x7fb29c0039b0 2024-04-26T23:46:06.892 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:06.886+0000 7fb2b9d9b640 1 -- 172.21.15.88:0/869748877 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fb29c00c4c0 con 0x7fb29c005370 2024-04-26T23:46:06.892 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:06.886+0000 7fb2ba59c640 1 -- 172.21.15.88:0/869748877 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb29c0039b0 msgr2=0x7fb29c003db0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.175:3300/0 2024-04-26T23:46:06.892 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:06.886+0000 7fb2ba59c640 1 --2- 172.21.15.88:0/869748877 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb29c0039b0 0x7fb29c003db0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:46:06.892 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:06.886+0000 7fb2b1d9b640 1 --2- 172.21.15.88:0/869748877 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb29c004800 0x7fb29c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:06.892 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:06.887+0000 7fb2bad9d640 1 --2- 172.21.15.88:0/869748877 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb29c005370 0x7fb29c00b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:06.892 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:06.887+0000 7fb2b1d9b640 1 -- 172.21.15.88:0/869748877 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb29c005370 msgr2=0x7fb29c00b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:46:06.892 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:06.887+0000 7fb2b1d9b640 1 --2- 172.21.15.88:0/869748877 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb29c005370 0x7fb29c00b9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:06.892 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:06.887+0000 7fb2b1d9b640 1 -- 172.21.15.88:0/869748877 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb29c0039b0 msgr2=0x7fb29c003db0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T23:46:06.892 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:06.887+0000 7fb2b1d9b640 1 --2- 172.21.15.88:0/869748877 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb29c0039b0 0x7fb29c003db0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:06.892 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:06.887+0000 7fb2b1d9b640 1 -- 172.21.15.88:0/869748877 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2bc0ca5d0 con 0x7fb29c004800 2024-04-26T23:46:06.892 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:06.887+0000 7fb2bad9d640 1 -- 172.21.15.88:0/869748877 reap_dead start 2024-04-26T23:46:06.893 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:06.888+0000 7fb2b1d9b640 1 --2- 172.21.15.88:0/869748877 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb29c004800 0x7fb29c004c80 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fb2ac02b9a0 tx=0x7fb29c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4eb70356679d91d8 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:06.893 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:06.889+0000 7fb2b9d9b640 1 -- 172.21.15.88:0/869748877 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2ac02b5a0 con 0x7fb29c004800 2024-04-26T23:46:06.893 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:06.889+0000 7fb2b9d9b640 1 -- 172.21.15.88:0/869748877 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2ac050070 con 0x7fb29c004800 2024-04-26T23:46:06.893 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:06.890+0000 7fb2b9d9b640 1 -- 172.21.15.88:0/869748877 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2ac04ce60 con 0x7fb29c004800 2024-04-26T23:46:06.894 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:06.890+0000 7fb2c0864640 1 -- 172.21.15.88:0/869748877 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb29c004800 msgr2=0x7fb29c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:06.894 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:06.890+0000 7fb2c0864640 1 --2- 172.21.15.88:0/869748877 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb29c004800 0x7fb29c004c80 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fb2ac02b9a0 tx=0x7fb29c005830 comp rx=0 tx=0).stop 2024-04-26T23:46:06.894 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:06.890+0000 7fb2c0864640 1 -- 172.21.15.88:0/869748877 shutdown_connections 2024-04-26T23:46:06.894 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:06.890+0000 7fb2c0864640 1 --2- 172.21.15.88:0/869748877 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb29c004800 0x7fb29c004c80 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:06.894 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:06.890+0000 7fb2c0864640 1 -- 172.21.15.88:0/869748877 >> 172.21.15.88:0/869748877 conn(0x7fb2bc0ae010 msgr2=0x7fb2bc0ae3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:06.894 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:06.891+0000 7fb2c0864640 1 -- 172.21.15.88:0/869748877 shutdown_connections 2024-04-26T23:46:06.894 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:06.891+0000 7fb2c0864640 1 -- 172.21.15.88:0/869748877 wait complete. 2024-04-26T23:46:06.896 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:06.893+0000 7fb2c0864640 1 Processor -- start 2024-04-26T23:46:06.898 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:06.893+0000 7fb2c0864640 1 -- start start 2024-04-26T23:46:06.898 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:06.894+0000 7fb2c0864640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb2bc1469f0 0x7fb2bc146dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:06.898 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:06.894+0000 7fb2c0864640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb2bc088ae0 0x7fb2bc089fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:06.898 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:06.894+0000 7fb2c0864640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb2bc0c0760 0x7fb2bc0c5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:06.898 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:06.894+0000 7fb2c0864640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fb2bc0ca380 con 0x7fb2bc088ae0 2024-04-26T23:46:06.898 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:06.894+0000 7fb2c0864640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fb2bc0c96b0 con 0x7fb2bc1469f0 2024-04-26T23:46:06.898 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:06.894+0000 7fb2c0864640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fb2bc15bc10 con 0x7fb2bc0c0760 2024-04-26T23:46:06.899 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:06.894+0000 7fb2ba59c640 1 -- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb2bc1469f0 msgr2=0x7fb2bc146dd0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.175:3300/0 2024-04-26T23:46:06.899 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:06.894+0000 7fb2ba59c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb2bc1469f0 0x7fb2bc146dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:46:06.899 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:06.894+0000 7fb2b1d9b640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb2bc088ae0 0x7fb2bc089fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:06.899 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:06.894+0000 7fb2b1d9b640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb2bc088ae0 0x7fb2bc089fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:42576/0 (socket says 172.21.15.88:42576) 2024-04-26T23:46:06.899 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:06.894+0000 7fb2b1d9b640 1 -- 172.21.15.88:0/2410968683 learned_addr learned my addr 172.21.15.88:0/2410968683 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:46:06.899 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:06.894+0000 7fb2bad9d640 1 --2- 172.21.15.88:0/2410968683 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb2bc0c0760 0x7fb2bc0c5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:06.899 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:06.895+0000 7fb2b1d9b640 1 -- 172.21.15.88:0/2410968683 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb2bc0c0760 msgr2=0x7fb2bc0c5920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:06.899 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:06.895+0000 7fb2b1d9b640 1 --2- 172.21.15.88:0/2410968683 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb2bc0c0760 0x7fb2bc0c5920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:06.899 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:06.895+0000 7fb2b1d9b640 1 -- 172.21.15.88:0/2410968683 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb2bc1469f0 msgr2=0x7fb2bc146dd0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T23:46:06.899 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:06.895+0000 7fb2b1d9b640 1 --2- 172.21.15.88:0/2410968683 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb2bc1469f0 0x7fb2bc146dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:06.899 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:06.895+0000 7fb2b1d9b640 1 -- 172.21.15.88:0/2410968683 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2bc0c45a0 con 0x7fb2bc088ae0 2024-04-26T23:46:06.899 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:06.895+0000 7fb2b1d9b640 1 --2- 172.21.15.88:0/2410968683 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb2bc088ae0 0x7fb2bc089fb0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fb2ac02bac0 tx=0x7fb2ac005a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:06.900 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:06.895+0000 7fb2b37fe640 1 -- 172.21.15.88:0/2410968683 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2ac063070 con 0x7fb2bc088ae0 2024-04-26T23:46:06.900 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:06.895+0000 7fb2c0864640 1 -- 172.21.15.88:0/2410968683 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2bc0c4880 con 0x7fb2bc088ae0 2024-04-26T23:46:06.900 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:06.895+0000 7fb2c0864640 1 -- 172.21.15.88:0/2410968683 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2bc0c4e40 con 0x7fb2bc088ae0 2024-04-26T23:46:06.900 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:06.896+0000 7fb2b37fe640 1 -- 172.21.15.88:0/2410968683 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2ac005480 con 0x7fb2bc088ae0 2024-04-26T23:46:06.901 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:06.896+0000 7fb2b37fe640 1 -- 172.21.15.88:0/2410968683 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2ac02b5a0 con 0x7fb2bc088ae0 2024-04-26T23:46:06.901 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:06.897+0000 7fb2c0864640 1 -- 172.21.15.88:0/2410968683 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb294005290 con 0x7fb2bc088ae0 2024-04-26T23:46:06.901 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:06.898+0000 7fb2b37fe640 1 -- 172.21.15.88:0/2410968683 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb2ac066070 con 0x7fb2bc088ae0 2024-04-26T23:46:06.908 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:06.901+0000 7fb2b37fe640 1 --2- 172.21.15.88:0/2410968683 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fb2a006c8f0 0x7fb2a006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:06.909 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:06.902+0000 7fb2b37fe640 1 -- 172.21.15.88:0/2410968683 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6666+0+0 (secure 0 0 0) 0x7fb2ac0cd540 con 0x7fb2bc088ae0 2024-04-26T23:46:06.909 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:06.903+0000 7fb2ba59c640 1 --2- 172.21.15.88:0/2410968683 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fb2a006c8f0 0x7fb2a006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:06.909 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:06.904+0000 7fb2ba59c640 1 --2- 172.21.15.88:0/2410968683 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fb2a006c8f0 0x7fb2a006edb0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fb2a4006fd0 tx=0x7fb2a4006ce0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:06.911 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:06.908+0000 7fb2b37fe640 1 -- 172.21.15.88:0/2410968683 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fb2ac05b040 con 0x7fb2bc088ae0 2024-04-26T23:46:07.416 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:07.412+0000 7fb2c0864640 1 -- 172.21.15.88:0/2410968683 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fb294005580 con 0x7fb2bc088ae0 2024-04-26T23:46:07.416 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:07.413+0000 7fb2b37fe640 1 -- 172.21.15.88:0/2410968683 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1559 (secure 0 0 0) 0x7fb2ac09afd0 con 0x7fb2bc088ae0 2024-04-26T23:46:07.420 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":58,"quorum":[0,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":21,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"555255e9-7ef9-4454-8dc9-35e96b70035c","modified":"2024-04-26T23:39:34.291658Z","created":"2024-04-26T23:39:34.291658Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:3300","nonce":0},{"type":"v1","addr":"172.21.15.175:6789","nonce":0}]},"addr":"172.21.15.175:6789/0","public_addr":"172.21.15.175:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:3301","nonce":0},{"type":"v1","addr":"172.21.15.175:6790","nonce":0}]},"addr":"172.21.15.175:6790/0","public_addr":"172.21.15.175:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-04-26T23:46:07.425 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:07.422+0000 7fb2c0864640 1 -- 172.21.15.88:0/2410968683 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fb2a006c8f0 msgr2=0x7fb2a006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:07.425 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:07.422+0000 7fb2c0864640 1 --2- 172.21.15.88:0/2410968683 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fb2a006c8f0 0x7fb2a006edb0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fb2a4006fd0 tx=0x7fb2a4006ce0 comp rx=0 tx=0).stop 2024-04-26T23:46:07.425 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:07.422+0000 7fb2c0864640 1 -- 172.21.15.88:0/2410968683 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb2bc088ae0 msgr2=0x7fb2bc089fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:07.425 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:07.422+0000 7fb2c0864640 1 --2- 172.21.15.88:0/2410968683 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb2bc088ae0 0x7fb2bc089fb0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fb2ac02bac0 tx=0x7fb2ac005a10 comp rx=0 tx=0).stop 2024-04-26T23:46:07.426 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:07.422+0000 7fb2c0864640 1 -- 172.21.15.88:0/2410968683 shutdown_connections 2024-04-26T23:46:07.426 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:07.422+0000 7fb2c0864640 1 --2- 172.21.15.88:0/2410968683 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fb2a006c8f0 0x7fb2a006edb0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:07.426 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:07.422+0000 7fb2c0864640 1 --2- 172.21.15.88:0/2410968683 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb2bc0c0760 0x7fb2bc0c5920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:07.426 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:07.422+0000 7fb2c0864640 1 --2- 172.21.15.88:0/2410968683 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb2bc088ae0 0x7fb2bc089fb0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:07.426 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:07.422+0000 7fb2c0864640 1 --2- 172.21.15.88:0/2410968683 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb2bc1469f0 0x7fb2bc146dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:07.427 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:07.422+0000 7fb2c0864640 1 -- 172.21.15.88:0/2410968683 >> 172.21.15.88:0/2410968683 conn(0x7fb2bc0ae010 msgr2=0x7fb2bc15b200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:07.427 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:07.423+0000 7fb2c0864640 1 -- 172.21.15.88:0/2410968683 shutdown_connections 2024-04-26T23:46:07.427 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:07.423+0000 7fb2c0864640 1 -- 172.21.15.88:0/2410968683 wait complete. 2024-04-26T23:46:10.447 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-04-26T23:46:10.631 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:10.625+0000 7fc065a09640 1 Processor -- start 2024-04-26T23:46:10.632 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:10.625+0000 7fc065a09640 1 -- start start 2024-04-26T23:46:10.632 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:10.627+0000 7fc065a09640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc0600a80a0 0x7fc0600c8250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:10.632 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:10.627+0000 7fc065a09640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc0600ae7b0 0x7fc06006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:10.632 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:10.627+0000 7fc065a09640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc060070750 con 0x7fc0600ae3d0 2024-04-26T23:46:10.632 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:10.627+0000 7fc065a09640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7fc0601565b0 con 0x7fc0600a80a0 2024-04-26T23:46:10.632 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:10.627+0000 7fc065a09640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fc060156800 con 0x7fc0600ae7b0 2024-04-26T23:46:10.632 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:10.628+0000 7fc05effd640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7fc0600ae3d0 0x7fc0600c5480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.88:59808/0 (socket says 172.21.15.88:59808) 2024-04-26T23:46:10.632 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:10.628+0000 7fc05effd640 1 -- 172.21.15.88:0/2444243069 learned_addr learned my addr 172.21.15.88:0/2444243069 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-26T23:46:10.633 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:10.629+0000 7fc05f7fe640 1 --2- 172.21.15.88:0/2444243069 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc0600ae7b0 0x7fc06006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:10.633 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:10.629+0000 7fc05e7fc640 1 --2- 172.21.15.88:0/2444243069 >> v2:172.21.15.88:3300/0 conn(0x7fc0600a80a0 0x7fc0600c8250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:10.635 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:10.629+0000 7fc05e7fc640 1 -- 172.21.15.88:0/2444243069 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc0600ae7b0 msgr2=0x7fc06006ede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:46:10.635 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:10.629+0000 7fc05e7fc640 1 --2- 172.21.15.88:0/2444243069 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc0600ae7b0 0x7fc06006ede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:10.635 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:10.629+0000 7fc05e7fc640 1 -- 172.21.15.88:0/2444243069 >> v1:172.21.15.175:6789/0 conn(0x7fc0600ae3d0 legacy=0x7fc0600c5480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:10.635 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:10.629+0000 7fc05e7fc640 1 -- 172.21.15.88:0/2444243069 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc060156ae0 con 0x7fc0600a80a0 2024-04-26T23:46:10.635 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:10.631+0000 7fc05e7fc640 1 --2- 172.21.15.88:0/2444243069 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc0600a80a0 0x7fc0600c8250 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fc0540097a0 tx=0x7fc05402b3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cfbbaf491707dbd server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:10.638 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:10.632+0000 7fc05dffb640 1 -- 172.21.15.88:0/2444243069 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc054037070 con 0x7fc0600a80a0 2024-04-26T23:46:10.638 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:10.632+0000 7fc05dffb640 1 -- 172.21.15.88:0/2444243069 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc054030710 con 0x7fc0600a80a0 2024-04-26T23:46:10.638 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:10.632+0000 7fc05dffb640 1 -- 172.21.15.88:0/2444243069 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc054030b20 con 0x7fc0600a80a0 2024-04-26T23:46:10.638 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:10.633+0000 7fc065a09640 1 -- 172.21.15.88:0/2444243069 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc0600a80a0 msgr2=0x7fc0600c8250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:10.638 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:10.633+0000 7fc065a09640 1 --2- 172.21.15.88:0/2444243069 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc0600a80a0 0x7fc0600c8250 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fc0540097a0 tx=0x7fc05402b3f0 comp rx=0 tx=0).stop 2024-04-26T23:46:10.638 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:10.633+0000 7fc065a09640 1 -- 172.21.15.88:0/2444243069 shutdown_connections 2024-04-26T23:46:10.640 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:10.633+0000 7fc065a09640 1 --2- 172.21.15.88:0/2444243069 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc0600ae7b0 0x7fc06006ede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:10.640 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:10.633+0000 7fc065a09640 1 --2- 172.21.15.88:0/2444243069 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc0600a80a0 0x7fc0600c8250 secure :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fc0540097a0 tx=0x7fc05402b3f0 comp rx=0 tx=0).stop 2024-04-26T23:46:10.640 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:10.633+0000 7fc065a09640 1 -- 172.21.15.88:0/2444243069 >> 172.21.15.88:0/2444243069 conn(0x7fc0600c89f0 msgr2=0x7fc0600c8dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:10.640 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:10.636+0000 7fc065a09640 1 -- 172.21.15.88:0/2444243069 shutdown_connections 2024-04-26T23:46:10.643 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:10.636+0000 7fc065a09640 1 -- 172.21.15.88:0/2444243069 wait complete. 2024-04-26T23:46:10.643 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:10.638+0000 7fc065a09640 1 Processor -- start 2024-04-26T23:46:10.643 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:10.638+0000 7fc065a09640 1 -- start start 2024-04-26T23:46:10.644 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:10.639+0000 7fc065a09640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc0600ae3d0 0x7fc06014ca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:10.644 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:10.639+0000 7fc065a09640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc0600ae7b0 0x7fc060153730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:10.644 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:10.639+0000 7fc065a09640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc060073840 0x7fc060073cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:10.645 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:10.639+0000 7fc065a09640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fc0600c5b90 con 0x7fc060073840 2024-04-26T23:46:10.645 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:10.639+0000 7fc065a09640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc0601570a0 con 0x7fc0600ae7b0 2024-04-26T23:46:10.645 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:10.639+0000 7fc065a09640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fc0600c5d10 con 0x7fc0600ae3d0 2024-04-26T23:46:10.646 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:10.641+0000 7fc05effd640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc0600ae3d0 0x7fc06014ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:10.646 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:10.641+0000 7fc05effd640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc0600ae3d0 0x7fc06014ca10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.88:59226/0 (socket says 172.21.15.88:59226) 2024-04-26T23:46:10.646 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:10.641+0000 7fc05effd640 1 -- 172.21.15.88:0/2879006776 learned_addr learned my addr 172.21.15.88:0/2879006776 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:46:10.646 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:10.642+0000 7fc05e7fc640 1 --2- 172.21.15.88:0/2879006776 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc0600ae7b0 0x7fc060153730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:10.646 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:10.642+0000 7fc05e7fc640 1 -- 172.21.15.88:0/2879006776 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc0600ae7b0 msgr2=0x7fc060153730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2024-04-26T23:46:10.646 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:10.642+0000 7fc05e7fc640 1 -- 172.21.15.88:0/2879006776 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc0600ae7b0 msgr2=0x7fc060153730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-26T23:46:10.646 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:10.642+0000 7fc05e7fc640 1 --2- 172.21.15.88:0/2879006776 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc0600ae7b0 0x7fc060153730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:46:10.646 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:10.642+0000 7fc05e7fc640 1 --2- 172.21.15.88:0/2879006776 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc0600ae7b0 0x7fc060153730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:46:10.647 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:10.643+0000 7fc05effd640 1 -- 172.21.15.88:0/2879006776 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc0600ae7b0 msgr2=0x7fc060153730 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T23:46:10.647 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:10.643+0000 7fc05effd640 1 --2- 172.21.15.88:0/2879006776 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc0600ae7b0 0x7fc060153730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:10.647 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:10.643+0000 7fc05effd640 1 -- 172.21.15.88:0/2879006776 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc060073840 msgr2=0x7fc060073cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:10.647 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:10.643+0000 7fc05f7fe640 1 --2- 172.21.15.88:0/2879006776 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc060073840 0x7fc060073cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:10.647 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:10.643+0000 7fc05effd640 1 --2- 172.21.15.88:0/2879006776 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc060073840 0x7fc060073cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:10.647 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:10.643+0000 7fc05effd640 1 -- 172.21.15.88:0/2879006776 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc060153c70 con 0x7fc0600ae3d0 2024-04-26T23:46:10.647 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:10.643+0000 7fc05f7fe640 1 --2- 172.21.15.88:0/2879006776 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc060073840 0x7fc060073cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:46:10.648 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:10.644+0000 7fc05effd640 1 --2- 172.21.15.88:0/2879006776 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc0600ae3d0 0x7fc06014ca10 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fc05800c460 tx=0x7fc05800c920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:10.652 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:10.647+0000 7fc047fff640 1 -- 172.21.15.88:0/2879006776 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc058017070 con 0x7fc0600ae3d0 2024-04-26T23:46:10.652 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:10.647+0000 7fc047fff640 1 -- 172.21.15.88:0/2879006776 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc058005ce0 con 0x7fc0600ae3d0 2024-04-26T23:46:10.652 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:10.647+0000 7fc047fff640 1 -- 172.21.15.88:0/2879006776 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc058007290 con 0x7fc0600ae3d0 2024-04-26T23:46:10.652 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:10.647+0000 7fc065a09640 1 -- 172.21.15.88:0/2879006776 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0601fd220 con 0x7fc0600ae3d0 2024-04-26T23:46:10.652 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:10.648+0000 7fc065a09640 1 -- 172.21.15.88:0/2879006776 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0601540d0 con 0x7fc0600ae3d0 2024-04-26T23:46:10.653 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:10.649+0000 7fc065a09640 1 -- 172.21.15.88:0/2879006776 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc0600c8280 con 0x7fc0600ae3d0 2024-04-26T23:46:10.658 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:10.653+0000 7fc047fff640 1 -- 172.21.15.88:0/2879006776 <== mon.2 v2:172.21.15.175:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc05801a070 con 0x7fc0600ae3d0 2024-04-26T23:46:10.658 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:10.653+0000 7fc047fff640 1 --2- 172.21.15.88:0/2879006776 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fc04c06c9f0 0x7fc04c06eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:10.659 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:10.653+0000 7fc047fff640 1 -- 172.21.15.88:0/2879006776 <== mon.2 v2:172.21.15.175:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6666+0+0 (secure 0 0 0) 0x7fc05808b6d0 con 0x7fc0600ae3d0 2024-04-26T23:46:10.659 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:10.654+0000 7fc05e7fc640 1 --2- 172.21.15.88:0/2879006776 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fc04c06c9f0 0x7fc04c06eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:10.659 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:10.655+0000 7fc05e7fc640 1 --2- 172.21.15.88:0/2879006776 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fc04c06c9f0 0x7fc04c06eeb0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fc054034000 tx=0x7fc054008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:10.665 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:10.661+0000 7fc047fff640 1 -- 172.21.15.88:0/2879006776 <== mon.2 v2:172.21.15.175:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fc0600c8280 con 0x7fc0600ae3d0 2024-04-26T23:46:11.194 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:11.189+0000 7fc065a09640 1 -- 172.21.15.88:0/2879006776 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fc0600765e0 con 0x7fc0600ae3d0 2024-04-26T23:46:11.195 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:11.191+0000 7fc047fff640 1 -- 172.21.15.88:0/2879006776 <== mon.2 v2:172.21.15.175:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1559 (secure 0 0 0) 0x7fc058021020 con 0x7fc0600ae3d0 2024-04-26T23:46:11.196 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":58,"quorum":[0,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":25,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"555255e9-7ef9-4454-8dc9-35e96b70035c","modified":"2024-04-26T23:39:34.291658Z","created":"2024-04-26T23:39:34.291658Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:3300","nonce":0},{"type":"v1","addr":"172.21.15.175:6789","nonce":0}]},"addr":"172.21.15.175:6789/0","public_addr":"172.21.15.175:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:3301","nonce":0},{"type":"v1","addr":"172.21.15.175:6790","nonce":0}]},"addr":"172.21.15.175:6790/0","public_addr":"172.21.15.175:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-04-26T23:46:11.201 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:11.195+0000 7fc065a09640 1 -- 172.21.15.88:0/2879006776 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fc04c06c9f0 msgr2=0x7fc04c06eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:11.201 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:11.196+0000 7fc065a09640 1 --2- 172.21.15.88:0/2879006776 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fc04c06c9f0 0x7fc04c06eeb0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fc054034000 tx=0x7fc054008030 comp rx=0 tx=0).stop 2024-04-26T23:46:11.201 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:11.196+0000 7fc065a09640 1 -- 172.21.15.88:0/2879006776 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc0600ae3d0 msgr2=0x7fc06014ca10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:11.201 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:11.196+0000 7fc065a09640 1 --2- 172.21.15.88:0/2879006776 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc0600ae3d0 0x7fc06014ca10 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fc05800c460 tx=0x7fc05800c920 comp rx=0 tx=0).stop 2024-04-26T23:46:11.201 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:11.196+0000 7fc065a09640 1 -- 172.21.15.88:0/2879006776 shutdown_connections 2024-04-26T23:46:11.201 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:11.196+0000 7fc065a09640 1 --2- 172.21.15.88:0/2879006776 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fc04c06c9f0 0x7fc04c06eeb0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:11.201 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:11.196+0000 7fc065a09640 1 --2- 172.21.15.88:0/2879006776 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc060073840 0x7fc060073cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:11.201 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:11.196+0000 7fc065a09640 1 --2- 172.21.15.88:0/2879006776 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc0600ae7b0 0x7fc060153730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:11.201 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:11.196+0000 7fc065a09640 1 --2- 172.21.15.88:0/2879006776 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc0600ae3d0 0x7fc06014ca10 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:11.201 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:11.196+0000 7fc065a09640 1 -- 172.21.15.88:0/2879006776 >> 172.21.15.88:0/2879006776 conn(0x7fc0600c89f0 msgr2=0x7fc06006eda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:11.201 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:11.197+0000 7fc065a09640 1 -- 172.21.15.88:0/2879006776 shutdown_connections 2024-04-26T23:46:11.201 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:11.197+0000 7fc065a09640 1 -- 172.21.15.88:0/2879006776 wait complete. 2024-04-26T23:46:14.219 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-04-26T23:46:14.425 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:14.420+0000 7f4b8e38e640 1 Processor -- start 2024-04-26T23:46:14.427 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:14.422+0000 7f4b8e38e640 1 -- start start 2024-04-26T23:46:14.427 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:14.423+0000 7f4b8e38e640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f4b800dbce0 0x7f4b800474a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:14.427 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:14.423+0000 7f4b8e38e640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4b8000bb50 con 0x7f4b8000a8b0 2024-04-26T23:46:14.428 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:14.423+0000 7f4b8e38e640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4b80048060 con 0x7f4b800df180 2024-04-26T23:46:14.428 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:14.423+0000 7f4b8e38e640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f4b8000a420 con 0x7f4b800dbce0 2024-04-26T23:46:14.428 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:14.423+0000 7f4b8cb8b640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f4b800df180 0x7f4b80006ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.88:59822/0 (socket says 172.21.15.88:59822) 2024-04-26T23:46:14.428 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:14.423+0000 7f4b8cb8b640 1 -- 172.21.15.88:0/2472955795 learned_addr learned my addr 172.21.15.88:0/2472955795 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-26T23:46:14.428 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:14.424+0000 7f4b8d38c640 1 --2- 172.21.15.88:0/2472955795 >> v2:172.21.15.88:3300/0 conn(0x7f4b800dbce0 0x7f4b800474a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:14.430 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:14.424+0000 7f4b8d38c640 1 -- 172.21.15.88:0/2472955795 >> v1:172.21.15.175:6789/0 conn(0x7f4b800df180 legacy=0x7f4b80006ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:46:14.430 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:14.424+0000 7f4b8d38c640 1 -- 172.21.15.88:0/2472955795 >> v1:172.21.15.88:6789/0 conn(0x7f4b8000a8b0 legacy=0x7f4b8000ad00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T23:46:14.430 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:14.424+0000 7f4b8d38c640 1 -- 172.21.15.88:0/2472955795 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b8000a0f0 con 0x7f4b800dbce0 2024-04-26T23:46:14.431 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:14.426+0000 7f4b8d38c640 1 --2- 172.21.15.88:0/2472955795 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4b800dbce0 0x7f4b800474a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f4b780097a0 tx=0x7f4b7802a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab4baa56bc0c3d66 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:14.431 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:14.427+0000 7f4b7ffff640 1 -- 172.21.15.88:0/2472955795 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b78037070 con 0x7f4b800dbce0 2024-04-26T23:46:14.431 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:14.427+0000 7f4b7ffff640 1 -- 172.21.15.88:0/2472955795 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b7802ae10 con 0x7f4b800dbce0 2024-04-26T23:46:14.432 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:14.428+0000 7f4b8e38e640 1 -- 172.21.15.88:0/2472955795 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4b800dbce0 msgr2=0x7f4b800474a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:14.432 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:14.428+0000 7f4b8e38e640 1 --2- 172.21.15.88:0/2472955795 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4b800dbce0 0x7f4b800474a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f4b780097a0 tx=0x7f4b7802a100 comp rx=0 tx=0).stop 2024-04-26T23:46:14.435 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:14.431+0000 7f4b8e38e640 1 -- 172.21.15.88:0/2472955795 shutdown_connections 2024-04-26T23:46:14.435 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:14.431+0000 7f4b8e38e640 1 --2- 172.21.15.88:0/2472955795 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4b800dbce0 0x7f4b800474a0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:14.435 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:14.431+0000 7f4b8e38e640 1 -- 172.21.15.88:0/2472955795 >> 172.21.15.88:0/2472955795 conn(0x7f4b80048250 msgr2=0x7f4b80048660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:14.436 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:14.432+0000 7f4b8e38e640 1 -- 172.21.15.88:0/2472955795 shutdown_connections 2024-04-26T23:46:14.440 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:14.432+0000 7f4b8e38e640 1 -- 172.21.15.88:0/2472955795 wait complete. 2024-04-26T23:46:14.440 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:14.434+0000 7f4b8e38e640 1 Processor -- start 2024-04-26T23:46:14.440 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:14.434+0000 7f4b8e38e640 1 -- start start 2024-04-26T23:46:14.440 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:14.435+0000 7f4b8e38e640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4b8000a8b0 0x7f4b8017d760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:14.440 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:14.435+0000 7f4b8e38e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4b800dbce0 0x7f4b800dde70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:14.440 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:14.435+0000 7f4b8e38e640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4b800df180 0x7f4b800449e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:14.441 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:14.435+0000 7f4b8e38e640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f4b800dc0c0 con 0x7f4b8000a8b0 2024-04-26T23:46:14.441 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:14.435+0000 7f4b8e38e640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f4b80047d80 con 0x7f4b800df180 2024-04-26T23:46:14.441 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:14.435+0000 7f4b8e38e640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f4b800df5f0 con 0x7f4b800dbce0 2024-04-26T23:46:14.441 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:14.435+0000 7f4b8d38c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4b8000a8b0 0x7f4b8017d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:14.441 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:14.436+0000 7f4b8d38c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4b8000a8b0 0x7f4b8017d760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:33472/0 (socket says 172.21.15.88:33472) 2024-04-26T23:46:14.441 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:14.436+0000 7f4b8d38c640 1 -- 172.21.15.88:0/4173400394 learned_addr learned my addr 172.21.15.88:0/4173400394 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:46:14.441 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:14.436+0000 7f4b8cb8b640 1 --2- 172.21.15.88:0/4173400394 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4b800dbce0 0x7f4b800dde70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:14.441 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:14.436+0000 7f4b8cb8b640 1 -- 172.21.15.88:0/4173400394 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4b800df180 msgr2=0x7f4b800449e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T23:46:14.441 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:14.437+0000 7f4b8db8d640 1 --2- 172.21.15.88:0/4173400394 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4b800df180 0x7f4b800449e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:14.444 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:14.440+0000 7f4b8cb8b640 1 --2- 172.21.15.88:0/4173400394 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4b800df180 0x7f4b800449e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:14.445 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:14.440+0000 7f4b8cb8b640 1 -- 172.21.15.88:0/4173400394 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4b8000a8b0 msgr2=0x7f4b8017d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:14.445 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:14.440+0000 7f4b8cb8b640 1 --2- 172.21.15.88:0/4173400394 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4b8000a8b0 0x7f4b8017d760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:14.445 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:14.440+0000 7f4b8cb8b640 1 -- 172.21.15.88:0/4173400394 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b8017cca0 con 0x7f4b800dbce0 2024-04-26T23:46:14.445 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:14.440+0000 7f4b8d38c640 1 --2- 172.21.15.88:0/4173400394 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4b8000a8b0 0x7f4b8017d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:46:14.445 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:14.440+0000 7f4b8db8d640 1 --2- 172.21.15.88:0/4173400394 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4b800df180 0x7f4b800449e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:46:14.449 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:14.445+0000 7f4b8cb8b640 1 --2- 172.21.15.88:0/4173400394 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4b800dbce0 0x7f4b800dde70 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f4b88069b60 tx=0x7f4b88069f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:14.450 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:14.445+0000 7f4b7dffb640 1 -- 172.21.15.88:0/4173400394 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b88091070 con 0x7f4b800dbce0 2024-04-26T23:46:14.451 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:14.446+0000 7f4b7dffb640 1 -- 172.21.15.88:0/4173400394 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b8806f840 con 0x7f4b800dbce0 2024-04-26T23:46:14.452 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:14.446+0000 7f4b8e38e640 1 -- 172.21.15.88:0/4173400394 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b80043020 con 0x7f4b800dbce0 2024-04-26T23:46:14.452 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:14.446+0000 7f4b7dffb640 1 -- 172.21.15.88:0/4173400394 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b8806fc30 con 0x7f4b800dbce0 2024-04-26T23:46:14.452 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:14.446+0000 7f4b8e38e640 1 -- 172.21.15.88:0/4173400394 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b8017cf60 con 0x7f4b800dbce0 2024-04-26T23:46:14.452 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:14.447+0000 7f4b8e38e640 1 -- 172.21.15.88:0/4173400394 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b68005290 con 0x7f4b800dbce0 2024-04-26T23:46:14.457 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:14.453+0000 7f4b7dffb640 1 -- 172.21.15.88:0/4173400394 <== mon.2 v2:172.21.15.175:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4b880b3690 con 0x7f4b800dbce0 2024-04-26T23:46:14.458 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:14.454+0000 7f4b7dffb640 1 --2- 172.21.15.88:0/4173400394 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f4b6c06c9c0 0x7f4b6c06ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:14.458 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:14.454+0000 7f4b7dffb640 1 -- 172.21.15.88:0/4173400394 <== mon.2 v2:172.21.15.175:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6666+0+0 (secure 0 0 0) 0x7f4b88108610 con 0x7f4b800dbce0 2024-04-26T23:46:14.458 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:14.454+0000 7f4b8d38c640 1 --2- 172.21.15.88:0/4173400394 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f4b6c06c9c0 0x7f4b6c06ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:14.459 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:14.455+0000 7f4b8d38c640 1 --2- 172.21.15.88:0/4173400394 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f4b6c06c9c0 0x7f4b6c06ee80 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f4b780097a0 tx=0x7f4b7802e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:14.471 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:14.467+0000 7f4b7dffb640 1 -- 172.21.15.88:0/4173400394 <== mon.2 v2:172.21.15.175:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f4b880d66f0 con 0x7f4b800dbce0 2024-04-26T23:46:14.894 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:14.890+0000 7f4b8e38e640 1 -- 172.21.15.88:0/4173400394 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f4b68005580 con 0x7f4b800dbce0 2024-04-26T23:46:14.895 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:14.891+0000 7f4b7dffb640 1 -- 172.21.15.88:0/4173400394 <== mon.2 v2:172.21.15.175:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1564 (secure 0 0 0) 0x7f4b880d5ff0 con 0x7f4b800dbce0 2024-04-26T23:46:14.895 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":60,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":2,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"555255e9-7ef9-4454-8dc9-35e96b70035c","modified":"2024-04-26T23:39:34.291658Z","created":"2024-04-26T23:39:34.291658Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:3300","nonce":0},{"type":"v1","addr":"172.21.15.175:6789","nonce":0}]},"addr":"172.21.15.175:6789/0","public_addr":"172.21.15.175:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:3301","nonce":0},{"type":"v1","addr":"172.21.15.175:6790","nonce":0}]},"addr":"172.21.15.175:6790/0","public_addr":"172.21.15.175:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-04-26T23:46:14.898 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:14.893+0000 7f4b8e38e640 1 -- 172.21.15.88:0/4173400394 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f4b6c06c9c0 msgr2=0x7f4b6c06ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:14.898 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:14.893+0000 7f4b8e38e640 1 --2- 172.21.15.88:0/4173400394 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f4b6c06c9c0 0x7f4b6c06ee80 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f4b780097a0 tx=0x7f4b7802e000 comp rx=0 tx=0).stop 2024-04-26T23:46:14.898 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:14.893+0000 7f4b8e38e640 1 -- 172.21.15.88:0/4173400394 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4b800dbce0 msgr2=0x7f4b800dde70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:14.898 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:14.893+0000 7f4b8e38e640 1 --2- 172.21.15.88:0/4173400394 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4b800dbce0 0x7f4b800dde70 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f4b88069b60 tx=0x7f4b88069f90 comp rx=0 tx=0).stop 2024-04-26T23:46:14.898 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:14.893+0000 7f4b8e38e640 1 -- 172.21.15.88:0/4173400394 shutdown_connections 2024-04-26T23:46:14.898 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:14.893+0000 7f4b8e38e640 1 --2- 172.21.15.88:0/4173400394 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f4b6c06c9c0 0x7f4b6c06ee80 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:14.898 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:14.893+0000 7f4b8e38e640 1 --2- 172.21.15.88:0/4173400394 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4b800dbce0 0x7f4b800dde70 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:14.898 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:14.893+0000 7f4b8e38e640 1 --2- 172.21.15.88:0/4173400394 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4b800df180 0x7f4b800449e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:14.898 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:14.893+0000 7f4b8e38e640 1 --2- 172.21.15.88:0/4173400394 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4b8000a8b0 0x7f4b8017d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:14.898 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:14.893+0000 7f4b8e38e640 1 -- 172.21.15.88:0/4173400394 >> 172.21.15.88:0/4173400394 conn(0x7f4b80048250 msgr2=0x7f4b8002b330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:14.898 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:14.893+0000 7f4b8e38e640 1 -- 172.21.15.88:0/4173400394 shutdown_connections 2024-04-26T23:46:14.899 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:14.893+0000 7f4b8e38e640 1 -- 172.21.15.88:0/4173400394 wait complete. 2024-04-26T23:46:14.911 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-04-26T23:46:14.911 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-04-26T23:46:14.912 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-04-26T23:46:15.091 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.086+0000 7f2559612640 1 Processor -- start 2024-04-26T23:46:15.091 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.086+0000 7f2559612640 1 -- start start 2024-04-26T23:46:15.092 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.088+0000 7f2559612640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f2554150300 0x7f2554152cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:15.092 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.088+0000 7f2559612640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f25540c3e00 con 0x7f25540ab380 2024-04-26T23:46:15.092 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.088+0000 7f2559612640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f25540c40e0 con 0x7f25540c4c90 2024-04-26T23:46:15.093 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.088+0000 7f2559612640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f255406e3d0 con 0x7f2554150300 2024-04-26T23:46:15.093 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.088+0000 7f2552ffd640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f2554150300 0x7f2554152cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:15.093 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.088+0000 7f2552ffd640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f2554150300 0x7f2554152cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:33484/0 (socket says 172.21.15.88:33484) 2024-04-26T23:46:15.093 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.088+0000 7f2552ffd640 1 -- 172.21.15.88:0/3884458742 learned_addr learned my addr 172.21.15.88:0/3884458742 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:46:15.094 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.089+0000 7f2552ffd640 1 -- 172.21.15.88:0/3884458742 >> v1:172.21.15.175:6789/0 conn(0x7f25540c4c90 legacy=0x7f255406eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:15.094 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.089+0000 7f2552ffd640 1 -- 172.21.15.88:0/3884458742 >> v1:172.21.15.88:6789/0 conn(0x7f25540ab380 legacy=0x7f25540c3640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:15.094 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.089+0000 7f2552ffd640 1 -- 172.21.15.88:0/3884458742 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25540c43c0 con 0x7f2554150300 2024-04-26T23:46:15.095 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.090+0000 7f2552ffd640 1 --2- 172.21.15.88:0/3884458742 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2554150300 0x7f2554152cf0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f255406e550 tx=0x7f254402a330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=107593ccec9ef2cb server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:15.095 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.091+0000 7f2551ffb640 1 -- 172.21.15.88:0/3884458742 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2544037070 con 0x7f2554150300 2024-04-26T23:46:15.095 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.091+0000 7f2551ffb640 1 -- 172.21.15.88:0/3884458742 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2544032640 con 0x7f2554150300 2024-04-26T23:46:15.095 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.091+0000 7f2551ffb640 1 -- 172.21.15.88:0/3884458742 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25440329f0 con 0x7f2554150300 2024-04-26T23:46:15.097 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.092+0000 7f2559612640 1 -- 172.21.15.88:0/3884458742 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2554150300 msgr2=0x7f2554152cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:15.097 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.092+0000 7f2559612640 1 --2- 172.21.15.88:0/3884458742 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2554150300 0x7f2554152cf0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f255406e550 tx=0x7f254402a330 comp rx=0 tx=0).stop 2024-04-26T23:46:15.097 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.093+0000 7f2559612640 1 -- 172.21.15.88:0/3884458742 shutdown_connections 2024-04-26T23:46:15.097 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.093+0000 7f2559612640 1 --2- 172.21.15.88:0/3884458742 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2554150300 0x7f2554152cf0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:15.097 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.093+0000 7f2559612640 1 -- 172.21.15.88:0/3884458742 >> 172.21.15.88:0/3884458742 conn(0x7f255406c310 msgr2=0x7f255406c6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:15.097 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.093+0000 7f2559612640 1 -- 172.21.15.88:0/3884458742 shutdown_connections 2024-04-26T23:46:15.098 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.093+0000 7f2559612640 1 -- 172.21.15.88:0/3884458742 wait complete. 2024-04-26T23:46:15.099 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.095+0000 7f2559612640 1 Processor -- start 2024-04-26T23:46:15.099 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.095+0000 7f2559612640 1 -- start start 2024-04-26T23:46:15.101 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.097+0000 7f2559612640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f25540ab380 0x7f2554074170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:15.101 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.097+0000 7f2559612640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f25540c4c90 0x7f25540746b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:15.101 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.097+0000 7f2559612640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2554150300 0x7f2554072c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:15.101 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.097+0000 7f2559612640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f255406f250 con 0x7f25540c4c90 2024-04-26T23:46:15.101 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.097+0000 7f2559612640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f255406e6b0 con 0x7f2554150300 2024-04-26T23:46:15.101 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.097+0000 7f2559612640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f255406f3d0 con 0x7f25540ab380 2024-04-26T23:46:15.103 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.097+0000 7f25527fc640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f25540c4c90 0x7f25540746b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:15.103 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.097+0000 7f25527fc640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f25540c4c90 0x7f25540746b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:33500/0 (socket says 172.21.15.88:33500) 2024-04-26T23:46:15.103 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.097+0000 7f25527fc640 1 -- 172.21.15.88:0/2175371298 learned_addr learned my addr 172.21.15.88:0/2175371298 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:46:15.103 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.097+0000 7f2552ffd640 1 --2- 172.21.15.88:0/2175371298 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f25540ab380 0x7f2554074170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:15.103 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.097+0000 7f25537fe640 1 --2- 172.21.15.88:0/2175371298 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2554150300 0x7f2554072c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:15.103 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.098+0000 7f25527fc640 1 -- 172.21.15.88:0/2175371298 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f25540ab380 msgr2=0x7f2554074170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:15.103 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.098+0000 7f25527fc640 1 --2- 172.21.15.88:0/2175371298 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f25540ab380 0x7f2554074170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:15.103 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.098+0000 7f25527fc640 1 -- 172.21.15.88:0/2175371298 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2554150300 msgr2=0x7f2554072c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:15.103 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.098+0000 7f25527fc640 1 --2- 172.21.15.88:0/2175371298 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2554150300 0x7f2554072c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:15.103 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.098+0000 7f25527fc640 1 -- 172.21.15.88:0/2175371298 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2554071ea0 con 0x7f25540c4c90 2024-04-26T23:46:15.104 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.098+0000 7f25527fc640 1 --2- 172.21.15.88:0/2175371298 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f25540c4c90 0x7f25540746b0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f254800c440 tx=0x7f2548001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:15.104 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.098+0000 7f253b7fe640 1 -- 172.21.15.88:0/2175371298 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25480052d0 con 0x7f25540c4c90 2024-04-26T23:46:15.104 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.098+0000 7f253b7fe640 1 -- 172.21.15.88:0/2175371298 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2548005470 con 0x7f25540c4c90 2024-04-26T23:46:15.104 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.098+0000 7f253b7fe640 1 -- 172.21.15.88:0/2175371298 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2548007260 con 0x7f25540c4c90 2024-04-26T23:46:15.104 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.098+0000 7f2559612640 1 -- 172.21.15.88:0/2175371298 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2554072180 con 0x7f25540c4c90 2024-04-26T23:46:15.104 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.099+0000 7f2559612640 1 -- 172.21.15.88:0/2175371298 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25541e5d10 con 0x7f25540c4c90 2024-04-26T23:46:15.105 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.100+0000 7f2559612640 1 --2- 172.21.15.88:0/2175371298 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f25541e8160 0x7f25540731a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:15.105 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.101+0000 7f2559612640 1 -- 172.21.15.88:0/2175371298 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f2554071c50 con 0x7f25541e8160 2024-04-26T23:46:15.105 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.101+0000 7f2552ffd640 1 --2- 172.21.15.88:0/2175371298 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f25541e8160 0x7f25540731a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:15.105 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.101+0000 7f253b7fe640 1 -- 172.21.15.88:0/2175371298 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2548007400 con 0x7f25540c4c90 2024-04-26T23:46:15.106 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.102+0000 7f253b7fe640 1 --2- 172.21.15.88:0/2175371298 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f254006c8f0 0x7f254006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:15.107 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.102+0000 7f253b7fe640 1 -- 172.21.15.88:0/2175371298 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6666+0+0 (secure 0 0 0) 0x7f254808b3c0 con 0x7f25540c4c90 2024-04-26T23:46:15.107 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.102+0000 7f25537fe640 1 --2- 172.21.15.88:0/2175371298 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f254006c8f0 0x7f254006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:15.107 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.103+0000 7f25537fe640 1 --2- 172.21.15.88:0/2175371298 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f254006c8f0 0x7f254006edb0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f254c001e90 tx=0x7f254c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:15.107 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.103+0000 7f2552ffd640 1 -- 172.21.15.88:0/2175371298 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2554069c10 con 0x7f25541e8160 2024-04-26T23:46:15.108 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.103+0000 7f2552ffd640 1 --2- 172.21.15.88:0/2175371298 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f25541e8160 0x7f25540731a0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f25540718e0 tx=0x7f25440046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:15.108 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.104+0000 7f253b7fe640 1 -- 172.21.15.88:0/2175371298 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2544037040 con 0x7f25541e8160 2024-04-26T23:46:15.111 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.105+0000 7f253b7fe640 1 -- 172.21.15.88:0/2175371298 <== mon.0 v2:172.21.15.88:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f2544009490 con 0x7f25541e8160 2024-04-26T23:46:15.111 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.105+0000 7f253b7fe640 1 -- 172.21.15.88:0/2175371298 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f25541e8160 msgr2=0x7f25540731a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:15.111 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.105+0000 7f253b7fe640 1 --2- 172.21.15.88:0/2175371298 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f25541e8160 0x7f25540731a0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f25540718e0 tx=0x7f25440046c0 comp rx=0 tx=0).stop 2024-04-26T23:46:15.111 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.105+0000 7f253b7fe640 1 -- 172.21.15.88:0/2175371298 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f25541e8160 msgr2=0x7f25540731a0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:46:15.111 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.105+0000 7f253b7fe640 1 --2- 172.21.15.88:0/2175371298 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f25541e8160 0x7f25540731a0 secure :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f25540718e0 tx=0x7f25440046c0 comp rx=0 tx=0).stop 2024-04-26T23:46:15.121 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.117+0000 7f2559612640 1 --2- 172.21.15.88:0/2175371298 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2554068a70 0x7f25541ea970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:15.122 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.117+0000 7f2559612640 1 -- 172.21.15.88:0/2175371298 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f25540507a0 con 0x7f2554068a70 2024-04-26T23:46:15.122 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.118+0000 7f2552ffd640 1 --2- 172.21.15.88:0/2175371298 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2554068a70 0x7f25541ea970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:15.122 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.118+0000 7f2552ffd640 1 -- 172.21.15.88:0/2175371298 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f25540c3420 con 0x7f2554068a70 2024-04-26T23:46:15.122 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.118+0000 7f2552ffd640 1 --2- 172.21.15.88:0/2175371298 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2554068a70 0x7f25541ea970 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f254402a370 tx=0x7f2544009240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:15.125 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-04-26T23:46:15.125 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2024-04-26T23:46:15.125 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2024-04-26T23:46:15.125 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "leader", 2024-04-26T23:46:15.125 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 60, 2024-04-26T23:46:15.125 INFO:teuthology.orchestra.run.smithi088.stdout: "uptime": 84173, 2024-04-26T23:46:15.125 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2024-04-26T23:46:15.125 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2024-04-26T23:46:15.125 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2024-04-26T23:46:15.125 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2024-04-26T23:46:15.125 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:46:15.125 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 3, 2024-04-26T23:46:15.125 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2024-04-26T23:46:15.126 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2450521708007866372", 2024-04-26T23:46:15.126 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2024-04-26T23:46:15.126 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-04-26T23:46:15.126 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-04-26T23:46:15.126 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-04-26T23:46:15.126 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-04-26T23:46:15.126 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-04-26T23:46:15.126 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-04-26T23:46:15.126 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-04-26T23:46:15.126 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-04-26T23:46:15.126 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-04-26T23:46:15.126 INFO:teuthology.orchestra.run.smithi088.stdout: "reef", 2024-04-26T23:46:15.126 INFO:teuthology.orchestra.run.smithi088.stdout: "squid" 2024-04-26T23:46:15.127 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:46:15.127 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540701547738038271", 2024-04-26T23:46:15.127 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2024-04-26T23:46:15.127 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-04-26T23:46:15.127 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-04-26T23:46:15.127 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-04-26T23:46:15.127 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-04-26T23:46:15.127 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-04-26T23:46:15.127 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-04-26T23:46:15.127 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-04-26T23:46:15.127 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-04-26T23:46:15.127 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-04-26T23:46:15.127 INFO:teuthology.orchestra.run.smithi088.stdout: "reef", 2024-04-26T23:46:15.127 INFO:teuthology.orchestra.run.smithi088.stdout: "squid" 2024-04-26T23:46:15.128 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:46:15.128 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:46:15.128 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2024-04-26T23:46:15.128 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2024-04-26T23:46:15.128 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2024-04-26T23:46:15.128 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2024-04-26T23:46:15.128 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2024-04-26T23:46:15.128 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "555255e9-7ef9-4454-8dc9-35e96b70035c", 2024-04-26T23:46:15.128 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2024-04-26T23:39:34.291658Z", 2024-04-26T23:46:15.128 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2024-04-26T23:39:34.291658Z", 2024-04-26T23:46:15.128 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 19, 2024-04-26T23:46:15.128 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "squid", 2024-04-26T23:46:15.128 INFO:teuthology.orchestra.run.smithi088.stdout: "election_strategy": 1, 2024-04-26T23:46:15.128 INFO:teuthology.orchestra.run.smithi088.stdout: "disallowed_leaders: ": "", 2024-04-26T23:46:15.129 INFO:teuthology.orchestra.run.smithi088.stdout: "stretch_mode": false, 2024-04-26T23:46:15.129 INFO:teuthology.orchestra.run.smithi088.stdout: "tiebreaker_mon": "", 2024-04-26T23:46:15.129 INFO:teuthology.orchestra.run.smithi088.stdout: "removed_ranks: ": "", 2024-04-26T23:46:15.129 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2024-04-26T23:46:15.129 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2024-04-26T23:46:15.129 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-04-26T23:46:15.129 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-04-26T23:46:15.129 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-04-26T23:46:15.129 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-04-26T23:46:15.129 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-04-26T23:46:15.129 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-04-26T23:46:15.129 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-04-26T23:46:15.129 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-04-26T23:46:15.130 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-04-26T23:46:15.130 INFO:teuthology.orchestra.run.smithi088.stdout: "reef", 2024-04-26T23:46:15.130 INFO:teuthology.orchestra.run.smithi088.stdout: "squid" 2024-04-26T23:46:15.130 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:46:15.130 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2024-04-26T23:46:15.130 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:46:15.130 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2024-04-26T23:46:15.130 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:46:15.130 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2024-04-26T23:46:15.130 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2024-04-26T23:46:15.130 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-04-26T23:46:15.130 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-04-26T23:46:15.130 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:46:15.130 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-04-26T23:46:15.130 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2024-04-26T23:46:15.131 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:46:15.131 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:46:15.131 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:46:15.131 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-04-26T23:46:15.131 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2024-04-26T23:46:15.131 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:46:15.131 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:46:15.131 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:46:15.131 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:46:15.131 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2024-04-26T23:46:15.131 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2024-04-26T23:46:15.131 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-04-26T23:46:15.131 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-04-26T23:46:15.132 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-04-26T23:46:15.132 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:46:15.132 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:46:15.132 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2024-04-26T23:46:15.132 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2024-04-26T23:46:15.132 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-04-26T23:46:15.132 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-04-26T23:46:15.132 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:46:15.132 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-04-26T23:46:15.132 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:3300", 2024-04-26T23:46:15.132 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:46:15.132 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:46:15.132 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:46:15.132 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-04-26T23:46:15.133 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6789", 2024-04-26T23:46:15.133 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:46:15.133 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:46:15.133 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:46:15.133 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:46:15.133 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6789/0", 2024-04-26T23:46:15.133 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.175:6789/0", 2024-04-26T23:46:15.133 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-04-26T23:46:15.133 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-04-26T23:46:15.133 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-04-26T23:46:15.133 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:46:15.133 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:46:15.133 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2024-04-26T23:46:15.133 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2024-04-26T23:46:15.133 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-04-26T23:46:15.134 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-04-26T23:46:15.134 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:46:15.134 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-04-26T23:46:15.134 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:3301", 2024-04-26T23:46:15.134 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:46:15.134 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:46:15.134 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:46:15.134 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-04-26T23:46:15.134 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6790", 2024-04-26T23:46:15.134 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:46:15.134 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:46:15.134 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:46:15.134 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:46:15.134 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6790/0", 2024-04-26T23:46:15.134 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.175:6790/0", 2024-04-26T23:46:15.135 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-04-26T23:46:15.135 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-04-26T23:46:15.135 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-04-26T23:46:15.135 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:46:15.135 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:46:15.135 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:46:15.135 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2024-04-26T23:46:15.135 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2024-04-26T23:46:15.135 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:46:15.135 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:46:15.135 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:46:15.135 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2024-04-26T23:46:15.135 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:46:15.135 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:46:15.135 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": [ 2024-04-26T23:46:15.135 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:46:15.136 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:46:15.136 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:46:15.136 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 3 2024-04-26T23:46:15.136 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:46:15.136 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:46:15.136 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": [ 2024-04-26T23:46:15.136 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:46:15.136 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:46:15.136 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:46:15.136 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2024-04-26T23:46:15.136 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:46:15.136 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:46:15.136 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2024-04-26T23:46:15.136 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:46:15.136 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:46:15.136 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:46:15.137 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 3 2024-04-26T23:46:15.137 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:46:15.137 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:46:15.137 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": [ 2024-04-26T23:46:15.137 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:46:15.137 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:46:15.137 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:46:15.137 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2024-04-26T23:46:15.137 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:46:15.137 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:46:15.137 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:46:15.137 INFO:teuthology.orchestra.run.smithi088.stdout: "stretch_mode": false 2024-04-26T23:46:15.137 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-04-26T23:46:15.138 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.120+0000 7f253b7fe640 1 -- 172.21.15.88:0/2175371298 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f254404e070 con 0x7f2554068a70 2024-04-26T23:46:15.138 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.120+0000 7f253b7fe640 1 -- 172.21.15.88:0/2175371298 <== mon.0 v2:172.21.15.88:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5066 (secure 0 0 0) 0x7f2544048a50 con 0x7f2554068a70 2024-04-26T23:46:15.138 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.120+0000 7f253b7fe640 1 -- 172.21.15.88:0/2175371298 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2554068a70 msgr2=0x7f25541ea970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:15.138 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.120+0000 7f253b7fe640 1 --2- 172.21.15.88:0/2175371298 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2554068a70 0x7f25541ea970 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f254402a370 tx=0x7f2544009240 comp rx=0 tx=0).stop 2024-04-26T23:46:15.139 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.120+0000 7f253b7fe640 1 -- 172.21.15.88:0/2175371298 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2554068a70 msgr2=0x7f25541ea970 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:46:15.139 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.120+0000 7f253b7fe640 1 --2- 172.21.15.88:0/2175371298 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2554068a70 0x7f25541ea970 secure :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f254402a370 tx=0x7f2544009240 comp rx=0 tx=0).stop 2024-04-26T23:46:15.139 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.120+0000 7f2559612640 1 -- 172.21.15.88:0/2175371298 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f254006c8f0 msgr2=0x7f254006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:15.139 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.120+0000 7f2559612640 1 --2- 172.21.15.88:0/2175371298 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f254006c8f0 0x7f254006edb0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f254c001e90 tx=0x7f254c009040 comp rx=0 tx=0).stop 2024-04-26T23:46:15.139 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.121+0000 7f2559612640 1 -- 172.21.15.88:0/2175371298 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f25540c4c90 msgr2=0x7f25540746b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:15.139 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.121+0000 7f2559612640 1 --2- 172.21.15.88:0/2175371298 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f25540c4c90 0x7f25540746b0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f254800c440 tx=0x7f2548001e70 comp rx=0 tx=0).stop 2024-04-26T23:46:15.139 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.121+0000 7f25537fe640 1 -- 172.21.15.88:0/2175371298 reap_dead start 2024-04-26T23:46:15.139 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.121+0000 7f25537fe640 1 -- 172.21.15.88:0/2175371298 reap_dead start 2024-04-26T23:46:15.139 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.121+0000 7f2559612640 1 -- 172.21.15.88:0/2175371298 shutdown_connections 2024-04-26T23:46:15.139 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.121+0000 7f2559612640 1 -- 172.21.15.88:0/2175371298 >> 172.21.15.88:0/2175371298 conn(0x7f255406c310 msgr2=0x7f255414f3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:15.139 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.121+0000 7f2559612640 1 -- 172.21.15.88:0/2175371298 shutdown_connections 2024-04-26T23:46:15.139 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.121+0000 7f2559612640 1 -- 172.21.15.88:0/2175371298 wait complete. 2024-04-26T23:46:15.145 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-04-26T23:46:15.145 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-04-26T23:46:15.145 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-04-26T23:46:15.265 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.261+0000 7f83cb0d1640 1 Processor -- start 2024-04-26T23:46:15.266 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.261+0000 7f83cb0d1640 1 -- start start 2024-04-26T23:46:15.270 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.262+0000 7f83cb0d1640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f83c4154160 0x7f83c4156bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:15.270 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.262+0000 7f83cb0d1640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f83c40ca5a0 0x7f83c415a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:15.270 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.262+0000 7f83cb0d1640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f83c40c6e00 0x7f83c40c7290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:15.271 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.262+0000 7f83cb0d1640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f83c415a6e0 con 0x7f83c4154160 2024-04-26T23:46:15.271 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.262+0000 7f83cb0d1640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f83c40c9100 con 0x7f83c40c6e00 2024-04-26T23:46:15.271 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.262+0000 7f83cb0d1640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f83c40c8df0 con 0x7f83c40ca5a0 2024-04-26T23:46:15.271 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.262+0000 7f83c8e6d640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f83c4154160 0x7f83c4156bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:15.271 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.262+0000 7f83c8e6d640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f83c4154160 0x7f83c4156bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:33526/0 (socket says 172.21.15.88:33526) 2024-04-26T23:46:15.271 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.262+0000 7f83c8e6d640 1 -- 172.21.15.88:0/386917500 learned_addr learned my addr 172.21.15.88:0/386917500 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:46:15.272 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.262+0000 7f83c3fff640 1 --2- 172.21.15.88:0/386917500 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f83c40ca5a0 0x7f83c415a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:15.272 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.262+0000 7f83c966e640 1 --2- 172.21.15.88:0/386917500 >> v2:172.21.15.175:3300/0 conn(0x7f83c40c6e00 0x7f83c40c7290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:15.272 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.262+0000 7f83c8e6d640 1 -- 172.21.15.88:0/386917500 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f83c40ca5a0 msgr2=0x7f83c415a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:46:15.272 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.262+0000 7f83c8e6d640 1 --2- 172.21.15.88:0/386917500 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f83c40ca5a0 0x7f83c415a1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:15.272 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.262+0000 7f83c8e6d640 1 -- 172.21.15.88:0/386917500 >> v2:172.21.15.175:3300/0 conn(0x7f83c40c6e00 msgr2=0x7f83c40c7290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:46:15.272 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.262+0000 7f83c8e6d640 1 --2- 172.21.15.88:0/386917500 >> v2:172.21.15.175:3300/0 conn(0x7f83c40c6e00 0x7f83c40c7290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:15.273 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.262+0000 7f83c8e6d640 1 -- 172.21.15.88:0/386917500 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83c4154540 con 0x7f83c4154160 2024-04-26T23:46:15.273 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.263+0000 7f83c8e6d640 1 --2- 172.21.15.88:0/386917500 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f83c4154160 0x7f83c4156bb0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f83c40aeb90 tx=0x7f83b802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e028c8c9aaa3f33 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:15.273 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.263+0000 7f83c37fe640 1 -- 172.21.15.88:0/386917500 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83b8037070 con 0x7f83c4154160 2024-04-26T23:46:15.273 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.263+0000 7f83c37fe640 1 -- 172.21.15.88:0/386917500 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83b8032440 con 0x7f83c4154160 2024-04-26T23:46:15.273 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.263+0000 7f83c37fe640 1 -- 172.21.15.88:0/386917500 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83b8032810 con 0x7f83c4154160 2024-04-26T23:46:15.273 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.264+0000 7f83cb0d1640 1 -- 172.21.15.88:0/386917500 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f83c4154160 msgr2=0x7f83c4156bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:15.273 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.264+0000 7f83cb0d1640 1 --2- 172.21.15.88:0/386917500 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f83c4154160 0x7f83c4156bb0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f83c40aeb90 tx=0x7f83b802a1e0 comp rx=0 tx=0).stop 2024-04-26T23:46:15.273 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.264+0000 7f83cb0d1640 1 -- 172.21.15.88:0/386917500 shutdown_connections 2024-04-26T23:46:15.274 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.264+0000 7f83cb0d1640 1 --2- 172.21.15.88:0/386917500 >> v2:172.21.15.175:3300/0 conn(0x7f83c40c6e00 0x7f83c40c7290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:15.274 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.264+0000 7f83cb0d1640 1 --2- 172.21.15.88:0/386917500 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f83c40ca5a0 0x7f83c415a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:15.274 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.264+0000 7f83cb0d1640 1 --2- 172.21.15.88:0/386917500 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f83c4154160 0x7f83c4156bb0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:15.274 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.264+0000 7f83cb0d1640 1 -- 172.21.15.88:0/386917500 >> 172.21.15.88:0/386917500 conn(0x7f83c40ae010 msgr2=0x7f83c40ae3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:15.274 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.264+0000 7f83cb0d1640 1 -- 172.21.15.88:0/386917500 shutdown_connections 2024-04-26T23:46:15.274 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.264+0000 7f83cb0d1640 1 -- 172.21.15.88:0/386917500 wait complete. 2024-04-26T23:46:15.274 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.265+0000 7f83cb0d1640 1 Processor -- start 2024-04-26T23:46:15.274 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.266+0000 7f83cb0d1640 1 -- start start 2024-04-26T23:46:15.279 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.267+0000 7f83cb0d1640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f83c40c6e00 0x7f83c40cb9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:15.280 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.267+0000 7f83cb0d1640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f83c40ca5a0 0x7f83c41496d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:15.280 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.267+0000 7f83cb0d1640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f83c4154160 0x7f83c4149c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:15.280 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.267+0000 7f83cb0d1640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f83c415aed0 con 0x7f83c40ca5a0 2024-04-26T23:46:15.280 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.267+0000 7f83cb0d1640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f83c415abf0 con 0x7f83c40c6e00 2024-04-26T23:46:15.280 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.267+0000 7f83cb0d1640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f83c40c9590 con 0x7f83c4154160 2024-04-26T23:46:15.280 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.267+0000 7f83c3fff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f83c40ca5a0 0x7f83c41496d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:15.280 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.267+0000 7f83c3fff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f83c40ca5a0 0x7f83c41496d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:33534/0 (socket says 172.21.15.88:33534) 2024-04-26T23:46:15.280 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.267+0000 7f83c3fff640 1 -- 172.21.15.88:0/3734873763 learned_addr learned my addr 172.21.15.88:0/3734873763 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:46:15.280 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.267+0000 7f83c8e6d640 1 --2- 172.21.15.88:0/3734873763 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f83c40c6e00 0x7f83c40cb9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:15.280 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.267+0000 7f83c966e640 1 --2- 172.21.15.88:0/3734873763 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f83c4154160 0x7f83c4149c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:15.280 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.267+0000 7f83c3fff640 1 -- 172.21.15.88:0/3734873763 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f83c4154160 msgr2=0x7f83c4149c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:15.281 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.267+0000 7f83c3fff640 1 --2- 172.21.15.88:0/3734873763 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f83c4154160 0x7f83c4149c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:15.281 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.267+0000 7f83c3fff640 1 -- 172.21.15.88:0/3734873763 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f83c40c6e00 msgr2=0x7f83c40cb9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:15.281 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.267+0000 7f83c3fff640 1 --2- 172.21.15.88:0/3734873763 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f83c40c6e00 0x7f83c40cb9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:15.281 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.267+0000 7f83c3fff640 1 -- 172.21.15.88:0/3734873763 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83c40c2b80 con 0x7f83c40ca5a0 2024-04-26T23:46:15.281 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.267+0000 7f83c8e6d640 1 --2- 172.21.15.88:0/3734873763 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f83c40c6e00 0x7f83c40cb9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:46:15.281 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.268+0000 7f83c3fff640 1 --2- 172.21.15.88:0/3734873763 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f83c40ca5a0 0x7f83c41496d0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f83b000e980 tx=0x7f83b000ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:15.281 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.268+0000 7f83c17fa640 1 -- 172.21.15.88:0/3734873763 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83b0017070 con 0x7f83c40ca5a0 2024-04-26T23:46:15.281 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.268+0000 7f83c17fa640 1 -- 172.21.15.88:0/3734873763 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83b000ca00 con 0x7f83c40ca5a0 2024-04-26T23:46:15.282 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.268+0000 7f83c17fa640 1 -- 172.21.15.88:0/3734873763 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83b000cdd0 con 0x7f83c40ca5a0 2024-04-26T23:46:15.282 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.268+0000 7f83cb0d1640 1 -- 172.21.15.88:0/3734873763 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83c40c2e60 con 0x7f83c40ca5a0 2024-04-26T23:46:15.282 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.268+0000 7f83cb0d1640 1 -- 172.21.15.88:0/3734873763 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83c40cbee0 con 0x7f83c40ca5a0 2024-04-26T23:46:15.282 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.269+0000 7f83cb0d1640 1 --2- 172.21.15.88:0/3734873763 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f83c40c0470 0x7f83c41f0190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:15.282 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.269+0000 7f83cb0d1640 1 -- 172.21.15.88:0/3734873763 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f83c40bfa30 con 0x7f83c40c0470 2024-04-26T23:46:15.282 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.270+0000 7f83c8e6d640 1 --2- 172.21.15.88:0/3734873763 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f83c40c0470 0x7f83c41f0190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:15.282 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.270+0000 7f83c17fa640 1 -- 172.21.15.88:0/3734873763 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f83b001a070 con 0x7f83c40ca5a0 2024-04-26T23:46:15.282 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.270+0000 7f83c8e6d640 1 -- 172.21.15.88:0/3734873763 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f83c40c6640 con 0x7f83c40c0470 2024-04-26T23:46:15.282 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.270+0000 7f83c8e6d640 1 --2- 172.21.15.88:0/3734873763 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f83c40c0470 0x7f83c41f0190 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f83c406da80 tx=0x7f83b80046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:15.282 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.271+0000 7f83c17fa640 1 --2- 172.21.15.88:0/3734873763 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f83a806c8f0 0x7f83a806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:15.282 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.271+0000 7f83c17fa640 1 -- 172.21.15.88:0/3734873763 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6666+0+0 (secure 0 0 0) 0x7f83b008bdf0 con 0x7f83c40ca5a0 2024-04-26T23:46:15.282 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.271+0000 7f83c966e640 1 --2- 172.21.15.88:0/3734873763 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f83a806c8f0 0x7f83a806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:15.282 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.271+0000 7f83c17fa640 1 -- 172.21.15.88:0/3734873763 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83b8043070 con 0x7f83c40c0470 2024-04-26T23:46:15.283 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.271+0000 7f83c966e640 1 --2- 172.21.15.88:0/3734873763 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f83a806c8f0 0x7f83a806edb0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f83bc003aa0 tx=0x7f83bc009820 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:15.283 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.271+0000 7f83c17fa640 1 -- 172.21.15.88:0/3734873763 <== mon.1 v2:172.21.15.175:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f83b803c640 con 0x7f83c40c0470 2024-04-26T23:46:15.283 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.271+0000 7f83c17fa640 1 -- 172.21.15.88:0/3734873763 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f83c40c0470 msgr2=0x7f83c41f0190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:15.283 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.271+0000 7f83c17fa640 1 --2- 172.21.15.88:0/3734873763 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f83c40c0470 0x7f83c41f0190 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f83c406da80 tx=0x7f83b80046c0 comp rx=0 tx=0).stop 2024-04-26T23:46:15.283 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.271+0000 7f83c17fa640 1 -- 172.21.15.88:0/3734873763 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f83c40c0470 msgr2=0x7f83c41f0190 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:46:15.283 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.271+0000 7f83c17fa640 1 --2- 172.21.15.88:0/3734873763 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f83c40c0470 0x7f83c41f0190 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:15.285 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.281+0000 7f83cb0d1640 1 --2- 172.21.15.88:0/3734873763 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f83c40c1380 0x7f83c41f06d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:15.285 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.281+0000 7f83cb0d1640 1 -- 172.21.15.88:0/3734873763 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f83c41efeb0 con 0x7f83c40c1380 2024-04-26T23:46:15.287 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.281+0000 7f83c8e6d640 1 --2- 172.21.15.88:0/3734873763 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f83c40c1380 0x7f83c41f06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:15.288 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.282+0000 7f83c8e6d640 1 -- 172.21.15.88:0/3734873763 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f83c40c3030 con 0x7f83c40c1380 2024-04-26T23:46:15.288 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.282+0000 7f83c8e6d640 1 --2- 172.21.15.88:0/3734873763 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f83c40c1380 0x7f83c41f06d0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f83b8000c00 tx=0x7f83b8009240 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:15.288 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.282+0000 7f83c17fa640 1 -- 172.21.15.88:0/3734873763 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83b8037040 con 0x7f83c40c1380 2024-04-26T23:46:15.288 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.283+0000 7f83c17fa640 1 -- 172.21.15.88:0/3734873763 <== mon.1 v2:172.21.15.175:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4553 (secure 0 0 0) 0x7f83b8009490 con 0x7f83c40c1380 2024-04-26T23:46:15.288 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.283+0000 7f83c17fa640 1 -- 172.21.15.88:0/3734873763 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f83c40c1380 msgr2=0x7f83c41f06d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:15.288 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.283+0000 7f83c17fa640 1 --2- 172.21.15.88:0/3734873763 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f83c40c1380 0x7f83c41f06d0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f83b8000c00 tx=0x7f83b8009240 comp rx=0 tx=0).stop 2024-04-26T23:46:15.288 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.283+0000 7f83c17fa640 1 -- 172.21.15.88:0/3734873763 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f83c40c1380 msgr2=0x7f83c41f06d0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:46:15.289 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.283+0000 7f83c17fa640 1 --2- 172.21.15.88:0/3734873763 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f83c40c1380 0x7f83c41f06d0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:15.289 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-04-26T23:46:15.289 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2024-04-26T23:46:15.289 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2024-04-26T23:46:15.289 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "peon", 2024-04-26T23:46:15.290 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 60, 2024-04-26T23:46:15.290 INFO:teuthology.orchestra.run.smithi088.stdout: "uptime": 8396, 2024-04-26T23:46:15.290 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2024-04-26T23:46:15.290 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2024-04-26T23:46:15.290 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2024-04-26T23:46:15.290 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2024-04-26T23:46:15.290 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:46:15.291 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 3, 2024-04-26T23:46:15.291 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2024-04-26T23:46:15.291 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2450521708007866372", 2024-04-26T23:46:15.291 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2024-04-26T23:46:15.291 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-04-26T23:46:15.291 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-04-26T23:46:15.291 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-04-26T23:46:15.291 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-04-26T23:46:15.292 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-04-26T23:46:15.292 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-04-26T23:46:15.292 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-04-26T23:46:15.292 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-04-26T23:46:15.292 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-04-26T23:46:15.292 INFO:teuthology.orchestra.run.smithi088.stdout: "reef", 2024-04-26T23:46:15.293 INFO:teuthology.orchestra.run.smithi088.stdout: "squid" 2024-04-26T23:46:15.293 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:46:15.293 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540701547738038271", 2024-04-26T23:46:15.293 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2024-04-26T23:46:15.293 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-04-26T23:46:15.293 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-04-26T23:46:15.293 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-04-26T23:46:15.294 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-04-26T23:46:15.294 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-04-26T23:46:15.294 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-04-26T23:46:15.294 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-04-26T23:46:15.294 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-04-26T23:46:15.294 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-04-26T23:46:15.294 INFO:teuthology.orchestra.run.smithi088.stdout: "reef", 2024-04-26T23:46:15.294 INFO:teuthology.orchestra.run.smithi088.stdout: "squid" 2024-04-26T23:46:15.294 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:46:15.295 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:46:15.295 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2024-04-26T23:46:15.295 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2024-04-26T23:46:15.295 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2024-04-26T23:46:15.295 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2024-04-26T23:46:15.295 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2024-04-26T23:46:15.295 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "555255e9-7ef9-4454-8dc9-35e96b70035c", 2024-04-26T23:46:15.295 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2024-04-26T23:39:34.291658Z", 2024-04-26T23:46:15.295 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2024-04-26T23:39:34.291658Z", 2024-04-26T23:46:15.295 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 19, 2024-04-26T23:46:15.295 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "squid", 2024-04-26T23:46:15.295 INFO:teuthology.orchestra.run.smithi088.stdout: "election_strategy": 1, 2024-04-26T23:46:15.295 INFO:teuthology.orchestra.run.smithi088.stdout: "disallowed_leaders: ": "", 2024-04-26T23:46:15.296 INFO:teuthology.orchestra.run.smithi088.stdout: "stretch_mode": false, 2024-04-26T23:46:15.296 INFO:teuthology.orchestra.run.smithi088.stdout: "tiebreaker_mon": "", 2024-04-26T23:46:15.296 INFO:teuthology.orchestra.run.smithi088.stdout: "removed_ranks: ": "", 2024-04-26T23:46:15.296 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2024-04-26T23:46:15.296 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2024-04-26T23:46:15.296 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-04-26T23:46:15.296 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-04-26T23:46:15.296 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-04-26T23:46:15.296 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-04-26T23:46:15.296 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-04-26T23:46:15.296 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-04-26T23:46:15.296 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-04-26T23:46:15.296 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-04-26T23:46:15.296 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-04-26T23:46:15.297 INFO:teuthology.orchestra.run.smithi088.stdout: "reef", 2024-04-26T23:46:15.297 INFO:teuthology.orchestra.run.smithi088.stdout: "squid" 2024-04-26T23:46:15.297 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:46:15.297 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2024-04-26T23:46:15.297 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:46:15.297 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2024-04-26T23:46:15.297 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:46:15.297 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2024-04-26T23:46:15.297 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2024-04-26T23:46:15.297 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-04-26T23:46:15.297 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-04-26T23:46:15.297 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:46:15.297 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-04-26T23:46:15.297 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2024-04-26T23:46:15.298 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:46:15.298 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:46:15.298 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:46:15.298 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-04-26T23:46:15.298 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2024-04-26T23:46:15.298 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:46:15.298 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:46:15.298 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:46:15.298 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:46:15.298 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2024-04-26T23:46:15.298 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2024-04-26T23:46:15.298 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-04-26T23:46:15.299 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-04-26T23:46:15.299 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-04-26T23:46:15.299 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:46:15.299 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:46:15.299 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2024-04-26T23:46:15.299 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2024-04-26T23:46:15.299 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-04-26T23:46:15.299 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-04-26T23:46:15.299 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:46:15.299 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-04-26T23:46:15.299 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:3300", 2024-04-26T23:46:15.299 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:46:15.299 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:46:15.299 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:46:15.299 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-04-26T23:46:15.300 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6789", 2024-04-26T23:46:15.300 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:46:15.300 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:46:15.300 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:46:15.300 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:46:15.300 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6789/0", 2024-04-26T23:46:15.300 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.175:6789/0", 2024-04-26T23:46:15.300 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-04-26T23:46:15.300 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-04-26T23:46:15.300 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-04-26T23:46:15.300 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:46:15.300 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:46:15.300 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2024-04-26T23:46:15.300 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2024-04-26T23:46:15.301 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-04-26T23:46:15.301 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-04-26T23:46:15.301 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:46:15.301 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-04-26T23:46:15.301 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:3301", 2024-04-26T23:46:15.301 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:46:15.301 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:46:15.301 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:46:15.301 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-04-26T23:46:15.301 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6790", 2024-04-26T23:46:15.301 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:46:15.301 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:46:15.302 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:46:15.302 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:46:15.302 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6790/0", 2024-04-26T23:46:15.302 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.175:6790/0", 2024-04-26T23:46:15.302 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-04-26T23:46:15.302 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-04-26T23:46:15.302 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-04-26T23:46:15.302 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:46:15.302 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:46:15.302 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:46:15.302 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2024-04-26T23:46:15.302 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2024-04-26T23:46:15.302 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:46:15.303 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:46:15.303 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:46:15.303 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2024-04-26T23:46:15.303 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:46:15.303 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:46:15.303 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2024-04-26T23:46:15.303 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:46:15.303 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:46:15.303 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:46:15.303 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2024-04-26T23:46:15.303 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:46:15.303 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:46:15.303 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:46:15.303 INFO:teuthology.orchestra.run.smithi088.stdout: "stretch_mode": false 2024-04-26T23:46:15.304 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-04-26T23:46:15.305 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.283+0000 7f83cb0d1640 1 -- 172.21.15.88:0/3734873763 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f83a806c8f0 msgr2=0x7f83a806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:15.305 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.283+0000 7f83cb0d1640 1 --2- 172.21.15.88:0/3734873763 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f83a806c8f0 0x7f83a806edb0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f83bc003aa0 tx=0x7f83bc009820 comp rx=0 tx=0).stop 2024-04-26T23:46:15.305 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.283+0000 7f83cb0d1640 1 -- 172.21.15.88:0/3734873763 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f83c40ca5a0 msgr2=0x7f83c41496d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:15.305 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.283+0000 7f83cb0d1640 1 --2- 172.21.15.88:0/3734873763 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f83c40ca5a0 0x7f83c41496d0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f83b000e980 tx=0x7f83b000ee40 comp rx=0 tx=0).stop 2024-04-26T23:46:15.305 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.283+0000 7f83c966e640 1 -- 172.21.15.88:0/3734873763 reap_dead start 2024-04-26T23:46:15.305 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.283+0000 7f83c966e640 1 -- 172.21.15.88:0/3734873763 reap_dead start 2024-04-26T23:46:15.305 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.283+0000 7f83cb0d1640 1 -- 172.21.15.88:0/3734873763 shutdown_connections 2024-04-26T23:46:15.306 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.283+0000 7f83cb0d1640 1 -- 172.21.15.88:0/3734873763 >> 172.21.15.88:0/3734873763 conn(0x7f83c40ae010 msgr2=0x7f83c40ccd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:15.306 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.283+0000 7f83cb0d1640 1 -- 172.21.15.88:0/3734873763 shutdown_connections 2024-04-26T23:46:15.306 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.283+0000 7f83cb0d1640 1 -- 172.21.15.88:0/3734873763 wait complete. 2024-04-26T23:46:15.306 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-04-26T23:46:15.306 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-04-26T23:46:15.306 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-04-26T23:46:15.442 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.437+0000 7f171efe5640 1 Processor -- start 2024-04-26T23:46:15.442 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.438+0000 7f171efe5640 1 -- start start 2024-04-26T23:46:15.445 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.439+0000 7f171efe5640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f171814cd10 0x7f17180acee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:15.445 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.439+0000 7f171efe5640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f17181534e0 0x7f17180c3ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:15.445 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.439+0000 7f171efe5640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1718153970 con 0x7f17180abfd0 2024-04-26T23:46:15.445 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.439+0000 7f171efe5640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f17180ab210 con 0x7f171814cd10 2024-04-26T23:46:15.445 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.439+0000 7f171efe5640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f17180ab4f0 con 0x7f17181534e0 2024-04-26T23:46:15.445 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.439+0000 7f171dfe3640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f171814cd10 0x7f17180acee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:15.445 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.439+0000 7f171dfe3640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f171814cd10 0x7f17180acee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:33544/0 (socket says 172.21.15.88:33544) 2024-04-26T23:46:15.446 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.439+0000 7f171dfe3640 1 -- 172.21.15.88:0/4164410634 learned_addr learned my addr 172.21.15.88:0/4164410634 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:46:15.446 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.440+0000 7f171dfe3640 1 -- 172.21.15.88:0/4164410634 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f17181534e0 msgr2=0x7f17180c3ad0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-26T23:46:15.446 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.440+0000 7f171dfe3640 1 --2- 172.21.15.88:0/4164410634 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f17181534e0 0x7f17180c3ad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:15.446 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.440+0000 7f171dfe3640 1 -- 172.21.15.88:0/4164410634 >> v1:172.21.15.88:6789/0 conn(0x7f17180abfd0 legacy=0x7f171806d1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:15.446 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.440+0000 7f171dfe3640 1 -- 172.21.15.88:0/4164410634 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17180ab7d0 con 0x7f171814cd10 2024-04-26T23:46:15.449 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.445+0000 7f171dfe3640 1 --2- 172.21.15.88:0/4164410634 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f171814cd10 0x7f17180acee0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f1714009870 tx=0x7f171402a1f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c9459ae0cc74b8 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:15.451 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.447+0000 7f171cfe1640 1 -- 172.21.15.88:0/4164410634 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1714037070 con 0x7f171814cd10 2024-04-26T23:46:15.451 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.447+0000 7f171cfe1640 1 -- 172.21.15.88:0/4164410634 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1714032440 con 0x7f171814cd10 2024-04-26T23:46:15.451 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.447+0000 7f171cfe1640 1 -- 172.21.15.88:0/4164410634 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1714032810 con 0x7f171814cd10 2024-04-26T23:46:15.455 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.451+0000 7f171efe5640 1 -- 172.21.15.88:0/4164410634 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f171814cd10 msgr2=0x7f17180acee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:15.455 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.451+0000 7f171efe5640 1 --2- 172.21.15.88:0/4164410634 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f171814cd10 0x7f17180acee0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f1714009870 tx=0x7f171402a1f0 comp rx=0 tx=0).stop 2024-04-26T23:46:15.458 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.454+0000 7f171efe5640 1 -- 172.21.15.88:0/4164410634 shutdown_connections 2024-04-26T23:46:15.459 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.454+0000 7f171efe5640 1 --2- 172.21.15.88:0/4164410634 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f17181534e0 0x7f17180c3ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:15.459 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.454+0000 7f171efe5640 1 --2- 172.21.15.88:0/4164410634 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f171814cd10 0x7f17180acee0 secure :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f1714009870 tx=0x7f171402a1f0 comp rx=0 tx=0).stop 2024-04-26T23:46:15.459 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.454+0000 7f171efe5640 1 -- 172.21.15.88:0/4164410634 >> 172.21.15.88:0/4164410634 conn(0x7f17180c4bc0 msgr2=0x7f17180c4fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:15.461 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.457+0000 7f171efe5640 1 -- 172.21.15.88:0/4164410634 shutdown_connections 2024-04-26T23:46:15.470 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.464+0000 7f171efe5640 1 -- 172.21.15.88:0/4164410634 wait complete. 2024-04-26T23:46:15.484 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.466+0000 7f171efe5640 1 Processor -- start 2024-04-26T23:46:15.485 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.480+0000 7f171efe5640 1 -- start start 2024-04-26T23:46:15.492 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.481+0000 7f171efe5640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f17180abfd0 0x7f17180c75f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:15.492 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.481+0000 7f171efe5640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f17181500c0 0x7f17181f4930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:15.492 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.481+0000 7f171efe5640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f17181557d0 0x7f17181f4e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:15.492 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.481+0000 7f171efe5640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f171806d900 con 0x7f17181557d0 2024-04-26T23:46:15.492 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.481+0000 7f171efe5640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f17180ac8a0 con 0x7f17180abfd0 2024-04-26T23:46:15.492 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.481+0000 7f171efe5640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f17181540d0 con 0x7f17181500c0 2024-04-26T23:46:15.492 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.482+0000 7f171e7e4640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f17181557d0 0x7f17181f4e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:15.492 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.482+0000 7f171e7e4640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f17181557d0 0x7f17181f4e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:33550/0 (socket says 172.21.15.88:33550) 2024-04-26T23:46:15.492 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.482+0000 7f171e7e4640 1 -- 172.21.15.88:0/1120799119 learned_addr learned my addr 172.21.15.88:0/1120799119 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:46:15.492 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.482+0000 7f171e7e4640 1 -- 172.21.15.88:0/1120799119 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f17181500c0 msgr2=0x7f17181f4930 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-26T23:46:15.492 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.482+0000 7f171e7e4640 1 --2- 172.21.15.88:0/1120799119 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f17181500c0 0x7f17181f4930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:15.492 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.482+0000 7f171e7e4640 1 -- 172.21.15.88:0/1120799119 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f17180abfd0 msgr2=0x7f17180c75f0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-26T23:46:15.492 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.482+0000 7f171e7e4640 1 --2- 172.21.15.88:0/1120799119 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f17180abfd0 0x7f17180c75f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:15.493 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.482+0000 7f171e7e4640 1 -- 172.21.15.88:0/1120799119 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1718154d90 con 0x7f17181557d0 2024-04-26T23:46:15.493 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.483+0000 7f171e7e4640 1 --2- 172.21.15.88:0/1120799119 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f17181557d0 0x7f17181f4e70 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f171000c710 tx=0x7f171000cbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:15.493 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.483+0000 7f170e7fc640 1 -- 172.21.15.88:0/1120799119 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1710016020 con 0x7f17181557d0 2024-04-26T23:46:15.493 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.483+0000 7f170e7fc640 1 -- 172.21.15.88:0/1120799119 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1710006d50 con 0x7f17181557d0 2024-04-26T23:46:15.493 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.483+0000 7f170e7fc640 1 -- 172.21.15.88:0/1120799119 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1710003b90 con 0x7f17181557d0 2024-04-26T23:46:15.493 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.486+0000 7f171efe5640 1 -- 172.21.15.88:0/1120799119 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1718155070 con 0x7f17181557d0 2024-04-26T23:46:15.493 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.486+0000 7f171efe5640 1 -- 172.21.15.88:0/1120799119 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17180c7b30 con 0x7f17181557d0 2024-04-26T23:46:15.494 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.490+0000 7f170e7fc640 1 -- 172.21.15.88:0/1120799119 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f171000a850 con 0x7f17181557d0 2024-04-26T23:46:15.495 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.491+0000 7f170e7fc640 1 --2- 172.21.15.88:0/1120799119 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f16fc06c940 0x7f16fc06ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:15.495 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.491+0000 7f171dfe3640 1 --2- 172.21.15.88:0/1120799119 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f16fc06c940 0x7f16fc06ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:15.495 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.491+0000 7f170e7fc640 1 -- 172.21.15.88:0/1120799119 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6666+0+0 (secure 0 0 0) 0x7f17100057a0 con 0x7f17181557d0 2024-04-26T23:46:15.496 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.492+0000 7f171efe5640 1 --2- 172.21.15.88:0/1120799119 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f17181534e0 0x7f171815dc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:15.496 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.492+0000 7f171efe5640 1 -- 172.21.15.88:0/1120799119 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f171806da80 con 0x7f17181534e0 2024-04-26T23:46:15.496 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.492+0000 7f171dfe3640 1 --2- 172.21.15.88:0/1120799119 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f16fc06c940 0x7f16fc06ee00 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f1714034000 tx=0x7f171402e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:15.497 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.493+0000 7f171d7e2640 1 --2- 172.21.15.88:0/1120799119 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f17181534e0 0x7f171815dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:15.498 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.494+0000 7f171d7e2640 1 -- 172.21.15.88:0/1120799119 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f17180506c0 con 0x7f17181534e0 2024-04-26T23:46:15.499 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.495+0000 7f171d7e2640 1 --2- 172.21.15.88:0/1120799119 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f17181534e0 0x7f171815dc70 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f17180c7e80 tx=0x7f170800b7a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:15.501 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.496+0000 7f170e7fc640 1 -- 172.21.15.88:0/1120799119 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1708015020 con 0x7f17181534e0 2024-04-26T23:46:15.501 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.497+0000 7f170e7fc640 1 -- 172.21.15.88:0/1120799119 <== mon.2 v2:172.21.15.175:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f1708011830 con 0x7f17181534e0 2024-04-26T23:46:15.501 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.497+0000 7f170e7fc640 1 -- 172.21.15.88:0/1120799119 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f17181534e0 msgr2=0x7f171815dc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:15.501 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.497+0000 7f170e7fc640 1 --2- 172.21.15.88:0/1120799119 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f17181534e0 0x7f171815dc70 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f17180c7e80 tx=0x7f170800b7a0 comp rx=0 tx=0).stop 2024-04-26T23:46:15.501 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.497+0000 7f170e7fc640 1 -- 172.21.15.88:0/1120799119 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f17181534e0 msgr2=0x7f171815dc70 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:46:15.501 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.497+0000 7f170e7fc640 1 --2- 172.21.15.88:0/1120799119 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f17181534e0 0x7f171815dc70 secure :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f17180c7e80 tx=0x7f170800b7a0 comp rx=0 tx=0).stop 2024-04-26T23:46:15.516 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.512+0000 7f171efe5640 1 --2- 172.21.15.88:0/1120799119 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f17180ac440 0x7f171815e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:15.516 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.512+0000 7f171efe5640 1 -- 172.21.15.88:0/1120799119 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f17181f4650 con 0x7f17180ac440 2024-04-26T23:46:15.517 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.513+0000 7f171d7e2640 1 --2- 172.21.15.88:0/1120799119 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f17180ac440 0x7f171815e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:15.524 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.520+0000 7f171d7e2640 1 -- 172.21.15.88:0/1120799119 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f171806eb50 con 0x7f17180ac440 2024-04-26T23:46:15.529 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-04-26T23:46:15.529 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2024-04-26T23:46:15.529 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2024-04-26T23:46:15.529 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "peon", 2024-04-26T23:46:15.530 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 60, 2024-04-26T23:46:15.530 INFO:teuthology.orchestra.run.smithi088.stdout: "uptime": 143810, 2024-04-26T23:46:15.530 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2024-04-26T23:46:15.530 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2024-04-26T23:46:15.530 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2024-04-26T23:46:15.530 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2024-04-26T23:46:15.530 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:46:15.530 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 3, 2024-04-26T23:46:15.530 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2024-04-26T23:46:15.530 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2450521708007866372", 2024-04-26T23:46:15.530 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2024-04-26T23:46:15.530 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-04-26T23:46:15.530 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-04-26T23:46:15.531 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-04-26T23:46:15.531 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-04-26T23:46:15.531 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-04-26T23:46:15.531 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-04-26T23:46:15.531 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-04-26T23:46:15.531 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-04-26T23:46:15.531 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-04-26T23:46:15.531 INFO:teuthology.orchestra.run.smithi088.stdout: "reef", 2024-04-26T23:46:15.531 INFO:teuthology.orchestra.run.smithi088.stdout: "squid" 2024-04-26T23:46:15.531 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:46:15.531 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540701547738038271", 2024-04-26T23:46:15.531 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2024-04-26T23:46:15.531 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-04-26T23:46:15.531 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-04-26T23:46:15.531 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-04-26T23:46:15.532 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-04-26T23:46:15.532 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-04-26T23:46:15.532 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-04-26T23:46:15.532 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-04-26T23:46:15.532 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-04-26T23:46:15.532 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-04-26T23:46:15.532 INFO:teuthology.orchestra.run.smithi088.stdout: "reef", 2024-04-26T23:46:15.532 INFO:teuthology.orchestra.run.smithi088.stdout: "squid" 2024-04-26T23:46:15.532 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:46:15.532 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:46:15.532 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2024-04-26T23:46:15.532 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2024-04-26T23:46:15.532 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2024-04-26T23:46:15.532 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2024-04-26T23:46:15.532 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2024-04-26T23:46:15.533 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "555255e9-7ef9-4454-8dc9-35e96b70035c", 2024-04-26T23:46:15.533 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2024-04-26T23:39:34.291658Z", 2024-04-26T23:46:15.533 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2024-04-26T23:39:34.291658Z", 2024-04-26T23:46:15.533 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 19, 2024-04-26T23:46:15.533 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "squid", 2024-04-26T23:46:15.533 INFO:teuthology.orchestra.run.smithi088.stdout: "election_strategy": 1, 2024-04-26T23:46:15.533 INFO:teuthology.orchestra.run.smithi088.stdout: "disallowed_leaders: ": "", 2024-04-26T23:46:15.533 INFO:teuthology.orchestra.run.smithi088.stdout: "stretch_mode": false, 2024-04-26T23:46:15.533 INFO:teuthology.orchestra.run.smithi088.stdout: "tiebreaker_mon": "", 2024-04-26T23:46:15.533 INFO:teuthology.orchestra.run.smithi088.stdout: "removed_ranks: ": "", 2024-04-26T23:46:15.533 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2024-04-26T23:46:15.533 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2024-04-26T23:46:15.533 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-04-26T23:46:15.533 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-04-26T23:46:15.533 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-04-26T23:46:15.534 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-04-26T23:46:15.534 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-04-26T23:46:15.534 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-04-26T23:46:15.534 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-04-26T23:46:15.534 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-04-26T23:46:15.534 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-04-26T23:46:15.534 INFO:teuthology.orchestra.run.smithi088.stdout: "reef", 2024-04-26T23:46:15.534 INFO:teuthology.orchestra.run.smithi088.stdout: "squid" 2024-04-26T23:46:15.534 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:46:15.534 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2024-04-26T23:46:15.534 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:46:15.534 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2024-04-26T23:46:15.534 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:46:15.535 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2024-04-26T23:46:15.535 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2024-04-26T23:46:15.535 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-04-26T23:46:15.535 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-04-26T23:46:15.535 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:46:15.535 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-04-26T23:46:15.535 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2024-04-26T23:46:15.535 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:46:15.535 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:46:15.535 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:46:15.535 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-04-26T23:46:15.535 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2024-04-26T23:46:15.535 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:46:15.535 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:46:15.535 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:46:15.536 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:46:15.536 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2024-04-26T23:46:15.536 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2024-04-26T23:46:15.536 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-04-26T23:46:15.536 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-04-26T23:46:15.536 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-04-26T23:46:15.536 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:46:15.536 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:46:15.536 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2024-04-26T23:46:15.536 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2024-04-26T23:46:15.536 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-04-26T23:46:15.536 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-04-26T23:46:15.536 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:46:15.536 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-04-26T23:46:15.536 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:3300", 2024-04-26T23:46:15.537 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:46:15.537 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:46:15.537 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:46:15.537 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-04-26T23:46:15.537 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6789", 2024-04-26T23:46:15.537 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:46:15.537 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:46:15.537 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:46:15.537 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:46:15.537 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6789/0", 2024-04-26T23:46:15.537 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.175:6789/0", 2024-04-26T23:46:15.537 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-04-26T23:46:15.537 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-04-26T23:46:15.537 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-04-26T23:46:15.537 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:46:15.538 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:46:15.538 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2024-04-26T23:46:15.538 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2024-04-26T23:46:15.538 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-04-26T23:46:15.538 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-04-26T23:46:15.538 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:46:15.538 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-04-26T23:46:15.538 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:3301", 2024-04-26T23:46:15.538 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:46:15.538 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:46:15.538 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:46:15.538 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-04-26T23:46:15.538 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6790", 2024-04-26T23:46:15.538 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:46:15.539 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:46:15.539 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:46:15.539 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:46:15.539 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6790/0", 2024-04-26T23:46:15.539 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.175:6790/0", 2024-04-26T23:46:15.539 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-04-26T23:46:15.539 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-04-26T23:46:15.539 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-04-26T23:46:15.539 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:46:15.539 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:46:15.539 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:46:15.539 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2024-04-26T23:46:15.539 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2024-04-26T23:46:15.539 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:46:15.539 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:46:15.540 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:46:15.540 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2024-04-26T23:46:15.540 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:46:15.540 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:46:15.540 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": [ 2024-04-26T23:46:15.540 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:46:15.540 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:46:15.540 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:46:15.540 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2024-04-26T23:46:15.540 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:46:15.541 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:46:15.541 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": [ 2024-04-26T23:46:15.541 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:46:15.541 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:46:15.541 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:46:15.541 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 6 2024-04-26T23:46:15.541 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:46:15.541 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:46:15.541 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2024-04-26T23:46:15.541 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:46:15.541 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x2f018fb87aa4aafe", 2024-04-26T23:46:15.541 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:46:15.541 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2024-04-26T23:46:15.541 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:46:15.541 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:46:15.542 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:46:15.542 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:46:15.542 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 4 2024-04-26T23:46:15.542 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:46:15.542 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:46:15.542 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": [ 2024-04-26T23:46:15.542 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:46:15.542 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:46:15.542 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:46:15.542 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2024-04-26T23:46:15.542 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:46:15.542 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:46:15.542 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:46:15.542 INFO:teuthology.orchestra.run.smithi088.stdout: "stretch_mode": false 2024-04-26T23:46:15.542 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-04-26T23:46:15.543 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.522+0000 7f171d7e2640 1 --2- 172.21.15.88:0/1120799119 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f17180ac440 0x7f171815e1b0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f17180c7e80 tx=0x7f17080046e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:15.543 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.523+0000 7f170e7fc640 1 -- 172.21.15.88:0/1120799119 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1708015040 con 0x7f17180ac440 2024-04-26T23:46:15.544 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.524+0000 7f170e7fc640 1 -- 172.21.15.88:0/1120799119 <== mon.2 v2:172.21.15.175:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5208 (secure 0 0 0) 0x7f170801c220 con 0x7f17180ac440 2024-04-26T23:46:15.544 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.524+0000 7f170e7fc640 1 -- 172.21.15.88:0/1120799119 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f17180ac440 msgr2=0x7f171815e1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:15.544 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.524+0000 7f170e7fc640 1 --2- 172.21.15.88:0/1120799119 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f17180ac440 0x7f171815e1b0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f17180c7e80 tx=0x7f17080046e0 comp rx=0 tx=0).stop 2024-04-26T23:46:15.544 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.524+0000 7f170e7fc640 1 -- 172.21.15.88:0/1120799119 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f17180ac440 msgr2=0x7f171815e1b0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:46:15.544 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.524+0000 7f170e7fc640 1 --2- 172.21.15.88:0/1120799119 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f17180ac440 0x7f171815e1b0 secure :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f17180c7e80 tx=0x7f17080046e0 comp rx=0 tx=0).stop 2024-04-26T23:46:15.544 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.530+0000 7f16fbfff640 1 -- 172.21.15.88:0/1120799119 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f16fc06c940 msgr2=0x7f16fc06ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:15.544 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.530+0000 7f16fbfff640 1 --2- 172.21.15.88:0/1120799119 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f16fc06c940 0x7f16fc06ee00 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f1714034000 tx=0x7f171402e000 comp rx=0 tx=0).stop 2024-04-26T23:46:15.544 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.530+0000 7f16fbfff640 1 -- 172.21.15.88:0/1120799119 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f17181557d0 msgr2=0x7f17181f4e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:15.544 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.530+0000 7f16fbfff640 1 --2- 172.21.15.88:0/1120799119 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f17181557d0 0x7f17181f4e70 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f171000c710 tx=0x7f171000cbd0 comp rx=0 tx=0).stop 2024-04-26T23:46:15.544 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.531+0000 7f171e7e4640 1 -- 172.21.15.88:0/1120799119 reap_dead start 2024-04-26T23:46:15.544 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.531+0000 7f171e7e4640 1 -- 172.21.15.88:0/1120799119 reap_dead start 2024-04-26T23:46:15.544 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.532+0000 7f16fbfff640 1 -- 172.21.15.88:0/1120799119 shutdown_connections 2024-04-26T23:46:15.544 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.532+0000 7f16fbfff640 1 -- 172.21.15.88:0/1120799119 >> 172.21.15.88:0/1120799119 conn(0x7f17180c4bc0 msgr2=0x7f1718147cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:15.544 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.532+0000 7f16fbfff640 1 -- 172.21.15.88:0/1120799119 shutdown_connections 2024-04-26T23:46:15.544 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.532+0000 7f16fbfff640 1 -- 172.21.15.88:0/1120799119 wait complete. 2024-04-26T23:46:15.569 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-04-26T23:46:15.569 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2024-04-26T23:46:15.569 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2024-04-26T23:46:15.751 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.746+0000 7f518e189640 1 Processor -- start 2024-04-26T23:46:15.751 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.747+0000 7f518e189640 1 -- start start 2024-04-26T23:46:15.753 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.749+0000 7f518e189640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f51880c55d0 0x7f51881575d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:15.754 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.750+0000 7f518e189640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f51880ad170 0x7f51880ad990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:15.754 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.750+0000 7f518e189640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f51880ab810 con 0x7f51880c2560 2024-04-26T23:46:15.754 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.750+0000 7f518e189640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f51880ad5b0 con 0x7f51880c55d0 2024-04-26T23:46:15.754 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.750+0000 7f518e189640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f51880abaf0 con 0x7f51880ad170 2024-04-26T23:46:15.755 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.751+0000 7f51877fe640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f51880c55d0 0x7f51881575d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:15.755 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.751+0000 7f51877fe640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f51880c55d0 0x7f51881575d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:33552/0 (socket says 172.21.15.88:33552) 2024-04-26T23:46:15.755 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.751+0000 7f5186ffd640 1 --1- 172.21.15.88:0/983485970 >> v1:172.21.15.175:6789/0 conn(0x7f51880c2560 0x7f518815a9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.88:59842/0 (socket says 172.21.15.88:59842) 2024-04-26T23:46:15.755 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.751+0000 7f51877fe640 1 -- 172.21.15.88:0/983485970 learned_addr learned my addr 172.21.15.88:0/983485970 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:46:15.756 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.752+0000 7f51877fe640 1 -- 172.21.15.88:0/983485970 >> v2:172.21.15.175:3300/0 conn(0x7f51880ad170 msgr2=0x7f51880ad990 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T23:46:15.756 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.752+0000 7f51877fe640 1 --2- 172.21.15.88:0/983485970 >> v2:172.21.15.175:3300/0 conn(0x7f51880ad170 0x7f51880ad990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:15.756 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.752+0000 7f51877fe640 1 -- 172.21.15.88:0/983485970 >> v1:172.21.15.175:6789/0 conn(0x7f51880c2560 legacy=0x7f518815a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:46:15.756 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.752+0000 7f51877fe640 1 -- 172.21.15.88:0/983485970 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f518815a1b0 con 0x7f51880c55d0 2024-04-26T23:46:15.759 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.754+0000 7f51877fe640 1 --2- 172.21.15.88:0/983485970 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f51880c55d0 0x7f51881575d0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f51880c29e0 tx=0x7f517802a4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=faf045a47d1b2296 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:15.759 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.755+0000 7f51867fc640 1 -- 172.21.15.88:0/983485970 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5178036070 con 0x7f51880c55d0 2024-04-26T23:46:15.759 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.755+0000 7f51867fc640 1 -- 172.21.15.88:0/983485970 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5178031600 con 0x7f51880c55d0 2024-04-26T23:46:15.760 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.755+0000 7f51867fc640 1 -- 172.21.15.88:0/983485970 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51780319d0 con 0x7f51880c55d0 2024-04-26T23:46:15.761 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.756+0000 7f518e189640 1 -- 172.21.15.88:0/983485970 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f51880c55d0 msgr2=0x7f51881575d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:15.761 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.756+0000 7f518e189640 1 --2- 172.21.15.88:0/983485970 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f51880c55d0 0x7f51881575d0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f51880c29e0 tx=0x7f517802a4a0 comp rx=0 tx=0).stop 2024-04-26T23:46:15.761 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.757+0000 7f518e189640 1 -- 172.21.15.88:0/983485970 shutdown_connections 2024-04-26T23:46:15.761 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.757+0000 7f518e189640 1 --2- 172.21.15.88:0/983485970 >> v2:172.21.15.175:3300/0 conn(0x7f51880ad170 0x7f51880ad990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:15.761 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.757+0000 7f518e189640 1 --2- 172.21.15.88:0/983485970 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f51880c55d0 0x7f51881575d0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:15.761 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.757+0000 7f518e189640 1 -- 172.21.15.88:0/983485970 >> 172.21.15.88:0/983485970 conn(0x7f51880c89b0 msgr2=0x7f51880c8dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:15.762 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.758+0000 7f518e189640 1 -- 172.21.15.88:0/983485970 shutdown_connections 2024-04-26T23:46:15.766 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.758+0000 7f518e189640 1 -- 172.21.15.88:0/983485970 wait complete. 2024-04-26T23:46:15.766 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.762+0000 7f518e189640 1 Processor -- start 2024-04-26T23:46:15.769 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.764+0000 7f518e189640 1 -- start start 2024-04-26T23:46:15.771 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.765+0000 7f518e189640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f51880ad170 0x7f518814d590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:15.771 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.765+0000 7f518e189640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f51880c2560 0x7f51880c77b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:15.771 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.765+0000 7f518e189640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f51881f72e0 0x7f51881f7790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:15.771 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.765+0000 7f518e189640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f51880c3560 con 0x7f51880ad170 2024-04-26T23:46:15.771 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.765+0000 7f518e189640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f518815b0c0 con 0x7f51881f72e0 2024-04-26T23:46:15.771 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.765+0000 7f518e189640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f51880c59b0 con 0x7f51880c2560 2024-04-26T23:46:15.772 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.765+0000 7f5187fff640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f51881f72e0 0x7f51881f7790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:15.772 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.765+0000 7f5187fff640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f51881f72e0 0x7f51881f7790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.88:32838/0 (socket says 172.21.15.88:32838) 2024-04-26T23:46:15.772 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.765+0000 7f5187fff640 1 -- 172.21.15.88:0/3005192076 learned_addr learned my addr 172.21.15.88:0/3005192076 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:46:15.772 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.765+0000 7f5186ffd640 1 --2- 172.21.15.88:0/3005192076 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f51880c2560 0x7f51880c77b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:15.772 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.767+0000 7f5187fff640 1 -- 172.21.15.88:0/3005192076 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f51880c2560 msgr2=0x7f51880c77b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:15.772 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.767+0000 7f5187fff640 1 --2- 172.21.15.88:0/3005192076 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f51880c2560 0x7f51880c77b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:15.772 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.767+0000 7f5187fff640 1 -- 172.21.15.88:0/3005192076 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f51880ad170 msgr2=0x7f518814d590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T23:46:15.772 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.767+0000 7f5187fff640 1 --2- 172.21.15.88:0/3005192076 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f51880ad170 0x7f518814d590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:15.772 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.767+0000 7f5187fff640 1 -- 172.21.15.88:0/3005192076 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f518814ef60 con 0x7f51881f72e0 2024-04-26T23:46:15.773 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.769+0000 7f5187fff640 1 --2- 172.21.15.88:0/3005192076 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f51881f72e0 0x7f51881f7790 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f518000b970 tx=0x7f518000be30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:15.777 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.771+0000 7f516ffff640 1 -- 172.21.15.88:0/3005192076 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5180019070 con 0x7f51881f72e0 2024-04-26T23:46:15.777 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.771+0000 7f516ffff640 1 -- 172.21.15.88:0/3005192076 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f518000cb40 con 0x7f51881f72e0 2024-04-26T23:46:15.777 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.771+0000 7f516ffff640 1 -- 172.21.15.88:0/3005192076 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5180014440 con 0x7f51881f72e0 2024-04-26T23:46:15.777 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.773+0000 7f518e189640 1 -- 172.21.15.88:0/3005192076 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51881fe430 con 0x7f51881f72e0 2024-04-26T23:46:15.777 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.773+0000 7f518e189640 1 -- 172.21.15.88:0/3005192076 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51881fd950 con 0x7f51881f72e0 2024-04-26T23:46:15.780 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.776+0000 7f516ffff640 1 -- 172.21.15.88:0/3005192076 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f518001c070 con 0x7f51881f72e0 2024-04-26T23:46:15.781 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.776+0000 7f516ffff640 1 --2- 172.21.15.88:0/3005192076 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f517406c9f0 0x7f517406eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:15.781 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.776+0000 7f518e189640 1 -- 172.21.15.88:0/3005192076 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5188076100 con 0x7f51881f72e0 2024-04-26T23:46:15.782 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.778+0000 7f51877fe640 1 --2- 172.21.15.88:0/3005192076 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f517406c9f0 0x7f517406eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:15.783 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.778+0000 7f51877fe640 1 --2- 172.21.15.88:0/3005192076 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f517406c9f0 0x7f517406eeb0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f5178033000 tx=0x7f5178008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:15.784 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.780+0000 7f516ffff640 1 -- 172.21.15.88:0/3005192076 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6666+0+0 (secure 0 0 0) 0x7f518008bb40 con 0x7f51881f72e0 2024-04-26T23:46:15.790 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:15.785+0000 7f516ffff640 1 -- 172.21.15.88:0/3005192076 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f51800595d0 con 0x7f51881f72e0 2024-04-26T23:46:16.307 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:16.303+0000 7f518e189640 1 -- 172.21.15.88:0/3005192076 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7f51880c8d90 con 0x7f51881f72e0 2024-04-26T23:46:16.311 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:16.307+0000 7f516ffff640 1 -- 172.21.15.88:0/3005192076 <== mon.1 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (secure 0 0 0) 0x7f518005d8d0 con 0x7f51881f72e0 2024-04-26T23:46:16.315 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:16.311+0000 7f518e189640 1 -- 172.21.15.88:0/3005192076 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f517406c9f0 msgr2=0x7f517406eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:16.316 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:16.311+0000 7f518e189640 1 --2- 172.21.15.88:0/3005192076 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f517406c9f0 0x7f517406eeb0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f5178033000 tx=0x7f5178008030 comp rx=0 tx=0).stop 2024-04-26T23:46:16.316 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:16.311+0000 7f518e189640 1 -- 172.21.15.88:0/3005192076 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f51881f72e0 msgr2=0x7f51881f7790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:16.316 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:16.311+0000 7f518e189640 1 --2- 172.21.15.88:0/3005192076 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f51881f72e0 0x7f51881f7790 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f518000b970 tx=0x7f518000be30 comp rx=0 tx=0).stop 2024-04-26T23:46:16.316 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:16.311+0000 7f518e189640 1 -- 172.21.15.88:0/3005192076 shutdown_connections 2024-04-26T23:46:16.316 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:16.311+0000 7f518e189640 1 --2- 172.21.15.88:0/3005192076 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f517406c9f0 0x7f517406eeb0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:16.316 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:16.311+0000 7f518e189640 1 --2- 172.21.15.88:0/3005192076 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f51880c2560 0x7f51880c77b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:16.316 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:16.311+0000 7f518e189640 1 --2- 172.21.15.88:0/3005192076 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f51881f72e0 0x7f51881f7790 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:16.316 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:16.311+0000 7f518e189640 1 --2- 172.21.15.88:0/3005192076 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f51880ad170 0x7f518814d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:16.316 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:16.311+0000 7f518e189640 1 -- 172.21.15.88:0/3005192076 >> 172.21.15.88:0/3005192076 conn(0x7f51880c89b0 msgr2=0x7f51880c38a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:16.317 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:16.313+0000 7f518e189640 1 -- 172.21.15.88:0/3005192076 shutdown_connections 2024-04-26T23:46:16.318 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:16.314+0000 7f518e189640 1 -- 172.21.15.88:0/3005192076 wait complete. 2024-04-26T23:46:16.337 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2024-04-26T23:46:26.337 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-04-26T23:46:26.338 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-04-26T23:46:26.508 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:26.503+0000 7f7e4c3c9640 1 Processor -- start 2024-04-26T23:46:26.508 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:26.504+0000 7f7e4c3c9640 1 -- start start 2024-04-26T23:46:26.510 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:26.505+0000 7f7e4c3c9640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f7e440c8dc0 0x7f7e4415ee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:26.510 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:26.505+0000 7f7e4a165640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f7e44150200 0x7f7e440ac140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:57786/0 (socket says 172.21.15.88:57786) 2024-04-26T23:46:26.510 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:26.505+0000 7f7e4a165640 1 -- 172.21.15.88:0/1651520182 learned_addr learned my addr 172.21.15.88:0/1651520182 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-26T23:46:26.510 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:26.505+0000 7f7e4c3c9640 1 -- 172.21.15.88:0/1651520182 --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7e4406ff20 con 0x7f7e44150200 2024-04-26T23:46:26.510 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:26.505+0000 7f7e4c3c9640 1 -- 172.21.15.88:0/1651520182 --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7e4406f4e0 con 0x7f7e440c2cd0 2024-04-26T23:46:26.510 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:26.505+0000 7f7e4c3c9640 1 -- 172.21.15.88:0/1651520182 --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f7e440c4bd0 con 0x7f7e440c8dc0 2024-04-26T23:46:26.510 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:26.505+0000 7f7e4a966640 1 --2- 172.21.15.88:0/1651520182 >> v2:172.21.15.175:3300/0 conn(0x7f7e440c8dc0 0x7f7e4415ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:26.510 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:26.505+0000 7f7e49163640 1 -- 172.21.15.88:0/1651520182 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1195180642 0 0) 0x7f7e34001110 con 0x7f7e44150200 2024-04-26T23:46:26.510 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:26.505+0000 7f7e49163640 1 -- 172.21.15.88:0/1651520182 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7e30003520 con 0x7f7e44150200 2024-04-26T23:46:26.511 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:26.506+0000 7f7e4a966640 1 -- 172.21.15.88:0/1651520182 >> v1:172.21.15.175:6789/0 conn(0x7f7e440c2cd0 legacy=0x7f7e441533b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:26.511 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:26.506+0000 7f7e4a966640 1 -- 172.21.15.88:0/1651520182 >> v1:172.21.15.88:6789/0 conn(0x7f7e44150200 legacy=0x7f7e440ac140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:26.511 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:26.506+0000 7f7e4a966640 1 -- 172.21.15.88:0/1651520182 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e440c48f0 con 0x7f7e440c8dc0 2024-04-26T23:46:26.511 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:26.507+0000 7f7e4a966640 1 --2- 172.21.15.88:0/1651520182 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7e440c8dc0 0x7f7e4415ee30 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f7e3c009d90 tx=0x7f7e3c02a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cdb845fc43179259 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:26.511 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:26.507+0000 7f7e49163640 1 -- 172.21.15.88:0/1651520182 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e3c007740 con 0x7f7e440c8dc0 2024-04-26T23:46:26.511 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:26.507+0000 7f7e49163640 1 -- 172.21.15.88:0/1651520182 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e3c0078e0 con 0x7f7e440c8dc0 2024-04-26T23:46:26.511 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:26.507+0000 7f7e49163640 1 -- 172.21.15.88:0/1651520182 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e3c007c90 con 0x7f7e440c8dc0 2024-04-26T23:46:26.512 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:26.508+0000 7f7e4c3c9640 1 -- 172.21.15.88:0/1651520182 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7e440c8dc0 msgr2=0x7f7e4415ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:26.513 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:26.508+0000 7f7e4c3c9640 1 --2- 172.21.15.88:0/1651520182 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7e440c8dc0 0x7f7e4415ee30 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f7e3c009d90 tx=0x7f7e3c02a660 comp rx=0 tx=0).stop 2024-04-26T23:46:26.513 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:26.508+0000 7f7e4c3c9640 1 -- 172.21.15.88:0/1651520182 shutdown_connections 2024-04-26T23:46:26.513 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:26.508+0000 7f7e4c3c9640 1 --2- 172.21.15.88:0/1651520182 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7e440c8dc0 0x7f7e4415ee30 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:26.513 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:26.508+0000 7f7e4c3c9640 1 -- 172.21.15.88:0/1651520182 >> 172.21.15.88:0/1651520182 conn(0x7f7e440c82d0 msgr2=0x7f7e440c86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:26.513 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:26.508+0000 7f7e4c3c9640 1 -- 172.21.15.88:0/1651520182 shutdown_connections 2024-04-26T23:46:26.513 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:26.508+0000 7f7e4c3c9640 1 -- 172.21.15.88:0/1651520182 wait complete. 2024-04-26T23:46:26.514 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:26.510+0000 7f7e4c3c9640 1 Processor -- start 2024-04-26T23:46:26.514 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:26.510+0000 7f7e4c3c9640 1 -- start start 2024-04-26T23:46:26.515 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:26.511+0000 7f7e4c3c9640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7e440c2cd0 0x7f7e44071d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:26.516 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:26.511+0000 7f7e4c3c9640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7e440c8dc0 0x7f7e44073c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:26.518 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:26.512+0000 7f7e4c3c9640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7e44150200 0x7f7e44154060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:26.518 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:26.512+0000 7f7e4a165640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7e440c2cd0 0x7f7e44071d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:26.518 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:26.512+0000 7f7e4a165640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7e440c2cd0 0x7f7e44071d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.88:58570/0 (socket says 172.21.15.88:58570) 2024-04-26T23:46:26.518 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:26.513+0000 7f7e4a966640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7e44150200 0x7f7e44154060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:26.518 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:26.513+0000 7f7e4a966640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7e44150200 0x7f7e44154060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:45880/0 (socket says 172.21.15.88:45880) 2024-04-26T23:46:26.518 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:26.513+0000 7f7e4a165640 1 -- 172.21.15.88:0/1547260404 learned_addr learned my addr 172.21.15.88:0/1547260404 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:46:26.518 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:26.513+0000 7f7e4c3c9640 1 -- 172.21.15.88:0/1547260404 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f7e440ac9d0 con 0x7f7e44150200 2024-04-26T23:46:26.518 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:26.513+0000 7f7e4c3c9640 1 -- 172.21.15.88:0/1547260404 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f7e440ac850 con 0x7f7e440c2cd0 2024-04-26T23:46:26.518 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:26.513+0000 7f7e4c3c9640 1 -- 172.21.15.88:0/1547260404 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f7e441505e0 con 0x7f7e440c8dc0 2024-04-26T23:46:26.518 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:26.513+0000 7f7e4a966640 1 -- 172.21.15.88:0/1547260404 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7e440c8dc0 msgr2=0x7f7e44073c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:26.519 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:26.513+0000 7f7e4a966640 1 --2- 172.21.15.88:0/1547260404 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7e440c8dc0 0x7f7e44073c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:26.519 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:26.513+0000 7f7e4a966640 1 -- 172.21.15.88:0/1547260404 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7e440c2cd0 msgr2=0x7f7e44071d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:26.519 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:26.513+0000 7f7e4a966640 1 --2- 172.21.15.88:0/1547260404 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7e440c2cd0 0x7f7e44071d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:26.519 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:26.513+0000 7f7e4a966640 1 -- 172.21.15.88:0/1547260404 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e440c2970 con 0x7f7e44150200 2024-04-26T23:46:26.519 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:26.514+0000 7f7e4a966640 1 --2- 172.21.15.88:0/1547260404 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7e44150200 0x7f7e44154060 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f7e3c031000 tx=0x7f7e3c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:26.519 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:26.514+0000 7f7e3affd640 1 -- 172.21.15.88:0/1547260404 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e3c03f9c0 con 0x7f7e44150200 2024-04-26T23:46:26.520 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:26.514+0000 7f7e3affd640 1 -- 172.21.15.88:0/1547260404 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e3c043070 con 0x7f7e44150200 2024-04-26T23:46:26.520 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:26.514+0000 7f7e3affd640 1 -- 172.21.15.88:0/1547260404 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e3c03fd60 con 0x7f7e44150200 2024-04-26T23:46:26.520 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:26.514+0000 7f7e4c3c9640 1 -- 172.21.15.88:0/1547260404 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e440731f0 con 0x7f7e44150200 2024-04-26T23:46:26.520 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:26.514+0000 7f7e4c3c9640 1 -- 172.21.15.88:0/1547260404 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e44156b00 con 0x7f7e44150200 2024-04-26T23:46:26.520 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:26.516+0000 7f7e3affd640 1 -- 172.21.15.88:0/1547260404 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f7e3c039040 con 0x7f7e44150200 2024-04-26T23:46:26.521 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:26.516+0000 7f7e4c3c9640 1 -- 172.21.15.88:0/1547260404 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e440507a0 con 0x7f7e44150200 2024-04-26T23:46:26.521 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:26.517+0000 7f7e3affd640 1 --2- 172.21.15.88:0/1547260404 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f7e2806c920 0x7f7e2806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:26.521 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:26.517+0000 7f7e4a165640 1 --2- 172.21.15.88:0/1547260404 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f7e2806c920 0x7f7e2806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:26.522 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:26.518+0000 7f7e3affd640 1 -- 172.21.15.88:0/1547260404 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6666+0+0 (secure 0 0 0) 0x7f7e3c0b1130 con 0x7f7e44150200 2024-04-26T23:46:26.522 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:26.518+0000 7f7e4a165640 1 --2- 172.21.15.88:0/1547260404 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f7e2806c920 0x7f7e2806ede0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f7e340013b0 tx=0x7f7e34000ed0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:26.529 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:26.525+0000 7f7e3affd640 1 -- 172.21.15.88:0/1547260404 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f7e3c07f230 con 0x7f7e44150200 2024-04-26T23:46:27.069 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.064+0000 7f7e4c3c9640 1 -- 172.21.15.88:0/1547260404 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f7e44069970 con 0x7f7e44150200 2024-04-26T23:46:27.069 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.065+0000 7f7e3affd640 1 -- 172.21.15.88:0/1547260404 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1565 (secure 0 0 0) 0x7f7e3c07eb30 con 0x7f7e44150200 2024-04-26T23:46:27.070 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":60,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":15,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"555255e9-7ef9-4454-8dc9-35e96b70035c","modified":"2024-04-26T23:39:34.291658Z","created":"2024-04-26T23:39:34.291658Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:3300","nonce":0},{"type":"v1","addr":"172.21.15.175:6789","nonce":0}]},"addr":"172.21.15.175:6789/0","public_addr":"172.21.15.175:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:3301","nonce":0},{"type":"v1","addr":"172.21.15.175:6790","nonce":0}]},"addr":"172.21.15.175:6790/0","public_addr":"172.21.15.175:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-04-26T23:46:27.073 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.068+0000 7f7e4c3c9640 1 -- 172.21.15.88:0/1547260404 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f7e2806c920 msgr2=0x7f7e2806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:27.073 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.068+0000 7f7e4c3c9640 1 --2- 172.21.15.88:0/1547260404 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f7e2806c920 0x7f7e2806ede0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f7e340013b0 tx=0x7f7e34000ed0 comp rx=0 tx=0).stop 2024-04-26T23:46:27.074 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.068+0000 7f7e4c3c9640 1 -- 172.21.15.88:0/1547260404 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7e44150200 msgr2=0x7f7e44154060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:27.074 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.068+0000 7f7e4c3c9640 1 --2- 172.21.15.88:0/1547260404 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7e44150200 0x7f7e44154060 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f7e3c031000 tx=0x7f7e3c004a40 comp rx=0 tx=0).stop 2024-04-26T23:46:27.074 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.069+0000 7f7e4c3c9640 1 -- 172.21.15.88:0/1547260404 shutdown_connections 2024-04-26T23:46:27.074 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.069+0000 7f7e4c3c9640 1 --2- 172.21.15.88:0/1547260404 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f7e2806c920 0x7f7e2806ede0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:27.074 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.069+0000 7f7e4c3c9640 1 --2- 172.21.15.88:0/1547260404 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7e440c8dc0 0x7f7e44073c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:27.074 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.069+0000 7f7e4c3c9640 1 --2- 172.21.15.88:0/1547260404 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7e44150200 0x7f7e44154060 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:27.074 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.069+0000 7f7e4c3c9640 1 --2- 172.21.15.88:0/1547260404 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7e440c2cd0 0x7f7e44071d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:27.074 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.069+0000 7f7e4c3c9640 1 -- 172.21.15.88:0/1547260404 >> 172.21.15.88:0/1547260404 conn(0x7f7e440c82d0 msgr2=0x7f7e440c4d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:27.074 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.069+0000 7f7e4c3c9640 1 -- 172.21.15.88:0/1547260404 shutdown_connections 2024-04-26T23:46:27.074 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.069+0000 7f7e4c3c9640 1 -- 172.21.15.88:0/1547260404 wait complete. 2024-04-26T23:46:27.090 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-04-26T23:46:27.090 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2024-04-26T23:46:27.090 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-04-26T23:46:27.091 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-04-26T23:46:27.263 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.259+0000 7f19f9c24640 1 Processor -- start 2024-04-26T23:46:27.264 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.260+0000 7f19f9c24640 1 -- start start 2024-04-26T23:46:27.265 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.261+0000 7f19f9c24640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f19ec00b2f0 0x7f19ec0d5510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:27.266 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.261+0000 7f19f9c24640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f19ec02eeb0 0x7f19ec04a650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:27.266 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.261+0000 7f19f9c24640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f19ec0d8fe0 con 0x7f19ec03f6d0 2024-04-26T23:46:27.266 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.261+0000 7f19f9c24640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f19ec0484e0 con 0x7f19ec02eeb0 2024-04-26T23:46:27.266 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.261+0000 7f19f9c24640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f19ec0d8b50 con 0x7f19ec00b2f0 2024-04-26T23:46:27.266 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.261+0000 7f19f8c22640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f19ec00b2f0 0x7f19ec0d5510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:27.266 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.261+0000 7f19f8c22640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f19ec00b2f0 0x7f19ec0d5510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.88:48456/0 (socket says 172.21.15.88:48456) 2024-04-26T23:46:27.266 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.261+0000 7f19f8c22640 1 -- 172.21.15.88:0/2960369098 learned_addr learned my addr 172.21.15.88:0/2960369098 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:46:27.266 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.261+0000 7f19f9423640 1 --2- 172.21.15.88:0/2960369098 >> v2:172.21.15.175:3300/0 conn(0x7f19ec02eeb0 0x7f19ec04a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:27.267 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.262+0000 7f19f8c22640 1 -- 172.21.15.88:0/2960369098 >> v2:172.21.15.175:3300/0 conn(0x7f19ec02eeb0 msgr2=0x7f19ec04a650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:46:27.268 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.262+0000 7f19f8c22640 1 --2- 172.21.15.88:0/2960369098 >> v2:172.21.15.175:3300/0 conn(0x7f19ec02eeb0 0x7f19ec04a650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:27.268 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.262+0000 7f19f8c22640 1 -- 172.21.15.88:0/2960369098 >> v1:172.21.15.175:6789/0 conn(0x7f19ec03f6d0 legacy=0x7f19ec049f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:46:27.268 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.262+0000 7f19f8c22640 1 -- 172.21.15.88:0/2960369098 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19ec0d8220 con 0x7f19ec00b2f0 2024-04-26T23:46:27.269 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.265+0000 7f19f8c22640 1 --2- 172.21.15.88:0/2960369098 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f19ec00b2f0 0x7f19ec0d5510 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f19e8009870 tx=0x7f19e802a0b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=58884c2f56670b2 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:27.270 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.266+0000 7f19f37fe640 1 -- 172.21.15.88:0/2960369098 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19e8037070 con 0x7f19ec00b2f0 2024-04-26T23:46:27.270 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.266+0000 7f19f37fe640 1 -- 172.21.15.88:0/2960369098 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19e802adc0 con 0x7f19ec00b2f0 2024-04-26T23:46:27.270 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.266+0000 7f19f37fe640 1 -- 172.21.15.88:0/2960369098 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19e8032660 con 0x7f19ec00b2f0 2024-04-26T23:46:27.271 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.267+0000 7f19f9c24640 1 -- 172.21.15.88:0/2960369098 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f19ec00b2f0 msgr2=0x7f19ec0d5510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:27.271 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.267+0000 7f19f9c24640 1 --2- 172.21.15.88:0/2960369098 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f19ec00b2f0 0x7f19ec0d5510 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f19e8009870 tx=0x7f19e802a0b0 comp rx=0 tx=0).stop 2024-04-26T23:46:27.272 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.268+0000 7f19f9c24640 1 -- 172.21.15.88:0/2960369098 shutdown_connections 2024-04-26T23:46:27.272 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.268+0000 7f19f9c24640 1 --2- 172.21.15.88:0/2960369098 >> v2:172.21.15.175:3300/0 conn(0x7f19ec02eeb0 0x7f19ec04a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:27.272 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.268+0000 7f19f9c24640 1 --2- 172.21.15.88:0/2960369098 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f19ec00b2f0 0x7f19ec0d5510 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:27.272 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.268+0000 7f19f9c24640 1 -- 172.21.15.88:0/2960369098 >> 172.21.15.88:0/2960369098 conn(0x7f19ec048ac0 msgr2=0x7f19ec048ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:27.274 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.270+0000 7f19f9c24640 1 -- 172.21.15.88:0/2960369098 shutdown_connections 2024-04-26T23:46:27.275 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.271+0000 7f19f9c24640 1 -- 172.21.15.88:0/2960369098 wait complete. 2024-04-26T23:46:27.277 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.273+0000 7f19f9c24640 1 Processor -- start 2024-04-26T23:46:27.277 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.273+0000 7f19f9c24640 1 -- start start 2024-04-26T23:46:27.281 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.274+0000 7f19f9c24640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f19ec00b2f0 0x7f19ec005c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:27.283 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.275+0000 7f19f9c24640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f19ec02eeb0 0x7f19ec0d2f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:27.284 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.275+0000 7f19f9c24640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f19ec03f6d0 0x7f19ec0d3450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:27.284 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.275+0000 7f19f8c22640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f19ec00b2f0 0x7f19ec005c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:27.284 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.275+0000 7f19f8c22640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f19ec00b2f0 0x7f19ec005c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:45886/0 (socket says 172.21.15.88:45886) 2024-04-26T23:46:27.284 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.275+0000 7f19f9423640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f19ec03f6d0 0x7f19ec0d3450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:27.284 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.275+0000 7f19f9423640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f19ec03f6d0 0x7f19ec0d3450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.88:58588/0 (socket says 172.21.15.88:58588) 2024-04-26T23:46:27.284 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.275+0000 7f19f3fff640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f19ec02eeb0 0x7f19ec0d2f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:27.284 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.275+0000 7f19f3fff640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f19ec02eeb0 0x7f19ec0d2f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.88:48464/0 (socket says 172.21.15.88:48464) 2024-04-26T23:46:27.284 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.276+0000 7f19f9c24640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f19ec0d87e0 con 0x7f19ec00b2f0 2024-04-26T23:46:27.284 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.276+0000 7f19f9c24640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f19ec04b350 con 0x7f19ec03f6d0 2024-04-26T23:46:27.284 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.276+0000 7f19f9c24640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f19ec0481b0 con 0x7f19ec02eeb0 2024-04-26T23:46:27.284 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.277+0000 7f19f8c22640 1 -- 172.21.15.88:0/3959302576 learned_addr learned my addr 172.21.15.88:0/3959302576 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:46:27.284 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.277+0000 7f19f8c22640 1 -- 172.21.15.88:0/3959302576 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f19ec02eeb0 msgr2=0x7f19ec0d2f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:27.284 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.277+0000 7f19f8c22640 1 --2- 172.21.15.88:0/3959302576 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f19ec02eeb0 0x7f19ec0d2f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:27.284 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.277+0000 7f19f8c22640 1 -- 172.21.15.88:0/3959302576 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f19ec03f6d0 msgr2=0x7f19ec0d3450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:27.285 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.277+0000 7f19f8c22640 1 --2- 172.21.15.88:0/3959302576 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f19ec03f6d0 0x7f19ec0d3450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:27.285 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.277+0000 7f19f8c22640 1 -- 172.21.15.88:0/3959302576 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19ec0ce900 con 0x7f19ec00b2f0 2024-04-26T23:46:27.285 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.278+0000 7f19f8c22640 1 --2- 172.21.15.88:0/3959302576 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f19ec00b2f0 0x7f19ec005c60 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f19e80098d0 tx=0x7f19e80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:27.285 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.278+0000 7f19f17fa640 1 -- 172.21.15.88:0/3959302576 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19e8041020 con 0x7f19ec00b2f0 2024-04-26T23:46:27.285 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.279+0000 7f19f17fa640 1 -- 172.21.15.88:0/3959302576 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19e803d6e0 con 0x7f19ec00b2f0 2024-04-26T23:46:27.286 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.279+0000 7f19f9c24640 1 -- 172.21.15.88:0/3959302576 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19ec0d42d0 con 0x7f19ec00b2f0 2024-04-26T23:46:27.286 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.279+0000 7f19f9c24640 1 -- 172.21.15.88:0/3959302576 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19ec0d2710 con 0x7f19ec00b2f0 2024-04-26T23:46:27.286 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.280+0000 7f19f17fa640 1 -- 172.21.15.88:0/3959302576 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19e8037040 con 0x7f19ec00b2f0 2024-04-26T23:46:27.286 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.280+0000 7f19f9c24640 1 --2- 172.21.15.88:0/3959302576 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f19d4002a70 0x7f19d4004f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:27.286 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.280+0000 7f19f9c24640 1 -- 172.21.15.88:0/3959302576 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f19d4007ec0 con 0x7f19d4002a70 2024-04-26T23:46:27.286 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.280+0000 7f19f3fff640 1 --2- 172.21.15.88:0/3959302576 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f19d4002a70 0x7f19d4004f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:27.286 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.281+0000 7f19f3fff640 1 -- 172.21.15.88:0/3959302576 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f19d40080c0 con 0x7f19d4002a70 2024-04-26T23:46:27.286 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.282+0000 7f19f3fff640 1 --2- 172.21.15.88:0/3959302576 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f19d4002a70 0x7f19d4004f30 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f19ec030d80 tx=0x7f19e000fc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:27.288 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.284+0000 7f19f17fa640 1 -- 172.21.15.88:0/3959302576 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19e0018030 con 0x7f19d4002a70 2024-04-26T23:46:27.288 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.284+0000 7f19f17fa640 1 -- 172.21.15.88:0/3959302576 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f19e8044020 con 0x7f19ec00b2f0 2024-04-26T23:46:27.289 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.285+0000 7f19f17fa640 1 --2- 172.21.15.88:0/3959302576 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f19d806c870 0x7f19d806ed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:27.290 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.286+0000 7f19f9423640 1 --2- 172.21.15.88:0/3959302576 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f19d806c870 0x7f19d806ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:27.291 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.287+0000 7f19f9423640 1 --2- 172.21.15.88:0/3959302576 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f19d806c870 0x7f19d806ed30 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f19f4051fc0 tx=0x7f19f408f040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:27.292 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.287+0000 7f19f17fa640 1 -- 172.21.15.88:0/3959302576 <== mon.0 v2:172.21.15.88:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f19e0003940 con 0x7f19d4002a70 2024-04-26T23:46:27.292 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.288+0000 7f19f17fa640 1 -- 172.21.15.88:0/3959302576 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f19d4002a70 msgr2=0x7f19d4004f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:27.292 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.288+0000 7f19f17fa640 1 --2- 172.21.15.88:0/3959302576 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f19d4002a70 0x7f19d4004f30 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f19ec030d80 tx=0x7f19e000fc90 comp rx=0 tx=0).stop 2024-04-26T23:46:27.293 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.288+0000 7f19f17fa640 1 -- 172.21.15.88:0/3959302576 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f19d4002a70 msgr2=0x7f19d4004f30 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:46:27.293 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.288+0000 7f19f17fa640 1 --2- 172.21.15.88:0/3959302576 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f19d4002a70 0x7f19d4004f30 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:27.293 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.288+0000 7f19f17fa640 1 -- 172.21.15.88:0/3959302576 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6666+0+0 (secure 0 0 0) 0x7f19e80ac380 con 0x7f19ec00b2f0 2024-04-26T23:46:27.317 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.312+0000 7f19f9c24640 1 --2- 172.21.15.88:0/3959302576 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f19d40016c0 0x7f19d4001b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:27.317 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.313+0000 7f19f3fff640 1 --2- 172.21.15.88:0/3959302576 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f19d40016c0 0x7f19d4001b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:27.317 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.313+0000 7f19f9c24640 1 -- 172.21.15.88:0/3959302576 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f19d400a3e0 con 0x7f19d40016c0 2024-04-26T23:46:27.318 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.314+0000 7f19f3fff640 1 -- 172.21.15.88:0/3959302576 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f19d4002090 con 0x7f19d40016c0 2024-04-26T23:46:27.318 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.314+0000 7f19f3fff640 1 --2- 172.21.15.88:0/3959302576 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f19d40016c0 0x7f19d4001b50 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f19ec030d80 tx=0x7f19e0003760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:27.319 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.315+0000 7f19f17fa640 1 -- 172.21.15.88:0/3959302576 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19e000d9f0 con 0x7f19d40016c0 2024-04-26T23:46:27.320 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.315+0000 7f19f17fa640 1 -- 172.21.15.88:0/3959302576 <== mon.0 v2:172.21.15.88:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5067 (secure 0 0 0) 0x7f19e000dbb0 con 0x7f19d40016c0 2024-04-26T23:46:27.320 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.315+0000 7f19f17fa640 1 -- 172.21.15.88:0/3959302576 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f19d40016c0 msgr2=0x7f19d4001b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:27.320 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.315+0000 7f19f17fa640 1 --2- 172.21.15.88:0/3959302576 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f19d40016c0 0x7f19d4001b50 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f19ec030d80 tx=0x7f19e0003760 comp rx=0 tx=0).stop 2024-04-26T23:46:27.320 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.315+0000 7f19f17fa640 1 -- 172.21.15.88:0/3959302576 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f19d40016c0 msgr2=0x7f19d4001b50 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:46:27.320 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.315+0000 7f19f17fa640 1 --2- 172.21.15.88:0/3959302576 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f19d40016c0 0x7f19d4001b50 secure :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f19ec030d80 tx=0x7f19e0003760 comp rx=0 tx=0).stop 2024-04-26T23:46:27.320 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-04-26T23:46:27.320 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2024-04-26T23:46:27.320 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2024-04-26T23:46:27.320 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "leader", 2024-04-26T23:46:27.320 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 60, 2024-04-26T23:46:27.321 INFO:teuthology.orchestra.run.smithi088.stdout: "uptime": 96368, 2024-04-26T23:46:27.321 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2024-04-26T23:46:27.321 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2024-04-26T23:46:27.321 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2024-04-26T23:46:27.321 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2024-04-26T23:46:27.321 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:46:27.321 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 15, 2024-04-26T23:46:27.321 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2024-04-26T23:46:27.321 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2450521708007866372", 2024-04-26T23:46:27.321 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2024-04-26T23:46:27.321 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-04-26T23:46:27.321 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-04-26T23:46:27.321 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-04-26T23:46:27.321 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-04-26T23:46:27.321 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-04-26T23:46:27.322 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-04-26T23:46:27.322 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-04-26T23:46:27.322 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-04-26T23:46:27.322 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-04-26T23:46:27.322 INFO:teuthology.orchestra.run.smithi088.stdout: "reef", 2024-04-26T23:46:27.322 INFO:teuthology.orchestra.run.smithi088.stdout: "squid" 2024-04-26T23:46:27.322 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:46:27.322 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540701547738038271", 2024-04-26T23:46:27.322 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2024-04-26T23:46:27.322 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-04-26T23:46:27.322 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-04-26T23:46:27.322 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-04-26T23:46:27.322 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-04-26T23:46:27.322 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-04-26T23:46:27.323 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-04-26T23:46:27.323 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-04-26T23:46:27.323 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-04-26T23:46:27.323 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-04-26T23:46:27.323 INFO:teuthology.orchestra.run.smithi088.stdout: "reef", 2024-04-26T23:46:27.323 INFO:teuthology.orchestra.run.smithi088.stdout: "squid" 2024-04-26T23:46:27.323 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:46:27.323 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:46:27.323 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2024-04-26T23:46:27.324 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2024-04-26T23:46:27.324 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2024-04-26T23:46:27.324 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2024-04-26T23:46:27.324 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2024-04-26T23:46:27.324 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "555255e9-7ef9-4454-8dc9-35e96b70035c", 2024-04-26T23:46:27.324 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2024-04-26T23:39:34.291658Z", 2024-04-26T23:46:27.324 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2024-04-26T23:39:34.291658Z", 2024-04-26T23:46:27.324 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 19, 2024-04-26T23:46:27.324 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "squid", 2024-04-26T23:46:27.324 INFO:teuthology.orchestra.run.smithi088.stdout: "election_strategy": 1, 2024-04-26T23:46:27.324 INFO:teuthology.orchestra.run.smithi088.stdout: "disallowed_leaders: ": "", 2024-04-26T23:46:27.324 INFO:teuthology.orchestra.run.smithi088.stdout: "stretch_mode": false, 2024-04-26T23:46:27.324 INFO:teuthology.orchestra.run.smithi088.stdout: "tiebreaker_mon": "", 2024-04-26T23:46:27.325 INFO:teuthology.orchestra.run.smithi088.stdout: "removed_ranks: ": "", 2024-04-26T23:46:27.325 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2024-04-26T23:46:27.325 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2024-04-26T23:46:27.325 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-04-26T23:46:27.325 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-04-26T23:46:27.325 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-04-26T23:46:27.325 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-04-26T23:46:27.325 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-04-26T23:46:27.325 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-04-26T23:46:27.325 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-04-26T23:46:27.325 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-04-26T23:46:27.325 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-04-26T23:46:27.325 INFO:teuthology.orchestra.run.smithi088.stdout: "reef", 2024-04-26T23:46:27.326 INFO:teuthology.orchestra.run.smithi088.stdout: "squid" 2024-04-26T23:46:27.326 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:46:27.326 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2024-04-26T23:46:27.326 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:46:27.326 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2024-04-26T23:46:27.326 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:46:27.326 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2024-04-26T23:46:27.326 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2024-04-26T23:46:27.326 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-04-26T23:46:27.326 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-04-26T23:46:27.326 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:46:27.326 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-04-26T23:46:27.327 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2024-04-26T23:46:27.327 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:46:27.327 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:46:27.327 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:46:27.327 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-04-26T23:46:27.327 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2024-04-26T23:46:27.327 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:46:27.327 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:46:27.327 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:46:27.327 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:46:27.327 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2024-04-26T23:46:27.327 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2024-04-26T23:46:27.327 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-04-26T23:46:27.327 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-04-26T23:46:27.327 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-04-26T23:46:27.328 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:46:27.328 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:46:27.328 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2024-04-26T23:46:27.328 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2024-04-26T23:46:27.328 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-04-26T23:46:27.328 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-04-26T23:46:27.328 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:46:27.328 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-04-26T23:46:27.328 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:3300", 2024-04-26T23:46:27.328 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:46:27.328 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:46:27.328 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:46:27.328 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-04-26T23:46:27.328 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6789", 2024-04-26T23:46:27.329 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:46:27.329 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:46:27.329 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:46:27.329 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:46:27.329 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6789/0", 2024-04-26T23:46:27.329 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.175:6789/0", 2024-04-26T23:46:27.329 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-04-26T23:46:27.329 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-04-26T23:46:27.329 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-04-26T23:46:27.329 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:46:27.329 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:46:27.329 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2024-04-26T23:46:27.329 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2024-04-26T23:46:27.329 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-04-26T23:46:27.329 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-04-26T23:46:27.330 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:46:27.330 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-04-26T23:46:27.330 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:3301", 2024-04-26T23:46:27.330 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:46:27.330 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:46:27.330 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:46:27.330 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-04-26T23:46:27.330 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6790", 2024-04-26T23:46:27.330 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:46:27.330 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:46:27.330 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:46:27.330 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:46:27.330 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6790/0", 2024-04-26T23:46:27.330 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.175:6790/0", 2024-04-26T23:46:27.331 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-04-26T23:46:27.331 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-04-26T23:46:27.331 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-04-26T23:46:27.331 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:46:27.331 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:46:27.331 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:46:27.331 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2024-04-26T23:46:27.331 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2024-04-26T23:46:27.331 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:46:27.331 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:46:27.331 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:46:27.331 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2024-04-26T23:46:27.331 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:46:27.332 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:46:27.332 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": [ 2024-04-26T23:46:27.332 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:46:27.332 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:46:27.332 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:46:27.332 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 3 2024-04-26T23:46:27.332 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:46:27.332 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:46:27.332 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": [ 2024-04-26T23:46:27.332 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:46:27.332 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:46:27.332 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:46:27.333 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2024-04-26T23:46:27.333 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:46:27.333 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:46:27.333 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2024-04-26T23:46:27.333 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:46:27.333 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:46:27.333 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:46:27.333 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 3 2024-04-26T23:46:27.333 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:46:27.333 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:46:27.333 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": [ 2024-04-26T23:46:27.333 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:46:27.333 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:46:27.334 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:46:27.334 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2024-04-26T23:46:27.334 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:46:27.334 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:46:27.334 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:46:27.334 INFO:teuthology.orchestra.run.smithi088.stdout: "stretch_mode": false 2024-04-26T23:46:27.334 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-04-26T23:46:27.336 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.316+0000 7f19f9c24640 1 -- 172.21.15.88:0/3959302576 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f19d806c870 msgr2=0x7f19d806ed30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:27.336 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.316+0000 7f19f9c24640 1 --2- 172.21.15.88:0/3959302576 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f19d806c870 0x7f19d806ed30 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f19f4051fc0 tx=0x7f19f408f040 comp rx=0 tx=0).stop 2024-04-26T23:46:27.336 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.316+0000 7f19f9423640 1 -- 172.21.15.88:0/3959302576 reap_dead start 2024-04-26T23:46:27.336 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.316+0000 7f19f9c24640 1 -- 172.21.15.88:0/3959302576 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f19ec00b2f0 msgr2=0x7f19ec005c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:27.336 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.316+0000 7f19f9c24640 1 --2- 172.21.15.88:0/3959302576 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f19ec00b2f0 0x7f19ec005c60 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f19e80098d0 tx=0x7f19e80046c0 comp rx=0 tx=0).stop 2024-04-26T23:46:27.336 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.316+0000 7f19f9c24640 1 -- 172.21.15.88:0/3959302576 shutdown_connections 2024-04-26T23:46:27.336 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.316+0000 7f19f9c24640 1 --2- 172.21.15.88:0/3959302576 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f19ec00b2f0 0x7f19ec005c60 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:27.336 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.316+0000 7f19f9c24640 1 -- 172.21.15.88:0/3959302576 >> 172.21.15.88:0/3959302576 conn(0x7f19ec048ac0 msgr2=0x7f19ec048ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:27.336 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.316+0000 7f19f9c24640 1 -- 172.21.15.88:0/3959302576 shutdown_connections 2024-04-26T23:46:27.336 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.316+0000 7f19f9c24640 1 -- 172.21.15.88:0/3959302576 wait complete. 2024-04-26T23:46:27.346 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-04-26T23:46:27.346 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-04-26T23:46:27.346 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-04-26T23:46:27.533 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.529+0000 7f27f6edd640 1 Processor -- start 2024-04-26T23:46:27.538 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.533+0000 7f27f6edd640 1 -- start start 2024-04-26T23:46:27.538 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.534+0000 7f27f6edd640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f27e8047260 0x7f27e8047640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:27.539 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.534+0000 7f27f6edd640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f27e804a7e0 0x7f27e804bb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:27.539 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.534+0000 7f27f6edd640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f27e804c0d0 0x7f27e80da6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:27.539 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.534+0000 7f27f6edd640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f27e80cdfa0 con 0x7f27e804c0d0 2024-04-26T23:46:27.539 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.534+0000 7f27f6edd640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f27e80d8010 con 0x7f27e804a7e0 2024-04-26T23:46:27.539 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.534+0000 7f27f6edd640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f27e804ad90 con 0x7f27e8047260 2024-04-26T23:46:27.540 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.535+0000 7f27f66dc640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f27e804c0d0 0x7f27e80da6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:27.540 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.535+0000 7f27f66dc640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f27e804c0d0 0x7f27e80da6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:45916/0 (socket says 172.21.15.88:45916) 2024-04-26T23:46:27.540 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.535+0000 7f27f66dc640 1 -- 172.21.15.88:0/1714233808 learned_addr learned my addr 172.21.15.88:0/1714233808 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:46:27.540 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.536+0000 7f27f66dc640 1 -- 172.21.15.88:0/1714233808 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f27e8047260 msgr2=0x7f27e8047640 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-26T23:46:27.540 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.536+0000 7f27f66dc640 1 --2- 172.21.15.88:0/1714233808 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f27e8047260 0x7f27e8047640 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:27.540 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.536+0000 7f27f66dc640 1 -- 172.21.15.88:0/1714233808 >> v2:172.21.15.175:3300/0 conn(0x7f27e804a7e0 msgr2=0x7f27e804bb90 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-26T23:46:27.540 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.536+0000 7f27f66dc640 1 --2- 172.21.15.88:0/1714233808 >> v2:172.21.15.175:3300/0 conn(0x7f27e804a7e0 0x7f27e804bb90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:27.541 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.536+0000 7f27f66dc640 1 -- 172.21.15.88:0/1714233808 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27e80d7d30 con 0x7f27e804c0d0 2024-04-26T23:46:27.542 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.537+0000 7f27f66dc640 1 --2- 172.21.15.88:0/1714233808 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f27e804c0d0 0x7f27e80da6b0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f27e800b2e0 tx=0x7f27ec032a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afb1a6acb1a734c5 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:27.542 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.538+0000 7f27f4ed9640 1 -- 172.21.15.88:0/1714233808 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27ec036850 con 0x7f27e804c0d0 2024-04-26T23:46:27.542 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.538+0000 7f27f4ed9640 1 -- 172.21.15.88:0/1714233808 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27ec0369f0 con 0x7f27e804c0d0 2024-04-26T23:46:27.542 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.538+0000 7f27f4ed9640 1 -- 172.21.15.88:0/1714233808 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27ec036dc0 con 0x7f27e804c0d0 2024-04-26T23:46:27.543 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.539+0000 7f27f6edd640 1 -- 172.21.15.88:0/1714233808 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f27e804c0d0 msgr2=0x7f27e80da6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:27.543 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.539+0000 7f27f6edd640 1 --2- 172.21.15.88:0/1714233808 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f27e804c0d0 0x7f27e80da6b0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f27e800b2e0 tx=0x7f27ec032a90 comp rx=0 tx=0).stop 2024-04-26T23:46:27.543 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.539+0000 7f27f6edd640 1 -- 172.21.15.88:0/1714233808 shutdown_connections 2024-04-26T23:46:27.543 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.539+0000 7f27f6edd640 1 --2- 172.21.15.88:0/1714233808 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f27e804c0d0 0x7f27e80da6b0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:27.543 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.539+0000 7f27f6edd640 1 --2- 172.21.15.88:0/1714233808 >> v2:172.21.15.175:3300/0 conn(0x7f27e804a7e0 0x7f27e804bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:27.543 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.539+0000 7f27f6edd640 1 --2- 172.21.15.88:0/1714233808 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f27e8047260 0x7f27e8047640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:27.544 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.539+0000 7f27f6edd640 1 -- 172.21.15.88:0/1714233808 >> 172.21.15.88:0/1714233808 conn(0x7f27e8049360 msgr2=0x7f27e8049740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:27.545 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.540+0000 7f27f6edd640 1 -- 172.21.15.88:0/1714233808 shutdown_connections 2024-04-26T23:46:27.549 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.543+0000 7f27f6edd640 1 -- 172.21.15.88:0/1714233808 wait complete. 2024-04-26T23:46:27.551 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.545+0000 7f27f6edd640 1 Processor -- start 2024-04-26T23:46:27.551 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.545+0000 7f27f6edd640 1 -- start start 2024-04-26T23:46:27.551 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.546+0000 7f27f6edd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f27e8047260 0x7f27e816f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:27.551 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.546+0000 7f27f6edd640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f27e804a7e0 0x7f27e80cbd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:27.551 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.546+0000 7f27f6edd640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f27e804c0d0 0x7f27e80cc2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:27.551 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.546+0000 7f27f6edd640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f27e804a140 con 0x7f27e8047260 2024-04-26T23:46:27.551 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.546+0000 7f27f6edd640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f27e804c580 con 0x7f27e804c0d0 2024-04-26T23:46:27.552 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.546+0000 7f27f6edd640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f27e804a2c0 con 0x7f27e804a7e0 2024-04-26T23:46:27.552 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.547+0000 7f27f56da640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f27e804a7e0 0x7f27e80cbd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:27.552 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.547+0000 7f27f5edb640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f27e8047260 0x7f27e816f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:27.552 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.547+0000 7f27f56da640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f27e804a7e0 0x7f27e80cbd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.88:48478/0 (socket says 172.21.15.88:48478) 2024-04-26T23:46:27.552 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.547+0000 7f27f56da640 1 -- 172.21.15.88:0/1121462082 learned_addr learned my addr 172.21.15.88:0/1121462082 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:46:27.552 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.547+0000 7f27f66dc640 1 --2- 172.21.15.88:0/1121462082 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f27e804c0d0 0x7f27e80cc2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:27.553 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.547+0000 7f27f5edb640 1 -- 172.21.15.88:0/1121462082 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f27e804a7e0 msgr2=0x7f27e80cbd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:27.553 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.547+0000 7f27f5edb640 1 --2- 172.21.15.88:0/1121462082 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f27e804a7e0 0x7f27e80cbd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:27.553 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.547+0000 7f27f5edb640 1 -- 172.21.15.88:0/1121462082 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f27e804c0d0 msgr2=0x7f27e80cc2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:27.553 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.547+0000 7f27f5edb640 1 --2- 172.21.15.88:0/1121462082 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f27e804c0d0 0x7f27e80cc2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:27.553 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.547+0000 7f27f5edb640 1 -- 172.21.15.88:0/1121462082 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27e80cc7e0 con 0x7f27e8047260 2024-04-26T23:46:27.553 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.548+0000 7f27f5edb640 1 --2- 172.21.15.88:0/1121462082 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f27e8047260 0x7f27e816f1a0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f27e000b3e0 tx=0x7f27e000b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:27.553 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.549+0000 7f27e67fc640 1 -- 172.21.15.88:0/1121462082 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27e0015020 con 0x7f27e8047260 2024-04-26T23:46:27.553 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.549+0000 7f27e67fc640 1 -- 172.21.15.88:0/1121462082 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27e0011830 con 0x7f27e8047260 2024-04-26T23:46:27.554 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.549+0000 7f27e67fc640 1 -- 172.21.15.88:0/1121462082 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27e0011c20 con 0x7f27e8047260 2024-04-26T23:46:27.554 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.549+0000 7f27f6edd640 1 -- 172.21.15.88:0/1121462082 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27e80ccc80 con 0x7f27e8047260 2024-04-26T23:46:27.554 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.549+0000 7f27f6edd640 1 -- 172.21.15.88:0/1121462082 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27e80dabf0 con 0x7f27e8047260 2024-04-26T23:46:27.555 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.550+0000 7f27f6edd640 1 --2- 172.21.15.88:0/1121462082 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f27e816f6e0 0x7f27e8003190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:27.555 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.551+0000 7f27f6edd640 1 -- 172.21.15.88:0/1121462082 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f27e80cca30 con 0x7f27e816f6e0 2024-04-26T23:46:27.555 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.551+0000 7f27f56da640 1 --2- 172.21.15.88:0/1121462082 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f27e816f6e0 0x7f27e8003190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:27.556 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.551+0000 7f27e67fc640 1 -- 172.21.15.88:0/1121462082 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f27e0018020 con 0x7f27e8047260 2024-04-26T23:46:27.556 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.552+0000 7f27f56da640 1 -- 172.21.15.88:0/1121462082 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f27e8005390 con 0x7f27e816f6e0 2024-04-26T23:46:27.556 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.552+0000 7f27e67fc640 1 --2- 172.21.15.88:0/1121462082 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f27d406c9c0 0x7f27d406ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:27.557 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.553+0000 7f27f66dc640 1 --2- 172.21.15.88:0/1121462082 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f27d406c9c0 0x7f27d406ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:27.557 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.553+0000 7f27e67fc640 1 -- 172.21.15.88:0/1121462082 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6666+0+0 (secure 0 0 0) 0x7f27e008bb90 con 0x7f27e8047260 2024-04-26T23:46:27.557 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.553+0000 7f27f56da640 1 --2- 172.21.15.88:0/1121462082 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f27e816f6e0 0x7f27e8003190 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f27f007cf00 tx=0x7f27f006a350 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:27.557 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.553+0000 7f27f66dc640 1 --2- 172.21.15.88:0/1121462082 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f27d406c9c0 0x7f27d406ee80 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f27ec03d000 tx=0x7f27ec038000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:27.558 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.553+0000 7f27e67fc640 1 -- 172.21.15.88:0/1121462082 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27f0097440 con 0x7f27e816f6e0 2024-04-26T23:46:27.558 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.554+0000 7f27e67fc640 1 -- 172.21.15.88:0/1121462082 <== mon.1 v2:172.21.15.175:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f27f0097440 con 0x7f27e816f6e0 2024-04-26T23:46:27.558 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.554+0000 7f27e67fc640 1 -- 172.21.15.88:0/1121462082 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f27e816f6e0 msgr2=0x7f27e8003190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:27.558 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.554+0000 7f27e67fc640 1 --2- 172.21.15.88:0/1121462082 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f27e816f6e0 0x7f27e8003190 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f27f007cf00 tx=0x7f27f006a350 comp rx=0 tx=0).stop 2024-04-26T23:46:27.559 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.554+0000 7f27e67fc640 1 -- 172.21.15.88:0/1121462082 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f27e816f6e0 msgr2=0x7f27e8003190 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:46:27.559 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.554+0000 7f27e67fc640 1 --2- 172.21.15.88:0/1121462082 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f27e816f6e0 0x7f27e8003190 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:27.568 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.564+0000 7f27f6edd640 1 --2- 172.21.15.88:0/1121462082 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f27e80ccf60 0x7f27e8040570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:27.569 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.564+0000 7f27f6edd640 1 -- 172.21.15.88:0/1121462082 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f27e8049f20 con 0x7f27e80ccf60 2024-04-26T23:46:27.569 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.564+0000 7f27f56da640 1 --2- 172.21.15.88:0/1121462082 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f27e80ccf60 0x7f27e8040570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:27.569 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.565+0000 7f27f56da640 1 -- 172.21.15.88:0/1121462082 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f27e80d6cc0 con 0x7f27e80ccf60 2024-04-26T23:46:27.569 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.565+0000 7f27f56da640 1 --2- 172.21.15.88:0/1121462082 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f27e80ccf60 0x7f27e8040570 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f27f007ce50 tx=0x7f27f00661d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:27.570 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.565+0000 7f27e67fc640 1 -- 172.21.15.88:0/1121462082 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27f0097940 con 0x7f27e80ccf60 2024-04-26T23:46:27.570 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.566+0000 7f27e67fc640 1 -- 172.21.15.88:0/1121462082 <== mon.1 v2:172.21.15.175:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4555 (secure 0 0 0) 0x7f27f0097940 con 0x7f27e80ccf60 2024-04-26T23:46:27.570 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.566+0000 7f27e67fc640 1 -- 172.21.15.88:0/1121462082 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f27e80ccf60 msgr2=0x7f27e8040570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:27.570 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.566+0000 7f27e67fc640 1 --2- 172.21.15.88:0/1121462082 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f27e80ccf60 0x7f27e8040570 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f27f007ce50 tx=0x7f27f00661d0 comp rx=0 tx=0).stop 2024-04-26T23:46:27.570 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.566+0000 7f27e67fc640 1 -- 172.21.15.88:0/1121462082 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f27e80ccf60 msgr2=0x7f27e8040570 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:46:27.570 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.566+0000 7f27e67fc640 1 --2- 172.21.15.88:0/1121462082 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f27e80ccf60 0x7f27e8040570 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:27.571 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-04-26T23:46:27.571 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2024-04-26T23:46:27.571 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2024-04-26T23:46:27.571 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "peon", 2024-04-26T23:46:27.571 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 60, 2024-04-26T23:46:27.571 INFO:teuthology.orchestra.run.smithi088.stdout: "uptime": 20679, 2024-04-26T23:46:27.571 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2024-04-26T23:46:27.571 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2024-04-26T23:46:27.571 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2024-04-26T23:46:27.571 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2024-04-26T23:46:27.572 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:46:27.572 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 15, 2024-04-26T23:46:27.572 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2024-04-26T23:46:27.572 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2450521708007866372", 2024-04-26T23:46:27.572 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2024-04-26T23:46:27.572 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-04-26T23:46:27.572 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-04-26T23:46:27.572 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-04-26T23:46:27.572 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-04-26T23:46:27.572 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-04-26T23:46:27.572 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-04-26T23:46:27.572 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-04-26T23:46:27.572 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-04-26T23:46:27.572 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-04-26T23:46:27.572 INFO:teuthology.orchestra.run.smithi088.stdout: "reef", 2024-04-26T23:46:27.572 INFO:teuthology.orchestra.run.smithi088.stdout: "squid" 2024-04-26T23:46:27.573 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:46:27.573 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540701547738038271", 2024-04-26T23:46:27.573 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2024-04-26T23:46:27.573 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-04-26T23:46:27.573 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-04-26T23:46:27.573 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-04-26T23:46:27.573 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-04-26T23:46:27.573 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-04-26T23:46:27.573 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-04-26T23:46:27.573 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-04-26T23:46:27.573 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-04-26T23:46:27.573 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-04-26T23:46:27.573 INFO:teuthology.orchestra.run.smithi088.stdout: "reef", 2024-04-26T23:46:27.573 INFO:teuthology.orchestra.run.smithi088.stdout: "squid" 2024-04-26T23:46:27.574 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:46:27.574 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:46:27.574 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2024-04-26T23:46:27.574 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2024-04-26T23:46:27.574 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2024-04-26T23:46:27.574 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2024-04-26T23:46:27.574 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2024-04-26T23:46:27.574 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "555255e9-7ef9-4454-8dc9-35e96b70035c", 2024-04-26T23:46:27.574 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2024-04-26T23:39:34.291658Z", 2024-04-26T23:46:27.574 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2024-04-26T23:39:34.291658Z", 2024-04-26T23:46:27.574 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 19, 2024-04-26T23:46:27.574 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "squid", 2024-04-26T23:46:27.574 INFO:teuthology.orchestra.run.smithi088.stdout: "election_strategy": 1, 2024-04-26T23:46:27.574 INFO:teuthology.orchestra.run.smithi088.stdout: "disallowed_leaders: ": "", 2024-04-26T23:46:27.575 INFO:teuthology.orchestra.run.smithi088.stdout: "stretch_mode": false, 2024-04-26T23:46:27.575 INFO:teuthology.orchestra.run.smithi088.stdout: "tiebreaker_mon": "", 2024-04-26T23:46:27.575 INFO:teuthology.orchestra.run.smithi088.stdout: "removed_ranks: ": "", 2024-04-26T23:46:27.575 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2024-04-26T23:46:27.575 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2024-04-26T23:46:27.575 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-04-26T23:46:27.575 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-04-26T23:46:27.575 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-04-26T23:46:27.575 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-04-26T23:46:27.575 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-04-26T23:46:27.575 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-04-26T23:46:27.575 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-04-26T23:46:27.575 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-04-26T23:46:27.575 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-04-26T23:46:27.576 INFO:teuthology.orchestra.run.smithi088.stdout: "reef", 2024-04-26T23:46:27.576 INFO:teuthology.orchestra.run.smithi088.stdout: "squid" 2024-04-26T23:46:27.576 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:46:27.576 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2024-04-26T23:46:27.576 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:46:27.576 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2024-04-26T23:46:27.576 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:46:27.576 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2024-04-26T23:46:27.576 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2024-04-26T23:46:27.576 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-04-26T23:46:27.576 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-04-26T23:46:27.576 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:46:27.576 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-04-26T23:46:27.576 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2024-04-26T23:46:27.576 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:46:27.577 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:46:27.577 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:46:27.577 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-04-26T23:46:27.577 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2024-04-26T23:46:27.577 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:46:27.577 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:46:27.577 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:46:27.577 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:46:27.577 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2024-04-26T23:46:27.577 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2024-04-26T23:46:27.577 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-04-26T23:46:27.577 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-04-26T23:46:27.577 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-04-26T23:46:27.577 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:46:27.577 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:46:27.578 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2024-04-26T23:46:27.578 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2024-04-26T23:46:27.578 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-04-26T23:46:27.578 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-04-26T23:46:27.578 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:46:27.578 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-04-26T23:46:27.578 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:3300", 2024-04-26T23:46:27.578 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:46:27.578 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:46:27.578 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:46:27.578 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-04-26T23:46:27.578 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6789", 2024-04-26T23:46:27.578 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:46:27.578 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:46:27.579 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:46:27.579 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:46:27.579 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6789/0", 2024-04-26T23:46:27.579 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.175:6789/0", 2024-04-26T23:46:27.579 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-04-26T23:46:27.579 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-04-26T23:46:27.579 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-04-26T23:46:27.579 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:46:27.579 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:46:27.579 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2024-04-26T23:46:27.579 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2024-04-26T23:46:27.579 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-04-26T23:46:27.579 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-04-26T23:46:27.579 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:46:27.580 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-04-26T23:46:27.580 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:3301", 2024-04-26T23:46:27.580 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:46:27.580 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:46:27.580 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:46:27.580 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-04-26T23:46:27.580 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6790", 2024-04-26T23:46:27.580 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:46:27.580 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:46:27.580 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:46:27.580 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:46:27.580 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6790/0", 2024-04-26T23:46:27.580 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.175:6790/0", 2024-04-26T23:46:27.580 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-04-26T23:46:27.580 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-04-26T23:46:27.581 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-04-26T23:46:27.581 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:46:27.581 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:46:27.581 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:46:27.581 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2024-04-26T23:46:27.581 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2024-04-26T23:46:27.581 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:46:27.581 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:46:27.581 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:46:27.581 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2024-04-26T23:46:27.581 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:46:27.581 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:46:27.581 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2024-04-26T23:46:27.581 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:46:27.581 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:46:27.582 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:46:27.582 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2024-04-26T23:46:27.582 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:46:27.582 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:46:27.582 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:46:27.582 INFO:teuthology.orchestra.run.smithi088.stdout: "stretch_mode": false 2024-04-26T23:46:27.582 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-04-26T23:46:27.583 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.566+0000 7f27f6edd640 1 -- 172.21.15.88:0/1121462082 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f27d406c9c0 msgr2=0x7f27d406ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:27.583 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.566+0000 7f27f6edd640 1 --2- 172.21.15.88:0/1121462082 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f27d406c9c0 0x7f27d406ee80 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f27ec03d000 tx=0x7f27ec038000 comp rx=0 tx=0).stop 2024-04-26T23:46:27.583 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.566+0000 7f27f66dc640 1 -- 172.21.15.88:0/1121462082 reap_dead start 2024-04-26T23:46:27.583 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.566+0000 7f27f6edd640 1 -- 172.21.15.88:0/1121462082 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f27e8047260 msgr2=0x7f27e816f1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:27.583 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.566+0000 7f27f6edd640 1 --2- 172.21.15.88:0/1121462082 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f27e8047260 0x7f27e816f1a0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f27e000b3e0 tx=0x7f27e000b8a0 comp rx=0 tx=0).stop 2024-04-26T23:46:27.583 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.566+0000 7f27f6edd640 1 -- 172.21.15.88:0/1121462082 shutdown_connections 2024-04-26T23:46:27.583 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.566+0000 7f27f6edd640 1 --2- 172.21.15.88:0/1121462082 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f27e8047260 0x7f27e816f1a0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:27.583 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.566+0000 7f27f6edd640 1 -- 172.21.15.88:0/1121462082 >> 172.21.15.88:0/1121462082 conn(0x7f27e8049360 msgr2=0x7f27e80d07b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:27.583 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.566+0000 7f27f6edd640 1 -- 172.21.15.88:0/1121462082 shutdown_connections 2024-04-26T23:46:27.583 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.566+0000 7f27f6edd640 1 -- 172.21.15.88:0/1121462082 wait complete. 2024-04-26T23:46:27.584 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-04-26T23:46:27.585 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-04-26T23:46:27.585 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-04-26T23:46:27.743 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.737+0000 7ff247a62640 1 Processor -- start 2024-04-26T23:46:27.743 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.737+0000 7ff247a62640 1 -- start start 2024-04-26T23:46:27.743 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.739+0000 7ff247a62640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ff24014cae0 0x7ff240153570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:27.744 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.740+0000 7ff247a62640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff24006d530 0x7ff2400abe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:27.745 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.740+0000 7ff247a62640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff2400ad3a0 con 0x7ff2400c3c70 2024-04-26T23:46:27.745 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.740+0000 7ff247a62640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7ff2400ab9d0 con 0x7ff24014cae0 2024-04-26T23:46:27.745 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.740+0000 7ff245fff640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7ff2400c3c70 0x7ff240156070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.88:54090/0 (socket says 172.21.15.88:54090) 2024-04-26T23:46:27.745 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.740+0000 7ff245fff640 1 -- 172.21.15.88:0/1898604011 learned_addr learned my addr 172.21.15.88:0/1898604011 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-26T23:46:27.745 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.740+0000 7ff247a62640 1 -- 172.21.15.88:0/1898604011 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7ff2400ad680 con 0x7ff24006d530 2024-04-26T23:46:27.745 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.741+0000 7ff2457fe640 1 --2- 172.21.15.88:0/1898604011 >> v2:172.21.15.88:3300/0 conn(0x7ff24014cae0 0x7ff240153570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:27.746 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.742+0000 7ff2457fe640 1 -- 172.21.15.88:0/1898604011 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff24006d530 msgr2=0x7ff2400abe60 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-26T23:46:27.746 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.742+0000 7ff2457fe640 1 --2- 172.21.15.88:0/1898604011 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff24006d530 0x7ff2400abe60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:27.749 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.742+0000 7ff2457fe640 1 -- 172.21.15.88:0/1898604011 >> v1:172.21.15.175:6789/0 conn(0x7ff2400c3c70 legacy=0x7ff240156070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:27.749 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.742+0000 7ff2457fe640 1 -- 172.21.15.88:0/1898604011 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2400ab380 con 0x7ff24014cae0 2024-04-26T23:46:27.749 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.745+0000 7ff2457fe640 1 --2- 172.21.15.88:0/1898604011 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff24014cae0 0x7ff240153570 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7ff23c0087a0 tx=0x7ff23c02c610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb87a0a19c6a2261 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:27.750 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.746+0000 7ff237fff640 1 -- 172.21.15.88:0/1898604011 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff23c03a070 con 0x7ff24014cae0 2024-04-26T23:46:27.750 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.746+0000 7ff237fff640 1 -- 172.21.15.88:0/1898604011 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff23c032480 con 0x7ff24014cae0 2024-04-26T23:46:27.752 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.747+0000 7ff247a62640 1 -- 172.21.15.88:0/1898604011 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff24014cae0 msgr2=0x7ff240153570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:27.752 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.747+0000 7ff247a62640 1 --2- 172.21.15.88:0/1898604011 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff24014cae0 0x7ff240153570 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7ff23c0087a0 tx=0x7ff23c02c610 comp rx=0 tx=0).stop 2024-04-26T23:46:27.753 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.749+0000 7ff247a62640 1 -- 172.21.15.88:0/1898604011 shutdown_connections 2024-04-26T23:46:27.753 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.749+0000 7ff247a62640 1 --2- 172.21.15.88:0/1898604011 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff24006d530 0x7ff2400abe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:27.754 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.749+0000 7ff247a62640 1 --2- 172.21.15.88:0/1898604011 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff24014cae0 0x7ff240153570 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:27.754 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.749+0000 7ff247a62640 1 -- 172.21.15.88:0/1898604011 >> 172.21.15.88:0/1898604011 conn(0x7ff2400c4d60 msgr2=0x7ff2400c5170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:27.758 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.754+0000 7ff247a62640 1 -- 172.21.15.88:0/1898604011 shutdown_connections 2024-04-26T23:46:27.758 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.754+0000 7ff247a62640 1 -- 172.21.15.88:0/1898604011 wait complete. 2024-04-26T23:46:27.760 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.755+0000 7ff247a62640 1 Processor -- start 2024-04-26T23:46:27.760 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.756+0000 7ff247a62640 1 -- start start 2024-04-26T23:46:27.762 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.757+0000 7ff247a62640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff24006d530 0x7ff24014f020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:27.762 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.757+0000 7ff247a62640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff2400c3c70 0x7ff24014f560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:27.762 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.757+0000 7ff247a62640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff24014cae0 0x7ff2401f3b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:27.762 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.757+0000 7ff247a62640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7ff24014cec0 con 0x7ff24006d530 2024-04-26T23:46:27.762 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.757+0000 7ff247a62640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff24006d9b0 con 0x7ff2400c3c70 2024-04-26T23:46:27.762 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.757+0000 7ff247a62640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7ff2400ac3a0 con 0x7ff24014cae0 2024-04-26T23:46:27.763 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.757+0000 7ff2457fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff24006d530 0x7ff24014f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:27.763 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.757+0000 7ff2457fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff24006d530 0x7ff24014f020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:45934/0 (socket says 172.21.15.88:45934) 2024-04-26T23:46:27.763 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.757+0000 7ff2457fe640 1 -- 172.21.15.88:0/1908308052 learned_addr learned my addr 172.21.15.88:0/1908308052 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:46:27.763 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.757+0000 7ff2457fe640 1 -- 172.21.15.88:0/1908308052 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff24014cae0 msgr2=0x7ff2401f3b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:27.763 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.757+0000 7ff2457fe640 1 --2- 172.21.15.88:0/1908308052 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff24014cae0 0x7ff2401f3b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:27.764 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.757+0000 7ff2457fe640 1 -- 172.21.15.88:0/1908308052 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff2400c3c70 msgr2=0x7ff24014f560 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T23:46:27.764 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.757+0000 7ff2457fe640 1 --2- 172.21.15.88:0/1908308052 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff2400c3c70 0x7ff24014f560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:27.764 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.757+0000 7ff2457fe640 1 -- 172.21.15.88:0/1908308052 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2401f12e0 con 0x7ff24006d530 2024-04-26T23:46:27.764 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.758+0000 7ff2457fe640 1 --2- 172.21.15.88:0/1908308052 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff24006d530 0x7ff24014f020 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7ff23c0087a0 tx=0x7ff23c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:27.764 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.758+0000 7ff235ffb640 1 -- 172.21.15.88:0/1908308052 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff23c03a070 con 0x7ff24006d530 2024-04-26T23:46:27.765 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.759+0000 7ff235ffb640 1 -- 172.21.15.88:0/1908308052 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff23c035bd0 con 0x7ff24006d530 2024-04-26T23:46:27.765 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.759+0000 7ff247a62640 1 -- 172.21.15.88:0/1908308052 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff24014d170 con 0x7ff24006d530 2024-04-26T23:46:27.765 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.759+0000 7ff247a62640 1 -- 172.21.15.88:0/1908308052 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff24014e7b0 con 0x7ff24006d530 2024-04-26T23:46:27.765 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.759+0000 7ff235ffb640 1 -- 172.21.15.88:0/1908308052 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff23c00b0b0 con 0x7ff24006d530 2024-04-26T23:46:27.769 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.762+0000 7ff235ffb640 1 -- 172.21.15.88:0/1908308052 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff23c03e070 con 0x7ff24006d530 2024-04-26T23:46:27.769 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.762+0000 7ff235ffb640 1 --2- 172.21.15.88:0/1908308052 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7ff22406c9c0 0x7ff22406ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:27.769 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.762+0000 7ff235ffb640 1 -- 172.21.15.88:0/1908308052 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6666+0+0 (secure 0 0 0) 0x7ff23c0ac3e0 con 0x7ff24006d530 2024-04-26T23:46:27.769 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.763+0000 7ff244ffd640 1 --2- 172.21.15.88:0/1908308052 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7ff22406c9c0 0x7ff22406ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:27.769 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.763+0000 7ff247a62640 1 --2- 172.21.15.88:0/1908308052 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff220002a70 0x7ff220004f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:27.770 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.763+0000 7ff247a62640 1 -- 172.21.15.88:0/1908308052 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7ff220007ec0 con 0x7ff220002a70 2024-04-26T23:46:27.770 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.763+0000 7ff244ffd640 1 --2- 172.21.15.88:0/1908308052 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7ff22406c9c0 0x7ff22406ee80 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7ff2400c7dd0 tx=0x7ff230006bd0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:27.770 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.766+0000 7ff245fff640 1 --2- 172.21.15.88:0/1908308052 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff220002a70 0x7ff220004f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:27.771 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.766+0000 7ff245fff640 1 -- 172.21.15.88:0/1908308052 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff2200080c0 con 0x7ff220002a70 2024-04-26T23:46:27.771 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.767+0000 7ff245fff640 1 --2- 172.21.15.88:0/1908308052 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff220002a70 0x7ff220004f30 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7ff24014d490 tx=0x7ff23800ce80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:27.772 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.768+0000 7ff235ffb640 1 -- 172.21.15.88:0/1908308052 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff238017070 con 0x7ff220002a70 2024-04-26T23:46:27.772 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.768+0000 7ff235ffb640 1 -- 172.21.15.88:0/1908308052 <== mon.2 v2:172.21.15.175:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7ff23800aae0 con 0x7ff220002a70 2024-04-26T23:46:27.773 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.768+0000 7ff235ffb640 1 -- 172.21.15.88:0/1908308052 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff220002a70 msgr2=0x7ff220004f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:27.773 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.768+0000 7ff235ffb640 1 --2- 172.21.15.88:0/1908308052 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff220002a70 0x7ff220004f30 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7ff24014d490 tx=0x7ff23800ce80 comp rx=0 tx=0).stop 2024-04-26T23:46:27.773 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.768+0000 7ff235ffb640 1 -- 172.21.15.88:0/1908308052 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff220002a70 msgr2=0x7ff220004f30 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:46:27.778 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.774+0000 7ff235ffb640 1 --2- 172.21.15.88:0/1908308052 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff220002a70 0x7ff220004f30 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:27.790 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.785+0000 7ff247a62640 1 --2- 172.21.15.88:0/1908308052 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff220006f30 0x7ff2200073c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:27.790 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.785+0000 7ff247a62640 1 -- 172.21.15.88:0/1908308052 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7ff22000a4a0 con 0x7ff220006f30 2024-04-26T23:46:27.790 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.786+0000 7ff245fff640 1 --2- 172.21.15.88:0/1908308052 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff220006f30 0x7ff2200073c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:27.791 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.786+0000 7ff245fff640 1 -- 172.21.15.88:0/1908308052 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7ff220007900 con 0x7ff220006f30 2024-04-26T23:46:27.791 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.787+0000 7ff245fff640 1 --2- 172.21.15.88:0/1908308052 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff220006f30 0x7ff2200073c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7ff238014000 tx=0x7ff238001250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:27.792 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.788+0000 7ff235ffb640 1 -- 172.21.15.88:0/1908308052 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff238017040 con 0x7ff220006f30 2024-04-26T23:46:27.792 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.788+0000 7ff235ffb640 1 -- 172.21.15.88:0/1908308052 <== mon.2 v2:172.21.15.175:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5209 (secure 0 0 0) 0x7ff238012400 con 0x7ff220006f30 2024-04-26T23:46:27.792 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.788+0000 7ff235ffb640 1 -- 172.21.15.88:0/1908308052 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff220006f30 msgr2=0x7ff2200073c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:27.792 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.788+0000 7ff235ffb640 1 --2- 172.21.15.88:0/1908308052 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff220006f30 0x7ff2200073c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7ff238014000 tx=0x7ff238001250 comp rx=0 tx=0).stop 2024-04-26T23:46:27.792 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.788+0000 7ff235ffb640 1 -- 172.21.15.88:0/1908308052 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff220006f30 msgr2=0x7ff2200073c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:46:27.792 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.788+0000 7ff235ffb640 1 --2- 172.21.15.88:0/1908308052 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff220006f30 0x7ff2200073c0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:27.793 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-04-26T23:46:27.793 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2024-04-26T23:46:27.793 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2024-04-26T23:46:27.793 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "peon", 2024-04-26T23:46:27.793 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 60, 2024-04-26T23:46:27.793 INFO:teuthology.orchestra.run.smithi088.stdout: "uptime": 156074, 2024-04-26T23:46:27.793 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2024-04-26T23:46:27.793 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2024-04-26T23:46:27.793 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2024-04-26T23:46:27.793 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2024-04-26T23:46:27.793 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:46:27.793 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 15, 2024-04-26T23:46:27.793 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2024-04-26T23:46:27.793 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2450521708007866372", 2024-04-26T23:46:27.794 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2024-04-26T23:46:27.794 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-04-26T23:46:27.794 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-04-26T23:46:27.794 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-04-26T23:46:27.794 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-04-26T23:46:27.794 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-04-26T23:46:27.794 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-04-26T23:46:27.794 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-04-26T23:46:27.794 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-04-26T23:46:27.794 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-04-26T23:46:27.794 INFO:teuthology.orchestra.run.smithi088.stdout: "reef", 2024-04-26T23:46:27.794 INFO:teuthology.orchestra.run.smithi088.stdout: "squid" 2024-04-26T23:46:27.794 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:46:27.794 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540701547738038271", 2024-04-26T23:46:27.795 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2024-04-26T23:46:27.795 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-04-26T23:46:27.795 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-04-26T23:46:27.795 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-04-26T23:46:27.795 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-04-26T23:46:27.795 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-04-26T23:46:27.795 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-04-26T23:46:27.795 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-04-26T23:46:27.795 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-04-26T23:46:27.795 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-04-26T23:46:27.795 INFO:teuthology.orchestra.run.smithi088.stdout: "reef", 2024-04-26T23:46:27.796 INFO:teuthology.orchestra.run.smithi088.stdout: "squid" 2024-04-26T23:46:27.796 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:46:27.796 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:46:27.796 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2024-04-26T23:46:27.796 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2024-04-26T23:46:27.796 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2024-04-26T23:46:27.796 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2024-04-26T23:46:27.796 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2024-04-26T23:46:27.796 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "555255e9-7ef9-4454-8dc9-35e96b70035c", 2024-04-26T23:46:27.796 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2024-04-26T23:39:34.291658Z", 2024-04-26T23:46:27.796 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2024-04-26T23:39:34.291658Z", 2024-04-26T23:46:27.796 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 19, 2024-04-26T23:46:27.796 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "squid", 2024-04-26T23:46:27.796 INFO:teuthology.orchestra.run.smithi088.stdout: "election_strategy": 1, 2024-04-26T23:46:27.797 INFO:teuthology.orchestra.run.smithi088.stdout: "disallowed_leaders: ": "", 2024-04-26T23:46:27.797 INFO:teuthology.orchestra.run.smithi088.stdout: "stretch_mode": false, 2024-04-26T23:46:27.797 INFO:teuthology.orchestra.run.smithi088.stdout: "tiebreaker_mon": "", 2024-04-26T23:46:27.797 INFO:teuthology.orchestra.run.smithi088.stdout: "removed_ranks: ": "", 2024-04-26T23:46:27.797 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2024-04-26T23:46:27.797 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2024-04-26T23:46:27.797 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-04-26T23:46:27.797 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-04-26T23:46:27.797 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-04-26T23:46:27.797 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-04-26T23:46:27.797 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-04-26T23:46:27.797 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-04-26T23:46:27.797 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-04-26T23:46:27.797 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-04-26T23:46:27.797 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-04-26T23:46:27.798 INFO:teuthology.orchestra.run.smithi088.stdout: "reef", 2024-04-26T23:46:27.798 INFO:teuthology.orchestra.run.smithi088.stdout: "squid" 2024-04-26T23:46:27.798 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:46:27.798 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2024-04-26T23:46:27.798 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:46:27.798 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2024-04-26T23:46:27.798 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:46:27.798 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2024-04-26T23:46:27.798 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2024-04-26T23:46:27.798 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-04-26T23:46:27.799 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-04-26T23:46:27.799 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:46:27.799 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-04-26T23:46:27.799 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2024-04-26T23:46:27.799 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:46:27.799 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:46:27.799 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:46:27.799 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-04-26T23:46:27.799 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2024-04-26T23:46:27.799 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:46:27.799 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:46:27.799 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:46:27.799 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:46:27.799 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2024-04-26T23:46:27.799 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2024-04-26T23:46:27.800 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-04-26T23:46:27.800 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-04-26T23:46:27.800 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-04-26T23:46:27.800 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:46:27.800 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:46:27.800 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2024-04-26T23:46:27.800 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2024-04-26T23:46:27.800 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-04-26T23:46:27.800 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-04-26T23:46:27.800 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:46:27.800 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-04-26T23:46:27.800 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:3300", 2024-04-26T23:46:27.800 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:46:27.800 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:46:27.800 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:46:27.801 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-04-26T23:46:27.801 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6789", 2024-04-26T23:46:27.801 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:46:27.801 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:46:27.801 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:46:27.801 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:46:27.801 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6789/0", 2024-04-26T23:46:27.801 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.175:6789/0", 2024-04-26T23:46:27.801 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-04-26T23:46:27.801 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-04-26T23:46:27.801 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-04-26T23:46:27.801 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:46:27.801 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:46:27.801 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2024-04-26T23:46:27.801 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2024-04-26T23:46:27.802 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-04-26T23:46:27.802 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-04-26T23:46:27.802 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:46:27.802 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-04-26T23:46:27.802 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:3301", 2024-04-26T23:46:27.802 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:46:27.802 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:46:27.802 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:46:27.802 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-04-26T23:46:27.802 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6790", 2024-04-26T23:46:27.802 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:46:27.802 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:46:27.802 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:46:27.803 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:46:27.803 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6790/0", 2024-04-26T23:46:27.803 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.175:6790/0", 2024-04-26T23:46:27.803 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-04-26T23:46:27.803 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-04-26T23:46:27.803 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-04-26T23:46:27.803 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:46:27.803 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:46:27.803 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:46:27.803 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2024-04-26T23:46:27.803 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2024-04-26T23:46:27.803 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:46:27.803 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:46:27.803 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:46:27.803 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2024-04-26T23:46:27.804 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:46:27.804 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:46:27.804 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": [ 2024-04-26T23:46:27.804 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:46:27.804 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:46:27.804 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:46:27.804 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2024-04-26T23:46:27.804 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:46:27.804 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:46:27.804 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": [ 2024-04-26T23:46:27.804 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:46:27.804 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:46:27.804 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:46:27.804 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 6 2024-04-26T23:46:27.804 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:46:27.805 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:46:27.805 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2024-04-26T23:46:27.805 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:46:27.805 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x2f018fb87aa4aafe", 2024-04-26T23:46:27.805 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:46:27.805 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2024-04-26T23:46:27.805 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:46:27.805 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:46:27.805 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:46:27.805 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:46:27.805 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 4 2024-04-26T23:46:27.805 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:46:27.805 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:46:27.805 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": [ 2024-04-26T23:46:27.805 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:46:27.806 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:46:27.806 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:46:27.806 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2024-04-26T23:46:27.806 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:46:27.806 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:46:27.806 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:46:27.806 INFO:teuthology.orchestra.run.smithi088.stdout: "stretch_mode": false 2024-04-26T23:46:27.806 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-04-26T23:46:27.807 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.793+0000 7ff247a62640 1 -- 172.21.15.88:0/1908308052 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7ff22406c9c0 msgr2=0x7ff22406ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:27.807 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.793+0000 7ff247a62640 1 --2- 172.21.15.88:0/1908308052 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7ff22406c9c0 0x7ff22406ee80 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7ff2400c7dd0 tx=0x7ff230006bd0 comp rx=0 tx=0).stop 2024-04-26T23:46:27.807 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.793+0000 7ff245fff640 1 -- 172.21.15.88:0/1908308052 reap_dead start 2024-04-26T23:46:27.807 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.793+0000 7ff247a62640 1 -- 172.21.15.88:0/1908308052 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff24006d530 msgr2=0x7ff24014f020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:27.807 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.793+0000 7ff247a62640 1 --2- 172.21.15.88:0/1908308052 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff24006d530 0x7ff24014f020 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7ff23c0087a0 tx=0x7ff23c0046c0 comp rx=0 tx=0).stop 2024-04-26T23:46:27.807 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.793+0000 7ff247a62640 1 -- 172.21.15.88:0/1908308052 shutdown_connections 2024-04-26T23:46:27.807 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.793+0000 7ff247a62640 1 --2- 172.21.15.88:0/1908308052 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff24006d530 0x7ff24014f020 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:27.807 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.793+0000 7ff247a62640 1 -- 172.21.15.88:0/1908308052 >> 172.21.15.88:0/1908308052 conn(0x7ff2400c4d60 msgr2=0x7ff2400c5140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:27.807 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.797+0000 7ff247a62640 1 -- 172.21.15.88:0/1908308052 shutdown_connections 2024-04-26T23:46:27.807 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:27.797+0000 7ff247a62640 1 -- 172.21.15.88:0/1908308052 wait complete. 2024-04-26T23:46:27.821 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-04-26T23:46:27.822 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['a'] 2024-04-26T23:46:27.822 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2024-04-26T23:46:27.822 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.a 2024-04-26T23:46:27.822 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2024-04-26T23:46:27.822 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-04-26T23:46:27.822 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T23:46:27.844 INFO:tasks.ceph.mon.a:Stopped 2024-04-26T23:46:27.845 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2024-04-26T23:46:27.845 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-04-26T23:46:28.021 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:28.016+0000 7f9e8215f640 1 Processor -- start 2024-04-26T23:46:28.021 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:28.016+0000 7f9e8215f640 1 -- start start 2024-04-26T23:46:28.022 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:28.017+0000 7f9e8215f640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f9e7c0c4160 0x7f9e7c06d320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:28.022 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:28.017+0000 7f9e8215f640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9e7c0c4b50 con 0x7f9e7c1510c0 2024-04-26T23:46:28.022 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:28.017+0000 7f9e8215f640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9e7c1514a0 con 0x7f9e7c06d860 2024-04-26T23:46:28.022 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:28.017+0000 7f9e8215f640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f9e7c0c50d0 con 0x7f9e7c0c4160 2024-04-26T23:46:28.022 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:28.017+0000 7f9e7b7fe640 1 -- >> v1:172.21.15.88:6789/0 conn(0x7f9e7c1510c0 legacy=0x7f9e7c072f90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.88:6789/0 2024-04-26T23:46:28.022 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:28.018+0000 7f9e7affd640 1 -- >> v2:172.21.15.88:3300/0 conn(0x7f9e7c0c4160 msgr2=0x7f9e7c06d320 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.88:3300/0 2024-04-26T23:46:28.022 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:28.018+0000 7f9e7affd640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f9e7c0c4160 0x7f9e7c06d320 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:46:28.024 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:28.020+0000 7f9e7bfff640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f9e7c06d860 0x7f9e7c15e400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.88:54104/0 (socket says 172.21.15.88:54104) 2024-04-26T23:46:28.024 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:28.020+0000 7f9e7bfff640 1 -- 172.21.15.88:0/1645589364 learned_addr learned my addr 172.21.15.88:0/1645589364 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-26T23:46:28.026 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:28.022+0000 7f9e7a7fc640 1 -- 172.21.15.88:0/1645589364 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2027554782 0 0) 0x7f9e7c1514a0 con 0x7f9e7c06d860 2024-04-26T23:46:28.026 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:28.022+0000 7f9e7a7fc640 1 -- 172.21.15.88:0/1645589364 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9e64003520 con 0x7f9e7c06d860 2024-04-26T23:46:28.028 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:28.023+0000 7f9e7a7fc640 1 -- 172.21.15.88:0/1645589364 <== mon.1 v1:172.21.15.175:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2532363419 0 0) 0x7f9e64003520 con 0x7f9e7c06d860 2024-04-26T23:46:28.028 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:28.023+0000 7f9e7a7fc640 1 -- 172.21.15.88:0/1645589364 >> v2:172.21.15.88:3300/0 conn(0x7f9e7c0c4160 msgr2=0x7f9e7c06d320 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T23:46:28.028 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:28.023+0000 7f9e7a7fc640 1 --2- 172.21.15.88:0/1645589364 >> v2:172.21.15.88:3300/0 conn(0x7f9e7c0c4160 0x7f9e7c06d320 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:28.028 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:28.023+0000 7f9e7a7fc640 1 -- 172.21.15.88:0/1645589364 >> v1:172.21.15.88:6789/0 conn(0x7f9e7c1510c0 legacy=0x7f9e7c072f90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T23:46:28.028 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:28.023+0000 7f9e7a7fc640 1 -- 172.21.15.88:0/1645589364 --> v1:172.21.15.175:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e7c0736a0 con 0x7f9e7c06d860 2024-04-26T23:46:28.028 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:28.023+0000 7f9e7a7fc640 1 -- 172.21.15.88:0/1645589364 <== mon.1 v1:172.21.15.175:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 356324787 0 0) 0x7f9e740019f0 con 0x7f9e7c06d860 2024-04-26T23:46:28.028 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:28.023+0000 7f9e7a7fc640 1 -- 172.21.15.88:0/1645589364 >> v1:172.21.15.175:6789/0 conn(0x7f9e7c06d860 legacy=0x7f9e7c15e400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:28.028 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:28.023+0000 7f9e7a7fc640 1 --2- 172.21.15.88:0/1645589364 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9e640039b0 0x7f9e64003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:28.028 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:28.023+0000 7f9e7a7fc640 1 --2- 172.21.15.88:0/1645589364 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9e64004800 0x7f9e64004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:28.028 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:28.023+0000 7f9e7a7fc640 1 --2- 172.21.15.88:0/1645589364 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9e640053c0 0x7f9e6400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:28.029 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:28.023+0000 7f9e7a7fc640 1 -- 172.21.15.88:0/1645589364 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f9e7c0c50d0 con 0x7f9e640039b0 2024-04-26T23:46:28.029 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:28.023+0000 7f9e7b7fe640 1 -- 172.21.15.88:0/1645589364 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9e640039b0 msgr2=0x7f9e64003dd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.88:3300/0 2024-04-26T23:46:28.029 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:28.023+0000 7f9e7a7fc640 1 -- 172.21.15.88:0/1645589364 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f9e6400c280 con 0x7f9e64004800 2024-04-26T23:46:28.029 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:28.023+0000 7f9e7b7fe640 1 --2- 172.21.15.88:0/1645589364 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9e640039b0 0x7f9e64003dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:46:28.029 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:28.023+0000 7f9e7a7fc640 1 -- 172.21.15.88:0/1645589364 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f9e6400e690 con 0x7f9e640053c0 2024-04-26T23:46:28.029 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:28.025+0000 7f9e7affd640 1 --2- 172.21.15.88:0/1645589364 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9e64004800 0x7f9e64004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:28.034 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:28.030+0000 7f9e7bfff640 1 --2- 172.21.15.88:0/1645589364 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9e640053c0 0x7f9e6400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:28.035 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:28.031+0000 7f9e7bfff640 1 -- 172.21.15.88:0/1645589364 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9e64004800 msgr2=0x7f9e64004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:46:28.035 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:28.031+0000 7f9e7bfff640 1 --2- 172.21.15.88:0/1645589364 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9e64004800 0x7f9e64004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:28.035 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:28.031+0000 7f9e7bfff640 1 -- 172.21.15.88:0/1645589364 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9e640039b0 msgr2=0x7f9e64003dd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T23:46:28.036 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:28.031+0000 7f9e7bfff640 1 --2- 172.21.15.88:0/1645589364 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9e640039b0 0x7f9e64003dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:28.036 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:28.031+0000 7f9e7bfff640 1 -- 172.21.15.88:0/1645589364 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e64003520 con 0x7f9e640053c0 2024-04-26T23:46:28.037 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:28.032+0000 7f9e7bfff640 1 -- 172.21.15.88:0/1645589364 reap_dead start 2024-04-26T23:46:28.037 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:28.032+0000 7f9e7bfff640 1 --2- 172.21.15.88:0/1645589364 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9e640053c0 0x7f9e6400b9c0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f9e7400a840 tx=0x7f9e64005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7437e350b17be7df server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:28.037 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:28.032+0000 7f9e7a7fc640 1 -- 172.21.15.88:0/1645589364 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e7400a460 con 0x7f9e640053c0 2024-04-26T23:46:28.037 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:28.032+0000 7f9e7a7fc640 1 -- 172.21.15.88:0/1645589364 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e7402f070 con 0x7f9e640053c0 2024-04-26T23:46:28.037 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:28.032+0000 7f9e7a7fc640 1 -- 172.21.15.88:0/1645589364 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e7402bc90 con 0x7f9e640053c0 2024-04-26T23:46:28.038 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:28.033+0000 7f9e8215f640 1 -- 172.21.15.88:0/1645589364 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9e640053c0 msgr2=0x7f9e6400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:28.038 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:28.033+0000 7f9e8215f640 1 --2- 172.21.15.88:0/1645589364 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9e640053c0 0x7f9e6400b9c0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f9e7400a840 tx=0x7f9e64005830 comp rx=0 tx=0).stop 2024-04-26T23:46:28.038 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:28.033+0000 7f9e8215f640 1 -- 172.21.15.88:0/1645589364 shutdown_connections 2024-04-26T23:46:28.038 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:28.033+0000 7f9e8215f640 1 --2- 172.21.15.88:0/1645589364 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9e640053c0 0x7f9e6400b9c0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:28.038 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:28.033+0000 7f9e8215f640 1 -- 172.21.15.88:0/1645589364 >> 172.21.15.88:0/1645589364 conn(0x7f9e7c0c5ce0 msgr2=0x7f9e7c0c60f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:28.038 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:28.033+0000 7f9e8215f640 1 -- 172.21.15.88:0/1645589364 shutdown_connections 2024-04-26T23:46:28.038 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:28.033+0000 7f9e8215f640 1 -- 172.21.15.88:0/1645589364 wait complete. 2024-04-26T23:46:28.039 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:28.035+0000 7f9e8215f640 1 Processor -- start 2024-04-26T23:46:28.039 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:28.035+0000 7f9e8215f640 1 -- start start 2024-04-26T23:46:28.041 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:28.036+0000 7f9e8215f640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9e640053c0 0x7f9e7c154e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:28.041 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:28.036+0000 7f9e8215f640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9e7c1501f0 0x7f9e7c14c850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:28.041 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:28.036+0000 7f9e8215f640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9e7c143ae0 0x7f9e7c143f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:28.041 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:28.036+0000 7f9e8215f640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f9e7c0c5400 con 0x7f9e7c1501f0 2024-04-26T23:46:28.041 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:28.036+0000 7f9e8215f640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f9e7c0c4df0 con 0x7f9e7c143ae0 2024-04-26T23:46:28.041 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:28.036+0000 7f9e8215f640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f9e7c0c5920 con 0x7f9e640053c0 2024-04-26T23:46:28.042 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:28.036+0000 7f9e7affd640 1 -- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9e7c1501f0 msgr2=0x7f9e7c14c850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.88:3300/0 2024-04-26T23:46:28.042 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:28.036+0000 7f9e7affd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9e7c1501f0 0x7f9e7c14c850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:46:28.042 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:28.037+0000 7f9e7bfff640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9e7c143ae0 0x7f9e7c143f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:28.042 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:28.037+0000 7f9e7bfff640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9e7c143ae0 0x7f9e7c143f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.88:58716/0 (socket says 172.21.15.88:58716) 2024-04-26T23:46:28.042 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:28.037+0000 7f9e7bfff640 1 -- 172.21.15.88:0/2211664613 learned_addr learned my addr 172.21.15.88:0/2211664613 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:46:28.043 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:28.038+0000 7f9e7bfff640 1 -- 172.21.15.88:0/2211664613 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9e640053c0 msgr2=0x7f9e7c154e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:28.043 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:28.038+0000 7f9e7bfff640 1 --2- 172.21.15.88:0/2211664613 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9e640053c0 0x7f9e7c154e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:28.043 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:28.038+0000 7f9e7bfff640 1 -- 172.21.15.88:0/2211664613 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9e7c1501f0 msgr2=0x7f9e7c14c850 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T23:46:28.043 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:28.038+0000 7f9e7bfff640 1 --2- 172.21.15.88:0/2211664613 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9e7c1501f0 0x7f9e7c14c850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:28.043 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:28.038+0000 7f9e7bfff640 1 -- 172.21.15.88:0/2211664613 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e7c1eda20 con 0x7f9e7c143ae0 2024-04-26T23:46:28.043 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:28.038+0000 7f9e7bfff640 1 --2- 172.21.15.88:0/2211664613 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9e7c143ae0 0x7f9e7c143f60 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f9e7402b4e0 tx=0x7f9e74001d80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:28.043 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:28.038+0000 7f9e63fff640 1 -- 172.21.15.88:0/2211664613 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e74001fb0 con 0x7f9e7c143ae0 2024-04-26T23:46:28.043 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:28.038+0000 7f9e8215f640 1 -- 172.21.15.88:0/2211664613 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e7c0c6fe0 con 0x7f9e7c143ae0 2024-04-26T23:46:28.044 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:28.039+0000 7f9e63fff640 1 -- 172.21.15.88:0/2211664613 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e7402bc40 con 0x7f9e7c143ae0 2024-04-26T23:46:28.044 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:28.039+0000 7f9e8215f640 1 -- 172.21.15.88:0/2211664613 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e7c14cd90 con 0x7f9e7c143ae0 2024-04-26T23:46:28.044 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:28.039+0000 7f9e63fff640 1 -- 172.21.15.88:0/2211664613 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e7404d060 con 0x7f9e7c143ae0 2024-04-26T23:46:28.046 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:28.042+0000 7f9e8215f640 1 -- 172.21.15.88:0/2211664613 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e7c0c6dd0 con 0x7f9e7c143ae0 2024-04-26T23:46:28.059 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:28.053+0000 7f9e63fff640 1 -- 172.21.15.88:0/2211664613 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f9e740635b0 con 0x7f9e7c143ae0 2024-04-26T23:46:28.059 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:28.053+0000 7f9e63fff640 1 --2- 172.21.15.88:0/2211664613 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f9e6806c8a0 0x7f9e6806ed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:28.059 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:28.053+0000 7f9e7b7fe640 1 --2- 172.21.15.88:0/2211664613 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f9e6806c8a0 0x7f9e6806ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:28.059 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:28.054+0000 7f9e7b7fe640 1 --2- 172.21.15.88:0/2211664613 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f9e6806c8a0 0x7f9e6806ed60 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f9e6c003980 tx=0x7f9e6c006cf0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:28.059 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:28.055+0000 7f9e63fff640 1 -- 172.21.15.88:0/2211664613 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6666+0+0 (secure 0 0 0) 0x7f9e740ac520 con 0x7f9e7c143ae0 2024-04-26T23:46:28.070 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:28.063+0000 7f9e63fff640 1 -- 172.21.15.88:0/2211664613 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f9e7407a620 con 0x7f9e7c143ae0 2024-04-26T23:46:28.610 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:28.606+0000 7f9e8215f640 1 -- 172.21.15.88:0/2211664613 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f9e7c152c10 con 0x7f9e7c143ae0 2024-04-26T23:46:28.611 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:28.607+0000 7f9e63fff640 1 -- 172.21.15.88:0/2211664613 <== mon.1 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1565 (secure 0 0 0) 0x7f9e74079f20 con 0x7f9e7c143ae0 2024-04-26T23:46:28.611 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":60,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":16,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"555255e9-7ef9-4454-8dc9-35e96b70035c","modified":"2024-04-26T23:39:34.291658Z","created":"2024-04-26T23:39:34.291658Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:3300","nonce":0},{"type":"v1","addr":"172.21.15.175:6789","nonce":0}]},"addr":"172.21.15.175:6789/0","public_addr":"172.21.15.175:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:3301","nonce":0},{"type":"v1","addr":"172.21.15.175:6790","nonce":0}]},"addr":"172.21.15.175:6790/0","public_addr":"172.21.15.175:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-04-26T23:46:28.614 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:28.610+0000 7f9e8215f640 1 -- 172.21.15.88:0/2211664613 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f9e6806c8a0 msgr2=0x7f9e6806ed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:28.614 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:28.610+0000 7f9e8215f640 1 --2- 172.21.15.88:0/2211664613 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f9e6806c8a0 0x7f9e6806ed60 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f9e6c003980 tx=0x7f9e6c006cf0 comp rx=0 tx=0).stop 2024-04-26T23:46:28.614 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:28.610+0000 7f9e8215f640 1 -- 172.21.15.88:0/2211664613 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9e7c143ae0 msgr2=0x7f9e7c143f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:28.615 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:28.610+0000 7f9e8215f640 1 --2- 172.21.15.88:0/2211664613 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9e7c143ae0 0x7f9e7c143f60 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f9e7402b4e0 tx=0x7f9e74001d80 comp rx=0 tx=0).stop 2024-04-26T23:46:28.615 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:28.610+0000 7f9e8215f640 1 -- 172.21.15.88:0/2211664613 shutdown_connections 2024-04-26T23:46:28.615 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:28.610+0000 7f9e8215f640 1 --2- 172.21.15.88:0/2211664613 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f9e6806c8a0 0x7f9e6806ed60 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:28.615 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:28.610+0000 7f9e8215f640 1 --2- 172.21.15.88:0/2211664613 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9e7c143ae0 0x7f9e7c143f60 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:28.615 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:28.610+0000 7f9e8215f640 1 --2- 172.21.15.88:0/2211664613 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9e7c1501f0 0x7f9e7c14c850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:28.615 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:28.610+0000 7f9e8215f640 1 --2- 172.21.15.88:0/2211664613 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9e640053c0 0x7f9e7c154e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:28.615 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:28.610+0000 7f9e8215f640 1 -- 172.21.15.88:0/2211664613 >> 172.21.15.88:0/2211664613 conn(0x7f9e7c0c5ce0 msgr2=0x7f9e7c0c26a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:28.615 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:28.610+0000 7f9e8215f640 1 -- 172.21.15.88:0/2211664613 shutdown_connections 2024-04-26T23:46:28.615 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:28.610+0000 7f9e8215f640 1 -- 172.21.15.88:0/2211664613 wait complete. 2024-04-26T23:46:31.635 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-04-26T23:46:31.841 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:31.834+0000 7fa06590f640 1 Processor -- start 2024-04-26T23:46:31.842 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:31.838+0000 7fa06590f640 1 -- start start 2024-04-26T23:46:31.846 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:31.839+0000 7fa06590f640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa0580d46d0 0x7fa05800b250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:31.846 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:31.839+0000 7fa06590f640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa0580d71f0 0x7fa0580472e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:31.846 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:31.839+0000 7fa06590f640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa0580402a0 con 0x7fa05802c020 2024-04-26T23:46:31.846 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:31.839+0000 7fa06590f640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7fa05804aef0 con 0x7fa0580d71f0 2024-04-26T23:46:31.846 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:31.839+0000 7fa06590f640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fa05804ba70 con 0x7fa0580d46d0 2024-04-26T23:46:31.846 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:31.839+0000 7fa06490d640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa0580d46d0 0x7fa05800b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:31.846 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:31.840+0000 7fa06490d640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa0580d46d0 0x7fa05800b250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.88:48784/0 (socket says 172.21.15.88:48784) 2024-04-26T23:46:31.847 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:31.840+0000 7fa06490d640 1 -- 172.21.15.88:0/2811750895 learned_addr learned my addr 172.21.15.88:0/2811750895 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:46:31.847 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:31.840+0000 7fa06490d640 1 -- 172.21.15.88:0/2811750895 >> v2:172.21.15.88:3300/0 conn(0x7fa0580d71f0 msgr2=0x7fa0580472e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T23:46:31.847 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:31.840+0000 7fa06490d640 1 --2- 172.21.15.88:0/2811750895 >> v2:172.21.15.88:3300/0 conn(0x7fa0580d71f0 0x7fa0580472e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:31.847 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:31.840+0000 7fa06490d640 1 -- 172.21.15.88:0/2811750895 >> v1:172.21.15.175:6789/0 conn(0x7fa05802c020 legacy=0x7fa05804bf00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T23:46:31.847 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:31.840+0000 7fa06490d640 1 -- 172.21.15.88:0/2811750895 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa05804c610 con 0x7fa0580d46d0 2024-04-26T23:46:31.848 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:31.843+0000 7fa06490d640 1 --2- 172.21.15.88:0/2811750895 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa0580d46d0 0x7fa05800b250 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fa054014410 tx=0x7fa05403b970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4e86c86dab874f4c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:31.848 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:31.843+0000 7fa05f7fe640 1 -- 172.21.15.88:0/2811750895 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa054045020 con 0x7fa0580d46d0 2024-04-26T23:46:31.848 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:31.843+0000 7fa05f7fe640 1 -- 172.21.15.88:0/2811750895 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa054041830 con 0x7fa0580d46d0 2024-04-26T23:46:31.848 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:31.843+0000 7fa05f7fe640 1 -- 172.21.15.88:0/2811750895 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa054041c00 con 0x7fa0580d46d0 2024-04-26T23:46:31.851 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:31.845+0000 7fa06590f640 1 -- 172.21.15.88:0/2811750895 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa0580d46d0 msgr2=0x7fa05800b250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:31.851 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:31.845+0000 7fa06590f640 1 --2- 172.21.15.88:0/2811750895 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa0580d46d0 0x7fa05800b250 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fa054014410 tx=0x7fa05403b970 comp rx=0 tx=0).stop 2024-04-26T23:46:31.852 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:31.848+0000 7fa06590f640 1 -- 172.21.15.88:0/2811750895 shutdown_connections 2024-04-26T23:46:31.853 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:31.848+0000 7fa06590f640 1 --2- 172.21.15.88:0/2811750895 >> v2:172.21.15.88:3300/0 conn(0x7fa0580d71f0 0x7fa0580472e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:31.853 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:31.848+0000 7fa06590f640 1 --2- 172.21.15.88:0/2811750895 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa0580d46d0 0x7fa05800b250 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:31.853 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:31.848+0000 7fa06590f640 1 -- 172.21.15.88:0/2811750895 >> 172.21.15.88:0/2811750895 conn(0x7fa058007b40 msgr2=0x7fa058007f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:31.855 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:31.851+0000 7fa06590f640 1 -- 172.21.15.88:0/2811750895 shutdown_connections 2024-04-26T23:46:31.860 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:31.852+0000 7fa06590f640 1 -- 172.21.15.88:0/2811750895 wait complete. 2024-04-26T23:46:31.860 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:31.853+0000 7fa06590f640 1 Processor -- start 2024-04-26T23:46:31.860 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:31.853+0000 7fa06590f640 1 -- start start 2024-04-26T23:46:31.860 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:31.855+0000 7fa06590f640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa05802c020 0x7fa0580d10f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:31.860 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:31.855+0000 7fa06590f640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa0580d46d0 0x7fa0581620c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:31.860 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:31.855+0000 7fa06590f640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa0580d71f0 0x7fa058162600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:31.860 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:31.855+0000 7fa06590f640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fa05804b700 con 0x7fa0580d46d0 2024-04-26T23:46:31.860 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:31.855+0000 7fa06590f640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fa05804b420 con 0x7fa0580d71f0 2024-04-26T23:46:31.860 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:31.855+0000 7fa06590f640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fa05802f210 con 0x7fa05802c020 2024-04-26T23:46:31.860 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:31.855+0000 7fa05ffff640 1 -- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa0580d46d0 msgr2=0x7fa0581620c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.88:3300/0 2024-04-26T23:46:31.861 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:31.855+0000 7fa05ffff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa0580d46d0 0x7fa0581620c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:46:31.861 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:31.855+0000 7fa06510e640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa0580d71f0 0x7fa058162600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:31.861 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:31.855+0000 7fa06510e640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa0580d71f0 0x7fa058162600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.88:32782/0 (socket says 172.21.15.88:32782) 2024-04-26T23:46:31.861 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:31.855+0000 7fa06510e640 1 -- 172.21.15.88:0/628508159 learned_addr learned my addr 172.21.15.88:0/628508159 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:46:31.863 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:31.857+0000 7fa06490d640 1 --2- 172.21.15.88:0/628508159 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa05802c020 0x7fa0580d10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:31.863 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:31.857+0000 7fa06490d640 1 -- 172.21.15.88:0/628508159 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa0580d71f0 msgr2=0x7fa058162600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:31.863 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:31.857+0000 7fa06490d640 1 --2- 172.21.15.88:0/628508159 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa0580d71f0 0x7fa058162600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:31.863 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:31.857+0000 7fa06490d640 1 -- 172.21.15.88:0/628508159 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa0580d46d0 msgr2=0x7fa0581620c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T23:46:31.863 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:31.857+0000 7fa06490d640 1 --2- 172.21.15.88:0/628508159 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa0580d46d0 0x7fa0581620c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:31.863 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:31.857+0000 7fa06490d640 1 -- 172.21.15.88:0/628508159 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0580d2df0 con 0x7fa05802c020 2024-04-26T23:46:31.864 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:31.858+0000 7fa06490d640 1 --2- 172.21.15.88:0/628508159 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa05802c020 0x7fa0580d10f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fa054043000 tx=0x7fa0540046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:31.864 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:31.858+0000 7fa05d7fa640 1 -- 172.21.15.88:0/628508159 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa05405b070 con 0x7fa05802c020 2024-04-26T23:46:31.864 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:31.858+0000 7fa06590f640 1 -- 172.21.15.88:0/628508159 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0580d30d0 con 0x7fa05802c020 2024-04-26T23:46:31.864 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:31.858+0000 7fa06590f640 1 -- 172.21.15.88:0/628508159 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fa058161a10 con 0x7fa05802c020 2024-04-26T23:46:31.864 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:31.859+0000 7fa05d7fa640 1 -- 172.21.15.88:0/628508159 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0540417d0 con 0x7fa05802c020 2024-04-26T23:46:31.864 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:31.859+0000 7fa05d7fa640 1 -- 172.21.15.88:0/628508159 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa05405b070 con 0x7fa05802c020 2024-04-26T23:46:31.866 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:31.861+0000 7fa05d7fa640 1 -- 172.21.15.88:0/628508159 <== mon.2 v2:172.21.15.175:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa054048020 con 0x7fa05802c020 2024-04-26T23:46:31.867 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:31.862+0000 7fa06590f640 1 -- 172.21.15.88:0/628508159 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa040005290 con 0x7fa05802c020 2024-04-26T23:46:31.867 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:31.862+0000 7fa05d7fa640 1 --2- 172.21.15.88:0/628508159 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fa05006ce10 0x7fa05006f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:31.867 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:31.863+0000 7fa05d7fa640 1 -- 172.21.15.88:0/628508159 <== mon.2 v2:172.21.15.175:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6666+0+0 (secure 0 0 0) 0x7fa054051030 con 0x7fa05802c020 2024-04-26T23:46:31.869 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:31.864+0000 7fa05ffff640 1 --2- 172.21.15.88:0/628508159 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fa05006ce10 0x7fa05006f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:31.869 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:31.865+0000 7fa05ffff640 1 --2- 172.21.15.88:0/628508159 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fa05006ce10 0x7fa05006f2d0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fa058042f00 tx=0x7fa04c006cf0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:31.879 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:31.875+0000 7fa05d7fa640 1 -- 172.21.15.88:0/628508159 <== mon.2 v2:172.21.15.175:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fa05408ab50 con 0x7fa05802c020 2024-04-26T23:46:32.480 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:32.475+0000 7fa06590f640 1 -- 172.21.15.88:0/628508159 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fa040005580 con 0x7fa05802c020 2024-04-26T23:46:32.481 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:32.477+0000 7fa05d7fa640 1 -- 172.21.15.88:0/628508159 <== mon.2 v2:172.21.15.175:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1565 (secure 0 0 0) 0x7fa05408ee50 con 0x7fa05802c020 2024-04-26T23:46:32.481 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":60,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":20,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"555255e9-7ef9-4454-8dc9-35e96b70035c","modified":"2024-04-26T23:39:34.291658Z","created":"2024-04-26T23:39:34.291658Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:3300","nonce":0},{"type":"v1","addr":"172.21.15.175:6789","nonce":0}]},"addr":"172.21.15.175:6789/0","public_addr":"172.21.15.175:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:3301","nonce":0},{"type":"v1","addr":"172.21.15.175:6790","nonce":0}]},"addr":"172.21.15.175:6790/0","public_addr":"172.21.15.175:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-04-26T23:46:32.485 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:32.480+0000 7fa06590f640 1 -- 172.21.15.88:0/628508159 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fa05006ce10 msgr2=0x7fa05006f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:32.485 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:32.480+0000 7fa06590f640 1 --2- 172.21.15.88:0/628508159 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fa05006ce10 0x7fa05006f2d0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fa058042f00 tx=0x7fa04c006cf0 comp rx=0 tx=0).stop 2024-04-26T23:46:32.485 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:32.480+0000 7fa06590f640 1 -- 172.21.15.88:0/628508159 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa05802c020 msgr2=0x7fa0580d10f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:32.485 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:32.480+0000 7fa06590f640 1 --2- 172.21.15.88:0/628508159 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa05802c020 0x7fa0580d10f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fa054043000 tx=0x7fa0540046c0 comp rx=0 tx=0).stop 2024-04-26T23:46:32.486 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:32.481+0000 7fa06590f640 1 -- 172.21.15.88:0/628508159 shutdown_connections 2024-04-26T23:46:32.486 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:32.481+0000 7fa06590f640 1 --2- 172.21.15.88:0/628508159 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fa05006ce10 0x7fa05006f2d0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:32.486 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:32.481+0000 7fa06590f640 1 --2- 172.21.15.88:0/628508159 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa0580d71f0 0x7fa058162600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:32.486 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:32.481+0000 7fa06590f640 1 --2- 172.21.15.88:0/628508159 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa0580d46d0 0x7fa0581620c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:32.486 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:32.481+0000 7fa06590f640 1 --2- 172.21.15.88:0/628508159 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa05802c020 0x7fa0580d10f0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:32.486 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:32.481+0000 7fa06590f640 1 -- 172.21.15.88:0/628508159 >> 172.21.15.88:0/628508159 conn(0x7fa058007b40 msgr2=0x7fa0580d55f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:32.486 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:32.481+0000 7fa06590f640 1 -- 172.21.15.88:0/628508159 shutdown_connections 2024-04-26T23:46:32.486 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:32.481+0000 7fa06590f640 1 -- 172.21.15.88:0/628508159 wait complete. 2024-04-26T23:46:34.549 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:46:34.551 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:46:35.508 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-04-26T23:46:35.712 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:35.707+0000 7fecded3b640 1 Processor -- start 2024-04-26T23:46:35.712 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:35.707+0000 7fecded3b640 1 -- start start 2024-04-26T23:46:35.712 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:35.709+0000 7fecded3b640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fecd00d48e0 0x7fecd000c240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:35.713 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:35.709+0000 7fecded3b640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fecd0009210 con 0x7fecd0008c50 2024-04-26T23:46:35.713 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:35.709+0000 7fecded3b640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fecd00d4cc0 con 0x7fecd0008740 2024-04-26T23:46:35.713 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:35.709+0000 7fecded3b640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fecd0047490 con 0x7fecd00d48e0 2024-04-26T23:46:35.714 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:35.709+0000 7fecdd538640 1 -- >> v1:172.21.15.88:6789/0 conn(0x7fecd0008c50 legacy=0x7fecd00d8550 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.88:6789/0 2024-04-26T23:46:35.714 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:35.710+0000 7fecde53a640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7fecd0008740 0x7fecd00e19e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.88:56934/0 (socket says 172.21.15.88:56934) 2024-04-26T23:46:35.714 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:35.710+0000 7fecde53a640 1 -- 172.21.15.88:0/3313187009 learned_addr learned my addr 172.21.15.88:0/3313187009 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-26T23:46:35.714 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:35.710+0000 7fecddd39640 1 --2- 172.21.15.88:0/3313187009 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fecd00d48e0 0x7fecd000c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:35.715 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:35.711+0000 7fecddd39640 1 -- 172.21.15.88:0/3313187009 >> v1:172.21.15.175:6789/0 conn(0x7fecd0008740 legacy=0x7fecd00e19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:35.715 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:35.711+0000 7fecddd39640 1 -- 172.21.15.88:0/3313187009 >> v1:172.21.15.88:6789/0 conn(0x7fecd0008c50 legacy=0x7fecd00d8550 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T23:46:35.715 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:35.711+0000 7fecddd39640 1 -- 172.21.15.88:0/3313187009 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fecd00d7da0 con 0x7fecd00d48e0 2024-04-26T23:46:35.716 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:35.712+0000 7fecddd39640 1 --2- 172.21.15.88:0/3313187009 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fecd00d48e0 0x7fecd000c240 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fecd40097d0 tx=0x7fecd402a0b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=880b4e601c621ed7 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:35.716 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:35.712+0000 7fecdcd37640 1 -- 172.21.15.88:0/3313187009 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecd4037070 con 0x7fecd00d48e0 2024-04-26T23:46:35.717 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:35.712+0000 7fecdcd37640 1 -- 172.21.15.88:0/3313187009 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fecd402adc0 con 0x7fecd00d48e0 2024-04-26T23:46:35.717 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:35.712+0000 7fecdcd37640 1 -- 172.21.15.88:0/3313187009 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecd4032660 con 0x7fecd00d48e0 2024-04-26T23:46:35.718 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:35.713+0000 7fecded3b640 1 -- 172.21.15.88:0/3313187009 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fecd00d48e0 msgr2=0x7fecd000c240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:35.718 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:35.713+0000 7fecded3b640 1 --2- 172.21.15.88:0/3313187009 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fecd00d48e0 0x7fecd000c240 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fecd40097d0 tx=0x7fecd402a0b0 comp rx=0 tx=0).stop 2024-04-26T23:46:35.718 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:35.714+0000 7fecded3b640 1 -- 172.21.15.88:0/3313187009 shutdown_connections 2024-04-26T23:46:35.718 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:35.714+0000 7fecded3b640 1 --2- 172.21.15.88:0/3313187009 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fecd00d48e0 0x7fecd000c240 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:35.718 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:35.714+0000 7fecded3b640 1 -- 172.21.15.88:0/3313187009 >> 172.21.15.88:0/3313187009 conn(0x7fecd0007c20 msgr2=0x7fecd0008030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:35.719 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:35.714+0000 7fecded3b640 1 -- 172.21.15.88:0/3313187009 shutdown_connections 2024-04-26T23:46:35.719 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:35.714+0000 7fecded3b640 1 -- 172.21.15.88:0/3313187009 wait complete. 2024-04-26T23:46:35.720 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:35.716+0000 7fecded3b640 1 Processor -- start 2024-04-26T23:46:35.720 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:35.716+0000 7fecded3b640 1 -- start start 2024-04-26T23:46:35.722 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:35.717+0000 7fecded3b640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fecd0008740 0x7fecd00d9440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:35.722 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:35.718+0000 7fecded3b640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fecd0008c50 0x7fecd00c8890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:35.722 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:35.718+0000 7fecded3b640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fecd00d48e0 0x7fecd00c8dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:35.724 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:35.718+0000 7fecddd39640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fecd0008740 0x7fecd00d9440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:35.724 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:35.718+0000 7fecddd39640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fecd0008740 0x7fecd00d9440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.88:48816/0 (socket says 172.21.15.88:48816) 2024-04-26T23:46:35.724 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:35.718+0000 7fecdd538640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fecd0008c50 0x7fecd00c8890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:35.724 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:35.718+0000 7fecdd538640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fecd0008c50 0x7fecd00c8890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.88:32796/0 (socket says 172.21.15.88:32796) 2024-04-26T23:46:35.724 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:35.718+0000 7fecde53a640 1 -- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fecd00d48e0 msgr2=0x7fecd00c8dd0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.88:3300/0 2024-04-26T23:46:35.724 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:35.718+0000 7fecde53a640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fecd00d48e0 0x7fecd00c8dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:46:35.724 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:35.718+0000 7fecddd39640 1 -- 172.21.15.88:0/2445138191 learned_addr learned my addr 172.21.15.88:0/2445138191 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:46:35.724 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:35.718+0000 7fecded3b640 1 -- 172.21.15.88:0/2445138191 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fecd00d8c60 con 0x7fecd00d48e0 2024-04-26T23:46:35.724 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:35.718+0000 7fecded3b640 1 -- 172.21.15.88:0/2445138191 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fecd002f190 con 0x7fecd0008c50 2024-04-26T23:46:35.724 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:35.718+0000 7fecded3b640 1 -- 172.21.15.88:0/2445138191 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fecd00ceb80 con 0x7fecd0008740 2024-04-26T23:46:35.724 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:35.719+0000 7fecddd39640 1 -- 172.21.15.88:0/2445138191 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fecd0008c50 msgr2=0x7fecd00c8890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:35.725 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:35.719+0000 7fecddd39640 1 --2- 172.21.15.88:0/2445138191 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fecd0008c50 0x7fecd00c8890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:35.725 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:35.719+0000 7fecddd39640 1 -- 172.21.15.88:0/2445138191 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fecd00d48e0 msgr2=0x7fecd00c8dd0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T23:46:35.725 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:35.719+0000 7fecddd39640 1 --2- 172.21.15.88:0/2445138191 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fecd00d48e0 0x7fecd00c8dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:35.725 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:35.719+0000 7fecddd39640 1 -- 172.21.15.88:0/2445138191 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fecd00cfec0 con 0x7fecd0008740 2024-04-26T23:46:35.726 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:35.719+0000 7fecddd39640 1 --2- 172.21.15.88:0/2445138191 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fecd0008740 0x7fecd00d9440 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fecd4009720 tx=0x7fecd40046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:35.726 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:35.720+0000 7fecce7fc640 1 -- 172.21.15.88:0/2445138191 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecd4042070 con 0x7fecd0008740 2024-04-26T23:46:35.726 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:35.720+0000 7fecce7fc640 1 -- 172.21.15.88:0/2445138191 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fecd403c860 con 0x7fecd0008740 2024-04-26T23:46:35.726 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:35.720+0000 7fecce7fc640 1 -- 172.21.15.88:0/2445138191 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecd4037040 con 0x7fecd0008740 2024-04-26T23:46:35.726 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:35.721+0000 7fecded3b640 1 -- 172.21.15.88:0/2445138191 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fecd002f710 con 0x7fecd0008740 2024-04-26T23:46:35.726 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:35.722+0000 7fecded3b640 1 -- 172.21.15.88:0/2445138191 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fecd002fcd0 con 0x7fecd0008740 2024-04-26T23:46:35.728 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:35.724+0000 7fecded3b640 1 -- 172.21.15.88:0/2445138191 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fecd00057e0 con 0x7fecd0008740 2024-04-26T23:46:35.733 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:35.726+0000 7fecce7fc640 1 -- 172.21.15.88:0/2445138191 <== mon.2 v2:172.21.15.175:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fecd404d060 con 0x7fecd0008740 2024-04-26T23:46:35.734 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:35.726+0000 7fecce7fc640 1 --2- 172.21.15.88:0/2445138191 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fecbc06c8d0 0x7fecbc06ed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:35.734 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:35.726+0000 7fecce7fc640 1 -- 172.21.15.88:0/2445138191 <== mon.2 v2:172.21.15.175:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6666+0+0 (secure 0 0 0) 0x7fecd40afb20 con 0x7fecd0008740 2024-04-26T23:46:35.734 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:35.727+0000 7fecdd538640 1 --2- 172.21.15.88:0/2445138191 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fecbc06c8d0 0x7fecbc06ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:35.734 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:35.728+0000 7fecdd538640 1 --2- 172.21.15.88:0/2445138191 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fecbc06c8d0 0x7fecbc06ed90 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fecd00328a0 tx=0x7fecc8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:35.751 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:35.747+0000 7fecce7fc640 1 -- 172.21.15.88:0/2445138191 <== mon.2 v2:172.21.15.175:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fecd407dc00 con 0x7fecd0008740 2024-04-26T23:46:36.365 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:36.361+0000 7fecded3b640 1 -- 172.21.15.88:0/2445138191 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fecd00d5660 con 0x7fecd0008740 2024-04-26T23:46:36.367 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:36.363+0000 7fecce7fc640 1 -- 172.21.15.88:0/2445138191 <== mon.2 v2:172.21.15.175:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1565 (secure 0 0 0) 0x7fecd407d500 con 0x7fecd0008740 2024-04-26T23:46:36.370 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":60,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":24,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"555255e9-7ef9-4454-8dc9-35e96b70035c","modified":"2024-04-26T23:39:34.291658Z","created":"2024-04-26T23:39:34.291658Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:3300","nonce":0},{"type":"v1","addr":"172.21.15.175:6789","nonce":0}]},"addr":"172.21.15.175:6789/0","public_addr":"172.21.15.175:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:3301","nonce":0},{"type":"v1","addr":"172.21.15.175:6790","nonce":0}]},"addr":"172.21.15.175:6790/0","public_addr":"172.21.15.175:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-04-26T23:46:36.375 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:36.371+0000 7fecbbfff640 1 -- 172.21.15.88:0/2445138191 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fecbc06c8d0 msgr2=0x7fecbc06ed90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:36.375 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:36.371+0000 7fecbbfff640 1 --2- 172.21.15.88:0/2445138191 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fecbc06c8d0 0x7fecbc06ed90 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fecd00328a0 tx=0x7fecc8008040 comp rx=0 tx=0).stop 2024-04-26T23:46:36.375 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:36.371+0000 7fecbbfff640 1 -- 172.21.15.88:0/2445138191 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fecd0008740 msgr2=0x7fecd00d9440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:36.375 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:36.371+0000 7fecbbfff640 1 --2- 172.21.15.88:0/2445138191 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fecd0008740 0x7fecd00d9440 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fecd4009720 tx=0x7fecd40046c0 comp rx=0 tx=0).stop 2024-04-26T23:46:36.376 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:36.371+0000 7fecbbfff640 1 -- 172.21.15.88:0/2445138191 shutdown_connections 2024-04-26T23:46:36.376 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:36.371+0000 7fecbbfff640 1 --2- 172.21.15.88:0/2445138191 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fecbc06c8d0 0x7fecbc06ed90 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:36.376 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:36.371+0000 7fecbbfff640 1 --2- 172.21.15.88:0/2445138191 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fecd00d48e0 0x7fecd00c8dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:36.376 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:36.371+0000 7fecbbfff640 1 --2- 172.21.15.88:0/2445138191 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fecd0008c50 0x7fecd00c8890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:36.376 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:36.371+0000 7fecbbfff640 1 --2- 172.21.15.88:0/2445138191 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fecd0008740 0x7fecd00d9440 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:36.376 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:36.371+0000 7fecbbfff640 1 -- 172.21.15.88:0/2445138191 >> 172.21.15.88:0/2445138191 conn(0x7fecd0007c20 msgr2=0x7fecd000af30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:36.376 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:36.371+0000 7fecbbfff640 1 -- 172.21.15.88:0/2445138191 shutdown_connections 2024-04-26T23:46:36.376 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:36.371+0000 7fecbbfff640 1 -- 172.21.15.88:0/2445138191 wait complete. 2024-04-26T23:46:39.400 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-04-26T23:46:39.585 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:39.581+0000 7f67f600b640 1 Processor -- start 2024-04-26T23:46:39.585 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:39.581+0000 7f67f600b640 1 -- start start 2024-04-26T23:46:39.586 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:39.583+0000 7f67f600b640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f67e80dbce0 0x7f67e80474a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:39.586 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:39.583+0000 7f67f600b640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f67e80df180 0x7f67e8006ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:39.586 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:39.583+0000 7f67f600b640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f67e800bb50 con 0x7f67e80073e0 2024-04-26T23:46:39.586 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:39.583+0000 7f67f600b640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f67e800a420 con 0x7f67e80df180 2024-04-26T23:46:39.586 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:39.583+0000 7f67f600b640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f67e8048060 con 0x7f67e80dbce0 2024-04-26T23:46:39.587 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:39.583+0000 7f67f5009640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f67e80dbce0 0x7f67e80474a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:39.587 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:39.583+0000 7f67f5009640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f67e80dbce0 0x7f67e80474a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.88:36356/0 (socket says 172.21.15.88:36356) 2024-04-26T23:46:39.587 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:39.583+0000 7f67f5009640 1 -- 172.21.15.88:0/2223142993 learned_addr learned my addr 172.21.15.88:0/2223142993 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:46:39.587 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:39.583+0000 7f67f5009640 1 -- 172.21.15.88:0/2223142993 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f67e80dbce0 msgr2=0x7f67e80474a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-26T23:46:39.587 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:39.583+0000 7f67f5009640 1 -- 172.21.15.88:0/2223142993 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f67e80dbce0 msgr2=0x7f67e80474a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T23:46:39.587 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:39.583+0000 7f67f5009640 1 --2- 172.21.15.88:0/2223142993 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f67e80dbce0 0x7f67e80474a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:46:39.587 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:39.583+0000 7f67f5009640 1 --2- 172.21.15.88:0/2223142993 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f67e80dbce0 0x7f67e80474a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:46:39.587 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:39.584+0000 7f67f4808640 1 --2- 172.21.15.88:0/2223142993 >> v2:172.21.15.175:3300/0 conn(0x7f67e80df180 0x7f67e8006ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:39.595 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:39.591+0000 7f67f4808640 1 -- 172.21.15.88:0/2223142993 >> v2:172.21.15.175:3300/0 conn(0x7f67e80df180 msgr2=0x7f67e8006ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-26T23:46:39.595 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:39.591+0000 7f67f4808640 1 -- 172.21.15.88:0/2223142993 >> v2:172.21.15.175:3300/0 conn(0x7f67e80df180 msgr2=0x7f67e8006ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T23:46:39.595 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:39.591+0000 7f67f4808640 1 --2- 172.21.15.88:0/2223142993 >> v2:172.21.15.175:3300/0 conn(0x7f67e80df180 0x7f67e8006ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:46:39.595 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:39.591+0000 7f67f4808640 1 --2- 172.21.15.88:0/2223142993 >> v2:172.21.15.175:3300/0 conn(0x7f67e80df180 0x7f67e8006ea0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:46:39.788 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:39.784+0000 7f67f5009640 1 --2- 172.21.15.88:0/2223142993 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f67e80dbce0 0x7f67e80474a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:39.789 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:39.784+0000 7f67f5009640 1 -- 172.21.15.88:0/2223142993 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f67e80dbce0 msgr2=0x7f67e80474a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-26T23:46:39.789 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:39.784+0000 7f67f5009640 1 -- 172.21.15.88:0/2223142993 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f67e80dbce0 msgr2=0x7f67e80474a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T23:46:39.789 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:39.784+0000 7f67f5009640 1 --2- 172.21.15.88:0/2223142993 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f67e80dbce0 0x7f67e80474a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:46:39.789 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:39.784+0000 7f67f5009640 1 --2- 172.21.15.88:0/2223142993 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f67e80dbce0 0x7f67e80474a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-26T23:46:39.796 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:39.792+0000 7f67f4808640 1 --2- 172.21.15.88:0/2223142993 >> v2:172.21.15.175:3300/0 conn(0x7f67e80df180 0x7f67e8006ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:39.796 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:39.792+0000 7f67f4808640 1 -- 172.21.15.88:0/2223142993 >> v2:172.21.15.175:3300/0 conn(0x7f67e80df180 msgr2=0x7f67e8006ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-26T23:46:39.797 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:39.792+0000 7f67f4808640 1 -- 172.21.15.88:0/2223142993 >> v2:172.21.15.175:3300/0 conn(0x7f67e80df180 msgr2=0x7f67e8006ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T23:46:39.797 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:39.792+0000 7f67f4808640 1 --2- 172.21.15.88:0/2223142993 >> v2:172.21.15.175:3300/0 conn(0x7f67e80df180 0x7f67e8006ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:46:39.797 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:39.792+0000 7f67f4808640 1 --2- 172.21.15.88:0/2223142993 >> v2:172.21.15.175:3300/0 conn(0x7f67e80df180 0x7f67e8006ea0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-26T23:46:40.188 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:40.185+0000 7f67f5009640 1 --2- 172.21.15.88:0/2223142993 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f67e80dbce0 0x7f67e80474a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:40.189 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:40.185+0000 7f67f5009640 1 -- 172.21.15.88:0/2223142993 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f67e80dbce0 msgr2=0x7f67e80474a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-26T23:46:40.189 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:40.185+0000 7f67f5009640 1 -- 172.21.15.88:0/2223142993 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f67e80dbce0 msgr2=0x7f67e80474a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T23:46:40.189 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:40.185+0000 7f67f5009640 1 --2- 172.21.15.88:0/2223142993 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f67e80dbce0 0x7f67e80474a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:46:40.189 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:40.185+0000 7f67f5009640 1 --2- 172.21.15.88:0/2223142993 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f67e80dbce0 0x7f67e80474a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-26T23:46:40.196 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:40.193+0000 7f67f4808640 1 --2- 172.21.15.88:0/2223142993 >> v2:172.21.15.175:3300/0 conn(0x7f67e80df180 0x7f67e8006ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:40.196 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:40.193+0000 7f67f4808640 1 -- 172.21.15.88:0/2223142993 >> v2:172.21.15.175:3300/0 conn(0x7f67e80df180 msgr2=0x7f67e8006ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-26T23:46:40.196 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:40.193+0000 7f67f4808640 1 -- 172.21.15.88:0/2223142993 >> v2:172.21.15.175:3300/0 conn(0x7f67e80df180 msgr2=0x7f67e8006ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T23:46:40.197 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:40.193+0000 7f67f4808640 1 --2- 172.21.15.88:0/2223142993 >> v2:172.21.15.175:3300/0 conn(0x7f67e80df180 0x7f67e8006ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:46:40.197 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:40.193+0000 7f67f4808640 1 --2- 172.21.15.88:0/2223142993 >> v2:172.21.15.175:3300/0 conn(0x7f67e80df180 0x7f67e8006ea0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-26T23:46:40.990 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:40.987+0000 7f67f5009640 1 --2- 172.21.15.88:0/2223142993 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f67e80dbce0 0x7f67e80474a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:40.991 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:40.988+0000 7f67f5009640 1 -- 172.21.15.88:0/2223142993 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f67e80dbce0 msgr2=0x7f67e80474a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-26T23:46:40.992 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:40.988+0000 7f67f5009640 1 -- 172.21.15.88:0/2223142993 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f67e80dbce0 msgr2=0x7f67e80474a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T23:46:40.992 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:40.988+0000 7f67f5009640 1 --2- 172.21.15.88:0/2223142993 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f67e80dbce0 0x7f67e80474a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:46:40.992 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:40.988+0000 7f67f5009640 1 --2- 172.21.15.88:0/2223142993 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f67e80dbce0 0x7f67e80474a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-26T23:46:40.997 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:40.994+0000 7f67f4808640 1 --2- 172.21.15.88:0/2223142993 >> v2:172.21.15.175:3300/0 conn(0x7f67e80df180 0x7f67e8006ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:40.997 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:40.994+0000 7f67f4808640 1 -- 172.21.15.88:0/2223142993 >> v2:172.21.15.175:3300/0 conn(0x7f67e80df180 msgr2=0x7f67e8006ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-26T23:46:40.997 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:40.994+0000 7f67f4808640 1 -- 172.21.15.88:0/2223142993 >> v2:172.21.15.175:3300/0 conn(0x7f67e80df180 msgr2=0x7f67e8006ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T23:46:40.997 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:40.994+0000 7f67f4808640 1 --2- 172.21.15.88:0/2223142993 >> v2:172.21.15.175:3300/0 conn(0x7f67e80df180 0x7f67e8006ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:46:40.997 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:40.994+0000 7f67f4808640 1 --2- 172.21.15.88:0/2223142993 >> v2:172.21.15.175:3300/0 conn(0x7f67e80df180 0x7f67e8006ea0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-26T23:46:42.587 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:42.583+0000 7f67e6ffd640 1 -- 172.21.15.88:0/2223142993 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f67e80dbce0 msgr2=0x7f67e80474a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T23:46:42.587 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:42.583+0000 7f67e6ffd640 1 --2- 172.21.15.88:0/2223142993 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f67e80dbce0 0x7f67e80474a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:42.587 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:42.583+0000 7f67e6ffd640 1 -- 172.21.15.88:0/2223142993 >> v2:172.21.15.175:3300/0 conn(0x7f67e80df180 msgr2=0x7f67e8006ea0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T23:46:42.587 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:42.583+0000 7f67e6ffd640 1 --2- 172.21.15.88:0/2223142993 >> v2:172.21.15.175:3300/0 conn(0x7f67e80df180 0x7f67e8006ea0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:42.587 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:42.583+0000 7f67e6ffd640 1 -- 172.21.15.88:0/2223142993 >> v1:172.21.15.175:6789/0 conn(0x7f67e80073e0 legacy=0x7f67e800a8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:42.587 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:42.583+0000 7f67e6ffd640 1 --2- 172.21.15.88:0/2223142993 >> v2:172.21.15.88:3300/0 conn(0x7f67d4007350 0x7f67d4009810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:42.587 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:42.583+0000 7f67e6ffd640 1 -- 172.21.15.88:0/2223142993 --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f67e800a0f0 con 0x7f67d40036a0 2024-04-26T23:46:42.587 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:42.583+0000 7f67e6ffd640 1 -- 172.21.15.88:0/2223142993 --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f67e800a420 con 0x7f67d4007350 2024-04-26T23:46:42.588 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:42.583+0000 7f67f5009640 1 -- 172.21.15.88:0/2223142993 >> v1:172.21.15.88:6789/0 conn(0x7f67d40036a0 legacy=0x7f67d4005b20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.88:6789/0 2024-04-26T23:46:42.588 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:42.583+0000 7f67f4808640 1 -- 172.21.15.88:0/2223142993 >> v2:172.21.15.88:3300/0 conn(0x7f67d4007350 msgr2=0x7f67d4009810 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.88:3300/0 2024-04-26T23:46:42.588 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:42.583+0000 7f67f4808640 1 --2- 172.21.15.88:0/2223142993 >> v2:172.21.15.88:3300/0 conn(0x7f67d4007350 0x7f67d4009810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:46:42.787 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:42.784+0000 7f67f5009640 1 -- 172.21.15.88:0/2223142993 >> v1:172.21.15.88:6789/0 conn(0x7f67d40036a0 legacy=0x7f67d4005b20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.88:6789/0 2024-04-26T23:46:42.787 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:42.784+0000 7f67f4808640 1 -- 172.21.15.88:0/2223142993 >> v2:172.21.15.88:3300/0 conn(0x7f67d4007350 msgr2=0x7f67d4009810 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.88:3300/0 2024-04-26T23:46:42.787 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:42.784+0000 7f67f4808640 1 --2- 172.21.15.88:0/2223142993 >> v2:172.21.15.88:3300/0 conn(0x7f67d4007350 0x7f67d4009810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-26T23:46:43.188 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:43.185+0000 7f67f4808640 1 -- 172.21.15.88:0/2223142993 >> v2:172.21.15.88:3300/0 conn(0x7f67d4007350 msgr2=0x7f67d4009810 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.88:3300/0 2024-04-26T23:46:43.188 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:43.185+0000 7f67f5009640 1 -- 172.21.15.88:0/2223142993 >> v1:172.21.15.88:6789/0 conn(0x7f67d40036a0 legacy=0x7f67d4005b20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.88:6789/0 2024-04-26T23:46:43.188 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:43.185+0000 7f67f4808640 1 --2- 172.21.15.88:0/2223142993 >> v2:172.21.15.88:3300/0 conn(0x7f67d4007350 0x7f67d4009810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-26T23:46:43.989 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:43.986+0000 7f67f4808640 1 -- 172.21.15.88:0/2223142993 >> v2:172.21.15.88:3300/0 conn(0x7f67d4007350 msgr2=0x7f67d4009810 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.88:3300/0 2024-04-26T23:46:43.989 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:43.986+0000 7f67f5009640 1 -- 172.21.15.88:0/2223142993 >> v1:172.21.15.88:6789/0 conn(0x7f67d40036a0 legacy=0x7f67d4005b20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.88:6789/0 2024-04-26T23:46:43.989 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:43.986+0000 7f67f4808640 1 --2- 172.21.15.88:0/2223142993 >> v2:172.21.15.88:3300/0 conn(0x7f67d4007350 0x7f67d4009810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-26T23:46:45.587 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:45.583+0000 7f67e6ffd640 1 -- 172.21.15.88:0/2223142993 >> v2:172.21.15.88:3300/0 conn(0x7f67d4007350 msgr2=0x7f67d4009810 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T23:46:45.587 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:45.583+0000 7f67e6ffd640 1 --2- 172.21.15.88:0/2223142993 >> v2:172.21.15.88:3300/0 conn(0x7f67d4007350 0x7f67d4009810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:45.587 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:45.583+0000 7f67e6ffd640 1 -- 172.21.15.88:0/2223142993 >> v1:172.21.15.88:6789/0 conn(0x7f67d40036a0 legacy=0x7f67d4005b20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T23:46:45.587 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:45.583+0000 7f67f580a640 1 -- 172.21.15.88:0/2223142993 reap_dead start 2024-04-26T23:46:45.588 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:45.583+0000 7f67e6ffd640 1 --2- 172.21.15.88:0/2223142993 >> v2:172.21.15.88:3300/0 conn(0x7f67d40036a0 0x7f67d4009810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:45.588 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:45.583+0000 7f67f5009640 1 -- 172.21.15.88:0/2223142993 >> v2:172.21.15.88:3300/0 conn(0x7f67d40036a0 msgr2=0x7f67d4009810 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.88:3300/0 2024-04-26T23:46:45.588 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:45.583+0000 7f67f5009640 1 --2- 172.21.15.88:0/2223142993 >> v2:172.21.15.88:3300/0 conn(0x7f67d40036a0 0x7f67d4009810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:46:45.588 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:45.583+0000 7f67e6ffd640 1 --2- 172.21.15.88:0/2223142993 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f67d4009e10 0x7f67d400a230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:45.588 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:45.583+0000 7f67e6ffd640 1 --2- 172.21.15.88:0/2223142993 >> v2:172.21.15.175:3300/0 conn(0x7f67d400a8b0 0x7f67d4005b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:45.588 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:45.584+0000 7f67e6ffd640 1 -- 172.21.15.88:0/2223142993 --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f67e800a420 con 0x7f67d40036a0 2024-04-26T23:46:45.588 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:45.584+0000 7f67e6ffd640 1 -- 172.21.15.88:0/2223142993 --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f67e8048060 con 0x7f67d400a8b0 2024-04-26T23:46:45.588 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:45.584+0000 7f67e6ffd640 1 -- 172.21.15.88:0/2223142993 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f67d4006170 con 0x7f67d4009e10 2024-04-26T23:46:45.588 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:45.584+0000 7f67f580a640 1 --2- 172.21.15.88:0/2223142993 >> v2:172.21.15.175:3300/0 conn(0x7f67d400a8b0 0x7f67d4005b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:45.589 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:45.584+0000 7f67f580a640 1 -- 172.21.15.88:0/2223142993 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f67d4009e10 msgr2=0x7f67d400a230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:46:45.589 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:45.584+0000 7f67f580a640 1 --2- 172.21.15.88:0/2223142993 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f67d4009e10 0x7f67d400a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:45.589 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:45.584+0000 7f67f580a640 1 -- 172.21.15.88:0/2223142993 >> v2:172.21.15.88:3300/0 conn(0x7f67d40036a0 msgr2=0x7f67d4009810 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T23:46:45.589 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:45.584+0000 7f67f580a640 1 --2- 172.21.15.88:0/2223142993 >> v2:172.21.15.88:3300/0 conn(0x7f67d40036a0 0x7f67d4009810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:45.589 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:45.584+0000 7f67f580a640 1 -- 172.21.15.88:0/2223142993 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67d400af80 con 0x7f67d400a8b0 2024-04-26T23:46:45.589 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:45.585+0000 7f67f580a640 1 --2- 172.21.15.88:0/2223142993 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f67d400a8b0 0x7f67d4005b20 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f67f006acf0 tx=0x7f67f00a70f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a1ca48d0c7be70ea server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:45.589 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:45.586+0000 7f67e7fff640 1 -- 172.21.15.88:0/2223142993 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67f00b4070 con 0x7f67d400a8b0 2024-04-26T23:46:45.590 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:45.586+0000 7f67e7fff640 1 -- 172.21.15.88:0/2223142993 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67f00af440 con 0x7f67d400a8b0 2024-04-26T23:46:45.591 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:45.586+0000 7f67e7fff640 1 -- 172.21.15.88:0/2223142993 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67f00af7f0 con 0x7f67d400a8b0 2024-04-26T23:46:45.591 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:45.587+0000 7f67f600b640 1 -- 172.21.15.88:0/2223142993 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f67d400a8b0 msgr2=0x7f67d4005b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:45.591 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:45.587+0000 7f67f600b640 1 --2- 172.21.15.88:0/2223142993 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f67d400a8b0 0x7f67d4005b20 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f67f006acf0 tx=0x7f67f00a70f0 comp rx=0 tx=0).stop 2024-04-26T23:46:45.591 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:45.587+0000 7f67f600b640 1 -- 172.21.15.88:0/2223142993 shutdown_connections 2024-04-26T23:46:45.591 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:45.587+0000 7f67f600b640 1 --2- 172.21.15.88:0/2223142993 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f67d400a8b0 0x7f67d4005b20 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:45.591 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:45.587+0000 7f67f600b640 1 --2- 172.21.15.88:0/2223142993 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f67d4009e10 0x7f67d400a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:45.591 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:45.587+0000 7f67f600b640 1 --2- 172.21.15.88:0/2223142993 >> v2:172.21.15.88:3300/0 conn(0x7f67d40036a0 0x7f67d4009810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:45.591 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:45.587+0000 7f67f600b640 1 -- 172.21.15.88:0/2223142993 >> 172.21.15.88:0/2223142993 conn(0x7f67e8048250 msgr2=0x7f67e8048660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:45.592 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:45.588+0000 7f67f600b640 1 -- 172.21.15.88:0/2223142993 shutdown_connections 2024-04-26T23:46:45.592 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:45.588+0000 7f67f600b640 1 -- 172.21.15.88:0/2223142993 wait complete. 2024-04-26T23:46:45.594 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:45.591+0000 7f67f600b640 1 Processor -- start 2024-04-26T23:46:45.594 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:45.591+0000 7f67f600b640 1 -- start start 2024-04-26T23:46:45.595 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:45.592+0000 7f67f600b640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f67d40036a0 0x7f67e8174de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:45.596 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:45.592+0000 7f67f600b640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f67d4009e10 0x7f67e803f520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:45.596 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:45.593+0000 7f67f4808640 1 -- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f67d4009e10 msgr2=0x7f67e803f520 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.88:3300/0 2024-04-26T23:46:45.596 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:45.593+0000 7f67f4808640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f67d4009e10 0x7f67e803f520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:46:45.596 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:45.593+0000 7f67f600b640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f67d400a8b0 0x7f67e8043eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:45.596 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:45.593+0000 7f67f600b640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f67e8047a00 con 0x7f67d4009e10 2024-04-26T23:46:45.597 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:45.593+0000 7f67f600b640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f67e80dc0c0 con 0x7f67d40036a0 2024-04-26T23:46:45.597 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:45.593+0000 7f67f580a640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f67d400a8b0 0x7f67e8043eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:45.597 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:45.593+0000 7f67f580a640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f67d400a8b0 0x7f67e8043eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.88:36422/0 (socket says 172.21.15.88:36422) 2024-04-26T23:46:45.597 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:45.593+0000 7f67f580a640 1 -- 172.21.15.88:0/3868734286 learned_addr learned my addr 172.21.15.88:0/3868734286 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:46:45.597 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:45.594+0000 7f67f600b640 1 -- 172.21.15.88:0/3868734286 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f67e80df5c0 con 0x7f67d400a8b0 2024-04-26T23:46:45.599 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:45.594+0000 7f67f580a640 1 -- 172.21.15.88:0/3868734286 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f67d40036a0 msgr2=0x7f67e8174de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:45.599 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:45.594+0000 7f67f580a640 1 --2- 172.21.15.88:0/3868734286 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f67d40036a0 0x7f67e8174de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:45.599 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:45.594+0000 7f67f580a640 1 -- 172.21.15.88:0/3868734286 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f67d4009e10 msgr2=0x7f67e803f520 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T23:46:45.599 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:45.594+0000 7f67f580a640 1 --2- 172.21.15.88:0/3868734286 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f67d4009e10 0x7f67e803f520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:45.599 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:45.594+0000 7f67f580a640 1 -- 172.21.15.88:0/3868734286 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67e80da4a0 con 0x7f67d400a8b0 2024-04-26T23:46:45.599 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:45.595+0000 7f67f580a640 1 --2- 172.21.15.88:0/3868734286 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f67d400a8b0 0x7f67e8043eb0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f67f0069b60 tx=0x7f67f006b850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:45.603 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:45.596+0000 7f67e5ffb640 1 -- 172.21.15.88:0/3868734286 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67f00b4070 con 0x7f67d400a8b0 2024-04-26T23:46:45.603 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:45.596+0000 7f67f600b640 1 -- 172.21.15.88:0/3868734286 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67e80d9c00 con 0x7f67d400a8b0 2024-04-26T23:46:45.603 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:45.597+0000 7f67f600b640 1 -- 172.21.15.88:0/3868734286 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f67e80da1c0 con 0x7f67d400a8b0 2024-04-26T23:46:45.603 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:45.598+0000 7f67e5ffb640 1 -- 172.21.15.88:0/3868734286 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67f00c1070 con 0x7f67d400a8b0 2024-04-26T23:46:45.603 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:45.599+0000 7f67e5ffb640 1 -- 172.21.15.88:0/3868734286 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67f00bbb50 con 0x7f67d400a8b0 2024-04-26T23:46:45.603 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:45.600+0000 7f67db7fe640 1 -- 172.21.15.88:0/3868734286 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f67d0005290 con 0x7f67d400a8b0 2024-04-26T23:46:45.606 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:45.602+0000 7f67e5ffb640 1 -- 172.21.15.88:0/3868734286 <== mon.2 v2:172.21.15.175:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f67f00bbcf0 con 0x7f67d400a8b0 2024-04-26T23:46:45.606 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:45.603+0000 7f67e5ffb640 1 --2- 172.21.15.88:0/3868734286 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f67d406de90 0x7f67d4070350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:45.606 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:45.603+0000 7f67e5ffb640 1 -- 172.21.15.88:0/3868734286 <== mon.2 v2:172.21.15.175:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6666+0+0 (secure 0 0 0) 0x7f67f0129e40 con 0x7f67d400a8b0 2024-04-26T23:46:45.607 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:45.604+0000 7f67f5009640 1 --2- 172.21.15.88:0/3868734286 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f67d406de90 0x7f67d4070350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:45.608 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:45.605+0000 7f67f5009640 1 --2- 172.21.15.88:0/3868734286 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f67d406de90 0x7f67d4070350 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f67ec009100 tx=0x7f67ec010370 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:45.614 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:45.611+0000 7f67e5ffb640 1 -- 172.21.15.88:0/3868734286 <== mon.2 v2:172.21.15.175:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f67f00ae3a0 con 0x7f67d400a8b0 2024-04-26T23:46:46.152 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:46.148+0000 7f67db7fe640 1 -- 172.21.15.88:0/3868734286 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f67d0005580 con 0x7f67d400a8b0 2024-04-26T23:46:46.154 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:46.150+0000 7f67e5ffb640 1 -- 172.21.15.88:0/3868734286 <== mon.2 v2:172.21.15.175:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1558 (secure 0 0 0) 0x7f67f00f7e90 con 0x7f67d400a8b0 2024-04-26T23:46:46.154 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":62,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":3,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"555255e9-7ef9-4454-8dc9-35e96b70035c","modified":"2024-04-26T23:39:34.291658Z","created":"2024-04-26T23:39:34.291658Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:3300","nonce":0},{"type":"v1","addr":"172.21.15.175:6789","nonce":0}]},"addr":"172.21.15.175:6789/0","public_addr":"172.21.15.175:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:3301","nonce":0},{"type":"v1","addr":"172.21.15.175:6790","nonce":0}]},"addr":"172.21.15.175:6790/0","public_addr":"172.21.15.175:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-04-26T23:46:46.157 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:46.154+0000 7f67db7fe640 1 -- 172.21.15.88:0/3868734286 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f67d406de90 msgr2=0x7f67d4070350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:46.157 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:46.154+0000 7f67db7fe640 1 --2- 172.21.15.88:0/3868734286 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f67d406de90 0x7f67d4070350 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f67ec009100 tx=0x7f67ec010370 comp rx=0 tx=0).stop 2024-04-26T23:46:46.157 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:46.154+0000 7f67db7fe640 1 -- 172.21.15.88:0/3868734286 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f67d400a8b0 msgr2=0x7f67e8043eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:46.157 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:46.154+0000 7f67db7fe640 1 --2- 172.21.15.88:0/3868734286 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f67d400a8b0 0x7f67e8043eb0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f67f0069b60 tx=0x7f67f006b850 comp rx=0 tx=0).stop 2024-04-26T23:46:46.157 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:46.154+0000 7f67db7fe640 1 -- 172.21.15.88:0/3868734286 shutdown_connections 2024-04-26T23:46:46.157 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:46.154+0000 7f67db7fe640 1 --2- 172.21.15.88:0/3868734286 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f67d406de90 0x7f67d4070350 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:46.157 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:46.154+0000 7f67db7fe640 1 --2- 172.21.15.88:0/3868734286 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f67d400a8b0 0x7f67e8043eb0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:46.157 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:46.154+0000 7f67db7fe640 1 --2- 172.21.15.88:0/3868734286 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f67d4009e10 0x7f67e803f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:46.157 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:46.154+0000 7f67db7fe640 1 --2- 172.21.15.88:0/3868734286 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f67d40036a0 0x7f67e8174de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:46.158 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:46.154+0000 7f67db7fe640 1 -- 172.21.15.88:0/3868734286 >> 172.21.15.88:0/3868734286 conn(0x7f67e8048250 msgr2=0x7f67e800a7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:46.158 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:46.155+0000 7f67db7fe640 1 -- 172.21.15.88:0/3868734286 shutdown_connections 2024-04-26T23:46:46.160 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:46.157+0000 7f67db7fe640 1 -- 172.21.15.88:0/3868734286 wait complete. 2024-04-26T23:46:46.180 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2024-04-26T23:46:46.181 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon b 2024-04-26T23:46:46.181 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-04-26T23:46:46.396 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:46.391+0000 7f201640f640 1 Processor -- start 2024-04-26T23:46:46.396 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:46.391+0000 7f201640f640 1 -- start start 2024-04-26T23:46:46.396 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:46.393+0000 7f201640f640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f20100ab380 0x7f2010152cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:46.397 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:46.393+0000 7f201640f640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f20100c3e00 con 0x7f20100c4c90 2024-04-26T23:46:46.397 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:46.393+0000 7f201640f640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f20100c40e0 con 0x7f2010150300 2024-04-26T23:46:46.397 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:46.393+0000 7f201640f640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f201006e3d0 con 0x7f20100ab380 2024-04-26T23:46:46.397 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:46.393+0000 7f20149ac640 1 -- >> v1:172.21.15.88:6789/0 conn(0x7f20100c4c90 legacy=0x7f201006eb40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.88:6789/0 2024-04-26T23:46:46.397 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:46.394+0000 7f200ffff640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f2010150300 0x7f20100c3640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.88:36358/0 (socket says 172.21.15.88:36358) 2024-04-26T23:46:46.397 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:46.394+0000 7f200ffff640 1 -- 172.21.15.88:0/3065233086 learned_addr learned my addr 172.21.15.88:0/3065233086 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-26T23:46:46.399 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:46.394+0000 7f200f7fe640 1 --2- 172.21.15.88:0/3065233086 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f20100ab380 0x7f2010152cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:46.399 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:46.395+0000 7f200f7fe640 1 -- 172.21.15.88:0/3065233086 >> v1:172.21.15.175:6789/0 conn(0x7f2010150300 legacy=0x7f20100c3640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:46.399 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:46.395+0000 7f200f7fe640 1 -- 172.21.15.88:0/3065233086 >> v1:172.21.15.88:6789/0 conn(0x7f20100c4c90 legacy=0x7f201006eb40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T23:46:46.399 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:46.395+0000 7f200f7fe640 1 -- 172.21.15.88:0/3065233086 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20100c43c0 con 0x7f20100ab380 2024-04-26T23:46:46.400 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:46.397+0000 7f200f7fe640 1 --2- 172.21.15.88:0/3065233086 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f20100ab380 0x7f2010152cf0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f20000097d0 tx=0x7f200002a1e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=310346dfd837d253 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:46.403 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:46.399+0000 7f200effd640 1 -- 172.21.15.88:0/3065233086 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2000037070 con 0x7f20100ab380 2024-04-26T23:46:46.403 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:46.399+0000 7f200effd640 1 -- 172.21.15.88:0/3065233086 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2000032440 con 0x7f20100ab380 2024-04-26T23:46:46.403 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:46.399+0000 7f200effd640 1 -- 172.21.15.88:0/3065233086 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2000032850 con 0x7f20100ab380 2024-04-26T23:46:46.407 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:46.401+0000 7f201640f640 1 -- 172.21.15.88:0/3065233086 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f20100ab380 msgr2=0x7f2010152cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:46.407 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:46.401+0000 7f201640f640 1 --2- 172.21.15.88:0/3065233086 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f20100ab380 0x7f2010152cf0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f20000097d0 tx=0x7f200002a1e0 comp rx=0 tx=0).stop 2024-04-26T23:46:46.407 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:46.401+0000 7f201640f640 1 -- 172.21.15.88:0/3065233086 shutdown_connections 2024-04-26T23:46:46.407 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:46.401+0000 7f201640f640 1 --2- 172.21.15.88:0/3065233086 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f20100ab380 0x7f2010152cf0 secure :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f20000097d0 tx=0x7f200002a1e0 comp rx=0 tx=0).stop 2024-04-26T23:46:46.407 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:46.401+0000 7f201640f640 1 -- 172.21.15.88:0/3065233086 >> 172.21.15.88:0/3065233086 conn(0x7f201006c310 msgr2=0x7f201006c6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:46.407 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:46.403+0000 7f201640f640 1 -- 172.21.15.88:0/3065233086 shutdown_connections 2024-04-26T23:46:46.407 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:46.403+0000 7f201640f640 1 -- 172.21.15.88:0/3065233086 wait complete. 2024-04-26T23:46:46.408 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:46.405+0000 7f201640f640 1 Processor -- start 2024-04-26T23:46:46.411 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:46.408+0000 7f201640f640 1 -- start start 2024-04-26T23:46:46.412 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:46.409+0000 7f201640f640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f20100c4c90 0x7f2010161030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:46.415 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:46.412+0000 7f201640f640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2010150300 0x7f20101f1480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:46.416 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:46.412+0000 7f201640f640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f20101f4d70 0x7f20101f19c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:46.416 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:46.412+0000 7f201640f640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f201006f250 con 0x7f20101f4d70 2024-04-26T23:46:46.416 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:46.412+0000 7f201640f640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f201006e6b0 con 0x7f20100c4c90 2024-04-26T23:46:46.416 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:46.412+0000 7f20149ac640 1 -- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f20101f4d70 msgr2=0x7f20101f19c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.88:3300/0 2024-04-26T23:46:46.416 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:46.412+0000 7f20149ac640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f20101f4d70 0x7f20101f19c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:46:46.416 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:46.412+0000 7f201640f640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f201006f3d0 con 0x7f2010150300 2024-04-26T23:46:46.417 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:46.414+0000 7f200f7fe640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2010150300 0x7f20101f1480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:46.417 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:46.414+0000 7f200f7fe640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2010150300 0x7f20101f1480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.88:36444/0 (socket says 172.21.15.88:36444) 2024-04-26T23:46:46.417 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:46.414+0000 7f200f7fe640 1 -- 172.21.15.88:0/1132764782 learned_addr learned my addr 172.21.15.88:0/1132764782 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:46:46.418 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:46.414+0000 7f200f7fe640 1 -- 172.21.15.88:0/1132764782 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f20100c4c90 msgr2=0x7f2010161030 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T23:46:46.418 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:46.414+0000 7f200f7fe640 1 --2- 172.21.15.88:0/1132764782 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f20100c4c90 0x7f2010161030 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:46.418 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:46.414+0000 7f200f7fe640 1 -- 172.21.15.88:0/1132764782 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f20101f4d70 msgr2=0x7f20101f19c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T23:46:46.418 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:46.414+0000 7f200f7fe640 1 --2- 172.21.15.88:0/1132764782 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f20101f4d70 0x7f20101f19c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:46.418 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:46.414+0000 7f200f7fe640 1 -- 172.21.15.88:0/1132764782 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20101f5260 con 0x7f2010150300 2024-04-26T23:46:46.418 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:46.415+0000 7f200f7fe640 1 --2- 172.21.15.88:0/1132764782 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2010150300 0x7f20101f1480 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f2000009720 tx=0x7f20000046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:46.419 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:46.415+0000 7f200cff9640 1 -- 172.21.15.88:0/1132764782 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2000037050 con 0x7f2010150300 2024-04-26T23:46:46.419 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:46.415+0000 7f201640f640 1 -- 172.21.15.88:0/1132764782 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20100722b0 con 0x7f2010150300 2024-04-26T23:46:46.419 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:46.415+0000 7f201640f640 1 -- 172.21.15.88:0/1132764782 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f2010071fd0 con 0x7f2010150300 2024-04-26T23:46:46.420 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:46.417+0000 7f200cff9640 1 -- 172.21.15.88:0/1132764782 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2000043070 con 0x7f2010150300 2024-04-26T23:46:46.420 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:46.417+0000 7f201640f640 1 --2- 172.21.15.88:0/1132764782 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2010068a70 0x7f20101454a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:46.420 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:46.417+0000 7f201640f640 1 -- 172.21.15.88:0/1132764782 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f201006c900 con 0x7f2010068a70 2024-04-26T23:46:46.420 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:46.417+0000 7f200cff9640 1 -- 172.21.15.88:0/1132764782 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2000030e00 con 0x7f2010150300 2024-04-26T23:46:46.422 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:46.418+0000 7f200ffff640 1 --2- 172.21.15.88:0/1132764782 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2010068a70 0x7f20101454a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:46.425 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:46.420+0000 7f200ffff640 1 -- 172.21.15.88:0/1132764782 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f20100ab160 con 0x7f2010068a70 2024-04-26T23:46:46.425 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:46.420+0000 7f200cff9640 1 -- 172.21.15.88:0/1132764782 <== mon.2 v2:172.21.15.175:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2000048460 con 0x7f2010150300 2024-04-26T23:46:46.425 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:46.420+0000 7f200ffff640 1 --2- 172.21.15.88:0/1132764782 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2010068a70 0x7f20101454a0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f20080016a0 tx=0x7f2008001b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:46.425 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:46.420+0000 7f200cff9640 1 --2- 172.21.15.88:0/1132764782 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f1ffc06c8d0 0x7f1ffc06ed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:46.425 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:46.421+0000 7f20149ac640 1 --2- 172.21.15.88:0/1132764782 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f1ffc06c8d0 0x7f1ffc06ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:46.433 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:46.422+0000 7f20149ac640 1 --2- 172.21.15.88:0/1132764782 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f1ffc06c8d0 0x7f1ffc06ed90 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f2004003980 tx=0x7f2004006cb0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:46.433 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:46.422+0000 7f200cff9640 1 -- 172.21.15.88:0/1132764782 <== mon.2 v2:172.21.15.175:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6666+0+0 (secure 0 0 0) 0x7f20000acc80 con 0x7f2010150300 2024-04-26T23:46:46.433 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:46.422+0000 7f200cff9640 1 -- 172.21.15.88:0/1132764782 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2008018070 con 0x7f2010068a70 2024-04-26T23:46:46.433 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:46.422+0000 7f200cff9640 1 -- 172.21.15.88:0/1132764782 <== mon.1 v2:172.21.15.175:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f20080064c0 con 0x7f2010068a70 2024-04-26T23:46:46.433 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:46.422+0000 7f200cff9640 1 -- 172.21.15.88:0/1132764782 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2010068a70 msgr2=0x7f20101454a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:46.433 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:46.422+0000 7f200cff9640 1 --2- 172.21.15.88:0/1132764782 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2010068a70 0x7f20101454a0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f20080016a0 tx=0x7f2008001b60 comp rx=0 tx=0).stop 2024-04-26T23:46:46.433 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:46.422+0000 7f200cff9640 1 -- 172.21.15.88:0/1132764782 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2010068a70 msgr2=0x7f20101454a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:46:46.433 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:46.422+0000 7f200cff9640 1 --2- 172.21.15.88:0/1132764782 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2010068a70 0x7f20101454a0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:46.456 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:46.452+0000 7f201640f640 1 --2- 172.21.15.88:0/1132764782 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f20100c7d10 0x7f20101459e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:46.456 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:46.452+0000 7f201640f640 1 -- 172.21.15.88:0/1132764782 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f20101f0e50 con 0x7f20100c7d10 2024-04-26T23:46:46.457 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:46.454+0000 7f200ffff640 1 --2- 172.21.15.88:0/1132764782 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f20100c7d10 0x7f20101459e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:46.461 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:46.457+0000 7f200ffff640 1 -- 172.21.15.88:0/1132764782 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f20100507a0 con 0x7f20100c7d10 2024-04-26T23:46:46.462 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:46.458+0000 7f200ffff640 1 --2- 172.21.15.88:0/1132764782 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f20100c7d10 0x7f20101459e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f20080016a0 tx=0x7f2008000f40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:46.467 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-04-26T23:46:46.467 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2024-04-26T23:46:46.467 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2024-04-26T23:46:46.467 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "leader", 2024-04-26T23:46:46.467 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 62, 2024-04-26T23:46:46.467 INFO:teuthology.orchestra.run.smithi088.stdout: "uptime": 39571, 2024-04-26T23:46:46.467 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2024-04-26T23:46:46.467 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2024-04-26T23:46:46.467 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2024-04-26T23:46:46.467 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:46:46.468 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 3, 2024-04-26T23:46:46.468 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2024-04-26T23:46:46.468 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2450521708007866372", 2024-04-26T23:46:46.468 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2024-04-26T23:46:46.468 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-04-26T23:46:46.468 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-04-26T23:46:46.468 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-04-26T23:46:46.468 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-04-26T23:46:46.468 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-04-26T23:46:46.468 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-04-26T23:46:46.468 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-04-26T23:46:46.468 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-04-26T23:46:46.468 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-04-26T23:46:46.468 INFO:teuthology.orchestra.run.smithi088.stdout: "reef", 2024-04-26T23:46:46.469 INFO:teuthology.orchestra.run.smithi088.stdout: "squid" 2024-04-26T23:46:46.469 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:46:46.469 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540701547738038271", 2024-04-26T23:46:46.469 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2024-04-26T23:46:46.469 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-04-26T23:46:46.469 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-04-26T23:46:46.469 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-04-26T23:46:46.469 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-04-26T23:46:46.469 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-04-26T23:46:46.469 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-04-26T23:46:46.469 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-04-26T23:46:46.469 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-04-26T23:46:46.469 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-04-26T23:46:46.469 INFO:teuthology.orchestra.run.smithi088.stdout: "reef", 2024-04-26T23:46:46.470 INFO:teuthology.orchestra.run.smithi088.stdout: "squid" 2024-04-26T23:46:46.470 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:46:46.470 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:46:46.470 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2024-04-26T23:46:46.470 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2024-04-26T23:46:46.470 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2024-04-26T23:46:46.470 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2024-04-26T23:46:46.470 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2024-04-26T23:46:46.470 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "555255e9-7ef9-4454-8dc9-35e96b70035c", 2024-04-26T23:46:46.470 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2024-04-26T23:39:34.291658Z", 2024-04-26T23:46:46.470 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2024-04-26T23:39:34.291658Z", 2024-04-26T23:46:46.470 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 19, 2024-04-26T23:46:46.470 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "squid", 2024-04-26T23:46:46.471 INFO:teuthology.orchestra.run.smithi088.stdout: "election_strategy": 1, 2024-04-26T23:46:46.471 INFO:teuthology.orchestra.run.smithi088.stdout: "disallowed_leaders: ": "", 2024-04-26T23:46:46.471 INFO:teuthology.orchestra.run.smithi088.stdout: "stretch_mode": false, 2024-04-26T23:46:46.471 INFO:teuthology.orchestra.run.smithi088.stdout: "tiebreaker_mon": "", 2024-04-26T23:46:46.471 INFO:teuthology.orchestra.run.smithi088.stdout: "removed_ranks: ": "", 2024-04-26T23:46:46.471 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2024-04-26T23:46:46.471 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2024-04-26T23:46:46.471 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-04-26T23:46:46.471 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-04-26T23:46:46.471 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-04-26T23:46:46.471 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-04-26T23:46:46.471 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-04-26T23:46:46.471 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-04-26T23:46:46.471 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-04-26T23:46:46.471 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-04-26T23:46:46.472 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-04-26T23:46:46.472 INFO:teuthology.orchestra.run.smithi088.stdout: "reef", 2024-04-26T23:46:46.472 INFO:teuthology.orchestra.run.smithi088.stdout: "squid" 2024-04-26T23:46:46.472 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:46:46.472 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2024-04-26T23:46:46.472 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:46:46.472 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2024-04-26T23:46:46.472 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:46:46.472 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2024-04-26T23:46:46.472 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2024-04-26T23:46:46.472 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-04-26T23:46:46.472 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-04-26T23:46:46.472 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:46:46.472 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-04-26T23:46:46.472 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2024-04-26T23:46:46.473 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:46:46.473 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:46:46.473 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:46:46.473 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-04-26T23:46:46.473 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2024-04-26T23:46:46.473 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:46:46.473 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:46:46.473 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:46:46.473 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:46:46.473 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2024-04-26T23:46:46.473 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2024-04-26T23:46:46.473 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-04-26T23:46:46.473 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-04-26T23:46:46.473 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-04-26T23:46:46.473 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:46:46.474 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:46:46.474 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2024-04-26T23:46:46.474 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2024-04-26T23:46:46.474 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-04-26T23:46:46.474 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-04-26T23:46:46.474 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:46:46.474 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-04-26T23:46:46.474 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:3300", 2024-04-26T23:46:46.474 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:46:46.474 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:46:46.475 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:46:46.475 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-04-26T23:46:46.475 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6789", 2024-04-26T23:46:46.475 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:46:46.475 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:46:46.475 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:46:46.475 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:46:46.475 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6789/0", 2024-04-26T23:46:46.475 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.175:6789/0", 2024-04-26T23:46:46.475 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-04-26T23:46:46.475 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-04-26T23:46:46.475 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-04-26T23:46:46.475 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:46:46.475 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:46:46.475 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2024-04-26T23:46:46.476 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2024-04-26T23:46:46.476 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-04-26T23:46:46.476 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-04-26T23:46:46.476 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:46:46.476 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-04-26T23:46:46.476 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:3301", 2024-04-26T23:46:46.476 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:46:46.476 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:46:46.476 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:46:46.476 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-04-26T23:46:46.476 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6790", 2024-04-26T23:46:46.476 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:46:46.476 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:46:46.476 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:46:46.476 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:46:46.477 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6790/0", 2024-04-26T23:46:46.477 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.175:6790/0", 2024-04-26T23:46:46.477 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-04-26T23:46:46.477 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-04-26T23:46:46.477 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-04-26T23:46:46.477 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:46:46.477 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:46:46.477 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:46:46.477 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2024-04-26T23:46:46.477 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2024-04-26T23:46:46.477 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:46:46.477 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:46:46.477 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:46:46.477 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2024-04-26T23:46:46.478 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:46:46.478 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:46:46.478 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": [ 2024-04-26T23:46:46.478 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:46:46.478 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:46:46.478 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:46:46.478 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2024-04-26T23:46:46.478 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:46:46.478 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:46:46.478 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2024-04-26T23:46:46.478 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:46:46.478 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:46:46.478 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:46:46.478 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2024-04-26T23:46:46.478 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:46:46.479 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:46:46.479 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": [ 2024-04-26T23:46:46.479 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:46:46.479 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:46:46.479 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:46:46.479 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2024-04-26T23:46:46.479 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:46:46.479 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:46:46.479 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:46:46.479 INFO:teuthology.orchestra.run.smithi088.stdout: "stretch_mode": false 2024-04-26T23:46:46.479 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-04-26T23:46:46.480 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:46.463+0000 7f200cff9640 1 -- 172.21.15.88:0/1132764782 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2008018040 con 0x7f20100c7d10 2024-04-26T23:46:46.480 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:46.463+0000 7f200cff9640 1 -- 172.21.15.88:0/1132764782 <== mon.1 v2:172.21.15.175:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4885 (secure 0 0 0) 0x7f200801b2b0 con 0x7f20100c7d10 2024-04-26T23:46:46.480 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:46.463+0000 7f200cff9640 1 -- 172.21.15.88:0/1132764782 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f20100c7d10 msgr2=0x7f20101459e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:46.480 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:46.463+0000 7f200cff9640 1 --2- 172.21.15.88:0/1132764782 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f20100c7d10 0x7f20101459e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f20080016a0 tx=0x7f2008000f40 comp rx=0 tx=0).stop 2024-04-26T23:46:46.480 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:46.463+0000 7f200cff9640 1 -- 172.21.15.88:0/1132764782 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f20100c7d10 msgr2=0x7f20101459e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:46:46.480 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:46.463+0000 7f200cff9640 1 --2- 172.21.15.88:0/1132764782 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f20100c7d10 0x7f20101459e0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:46.480 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:46.464+0000 7f1ff67fc640 1 -- 172.21.15.88:0/1132764782 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f1ffc06c8d0 msgr2=0x7f1ffc06ed90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:46.481 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:46.464+0000 7f1ff67fc640 1 --2- 172.21.15.88:0/1132764782 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f1ffc06c8d0 0x7f1ffc06ed90 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f2004003980 tx=0x7f2004006cb0 comp rx=0 tx=0).stop 2024-04-26T23:46:46.481 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:46.464+0000 7f20149ac640 1 -- 172.21.15.88:0/1132764782 reap_dead start 2024-04-26T23:46:46.481 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:46.464+0000 7f1ff67fc640 1 -- 172.21.15.88:0/1132764782 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2010150300 msgr2=0x7f20101f1480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:46.481 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:46.464+0000 7f1ff67fc640 1 --2- 172.21.15.88:0/1132764782 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2010150300 0x7f20101f1480 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f2000009720 tx=0x7f20000046c0 comp rx=0 tx=0).stop 2024-04-26T23:46:46.481 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:46.467+0000 7f1ff67fc640 1 -- 172.21.15.88:0/1132764782 shutdown_connections 2024-04-26T23:46:46.481 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:46.467+0000 7f1ff67fc640 1 --2- 172.21.15.88:0/1132764782 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2010150300 0x7f20101f1480 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:46.481 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:46.467+0000 7f1ff67fc640 1 -- 172.21.15.88:0/1132764782 >> 172.21.15.88:0/1132764782 conn(0x7f201006c310 msgr2=0x7f201006eb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:46.481 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:46.468+0000 7f1ff67fc640 1 -- 172.21.15.88:0/1132764782 shutdown_connections 2024-04-26T23:46:46.481 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:46.468+0000 7f1ff67fc640 1 -- 172.21.15.88:0/1132764782 wait complete. 2024-04-26T23:46:46.492 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-04-26T23:46:46.492 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon c 2024-04-26T23:46:46.492 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-04-26T23:46:46.685 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:46.681+0000 7f626b210640 1 Processor -- start 2024-04-26T23:46:46.687 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:46.681+0000 7f626b210640 1 -- start start 2024-04-26T23:46:46.687 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:46.683+0000 7f626b210640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f625c02c020 0x7f625c00b250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:46.687 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:46.683+0000 7f626b210640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f625c0d71f0 0x7f625c0472e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:46.687 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:46.683+0000 7f626b210640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f625c0402a0 con 0x7f625c0d46d0 2024-04-26T23:46:46.687 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:46.683+0000 7f626b210640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f625c04aef0 con 0x7f625c0d71f0 2024-04-26T23:46:46.687 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:46.683+0000 7f626b210640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f625c04ba70 con 0x7f625c02c020 2024-04-26T23:46:46.687 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:46.683+0000 7f626aa0f640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f625c0d71f0 0x7f625c0472e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:46.687 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:46.683+0000 7f626aa0f640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f625c0d71f0 0x7f625c0472e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.88:58560/0 (socket says 172.21.15.88:58560) 2024-04-26T23:46:46.687 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:46.683+0000 7f626aa0f640 1 -- 172.21.15.88:0/3616301170 learned_addr learned my addr 172.21.15.88:0/3616301170 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:46:46.688 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:46.684+0000 7f626aa0f640 1 -- 172.21.15.88:0/3616301170 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f625c02c020 msgr2=0x7f625c00b250 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T23:46:46.688 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:46.684+0000 7f626aa0f640 1 --2- 172.21.15.88:0/3616301170 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f625c02c020 0x7f625c00b250 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:46.688 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:46.684+0000 7f626aa0f640 1 -- 172.21.15.88:0/3616301170 >> v1:172.21.15.175:6789/0 conn(0x7f625c0d46d0 legacy=0x7f625c04bf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:46.688 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:46.684+0000 7f626aa0f640 1 -- 172.21.15.88:0/3616301170 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f625c04c610 con 0x7f625c0d71f0 2024-04-26T23:46:46.693 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:46.690+0000 7f626aa0f640 1 --2- 172.21.15.88:0/3616301170 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f625c0d71f0 0x7f625c0472e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f6264065e50 tx=0x7f62640a8fe0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=61fe79090b80445d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:46.694 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:46.691+0000 7f626920c640 1 -- 172.21.15.88:0/3616301170 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62640a9920 con 0x7f625c0d71f0 2024-04-26T23:46:46.696 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:46.692+0000 7f626920c640 1 -- 172.21.15.88:0/3616301170 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62640a9ac0 con 0x7f625c0d71f0 2024-04-26T23:46:46.696 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:46.693+0000 7f626b210640 1 -- 172.21.15.88:0/3616301170 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f625c0d71f0 msgr2=0x7f625c0472e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:46.696 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:46.693+0000 7f626b210640 1 --2- 172.21.15.88:0/3616301170 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f625c0d71f0 0x7f625c0472e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f6264065e50 tx=0x7f62640a8fe0 comp rx=0 tx=0).stop 2024-04-26T23:46:46.699 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:46.696+0000 7f626b210640 1 -- 172.21.15.88:0/3616301170 shutdown_connections 2024-04-26T23:46:46.699 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:46.696+0000 7f626b210640 1 --2- 172.21.15.88:0/3616301170 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f625c0d71f0 0x7f625c0472e0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:46.699 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:46.696+0000 7f626b210640 1 --2- 172.21.15.88:0/3616301170 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f625c02c020 0x7f625c00b250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:46.699 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:46.696+0000 7f626b210640 1 -- 172.21.15.88:0/3616301170 >> 172.21.15.88:0/3616301170 conn(0x7f625c007b40 msgr2=0x7f625c007f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:46.700 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:46.697+0000 7f626b210640 1 -- 172.21.15.88:0/3616301170 shutdown_connections 2024-04-26T23:46:46.706 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:46.701+0000 7f626b210640 1 -- 172.21.15.88:0/3616301170 wait complete. 2024-04-26T23:46:46.706 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:46.703+0000 7f626b210640 1 Processor -- start 2024-04-26T23:46:46.712 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:46.703+0000 7f626b210640 1 -- start start 2024-04-26T23:46:46.712 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:46.704+0000 7f626b210640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f625c02c020 0x7f625c0ce8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:46.712 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:46.704+0000 7f626b210640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f625c0d46d0 0x7f625c0301a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:46.712 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:46.704+0000 7f626b210640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f625c0d71f0 0x7f625c0cf1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:46.712 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:46.704+0000 7f626b210640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f625c04b700 con 0x7f625c0d46d0 2024-04-26T23:46:46.712 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:46.704+0000 7f626b210640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f625c04b420 con 0x7f625c02c020 2024-04-26T23:46:46.712 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:46.704+0000 7f626b210640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f625c02f210 con 0x7f625c0d71f0 2024-04-26T23:46:46.712 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:46.704+0000 7f6269a0d640 1 -- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f625c0d46d0 msgr2=0x7f625c0301a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.88:3300/0 2024-04-26T23:46:46.712 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:46.704+0000 7f6269a0d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f625c0d46d0 0x7f625c0301a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:46:46.712 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:46.705+0000 7f626a20e640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f625c02c020 0x7f625c0ce8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:46.713 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:46.705+0000 7f626a20e640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f625c02c020 0x7f625c0ce8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.88:58576/0 (socket says 172.21.15.88:58576) 2024-04-26T23:46:46.713 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:46.705+0000 7f626a20e640 1 -- 172.21.15.88:0/3055629514 learned_addr learned my addr 172.21.15.88:0/3055629514 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:46:46.713 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:46.708+0000 7f626aa0f640 1 --2- 172.21.15.88:0/3055629514 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f625c0d71f0 0x7f625c0cf1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:46.713 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:46.709+0000 7f626a20e640 1 -- 172.21.15.88:0/3055629514 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f625c0d71f0 msgr2=0x7f625c0cf1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:46.713 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:46.709+0000 7f626a20e640 1 --2- 172.21.15.88:0/3055629514 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f625c0d71f0 0x7f625c0cf1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:46.713 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:46.709+0000 7f626a20e640 1 -- 172.21.15.88:0/3055629514 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f625c0d46d0 msgr2=0x7f625c0301a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T23:46:46.713 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:46.709+0000 7f626a20e640 1 --2- 172.21.15.88:0/3055629514 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f625c0d46d0 0x7f625c0301a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:46.713 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:46.709+0000 7f626a20e640 1 -- 172.21.15.88:0/3055629514 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f625c0d19b0 con 0x7f625c02c020 2024-04-26T23:46:46.716 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:46.713+0000 7f626a20e640 1 --2- 172.21.15.88:0/3055629514 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f625c02c020 0x7f625c0ce8f0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f626000c450 tx=0x7f626000c910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:46.717 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:46.714+0000 7f625affd640 1 -- 172.21.15.88:0/3055629514 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62600052d0 con 0x7f625c02c020 2024-04-26T23:46:46.718 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:46.714+0000 7f625affd640 1 -- 172.21.15.88:0/3055629514 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6260005470 con 0x7f625c02c020 2024-04-26T23:46:46.718 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:46.714+0000 7f626b210640 1 -- 172.21.15.88:0/3055629514 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f625c0ceed0 con 0x7f625c02c020 2024-04-26T23:46:46.719 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:46.714+0000 7f626b210640 1 -- 172.21.15.88:0/3055629514 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f625c02f9a0 con 0x7f625c02c020 2024-04-26T23:46:46.719 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:46.715+0000 7f625affd640 1 -- 172.21.15.88:0/3055629514 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6260012870 con 0x7f625c02c020 2024-04-26T23:46:46.722 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:46.718+0000 7f625affd640 1 -- 172.21.15.88:0/3055629514 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6260012a10 con 0x7f625c02c020 2024-04-26T23:46:46.722 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:46.718+0000 7f626b210640 1 --2- 172.21.15.88:0/3055629514 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f624c002a70 0x7f624c004f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:46.722 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:46.718+0000 7f626b210640 1 -- 172.21.15.88:0/3055629514 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f624c007ec0 con 0x7f624c002a70 2024-04-26T23:46:46.722 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:46.718+0000 7f625affd640 1 --2- 172.21.15.88:0/3055629514 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f624806c920 0x7f624806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:46.722 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:46.719+0000 7f625affd640 1 -- 172.21.15.88:0/3055629514 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6666+0+0 (secure 0 0 0) 0x7f626008bac0 con 0x7f625c02c020 2024-04-26T23:46:46.729 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:46.725+0000 7f6269a0d640 1 --2- 172.21.15.88:0/3055629514 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f624c002a70 0x7f624c004f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:46.729 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:46.725+0000 7f626aa0f640 1 --2- 172.21.15.88:0/3055629514 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f624806c920 0x7f624806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:46.731 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:46.726+0000 7f6269a0d640 1 -- 172.21.15.88:0/3055629514 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f624c0080c0 con 0x7f624c002a70 2024-04-26T23:46:46.732 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:46.726+0000 7f626aa0f640 1 --2- 172.21.15.88:0/3055629514 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f624806c920 0x7f624806ede0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f625c00abb0 tx=0x7f62640ad000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:46.732 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:46.727+0000 7f6269a0d640 1 --2- 172.21.15.88:0/3055629514 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f624c002a70 0x7f624c004f30 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f625c0d62d0 tx=0x7f625400b810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:46.737 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:46.730+0000 7f625affd640 1 -- 172.21.15.88:0/3055629514 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6254016070 con 0x7f624c002a70 2024-04-26T23:46:46.737 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:46.730+0000 7f625affd640 1 -- 172.21.15.88:0/3055629514 <== mon.2 v2:172.21.15.175:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f6254003d20 con 0x7f624c002a70 2024-04-26T23:46:46.737 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:46.730+0000 7f625affd640 1 -- 172.21.15.88:0/3055629514 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f624c002a70 msgr2=0x7f624c004f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:46.737 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:46.730+0000 7f625affd640 1 --2- 172.21.15.88:0/3055629514 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f624c002a70 0x7f624c004f30 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f625c0d62d0 tx=0x7f625400b810 comp rx=0 tx=0).stop 2024-04-26T23:46:46.737 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:46.730+0000 7f625affd640 1 -- 172.21.15.88:0/3055629514 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f624c002a70 msgr2=0x7f624c004f30 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:46:46.737 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:46.730+0000 7f625affd640 1 --2- 172.21.15.88:0/3055629514 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f624c002a70 0x7f624c004f30 secure :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f625c0d62d0 tx=0x7f625400b810 comp rx=0 tx=0).stop 2024-04-26T23:46:46.749 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:46.746+0000 7f626b210640 1 --2- 172.21.15.88:0/3055629514 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f624c006f00 0x7f624c007390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:46.755 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:46.751+0000 7f626b210640 1 -- 172.21.15.88:0/3055629514 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f624c00a4a0 con 0x7f624c006f00 2024-04-26T23:46:46.755 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:46.752+0000 7f6269a0d640 1 --2- 172.21.15.88:0/3055629514 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f624c006f00 0x7f624c007390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:46.758 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:46.755+0000 7f6269a0d640 1 -- 172.21.15.88:0/3055629514 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f624c0078d0 con 0x7f624c006f00 2024-04-26T23:46:46.760 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:46.757+0000 7f6269a0d640 1 --2- 172.21.15.88:0/3055629514 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f624c006f00 0x7f624c007390 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f6254013000 tx=0x7f6254005970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:46.760 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:46.757+0000 7f625affd640 1 -- 172.21.15.88:0/3055629514 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6254016030 con 0x7f624c006f00 2024-04-26T23:46:46.762 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-04-26T23:46:46.762 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2024-04-26T23:46:46.762 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2024-04-26T23:46:46.762 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "peon", 2024-04-26T23:46:46.762 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 62, 2024-04-26T23:46:46.762 INFO:teuthology.orchestra.run.smithi088.stdout: "uptime": 175044, 2024-04-26T23:46:46.762 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2024-04-26T23:46:46.762 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2024-04-26T23:46:46.762 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2024-04-26T23:46:46.762 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:46:46.763 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 4, 2024-04-26T23:46:46.763 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2024-04-26T23:46:46.763 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2450521708007866372", 2024-04-26T23:46:46.763 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2024-04-26T23:46:46.763 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-04-26T23:46:46.763 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-04-26T23:46:46.763 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-04-26T23:46:46.763 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-04-26T23:46:46.763 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-04-26T23:46:46.763 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-04-26T23:46:46.763 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-04-26T23:46:46.763 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-04-26T23:46:46.763 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-04-26T23:46:46.763 INFO:teuthology.orchestra.run.smithi088.stdout: "reef", 2024-04-26T23:46:46.763 INFO:teuthology.orchestra.run.smithi088.stdout: "squid" 2024-04-26T23:46:46.764 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:46:46.764 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540701547738038271", 2024-04-26T23:46:46.764 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2024-04-26T23:46:46.764 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-04-26T23:46:46.764 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-04-26T23:46:46.764 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-04-26T23:46:46.764 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-04-26T23:46:46.764 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-04-26T23:46:46.764 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-04-26T23:46:46.764 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-04-26T23:46:46.764 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-04-26T23:46:46.764 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-04-26T23:46:46.764 INFO:teuthology.orchestra.run.smithi088.stdout: "reef", 2024-04-26T23:46:46.764 INFO:teuthology.orchestra.run.smithi088.stdout: "squid" 2024-04-26T23:46:46.764 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:46:46.765 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:46:46.765 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2024-04-26T23:46:46.765 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2024-04-26T23:46:46.765 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2024-04-26T23:46:46.765 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2024-04-26T23:46:46.765 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2024-04-26T23:46:46.765 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "555255e9-7ef9-4454-8dc9-35e96b70035c", 2024-04-26T23:46:46.765 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2024-04-26T23:39:34.291658Z", 2024-04-26T23:46:46.765 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2024-04-26T23:39:34.291658Z", 2024-04-26T23:46:46.765 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 19, 2024-04-26T23:46:46.765 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "squid", 2024-04-26T23:46:46.765 INFO:teuthology.orchestra.run.smithi088.stdout: "election_strategy": 1, 2024-04-26T23:46:46.765 INFO:teuthology.orchestra.run.smithi088.stdout: "disallowed_leaders: ": "", 2024-04-26T23:46:46.765 INFO:teuthology.orchestra.run.smithi088.stdout: "stretch_mode": false, 2024-04-26T23:46:46.765 INFO:teuthology.orchestra.run.smithi088.stdout: "tiebreaker_mon": "", 2024-04-26T23:46:46.766 INFO:teuthology.orchestra.run.smithi088.stdout: "removed_ranks: ": "", 2024-04-26T23:46:46.766 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2024-04-26T23:46:46.766 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2024-04-26T23:46:46.766 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-04-26T23:46:46.766 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-04-26T23:46:46.766 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-04-26T23:46:46.766 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-04-26T23:46:46.766 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-04-26T23:46:46.766 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-04-26T23:46:46.766 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-04-26T23:46:46.766 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-04-26T23:46:46.766 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-04-26T23:46:46.766 INFO:teuthology.orchestra.run.smithi088.stdout: "reef", 2024-04-26T23:46:46.766 INFO:teuthology.orchestra.run.smithi088.stdout: "squid" 2024-04-26T23:46:46.767 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:46:46.767 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2024-04-26T23:46:46.767 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:46:46.767 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2024-04-26T23:46:46.767 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:46:46.767 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2024-04-26T23:46:46.767 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2024-04-26T23:46:46.767 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-04-26T23:46:46.767 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-04-26T23:46:46.767 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:46:46.767 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-04-26T23:46:46.767 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2024-04-26T23:46:46.767 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:46:46.767 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:46:46.767 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:46:46.768 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-04-26T23:46:46.768 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2024-04-26T23:46:46.768 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:46:46.768 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:46:46.768 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:46:46.768 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:46:46.768 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2024-04-26T23:46:46.768 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2024-04-26T23:46:46.768 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-04-26T23:46:46.768 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-04-26T23:46:46.768 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-04-26T23:46:46.768 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:46:46.768 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:46:46.768 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2024-04-26T23:46:46.768 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2024-04-26T23:46:46.769 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-04-26T23:46:46.769 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-04-26T23:46:46.769 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:46:46.769 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-04-26T23:46:46.769 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:3300", 2024-04-26T23:46:46.769 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:46:46.769 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:46:46.769 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:46:46.769 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-04-26T23:46:46.769 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6789", 2024-04-26T23:46:46.769 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:46:46.769 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:46:46.769 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:46:46.769 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:46:46.770 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6789/0", 2024-04-26T23:46:46.770 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.175:6789/0", 2024-04-26T23:46:46.770 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-04-26T23:46:46.770 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-04-26T23:46:46.770 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-04-26T23:46:46.770 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:46:46.770 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:46:46.770 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2024-04-26T23:46:46.770 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2024-04-26T23:46:46.770 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-04-26T23:46:46.770 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-04-26T23:46:46.770 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:46:46.770 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-04-26T23:46:46.770 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:3301", 2024-04-26T23:46:46.771 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:46:46.771 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:46:46.771 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:46:46.771 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-04-26T23:46:46.771 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6790", 2024-04-26T23:46:46.771 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:46:46.771 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:46:46.771 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:46:46.771 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:46:46.771 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6790/0", 2024-04-26T23:46:46.771 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.175:6790/0", 2024-04-26T23:46:46.771 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-04-26T23:46:46.771 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-04-26T23:46:46.771 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-04-26T23:46:46.771 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:46:46.772 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:46:46.772 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:46:46.772 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2024-04-26T23:46:46.772 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2024-04-26T23:46:46.772 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:46:46.772 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:46:46.772 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:46:46.772 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2024-04-26T23:46:46.772 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:46:46.772 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:46:46.772 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": [ 2024-04-26T23:46:46.772 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:46:46.772 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:46:46.772 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:46:46.772 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 4 2024-04-26T23:46:46.773 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:46:46.773 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:46:46.773 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": [ 2024-04-26T23:46:46.773 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:46:46.773 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:46:46.773 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:46:46.773 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 7 2024-04-26T23:46:46.773 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:46:46.773 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:46:46.773 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2024-04-26T23:46:46.773 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:46:46.773 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x2f018fb87aa4aafe", 2024-04-26T23:46:46.773 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:46:46.773 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2024-04-26T23:46:46.774 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:46:46.774 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:46:46.774 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:46:46.774 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:46:46.774 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 5 2024-04-26T23:46:46.774 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:46:46.774 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:46:46.774 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": [ 2024-04-26T23:46:46.774 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:46:46.774 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:46:46.774 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:46:46.774 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2024-04-26T23:46:46.774 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:46:46.774 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:46:46.774 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:46:46.775 INFO:teuthology.orchestra.run.smithi088.stdout: "stretch_mode": false 2024-04-26T23:46:46.775 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-04-26T23:46:46.775 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:46.758+0000 7f625affd640 1 -- 172.21.15.88:0/3055629514 <== mon.2 v2:172.21.15.175:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5197 (secure 0 0 0) 0x7f62540103a0 con 0x7f624c006f00 2024-04-26T23:46:46.775 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:46.758+0000 7f625affd640 1 -- 172.21.15.88:0/3055629514 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f624c006f00 msgr2=0x7f624c007390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:46.775 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:46.758+0000 7f625affd640 1 --2- 172.21.15.88:0/3055629514 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f624c006f00 0x7f624c007390 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f6254013000 tx=0x7f6254005970 comp rx=0 tx=0).stop 2024-04-26T23:46:46.775 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:46.758+0000 7f625affd640 1 -- 172.21.15.88:0/3055629514 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f624c006f00 msgr2=0x7f624c007390 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:46:46.776 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:46.758+0000 7f625affd640 1 --2- 172.21.15.88:0/3055629514 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f624c006f00 0x7f624c007390 secure :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f6254013000 tx=0x7f6254005970 comp rx=0 tx=0).stop 2024-04-26T23:46:46.776 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:46.767+0000 7f6258ff9640 1 -- 172.21.15.88:0/3055629514 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f624806c920 msgr2=0x7f624806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:46.776 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:46.767+0000 7f6258ff9640 1 --2- 172.21.15.88:0/3055629514 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f624806c920 0x7f624806ede0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f625c00abb0 tx=0x7f62640ad000 comp rx=0 tx=0).stop 2024-04-26T23:46:46.776 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:46.767+0000 7f6258ff9640 1 -- 172.21.15.88:0/3055629514 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f625c02c020 msgr2=0x7f625c0ce8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:46.776 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:46.767+0000 7f6258ff9640 1 --2- 172.21.15.88:0/3055629514 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f625c02c020 0x7f625c0ce8f0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f626000c450 tx=0x7f626000c910 comp rx=0 tx=0).stop 2024-04-26T23:46:46.776 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:46.771+0000 7f626aa0f640 1 -- 172.21.15.88:0/3055629514 reap_dead start 2024-04-26T23:46:46.776 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:46.771+0000 7f626aa0f640 1 -- 172.21.15.88:0/3055629514 reap_dead start 2024-04-26T23:46:46.776 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:46.773+0000 7f6258ff9640 1 -- 172.21.15.88:0/3055629514 shutdown_connections 2024-04-26T23:46:46.776 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:46.773+0000 7f6258ff9640 1 -- 172.21.15.88:0/3055629514 >> 172.21.15.88:0/3055629514 conn(0x7f625c007b40 msgr2=0x7f625c008e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:46.778 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:46.775+0000 7f6258ff9640 1 -- 172.21.15.88:0/3055629514 shutdown_connections 2024-04-26T23:46:46.779 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:46:46.776+0000 7f6258ff9640 1 -- 172.21.15.88:0/3055629514 wait complete. 2024-04-26T23:46:46.805 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-04-26T23:46:46.805 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2024-04-26T23:47:04.629 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:47:04.634 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:47:06.806 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2024-04-26T23:47:06.807 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.a 2024-04-26T23:47:06.807 INFO:tasks.ceph.mon.a:Restarting daemon 2024-04-26T23:47:06.807 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-04-26T23:47:06.809 INFO:tasks.ceph.mon.a:Started 2024-04-26T23:47:06.810 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-04-26T23:47:06.810 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-04-26T23:47:06.972 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:06.967+0000 7fef36519640 1 Processor -- start 2024-04-26T23:47:06.972 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:06.967+0000 7fef36519640 1 -- start start 2024-04-26T23:47:06.974 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:06.969+0000 7fef36519640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fef300c90c0 0x7fef3015bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:06.974 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:06.969+0000 7fef36519640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fef300c6e00 0x7fef30158510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:06.974 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:06.969+0000 7fef36519640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fef300cbde0 con 0x7fef300bfbb0 2024-04-26T23:47:06.974 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:06.969+0000 7fef36519640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7fef3015c150 con 0x7fef300c90c0 2024-04-26T23:47:06.974 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:06.969+0000 7fef36519640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fef300ca380 con 0x7fef300c6e00 2024-04-26T23:47:06.974 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:06.969+0000 7fef2ffff640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fef300c90c0 0x7fef3015bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:06.974 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:06.969+0000 7fef2f7fe640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fef300bfbb0 0x7fef300cadd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:43480/0 (socket says 172.21.15.88:43480) 2024-04-26T23:47:06.975 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:06.969+0000 7fef2f7fe640 1 -- 172.21.15.88:0/167891456 learned_addr learned my addr 172.21.15.88:0/167891456 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-26T23:47:06.975 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:06.969+0000 7fef34ab6640 1 --2- 172.21.15.88:0/167891456 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fef300c6e00 0x7fef30158510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:06.975 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:06.969+0000 7fef2ffff640 1 -- 172.21.15.88:0/167891456 >> v2:172.21.15.88:3300/0 conn(0x7fef300c90c0 msgr2=0x7fef3015bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-26T23:47:06.975 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:06.969+0000 7fef2ffff640 1 -- 172.21.15.88:0/167891456 >> v2:172.21.15.88:3300/0 conn(0x7fef300c90c0 msgr2=0x7fef3015bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T23:47:06.975 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:06.969+0000 7fef2ffff640 1 --2- 172.21.15.88:0/167891456 >> v2:172.21.15.88:3300/0 conn(0x7fef300c90c0 0x7fef3015bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:47:06.975 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:06.969+0000 7fef2ffff640 1 --2- 172.21.15.88:0/167891456 >> v2:172.21.15.88:3300/0 conn(0x7fef300c90c0 0x7fef3015bc10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:47:06.975 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:06.970+0000 7fef34ab6640 1 -- 172.21.15.88:0/167891456 >> v2:172.21.15.88:3300/0 conn(0x7fef300c90c0 msgr2=0x7fef3015bc10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T23:47:06.975 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:06.970+0000 7fef34ab6640 1 --2- 172.21.15.88:0/167891456 >> v2:172.21.15.88:3300/0 conn(0x7fef300c90c0 0x7fef3015bc10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:06.975 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:06.970+0000 7fef34ab6640 1 -- 172.21.15.88:0/167891456 >> v1:172.21.15.88:6789/0 conn(0x7fef300bfbb0 legacy=0x7fef300cadd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:06.975 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:06.970+0000 7fef34ab6640 1 -- 172.21.15.88:0/167891456 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef300cc0c0 con 0x7fef300c6e00 2024-04-26T23:47:06.977 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:06.970+0000 7fef34ab6640 1 --2- 172.21.15.88:0/167891456 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fef300c6e00 0x7fef30158510 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fef28009d90 tx=0x7fef2802a530 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a68a8f7e0b7dac71 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:47:06.977 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:06.971+0000 7fef2effd640 1 -- 172.21.15.88:0/167891456 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef28007740 con 0x7fef300c6e00 2024-04-26T23:47:06.977 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:06.971+0000 7fef2effd640 1 -- 172.21.15.88:0/167891456 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef280078e0 con 0x7fef300c6e00 2024-04-26T23:47:06.977 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:06.971+0000 7fef2effd640 1 -- 172.21.15.88:0/167891456 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef28007740 con 0x7fef300c6e00 2024-04-26T23:47:06.977 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:06.972+0000 7fef36519640 1 -- 172.21.15.88:0/167891456 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fef300c6e00 msgr2=0x7fef30158510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:06.977 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:06.972+0000 7fef36519640 1 --2- 172.21.15.88:0/167891456 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fef300c6e00 0x7fef30158510 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fef28009d90 tx=0x7fef2802a530 comp rx=0 tx=0).stop 2024-04-26T23:47:06.977 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:06.972+0000 7fef36519640 1 -- 172.21.15.88:0/167891456 shutdown_connections 2024-04-26T23:47:06.977 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:06.972+0000 7fef36519640 1 --2- 172.21.15.88:0/167891456 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fef300c6e00 0x7fef30158510 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:06.977 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:06.972+0000 7fef36519640 1 --2- 172.21.15.88:0/167891456 >> v2:172.21.15.88:3300/0 conn(0x7fef300c90c0 0x7fef3015bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:06.977 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:06.972+0000 7fef36519640 1 -- 172.21.15.88:0/167891456 >> 172.21.15.88:0/167891456 conn(0x7fef300ae010 msgr2=0x7fef300ae3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:47:06.977 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:06.972+0000 7fef36519640 1 -- 172.21.15.88:0/167891456 shutdown_connections 2024-04-26T23:47:06.977 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:06.972+0000 7fef36519640 1 -- 172.21.15.88:0/167891456 wait complete. 2024-04-26T23:47:06.978 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:06.973+0000 7fef36519640 1 Processor -- start 2024-04-26T23:47:06.978 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:06.973+0000 7fef36519640 1 -- start start 2024-04-26T23:47:06.980 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:06.974+0000 7fef36519640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fef300bfbb0 0x7fef3015aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:06.980 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:06.974+0000 7fef36519640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fef300c6e00 0x7fef300c5930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:06.980 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:06.974+0000 7fef36519640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fef300c90c0 0x7fef300c5e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:06.981 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:06.974+0000 7fef36519640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fef300c94a0 con 0x7fef300bfbb0 2024-04-26T23:47:06.981 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:06.974+0000 7fef36519640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fef300cb4e0 con 0x7fef300c6e00 2024-04-26T23:47:06.981 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:06.974+0000 7fef36519640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fef300c9620 con 0x7fef300c90c0 2024-04-26T23:47:06.981 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:06.974+0000 7fef2f7fe640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fef300c6e00 0x7fef300c5930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:06.981 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:06.975+0000 7fef2ffff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fef300bfbb0 0x7fef3015aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:06.981 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:06.975+0000 7fef2f7fe640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fef300c6e00 0x7fef300c5930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.88:40656/0 (socket says 172.21.15.88:40656) 2024-04-26T23:47:06.981 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:06.975+0000 7fef2f7fe640 1 -- 172.21.15.88:0/319159081 learned_addr learned my addr 172.21.15.88:0/319159081 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:47:06.981 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:06.975+0000 7fef2ffff640 1 --2- 172.21.15.88:0/319159081 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fef300bfbb0 0x7fef3015aa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:39188/0 (socket says 172.21.15.88:39188) 2024-04-26T23:47:06.981 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:06.975+0000 7fef34ab6640 1 --2- 172.21.15.88:0/319159081 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fef300c90c0 0x7fef300c5e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:06.981 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:06.975+0000 7fef2ffff640 1 -- 172.21.15.88:0/319159081 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fef300bfbb0 msgr2=0x7fef3015aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2024-04-26T23:47:06.981 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:06.975+0000 7fef2ffff640 1 -- 172.21.15.88:0/319159081 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fef300bfbb0 msgr2=0x7fef3015aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-26T23:47:06.981 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:06.975+0000 7fef2ffff640 1 --2- 172.21.15.88:0/319159081 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fef300bfbb0 0x7fef3015aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:47:06.981 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:06.975+0000 7fef2ffff640 1 --2- 172.21.15.88:0/319159081 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fef300bfbb0 0x7fef3015aa50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:47:06.981 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:06.975+0000 7fef2f7fe640 1 -- 172.21.15.88:0/319159081 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fef300c90c0 msgr2=0x7fef300c5e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:06.982 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:06.975+0000 7fef2f7fe640 1 --2- 172.21.15.88:0/319159081 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fef300c90c0 0x7fef300c5e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:06.982 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:06.975+0000 7fef2f7fe640 1 -- 172.21.15.88:0/319159081 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fef300bfbb0 msgr2=0x7fef3015aa50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T23:47:06.982 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:06.975+0000 7fef2f7fe640 1 --2- 172.21.15.88:0/319159081 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fef300bfbb0 0x7fef3015aa50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:06.982 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:06.975+0000 7fef2f7fe640 1 -- 172.21.15.88:0/319159081 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef3015d660 con 0x7fef300c6e00 2024-04-26T23:47:06.982 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:06.976+0000 7fef2f7fe640 1 --2- 172.21.15.88:0/319159081 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fef300c6e00 0x7fef300c5930 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fef2400c430 tx=0x7fef2400c8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:47:06.982 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:06.976+0000 7fef2cff9640 1 -- 172.21.15.88:0/319159081 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef24017070 con 0x7fef300c6e00 2024-04-26T23:47:06.982 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:06.976+0000 7fef2cff9640 1 -- 172.21.15.88:0/319159081 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef24005ce0 con 0x7fef300c6e00 2024-04-26T23:47:06.982 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:06.976+0000 7fef2cff9640 1 -- 172.21.15.88:0/319159081 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef24007310 con 0x7fef300c6e00 2024-04-26T23:47:06.982 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:06.976+0000 7fef36519640 1 -- 172.21.15.88:0/319159081 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef301f43e0 con 0x7fef300c6e00 2024-04-26T23:47:06.982 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:06.976+0000 7fef36519640 1 -- 172.21.15.88:0/319159081 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef301f4960 con 0x7fef300c6e00 2024-04-26T23:47:06.983 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:06.977+0000 7fef36519640 1 -- 172.21.15.88:0/319159081 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef30076650 con 0x7fef300c6e00 2024-04-26T23:47:06.983 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:06.978+0000 7fef2cff9640 1 -- 172.21.15.88:0/319159081 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fef2401a070 con 0x7fef300c6e00 2024-04-26T23:47:06.983 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:06.979+0000 7fef2cff9640 1 --2- 172.21.15.88:0/319159081 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fef1c06c8f0 0x7fef1c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:06.983 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:06.979+0000 7fef2cff9640 1 -- 172.21.15.88:0/319159081 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6666+0+0 (secure 0 0 0) 0x7fef2408b180 con 0x7fef300c6e00 2024-04-26T23:47:06.983 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:06.979+0000 7fef2ffff640 1 --2- 172.21.15.88:0/319159081 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fef1c06c8f0 0x7fef1c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:06.984 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:06.980+0000 7fef2ffff640 1 --2- 172.21.15.88:0/319159081 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fef1c06c8f0 0x7fef1c06edb0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fef20006fd0 tx=0x7fef20008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:47:06.991 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:06.987+0000 7fef2cff9640 1 -- 172.21.15.88:0/319159081 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fef24058c30 con 0x7fef300c6e00 2024-04-26T23:47:07.503 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:07.498+0000 7fef36519640 1 -- 172.21.15.88:0/319159081 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fef300507a0 con 0x7fef300c6e00 2024-04-26T23:47:07.505 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:07.500+0000 7fef2cff9640 1 -- 172.21.15.88:0/319159081 <== mon.1 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1559 (secure 0 0 0) 0x7fef2405cf30 con 0x7fef300c6e00 2024-04-26T23:47:07.507 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":62,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":24,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"555255e9-7ef9-4454-8dc9-35e96b70035c","modified":"2024-04-26T23:39:34.291658Z","created":"2024-04-26T23:39:34.291658Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:3300","nonce":0},{"type":"v1","addr":"172.21.15.175:6789","nonce":0}]},"addr":"172.21.15.175:6789/0","public_addr":"172.21.15.175:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:3301","nonce":0},{"type":"v1","addr":"172.21.15.175:6790","nonce":0}]},"addr":"172.21.15.175:6790/0","public_addr":"172.21.15.175:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-04-26T23:47:07.510 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:07.506+0000 7fef36519640 1 -- 172.21.15.88:0/319159081 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fef1c06c8f0 msgr2=0x7fef1c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:07.510 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:07.506+0000 7fef36519640 1 --2- 172.21.15.88:0/319159081 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fef1c06c8f0 0x7fef1c06edb0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fef20006fd0 tx=0x7fef20008040 comp rx=0 tx=0).stop 2024-04-26T23:47:07.510 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:07.506+0000 7fef36519640 1 -- 172.21.15.88:0/319159081 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fef300c6e00 msgr2=0x7fef300c5930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:07.510 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:07.506+0000 7fef36519640 1 --2- 172.21.15.88:0/319159081 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fef300c6e00 0x7fef300c5930 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fef2400c430 tx=0x7fef2400c8f0 comp rx=0 tx=0).stop 2024-04-26T23:47:07.515 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:07.511+0000 7fef36519640 1 -- 172.21.15.88:0/319159081 shutdown_connections 2024-04-26T23:47:07.515 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:07.511+0000 7fef36519640 1 --2- 172.21.15.88:0/319159081 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fef1c06c8f0 0x7fef1c06edb0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:07.516 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:07.511+0000 7fef36519640 1 --2- 172.21.15.88:0/319159081 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fef300c90c0 0x7fef300c5e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:07.516 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:07.511+0000 7fef36519640 1 --2- 172.21.15.88:0/319159081 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fef300c6e00 0x7fef300c5930 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:07.516 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:07.511+0000 7fef36519640 1 --2- 172.21.15.88:0/319159081 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fef300bfbb0 0x7fef3015aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:07.516 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:07.511+0000 7fef36519640 1 -- 172.21.15.88:0/319159081 >> 172.21.15.88:0/319159081 conn(0x7fef300ae010 msgr2=0x7fef30157bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:47:07.516 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:07.511+0000 7fef36519640 1 -- 172.21.15.88:0/319159081 shutdown_connections 2024-04-26T23:47:07.519 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:07.515+0000 7fef36519640 1 -- 172.21.15.88:0/319159081 wait complete. 2024-04-26T23:47:10.540 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-04-26T23:47:10.709 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:10.705+0000 7f28095e4640 1 Processor -- start 2024-04-26T23:47:10.709 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:10.705+0000 7f28095e4640 1 -- start start 2024-04-26T23:47:10.712 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:10.706+0000 7f28095e4640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f280413ddd0 0x7f2804154b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:10.713 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:10.706+0000 7f28095e4640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f2804070f70 0x7f28040713c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:10.713 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:10.706+0000 7f28095e4640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f28040707e0 con 0x7f2804071cc0 2024-04-26T23:47:10.713 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:10.706+0000 7f28095e4640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f2804071900 con 0x7f2804070f70 2024-04-26T23:47:10.713 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:10.706+0000 7f28095e4640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f2804155450 con 0x7f280413ddd0 2024-04-26T23:47:10.713 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:10.706+0000 7f2802ffd640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f280413ddd0 0x7f2804154b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:10.713 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:10.706+0000 7f28027fc640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f2804071cc0 0x7f2804073700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.88:47452/0 (socket says 172.21.15.88:47452) 2024-04-26T23:47:10.713 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:10.706+0000 7f28027fc640 1 -- 172.21.15.88:0/490512376 learned_addr learned my addr 172.21.15.88:0/490512376 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-26T23:47:10.713 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:10.707+0000 7f28037fe640 1 --2- 172.21.15.88:0/490512376 >> v2:172.21.15.88:3300/0 conn(0x7f2804070f70 0x7f28040713c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:10.713 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:10.707+0000 7f2801ffb640 1 -- 172.21.15.88:0/490512376 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3128535130 0 0) 0x7f28040707e0 con 0x7f2804071cc0 2024-04-26T23:47:10.713 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:10.707+0000 7f28037fe640 1 -- 172.21.15.88:0/490512376 >> v2:172.21.15.88:3300/0 conn(0x7f2804070f70 msgr2=0x7f28040713c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-26T23:47:10.714 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:10.707+0000 7f2802ffd640 1 -- 172.21.15.88:0/490512376 >> v2:172.21.15.88:3300/0 conn(0x7f2804070f70 msgr2=0x7f28040713c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:47:10.714 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:10.707+0000 7f28037fe640 1 -- 172.21.15.88:0/490512376 >> v2:172.21.15.88:3300/0 conn(0x7f2804070f70 msgr2=0x7f28040713c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T23:47:10.714 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:10.707+0000 7f28037fe640 1 --2- 172.21.15.88:0/490512376 >> v2:172.21.15.88:3300/0 conn(0x7f2804070f70 0x7f28040713c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:47:10.714 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:10.707+0000 7f28037fe640 1 --2- 172.21.15.88:0/490512376 >> v2:172.21.15.88:3300/0 conn(0x7f2804070f70 0x7f28040713c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:47:10.714 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:10.707+0000 7f2802ffd640 1 --2- 172.21.15.88:0/490512376 >> v2:172.21.15.88:3300/0 conn(0x7f2804070f70 0x7f28040713c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:10.714 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:10.707+0000 7f2802ffd640 1 -- 172.21.15.88:0/490512376 >> v1:172.21.15.175:6789/0 conn(0x7f2804071cc0 legacy=0x7f2804073700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:10.714 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:10.707+0000 7f2802ffd640 1 -- 172.21.15.88:0/490512376 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2804155730 con 0x7f280413ddd0 2024-04-26T23:47:10.714 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:10.708+0000 7f2802ffd640 1 --2- 172.21.15.88:0/490512376 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f280413ddd0 0x7f2804154b00 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f2804075020 tx=0x7f27f802a110 comp rx=0 tx=0).ready entity=mon.1 client_cookie=41a108085fa9b43a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:47:10.715 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:10.709+0000 7f2801ffb640 1 -- 172.21.15.88:0/490512376 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27f8037070 con 0x7f280413ddd0 2024-04-26T23:47:10.715 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:10.709+0000 7f2801ffb640 1 -- 172.21.15.88:0/490512376 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27f8032440 con 0x7f280413ddd0 2024-04-26T23:47:10.715 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:10.710+0000 7f28095e4640 1 -- 172.21.15.88:0/490512376 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f280413ddd0 msgr2=0x7f2804154b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:10.715 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:10.710+0000 7f28095e4640 1 --2- 172.21.15.88:0/490512376 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f280413ddd0 0x7f2804154b00 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f2804075020 tx=0x7f27f802a110 comp rx=0 tx=0).stop 2024-04-26T23:47:10.716 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:10.710+0000 7f28095e4640 1 -- 172.21.15.88:0/490512376 shutdown_connections 2024-04-26T23:47:10.716 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:10.710+0000 7f28095e4640 1 --2- 172.21.15.88:0/490512376 >> v2:172.21.15.88:3300/0 conn(0x7f2804070f70 0x7f28040713c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:10.716 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:10.710+0000 7f28095e4640 1 --2- 172.21.15.88:0/490512376 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f280413ddd0 0x7f2804154b00 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:10.716 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:10.710+0000 7f28095e4640 1 -- 172.21.15.88:0/490512376 >> 172.21.15.88:0/490512376 conn(0x7f28040ca2f0 msgr2=0x7f28040ca6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:47:10.716 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:10.710+0000 7f28095e4640 1 -- 172.21.15.88:0/490512376 shutdown_connections 2024-04-26T23:47:10.716 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:10.710+0000 7f28095e4640 1 -- 172.21.15.88:0/490512376 wait complete. 2024-04-26T23:47:10.716 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:10.712+0000 7f28095e4640 1 Processor -- start 2024-04-26T23:47:10.720 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:10.712+0000 7f28095e4640 1 -- start start 2024-04-26T23:47:10.720 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:10.713+0000 7f28095e4640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2804070f70 0x7f28041f1020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:10.720 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:10.713+0000 7f28095e4640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2804071cc0 0x7f2804152970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:10.720 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:10.713+0000 7f28095e4640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f280413ddd0 0x7f2804152eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:10.720 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:10.713+0000 7f28095e4640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f2804073f90 con 0x7f2804071cc0 2024-04-26T23:47:10.720 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:10.713+0000 7f28095e4640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f2804073e10 con 0x7f2804070f70 2024-04-26T23:47:10.720 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:10.713+0000 7f28095e4640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f280413e1b0 con 0x7f280413ddd0 2024-04-26T23:47:10.721 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:10.714+0000 7f28027fc640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2804071cc0 0x7f2804152970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:10.721 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:10.714+0000 7f28027fc640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2804071cc0 0x7f2804152970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:58458/0 (socket says 172.21.15.88:58458) 2024-04-26T23:47:10.721 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:10.714+0000 7f28027fc640 1 -- 172.21.15.88:0/3476548459 learned_addr learned my addr 172.21.15.88:0/3476548459 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:47:10.721 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:10.714+0000 7f28027fc640 1 -- 172.21.15.88:0/3476548459 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2804071cc0 msgr2=0x7f2804152970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2024-04-26T23:47:10.721 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:10.714+0000 7f28027fc640 1 -- 172.21.15.88:0/3476548459 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2804071cc0 msgr2=0x7f2804152970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-26T23:47:10.721 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:10.714+0000 7f28027fc640 1 --2- 172.21.15.88:0/3476548459 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2804071cc0 0x7f2804152970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:47:10.721 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:10.714+0000 7f28027fc640 1 --2- 172.21.15.88:0/3476548459 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2804071cc0 0x7f2804152970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:47:10.721 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:10.714+0000 7f28037fe640 1 --2- 172.21.15.88:0/3476548459 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f280413ddd0 0x7f2804152eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:10.721 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:10.715+0000 7f28037fe640 1 -- 172.21.15.88:0/3476548459 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2804070f70 msgr2=0x7f28041f1020 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-26T23:47:10.721 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:10.715+0000 7f28037fe640 1 --2- 172.21.15.88:0/3476548459 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2804070f70 0x7f28041f1020 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:10.721 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:10.715+0000 7f28037fe640 1 -- 172.21.15.88:0/3476548459 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2804071cc0 msgr2=0x7f2804152970 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T23:47:10.721 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:10.715+0000 7f28037fe640 1 --2- 172.21.15.88:0/3476548459 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2804071cc0 0x7f2804152970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:10.721 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:10.715+0000 7f28037fe640 1 -- 172.21.15.88:0/3476548459 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28040adfb0 con 0x7f280413ddd0 2024-04-26T23:47:10.721 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:10.715+0000 7f28037fe640 1 --2- 172.21.15.88:0/3476548459 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f280413ddd0 0x7f2804152eb0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f27fc009610 tx=0x7f27fc00e4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:47:10.722 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:10.716+0000 7f27eb7fe640 1 -- 172.21.15.88:0/3476548459 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27fc014420 con 0x7f280413ddd0 2024-04-26T23:47:10.722 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:10.716+0000 7f28095e4640 1 -- 172.21.15.88:0/3476548459 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28041583c0 con 0x7f280413ddd0 2024-04-26T23:47:10.722 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:10.716+0000 7f28095e4640 1 -- 172.21.15.88:0/3476548459 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f2804158ee0 con 0x7f280413ddd0 2024-04-26T23:47:10.722 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:10.716+0000 7f27eb7fe640 1 -- 172.21.15.88:0/3476548459 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27fc019070 con 0x7f280413ddd0 2024-04-26T23:47:10.722 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:10.716+0000 7f27eb7fe640 1 -- 172.21.15.88:0/3476548459 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27fc014800 con 0x7f280413ddd0 2024-04-26T23:47:10.723 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:10.719+0000 7f27eb7fe640 1 -- 172.21.15.88:0/3476548459 <== mon.2 v2:172.21.15.175:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f27fc0149a0 con 0x7f280413ddd0 2024-04-26T23:47:10.723 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:10.719+0000 7f28095e4640 1 -- 172.21.15.88:0/3476548459 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f27e4005290 con 0x7f280413ddd0 2024-04-26T23:47:10.724 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:10.719+0000 7f27eb7fe640 1 --2- 172.21.15.88:0/3476548459 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f27f006c9f0 0x7f27f006eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:10.724 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:10.720+0000 7f27eb7fe640 1 -- 172.21.15.88:0/3476548459 <== mon.2 v2:172.21.15.175:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6666+0+0 (secure 0 0 0) 0x7f27fc08c550 con 0x7f280413ddd0 2024-04-26T23:47:10.725 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:10.721+0000 7f2802ffd640 1 --2- 172.21.15.88:0/3476548459 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f27f006c9f0 0x7f27f006eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:10.725 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:10.721+0000 7f2802ffd640 1 --2- 172.21.15.88:0/3476548459 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f27f006c9f0 0x7f27f006eeb0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f27f8034000 tx=0x7f27f802e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:47:10.732 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:10.728+0000 7f27eb7fe640 1 -- 172.21.15.88:0/3476548459 <== mon.2 v2:172.21.15.175:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f27fc05a630 con 0x7f280413ddd0 2024-04-26T23:47:11.243 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:11.239+0000 7f28095e4640 1 -- 172.21.15.88:0/3476548459 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f27e4005580 con 0x7f280413ddd0 2024-04-26T23:47:11.244 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:11.240+0000 7f27eb7fe640 1 -- 172.21.15.88:0/3476548459 <== mon.2 v2:172.21.15.175:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1559 (secure 0 0 0) 0x7f27fc059f30 con 0x7f280413ddd0 2024-04-26T23:47:11.244 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":62,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":28,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"555255e9-7ef9-4454-8dc9-35e96b70035c","modified":"2024-04-26T23:39:34.291658Z","created":"2024-04-26T23:39:34.291658Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:3300","nonce":0},{"type":"v1","addr":"172.21.15.175:6789","nonce":0}]},"addr":"172.21.15.175:6789/0","public_addr":"172.21.15.175:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:3301","nonce":0},{"type":"v1","addr":"172.21.15.175:6790","nonce":0}]},"addr":"172.21.15.175:6790/0","public_addr":"172.21.15.175:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-04-26T23:47:11.247 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:11.242+0000 7f28095e4640 1 -- 172.21.15.88:0/3476548459 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f27f006c9f0 msgr2=0x7f27f006eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:11.247 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:11.242+0000 7f28095e4640 1 --2- 172.21.15.88:0/3476548459 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f27f006c9f0 0x7f27f006eeb0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f27f8034000 tx=0x7f27f802e000 comp rx=0 tx=0).stop 2024-04-26T23:47:11.247 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:11.242+0000 7f28095e4640 1 -- 172.21.15.88:0/3476548459 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f280413ddd0 msgr2=0x7f2804152eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:11.247 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:11.242+0000 7f28095e4640 1 --2- 172.21.15.88:0/3476548459 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f280413ddd0 0x7f2804152eb0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f27fc009610 tx=0x7f27fc00e4b0 comp rx=0 tx=0).stop 2024-04-26T23:47:11.247 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:11.242+0000 7f28095e4640 1 -- 172.21.15.88:0/3476548459 shutdown_connections 2024-04-26T23:47:11.247 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:11.242+0000 7f28095e4640 1 --2- 172.21.15.88:0/3476548459 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f27f006c9f0 0x7f27f006eeb0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:11.247 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:11.242+0000 7f28095e4640 1 --2- 172.21.15.88:0/3476548459 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f280413ddd0 0x7f2804152eb0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:11.247 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:11.242+0000 7f28095e4640 1 --2- 172.21.15.88:0/3476548459 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2804071cc0 0x7f2804152970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:11.247 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:11.242+0000 7f28095e4640 1 --2- 172.21.15.88:0/3476548459 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2804070f70 0x7f28041f1020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:11.247 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:11.242+0000 7f28095e4640 1 -- 172.21.15.88:0/3476548459 >> 172.21.15.88:0/3476548459 conn(0x7f28040ca2f0 msgr2=0x7f28040c7d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:47:11.248 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:11.243+0000 7f28095e4640 1 -- 172.21.15.88:0/3476548459 shutdown_connections 2024-04-26T23:47:11.248 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:11.243+0000 7f28095e4640 1 -- 172.21.15.88:0/3476548459 wait complete. 2024-04-26T23:47:14.264 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-04-26T23:47:14.442 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:14.437+0000 7f4b70f4e640 1 Processor -- start 2024-04-26T23:47:14.442 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:14.438+0000 7f4b70f4e640 1 -- start start 2024-04-26T23:47:14.444 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:14.439+0000 7f4b70f4e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4b6c0ac090 0x7f4b6c0c4b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:14.444 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:14.439+0000 7f4b70f4e640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f4b6c15e660 0x7f4b6c0c5300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:14.444 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:14.439+0000 7f4b70f4e640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4b6c0c3830 con 0x7f4b6c1588c0 2024-04-26T23:47:14.445 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:14.439+0000 7f4b70f4e640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f4b6c074710 con 0x7f4b6c15e660 2024-04-26T23:47:14.445 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:14.439+0000 7f4b70f4e640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f4b6c0c4680 con 0x7f4b6c0ac090 2024-04-26T23:47:14.445 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:14.439+0000 7f4b69d9b640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4b6c0ac090 0x7f4b6c0c4b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:14.445 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:14.439+0000 7f4b69d9b640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4b6c0ac090 0x7f4b6c0c4b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.88:49286/0 (socket says 172.21.15.88:49286) 2024-04-26T23:47:14.445 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:14.439+0000 7f4b69d9b640 1 -- 172.21.15.88:0/1472539399 learned_addr learned my addr 172.21.15.88:0/1472539399 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:47:14.445 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:14.439+0000 7f4b69d9b640 1 -- 172.21.15.88:0/1472539399 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4b6c0ac090 msgr2=0x7f4b6c0c4b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-26T23:47:14.445 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:14.439+0000 7f4b69d9b640 1 -- 172.21.15.88:0/1472539399 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4b6c0ac090 msgr2=0x7f4b6c0c4b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T23:47:14.445 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:14.439+0000 7f4b69d9b640 1 --2- 172.21.15.88:0/1472539399 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4b6c0ac090 0x7f4b6c0c4b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:47:14.445 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:14.439+0000 7f4b69d9b640 1 --2- 172.21.15.88:0/1472539399 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4b6c0ac090 0x7f4b6c0c4b10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:47:14.445 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:14.439+0000 7f4b6ad9d640 1 --2- 172.21.15.88:0/1472539399 >> v2:172.21.15.88:3300/0 conn(0x7f4b6c15e660 0x7f4b6c0c5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:14.445 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:14.440+0000 7f4b6ad9d640 1 -- 172.21.15.88:0/1472539399 >> v2:172.21.15.88:3300/0 conn(0x7f4b6c15e660 msgr2=0x7f4b6c0c5300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-26T23:47:14.445 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:14.440+0000 7f4b6ad9d640 1 -- 172.21.15.88:0/1472539399 >> v2:172.21.15.88:3300/0 conn(0x7f4b6c15e660 msgr2=0x7f4b6c0c5300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T23:47:14.445 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:14.440+0000 7f4b6ad9d640 1 --2- 172.21.15.88:0/1472539399 >> v2:172.21.15.88:3300/0 conn(0x7f4b6c15e660 0x7f4b6c0c5300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:47:14.445 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:14.440+0000 7f4b6ad9d640 1 --2- 172.21.15.88:0/1472539399 >> v2:172.21.15.88:3300/0 conn(0x7f4b6c15e660 0x7f4b6c0c5300 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:47:14.645 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:14.641+0000 7f4b6ad9d640 1 --2- 172.21.15.88:0/1472539399 >> v2:172.21.15.88:3300/0 conn(0x7f4b6c15e660 0x7f4b6c0c5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:14.646 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:14.641+0000 7f4b6ad9d640 1 -- 172.21.15.88:0/1472539399 >> v2:172.21.15.88:3300/0 conn(0x7f4b6c15e660 msgr2=0x7f4b6c0c5300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-26T23:47:14.646 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:14.641+0000 7f4b6ad9d640 1 -- 172.21.15.88:0/1472539399 >> v2:172.21.15.88:3300/0 conn(0x7f4b6c15e660 msgr2=0x7f4b6c0c5300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T23:47:14.646 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:14.641+0000 7f4b6ad9d640 1 --2- 172.21.15.88:0/1472539399 >> v2:172.21.15.88:3300/0 conn(0x7f4b6c15e660 0x7f4b6c0c5300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:47:14.646 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:14.641+0000 7f4b6ad9d640 1 --2- 172.21.15.88:0/1472539399 >> v2:172.21.15.88:3300/0 conn(0x7f4b6c15e660 0x7f4b6c0c5300 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-26T23:47:14.646 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:14.641+0000 7f4b69d9b640 1 --2- 172.21.15.88:0/1472539399 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4b6c0ac090 0x7f4b6c0c4b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:14.646 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:14.642+0000 7f4b69d9b640 1 -- 172.21.15.88:0/1472539399 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4b6c0ac090 msgr2=0x7f4b6c0c4b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-26T23:47:14.647 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:14.642+0000 7f4b69d9b640 1 -- 172.21.15.88:0/1472539399 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4b6c0ac090 msgr2=0x7f4b6c0c4b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T23:47:14.647 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:14.642+0000 7f4b69d9b640 1 --2- 172.21.15.88:0/1472539399 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4b6c0ac090 0x7f4b6c0c4b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:47:14.647 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:14.642+0000 7f4b69d9b640 1 --2- 172.21.15.88:0/1472539399 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4b6c0ac090 0x7f4b6c0c4b10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-26T23:47:15.046 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:15.042+0000 7f4b6ad9d640 1 --2- 172.21.15.88:0/1472539399 >> v2:172.21.15.88:3300/0 conn(0x7f4b6c15e660 0x7f4b6c0c5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:15.047 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:15.042+0000 7f4b6ad9d640 1 -- 172.21.15.88:0/1472539399 >> v2:172.21.15.88:3300/0 conn(0x7f4b6c15e660 msgr2=0x7f4b6c0c5300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-26T23:47:15.047 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:15.042+0000 7f4b6ad9d640 1 -- 172.21.15.88:0/1472539399 >> v2:172.21.15.88:3300/0 conn(0x7f4b6c15e660 msgr2=0x7f4b6c0c5300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T23:47:15.047 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:15.042+0000 7f4b6ad9d640 1 --2- 172.21.15.88:0/1472539399 >> v2:172.21.15.88:3300/0 conn(0x7f4b6c15e660 0x7f4b6c0c5300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:47:15.047 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:15.042+0000 7f4b6ad9d640 1 --2- 172.21.15.88:0/1472539399 >> v2:172.21.15.88:3300/0 conn(0x7f4b6c15e660 0x7f4b6c0c5300 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-26T23:47:15.047 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:15.043+0000 7f4b69d9b640 1 --2- 172.21.15.88:0/1472539399 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4b6c0ac090 0x7f4b6c0c4b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:15.047 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:15.043+0000 7f4b69d9b640 1 -- 172.21.15.88:0/1472539399 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4b6c0ac090 msgr2=0x7f4b6c0c4b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-26T23:47:15.047 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:15.043+0000 7f4b69d9b640 1 -- 172.21.15.88:0/1472539399 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4b6c0ac090 msgr2=0x7f4b6c0c4b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T23:47:15.047 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:15.043+0000 7f4b69d9b640 1 --2- 172.21.15.88:0/1472539399 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4b6c0ac090 0x7f4b6c0c4b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:47:15.048 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:15.043+0000 7f4b69d9b640 1 --2- 172.21.15.88:0/1472539399 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4b6c0ac090 0x7f4b6c0c4b10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-26T23:47:15.847 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:15.843+0000 7f4b6ad9d640 1 --2- 172.21.15.88:0/1472539399 >> v2:172.21.15.88:3300/0 conn(0x7f4b6c15e660 0x7f4b6c0c5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:15.848 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:15.843+0000 7f4b6ad9d640 1 -- 172.21.15.88:0/1472539399 >> v2:172.21.15.88:3300/0 conn(0x7f4b6c15e660 msgr2=0x7f4b6c0c5300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-26T23:47:15.848 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:15.843+0000 7f4b6ad9d640 1 -- 172.21.15.88:0/1472539399 >> v2:172.21.15.88:3300/0 conn(0x7f4b6c15e660 msgr2=0x7f4b6c0c5300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T23:47:15.848 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:15.843+0000 7f4b6ad9d640 1 --2- 172.21.15.88:0/1472539399 >> v2:172.21.15.88:3300/0 conn(0x7f4b6c15e660 0x7f4b6c0c5300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:47:15.848 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:15.843+0000 7f4b6ad9d640 1 --2- 172.21.15.88:0/1472539399 >> v2:172.21.15.88:3300/0 conn(0x7f4b6c15e660 0x7f4b6c0c5300 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-26T23:47:15.848 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:15.844+0000 7f4b69d9b640 1 --2- 172.21.15.88:0/1472539399 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4b6c0ac090 0x7f4b6c0c4b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:15.848 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:15.844+0000 7f4b69d9b640 1 -- 172.21.15.88:0/1472539399 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4b6c0ac090 msgr2=0x7f4b6c0c4b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-26T23:47:15.849 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:15.844+0000 7f4b69d9b640 1 -- 172.21.15.88:0/1472539399 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4b6c0ac090 msgr2=0x7f4b6c0c4b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T23:47:15.849 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:15.844+0000 7f4b69d9b640 1 --2- 172.21.15.88:0/1472539399 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4b6c0ac090 0x7f4b6c0c4b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:47:15.849 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:15.844+0000 7f4b69d9b640 1 --2- 172.21.15.88:0/1472539399 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4b6c0ac090 0x7f4b6c0c4b10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-26T23:47:17.444 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:17.439+0000 7f4b5bfff640 1 -- 172.21.15.88:0/1472539399 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4b6c0ac090 msgr2=0x7f4b6c0c4b10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T23:47:17.444 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:17.439+0000 7f4b5bfff640 1 --2- 172.21.15.88:0/1472539399 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4b6c0ac090 0x7f4b6c0c4b10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:17.444 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:17.439+0000 7f4b5bfff640 1 -- 172.21.15.88:0/1472539399 >> v2:172.21.15.88:3300/0 conn(0x7f4b6c15e660 msgr2=0x7f4b6c0c5300 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T23:47:17.444 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:17.439+0000 7f4b5bfff640 1 --2- 172.21.15.88:0/1472539399 >> v2:172.21.15.88:3300/0 conn(0x7f4b6c15e660 0x7f4b6c0c5300 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:17.444 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:17.439+0000 7f4b5bfff640 1 -- 172.21.15.88:0/1472539399 >> v1:172.21.15.175:6789/0 conn(0x7f4b6c1588c0 legacy=0x7f4b6c0ab800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:17.444 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:17.439+0000 7f4b5bfff640 1 --2- 172.21.15.88:0/1472539399 >> v2:172.21.15.175:3300/0 conn(0x7f4b4c007350 0x7f4b4c0097f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:17.445 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:17.439+0000 7f4b5bfff640 1 -- 172.21.15.88:0/1472539399 --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4b6c0c3b10 con 0x7f4b4c0036a0 2024-04-26T23:47:17.445 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:17.439+0000 7f4b5bfff640 1 -- 172.21.15.88:0/1472539399 --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f4b6c074710 con 0x7f4b4c007350 2024-04-26T23:47:17.445 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:17.439+0000 7f4b69d9b640 1 --2- 172.21.15.88:0/1472539399 >> v2:172.21.15.175:3300/0 conn(0x7f4b4c007350 0x7f4b4c0097f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:17.445 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:17.439+0000 7f4b69d9b640 1 -- 172.21.15.88:0/1472539399 >> v2:172.21.15.175:3300/0 conn(0x7f4b4c007350 msgr2=0x7f4b4c0097f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-26T23:47:17.445 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:17.439+0000 7f4b69d9b640 1 -- 172.21.15.88:0/1472539399 >> v2:172.21.15.175:3300/0 conn(0x7f4b4c007350 msgr2=0x7f4b4c0097f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T23:47:17.445 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:17.439+0000 7f4b69d9b640 1 --2- 172.21.15.88:0/1472539399 >> v2:172.21.15.175:3300/0 conn(0x7f4b4c007350 0x7f4b4c0097f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:47:17.445 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:17.439+0000 7f4b69d9b640 1 --2- 172.21.15.88:0/1472539399 >> v2:172.21.15.175:3300/0 conn(0x7f4b4c007350 0x7f4b4c0097f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:47:17.644 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:17.640+0000 7f4b69d9b640 1 --2- 172.21.15.88:0/1472539399 >> v2:172.21.15.175:3300/0 conn(0x7f4b4c007350 0x7f4b4c0097f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:17.645 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:17.640+0000 7f4b69d9b640 1 -- 172.21.15.88:0/1472539399 >> v2:172.21.15.175:3300/0 conn(0x7f4b4c007350 msgr2=0x7f4b4c0097f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-26T23:47:17.645 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:17.640+0000 7f4b69d9b640 1 -- 172.21.15.88:0/1472539399 >> v2:172.21.15.175:3300/0 conn(0x7f4b4c007350 msgr2=0x7f4b4c0097f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T23:47:17.645 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:17.640+0000 7f4b69d9b640 1 --2- 172.21.15.88:0/1472539399 >> v2:172.21.15.175:3300/0 conn(0x7f4b4c007350 0x7f4b4c0097f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:47:17.645 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:17.640+0000 7f4b69d9b640 1 --2- 172.21.15.88:0/1472539399 >> v2:172.21.15.175:3300/0 conn(0x7f4b4c007350 0x7f4b4c0097f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-26T23:47:18.045 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:18.041+0000 7f4b69d9b640 1 --2- 172.21.15.88:0/1472539399 >> v2:172.21.15.175:3300/0 conn(0x7f4b4c007350 0x7f4b4c0097f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:18.046 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:18.041+0000 7f4b69d9b640 1 -- 172.21.15.88:0/1472539399 >> v2:172.21.15.175:3300/0 conn(0x7f4b4c007350 msgr2=0x7f4b4c0097f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-26T23:47:18.046 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:18.041+0000 7f4b69d9b640 1 -- 172.21.15.88:0/1472539399 >> v2:172.21.15.175:3300/0 conn(0x7f4b4c007350 msgr2=0x7f4b4c0097f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T23:47:18.046 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:18.041+0000 7f4b69d9b640 1 --2- 172.21.15.88:0/1472539399 >> v2:172.21.15.175:3300/0 conn(0x7f4b4c007350 0x7f4b4c0097f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:47:18.046 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:18.041+0000 7f4b69d9b640 1 --2- 172.21.15.88:0/1472539399 >> v2:172.21.15.175:3300/0 conn(0x7f4b4c007350 0x7f4b4c0097f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-26T23:47:18.846 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:18.842+0000 7f4b69d9b640 1 --2- 172.21.15.88:0/1472539399 >> v2:172.21.15.175:3300/0 conn(0x7f4b4c007350 0x7f4b4c0097f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:18.847 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:18.842+0000 7f4b69d9b640 1 -- 172.21.15.88:0/1472539399 >> v2:172.21.15.175:3300/0 conn(0x7f4b4c007350 msgr2=0x7f4b4c0097f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-26T23:47:18.847 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:18.842+0000 7f4b69d9b640 1 -- 172.21.15.88:0/1472539399 >> v2:172.21.15.175:3300/0 conn(0x7f4b4c007350 msgr2=0x7f4b4c0097f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T23:47:18.847 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:18.842+0000 7f4b69d9b640 1 --2- 172.21.15.88:0/1472539399 >> v2:172.21.15.175:3300/0 conn(0x7f4b4c007350 0x7f4b4c0097f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:47:18.847 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:18.842+0000 7f4b69d9b640 1 --2- 172.21.15.88:0/1472539399 >> v2:172.21.15.175:3300/0 conn(0x7f4b4c007350 0x7f4b4c0097f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-26T23:47:19.587 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:19.583+0000 7f4b6959a640 1 -- 172.21.15.88:0/1472539399 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2031247343 0 0) 0x7f4b6c0c3b10 con 0x7f4b4c0036a0 2024-04-26T23:47:19.588 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:19.583+0000 7f4b6959a640 1 -- 172.21.15.88:0/1472539399 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4b54003520 con 0x7f4b4c0036a0 2024-04-26T23:47:19.599 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:19.594+0000 7f4b6959a640 1 -- 172.21.15.88:0/1472539399 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3738426101 0 0) 0x7f4b54003520 con 0x7f4b4c0036a0 2024-04-26T23:47:19.600 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:19.594+0000 7f4b6959a640 1 -- 172.21.15.88:0/1472539399 >> v2:172.21.15.175:3300/0 conn(0x7f4b4c007350 msgr2=0x7f4b4c0097f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T23:47:19.600 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:19.594+0000 7f4b6959a640 1 --2- 172.21.15.88:0/1472539399 >> v2:172.21.15.175:3300/0 conn(0x7f4b4c007350 0x7f4b4c0097f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:19.600 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:19.594+0000 7f4b6959a640 1 -- 172.21.15.88:0/1472539399 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b4c00af60 con 0x7f4b4c0036a0 2024-04-26T23:47:19.600 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:19.594+0000 7f4b6959a640 1 -- 172.21.15.88:0/1472539399 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 356324787 0 0) 0x7f4b600016f0 con 0x7f4b4c0036a0 2024-04-26T23:47:19.600 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:19.595+0000 7f4b6959a640 1 -- 172.21.15.88:0/1472539399 >> v1:172.21.15.88:6789/0 conn(0x7f4b4c0036a0 legacy=0x7f4b4c005b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:19.600 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:19.595+0000 7f4b6959a640 1 --2- 172.21.15.88:0/1472539399 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4b6c0ac090 0x7f4b540039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:19.600 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:19.595+0000 7f4b6959a640 1 --2- 172.21.15.88:0/1472539399 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4b54004010 0x7f4b54004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:19.600 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:19.595+0000 7f4b6ad9d640 1 -- 172.21.15.88:0/1472539399 reap_dead start 2024-04-26T23:47:19.600 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:19.595+0000 7f4b6959a640 1 --2- 172.21.15.88:0/1472539399 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4b54004d90 0x7f4b54005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:19.600 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:19.595+0000 7f4b6959a640 1 -- 172.21.15.88:0/1472539399 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f4b6c074710 con 0x7f4b54004d90 2024-04-26T23:47:19.600 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:19.595+0000 7f4b6959a640 1 -- 172.21.15.88:0/1472539399 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f4b5400bca0 con 0x7f4b54004010 2024-04-26T23:47:19.600 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:19.595+0000 7f4b6959a640 1 -- 172.21.15.88:0/1472539399 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f4b5400bea0 con 0x7f4b6c0ac090 2024-04-26T23:47:19.600 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:19.595+0000 7f4b6a59c640 1 --2- 172.21.15.88:0/1472539399 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4b6c0ac090 0x7f4b540039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:19.600 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:19.595+0000 7f4b69d9b640 1 --2- 172.21.15.88:0/1472539399 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4b54004010 0x7f4b54004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:19.601 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:19.595+0000 7f4b6ad9d640 1 --2- 172.21.15.88:0/1472539399 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4b54004d90 0x7f4b54005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:19.601 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:19.596+0000 7f4b69d9b640 1 -- 172.21.15.88:0/1472539399 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4b6c0ac090 msgr2=0x7f4b540039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:47:19.601 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:19.596+0000 7f4b69d9b640 1 --2- 172.21.15.88:0/1472539399 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4b6c0ac090 0x7f4b540039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:19.601 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:19.596+0000 7f4b69d9b640 1 -- 172.21.15.88:0/1472539399 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4b54004d90 msgr2=0x7f4b54005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:47:19.601 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:19.596+0000 7f4b69d9b640 1 --2- 172.21.15.88:0/1472539399 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4b54004d90 0x7f4b54005210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:19.602 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:19.596+0000 7f4b69d9b640 1 -- 172.21.15.88:0/1472539399 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b4c00af60 con 0x7f4b54004010 2024-04-26T23:47:19.602 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:19.597+0000 7f4b69d9b640 1 --2- 172.21.15.88:0/1472539399 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4b54004010 0x7f4b54004800 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f4b6c0ac490 tx=0x7f4b54005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=28dfa2a840e1a9c9 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:47:19.605 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:19.599+0000 7f4b6959a640 1 -- 172.21.15.88:0/1472539399 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b5c039070 con 0x7f4b54004010 2024-04-26T23:47:19.605 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:19.600+0000 7f4b6959a640 1 -- 172.21.15.88:0/1472539399 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b5c02c820 con 0x7f4b54004010 2024-04-26T23:47:19.605 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:19.600+0000 7f4b70f4e640 1 -- 172.21.15.88:0/1472539399 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4b54004010 msgr2=0x7f4b54004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:19.605 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:19.600+0000 7f4b70f4e640 1 --2- 172.21.15.88:0/1472539399 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4b54004010 0x7f4b54004800 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f4b6c0ac490 tx=0x7f4b54005830 comp rx=0 tx=0).stop 2024-04-26T23:47:19.605 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:19.601+0000 7f4b6959a640 1 -- 172.21.15.88:0/1472539399 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b5c00f040 con 0x7f4b54004010 2024-04-26T23:47:19.605 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:19.601+0000 7f4b70f4e640 1 -- 172.21.15.88:0/1472539399 shutdown_connections 2024-04-26T23:47:19.606 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:19.601+0000 7f4b70f4e640 1 --2- 172.21.15.88:0/1472539399 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4b54004d90 0x7f4b54005210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:19.606 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:19.601+0000 7f4b70f4e640 1 --2- 172.21.15.88:0/1472539399 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4b54004010 0x7f4b54004800 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:19.606 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:19.601+0000 7f4b70f4e640 1 --2- 172.21.15.88:0/1472539399 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4b6c0ac090 0x7f4b540039b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:19.606 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:19.601+0000 7f4b70f4e640 1 -- 172.21.15.88:0/1472539399 >> 172.21.15.88:0/1472539399 conn(0x7f4b6c0c89b0 msgr2=0x7f4b6c0c8dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:47:19.606 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:19.601+0000 7f4b70f4e640 1 -- 172.21.15.88:0/1472539399 shutdown_connections 2024-04-26T23:47:19.607 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:19.601+0000 7f4b70f4e640 1 -- 172.21.15.88:0/1472539399 wait complete. 2024-04-26T23:47:19.607 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:19.603+0000 7f4b70f4e640 1 Processor -- start 2024-04-26T23:47:19.607 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:19.603+0000 7f4b70f4e640 1 -- start start 2024-04-26T23:47:19.610 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:19.604+0000 7f4b70f4e640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4b54004010 0x7f4b6c154a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:19.610 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:19.604+0000 7f4b70f4e640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4b54004d90 0x7f4b6c155800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:19.610 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:19.605+0000 7f4b6a59c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4b54004010 0x7f4b6c154a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:19.610 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:19.605+0000 7f4b6a59c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4b54004010 0x7f4b6c154a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:52528/0 (socket says 172.21.15.88:52528) 2024-04-26T23:47:19.610 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:19.605+0000 7f4b6a59c640 1 -- 172.21.15.88:0/3205427848 learned_addr learned my addr 172.21.15.88:0/3205427848 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:47:19.610 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:19.605+0000 7f4b70f4e640 1 --2- 172.21.15.88:0/3205427848 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4b6c0ac090 0x7f4b6c152010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:19.610 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:19.605+0000 7f4b69d9b640 1 --2- 172.21.15.88:0/3205427848 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4b54004d90 0x7f4b6c155800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:19.610 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:19.605+0000 7f4b70f4e640 1 -- 172.21.15.88:0/3205427848 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f4b6c158ca0 con 0x7f4b54004010 2024-04-26T23:47:19.610 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:19.605+0000 7f4b70f4e640 1 -- 172.21.15.88:0/3205427848 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f4b6c0c3df0 con 0x7f4b54004d90 2024-04-26T23:47:19.610 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:19.605+0000 7f4b70f4e640 1 -- 172.21.15.88:0/3205427848 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f4b6c15ead0 con 0x7f4b6c0ac090 2024-04-26T23:47:19.610 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:19.605+0000 7f4b6ad9d640 1 --2- 172.21.15.88:0/3205427848 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4b6c0ac090 0x7f4b6c152010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:19.612 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:19.607+0000 7f4b6a59c640 1 -- 172.21.15.88:0/3205427848 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4b6c0ac090 msgr2=0x7f4b6c152010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:19.612 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:19.607+0000 7f4b6a59c640 1 --2- 172.21.15.88:0/3205427848 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4b6c0ac090 0x7f4b6c152010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:19.612 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:19.607+0000 7f4b6a59c640 1 -- 172.21.15.88:0/3205427848 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4b54004d90 msgr2=0x7f4b6c155800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:19.612 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:19.607+0000 7f4b6a59c640 1 --2- 172.21.15.88:0/3205427848 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4b54004d90 0x7f4b6c155800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:19.612 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:19.607+0000 7f4b6a59c640 1 -- 172.21.15.88:0/3205427848 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b6c1f0f30 con 0x7f4b54004010 2024-04-26T23:47:19.612 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:19.608+0000 7f4b6a59c640 1 --2- 172.21.15.88:0/3205427848 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4b54004010 0x7f4b6c154a50 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f4b60001280 tx=0x7f4b6000fd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:47:19.614 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:19.608+0000 7f4b5affd640 1 -- 172.21.15.88:0/3205427848 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b600052e0 con 0x7f4b54004010 2024-04-26T23:47:19.614 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:19.608+0000 7f4b5affd640 1 -- 172.21.15.88:0/3205427848 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b60018070 con 0x7f4b54004010 2024-04-26T23:47:19.614 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:19.608+0000 7f4b5affd640 1 -- 172.21.15.88:0/3205427848 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b6000d970 con 0x7f4b54004010 2024-04-26T23:47:19.614 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:19.609+0000 7f4b70f4e640 1 -- 172.21.15.88:0/3205427848 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b6c1f1210 con 0x7f4b54004010 2024-04-26T23:47:19.614 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:19.609+0000 7f4b70f4e640 1 -- 172.21.15.88:0/3205427848 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b6c154250 con 0x7f4b54004010 2024-04-26T23:47:19.620 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:19.616+0000 7f4b70f4e640 1 -- 172.21.15.88:0/3205427848 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b6c153d80 con 0x7f4b54004010 2024-04-26T23:47:19.621 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:19.616+0000 7f4b5affd640 1 -- 172.21.15.88:0/3205427848 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4b6000db10 con 0x7f4b54004010 2024-04-26T23:47:19.621 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:19.617+0000 7f4b5affd640 1 --2- 172.21.15.88:0/3205427848 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f4b4c06d550 0x7f4b4c06fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:19.622 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:19.617+0000 7f4b69d9b640 1 --2- 172.21.15.88:0/3205427848 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f4b4c06d550 0x7f4b4c06fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:19.622 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:19.617+0000 7f4b5affd640 1 -- 172.21.15.88:0/3205427848 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6666+0+0 (secure 0 0 0) 0x7f4b6008c010 con 0x7f4b54004010 2024-04-26T23:47:19.622 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:19.618+0000 7f4b69d9b640 1 --2- 172.21.15.88:0/3205427848 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f4b4c06d550 0x7f4b4c06fa10 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f4b5c036000 tx=0x7f4b5c030000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:47:19.630 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:19.625+0000 7f4b5affd640 1 -- 172.21.15.88:0/3205427848 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f4b6005a0f0 con 0x7f4b54004010 2024-04-26T23:47:20.182 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:20.177+0000 7f4b70f4e640 1 -- 172.21.15.88:0/3205427848 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f4b6c076100 con 0x7f4b54004010 2024-04-26T23:47:20.182 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:20.178+0000 7f4b5affd640 1 -- 172.21.15.88:0/3205427848 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1564 (secure 0 0 0) 0x7f4b600599f0 con 0x7f4b54004010 2024-04-26T23:47:20.193 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":70,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"555255e9-7ef9-4454-8dc9-35e96b70035c","modified":"2024-04-26T23:39:34.291658Z","created":"2024-04-26T23:39:34.291658Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:3300","nonce":0},{"type":"v1","addr":"172.21.15.175:6789","nonce":0}]},"addr":"172.21.15.175:6789/0","public_addr":"172.21.15.175:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:3301","nonce":0},{"type":"v1","addr":"172.21.15.175:6790","nonce":0}]},"addr":"172.21.15.175:6790/0","public_addr":"172.21.15.175:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-04-26T23:47:20.196 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:20.192+0000 7f4b70f4e640 1 -- 172.21.15.88:0/3205427848 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f4b4c06d550 msgr2=0x7f4b4c06fa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:20.196 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:20.192+0000 7f4b70f4e640 1 --2- 172.21.15.88:0/3205427848 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f4b4c06d550 0x7f4b4c06fa10 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f4b5c036000 tx=0x7f4b5c030000 comp rx=0 tx=0).stop 2024-04-26T23:47:20.196 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:20.192+0000 7f4b70f4e640 1 -- 172.21.15.88:0/3205427848 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4b54004010 msgr2=0x7f4b6c154a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:20.197 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:20.192+0000 7f4b70f4e640 1 --2- 172.21.15.88:0/3205427848 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4b54004010 0x7f4b6c154a50 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f4b60001280 tx=0x7f4b6000fd70 comp rx=0 tx=0).stop 2024-04-26T23:47:20.197 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:20.193+0000 7f4b70f4e640 1 -- 172.21.15.88:0/3205427848 shutdown_connections 2024-04-26T23:47:20.197 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:20.193+0000 7f4b70f4e640 1 --2- 172.21.15.88:0/3205427848 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f4b4c06d550 0x7f4b4c06fa10 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:20.197 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:20.193+0000 7f4b70f4e640 1 --2- 172.21.15.88:0/3205427848 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4b6c0ac090 0x7f4b6c152010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:20.197 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:20.193+0000 7f4b70f4e640 1 --2- 172.21.15.88:0/3205427848 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4b54004d90 0x7f4b6c155800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:20.197 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:20.193+0000 7f4b70f4e640 1 --2- 172.21.15.88:0/3205427848 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4b54004010 0x7f4b6c154a50 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:20.197 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:20.193+0000 7f4b70f4e640 1 -- 172.21.15.88:0/3205427848 >> 172.21.15.88:0/3205427848 conn(0x7f4b6c0c89b0 msgr2=0x7f4b6c0ac470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:47:20.197 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:20.193+0000 7f4b70f4e640 1 -- 172.21.15.88:0/3205427848 shutdown_connections 2024-04-26T23:47:20.198 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:20.193+0000 7f4b70f4e640 1 -- 172.21.15.88:0/3205427848 wait complete. 2024-04-26T23:47:20.229 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-04-26T23:47:20.229 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-04-26T23:47:20.229 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-04-26T23:47:20.505 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:20.500+0000 7f908ee31640 1 Processor -- start 2024-04-26T23:47:20.505 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:20.501+0000 7f908ee31640 1 -- start start 2024-04-26T23:47:20.507 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:20.502+0000 7f908ee31640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f908000b7f0 0x7f9080046750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:20.507 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:20.502+0000 7f908ee31640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9080007960 0x7f90800daee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:20.507 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:20.502+0000 7f908ee31640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9080006ea0 con 0x7f9080007310 2024-04-26T23:47:20.507 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:20.502+0000 7f908ee31640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f908004b190 con 0x7f908000b7f0 2024-04-26T23:47:20.507 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:20.502+0000 7f908ee31640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f9080048000 con 0x7f9080007960 2024-04-26T23:47:20.507 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:20.502+0000 7f908d62e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9080007960 0x7f90800daee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:20.507 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:20.502+0000 7f908d62e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9080007960 0x7f90800daee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.88:38206/0 (socket says 172.21.15.88:38206) 2024-04-26T23:47:20.507 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:20.502+0000 7f908d62e640 1 -- 172.21.15.88:0/804016278 learned_addr learned my addr 172.21.15.88:0/804016278 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:47:20.507 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:20.502+0000 7f908de2f640 1 --2- 172.21.15.88:0/804016278 >> v2:172.21.15.88:3300/0 conn(0x7f908000b7f0 0x7f9080046750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:20.507 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:20.502+0000 7f908d62e640 1 -- 172.21.15.88:0/804016278 >> v2:172.21.15.88:3300/0 conn(0x7f908000b7f0 msgr2=0x7f9080046750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:47:20.508 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:20.502+0000 7f908d62e640 1 --2- 172.21.15.88:0/804016278 >> v2:172.21.15.88:3300/0 conn(0x7f908000b7f0 0x7f9080046750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:20.508 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:20.503+0000 7f908d62e640 1 -- 172.21.15.88:0/804016278 >> v1:172.21.15.88:6789/0 conn(0x7f9080007310 legacy=0x7f90800d77f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:20.508 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:20.503+0000 7f908d62e640 1 -- 172.21.15.88:0/804016278 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90800482e0 con 0x7f9080007960 2024-04-26T23:47:20.508 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:20.504+0000 7f908d62e640 1 --2- 172.21.15.88:0/804016278 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9080007960 0x7f90800daee0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f9088051fc0 tx=0x7f90880a7250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8c2d59cd3a123796 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:47:20.509 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:20.505+0000 7f908ce2d640 1 -- 172.21.15.88:0/804016278 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90880b4070 con 0x7f9080007960 2024-04-26T23:47:20.510 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:20.506+0000 7f908ce2d640 1 -- 172.21.15.88:0/804016278 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90880af680 con 0x7f9080007960 2024-04-26T23:47:20.510 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:20.506+0000 7f908ce2d640 1 -- 172.21.15.88:0/804016278 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90880a7e60 con 0x7f9080007960 2024-04-26T23:47:20.511 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:20.507+0000 7f908ee31640 1 -- 172.21.15.88:0/804016278 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9080007960 msgr2=0x7f90800daee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:20.511 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:20.507+0000 7f908ee31640 1 --2- 172.21.15.88:0/804016278 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9080007960 0x7f90800daee0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f9088051fc0 tx=0x7f90880a7250 comp rx=0 tx=0).stop 2024-04-26T23:47:20.512 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:20.508+0000 7f908ee31640 1 -- 172.21.15.88:0/804016278 shutdown_connections 2024-04-26T23:47:20.512 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:20.508+0000 7f908ee31640 1 --2- 172.21.15.88:0/804016278 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9080007960 0x7f90800daee0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:20.512 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:20.508+0000 7f908ee31640 1 --2- 172.21.15.88:0/804016278 >> v2:172.21.15.88:3300/0 conn(0x7f908000b7f0 0x7f9080046750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:20.512 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:20.508+0000 7f908ee31640 1 -- 172.21.15.88:0/804016278 >> 172.21.15.88:0/804016278 conn(0x7f90800062e0 msgr2=0x7f90800066f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:47:20.512 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:20.508+0000 7f908ee31640 1 -- 172.21.15.88:0/804016278 shutdown_connections 2024-04-26T23:47:20.514 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:20.508+0000 7f908ee31640 1 -- 172.21.15.88:0/804016278 wait complete. 2024-04-26T23:47:20.514 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:20.510+0000 7f908ee31640 1 Processor -- start 2024-04-26T23:47:20.515 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:20.510+0000 7f908ee31640 1 -- start start 2024-04-26T23:47:20.515 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:20.511+0000 7f908ee31640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9080007310 0x7f9080177440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:20.517 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:20.511+0000 7f908ee31640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9080007960 0x7f908003ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:20.517 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:20.512+0000 7f908ee31640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f908000b7f0 0x7f9080041950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:20.517 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:20.512+0000 7f908de2f640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9080007310 0x7f9080177440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:20.517 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:20.512+0000 7f908de2f640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9080007310 0x7f9080177440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:52544/0 (socket says 172.21.15.88:52544) 2024-04-26T23:47:20.517 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:20.512+0000 7f908de2f640 1 -- 172.21.15.88:0/498620337 learned_addr learned my addr 172.21.15.88:0/498620337 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:47:20.517 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:20.512+0000 7f908ee31640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f9080004c80 con 0x7f9080007310 2024-04-26T23:47:20.517 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:20.512+0000 7f908ee31640 1 -- 172.21.15.88:0/498620337 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f9080004b00 con 0x7f9080007960 2024-04-26T23:47:20.517 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:20.512+0000 7f908ee31640 1 -- 172.21.15.88:0/498620337 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f908000bbd0 con 0x7f908000b7f0 2024-04-26T23:47:20.517 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:20.513+0000 7f908e630640 1 --2- 172.21.15.88:0/498620337 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f908000b7f0 0x7f9080041950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:20.518 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:20.513+0000 7f908de2f640 1 -- 172.21.15.88:0/498620337 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f908000b7f0 msgr2=0x7f9080041950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:20.518 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:20.513+0000 7f908de2f640 1 --2- 172.21.15.88:0/498620337 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f908000b7f0 0x7f9080041950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:20.518 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:20.513+0000 7f908de2f640 1 -- 172.21.15.88:0/498620337 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9080007960 msgr2=0x7f908003ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:20.518 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:20.513+0000 7f908de2f640 1 --2- 172.21.15.88:0/498620337 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9080007960 0x7f908003ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:20.519 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:20.513+0000 7f908de2f640 1 -- 172.21.15.88:0/498620337 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f908003f8f0 con 0x7f9080007310 2024-04-26T23:47:20.519 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:20.513+0000 7f908de2f640 1 --2- 172.21.15.88:0/498620337 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9080007310 0x7f9080177440 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f907800d5f0 tx=0x7f907800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:47:20.519 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:20.514+0000 7f907e7fc640 1 -- 172.21.15.88:0/498620337 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90780125f0 con 0x7f9080007310 2024-04-26T23:47:20.519 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:20.514+0000 7f907e7fc640 1 -- 172.21.15.88:0/498620337 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9078019070 con 0x7f9080007310 2024-04-26T23:47:20.519 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:20.514+0000 7f907e7fc640 1 -- 172.21.15.88:0/498620337 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90780129b0 con 0x7f9080007310 2024-04-26T23:47:20.520 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:20.514+0000 7f908ee31640 1 -- 172.21.15.88:0/498620337 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90800d8db0 con 0x7f9080007310 2024-04-26T23:47:20.520 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:20.514+0000 7f908ee31640 1 -- 172.21.15.88:0/498620337 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f908003f3a0 con 0x7f9080007310 2024-04-26T23:47:20.520 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:20.515+0000 7f908ee31640 1 --2- 172.21.15.88:0/498620337 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f90800ce7c0 0x7f90800cdcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:20.520 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:20.515+0000 7f908ee31640 1 -- 172.21.15.88:0/498620337 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f90800d6fb0 con 0x7f90800ce7c0 2024-04-26T23:47:20.520 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:20.515+0000 7f908d62e640 1 --2- 172.21.15.88:0/498620337 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f90800ce7c0 0x7f90800cdcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:20.520 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:20.516+0000 7f908d62e640 1 -- 172.21.15.88:0/498620337 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f90800057e0 con 0x7f90800ce7c0 2024-04-26T23:47:20.521 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:20.516+0000 7f908d62e640 1 --2- 172.21.15.88:0/498620337 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f90800ce7c0 0x7f90800cdcc0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f9088069b60 tx=0x7f90880a7250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:47:20.521 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:20.516+0000 7f907e7fc640 1 -- 172.21.15.88:0/498620337 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f9078012b50 con 0x7f9080007310 2024-04-26T23:47:20.522 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:20.517+0000 7f907e7fc640 1 --2- 172.21.15.88:0/498620337 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f906c06c970 0x7f906c06ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:20.522 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:20.517+0000 7f907e7fc640 1 -- 172.21.15.88:0/498620337 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6666+0+0 (secure 0 0 0) 0x7f907808c1a0 con 0x7f9080007310 2024-04-26T23:47:20.522 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:20.517+0000 7f907e7fc640 1 -- 172.21.15.88:0/498620337 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90880b4040 con 0x7f90800ce7c0 2024-04-26T23:47:20.522 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:20.517+0000 7f907e7fc640 1 -- 172.21.15.88:0/498620337 <== mon.0 v2:172.21.15.88:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f90880ba440 con 0x7f90800ce7c0 2024-04-26T23:47:20.522 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:20.517+0000 7f907e7fc640 1 -- 172.21.15.88:0/498620337 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f90800ce7c0 msgr2=0x7f90800cdcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:20.523 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:20.517+0000 7f907e7fc640 1 --2- 172.21.15.88:0/498620337 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f90800ce7c0 0x7f90800cdcc0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f9088069b60 tx=0x7f90880a7250 comp rx=0 tx=0).stop 2024-04-26T23:47:20.523 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:20.517+0000 7f907e7fc640 1 -- 172.21.15.88:0/498620337 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f90800ce7c0 msgr2=0x7f90800cdcc0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:47:20.523 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:20.517+0000 7f907e7fc640 1 --2- 172.21.15.88:0/498620337 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f90800ce7c0 0x7f90800cdcc0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:20.523 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:20.518+0000 7f908e630640 1 --2- 172.21.15.88:0/498620337 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f906c06c970 0x7f906c06ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:20.527 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:20.522+0000 7f908e630640 1 --2- 172.21.15.88:0/498620337 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f906c06c970 0x7f906c06ee30 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f908002b670 tx=0x7f9084009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:47:20.539 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:20.535+0000 7f908ee31640 1 --2- 172.21.15.88:0/498620337 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f90800ce200 0x7f90800ceeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:20.540 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:20.535+0000 7f908ee31640 1 -- 172.21.15.88:0/498620337 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f90800ce620 con 0x7f90800ce200 2024-04-26T23:47:20.540 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:20.535+0000 7f908d62e640 1 --2- 172.21.15.88:0/498620337 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f90800ce200 0x7f90800ceeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:20.540 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:20.536+0000 7f908d62e640 1 -- 172.21.15.88:0/498620337 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f90800d8b60 con 0x7f90800ce200 2024-04-26T23:47:20.541 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:20.536+0000 7f908d62e640 1 --2- 172.21.15.88:0/498620337 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f90800ce200 0x7f90800ceeb0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f908806acf0 tx=0x7f90880ac000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:47:20.542 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:20.538+0000 7f907e7fc640 1 -- 172.21.15.88:0/498620337 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90880b4050 con 0x7f90800ce200 2024-04-26T23:47:20.542 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:20.538+0000 7f907e7fc640 1 -- 172.21.15.88:0/498620337 <== mon.0 v2:172.21.15.88:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4556 (secure 0 0 0) 0x7f90880b8e50 con 0x7f90800ce200 2024-04-26T23:47:20.542 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:20.538+0000 7f907e7fc640 1 -- 172.21.15.88:0/498620337 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f90800ce200 msgr2=0x7f90800ceeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:20.542 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:20.538+0000 7f907e7fc640 1 --2- 172.21.15.88:0/498620337 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f90800ce200 0x7f90800ceeb0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f908806acf0 tx=0x7f90880ac000 comp rx=0 tx=0).stop 2024-04-26T23:47:20.542 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:20.538+0000 7f907e7fc640 1 -- 172.21.15.88:0/498620337 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f90800ce200 msgr2=0x7f90800ceeb0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:47:20.542 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:20.538+0000 7f907e7fc640 1 --2- 172.21.15.88:0/498620337 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f90800ce200 0x7f90800ceeb0 secure :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f908806acf0 tx=0x7f90880ac000 comp rx=0 tx=0).stop 2024-04-26T23:47:20.547 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-04-26T23:47:20.547 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2024-04-26T23:47:20.547 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2024-04-26T23:47:20.547 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "leader", 2024-04-26T23:47:20.547 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 70, 2024-04-26T23:47:20.548 INFO:teuthology.orchestra.run.smithi088.stdout: "uptime": 13604, 2024-04-26T23:47:20.548 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2024-04-26T23:47:20.548 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2024-04-26T23:47:20.548 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2024-04-26T23:47:20.548 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2024-04-26T23:47:20.548 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:47:20.548 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 0, 2024-04-26T23:47:20.548 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2024-04-26T23:47:20.548 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2450521708007866372", 2024-04-26T23:47:20.548 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2024-04-26T23:47:20.548 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-04-26T23:47:20.548 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-04-26T23:47:20.549 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-04-26T23:47:20.549 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-04-26T23:47:20.549 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-04-26T23:47:20.549 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-04-26T23:47:20.549 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-04-26T23:47:20.549 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-04-26T23:47:20.549 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-04-26T23:47:20.549 INFO:teuthology.orchestra.run.smithi088.stdout: "reef", 2024-04-26T23:47:20.549 INFO:teuthology.orchestra.run.smithi088.stdout: "squid" 2024-04-26T23:47:20.549 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:47:20.549 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540701547738038271", 2024-04-26T23:47:20.549 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2024-04-26T23:47:20.549 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-04-26T23:47:20.549 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-04-26T23:47:20.549 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-04-26T23:47:20.550 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-04-26T23:47:20.550 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-04-26T23:47:20.550 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-04-26T23:47:20.550 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-04-26T23:47:20.550 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-04-26T23:47:20.550 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-04-26T23:47:20.550 INFO:teuthology.orchestra.run.smithi088.stdout: "reef", 2024-04-26T23:47:20.550 INFO:teuthology.orchestra.run.smithi088.stdout: "squid" 2024-04-26T23:47:20.550 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:47:20.550 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:47:20.550 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2024-04-26T23:47:20.550 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2024-04-26T23:47:20.550 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2024-04-26T23:47:20.550 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2024-04-26T23:47:20.550 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2024-04-26T23:47:20.551 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "555255e9-7ef9-4454-8dc9-35e96b70035c", 2024-04-26T23:47:20.551 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2024-04-26T23:39:34.291658Z", 2024-04-26T23:47:20.551 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2024-04-26T23:39:34.291658Z", 2024-04-26T23:47:20.551 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 19, 2024-04-26T23:47:20.551 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "squid", 2024-04-26T23:47:20.551 INFO:teuthology.orchestra.run.smithi088.stdout: "election_strategy": 1, 2024-04-26T23:47:20.551 INFO:teuthology.orchestra.run.smithi088.stdout: "disallowed_leaders: ": "", 2024-04-26T23:47:20.551 INFO:teuthology.orchestra.run.smithi088.stdout: "stretch_mode": false, 2024-04-26T23:47:20.551 INFO:teuthology.orchestra.run.smithi088.stdout: "tiebreaker_mon": "", 2024-04-26T23:47:20.551 INFO:teuthology.orchestra.run.smithi088.stdout: "removed_ranks: ": "", 2024-04-26T23:47:20.551 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2024-04-26T23:47:20.551 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2024-04-26T23:47:20.551 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-04-26T23:47:20.551 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-04-26T23:47:20.551 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-04-26T23:47:20.552 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-04-26T23:47:20.552 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-04-26T23:47:20.552 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-04-26T23:47:20.552 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-04-26T23:47:20.552 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-04-26T23:47:20.552 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-04-26T23:47:20.552 INFO:teuthology.orchestra.run.smithi088.stdout: "reef", 2024-04-26T23:47:20.552 INFO:teuthology.orchestra.run.smithi088.stdout: "squid" 2024-04-26T23:47:20.552 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:47:20.552 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2024-04-26T23:47:20.552 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:47:20.552 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2024-04-26T23:47:20.552 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:47:20.552 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2024-04-26T23:47:20.552 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2024-04-26T23:47:20.553 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-04-26T23:47:20.553 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-04-26T23:47:20.553 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:47:20.553 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-04-26T23:47:20.553 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2024-04-26T23:47:20.553 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:47:20.553 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:47:20.553 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:47:20.553 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-04-26T23:47:20.553 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2024-04-26T23:47:20.553 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:47:20.553 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:47:20.553 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:47:20.553 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:47:20.553 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2024-04-26T23:47:20.554 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2024-04-26T23:47:20.554 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-04-26T23:47:20.554 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-04-26T23:47:20.554 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-04-26T23:47:20.554 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:47:20.554 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:47:20.554 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2024-04-26T23:47:20.554 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2024-04-26T23:47:20.554 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-04-26T23:47:20.554 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-04-26T23:47:20.554 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:47:20.554 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-04-26T23:47:20.554 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:3300", 2024-04-26T23:47:20.554 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:47:20.555 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:47:20.555 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:47:20.555 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-04-26T23:47:20.555 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6789", 2024-04-26T23:47:20.555 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:47:20.555 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:47:20.555 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:47:20.555 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:47:20.555 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6789/0", 2024-04-26T23:47:20.555 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.175:6789/0", 2024-04-26T23:47:20.555 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-04-26T23:47:20.555 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-04-26T23:47:20.555 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-04-26T23:47:20.555 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:47:20.556 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:47:20.556 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2024-04-26T23:47:20.556 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2024-04-26T23:47:20.556 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-04-26T23:47:20.556 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-04-26T23:47:20.556 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:47:20.556 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-04-26T23:47:20.556 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:3301", 2024-04-26T23:47:20.556 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:47:20.556 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:47:20.556 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:47:20.556 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-04-26T23:47:20.556 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6790", 2024-04-26T23:47:20.556 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:47:20.556 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:47:20.557 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:47:20.557 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:47:20.557 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6790/0", 2024-04-26T23:47:20.557 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.175:6790/0", 2024-04-26T23:47:20.557 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-04-26T23:47:20.557 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-04-26T23:47:20.557 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-04-26T23:47:20.557 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:47:20.557 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:47:20.557 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:47:20.557 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2024-04-26T23:47:20.557 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2024-04-26T23:47:20.557 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:47:20.557 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:47:20.557 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:47:20.557 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2024-04-26T23:47:20.558 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:47:20.558 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:47:20.558 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2024-04-26T23:47:20.558 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:47:20.558 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:47:20.558 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:47:20.558 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2024-04-26T23:47:20.558 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:47:20.558 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:47:20.558 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:47:20.558 INFO:teuthology.orchestra.run.smithi088.stdout: "stretch_mode": false 2024-04-26T23:47:20.559 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-04-26T23:47:20.559 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:20.546+0000 7f908ee31640 1 -- 172.21.15.88:0/498620337 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f906c06c970 msgr2=0x7f906c06ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:20.559 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:20.546+0000 7f908ee31640 1 --2- 172.21.15.88:0/498620337 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f906c06c970 0x7f906c06ee30 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f908002b670 tx=0x7f9084009040 comp rx=0 tx=0).stop 2024-04-26T23:47:20.560 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:20.547+0000 7f908e630640 1 -- 172.21.15.88:0/498620337 reap_dead start 2024-04-26T23:47:20.560 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:20.547+0000 7f908ee31640 1 -- 172.21.15.88:0/498620337 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9080007310 msgr2=0x7f9080177440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:20.560 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:20.547+0000 7f908ee31640 1 --2- 172.21.15.88:0/498620337 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9080007310 0x7f9080177440 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f907800d5f0 tx=0x7f907800dab0 comp rx=0 tx=0).stop 2024-04-26T23:47:20.560 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:20.554+0000 7f908ee31640 1 -- 172.21.15.88:0/498620337 shutdown_connections 2024-04-26T23:47:20.560 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:20.554+0000 7f908ee31640 1 --2- 172.21.15.88:0/498620337 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9080007310 0x7f9080177440 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:20.560 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:20.554+0000 7f908ee31640 1 -- 172.21.15.88:0/498620337 >> 172.21.15.88:0/498620337 conn(0x7f90800062e0 msgr2=0x7f90800d68a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:47:20.560 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:20.556+0000 7f908ee31640 1 -- 172.21.15.88:0/498620337 shutdown_connections 2024-04-26T23:47:20.561 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:20.556+0000 7f908ee31640 1 -- 172.21.15.88:0/498620337 wait complete. 2024-04-26T23:47:20.594 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-04-26T23:47:20.594 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-04-26T23:47:20.594 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-04-26T23:47:20.848 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:20.837+0000 7fb6777a4640 1 Processor -- start 2024-04-26T23:47:20.848 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:20.837+0000 7fb6777a4640 1 -- start start 2024-04-26T23:47:20.848 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:20.839+0000 7fb6777a4640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fb6700c5880 0x7fb670167940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:20.848 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:20.839+0000 7fb6777a4640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb6700ad550 0x7fb67006e160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:20.849 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:20.839+0000 7fb6777a4640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb67006e6a0 con 0x7fb6700c4730 2024-04-26T23:47:20.849 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:20.839+0000 7fb6777a4640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7fb6700ad0c0 con 0x7fb6700c5880 2024-04-26T23:47:20.849 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:20.839+0000 7fb6777a4640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fb67006dc40 con 0x7fb6700ad550 2024-04-26T23:47:20.849 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:20.839+0000 7fb674d3f640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb6700ad550 0x7fb67006e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:20.849 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:20.839+0000 7fb674d3f640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb6700ad550 0x7fb67006e160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.88:38220/0 (socket says 172.21.15.88:38220) 2024-04-26T23:47:20.849 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:20.839+0000 7fb674d3f640 1 -- 172.21.15.88:0/2273808998 learned_addr learned my addr 172.21.15.88:0/2273808998 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:47:20.849 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:20.839+0000 7fb675540640 1 --2- 172.21.15.88:0/2273808998 >> v2:172.21.15.88:3300/0 conn(0x7fb6700c5880 0x7fb670167940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:20.849 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:20.840+0000 7fb675540640 1 -- 172.21.15.88:0/2273808998 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb6700ad550 msgr2=0x7fb67006e160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:47:20.849 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:20.840+0000 7fb675540640 1 --2- 172.21.15.88:0/2273808998 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb6700ad550 0x7fb67006e160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:20.849 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:20.840+0000 7fb675540640 1 -- 172.21.15.88:0/2273808998 >> v1:172.21.15.88:6789/0 conn(0x7fb6700c4730 legacy=0x7fb67006d530 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T23:47:20.849 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:20.840+0000 7fb675540640 1 -- 172.21.15.88:0/2273808998 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb670074570 con 0x7fb6700c5880 2024-04-26T23:47:20.850 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:20.841+0000 7fb675540640 1 --2- 172.21.15.88:0/2273808998 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb6700c5880 0x7fb670167940 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fb66c009a60 tx=0x7fb66c03b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b207b70768e68279 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:47:20.850 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:20.843+0000 7fb667fff640 1 -- 172.21.15.88:0/2273808998 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb66c048070 con 0x7fb6700c5880 2024-04-26T23:47:20.850 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:20.843+0000 7fb667fff640 1 -- 172.21.15.88:0/2273808998 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb66c03be40 con 0x7fb6700c5880 2024-04-26T23:47:20.850 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:20.844+0000 7fb667fff640 1 -- 172.21.15.88:0/2273808998 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb66c043660 con 0x7fb6700c5880 2024-04-26T23:47:20.850 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:20.844+0000 7fb6777a4640 1 -- 172.21.15.88:0/2273808998 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb6700c5880 msgr2=0x7fb670167940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:20.850 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:20.844+0000 7fb6777a4640 1 --2- 172.21.15.88:0/2273808998 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb6700c5880 0x7fb670167940 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fb66c009a60 tx=0x7fb66c03b340 comp rx=0 tx=0).stop 2024-04-26T23:47:20.851 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:20.844+0000 7fb6777a4640 1 -- 172.21.15.88:0/2273808998 shutdown_connections 2024-04-26T23:47:20.851 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:20.844+0000 7fb6777a4640 1 --2- 172.21.15.88:0/2273808998 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb6700ad550 0x7fb67006e160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:20.851 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:20.844+0000 7fb6777a4640 1 --2- 172.21.15.88:0/2273808998 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb6700c5880 0x7fb670167940 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:20.851 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:20.844+0000 7fb6777a4640 1 -- 172.21.15.88:0/2273808998 >> 172.21.15.88:0/2273808998 conn(0x7fb6700c4d60 msgr2=0x7fb6700c5170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:47:20.851 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:20.845+0000 7fb6777a4640 1 -- 172.21.15.88:0/2273808998 shutdown_connections 2024-04-26T23:47:20.851 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:20.845+0000 7fb6777a4640 1 -- 172.21.15.88:0/2273808998 wait complete. 2024-04-26T23:47:20.851 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:20.846+0000 7fb6777a4640 1 Processor -- start 2024-04-26T23:47:20.852 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:20.846+0000 7fb6777a4640 1 -- start start 2024-04-26T23:47:20.853 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:20.848+0000 7fb6777a4640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb6700ad550 0x7fb6700bd280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:20.853 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:20.848+0000 7fb6777a4640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb6700c4730 0x7fb670072d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:20.853 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:20.848+0000 7fb6777a4640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb6700c5880 0x7fb6701ef700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:20.853 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:20.848+0000 7fb6777a4640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fb6700c3c70 con 0x7fb6700ad550 2024-04-26T23:47:20.853 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:20.848+0000 7fb6777a4640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fb670074b30 con 0x7fb6700c5880 2024-04-26T23:47:20.853 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:20.848+0000 7fb6777a4640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fb6700c3df0 con 0x7fb6700c4730 2024-04-26T23:47:20.853 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:20.848+0000 7fb675d41640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb6700c5880 0x7fb6701ef700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:20.853 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:20.848+0000 7fb675d41640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb6700c5880 0x7fb6701ef700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.88:56192/0 (socket says 172.21.15.88:56192) 2024-04-26T23:47:20.853 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:20.848+0000 7fb675d41640 1 -- 172.21.15.88:0/2072925500 learned_addr learned my addr 172.21.15.88:0/2072925500 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:47:20.853 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:20.848+0000 7fb675540640 1 --2- 172.21.15.88:0/2072925500 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb6700ad550 0x7fb6700bd280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:20.854 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:20.849+0000 7fb675d41640 1 -- 172.21.15.88:0/2072925500 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb6700c4730 msgr2=0x7fb670072d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:20.854 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:20.849+0000 7fb675d41640 1 --2- 172.21.15.88:0/2072925500 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb6700c4730 0x7fb670072d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:20.854 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:20.849+0000 7fb675d41640 1 -- 172.21.15.88:0/2072925500 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb6700ad550 msgr2=0x7fb6700bd280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:20.855 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:20.849+0000 7fb675d41640 1 --2- 172.21.15.88:0/2072925500 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb6700ad550 0x7fb6700bd280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:20.855 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:20.849+0000 7fb675d41640 1 -- 172.21.15.88:0/2072925500 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6701ed240 con 0x7fb6700c5880 2024-04-26T23:47:20.855 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:20.849+0000 7fb675540640 1 --2- 172.21.15.88:0/2072925500 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb6700ad550 0x7fb6700bd280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:47:20.855 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:20.849+0000 7fb675d41640 1 --2- 172.21.15.88:0/2072925500 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb6700c5880 0x7fb6701ef700 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fb66000b3f0 tx=0x7fb66000b8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:47:20.855 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:20.849+0000 7fb665ffb640 1 -- 172.21.15.88:0/2072925500 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb660015020 con 0x7fb6700c5880 2024-04-26T23:47:20.855 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:20.850+0000 7fb6777a4640 1 -- 172.21.15.88:0/2072925500 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6701ed520 con 0x7fb6700c5880 2024-04-26T23:47:20.855 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:20.850+0000 7fb665ffb640 1 -- 172.21.15.88:0/2072925500 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb660011830 con 0x7fb6700c5880 2024-04-26T23:47:20.855 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:20.850+0000 7fb665ffb640 1 -- 172.21.15.88:0/2072925500 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb660011c00 con 0x7fb6700c5880 2024-04-26T23:47:20.855 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:20.850+0000 7fb6777a4640 1 -- 172.21.15.88:0/2072925500 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6701edae0 con 0x7fb6700c5880 2024-04-26T23:47:20.859 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:20.853+0000 7fb665ffb640 1 -- 172.21.15.88:0/2072925500 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb660018020 con 0x7fb6700c5880 2024-04-26T23:47:20.859 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:20.853+0000 7fb665ffb640 1 --2- 172.21.15.88:0/2072925500 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fb65406c8f0 0x7fb65406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:20.860 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:20.853+0000 7fb665ffb640 1 -- 172.21.15.88:0/2072925500 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6666+0+0 (secure 0 0 0) 0x7fb66008bf70 con 0x7fb6700c5880 2024-04-26T23:47:20.860 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:20.853+0000 7fb65b7fe640 1 --2- 172.21.15.88:0/2072925500 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb670161150 0x7fb6701fc810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:20.860 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:20.854+0000 7fb65b7fe640 1 -- 172.21.15.88:0/2072925500 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fb6700699d0 con 0x7fb670161150 2024-04-26T23:47:20.860 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:20.854+0000 7fb674d3f640 1 --2- 172.21.15.88:0/2072925500 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb670161150 0x7fb6701fc810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:20.860 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:20.855+0000 7fb675540640 1 --2- 172.21.15.88:0/2072925500 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fb65406c8f0 0x7fb65406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:20.860 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:20.856+0000 7fb675540640 1 --2- 172.21.15.88:0/2072925500 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fb65406c8f0 0x7fb65406edb0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fb66c045000 tx=0x7fb66c03f000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:47:20.864 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:20.860+0000 7fb674d3f640 1 -- 172.21.15.88:0/2072925500 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb6701edec0 con 0x7fb670161150 2024-04-26T23:47:20.867 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:20.863+0000 7fb674d3f640 1 --2- 172.21.15.88:0/2072925500 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb670161150 0x7fb6701fc810 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fb670165a70 tx=0x7fb668007eb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:47:20.871 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:20.866+0000 7fb665ffb640 1 -- 172.21.15.88:0/2072925500 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb66800dc20 con 0x7fb670161150 2024-04-26T23:47:20.871 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:20.866+0000 7fb665ffb640 1 -- 172.21.15.88:0/2072925500 <== mon.1 v2:172.21.15.175:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fb668018070 con 0x7fb670161150 2024-04-26T23:47:20.871 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:20.866+0000 7fb665ffb640 1 -- 172.21.15.88:0/2072925500 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb670161150 msgr2=0x7fb6701fc810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:20.871 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:20.866+0000 7fb665ffb640 1 --2- 172.21.15.88:0/2072925500 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb670161150 0x7fb6701fc810 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fb670165a70 tx=0x7fb668007eb0 comp rx=0 tx=0).stop 2024-04-26T23:47:20.871 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:20.866+0000 7fb665ffb640 1 -- 172.21.15.88:0/2072925500 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb670161150 msgr2=0x7fb6701fc810 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:47:20.871 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:20.866+0000 7fb665ffb640 1 --2- 172.21.15.88:0/2072925500 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb670161150 0x7fb6701fc810 secure :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fb670165a70 tx=0x7fb668007eb0 comp rx=0 tx=0).stop 2024-04-26T23:47:20.883 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:20.879+0000 7fb65b7fe640 1 --2- 172.21.15.88:0/2072925500 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb6701fcd50 0x7fb6701fd130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:20.884 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:20.880+0000 7fb65b7fe640 1 -- 172.21.15.88:0/2072925500 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fb6701f0400 con 0x7fb6701fcd50 2024-04-26T23:47:20.885 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:20.881+0000 7fb674d3f640 1 --2- 172.21.15.88:0/2072925500 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb6701fcd50 0x7fb6701fd130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:20.887 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:20.883+0000 7fb674d3f640 1 -- 172.21.15.88:0/2072925500 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fb6701fd670 con 0x7fb6701fcd50 2024-04-26T23:47:20.889 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:20.885+0000 7fb674d3f640 1 --2- 172.21.15.88:0/2072925500 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb6701fcd50 0x7fb6701fd130 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fb668014000 tx=0x7fb668004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:47:20.896 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:20.892+0000 7fb665ffb640 1 -- 172.21.15.88:0/2072925500 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb66801d250 con 0x7fb6701fcd50 2024-04-26T23:47:20.897 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-04-26T23:47:20.897 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2024-04-26T23:47:20.897 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2024-04-26T23:47:20.897 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "peon", 2024-04-26T23:47:20.897 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 70, 2024-04-26T23:47:20.897 INFO:teuthology.orchestra.run.smithi088.stdout: "uptime": 73999, 2024-04-26T23:47:20.897 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2024-04-26T23:47:20.897 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2024-04-26T23:47:20.897 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2024-04-26T23:47:20.897 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2024-04-26T23:47:20.897 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:47:20.897 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 1, 2024-04-26T23:47:20.898 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2024-04-26T23:47:20.898 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2450521708007866372", 2024-04-26T23:47:20.898 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2024-04-26T23:47:20.898 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-04-26T23:47:20.898 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-04-26T23:47:20.898 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-04-26T23:47:20.898 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-04-26T23:47:20.898 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-04-26T23:47:20.898 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-04-26T23:47:20.898 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-04-26T23:47:20.898 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-04-26T23:47:20.898 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-04-26T23:47:20.898 INFO:teuthology.orchestra.run.smithi088.stdout: "reef", 2024-04-26T23:47:20.898 INFO:teuthology.orchestra.run.smithi088.stdout: "squid" 2024-04-26T23:47:20.899 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:47:20.899 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540701547738038271", 2024-04-26T23:47:20.899 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2024-04-26T23:47:20.899 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-04-26T23:47:20.899 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-04-26T23:47:20.899 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-04-26T23:47:20.899 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-04-26T23:47:20.899 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-04-26T23:47:20.899 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-04-26T23:47:20.899 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-04-26T23:47:20.899 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-04-26T23:47:20.899 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-04-26T23:47:20.899 INFO:teuthology.orchestra.run.smithi088.stdout: "reef", 2024-04-26T23:47:20.899 INFO:teuthology.orchestra.run.smithi088.stdout: "squid" 2024-04-26T23:47:20.899 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:47:20.900 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:47:20.900 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2024-04-26T23:47:20.900 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2024-04-26T23:47:20.900 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2024-04-26T23:47:20.900 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2024-04-26T23:47:20.900 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2024-04-26T23:47:20.900 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "555255e9-7ef9-4454-8dc9-35e96b70035c", 2024-04-26T23:47:20.900 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2024-04-26T23:39:34.291658Z", 2024-04-26T23:47:20.900 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2024-04-26T23:39:34.291658Z", 2024-04-26T23:47:20.900 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 19, 2024-04-26T23:47:20.900 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "squid", 2024-04-26T23:47:20.900 INFO:teuthology.orchestra.run.smithi088.stdout: "election_strategy": 1, 2024-04-26T23:47:20.900 INFO:teuthology.orchestra.run.smithi088.stdout: "disallowed_leaders: ": "", 2024-04-26T23:47:20.900 INFO:teuthology.orchestra.run.smithi088.stdout: "stretch_mode": false, 2024-04-26T23:47:20.900 INFO:teuthology.orchestra.run.smithi088.stdout: "tiebreaker_mon": "", 2024-04-26T23:47:20.901 INFO:teuthology.orchestra.run.smithi088.stdout: "removed_ranks: ": "", 2024-04-26T23:47:20.901 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2024-04-26T23:47:20.901 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2024-04-26T23:47:20.901 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-04-26T23:47:20.901 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-04-26T23:47:20.901 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-04-26T23:47:20.901 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-04-26T23:47:20.901 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-04-26T23:47:20.901 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-04-26T23:47:20.901 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-04-26T23:47:20.901 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-04-26T23:47:20.901 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-04-26T23:47:20.901 INFO:teuthology.orchestra.run.smithi088.stdout: "reef", 2024-04-26T23:47:20.901 INFO:teuthology.orchestra.run.smithi088.stdout: "squid" 2024-04-26T23:47:20.901 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:47:20.901 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2024-04-26T23:47:20.902 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:47:20.902 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2024-04-26T23:47:20.902 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:47:20.902 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2024-04-26T23:47:20.902 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2024-04-26T23:47:20.902 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-04-26T23:47:20.902 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-04-26T23:47:20.902 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:47:20.902 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-04-26T23:47:20.902 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2024-04-26T23:47:20.902 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:47:20.902 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:47:20.902 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:47:20.903 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-04-26T23:47:20.903 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2024-04-26T23:47:20.903 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:47:20.903 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:47:20.903 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:47:20.903 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:47:20.903 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2024-04-26T23:47:20.903 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2024-04-26T23:47:20.903 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-04-26T23:47:20.903 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-04-26T23:47:20.903 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-04-26T23:47:20.903 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:47:20.903 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:47:20.903 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2024-04-26T23:47:20.903 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2024-04-26T23:47:20.904 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-04-26T23:47:20.904 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-04-26T23:47:20.904 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:47:20.904 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-04-26T23:47:20.904 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:3300", 2024-04-26T23:47:20.904 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:47:20.904 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:47:20.904 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:47:20.904 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-04-26T23:47:20.904 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6789", 2024-04-26T23:47:20.904 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:47:20.904 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:47:20.904 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:47:20.904 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:47:20.905 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6789/0", 2024-04-26T23:47:20.905 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.175:6789/0", 2024-04-26T23:47:20.905 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-04-26T23:47:20.905 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-04-26T23:47:20.905 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-04-26T23:47:20.905 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:47:20.905 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:47:20.905 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2024-04-26T23:47:20.905 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2024-04-26T23:47:20.905 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-04-26T23:47:20.905 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-04-26T23:47:20.905 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:47:20.905 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-04-26T23:47:20.905 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:3301", 2024-04-26T23:47:20.905 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:47:20.905 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:47:20.905 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:47:20.906 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-04-26T23:47:20.906 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6790", 2024-04-26T23:47:20.906 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:47:20.906 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:47:20.906 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:47:20.906 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:47:20.906 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6790/0", 2024-04-26T23:47:20.906 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.175:6790/0", 2024-04-26T23:47:20.906 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-04-26T23:47:20.906 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-04-26T23:47:20.906 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-04-26T23:47:20.906 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:47:20.906 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:47:20.906 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:47:20.906 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2024-04-26T23:47:20.907 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2024-04-26T23:47:20.907 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:47:20.907 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:47:20.907 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:47:20.907 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2024-04-26T23:47:20.907 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:47:20.907 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:47:20.907 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": [ 2024-04-26T23:47:20.907 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:47:20.907 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:47:20.907 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:47:20.907 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2024-04-26T23:47:20.907 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:47:20.907 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:47:20.907 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2024-04-26T23:47:20.908 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:47:20.908 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:47:20.908 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:47:20.908 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2024-04-26T23:47:20.908 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:47:20.908 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:47:20.908 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": [ 2024-04-26T23:47:20.908 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:47:20.908 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:47:20.908 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:47:20.908 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2024-04-26T23:47:20.908 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:47:20.908 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:47:20.908 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:47:20.908 INFO:teuthology.orchestra.run.smithi088.stdout: "stretch_mode": false 2024-04-26T23:47:20.908 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-04-26T23:47:20.909 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:20.892+0000 7fb665ffb640 1 -- 172.21.15.88:0/2072925500 <== mon.1 v2:172.21.15.175:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4894 (secure 0 0 0) 0x7fb668027400 con 0x7fb6701fcd50 2024-04-26T23:47:20.909 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:20.892+0000 7fb665ffb640 1 -- 172.21.15.88:0/2072925500 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb6701fcd50 msgr2=0x7fb6701fd130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:20.909 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:20.892+0000 7fb665ffb640 1 --2- 172.21.15.88:0/2072925500 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb6701fcd50 0x7fb6701fd130 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fb668014000 tx=0x7fb668004a40 comp rx=0 tx=0).stop 2024-04-26T23:47:20.909 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:20.892+0000 7fb665ffb640 1 -- 172.21.15.88:0/2072925500 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb6701fcd50 msgr2=0x7fb6701fd130 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:47:20.909 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:20.892+0000 7fb665ffb640 1 --2- 172.21.15.88:0/2072925500 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb6701fcd50 0x7fb6701fd130 secure :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fb668014000 tx=0x7fb668004a40 comp rx=0 tx=0).stop 2024-04-26T23:47:20.909 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:20.893+0000 7fb6777a4640 1 -- 172.21.15.88:0/2072925500 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fb65406c8f0 msgr2=0x7fb65406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:20.909 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:20.893+0000 7fb6777a4640 1 --2- 172.21.15.88:0/2072925500 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fb65406c8f0 0x7fb65406edb0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fb66c045000 tx=0x7fb66c03f000 comp rx=0 tx=0).stop 2024-04-26T23:47:20.909 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:20.893+0000 7fb675d41640 1 -- 172.21.15.88:0/2072925500 reap_dead start 2024-04-26T23:47:20.909 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:20.893+0000 7fb6777a4640 1 -- 172.21.15.88:0/2072925500 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb6700c5880 msgr2=0x7fb6701ef700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:20.909 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:20.893+0000 7fb6777a4640 1 --2- 172.21.15.88:0/2072925500 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb6700c5880 0x7fb6701ef700 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fb66000b3f0 tx=0x7fb66000b8b0 comp rx=0 tx=0).stop 2024-04-26T23:47:20.910 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:20.893+0000 7fb6777a4640 1 -- 172.21.15.88:0/2072925500 shutdown_connections 2024-04-26T23:47:20.910 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:20.893+0000 7fb6777a4640 1 --2- 172.21.15.88:0/2072925500 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb6700c5880 0x7fb6701ef700 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:20.910 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:20.893+0000 7fb6777a4640 1 -- 172.21.15.88:0/2072925500 >> 172.21.15.88:0/2072925500 conn(0x7fb6700c4d60 msgr2=0x7fb670164af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:47:20.910 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:20.894+0000 7fb6777a4640 1 -- 172.21.15.88:0/2072925500 shutdown_connections 2024-04-26T23:47:20.910 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:20.895+0000 7fb6777a4640 1 -- 172.21.15.88:0/2072925500 wait complete. 2024-04-26T23:47:20.919 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-04-26T23:47:20.919 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-04-26T23:47:20.919 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-04-26T23:47:21.093 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:21.088+0000 7feee3fff640 1 Processor -- start 2024-04-26T23:47:21.093 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:21.088+0000 7feee3fff640 1 -- start start 2024-04-26T23:47:21.094 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:21.090+0000 7feee3fff640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7feedc0071b0 0x7feedc007590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:21.095 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:21.090+0000 7feee3fff640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7feedc0e2730 0x7feedc0e9100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:21.095 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:21.090+0000 7feee3fff640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feedc04a560 con 0x7feedc04db50 2024-04-26T23:47:21.095 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:21.090+0000 7feee3fff640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7feedc00e530 con 0x7feedc0e2730 2024-04-26T23:47:21.095 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:21.090+0000 7feee3fff640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7feedc00e200 con 0x7feedc0071b0 2024-04-26T23:47:21.097 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:21.091+0000 7feee2ffd640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7feedc0071b0 0x7feedc007590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:21.097 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:21.091+0000 7feee2ffd640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7feedc0071b0 0x7feedc007590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.88:38226/0 (socket says 172.21.15.88:38226) 2024-04-26T23:47:21.097 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:21.091+0000 7feee2ffd640 1 -- 172.21.15.88:0/2394872475 learned_addr learned my addr 172.21.15.88:0/2394872475 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:47:21.097 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:21.093+0000 7feee37fe640 1 --2- 172.21.15.88:0/2394872475 >> v2:172.21.15.175:3300/0 conn(0x7feedc0e2730 0x7feedc0e9100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:21.099 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:21.093+0000 7feee2ffd640 1 -- 172.21.15.88:0/2394872475 >> v2:172.21.15.175:3300/0 conn(0x7feedc0e2730 msgr2=0x7feedc0e9100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:47:21.099 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:21.093+0000 7feee2ffd640 1 --2- 172.21.15.88:0/2394872475 >> v2:172.21.15.175:3300/0 conn(0x7feedc0e2730 0x7feedc0e9100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:21.100 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:21.093+0000 7feee2ffd640 1 -- 172.21.15.88:0/2394872475 >> v1:172.21.15.88:6789/0 conn(0x7feedc04db50 legacy=0x7feedc00e9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:21.100 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:21.093+0000 7feee2ffd640 1 -- 172.21.15.88:0/2394872475 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feedc04a800 con 0x7feedc0071b0 2024-04-26T23:47:21.101 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:21.097+0000 7feee2ffd640 1 --2- 172.21.15.88:0/2394872475 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7feedc0071b0 0x7feedc007590 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7feee4065e50 tx=0x7feee40a7120 comp rx=0 tx=0).ready entity=mon.2 client_cookie=19a658e78994857 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:47:21.103 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:21.098+0000 7feee1ffb640 1 -- 172.21.15.88:0/2394872475 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feee40b4070 con 0x7feedc0071b0 2024-04-26T23:47:21.103 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:21.098+0000 7feee1ffb640 1 -- 172.21.15.88:0/2394872475 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feee40af440 con 0x7feedc0071b0 2024-04-26T23:47:21.103 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:21.098+0000 7feee1ffb640 1 -- 172.21.15.88:0/2394872475 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feee40af870 con 0x7feedc0071b0 2024-04-26T23:47:21.103 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:21.099+0000 7feee3fff640 1 -- 172.21.15.88:0/2394872475 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7feedc0071b0 msgr2=0x7feedc007590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:21.104 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:21.099+0000 7feee3fff640 1 --2- 172.21.15.88:0/2394872475 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7feedc0071b0 0x7feedc007590 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7feee4065e50 tx=0x7feee40a7120 comp rx=0 tx=0).stop 2024-04-26T23:47:21.108 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:21.103+0000 7feee3fff640 1 -- 172.21.15.88:0/2394872475 shutdown_connections 2024-04-26T23:47:21.108 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:21.103+0000 7feee3fff640 1 --2- 172.21.15.88:0/2394872475 >> v2:172.21.15.175:3300/0 conn(0x7feedc0e2730 0x7feedc0e9100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:21.108 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:21.103+0000 7feee3fff640 1 --2- 172.21.15.88:0/2394872475 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7feedc0071b0 0x7feedc007590 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:21.108 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:21.103+0000 7feee3fff640 1 -- 172.21.15.88:0/2394872475 >> 172.21.15.88:0/2394872475 conn(0x7feedc04c660 msgr2=0x7feedc04ca40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:47:21.113 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:21.105+0000 7feee3fff640 1 -- 172.21.15.88:0/2394872475 shutdown_connections 2024-04-26T23:47:21.113 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:21.105+0000 7feee3fff640 1 -- 172.21.15.88:0/2394872475 wait complete. 2024-04-26T23:47:21.113 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:21.107+0000 7feee3fff640 1 Processor -- start 2024-04-26T23:47:21.114 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:21.107+0000 7feee3fff640 1 -- start start 2024-04-26T23:47:21.114 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:21.108+0000 7feee3fff640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7feedc0071b0 0x7feedc17e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:21.114 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:21.108+0000 7feee3fff640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7feedc04db50 0x7feedc046fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:21.114 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:21.108+0000 7feee3fff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feedc0e2730 0x7feedc180cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:21.114 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:21.108+0000 7feee3fff640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7feedc04adc0 con 0x7feedc0e2730 2024-04-26T23:47:21.114 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:21.108+0000 7feee3fff640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7feedc0e2be0 con 0x7feedc0071b0 2024-04-26T23:47:21.114 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:21.108+0000 7feee3fff640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7feedc04af40 con 0x7feedc04db50 2024-04-26T23:47:21.114 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:21.109+0000 7feee37fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feedc0e2730 0x7feedc180cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:21.114 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:21.109+0000 7feee27fc640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7feedc04db50 0x7feedc046fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:21.114 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:21.109+0000 7feee37fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feedc0e2730 0x7feedc180cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:52590/0 (socket says 172.21.15.88:52590) 2024-04-26T23:47:21.114 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:21.109+0000 7feee37fe640 1 -- 172.21.15.88:0/2150603897 learned_addr learned my addr 172.21.15.88:0/2150603897 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:47:21.115 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:21.110+0000 7feee37fe640 1 -- 172.21.15.88:0/2150603897 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7feedc04db50 msgr2=0x7feedc046fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:21.115 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:21.110+0000 7feee37fe640 1 --2- 172.21.15.88:0/2150603897 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7feedc04db50 0x7feedc046fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:21.115 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:21.110+0000 7feee37fe640 1 -- 172.21.15.88:0/2150603897 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7feedc0071b0 msgr2=0x7feedc17e1d0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-26T23:47:21.115 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:21.110+0000 7feee37fe640 1 --2- 172.21.15.88:0/2150603897 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7feedc0071b0 0x7feedc17e1d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:21.115 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:21.110+0000 7feee37fe640 1 -- 172.21.15.88:0/2150603897 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feedc17d710 con 0x7feedc0e2730 2024-04-26T23:47:21.115 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:21.111+0000 7feee37fe640 1 --2- 172.21.15.88:0/2150603897 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feedc0e2730 0x7feedc180cc0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7feed800d800 tx=0x7feed800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:47:21.118 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:21.113+0000 7feecbfff640 1 -- 172.21.15.88:0/2150603897 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feed800b660 con 0x7feedc0e2730 2024-04-26T23:47:21.118 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:21.113+0000 7feecbfff640 1 -- 172.21.15.88:0/2150603897 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feed8019070 con 0x7feedc0e2730 2024-04-26T23:47:21.118 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:21.113+0000 7feee3fff640 1 -- 172.21.15.88:0/2150603897 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feedc047850 con 0x7feedc0e2730 2024-04-26T23:47:21.118 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:21.114+0000 7feee3fff640 1 -- 172.21.15.88:0/2150603897 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feedc17d9d0 con 0x7feedc0e2730 2024-04-26T23:47:21.119 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:21.114+0000 7feecbfff640 1 -- 172.21.15.88:0/2150603897 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feed800ba40 con 0x7feedc0e2730 2024-04-26T23:47:21.122 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:21.117+0000 7feecbfff640 1 -- 172.21.15.88:0/2150603897 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7feed800bbe0 con 0x7feedc0e2730 2024-04-26T23:47:21.122 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:21.118+0000 7feecbfff640 1 --2- 172.21.15.88:0/2150603897 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7feed006c9c0 0x7feed006ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:21.123 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:21.119+0000 7feecbfff640 1 -- 172.21.15.88:0/2150603897 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6666+0+0 (secure 0 0 0) 0x7feed808c210 con 0x7feedc0e2730 2024-04-26T23:47:21.123 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:21.119+0000 7feee2ffd640 1 --2- 172.21.15.88:0/2150603897 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7feed006c9c0 0x7feed006ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:21.124 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:21.120+0000 7feee2ffd640 1 --2- 172.21.15.88:0/2150603897 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7feed006c9c0 0x7feed006ee80 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7feedc04a730 tx=0x7feee40ab000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:47:21.124 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:21.120+0000 7feee3fff640 1 --2- 172.21.15.88:0/2150603897 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7feec4002a70 0x7feec4004f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:21.124 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:21.120+0000 7feee3fff640 1 -- 172.21.15.88:0/2150603897 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7feec4007ec0 con 0x7feec4002a70 2024-04-26T23:47:21.128 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:21.124+0000 7feee27fc640 1 --2- 172.21.15.88:0/2150603897 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7feec4002a70 0x7feec4004f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:21.132 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:21.128+0000 7feee27fc640 1 -- 172.21.15.88:0/2150603897 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7feec40080c0 con 0x7feec4002a70 2024-04-26T23:47:21.135 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:21.131+0000 7feee27fc640 1 --2- 172.21.15.88:0/2150603897 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7feec4002a70 0x7feec4004f30 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7feed400d4e0 tx=0x7feed400d9a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:47:21.139 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:21.134+0000 7feecbfff640 1 -- 172.21.15.88:0/2150603897 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feed4005480 con 0x7feec4002a70 2024-04-26T23:47:21.139 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:21.134+0000 7feecbfff640 1 -- 172.21.15.88:0/2150603897 <== mon.2 v2:172.21.15.175:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7feed4017070 con 0x7feec4002a70 2024-04-26T23:47:21.139 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:21.134+0000 7feecbfff640 1 -- 172.21.15.88:0/2150603897 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7feec4002a70 msgr2=0x7feec4004f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:21.139 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:21.134+0000 7feecbfff640 1 --2- 172.21.15.88:0/2150603897 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7feec4002a70 0x7feec4004f30 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7feed400d4e0 tx=0x7feed400d9a0 comp rx=0 tx=0).stop 2024-04-26T23:47:21.139 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:21.134+0000 7feecbfff640 1 -- 172.21.15.88:0/2150603897 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7feec4002a70 msgr2=0x7feec4004f30 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:47:21.139 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:21.134+0000 7feecbfff640 1 --2- 172.21.15.88:0/2150603897 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7feec4002a70 0x7feec4004f30 secure :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7feed400d4e0 tx=0x7feed400d9a0 comp rx=0 tx=0).stop 2024-04-26T23:47:21.157 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:21.152+0000 7feee3fff640 1 --2- 172.21.15.88:0/2150603897 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7feec4006f00 0x7feec4007390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:21.157 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:21.153+0000 7feee3fff640 1 -- 172.21.15.88:0/2150603897 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7feec400a4a0 con 0x7feec4006f00 2024-04-26T23:47:21.158 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:21.154+0000 7feee27fc640 1 --2- 172.21.15.88:0/2150603897 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7feec4006f00 0x7feec4007390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:21.163 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:21.158+0000 7feee27fc640 1 -- 172.21.15.88:0/2150603897 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7feec40078d0 con 0x7feec4006f00 2024-04-26T23:47:21.167 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:21.163+0000 7feee27fc640 1 --2- 172.21.15.88:0/2150603897 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7feec4006f00 0x7feec4007390 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7feed400d4e0 tx=0x7feed4000ed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:47:21.169 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:21.165+0000 7feecbfff640 1 -- 172.21.15.88:0/2150603897 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feed4003c30 con 0x7feec4006f00 2024-04-26T23:47:21.170 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:21.165+0000 7feecbfff640 1 -- 172.21.15.88:0/2150603897 <== mon.2 v2:172.21.15.175:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5208 (secure 0 0 0) 0x7feed4003dd0 con 0x7feec4006f00 2024-04-26T23:47:21.170 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:21.165+0000 7feecbfff640 1 -- 172.21.15.88:0/2150603897 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7feec4006f00 msgr2=0x7feec4007390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:21.170 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:21.165+0000 7feecbfff640 1 --2- 172.21.15.88:0/2150603897 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7feec4006f00 0x7feec4007390 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7feed400d4e0 tx=0x7feed4000ed0 comp rx=0 tx=0).stop 2024-04-26T23:47:21.170 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:21.165+0000 7feecbfff640 1 -- 172.21.15.88:0/2150603897 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7feec4006f00 msgr2=0x7feec4007390 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:47:21.170 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:21.165+0000 7feecbfff640 1 --2- 172.21.15.88:0/2150603897 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7feec4006f00 0x7feec4007390 secure :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7feed400d4e0 tx=0x7feed4000ed0 comp rx=0 tx=0).stop 2024-04-26T23:47:21.171 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-04-26T23:47:21.171 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2024-04-26T23:47:21.171 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2024-04-26T23:47:21.171 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "peon", 2024-04-26T23:47:21.171 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 70, 2024-04-26T23:47:21.171 INFO:teuthology.orchestra.run.smithi088.stdout: "uptime": 209451, 2024-04-26T23:47:21.171 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2024-04-26T23:47:21.171 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2024-04-26T23:47:21.171 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2024-04-26T23:47:21.172 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2024-04-26T23:47:21.172 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:47:21.172 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 1, 2024-04-26T23:47:21.172 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2024-04-26T23:47:21.172 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2450521708007866372", 2024-04-26T23:47:21.172 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2024-04-26T23:47:21.172 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-04-26T23:47:21.172 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-04-26T23:47:21.172 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-04-26T23:47:21.172 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-04-26T23:47:21.172 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-04-26T23:47:21.172 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-04-26T23:47:21.172 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-04-26T23:47:21.172 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-04-26T23:47:21.172 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-04-26T23:47:21.173 INFO:teuthology.orchestra.run.smithi088.stdout: "reef", 2024-04-26T23:47:21.173 INFO:teuthology.orchestra.run.smithi088.stdout: "squid" 2024-04-26T23:47:21.173 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:47:21.173 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540701547738038271", 2024-04-26T23:47:21.173 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2024-04-26T23:47:21.173 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-04-26T23:47:21.173 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-04-26T23:47:21.173 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-04-26T23:47:21.173 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-04-26T23:47:21.173 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-04-26T23:47:21.173 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-04-26T23:47:21.173 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-04-26T23:47:21.173 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-04-26T23:47:21.173 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-04-26T23:47:21.173 INFO:teuthology.orchestra.run.smithi088.stdout: "reef", 2024-04-26T23:47:21.174 INFO:teuthology.orchestra.run.smithi088.stdout: "squid" 2024-04-26T23:47:21.174 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:47:21.174 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:47:21.174 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2024-04-26T23:47:21.174 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2024-04-26T23:47:21.174 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2024-04-26T23:47:21.174 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2024-04-26T23:47:21.174 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2024-04-26T23:47:21.174 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "555255e9-7ef9-4454-8dc9-35e96b70035c", 2024-04-26T23:47:21.174 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2024-04-26T23:39:34.291658Z", 2024-04-26T23:47:21.174 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2024-04-26T23:39:34.291658Z", 2024-04-26T23:47:21.174 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 19, 2024-04-26T23:47:21.174 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "squid", 2024-04-26T23:47:21.174 INFO:teuthology.orchestra.run.smithi088.stdout: "election_strategy": 1, 2024-04-26T23:47:21.175 INFO:teuthology.orchestra.run.smithi088.stdout: "disallowed_leaders: ": "", 2024-04-26T23:47:21.175 INFO:teuthology.orchestra.run.smithi088.stdout: "stretch_mode": false, 2024-04-26T23:47:21.175 INFO:teuthology.orchestra.run.smithi088.stdout: "tiebreaker_mon": "", 2024-04-26T23:47:21.175 INFO:teuthology.orchestra.run.smithi088.stdout: "removed_ranks: ": "", 2024-04-26T23:47:21.175 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2024-04-26T23:47:21.175 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2024-04-26T23:47:21.175 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-04-26T23:47:21.175 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-04-26T23:47:21.175 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-04-26T23:47:21.175 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-04-26T23:47:21.175 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-04-26T23:47:21.175 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-04-26T23:47:21.175 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-04-26T23:47:21.175 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-04-26T23:47:21.176 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-04-26T23:47:21.176 INFO:teuthology.orchestra.run.smithi088.stdout: "reef", 2024-04-26T23:47:21.176 INFO:teuthology.orchestra.run.smithi088.stdout: "squid" 2024-04-26T23:47:21.176 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:47:21.176 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2024-04-26T23:47:21.176 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:47:21.176 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2024-04-26T23:47:21.176 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:47:21.176 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2024-04-26T23:47:21.176 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2024-04-26T23:47:21.176 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-04-26T23:47:21.176 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-04-26T23:47:21.176 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:47:21.176 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-04-26T23:47:21.176 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2024-04-26T23:47:21.177 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:47:21.177 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:47:21.177 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:47:21.177 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-04-26T23:47:21.177 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2024-04-26T23:47:21.177 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:47:21.177 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:47:21.177 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:47:21.177 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:47:21.177 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2024-04-26T23:47:21.177 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2024-04-26T23:47:21.177 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-04-26T23:47:21.177 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-04-26T23:47:21.177 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-04-26T23:47:21.178 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:47:21.178 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:47:21.178 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2024-04-26T23:47:21.178 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2024-04-26T23:47:21.178 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-04-26T23:47:21.178 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-04-26T23:47:21.178 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:47:21.178 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-04-26T23:47:21.178 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:3300", 2024-04-26T23:47:21.178 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:47:21.178 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:47:21.178 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:47:21.178 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-04-26T23:47:21.178 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6789", 2024-04-26T23:47:21.179 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:47:21.179 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:47:21.179 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:47:21.179 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:47:21.179 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6789/0", 2024-04-26T23:47:21.179 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.175:6789/0", 2024-04-26T23:47:21.179 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-04-26T23:47:21.179 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-04-26T23:47:21.179 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-04-26T23:47:21.179 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:47:21.179 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:47:21.179 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2024-04-26T23:47:21.179 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2024-04-26T23:47:21.179 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-04-26T23:47:21.179 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-04-26T23:47:21.180 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:47:21.180 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-04-26T23:47:21.180 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:3301", 2024-04-26T23:47:21.180 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:47:21.180 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:47:21.180 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:47:21.180 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-04-26T23:47:21.180 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6790", 2024-04-26T23:47:21.180 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:47:21.180 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:47:21.180 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:47:21.180 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:47:21.180 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6790/0", 2024-04-26T23:47:21.180 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.175:6790/0", 2024-04-26T23:47:21.180 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-04-26T23:47:21.181 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-04-26T23:47:21.181 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-04-26T23:47:21.181 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:47:21.181 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:47:21.181 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:47:21.181 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2024-04-26T23:47:21.181 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2024-04-26T23:47:21.181 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:47:21.181 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:47:21.181 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:47:21.181 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2024-04-26T23:47:21.181 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:47:21.181 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:47:21.181 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": [ 2024-04-26T23:47:21.181 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:47:21.181 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:47:21.181 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:47:21.182 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 4 2024-04-26T23:47:21.182 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:47:21.182 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:47:21.182 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": [ 2024-04-26T23:47:21.182 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:47:21.182 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:47:21.182 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:47:21.182 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 7 2024-04-26T23:47:21.182 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:47:21.182 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:47:21.182 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2024-04-26T23:47:21.182 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:47:21.182 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x2f018fb87aa4aafe", 2024-04-26T23:47:21.182 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:47:21.182 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2024-04-26T23:47:21.183 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:47:21.183 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:47:21.183 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:47:21.183 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:47:21.183 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 5 2024-04-26T23:47:21.183 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:47:21.183 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:47:21.183 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": [ 2024-04-26T23:47:21.183 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:47:21.183 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:47:21.183 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:47:21.183 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2024-04-26T23:47:21.183 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:47:21.183 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:47:21.183 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:47:21.184 INFO:teuthology.orchestra.run.smithi088.stdout: "stretch_mode": false 2024-04-26T23:47:21.184 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-04-26T23:47:21.184 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:21.170+0000 7feee3fff640 1 -- 172.21.15.88:0/2150603897 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7feed006c9c0 msgr2=0x7feed006ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:21.185 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:21.170+0000 7feee3fff640 1 --2- 172.21.15.88:0/2150603897 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7feed006c9c0 0x7feed006ee80 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7feedc04a730 tx=0x7feee40ab000 comp rx=0 tx=0).stop 2024-04-26T23:47:21.185 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:21.170+0000 7feee3fff640 1 -- 172.21.15.88:0/2150603897 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feedc0e2730 msgr2=0x7feedc180cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:21.185 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:21.170+0000 7feee3fff640 1 --2- 172.21.15.88:0/2150603897 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feedc0e2730 0x7feedc180cc0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7feed800d800 tx=0x7feed800dcc0 comp rx=0 tx=0).stop 2024-04-26T23:47:21.185 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:21.170+0000 7feee37fe640 1 -- 172.21.15.88:0/2150603897 reap_dead start 2024-04-26T23:47:21.185 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:21.170+0000 7feee37fe640 1 -- 172.21.15.88:0/2150603897 reap_dead start 2024-04-26T23:47:21.185 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:21.173+0000 7feee3fff640 1 -- 172.21.15.88:0/2150603897 shutdown_connections 2024-04-26T23:47:21.185 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:21.173+0000 7feee3fff640 1 -- 172.21.15.88:0/2150603897 >> 172.21.15.88:0/2150603897 conn(0x7feedc04c660 msgr2=0x7feedc0e1240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:47:21.185 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:21.177+0000 7feee3fff640 1 -- 172.21.15.88:0/2150603897 shutdown_connections 2024-04-26T23:47:21.185 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:21.177+0000 7feee3fff640 1 -- 172.21.15.88:0/2150603897 wait complete. 2024-04-26T23:47:21.205 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-04-26T23:47:21.205 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2024-04-26T23:47:21.205 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2024-04-26T23:47:21.380 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:21.375+0000 7f790f59e640 1 Processor -- start 2024-04-26T23:47:21.380 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:21.375+0000 7f790f59e640 1 -- start start 2024-04-26T23:47:21.381 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:21.376+0000 7f790f59e640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f79080f9ae0 0x7f7908046150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:21.381 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:21.376+0000 7f790f59e640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7908007080 con 0x7f79080fdf20 2024-04-26T23:47:21.381 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:21.377+0000 7f790f59e640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7908007340 con 0x7f7908046690 2024-04-26T23:47:21.381 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:21.377+0000 7f790f59e640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f79080fc430 con 0x7f79080f9ae0 2024-04-26T23:47:21.381 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:21.377+0000 7f790dd9b640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f7908046690 0x7f79080fd810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.88:50684/0 (socket says 172.21.15.88:50684) 2024-04-26T23:47:21.382 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:21.377+0000 7f790dd9b640 1 -- 172.21.15.88:0/826888626 learned_addr learned my addr 172.21.15.88:0/826888626 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-26T23:47:21.382 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:21.377+0000 7f790e59c640 1 --2- 172.21.15.88:0/826888626 >> v2:172.21.15.88:3300/0 conn(0x7f79080f9ae0 0x7f7908046150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:21.382 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:21.378+0000 7f790d59a640 1 -- 172.21.15.88:0/826888626 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1859297712 0 0) 0x7f7908007340 con 0x7f7908046690 2024-04-26T23:47:21.382 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:21.378+0000 7f790d59a640 1 -- 172.21.15.88:0/826888626 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f78f8003520 con 0x7f7908046690 2024-04-26T23:47:21.383 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:21.378+0000 7f790e59c640 1 -- 172.21.15.88:0/826888626 >> v1:172.21.15.175:6789/0 conn(0x7f7908046690 legacy=0x7f79080fd810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:21.383 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:21.378+0000 7f790e59c640 1 -- 172.21.15.88:0/826888626 >> v1:172.21.15.88:6789/0 conn(0x7f79080fdf20 legacy=0x7f7908106ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:21.383 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:21.378+0000 7f790e59c640 1 -- 172.21.15.88:0/826888626 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79080fc710 con 0x7f79080f9ae0 2024-04-26T23:47:21.383 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:21.379+0000 7f790e59c640 1 --2- 172.21.15.88:0/826888626 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f79080f9ae0 0x7f7908046150 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f79040097a0 tx=0x7f790402a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=353c9227e24d7178 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:47:21.384 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:21.379+0000 7f790d59a640 1 -- 172.21.15.88:0/826888626 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7904037070 con 0x7f79080f9ae0 2024-04-26T23:47:21.384 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:21.379+0000 7f790d59a640 1 -- 172.21.15.88:0/826888626 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f790402ac90 con 0x7f79080f9ae0 2024-04-26T23:47:21.384 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:21.380+0000 7f790d59a640 1 -- 172.21.15.88:0/826888626 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7904032660 con 0x7f79080f9ae0 2024-04-26T23:47:21.385 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:21.380+0000 7f790f59e640 1 -- 172.21.15.88:0/826888626 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f79080f9ae0 msgr2=0x7f7908046150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:21.385 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:21.380+0000 7f790f59e640 1 --2- 172.21.15.88:0/826888626 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f79080f9ae0 0x7f7908046150 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f79040097a0 tx=0x7f790402a000 comp rx=0 tx=0).stop 2024-04-26T23:47:21.385 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:21.381+0000 7f790f59e640 1 -- 172.21.15.88:0/826888626 shutdown_connections 2024-04-26T23:47:21.385 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:21.381+0000 7f790f59e640 1 --2- 172.21.15.88:0/826888626 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f79080f9ae0 0x7f7908046150 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:21.385 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:21.381+0000 7f790f59e640 1 -- 172.21.15.88:0/826888626 >> 172.21.15.88:0/826888626 conn(0x7f7908005e90 msgr2=0x7f79080062a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:47:21.385 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:21.381+0000 7f790f59e640 1 -- 172.21.15.88:0/826888626 shutdown_connections 2024-04-26T23:47:21.386 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:21.381+0000 7f790f59e640 1 -- 172.21.15.88:0/826888626 wait complete. 2024-04-26T23:47:21.387 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:21.383+0000 7f790f59e640 1 Processor -- start 2024-04-26T23:47:21.387 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:21.383+0000 7f790f59e640 1 -- start start 2024-04-26T23:47:21.388 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:21.384+0000 7f790f59e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7908046690 0x7f79080f8cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:21.388 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:21.384+0000 7f790f59e640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f79080fdf20 0x7f79080f5970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:21.389 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:21.384+0000 7f790f59e640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f79080f5eb0 0x7f79080fac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:21.389 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:21.384+0000 7f790f59e640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f79080f9ec0 con 0x7f79080fdf20 2024-04-26T23:47:21.389 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:21.385+0000 7f790dd9b640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f79080fdf20 0x7f79080f5970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:21.389 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:21.385+0000 7f790e59c640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7908046690 0x7f79080f8cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:21.389 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:21.385+0000 7f790dd9b640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f79080fdf20 0x7f79080f5970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:52612/0 (socket says 172.21.15.88:52612) 2024-04-26T23:47:21.389 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:21.385+0000 7f790dd9b640 1 -- 172.21.15.88:0/240700948 learned_addr learned my addr 172.21.15.88:0/240700948 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:47:21.389 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:21.385+0000 7f790f59e640 1 -- 172.21.15.88:0/240700948 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f79080fccd0 con 0x7f79080f5eb0 2024-04-26T23:47:21.390 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:21.385+0000 7f790f59e640 1 -- 172.21.15.88:0/240700948 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f79080fd1f0 con 0x7f7908046690 2024-04-26T23:47:21.390 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:21.385+0000 7f790ed9d640 1 --2- 172.21.15.88:0/240700948 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f79080f5eb0 0x7f79080fac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:21.390 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:21.385+0000 7f790dd9b640 1 -- 172.21.15.88:0/240700948 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7908046690 msgr2=0x7f79080f8cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:21.390 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:21.385+0000 7f790dd9b640 1 --2- 172.21.15.88:0/240700948 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7908046690 0x7f79080f8cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:21.390 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:21.385+0000 7f790dd9b640 1 -- 172.21.15.88:0/240700948 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f79080f5eb0 msgr2=0x7f79080fac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:21.390 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:21.385+0000 7f790dd9b640 1 --2- 172.21.15.88:0/240700948 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f79080f5eb0 0x7f79080fac60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:21.390 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:21.385+0000 7f790dd9b640 1 -- 172.21.15.88:0/240700948 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79080fbdd0 con 0x7f79080fdf20 2024-04-26T23:47:21.390 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:21.386+0000 7f790dd9b640 1 --2- 172.21.15.88:0/240700948 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f79080fdf20 0x7f79080f5970 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f790000c500 tx=0x7f790000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:47:21.391 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:21.386+0000 7f78feffd640 1 -- 172.21.15.88:0/240700948 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7900005ce0 con 0x7f79080fdf20 2024-04-26T23:47:21.391 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:21.386+0000 7f78feffd640 1 -- 172.21.15.88:0/240700948 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7900007070 con 0x7f79080fdf20 2024-04-26T23:47:21.391 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:21.386+0000 7f78feffd640 1 -- 172.21.15.88:0/240700948 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7900007420 con 0x7f79080fdf20 2024-04-26T23:47:21.391 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:21.386+0000 7f790f59e640 1 -- 172.21.15.88:0/240700948 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79080f73a0 con 0x7f79080fdf20 2024-04-26T23:47:21.391 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:21.386+0000 7f790f59e640 1 -- 172.21.15.88:0/240700948 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79080f7960 con 0x7f79080fdf20 2024-04-26T23:47:21.392 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:21.388+0000 7f78fcff9640 1 -- 172.21.15.88:0/240700948 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7908007340 con 0x7f79080fdf20 2024-04-26T23:47:21.394 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:21.389+0000 7f78feffd640 1 -- 172.21.15.88:0/240700948 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f79000075c0 con 0x7f79080fdf20 2024-04-26T23:47:21.394 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:21.389+0000 7f78feffd640 1 --2- 172.21.15.88:0/240700948 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f78f006c9f0 0x7f78f006eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:21.394 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:21.390+0000 7f78feffd640 1 -- 172.21.15.88:0/240700948 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6666+0+0 (secure 0 0 0) 0x7f790008bbd0 con 0x7f79080fdf20 2024-04-26T23:47:21.394 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:21.390+0000 7f790e59c640 1 --2- 172.21.15.88:0/240700948 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f78f006c9f0 0x7f78f006eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:21.395 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:21.390+0000 7f790e59c640 1 --2- 172.21.15.88:0/240700948 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f78f006c9f0 0x7f78f006eeb0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f7904034000 tx=0x7f790402e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:47:21.401 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:21.397+0000 7f78feffd640 1 -- 172.21.15.88:0/240700948 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f79000182b0 con 0x7f79080fdf20 2024-04-26T23:47:21.939 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:21.935+0000 7f78fcff9640 1 -- 172.21.15.88:0/240700948 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7f79080f39b0 con 0x7f79080fdf20 2024-04-26T23:47:21.941 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:21.937+0000 7f78feffd640 1 -- 172.21.15.88:0/240700948 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (secure 0 0 0) 0x7f7900059c20 con 0x7f79080fdf20 2024-04-26T23:47:21.947 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:21.943+0000 7f78fcff9640 1 -- 172.21.15.88:0/240700948 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f78f006c9f0 msgr2=0x7f78f006eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:21.947 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:21.943+0000 7f78fcff9640 1 --2- 172.21.15.88:0/240700948 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f78f006c9f0 0x7f78f006eeb0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f7904034000 tx=0x7f790402e000 comp rx=0 tx=0).stop 2024-04-26T23:47:21.947 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:21.943+0000 7f78fcff9640 1 -- 172.21.15.88:0/240700948 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f79080fdf20 msgr2=0x7f79080f5970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:21.947 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:21.943+0000 7f78fcff9640 1 --2- 172.21.15.88:0/240700948 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f79080fdf20 0x7f79080f5970 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f790000c500 tx=0x7f790000c9c0 comp rx=0 tx=0).stop 2024-04-26T23:47:21.948 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:21.943+0000 7f78fcff9640 1 -- 172.21.15.88:0/240700948 shutdown_connections 2024-04-26T23:47:21.948 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:21.943+0000 7f78fcff9640 1 --2- 172.21.15.88:0/240700948 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f78f006c9f0 0x7f78f006eeb0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:21.948 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:21.944+0000 7f78fcff9640 1 --2- 172.21.15.88:0/240700948 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f79080f5eb0 0x7f79080fac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:21.948 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:21.944+0000 7f78fcff9640 1 --2- 172.21.15.88:0/240700948 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f79080fdf20 0x7f79080f5970 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:21.948 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:21.944+0000 7f78fcff9640 1 --2- 172.21.15.88:0/240700948 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7908046690 0x7f79080f8cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:21.948 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:21.944+0000 7f78fcff9640 1 -- 172.21.15.88:0/240700948 >> 172.21.15.88:0/240700948 conn(0x7f7908005e90 msgr2=0x7f79080056a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:47:21.948 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:21.944+0000 7f78fcff9640 1 -- 172.21.15.88:0/240700948 shutdown_connections 2024-04-26T23:47:21.949 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:21.944+0000 7f78fcff9640 1 -- 172.21.15.88:0/240700948 wait complete. 2024-04-26T23:47:21.969 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2024-04-26T23:47:31.970 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-04-26T23:47:31.970 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-04-26T23:47:32.173 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:32.170+0000 7f1086cd1640 1 Processor -- start 2024-04-26T23:47:32.174 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:32.170+0000 7f1086cd1640 1 -- start start 2024-04-26T23:47:32.175 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:32.171+0000 7f1086cd1640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f10800bfa80 0x7f108015a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:32.176 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:32.171+0000 7f1086cd1640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f10800ca2f0 0x7f108015a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:32.176 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:32.171+0000 7f1086cd1640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1080157840 con 0x7f10800b1ac0 2024-04-26T23:47:32.176 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:32.171+0000 7f1086cd1640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f10800b1ea0 con 0x7f10800bfa80 2024-04-26T23:47:32.176 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:32.171+0000 7f1086cd1640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f10800739f0 con 0x7f10800ca2f0 2024-04-26T23:47:32.176 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:32.171+0000 7f107ffff640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f10800bfa80 0x7f108015a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:32.176 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:32.171+0000 7f1084a6d640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f10800b1ac0 0x7f10800c6d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.88:57974/0 (socket says 172.21.15.88:57974) 2024-04-26T23:47:32.176 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:32.171+0000 7f1084a6d640 1 -- 172.21.15.88:0/3261794157 learned_addr learned my addr 172.21.15.88:0/3261794157 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-26T23:47:32.176 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:32.171+0000 7f108526e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f10800ca2f0 0x7f108015a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:32.176 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:32.171+0000 7f107ffff640 1 -- 172.21.15.88:0/3261794157 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f10800ca2f0 msgr2=0x7f108015a7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:47:32.176 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:32.171+0000 7f107ffff640 1 --2- 172.21.15.88:0/3261794157 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f10800ca2f0 0x7f108015a7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:32.176 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:32.171+0000 7f107ffff640 1 -- 172.21.15.88:0/3261794157 >> v1:172.21.15.175:6789/0 conn(0x7f10800b1ac0 legacy=0x7f10800c6d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:32.176 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:32.171+0000 7f107ffff640 1 -- 172.21.15.88:0/3261794157 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f108006db60 con 0x7f10800bfa80 2024-04-26T23:47:32.178 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:32.173+0000 7f107ffff640 1 --2- 172.21.15.88:0/3261794157 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f10800bfa80 0x7f108015a2a0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f10740097a0 tx=0x7f107402a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7014b126fcde9f0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:47:32.178 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:32.173+0000 7f107f7fe640 1 -- 172.21.15.88:0/3261794157 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1074037070 con 0x7f10800bfa80 2024-04-26T23:47:32.178 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:32.173+0000 7f107f7fe640 1 -- 172.21.15.88:0/3261794157 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f107402ae50 con 0x7f10800bfa80 2024-04-26T23:47:32.178 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:32.173+0000 7f107f7fe640 1 -- 172.21.15.88:0/3261794157 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1074032660 con 0x7f10800bfa80 2024-04-26T23:47:32.178 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:32.174+0000 7f1086cd1640 1 -- 172.21.15.88:0/3261794157 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f10800bfa80 msgr2=0x7f108015a2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:32.178 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:32.174+0000 7f1086cd1640 1 --2- 172.21.15.88:0/3261794157 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f10800bfa80 0x7f108015a2a0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f10740097a0 tx=0x7f107402a100 comp rx=0 tx=0).stop 2024-04-26T23:47:32.178 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:32.174+0000 7f1086cd1640 1 -- 172.21.15.88:0/3261794157 shutdown_connections 2024-04-26T23:47:32.178 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:32.174+0000 7f1086cd1640 1 --2- 172.21.15.88:0/3261794157 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f10800ca2f0 0x7f108015a7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:32.179 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:32.174+0000 7f1086cd1640 1 --2- 172.21.15.88:0/3261794157 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f10800bfa80 0x7f108015a2a0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:32.179 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:32.174+0000 7f1086cd1640 1 -- 172.21.15.88:0/3261794157 >> 172.21.15.88:0/3261794157 conn(0x7f10800cc7e0 msgr2=0x7f10800ccbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:47:32.179 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:32.174+0000 7f1086cd1640 1 -- 172.21.15.88:0/3261794157 shutdown_connections 2024-04-26T23:47:32.179 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:32.174+0000 7f1086cd1640 1 -- 172.21.15.88:0/3261794157 wait complete. 2024-04-26T23:47:32.180 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:32.176+0000 7f1086cd1640 1 Processor -- start 2024-04-26T23:47:32.180 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:32.176+0000 7f1086cd1640 1 -- start start 2024-04-26T23:47:32.182 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:32.178+0000 7f1086cd1640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f10800b1ac0 0x7f10800abf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:32.182 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:32.178+0000 7f1086cd1640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f10800bfa80 0x7f108014b920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:32.182 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:32.178+0000 7f1086cd1640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f10800ca2f0 0x7f108014be60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:32.182 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:32.178+0000 7f1086cd1640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f108006e120 con 0x7f10800bfa80 2024-04-26T23:47:32.182 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:32.178+0000 7f1086cd1640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f108006d910 con 0x7f10800ca2f0 2024-04-26T23:47:32.182 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:32.178+0000 7f1086cd1640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f10801574a0 con 0x7f10800b1ac0 2024-04-26T23:47:32.183 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:32.178+0000 7f107ffff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f10800bfa80 0x7f108014b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:32.183 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:32.178+0000 7f1084a6d640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f10800b1ac0 0x7f10800abf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:32.183 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:32.178+0000 7f107ffff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f10800bfa80 0x7f108014b920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:41402/0 (socket says 172.21.15.88:41402) 2024-04-26T23:47:32.183 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:32.178+0000 7f107ffff640 1 -- 172.21.15.88:0/3483654969 learned_addr learned my addr 172.21.15.88:0/3483654969 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:47:32.183 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:32.179+0000 7f108526e640 1 --2- 172.21.15.88:0/3483654969 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f10800ca2f0 0x7f108014be60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:32.184 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:32.179+0000 7f107ffff640 1 -- 172.21.15.88:0/3483654969 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f10800b1ac0 msgr2=0x7f10800abf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:32.184 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:32.179+0000 7f107ffff640 1 --2- 172.21.15.88:0/3483654969 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f10800b1ac0 0x7f10800abf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:32.184 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:32.179+0000 7f107ffff640 1 -- 172.21.15.88:0/3483654969 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f10800ca2f0 msgr2=0x7f108014be60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:32.185 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:32.179+0000 7f107ffff640 1 --2- 172.21.15.88:0/3483654969 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f10800ca2f0 0x7f108014be60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:32.185 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:32.179+0000 7f107ffff640 1 -- 172.21.15.88:0/3483654969 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f108014c3a0 con 0x7f10800bfa80 2024-04-26T23:47:32.185 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:32.179+0000 7f107ffff640 1 --2- 172.21.15.88:0/3483654969 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f10800bfa80 0x7f108014b920 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f10740098c0 tx=0x7f10740046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:47:32.185 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:32.180+0000 7f107d7fa640 1 -- 172.21.15.88:0/3483654969 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1074041030 con 0x7f10800bfa80 2024-04-26T23:47:32.185 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:32.180+0000 7f1086cd1640 1 -- 172.21.15.88:0/3483654969 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10800ae590 con 0x7f10800bfa80 2024-04-26T23:47:32.185 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:32.180+0000 7f107d7fa640 1 -- 172.21.15.88:0/3483654969 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f107402ac50 con 0x7f10800bfa80 2024-04-26T23:47:32.185 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:32.180+0000 7f1086cd1640 1 -- 172.21.15.88:0/3483654969 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10800af400 con 0x7f10800bfa80 2024-04-26T23:47:32.185 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:32.181+0000 7f107d7fa640 1 -- 172.21.15.88:0/3483654969 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1074037040 con 0x7f10800bfa80 2024-04-26T23:47:32.185 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:32.181+0000 7f1086cd1640 1 -- 172.21.15.88:0/3483654969 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1060005290 con 0x7f10800bfa80 2024-04-26T23:47:32.185 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:32.182+0000 7f107d7fa640 1 -- 172.21.15.88:0/3483654969 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f1074044070 con 0x7f10800bfa80 2024-04-26T23:47:32.186 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:32.183+0000 7f107d7fa640 1 --2- 172.21.15.88:0/3483654969 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f106406c920 0x7f106406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:32.186 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:32.183+0000 7f107d7fa640 1 -- 172.21.15.88:0/3483654969 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6666+0+0 (secure 0 0 0) 0x7f10740ac160 con 0x7f10800bfa80 2024-04-26T23:47:32.187 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:32.184+0000 7f1084a6d640 1 --2- 172.21.15.88:0/3483654969 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f106406c920 0x7f106406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:32.188 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:32.184+0000 7f1084a6d640 1 --2- 172.21.15.88:0/3483654969 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f106406c920 0x7f106406ede0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f106c007fd0 tx=0x7f106c007e80 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:47:32.194 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:32.191+0000 7f107d7fa640 1 -- 172.21.15.88:0/3483654969 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f107404b070 con 0x7f10800bfa80 2024-04-26T23:47:32.812 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:32.809+0000 7f1086cd1640 1 -- 172.21.15.88:0/3483654969 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f1060005850 con 0x7f10800bfa80 2024-04-26T23:47:32.813 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:32.810+0000 7f107d7fa640 1 -- 172.21.15.88:0/3483654969 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1565 (secure 0 0 0) 0x7f1074079a70 con 0x7f10800bfa80 2024-04-26T23:47:32.813 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":70,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":13,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"555255e9-7ef9-4454-8dc9-35e96b70035c","modified":"2024-04-26T23:39:34.291658Z","created":"2024-04-26T23:39:34.291658Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:3300","nonce":0},{"type":"v1","addr":"172.21.15.175:6789","nonce":0}]},"addr":"172.21.15.175:6789/0","public_addr":"172.21.15.175:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:3301","nonce":0},{"type":"v1","addr":"172.21.15.175:6790","nonce":0}]},"addr":"172.21.15.175:6790/0","public_addr":"172.21.15.175:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-04-26T23:47:32.816 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:32.813+0000 7f1086cd1640 1 -- 172.21.15.88:0/3483654969 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f106406c920 msgr2=0x7f106406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:32.816 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:32.813+0000 7f1086cd1640 1 --2- 172.21.15.88:0/3483654969 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f106406c920 0x7f106406ede0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f106c007fd0 tx=0x7f106c007e80 comp rx=0 tx=0).stop 2024-04-26T23:47:32.817 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:32.813+0000 7f1086cd1640 1 -- 172.21.15.88:0/3483654969 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f10800bfa80 msgr2=0x7f108014b920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:32.817 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:32.813+0000 7f1086cd1640 1 --2- 172.21.15.88:0/3483654969 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f10800bfa80 0x7f108014b920 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f10740098c0 tx=0x7f10740046c0 comp rx=0 tx=0).stop 2024-04-26T23:47:32.817 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:32.813+0000 7f1086cd1640 1 -- 172.21.15.88:0/3483654969 shutdown_connections 2024-04-26T23:47:32.817 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:32.813+0000 7f1086cd1640 1 --2- 172.21.15.88:0/3483654969 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f106406c920 0x7f106406ede0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:32.817 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:32.813+0000 7f1086cd1640 1 --2- 172.21.15.88:0/3483654969 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f10800ca2f0 0x7f108014be60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:32.817 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:32.813+0000 7f1086cd1640 1 --2- 172.21.15.88:0/3483654969 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f10800bfa80 0x7f108014b920 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:32.817 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:32.813+0000 7f1086cd1640 1 --2- 172.21.15.88:0/3483654969 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f10800b1ac0 0x7f10800abf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:32.818 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:32.813+0000 7f1086cd1640 1 -- 172.21.15.88:0/3483654969 >> 172.21.15.88:0/3483654969 conn(0x7f10800cc7e0 msgr2=0x7f10800ca800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:47:32.818 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:32.814+0000 7f1086cd1640 1 -- 172.21.15.88:0/3483654969 shutdown_connections 2024-04-26T23:47:32.818 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:32.814+0000 7f1086cd1640 1 -- 172.21.15.88:0/3483654969 wait complete. 2024-04-26T23:47:32.838 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-04-26T23:47:32.838 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2024-04-26T23:47:32.838 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-04-26T23:47:32.838 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-04-26T23:47:33.033 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.030+0000 7f76030c8640 1 Processor -- start 2024-04-26T23:47:33.038 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.031+0000 7f76030c8640 1 -- start start 2024-04-26T23:47:33.038 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.033+0000 7f76030c8640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f75fc0c90c0 0x7f75fc15bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:33.038 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.033+0000 7f76030c8640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f75fc0bfbb0 0x7f75fc0cadd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:33.038 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.033+0000 7f76030c8640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f75fc0cbde0 con 0x7f75fc0cb310 2024-04-26T23:47:33.038 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.033+0000 7f76030c8640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f75fc15c150 con 0x7f75fc0bfbb0 2024-04-26T23:47:33.038 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.033+0000 7f76030c8640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f75fc0ca380 con 0x7f75fc0c90c0 2024-04-26T23:47:33.038 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.034+0000 7f75fbfff640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f75fc0bfbb0 0x7f75fc0cadd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:33.038 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.034+0000 7f75fbfff640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f75fc0bfbb0 0x7f75fc0cadd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:41412/0 (socket says 172.21.15.88:41412) 2024-04-26T23:47:33.039 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.034+0000 7f75fbfff640 1 -- 172.21.15.88:0/3065482936 learned_addr learned my addr 172.21.15.88:0/3065482936 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:47:33.039 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.035+0000 7f75fbfff640 1 -- 172.21.15.88:0/3065482936 >> v2:172.21.15.175:3300/0 conn(0x7f75fc0c90c0 msgr2=0x7f75fc15bc10 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-26T23:47:33.039 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.035+0000 7f75fbfff640 1 --2- 172.21.15.88:0/3065482936 >> v2:172.21.15.175:3300/0 conn(0x7f75fc0c90c0 0x7f75fc15bc10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:33.039 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.035+0000 7f75fbfff640 1 -- 172.21.15.88:0/3065482936 >> v1:172.21.15.175:6789/0 conn(0x7f75fc0cb310 legacy=0x7f75fc158510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:47:33.042 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.037+0000 7f75fbfff640 1 -- 172.21.15.88:0/3065482936 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75fc0cc0c0 con 0x7f75fc0bfbb0 2024-04-26T23:47:33.042 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.038+0000 7f75fbfff640 1 --2- 172.21.15.88:0/3065482936 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f75fc0bfbb0 0x7f75fc0cadd0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f75fc08e0f0 tx=0x7f75f402a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29449b1589318258 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:47:33.042 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.039+0000 7f75fb7fe640 1 -- 172.21.15.88:0/3065482936 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75f4036070 con 0x7f75fc0bfbb0 2024-04-26T23:47:33.042 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.039+0000 7f75fb7fe640 1 -- 172.21.15.88:0/3065482936 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75f4031600 con 0x7f75fc0bfbb0 2024-04-26T23:47:33.042 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.039+0000 7f75fb7fe640 1 -- 172.21.15.88:0/3065482936 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75f40319d0 con 0x7f75fc0bfbb0 2024-04-26T23:47:33.044 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.041+0000 7f76030c8640 1 -- 172.21.15.88:0/3065482936 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f75fc0bfbb0 msgr2=0x7f75fc0cadd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:33.045 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.041+0000 7f76030c8640 1 --2- 172.21.15.88:0/3065482936 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f75fc0bfbb0 0x7f75fc0cadd0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f75fc08e0f0 tx=0x7f75f402a660 comp rx=0 tx=0).stop 2024-04-26T23:47:33.045 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.041+0000 7f76030c8640 1 -- 172.21.15.88:0/3065482936 shutdown_connections 2024-04-26T23:47:33.045 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.041+0000 7f76030c8640 1 --2- 172.21.15.88:0/3065482936 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f75fc0bfbb0 0x7f75fc0cadd0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:33.045 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.041+0000 7f76030c8640 1 --2- 172.21.15.88:0/3065482936 >> v2:172.21.15.175:3300/0 conn(0x7f75fc0c90c0 0x7f75fc15bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:33.045 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.041+0000 7f76030c8640 1 -- 172.21.15.88:0/3065482936 >> 172.21.15.88:0/3065482936 conn(0x7f75fc0ae010 msgr2=0x7f75fc0ae3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:47:33.048 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.043+0000 7f76030c8640 1 -- 172.21.15.88:0/3065482936 shutdown_connections 2024-04-26T23:47:33.053 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.046+0000 7f76030c8640 1 -- 172.21.15.88:0/3065482936 wait complete. 2024-04-26T23:47:33.054 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.048+0000 7f76030c8640 1 Processor -- start 2024-04-26T23:47:33.054 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.048+0000 7f76030c8640 1 -- start start 2024-04-26T23:47:33.054 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.049+0000 7f76030c8640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f75fc0bfbb0 0x7f75fc15ca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:33.054 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.049+0000 7f76030c8640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f75fc0c90c0 0x7f75fc175b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:33.055 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.049+0000 7f76030c8640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f75fc0cb310 0x7f75fc176070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:33.055 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.049+0000 7f76030c8640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f75fc0c9620 con 0x7f75fc0cb310 2024-04-26T23:47:33.055 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.049+0000 7f76030c8640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f75fc0c94a0 con 0x7f75fc0c90c0 2024-04-26T23:47:33.055 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.050+0000 7f76030c8640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f75fc158c20 con 0x7f75fc0bfbb0 2024-04-26T23:47:33.055 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.050+0000 7f7601665640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f75fc0cb310 0x7f75fc176070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:33.055 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.051+0000 7f7601665640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f75fc0cb310 0x7f75fc176070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:41428/0 (socket says 172.21.15.88:41428) 2024-04-26T23:47:33.055 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.051+0000 7f7601665640 1 -- 172.21.15.88:0/2588956012 learned_addr learned my addr 172.21.15.88:0/2588956012 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:47:33.056 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.051+0000 7f7601665640 1 -- 172.21.15.88:0/2588956012 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f75fc0bfbb0 msgr2=0x7f75fc15ca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:33.056 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.051+0000 7f7601665640 1 --2- 172.21.15.88:0/2588956012 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f75fc0bfbb0 0x7f75fc15ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:33.056 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.051+0000 7f7601665640 1 -- 172.21.15.88:0/2588956012 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f75fc0c90c0 msgr2=0x7f75fc175b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:33.056 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.051+0000 7f7601665640 1 --2- 172.21.15.88:0/2588956012 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f75fc0c90c0 0x7f75fc175b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:33.056 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.051+0000 7f7601665640 1 -- 172.21.15.88:0/2588956012 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75fc134c00 con 0x7f75fc0cb310 2024-04-26T23:47:33.057 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.052+0000 7f7601665640 1 --2- 172.21.15.88:0/2588956012 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f75fc0cb310 0x7f75fc176070 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f75ec00c550 tx=0x7f75ec00ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:47:33.057 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.053+0000 7f75f97fa640 1 -- 172.21.15.88:0/2588956012 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75ec016020 con 0x7f75fc0cb310 2024-04-26T23:47:33.057 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.053+0000 7f75f97fa640 1 -- 172.21.15.88:0/2588956012 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75ec0052d0 con 0x7f75fc0cb310 2024-04-26T23:47:33.057 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.053+0000 7f75f97fa640 1 -- 172.21.15.88:0/2588956012 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75ec007240 con 0x7f75fc0cb310 2024-04-26T23:47:33.057 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.053+0000 7f76030c8640 1 -- 172.21.15.88:0/2588956012 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75fc134ee0 con 0x7f75fc0cb310 2024-04-26T23:47:33.057 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.053+0000 7f76030c8640 1 -- 172.21.15.88:0/2588956012 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75fc1765b0 con 0x7f75fc0cb310 2024-04-26T23:47:33.065 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.056+0000 7f75f97fa640 1 -- 172.21.15.88:0/2588956012 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f75ec0073e0 con 0x7f75fc0cb310 2024-04-26T23:47:33.065 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.058+0000 7f75f97fa640 1 --2- 172.21.15.88:0/2588956012 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f75e406c9f0 0x7f75e406eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:33.065 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.058+0000 7f76030c8640 1 --2- 172.21.15.88:0/2588956012 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f75fc15d5a0 0x7f75fc0c5430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:33.066 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.058+0000 7f76030c8640 1 -- 172.21.15.88:0/2588956012 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f75fc15daa0 con 0x7f75fc15d5a0 2024-04-26T23:47:33.066 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.058+0000 7f75f97fa640 1 -- 172.21.15.88:0/2588956012 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6666+0+0 (secure 0 0 0) 0x7f75ec08b6e0 con 0x7f75fc0cb310 2024-04-26T23:47:33.066 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.061+0000 7f7600e64640 1 --2- 172.21.15.88:0/2588956012 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f75e406c9f0 0x7f75e406eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:33.066 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.061+0000 7f75fbfff640 1 --2- 172.21.15.88:0/2588956012 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f75fc15d5a0 0x7f75fc0c5430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:33.066 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.063+0000 7f75fbfff640 1 -- 172.21.15.88:0/2588956012 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f75fc076650 con 0x7f75fc15d5a0 2024-04-26T23:47:33.066 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.063+0000 7f7600e64640 1 --2- 172.21.15.88:0/2588956012 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f75e406c9f0 0x7f75e406eeb0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f75e8009740 tx=0x7f75e8006c40 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:47:33.071 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.067+0000 7f75fbfff640 1 --2- 172.21.15.88:0/2588956012 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f75fc15d5a0 0x7f75fc0c5430 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f75fc06dc00 tx=0x7f75f4008590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:47:33.072 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.068+0000 7f75f97fa640 1 -- 172.21.15.88:0/2588956012 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75f4041020 con 0x7f75fc15d5a0 2024-04-26T23:47:33.072 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.068+0000 7f75f97fa640 1 -- 172.21.15.88:0/2588956012 <== mon.0 v2:172.21.15.88:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f75f4037040 con 0x7f75fc15d5a0 2024-04-26T23:47:33.072 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.069+0000 7f75f97fa640 1 -- 172.21.15.88:0/2588956012 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f75fc15d5a0 msgr2=0x7f75fc0c5430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:33.072 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.069+0000 7f75f97fa640 1 --2- 172.21.15.88:0/2588956012 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f75fc15d5a0 0x7f75fc0c5430 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f75fc06dc00 tx=0x7f75f4008590 comp rx=0 tx=0).stop 2024-04-26T23:47:33.079 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.076+0000 7f75f97fa640 1 -- 172.21.15.88:0/2588956012 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f75fc15d5a0 msgr2=0x7f75fc0c5430 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:47:33.080 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.076+0000 7f75f97fa640 1 --2- 172.21.15.88:0/2588956012 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f75fc15d5a0 0x7f75fc0c5430 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:33.091 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.088+0000 7f76030c8640 1 --2- 172.21.15.88:0/2588956012 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f75fc0c63f0 0x7f75fc0c5970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:33.098 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.088+0000 7f75fbfff640 1 --2- 172.21.15.88:0/2588956012 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f75fc0c63f0 0x7f75fc0c5970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:33.098 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.095+0000 7f76030c8640 1 -- 172.21.15.88:0/2588956012 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f75fc0507a0 con 0x7f75fc0c63f0 2024-04-26T23:47:33.101 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.098+0000 7f75fbfff640 1 -- 172.21.15.88:0/2588956012 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f75fc0c9d20 con 0x7f75fc0c63f0 2024-04-26T23:47:33.105 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.102+0000 7f75fbfff640 1 --2- 172.21.15.88:0/2588956012 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f75fc0c63f0 0x7f75fc0c5970 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f75f4000f80 tx=0x7f75f4009000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:47:33.106 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.103+0000 7f75f97fa640 1 -- 172.21.15.88:0/2588956012 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75f4041030 con 0x7f75fc0c63f0 2024-04-26T23:47:33.108 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-04-26T23:47:33.108 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2024-04-26T23:47:33.108 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2024-04-26T23:47:33.108 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "leader", 2024-04-26T23:47:33.108 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 70, 2024-04-26T23:47:33.108 INFO:teuthology.orchestra.run.smithi088.stdout: "uptime": 26169, 2024-04-26T23:47:33.108 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2024-04-26T23:47:33.108 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2024-04-26T23:47:33.108 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2024-04-26T23:47:33.109 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2024-04-26T23:47:33.109 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:47:33.109 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 13, 2024-04-26T23:47:33.109 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2024-04-26T23:47:33.109 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2450521708007866372", 2024-04-26T23:47:33.109 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2024-04-26T23:47:33.109 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-04-26T23:47:33.109 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-04-26T23:47:33.109 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-04-26T23:47:33.109 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-04-26T23:47:33.109 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-04-26T23:47:33.109 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-04-26T23:47:33.109 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-04-26T23:47:33.109 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-04-26T23:47:33.110 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-04-26T23:47:33.110 INFO:teuthology.orchestra.run.smithi088.stdout: "reef", 2024-04-26T23:47:33.110 INFO:teuthology.orchestra.run.smithi088.stdout: "squid" 2024-04-26T23:47:33.110 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:47:33.110 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540701547738038271", 2024-04-26T23:47:33.110 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2024-04-26T23:47:33.110 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-04-26T23:47:33.110 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-04-26T23:47:33.110 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-04-26T23:47:33.110 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-04-26T23:47:33.110 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-04-26T23:47:33.110 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-04-26T23:47:33.110 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-04-26T23:47:33.110 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-04-26T23:47:33.111 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-04-26T23:47:33.111 INFO:teuthology.orchestra.run.smithi088.stdout: "reef", 2024-04-26T23:47:33.111 INFO:teuthology.orchestra.run.smithi088.stdout: "squid" 2024-04-26T23:47:33.111 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:47:33.111 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:47:33.111 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2024-04-26T23:47:33.111 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2024-04-26T23:47:33.111 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2024-04-26T23:47:33.111 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2024-04-26T23:47:33.111 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2024-04-26T23:47:33.111 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "555255e9-7ef9-4454-8dc9-35e96b70035c", 2024-04-26T23:47:33.111 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2024-04-26T23:39:34.291658Z", 2024-04-26T23:47:33.111 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2024-04-26T23:39:34.291658Z", 2024-04-26T23:47:33.111 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 19, 2024-04-26T23:47:33.112 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "squid", 2024-04-26T23:47:33.112 INFO:teuthology.orchestra.run.smithi088.stdout: "election_strategy": 1, 2024-04-26T23:47:33.112 INFO:teuthology.orchestra.run.smithi088.stdout: "disallowed_leaders: ": "", 2024-04-26T23:47:33.112 INFO:teuthology.orchestra.run.smithi088.stdout: "stretch_mode": false, 2024-04-26T23:47:33.112 INFO:teuthology.orchestra.run.smithi088.stdout: "tiebreaker_mon": "", 2024-04-26T23:47:33.112 INFO:teuthology.orchestra.run.smithi088.stdout: "removed_ranks: ": "", 2024-04-26T23:47:33.112 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2024-04-26T23:47:33.112 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2024-04-26T23:47:33.112 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-04-26T23:47:33.112 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-04-26T23:47:33.112 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-04-26T23:47:33.112 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-04-26T23:47:33.112 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-04-26T23:47:33.112 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-04-26T23:47:33.112 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-04-26T23:47:33.113 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-04-26T23:47:33.113 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-04-26T23:47:33.113 INFO:teuthology.orchestra.run.smithi088.stdout: "reef", 2024-04-26T23:47:33.113 INFO:teuthology.orchestra.run.smithi088.stdout: "squid" 2024-04-26T23:47:33.113 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:47:33.113 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2024-04-26T23:47:33.113 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:47:33.113 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2024-04-26T23:47:33.113 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:47:33.113 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2024-04-26T23:47:33.113 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2024-04-26T23:47:33.113 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-04-26T23:47:33.113 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-04-26T23:47:33.113 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:47:33.113 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-04-26T23:47:33.114 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2024-04-26T23:47:33.114 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:47:33.114 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:47:33.114 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:47:33.114 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-04-26T23:47:33.114 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2024-04-26T23:47:33.114 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:47:33.114 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:47:33.114 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:47:33.114 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:47:33.114 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2024-04-26T23:47:33.114 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2024-04-26T23:47:33.114 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-04-26T23:47:33.115 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-04-26T23:47:33.115 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-04-26T23:47:33.115 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:47:33.115 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:47:33.115 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2024-04-26T23:47:33.115 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2024-04-26T23:47:33.115 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-04-26T23:47:33.115 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-04-26T23:47:33.115 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:47:33.115 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-04-26T23:47:33.115 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:3300", 2024-04-26T23:47:33.115 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:47:33.115 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:47:33.115 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:47:33.116 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-04-26T23:47:33.116 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6789", 2024-04-26T23:47:33.116 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:47:33.116 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:47:33.116 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:47:33.116 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:47:33.116 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6789/0", 2024-04-26T23:47:33.116 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.175:6789/0", 2024-04-26T23:47:33.116 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-04-26T23:47:33.116 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-04-26T23:47:33.116 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-04-26T23:47:33.116 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:47:33.116 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:47:33.116 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2024-04-26T23:47:33.116 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2024-04-26T23:47:33.117 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-04-26T23:47:33.117 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-04-26T23:47:33.117 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:47:33.117 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-04-26T23:47:33.117 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:3301", 2024-04-26T23:47:33.117 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:47:33.117 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:47:33.117 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:47:33.117 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-04-26T23:47:33.117 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6790", 2024-04-26T23:47:33.117 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:47:33.117 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:47:33.117 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:47:33.117 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:47:33.117 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6790/0", 2024-04-26T23:47:33.118 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.175:6790/0", 2024-04-26T23:47:33.118 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-04-26T23:47:33.118 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-04-26T23:47:33.118 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-04-26T23:47:33.118 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:47:33.118 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:47:33.118 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:47:33.118 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2024-04-26T23:47:33.118 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2024-04-26T23:47:33.118 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:47:33.118 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:47:33.118 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:47:33.118 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2024-04-26T23:47:33.118 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:47:33.119 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:47:33.119 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2024-04-26T23:47:33.119 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:47:33.119 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:47:33.119 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:47:33.119 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2024-04-26T23:47:33.119 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:47:33.119 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:47:33.119 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:47:33.119 INFO:teuthology.orchestra.run.smithi088.stdout: "stretch_mode": false 2024-04-26T23:47:33.119 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-04-26T23:47:33.120 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.103+0000 7f75f97fa640 1 -- 172.21.15.88:0/2588956012 <== mon.0 v2:172.21.15.88:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4557 (secure 0 0 0) 0x7f75f4048a60 con 0x7f75fc0c63f0 2024-04-26T23:47:33.120 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.103+0000 7f75f97fa640 1 -- 172.21.15.88:0/2588956012 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f75fc0c63f0 msgr2=0x7f75fc0c5970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:33.120 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.103+0000 7f75f97fa640 1 --2- 172.21.15.88:0/2588956012 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f75fc0c63f0 0x7f75fc0c5970 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f75f4000f80 tx=0x7f75f4009000 comp rx=0 tx=0).stop 2024-04-26T23:47:33.120 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.103+0000 7f75f97fa640 1 -- 172.21.15.88:0/2588956012 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f75fc0c63f0 msgr2=0x7f75fc0c5970 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:47:33.120 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.103+0000 7f75f97fa640 1 --2- 172.21.15.88:0/2588956012 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f75fc0c63f0 0x7f75fc0c5970 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:33.120 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.104+0000 7f75f2ffd640 1 -- 172.21.15.88:0/2588956012 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f75e406c9f0 msgr2=0x7f75e406eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:33.120 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.104+0000 7f75f2ffd640 1 --2- 172.21.15.88:0/2588956012 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f75e406c9f0 0x7f75e406eeb0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f75e8009740 tx=0x7f75e8006c40 comp rx=0 tx=0).stop 2024-04-26T23:47:33.120 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.104+0000 7f7601665640 1 -- 172.21.15.88:0/2588956012 reap_dead start 2024-04-26T23:47:33.120 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.104+0000 7f75f2ffd640 1 -- 172.21.15.88:0/2588956012 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f75fc0cb310 msgr2=0x7f75fc176070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:33.120 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.104+0000 7f75f2ffd640 1 --2- 172.21.15.88:0/2588956012 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f75fc0cb310 0x7f75fc176070 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f75ec00c550 tx=0x7f75ec00ca10 comp rx=0 tx=0).stop 2024-04-26T23:47:33.120 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.105+0000 7f75f2ffd640 1 -- 172.21.15.88:0/2588956012 shutdown_connections 2024-04-26T23:47:33.121 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.105+0000 7f75f2ffd640 1 --2- 172.21.15.88:0/2588956012 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f75fc0cb310 0x7f75fc176070 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:33.121 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.105+0000 7f75f2ffd640 1 -- 172.21.15.88:0/2588956012 >> 172.21.15.88:0/2588956012 conn(0x7f75fc0ae010 msgr2=0x7f75fc15ae80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:47:33.121 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.105+0000 7f75f2ffd640 1 -- 172.21.15.88:0/2588956012 shutdown_connections 2024-04-26T23:47:33.121 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.105+0000 7f75f2ffd640 1 -- 172.21.15.88:0/2588956012 wait complete. 2024-04-26T23:47:33.144 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-04-26T23:47:33.145 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-04-26T23:47:33.145 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-04-26T23:47:33.334 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.330+0000 7f281df27640 1 Processor -- start 2024-04-26T23:47:33.334 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.331+0000 7f281df27640 1 -- start start 2024-04-26T23:47:33.336 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.332+0000 7f281df27640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f2810047240 0x7f28100479e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:33.336 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.332+0000 7f281df27640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2810048090 con 0x7f281003fb00 2024-04-26T23:47:33.336 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.332+0000 7f281df27640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2810047700 con 0x7f28100deb90 2024-04-26T23:47:33.336 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.332+0000 7f281df27640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f2810048980 con 0x7f2810047240 2024-04-26T23:47:33.337 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.332+0000 7f281cf25640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f281003fb00 0x7f28100dbcf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:58048/0 (socket says 172.21.15.88:58048) 2024-04-26T23:47:33.337 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.332+0000 7f281cf25640 1 -- 172.21.15.88:0/793182284 learned_addr learned my addr 172.21.15.88:0/793182284 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-26T23:47:33.337 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.333+0000 7f2817fff640 1 --2- 172.21.15.88:0/793182284 >> v2:172.21.15.88:3300/0 conn(0x7f2810047240 0x7f28100479e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:33.337 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.333+0000 7f28177fe640 1 -- 172.21.15.88:0/793182284 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2576603558 0 0) 0x7f2810048090 con 0x7f281003fb00 2024-04-26T23:47:33.337 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.333+0000 7f28177fe640 1 -- 172.21.15.88:0/793182284 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2808003520 con 0x7f281003fb00 2024-04-26T23:47:33.337 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.334+0000 7f28177fe640 1 -- 172.21.15.88:0/793182284 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1830820931 0 0) 0x7f2808003520 con 0x7f281003fb00 2024-04-26T23:47:33.337 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.334+0000 7f28177fe640 1 -- 172.21.15.88:0/793182284 >> v2:172.21.15.88:3300/0 conn(0x7f2810047240 msgr2=0x7f28100479e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:47:33.341 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.334+0000 7f28177fe640 1 --2- 172.21.15.88:0/793182284 >> v2:172.21.15.88:3300/0 conn(0x7f2810047240 0x7f28100479e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:33.341 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.334+0000 7f28177fe640 1 -- 172.21.15.88:0/793182284 >> v1:172.21.15.175:6789/0 conn(0x7f28100deb90 legacy=0x7f28100defb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:47:33.341 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.334+0000 7f28177fe640 1 -- 172.21.15.88:0/793182284 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2810048330 con 0x7f281003fb00 2024-04-26T23:47:33.341 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.334+0000 7f28177fe640 1 -- 172.21.15.88:0/793182284 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 356324787 0 0) 0x7f2818050be0 con 0x7f281003fb00 2024-04-26T23:47:33.341 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.334+0000 7f28177fe640 1 -- 172.21.15.88:0/793182284 >> v1:172.21.15.88:6789/0 conn(0x7f281003fb00 legacy=0x7f28100dbcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:33.341 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.334+0000 7f28177fe640 1 --2- 172.21.15.88:0/793182284 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f28080039b0 0x7f2808003db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:33.341 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.334+0000 7f28177fe640 1 --2- 172.21.15.88:0/793182284 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f28080043d0 0x7f28080048a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:33.341 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.334+0000 7f28177fe640 1 --2- 172.21.15.88:0/793182284 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2808005140 0x7f280800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:33.342 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.334+0000 7f28177fe640 1 -- 172.21.15.88:0/793182284 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f2810048980 con 0x7f28080039b0 2024-04-26T23:47:33.342 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.334+0000 7f28177fe640 1 -- 172.21.15.88:0/793182284 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f280800c090 con 0x7f28080043d0 2024-04-26T23:47:33.342 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.334+0000 7f28177fe640 1 -- 172.21.15.88:0/793182284 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f280800c290 con 0x7f2808005140 2024-04-26T23:47:33.342 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.334+0000 7f281cf25640 1 --2- 172.21.15.88:0/793182284 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f28080039b0 0x7f2808003db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:33.342 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.335+0000 7f281cf25640 1 -- 172.21.15.88:0/793182284 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2808005140 msgr2=0x7f280800b9c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T23:47:33.342 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.335+0000 7f281cf25640 1 --2- 172.21.15.88:0/793182284 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2808005140 0x7f280800b9c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:33.342 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.335+0000 7f281cf25640 1 -- 172.21.15.88:0/793182284 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f28080043d0 msgr2=0x7f28080048a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T23:47:33.342 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.335+0000 7f281cf25640 1 --2- 172.21.15.88:0/793182284 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f28080043d0 0x7f28080048a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:33.342 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.335+0000 7f281cf25640 1 -- 172.21.15.88:0/793182284 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2808003520 con 0x7f28080039b0 2024-04-26T23:47:33.342 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.336+0000 7f281cf25640 1 --2- 172.21.15.88:0/793182284 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f28080039b0 0x7f2808003db0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f2810048260 tx=0x7f2808005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39ff447b63d5bcfd server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:47:33.342 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.336+0000 7f28177fe640 1 -- 172.21.15.88:0/793182284 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2818050f10 con 0x7f28080039b0 2024-04-26T23:47:33.342 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.336+0000 7f28177fe640 1 -- 172.21.15.88:0/793182284 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28180b3070 con 0x7f28080039b0 2024-04-26T23:47:33.343 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.336+0000 7f28177fe640 1 -- 172.21.15.88:0/793182284 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28180ae920 con 0x7f28080039b0 2024-04-26T23:47:33.343 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.338+0000 7f281d726640 1 -- 172.21.15.88:0/793182284 reap_dead start 2024-04-26T23:47:33.343 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.338+0000 7f2817fff640 1 --2- 172.21.15.88:0/793182284 >> v2:172.21.15.88:3300/0 conn(0x7f2810047240 0x7f28100479e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:47:33.344 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.339+0000 7f281df27640 1 -- 172.21.15.88:0/793182284 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f28080039b0 msgr2=0x7f2808003db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:33.344 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.339+0000 7f281df27640 1 --2- 172.21.15.88:0/793182284 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f28080039b0 0x7f2808003db0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f2810048260 tx=0x7f2808005830 comp rx=0 tx=0).stop 2024-04-26T23:47:33.344 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.339+0000 7f281df27640 1 -- 172.21.15.88:0/793182284 shutdown_connections 2024-04-26T23:47:33.344 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.339+0000 7f281df27640 1 --2- 172.21.15.88:0/793182284 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f28080039b0 0x7f2808003db0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:33.344 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.339+0000 7f281df27640 1 -- 172.21.15.88:0/793182284 >> 172.21.15.88:0/793182284 conn(0x7f2810049340 msgr2=0x7f2810049750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:47:33.344 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.339+0000 7f281df27640 1 -- 172.21.15.88:0/793182284 shutdown_connections 2024-04-26T23:47:33.344 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.339+0000 7f281df27640 1 -- 172.21.15.88:0/793182284 wait complete. 2024-04-26T23:47:33.344 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.341+0000 7f281df27640 1 Processor -- start 2024-04-26T23:47:33.352 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.345+0000 7f281df27640 1 -- start start 2024-04-26T23:47:33.352 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.346+0000 7f281df27640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f28080039b0 0x7f2810031f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:33.352 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.346+0000 7f281df27640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f28100db000 0x7f2810030810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:33.352 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.346+0000 7f281df27640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2810041210 0x7f28100da660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:33.352 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.346+0000 7f281df27640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f281004a200 con 0x7f28100db000 2024-04-26T23:47:33.352 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.346+0000 7f281df27640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f281004a080 con 0x7f2810041210 2024-04-26T23:47:33.352 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.346+0000 7f281df27640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f28100dc400 con 0x7f28080039b0 2024-04-26T23:47:33.352 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.346+0000 7f2817fff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f28100db000 0x7f2810030810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:33.352 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.346+0000 7f2817fff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f28100db000 0x7f2810030810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:41472/0 (socket says 172.21.15.88:41472) 2024-04-26T23:47:33.352 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.346+0000 7f2817fff640 1 -- 172.21.15.88:0/1562467049 learned_addr learned my addr 172.21.15.88:0/1562467049 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:47:33.353 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.347+0000 7f2817fff640 1 -- 172.21.15.88:0/1562467049 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f28080039b0 msgr2=0x7f2810031f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:33.353 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.347+0000 7f2817fff640 1 --2- 172.21.15.88:0/1562467049 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f28080039b0 0x7f2810031f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:33.353 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.347+0000 7f2817fff640 1 -- 172.21.15.88:0/1562467049 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2810041210 msgr2=0x7f28100da660 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T23:47:33.353 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.347+0000 7f2817fff640 1 --2- 172.21.15.88:0/1562467049 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2810041210 0x7f28100da660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:33.353 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.347+0000 7f2817fff640 1 -- 172.21.15.88:0/1562467049 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2810180990 con 0x7f28100db000 2024-04-26T23:47:33.353 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.347+0000 7f2817fff640 1 --2- 172.21.15.88:0/1562467049 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f28100db000 0x7f2810030810 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f280c00e7e0 tx=0x7f280c00eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:47:33.357 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.350+0000 7f28157fa640 1 -- 172.21.15.88:0/1562467049 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f280c017070 con 0x7f28100db000 2024-04-26T23:47:33.358 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.350+0000 7f28157fa640 1 -- 172.21.15.88:0/1562467049 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f280c00c860 con 0x7f28100db000 2024-04-26T23:47:33.358 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.350+0000 7f28157fa640 1 -- 172.21.15.88:0/1562467049 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f280c00cc50 con 0x7f28100db000 2024-04-26T23:47:33.358 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.350+0000 7f281df27640 1 -- 172.21.15.88:0/1562467049 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2810030010 con 0x7f28100db000 2024-04-26T23:47:33.358 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.350+0000 7f281df27640 1 -- 172.21.15.88:0/1562467049 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28100312e0 con 0x7f28100db000 2024-04-26T23:47:33.358 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.353+0000 7f2802ffd640 1 --2- 172.21.15.88:0/1562467049 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f28101804f0 0x7f281017c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:33.358 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.353+0000 7f2802ffd640 1 -- 172.21.15.88:0/1562467049 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f2810030530 con 0x7f28101804f0 2024-04-26T23:47:33.358 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.355+0000 7f281cf25640 1 --2- 172.21.15.88:0/1562467049 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f28101804f0 0x7f281017c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:33.359 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.355+0000 7f28157fa640 1 -- 172.21.15.88:0/1562467049 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f280c01a070 con 0x7f28100db000 2024-04-26T23:47:33.359 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.356+0000 7f28157fa640 1 --2- 172.21.15.88:0/1562467049 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f27fc06c9c0 0x7f27fc06ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:33.359 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.356+0000 7f28157fa640 1 -- 172.21.15.88:0/1562467049 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6666+0+0 (secure 0 0 0) 0x7f280c08bee0 con 0x7f28100db000 2024-04-26T23:47:33.365 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.356+0000 7f281d726640 1 --2- 172.21.15.88:0/1562467049 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f27fc06c9c0 0x7f27fc06ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:33.365 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.357+0000 7f281d726640 1 --2- 172.21.15.88:0/1562467049 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f27fc06c9c0 0x7f27fc06ee80 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f281000e0c0 tx=0x7f2804007990 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:47:33.365 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.358+0000 7f281cf25640 1 -- 172.21.15.88:0/1562467049 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2810030d50 con 0x7f28101804f0 2024-04-26T23:47:33.365 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.358+0000 7f281cf25640 1 --2- 172.21.15.88:0/1562467049 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f28101804f0 0x7f281017c7c0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f2818050e00 tx=0x7f2818067fd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:47:33.366 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.361+0000 7f28157fa640 1 -- 172.21.15.88:0/1562467049 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2818050f10 con 0x7f28101804f0 2024-04-26T23:47:33.367 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.361+0000 7f28157fa640 1 -- 172.21.15.88:0/1562467049 <== mon.1 v2:172.21.15.175:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f28180b3070 con 0x7f28101804f0 2024-04-26T23:47:33.367 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.361+0000 7f28157fa640 1 -- 172.21.15.88:0/1562467049 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f28101804f0 msgr2=0x7f281017c7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:33.367 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.361+0000 7f28157fa640 1 --2- 172.21.15.88:0/1562467049 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f28101804f0 0x7f281017c7c0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f2818050e00 tx=0x7f2818067fd0 comp rx=0 tx=0).stop 2024-04-26T23:47:33.367 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.362+0000 7f28157fa640 1 -- 172.21.15.88:0/1562467049 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f28101804f0 msgr2=0x7f281017c7c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:47:33.367 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.362+0000 7f28157fa640 1 --2- 172.21.15.88:0/1562467049 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f28101804f0 0x7f281017c7c0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:33.383 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.378+0000 7f2802ffd640 1 --2- 172.21.15.88:0/1562467049 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2810041610 0x7f281017cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:33.383 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.378+0000 7f2802ffd640 1 -- 172.21.15.88:0/1562467049 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f28100057e0 con 0x7f2810041610 2024-04-26T23:47:33.383 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.380+0000 7f281cf25640 1 --2- 172.21.15.88:0/1562467049 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2810041610 0x7f281017cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:33.388 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.385+0000 7f281cf25640 1 -- 172.21.15.88:0/1562467049 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f28100db550 con 0x7f2810041610 2024-04-26T23:47:33.389 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.386+0000 7f281cf25640 1 --2- 172.21.15.88:0/1562467049 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2810041610 0x7f281017cd00 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f2818051fc0 tx=0x7f2818075f20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:47:33.389 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.386+0000 7f28157fa640 1 -- 172.21.15.88:0/1562467049 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28180ca070 con 0x7f2810041610 2024-04-26T23:47:33.391 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-04-26T23:47:33.391 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2024-04-26T23:47:33.391 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2024-04-26T23:47:33.391 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "peon", 2024-04-26T23:47:33.391 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 70, 2024-04-26T23:47:33.392 INFO:teuthology.orchestra.run.smithi088.stdout: "uptime": 86498, 2024-04-26T23:47:33.392 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2024-04-26T23:47:33.392 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2024-04-26T23:47:33.392 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2024-04-26T23:47:33.392 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2024-04-26T23:47:33.392 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:47:33.392 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 13, 2024-04-26T23:47:33.392 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2024-04-26T23:47:33.392 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2450521708007866372", 2024-04-26T23:47:33.392 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2024-04-26T23:47:33.392 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-04-26T23:47:33.392 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-04-26T23:47:33.392 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-04-26T23:47:33.392 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-04-26T23:47:33.392 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-04-26T23:47:33.393 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-04-26T23:47:33.393 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-04-26T23:47:33.393 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-04-26T23:47:33.393 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-04-26T23:47:33.393 INFO:teuthology.orchestra.run.smithi088.stdout: "reef", 2024-04-26T23:47:33.393 INFO:teuthology.orchestra.run.smithi088.stdout: "squid" 2024-04-26T23:47:33.393 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:47:33.393 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540701547738038271", 2024-04-26T23:47:33.393 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2024-04-26T23:47:33.393 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-04-26T23:47:33.393 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-04-26T23:47:33.393 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-04-26T23:47:33.393 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-04-26T23:47:33.393 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-04-26T23:47:33.393 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-04-26T23:47:33.394 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-04-26T23:47:33.394 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-04-26T23:47:33.394 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-04-26T23:47:33.394 INFO:teuthology.orchestra.run.smithi088.stdout: "reef", 2024-04-26T23:47:33.394 INFO:teuthology.orchestra.run.smithi088.stdout: "squid" 2024-04-26T23:47:33.394 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:47:33.394 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:47:33.394 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2024-04-26T23:47:33.394 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2024-04-26T23:47:33.394 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2024-04-26T23:47:33.394 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2024-04-26T23:47:33.394 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2024-04-26T23:47:33.394 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "555255e9-7ef9-4454-8dc9-35e96b70035c", 2024-04-26T23:47:33.394 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2024-04-26T23:39:34.291658Z", 2024-04-26T23:47:33.395 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2024-04-26T23:39:34.291658Z", 2024-04-26T23:47:33.395 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 19, 2024-04-26T23:47:33.395 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "squid", 2024-04-26T23:47:33.395 INFO:teuthology.orchestra.run.smithi088.stdout: "election_strategy": 1, 2024-04-26T23:47:33.395 INFO:teuthology.orchestra.run.smithi088.stdout: "disallowed_leaders: ": "", 2024-04-26T23:47:33.395 INFO:teuthology.orchestra.run.smithi088.stdout: "stretch_mode": false, 2024-04-26T23:47:33.395 INFO:teuthology.orchestra.run.smithi088.stdout: "tiebreaker_mon": "", 2024-04-26T23:47:33.395 INFO:teuthology.orchestra.run.smithi088.stdout: "removed_ranks: ": "", 2024-04-26T23:47:33.395 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2024-04-26T23:47:33.395 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2024-04-26T23:47:33.395 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-04-26T23:47:33.395 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-04-26T23:47:33.395 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-04-26T23:47:33.395 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-04-26T23:47:33.395 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-04-26T23:47:33.396 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-04-26T23:47:33.396 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-04-26T23:47:33.396 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-04-26T23:47:33.396 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-04-26T23:47:33.396 INFO:teuthology.orchestra.run.smithi088.stdout: "reef", 2024-04-26T23:47:33.396 INFO:teuthology.orchestra.run.smithi088.stdout: "squid" 2024-04-26T23:47:33.396 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:47:33.396 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2024-04-26T23:47:33.396 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:47:33.396 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2024-04-26T23:47:33.396 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:47:33.396 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2024-04-26T23:47:33.396 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2024-04-26T23:47:33.396 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-04-26T23:47:33.396 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-04-26T23:47:33.397 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:47:33.397 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-04-26T23:47:33.397 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2024-04-26T23:47:33.397 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:47:33.397 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:47:33.397 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:47:33.397 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-04-26T23:47:33.397 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2024-04-26T23:47:33.397 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:47:33.397 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:47:33.397 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:47:33.397 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:47:33.397 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2024-04-26T23:47:33.397 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2024-04-26T23:47:33.398 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-04-26T23:47:33.398 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-04-26T23:47:33.398 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-04-26T23:47:33.398 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:47:33.398 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:47:33.398 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2024-04-26T23:47:33.398 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2024-04-26T23:47:33.398 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-04-26T23:47:33.398 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-04-26T23:47:33.398 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:47:33.398 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-04-26T23:47:33.398 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:3300", 2024-04-26T23:47:33.398 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:47:33.398 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:47:33.398 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:47:33.399 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-04-26T23:47:33.399 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6789", 2024-04-26T23:47:33.399 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:47:33.399 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:47:33.399 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:47:33.399 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:47:33.399 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6789/0", 2024-04-26T23:47:33.399 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.175:6789/0", 2024-04-26T23:47:33.399 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-04-26T23:47:33.399 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-04-26T23:47:33.399 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-04-26T23:47:33.399 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:47:33.399 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:47:33.399 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2024-04-26T23:47:33.400 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2024-04-26T23:47:33.400 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-04-26T23:47:33.400 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-04-26T23:47:33.400 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:47:33.400 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-04-26T23:47:33.400 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:3301", 2024-04-26T23:47:33.400 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:47:33.400 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:47:33.400 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:47:33.400 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-04-26T23:47:33.400 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6790", 2024-04-26T23:47:33.400 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:47:33.400 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:47:33.400 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:47:33.401 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:47:33.401 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6790/0", 2024-04-26T23:47:33.401 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.175:6790/0", 2024-04-26T23:47:33.401 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-04-26T23:47:33.401 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-04-26T23:47:33.401 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-04-26T23:47:33.401 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:47:33.401 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:47:33.401 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:47:33.401 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2024-04-26T23:47:33.401 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2024-04-26T23:47:33.401 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:47:33.401 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:47:33.401 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:47:33.401 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2024-04-26T23:47:33.402 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:47:33.402 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:47:33.402 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": [ 2024-04-26T23:47:33.402 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:47:33.402 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:47:33.402 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:47:33.402 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2024-04-26T23:47:33.402 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:47:33.402 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:47:33.402 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2024-04-26T23:47:33.402 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:47:33.402 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:47:33.402 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:47:33.402 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2024-04-26T23:47:33.402 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:47:33.403 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:47:33.403 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": [ 2024-04-26T23:47:33.403 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:47:33.403 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:47:33.403 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:47:33.403 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2024-04-26T23:47:33.403 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:47:33.403 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:47:33.403 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:47:33.403 INFO:teuthology.orchestra.run.smithi088.stdout: "stretch_mode": false 2024-04-26T23:47:33.403 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-04-26T23:47:33.404 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.387+0000 7f28157fa640 1 -- 172.21.15.88:0/1562467049 <== mon.1 v2:172.21.15.175:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4895 (secure 0 0 0) 0x7f28180c6770 con 0x7f2810041610 2024-04-26T23:47:33.404 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.387+0000 7f28157fa640 1 -- 172.21.15.88:0/1562467049 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2810041610 msgr2=0x7f281017cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:33.404 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.387+0000 7f28157fa640 1 --2- 172.21.15.88:0/1562467049 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2810041610 0x7f281017cd00 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f2818051fc0 tx=0x7f2818075f20 comp rx=0 tx=0).stop 2024-04-26T23:47:33.404 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.387+0000 7f28157fa640 1 -- 172.21.15.88:0/1562467049 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2810041610 msgr2=0x7f281017cd00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:47:33.404 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.387+0000 7f28157fa640 1 --2- 172.21.15.88:0/1562467049 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2810041610 0x7f281017cd00 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:33.404 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.390+0000 7f281df27640 1 -- 172.21.15.88:0/1562467049 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f27fc06c9c0 msgr2=0x7f27fc06ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:33.404 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.390+0000 7f281df27640 1 --2- 172.21.15.88:0/1562467049 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f27fc06c9c0 0x7f27fc06ee80 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f281000e0c0 tx=0x7f2804007990 comp rx=0 tx=0).stop 2024-04-26T23:47:33.404 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.390+0000 7f281df27640 1 -- 172.21.15.88:0/1562467049 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f28100db000 msgr2=0x7f2810030810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:33.404 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.390+0000 7f281df27640 1 --2- 172.21.15.88:0/1562467049 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f28100db000 0x7f2810030810 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f280c00e7e0 tx=0x7f280c00eca0 comp rx=0 tx=0).stop 2024-04-26T23:47:33.405 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.390+0000 7f281d726640 1 -- 172.21.15.88:0/1562467049 reap_dead start 2024-04-26T23:47:33.405 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.390+0000 7f281d726640 1 -- 172.21.15.88:0/1562467049 reap_dead start 2024-04-26T23:47:33.405 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.390+0000 7f281df27640 1 -- 172.21.15.88:0/1562467049 shutdown_connections 2024-04-26T23:47:33.405 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.390+0000 7f281df27640 1 -- 172.21.15.88:0/1562467049 >> 172.21.15.88:0/1562467049 conn(0x7f2810049340 msgr2=0x7f28100059f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:47:33.405 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.390+0000 7f281df27640 1 -- 172.21.15.88:0/1562467049 shutdown_connections 2024-04-26T23:47:33.405 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.390+0000 7f281df27640 1 -- 172.21.15.88:0/1562467049 wait complete. 2024-04-26T23:47:33.433 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-04-26T23:47:33.433 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-04-26T23:47:33.433 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-04-26T23:47:33.636 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.629+0000 7f1ac6b86640 1 Processor -- start 2024-04-26T23:47:33.636 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.629+0000 7f1ac6b86640 1 -- start start 2024-04-26T23:47:33.636 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.630+0000 7f1ac6b86640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1ac00c5880 0x7f1ac006e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:33.636 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.630+0000 7f1ac6b86640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1ac00ac1c0 con 0x7f1ac0073eb0 2024-04-26T23:47:33.636 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.630+0000 7f1ac6b86640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1ac006d6d0 con 0x7f1ac006e720 2024-04-26T23:47:33.636 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.630+0000 7f1ac6b86640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f1ac00ab620 con 0x7f1ac00c5880 2024-04-26T23:47:33.636 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.631+0000 7f1ac4922640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f1ac0073eb0 0x7f1ac00abab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:58064/0 (socket says 172.21.15.88:58064) 2024-04-26T23:47:33.636 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.631+0000 7f1ac4922640 1 -- 172.21.15.88:0/1380671932 learned_addr learned my addr 172.21.15.88:0/1380671932 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-26T23:47:33.637 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.631+0000 7f1abffff640 1 --2- 172.21.15.88:0/1380671932 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1ac00c5880 0x7f1ac006e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:33.637 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.632+0000 7f1abf7fe640 1 -- 172.21.15.88:0/1380671932 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1257792678 0 0) 0x7f1ac00ac1c0 con 0x7f1ac0073eb0 2024-04-26T23:47:33.637 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.632+0000 7f1abf7fe640 1 -- 172.21.15.88:0/1380671932 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1aa8003520 con 0x7f1ac0073eb0 2024-04-26T23:47:33.638 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.633+0000 7f1abf7fe640 1 -- 172.21.15.88:0/1380671932 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4062608626 0 0) 0x7f1ac006d6d0 con 0x7f1ac006e720 2024-04-26T23:47:33.638 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.633+0000 7f1abf7fe640 1 -- 172.21.15.88:0/1380671932 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1ac00ac1c0 con 0x7f1ac006e720 2024-04-26T23:47:33.638 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.633+0000 7f1abf7fe640 1 -- 172.21.15.88:0/1380671932 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 384727265 0 0) 0x7f1aa8003520 con 0x7f1ac0073eb0 2024-04-26T23:47:33.638 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.633+0000 7f1abf7fe640 1 -- 172.21.15.88:0/1380671932 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1ac00c5880 msgr2=0x7f1ac006e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:47:33.638 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.633+0000 7f1abf7fe640 1 --2- 172.21.15.88:0/1380671932 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1ac00c5880 0x7f1ac006e1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:33.638 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.634+0000 7f1abf7fe640 1 -- 172.21.15.88:0/1380671932 >> v1:172.21.15.175:6789/0 conn(0x7f1ac006e720 legacy=0x7f1ac01657d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:33.639 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.634+0000 7f1abf7fe640 1 -- 172.21.15.88:0/1380671932 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ac006d9b0 con 0x7f1ac0073eb0 2024-04-26T23:47:33.639 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.634+0000 7f1abf7fe640 1 -- 172.21.15.88:0/1380671932 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 356324787 0 0) 0x7f1ab8001970 con 0x7f1ac0073eb0 2024-04-26T23:47:33.639 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.634+0000 7f1abf7fe640 1 -- 172.21.15.88:0/1380671932 >> v1:172.21.15.88:6789/0 conn(0x7f1ac0073eb0 legacy=0x7f1ac00abab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:33.639 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.635+0000 7f1abf7fe640 1 --2- 172.21.15.88:0/1380671932 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1aa8003c40 0x7f1aa8004020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:33.640 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.635+0000 7f1ac4922640 1 --2- 172.21.15.88:0/1380671932 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1aa8003c40 0x7f1aa8004020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:33.640 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.635+0000 7f1abf7fe640 1 --2- 172.21.15.88:0/1380671932 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1aa8004800 0x7f1aa8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:33.640 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.635+0000 7f1abf7fe640 1 --2- 172.21.15.88:0/1380671932 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1aa8005330 0x7f1aa800ba40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:33.640 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.636+0000 7f1abf7fe640 1 -- 172.21.15.88:0/1380671932 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f1ac00ab620 con 0x7f1aa8003c40 2024-04-26T23:47:33.641 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.636+0000 7f1abf7fe640 1 -- 172.21.15.88:0/1380671932 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f1aa800c280 con 0x7f1aa8004800 2024-04-26T23:47:33.641 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.636+0000 7f1ac5123640 1 --2- 172.21.15.88:0/1380671932 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1aa8005330 0x7f1aa800ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:33.641 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.636+0000 7f1abf7fe640 1 -- 172.21.15.88:0/1380671932 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f1aa800c480 con 0x7f1aa8005330 2024-04-26T23:47:33.641 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.636+0000 7f1abffff640 1 --2- 172.21.15.88:0/1380671932 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1ac00c5880 0x7f1ac006e1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:47:33.641 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.636+0000 7f1abffff640 1 --2- 172.21.15.88:0/1380671932 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1aa8004800 0x7f1aa8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:33.641 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.637+0000 7f1ac4922640 1 -- 172.21.15.88:0/1380671932 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1aa8005330 msgr2=0x7f1aa800ba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:47:33.641 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.637+0000 7f1ac4922640 1 --2- 172.21.15.88:0/1380671932 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1aa8005330 0x7f1aa800ba40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:33.641 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.637+0000 7f1ac4922640 1 -- 172.21.15.88:0/1380671932 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1aa8004800 msgr2=0x7f1aa8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:47:33.642 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.637+0000 7f1ac4922640 1 --2- 172.21.15.88:0/1380671932 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1aa8004800 0x7f1aa8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:33.642 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.637+0000 7f1ac4922640 1 -- 172.21.15.88:0/1380671932 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1aa8003520 con 0x7f1aa8003c40 2024-04-26T23:47:33.642 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.638+0000 7f1ac4922640 1 --2- 172.21.15.88:0/1380671932 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1aa8003c40 0x7f1aa8004020 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f1ab8005820 tx=0x7f1aa8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3f79034f4614c1 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:47:33.643 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.639+0000 7f1abf7fe640 1 -- 172.21.15.88:0/1380671932 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ab8005470 con 0x7f1aa8003c40 2024-04-26T23:47:33.644 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.639+0000 7f1abf7fe640 1 -- 172.21.15.88:0/1380671932 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ab802f030 con 0x7f1aa8003c40 2024-04-26T23:47:33.644 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.640+0000 7f1ac6b86640 1 -- 172.21.15.88:0/1380671932 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1aa8003c40 msgr2=0x7f1aa8004020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:33.644 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.640+0000 7f1ac6b86640 1 --2- 172.21.15.88:0/1380671932 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1aa8003c40 0x7f1aa8004020 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f1ab8005820 tx=0x7f1aa8005830 comp rx=0 tx=0).stop 2024-04-26T23:47:33.644 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.640+0000 7f1ac5123640 1 -- 172.21.15.88:0/1380671932 reap_dead start 2024-04-26T23:47:33.644 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.640+0000 7f1ac6b86640 1 -- 172.21.15.88:0/1380671932 shutdown_connections 2024-04-26T23:47:33.644 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.640+0000 7f1ac6b86640 1 -- 172.21.15.88:0/1380671932 >> 172.21.15.88:0/1380671932 conn(0x7f1ac00c4d60 msgr2=0x7f1ac00c5170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:47:33.648 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.645+0000 7f1ac6b86640 1 -- 172.21.15.88:0/1380671932 shutdown_connections 2024-04-26T23:47:33.652 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.647+0000 7f1ac6b86640 1 -- 172.21.15.88:0/1380671932 wait complete. 2024-04-26T23:47:33.654 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.649+0000 7f1ac6b86640 1 Processor -- start 2024-04-26T23:47:33.654 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.649+0000 7f1ac6b86640 1 -- start start 2024-04-26T23:47:33.654 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.650+0000 7f1ac6b86640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1ac014c5b0 0x7f1ac014c990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:33.654 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.650+0000 7f1ac6b86640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1ac00bde50 0x7f1ac0138b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:33.654 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.650+0000 7f1ac6b86640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1ac0139040 0x7f1ac015e520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:33.654 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.650+0000 7f1ac6b86640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f1ac00ac6b0 con 0x7f1ac0139040 2024-04-26T23:47:33.654 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.650+0000 7f1ac6b86640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f1ac00c4870 con 0x7f1ac00bde50 2024-04-26T23:47:33.654 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.650+0000 7f1ac6b86640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f1ac00ac830 con 0x7f1ac014c5b0 2024-04-26T23:47:33.655 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.651+0000 7f1ac4922640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1ac014c5b0 0x7f1ac014c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:33.655 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.651+0000 7f1ac5123640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1ac0139040 0x7f1ac015e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:33.655 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.651+0000 7f1ac5123640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1ac0139040 0x7f1ac015e520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:41484/0 (socket says 172.21.15.88:41484) 2024-04-26T23:47:33.655 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.651+0000 7f1ac5123640 1 -- 172.21.15.88:0/1005979673 learned_addr learned my addr 172.21.15.88:0/1005979673 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:47:33.655 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.651+0000 7f1ac5123640 1 -- 172.21.15.88:0/1005979673 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1ac014c5b0 msgr2=0x7f1ac014c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:33.657 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.651+0000 7f1ac5123640 1 --2- 172.21.15.88:0/1005979673 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1ac014c5b0 0x7f1ac014c990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:33.657 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.651+0000 7f1ac5123640 1 -- 172.21.15.88:0/1005979673 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1ac00bde50 msgr2=0x7f1ac0138b00 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T23:47:33.657 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.651+0000 7f1ac5123640 1 --2- 172.21.15.88:0/1005979673 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1ac00bde50 0x7f1ac0138b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:33.657 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.651+0000 7f1ac5123640 1 -- 172.21.15.88:0/1005979673 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ac00c1ab0 con 0x7f1ac0139040 2024-04-26T23:47:33.657 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.652+0000 7f1ac5123640 1 --2- 172.21.15.88:0/1005979673 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1ac0139040 0x7f1ac015e520 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f1ac0076890 tx=0x7f1ab000fc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:47:33.657 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.654+0000 7f1abd7fa640 1 -- 172.21.15.88:0/1005979673 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ab00050d0 con 0x7f1ac0139040 2024-04-26T23:47:33.668 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.654+0000 7f1ac6b86640 1 -- 172.21.15.88:0/1005979673 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ac015aa30 con 0x7f1ac0139040 2024-04-26T23:47:33.668 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.654+0000 7f1ac6b86640 1 -- 172.21.15.88:0/1005979673 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ac00c2520 con 0x7f1ac0139040 2024-04-26T23:47:33.668 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.657+0000 7f1ac6b86640 1 --2- 172.21.15.88:0/1005979673 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1ac015ea60 0x7f1ac015ee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:33.668 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.657+0000 7f1ac6b86640 1 -- 172.21.15.88:0/1005979673 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f1ac00506c0 con 0x7f1ac015ea60 2024-04-26T23:47:33.668 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.661+0000 7f1ac4922640 1 --2- 172.21.15.88:0/1005979673 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1ac015ea60 0x7f1ac015ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:33.668 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.664+0000 7f1abd7fa640 1 -- 172.21.15.88:0/1005979673 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ab0018070 con 0x7f1ac0139040 2024-04-26T23:47:33.668 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.664+0000 7f1abd7fa640 1 -- 172.21.15.88:0/1005979673 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ab00035f0 con 0x7f1ac0139040 2024-04-26T23:47:33.668 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.664+0000 7f1abd7fa640 1 -- 172.21.15.88:0/1005979673 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f1ab0003790 con 0x7f1ac0139040 2024-04-26T23:47:33.668 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.664+0000 7f1ac4922640 1 -- 172.21.15.88:0/1005979673 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1ac01387e0 con 0x7f1ac015ea60 2024-04-26T23:47:33.670 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.667+0000 7f1abd7fa640 1 --2- 172.21.15.88:0/1005979673 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f1aac06c9f0 0x7f1aac06eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:33.671 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.667+0000 7f1abd7fa640 1 -- 172.21.15.88:0/1005979673 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6666+0+0 (secure 0 0 0) 0x7f1ab008bc30 con 0x7f1ac0139040 2024-04-26T23:47:33.675 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.670+0000 7f1abffff640 1 --2- 172.21.15.88:0/1005979673 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f1aac06c9f0 0x7f1aac06eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:33.675 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.671+0000 7f1ac4922640 1 --2- 172.21.15.88:0/1005979673 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1ac015ea60 0x7f1ac015ee40 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f1ab8002230 tx=0x7f1ab802d070 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:47:33.676 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.671+0000 7f1abffff640 1 --2- 172.21.15.88:0/1005979673 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f1aac06c9f0 0x7f1aac06eeb0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f1ac0072bd0 tx=0x7f1ab4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:47:33.676 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.671+0000 7f1abd7fa640 1 -- 172.21.15.88:0/1005979673 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ab8045070 con 0x7f1ac015ea60 2024-04-26T23:47:33.676 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.672+0000 7f1abd7fa640 1 -- 172.21.15.88:0/1005979673 <== mon.2 v2:172.21.15.175:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f1ab8001bd0 con 0x7f1ac015ea60 2024-04-26T23:47:33.676 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.672+0000 7f1abd7fa640 1 -- 172.21.15.88:0/1005979673 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1ac015ea60 msgr2=0x7f1ac015ee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:33.676 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.672+0000 7f1abd7fa640 1 --2- 172.21.15.88:0/1005979673 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1ac015ea60 0x7f1ac015ee40 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f1ab8002230 tx=0x7f1ab802d070 comp rx=0 tx=0).stop 2024-04-26T23:47:33.676 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.672+0000 7f1abd7fa640 1 -- 172.21.15.88:0/1005979673 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1ac015ea60 msgr2=0x7f1ac015ee40 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:47:33.676 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.672+0000 7f1abd7fa640 1 --2- 172.21.15.88:0/1005979673 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1ac015ea60 0x7f1ac015ee40 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:33.704 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.700+0000 7f1ac6b86640 1 --2- 172.21.15.88:0/1005979673 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1ac015d1e0 0x7f1ac015d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:33.704 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.700+0000 7f1ac6b86640 1 -- 172.21.15.88:0/1005979673 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f1ac00c2940 con 0x7f1ac015d1e0 2024-04-26T23:47:33.704 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.701+0000 7f1ac4922640 1 --2- 172.21.15.88:0/1005979673 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1ac015d1e0 0x7f1ac015d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:33.713 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.709+0000 7f1ac4922640 1 -- 172.21.15.88:0/1005979673 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f1ac00696c0 con 0x7f1ac015d1e0 2024-04-26T23:47:33.713 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.710+0000 7f1ac4922640 1 --2- 172.21.15.88:0/1005979673 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1ac015d1e0 0x7f1ac015d5f0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f1ac0139520 tx=0x7f1ab802e000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:47:33.714 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.710+0000 7f1abd7fa640 1 -- 172.21.15.88:0/1005979673 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ab8045040 con 0x7f1ac015d1e0 2024-04-26T23:47:33.714 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.711+0000 7f1abd7fa640 1 -- 172.21.15.88:0/1005979673 <== mon.2 v2:172.21.15.175:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5209 (secure 0 0 0) 0x7f1ab804b070 con 0x7f1ac015d1e0 2024-04-26T23:47:33.714 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.711+0000 7f1abd7fa640 1 -- 172.21.15.88:0/1005979673 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1ac015d1e0 msgr2=0x7f1ac015d5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:33.714 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.711+0000 7f1abd7fa640 1 --2- 172.21.15.88:0/1005979673 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1ac015d1e0 0x7f1ac015d5f0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f1ac0139520 tx=0x7f1ab802e000 comp rx=0 tx=0).stop 2024-04-26T23:47:33.714 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.711+0000 7f1abd7fa640 1 -- 172.21.15.88:0/1005979673 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1ac015d1e0 msgr2=0x7f1ac015d5f0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:47:33.715 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.711+0000 7f1abd7fa640 1 --2- 172.21.15.88:0/1005979673 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1ac015d1e0 0x7f1ac015d5f0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:33.715 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-04-26T23:47:33.715 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2024-04-26T23:47:33.715 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2024-04-26T23:47:33.715 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "peon", 2024-04-26T23:47:33.715 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 70, 2024-04-26T23:47:33.715 INFO:teuthology.orchestra.run.smithi088.stdout: "uptime": 221997, 2024-04-26T23:47:33.715 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2024-04-26T23:47:33.715 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2024-04-26T23:47:33.715 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2024-04-26T23:47:33.715 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2024-04-26T23:47:33.716 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:47:33.716 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 14, 2024-04-26T23:47:33.716 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2024-04-26T23:47:33.716 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2450521708007866372", 2024-04-26T23:47:33.716 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2024-04-26T23:47:33.716 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-04-26T23:47:33.716 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-04-26T23:47:33.716 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-04-26T23:47:33.716 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-04-26T23:47:33.716 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-04-26T23:47:33.716 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-04-26T23:47:33.716 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-04-26T23:47:33.716 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-04-26T23:47:33.717 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-04-26T23:47:33.717 INFO:teuthology.orchestra.run.smithi088.stdout: "reef", 2024-04-26T23:47:33.717 INFO:teuthology.orchestra.run.smithi088.stdout: "squid" 2024-04-26T23:47:33.717 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:47:33.717 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540701547738038271", 2024-04-26T23:47:33.717 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2024-04-26T23:47:33.717 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-04-26T23:47:33.717 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-04-26T23:47:33.717 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-04-26T23:47:33.717 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-04-26T23:47:33.717 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-04-26T23:47:33.718 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-04-26T23:47:33.718 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-04-26T23:47:33.718 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-04-26T23:47:33.718 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-04-26T23:47:33.718 INFO:teuthology.orchestra.run.smithi088.stdout: "reef", 2024-04-26T23:47:33.718 INFO:teuthology.orchestra.run.smithi088.stdout: "squid" 2024-04-26T23:47:33.718 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:47:33.718 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:47:33.718 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2024-04-26T23:47:33.718 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2024-04-26T23:47:33.719 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2024-04-26T23:47:33.719 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2024-04-26T23:47:33.719 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2024-04-26T23:47:33.719 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "555255e9-7ef9-4454-8dc9-35e96b70035c", 2024-04-26T23:47:33.719 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2024-04-26T23:39:34.291658Z", 2024-04-26T23:47:33.719 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2024-04-26T23:39:34.291658Z", 2024-04-26T23:47:33.719 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 19, 2024-04-26T23:47:33.719 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "squid", 2024-04-26T23:47:33.719 INFO:teuthology.orchestra.run.smithi088.stdout: "election_strategy": 1, 2024-04-26T23:47:33.719 INFO:teuthology.orchestra.run.smithi088.stdout: "disallowed_leaders: ": "", 2024-04-26T23:47:33.720 INFO:teuthology.orchestra.run.smithi088.stdout: "stretch_mode": false, 2024-04-26T23:47:33.720 INFO:teuthology.orchestra.run.smithi088.stdout: "tiebreaker_mon": "", 2024-04-26T23:47:33.720 INFO:teuthology.orchestra.run.smithi088.stdout: "removed_ranks: ": "", 2024-04-26T23:47:33.720 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2024-04-26T23:47:33.720 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2024-04-26T23:47:33.720 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-04-26T23:47:33.720 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-04-26T23:47:33.720 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-04-26T23:47:33.720 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-04-26T23:47:33.720 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-04-26T23:47:33.720 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-04-26T23:47:33.720 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-04-26T23:47:33.720 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-04-26T23:47:33.721 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-04-26T23:47:33.721 INFO:teuthology.orchestra.run.smithi088.stdout: "reef", 2024-04-26T23:47:33.721 INFO:teuthology.orchestra.run.smithi088.stdout: "squid" 2024-04-26T23:47:33.721 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:47:33.721 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2024-04-26T23:47:33.721 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:47:33.721 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2024-04-26T23:47:33.721 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:47:33.721 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2024-04-26T23:47:33.721 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2024-04-26T23:47:33.721 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-04-26T23:47:33.721 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-04-26T23:47:33.721 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:47:33.721 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-04-26T23:47:33.721 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2024-04-26T23:47:33.722 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:47:33.722 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:47:33.722 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:47:33.722 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-04-26T23:47:33.722 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2024-04-26T23:47:33.722 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:47:33.722 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:47:33.722 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:47:33.722 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:47:33.722 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2024-04-26T23:47:33.722 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2024-04-26T23:47:33.722 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-04-26T23:47:33.722 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-04-26T23:47:33.722 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-04-26T23:47:33.723 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:47:33.723 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:47:33.723 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2024-04-26T23:47:33.723 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2024-04-26T23:47:33.723 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-04-26T23:47:33.723 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-04-26T23:47:33.723 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:47:33.723 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-04-26T23:47:33.723 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:3300", 2024-04-26T23:47:33.723 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:47:33.723 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:47:33.723 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:47:33.723 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-04-26T23:47:33.723 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6789", 2024-04-26T23:47:33.724 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:47:33.724 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:47:33.724 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:47:33.724 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:47:33.724 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6789/0", 2024-04-26T23:47:33.724 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.175:6789/0", 2024-04-26T23:47:33.724 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-04-26T23:47:33.724 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-04-26T23:47:33.724 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-04-26T23:47:33.724 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:47:33.724 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:47:33.724 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2024-04-26T23:47:33.724 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2024-04-26T23:47:33.724 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-04-26T23:47:33.724 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-04-26T23:47:33.725 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:47:33.725 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-04-26T23:47:33.725 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:3301", 2024-04-26T23:47:33.725 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:47:33.725 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:47:33.725 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:47:33.725 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-04-26T23:47:33.725 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6790", 2024-04-26T23:47:33.725 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:47:33.725 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:47:33.725 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:47:33.725 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:47:33.725 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6790/0", 2024-04-26T23:47:33.725 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.175:6790/0", 2024-04-26T23:47:33.725 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-04-26T23:47:33.726 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-04-26T23:47:33.726 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-04-26T23:47:33.726 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:47:33.726 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:47:33.726 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:47:33.726 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2024-04-26T23:47:33.726 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2024-04-26T23:47:33.726 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:47:33.726 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:47:33.726 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:47:33.726 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2024-04-26T23:47:33.726 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:47:33.726 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:47:33.727 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": [ 2024-04-26T23:47:33.727 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:47:33.727 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:47:33.727 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:47:33.727 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 4 2024-04-26T23:47:33.727 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:47:33.727 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:47:33.727 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": [ 2024-04-26T23:47:33.727 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:47:33.727 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:47:33.727 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:47:33.727 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 7 2024-04-26T23:47:33.727 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:47:33.727 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:47:33.727 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2024-04-26T23:47:33.728 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:47:33.728 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x2f018fb87aa4aafe", 2024-04-26T23:47:33.728 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:47:33.728 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2024-04-26T23:47:33.728 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:47:33.728 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:47:33.728 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:47:33.728 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:47:33.728 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 5 2024-04-26T23:47:33.728 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:47:33.728 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:47:33.728 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": [ 2024-04-26T23:47:33.728 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:47:33.728 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:47:33.729 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:47:33.729 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2024-04-26T23:47:33.729 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:47:33.729 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:47:33.729 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:47:33.729 INFO:teuthology.orchestra.run.smithi088.stdout: "stretch_mode": false 2024-04-26T23:47:33.729 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-04-26T23:47:33.729 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.715+0000 7f1aa6ffd640 1 -- 172.21.15.88:0/1005979673 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f1aac06c9f0 msgr2=0x7f1aac06eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:33.730 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.715+0000 7f1aa6ffd640 1 --2- 172.21.15.88:0/1005979673 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f1aac06c9f0 0x7f1aac06eeb0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f1ac0072bd0 tx=0x7f1ab4008040 comp rx=0 tx=0).stop 2024-04-26T23:47:33.730 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.715+0000 7f1aa6ffd640 1 -- 172.21.15.88:0/1005979673 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1ac0139040 msgr2=0x7f1ac015e520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:33.730 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.715+0000 7f1aa6ffd640 1 --2- 172.21.15.88:0/1005979673 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1ac0139040 0x7f1ac015e520 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f1ac0076890 tx=0x7f1ab000fc00 comp rx=0 tx=0).stop 2024-04-26T23:47:33.730 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.715+0000 7f1ac5123640 1 -- 172.21.15.88:0/1005979673 reap_dead start 2024-04-26T23:47:33.730 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.715+0000 7f1ac5123640 1 -- 172.21.15.88:0/1005979673 reap_dead start 2024-04-26T23:47:33.730 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.715+0000 7f1aa6ffd640 1 -- 172.21.15.88:0/1005979673 shutdown_connections 2024-04-26T23:47:33.730 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.715+0000 7f1aa6ffd640 1 -- 172.21.15.88:0/1005979673 >> 172.21.15.88:0/1005979673 conn(0x7f1ac00c4d60 msgr2=0x7f1ac00c79e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:47:33.730 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.717+0000 7f1aa6ffd640 1 -- 172.21.15.88:0/1005979673 shutdown_connections 2024-04-26T23:47:33.730 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.717+0000 7f1aa6ffd640 1 -- 172.21.15.88:0/1005979673 wait complete. 2024-04-26T23:47:33.743 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-04-26T23:47:33.743 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['b'] 2024-04-26T23:47:33.743 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2024-04-26T23:47:33.744 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.b 2024-04-26T23:47:33.744 INFO:tasks.mon_thrash.mon_thrasher:killing mon.b 2024-04-26T23:47:33.744 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-04-26T23:47:33.744 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T23:47:33.773 INFO:tasks.ceph.mon.b:Stopped 2024-04-26T23:47:33.773 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2024-04-26T23:47:33.774 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-04-26T23:47:33.960 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.956+0000 7faea9269640 1 Processor -- start 2024-04-26T23:47:33.963 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.960+0000 7faea9269640 1 -- start start 2024-04-26T23:47:33.969 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.964+0000 7faea9269640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7faea4154200 0x7faea406f260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:33.969 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.964+0000 7faea9269640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7faea406d320 0x7faea406d770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:33.969 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.964+0000 7faea9269640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faea40c3910 con 0x7faea40ac390 2024-04-26T23:47:33.969 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.964+0000 7faea9269640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7faea4153d70 con 0x7faea406d320 2024-04-26T23:47:33.969 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.964+0000 7faea9269640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7faea4070b90 con 0x7faea4154200 2024-04-26T23:47:33.969 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.965+0000 7faea27fc640 1 -- >> v2:172.21.15.175:3300/0 conn(0x7faea4154200 msgr2=0x7faea406f260 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.175:3300/0 2024-04-26T23:47:33.969 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.965+0000 7faea27fc640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7faea4154200 0x7faea406f260 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:47:33.969 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.966+0000 7faea37fe640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7faea406d320 0x7faea406d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:33.970 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.966+0000 7faea37fe640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7faea406d320 0x7faea406d770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:41494/0 (socket says 172.21.15.88:41494) 2024-04-26T23:47:33.970 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.966+0000 7faea37fe640 1 -- 172.21.15.88:0/3353683922 learned_addr learned my addr 172.21.15.88:0/3353683922 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:47:33.970 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.966+0000 7faea37fe640 1 -- 172.21.15.88:0/3353683922 >> v2:172.21.15.175:3300/0 conn(0x7faea4154200 msgr2=0x7faea406f260 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T23:47:33.970 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.966+0000 7faea37fe640 1 --2- 172.21.15.88:0/3353683922 >> v2:172.21.15.175:3300/0 conn(0x7faea4154200 0x7faea406f260 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:33.970 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.966+0000 7faea37fe640 1 -- 172.21.15.88:0/3353683922 >> v1:172.21.15.88:6789/0 conn(0x7faea40ac390 legacy=0x7faea4150c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:33.970 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.966+0000 7faea37fe640 1 -- 172.21.15.88:0/3353683922 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faea4070e70 con 0x7faea406d320 2024-04-26T23:47:33.972 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.967+0000 7faea37fe640 1 --2- 172.21.15.88:0/3353683922 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faea406d320 0x7faea406d770 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7faea4072020 tx=0x7fae9c02a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54a45b4c923be708 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:47:33.972 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.967+0000 7faea1ffb640 1 -- 172.21.15.88:0/3353683922 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae9c036070 con 0x7faea406d320 2024-04-26T23:47:33.972 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.968+0000 7faea1ffb640 1 -- 172.21.15.88:0/3353683922 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae9c031600 con 0x7faea406d320 2024-04-26T23:47:33.972 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.968+0000 7faea1ffb640 1 -- 172.21.15.88:0/3353683922 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae9c0319d0 con 0x7faea406d320 2024-04-26T23:47:33.974 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.969+0000 7faea9269640 1 -- 172.21.15.88:0/3353683922 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faea406d320 msgr2=0x7faea406d770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:33.974 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.969+0000 7faea9269640 1 --2- 172.21.15.88:0/3353683922 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faea406d320 0x7faea406d770 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7faea4072020 tx=0x7fae9c02a6c0 comp rx=0 tx=0).stop 2024-04-26T23:47:33.978 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.973+0000 7faea9269640 1 -- 172.21.15.88:0/3353683922 shutdown_connections 2024-04-26T23:47:33.979 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.973+0000 7faea9269640 1 --2- 172.21.15.88:0/3353683922 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faea406d320 0x7faea406d770 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:33.979 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.973+0000 7faea9269640 1 --2- 172.21.15.88:0/3353683922 >> v2:172.21.15.175:3300/0 conn(0x7faea4154200 0x7faea406f260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:33.979 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.973+0000 7faea9269640 1 -- 172.21.15.88:0/3353683922 >> 172.21.15.88:0/3353683922 conn(0x7faea40c5ce0 msgr2=0x7faea40c60f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:47:33.982 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.979+0000 7faea9269640 1 -- 172.21.15.88:0/3353683922 shutdown_connections 2024-04-26T23:47:33.985 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.980+0000 7faea9269640 1 -- 172.21.15.88:0/3353683922 wait complete. 2024-04-26T23:47:33.987 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.982+0000 7faea9269640 1 Processor -- start 2024-04-26T23:47:33.987 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.983+0000 7faea9269640 1 -- start start 2024-04-26T23:47:33.991 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.984+0000 7faea9269640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faea406d320 0x7faea4150200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:33.992 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.984+0000 7faea9269640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faea40ac390 0x7faea40c7cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:33.992 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.984+0000 7faea9269640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faea4154200 0x7faea4133b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:33.992 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.984+0000 7faea9269640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7faea41536d0 con 0x7faea4154200 2024-04-26T23:47:33.992 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.984+0000 7faea9269640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7faea4154620 con 0x7faea406d320 2024-04-26T23:47:33.992 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.984+0000 7faea9269640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7faea406f7a0 con 0x7faea40ac390 2024-04-26T23:47:33.992 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.985+0000 7faea37fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faea4154200 0x7faea4133b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:33.992 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.985+0000 7faea37fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faea4154200 0x7faea4133b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:41500/0 (socket says 172.21.15.88:41500) 2024-04-26T23:47:33.992 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.985+0000 7faea37fe640 1 -- 172.21.15.88:0/4009479667 learned_addr learned my addr 172.21.15.88:0/4009479667 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:47:33.992 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.985+0000 7faea37fe640 1 -- 172.21.15.88:0/4009479667 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faea40ac390 msgr2=0x7faea40c7cf0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-26T23:47:33.992 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.985+0000 7faea37fe640 1 --2- 172.21.15.88:0/4009479667 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faea40ac390 0x7faea40c7cf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:33.992 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.985+0000 7faea37fe640 1 -- 172.21.15.88:0/4009479667 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faea406d320 msgr2=0x7faea4150200 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-26T23:47:33.992 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.985+0000 7faea37fe640 1 --2- 172.21.15.88:0/4009479667 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faea406d320 0x7faea4150200 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:33.992 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.985+0000 7faea37fe640 1 -- 172.21.15.88:0/4009479667 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faea4072980 con 0x7faea4154200 2024-04-26T23:47:33.992 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.986+0000 7faea37fe640 1 --2- 172.21.15.88:0/4009479667 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faea4154200 0x7faea4133b80 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fae9c02acb0 tx=0x7fae9c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:47:33.993 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.987+0000 7fae8b7fe640 1 -- 172.21.15.88:0/4009479667 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae9c041020 con 0x7faea4154200 2024-04-26T23:47:33.993 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.987+0000 7fae8b7fe640 1 -- 172.21.15.88:0/4009479667 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae9c031e40 con 0x7faea4154200 2024-04-26T23:47:33.993 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.988+0000 7fae8b7fe640 1 -- 172.21.15.88:0/4009479667 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae9c036040 con 0x7faea4154200 2024-04-26T23:47:33.993 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.988+0000 7faea9269640 1 -- 172.21.15.88:0/4009479667 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faea40c8a50 con 0x7faea4154200 2024-04-26T23:47:33.993 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.988+0000 7faea9269640 1 -- 172.21.15.88:0/4009479667 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faea41340c0 con 0x7faea4154200 2024-04-26T23:47:33.993 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:33.989+0000 7faea9269640 1 -- 172.21.15.88:0/4009479667 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faea40506c0 con 0x7faea4154200 2024-04-26T23:47:34.008 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:34.001+0000 7fae8b7fe640 1 -- 172.21.15.88:0/4009479667 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fae9c044020 con 0x7faea4154200 2024-04-26T23:47:34.008 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:34.002+0000 7fae8b7fe640 1 --2- 172.21.15.88:0/4009479667 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fae9006c9f0 0x7fae9006eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:34.008 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:34.002+0000 7fae8b7fe640 1 -- 172.21.15.88:0/4009479667 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6666+0+0 (secure 0 0 0) 0x7fae9c0ad290 con 0x7faea4154200 2024-04-26T23:47:34.008 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:34.002+0000 7fae8b7fe640 1 -- 172.21.15.88:0/4009479667 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fae9c04b030 con 0x7faea4154200 2024-04-26T23:47:34.008 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:34.005+0000 7faea2ffd640 1 --2- 172.21.15.88:0/4009479667 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fae9006c9f0 0x7fae9006eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:34.009 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:34.005+0000 7faea2ffd640 1 --2- 172.21.15.88:0/4009479667 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fae9006c9f0 0x7fae9006eeb0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fae98000f60 tx=0x7fae980079b0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:47:34.533 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:34.529+0000 7faea9269640 1 -- 172.21.15.88:0/4009479667 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7faea40705b0 con 0x7faea4154200 2024-04-26T23:47:34.537 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:34.534+0000 7fae8b7fe640 1 -- 172.21.15.88:0/4009479667 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1565 (secure 0 0 0) 0x7fae9c081030 con 0x7faea4154200 2024-04-26T23:47:34.540 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":70,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":14,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"555255e9-7ef9-4454-8dc9-35e96b70035c","modified":"2024-04-26T23:39:34.291658Z","created":"2024-04-26T23:39:34.291658Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:3300","nonce":0},{"type":"v1","addr":"172.21.15.175:6789","nonce":0}]},"addr":"172.21.15.175:6789/0","public_addr":"172.21.15.175:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:3301","nonce":0},{"type":"v1","addr":"172.21.15.175:6790","nonce":0}]},"addr":"172.21.15.175:6790/0","public_addr":"172.21.15.175:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-04-26T23:47:34.544 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:34.541+0000 7faea9269640 1 -- 172.21.15.88:0/4009479667 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fae9006c9f0 msgr2=0x7fae9006eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:34.544 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:34.541+0000 7faea9269640 1 --2- 172.21.15.88:0/4009479667 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fae9006c9f0 0x7fae9006eeb0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fae98000f60 tx=0x7fae980079b0 comp rx=0 tx=0).stop 2024-04-26T23:47:34.544 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:34.541+0000 7faea9269640 1 -- 172.21.15.88:0/4009479667 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faea4154200 msgr2=0x7faea4133b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:34.544 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:34.541+0000 7faea9269640 1 --2- 172.21.15.88:0/4009479667 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faea4154200 0x7faea4133b80 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fae9c02acb0 tx=0x7fae9c004a40 comp rx=0 tx=0).stop 2024-04-26T23:47:34.545 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:34.541+0000 7faea9269640 1 -- 172.21.15.88:0/4009479667 shutdown_connections 2024-04-26T23:47:34.545 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:34.541+0000 7faea9269640 1 --2- 172.21.15.88:0/4009479667 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fae9006c9f0 0x7fae9006eeb0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:34.545 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:34.541+0000 7faea9269640 1 --2- 172.21.15.88:0/4009479667 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faea40ac390 0x7faea40c7cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:34.545 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:34.541+0000 7faea9269640 1 --2- 172.21.15.88:0/4009479667 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faea4154200 0x7faea4133b80 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:34.545 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:34.541+0000 7faea9269640 1 --2- 172.21.15.88:0/4009479667 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faea406d320 0x7faea4150200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:34.545 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:34.541+0000 7faea9269640 1 -- 172.21.15.88:0/4009479667 >> 172.21.15.88:0/4009479667 conn(0x7faea40c5ce0 msgr2=0x7faea4150c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:47:34.545 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:34.541+0000 7faea9269640 1 -- 172.21.15.88:0/4009479667 shutdown_connections 2024-04-26T23:47:34.545 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:34.541+0000 7faea9269640 1 -- 172.21.15.88:0/4009479667 wait complete. 2024-04-26T23:47:34.869 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:47:34.872 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:47:37.572 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-04-26T23:47:37.779 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:37.769+0000 7f46141f2640 1 Processor -- start 2024-04-26T23:47:37.779 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:37.772+0000 7f46141f2640 1 -- start start 2024-04-26T23:47:37.779 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:37.773+0000 7f46141f2640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f46040d3b40 0x7f4604046b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:37.779 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:37.773+0000 7f46141f2640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f460404b110 0x7f4604006ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:37.779 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:37.773+0000 7f46141f2640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f46040073e0 0x7f46040d6710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:37.779 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:37.773+0000 7f46141f2640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f4604047050 con 0x7f46040073e0 2024-04-26T23:47:37.780 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:37.773+0000 7f46141f2640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f46040d9c60 con 0x7f46040d3b40 2024-04-26T23:47:37.780 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:37.773+0000 7f46141f2640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f46040d9f40 con 0x7f460404b110 2024-04-26T23:47:37.780 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:37.774+0000 7f461178d640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f460404b110 0x7f4604006ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:37.780 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:37.774+0000 7f461178d640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f460404b110 0x7f4604006ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.88:44340/0 (socket says 172.21.15.88:44340) 2024-04-26T23:47:37.780 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:37.774+0000 7f461178d640 1 -- 172.21.15.88:0/186820003 learned_addr learned my addr 172.21.15.88:0/186820003 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:47:37.780 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:37.775+0000 7f461178d640 1 -- 172.21.15.88:0/186820003 >> v2:172.21.15.175:3300/0 conn(0x7f46040d3b40 msgr2=0x7f4604046b10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T23:47:37.780 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:37.775+0000 7f461178d640 1 --2- 172.21.15.88:0/186820003 >> v2:172.21.15.175:3300/0 conn(0x7f46040d3b40 0x7f4604046b10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:37.780 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:37.775+0000 7f461178d640 1 -- 172.21.15.88:0/186820003 >> v2:172.21.15.88:3300/0 conn(0x7f46040073e0 msgr2=0x7f46040d6710 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T23:47:37.780 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:37.775+0000 7f461178d640 1 --2- 172.21.15.88:0/186820003 >> v2:172.21.15.88:3300/0 conn(0x7f46040073e0 0x7f46040d6710 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:37.780 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:37.775+0000 7f461178d640 1 -- 172.21.15.88:0/186820003 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46040da220 con 0x7f460404b110 2024-04-26T23:47:37.783 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:37.778+0000 7f461178d640 1 --2- 172.21.15.88:0/186820003 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f460404b110 0x7f4604006ea0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f460c07cda0 tx=0x7f460c0ab230 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3736b39773b72c3a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:47:37.786 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:37.782+0000 7f4610f8c640 1 -- 172.21.15.88:0/186820003 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f460c0b1070 con 0x7f460404b110 2024-04-26T23:47:37.786 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:37.782+0000 7f4610f8c640 1 -- 172.21.15.88:0/186820003 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f460c0b5640 con 0x7f460404b110 2024-04-26T23:47:37.786 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:37.783+0000 7f46141f2640 1 -- 172.21.15.88:0/186820003 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f460404b110 msgr2=0x7f4604006ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:37.786 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:37.783+0000 7f46141f2640 1 --2- 172.21.15.88:0/186820003 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f460404b110 0x7f4604006ea0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f460c07cda0 tx=0x7f460c0ab230 comp rx=0 tx=0).stop 2024-04-26T23:47:37.787 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:37.783+0000 7f46141f2640 1 -- 172.21.15.88:0/186820003 shutdown_connections 2024-04-26T23:47:37.787 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:37.783+0000 7f46141f2640 1 --2- 172.21.15.88:0/186820003 >> v2:172.21.15.88:3300/0 conn(0x7f46040073e0 0x7f46040d6710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:37.787 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:37.783+0000 7f46141f2640 1 --2- 172.21.15.88:0/186820003 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f460404b110 0x7f4604006ea0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:37.787 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:37.783+0000 7f46141f2640 1 --2- 172.21.15.88:0/186820003 >> v2:172.21.15.175:3300/0 conn(0x7f46040d3b40 0x7f4604046b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:37.787 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:37.783+0000 7f46141f2640 1 -- 172.21.15.88:0/186820003 >> 172.21.15.88:0/186820003 conn(0x7f4604048250 msgr2=0x7f4604048660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:47:37.788 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:37.785+0000 7f46141f2640 1 -- 172.21.15.88:0/186820003 shutdown_connections 2024-04-26T23:47:37.791 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:37.788+0000 7f46141f2640 1 -- 172.21.15.88:0/186820003 wait complete. 2024-04-26T23:47:37.792 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:37.789+0000 7f46141f2640 1 Processor -- start 2024-04-26T23:47:37.796 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:37.791+0000 7f46141f2640 1 -- start start 2024-04-26T23:47:37.796 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:37.792+0000 7f46141f2640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f46040073e0 0x7f46040d8340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:37.796 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:37.792+0000 7f46141f2640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f460404b110 0x7f460402fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:37.796 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:37.792+0000 7f46141f2640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f46040d3b40 0x7f460416d550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:37.796 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:37.792+0000 7f46141f2640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f46040d9930 con 0x7f460404b110 2024-04-26T23:47:37.796 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:37.792+0000 7f46141f2640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f46040da7e0 con 0x7f46040d3b40 2024-04-26T23:47:37.796 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:37.792+0000 7f46141f2640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f46040d3f20 con 0x7f46040073e0 2024-04-26T23:47:37.796 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:37.793+0000 7f461278f640 1 -- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f46040d3b40 msgr2=0x7f460416d550 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.175:3300/0 2024-04-26T23:47:37.797 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:37.793+0000 7f461278f640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f46040d3b40 0x7f460416d550 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:47:37.797 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:37.793+0000 7f4611f8e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f46040073e0 0x7f46040d8340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:37.797 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:37.793+0000 7f4611f8e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f46040073e0 0x7f46040d8340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.88:44348/0 (socket says 172.21.15.88:44348) 2024-04-26T23:47:37.797 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:37.793+0000 7f4611f8e640 1 -- 172.21.15.88:0/55104742 learned_addr learned my addr 172.21.15.88:0/55104742 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:47:37.797 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:37.793+0000 7f461178d640 1 --2- 172.21.15.88:0/55104742 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f460404b110 0x7f460402fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:37.797 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:37.794+0000 7f4611f8e640 1 -- 172.21.15.88:0/55104742 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f46040d3b40 msgr2=0x7f460416d550 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T23:47:37.797 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:37.794+0000 7f4611f8e640 1 --2- 172.21.15.88:0/55104742 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f46040d3b40 0x7f460416d550 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:37.798 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:37.794+0000 7f4611f8e640 1 -- 172.21.15.88:0/55104742 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f460404b110 msgr2=0x7f460402fdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:37.798 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:37.794+0000 7f4611f8e640 1 --2- 172.21.15.88:0/55104742 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f460404b110 0x7f460402fdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:37.798 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:37.794+0000 7f4611f8e640 1 -- 172.21.15.88:0/55104742 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f460416cdb0 con 0x7f46040073e0 2024-04-26T23:47:37.798 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:37.794+0000 7f461178d640 1 --2- 172.21.15.88:0/55104742 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f460404b110 0x7f460402fdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:47:37.798 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:37.795+0000 7f4611f8e640 1 --2- 172.21.15.88:0/55104742 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f46040073e0 0x7f46040d8340 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f460800b450 tx=0x7f460800b910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:47:37.803 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:37.795+0000 7f46027fc640 1 -- 172.21.15.88:0/55104742 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4608015020 con 0x7f46040073e0 2024-04-26T23:47:37.803 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:37.795+0000 7f46141f2640 1 -- 172.21.15.88:0/55104742 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46040d7860 con 0x7f46040073e0 2024-04-26T23:47:37.803 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:37.795+0000 7f46141f2640 1 -- 172.21.15.88:0/55104742 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f46040d7e20 con 0x7f46040073e0 2024-04-26T23:47:37.803 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:37.795+0000 7f46027fc640 1 -- 172.21.15.88:0/55104742 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4608011890 con 0x7f46040073e0 2024-04-26T23:47:37.803 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:37.795+0000 7f46027fc640 1 -- 172.21.15.88:0/55104742 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4608011c80 con 0x7f46040073e0 2024-04-26T23:47:37.803 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:37.798+0000 7f46027fc640 1 -- 172.21.15.88:0/55104742 <== mon.2 v2:172.21.15.175:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4608018020 con 0x7f46040073e0 2024-04-26T23:47:37.803 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:37.798+0000 7f46027fc640 1 --2- 172.21.15.88:0/55104742 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f45f00750b0 0x7f45f0077570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:37.803 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:37.799+0000 7f46027fc640 1 -- 172.21.15.88:0/55104742 <== mon.2 v2:172.21.15.175:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6666+0+0 (secure 0 0 0) 0x7f460808c0c0 con 0x7f46040073e0 2024-04-26T23:47:37.803 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:37.799+0000 7f46141f2640 1 -- 172.21.15.88:0/55104742 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f45f4005290 con 0x7f46040073e0 2024-04-26T23:47:37.803 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:37.800+0000 7f461178d640 1 --2- 172.21.15.88:0/55104742 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f45f00750b0 0x7f45f0077570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:37.804 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:37.800+0000 7f461178d640 1 --2- 172.21.15.88:0/55104742 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f45f00750b0 0x7f45f0077570 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f46040da0c0 tx=0x7f460c08f040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:47:37.813 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:37.809+0000 7f46027fc640 1 -- 172.21.15.88:0/55104742 <== mon.2 v2:172.21.15.175:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f460801f020 con 0x7f46040073e0 2024-04-26T23:47:38.354 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:38.351+0000 7f46141f2640 1 -- 172.21.15.88:0/55104742 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f45f4005580 con 0x7f46040073e0 2024-04-26T23:47:38.355 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:38.352+0000 7f46027fc640 1 -- 172.21.15.88:0/55104742 <== mon.2 v2:172.21.15.175:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1565 (secure 0 0 0) 0x7f460800d040 con 0x7f46040073e0 2024-04-26T23:47:38.356 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":70,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":18,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"555255e9-7ef9-4454-8dc9-35e96b70035c","modified":"2024-04-26T23:39:34.291658Z","created":"2024-04-26T23:39:34.291658Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:3300","nonce":0},{"type":"v1","addr":"172.21.15.175:6789","nonce":0}]},"addr":"172.21.15.175:6789/0","public_addr":"172.21.15.175:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:3301","nonce":0},{"type":"v1","addr":"172.21.15.175:6790","nonce":0}]},"addr":"172.21.15.175:6790/0","public_addr":"172.21.15.175:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-04-26T23:47:38.361 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:38.356+0000 7f46141f2640 1 -- 172.21.15.88:0/55104742 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f45f00750b0 msgr2=0x7f45f0077570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:38.361 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:38.357+0000 7f46141f2640 1 --2- 172.21.15.88:0/55104742 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f45f00750b0 0x7f45f0077570 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f46040da0c0 tx=0x7f460c08f040 comp rx=0 tx=0).stop 2024-04-26T23:47:38.361 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:38.357+0000 7f46141f2640 1 -- 172.21.15.88:0/55104742 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f46040073e0 msgr2=0x7f46040d8340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:38.361 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:38.357+0000 7f46141f2640 1 --2- 172.21.15.88:0/55104742 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f46040073e0 0x7f46040d8340 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f460800b450 tx=0x7f460800b910 comp rx=0 tx=0).stop 2024-04-26T23:47:38.361 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:38.357+0000 7f46141f2640 1 -- 172.21.15.88:0/55104742 shutdown_connections 2024-04-26T23:47:38.361 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:38.357+0000 7f46141f2640 1 --2- 172.21.15.88:0/55104742 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f45f00750b0 0x7f45f0077570 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:38.361 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:38.357+0000 7f46141f2640 1 --2- 172.21.15.88:0/55104742 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f46040d3b40 0x7f460416d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:38.361 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:38.357+0000 7f46141f2640 1 --2- 172.21.15.88:0/55104742 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f460404b110 0x7f460402fdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:38.361 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:38.357+0000 7f46141f2640 1 --2- 172.21.15.88:0/55104742 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f46040073e0 0x7f46040d8340 secure :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f460800b450 tx=0x7f460800b910 comp rx=0 tx=0).stop 2024-04-26T23:47:38.362 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:38.357+0000 7f46141f2640 1 -- 172.21.15.88:0/55104742 >> 172.21.15.88:0/55104742 conn(0x7f4604048250 msgr2=0x7f460404a840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:47:38.362 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:38.357+0000 7f46141f2640 1 -- 172.21.15.88:0/55104742 shutdown_connections 2024-04-26T23:47:38.362 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:38.357+0000 7f46141f2640 1 -- 172.21.15.88:0/55104742 wait complete. 2024-04-26T23:47:41.374 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-04-26T23:47:41.493 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:41.490+0000 7f8cc4afc640 1 Processor -- start 2024-04-26T23:47:41.493 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:41.490+0000 7f8cc4afc640 1 -- start start 2024-04-26T23:47:41.495 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:41.491+0000 7f8cc4afc640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f8cc00ca5a0 0x7f8cc0156bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:41.495 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:41.491+0000 7f8cc4afc640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f8cc015a1a0 0x7f8cc00c9590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:41.495 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:41.491+0000 7f8cc4afc640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8cc00c8df0 con 0x7f8cc0154160 2024-04-26T23:47:41.495 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:41.491+0000 7f8cc4afc640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f8cc00c9100 con 0x7f8cc00ca5a0 2024-04-26T23:47:41.495 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:41.491+0000 7f8cc4afc640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f8cc0154540 con 0x7f8cc015a1a0 2024-04-26T23:47:41.495 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:41.491+0000 7f8cbed9d640 1 -- >> v2:172.21.15.175:3300/0 conn(0x7f8cc015a1a0 msgr2=0x7f8cc00c9590 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.175:3300/0 2024-04-26T23:47:41.495 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:41.491+0000 7f8cbe59c640 1 -- >> v1:172.21.15.175:6789/0 conn(0x7f8cc0154160 legacy=0x7f8cc00c6e00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.175:6789/0 2024-04-26T23:47:41.495 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:41.491+0000 7f8cb7fff640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f8cc00ca5a0 0x7f8cc0156bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:41.495 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:41.491+0000 7f8cbed9d640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f8cc015a1a0 0x7f8cc00c9590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:47:41.495 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:41.491+0000 7f8cb7fff640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f8cc00ca5a0 0x7f8cc0156bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:39886/0 (socket says 172.21.15.88:39886) 2024-04-26T23:47:41.495 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:41.491+0000 7f8cb7fff640 1 -- 172.21.15.88:0/4231831191 learned_addr learned my addr 172.21.15.88:0/4231831191 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:47:41.496 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:41.491+0000 7f8cb7fff640 1 -- 172.21.15.88:0/4231831191 >> v2:172.21.15.175:3300/0 conn(0x7f8cc015a1a0 msgr2=0x7f8cc00c9590 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T23:47:41.496 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:41.491+0000 7f8cb7fff640 1 --2- 172.21.15.88:0/4231831191 >> v2:172.21.15.175:3300/0 conn(0x7f8cc015a1a0 0x7f8cc00c9590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:41.496 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:41.491+0000 7f8cb7fff640 1 -- 172.21.15.88:0/4231831191 >> v1:172.21.15.175:6789/0 conn(0x7f8cc0154160 legacy=0x7f8cc00c6e00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T23:47:41.496 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:41.491+0000 7f8cb7fff640 1 -- 172.21.15.88:0/4231831191 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8cc015a910 con 0x7f8cc00ca5a0 2024-04-26T23:47:41.497 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:41.492+0000 7f8cb7fff640 1 --2- 172.21.15.88:0/4231831191 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8cc00ca5a0 0x7f8cc0156bb0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f8cc00c9280 tx=0x7f8ca802a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53ea69e6b5f52e73 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:47:41.497 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:41.492+0000 7f8cbdd9b640 1 -- 172.21.15.88:0/4231831191 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ca8037070 con 0x7f8cc00ca5a0 2024-04-26T23:47:41.497 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:41.492+0000 7f8cbdd9b640 1 -- 172.21.15.88:0/4231831191 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ca8032440 con 0x7f8cc00ca5a0 2024-04-26T23:47:41.497 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:41.492+0000 7f8cbdd9b640 1 -- 172.21.15.88:0/4231831191 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ca8032810 con 0x7f8cc00ca5a0 2024-04-26T23:47:41.497 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:41.493+0000 7f8cc4afc640 1 -- 172.21.15.88:0/4231831191 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8cc00ca5a0 msgr2=0x7f8cc0156bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:41.497 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:41.493+0000 7f8cc4afc640 1 --2- 172.21.15.88:0/4231831191 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8cc00ca5a0 0x7f8cc0156bb0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f8cc00c9280 tx=0x7f8ca802a230 comp rx=0 tx=0).stop 2024-04-26T23:47:41.497 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:41.493+0000 7f8cc4afc640 1 -- 172.21.15.88:0/4231831191 shutdown_connections 2024-04-26T23:47:41.497 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:41.493+0000 7f8cc4afc640 1 --2- 172.21.15.88:0/4231831191 >> v2:172.21.15.175:3300/0 conn(0x7f8cc015a1a0 0x7f8cc00c9590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:41.498 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:41.493+0000 7f8cc4afc640 1 --2- 172.21.15.88:0/4231831191 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8cc00ca5a0 0x7f8cc0156bb0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:41.498 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:41.493+0000 7f8cc4afc640 1 -- 172.21.15.88:0/4231831191 >> 172.21.15.88:0/4231831191 conn(0x7f8cc00ae010 msgr2=0x7f8cc00ae3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:47:41.498 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:41.493+0000 7f8cc4afc640 1 -- 172.21.15.88:0/4231831191 shutdown_connections 2024-04-26T23:47:41.498 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:41.493+0000 7f8cc4afc640 1 -- 172.21.15.88:0/4231831191 wait complete. 2024-04-26T23:47:41.498 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:41.495+0000 7f8cc4afc640 1 Processor -- start 2024-04-26T23:47:41.498 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:41.495+0000 7f8cc4afc640 1 -- start start 2024-04-26T23:47:41.500 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:41.496+0000 7f8cc4afc640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8cc00ca5a0 0x7f8cc0159370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:41.501 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:41.496+0000 7f8cc4afc640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8cc0154160 0x7f8cc014c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:41.501 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:41.496+0000 7f8cc4afc640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8cc015a1a0 0x7f8cc01e24a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:41.501 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:41.496+0000 7f8cc4afc640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f8cc015a5b0 con 0x7f8cc00ca5a0 2024-04-26T23:47:41.501 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:41.496+0000 7f8cc4afc640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f8cc015aed0 con 0x7f8cc015a1a0 2024-04-26T23:47:41.501 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:41.496+0000 7f8cc4afc640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f8cc00c7510 con 0x7f8cc0154160 2024-04-26T23:47:41.501 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:41.496+0000 7f8cbed9d640 1 -- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8cc015a1a0 msgr2=0x7f8cc01e24a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.175:3300/0 2024-04-26T23:47:41.501 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:41.496+0000 7f8cbed9d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8cc015a1a0 0x7f8cc01e24a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:47:41.501 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:41.496+0000 7f8cbe59c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8cc00ca5a0 0x7f8cc0159370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:41.501 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:41.496+0000 7f8cbe59c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8cc00ca5a0 0x7f8cc0159370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:39902/0 (socket says 172.21.15.88:39902) 2024-04-26T23:47:41.501 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:41.496+0000 7f8cbe59c640 1 -- 172.21.15.88:0/4216112172 learned_addr learned my addr 172.21.15.88:0/4216112172 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:47:41.501 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:41.496+0000 7f8cb7fff640 1 --2- 172.21.15.88:0/4216112172 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8cc0154160 0x7f8cc014c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:41.501 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:41.497+0000 7f8cbe59c640 1 -- 172.21.15.88:0/4216112172 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8cc0154160 msgr2=0x7f8cc014c0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:41.501 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:41.497+0000 7f8cbe59c640 1 --2- 172.21.15.88:0/4216112172 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8cc0154160 0x7f8cc014c0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:41.501 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:41.497+0000 7f8cbe59c640 1 -- 172.21.15.88:0/4216112172 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8cc015a1a0 msgr2=0x7f8cc01e24a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T23:47:41.502 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:41.497+0000 7f8cbe59c640 1 --2- 172.21.15.88:0/4216112172 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8cc015a1a0 0x7f8cc01e24a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:41.502 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:41.497+0000 7f8cbe59c640 1 -- 172.21.15.88:0/4216112172 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8cc0153530 con 0x7f8cc00ca5a0 2024-04-26T23:47:41.502 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:41.497+0000 7f8cbe59c640 1 --2- 172.21.15.88:0/4216112172 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8cc00ca5a0 0x7f8cc0159370 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f8cb000b550 tx=0x7f8cb000ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:47:41.502 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:41.497+0000 7f8cb6ffd640 1 -- 172.21.15.88:0/4216112172 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cb0003b70 con 0x7f8cc00ca5a0 2024-04-26T23:47:41.502 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:41.497+0000 7f8cb6ffd640 1 -- 172.21.15.88:0/4216112172 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8cb0015070 con 0x7f8cc00ca5a0 2024-04-26T23:47:41.502 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:41.497+0000 7f8cb6ffd640 1 -- 172.21.15.88:0/4216112172 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cb0005070 con 0x7f8cc00ca5a0 2024-04-26T23:47:41.502 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:41.497+0000 7f8cc4afc640 1 -- 172.21.15.88:0/4216112172 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8cc0153290 con 0x7f8cc00ca5a0 2024-04-26T23:47:41.502 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:41.497+0000 7f8cc4afc640 1 -- 172.21.15.88:0/4216112172 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8cc014b4f0 con 0x7f8cc00ca5a0 2024-04-26T23:47:41.503 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:41.498+0000 7f8cc4afc640 1 -- 172.21.15.88:0/4216112172 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8cc0076650 con 0x7f8cc00ca5a0 2024-04-26T23:47:41.503 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:41.499+0000 7f8cb6ffd640 1 -- 172.21.15.88:0/4216112172 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8cb0005210 con 0x7f8cc00ca5a0 2024-04-26T23:47:41.503 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:41.500+0000 7f8cb6ffd640 1 --2- 172.21.15.88:0/4216112172 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f8ca006c8a0 0x7f8ca006ed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:41.503 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:41.500+0000 7f8cb6ffd640 1 -- 172.21.15.88:0/4216112172 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6666+0+0 (secure 0 0 0) 0x7f8cb008b820 con 0x7f8cc00ca5a0 2024-04-26T23:47:41.503 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:41.500+0000 7f8cb7fff640 1 --2- 172.21.15.88:0/4216112172 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f8ca006c8a0 0x7f8ca006ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:41.503 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:41.500+0000 7f8cb7fff640 1 --2- 172.21.15.88:0/4216112172 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f8ca006c8a0 0x7f8ca006ed60 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f8ca8034000 tx=0x7f8ca802e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:47:41.510 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:41.507+0000 7f8cb6ffd640 1 -- 172.21.15.88:0/4216112172 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f8cb0059920 con 0x7f8cc00ca5a0 2024-04-26T23:47:42.026 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:42.022+0000 7f8cc4afc640 1 -- 172.21.15.88:0/4216112172 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f8cc00507a0 con 0x7f8cc00ca5a0 2024-04-26T23:47:42.026 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:42.023+0000 7f8cb6ffd640 1 -- 172.21.15.88:0/4216112172 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1565 (secure 0 0 0) 0x7f8cb0059220 con 0x7f8cc00ca5a0 2024-04-26T23:47:42.027 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":70,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":22,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"555255e9-7ef9-4454-8dc9-35e96b70035c","modified":"2024-04-26T23:39:34.291658Z","created":"2024-04-26T23:39:34.291658Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:3300","nonce":0},{"type":"v1","addr":"172.21.15.175:6789","nonce":0}]},"addr":"172.21.15.175:6789/0","public_addr":"172.21.15.175:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:3301","nonce":0},{"type":"v1","addr":"172.21.15.175:6790","nonce":0}]},"addr":"172.21.15.175:6790/0","public_addr":"172.21.15.175:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-04-26T23:47:42.030 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:42.026+0000 7f8cc4afc640 1 -- 172.21.15.88:0/4216112172 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f8ca006c8a0 msgr2=0x7f8ca006ed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:42.030 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:42.026+0000 7f8cc4afc640 1 --2- 172.21.15.88:0/4216112172 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f8ca006c8a0 0x7f8ca006ed60 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f8ca8034000 tx=0x7f8ca802e000 comp rx=0 tx=0).stop 2024-04-26T23:47:42.030 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:42.026+0000 7f8cc4afc640 1 -- 172.21.15.88:0/4216112172 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8cc00ca5a0 msgr2=0x7f8cc0159370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:42.030 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:42.026+0000 7f8cc4afc640 1 --2- 172.21.15.88:0/4216112172 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8cc00ca5a0 0x7f8cc0159370 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f8cb000b550 tx=0x7f8cb000ba10 comp rx=0 tx=0).stop 2024-04-26T23:47:42.031 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:42.027+0000 7f8cc4afc640 1 -- 172.21.15.88:0/4216112172 shutdown_connections 2024-04-26T23:47:42.031 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:42.027+0000 7f8cc4afc640 1 --2- 172.21.15.88:0/4216112172 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f8ca006c8a0 0x7f8ca006ed60 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:42.031 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:42.027+0000 7f8cc4afc640 1 --2- 172.21.15.88:0/4216112172 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8cc0154160 0x7f8cc014c0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:42.031 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:42.027+0000 7f8cc4afc640 1 --2- 172.21.15.88:0/4216112172 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8cc015a1a0 0x7f8cc01e24a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:42.031 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:42.027+0000 7f8cc4afc640 1 --2- 172.21.15.88:0/4216112172 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8cc00ca5a0 0x7f8cc0159370 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:42.031 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:42.027+0000 7f8cc4afc640 1 -- 172.21.15.88:0/4216112172 >> 172.21.15.88:0/4216112172 conn(0x7f8cc00ae010 msgr2=0x7f8cc0150dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:47:42.031 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:42.027+0000 7f8cc4afc640 1 -- 172.21.15.88:0/4216112172 shutdown_connections 2024-04-26T23:47:42.032 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:42.027+0000 7f8cc4afc640 1 -- 172.21.15.88:0/4216112172 wait complete. 2024-04-26T23:47:45.050 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-04-26T23:47:45.242 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:45.238+0000 7f3055f24640 1 Processor -- start 2024-04-26T23:47:45.252 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:45.246+0000 7f3055f24640 1 -- start start 2024-04-26T23:47:45.252 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:45.247+0000 7f3055f24640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f30480d3c40 0x7f304804ac70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:45.252 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:45.247+0000 7f3055f24640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f304804b1b0 0x7f30480d6a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:45.252 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:45.247+0000 7f3055f24640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f30480d6fa0 0x7f30480d99a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:45.253 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:45.247+0000 7f3055f24640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f3048047660 con 0x7f304804b1b0 2024-04-26T23:47:45.253 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:45.247+0000 7f3055f24640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f30480d65d0 con 0x7f30480d3c40 2024-04-26T23:47:45.253 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:45.247+0000 7f3055f24640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f30480468d0 con 0x7f30480d6fa0 2024-04-26T23:47:45.253 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:45.248+0000 7f304effd640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f304804b1b0 0x7f30480d6a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:45.253 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:45.248+0000 7f304effd640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f304804b1b0 0x7f30480d6a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:39908/0 (socket says 172.21.15.88:39908) 2024-04-26T23:47:45.253 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:45.248+0000 7f304effd640 1 -- 172.21.15.88:0/2825413765 learned_addr learned my addr 172.21.15.88:0/2825413765 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:47:45.253 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:45.248+0000 7f304f7fe640 1 -- 172.21.15.88:0/2825413765 >> v2:172.21.15.175:3300/0 conn(0x7f30480d3c40 msgr2=0x7f304804ac70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.175:3300/0 2024-04-26T23:47:45.253 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:45.248+0000 7f304effd640 1 -- 172.21.15.88:0/2825413765 >> v2:172.21.15.88:3300/0 conn(0x7f304804b1b0 msgr2=0x7f30480d6a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-26T23:47:45.253 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:45.248+0000 7f304effd640 1 -- 172.21.15.88:0/2825413765 >> v2:172.21.15.88:3300/0 conn(0x7f304804b1b0 msgr2=0x7f30480d6a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T23:47:45.253 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:45.248+0000 7f304effd640 1 --2- 172.21.15.88:0/2825413765 >> v2:172.21.15.88:3300/0 conn(0x7f304804b1b0 0x7f30480d6a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:47:45.253 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:45.248+0000 7f304f7fe640 1 --2- 172.21.15.88:0/2825413765 >> v2:172.21.15.175:3300/0 conn(0x7f30480d3c40 0x7f304804ac70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:47:45.253 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:45.248+0000 7f304effd640 1 --2- 172.21.15.88:0/2825413765 >> v2:172.21.15.88:3300/0 conn(0x7f304804b1b0 0x7f30480d6a60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:47:45.259 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:45.249+0000 7f304ffff640 1 --2- 172.21.15.88:0/2825413765 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f30480d6fa0 0x7f30480d99a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:45.259 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:45.252+0000 7f304ffff640 1 -- 172.21.15.88:0/2825413765 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f30480d6fa0 msgr2=0x7f30480d99a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-26T23:47:45.259 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:45.252+0000 7f304ffff640 1 -- 172.21.15.88:0/2825413765 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f30480d6fa0 msgr2=0x7f30480d99a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T23:47:45.259 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:45.252+0000 7f304ffff640 1 --2- 172.21.15.88:0/2825413765 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f30480d6fa0 0x7f30480d99a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:47:45.259 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:45.252+0000 7f304ffff640 1 --2- 172.21.15.88:0/2825413765 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f30480d6fa0 0x7f30480d99a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:47:45.453 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:45.449+0000 7f304f7fe640 1 -- 172.21.15.88:0/2825413765 >> v2:172.21.15.175:3300/0 conn(0x7f30480d3c40 msgr2=0x7f304804ac70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.175:3300/0 2024-04-26T23:47:45.454 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:45.449+0000 7f304f7fe640 1 --2- 172.21.15.88:0/2825413765 >> v2:172.21.15.175:3300/0 conn(0x7f30480d3c40 0x7f304804ac70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-26T23:47:45.454 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:45.449+0000 7f304effd640 1 --2- 172.21.15.88:0/2825413765 >> v2:172.21.15.88:3300/0 conn(0x7f304804b1b0 0x7f30480d6a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:45.454 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:45.449+0000 7f304effd640 1 -- 172.21.15.88:0/2825413765 >> v2:172.21.15.88:3300/0 conn(0x7f304804b1b0 msgr2=0x7f30480d6a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-26T23:47:45.454 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:45.449+0000 7f304effd640 1 -- 172.21.15.88:0/2825413765 >> v2:172.21.15.88:3300/0 conn(0x7f304804b1b0 msgr2=0x7f30480d6a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T23:47:45.454 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:45.449+0000 7f304effd640 1 --2- 172.21.15.88:0/2825413765 >> v2:172.21.15.88:3300/0 conn(0x7f304804b1b0 0x7f30480d6a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:47:45.454 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:45.449+0000 7f304effd640 1 --2- 172.21.15.88:0/2825413765 >> v2:172.21.15.88:3300/0 conn(0x7f304804b1b0 0x7f30480d6a60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-26T23:47:45.457 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:45.453+0000 7f304ffff640 1 --2- 172.21.15.88:0/2825413765 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f30480d6fa0 0x7f30480d99a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:45.457 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:45.453+0000 7f304ffff640 1 -- 172.21.15.88:0/2825413765 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f30480d6fa0 msgr2=0x7f30480d99a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-26T23:47:45.457 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:45.453+0000 7f304ffff640 1 -- 172.21.15.88:0/2825413765 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f30480d6fa0 msgr2=0x7f30480d99a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T23:47:45.458 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:45.453+0000 7f304ffff640 1 --2- 172.21.15.88:0/2825413765 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f30480d6fa0 0x7f30480d99a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:47:45.458 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:45.453+0000 7f304ffff640 1 --2- 172.21.15.88:0/2825413765 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f30480d6fa0 0x7f30480d99a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-26T23:47:45.854 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:45.850+0000 7f304f7fe640 1 -- 172.21.15.88:0/2825413765 >> v2:172.21.15.175:3300/0 conn(0x7f30480d3c40 msgr2=0x7f304804ac70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.175:3300/0 2024-04-26T23:47:45.855 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:45.850+0000 7f304f7fe640 1 --2- 172.21.15.88:0/2825413765 >> v2:172.21.15.175:3300/0 conn(0x7f30480d3c40 0x7f304804ac70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-26T23:47:45.855 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:45.850+0000 7f304effd640 1 --2- 172.21.15.88:0/2825413765 >> v2:172.21.15.88:3300/0 conn(0x7f304804b1b0 0x7f30480d6a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:45.855 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:45.850+0000 7f304effd640 1 -- 172.21.15.88:0/2825413765 >> v2:172.21.15.88:3300/0 conn(0x7f304804b1b0 msgr2=0x7f30480d6a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-26T23:47:45.855 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:45.850+0000 7f304effd640 1 -- 172.21.15.88:0/2825413765 >> v2:172.21.15.88:3300/0 conn(0x7f304804b1b0 msgr2=0x7f30480d6a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T23:47:45.855 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:45.850+0000 7f304effd640 1 --2- 172.21.15.88:0/2825413765 >> v2:172.21.15.88:3300/0 conn(0x7f304804b1b0 0x7f30480d6a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:47:45.855 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:45.850+0000 7f304effd640 1 --2- 172.21.15.88:0/2825413765 >> v2:172.21.15.88:3300/0 conn(0x7f304804b1b0 0x7f30480d6a60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-26T23:47:45.858 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:45.854+0000 7f304ffff640 1 --2- 172.21.15.88:0/2825413765 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f30480d6fa0 0x7f30480d99a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:45.858 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:45.854+0000 7f304ffff640 1 -- 172.21.15.88:0/2825413765 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f30480d6fa0 msgr2=0x7f30480d99a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-26T23:47:45.858 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:45.854+0000 7f304ffff640 1 -- 172.21.15.88:0/2825413765 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f30480d6fa0 msgr2=0x7f30480d99a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T23:47:45.859 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:45.854+0000 7f304ffff640 1 --2- 172.21.15.88:0/2825413765 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f30480d6fa0 0x7f30480d99a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:47:45.859 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:45.854+0000 7f304ffff640 1 --2- 172.21.15.88:0/2825413765 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f30480d6fa0 0x7f30480d99a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-26T23:47:46.655 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:46.651+0000 7f304f7fe640 1 -- 172.21.15.88:0/2825413765 >> v2:172.21.15.175:3300/0 conn(0x7f30480d3c40 msgr2=0x7f304804ac70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.175:3300/0 2024-04-26T23:47:46.656 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:46.651+0000 7f304f7fe640 1 --2- 172.21.15.88:0/2825413765 >> v2:172.21.15.175:3300/0 conn(0x7f30480d3c40 0x7f304804ac70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-26T23:47:46.656 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:46.651+0000 7f304effd640 1 --2- 172.21.15.88:0/2825413765 >> v2:172.21.15.88:3300/0 conn(0x7f304804b1b0 0x7f30480d6a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:46.656 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:46.651+0000 7f304effd640 1 -- 172.21.15.88:0/2825413765 >> v2:172.21.15.88:3300/0 conn(0x7f304804b1b0 msgr2=0x7f30480d6a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-26T23:47:46.656 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:46.651+0000 7f304effd640 1 -- 172.21.15.88:0/2825413765 >> v2:172.21.15.88:3300/0 conn(0x7f304804b1b0 msgr2=0x7f30480d6a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T23:47:46.656 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:46.651+0000 7f304effd640 1 --2- 172.21.15.88:0/2825413765 >> v2:172.21.15.88:3300/0 conn(0x7f304804b1b0 0x7f30480d6a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:47:46.656 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:46.651+0000 7f304effd640 1 --2- 172.21.15.88:0/2825413765 >> v2:172.21.15.88:3300/0 conn(0x7f304804b1b0 0x7f30480d6a60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-26T23:47:46.661 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:46.657+0000 7f304ffff640 1 --2- 172.21.15.88:0/2825413765 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f30480d6fa0 0x7f30480d99a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:46.662 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:46.658+0000 7f304ffff640 1 -- 172.21.15.88:0/2825413765 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f30480d6fa0 msgr2=0x7f30480d99a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-26T23:47:46.662 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:46.658+0000 7f304ffff640 1 -- 172.21.15.88:0/2825413765 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f30480d6fa0 msgr2=0x7f30480d99a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T23:47:46.662 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:46.658+0000 7f304ffff640 1 --2- 172.21.15.88:0/2825413765 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f30480d6fa0 0x7f30480d99a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:47:46.662 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:46.658+0000 7f304ffff640 1 --2- 172.21.15.88:0/2825413765 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f30480d6fa0 0x7f30480d99a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-26T23:47:48.252 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:48.247+0000 7f304d7fa640 1 -- 172.21.15.88:0/2825413765 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f30480d6fa0 msgr2=0x7f30480d99a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T23:47:48.252 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:48.247+0000 7f304d7fa640 1 --2- 172.21.15.88:0/2825413765 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f30480d6fa0 0x7f30480d99a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:48.252 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:48.247+0000 7f304d7fa640 1 -- 172.21.15.88:0/2825413765 >> v2:172.21.15.175:3300/0 conn(0x7f30480d3c40 msgr2=0x7f304804ac70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T23:47:48.252 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:48.247+0000 7f304d7fa640 1 --2- 172.21.15.88:0/2825413765 >> v2:172.21.15.175:3300/0 conn(0x7f30480d3c40 0x7f304804ac70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:48.252 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:48.247+0000 7f304d7fa640 1 -- 172.21.15.88:0/2825413765 >> v2:172.21.15.88:3300/0 conn(0x7f304804b1b0 msgr2=0x7f30480d6a60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T23:47:48.252 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:48.247+0000 7f304d7fa640 1 --2- 172.21.15.88:0/2825413765 >> v2:172.21.15.88:3300/0 conn(0x7f304804b1b0 0x7f30480d6a60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:48.253 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:48.247+0000 7f304d7fa640 1 -- 172.21.15.88:0/2825413765 --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3048046bb0 con 0x7f303400b770 2024-04-26T23:47:48.253 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:48.247+0000 7f304d7fa640 1 -- 172.21.15.88:0/2825413765 --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f30340104f0 con 0x7f3034007ac0 2024-04-26T23:47:48.253 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:48.247+0000 7f304f7fe640 1 -- 172.21.15.88:0/2825413765 >> v1:172.21.15.175:6789/0 conn(0x7f3034007ac0 legacy=0x7f3034009f40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.175:6789/0 2024-04-26T23:47:48.452 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:48.448+0000 7f304f7fe640 1 -- 172.21.15.88:0/2825413765 >> v1:172.21.15.175:6789/0 conn(0x7f3034007ac0 legacy=0x7f3034009f40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.175:6789/0 2024-04-26T23:47:48.719 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:48.714+0000 7f304e7fc640 1 -- 172.21.15.88:0/2825413765 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 45266469 0 0) 0x7f3048046bb0 con 0x7f303400b770 2024-04-26T23:47:48.719 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:48.714+0000 7f304e7fc640 1 -- 172.21.15.88:0/2825413765 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3040003520 con 0x7f303400b770 2024-04-26T23:47:48.727 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:48.722+0000 7f304e7fc640 1 -- 172.21.15.88:0/2825413765 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3114092877 0 0) 0x7f3040003520 con 0x7f303400b770 2024-04-26T23:47:48.727 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:48.722+0000 7f304e7fc640 1 -- 172.21.15.88:0/2825413765 >> v1:172.21.15.175:6789/0 conn(0x7f3034007ac0 legacy=0x7f3034009f40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T23:47:48.727 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:48.722+0000 7f304e7fc640 1 -- 172.21.15.88:0/2825413765 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3034011730 con 0x7f303400b770 2024-04-26T23:47:48.727 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:48.722+0000 7f304e7fc640 1 -- 172.21.15.88:0/2825413765 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 356324787 0 0) 0x7f303c00d640 con 0x7f303400b770 2024-04-26T23:47:48.727 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:48.722+0000 7f304e7fc640 1 -- 172.21.15.88:0/2825413765 >> v1:172.21.15.88:6789/0 conn(0x7f303400b770 legacy=0x7f303400dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:48.727 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:48.722+0000 7f304e7fc640 1 --2- 172.21.15.88:0/2825413765 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f30400039e0 0x7f3040003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:48.727 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:48.722+0000 7f304ffff640 1 -- 172.21.15.88:0/2825413765 reap_dead start 2024-04-26T23:47:48.727 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:48.722+0000 7f304e7fc640 1 --2- 172.21.15.88:0/2825413765 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f30480d6fa0 0x7f3040004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:48.728 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:48.722+0000 7f304f7fe640 1 -- 172.21.15.88:0/2825413765 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f30400039e0 msgr2=0x7f3040003dc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.175:3300/0 2024-04-26T23:47:48.728 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:48.722+0000 7f304f7fe640 1 --2- 172.21.15.88:0/2825413765 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f30400039e0 0x7f3040003dc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:47:48.728 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:48.722+0000 7f304e7fc640 1 --2- 172.21.15.88:0/2825413765 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3040004d40 0x7f30400051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:48.728 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:48.722+0000 7f304e7fc640 1 -- 172.21.15.88:0/2825413765 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f3040014340 con 0x7f3040004d40 2024-04-26T23:47:48.728 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:48.722+0000 7f304e7fc640 1 -- 172.21.15.88:0/2825413765 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f30400144f0 con 0x7f30400039e0 2024-04-26T23:47:48.728 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:48.722+0000 7f304e7fc640 1 -- 172.21.15.88:0/2825413765 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f30400146f0 con 0x7f30480d6fa0 2024-04-26T23:47:48.728 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:48.723+0000 7f304ffff640 1 --2- 172.21.15.88:0/2825413765 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3040004d40 0x7f30400051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:48.728 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:48.723+0000 7f304effd640 1 --2- 172.21.15.88:0/2825413765 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f30480d6fa0 0x7f3040004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:48.729 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:48.724+0000 7f304ffff640 1 -- 172.21.15.88:0/2825413765 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f30480d6fa0 msgr2=0x7f3040004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:47:48.729 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:48.724+0000 7f304ffff640 1 --2- 172.21.15.88:0/2825413765 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f30480d6fa0 0x7f3040004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:48.729 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:48.724+0000 7f304ffff640 1 -- 172.21.15.88:0/2825413765 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f30400039e0 msgr2=0x7f3040003dc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T23:47:48.729 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:48.724+0000 7f304ffff640 1 --2- 172.21.15.88:0/2825413765 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f30400039e0 0x7f3040003dc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:48.729 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:48.724+0000 7f304ffff640 1 -- 172.21.15.88:0/2825413765 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3034011730 con 0x7f3040004d40 2024-04-26T23:47:48.729 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:48.725+0000 7f304ffff640 1 --2- 172.21.15.88:0/2825413765 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3040004d40 0x7f30400051c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f304800d340 tx=0x7f3040005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f472780cbc8927a3 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:47:48.732 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:48.725+0000 7f304e7fc640 1 -- 172.21.15.88:0/2825413765 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3044038070 con 0x7f3040004d40 2024-04-26T23:47:48.732 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:48.725+0000 7f304e7fc640 1 -- 172.21.15.88:0/2825413765 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f304402bc20 con 0x7f3040004d40 2024-04-26T23:47:48.732 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:48.725+0000 7f304e7fc640 1 -- 172.21.15.88:0/2825413765 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3044010890 con 0x7f3040004d40 2024-04-26T23:47:48.732 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:48.726+0000 7f3055f24640 1 -- 172.21.15.88:0/2825413765 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3040004d40 msgr2=0x7f30400051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:48.732 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:48.726+0000 7f3055f24640 1 --2- 172.21.15.88:0/2825413765 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3040004d40 0x7f30400051c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f304800d340 tx=0x7f3040005830 comp rx=0 tx=0).stop 2024-04-26T23:47:48.732 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:48.727+0000 7f3055f24640 1 -- 172.21.15.88:0/2825413765 shutdown_connections 2024-04-26T23:47:48.733 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:48.727+0000 7f3055f24640 1 --2- 172.21.15.88:0/2825413765 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f30480d6fa0 0x7f3040004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:48.733 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:48.727+0000 7f3055f24640 1 --2- 172.21.15.88:0/2825413765 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3040004d40 0x7f30400051c0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:48.733 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:48.727+0000 7f3055f24640 1 --2- 172.21.15.88:0/2825413765 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f30400039e0 0x7f3040003dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:48.733 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:48.727+0000 7f3055f24640 1 -- 172.21.15.88:0/2825413765 >> 172.21.15.88:0/2825413765 conn(0x7f3048005e90 msgr2=0x7f30480062a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:47:48.734 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:48.727+0000 7f3055f24640 1 -- 172.21.15.88:0/2825413765 shutdown_connections 2024-04-26T23:47:48.734 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:48.727+0000 7f3055f24640 1 -- 172.21.15.88:0/2825413765 wait complete. 2024-04-26T23:47:48.737 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:48.729+0000 7f3055f24640 1 Processor -- start 2024-04-26T23:47:48.740 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:48.730+0000 7f3055f24640 1 -- start start 2024-04-26T23:47:48.740 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:48.732+0000 7f3055f24640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f30400039e0 0x7f3048042b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:48.740 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:48.732+0000 7f3055f24640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3040004d40 0x7f30480d9b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:48.740 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:48.732+0000 7f3055f24640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f30480d6fa0 0x7f304816e630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:48.740 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:48.732+0000 7f304f7fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f30400039e0 0x7f3048042b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:48.740 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:48.732+0000 7f304f7fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f30400039e0 0x7f3048042b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:44710/0 (socket says 172.21.15.88:44710) 2024-04-26T23:47:48.740 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:48.732+0000 7f304effd640 1 -- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3040004d40 msgr2=0x7f30480d9b80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.175:3300/0 2024-04-26T23:47:48.740 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:48.732+0000 7f304effd640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3040004d40 0x7f30480d9b80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:47:48.741 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:48.733+0000 7f304f7fe640 1 -- 172.21.15.88:0/2464069424 learned_addr learned my addr 172.21.15.88:0/2464069424 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:47:48.741 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:48.733+0000 7f3055f24640 1 -- 172.21.15.88:0/2464069424 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f3048046360 con 0x7f30400039e0 2024-04-26T23:47:48.741 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:48.733+0000 7f3055f24640 1 -- 172.21.15.88:0/2464069424 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f30480461e0 con 0x7f3040004d40 2024-04-26T23:47:48.741 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:48.733+0000 7f3055f24640 1 -- 172.21.15.88:0/2464069424 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f3048046e90 con 0x7f30480d6fa0 2024-04-26T23:47:48.741 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:48.733+0000 7f304ffff640 1 --2- 172.21.15.88:0/2464069424 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f30480d6fa0 0x7f304816e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:48.741 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:48.734+0000 7f304f7fe640 1 -- 172.21.15.88:0/2464069424 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f30480d6fa0 msgr2=0x7f304816e630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:48.741 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:48.734+0000 7f304f7fe640 1 --2- 172.21.15.88:0/2464069424 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f30480d6fa0 0x7f304816e630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:48.741 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:48.734+0000 7f304f7fe640 1 -- 172.21.15.88:0/2464069424 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3040004d40 msgr2=0x7f30480d9b80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T23:47:48.741 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:48.734+0000 7f304f7fe640 1 --2- 172.21.15.88:0/2464069424 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3040004d40 0x7f30480d9b80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:48.741 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:48.734+0000 7f304f7fe640 1 -- 172.21.15.88:0/2464069424 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30480d3050 con 0x7f30400039e0 2024-04-26T23:47:48.741 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:48.734+0000 7f304f7fe640 1 --2- 172.21.15.88:0/2464069424 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f30400039e0 0x7f3048042b80 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f305002e060 tx=0x7f305006a050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:47:48.741 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:48.734+0000 7f303bfff640 1 -- 172.21.15.88:0/2464069424 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3050091070 con 0x7f30400039e0 2024-04-26T23:47:48.741 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:48.734+0000 7f303bfff640 1 -- 172.21.15.88:0/2464069424 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30500719d0 con 0x7f30400039e0 2024-04-26T23:47:48.741 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:48.735+0000 7f303bfff640 1 -- 172.21.15.88:0/2464069424 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3050071dc0 con 0x7f30400039e0 2024-04-26T23:47:48.741 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:48.735+0000 7f3055f24640 1 -- 172.21.15.88:0/2464069424 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30480d83d0 con 0x7f30400039e0 2024-04-26T23:47:48.743 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:48.738+0000 7f303bfff640 1 -- 172.21.15.88:0/2464069424 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f3050096450 con 0x7f30400039e0 2024-04-26T23:47:48.743 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:48.738+0000 7f303bfff640 1 --2- 172.21.15.88:0/2464069424 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f303406d590 0x7f303406fa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:48.743 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:48.739+0000 7f304effd640 1 --2- 172.21.15.88:0/2464069424 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f303406d590 0x7f303406fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:48.744 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:48.739+0000 7f3055f24640 1 -- 172.21.15.88:0/2464069424 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30480430c0 con 0x7f30400039e0 2024-04-26T23:47:48.744 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:48.739+0000 7f303bfff640 1 -- 172.21.15.88:0/2464069424 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6666+0+0 (secure 0 0 0) 0x7f30500d3970 con 0x7f30400039e0 2024-04-26T23:47:48.744 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:48.740+0000 7f304effd640 1 --2- 172.21.15.88:0/2464069424 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f303406d590 0x7f303406fa50 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f30480052d0 tx=0x7f303c016040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:47:48.748 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:48.744+0000 7f3055f24640 1 -- 172.21.15.88:0/2464069424 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f30480493a0 con 0x7f30400039e0 2024-04-26T23:47:48.759 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:48.755+0000 7f303bfff640 1 -- 172.21.15.88:0/2464069424 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f30480493a0 con 0x7f30400039e0 2024-04-26T23:47:49.316 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:49.311+0000 7f3055f24640 1 -- 172.21.15.88:0/2464069424 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f3048005390 con 0x7f30400039e0 2024-04-26T23:47:49.317 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:49.312+0000 7f303bfff640 1 -- 172.21.15.88:0/2464069424 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1558 (secure 0 0 0) 0x7f30500d5fd0 con 0x7f30400039e0 2024-04-26T23:47:49.318 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":74,"quorum":[0,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"555255e9-7ef9-4454-8dc9-35e96b70035c","modified":"2024-04-26T23:39:34.291658Z","created":"2024-04-26T23:39:34.291658Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:3300","nonce":0},{"type":"v1","addr":"172.21.15.175:6789","nonce":0}]},"addr":"172.21.15.175:6789/0","public_addr":"172.21.15.175:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:3301","nonce":0},{"type":"v1","addr":"172.21.15.175:6790","nonce":0}]},"addr":"172.21.15.175:6790/0","public_addr":"172.21.15.175:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-04-26T23:47:49.322 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:49.317+0000 7f3055f24640 1 -- 172.21.15.88:0/2464069424 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f303406d590 msgr2=0x7f303406fa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:49.322 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:49.317+0000 7f3055f24640 1 --2- 172.21.15.88:0/2464069424 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f303406d590 0x7f303406fa50 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f30480052d0 tx=0x7f303c016040 comp rx=0 tx=0).stop 2024-04-26T23:47:49.322 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:49.317+0000 7f3055f24640 1 -- 172.21.15.88:0/2464069424 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f30400039e0 msgr2=0x7f3048042b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:49.322 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:49.317+0000 7f3055f24640 1 --2- 172.21.15.88:0/2464069424 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f30400039e0 0x7f3048042b80 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f305002e060 tx=0x7f305006a050 comp rx=0 tx=0).stop 2024-04-26T23:47:49.322 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:49.317+0000 7f3055f24640 1 -- 172.21.15.88:0/2464069424 shutdown_connections 2024-04-26T23:47:49.323 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:49.317+0000 7f3055f24640 1 --2- 172.21.15.88:0/2464069424 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f303406d590 0x7f303406fa50 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:49.323 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:49.317+0000 7f3055f24640 1 --2- 172.21.15.88:0/2464069424 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f30480d6fa0 0x7f304816e630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:49.323 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:49.317+0000 7f3055f24640 1 --2- 172.21.15.88:0/2464069424 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3040004d40 0x7f30480d9b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:49.323 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:49.317+0000 7f3055f24640 1 --2- 172.21.15.88:0/2464069424 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f30400039e0 0x7f3048042b80 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:49.323 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:49.317+0000 7f3055f24640 1 -- 172.21.15.88:0/2464069424 >> 172.21.15.88:0/2464069424 conn(0x7f3048005e90 msgr2=0x7f304802b890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:47:49.323 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:49.318+0000 7f3055f24640 1 -- 172.21.15.88:0/2464069424 shutdown_connections 2024-04-26T23:47:49.323 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:49.318+0000 7f3055f24640 1 -- 172.21.15.88:0/2464069424 wait complete. 2024-04-26T23:47:49.342 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2024-04-26T23:47:49.343 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon a 2024-04-26T23:47:49.343 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-04-26T23:47:49.538 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:49.530+0000 7f7d3ecbd640 1 Processor -- start 2024-04-26T23:47:49.538 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:49.530+0000 7f7d3ecbd640 1 -- start start 2024-04-26T23:47:49.538 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:49.531+0000 7f7d3ecbd640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f7d38167b90 0x7f7d380ac7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:49.538 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:49.531+0000 7f7d3ecbd640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7d380c5880 0x7f7d380accf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:49.538 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:49.531+0000 7f7d3ecbd640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7d3806d530 con 0x7f7d380c3ee0 2024-04-26T23:47:49.538 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:49.531+0000 7f7d3ecbd640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f7d3806db60 con 0x7f7d38167b90 2024-04-26T23:47:49.538 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:49.531+0000 7f7d3ecbd640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f7d380748c0 con 0x7f7d380c5880 2024-04-26T23:47:49.538 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:49.531+0000 7f7d37fff640 1 -- >> v2:172.21.15.175:3300/0 conn(0x7f7d38167b90 msgr2=0x7f7d380ac7b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.175:3300/0 2024-04-26T23:47:49.538 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:49.531+0000 7f7d37fff640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f7d38167b90 0x7f7d380ac7b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:47:49.539 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:49.532+0000 7f7d3ca59640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f7d380c3ee0 0x7f7d38167480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:38122/0 (socket says 172.21.15.88:38122) 2024-04-26T23:47:49.540 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:49.532+0000 7f7d3ca59640 1 -- 172.21.15.88:0/1080140535 learned_addr learned my addr 172.21.15.88:0/1080140535 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-26T23:47:49.540 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:49.532+0000 7f7d3d25a640 1 --2- 172.21.15.88:0/1080140535 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7d380c5880 0x7f7d380accf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:49.540 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:49.533+0000 7f7d3d25a640 1 -- 172.21.15.88:0/1080140535 >> v2:172.21.15.175:3300/0 conn(0x7f7d38167b90 msgr2=0x7f7d380ac7b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T23:47:49.540 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:49.533+0000 7f7d3d25a640 1 --2- 172.21.15.88:0/1080140535 >> v2:172.21.15.175:3300/0 conn(0x7f7d38167b90 0x7f7d380ac7b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:49.540 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:49.533+0000 7f7d3d25a640 1 -- 172.21.15.88:0/1080140535 >> v1:172.21.15.88:6789/0 conn(0x7f7d380c3ee0 legacy=0x7f7d38167480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:49.540 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:49.533+0000 7f7d3d25a640 1 -- 172.21.15.88:0/1080140535 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d38074ba0 con 0x7f7d380c5880 2024-04-26T23:47:49.540 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:49.534+0000 7f7d3d25a640 1 --2- 172.21.15.88:0/1080140535 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7d380c5880 0x7f7d380accf0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f7d2c008800 tx=0x7f7d2c02e580 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9da6ec18fd13777b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:47:49.541 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:49.537+0000 7f7d377fe640 1 -- 172.21.15.88:0/1080140535 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d2c03c070 con 0x7f7d380c5880 2024-04-26T23:47:49.541 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:49.537+0000 7f7d377fe640 1 -- 172.21.15.88:0/1080140535 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d2c034480 con 0x7f7d380c5880 2024-04-26T23:47:49.543 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:49.538+0000 7f7d3ecbd640 1 -- 172.21.15.88:0/1080140535 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7d380c5880 msgr2=0x7f7d380accf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:49.543 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:49.538+0000 7f7d3ecbd640 1 --2- 172.21.15.88:0/1080140535 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7d380c5880 0x7f7d380accf0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f7d2c008800 tx=0x7f7d2c02e580 comp rx=0 tx=0).stop 2024-04-26T23:47:49.543 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:49.538+0000 7f7d3ecbd640 1 -- 172.21.15.88:0/1080140535 shutdown_connections 2024-04-26T23:47:49.543 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:49.538+0000 7f7d3ecbd640 1 --2- 172.21.15.88:0/1080140535 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7d380c5880 0x7f7d380accf0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:49.543 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:49.538+0000 7f7d3ecbd640 1 --2- 172.21.15.88:0/1080140535 >> v2:172.21.15.175:3300/0 conn(0x7f7d38167b90 0x7f7d380ac7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:49.543 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:49.538+0000 7f7d3ecbd640 1 -- 172.21.15.88:0/1080140535 >> 172.21.15.88:0/1080140535 conn(0x7f7d380c4d60 msgr2=0x7f7d380c5170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:47:49.549 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:49.538+0000 7f7d3ecbd640 1 -- 172.21.15.88:0/1080140535 shutdown_connections 2024-04-26T23:47:49.549 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:49.539+0000 7f7d3ecbd640 1 -- 172.21.15.88:0/1080140535 wait complete. 2024-04-26T23:47:49.549 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:49.540+0000 7f7d3ecbd640 1 Processor -- start 2024-04-26T23:47:49.553 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:49.540+0000 7f7d3ecbd640 1 -- start start 2024-04-26T23:47:49.553 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:49.541+0000 7f7d3ecbd640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7d380c3ee0 0x7f7d3809ca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:49.553 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:49.541+0000 7f7d3ecbd640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7d38167b90 0x7f7d380c7770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:49.553 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:49.541+0000 7f7d3ecbd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7d380a9880 0x7f7d380a9d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:49.553 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:49.541+0000 7f7d3ecbd640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f7d380c42c0 con 0x7f7d380a9880 2024-04-26T23:47:49.553 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:49.541+0000 7f7d3ecbd640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f7d38074570 con 0x7f7d38167b90 2024-04-26T23:47:49.554 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:49.541+0000 7f7d3ecbd640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f7d380c4440 con 0x7f7d380c3ee0 2024-04-26T23:47:49.554 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:49.544+0000 7f7d37fff640 1 -- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7d38167b90 msgr2=0x7f7d380c7770 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.175:3300/0 2024-04-26T23:47:49.554 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:49.544+0000 7f7d37fff640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7d38167b90 0x7f7d380c7770 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:47:49.554 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:49.544+0000 7f7d3d25a640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7d380a9880 0x7f7d380a9d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:49.554 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:49.544+0000 7f7d3d25a640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7d380a9880 0x7f7d380a9d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:44724/0 (socket says 172.21.15.88:44724) 2024-04-26T23:47:49.554 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:49.544+0000 7f7d3d25a640 1 -- 172.21.15.88:0/3121109617 learned_addr learned my addr 172.21.15.88:0/3121109617 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:47:49.554 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:49.545+0000 7f7d3ca59640 1 --2- 172.21.15.88:0/3121109617 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7d380c3ee0 0x7f7d3809ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:49.554 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:49.545+0000 7f7d3ca59640 1 -- 172.21.15.88:0/3121109617 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7d38167b90 msgr2=0x7f7d380c7770 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T23:47:49.554 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:49.545+0000 7f7d3ca59640 1 --2- 172.21.15.88:0/3121109617 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7d38167b90 0x7f7d380c7770 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:49.554 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:49.545+0000 7f7d3ca59640 1 -- 172.21.15.88:0/3121109617 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7d380a9880 msgr2=0x7f7d380a9d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:49.554 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:49.545+0000 7f7d3ca59640 1 --2- 172.21.15.88:0/3121109617 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7d380a9880 0x7f7d380a9d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:49.554 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:49.545+0000 7f7d3ca59640 1 -- 172.21.15.88:0/3121109617 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d3809cf50 con 0x7f7d380c3ee0 2024-04-26T23:47:49.554 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:49.546+0000 7f7d3d25a640 1 --2- 172.21.15.88:0/3121109617 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7d380a9880 0x7f7d380a9d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:47:49.557 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:49.551+0000 7f7d3ca59640 1 --2- 172.21.15.88:0/3121109617 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7d380c3ee0 0x7f7d3809ca10 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f7d2800c780 tx=0x7f7d2800cc40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:47:49.557 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:49.552+0000 7f7d357fa640 1 -- 172.21.15.88:0/3121109617 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d28018070 con 0x7f7d380c3ee0 2024-04-26T23:47:49.559 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:49.553+0000 7f7d3ecbd640 1 -- 172.21.15.88:0/3121109617 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d380aa270 con 0x7f7d380c3ee0 2024-04-26T23:47:49.559 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:49.553+0000 7f7d3ecbd640 1 -- 172.21.15.88:0/3121109617 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d381f8e80 con 0x7f7d380c3ee0 2024-04-26T23:47:49.559 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:49.554+0000 7f7d357fa640 1 -- 172.21.15.88:0/3121109617 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d280072f0 con 0x7f7d380c3ee0 2024-04-26T23:47:49.559 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:49.554+0000 7f7d357fa640 1 -- 172.21.15.88:0/3121109617 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d280047e0 con 0x7f7d380c3ee0 2024-04-26T23:47:49.560 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:49.556+0000 7f7d357fa640 1 -- 172.21.15.88:0/3121109617 <== mon.2 v2:172.21.15.175:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f7d2801b070 con 0x7f7d380c3ee0 2024-04-26T23:47:49.561 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:49.557+0000 7f7d3ecbd640 1 --2- 172.21.15.88:0/3121109617 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7d18002a70 0x7f7d18004f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:49.561 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:49.557+0000 7f7d3ecbd640 1 -- 172.21.15.88:0/3121109617 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f7d18007ec0 con 0x7f7d18002a70 2024-04-26T23:47:49.561 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:49.557+0000 7f7d357fa640 1 --2- 172.21.15.88:0/3121109617 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f7d2006ca10 0x7f7d2006eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:49.561 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:49.557+0000 7f7d357fa640 1 -- 172.21.15.88:0/3121109617 <== mon.2 v2:172.21.15.175:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6666+0+0 (secure 0 0 0) 0x7f7d2808b320 con 0x7f7d380c3ee0 2024-04-26T23:47:49.562 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:49.557+0000 7f7d37fff640 1 --2- 172.21.15.88:0/3121109617 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7d18002a70 0x7f7d18004f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:49.562 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:49.557+0000 7f7d37fff640 1 -- 172.21.15.88:0/3121109617 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7d180080c0 con 0x7f7d18002a70 2024-04-26T23:47:49.562 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:49.557+0000 7f7d3d25a640 1 --2- 172.21.15.88:0/3121109617 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f7d2006ca10 0x7f7d2006eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:49.562 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:49.558+0000 7f7d37fff640 1 --2- 172.21.15.88:0/3121109617 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7d18002a70 0x7f7d18004f30 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f7d38164940 tx=0x7f7d30009ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:47:49.563 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:49.558+0000 7f7d3d25a640 1 --2- 172.21.15.88:0/3121109617 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f7d2006ca10 0x7f7d2006eed0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f7d2c006fd0 tx=0x7f7d2c032000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:47:49.563 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:49.558+0000 7f7d357fa640 1 -- 172.21.15.88:0/3121109617 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d30014630 con 0x7f7d18002a70 2024-04-26T23:47:49.563 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:49.558+0000 7f7d357fa640 1 -- 172.21.15.88:0/3121109617 <== mon.0 v2:172.21.15.88:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f7d3000ce50 con 0x7f7d18002a70 2024-04-26T23:47:49.563 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:49.559+0000 7f7d357fa640 1 -- 172.21.15.88:0/3121109617 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7d18002a70 msgr2=0x7f7d18004f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:49.563 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:49.559+0000 7f7d357fa640 1 --2- 172.21.15.88:0/3121109617 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7d18002a70 0x7f7d18004f30 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f7d38164940 tx=0x7f7d30009ef0 comp rx=0 tx=0).stop 2024-04-26T23:47:49.563 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:49.559+0000 7f7d357fa640 1 -- 172.21.15.88:0/3121109617 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7d18002a70 msgr2=0x7f7d18004f30 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:47:49.566 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:49.559+0000 7f7d357fa640 1 --2- 172.21.15.88:0/3121109617 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7d18002a70 0x7f7d18004f30 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:49.576 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:49.572+0000 7f7d3ecbd640 1 --2- 172.21.15.88:0/3121109617 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7d18006f30 0x7f7d180073c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:49.577 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:49.572+0000 7f7d37fff640 1 --2- 172.21.15.88:0/3121109617 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7d18006f30 0x7f7d180073c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:49.577 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:49.572+0000 7f7d3ecbd640 1 -- 172.21.15.88:0/3121109617 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f7d1800a4a0 con 0x7f7d18006f30 2024-04-26T23:47:49.578 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:49.573+0000 7f7d37fff640 1 -- 172.21.15.88:0/3121109617 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f7d18007900 con 0x7f7d18006f30 2024-04-26T23:47:49.578 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:49.573+0000 7f7d37fff640 1 --2- 172.21.15.88:0/3121109617 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7d18006f30 0x7f7d180073c0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f7d38165150 tx=0x7f7d30005da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:47:49.578 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:49.574+0000 7f7d357fa640 1 -- 172.21.15.88:0/3121109617 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d30019040 con 0x7f7d18006f30 2024-04-26T23:47:49.579 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:49.574+0000 7f7d357fa640 1 -- 172.21.15.88:0/3121109617 <== mon.0 v2:172.21.15.88:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4715 (secure 0 0 0) 0x7f7d300133d0 con 0x7f7d18006f30 2024-04-26T23:47:49.579 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:49.574+0000 7f7d357fa640 1 -- 172.21.15.88:0/3121109617 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7d18006f30 msgr2=0x7f7d180073c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:49.579 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:49.574+0000 7f7d357fa640 1 --2- 172.21.15.88:0/3121109617 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7d18006f30 0x7f7d180073c0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f7d38165150 tx=0x7f7d30005da0 comp rx=0 tx=0).stop 2024-04-26T23:47:49.579 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:49.574+0000 7f7d357fa640 1 -- 172.21.15.88:0/3121109617 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7d18006f30 msgr2=0x7f7d180073c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:47:49.579 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:49.574+0000 7f7d357fa640 1 --2- 172.21.15.88:0/3121109617 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7d18006f30 0x7f7d180073c0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:49.579 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-04-26T23:47:49.580 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2024-04-26T23:47:49.580 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2024-04-26T23:47:49.580 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "leader", 2024-04-26T23:47:49.580 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 74, 2024-04-26T23:47:49.580 INFO:teuthology.orchestra.run.smithi088.stdout: "uptime": 42642, 2024-04-26T23:47:49.580 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2024-04-26T23:47:49.580 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2024-04-26T23:47:49.580 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2024-04-26T23:47:49.580 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:47:49.580 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 0, 2024-04-26T23:47:49.580 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2024-04-26T23:47:49.580 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2450521708007866372", 2024-04-26T23:47:49.580 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2024-04-26T23:47:49.580 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-04-26T23:47:49.581 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-04-26T23:47:49.581 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-04-26T23:47:49.581 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-04-26T23:47:49.581 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-04-26T23:47:49.581 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-04-26T23:47:49.581 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-04-26T23:47:49.581 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-04-26T23:47:49.581 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-04-26T23:47:49.581 INFO:teuthology.orchestra.run.smithi088.stdout: "reef", 2024-04-26T23:47:49.581 INFO:teuthology.orchestra.run.smithi088.stdout: "squid" 2024-04-26T23:47:49.581 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:47:49.581 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540701547738038271", 2024-04-26T23:47:49.581 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2024-04-26T23:47:49.581 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-04-26T23:47:49.581 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-04-26T23:47:49.582 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-04-26T23:47:49.582 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-04-26T23:47:49.582 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-04-26T23:47:49.582 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-04-26T23:47:49.582 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-04-26T23:47:49.582 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-04-26T23:47:49.582 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-04-26T23:47:49.582 INFO:teuthology.orchestra.run.smithi088.stdout: "reef", 2024-04-26T23:47:49.582 INFO:teuthology.orchestra.run.smithi088.stdout: "squid" 2024-04-26T23:47:49.582 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:47:49.582 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:47:49.582 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2024-04-26T23:47:49.582 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2024-04-26T23:47:49.583 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2024-04-26T23:47:49.583 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2024-04-26T23:47:49.583 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2024-04-26T23:47:49.583 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "555255e9-7ef9-4454-8dc9-35e96b70035c", 2024-04-26T23:47:49.583 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2024-04-26T23:39:34.291658Z", 2024-04-26T23:47:49.583 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2024-04-26T23:39:34.291658Z", 2024-04-26T23:47:49.583 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 19, 2024-04-26T23:47:49.583 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "squid", 2024-04-26T23:47:49.583 INFO:teuthology.orchestra.run.smithi088.stdout: "election_strategy": 1, 2024-04-26T23:47:49.583 INFO:teuthology.orchestra.run.smithi088.stdout: "disallowed_leaders: ": "", 2024-04-26T23:47:49.583 INFO:teuthology.orchestra.run.smithi088.stdout: "stretch_mode": false, 2024-04-26T23:47:49.583 INFO:teuthology.orchestra.run.smithi088.stdout: "tiebreaker_mon": "", 2024-04-26T23:47:49.583 INFO:teuthology.orchestra.run.smithi088.stdout: "removed_ranks: ": "", 2024-04-26T23:47:49.583 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2024-04-26T23:47:49.584 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2024-04-26T23:47:49.584 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-04-26T23:47:49.584 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-04-26T23:47:49.584 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-04-26T23:47:49.584 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-04-26T23:47:49.584 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-04-26T23:47:49.584 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-04-26T23:47:49.584 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-04-26T23:47:49.584 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-04-26T23:47:49.584 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-04-26T23:47:49.584 INFO:teuthology.orchestra.run.smithi088.stdout: "reef", 2024-04-26T23:47:49.584 INFO:teuthology.orchestra.run.smithi088.stdout: "squid" 2024-04-26T23:47:49.584 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:47:49.585 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2024-04-26T23:47:49.585 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:47:49.585 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2024-04-26T23:47:49.585 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:47:49.585 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2024-04-26T23:47:49.585 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2024-04-26T23:47:49.585 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-04-26T23:47:49.585 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-04-26T23:47:49.585 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:47:49.585 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-04-26T23:47:49.585 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2024-04-26T23:47:49.585 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:47:49.585 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:47:49.585 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:47:49.586 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-04-26T23:47:49.586 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2024-04-26T23:47:49.586 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:47:49.586 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:47:49.586 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:47:49.586 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:47:49.586 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2024-04-26T23:47:49.586 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2024-04-26T23:47:49.586 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-04-26T23:47:49.586 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-04-26T23:47:49.586 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-04-26T23:47:49.586 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:47:49.586 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:47:49.587 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2024-04-26T23:47:49.587 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2024-04-26T23:47:49.587 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-04-26T23:47:49.587 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-04-26T23:47:49.587 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:47:49.587 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-04-26T23:47:49.587 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:3300", 2024-04-26T23:47:49.587 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:47:49.587 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:47:49.587 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:47:49.587 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-04-26T23:47:49.587 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6789", 2024-04-26T23:47:49.587 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:47:49.587 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:47:49.587 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:47:49.587 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:47:49.588 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6789/0", 2024-04-26T23:47:49.588 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.175:6789/0", 2024-04-26T23:47:49.588 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-04-26T23:47:49.588 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-04-26T23:47:49.588 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-04-26T23:47:49.588 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:47:49.588 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:47:49.588 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2024-04-26T23:47:49.588 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2024-04-26T23:47:49.588 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-04-26T23:47:49.588 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-04-26T23:47:49.588 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:47:49.588 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-04-26T23:47:49.588 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:3301", 2024-04-26T23:47:49.589 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:47:49.589 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:47:49.589 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:47:49.589 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-04-26T23:47:49.589 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6790", 2024-04-26T23:47:49.589 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:47:49.589 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:47:49.589 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:47:49.589 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:47:49.589 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6790/0", 2024-04-26T23:47:49.590 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.175:6790/0", 2024-04-26T23:47:49.590 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-04-26T23:47:49.590 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-04-26T23:47:49.590 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-04-26T23:47:49.590 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:47:49.590 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:47:49.590 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:47:49.590 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2024-04-26T23:47:49.590 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2024-04-26T23:47:49.590 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:47:49.590 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:47:49.590 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:47:49.590 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2024-04-26T23:47:49.591 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:47:49.591 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:47:49.591 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2024-04-26T23:47:49.591 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:47:49.591 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:47:49.591 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:47:49.591 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2024-04-26T23:47:49.591 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:47:49.591 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:47:49.591 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": [ 2024-04-26T23:47:49.591 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:47:49.591 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:47:49.591 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:47:49.591 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2024-04-26T23:47:49.592 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:47:49.592 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:47:49.592 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:47:49.592 INFO:teuthology.orchestra.run.smithi088.stdout: "stretch_mode": false 2024-04-26T23:47:49.592 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-04-26T23:47:49.593 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:49.575+0000 7f7d3ecbd640 1 -- 172.21.15.88:0/3121109617 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f7d2006ca10 msgr2=0x7f7d2006eed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:49.593 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:49.575+0000 7f7d3ecbd640 1 --2- 172.21.15.88:0/3121109617 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f7d2006ca10 0x7f7d2006eed0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f7d2c006fd0 tx=0x7f7d2c032000 comp rx=0 tx=0).stop 2024-04-26T23:47:49.593 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:49.575+0000 7f7d3ecbd640 1 -- 172.21.15.88:0/3121109617 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7d380c3ee0 msgr2=0x7f7d3809ca10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:49.593 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:49.575+0000 7f7d3ecbd640 1 --2- 172.21.15.88:0/3121109617 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7d380c3ee0 0x7f7d3809ca10 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f7d2800c780 tx=0x7f7d2800cc40 comp rx=0 tx=0).stop 2024-04-26T23:47:49.593 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:49.576+0000 7f7d3d25a640 1 -- 172.21.15.88:0/3121109617 reap_dead start 2024-04-26T23:47:49.593 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:49.576+0000 7f7d3d25a640 1 -- 172.21.15.88:0/3121109617 reap_dead start 2024-04-26T23:47:49.593 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:49.577+0000 7f7d3ecbd640 1 -- 172.21.15.88:0/3121109617 shutdown_connections 2024-04-26T23:47:49.593 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:49.577+0000 7f7d3ecbd640 1 -- 172.21.15.88:0/3121109617 >> 172.21.15.88:0/3121109617 conn(0x7f7d380c4d60 msgr2=0x7f7d380c5140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:47:49.593 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:49.579+0000 7f7d3ecbd640 1 -- 172.21.15.88:0/3121109617 shutdown_connections 2024-04-26T23:47:49.594 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:49.579+0000 7f7d3ecbd640 1 -- 172.21.15.88:0/3121109617 wait complete. 2024-04-26T23:47:49.609 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-04-26T23:47:49.609 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon c 2024-04-26T23:47:49.609 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-04-26T23:47:49.789 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:49.784+0000 7f9a22b08640 1 Processor -- start 2024-04-26T23:47:49.789 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:49.784+0000 7f9a22b08640 1 -- start start 2024-04-26T23:47:49.790 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:49.786+0000 7f9a22b08640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f9a1c06f4b0 0x7f9a1c06e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:49.790 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:49.786+0000 7f9a22b08640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9a1c06d390 con 0x7f9a1c06e410 2024-04-26T23:47:49.791 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:49.786+0000 7f9a22b08640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9a1c0c2bf0 con 0x7f9a1c0c40c0 2024-04-26T23:47:49.791 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:49.786+0000 7f9a22b08640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f9a1c0c3520 con 0x7f9a1c06f4b0 2024-04-26T23:47:49.791 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:49.786+0000 7f9a21305640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f9a1c06f4b0 0x7f9a1c06e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:49.791 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:49.786+0000 7f9a21b06640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f9a1c06e410 0x7f9a1c0c39b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:38126/0 (socket says 172.21.15.88:38126) 2024-04-26T23:47:49.791 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:49.786+0000 7f9a21b06640 1 -- 172.21.15.88:0/3899962775 learned_addr learned my addr 172.21.15.88:0/3899962775 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-26T23:47:49.793 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:49.786+0000 7f9a21305640 1 -- 172.21.15.88:0/3899962775 >> v1:172.21.15.175:6789/0 conn(0x7f9a1c0c40c0 legacy=0x7f9a1c15d330 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-26T23:47:49.793 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:49.787+0000 7f9a21305640 1 -- 172.21.15.88:0/3899962775 >> v1:172.21.15.88:6789/0 conn(0x7f9a1c06e410 legacy=0x7f9a1c0c39b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:49.793 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:49.787+0000 7f9a21305640 1 -- 172.21.15.88:0/3899962775 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a1c0c2ed0 con 0x7f9a1c06f4b0 2024-04-26T23:47:49.793 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:49.788+0000 7f9a21305640 1 --2- 172.21.15.88:0/3899962775 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9a1c06f4b0 0x7f9a1c06e7f0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f9a0c0071d0 tx=0x7f9a0c02afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9705de3a286c92de server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:47:49.793 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:49.789+0000 7f9a20b04640 1 -- 172.21.15.88:0/3899962775 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a0c008df0 con 0x7f9a1c06f4b0 2024-04-26T23:47:49.793 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:49.789+0000 7f9a20b04640 1 -- 172.21.15.88:0/3899962775 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a0c02b850 con 0x7f9a1c06f4b0 2024-04-26T23:47:49.793 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:49.789+0000 7f9a20b04640 1 -- 172.21.15.88:0/3899962775 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a0c02bc20 con 0x7f9a1c06f4b0 2024-04-26T23:47:49.794 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:49.790+0000 7f9a22b08640 1 -- 172.21.15.88:0/3899962775 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9a1c06f4b0 msgr2=0x7f9a1c06e7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:49.794 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:49.790+0000 7f9a22b08640 1 --2- 172.21.15.88:0/3899962775 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9a1c06f4b0 0x7f9a1c06e7f0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f9a0c0071d0 tx=0x7f9a0c02afd0 comp rx=0 tx=0).stop 2024-04-26T23:47:49.795 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:49.790+0000 7f9a22b08640 1 -- 172.21.15.88:0/3899962775 shutdown_connections 2024-04-26T23:47:49.795 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:49.790+0000 7f9a22b08640 1 --2- 172.21.15.88:0/3899962775 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9a1c06f4b0 0x7f9a1c06e7f0 secure :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f9a0c0071d0 tx=0x7f9a0c02afd0 comp rx=0 tx=0).stop 2024-04-26T23:47:49.795 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:49.790+0000 7f9a22b08640 1 -- 172.21.15.88:0/3899962775 >> 172.21.15.88:0/3899962775 conn(0x7f9a1c0c80c0 msgr2=0x7f9a1c0c84a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:47:49.802 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:49.795+0000 7f9a22b08640 1 -- 172.21.15.88:0/3899962775 shutdown_connections 2024-04-26T23:47:49.802 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:49.795+0000 7f9a22b08640 1 -- 172.21.15.88:0/3899962775 wait complete. 2024-04-26T23:47:49.802 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:49.797+0000 7f9a22b08640 1 Processor -- start 2024-04-26T23:47:49.802 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:49.797+0000 7f9a22b08640 1 -- start start 2024-04-26T23:47:49.805 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:49.798+0000 7f9a22b08640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9a1c06e410 0x7f9a1c1ded30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:49.805 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:49.798+0000 7f9a22b08640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9a1c0c40c0 0x7f9a1c143d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:49.805 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:49.798+0000 7f9a22b08640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9a1c1dfae0 0x7f9a1c072170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:49.805 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:49.798+0000 7f9a22b08640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f9a1c152a70 con 0x7f9a1c06e410 2024-04-26T23:47:49.805 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:49.798+0000 7f9a22b08640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f9a1c152e30 con 0x7f9a1c1dfae0 2024-04-26T23:47:49.805 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:49.798+0000 7f9a22b08640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f9a1c152bf0 con 0x7f9a1c0c40c0 2024-04-26T23:47:49.805 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:49.799+0000 7f9a21b06640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9a1c06e410 0x7f9a1c1ded30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:49.805 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:49.799+0000 7f9a21b06640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9a1c06e410 0x7f9a1c1ded30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:44762/0 (socket says 172.21.15.88:44762) 2024-04-26T23:47:49.805 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:49.799+0000 7f9a21b06640 1 -- 172.21.15.88:0/4001349637 learned_addr learned my addr 172.21.15.88:0/4001349637 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:47:49.805 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:49.799+0000 7f9a21b06640 1 -- 172.21.15.88:0/4001349637 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9a1c0c40c0 msgr2=0x7f9a1c143d30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T23:47:49.805 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:49.799+0000 7f9a21b06640 1 --2- 172.21.15.88:0/4001349637 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9a1c0c40c0 0x7f9a1c143d30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:49.806 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:49.799+0000 7f9a21b06640 1 -- 172.21.15.88:0/4001349637 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9a1c1dfae0 msgr2=0x7f9a1c072170 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-26T23:47:49.806 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:49.799+0000 7f9a21b06640 1 --2- 172.21.15.88:0/4001349637 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9a1c1dfae0 0x7f9a1c072170 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:49.806 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:49.799+0000 7f9a21b06640 1 -- 172.21.15.88:0/4001349637 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a1c144270 con 0x7f9a1c06e410 2024-04-26T23:47:49.806 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:49.800+0000 7f9a21b06640 1 --2- 172.21.15.88:0/4001349637 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9a1c06e410 0x7f9a1c1ded30 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f9a1800c8c0 tx=0x7f9a1800cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:47:49.806 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:49.800+0000 7f9a127fc640 1 -- 172.21.15.88:0/4001349637 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a18018070 con 0x7f9a1c06e410 2024-04-26T23:47:49.806 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:49.800+0000 7f9a22b08640 1 -- 172.21.15.88:0/4001349637 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a1c073290 con 0x7f9a1c06e410 2024-04-26T23:47:49.806 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:49.800+0000 7f9a127fc640 1 -- 172.21.15.88:0/4001349637 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a180072d0 con 0x7f9a1c06e410 2024-04-26T23:47:49.806 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:49.801+0000 7f9a127fc640 1 -- 172.21.15.88:0/4001349637 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a180047e0 con 0x7f9a1c06e410 2024-04-26T23:47:49.807 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:49.801+0000 7f9a22b08640 1 -- 172.21.15.88:0/4001349637 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a1c073850 con 0x7f9a1c06e410 2024-04-26T23:47:49.807 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:49.803+0000 7f9a127fc640 1 -- 172.21.15.88:0/4001349637 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f9a1801b070 con 0x7f9a1c06e410 2024-04-26T23:47:49.808 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:49.803+0000 7f9a127fc640 1 --2- 172.21.15.88:0/4001349637 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f9a00070d50 0x7f9a00073210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:49.808 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:49.804+0000 7f9a127fc640 1 -- 172.21.15.88:0/4001349637 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6666+0+0 (secure 0 0 0) 0x7f9a1808b2a0 con 0x7f9a1c06e410 2024-04-26T23:47:49.809 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:49.804+0000 7f9a07fff640 1 --2- 172.21.15.88:0/4001349637 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f99fc002a70 0x7f99fc004f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:49.809 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:49.804+0000 7f9a07fff640 1 -- 172.21.15.88:0/4001349637 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f99fc007ec0 con 0x7f99fc002a70 2024-04-26T23:47:49.809 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:49.804+0000 7f9a21305640 1 --2- 172.21.15.88:0/4001349637 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f9a00070d50 0x7f9a00073210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:49.809 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:49.805+0000 7f9a22307640 1 --2- 172.21.15.88:0/4001349637 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f99fc002a70 0x7f99fc004f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:49.809 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:49.805+0000 7f9a21305640 1 --2- 172.21.15.88:0/4001349637 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f9a00070d50 0x7f9a00073210 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f9a0c034000 tx=0x7f9a0c02f000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:47:49.811 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:49.807+0000 7f9a22307640 1 -- 172.21.15.88:0/4001349637 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f99fc0080c0 con 0x7f99fc002a70 2024-04-26T23:47:49.812 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:49.808+0000 7f9a22307640 1 --2- 172.21.15.88:0/4001349637 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f99fc002a70 0x7f99fc004f30 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f9a1400bd50 tx=0x7f9a14009e70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:47:49.813 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:49.808+0000 7f9a127fc640 1 -- 172.21.15.88:0/4001349637 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a14019070 con 0x7f99fc002a70 2024-04-26T23:47:49.813 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:49.809+0000 7f9a127fc640 1 -- 172.21.15.88:0/4001349637 <== mon.2 v2:172.21.15.175:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f9a14014440 con 0x7f99fc002a70 2024-04-26T23:47:49.813 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:49.809+0000 7f9a127fc640 1 -- 172.21.15.88:0/4001349637 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f99fc002a70 msgr2=0x7f99fc004f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:49.813 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:49.809+0000 7f9a127fc640 1 --2- 172.21.15.88:0/4001349637 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f99fc002a70 0x7f99fc004f30 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f9a1400bd50 tx=0x7f9a14009e70 comp rx=0 tx=0).stop 2024-04-26T23:47:49.813 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:49.809+0000 7f9a127fc640 1 -- 172.21.15.88:0/4001349637 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f99fc002a70 msgr2=0x7f99fc004f30 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:47:49.813 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:49.809+0000 7f9a127fc640 1 --2- 172.21.15.88:0/4001349637 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f99fc002a70 0x7f99fc004f30 secure :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f9a1400bd50 tx=0x7f9a14009e70 comp rx=0 tx=0).stop 2024-04-26T23:47:49.838 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:49.833+0000 7f9a07fff640 1 --2- 172.21.15.88:0/4001349637 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f99fc006f00 0x7f99fc007390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:49.838 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:49.833+0000 7f9a07fff640 1 -- 172.21.15.88:0/4001349637 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f99fc00a4a0 con 0x7f99fc006f00 2024-04-26T23:47:49.839 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:49.835+0000 7f9a22307640 1 --2- 172.21.15.88:0/4001349637 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f99fc006f00 0x7f99fc007390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:49.840 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:49.835+0000 7f9a22307640 1 -- 172.21.15.88:0/4001349637 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f99fc0078d0 con 0x7f99fc006f00 2024-04-26T23:47:49.843 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:49.838+0000 7f9a22307640 1 --2- 172.21.15.88:0/4001349637 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f99fc006f00 0x7f99fc007390 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f9a14009fd0 tx=0x7f9a140049c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:47:49.845 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:49.840+0000 7f9a127fc640 1 -- 172.21.15.88:0/4001349637 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a14019050 con 0x7f99fc006f00 2024-04-26T23:47:49.845 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:49.841+0000 7f9a127fc640 1 -- 172.21.15.88:0/4001349637 <== mon.2 v2:172.21.15.175:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5197 (secure 0 0 0) 0x7f9a1401a040 con 0x7f99fc006f00 2024-04-26T23:47:49.845 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:49.841+0000 7f9a127fc640 1 -- 172.21.15.88:0/4001349637 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f99fc006f00 msgr2=0x7f99fc007390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:49.845 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:49.841+0000 7f9a127fc640 1 --2- 172.21.15.88:0/4001349637 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f99fc006f00 0x7f99fc007390 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f9a14009fd0 tx=0x7f9a140049c0 comp rx=0 tx=0).stop 2024-04-26T23:47:49.845 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:49.841+0000 7f9a127fc640 1 -- 172.21.15.88:0/4001349637 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f99fc006f00 msgr2=0x7f99fc007390 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:47:49.845 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:49.841+0000 7f9a127fc640 1 --2- 172.21.15.88:0/4001349637 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f99fc006f00 0x7f99fc007390 secure :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f9a14009fd0 tx=0x7f9a140049c0 comp rx=0 tx=0).stop 2024-04-26T23:47:49.847 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-04-26T23:47:49.847 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2024-04-26T23:47:49.847 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2024-04-26T23:47:49.847 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "peon", 2024-04-26T23:47:49.847 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 74, 2024-04-26T23:47:49.847 INFO:teuthology.orchestra.run.smithi088.stdout: "uptime": 238126, 2024-04-26T23:47:49.847 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2024-04-26T23:47:49.847 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2024-04-26T23:47:49.848 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2024-04-26T23:47:49.848 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:47:49.848 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 1, 2024-04-26T23:47:49.848 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2024-04-26T23:47:49.848 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2450521708007866372", 2024-04-26T23:47:49.848 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2024-04-26T23:47:49.848 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-04-26T23:47:49.848 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-04-26T23:47:49.848 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-04-26T23:47:49.848 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-04-26T23:47:49.848 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-04-26T23:47:49.848 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-04-26T23:47:49.848 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-04-26T23:47:49.848 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-04-26T23:47:49.848 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-04-26T23:47:49.849 INFO:teuthology.orchestra.run.smithi088.stdout: "reef", 2024-04-26T23:47:49.849 INFO:teuthology.orchestra.run.smithi088.stdout: "squid" 2024-04-26T23:47:49.849 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:47:49.849 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540701547738038271", 2024-04-26T23:47:49.849 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2024-04-26T23:47:49.849 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-04-26T23:47:49.849 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-04-26T23:47:49.849 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-04-26T23:47:49.849 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-04-26T23:47:49.849 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-04-26T23:47:49.849 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-04-26T23:47:49.849 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-04-26T23:47:49.849 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-04-26T23:47:49.849 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-04-26T23:47:49.850 INFO:teuthology.orchestra.run.smithi088.stdout: "reef", 2024-04-26T23:47:49.850 INFO:teuthology.orchestra.run.smithi088.stdout: "squid" 2024-04-26T23:47:49.850 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:47:49.850 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:47:49.850 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2024-04-26T23:47:49.850 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2024-04-26T23:47:49.850 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2024-04-26T23:47:49.850 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2024-04-26T23:47:49.850 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2024-04-26T23:47:49.850 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "555255e9-7ef9-4454-8dc9-35e96b70035c", 2024-04-26T23:47:49.850 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2024-04-26T23:39:34.291658Z", 2024-04-26T23:47:49.850 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2024-04-26T23:39:34.291658Z", 2024-04-26T23:47:49.850 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 19, 2024-04-26T23:47:49.851 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "squid", 2024-04-26T23:47:49.851 INFO:teuthology.orchestra.run.smithi088.stdout: "election_strategy": 1, 2024-04-26T23:47:49.851 INFO:teuthology.orchestra.run.smithi088.stdout: "disallowed_leaders: ": "", 2024-04-26T23:47:49.851 INFO:teuthology.orchestra.run.smithi088.stdout: "stretch_mode": false, 2024-04-26T23:47:49.851 INFO:teuthology.orchestra.run.smithi088.stdout: "tiebreaker_mon": "", 2024-04-26T23:47:49.851 INFO:teuthology.orchestra.run.smithi088.stdout: "removed_ranks: ": "", 2024-04-26T23:47:49.851 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2024-04-26T23:47:49.851 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2024-04-26T23:47:49.851 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-04-26T23:47:49.851 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-04-26T23:47:49.851 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-04-26T23:47:49.851 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-04-26T23:47:49.851 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-04-26T23:47:49.851 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-04-26T23:47:49.851 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-04-26T23:47:49.852 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-04-26T23:47:49.852 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-04-26T23:47:49.852 INFO:teuthology.orchestra.run.smithi088.stdout: "reef", 2024-04-26T23:47:49.852 INFO:teuthology.orchestra.run.smithi088.stdout: "squid" 2024-04-26T23:47:49.852 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:47:49.852 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2024-04-26T23:47:49.852 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:47:49.852 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2024-04-26T23:47:49.852 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:47:49.852 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2024-04-26T23:47:49.852 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2024-04-26T23:47:49.852 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-04-26T23:47:49.852 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-04-26T23:47:49.852 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:47:49.852 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-04-26T23:47:49.853 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2024-04-26T23:47:49.853 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:47:49.853 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:47:49.853 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:47:49.853 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-04-26T23:47:49.853 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2024-04-26T23:47:49.853 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:47:49.853 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:47:49.853 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:47:49.853 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:47:49.853 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2024-04-26T23:47:49.853 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2024-04-26T23:47:49.853 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-04-26T23:47:49.853 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-04-26T23:47:49.853 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-04-26T23:47:49.854 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:47:49.854 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:47:49.854 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2024-04-26T23:47:49.854 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2024-04-26T23:47:49.854 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-04-26T23:47:49.854 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-04-26T23:47:49.854 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:47:49.854 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-04-26T23:47:49.854 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:3300", 2024-04-26T23:47:49.854 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:47:49.854 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:47:49.854 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:47:49.854 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-04-26T23:47:49.855 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6789", 2024-04-26T23:47:49.855 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:47:49.855 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:47:49.855 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:47:49.855 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:47:49.855 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6789/0", 2024-04-26T23:47:49.855 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.175:6789/0", 2024-04-26T23:47:49.855 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-04-26T23:47:49.855 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-04-26T23:47:49.855 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-04-26T23:47:49.855 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:47:49.855 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:47:49.855 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2024-04-26T23:47:49.855 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2024-04-26T23:47:49.855 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-04-26T23:47:49.856 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-04-26T23:47:49.856 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:47:49.856 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-04-26T23:47:49.856 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:3301", 2024-04-26T23:47:49.856 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:47:49.856 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:47:49.856 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:47:49.856 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-04-26T23:47:49.856 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6790", 2024-04-26T23:47:49.856 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:47:49.856 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:47:49.856 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:47:49.856 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:47:49.856 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6790/0", 2024-04-26T23:47:49.856 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.175:6790/0", 2024-04-26T23:47:49.857 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-04-26T23:47:49.857 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-04-26T23:47:49.857 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-04-26T23:47:49.857 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:47:49.857 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:47:49.857 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:47:49.857 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2024-04-26T23:47:49.857 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2024-04-26T23:47:49.857 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:47:49.857 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:47:49.857 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:47:49.857 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2024-04-26T23:47:49.857 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:47:49.858 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:47:49.858 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": [ 2024-04-26T23:47:49.858 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:47:49.858 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:47:49.858 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:47:49.858 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 4 2024-04-26T23:47:49.858 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:47:49.858 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:47:49.858 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": [ 2024-04-26T23:47:49.858 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:47:49.858 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:47:49.858 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:47:49.858 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 8 2024-04-26T23:47:49.858 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:47:49.859 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:47:49.859 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2024-04-26T23:47:49.859 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:47:49.859 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x2f018fb87aa4aafe", 2024-04-26T23:47:49.859 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:47:49.859 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2024-04-26T23:47:49.859 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:47:49.859 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:47:49.859 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:47:49.859 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:47:49.859 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 5 2024-04-26T23:47:49.859 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:47:49.859 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:47:49.859 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": [ 2024-04-26T23:47:49.859 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:47:49.860 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:47:49.860 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:47:49.860 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2024-04-26T23:47:49.860 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:47:49.860 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:47:49.860 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:47:49.860 INFO:teuthology.orchestra.run.smithi088.stdout: "stretch_mode": false 2024-04-26T23:47:49.860 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-04-26T23:47:49.861 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:49.843+0000 7f9a07fff640 1 -- 172.21.15.88:0/4001349637 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f9a00070d50 msgr2=0x7f9a00073210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:49.861 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:49.843+0000 7f9a07fff640 1 --2- 172.21.15.88:0/4001349637 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f9a00070d50 0x7f9a00073210 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f9a0c034000 tx=0x7f9a0c02f000 comp rx=0 tx=0).stop 2024-04-26T23:47:49.861 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:49.843+0000 7f9a07fff640 1 -- 172.21.15.88:0/4001349637 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9a1c06e410 msgr2=0x7f9a1c1ded30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:49.861 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:49.843+0000 7f9a07fff640 1 --2- 172.21.15.88:0/4001349637 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9a1c06e410 0x7f9a1c1ded30 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f9a1800c8c0 tx=0x7f9a1800cd80 comp rx=0 tx=0).stop 2024-04-26T23:47:49.861 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:49.843+0000 7f9a22307640 1 -- 172.21.15.88:0/4001349637 reap_dead start 2024-04-26T23:47:49.861 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:49.843+0000 7f9a07fff640 1 -- 172.21.15.88:0/4001349637 shutdown_connections 2024-04-26T23:47:49.861 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:49.843+0000 7f9a07fff640 1 -- 172.21.15.88:0/4001349637 >> 172.21.15.88:0/4001349637 conn(0x7f9a1c0c80c0 msgr2=0x7f9a1c153740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:47:49.861 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:49.846+0000 7f9a07fff640 1 -- 172.21.15.88:0/4001349637 shutdown_connections 2024-04-26T23:47:49.861 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:47:49.847+0000 7f9a07fff640 1 -- 172.21.15.88:0/4001349637 wait complete. 2024-04-26T23:47:49.877 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-04-26T23:47:49.877 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2024-04-26T23:48:05.332 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:48:05.337 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:48:09.877 INFO:tasks.mon_thrash.mon_thrasher:killing mon.b 2024-04-26T23:48:09.878 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.b 2024-04-26T23:48:09.878 INFO:tasks.ceph.mon.b:Restarting daemon 2024-04-26T23:48:09.878 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-04-26T23:48:09.882 INFO:tasks.ceph.mon.b:Started 2024-04-26T23:48:09.882 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-04-26T23:48:09.883 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-04-26T23:48:10.063 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:10.057+0000 7fd80da21640 1 Processor -- start 2024-04-26T23:48:10.063 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:10.058+0000 7fd80da21640 1 -- start start 2024-04-26T23:48:10.065 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:10.059+0000 7fd80da21640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fd8000474a0 0x7fd800006ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:10.065 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:10.059+0000 7fd80da21640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fd8000073e0 0x7fd80000a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:10.065 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:10.059+0000 7fd80da21640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd80000bb50 con 0x7fd8000dbce0 2024-04-26T23:48:10.065 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:10.059+0000 7fd80da21640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7fd80000a420 con 0x7fd8000474a0 2024-04-26T23:48:10.065 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:10.059+0000 7fd80da21640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7fd800048060 con 0x7fd8000073e0 2024-04-26T23:48:10.065 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:10.059+0000 7fd80d220640 1 -- >> v2:172.21.15.175:3300/0 conn(0x7fd8000073e0 msgr2=0x7fd80000a8b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.175:3300/0 2024-04-26T23:48:10.065 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:10.059+0000 7fd80d220640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fd8000073e0 0x7fd80000a8b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:48:10.065 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:10.059+0000 7fd807fff640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fd8000474a0 0x7fd800006ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:10.066 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:10.059+0000 7fd807fff640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fd8000474a0 0x7fd800006ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:48842/0 (socket says 172.21.15.88:48842) 2024-04-26T23:48:10.066 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:10.059+0000 7fd807fff640 1 -- 172.21.15.88:0/2124416198 learned_addr learned my addr 172.21.15.88:0/2124416198 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:48:10.066 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:10.060+0000 7fd807fff640 1 -- 172.21.15.88:0/2124416198 >> v2:172.21.15.175:3300/0 conn(0x7fd8000073e0 msgr2=0x7fd80000a8b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T23:48:10.066 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:10.060+0000 7fd807fff640 1 --2- 172.21.15.88:0/2124416198 >> v2:172.21.15.175:3300/0 conn(0x7fd8000073e0 0x7fd80000a8b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:10.066 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:10.060+0000 7fd807fff640 1 -- 172.21.15.88:0/2124416198 >> v1:172.21.15.88:6789/0 conn(0x7fd8000dbce0 legacy=0x7fd8000df180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:10.066 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:10.060+0000 7fd807fff640 1 -- 172.21.15.88:0/2124416198 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd80000a0f0 con 0x7fd8000474a0 2024-04-26T23:48:10.067 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:10.061+0000 7fd807fff640 1 --2- 172.21.15.88:0/2124416198 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd8000474a0 0x7fd800006ea0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fd800035f20 tx=0x7fd7f402a490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c481c3f534cc5de0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:48:10.068 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:10.061+0000 7fd8077fe640 1 -- 172.21.15.88:0/2124416198 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7f4036070 con 0x7fd8000474a0 2024-04-26T23:48:10.068 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:10.061+0000 7fd8077fe640 1 -- 172.21.15.88:0/2124416198 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7f4031600 con 0x7fd8000474a0 2024-04-26T23:48:10.068 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:10.061+0000 7fd8077fe640 1 -- 172.21.15.88:0/2124416198 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7f40319b0 con 0x7fd8000474a0 2024-04-26T23:48:10.068 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:10.063+0000 7fd80da21640 1 -- 172.21.15.88:0/2124416198 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd8000474a0 msgr2=0x7fd800006ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:10.068 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:10.063+0000 7fd80da21640 1 --2- 172.21.15.88:0/2124416198 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd8000474a0 0x7fd800006ea0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fd800035f20 tx=0x7fd7f402a490 comp rx=0 tx=0).stop 2024-04-26T23:48:10.068 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:10.063+0000 7fd80da21640 1 -- 172.21.15.88:0/2124416198 shutdown_connections 2024-04-26T23:48:10.068 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:10.063+0000 7fd80da21640 1 --2- 172.21.15.88:0/2124416198 >> v2:172.21.15.175:3300/0 conn(0x7fd8000073e0 0x7fd80000a8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:10.068 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:10.063+0000 7fd80da21640 1 --2- 172.21.15.88:0/2124416198 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd8000474a0 0x7fd800006ea0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:10.068 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:10.063+0000 7fd80da21640 1 -- 172.21.15.88:0/2124416198 >> 172.21.15.88:0/2124416198 conn(0x7fd800048250 msgr2=0x7fd800048660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:48:10.069 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:10.063+0000 7fd80da21640 1 -- 172.21.15.88:0/2124416198 shutdown_connections 2024-04-26T23:48:10.069 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:10.063+0000 7fd80da21640 1 -- 172.21.15.88:0/2124416198 wait complete. 2024-04-26T23:48:10.069 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:10.065+0000 7fd80da21640 1 Processor -- start 2024-04-26T23:48:10.071 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:10.065+0000 7fd80da21640 1 -- start start 2024-04-26T23:48:10.072 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:10.066+0000 7fd80da21640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd8000073e0 0x7fd8000d9e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:10.072 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:10.066+0000 7fd80da21640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd8000474a0 0x7fd80002e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:10.072 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:10.066+0000 7fd80da21640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd8000dbce0 0x7fd8000d6a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:10.072 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:10.066+0000 7fd80da21640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fd8000dc0c0 con 0x7fd8000073e0 2024-04-26T23:48:10.072 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:10.066+0000 7fd80da21640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fd800047d80 con 0x7fd8000474a0 2024-04-26T23:48:10.072 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:10.066+0000 7fd80da21640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fd8000dfbf0 con 0x7fd8000dbce0 2024-04-26T23:48:10.072 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:10.067+0000 7fd807fff640 1 -- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd8000474a0 msgr2=0x7fd80002e3f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.175:3300/0 2024-04-26T23:48:10.072 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:10.067+0000 7fd807fff640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd8000474a0 0x7fd80002e3f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:48:10.072 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:10.067+0000 7fd80d220640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd8000dbce0 0x7fd8000d6a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:10.072 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:10.067+0000 7fd80d220640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd8000dbce0 0x7fd8000d6a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.88:39396/0 (socket says 172.21.15.88:39396) 2024-04-26T23:48:10.072 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:10.067+0000 7fd80d220640 1 -- 172.21.15.88:0/547451267 learned_addr learned my addr 172.21.15.88:0/547451267 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:48:10.072 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:10.067+0000 7fd80ca1f640 1 --2- 172.21.15.88:0/547451267 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd8000073e0 0x7fd8000d9e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:10.073 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:10.068+0000 7fd80ca1f640 1 -- 172.21.15.88:0/547451267 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd8000dbce0 msgr2=0x7fd8000d6a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:10.073 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:10.068+0000 7fd80ca1f640 1 --2- 172.21.15.88:0/547451267 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd8000dbce0 0x7fd8000d6a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:10.073 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:10.068+0000 7fd80ca1f640 1 -- 172.21.15.88:0/547451267 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd8000474a0 msgr2=0x7fd80002e3f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T23:48:10.073 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:10.068+0000 7fd80ca1f640 1 --2- 172.21.15.88:0/547451267 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd8000474a0 0x7fd80002e3f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:10.074 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:10.068+0000 7fd80ca1f640 1 -- 172.21.15.88:0/547451267 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd800177d60 con 0x7fd8000073e0 2024-04-26T23:48:10.074 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:10.068+0000 7fd80ca1f640 1 --2- 172.21.15.88:0/547451267 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd8000073e0 0x7fd8000d9e30 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fd7fc00c780 tx=0x7fd7fc00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:48:10.074 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:10.069+0000 7fd8057fa640 1 -- 172.21.15.88:0/547451267 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7fc016020 con 0x7fd8000073e0 2024-04-26T23:48:10.074 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:10.070+0000 7fd80da21640 1 -- 172.21.15.88:0/547451267 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd800178040 con 0x7fd8000073e0 2024-04-26T23:48:10.074 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:10.070+0000 7fd80da21640 1 -- 172.21.15.88:0/547451267 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd800178600 con 0x7fd8000073e0 2024-04-26T23:48:10.076 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:10.071+0000 7fd8057fa640 1 -- 172.21.15.88:0/547451267 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7fc005020 con 0x7fd8000073e0 2024-04-26T23:48:10.076 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:10.071+0000 7fd8057fa640 1 -- 172.21.15.88:0/547451267 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7fc0053f0 con 0x7fd8000073e0 2024-04-26T23:48:10.076 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:10.072+0000 7fd8057fa640 1 -- 172.21.15.88:0/547451267 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd7fc007030 con 0x7fd8000073e0 2024-04-26T23:48:10.077 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:10.072+0000 7fd80da21640 1 -- 172.21.15.88:0/547451267 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd7e8005290 con 0x7fd8000073e0 2024-04-26T23:48:10.077 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:10.073+0000 7fd8057fa640 1 --2- 172.21.15.88:0/547451267 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fd7ec06c940 0x7fd7ec06ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:10.077 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:10.073+0000 7fd8057fa640 1 -- 172.21.15.88:0/547451267 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6666+0+0 (secure 0 0 0) 0x7fd7fc08b7a0 con 0x7fd8000073e0 2024-04-26T23:48:10.078 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:10.074+0000 7fd807fff640 1 --2- 172.21.15.88:0/547451267 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fd7ec06c940 0x7fd7ec06ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:10.080 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:10.076+0000 7fd807fff640 1 --2- 172.21.15.88:0/547451267 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fd7ec06c940 0x7fd7ec06ee00 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fd7f4033000 tx=0x7fd7f4008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:48:10.086 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:10.081+0000 7fd8057fa640 1 -- 172.21.15.88:0/547451267 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fd7fc020020 con 0x7fd8000073e0 2024-04-26T23:48:10.593 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:10.589+0000 7fd80da21640 1 -- 172.21.15.88:0/547451267 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fd7e8005580 con 0x7fd8000073e0 2024-04-26T23:48:10.594 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:10.590+0000 7fd8057fa640 1 -- 172.21.15.88:0/547451267 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1559 (secure 0 0 0) 0x7fd7fc019310 con 0x7fd8000073e0 2024-04-26T23:48:10.598 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":74,"quorum":[0,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":21,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"555255e9-7ef9-4454-8dc9-35e96b70035c","modified":"2024-04-26T23:39:34.291658Z","created":"2024-04-26T23:39:34.291658Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:3300","nonce":0},{"type":"v1","addr":"172.21.15.175:6789","nonce":0}]},"addr":"172.21.15.175:6789/0","public_addr":"172.21.15.175:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:3301","nonce":0},{"type":"v1","addr":"172.21.15.175:6790","nonce":0}]},"addr":"172.21.15.175:6790/0","public_addr":"172.21.15.175:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-04-26T23:48:10.599 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:10.594+0000 7fd80da21640 1 -- 172.21.15.88:0/547451267 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fd7ec06c940 msgr2=0x7fd7ec06ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:10.599 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:10.594+0000 7fd80da21640 1 --2- 172.21.15.88:0/547451267 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fd7ec06c940 0x7fd7ec06ee00 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fd7f4033000 tx=0x7fd7f4008030 comp rx=0 tx=0).stop 2024-04-26T23:48:10.599 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:10.594+0000 7fd80da21640 1 -- 172.21.15.88:0/547451267 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd8000073e0 msgr2=0x7fd8000d9e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:10.599 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:10.594+0000 7fd80da21640 1 --2- 172.21.15.88:0/547451267 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd8000073e0 0x7fd8000d9e30 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fd7fc00c780 tx=0x7fd7fc00cc40 comp rx=0 tx=0).stop 2024-04-26T23:48:10.599 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:10.595+0000 7fd80da21640 1 -- 172.21.15.88:0/547451267 shutdown_connections 2024-04-26T23:48:10.599 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:10.595+0000 7fd80da21640 1 --2- 172.21.15.88:0/547451267 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fd7ec06c940 0x7fd7ec06ee00 secure :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fd7f4033000 tx=0x7fd7f4008030 comp rx=0 tx=0).stop 2024-04-26T23:48:10.599 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:10.595+0000 7fd80da21640 1 --2- 172.21.15.88:0/547451267 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd8000dbce0 0x7fd8000d6a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:10.600 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:10.595+0000 7fd80da21640 1 --2- 172.21.15.88:0/547451267 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd8000474a0 0x7fd80002e3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:10.600 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:10.595+0000 7fd80da21640 1 --2- 172.21.15.88:0/547451267 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd8000073e0 0x7fd8000d9e30 secure :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fd7fc00c780 tx=0x7fd7fc00cc40 comp rx=0 tx=0).stop 2024-04-26T23:48:10.600 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:10.595+0000 7fd80da21640 1 -- 172.21.15.88:0/547451267 >> 172.21.15.88:0/547451267 conn(0x7fd800048250 msgr2=0x7fd8000055a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:48:10.600 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:10.596+0000 7fd80da21640 1 -- 172.21.15.88:0/547451267 shutdown_connections 2024-04-26T23:48:10.600 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:10.596+0000 7fd80da21640 1 -- 172.21.15.88:0/547451267 wait complete. 2024-04-26T23:48:13.622 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-04-26T23:48:13.817 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:13.812+0000 7f169e2ea640 1 Processor -- start 2024-04-26T23:48:13.818 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:13.814+0000 7f169e2ea640 1 -- start start 2024-04-26T23:48:13.820 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:13.815+0000 7f169e2ea640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f169814e890 0x7f16980ad430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:13.820 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:13.816+0000 7f169e2ea640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f1698157d20 0x7f16981581a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:13.820 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:13.816+0000 7f169e2ea640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1698074590 con 0x7f16980c5fa0 2024-04-26T23:48:13.820 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:13.816+0000 7f169e2ea640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f169814ec70 con 0x7f169814e890 2024-04-26T23:48:13.820 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:13.816+0000 7f169e2ea640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f16980ab470 con 0x7f1698157d20 2024-04-26T23:48:13.823 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:13.817+0000 7f16977fe640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f1698157d20 0x7f16981581a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:13.823 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:13.817+0000 7f16977fe640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f1698157d20 0x7f16981581a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.88:54672/0 (socket says 172.21.15.88:54672) 2024-04-26T23:48:13.824 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:13.817+0000 7f16977fe640 1 -- 172.21.15.88:0/153193439 learned_addr learned my addr 172.21.15.88:0/153193439 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:48:13.824 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:13.817+0000 7f1697fff640 1 --2- 172.21.15.88:0/153193439 >> v2:172.21.15.88:3300/0 conn(0x7f169814e890 0x7f16980ad430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:13.824 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:13.817+0000 7f16977fe640 1 -- 172.21.15.88:0/153193439 >> v2:172.21.15.175:3300/0 conn(0x7f1698157d20 msgr2=0x7f16981581a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-26T23:48:13.824 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:13.817+0000 7f16977fe640 1 -- 172.21.15.88:0/153193439 >> v2:172.21.15.175:3300/0 conn(0x7f1698157d20 msgr2=0x7f16981581a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T23:48:13.824 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:13.817+0000 7f16977fe640 1 --2- 172.21.15.88:0/153193439 >> v2:172.21.15.175:3300/0 conn(0x7f1698157d20 0x7f16981581a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:48:13.824 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:13.817+0000 7f16977fe640 1 --2- 172.21.15.88:0/153193439 >> v2:172.21.15.175:3300/0 conn(0x7f1698157d20 0x7f16981581a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:48:13.824 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:13.817+0000 7f1697fff640 1 -- 172.21.15.88:0/153193439 >> v2:172.21.15.175:3300/0 conn(0x7f1698157d20 msgr2=0x7f16981581a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T23:48:13.824 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:13.817+0000 7f1697fff640 1 --2- 172.21.15.88:0/153193439 >> v2:172.21.15.175:3300/0 conn(0x7f1698157d20 0x7f16981581a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:13.824 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:13.817+0000 7f1697fff640 1 -- 172.21.15.88:0/153193439 >> v1:172.21.15.175:6789/0 conn(0x7f16980c5fa0 legacy=0x7f16980c63f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:48:13.824 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:13.817+0000 7f1697fff640 1 -- 172.21.15.88:0/153193439 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f169806e320 con 0x7f169814e890 2024-04-26T23:48:13.824 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:13.819+0000 7f1697fff640 1 --2- 172.21.15.88:0/153193439 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f169814e890 0x7f16980ad430 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f16980c5dc0 tx=0x7f169002a640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=586620b85045401b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:48:13.835 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:13.829+0000 7f1696ffd640 1 -- 172.21.15.88:0/153193439 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1690007740 con 0x7f169814e890 2024-04-26T23:48:13.836 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:13.829+0000 7f1696ffd640 1 -- 172.21.15.88:0/153193439 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16900078e0 con 0x7f169814e890 2024-04-26T23:48:13.836 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:13.829+0000 7f1696ffd640 1 -- 172.21.15.88:0/153193439 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1690007cf0 con 0x7f169814e890 2024-04-26T23:48:13.839 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:13.831+0000 7f169e2ea640 1 -- 172.21.15.88:0/153193439 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f169814e890 msgr2=0x7f16980ad430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:13.839 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:13.831+0000 7f169e2ea640 1 --2- 172.21.15.88:0/153193439 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f169814e890 0x7f16980ad430 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f16980c5dc0 tx=0x7f169002a640 comp rx=0 tx=0).stop 2024-04-26T23:48:13.843 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:13.839+0000 7f169e2ea640 1 -- 172.21.15.88:0/153193439 shutdown_connections 2024-04-26T23:48:13.843 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:13.839+0000 7f169e2ea640 1 --2- 172.21.15.88:0/153193439 >> v2:172.21.15.175:3300/0 conn(0x7f1698157d20 0x7f16981581a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:13.843 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:13.839+0000 7f169e2ea640 1 --2- 172.21.15.88:0/153193439 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f169814e890 0x7f16980ad430 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:13.843 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:13.839+0000 7f169e2ea640 1 -- 172.21.15.88:0/153193439 >> 172.21.15.88:0/153193439 conn(0x7f16980c6cf0 msgr2=0x7f16980c7100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:48:13.849 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:13.844+0000 7f169e2ea640 1 -- 172.21.15.88:0/153193439 shutdown_connections 2024-04-26T23:48:13.854 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:13.848+0000 7f169e2ea640 1 -- 172.21.15.88:0/153193439 wait complete. 2024-04-26T23:48:13.854 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:13.850+0000 7f169e2ea640 1 Processor -- start 2024-04-26T23:48:13.855 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:13.850+0000 7f169e2ea640 1 -- start start 2024-04-26T23:48:13.858 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:13.851+0000 7f169e2ea640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f16980c5fa0 0x7f169814ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:13.858 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:13.851+0000 7f169e2ea640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f169814e890 0x7f1698145150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:13.858 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:13.851+0000 7f169e2ea640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1698157d20 0x7f16981f0db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:13.858 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:13.851+0000 7f169e2ea640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f1698071fa0 con 0x7f169814e890 2024-04-26T23:48:13.858 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:13.851+0000 7f169e2ea640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f16980af660 con 0x7f16980c5fa0 2024-04-26T23:48:13.858 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:13.851+0000 7f169e2ea640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f16980c6b00 con 0x7f1698157d20 2024-04-26T23:48:13.858 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:13.852+0000 7f169c887640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1698157d20 0x7f16981f0db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:13.858 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:13.852+0000 7f169c887640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1698157d20 0x7f16981f0db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.88:39404/0 (socket says 172.21.15.88:39404) 2024-04-26T23:48:13.858 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:13.852+0000 7f169c887640 1 -- 172.21.15.88:0/644520480 learned_addr learned my addr 172.21.15.88:0/644520480 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:48:13.858 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:13.852+0000 7f169c887640 1 -- 172.21.15.88:0/644520480 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f16980c5fa0 msgr2=0x7f169814ee80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T23:48:13.858 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:13.852+0000 7f169c887640 1 --2- 172.21.15.88:0/644520480 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f16980c5fa0 0x7f169814ee80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:13.859 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:13.852+0000 7f169c887640 1 -- 172.21.15.88:0/644520480 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f169814e890 msgr2=0x7f1698145150 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T23:48:13.859 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:13.852+0000 7f169c887640 1 --2- 172.21.15.88:0/644520480 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f169814e890 0x7f1698145150 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:13.859 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:13.852+0000 7f169c887640 1 -- 172.21.15.88:0/644520480 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1698070ba0 con 0x7f1698157d20 2024-04-26T23:48:13.859 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:13.852+0000 7f169c887640 1 --2- 172.21.15.88:0/644520480 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1698157d20 0x7f16981f0db0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f168c00c3c0 tx=0x7f168c00c880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:48:13.859 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:13.853+0000 7f1694ff9640 1 -- 172.21.15.88:0/644520480 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f168c017070 con 0x7f1698157d20 2024-04-26T23:48:13.859 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:13.853+0000 7f169e2ea640 1 -- 172.21.15.88:0/644520480 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1698070e80 con 0x7f1698157d20 2024-04-26T23:48:13.859 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:13.853+0000 7f169e2ea640 1 -- 172.21.15.88:0/644520480 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f1698145690 con 0x7f1698157d20 2024-04-26T23:48:13.859 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:13.853+0000 7f1694ff9640 1 -- 172.21.15.88:0/644520480 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f168c0035f0 con 0x7f1698157d20 2024-04-26T23:48:13.859 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:13.853+0000 7f1694ff9640 1 -- 172.21.15.88:0/644520480 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f168c0039e0 con 0x7f1698157d20 2024-04-26T23:48:13.862 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:13.855+0000 7f1694ff9640 1 -- 172.21.15.88:0/644520480 <== mon.2 v2:172.21.15.175:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f168c01a070 con 0x7f1698157d20 2024-04-26T23:48:13.862 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:13.856+0000 7f1694ff9640 1 --2- 172.21.15.88:0/644520480 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f167c06c8f0 0x7f167c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:13.862 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:13.856+0000 7f1694ff9640 1 -- 172.21.15.88:0/644520480 <== mon.2 v2:172.21.15.175:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6666+0+0 (secure 0 0 0) 0x7f168c08b2d0 con 0x7f1698157d20 2024-04-26T23:48:13.862 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:13.857+0000 7f169e2ea640 1 -- 172.21.15.88:0/644520480 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1678005290 con 0x7f1698157d20 2024-04-26T23:48:13.866 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:13.858+0000 7f1697fff640 1 --2- 172.21.15.88:0/644520480 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f167c06c8f0 0x7f167c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:13.866 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:13.859+0000 7f1697fff640 1 --2- 172.21.15.88:0/644520480 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f167c06c8f0 0x7f167c06edb0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f1690034000 tx=0x7f169002f000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:48:13.872 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:13.867+0000 7f1694ff9640 1 -- 172.21.15.88:0/644520480 <== mon.2 v2:172.21.15.175:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f168c059350 con 0x7f1698157d20 2024-04-26T23:48:14.398 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:14.394+0000 7f169e2ea640 1 -- 172.21.15.88:0/644520480 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f1678005580 con 0x7f1698157d20 2024-04-26T23:48:14.399 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:14.395+0000 7f1694ff9640 1 -- 172.21.15.88:0/644520480 <== mon.2 v2:172.21.15.175:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1559 (secure 0 0 0) 0x7f168c058c50 con 0x7f1698157d20 2024-04-26T23:48:14.402 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":74,"quorum":[0,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":25,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"555255e9-7ef9-4454-8dc9-35e96b70035c","modified":"2024-04-26T23:39:34.291658Z","created":"2024-04-26T23:39:34.291658Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:3300","nonce":0},{"type":"v1","addr":"172.21.15.175:6789","nonce":0}]},"addr":"172.21.15.175:6789/0","public_addr":"172.21.15.175:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:3301","nonce":0},{"type":"v1","addr":"172.21.15.175:6790","nonce":0}]},"addr":"172.21.15.175:6790/0","public_addr":"172.21.15.175:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-04-26T23:48:14.405 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:14.401+0000 7f169e2ea640 1 -- 172.21.15.88:0/644520480 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f167c06c8f0 msgr2=0x7f167c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:14.405 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:14.401+0000 7f169e2ea640 1 --2- 172.21.15.88:0/644520480 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f167c06c8f0 0x7f167c06edb0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f1690034000 tx=0x7f169002f000 comp rx=0 tx=0).stop 2024-04-26T23:48:14.405 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:14.401+0000 7f169e2ea640 1 -- 172.21.15.88:0/644520480 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1698157d20 msgr2=0x7f16981f0db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:14.405 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:14.401+0000 7f169e2ea640 1 --2- 172.21.15.88:0/644520480 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1698157d20 0x7f16981f0db0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f168c00c3c0 tx=0x7f168c00c880 comp rx=0 tx=0).stop 2024-04-26T23:48:14.407 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:14.403+0000 7f169e2ea640 1 -- 172.21.15.88:0/644520480 shutdown_connections 2024-04-26T23:48:14.407 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:14.403+0000 7f169e2ea640 1 --2- 172.21.15.88:0/644520480 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f167c06c8f0 0x7f167c06edb0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:14.407 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:14.403+0000 7f169e2ea640 1 --2- 172.21.15.88:0/644520480 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1698157d20 0x7f16981f0db0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:14.407 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:14.403+0000 7f169e2ea640 1 --2- 172.21.15.88:0/644520480 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f169814e890 0x7f1698145150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:14.407 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:14.403+0000 7f169e2ea640 1 --2- 172.21.15.88:0/644520480 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f16980c5fa0 0x7f169814ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:14.408 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:14.403+0000 7f169e2ea640 1 -- 172.21.15.88:0/644520480 >> 172.21.15.88:0/644520480 conn(0x7f16980c6cf0 msgr2=0x7f169806d660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:48:14.408 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:14.403+0000 7f169e2ea640 1 -- 172.21.15.88:0/644520480 shutdown_connections 2024-04-26T23:48:14.408 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:14.403+0000 7f169e2ea640 1 -- 172.21.15.88:0/644520480 wait complete. 2024-04-26T23:48:17.426 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-04-26T23:48:17.628 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:17.623+0000 7f00833bb640 1 Processor -- start 2024-04-26T23:48:17.629 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:17.623+0000 7f00833bb640 1 -- start start 2024-04-26T23:48:17.629 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:17.624+0000 7f00833bb640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f00740d3ab0 0x7f00740d7860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:17.629 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:17.624+0000 7f00833bb640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f00740dece0 0x7f00740e10d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:17.629 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:17.624+0000 7f00833bb640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0074007050 con 0x7f00740d6d10 2024-04-26T23:48:17.629 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:17.624+0000 7f00833bb640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f0074006e00 con 0x7f00740dece0 2024-04-26T23:48:17.629 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:17.624+0000 7f00833bb640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f0074007330 con 0x7f00740d3ab0 2024-04-26T23:48:17.629 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:17.624+0000 7f0081bb8640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f00740d6d10 0x7f00740465a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.88:38472/0 (socket says 172.21.15.88:38472) 2024-04-26T23:48:17.629 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:17.624+0000 7f0081bb8640 1 -- 172.21.15.88:0/2040328336 learned_addr learned my addr 172.21.15.88:0/2040328336 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-26T23:48:17.629 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:17.625+0000 7f0082bba640 1 --2- 172.21.15.88:0/2040328336 >> v2:172.21.15.88:3300/0 conn(0x7f00740dece0 0x7f00740e10d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:17.629 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:17.625+0000 7f00823b9640 1 --2- 172.21.15.88:0/2040328336 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f00740d3ab0 0x7f00740d7860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:17.630 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:17.625+0000 7f00823b9640 1 -- 172.21.15.88:0/2040328336 >> v2:172.21.15.88:3300/0 conn(0x7f00740dece0 msgr2=0x7f00740e10d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:48:17.630 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:17.625+0000 7f00823b9640 1 --2- 172.21.15.88:0/2040328336 >> v2:172.21.15.88:3300/0 conn(0x7f00740dece0 0x7f00740e10d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:17.630 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:17.625+0000 7f00823b9640 1 -- 172.21.15.88:0/2040328336 >> v1:172.21.15.175:6789/0 conn(0x7f00740d6d10 legacy=0x7f00740465a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:17.630 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:17.626+0000 7f00823b9640 1 -- 172.21.15.88:0/2040328336 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00740d6510 con 0x7f00740d3ab0 2024-04-26T23:48:17.640 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:17.632+0000 7f00823b9640 1 --2- 172.21.15.88:0/2040328336 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f00740d3ab0 0x7f00740d7860 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f006c0087a0 tx=0x7f006c02c460 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9f10b8dd0971373c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:48:17.640 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:17.634+0000 7f00813b7640 1 -- 172.21.15.88:0/2040328336 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f006c032070 con 0x7f00740d3ab0 2024-04-26T23:48:17.640 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:17.634+0000 7f00813b7640 1 -- 172.21.15.88:0/2040328336 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f006c036600 con 0x7f00740d3ab0 2024-04-26T23:48:17.640 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:17.635+0000 7f00833bb640 1 -- 172.21.15.88:0/2040328336 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f00740d3ab0 msgr2=0x7f00740d7860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:17.641 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:17.635+0000 7f00833bb640 1 --2- 172.21.15.88:0/2040328336 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f00740d3ab0 0x7f00740d7860 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f006c0087a0 tx=0x7f006c02c460 comp rx=0 tx=0).stop 2024-04-26T23:48:17.641 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:17.634+0000 7f00813b7640 1 -- 172.21.15.88:0/2040328336 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f006c0369d0 con 0x7f00740d3ab0 2024-04-26T23:48:17.641 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:17.636+0000 7f00833bb640 1 -- 172.21.15.88:0/2040328336 shutdown_connections 2024-04-26T23:48:17.641 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:17.636+0000 7f00833bb640 1 --2- 172.21.15.88:0/2040328336 >> v2:172.21.15.88:3300/0 conn(0x7f00740dece0 0x7f00740e10d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:17.641 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:17.636+0000 7f00833bb640 1 --2- 172.21.15.88:0/2040328336 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f00740d3ab0 0x7f00740d7860 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:17.641 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:17.636+0000 7f00833bb640 1 -- 172.21.15.88:0/2040328336 >> 172.21.15.88:0/2040328336 conn(0x7f00740062e0 msgr2=0x7f00740066f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:48:17.644 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:17.641+0000 7f00833bb640 1 -- 172.21.15.88:0/2040328336 shutdown_connections 2024-04-26T23:48:17.647 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:17.642+0000 7f00833bb640 1 -- 172.21.15.88:0/2040328336 wait complete. 2024-04-26T23:48:17.649 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:17.645+0000 7f00833bb640 1 Processor -- start 2024-04-26T23:48:17.651 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:17.647+0000 7f00833bb640 1 -- start start 2024-04-26T23:48:17.653 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:17.648+0000 7f00833bb640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f00740d3ab0 0x7f00740d4f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:17.653 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:17.648+0000 7f00833bb640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f00740d6d10 0x7f00740c68f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:17.653 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:17.648+0000 7f00833bb640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f00740dece0 0x7f00740c6e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:17.653 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:17.648+0000 7f00833bb640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f0074046e30 con 0x7f00740d3ab0 2024-04-26T23:48:17.653 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:17.648+0000 7f00833bb640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f0074046cb0 con 0x7f00740d6d10 2024-04-26T23:48:17.653 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:17.648+0000 7f00833bb640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f0074009a60 con 0x7f00740dece0 2024-04-26T23:48:17.653 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:17.649+0000 7f0081bb8640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f00740d6d10 0x7f00740c68f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:17.653 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:17.649+0000 7f0081bb8640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f00740d6d10 0x7f00740c68f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.88:54694/0 (socket says 172.21.15.88:54694) 2024-04-26T23:48:17.653 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:17.649+0000 7f0081bb8640 1 -- 172.21.15.88:0/800702557 learned_addr learned my addr 172.21.15.88:0/800702557 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:48:17.653 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:17.649+0000 7f00823b9640 1 --2- 172.21.15.88:0/800702557 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f00740d3ab0 0x7f00740d4f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:17.653 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:17.649+0000 7f0081bb8640 1 -- 172.21.15.88:0/800702557 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f00740dece0 msgr2=0x7f00740c6e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:17.654 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:17.649+0000 7f0082bba640 1 --2- 172.21.15.88:0/800702557 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f00740dece0 0x7f00740c6e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:17.654 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:17.649+0000 7f0081bb8640 1 --2- 172.21.15.88:0/800702557 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f00740dece0 0x7f00740c6e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:17.654 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:17.649+0000 7f0081bb8640 1 -- 172.21.15.88:0/800702557 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f00740d3ab0 msgr2=0x7f00740d4f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:17.654 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:17.649+0000 7f0081bb8640 1 --2- 172.21.15.88:0/800702557 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f00740d3ab0 0x7f00740d4f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:17.654 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:17.649+0000 7f0081bb8640 1 -- 172.21.15.88:0/800702557 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f007402cfe0 con 0x7f00740d6d10 2024-04-26T23:48:17.654 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:17.649+0000 7f00823b9640 1 --2- 172.21.15.88:0/800702557 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f00740d3ab0 0x7f00740d4f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:48:17.654 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:17.650+0000 7f0081bb8640 1 --2- 172.21.15.88:0/800702557 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f00740d6d10 0x7f00740c68f0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f007c06acf0 tx=0x7f007c069f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:48:17.656 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:17.652+0000 7f0072ffd640 1 -- 172.21.15.88:0/800702557 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f007c06f840 con 0x7f00740d6d10 2024-04-26T23:48:17.656 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:17.652+0000 7f00833bb640 1 -- 172.21.15.88:0/800702557 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f007402d2c0 con 0x7f00740d6d10 2024-04-26T23:48:17.656 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:17.652+0000 7f00833bb640 1 -- 172.21.15.88:0/800702557 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00740d54a0 con 0x7f00740d6d10 2024-04-26T23:48:17.656 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:17.652+0000 7f0072ffd640 1 -- 172.21.15.88:0/800702557 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f007c06f9e0 con 0x7f00740d6d10 2024-04-26T23:48:17.656 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:17.652+0000 7f0072ffd640 1 -- 172.21.15.88:0/800702557 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f007c06f840 con 0x7f00740d6d10 2024-04-26T23:48:17.659 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:17.654+0000 7f0072ffd640 1 -- 172.21.15.88:0/800702557 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f007c096480 con 0x7f00740d6d10 2024-04-26T23:48:17.659 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:17.655+0000 7f0072ffd640 1 --2- 172.21.15.88:0/800702557 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f006006ccf0 0x7f006006f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:17.659 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:17.655+0000 7f0072ffd640 1 -- 172.21.15.88:0/800702557 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6666+0+0 (secure 0 0 0) 0x7f007c06f640 con 0x7f00740d6d10 2024-04-26T23:48:17.659 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:17.656+0000 7f00823b9640 1 --2- 172.21.15.88:0/800702557 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f006006ccf0 0x7f006006f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:17.660 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:17.657+0000 7f00833bb640 1 -- 172.21.15.88:0/800702557 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0064005290 con 0x7f00740d6d10 2024-04-26T23:48:17.661 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:17.657+0000 7f00823b9640 1 --2- 172.21.15.88:0/800702557 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f006006ccf0 0x7f006006f1b0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f006c037000 tx=0x7f006c00a040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:48:17.682 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:17.670+0000 7f0072ffd640 1 -- 172.21.15.88:0/800702557 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f007c0d5bf0 con 0x7f00740d6d10 2024-04-26T23:48:18.191 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:18.188+0000 7f00833bb640 1 -- 172.21.15.88:0/800702557 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f0064005580 con 0x7f00740d6d10 2024-04-26T23:48:18.193 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:18.189+0000 7f0072ffd640 1 -- 172.21.15.88:0/800702557 <== mon.1 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1564 (secure 0 0 0) 0x7f007c0d54f0 con 0x7f00740d6d10 2024-04-26T23:48:18.193 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":76,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":3,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"555255e9-7ef9-4454-8dc9-35e96b70035c","modified":"2024-04-26T23:39:34.291658Z","created":"2024-04-26T23:39:34.291658Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:3300","nonce":0},{"type":"v1","addr":"172.21.15.175:6789","nonce":0}]},"addr":"172.21.15.175:6789/0","public_addr":"172.21.15.175:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:3301","nonce":0},{"type":"v1","addr":"172.21.15.175:6790","nonce":0}]},"addr":"172.21.15.175:6790/0","public_addr":"172.21.15.175:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-04-26T23:48:18.204 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:18.198+0000 7f00833bb640 1 -- 172.21.15.88:0/800702557 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f006006ccf0 msgr2=0x7f006006f1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:18.204 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:18.198+0000 7f00833bb640 1 --2- 172.21.15.88:0/800702557 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f006006ccf0 0x7f006006f1b0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f006c037000 tx=0x7f006c00a040 comp rx=0 tx=0).stop 2024-04-26T23:48:18.204 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:18.198+0000 7f00833bb640 1 -- 172.21.15.88:0/800702557 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f00740d6d10 msgr2=0x7f00740c68f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:18.204 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:18.198+0000 7f00833bb640 1 --2- 172.21.15.88:0/800702557 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f00740d6d10 0x7f00740c68f0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f007c06acf0 tx=0x7f007c069f90 comp rx=0 tx=0).stop 2024-04-26T23:48:18.204 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:18.198+0000 7f00833bb640 1 -- 172.21.15.88:0/800702557 shutdown_connections 2024-04-26T23:48:18.204 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:18.198+0000 7f00833bb640 1 --2- 172.21.15.88:0/800702557 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f006006ccf0 0x7f006006f1b0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:18.204 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:18.198+0000 7f00833bb640 1 --2- 172.21.15.88:0/800702557 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f00740dece0 0x7f00740c6e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:18.204 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:18.198+0000 7f00833bb640 1 --2- 172.21.15.88:0/800702557 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f00740d6d10 0x7f00740c68f0 secure :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f007c06acf0 tx=0x7f007c069f90 comp rx=0 tx=0).stop 2024-04-26T23:48:18.204 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:18.198+0000 7f00833bb640 1 --2- 172.21.15.88:0/800702557 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f00740d3ab0 0x7f00740d4f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:18.204 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:18.198+0000 7f00833bb640 1 -- 172.21.15.88:0/800702557 >> 172.21.15.88:0/800702557 conn(0x7f00740062e0 msgr2=0x7f007400afa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:48:18.204 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:18.200+0000 7f00833bb640 1 -- 172.21.15.88:0/800702557 shutdown_connections 2024-04-26T23:48:18.204 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:18.200+0000 7f00833bb640 1 -- 172.21.15.88:0/800702557 wait complete. 2024-04-26T23:48:18.224 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-04-26T23:48:18.224 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-04-26T23:48:18.224 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-04-26T23:48:18.412 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:18.408+0000 7faa35274640 1 Processor -- start 2024-04-26T23:48:18.421 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:18.412+0000 7faa35274640 1 -- start start 2024-04-26T23:48:18.421 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:18.413+0000 7faa35274640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7faa300ac6b0 0x7faa301667e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:18.421 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:18.413+0000 7faa35274640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faa300ac1c0 con 0x7faa30073eb0 2024-04-26T23:48:18.421 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:18.413+0000 7faa35274640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faa3006d6d0 con 0x7faa300c5880 2024-04-26T23:48:18.422 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:18.413+0000 7faa35274640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7faa300ab620 con 0x7faa300ac6b0 2024-04-26T23:48:18.422 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:18.413+0000 7faa2f7fe640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7faa300ac6b0 0x7faa301667e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:18.422 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:18.413+0000 7faa2f7fe640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7faa300ac6b0 0x7faa301667e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:48862/0 (socket says 172.21.15.88:48862) 2024-04-26T23:48:18.422 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:18.413+0000 7faa2f7fe640 1 -- 172.21.15.88:0/892449442 learned_addr learned my addr 172.21.15.88:0/892449442 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:48:18.422 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:18.414+0000 7faa2f7fe640 1 -- 172.21.15.88:0/892449442 >> v1:172.21.15.175:6789/0 conn(0x7faa300c5880 legacy=0x7faa3006e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:18.422 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:18.414+0000 7faa2f7fe640 1 -- 172.21.15.88:0/892449442 >> v1:172.21.15.88:6789/0 conn(0x7faa30073eb0 legacy=0x7faa300abab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:48:18.422 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:18.414+0000 7faa2f7fe640 1 -- 172.21.15.88:0/892449442 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa3006d9b0 con 0x7faa300ac6b0 2024-04-26T23:48:18.422 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:18.415+0000 7faa2f7fe640 1 --2- 172.21.15.88:0/892449442 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faa300ac6b0 0x7faa301667e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7faa2801ae50 tx=0x7faa2803b660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a2493882613968e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:48:18.422 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:18.418+0000 7faa2dffb640 1 -- 172.21.15.88:0/892449442 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa28047070 con 0x7faa300ac6b0 2024-04-26T23:48:18.422 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:18.418+0000 7faa2dffb640 1 -- 172.21.15.88:0/892449442 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa28042600 con 0x7faa300ac6b0 2024-04-26T23:48:18.422 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:18.418+0000 7faa2dffb640 1 -- 172.21.15.88:0/892449442 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa28042a10 con 0x7faa300ac6b0 2024-04-26T23:48:18.425 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:18.419+0000 7faa35274640 1 -- 172.21.15.88:0/892449442 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faa300ac6b0 msgr2=0x7faa301667e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:18.425 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:18.419+0000 7faa35274640 1 --2- 172.21.15.88:0/892449442 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faa300ac6b0 0x7faa301667e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7faa2801ae50 tx=0x7faa2803b660 comp rx=0 tx=0).stop 2024-04-26T23:48:18.425 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:18.422+0000 7faa35274640 1 -- 172.21.15.88:0/892449442 shutdown_connections 2024-04-26T23:48:18.426 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:18.422+0000 7faa35274640 1 --2- 172.21.15.88:0/892449442 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faa300ac6b0 0x7faa301667e0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:18.426 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:18.422+0000 7faa35274640 1 -- 172.21.15.88:0/892449442 >> 172.21.15.88:0/892449442 conn(0x7faa300c4d60 msgr2=0x7faa300c5170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:48:18.426 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:18.422+0000 7faa35274640 1 -- 172.21.15.88:0/892449442 shutdown_connections 2024-04-26T23:48:18.431 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:18.426+0000 7faa35274640 1 -- 172.21.15.88:0/892449442 wait complete. 2024-04-26T23:48:18.431 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:18.428+0000 7faa35274640 1 Processor -- start 2024-04-26T23:48:18.434 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:18.429+0000 7faa35274640 1 -- start start 2024-04-26T23:48:18.434 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:18.430+0000 7faa35274640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faa30073eb0 0x7faa300bfe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:18.434 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:18.430+0000 7faa35274640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faa300ac6b0 0x7faa300c3d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:18.435 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:18.431+0000 7faa35274640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faa300c5880 0x7faa30152040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:18.435 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:18.431+0000 7faa35274640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7faa3006e8f0 con 0x7faa300c5880 2024-04-26T23:48:18.435 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:18.431+0000 7faa35274640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7faa300c4870 con 0x7faa30073eb0 2024-04-26T23:48:18.435 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:18.431+0000 7faa35274640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7faa3006ea70 con 0x7faa300ac6b0 2024-04-26T23:48:18.435 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:18.431+0000 7faa2e7fc640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faa300ac6b0 0x7faa300c3d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:18.435 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:18.431+0000 7faa2e7fc640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faa300ac6b0 0x7faa300c3d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.88:39432/0 (socket says 172.21.15.88:39432) 2024-04-26T23:48:18.435 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:18.431+0000 7faa2e7fc640 1 -- 172.21.15.88:0/445505359 learned_addr learned my addr 172.21.15.88:0/445505359 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:48:18.437 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:18.433+0000 7faa2f7fe640 1 --2- 172.21.15.88:0/445505359 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faa300c5880 0x7faa30152040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:18.437 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:18.434+0000 7faa2f7fe640 1 -- 172.21.15.88:0/445505359 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faa300ac6b0 msgr2=0x7faa300c3d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:18.438 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:18.434+0000 7faa2f7fe640 1 --2- 172.21.15.88:0/445505359 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faa300ac6b0 0x7faa300c3d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:18.438 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:18.434+0000 7faa2f7fe640 1 -- 172.21.15.88:0/445505359 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faa30073eb0 msgr2=0x7faa300bfe60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T23:48:18.438 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:18.434+0000 7faa2f7fe640 1 --2- 172.21.15.88:0/445505359 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faa30073eb0 0x7faa300bfe60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:18.438 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:18.434+0000 7faa2f7fe640 1 -- 172.21.15.88:0/445505359 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa300c03a0 con 0x7faa300c5880 2024-04-26T23:48:18.438 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:18.435+0000 7faa2f7fe640 1 --2- 172.21.15.88:0/445505359 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faa300c5880 0x7faa30152040 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7faa30074fe0 tx=0x7faa28004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:48:18.441 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:18.435+0000 7faa177fe640 1 -- 172.21.15.88:0/445505359 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa28052020 con 0x7faa300c5880 2024-04-26T23:48:18.441 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:18.435+0000 7faa35274640 1 -- 172.21.15.88:0/445505359 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa301572a0 con 0x7faa300c5880 2024-04-26T23:48:18.441 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:18.435+0000 7faa35274640 1 -- 172.21.15.88:0/445505359 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa300c10f0 con 0x7faa300c5880 2024-04-26T23:48:18.441 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:18.437+0000 7faa177fe640 1 -- 172.21.15.88:0/445505359 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa28048040 con 0x7faa300c5880 2024-04-26T23:48:18.442 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:18.437+0000 7faa35274640 1 --2- 172.21.15.88:0/445505359 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faa30152580 0x7faa300c18d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:18.442 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:18.437+0000 7faa35274640 1 -- 172.21.15.88:0/445505359 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7faa300c0f70 con 0x7faa30152580 2024-04-26T23:48:18.442 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:18.437+0000 7faa2effd640 1 --2- 172.21.15.88:0/445505359 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faa30152580 0x7faa300c18d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:18.442 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:18.438+0000 7faa2effd640 1 -- 172.21.15.88:0/445505359 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7faa300506c0 con 0x7faa30152580 2024-04-26T23:48:18.442 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:18.438+0000 7faa2effd640 1 --2- 172.21.15.88:0/445505359 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faa30152580 0x7faa300c18d0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7faa2400c340 tx=0x7faa2400c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:48:18.443 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:18.439+0000 7faa177fe640 1 -- 172.21.15.88:0/445505359 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa28047070 con 0x7faa300c5880 2024-04-26T23:48:18.443 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:18.439+0000 7faa177fe640 1 -- 172.21.15.88:0/445505359 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7faa28055020 con 0x7faa300c5880 2024-04-26T23:48:18.443 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:18.439+0000 7faa177fe640 1 --2- 172.21.15.88:0/445505359 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7faa1c06c9c0 0x7faa1c06ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:18.447 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:18.444+0000 7faa2e7fc640 1 --2- 172.21.15.88:0/445505359 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7faa1c06c9c0 0x7faa1c06ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:18.447 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:18.444+0000 7faa177fe640 1 -- 172.21.15.88:0/445505359 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6666+0+0 (secure 0 0 0) 0x7faa280bdcf0 con 0x7faa300c5880 2024-04-26T23:48:18.448 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:18.444+0000 7faa177fe640 1 -- 172.21.15.88:0/445505359 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa24017070 con 0x7faa30152580 2024-04-26T23:48:18.448 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:18.444+0000 7faa177fe640 1 -- 172.21.15.88:0/445505359 <== mon.0 v2:172.21.15.88:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7faa240035f0 con 0x7faa30152580 2024-04-26T23:48:18.448 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:18.444+0000 7faa177fe640 1 -- 172.21.15.88:0/445505359 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faa30152580 msgr2=0x7faa300c18d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:18.448 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:18.444+0000 7faa177fe640 1 --2- 172.21.15.88:0/445505359 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faa30152580 0x7faa300c18d0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7faa2400c340 tx=0x7faa2400c800 comp rx=0 tx=0).stop 2024-04-26T23:48:18.448 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:18.444+0000 7faa177fe640 1 -- 172.21.15.88:0/445505359 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faa30152580 msgr2=0x7faa300c18d0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:48:18.448 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:18.444+0000 7faa177fe640 1 --2- 172.21.15.88:0/445505359 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faa30152580 0x7faa300c18d0 secure :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7faa2400c340 tx=0x7faa2400c800 comp rx=0 tx=0).stop 2024-04-26T23:48:18.448 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:18.445+0000 7faa2e7fc640 1 --2- 172.21.15.88:0/445505359 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7faa1c06c9c0 0x7faa1c06ee80 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7faa300c07c0 tx=0x7faa20009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:48:18.461 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:18.458+0000 7faa35274640 1 --2- 172.21.15.88:0/445505359 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faa300c1e10 0x7faa300c2220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:18.462 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:18.458+0000 7faa35274640 1 -- 172.21.15.88:0/445505359 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7faa300c12c0 con 0x7faa300c1e10 2024-04-26T23:48:18.466 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:18.462+0000 7faa2effd640 1 --2- 172.21.15.88:0/445505359 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faa300c1e10 0x7faa300c2220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:18.466 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:18.463+0000 7faa2effd640 1 -- 172.21.15.88:0/445505359 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7faa300726c0 con 0x7faa300c1e10 2024-04-26T23:48:18.466 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:18.463+0000 7faa2effd640 1 --2- 172.21.15.88:0/445505359 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faa300c1e10 0x7faa300c2220 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7faa2400c340 tx=0x7faa24000fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:48:18.468 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:18.464+0000 7faa177fe640 1 -- 172.21.15.88:0/445505359 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa24017040 con 0x7faa300c1e10 2024-04-26T23:48:18.468 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:18.464+0000 7faa177fe640 1 -- 172.21.15.88:0/445505359 <== mon.0 v2:172.21.15.88:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4726 (secure 0 0 0) 0x7faa24003e20 con 0x7faa300c1e10 2024-04-26T23:48:18.468 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:18.464+0000 7faa177fe640 1 -- 172.21.15.88:0/445505359 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faa300c1e10 msgr2=0x7faa300c2220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:18.468 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:18.464+0000 7faa177fe640 1 --2- 172.21.15.88:0/445505359 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faa300c1e10 0x7faa300c2220 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7faa2400c340 tx=0x7faa24000fb0 comp rx=0 tx=0).stop 2024-04-26T23:48:18.468 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:18.465+0000 7faa177fe640 1 -- 172.21.15.88:0/445505359 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faa300c1e10 msgr2=0x7faa300c2220 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:48:18.468 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:18.465+0000 7faa177fe640 1 --2- 172.21.15.88:0/445505359 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faa300c1e10 0x7faa300c2220 secure :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7faa2400c340 tx=0x7faa24000fb0 comp rx=0 tx=0).stop 2024-04-26T23:48:18.469 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-04-26T23:48:18.469 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2024-04-26T23:48:18.469 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2024-04-26T23:48:18.470 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "leader", 2024-04-26T23:48:18.470 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 76, 2024-04-26T23:48:18.470 INFO:teuthology.orchestra.run.smithi088.stdout: "uptime": 71530, 2024-04-26T23:48:18.470 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2024-04-26T23:48:18.470 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2024-04-26T23:48:18.470 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2024-04-26T23:48:18.470 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2024-04-26T23:48:18.470 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:48:18.470 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 3, 2024-04-26T23:48:18.470 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2024-04-26T23:48:18.471 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2450521708007866372", 2024-04-26T23:48:18.471 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2024-04-26T23:48:18.471 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-04-26T23:48:18.471 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-04-26T23:48:18.471 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-04-26T23:48:18.471 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-04-26T23:48:18.471 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-04-26T23:48:18.471 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-04-26T23:48:18.471 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-04-26T23:48:18.471 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-04-26T23:48:18.471 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-04-26T23:48:18.471 INFO:teuthology.orchestra.run.smithi088.stdout: "reef", 2024-04-26T23:48:18.471 INFO:teuthology.orchestra.run.smithi088.stdout: "squid" 2024-04-26T23:48:18.471 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:48:18.471 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540701547738038271", 2024-04-26T23:48:18.472 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2024-04-26T23:48:18.472 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-04-26T23:48:18.472 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-04-26T23:48:18.472 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-04-26T23:48:18.472 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-04-26T23:48:18.472 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-04-26T23:48:18.472 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-04-26T23:48:18.472 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-04-26T23:48:18.472 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-04-26T23:48:18.472 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-04-26T23:48:18.472 INFO:teuthology.orchestra.run.smithi088.stdout: "reef", 2024-04-26T23:48:18.472 INFO:teuthology.orchestra.run.smithi088.stdout: "squid" 2024-04-26T23:48:18.472 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:48:18.472 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:48:18.472 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2024-04-26T23:48:18.473 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2024-04-26T23:48:18.473 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2024-04-26T23:48:18.473 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2024-04-26T23:48:18.473 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2024-04-26T23:48:18.473 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "555255e9-7ef9-4454-8dc9-35e96b70035c", 2024-04-26T23:48:18.473 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2024-04-26T23:39:34.291658Z", 2024-04-26T23:48:18.473 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2024-04-26T23:39:34.291658Z", 2024-04-26T23:48:18.473 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 19, 2024-04-26T23:48:18.473 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "squid", 2024-04-26T23:48:18.473 INFO:teuthology.orchestra.run.smithi088.stdout: "election_strategy": 1, 2024-04-26T23:48:18.473 INFO:teuthology.orchestra.run.smithi088.stdout: "disallowed_leaders: ": "", 2024-04-26T23:48:18.473 INFO:teuthology.orchestra.run.smithi088.stdout: "stretch_mode": false, 2024-04-26T23:48:18.473 INFO:teuthology.orchestra.run.smithi088.stdout: "tiebreaker_mon": "", 2024-04-26T23:48:18.473 INFO:teuthology.orchestra.run.smithi088.stdout: "removed_ranks: ": "", 2024-04-26T23:48:18.473 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2024-04-26T23:48:18.473 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2024-04-26T23:48:18.474 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-04-26T23:48:18.474 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-04-26T23:48:18.474 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-04-26T23:48:18.474 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-04-26T23:48:18.474 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-04-26T23:48:18.474 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-04-26T23:48:18.474 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-04-26T23:48:18.474 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-04-26T23:48:18.474 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-04-26T23:48:18.474 INFO:teuthology.orchestra.run.smithi088.stdout: "reef", 2024-04-26T23:48:18.474 INFO:teuthology.orchestra.run.smithi088.stdout: "squid" 2024-04-26T23:48:18.474 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:48:18.474 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2024-04-26T23:48:18.474 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:48:18.474 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2024-04-26T23:48:18.474 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:48:18.475 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2024-04-26T23:48:18.475 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2024-04-26T23:48:18.475 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-04-26T23:48:18.475 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-04-26T23:48:18.475 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:48:18.475 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-04-26T23:48:18.475 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2024-04-26T23:48:18.475 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:48:18.475 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:48:18.475 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:48:18.475 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-04-26T23:48:18.475 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2024-04-26T23:48:18.475 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:48:18.475 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:48:18.475 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:48:18.476 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:48:18.476 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2024-04-26T23:48:18.476 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2024-04-26T23:48:18.476 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-04-26T23:48:18.476 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-04-26T23:48:18.476 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-04-26T23:48:18.476 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:48:18.476 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:48:18.476 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2024-04-26T23:48:18.476 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2024-04-26T23:48:18.476 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-04-26T23:48:18.476 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-04-26T23:48:18.476 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:48:18.476 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-04-26T23:48:18.476 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:3300", 2024-04-26T23:48:18.476 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:48:18.477 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:48:18.477 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:48:18.477 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-04-26T23:48:18.477 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6789", 2024-04-26T23:48:18.477 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:48:18.477 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:48:18.477 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:48:18.477 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:48:18.477 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6789/0", 2024-04-26T23:48:18.477 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.175:6789/0", 2024-04-26T23:48:18.477 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-04-26T23:48:18.477 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-04-26T23:48:18.477 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-04-26T23:48:18.477 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:48:18.477 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:48:18.477 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2024-04-26T23:48:18.478 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2024-04-26T23:48:18.478 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-04-26T23:48:18.478 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-04-26T23:48:18.478 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:48:18.478 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-04-26T23:48:18.478 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:3301", 2024-04-26T23:48:18.478 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:48:18.478 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:48:18.478 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:48:18.478 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-04-26T23:48:18.478 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6790", 2024-04-26T23:48:18.478 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:48:18.478 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:48:18.478 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:48:18.479 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:48:18.479 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6790/0", 2024-04-26T23:48:18.479 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.175:6790/0", 2024-04-26T23:48:18.479 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-04-26T23:48:18.479 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-04-26T23:48:18.479 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-04-26T23:48:18.479 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:48:18.479 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:48:18.479 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:48:18.479 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2024-04-26T23:48:18.479 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2024-04-26T23:48:18.479 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:48:18.479 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:48:18.479 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:48:18.479 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2024-04-26T23:48:18.480 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:48:18.480 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:48:18.480 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2024-04-26T23:48:18.480 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:48:18.480 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:48:18.480 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:48:18.480 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2024-04-26T23:48:18.480 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:48:18.480 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:48:18.480 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": [ 2024-04-26T23:48:18.480 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:48:18.480 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:48:18.480 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:48:18.480 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2024-04-26T23:48:18.480 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:48:18.481 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:48:18.481 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:48:18.481 INFO:teuthology.orchestra.run.smithi088.stdout: "stretch_mode": false 2024-04-26T23:48:18.481 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-04-26T23:48:18.482 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:18.466+0000 7faa35274640 1 -- 172.21.15.88:0/445505359 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7faa1c06c9c0 msgr2=0x7faa1c06ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:18.482 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:18.466+0000 7faa35274640 1 --2- 172.21.15.88:0/445505359 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7faa1c06c9c0 0x7faa1c06ee80 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7faa300c07c0 tx=0x7faa20009040 comp rx=0 tx=0).stop 2024-04-26T23:48:18.482 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:18.466+0000 7faa2f7fe640 1 -- 172.21.15.88:0/445505359 reap_dead start 2024-04-26T23:48:18.482 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:18.466+0000 7faa35274640 1 -- 172.21.15.88:0/445505359 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faa300c5880 msgr2=0x7faa30152040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:18.482 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:18.466+0000 7faa35274640 1 --2- 172.21.15.88:0/445505359 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faa300c5880 0x7faa30152040 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7faa30074fe0 tx=0x7faa28004a40 comp rx=0 tx=0).stop 2024-04-26T23:48:18.482 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:18.466+0000 7faa35274640 1 -- 172.21.15.88:0/445505359 shutdown_connections 2024-04-26T23:48:18.482 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:18.466+0000 7faa35274640 1 --2- 172.21.15.88:0/445505359 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faa300c5880 0x7faa30152040 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:18.482 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:18.466+0000 7faa35274640 1 -- 172.21.15.88:0/445505359 >> 172.21.15.88:0/445505359 conn(0x7faa300c4d60 msgr2=0x7faa300c5e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:48:18.482 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:18.467+0000 7faa35274640 1 -- 172.21.15.88:0/445505359 shutdown_connections 2024-04-26T23:48:18.483 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:18.467+0000 7faa35274640 1 -- 172.21.15.88:0/445505359 wait complete. 2024-04-26T23:48:18.489 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-04-26T23:48:18.489 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-04-26T23:48:18.489 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-04-26T23:48:18.709 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:18.706+0000 7fc89e296640 1 Processor -- start 2024-04-26T23:48:18.711 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:18.706+0000 7fc89e296640 1 -- start start 2024-04-26T23:48:18.711 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:18.707+0000 7fc89e296640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc8900cd2b0 0x7fc8900469c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:18.711 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:18.707+0000 7fc89e296640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fc890049f40 0x7fc8900315e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:18.712 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:18.707+0000 7fc89e296640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc890031b20 con 0x7fc89003f740 2024-04-26T23:48:18.712 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:18.707+0000 7fc89e296640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7fc89000b800 con 0x7fc890049f40 2024-04-26T23:48:18.712 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:18.707+0000 7fc89e296640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fc8900cd690 con 0x7fc8900cd2b0 2024-04-26T23:48:18.712 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:18.708+0000 7fc89da95640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fc890049f40 0x7fc8900315e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:18.712 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:18.708+0000 7fc89da95640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fc890049f40 0x7fc8900315e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.88:34088/0 (socket says 172.21.15.88:34088) 2024-04-26T23:48:18.712 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:18.708+0000 7fc89da95640 1 -- 172.21.15.88:0/4234181264 learned_addr learned my addr 172.21.15.88:0/4234181264 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:48:18.712 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:18.708+0000 7fc89d294640 1 --2- 172.21.15.88:0/4234181264 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc8900cd2b0 0x7fc8900469c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:18.714 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:18.710+0000 7fc88ffff640 1 -- 172.21.15.88:0/4234181264 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3074665196 0 0) 0x7fc890031b20 con 0x7fc89003f740 2024-04-26T23:48:18.714 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:18.710+0000 7fc89da95640 1 -- 172.21.15.88:0/4234181264 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc8900cd2b0 msgr2=0x7fc8900469c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:48:18.714 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:18.710+0000 7fc89da95640 1 --2- 172.21.15.88:0/4234181264 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc8900cd2b0 0x7fc8900469c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:18.714 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:18.710+0000 7fc89da95640 1 -- 172.21.15.88:0/4234181264 >> v1:172.21.15.175:6789/0 conn(0x7fc89003f740 legacy=0x7fc890030ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:18.714 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:18.710+0000 7fc89da95640 1 -- 172.21.15.88:0/4234181264 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8900d7720 con 0x7fc890049f40 2024-04-26T23:48:18.715 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:18.711+0000 7fc89da95640 1 --2- 172.21.15.88:0/4234181264 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc890049f40 0x7fc8900315e0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fc898065e50 tx=0x7fc8980a8290 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7a6bc8db0af1e61f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:48:18.715 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:18.711+0000 7fc88ffff640 1 -- 172.21.15.88:0/4234181264 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8980b5070 con 0x7fc890049f40 2024-04-26T23:48:18.718 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:18.714+0000 7fc88ffff640 1 -- 172.21.15.88:0/4234181264 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8980b0640 con 0x7fc890049f40 2024-04-26T23:48:18.718 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:18.715+0000 7fc89e296640 1 -- 172.21.15.88:0/4234181264 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc890049f40 msgr2=0x7fc8900315e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:18.718 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:18.715+0000 7fc89e296640 1 --2- 172.21.15.88:0/4234181264 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc890049f40 0x7fc8900315e0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fc898065e50 tx=0x7fc8980a8290 comp rx=0 tx=0).stop 2024-04-26T23:48:18.718 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:18.715+0000 7fc89e296640 1 -- 172.21.15.88:0/4234181264 shutdown_connections 2024-04-26T23:48:18.719 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:18.715+0000 7fc89e296640 1 --2- 172.21.15.88:0/4234181264 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc890049f40 0x7fc8900315e0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:18.719 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:18.715+0000 7fc89e296640 1 --2- 172.21.15.88:0/4234181264 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc8900cd2b0 0x7fc8900469c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:18.719 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:18.715+0000 7fc89e296640 1 -- 172.21.15.88:0/4234181264 >> 172.21.15.88:0/4234181264 conn(0x7fc890048ac0 msgr2=0x7fc890048ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:48:18.719 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:18.716+0000 7fc89e296640 1 -- 172.21.15.88:0/4234181264 shutdown_connections 2024-04-26T23:48:18.719 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:18.716+0000 7fc89e296640 1 -- 172.21.15.88:0/4234181264 wait complete. 2024-04-26T23:48:18.722 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:18.719+0000 7fc89e296640 1 Processor -- start 2024-04-26T23:48:18.724 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:18.719+0000 7fc89e296640 1 -- start start 2024-04-26T23:48:18.724 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:18.720+0000 7fc89e296640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc89003f740 0x7fc89016e580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:18.724 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:18.720+0000 7fc89e296640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc890049f40 0x7fc8900310e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:18.724 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:18.720+0000 7fc89e296640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc8900cd2b0 0x7fc890044840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:18.724 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:18.720+0000 7fc89e296640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fc89000b490 con 0x7fc89003f740 2024-04-26T23:48:18.724 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:18.720+0000 7fc89e296640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc89000b1b0 con 0x7fc890049f40 2024-04-26T23:48:18.724 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:18.720+0000 7fc89e296640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fc89000c220 con 0x7fc8900cd2b0 2024-04-26T23:48:18.724 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:18.720+0000 7fc89d294640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc89003f740 0x7fc89016e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:18.724 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:18.720+0000 7fc89ca93640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc890049f40 0x7fc8900310e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:18.724 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:18.721+0000 7fc89da95640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc8900cd2b0 0x7fc890044840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:18.725 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:18.721+0000 7fc89ca93640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc890049f40 0x7fc8900310e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.88:34102/0 (socket says 172.21.15.88:34102) 2024-04-26T23:48:18.725 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:18.721+0000 7fc89ca93640 1 -- 172.21.15.88:0/321326222 learned_addr learned my addr 172.21.15.88:0/321326222 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:48:18.725 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:18.721+0000 7fc89ca93640 1 -- 172.21.15.88:0/321326222 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc8900cd2b0 msgr2=0x7fc890044840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:18.725 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:18.721+0000 7fc89ca93640 1 --2- 172.21.15.88:0/321326222 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc8900cd2b0 0x7fc890044840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:18.725 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:18.721+0000 7fc89ca93640 1 -- 172.21.15.88:0/321326222 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc89003f740 msgr2=0x7fc89016e580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:18.725 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:18.721+0000 7fc89ca93640 1 --2- 172.21.15.88:0/321326222 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc89003f740 0x7fc89016e580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:18.726 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:18.721+0000 7fc89ca93640 1 -- 172.21.15.88:0/321326222 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8900454b0 con 0x7fc890049f40 2024-04-26T23:48:18.726 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:18.721+0000 7fc89d294640 1 --2- 172.21.15.88:0/321326222 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc89003f740 0x7fc89016e580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:48:18.726 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:18.722+0000 7fc89ca93640 1 --2- 172.21.15.88:0/321326222 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc890049f40 0x7fc8900310e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fc88800c390 tx=0x7fc88800c850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:48:18.726 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:18.722+0000 7fc88dffb640 1 -- 172.21.15.88:0/321326222 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc888017070 con 0x7fc890049f40 2024-04-26T23:48:18.726 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:18.722+0000 7fc88dffb640 1 -- 172.21.15.88:0/321326222 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8880035f0 con 0x7fc890049f40 2024-04-26T23:48:18.726 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:18.723+0000 7fc88dffb640 1 -- 172.21.15.88:0/321326222 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8880039e0 con 0x7fc890049f40 2024-04-26T23:48:18.728 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:18.724+0000 7fc89e296640 1 -- 172.21.15.88:0/321326222 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc890045790 con 0x7fc890049f40 2024-04-26T23:48:18.728 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:18.724+0000 7fc89e296640 1 -- 172.21.15.88:0/321326222 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc890045d50 con 0x7fc890049f40 2024-04-26T23:48:18.730 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:18.727+0000 7fc88dffb640 1 -- 172.21.15.88:0/321326222 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc88801a070 con 0x7fc890049f40 2024-04-26T23:48:18.730 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:18.727+0000 7fc88dffb640 1 --2- 172.21.15.88:0/321326222 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fc87c06c8f0 0x7fc87c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:18.731 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:18.727+0000 7fc89d294640 1 --2- 172.21.15.88:0/321326222 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fc87c06c8f0 0x7fc87c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:18.731 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:18.728+0000 7fc88dffb640 1 -- 172.21.15.88:0/321326222 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6666+0+0 (secure 0 0 0) 0x7fc88808b1d0 con 0x7fc890049f40 2024-04-26T23:48:18.731 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:18.728+0000 7fc89d294640 1 --2- 172.21.15.88:0/321326222 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fc87c06c8f0 0x7fc87c06edb0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fc894009eb0 tx=0x7fc894009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:48:18.733 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:18.729+0000 7fc89e296640 1 --2- 172.21.15.88:0/321326222 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc89002c280 0x7fc890044d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:18.733 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:18.729+0000 7fc89e296640 1 -- 172.21.15.88:0/321326222 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc890030c70 con 0x7fc89002c280 2024-04-26T23:48:18.733 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:18.729+0000 7fc89da95640 1 --2- 172.21.15.88:0/321326222 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc89002c280 0x7fc890044d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:18.737 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:18.733+0000 7fc89da95640 1 -- 172.21.15.88:0/321326222 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc8900057e0 con 0x7fc89002c280 2024-04-26T23:48:18.738 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:18.735+0000 7fc89da95640 1 --2- 172.21.15.88:0/321326222 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc89002c280 0x7fc890044d80 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fc89807cda0 tx=0x7fc8980661d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:48:18.738 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:18.735+0000 7fc88dffb640 1 -- 172.21.15.88:0/321326222 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8980bf070 con 0x7fc89002c280 2024-04-26T23:48:18.739 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:18.736+0000 7fc88dffb640 1 -- 172.21.15.88:0/321326222 <== mon.1 v2:172.21.15.175:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fc8980b6040 con 0x7fc89002c280 2024-04-26T23:48:18.740 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:18.736+0000 7fc88dffb640 1 -- 172.21.15.88:0/321326222 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc89002c280 msgr2=0x7fc890044d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:18.740 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:18.736+0000 7fc88dffb640 1 --2- 172.21.15.88:0/321326222 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc89002c280 0x7fc890044d80 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fc89807cda0 tx=0x7fc8980661d0 comp rx=0 tx=0).stop 2024-04-26T23:48:18.740 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:18.736+0000 7fc88dffb640 1 -- 172.21.15.88:0/321326222 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc89002c280 msgr2=0x7fc890044d80 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:48:18.740 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:18.736+0000 7fc88dffb640 1 --2- 172.21.15.88:0/321326222 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc89002c280 0x7fc890044d80 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:18.766 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:18.763+0000 7fc87b7fe640 1 --2- 172.21.15.88:0/321326222 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc8900cc5c0 0x7fc8900440d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:18.766 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:18.763+0000 7fc87b7fe640 1 -- 172.21.15.88:0/321326222 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc890044610 con 0x7fc8900cc5c0 2024-04-26T23:48:18.767 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:18.764+0000 7fc89da95640 1 --2- 172.21.15.88:0/321326222 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc8900cc5c0 0x7fc8900440d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:18.769 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:18.766+0000 7fc89da95640 1 -- 172.21.15.88:0/321326222 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fc890049180 con 0x7fc8900cc5c0 2024-04-26T23:48:18.770 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:18.766+0000 7fc89da95640 1 --2- 172.21.15.88:0/321326222 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc8900cc5c0 0x7fc8900440d0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fc898051fc0 tx=0x7fc8980ad000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:48:18.770 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:18.766+0000 7fc88dffb640 1 -- 172.21.15.88:0/321326222 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8980d2020 con 0x7fc8900cc5c0 2024-04-26T23:48:18.770 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:18.767+0000 7fc88dffb640 1 -- 172.21.15.88:0/321326222 <== mon.1 v2:172.21.15.175:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4553 (secure 0 0 0) 0x7fc8980bb3f0 con 0x7fc8900cc5c0 2024-04-26T23:48:18.770 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:18.767+0000 7fc88dffb640 1 -- 172.21.15.88:0/321326222 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc8900cc5c0 msgr2=0x7fc8900440d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:18.770 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:18.767+0000 7fc88dffb640 1 --2- 172.21.15.88:0/321326222 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc8900cc5c0 0x7fc8900440d0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fc898051fc0 tx=0x7fc8980ad000 comp rx=0 tx=0).stop 2024-04-26T23:48:18.771 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:18.767+0000 7fc88dffb640 1 -- 172.21.15.88:0/321326222 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc8900cc5c0 msgr2=0x7fc8900440d0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:48:18.771 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:18.767+0000 7fc88dffb640 1 --2- 172.21.15.88:0/321326222 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc8900cc5c0 0x7fc8900440d0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:18.771 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-04-26T23:48:18.771 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2024-04-26T23:48:18.771 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2024-04-26T23:48:18.771 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "peon", 2024-04-26T23:48:18.771 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 76, 2024-04-26T23:48:18.771 INFO:teuthology.orchestra.run.smithi088.stdout: "uptime": 8316, 2024-04-26T23:48:18.771 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2024-04-26T23:48:18.772 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2024-04-26T23:48:18.772 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2024-04-26T23:48:18.772 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2024-04-26T23:48:18.772 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:48:18.772 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 3, 2024-04-26T23:48:18.772 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2024-04-26T23:48:18.772 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2450521708007866372", 2024-04-26T23:48:18.772 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2024-04-26T23:48:18.772 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-04-26T23:48:18.772 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-04-26T23:48:18.772 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-04-26T23:48:18.772 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-04-26T23:48:18.772 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-04-26T23:48:18.772 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-04-26T23:48:18.772 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-04-26T23:48:18.772 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-04-26T23:48:18.773 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-04-26T23:48:18.773 INFO:teuthology.orchestra.run.smithi088.stdout: "reef", 2024-04-26T23:48:18.773 INFO:teuthology.orchestra.run.smithi088.stdout: "squid" 2024-04-26T23:48:18.773 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:48:18.773 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540701547738038271", 2024-04-26T23:48:18.773 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2024-04-26T23:48:18.773 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-04-26T23:48:18.773 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-04-26T23:48:18.773 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-04-26T23:48:18.773 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-04-26T23:48:18.773 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-04-26T23:48:18.773 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-04-26T23:48:18.773 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-04-26T23:48:18.773 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-04-26T23:48:18.773 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-04-26T23:48:18.773 INFO:teuthology.orchestra.run.smithi088.stdout: "reef", 2024-04-26T23:48:18.773 INFO:teuthology.orchestra.run.smithi088.stdout: "squid" 2024-04-26T23:48:18.774 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:48:18.774 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:48:18.774 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2024-04-26T23:48:18.774 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2024-04-26T23:48:18.774 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2024-04-26T23:48:18.774 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2024-04-26T23:48:18.774 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2024-04-26T23:48:18.774 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "555255e9-7ef9-4454-8dc9-35e96b70035c", 2024-04-26T23:48:18.774 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2024-04-26T23:39:34.291658Z", 2024-04-26T23:48:18.774 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2024-04-26T23:39:34.291658Z", 2024-04-26T23:48:18.774 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 19, 2024-04-26T23:48:18.774 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "squid", 2024-04-26T23:48:18.774 INFO:teuthology.orchestra.run.smithi088.stdout: "election_strategy": 1, 2024-04-26T23:48:18.775 INFO:teuthology.orchestra.run.smithi088.stdout: "disallowed_leaders: ": "", 2024-04-26T23:48:18.775 INFO:teuthology.orchestra.run.smithi088.stdout: "stretch_mode": false, 2024-04-26T23:48:18.775 INFO:teuthology.orchestra.run.smithi088.stdout: "tiebreaker_mon": "", 2024-04-26T23:48:18.775 INFO:teuthology.orchestra.run.smithi088.stdout: "removed_ranks: ": "", 2024-04-26T23:48:18.775 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2024-04-26T23:48:18.775 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2024-04-26T23:48:18.775 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-04-26T23:48:18.775 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-04-26T23:48:18.775 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-04-26T23:48:18.775 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-04-26T23:48:18.776 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-04-26T23:48:18.776 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-04-26T23:48:18.776 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-04-26T23:48:18.776 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-04-26T23:48:18.776 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-04-26T23:48:18.776 INFO:teuthology.orchestra.run.smithi088.stdout: "reef", 2024-04-26T23:48:18.776 INFO:teuthology.orchestra.run.smithi088.stdout: "squid" 2024-04-26T23:48:18.776 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:48:18.776 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2024-04-26T23:48:18.776 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:48:18.776 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2024-04-26T23:48:18.776 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:48:18.776 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2024-04-26T23:48:18.776 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2024-04-26T23:48:18.776 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-04-26T23:48:18.777 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-04-26T23:48:18.777 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:48:18.777 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-04-26T23:48:18.777 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2024-04-26T23:48:18.777 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:48:18.777 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:48:18.777 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:48:18.777 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-04-26T23:48:18.777 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2024-04-26T23:48:18.777 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:48:18.777 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:48:18.778 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:48:18.778 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:48:18.778 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2024-04-26T23:48:18.778 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2024-04-26T23:48:18.778 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-04-26T23:48:18.778 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-04-26T23:48:18.778 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-04-26T23:48:18.778 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:48:18.778 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:48:18.778 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2024-04-26T23:48:18.778 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2024-04-26T23:48:18.778 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-04-26T23:48:18.779 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-04-26T23:48:18.779 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:48:18.779 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-04-26T23:48:18.779 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:3300", 2024-04-26T23:48:18.779 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:48:18.779 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:48:18.779 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:48:18.779 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-04-26T23:48:18.779 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6789", 2024-04-26T23:48:18.779 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:48:18.780 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:48:18.780 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:48:18.780 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:48:18.780 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6789/0", 2024-04-26T23:48:18.780 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.175:6789/0", 2024-04-26T23:48:18.780 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-04-26T23:48:18.780 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-04-26T23:48:18.780 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-04-26T23:48:18.780 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:48:18.780 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:48:18.780 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2024-04-26T23:48:18.780 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2024-04-26T23:48:18.780 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-04-26T23:48:18.781 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-04-26T23:48:18.781 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:48:18.781 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-04-26T23:48:18.781 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:3301", 2024-04-26T23:48:18.781 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:48:18.781 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:48:18.781 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:48:18.781 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-04-26T23:48:18.781 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6790", 2024-04-26T23:48:18.781 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:48:18.782 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:48:18.782 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:48:18.782 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:48:18.782 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6790/0", 2024-04-26T23:48:18.782 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.175:6790/0", 2024-04-26T23:48:18.782 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-04-26T23:48:18.782 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-04-26T23:48:18.782 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-04-26T23:48:18.782 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:48:18.782 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:48:18.782 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:48:18.783 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2024-04-26T23:48:18.783 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2024-04-26T23:48:18.783 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:48:18.783 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:48:18.783 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:48:18.783 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2024-04-26T23:48:18.783 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:48:18.783 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:48:18.783 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2024-04-26T23:48:18.783 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:48:18.783 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:48:18.784 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:48:18.784 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2024-04-26T23:48:18.784 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:48:18.784 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:48:18.784 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:48:18.784 INFO:teuthology.orchestra.run.smithi088.stdout: "stretch_mode": false 2024-04-26T23:48:18.784 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-04-26T23:48:18.785 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:18.772+0000 7fc87b7fe640 1 -- 172.21.15.88:0/321326222 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fc87c06c8f0 msgr2=0x7fc87c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:18.785 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:18.772+0000 7fc87b7fe640 1 --2- 172.21.15.88:0/321326222 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fc87c06c8f0 0x7fc87c06edb0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fc894009eb0 tx=0x7fc894009190 comp rx=0 tx=0).stop 2024-04-26T23:48:18.785 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:18.772+0000 7fc89da95640 1 -- 172.21.15.88:0/321326222 reap_dead start 2024-04-26T23:48:18.785 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:18.772+0000 7fc87b7fe640 1 -- 172.21.15.88:0/321326222 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc890049f40 msgr2=0x7fc8900310e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:18.785 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:18.772+0000 7fc87b7fe640 1 --2- 172.21.15.88:0/321326222 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc890049f40 0x7fc8900310e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fc88800c390 tx=0x7fc88800c850 comp rx=0 tx=0).stop 2024-04-26T23:48:18.786 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:18.774+0000 7fc87b7fe640 1 -- 172.21.15.88:0/321326222 shutdown_connections 2024-04-26T23:48:18.786 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:18.774+0000 7fc87b7fe640 1 --2- 172.21.15.88:0/321326222 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc890049f40 0x7fc8900310e0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:18.786 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:18.774+0000 7fc87b7fe640 1 -- 172.21.15.88:0/321326222 >> 172.21.15.88:0/321326222 conn(0x7fc890048ac0 msgr2=0x7fc8900d9090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:48:18.786 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:18.775+0000 7fc87b7fe640 1 -- 172.21.15.88:0/321326222 shutdown_connections 2024-04-26T23:48:18.786 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:18.775+0000 7fc87b7fe640 1 -- 172.21.15.88:0/321326222 wait complete. 2024-04-26T23:48:18.803 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-04-26T23:48:18.803 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-04-26T23:48:18.803 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-04-26T23:48:19.031 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:19.027+0000 7f0375b2c640 1 Processor -- start 2024-04-26T23:48:19.031 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:19.027+0000 7f0375b2c640 1 -- start start 2024-04-26T23:48:19.032 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:19.028+0000 7f0375b2c640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f037014d980 0x7f03700c3ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:19.032 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:19.028+0000 7f0375b2c640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f03700c6900 0x7f037006d320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:19.032 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:19.028+0000 7f0375b2c640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f03700ae870 con 0x7f037006f1a0 2024-04-26T23:48:19.032 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:19.028+0000 7f0375b2c640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f03700c4d00 con 0x7f03700c6900 2024-04-26T23:48:19.032 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:19.028+0000 7f0375b2c640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f03701537f0 con 0x7f037014d980 2024-04-26T23:48:19.033 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:19.029+0000 7f036effd640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f037006f1a0 0x7f0370153fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.88:50146/0 (socket says 172.21.15.88:50146) 2024-04-26T23:48:19.033 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:19.029+0000 7f036effd640 1 -- 172.21.15.88:0/1742274263 learned_addr learned my addr 172.21.15.88:0/1742274263 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-26T23:48:19.033 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:19.030+0000 7f036ffff640 1 --2- 172.21.15.88:0/1742274263 >> v2:172.21.15.175:3300/0 conn(0x7f03700c6900 0x7f037006d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:19.033 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:19.030+0000 7f036f7fe640 1 --2- 172.21.15.88:0/1742274263 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f037014d980 0x7f03700c3ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:19.034 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:19.030+0000 7f036ffff640 1 -- 172.21.15.88:0/1742274263 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f037014d980 msgr2=0x7f03700c3ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:48:19.034 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:19.030+0000 7f036ffff640 1 --2- 172.21.15.88:0/1742274263 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f037014d980 0x7f03700c3ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:19.034 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:19.030+0000 7f036ffff640 1 -- 172.21.15.88:0/1742274263 >> v1:172.21.15.175:6789/0 conn(0x7f037006f1a0 legacy=0x7f0370153fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:19.035 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:19.030+0000 7f036ffff640 1 -- 172.21.15.88:0/1742274263 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03701546e0 con 0x7f03700c6900 2024-04-26T23:48:19.035 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:19.031+0000 7f036ffff640 1 --2- 172.21.15.88:0/1742274263 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f03700c6900 0x7f037006d320 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f03600097a0 tx=0x7f036002c320 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ad754b75298b06 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:48:19.035 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:19.032+0000 7f036e7fc640 1 -- 172.21.15.88:0/1742274263 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0360039070 con 0x7f03700c6900 2024-04-26T23:48:19.036 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:19.032+0000 7f036e7fc640 1 -- 172.21.15.88:0/1742274263 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0360034640 con 0x7f03700c6900 2024-04-26T23:48:19.036 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:19.033+0000 7f0375b2c640 1 -- 172.21.15.88:0/1742274263 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f03700c6900 msgr2=0x7f037006d320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:19.037 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:19.033+0000 7f0375b2c640 1 --2- 172.21.15.88:0/1742274263 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f03700c6900 0x7f037006d320 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f03600097a0 tx=0x7f036002c320 comp rx=0 tx=0).stop 2024-04-26T23:48:19.037 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:19.034+0000 7f0375b2c640 1 -- 172.21.15.88:0/1742274263 shutdown_connections 2024-04-26T23:48:19.038 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:19.034+0000 7f0375b2c640 1 --2- 172.21.15.88:0/1742274263 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f03700c6900 0x7f037006d320 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:19.038 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:19.034+0000 7f0375b2c640 1 --2- 172.21.15.88:0/1742274263 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f037014d980 0x7f03700c3ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:19.038 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:19.034+0000 7f0375b2c640 1 -- 172.21.15.88:0/1742274263 >> 172.21.15.88:0/1742274263 conn(0x7f03700c5de0 msgr2=0x7f03700c61f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:48:19.043 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:19.038+0000 7f0375b2c640 1 -- 172.21.15.88:0/1742274263 shutdown_connections 2024-04-26T23:48:19.043 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:19.038+0000 7f0375b2c640 1 -- 172.21.15.88:0/1742274263 wait complete. 2024-04-26T23:48:19.043 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:19.040+0000 7f0375b2c640 1 Processor -- start 2024-04-26T23:48:19.043 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:19.040+0000 7f0375b2c640 1 -- start start 2024-04-26T23:48:19.045 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:19.041+0000 7f0375b2c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f037006f1a0 0x7f03701574b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:19.046 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:19.042+0000 7f036f7fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f037006f1a0 0x7f03701574b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:19.046 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:19.042+0000 7f036f7fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f037006f1a0 0x7f03701574b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:46952/0 (socket says 172.21.15.88:46952) 2024-04-26T23:48:19.046 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:19.042+0000 7f036f7fe640 1 -- 172.21.15.88:0/2866930218 learned_addr learned my addr 172.21.15.88:0/2866930218 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:48:19.046 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:19.042+0000 7f0375b2c640 1 --2- 172.21.15.88:0/2866930218 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f03700c6900 0x7f03701eb770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:19.046 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:19.042+0000 7f0375b2c640 1 --2- 172.21.15.88:0/2866930218 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f037014d980 0x7f03701fc580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:19.046 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:19.042+0000 7f0375b2c640 1 -- 172.21.15.88:0/2866930218 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f0370153ab0 con 0x7f037006f1a0 2024-04-26T23:48:19.046 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:19.042+0000 7f0375b2c640 1 -- 172.21.15.88:0/2866930218 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f03700c5970 con 0x7f03700c6900 2024-04-26T23:48:19.046 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:19.042+0000 7f0375b2c640 1 -- 172.21.15.88:0/2866930218 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f03700ac390 con 0x7f037014d980 2024-04-26T23:48:19.046 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:19.042+0000 7f036ffff640 1 --2- 172.21.15.88:0/2866930218 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f037014d980 0x7f03701fc580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:19.048 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:19.043+0000 7f036f7fe640 1 -- 172.21.15.88:0/2866930218 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f037014d980 msgr2=0x7f03701fc580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:19.048 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:19.043+0000 7f036f7fe640 1 --2- 172.21.15.88:0/2866930218 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f037014d980 0x7f03701fc580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:19.048 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:19.043+0000 7f036f7fe640 1 -- 172.21.15.88:0/2866930218 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f03700c6900 msgr2=0x7f03701eb770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:19.048 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:19.043+0000 7f036f7fe640 1 --2- 172.21.15.88:0/2866930218 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f03700c6900 0x7f03701eb770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:19.048 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:19.043+0000 7f036f7fe640 1 -- 172.21.15.88:0/2866930218 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0370156400 con 0x7f037006f1a0 2024-04-26T23:48:19.048 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:19.044+0000 7f036f7fe640 1 --2- 172.21.15.88:0/2866930218 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f037006f1a0 0x7f03701574b0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f036400ec10 tx=0x7f036400c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:48:19.048 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:19.044+0000 7f036ffff640 1 --2- 172.21.15.88:0/2866930218 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f037014d980 0x7f03701fc580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:48:19.048 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:19.044+0000 7f0357fff640 1 -- 172.21.15.88:0/2866930218 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0364017070 con 0x7f037006f1a0 2024-04-26T23:48:19.048 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:19.044+0000 7f0357fff640 1 -- 172.21.15.88:0/2866930218 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f036400ed00 con 0x7f037006f1a0 2024-04-26T23:48:19.049 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:19.044+0000 7f0357fff640 1 -- 172.21.15.88:0/2866930218 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f036400ce50 con 0x7f037006f1a0 2024-04-26T23:48:19.049 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:19.045+0000 7f0375b2c640 1 -- 172.21.15.88:0/2866930218 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03701566a0 con 0x7f037006f1a0 2024-04-26T23:48:19.049 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:19.046+0000 7f0375b2c640 1 -- 172.21.15.88:0/2866930218 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0370157a90 con 0x7f037006f1a0 2024-04-26T23:48:19.051 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:19.048+0000 7f0355ffb640 1 --2- 172.21.15.88:0/2866930218 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f037006dd30 0x7f03700c6ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:19.052 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:19.048+0000 7f0355ffb640 1 -- 172.21.15.88:0/2866930218 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f0370074b10 con 0x7f037006dd30 2024-04-26T23:48:19.054 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:19.050+0000 7f036effd640 1 --2- 172.21.15.88:0/2866930218 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f037006dd30 0x7f03700c6ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:19.054 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:19.051+0000 7f0357fff640 1 -- 172.21.15.88:0/2866930218 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f036401a070 con 0x7f037006f1a0 2024-04-26T23:48:19.054 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:19.051+0000 7f036effd640 1 -- 172.21.15.88:0/2866930218 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f03700507a0 con 0x7f037006dd30 2024-04-26T23:48:19.054 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:19.051+0000 7f036effd640 1 --2- 172.21.15.88:0/2866930218 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f037006dd30 0x7f03700c6ed0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f036800ca60 tx=0x7f036800cf20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:48:19.055 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:19.052+0000 7f0357fff640 1 --2- 172.21.15.88:0/2866930218 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f035c06c9c0 0x7f035c06ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:19.055 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:19.052+0000 7f036ffff640 1 --2- 172.21.15.88:0/2866930218 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f035c06c9c0 0x7f035c06ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:19.056 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:19.053+0000 7f0357fff640 1 -- 172.21.15.88:0/2866930218 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6666+0+0 (secure 0 0 0) 0x7f036408c1b0 con 0x7f037006f1a0 2024-04-26T23:48:19.057 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:19.053+0000 7f036ffff640 1 --2- 172.21.15.88:0/2866930218 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f035c06c9c0 0x7f035c06ee80 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f0360036000 tx=0x7f0360030000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:48:19.057 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:19.053+0000 7f0357fff640 1 -- 172.21.15.88:0/2866930218 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0368017070 con 0x7f037006dd30 2024-04-26T23:48:19.057 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:19.053+0000 7f0357fff640 1 -- 172.21.15.88:0/2866930218 <== mon.2 v2:172.21.15.175:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f036800abf0 con 0x7f037006dd30 2024-04-26T23:48:19.057 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:19.054+0000 7f0357fff640 1 -- 172.21.15.88:0/2866930218 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f037006dd30 msgr2=0x7f03700c6ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:19.058 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:19.054+0000 7f0357fff640 1 --2- 172.21.15.88:0/2866930218 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f037006dd30 0x7f03700c6ed0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f036800ca60 tx=0x7f036800cf20 comp rx=0 tx=0).stop 2024-04-26T23:48:19.058 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:19.054+0000 7f0357fff640 1 -- 172.21.15.88:0/2866930218 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f037006dd30 msgr2=0x7f03700c6ed0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:48:19.058 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:19.054+0000 7f0357fff640 1 --2- 172.21.15.88:0/2866930218 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f037006dd30 0x7f03700c6ed0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:19.071 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:19.067+0000 7f0355ffb640 1 --2- 172.21.15.88:0/2866930218 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f03700c7410 0x7f03700c77f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:19.071 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:19.068+0000 7f0355ffb640 1 -- 172.21.15.88:0/2866930218 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f03700c7d30 con 0x7f03700c7410 2024-04-26T23:48:19.075 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:19.070+0000 7f036effd640 1 --2- 172.21.15.88:0/2866930218 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f03700c7410 0x7f03700c77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:19.077 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:19.074+0000 7f036effd640 1 -- 172.21.15.88:0/2866930218 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f03700c52b0 con 0x7f03700c7410 2024-04-26T23:48:19.078 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:19.074+0000 7f036effd640 1 --2- 172.21.15.88:0/2866930218 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f03700c7410 0x7f03700c77f0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f03701ebf30 tx=0x7f0368005b70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:48:19.080 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:19.076+0000 7f0357fff640 1 -- 172.21.15.88:0/2866930218 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0368017040 con 0x7f03700c7410 2024-04-26T23:48:19.080 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:19.076+0000 7f0357fff640 1 -- 172.21.15.88:0/2866930218 <== mon.2 v2:172.21.15.175:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5208 (secure 0 0 0) 0x7f036800ae90 con 0x7f03700c7410 2024-04-26T23:48:19.080 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:19.077+0000 7f0357fff640 1 -- 172.21.15.88:0/2866930218 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f03700c7410 msgr2=0x7f03700c77f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:19.080 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:19.077+0000 7f0357fff640 1 --2- 172.21.15.88:0/2866930218 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f03700c7410 0x7f03700c77f0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f03701ebf30 tx=0x7f0368005b70 comp rx=0 tx=0).stop 2024-04-26T23:48:19.080 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:19.077+0000 7f0357fff640 1 -- 172.21.15.88:0/2866930218 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f03700c7410 msgr2=0x7f03700c77f0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:48:19.080 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:19.077+0000 7f0357fff640 1 --2- 172.21.15.88:0/2866930218 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f03700c7410 0x7f03700c77f0 secure :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f03701ebf30 tx=0x7f0368005b70 comp rx=0 tx=0).stop 2024-04-26T23:48:19.081 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-04-26T23:48:19.081 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2024-04-26T23:48:19.081 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2024-04-26T23:48:19.081 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "peon", 2024-04-26T23:48:19.081 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 76, 2024-04-26T23:48:19.081 INFO:teuthology.orchestra.run.smithi088.stdout: "uptime": 267361, 2024-04-26T23:48:19.081 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2024-04-26T23:48:19.081 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2024-04-26T23:48:19.081 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2024-04-26T23:48:19.081 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2024-04-26T23:48:19.081 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:48:19.081 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 4, 2024-04-26T23:48:19.082 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2024-04-26T23:48:19.082 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2450521708007866372", 2024-04-26T23:48:19.082 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2024-04-26T23:48:19.082 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-04-26T23:48:19.082 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-04-26T23:48:19.082 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-04-26T23:48:19.082 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-04-26T23:48:19.082 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-04-26T23:48:19.082 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-04-26T23:48:19.082 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-04-26T23:48:19.082 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-04-26T23:48:19.082 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-04-26T23:48:19.082 INFO:teuthology.orchestra.run.smithi088.stdout: "reef", 2024-04-26T23:48:19.083 INFO:teuthology.orchestra.run.smithi088.stdout: "squid" 2024-04-26T23:48:19.083 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:48:19.083 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540701547738038271", 2024-04-26T23:48:19.083 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2024-04-26T23:48:19.083 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-04-26T23:48:19.083 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-04-26T23:48:19.083 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-04-26T23:48:19.083 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-04-26T23:48:19.083 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-04-26T23:48:19.083 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-04-26T23:48:19.083 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-04-26T23:48:19.083 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-04-26T23:48:19.083 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-04-26T23:48:19.083 INFO:teuthology.orchestra.run.smithi088.stdout: "reef", 2024-04-26T23:48:19.083 INFO:teuthology.orchestra.run.smithi088.stdout: "squid" 2024-04-26T23:48:19.084 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:48:19.084 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:48:19.084 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2024-04-26T23:48:19.084 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2024-04-26T23:48:19.084 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2024-04-26T23:48:19.084 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2024-04-26T23:48:19.084 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2024-04-26T23:48:19.084 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "555255e9-7ef9-4454-8dc9-35e96b70035c", 2024-04-26T23:48:19.084 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2024-04-26T23:39:34.291658Z", 2024-04-26T23:48:19.084 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2024-04-26T23:39:34.291658Z", 2024-04-26T23:48:19.084 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 19, 2024-04-26T23:48:19.084 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "squid", 2024-04-26T23:48:19.084 INFO:teuthology.orchestra.run.smithi088.stdout: "election_strategy": 1, 2024-04-26T23:48:19.084 INFO:teuthology.orchestra.run.smithi088.stdout: "disallowed_leaders: ": "", 2024-04-26T23:48:19.085 INFO:teuthology.orchestra.run.smithi088.stdout: "stretch_mode": false, 2024-04-26T23:48:19.085 INFO:teuthology.orchestra.run.smithi088.stdout: "tiebreaker_mon": "", 2024-04-26T23:48:19.085 INFO:teuthology.orchestra.run.smithi088.stdout: "removed_ranks: ": "", 2024-04-26T23:48:19.085 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2024-04-26T23:48:19.085 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2024-04-26T23:48:19.085 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-04-26T23:48:19.085 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-04-26T23:48:19.085 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-04-26T23:48:19.085 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-04-26T23:48:19.085 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-04-26T23:48:19.085 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-04-26T23:48:19.085 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-04-26T23:48:19.085 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-04-26T23:48:19.085 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-04-26T23:48:19.086 INFO:teuthology.orchestra.run.smithi088.stdout: "reef", 2024-04-26T23:48:19.086 INFO:teuthology.orchestra.run.smithi088.stdout: "squid" 2024-04-26T23:48:19.086 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:48:19.086 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2024-04-26T23:48:19.086 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:48:19.086 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2024-04-26T23:48:19.086 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:48:19.086 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2024-04-26T23:48:19.086 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2024-04-26T23:48:19.086 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-04-26T23:48:19.086 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-04-26T23:48:19.086 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:48:19.086 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-04-26T23:48:19.087 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2024-04-26T23:48:19.087 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:48:19.087 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:48:19.087 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:48:19.087 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-04-26T23:48:19.087 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2024-04-26T23:48:19.087 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:48:19.087 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:48:19.087 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:48:19.087 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:48:19.087 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2024-04-26T23:48:19.087 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2024-04-26T23:48:19.087 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-04-26T23:48:19.087 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-04-26T23:48:19.088 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-04-26T23:48:19.088 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:48:19.088 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:48:19.088 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2024-04-26T23:48:19.088 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2024-04-26T23:48:19.088 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-04-26T23:48:19.088 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-04-26T23:48:19.088 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:48:19.088 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-04-26T23:48:19.088 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:3300", 2024-04-26T23:48:19.088 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:48:19.088 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:48:19.088 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:48:19.088 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-04-26T23:48:19.089 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6789", 2024-04-26T23:48:19.089 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:48:19.089 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:48:19.089 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:48:19.089 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:48:19.089 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6789/0", 2024-04-26T23:48:19.089 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.175:6789/0", 2024-04-26T23:48:19.089 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-04-26T23:48:19.089 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-04-26T23:48:19.089 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-04-26T23:48:19.089 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:48:19.089 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:48:19.089 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2024-04-26T23:48:19.089 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2024-04-26T23:48:19.090 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-04-26T23:48:19.090 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-04-26T23:48:19.090 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:48:19.090 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-04-26T23:48:19.090 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:3301", 2024-04-26T23:48:19.090 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:48:19.090 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:48:19.090 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:48:19.090 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-04-26T23:48:19.090 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6790", 2024-04-26T23:48:19.090 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:48:19.090 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:48:19.090 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:48:19.090 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:48:19.091 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6790/0", 2024-04-26T23:48:19.091 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.175:6790/0", 2024-04-26T23:48:19.091 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-04-26T23:48:19.091 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-04-26T23:48:19.091 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-04-26T23:48:19.091 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:48:19.091 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:48:19.091 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:48:19.091 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2024-04-26T23:48:19.091 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2024-04-26T23:48:19.091 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:48:19.091 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:48:19.091 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:48:19.091 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2024-04-26T23:48:19.092 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:48:19.092 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:48:19.092 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": [ 2024-04-26T23:48:19.092 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:48:19.092 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:48:19.092 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:48:19.092 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 4 2024-04-26T23:48:19.092 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:48:19.092 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:48:19.092 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": [ 2024-04-26T23:48:19.092 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:48:19.092 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:48:19.092 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:48:19.092 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 8 2024-04-26T23:48:19.092 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:48:19.093 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:48:19.093 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2024-04-26T23:48:19.093 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:48:19.093 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x2f018fb87aa4aafe", 2024-04-26T23:48:19.093 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:48:19.093 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2024-04-26T23:48:19.093 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:48:19.093 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:48:19.093 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:48:19.093 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:48:19.093 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 5 2024-04-26T23:48:19.093 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:48:19.093 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:48:19.093 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": [ 2024-04-26T23:48:19.094 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:48:19.094 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:48:19.094 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:48:19.094 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2024-04-26T23:48:19.094 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:48:19.094 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:48:19.094 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:48:19.094 INFO:teuthology.orchestra.run.smithi088.stdout: "stretch_mode": false 2024-04-26T23:48:19.094 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-04-26T23:48:19.095 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:19.077+0000 7f0375b2c640 1 -- 172.21.15.88:0/2866930218 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f035c06c9c0 msgr2=0x7f035c06ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:19.095 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:19.077+0000 7f0375b2c640 1 --2- 172.21.15.88:0/2866930218 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f035c06c9c0 0x7f035c06ee80 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f0360036000 tx=0x7f0360030000 comp rx=0 tx=0).stop 2024-04-26T23:48:19.095 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:19.077+0000 7f036ffff640 1 -- 172.21.15.88:0/2866930218 reap_dead start 2024-04-26T23:48:19.095 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:19.077+0000 7f0375b2c640 1 -- 172.21.15.88:0/2866930218 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f037006f1a0 msgr2=0x7f03701574b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:19.095 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:19.077+0000 7f0375b2c640 1 --2- 172.21.15.88:0/2866930218 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f037006f1a0 0x7f03701574b0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f036400ec10 tx=0x7f036400c520 comp rx=0 tx=0).stop 2024-04-26T23:48:19.095 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:19.078+0000 7f0375b2c640 1 -- 172.21.15.88:0/2866930218 shutdown_connections 2024-04-26T23:48:19.095 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:19.078+0000 7f0375b2c640 1 --2- 172.21.15.88:0/2866930218 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f037006f1a0 0x7f03701574b0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:19.095 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:19.078+0000 7f0375b2c640 1 -- 172.21.15.88:0/2866930218 >> 172.21.15.88:0/2866930218 conn(0x7f03700c5de0 msgr2=0x7f037006d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:48:19.095 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:19.081+0000 7f0375b2c640 1 -- 172.21.15.88:0/2866930218 shutdown_connections 2024-04-26T23:48:19.096 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:19.081+0000 7f0375b2c640 1 -- 172.21.15.88:0/2866930218 wait complete. 2024-04-26T23:48:19.113 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-04-26T23:48:19.114 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2024-04-26T23:48:19.114 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2024-04-26T23:48:19.294 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:19.291+0000 7fed99874640 1 Processor -- start 2024-04-26T23:48:19.296 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:19.292+0000 7fed99874640 1 -- start start 2024-04-26T23:48:19.296 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:19.293+0000 7fed99874640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fed94150fa0 0x7fed9406d320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:19.296 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:19.293+0000 7fed99874640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fed94156e40 0x7fed9406f540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:19.296 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:19.293+0000 7fed99874640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fed94153a40 con 0x7fed9406d860 2024-04-26T23:48:19.296 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:19.293+0000 7fed99874640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7fed94070ab0 con 0x7fed94150fa0 2024-04-26T23:48:19.296 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:19.293+0000 7fed99874640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fed94153d20 con 0x7fed94156e40 2024-04-26T23:48:19.298 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:19.294+0000 7fed92ffd640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fed94150fa0 0x7fed9406d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:19.298 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:19.294+0000 7fed937fe640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fed9406d860 0x7fed9406fa80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:59122/0 (socket says 172.21.15.88:59122) 2024-04-26T23:48:19.298 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:19.294+0000 7fed937fe640 1 -- 172.21.15.88:0/3255604113 learned_addr learned my addr 172.21.15.88:0/3255604113 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-26T23:48:19.299 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:19.294+0000 7fed91ffb640 1 -- 172.21.15.88:0/3255604113 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1535693671 0 0) 0x7fed94153a40 con 0x7fed9406d860 2024-04-26T23:48:19.299 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:19.294+0000 7fed91ffb640 1 -- 172.21.15.88:0/3255604113 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fed7c003520 con 0x7fed9406d860 2024-04-26T23:48:19.299 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:19.294+0000 7fed91ffb640 1 -- 172.21.15.88:0/3255604113 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3626130091 0 0) 0x7fed7c003520 con 0x7fed9406d860 2024-04-26T23:48:19.299 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:19.294+0000 7fed92ffd640 1 -- 172.21.15.88:0/3255604113 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fed94156e40 msgr2=0x7fed9406f540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:48:19.299 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:19.294+0000 7fed92ffd640 1 --2- 172.21.15.88:0/3255604113 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fed94156e40 0x7fed9406f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:19.299 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:19.295+0000 7fed92ffd640 1 -- 172.21.15.88:0/3255604113 >> v1:172.21.15.88:6789/0 conn(0x7fed9406d860 legacy=0x7fed9406fa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:19.299 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:19.295+0000 7fed92ffd640 1 -- 172.21.15.88:0/3255604113 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed94154000 con 0x7fed94150fa0 2024-04-26T23:48:19.299 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:19.296+0000 7fed92ffd640 1 --2- 172.21.15.88:0/3255604113 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fed94150fa0 0x7fed9406d320 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fed880097a0 tx=0x7fed8802a080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfaeb00a6c97e9c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:48:19.300 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:19.296+0000 7fed91ffb640 1 -- 172.21.15.88:0/3255604113 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed88037070 con 0x7fed94150fa0 2024-04-26T23:48:19.300 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:19.296+0000 7fed91ffb640 1 -- 172.21.15.88:0/3255604113 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed8802ab10 con 0x7fed94150fa0 2024-04-26T23:48:19.301 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:19.296+0000 7fed91ffb640 1 -- 172.21.15.88:0/3255604113 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed84001670 con 0x7fed94150fa0 2024-04-26T23:48:19.302 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:19.298+0000 7fed99874640 1 -- 172.21.15.88:0/3255604113 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fed94150fa0 msgr2=0x7fed9406d320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:19.302 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:19.298+0000 7fed99874640 1 --2- 172.21.15.88:0/3255604113 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fed94150fa0 0x7fed9406d320 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fed880097a0 tx=0x7fed8802a080 comp rx=0 tx=0).stop 2024-04-26T23:48:19.302 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:19.298+0000 7fed99874640 1 -- 172.21.15.88:0/3255604113 shutdown_connections 2024-04-26T23:48:19.303 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:19.298+0000 7fed99874640 1 --2- 172.21.15.88:0/3255604113 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fed94156e40 0x7fed9406f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:19.303 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:19.298+0000 7fed99874640 1 --2- 172.21.15.88:0/3255604113 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fed94150fa0 0x7fed9406d320 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:19.303 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:19.298+0000 7fed99874640 1 -- 172.21.15.88:0/3255604113 >> 172.21.15.88:0/3255604113 conn(0x7fed940c5ce0 msgr2=0x7fed940c60c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:48:19.308 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:19.303+0000 7fed99874640 1 -- 172.21.15.88:0/3255604113 shutdown_connections 2024-04-26T23:48:19.308 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:19.303+0000 7fed99874640 1 -- 172.21.15.88:0/3255604113 wait complete. 2024-04-26T23:48:19.308 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:19.304+0000 7fed99874640 1 Processor -- start 2024-04-26T23:48:19.311 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:19.305+0000 7fed99874640 1 -- start start 2024-04-26T23:48:19.311 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:19.306+0000 7fed99874640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fed9406d860 0x7fed9413be10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:19.311 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:19.306+0000 7fed92ffd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fed9406d860 0x7fed9413be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:19.311 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:19.306+0000 7fed92ffd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fed9406d860 0x7fed9413be10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:46976/0 (socket says 172.21.15.88:46976) 2024-04-26T23:48:19.311 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:19.306+0000 7fed92ffd640 1 -- 172.21.15.88:0/1138737533 learned_addr learned my addr 172.21.15.88:0/1138737533 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:48:19.311 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:19.306+0000 7fed99874640 1 --2- 172.21.15.88:0/1138737533 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fed94150fa0 0x7fed9414c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:19.311 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:19.306+0000 7fed99874640 1 --2- 172.21.15.88:0/1138737533 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fed94156e40 0x7fed94146fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:19.311 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:19.306+0000 7fed99874640 1 -- 172.21.15.88:0/1138737533 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fed94070190 con 0x7fed9406d860 2024-04-26T23:48:19.311 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:19.306+0000 7fed99874640 1 -- 172.21.15.88:0/1138737533 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fed941545c0 con 0x7fed94150fa0 2024-04-26T23:48:19.312 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:19.306+0000 7fed99874640 1 -- 172.21.15.88:0/1138737533 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fed94070ce0 con 0x7fed94156e40 2024-04-26T23:48:19.312 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:19.307+0000 7fed92ffd640 1 -- 172.21.15.88:0/1138737533 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fed94156e40 msgr2=0x7fed94146fb0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T23:48:19.312 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:19.307+0000 7fed92ffd640 1 --2- 172.21.15.88:0/1138737533 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fed94156e40 0x7fed94146fb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:19.312 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:19.307+0000 7fed92ffd640 1 -- 172.21.15.88:0/1138737533 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fed94150fa0 msgr2=0x7fed9414c9b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T23:48:19.312 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:19.307+0000 7fed92ffd640 1 --2- 172.21.15.88:0/1138737533 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fed94150fa0 0x7fed9414c9b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:19.312 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:19.307+0000 7fed92ffd640 1 -- 172.21.15.88:0/1138737533 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed94154dc0 con 0x7fed9406d860 2024-04-26T23:48:19.312 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:19.307+0000 7fed92ffd640 1 --2- 172.21.15.88:0/1138737533 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fed9406d860 0x7fed9413be10 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fed880098c0 tx=0x7fed880046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:48:19.313 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:19.309+0000 7fed7bfff640 1 -- 172.21.15.88:0/1138737533 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed88042020 con 0x7fed9406d860 2024-04-26T23:48:19.313 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:19.309+0000 7fed7bfff640 1 -- 172.21.15.88:0/1138737533 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed8803d730 con 0x7fed9406d860 2024-04-26T23:48:19.313 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:19.309+0000 7fed7bfff640 1 -- 172.21.15.88:0/1138737533 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed88037040 con 0x7fed9406d860 2024-04-26T23:48:19.313 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:19.309+0000 7fed99874640 1 -- 172.21.15.88:0/1138737533 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed940ae690 con 0x7fed9406d860 2024-04-26T23:48:19.313 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:19.309+0000 7fed99874640 1 -- 172.21.15.88:0/1138737533 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed94156510 con 0x7fed9406d860 2024-04-26T23:48:19.315 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:19.312+0000 7fed99874640 1 -- 172.21.15.88:0/1138737533 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed74005290 con 0x7fed9406d860 2024-04-26T23:48:19.320 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:19.316+0000 7fed7bfff640 1 -- 172.21.15.88:0/1138737533 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fed88045020 con 0x7fed9406d860 2024-04-26T23:48:19.320 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:19.316+0000 7fed7bfff640 1 --2- 172.21.15.88:0/1138737533 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fed8006c9c0 0x7fed8006ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:19.320 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:19.316+0000 7fed7bfff640 1 -- 172.21.15.88:0/1138737533 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6666+0+0 (secure 0 0 0) 0x7fed880aca00 con 0x7fed9406d860 2024-04-26T23:48:19.320 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:19.317+0000 7fed927fc640 1 --2- 172.21.15.88:0/1138737533 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fed8006c9c0 0x7fed8006ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:19.321 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:19.318+0000 7fed927fc640 1 --2- 172.21.15.88:0/1138737533 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fed8006c9c0 0x7fed8006ee80 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fed941647c0 tx=0x7fed8c009250 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:48:19.327 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:19.323+0000 7fed7bfff640 1 -- 172.21.15.88:0/1138737533 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fed8804c030 con 0x7fed9406d860 2024-04-26T23:48:19.853 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:19.849+0000 7fed99874640 1 -- 172.21.15.88:0/1138737533 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7fed74005d90 con 0x7fed9406d860 2024-04-26T23:48:19.854 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:19.851+0000 7fed7bfff640 1 -- 172.21.15.88:0/1138737533 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (secure 0 0 0) 0x7fed8807aae0 con 0x7fed9406d860 2024-04-26T23:48:19.859 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:19.855+0000 7fed99874640 1 -- 172.21.15.88:0/1138737533 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fed8006c9c0 msgr2=0x7fed8006ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:19.859 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:19.855+0000 7fed99874640 1 --2- 172.21.15.88:0/1138737533 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fed8006c9c0 0x7fed8006ee80 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fed941647c0 tx=0x7fed8c009250 comp rx=0 tx=0).stop 2024-04-26T23:48:19.859 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:19.855+0000 7fed99874640 1 -- 172.21.15.88:0/1138737533 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fed9406d860 msgr2=0x7fed9413be10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:19.859 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:19.855+0000 7fed99874640 1 --2- 172.21.15.88:0/1138737533 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fed9406d860 0x7fed9413be10 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fed880098c0 tx=0x7fed880046c0 comp rx=0 tx=0).stop 2024-04-26T23:48:19.859 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:19.856+0000 7fed99874640 1 -- 172.21.15.88:0/1138737533 shutdown_connections 2024-04-26T23:48:19.859 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:19.856+0000 7fed99874640 1 --2- 172.21.15.88:0/1138737533 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fed8006c9c0 0x7fed8006ee80 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:19.859 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:19.856+0000 7fed99874640 1 --2- 172.21.15.88:0/1138737533 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fed94156e40 0x7fed94146fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:19.859 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:19.856+0000 7fed99874640 1 --2- 172.21.15.88:0/1138737533 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fed94150fa0 0x7fed9414c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:19.859 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:19.856+0000 7fed99874640 1 --2- 172.21.15.88:0/1138737533 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fed9406d860 0x7fed9413be10 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:19.859 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:19.856+0000 7fed99874640 1 -- 172.21.15.88:0/1138737533 >> 172.21.15.88:0/1138737533 conn(0x7fed940c5ce0 msgr2=0x7fed9414f640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:48:19.862 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:19.859+0000 7fed99874640 1 -- 172.21.15.88:0/1138737533 shutdown_connections 2024-04-26T23:48:19.862 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:19.859+0000 7fed99874640 1 -- 172.21.15.88:0/1138737533 wait complete. 2024-04-26T23:48:19.883 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2024-04-26T23:48:29.883 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-04-26T23:48:29.884 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-04-26T23:48:30.064 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:30.061+0000 7fc2fb2fc640 1 Processor -- start 2024-04-26T23:48:30.068 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:30.061+0000 7fc2fb2fc640 1 -- start start 2024-04-26T23:48:30.068 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:30.062+0000 7fc2fb2fc640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fc2f40c49e0 0x7fc2f40ad650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:30.068 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:30.062+0000 7fc2fb2fc640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc2f40c8620 0x7fc2f40adb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:30.069 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:30.062+0000 7fc2fb2fc640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc2f415ba80 con 0x7fc2f40c4dc0 2024-04-26T23:48:30.069 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:30.062+0000 7fc2fb2fc640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7fc2f40c53c0 con 0x7fc2f40c49e0 2024-04-26T23:48:30.069 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:30.062+0000 7fc2fb2fc640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fc2f40c69f0 con 0x7fc2f40c8620 2024-04-26T23:48:30.069 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:30.063+0000 7fc2f9899640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fc2f40c4dc0 0x7fc2f40c6e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:46816/0 (socket says 172.21.15.88:46816) 2024-04-26T23:48:30.069 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:30.063+0000 7fc2f9899640 1 -- 172.21.15.88:0/3182475616 learned_addr learned my addr 172.21.15.88:0/3182475616 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-26T23:48:30.069 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:30.064+0000 7fc2f8897640 1 --2- 172.21.15.88:0/3182475616 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc2f40c8620 0x7fc2f40adb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:30.069 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:30.064+0000 7fc2ebfff640 1 -- 172.21.15.88:0/3182475616 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4088364020 0 0) 0x7fc2f415ba80 con 0x7fc2f40c4dc0 2024-04-26T23:48:30.069 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:30.064+0000 7fc2ebfff640 1 -- 172.21.15.88:0/3182475616 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc2e0003520 con 0x7fc2f40c4dc0 2024-04-26T23:48:30.069 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:30.064+0000 7fc2ebfff640 1 -- 172.21.15.88:0/3182475616 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2841262009 0 0) 0x7fc2e0003520 con 0x7fc2f40c4dc0 2024-04-26T23:48:30.069 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:30.064+0000 7fc2ebfff640 1 -- 172.21.15.88:0/3182475616 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc2f40c8620 msgr2=0x7fc2f40adb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:48:30.069 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:30.064+0000 7fc2ebfff640 1 --2- 172.21.15.88:0/3182475616 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc2f40c8620 0x7fc2f40adb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:30.069 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:30.064+0000 7fc2ebfff640 1 -- 172.21.15.88:0/3182475616 >> v2:172.21.15.175:3300/0 conn(0x7fc2f40c49e0 msgr2=0x7fc2f40ad650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:48:30.069 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:30.064+0000 7fc2ebfff640 1 --2- 172.21.15.88:0/3182475616 >> v2:172.21.15.175:3300/0 conn(0x7fc2f40c49e0 0x7fc2f40ad650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:30.069 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:30.064+0000 7fc2ebfff640 1 -- 172.21.15.88:0/3182475616 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2f40c7b10 con 0x7fc2f40c4dc0 2024-04-26T23:48:30.070 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:30.064+0000 7fc2ebfff640 1 -- 172.21.15.88:0/3182475616 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 356324787 0 0) 0x7fc2ec0019f0 con 0x7fc2f40c4dc0 2024-04-26T23:48:30.070 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:30.064+0000 7fc2ebfff640 1 -- 172.21.15.88:0/3182475616 >> v1:172.21.15.88:6789/0 conn(0x7fc2f40c4dc0 legacy=0x7fc2f40c6e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:30.070 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:30.064+0000 7fc2ebfff640 1 --2- 172.21.15.88:0/3182475616 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc2e00039b0 0x7fc2e0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:30.070 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:30.064+0000 7fc2ebfff640 1 --2- 172.21.15.88:0/3182475616 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc2e0004800 0x7fc2e0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:30.070 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:30.064+0000 7fc2ebfff640 1 --2- 172.21.15.88:0/3182475616 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc2f40c8620 0x7fc2e0005270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:30.070 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:30.064+0000 7fc2ebfff640 1 -- 172.21.15.88:0/3182475616 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fc2f40c53c0 con 0x7fc2e00039b0 2024-04-26T23:48:30.070 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:30.064+0000 7fc2ebfff640 1 -- 172.21.15.88:0/3182475616 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc2f40c69f0 con 0x7fc2e0004800 2024-04-26T23:48:30.070 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:30.064+0000 7fc2ebfff640 1 -- 172.21.15.88:0/3182475616 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fc2e002dc10 con 0x7fc2f40c8620 2024-04-26T23:48:30.070 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:30.065+0000 7fc2f8897640 1 --2- 172.21.15.88:0/3182475616 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc2e0004800 0x7fc2e0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:30.070 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:30.066+0000 7fc2f9098640 1 --2- 172.21.15.88:0/3182475616 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc2e00039b0 0x7fc2e0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:30.071 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:30.066+0000 7fc2f9098640 1 -- 172.21.15.88:0/3182475616 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc2f40c8620 msgr2=0x7fc2e0005270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:48:30.071 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:30.066+0000 7fc2f9098640 1 --2- 172.21.15.88:0/3182475616 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc2f40c8620 0x7fc2e0005270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:30.071 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:30.066+0000 7fc2f9098640 1 -- 172.21.15.88:0/3182475616 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc2e0004800 msgr2=0x7fc2e0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:48:30.071 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:30.066+0000 7fc2f9098640 1 --2- 172.21.15.88:0/3182475616 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc2e0004800 0x7fc2e0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:30.071 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:30.066+0000 7fc2f9098640 1 -- 172.21.15.88:0/3182475616 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2e0003520 con 0x7fc2e00039b0 2024-04-26T23:48:30.071 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:30.066+0000 7fc2f8897640 1 --2- 172.21.15.88:0/3182475616 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc2e0004800 0x7fc2e0004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:48:30.071 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:30.067+0000 7fc2f9098640 1 --2- 172.21.15.88:0/3182475616 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc2e00039b0 0x7fc2e0003dd0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fc2e4009880 tx=0x7fc2e0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b7a0d56461c30e0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:48:30.073 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:30.069+0000 7fc2ebfff640 1 -- 172.21.15.88:0/3182475616 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2e4037070 con 0x7fc2e00039b0 2024-04-26T23:48:30.073 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:30.069+0000 7fc2ebfff640 1 -- 172.21.15.88:0/3182475616 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2e402aad0 con 0x7fc2e00039b0 2024-04-26T23:48:30.074 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:30.070+0000 7fc2fb2fc640 1 -- 172.21.15.88:0/3182475616 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc2e00039b0 msgr2=0x7fc2e0003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:30.074 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:30.070+0000 7fc2fb2fc640 1 --2- 172.21.15.88:0/3182475616 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc2e00039b0 0x7fc2e0003dd0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fc2e4009880 tx=0x7fc2e0005830 comp rx=0 tx=0).stop 2024-04-26T23:48:30.074 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:30.070+0000 7fc2f9899640 1 -- 172.21.15.88:0/3182475616 reap_dead start 2024-04-26T23:48:30.074 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:30.071+0000 7fc2fb2fc640 1 -- 172.21.15.88:0/3182475616 shutdown_connections 2024-04-26T23:48:30.074 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:30.071+0000 7fc2fb2fc640 1 -- 172.21.15.88:0/3182475616 >> 172.21.15.88:0/3182475616 conn(0x7fc2f40aa810 msgr2=0x7fc2f40aac20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:48:30.075 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:30.071+0000 7fc2fb2fc640 1 -- 172.21.15.88:0/3182475616 shutdown_connections 2024-04-26T23:48:30.075 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:30.071+0000 7fc2fb2fc640 1 -- 172.21.15.88:0/3182475616 wait complete. 2024-04-26T23:48:30.078 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:30.073+0000 7fc2fb2fc640 1 Processor -- start 2024-04-26T23:48:30.078 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:30.073+0000 7fc2fb2fc640 1 -- start start 2024-04-26T23:48:30.078 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:30.074+0000 7fc2fb2fc640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc2e00039b0 0x7fc2f415c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:30.078 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:30.074+0000 7fc2f9098640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc2e00039b0 0x7fc2f415c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:30.078 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:30.074+0000 7fc2f9098640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc2e00039b0 0x7fc2f415c2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54540/0 (socket says 172.21.15.88:54540) 2024-04-26T23:48:30.079 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:30.074+0000 7fc2f9098640 1 -- 172.21.15.88:0/4067029727 learned_addr learned my addr 172.21.15.88:0/4067029727 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:48:30.079 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:30.074+0000 7fc2fb2fc640 1 --2- 172.21.15.88:0/4067029727 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc2f415dbe0 0x7fc2f414fa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:30.079 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:30.074+0000 7fc2fb2fc640 1 --2- 172.21.15.88:0/4067029727 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc2f414e740 0x7fc2f414ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:30.079 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:30.074+0000 7fc2fb2fc640 1 -- 172.21.15.88:0/4067029727 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fc2f40abf90 con 0x7fc2e00039b0 2024-04-26T23:48:30.079 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:30.074+0000 7fc2fb2fc640 1 -- 172.21.15.88:0/4067029727 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc2f40abcb0 con 0x7fc2f415dbe0 2024-04-26T23:48:30.079 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:30.074+0000 7fc2fb2fc640 1 -- 172.21.15.88:0/4067029727 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fc2f40c7590 con 0x7fc2f414e740 2024-04-26T23:48:30.079 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:30.075+0000 7fc2f9098640 1 -- 172.21.15.88:0/4067029727 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc2f414e740 msgr2=0x7fc2f414ebc0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T23:48:30.079 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:30.075+0000 7fc2f9098640 1 --2- 172.21.15.88:0/4067029727 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc2f414e740 0x7fc2f414ebc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:30.079 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:30.075+0000 7fc2f9098640 1 -- 172.21.15.88:0/4067029727 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc2f415dbe0 msgr2=0x7fc2f414fa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:30.079 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:30.075+0000 7fc2f9098640 1 --2- 172.21.15.88:0/4067029727 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc2f415dbe0 0x7fc2f414fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:30.079 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:30.075+0000 7fc2f9098640 1 -- 172.21.15.88:0/4067029727 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2f415d4e0 con 0x7fc2e00039b0 2024-04-26T23:48:30.080 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:30.075+0000 7fc2f9098640 1 --2- 172.21.15.88:0/4067029727 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc2e00039b0 0x7fc2f415c2f0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fc2e40099a0 tx=0x7fc2e40047d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:48:30.080 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:30.076+0000 7fc2e9ffb640 1 -- 172.21.15.88:0/4067029727 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2e4042020 con 0x7fc2e00039b0 2024-04-26T23:48:30.080 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:30.076+0000 7fc2e9ffb640 1 -- 172.21.15.88:0/4067029727 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2e403d670 con 0x7fc2e00039b0 2024-04-26T23:48:30.080 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:30.076+0000 7fc2e9ffb640 1 -- 172.21.15.88:0/4067029727 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2e4037040 con 0x7fc2e00039b0 2024-04-26T23:48:30.080 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:30.076+0000 7fc2fb2fc640 1 -- 172.21.15.88:0/4067029727 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2f41ec440 con 0x7fc2e00039b0 2024-04-26T23:48:30.085 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:30.079+0000 7fc2e9ffb640 1 -- 172.21.15.88:0/4067029727 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc2e4045020 con 0x7fc2e00039b0 2024-04-26T23:48:30.085 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:30.081+0000 7fc2fb2fc640 1 -- 172.21.15.88:0/4067029727 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2f414df40 con 0x7fc2e00039b0 2024-04-26T23:48:30.085 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:30.082+0000 7fc2e9ffb640 1 --2- 172.21.15.88:0/4067029727 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fc2e0090050 0x7fc2e0092510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:30.086 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:30.082+0000 7fc2f8897640 1 --2- 172.21.15.88:0/4067029727 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fc2e0090050 0x7fc2e0092510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:30.086 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:30.082+0000 7fc2e9ffb640 1 -- 172.21.15.88:0/4067029727 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6666+0+0 (secure 0 0 0) 0x7fc2e40ac270 con 0x7fc2e00039b0 2024-04-26T23:48:30.086 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:30.083+0000 7fc2f8897640 1 --2- 172.21.15.88:0/4067029727 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fc2e0090050 0x7fc2e0092510 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fc2f40c7510 tx=0x7fc2f0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:48:30.087 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:30.084+0000 7fc2d77fe640 1 -- 172.21.15.88:0/4067029727 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc2f40a7e80 con 0x7fc2e00039b0 2024-04-26T23:48:30.101 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:30.096+0000 7fc2e9ffb640 1 -- 172.21.15.88:0/4067029727 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fc2f40a7e80 con 0x7fc2e00039b0 2024-04-26T23:48:30.627 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:30.623+0000 7fc2d77fe640 1 -- 172.21.15.88:0/4067029727 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fc2f40765e0 con 0x7fc2e00039b0 2024-04-26T23:48:30.628 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":76,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":15,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"555255e9-7ef9-4454-8dc9-35e96b70035c","modified":"2024-04-26T23:39:34.291658Z","created":"2024-04-26T23:39:34.291658Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:3300","nonce":0},{"type":"v1","addr":"172.21.15.175:6789","nonce":0}]},"addr":"172.21.15.175:6789/0","public_addr":"172.21.15.175:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:3301","nonce":0},{"type":"v1","addr":"172.21.15.175:6790","nonce":0}]},"addr":"172.21.15.175:6790/0","public_addr":"172.21.15.175:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-04-26T23:48:30.628 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:30.624+0000 7fc2e9ffb640 1 -- 172.21.15.88:0/4067029727 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1565 (secure 0 0 0) 0x7fc2e407a470 con 0x7fc2e00039b0 2024-04-26T23:48:30.634 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:30.630+0000 7fc2fb2fc640 1 -- 172.21.15.88:0/4067029727 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fc2e0090050 msgr2=0x7fc2e0092510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:30.634 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:30.630+0000 7fc2fb2fc640 1 --2- 172.21.15.88:0/4067029727 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fc2e0090050 0x7fc2e0092510 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fc2f40c7510 tx=0x7fc2f0008040 comp rx=0 tx=0).stop 2024-04-26T23:48:30.634 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:30.631+0000 7fc2fb2fc640 1 -- 172.21.15.88:0/4067029727 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc2e00039b0 msgr2=0x7fc2f415c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:30.634 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:30.631+0000 7fc2fb2fc640 1 --2- 172.21.15.88:0/4067029727 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc2e00039b0 0x7fc2f415c2f0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fc2e40099a0 tx=0x7fc2e40047d0 comp rx=0 tx=0).stop 2024-04-26T23:48:30.635 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:30.631+0000 7fc2fb2fc640 1 -- 172.21.15.88:0/4067029727 shutdown_connections 2024-04-26T23:48:30.635 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:30.631+0000 7fc2fb2fc640 1 --2- 172.21.15.88:0/4067029727 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fc2e0090050 0x7fc2e0092510 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:30.635 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:30.631+0000 7fc2fb2fc640 1 --2- 172.21.15.88:0/4067029727 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc2f414e740 0x7fc2f414ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:30.635 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:30.631+0000 7fc2fb2fc640 1 --2- 172.21.15.88:0/4067029727 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc2f415dbe0 0x7fc2f414fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:30.635 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:30.631+0000 7fc2fb2fc640 1 --2- 172.21.15.88:0/4067029727 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc2e00039b0 0x7fc2f415c2f0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:30.635 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:30.631+0000 7fc2fb2fc640 1 -- 172.21.15.88:0/4067029727 >> 172.21.15.88:0/4067029727 conn(0x7fc2f40aa810 msgr2=0x7fc2f415a310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:48:30.635 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:30.631+0000 7fc2fb2fc640 1 -- 172.21.15.88:0/4067029727 shutdown_connections 2024-04-26T23:48:30.635 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:30.631+0000 7fc2fb2fc640 1 -- 172.21.15.88:0/4067029727 wait complete. 2024-04-26T23:48:30.655 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-04-26T23:48:30.655 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2024-04-26T23:48:30.655 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-04-26T23:48:30.655 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-04-26T23:48:30.861 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:30.855+0000 7f4249f89640 1 Processor -- start 2024-04-26T23:48:30.861 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:30.856+0000 7f4249f89640 1 -- start start 2024-04-26T23:48:30.861 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:30.857+0000 7f4249f89640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f424413ce60 0x7f424406d320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:30.861 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:30.857+0000 7f4249f89640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f424406f0f0 0x7f424415e250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:30.861 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:30.857+0000 7f4249f89640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42440c5670 con 0x7f42440c4e90 2024-04-26T23:48:30.861 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:30.857+0000 7f4249f89640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f4244073520 con 0x7f424406f0f0 2024-04-26T23:48:30.861 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:30.857+0000 7f4249f89640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f4244157040 con 0x7f424413ce60 2024-04-26T23:48:30.861 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:30.857+0000 7f4243fff640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f424406f0f0 0x7f424415e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:30.862 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:30.857+0000 7f4243fff640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f424406f0f0 0x7f424415e250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54542/0 (socket says 172.21.15.88:54542) 2024-04-26T23:48:30.862 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:30.857+0000 7f4243fff640 1 -- 172.21.15.88:0/4014630429 learned_addr learned my addr 172.21.15.88:0/4014630429 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:48:30.862 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:30.858+0000 7f4243fff640 1 -- 172.21.15.88:0/4014630429 >> v2:172.21.15.175:3300/0 conn(0x7f424413ce60 msgr2=0x7f424406d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:48:30.863 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:30.858+0000 7f4243fff640 1 --2- 172.21.15.88:0/4014630429 >> v2:172.21.15.175:3300/0 conn(0x7f424413ce60 0x7f424406d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:30.863 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:30.858+0000 7f4243fff640 1 -- 172.21.15.88:0/4014630429 >> v1:172.21.15.175:6789/0 conn(0x7f42440c4e90 legacy=0x7f42441538d0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-26T23:48:30.863 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:30.858+0000 7f4243fff640 1 -- 172.21.15.88:0/4014630429 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4244157320 con 0x7f424406f0f0 2024-04-26T23:48:30.863 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:30.860+0000 7f4243fff640 1 --2- 172.21.15.88:0/4014630429 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f424406f0f0 0x7f424415e250 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f42440af480 tx=0x7f423402c7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=470e2826c8a49e1c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:48:30.864 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:30.860+0000 7f42427fc640 1 -- 172.21.15.88:0/4014630429 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4234039070 con 0x7f424406f0f0 2024-04-26T23:48:30.864 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:30.860+0000 7f42427fc640 1 -- 172.21.15.88:0/4014630429 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42340316b0 con 0x7f424406f0f0 2024-04-26T23:48:30.864 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:30.860+0000 7f42427fc640 1 -- 172.21.15.88:0/4014630429 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4234031a80 con 0x7f424406f0f0 2024-04-26T23:48:30.865 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:30.862+0000 7f4249f89640 1 -- 172.21.15.88:0/4014630429 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f424406f0f0 msgr2=0x7f424415e250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:30.865 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:30.862+0000 7f4249f89640 1 --2- 172.21.15.88:0/4014630429 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f424406f0f0 0x7f424415e250 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f42440af480 tx=0x7f423402c7c0 comp rx=0 tx=0).stop 2024-04-26T23:48:30.867 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:30.863+0000 7f4249f89640 1 -- 172.21.15.88:0/4014630429 shutdown_connections 2024-04-26T23:48:30.867 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:30.863+0000 7f4249f89640 1 --2- 172.21.15.88:0/4014630429 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f424406f0f0 0x7f424415e250 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:30.868 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:30.863+0000 7f4249f89640 1 --2- 172.21.15.88:0/4014630429 >> v2:172.21.15.175:3300/0 conn(0x7f424413ce60 0x7f424406d320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:30.868 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:30.863+0000 7f4249f89640 1 -- 172.21.15.88:0/4014630429 >> 172.21.15.88:0/4014630429 conn(0x7f42440c5ce0 msgr2=0x7f42440c60c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:48:30.868 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:30.864+0000 7f4249f89640 1 -- 172.21.15.88:0/4014630429 shutdown_connections 2024-04-26T23:48:30.868 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:30.865+0000 7f4249f89640 1 -- 172.21.15.88:0/4014630429 wait complete. 2024-04-26T23:48:30.870 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:30.866+0000 7f4249f89640 1 Processor -- start 2024-04-26T23:48:30.870 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:30.867+0000 7f4249f89640 1 -- start start 2024-04-26T23:48:30.872 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:30.868+0000 7f4249f89640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f424406f0f0 0x7f4244153230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:30.872 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:30.868+0000 7f4249f89640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f42440c4e90 0x7f42441dcf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:30.872 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:30.868+0000 7f4249f89640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f424413ce60 0x7f4244155ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:30.872 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:30.868+0000 7f4249f89640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f4244153fe0 con 0x7f424406f0f0 2024-04-26T23:48:30.872 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:30.868+0000 7f4249f89640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f42440748f0 con 0x7f424413ce60 2024-04-26T23:48:30.872 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:30.868+0000 7f4249f89640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f4244154160 con 0x7f42440c4e90 2024-04-26T23:48:30.872 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:30.869+0000 7f4243fff640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f424413ce60 0x7f4244155ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:30.873 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:30.869+0000 7f4243fff640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f424413ce60 0x7f4244155ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.88:51058/0 (socket says 172.21.15.88:51058) 2024-04-26T23:48:30.873 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:30.869+0000 7f4243fff640 1 -- 172.21.15.88:0/1666679630 learned_addr learned my addr 172.21.15.88:0/1666679630 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:48:30.873 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:30.869+0000 7f4242ffd640 1 --2- 172.21.15.88:0/1666679630 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f42440c4e90 0x7f42441dcf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:30.873 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:30.869+0000 7f42437fe640 1 --2- 172.21.15.88:0/1666679630 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f424406f0f0 0x7f4244153230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:30.874 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:30.870+0000 7f4243fff640 1 -- 172.21.15.88:0/1666679630 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f42440c4e90 msgr2=0x7f42441dcf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:30.874 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:30.870+0000 7f4243fff640 1 --2- 172.21.15.88:0/1666679630 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f42440c4e90 0x7f42441dcf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:30.874 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:30.870+0000 7f4243fff640 1 -- 172.21.15.88:0/1666679630 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f424406f0f0 msgr2=0x7f4244153230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:30.874 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:30.870+0000 7f4243fff640 1 --2- 172.21.15.88:0/1666679630 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f424406f0f0 0x7f4244153230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:30.874 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:30.870+0000 7f4243fff640 1 -- 172.21.15.88:0/1666679630 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42441de460 con 0x7f424413ce60 2024-04-26T23:48:30.874 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:30.870+0000 7f4243fff640 1 --2- 172.21.15.88:0/1666679630 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f424413ce60 0x7f4244155ac0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f423402cdb0 tx=0x7f4234004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:48:30.875 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:30.871+0000 7f422bfff640 1 -- 172.21.15.88:0/1666679630 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4234039040 con 0x7f424413ce60 2024-04-26T23:48:30.875 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:30.871+0000 7f422bfff640 1 -- 172.21.15.88:0/1666679630 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4234044070 con 0x7f424413ce60 2024-04-26T23:48:30.875 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:30.871+0000 7f422bfff640 1 -- 172.21.15.88:0/1666679630 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4234034c30 con 0x7f424413ce60 2024-04-26T23:48:30.875 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:30.871+0000 7f4249f89640 1 -- 172.21.15.88:0/1666679630 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f424413a300 con 0x7f424413ce60 2024-04-26T23:48:30.875 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:30.871+0000 7f4249f89640 1 -- 172.21.15.88:0/1666679630 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4244153bf0 con 0x7f424413ce60 2024-04-26T23:48:30.875 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:30.872+0000 7f4249f89640 1 --2- 172.21.15.88:0/1666679630 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f42441e9060 0x7f42441dfa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:30.876 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:30.872+0000 7f4249f89640 1 -- 172.21.15.88:0/1666679630 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f42440507a0 con 0x7f42441e9060 2024-04-26T23:48:30.879 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:30.876+0000 7f422bfff640 1 -- 172.21.15.88:0/1666679630 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4234049460 con 0x7f424413ce60 2024-04-26T23:48:30.880 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:30.877+0000 7f422bfff640 1 --2- 172.21.15.88:0/1666679630 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f423006c920 0x7f423006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:30.880 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:30.877+0000 7f422bfff640 1 -- 172.21.15.88:0/1666679630 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6666+0+0 (secure 0 0 0) 0x7f42340acd00 con 0x7f424413ce60 2024-04-26T23:48:30.883 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:30.879+0000 7f42437fe640 1 --2- 172.21.15.88:0/1666679630 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f42441e9060 0x7f42441dfa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:30.883 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:30.880+0000 7f42437fe640 1 -- 172.21.15.88:0/1666679630 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f424413d2f0 con 0x7f42441e9060 2024-04-26T23:48:30.883 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:30.880+0000 7f42437fe640 1 --2- 172.21.15.88:0/1666679630 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f42441e9060 0x7f42441dfa70 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f423800e560 tx=0x7f423800ea20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:48:30.890 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:30.881+0000 7f422bfff640 1 -- 172.21.15.88:0/1666679630 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4238017070 con 0x7f42441e9060 2024-04-26T23:48:30.890 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:30.881+0000 7f422bfff640 1 -- 172.21.15.88:0/1666679630 <== mon.0 v2:172.21.15.88:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f4238013680 con 0x7f42441e9060 2024-04-26T23:48:30.890 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:30.881+0000 7f422bfff640 1 -- 172.21.15.88:0/1666679630 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f42441e9060 msgr2=0x7f42441dfa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:30.890 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:30.881+0000 7f422bfff640 1 --2- 172.21.15.88:0/1666679630 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f42441e9060 0x7f42441dfa70 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f423800e560 tx=0x7f423800ea20 comp rx=0 tx=0).stop 2024-04-26T23:48:30.890 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:30.881+0000 7f422bfff640 1 -- 172.21.15.88:0/1666679630 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f42441e9060 msgr2=0x7f42441dfa70 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:48:30.890 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:30.881+0000 7f422bfff640 1 --2- 172.21.15.88:0/1666679630 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f42441e9060 0x7f42441dfa70 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:30.890 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:30.881+0000 7f4242ffd640 1 --2- 172.21.15.88:0/1666679630 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f423006c920 0x7f423006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:30.890 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:30.882+0000 7f4242ffd640 1 --2- 172.21.15.88:0/1666679630 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f423006c920 0x7f423006ede0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f42441e9490 tx=0x7f423c0094f0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:48:30.908 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:30.905+0000 7f4249f89640 1 --2- 172.21.15.88:0/1666679630 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f424406dd10 0x7f42441394d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:30.909 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:30.905+0000 7f42437fe640 1 --2- 172.21.15.88:0/1666679630 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f424406dd10 0x7f42441394d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:30.909 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:30.906+0000 7f4249f89640 1 -- 172.21.15.88:0/1666679630 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f424406d000 con 0x7f424406dd10 2024-04-26T23:48:30.909 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:30.906+0000 7f42437fe640 1 -- 172.21.15.88:0/1666679630 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f424406cd20 con 0x7f424406dd10 2024-04-26T23:48:30.911 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:30.906+0000 7f42437fe640 1 --2- 172.21.15.88:0/1666679630 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f424406dd10 0x7f42441394d0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f4238019000 tx=0x7f4238004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:48:30.911 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:30.907+0000 7f422bfff640 1 -- 172.21.15.88:0/1666679630 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4238017070 con 0x7f424406dd10 2024-04-26T23:48:30.911 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:30.908+0000 7f422bfff640 1 -- 172.21.15.88:0/1666679630 <== mon.0 v2:172.21.15.88:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4727 (secure 0 0 0) 0x7f4238006450 con 0x7f424406dd10 2024-04-26T23:48:30.911 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:30.908+0000 7f422bfff640 1 -- 172.21.15.88:0/1666679630 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f424406dd10 msgr2=0x7f42441394d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:30.911 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:30.908+0000 7f422bfff640 1 --2- 172.21.15.88:0/1666679630 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f424406dd10 0x7f42441394d0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f4238019000 tx=0x7f4238004730 comp rx=0 tx=0).stop 2024-04-26T23:48:30.911 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:30.908+0000 7f422bfff640 1 -- 172.21.15.88:0/1666679630 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f424406dd10 msgr2=0x7f42441394d0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:48:30.911 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:30.908+0000 7f422bfff640 1 --2- 172.21.15.88:0/1666679630 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f424406dd10 0x7f42441394d0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:30.916 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-04-26T23:48:30.916 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2024-04-26T23:48:30.916 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2024-04-26T23:48:30.916 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "leader", 2024-04-26T23:48:30.917 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 76, 2024-04-26T23:48:30.917 INFO:teuthology.orchestra.run.smithi088.stdout: "uptime": 83974, 2024-04-26T23:48:30.917 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2024-04-26T23:48:30.917 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2024-04-26T23:48:30.917 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2024-04-26T23:48:30.917 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2024-04-26T23:48:30.917 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:48:30.917 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 15, 2024-04-26T23:48:30.917 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2024-04-26T23:48:30.917 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2450521708007866372", 2024-04-26T23:48:30.917 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2024-04-26T23:48:30.917 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-04-26T23:48:30.917 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-04-26T23:48:30.917 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-04-26T23:48:30.918 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-04-26T23:48:30.918 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-04-26T23:48:30.918 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-04-26T23:48:30.918 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-04-26T23:48:30.918 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-04-26T23:48:30.918 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-04-26T23:48:30.918 INFO:teuthology.orchestra.run.smithi088.stdout: "reef", 2024-04-26T23:48:30.918 INFO:teuthology.orchestra.run.smithi088.stdout: "squid" 2024-04-26T23:48:30.918 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:48:30.918 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540701547738038271", 2024-04-26T23:48:30.918 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2024-04-26T23:48:30.918 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-04-26T23:48:30.918 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-04-26T23:48:30.918 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-04-26T23:48:30.919 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-04-26T23:48:30.919 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-04-26T23:48:30.919 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-04-26T23:48:30.919 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-04-26T23:48:30.919 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-04-26T23:48:30.919 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-04-26T23:48:30.919 INFO:teuthology.orchestra.run.smithi088.stdout: "reef", 2024-04-26T23:48:30.919 INFO:teuthology.orchestra.run.smithi088.stdout: "squid" 2024-04-26T23:48:30.919 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:48:30.919 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:48:30.919 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2024-04-26T23:48:30.919 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2024-04-26T23:48:30.919 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2024-04-26T23:48:30.919 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2024-04-26T23:48:30.920 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2024-04-26T23:48:30.920 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "555255e9-7ef9-4454-8dc9-35e96b70035c", 2024-04-26T23:48:30.920 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2024-04-26T23:39:34.291658Z", 2024-04-26T23:48:30.920 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2024-04-26T23:39:34.291658Z", 2024-04-26T23:48:30.920 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 19, 2024-04-26T23:48:30.920 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "squid", 2024-04-26T23:48:30.920 INFO:teuthology.orchestra.run.smithi088.stdout: "election_strategy": 1, 2024-04-26T23:48:30.920 INFO:teuthology.orchestra.run.smithi088.stdout: "disallowed_leaders: ": "", 2024-04-26T23:48:30.920 INFO:teuthology.orchestra.run.smithi088.stdout: "stretch_mode": false, 2024-04-26T23:48:30.920 INFO:teuthology.orchestra.run.smithi088.stdout: "tiebreaker_mon": "", 2024-04-26T23:48:30.920 INFO:teuthology.orchestra.run.smithi088.stdout: "removed_ranks: ": "", 2024-04-26T23:48:30.920 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2024-04-26T23:48:30.920 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2024-04-26T23:48:30.920 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-04-26T23:48:30.920 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-04-26T23:48:30.921 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-04-26T23:48:30.921 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-04-26T23:48:30.921 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-04-26T23:48:30.921 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-04-26T23:48:30.921 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-04-26T23:48:30.921 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-04-26T23:48:30.921 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-04-26T23:48:30.921 INFO:teuthology.orchestra.run.smithi088.stdout: "reef", 2024-04-26T23:48:30.921 INFO:teuthology.orchestra.run.smithi088.stdout: "squid" 2024-04-26T23:48:30.921 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:48:30.921 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2024-04-26T23:48:30.921 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:48:30.921 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2024-04-26T23:48:30.921 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:48:30.921 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2024-04-26T23:48:30.921 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2024-04-26T23:48:30.922 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-04-26T23:48:30.922 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-04-26T23:48:30.922 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:48:30.922 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-04-26T23:48:30.922 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2024-04-26T23:48:30.922 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:48:30.922 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:48:30.922 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:48:30.922 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-04-26T23:48:30.922 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2024-04-26T23:48:30.922 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:48:30.922 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:48:30.922 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:48:30.922 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:48:30.922 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2024-04-26T23:48:30.923 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2024-04-26T23:48:30.923 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-04-26T23:48:30.923 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-04-26T23:48:30.923 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-04-26T23:48:30.923 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:48:30.923 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:48:30.923 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2024-04-26T23:48:30.923 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2024-04-26T23:48:30.923 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-04-26T23:48:30.923 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-04-26T23:48:30.923 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:48:30.923 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-04-26T23:48:30.923 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:3300", 2024-04-26T23:48:30.924 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:48:30.924 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:48:30.924 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:48:30.924 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-04-26T23:48:30.924 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6789", 2024-04-26T23:48:30.924 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:48:30.924 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:48:30.924 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:48:30.924 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:48:30.924 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6789/0", 2024-04-26T23:48:30.924 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.175:6789/0", 2024-04-26T23:48:30.924 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-04-26T23:48:30.924 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-04-26T23:48:30.924 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-04-26T23:48:30.924 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:48:30.925 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:48:30.925 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2024-04-26T23:48:30.925 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2024-04-26T23:48:30.925 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-04-26T23:48:30.925 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-04-26T23:48:30.925 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:48:30.925 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-04-26T23:48:30.925 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:3301", 2024-04-26T23:48:30.925 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:48:30.925 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:48:30.925 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:48:30.925 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-04-26T23:48:30.925 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6790", 2024-04-26T23:48:30.925 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:48:30.925 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:48:30.926 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:48:30.926 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:48:30.926 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6790/0", 2024-04-26T23:48:30.926 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.175:6790/0", 2024-04-26T23:48:30.926 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-04-26T23:48:30.926 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-04-26T23:48:30.926 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-04-26T23:48:30.926 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:48:30.926 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:48:30.926 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:48:30.926 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2024-04-26T23:48:30.926 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2024-04-26T23:48:30.926 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:48:30.926 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:48:30.927 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:48:30.927 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2024-04-26T23:48:30.927 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:48:30.927 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:48:30.927 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2024-04-26T23:48:30.927 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:48:30.927 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:48:30.927 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:48:30.927 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2024-04-26T23:48:30.927 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:48:30.927 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:48:30.927 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": [ 2024-04-26T23:48:30.927 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:48:30.927 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:48:30.927 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:48:30.928 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2024-04-26T23:48:30.928 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:48:30.928 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:48:30.928 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:48:30.928 INFO:teuthology.orchestra.run.smithi088.stdout: "stretch_mode": false 2024-04-26T23:48:30.928 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-04-26T23:48:30.929 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:30.914+0000 7f4249f89640 1 -- 172.21.15.88:0/1666679630 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f423006c920 msgr2=0x7f423006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:30.929 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:30.914+0000 7f4249f89640 1 --2- 172.21.15.88:0/1666679630 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f423006c920 0x7f423006ede0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f42441e9490 tx=0x7f423c0094f0 comp rx=0 tx=0).stop 2024-04-26T23:48:30.929 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:30.914+0000 7f4249f89640 1 -- 172.21.15.88:0/1666679630 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f424413ce60 msgr2=0x7f4244155ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:30.929 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:30.914+0000 7f4249f89640 1 --2- 172.21.15.88:0/1666679630 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f424413ce60 0x7f4244155ac0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f423402cdb0 tx=0x7f4234004730 comp rx=0 tx=0).stop 2024-04-26T23:48:30.929 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:30.914+0000 7f4243fff640 1 -- 172.21.15.88:0/1666679630 reap_dead start 2024-04-26T23:48:30.929 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:30.914+0000 7f4243fff640 1 -- 172.21.15.88:0/1666679630 reap_dead start 2024-04-26T23:48:30.929 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:30.914+0000 7f4249f89640 1 -- 172.21.15.88:0/1666679630 shutdown_connections 2024-04-26T23:48:30.930 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:30.914+0000 7f4249f89640 1 -- 172.21.15.88:0/1666679630 >> 172.21.15.88:0/1666679630 conn(0x7f42440c5ce0 msgr2=0x7f4244154300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:48:30.930 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:30.915+0000 7f4249f89640 1 -- 172.21.15.88:0/1666679630 shutdown_connections 2024-04-26T23:48:30.930 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:30.915+0000 7f4249f89640 1 -- 172.21.15.88:0/1666679630 wait complete. 2024-04-26T23:48:30.937 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-04-26T23:48:30.937 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-04-26T23:48:30.937 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-04-26T23:48:31.116 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:31.112+0000 7f85fa9be640 1 Processor -- start 2024-04-26T23:48:31.120 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:31.117+0000 7f85fa9be640 1 -- start start 2024-04-26T23:48:31.122 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:31.118+0000 7f85fa9be640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f85ec050720 0x7f85ec0062c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:31.122 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:31.118+0000 7f85fa9be640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f85ec0d7d00 con 0x7f85ec00fcf0 2024-04-26T23:48:31.122 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:31.118+0000 7f85fa9be640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f85ec0db250 con 0x7f85ec0d7920 2024-04-26T23:48:31.122 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:31.118+0000 7f85fa9be640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f85ec04ba00 con 0x7f85ec050720 2024-04-26T23:48:31.122 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:31.118+0000 7f85f91bb640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f85ec050720 0x7f85ec0062c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:31.122 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:31.118+0000 7f85f91bb640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f85ec050720 0x7f85ec0062c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54580/0 (socket says 172.21.15.88:54580) 2024-04-26T23:48:31.122 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:31.118+0000 7f85f91bb640 1 -- 172.21.15.88:0/2772521512 learned_addr learned my addr 172.21.15.88:0/2772521512 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:48:31.123 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:31.119+0000 7f85f91bb640 1 -- 172.21.15.88:0/2772521512 >> v1:172.21.15.175:6789/0 conn(0x7f85ec0d7920 legacy=0x7f85ec00edb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:48:31.123 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:31.119+0000 7f85f91bb640 1 -- 172.21.15.88:0/2772521512 >> v1:172.21.15.88:6789/0 conn(0x7f85ec00fcf0 legacy=0x7f85ec006800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:48:31.123 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:31.119+0000 7f85f91bb640 1 -- 172.21.15.88:0/2772521512 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85ec04bce0 con 0x7f85ec050720 2024-04-26T23:48:31.124 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:31.120+0000 7f85f91bb640 1 --2- 172.21.15.88:0/2772521512 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f85ec050720 0x7f85ec0062c0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f85f406bd80 tx=0x7f85f40afa00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c6e20e532ac68a9 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:48:31.125 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:31.121+0000 7f85f89ba640 1 -- 172.21.15.88:0/2772521512 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85f40b8070 con 0x7f85ec050720 2024-04-26T23:48:31.125 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:31.122+0000 7f85f89ba640 1 -- 172.21.15.88:0/2772521512 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85f40b4710 con 0x7f85ec050720 2024-04-26T23:48:31.125 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:31.122+0000 7f85f89ba640 1 -- 172.21.15.88:0/2772521512 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85f40b4b80 con 0x7f85ec050720 2024-04-26T23:48:31.126 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:31.122+0000 7f85fa9be640 1 -- 172.21.15.88:0/2772521512 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f85ec050720 msgr2=0x7f85ec0062c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:31.126 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:31.122+0000 7f85fa9be640 1 --2- 172.21.15.88:0/2772521512 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f85ec050720 0x7f85ec0062c0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f85f406bd80 tx=0x7f85f40afa00 comp rx=0 tx=0).stop 2024-04-26T23:48:31.133 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:31.130+0000 7f85fa9be640 1 -- 172.21.15.88:0/2772521512 shutdown_connections 2024-04-26T23:48:31.133 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:31.130+0000 7f85fa9be640 1 --2- 172.21.15.88:0/2772521512 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f85ec050720 0x7f85ec0062c0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:31.133 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:31.130+0000 7f85fa9be640 1 -- 172.21.15.88:0/2772521512 >> 172.21.15.88:0/2772521512 conn(0x7f85ec04fc00 msgr2=0x7f85ec050010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:48:31.135 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:31.132+0000 7f85fa9be640 1 -- 172.21.15.88:0/2772521512 shutdown_connections 2024-04-26T23:48:31.138 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:31.132+0000 7f85fa9be640 1 -- 172.21.15.88:0/2772521512 wait complete. 2024-04-26T23:48:31.138 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:31.134+0000 7f85fa9be640 1 Processor -- start 2024-04-26T23:48:31.140 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:31.135+0000 7f85fa9be640 1 -- start start 2024-04-26T23:48:31.140 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:31.136+0000 7f85fa9be640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f85ec00fcf0 0x7f85ec04dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:31.140 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:31.136+0000 7f85fa9be640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f85ec050720 0x7f85ec0341d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:31.140 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:31.136+0000 7f85fa9be640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f85ec0d7920 0x7f85ec0d23a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:31.140 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:31.136+0000 7f85fa9be640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f85ec006f10 con 0x7f85ec00fcf0 2024-04-26T23:48:31.140 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:31.136+0000 7f85fa9be640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f85ec04c2a0 con 0x7f85ec0d7920 2024-04-26T23:48:31.140 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:31.136+0000 7f85fa9be640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f85ec00f4c0 con 0x7f85ec050720 2024-04-26T23:48:31.141 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:31.137+0000 7f85fa1bd640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f85ec0d7920 0x7f85ec0d23a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:31.141 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:31.137+0000 7f85fa1bd640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f85ec0d7920 0x7f85ec0d23a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.88:51064/0 (socket says 172.21.15.88:51064) 2024-04-26T23:48:31.141 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:31.137+0000 7f85fa1bd640 1 -- 172.21.15.88:0/71598934 learned_addr learned my addr 172.21.15.88:0/71598934 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:48:31.141 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:31.137+0000 7f85f91bb640 1 --2- 172.21.15.88:0/71598934 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f85ec050720 0x7f85ec0341d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:31.141 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:31.137+0000 7f85f99bc640 1 --2- 172.21.15.88:0/71598934 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f85ec00fcf0 0x7f85ec04dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:31.142 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:31.137+0000 7f85f91bb640 1 -- 172.21.15.88:0/71598934 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f85ec0d7920 msgr2=0x7f85ec0d23a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:31.142 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:31.137+0000 7f85f91bb640 1 --2- 172.21.15.88:0/71598934 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f85ec0d7920 0x7f85ec0d23a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:31.142 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:31.137+0000 7f85f91bb640 1 -- 172.21.15.88:0/71598934 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f85ec00fcf0 msgr2=0x7f85ec04dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:31.142 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:31.138+0000 7f85f91bb640 1 --2- 172.21.15.88:0/71598934 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f85ec00fcf0 0x7f85ec04dc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:31.142 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:31.138+0000 7f85f91bb640 1 -- 172.21.15.88:0/71598934 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85ec032e40 con 0x7f85ec050720 2024-04-26T23:48:31.142 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:31.138+0000 7f85f99bc640 1 --2- 172.21.15.88:0/71598934 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f85ec00fcf0 0x7f85ec04dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:48:31.142 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:31.138+0000 7f85f91bb640 1 --2- 172.21.15.88:0/71598934 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f85ec050720 0x7f85ec0341d0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f85f406bac0 tx=0x7f85f406b850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:48:31.143 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:31.139+0000 7f85ea7fc640 1 -- 172.21.15.88:0/71598934 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85f40c1020 con 0x7f85ec050720 2024-04-26T23:48:31.143 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:31.139+0000 7f85fa9be640 1 -- 172.21.15.88:0/71598934 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85ec033120 con 0x7f85ec050720 2024-04-26T23:48:31.143 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:31.139+0000 7f85fa9be640 1 -- 172.21.15.88:0/71598934 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f85ec034710 con 0x7f85ec050720 2024-04-26T23:48:31.144 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:31.139+0000 7f85ea7fc640 1 -- 172.21.15.88:0/71598934 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85f4096260 con 0x7f85ec050720 2024-04-26T23:48:31.144 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:31.139+0000 7f85ea7fc640 1 -- 172.21.15.88:0/71598934 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85f40b8040 con 0x7f85ec050720 2024-04-26T23:48:31.145 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:31.141+0000 7f85ea7fc640 1 -- 172.21.15.88:0/71598934 <== mon.2 v2:172.21.15.175:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f85f40c4020 con 0x7f85ec050720 2024-04-26T23:48:31.145 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:31.142+0000 7f85ea7fc640 1 --2- 172.21.15.88:0/71598934 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f85d806c920 0x7f85d806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:31.146 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:31.142+0000 7f85f99bc640 1 --2- 172.21.15.88:0/71598934 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f85d806c920 0x7f85d806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:31.146 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:31.143+0000 7f85ea7fc640 1 -- 172.21.15.88:0/71598934 <== mon.2 v2:172.21.15.175:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6666+0+0 (secure 0 0 0) 0x7f85f41293d0 con 0x7f85ec050720 2024-04-26T23:48:31.147 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:31.144+0000 7f85f99bc640 1 --2- 172.21.15.88:0/71598934 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f85d806c920 0x7f85d806ede0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f85ec16faf0 tx=0x7f85e4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:48:31.147 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:31.144+0000 7f85fa9be640 1 --2- 172.21.15.88:0/71598934 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f85dc002a70 0x7f85dc004f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:31.147 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:31.144+0000 7f85fa9be640 1 -- 172.21.15.88:0/71598934 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f85dc007ec0 con 0x7f85dc002a70 2024-04-26T23:48:31.150 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:31.147+0000 7f85fa1bd640 1 --2- 172.21.15.88:0/71598934 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f85dc002a70 0x7f85dc004f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:31.151 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:31.148+0000 7f85fa1bd640 1 -- 172.21.15.88:0/71598934 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f85dc0080c0 con 0x7f85dc002a70 2024-04-26T23:48:31.152 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:31.148+0000 7f85fa1bd640 1 --2- 172.21.15.88:0/71598934 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f85dc002a70 0x7f85dc004f30 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f85f000f590 tx=0x7f85f000fa50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:48:31.153 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:31.149+0000 7f85ea7fc640 1 -- 172.21.15.88:0/71598934 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85f00052e0 con 0x7f85dc002a70 2024-04-26T23:48:31.153 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:31.149+0000 7f85ea7fc640 1 -- 172.21.15.88:0/71598934 <== mon.1 v2:172.21.15.175:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f85f0018070 con 0x7f85dc002a70 2024-04-26T23:48:31.153 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:31.149+0000 7f85ea7fc640 1 -- 172.21.15.88:0/71598934 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f85dc002a70 msgr2=0x7f85dc004f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:31.153 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:31.149+0000 7f85ea7fc640 1 --2- 172.21.15.88:0/71598934 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f85dc002a70 0x7f85dc004f30 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f85f000f590 tx=0x7f85f000fa50 comp rx=0 tx=0).stop 2024-04-26T23:48:31.153 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:31.149+0000 7f85ea7fc640 1 -- 172.21.15.88:0/71598934 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f85dc002a70 msgr2=0x7f85dc004f30 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:48:31.153 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:31.149+0000 7f85ea7fc640 1 --2- 172.21.15.88:0/71598934 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f85dc002a70 0x7f85dc004f30 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:31.178 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:31.173+0000 7f85fa9be640 1 --2- 172.21.15.88:0/71598934 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f85dc006f30 0x7f85dc0073c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:31.179 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:31.173+0000 7f85fa9be640 1 -- 172.21.15.88:0/71598934 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f85dc00a4a0 con 0x7f85dc006f30 2024-04-26T23:48:31.179 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:31.175+0000 7f85fa1bd640 1 --2- 172.21.15.88:0/71598934 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f85dc006f30 0x7f85dc0073c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:31.180 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:31.176+0000 7f85fa1bd640 1 -- 172.21.15.88:0/71598934 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f85dc007900 con 0x7f85dc006f30 2024-04-26T23:48:31.181 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:31.177+0000 7f85fa1bd640 1 --2- 172.21.15.88:0/71598934 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f85dc006f30 0x7f85dc0073c0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f85f000f590 tx=0x7f85f0001020 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:48:31.181 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:31.177+0000 7f85ea7fc640 1 -- 172.21.15.88:0/71598934 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85f0003b40 con 0x7f85dc006f30 2024-04-26T23:48:31.182 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:31.177+0000 7f85ea7fc640 1 -- 172.21.15.88:0/71598934 <== mon.1 v2:172.21.15.175:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4555 (secure 0 0 0) 0x7f85f0003b40 con 0x7f85dc006f30 2024-04-26T23:48:31.182 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:31.178+0000 7f85ea7fc640 1 -- 172.21.15.88:0/71598934 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f85dc006f30 msgr2=0x7f85dc0073c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:31.182 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:31.178+0000 7f85ea7fc640 1 --2- 172.21.15.88:0/71598934 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f85dc006f30 0x7f85dc0073c0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f85f000f590 tx=0x7f85f0001020 comp rx=0 tx=0).stop 2024-04-26T23:48:31.182 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:31.178+0000 7f85ea7fc640 1 -- 172.21.15.88:0/71598934 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f85dc006f30 msgr2=0x7f85dc0073c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:48:31.182 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:31.178+0000 7f85ea7fc640 1 --2- 172.21.15.88:0/71598934 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f85dc006f30 0x7f85dc0073c0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:31.183 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-04-26T23:48:31.183 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2024-04-26T23:48:31.183 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2024-04-26T23:48:31.183 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "peon", 2024-04-26T23:48:31.183 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 76, 2024-04-26T23:48:31.183 INFO:teuthology.orchestra.run.smithi088.stdout: "uptime": 20727, 2024-04-26T23:48:31.183 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2024-04-26T23:48:31.183 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2024-04-26T23:48:31.183 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2024-04-26T23:48:31.183 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2024-04-26T23:48:31.183 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:48:31.183 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 16, 2024-04-26T23:48:31.184 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2024-04-26T23:48:31.184 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2450521708007866372", 2024-04-26T23:48:31.184 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2024-04-26T23:48:31.184 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-04-26T23:48:31.184 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-04-26T23:48:31.184 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-04-26T23:48:31.184 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-04-26T23:48:31.184 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-04-26T23:48:31.184 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-04-26T23:48:31.184 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-04-26T23:48:31.184 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-04-26T23:48:31.184 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-04-26T23:48:31.184 INFO:teuthology.orchestra.run.smithi088.stdout: "reef", 2024-04-26T23:48:31.184 INFO:teuthology.orchestra.run.smithi088.stdout: "squid" 2024-04-26T23:48:31.184 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:48:31.185 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540701547738038271", 2024-04-26T23:48:31.185 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2024-04-26T23:48:31.185 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-04-26T23:48:31.185 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-04-26T23:48:31.185 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-04-26T23:48:31.185 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-04-26T23:48:31.185 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-04-26T23:48:31.185 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-04-26T23:48:31.185 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-04-26T23:48:31.185 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-04-26T23:48:31.185 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-04-26T23:48:31.185 INFO:teuthology.orchestra.run.smithi088.stdout: "reef", 2024-04-26T23:48:31.185 INFO:teuthology.orchestra.run.smithi088.stdout: "squid" 2024-04-26T23:48:31.185 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:48:31.185 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:48:31.185 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2024-04-26T23:48:31.186 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2024-04-26T23:48:31.186 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2024-04-26T23:48:31.186 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2024-04-26T23:48:31.186 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2024-04-26T23:48:31.186 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "555255e9-7ef9-4454-8dc9-35e96b70035c", 2024-04-26T23:48:31.186 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2024-04-26T23:39:34.291658Z", 2024-04-26T23:48:31.186 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2024-04-26T23:39:34.291658Z", 2024-04-26T23:48:31.186 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 19, 2024-04-26T23:48:31.186 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "squid", 2024-04-26T23:48:31.186 INFO:teuthology.orchestra.run.smithi088.stdout: "election_strategy": 1, 2024-04-26T23:48:31.186 INFO:teuthology.orchestra.run.smithi088.stdout: "disallowed_leaders: ": "", 2024-04-26T23:48:31.186 INFO:teuthology.orchestra.run.smithi088.stdout: "stretch_mode": false, 2024-04-26T23:48:31.186 INFO:teuthology.orchestra.run.smithi088.stdout: "tiebreaker_mon": "", 2024-04-26T23:48:31.187 INFO:teuthology.orchestra.run.smithi088.stdout: "removed_ranks: ": "", 2024-04-26T23:48:31.187 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2024-04-26T23:48:31.187 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2024-04-26T23:48:31.187 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-04-26T23:48:31.187 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-04-26T23:48:31.187 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-04-26T23:48:31.187 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-04-26T23:48:31.187 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-04-26T23:48:31.187 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-04-26T23:48:31.187 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-04-26T23:48:31.187 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-04-26T23:48:31.187 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-04-26T23:48:31.187 INFO:teuthology.orchestra.run.smithi088.stdout: "reef", 2024-04-26T23:48:31.187 INFO:teuthology.orchestra.run.smithi088.stdout: "squid" 2024-04-26T23:48:31.187 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:48:31.187 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2024-04-26T23:48:31.188 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:48:31.188 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2024-04-26T23:48:31.188 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:48:31.188 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2024-04-26T23:48:31.188 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2024-04-26T23:48:31.188 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-04-26T23:48:31.188 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-04-26T23:48:31.188 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:48:31.188 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-04-26T23:48:31.188 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2024-04-26T23:48:31.188 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:48:31.188 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:48:31.188 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:48:31.188 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-04-26T23:48:31.188 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2024-04-26T23:48:31.189 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:48:31.189 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:48:31.189 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:48:31.189 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:48:31.189 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2024-04-26T23:48:31.189 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2024-04-26T23:48:31.189 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-04-26T23:48:31.189 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-04-26T23:48:31.189 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-04-26T23:48:31.189 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:48:31.189 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:48:31.189 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2024-04-26T23:48:31.189 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2024-04-26T23:48:31.189 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-04-26T23:48:31.190 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-04-26T23:48:31.190 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:48:31.190 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-04-26T23:48:31.190 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:3300", 2024-04-26T23:48:31.190 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:48:31.190 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:48:31.190 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:48:31.190 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-04-26T23:48:31.190 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6789", 2024-04-26T23:48:31.190 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:48:31.190 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:48:31.190 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:48:31.190 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:48:31.190 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6789/0", 2024-04-26T23:48:31.191 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.175:6789/0", 2024-04-26T23:48:31.191 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-04-26T23:48:31.191 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-04-26T23:48:31.191 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-04-26T23:48:31.191 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:48:31.191 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:48:31.191 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2024-04-26T23:48:31.191 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2024-04-26T23:48:31.191 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-04-26T23:48:31.191 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-04-26T23:48:31.191 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:48:31.191 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-04-26T23:48:31.191 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:3301", 2024-04-26T23:48:31.191 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:48:31.191 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:48:31.191 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:48:31.192 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-04-26T23:48:31.192 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6790", 2024-04-26T23:48:31.192 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:48:31.192 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:48:31.192 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:48:31.192 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:48:31.192 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6790/0", 2024-04-26T23:48:31.192 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.175:6790/0", 2024-04-26T23:48:31.192 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-04-26T23:48:31.192 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-04-26T23:48:31.192 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-04-26T23:48:31.192 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:48:31.192 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:48:31.192 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:48:31.192 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2024-04-26T23:48:31.193 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2024-04-26T23:48:31.193 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:48:31.193 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:48:31.193 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:48:31.193 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2024-04-26T23:48:31.193 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:48:31.193 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:48:31.193 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2024-04-26T23:48:31.193 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:48:31.193 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:48:31.193 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:48:31.193 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2024-04-26T23:48:31.193 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:48:31.193 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:48:31.193 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:48:31.194 INFO:teuthology.orchestra.run.smithi088.stdout: "stretch_mode": false 2024-04-26T23:48:31.194 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-04-26T23:48:31.194 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:31.184+0000 7f85fa9be640 1 -- 172.21.15.88:0/71598934 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f85d806c920 msgr2=0x7f85d806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:31.194 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:31.184+0000 7f85fa9be640 1 --2- 172.21.15.88:0/71598934 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f85d806c920 0x7f85d806ede0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f85ec16faf0 tx=0x7f85e4008040 comp rx=0 tx=0).stop 2024-04-26T23:48:31.194 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:31.184+0000 7f85fa1bd640 1 -- 172.21.15.88:0/71598934 reap_dead start 2024-04-26T23:48:31.194 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:31.184+0000 7f85fa9be640 1 -- 172.21.15.88:0/71598934 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f85ec050720 msgr2=0x7f85ec0341d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:31.195 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:31.184+0000 7f85fa9be640 1 --2- 172.21.15.88:0/71598934 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f85ec050720 0x7f85ec0341d0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f85f406bac0 tx=0x7f85f406b850 comp rx=0 tx=0).stop 2024-04-26T23:48:31.195 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:31.185+0000 7f85fa9be640 1 -- 172.21.15.88:0/71598934 shutdown_connections 2024-04-26T23:48:31.195 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:31.185+0000 7f85fa9be640 1 --2- 172.21.15.88:0/71598934 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f85ec050720 0x7f85ec0341d0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:31.195 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:31.185+0000 7f85fa9be640 1 -- 172.21.15.88:0/71598934 >> 172.21.15.88:0/71598934 conn(0x7f85ec04fc00 msgr2=0x7f85ec0062c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:48:31.195 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:31.185+0000 7f85fa9be640 1 -- 172.21.15.88:0/71598934 shutdown_connections 2024-04-26T23:48:31.195 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:31.185+0000 7f85fa9be640 1 -- 172.21.15.88:0/71598934 wait complete. 2024-04-26T23:48:31.216 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-04-26T23:48:31.216 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-04-26T23:48:31.216 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-04-26T23:48:31.416 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:31.412+0000 7f7ff3cf1640 1 Processor -- start 2024-04-26T23:48:31.418 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:31.413+0000 7f7ff3cf1640 1 -- start start 2024-04-26T23:48:31.419 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:31.414+0000 7f7ff3cf1640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7fec150200 0x7f7fec0ac140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:31.419 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:31.414+0000 7f7ff3cf1640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f7fec0ac680 0x7f7fec15d590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:31.419 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:31.414+0000 7f7ff3cf1640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7fec06ff20 con 0x7f7fec0c2cd0 2024-04-26T23:48:31.419 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:31.414+0000 7f7ff3cf1640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f7fec0c4bd0 con 0x7f7fec0ac680 2024-04-26T23:48:31.419 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:31.414+0000 7f7ff3cf1640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f7fec06f4e0 con 0x7f7fec150200 2024-04-26T23:48:31.419 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:31.414+0000 7f7ff228e640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f7fec0ac680 0x7f7fec15d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:31.419 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:31.414+0000 7f7ff228e640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f7fec0ac680 0x7f7fec15d590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.88:51092/0 (socket says 172.21.15.88:51092) 2024-04-26T23:48:31.419 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:31.414+0000 7f7ff228e640 1 -- 172.21.15.88:0/2252807964 learned_addr learned my addr 172.21.15.88:0/2252807964 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:48:31.419 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:31.415+0000 7f7ff228e640 1 -- 172.21.15.88:0/2252807964 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7fec150200 msgr2=0x7f7fec0ac140 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T23:48:31.419 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:31.415+0000 7f7ff228e640 1 --2- 172.21.15.88:0/2252807964 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7fec150200 0x7f7fec0ac140 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:31.420 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:31.415+0000 7f7ff228e640 1 -- 172.21.15.88:0/2252807964 >> v1:172.21.15.88:6789/0 conn(0x7f7fec0c2cd0 legacy=0x7f7fec1533b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:48:31.420 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:31.415+0000 7f7ff228e640 1 -- 172.21.15.88:0/2252807964 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fec0c48f0 con 0x7f7fec0ac680 2024-04-26T23:48:31.420 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:31.416+0000 7f7ff228e640 1 --2- 172.21.15.88:0/2252807964 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7fec0ac680 0x7f7fec15d590 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f7fe400d370 tx=0x7f7fe402ca20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a5973b4a4110b86f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:48:31.421 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:31.417+0000 7f7ff0a8b640 1 -- 172.21.15.88:0/2252807964 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fe4037020 con 0x7f7fec0ac680 2024-04-26T23:48:31.421 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:31.417+0000 7f7ff0a8b640 1 -- 172.21.15.88:0/2252807964 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7fe4033850 con 0x7f7fec0ac680 2024-04-26T23:48:31.422 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:31.418+0000 7f7ff3cf1640 1 -- 172.21.15.88:0/2252807964 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7fec0ac680 msgr2=0x7f7fec15d590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:31.422 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:31.418+0000 7f7ff3cf1640 1 --2- 172.21.15.88:0/2252807964 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7fec0ac680 0x7f7fec15d590 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f7fe400d370 tx=0x7f7fe402ca20 comp rx=0 tx=0).stop 2024-04-26T23:48:31.425 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:31.421+0000 7f7ff3cf1640 1 -- 172.21.15.88:0/2252807964 shutdown_connections 2024-04-26T23:48:31.425 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:31.421+0000 7f7ff3cf1640 1 --2- 172.21.15.88:0/2252807964 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7fec0ac680 0x7f7fec15d590 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:31.425 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:31.421+0000 7f7ff3cf1640 1 --2- 172.21.15.88:0/2252807964 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7fec150200 0x7f7fec0ac140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:31.425 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:31.421+0000 7f7ff3cf1640 1 -- 172.21.15.88:0/2252807964 >> 172.21.15.88:0/2252807964 conn(0x7f7fec0c82d0 msgr2=0x7f7fec0c86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:48:31.431 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:31.426+0000 7f7ff3cf1640 1 -- 172.21.15.88:0/2252807964 shutdown_connections 2024-04-26T23:48:31.433 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:31.427+0000 7f7ff3cf1640 1 -- 172.21.15.88:0/2252807964 wait complete. 2024-04-26T23:48:31.433 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:31.428+0000 7f7ff3cf1640 1 Processor -- start 2024-04-26T23:48:31.436 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:31.431+0000 7f7ff3cf1640 1 -- start start 2024-04-26T23:48:31.436 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:31.432+0000 7f7ff3cf1640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7fec0ac680 0x7f7fec1ec8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:31.437 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:31.432+0000 7f7ff3cf1640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7fec0c2cd0 0x7f7fec14b860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:31.437 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:31.432+0000 7f7ff3cf1640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7fec150200 0x7f7fec1427c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:31.437 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:31.432+0000 7f7ff3cf1640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f7fec150760 con 0x7f7fec150200 2024-04-26T23:48:31.437 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:31.432+0000 7f7ff3cf1640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f7fec1505e0 con 0x7f7fec0ac680 2024-04-26T23:48:31.437 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:31.432+0000 7f7ff3cf1640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f7fec153ac0 con 0x7f7fec0c2cd0 2024-04-26T23:48:31.437 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:31.432+0000 7f7ff228e640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7fec150200 0x7f7fec1427c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:31.437 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:31.432+0000 7f7ff228e640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7fec150200 0x7f7fec1427c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54600/0 (socket says 172.21.15.88:54600) 2024-04-26T23:48:31.437 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:31.432+0000 7f7ff228e640 1 -- 172.21.15.88:0/1987933332 learned_addr learned my addr 172.21.15.88:0/1987933332 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:48:31.437 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:31.433+0000 7f7ff228e640 1 -- 172.21.15.88:0/1987933332 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7fec0c2cd0 msgr2=0x7f7fec14b860 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-26T23:48:31.438 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:31.433+0000 7f7ff228e640 1 --2- 172.21.15.88:0/1987933332 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7fec0c2cd0 0x7f7fec14b860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:31.438 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:31.433+0000 7f7ff228e640 1 -- 172.21.15.88:0/1987933332 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7fec0ac680 msgr2=0x7f7fec1ec8f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T23:48:31.438 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:31.433+0000 7f7ff228e640 1 --2- 172.21.15.88:0/1987933332 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7fec0ac680 0x7f7fec1ec8f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:31.438 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:31.433+0000 7f7ff228e640 1 -- 172.21.15.88:0/1987933332 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fec14c280 con 0x7f7fec150200 2024-04-26T23:48:31.438 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:31.433+0000 7f7ff228e640 1 --2- 172.21.15.88:0/1987933332 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7fec150200 0x7f7fec1427c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f7fe400d370 tx=0x7f7fe4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:48:31.439 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:31.434+0000 7f7fe27fc640 1 -- 172.21.15.88:0/1987933332 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fe400be60 con 0x7f7fec150200 2024-04-26T23:48:31.439 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:31.434+0000 7f7fe27fc640 1 -- 172.21.15.88:0/1987933332 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7fe4007cb0 con 0x7f7fec150200 2024-04-26T23:48:31.439 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:31.434+0000 7f7ff3cf1640 1 -- 172.21.15.88:0/1987933332 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7fec0c7b50 con 0x7f7fec150200 2024-04-26T23:48:31.439 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:31.434+0000 7f7ff3cf1640 1 -- 172.21.15.88:0/1987933332 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7fec155890 con 0x7f7fec150200 2024-04-26T23:48:31.441 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:31.437+0000 7f7ff3cf1640 1 --2- 172.21.15.88:0/1987933332 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7fec0c7650 0x7f7fec142d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:31.441 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:31.437+0000 7f7ff3cf1640 1 -- 172.21.15.88:0/1987933332 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f7fec0699d0 con 0x7f7fec0c7650 2024-04-26T23:48:31.442 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:31.438+0000 7f7fe27fc640 1 -- 172.21.15.88:0/1987933332 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fe4007e60 con 0x7f7fec150200 2024-04-26T23:48:31.445 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:31.439+0000 7f7ff1a8d640 1 --2- 172.21.15.88:0/1987933332 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7fec0c7650 0x7f7fec142d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:31.445 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:31.439+0000 7f7fe27fc640 1 -- 172.21.15.88:0/1987933332 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f7fe403a020 con 0x7f7fec150200 2024-04-26T23:48:31.445 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:31.440+0000 7f7fe27fc640 1 --2- 172.21.15.88:0/1987933332 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f7fd0070e00 0x7f7fd00732c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:31.445 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:31.440+0000 7f7fe27fc640 1 -- 172.21.15.88:0/1987933332 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6666+0+0 (secure 0 0 0) 0x7f7fe40af8e0 con 0x7f7fec150200 2024-04-26T23:48:31.447 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:31.442+0000 7f7ff1a8d640 1 -- 172.21.15.88:0/1987933332 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7fec14a070 con 0x7f7fec0c7650 2024-04-26T23:48:31.447 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:31.443+0000 7f7ff128c640 1 --2- 172.21.15.88:0/1987933332 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f7fd0070e00 0x7f7fd00732c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:31.449 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:31.443+0000 7f7ff1a8d640 1 --2- 172.21.15.88:0/1987933332 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7fec0c7650 0x7f7fec142d00 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f7fdc00b310 tx=0x7f7fdc00b7d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:48:31.449 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:31.444+0000 7f7ff128c640 1 --2- 172.21.15.88:0/1987933332 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f7fd0070e00 0x7f7fd00732c0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f7fec1e9aa0 tx=0x7f7fe80079d0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:48:31.454 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:31.447+0000 7f7fe27fc640 1 -- 172.21.15.88:0/1987933332 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fdc015020 con 0x7f7fec0c7650 2024-04-26T23:48:31.454 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:31.447+0000 7f7fe27fc640 1 -- 172.21.15.88:0/1987933332 <== mon.2 v2:172.21.15.175:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f7fdc011830 con 0x7f7fec0c7650 2024-04-26T23:48:31.454 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:31.447+0000 7f7fe27fc640 1 -- 172.21.15.88:0/1987933332 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7fec0c7650 msgr2=0x7f7fec142d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:31.454 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:31.447+0000 7f7fe27fc640 1 --2- 172.21.15.88:0/1987933332 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7fec0c7650 0x7f7fec142d00 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f7fdc00b310 tx=0x7f7fdc00b7d0 comp rx=0 tx=0).stop 2024-04-26T23:48:31.454 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:31.447+0000 7f7fe27fc640 1 -- 172.21.15.88:0/1987933332 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7fec0c7650 msgr2=0x7f7fec142d00 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:48:31.455 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:31.447+0000 7f7fe27fc640 1 --2- 172.21.15.88:0/1987933332 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7fec0c7650 0x7f7fec142d00 secure :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f7fdc00b310 tx=0x7f7fdc00b7d0 comp rx=0 tx=0).stop 2024-04-26T23:48:31.477 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:31.472+0000 7f7ff3cf1640 1 --2- 172.21.15.88:0/1987933332 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7fec155a90 0x7f7fec156090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:31.477 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:31.473+0000 7f7ff3cf1640 1 -- 172.21.15.88:0/1987933332 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f7fec14e380 con 0x7f7fec155a90 2024-04-26T23:48:31.481 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:31.477+0000 7f7ff1a8d640 1 --2- 172.21.15.88:0/1987933332 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7fec155a90 0x7f7fec156090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:31.484 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:31.480+0000 7f7ff1a8d640 1 -- 172.21.15.88:0/1987933332 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f7fec14d580 con 0x7f7fec155a90 2024-04-26T23:48:31.491 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:31.487+0000 7f7ff1a8d640 1 --2- 172.21.15.88:0/1987933332 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7fec155a90 0x7f7fec156090 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f7fdc00b310 tx=0x7f7fdc004650 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:48:31.493 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:31.488+0000 7f7fe27fc640 1 -- 172.21.15.88:0/1987933332 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fdc015040 con 0x7f7fec155a90 2024-04-26T23:48:31.493 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:31.488+0000 7f7fe27fc640 1 -- 172.21.15.88:0/1987933332 <== mon.2 v2:172.21.15.175:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5209 (secure 0 0 0) 0x7f7fdc01c020 con 0x7f7fec155a90 2024-04-26T23:48:31.493 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:31.488+0000 7f7fe27fc640 1 -- 172.21.15.88:0/1987933332 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7fec155a90 msgr2=0x7f7fec156090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:31.493 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:31.488+0000 7f7fe27fc640 1 --2- 172.21.15.88:0/1987933332 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7fec155a90 0x7f7fec156090 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f7fdc00b310 tx=0x7f7fdc004650 comp rx=0 tx=0).stop 2024-04-26T23:48:31.493 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:31.488+0000 7f7fe27fc640 1 -- 172.21.15.88:0/1987933332 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7fec155a90 msgr2=0x7f7fec156090 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:48:31.493 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:31.488+0000 7f7fe27fc640 1 --2- 172.21.15.88:0/1987933332 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7fec155a90 0x7f7fec156090 secure :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f7fdc00b310 tx=0x7f7fdc004650 comp rx=0 tx=0).stop 2024-04-26T23:48:31.495 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-04-26T23:48:31.495 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2024-04-26T23:48:31.495 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2024-04-26T23:48:31.496 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "peon", 2024-04-26T23:48:31.496 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 76, 2024-04-26T23:48:31.496 INFO:teuthology.orchestra.run.smithi088.stdout: "uptime": 279775, 2024-04-26T23:48:31.496 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2024-04-26T23:48:31.496 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2024-04-26T23:48:31.496 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2024-04-26T23:48:31.496 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2024-04-26T23:48:31.496 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:48:31.496 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 16, 2024-04-26T23:48:31.496 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2024-04-26T23:48:31.496 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2450521708007866372", 2024-04-26T23:48:31.496 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2024-04-26T23:48:31.496 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-04-26T23:48:31.496 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-04-26T23:48:31.497 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-04-26T23:48:31.497 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-04-26T23:48:31.497 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-04-26T23:48:31.497 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-04-26T23:48:31.497 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-04-26T23:48:31.497 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-04-26T23:48:31.497 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-04-26T23:48:31.497 INFO:teuthology.orchestra.run.smithi088.stdout: "reef", 2024-04-26T23:48:31.497 INFO:teuthology.orchestra.run.smithi088.stdout: "squid" 2024-04-26T23:48:31.497 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:48:31.497 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540701547738038271", 2024-04-26T23:48:31.497 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2024-04-26T23:48:31.497 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-04-26T23:48:31.497 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-04-26T23:48:31.498 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-04-26T23:48:31.498 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-04-26T23:48:31.498 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-04-26T23:48:31.498 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-04-26T23:48:31.498 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-04-26T23:48:31.498 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-04-26T23:48:31.498 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-04-26T23:48:31.498 INFO:teuthology.orchestra.run.smithi088.stdout: "reef", 2024-04-26T23:48:31.498 INFO:teuthology.orchestra.run.smithi088.stdout: "squid" 2024-04-26T23:48:31.498 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:48:31.498 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:48:31.498 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2024-04-26T23:48:31.498 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2024-04-26T23:48:31.498 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2024-04-26T23:48:31.498 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2024-04-26T23:48:31.499 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2024-04-26T23:48:31.499 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "555255e9-7ef9-4454-8dc9-35e96b70035c", 2024-04-26T23:48:31.499 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2024-04-26T23:39:34.291658Z", 2024-04-26T23:48:31.499 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2024-04-26T23:39:34.291658Z", 2024-04-26T23:48:31.499 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 19, 2024-04-26T23:48:31.499 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "squid", 2024-04-26T23:48:31.499 INFO:teuthology.orchestra.run.smithi088.stdout: "election_strategy": 1, 2024-04-26T23:48:31.499 INFO:teuthology.orchestra.run.smithi088.stdout: "disallowed_leaders: ": "", 2024-04-26T23:48:31.499 INFO:teuthology.orchestra.run.smithi088.stdout: "stretch_mode": false, 2024-04-26T23:48:31.499 INFO:teuthology.orchestra.run.smithi088.stdout: "tiebreaker_mon": "", 2024-04-26T23:48:31.499 INFO:teuthology.orchestra.run.smithi088.stdout: "removed_ranks: ": "", 2024-04-26T23:48:31.499 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2024-04-26T23:48:31.499 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2024-04-26T23:48:31.499 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-04-26T23:48:31.500 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-04-26T23:48:31.500 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-04-26T23:48:31.500 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-04-26T23:48:31.500 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-04-26T23:48:31.500 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-04-26T23:48:31.500 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-04-26T23:48:31.500 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-04-26T23:48:31.500 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-04-26T23:48:31.500 INFO:teuthology.orchestra.run.smithi088.stdout: "reef", 2024-04-26T23:48:31.500 INFO:teuthology.orchestra.run.smithi088.stdout: "squid" 2024-04-26T23:48:31.500 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:48:31.500 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2024-04-26T23:48:31.500 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:48:31.500 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2024-04-26T23:48:31.500 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:48:31.501 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2024-04-26T23:48:31.501 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2024-04-26T23:48:31.501 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-04-26T23:48:31.501 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-04-26T23:48:31.501 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:48:31.501 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-04-26T23:48:31.501 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2024-04-26T23:48:31.501 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:48:31.501 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:48:31.501 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:48:31.501 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-04-26T23:48:31.501 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2024-04-26T23:48:31.501 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:48:31.501 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:48:31.502 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:48:31.502 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:48:31.502 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2024-04-26T23:48:31.502 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2024-04-26T23:48:31.502 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-04-26T23:48:31.502 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-04-26T23:48:31.502 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-04-26T23:48:31.502 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:48:31.502 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:48:31.502 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2024-04-26T23:48:31.502 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2024-04-26T23:48:31.502 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-04-26T23:48:31.502 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-04-26T23:48:31.502 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:48:31.503 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-04-26T23:48:31.503 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:3300", 2024-04-26T23:48:31.503 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:48:31.503 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:48:31.503 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:48:31.503 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-04-26T23:48:31.503 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6789", 2024-04-26T23:48:31.503 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:48:31.503 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:48:31.503 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:48:31.503 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:48:31.503 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6789/0", 2024-04-26T23:48:31.503 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.175:6789/0", 2024-04-26T23:48:31.503 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-04-26T23:48:31.504 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-04-26T23:48:31.504 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-04-26T23:48:31.504 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:48:31.504 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:48:31.504 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2024-04-26T23:48:31.504 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2024-04-26T23:48:31.504 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-04-26T23:48:31.504 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-04-26T23:48:31.504 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:48:31.504 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-04-26T23:48:31.504 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:3301", 2024-04-26T23:48:31.504 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:48:31.504 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:48:31.504 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:48:31.504 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-04-26T23:48:31.505 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6790", 2024-04-26T23:48:31.505 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:48:31.505 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:48:31.505 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:48:31.505 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:48:31.505 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6790/0", 2024-04-26T23:48:31.505 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.175:6790/0", 2024-04-26T23:48:31.505 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-04-26T23:48:31.505 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-04-26T23:48:31.505 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-04-26T23:48:31.505 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:48:31.505 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:48:31.505 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:48:31.505 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2024-04-26T23:48:31.506 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2024-04-26T23:48:31.506 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:48:31.506 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:48:31.506 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:48:31.506 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2024-04-26T23:48:31.506 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:48:31.506 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:48:31.506 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": [ 2024-04-26T23:48:31.506 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:48:31.506 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:48:31.506 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:48:31.506 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 4 2024-04-26T23:48:31.506 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:48:31.506 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:48:31.506 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": [ 2024-04-26T23:48:31.506 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:48:31.507 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:48:31.507 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:48:31.507 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 8 2024-04-26T23:48:31.507 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:48:31.507 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:48:31.507 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2024-04-26T23:48:31.507 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:48:31.507 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x2f018fb87aa4aafe", 2024-04-26T23:48:31.507 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:48:31.507 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2024-04-26T23:48:31.507 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:48:31.507 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:48:31.507 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:48:31.507 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:48:31.507 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 5 2024-04-26T23:48:31.508 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:48:31.508 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:48:31.508 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": [ 2024-04-26T23:48:31.508 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:48:31.508 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:48:31.508 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:48:31.508 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2024-04-26T23:48:31.508 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:48:31.508 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:48:31.508 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:48:31.508 INFO:teuthology.orchestra.run.smithi088.stdout: "stretch_mode": false 2024-04-26T23:48:31.508 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-04-26T23:48:31.509 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:31.492+0000 7f7ff3cf1640 1 -- 172.21.15.88:0/1987933332 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f7fd0070e00 msgr2=0x7f7fd00732c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:31.509 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:31.492+0000 7f7ff3cf1640 1 --2- 172.21.15.88:0/1987933332 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f7fd0070e00 0x7f7fd00732c0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f7fec1e9aa0 tx=0x7f7fe80079d0 comp rx=0 tx=0).stop 2024-04-26T23:48:31.509 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:31.492+0000 7f7ff3cf1640 1 -- 172.21.15.88:0/1987933332 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7fec150200 msgr2=0x7f7fec1427c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:31.509 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:31.492+0000 7f7ff3cf1640 1 --2- 172.21.15.88:0/1987933332 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7fec150200 0x7f7fec1427c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f7fe400d370 tx=0x7f7fe4004a40 comp rx=0 tx=0).stop 2024-04-26T23:48:31.509 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:31.493+0000 7f7ff228e640 1 -- 172.21.15.88:0/1987933332 reap_dead start 2024-04-26T23:48:31.509 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:31.493+0000 7f7ff228e640 1 -- 172.21.15.88:0/1987933332 reap_dead start 2024-04-26T23:48:31.509 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:31.497+0000 7f7ff3cf1640 1 -- 172.21.15.88:0/1987933332 shutdown_connections 2024-04-26T23:48:31.509 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:31.497+0000 7f7ff3cf1640 1 -- 172.21.15.88:0/1987933332 >> 172.21.15.88:0/1987933332 conn(0x7f7fec0c82d0 msgr2=0x7f7fec14ce10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:48:31.510 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:31.505+0000 7f7ff3cf1640 1 -- 172.21.15.88:0/1987933332 shutdown_connections 2024-04-26T23:48:31.512 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:31.508+0000 7f7ff3cf1640 1 -- 172.21.15.88:0/1987933332 wait complete. 2024-04-26T23:48:31.541 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-04-26T23:48:31.541 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['a'] 2024-04-26T23:48:31.541 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: ['b'] 2024-04-26T23:48:31.541 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.a 2024-04-26T23:48:31.541 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2024-04-26T23:48:31.541 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-04-26T23:48:31.541 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T23:48:31.558 INFO:tasks.ceph.mon.a:Stopped 2024-04-26T23:48:31.558 INFO:tasks.mon_thrash:Sending STOP to mon b 2024-04-26T23:48:31.558 INFO:tasks.ceph.mon.b:Sent signal 19 2024-04-26T23:48:31.559 INFO:tasks.mon_thrash.mon_thrasher:waiting for 15.0 secs to unfreeze mons 2024-04-26T23:48:35.517 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:48:35.521 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:48:46.559 INFO:tasks.mon_thrash:Sending CONT to mon b 2024-04-26T23:48:46.560 INFO:tasks.ceph.mon.b:Sent signal 18 2024-04-26T23:48:46.560 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2024-04-26T23:48:46.560 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-04-26T23:48:46.787 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:46.782+0000 7f1c3f740640 1 Processor -- start 2024-04-26T23:48:46.787 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:46.782+0000 7f1c3f740640 1 -- start start 2024-04-26T23:48:46.788 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:46.783+0000 7f1c3f740640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f1c38073900 0x7f1c3806d940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:46.788 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:46.783+0000 7f1c3f740640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1c3815e540 0x7f1c3815e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:46.788 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:46.783+0000 7f1c3f740640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1c380c4e30 con 0x7f1c38074a70 2024-04-26T23:48:46.788 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:46.783+0000 7f1c3f740640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f1c3815af50 con 0x7f1c38073900 2024-04-26T23:48:46.788 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:46.783+0000 7f1c3f740640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f1c3806e1b0 con 0x7f1c3815e540 2024-04-26T23:48:46.788 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:46.783+0000 7f1c3d4dc640 1 -- >> v2:172.21.15.88:3300/0 conn(0x7f1c38073900 msgr2=0x7f1c3806d940 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.88:3300/0 2024-04-26T23:48:46.788 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:46.783+0000 7f1c3d4dc640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f1c38073900 0x7f1c3806d940 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:48:46.788 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:46.783+0000 7f1c3dcdd640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1c3815e540 0x7f1c3815e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:46.788 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:46.784+0000 7f1c3dcdd640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1c3815e540 0x7f1c3815e9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.88:50156/0 (socket says 172.21.15.88:50156) 2024-04-26T23:48:46.788 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:46.784+0000 7f1c3dcdd640 1 -- 172.21.15.88:0/2963128071 learned_addr learned my addr 172.21.15.88:0/2963128071 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:48:46.789 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:46.784+0000 7f1c3dcdd640 1 -- 172.21.15.88:0/2963128071 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1c3815e540 msgr2=0x7f1c3815e9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-26T23:48:46.789 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:46.784+0000 7f1c3dcdd640 1 -- 172.21.15.88:0/2963128071 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1c3815e540 msgr2=0x7f1c3815e9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T23:48:46.789 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:46.784+0000 7f1c3dcdd640 1 --2- 172.21.15.88:0/2963128071 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1c3815e540 0x7f1c3815e9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:48:46.789 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:46.784+0000 7f1c3dcdd640 1 --2- 172.21.15.88:0/2963128071 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1c3815e540 0x7f1c3815e9f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:48:46.790 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:46.786+0000 7f1c3ccdb640 1 -- 172.21.15.88:0/2963128071 >> v1:172.21.15.88:6789/0 conn(0x7f1c38074a70 legacy=0x7f1c38158380 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.88:6789/0 2024-04-26T23:48:46.988 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:46.984+0000 7f1c3d4dc640 1 -- 172.21.15.88:0/2963128071 >> v2:172.21.15.88:3300/0 conn(0x7f1c38073900 msgr2=0x7f1c3806d940 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.88:3300/0 2024-04-26T23:48:46.988 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:46.984+0000 7f1c3d4dc640 1 --2- 172.21.15.88:0/2963128071 >> v2:172.21.15.88:3300/0 conn(0x7f1c38073900 0x7f1c3806d940 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-26T23:48:46.989 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:46.985+0000 7f1c3dcdd640 1 --2- 172.21.15.88:0/2963128071 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1c3815e540 0x7f1c3815e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:46.989 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:46.985+0000 7f1c3dcdd640 1 -- 172.21.15.88:0/2963128071 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1c3815e540 msgr2=0x7f1c3815e9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-26T23:48:46.989 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:46.985+0000 7f1c3dcdd640 1 -- 172.21.15.88:0/2963128071 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1c3815e540 msgr2=0x7f1c3815e9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T23:48:46.989 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:46.985+0000 7f1c3dcdd640 1 --2- 172.21.15.88:0/2963128071 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1c3815e540 0x7f1c3815e9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:48:46.990 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:46.985+0000 7f1c3dcdd640 1 --2- 172.21.15.88:0/2963128071 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1c3815e540 0x7f1c3815e9f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-26T23:48:46.991 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:46.987+0000 7f1c3ccdb640 1 -- 172.21.15.88:0/2963128071 >> v1:172.21.15.88:6789/0 conn(0x7f1c38074a70 legacy=0x7f1c38158380 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.88:6789/0 2024-04-26T23:48:47.389 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:47.385+0000 7f1c3d4dc640 1 -- 172.21.15.88:0/2963128071 >> v2:172.21.15.88:3300/0 conn(0x7f1c38073900 msgr2=0x7f1c3806d940 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.88:3300/0 2024-04-26T23:48:47.389 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:47.385+0000 7f1c3d4dc640 1 --2- 172.21.15.88:0/2963128071 >> v2:172.21.15.88:3300/0 conn(0x7f1c38073900 0x7f1c3806d940 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-26T23:48:47.390 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:47.386+0000 7f1c3dcdd640 1 --2- 172.21.15.88:0/2963128071 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1c3815e540 0x7f1c3815e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:47.391 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:47.387+0000 7f1c3dcdd640 1 -- 172.21.15.88:0/2963128071 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1c3815e540 msgr2=0x7f1c3815e9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-26T23:48:47.391 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:47.387+0000 7f1c3dcdd640 1 -- 172.21.15.88:0/2963128071 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1c3815e540 msgr2=0x7f1c3815e9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T23:48:47.391 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:47.387+0000 7f1c3dcdd640 1 --2- 172.21.15.88:0/2963128071 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1c3815e540 0x7f1c3815e9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:48:47.391 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:47.387+0000 7f1c3dcdd640 1 --2- 172.21.15.88:0/2963128071 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1c3815e540 0x7f1c3815e9f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-26T23:48:47.392 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:47.388+0000 7f1c3ccdb640 1 -- 172.21.15.88:0/2963128071 >> v1:172.21.15.88:6789/0 conn(0x7f1c38074a70 legacy=0x7f1c38158380 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.88:6789/0 2024-04-26T23:48:48.190 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:48.186+0000 7f1c3d4dc640 1 -- 172.21.15.88:0/2963128071 >> v2:172.21.15.88:3300/0 conn(0x7f1c38073900 msgr2=0x7f1c3806d940 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.88:3300/0 2024-04-26T23:48:48.190 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:48.186+0000 7f1c3d4dc640 1 --2- 172.21.15.88:0/2963128071 >> v2:172.21.15.88:3300/0 conn(0x7f1c38073900 0x7f1c3806d940 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-26T23:48:48.192 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:48.188+0000 7f1c3dcdd640 1 --2- 172.21.15.88:0/2963128071 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1c3815e540 0x7f1c3815e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:48.192 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:48.188+0000 7f1c3dcdd640 1 -- 172.21.15.88:0/2963128071 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1c3815e540 msgr2=0x7f1c3815e9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-26T23:48:48.192 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:48.188+0000 7f1c3dcdd640 1 -- 172.21.15.88:0/2963128071 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1c3815e540 msgr2=0x7f1c3815e9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T23:48:48.193 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:48.188+0000 7f1c3dcdd640 1 --2- 172.21.15.88:0/2963128071 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1c3815e540 0x7f1c3815e9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:48:48.193 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:48.188+0000 7f1c3dcdd640 1 --2- 172.21.15.88:0/2963128071 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1c3815e540 0x7f1c3815e9f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-26T23:48:48.193 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:48.189+0000 7f1c3ccdb640 1 -- 172.21.15.88:0/2963128071 >> v1:172.21.15.88:6789/0 conn(0x7f1c38074a70 legacy=0x7f1c38158380 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.88:6789/0 2024-04-26T23:48:49.789 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:49.783+0000 7f1c36ffd640 1 -- 172.21.15.88:0/2963128071 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1c3815e540 msgr2=0x7f1c3815e9f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T23:48:49.789 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:49.783+0000 7f1c36ffd640 1 --2- 172.21.15.88:0/2963128071 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1c3815e540 0x7f1c3815e9f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:49.789 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:49.783+0000 7f1c36ffd640 1 -- 172.21.15.88:0/2963128071 >> v2:172.21.15.88:3300/0 conn(0x7f1c38073900 msgr2=0x7f1c3806d940 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T23:48:49.789 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:49.783+0000 7f1c36ffd640 1 --2- 172.21.15.88:0/2963128071 >> v2:172.21.15.88:3300/0 conn(0x7f1c38073900 0x7f1c3806d940 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:49.789 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:49.783+0000 7f1c36ffd640 1 -- 172.21.15.88:0/2963128071 >> v1:172.21.15.88:6789/0 conn(0x7f1c38074a70 legacy=0x7f1c38158380 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T23:48:49.789 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:49.783+0000 7f1c36ffd640 1 --2- 172.21.15.88:0/2963128071 >> v2:172.21.15.175:3300/0 conn(0x7f1c240036a0 0x7f1c24005b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:49.789 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:49.784+0000 7f1c36ffd640 1 -- 172.21.15.88:0/2963128071 --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1c3815b210 con 0x7f1c24006170 2024-04-26T23:48:49.789 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:49.784+0000 7f1c3d4dc640 1 --2- 172.21.15.88:0/2963128071 >> v2:172.21.15.175:3300/0 conn(0x7f1c240036a0 0x7f1c24005b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:49.789 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:49.784+0000 7f1c36ffd640 1 -- 172.21.15.88:0/2963128071 --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f1c3815af50 con 0x7f1c240036a0 2024-04-26T23:48:49.789 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:49.784+0000 7f1c3d4dc640 1 -- 172.21.15.88:0/2963128071 >> v2:172.21.15.175:3300/0 conn(0x7f1c240036a0 msgr2=0x7f1c24005b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-26T23:48:49.789 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:49.784+0000 7f1c3d4dc640 1 -- 172.21.15.88:0/2963128071 >> v2:172.21.15.175:3300/0 conn(0x7f1c240036a0 msgr2=0x7f1c24005b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T23:48:49.790 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:49.784+0000 7f1c3d4dc640 1 --2- 172.21.15.88:0/2963128071 >> v2:172.21.15.175:3300/0 conn(0x7f1c240036a0 0x7f1c24005b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:48:49.790 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:49.784+0000 7f1c3d4dc640 1 --2- 172.21.15.88:0/2963128071 >> v2:172.21.15.175:3300/0 conn(0x7f1c240036a0 0x7f1c24005b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:48:49.990 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:49.985+0000 7f1c3d4dc640 1 --2- 172.21.15.88:0/2963128071 >> v2:172.21.15.175:3300/0 conn(0x7f1c240036a0 0x7f1c24005b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:49.990 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:49.986+0000 7f1c3d4dc640 1 -- 172.21.15.88:0/2963128071 >> v2:172.21.15.175:3300/0 conn(0x7f1c240036a0 msgr2=0x7f1c24005b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-26T23:48:49.991 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:49.986+0000 7f1c3d4dc640 1 -- 172.21.15.88:0/2963128071 >> v2:172.21.15.175:3300/0 conn(0x7f1c240036a0 msgr2=0x7f1c24005b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T23:48:49.991 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:49.986+0000 7f1c3d4dc640 1 --2- 172.21.15.88:0/2963128071 >> v2:172.21.15.175:3300/0 conn(0x7f1c240036a0 0x7f1c24005b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:48:49.991 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:49.986+0000 7f1c3d4dc640 1 --2- 172.21.15.88:0/2963128071 >> v2:172.21.15.175:3300/0 conn(0x7f1c240036a0 0x7f1c24005b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-26T23:48:50.391 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:50.387+0000 7f1c3d4dc640 1 --2- 172.21.15.88:0/2963128071 >> v2:172.21.15.175:3300/0 conn(0x7f1c240036a0 0x7f1c24005b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:50.392 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:50.387+0000 7f1c3d4dc640 1 -- 172.21.15.88:0/2963128071 >> v2:172.21.15.175:3300/0 conn(0x7f1c240036a0 msgr2=0x7f1c24005b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-26T23:48:50.392 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:50.387+0000 7f1c3d4dc640 1 -- 172.21.15.88:0/2963128071 >> v2:172.21.15.175:3300/0 conn(0x7f1c240036a0 msgr2=0x7f1c24005b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T23:48:50.392 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:50.387+0000 7f1c3d4dc640 1 --2- 172.21.15.88:0/2963128071 >> v2:172.21.15.175:3300/0 conn(0x7f1c240036a0 0x7f1c24005b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:48:50.392 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:50.387+0000 7f1c3d4dc640 1 --2- 172.21.15.88:0/2963128071 >> v2:172.21.15.175:3300/0 conn(0x7f1c240036a0 0x7f1c24005b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-26T23:48:51.192 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:51.188+0000 7f1c3d4dc640 1 --2- 172.21.15.88:0/2963128071 >> v2:172.21.15.175:3300/0 conn(0x7f1c240036a0 0x7f1c24005b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:51.193 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:51.188+0000 7f1c3d4dc640 1 -- 172.21.15.88:0/2963128071 >> v2:172.21.15.175:3300/0 conn(0x7f1c240036a0 msgr2=0x7f1c24005b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-26T23:48:51.193 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:51.188+0000 7f1c3d4dc640 1 -- 172.21.15.88:0/2963128071 >> v2:172.21.15.175:3300/0 conn(0x7f1c240036a0 msgr2=0x7f1c24005b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T23:48:51.193 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:51.188+0000 7f1c3d4dc640 1 --2- 172.21.15.88:0/2963128071 >> v2:172.21.15.175:3300/0 conn(0x7f1c240036a0 0x7f1c24005b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:48:51.193 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:51.188+0000 7f1c3d4dc640 1 --2- 172.21.15.88:0/2963128071 >> v2:172.21.15.175:3300/0 conn(0x7f1c240036a0 0x7f1c24005b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-26T23:48:51.585 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:51.581+0000 7f1c37fff640 1 -- 172.21.15.88:0/2963128071 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3337114976 0 0) 0x7f1c3815b210 con 0x7f1c24006170 2024-04-26T23:48:51.585 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:51.581+0000 7f1c37fff640 1 -- 172.21.15.88:0/2963128071 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1c20003520 con 0x7f1c24006170 2024-04-26T23:48:51.599 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:51.594+0000 7f1c37fff640 1 -- 172.21.15.88:0/2963128071 <== mon.1 v1:172.21.15.175:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 282949309 0 0) 0x7f1c20003520 con 0x7f1c24006170 2024-04-26T23:48:51.599 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:51.594+0000 7f1c37fff640 1 -- 172.21.15.88:0/2963128071 >> v2:172.21.15.175:3300/0 conn(0x7f1c240036a0 msgr2=0x7f1c24005b20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T23:48:51.599 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:51.594+0000 7f1c37fff640 1 --2- 172.21.15.88:0/2963128071 >> v2:172.21.15.175:3300/0 conn(0x7f1c240036a0 0x7f1c24005b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:51.599 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:51.594+0000 7f1c37fff640 1 -- 172.21.15.88:0/2963128071 --> v1:172.21.15.175:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c2400aee0 con 0x7f1c24006170 2024-04-26T23:48:51.599 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:51.595+0000 7f1c37fff640 1 -- 172.21.15.88:0/2963128071 <== mon.1 v1:172.21.15.175:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 356324787 0 0) 0x7f1c2c0040f0 con 0x7f1c24006170 2024-04-26T23:48:51.600 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:51.595+0000 7f1c37fff640 1 -- 172.21.15.88:0/2963128071 >> v1:172.21.15.175:6789/0 conn(0x7f1c24006170 legacy=0x7f1c24008630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:51.600 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:51.595+0000 7f1c3dcdd640 1 -- 172.21.15.88:0/2963128071 reap_dead start 2024-04-26T23:48:51.600 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:51.595+0000 7f1c37fff640 1 --2- 172.21.15.88:0/2963128071 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1c200039b0 0x7f1c20003db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:51.600 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:51.595+0000 7f1c3d4dc640 1 -- 172.21.15.88:0/2963128071 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1c200039b0 msgr2=0x7f1c20003db0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.88:3300/0 2024-04-26T23:48:51.600 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:51.595+0000 7f1c3d4dc640 1 --2- 172.21.15.88:0/2963128071 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1c200039b0 0x7f1c20003db0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:48:51.600 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:51.595+0000 7f1c37fff640 1 --2- 172.21.15.88:0/2963128071 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1c20004800 0x7f1c20004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:51.600 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:51.595+0000 7f1c37fff640 1 --2- 172.21.15.88:0/2963128071 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1c20005210 0x7f1c2000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:51.600 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:51.595+0000 7f1c37fff640 1 -- 172.21.15.88:0/2963128071 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f1c3815af50 con 0x7f1c200039b0 2024-04-26T23:48:51.600 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:51.595+0000 7f1c37fff640 1 -- 172.21.15.88:0/2963128071 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f1c2000c140 con 0x7f1c20004800 2024-04-26T23:48:51.600 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:51.595+0000 7f1c37fff640 1 -- 172.21.15.88:0/2963128071 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f1c2000c340 con 0x7f1c20005210 2024-04-26T23:48:51.600 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:51.595+0000 7f1c3dcdd640 1 --2- 172.21.15.88:0/2963128071 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1c20005210 0x7f1c2000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:51.600 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:51.595+0000 7f1c3ccdb640 1 --2- 172.21.15.88:0/2963128071 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1c20004800 0x7f1c20004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:51.601 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:51.596+0000 7f1c3dcdd640 1 -- 172.21.15.88:0/2963128071 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1c20004800 msgr2=0x7f1c20004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:48:51.601 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:51.596+0000 7f1c3dcdd640 1 --2- 172.21.15.88:0/2963128071 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1c20004800 0x7f1c20004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:51.601 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:51.596+0000 7f1c3dcdd640 1 -- 172.21.15.88:0/2963128071 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1c200039b0 msgr2=0x7f1c20003db0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T23:48:51.601 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:51.596+0000 7f1c3dcdd640 1 --2- 172.21.15.88:0/2963128071 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1c200039b0 0x7f1c20003db0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:51.601 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:51.596+0000 7f1c3dcdd640 1 -- 172.21.15.88:0/2963128071 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c20003520 con 0x7f1c20005210 2024-04-26T23:48:51.601 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:51.597+0000 7f1c3dcdd640 1 --2- 172.21.15.88:0/2963128071 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1c20005210 0x7f1c2000b9c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f1c3815e920 tx=0x7f1c20005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1f373ed54b1fcbe3 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:48:51.646 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:51.642+0000 7f1c37fff640 1 -- 172.21.15.88:0/2963128071 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c30031070 con 0x7f1c20005210 2024-04-26T23:48:51.648 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:51.642+0000 7f1c37fff640 1 -- 172.21.15.88:0/2963128071 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c3002b530 con 0x7f1c20005210 2024-04-26T23:48:51.648 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:51.642+0000 7f1c37fff640 1 -- 172.21.15.88:0/2963128071 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c30009700 con 0x7f1c20005210 2024-04-26T23:48:51.648 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:51.643+0000 7f1c3f740640 1 -- 172.21.15.88:0/2963128071 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1c20005210 msgr2=0x7f1c2000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:51.648 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:51.643+0000 7f1c3f740640 1 --2- 172.21.15.88:0/2963128071 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1c20005210 0x7f1c2000b9c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f1c3815e920 tx=0x7f1c20005830 comp rx=0 tx=0).stop 2024-04-26T23:48:51.648 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:51.643+0000 7f1c3f740640 1 -- 172.21.15.88:0/2963128071 shutdown_connections 2024-04-26T23:48:51.648 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:51.643+0000 7f1c3f740640 1 --2- 172.21.15.88:0/2963128071 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1c20005210 0x7f1c2000b9c0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:51.649 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:51.643+0000 7f1c3f740640 1 --2- 172.21.15.88:0/2963128071 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1c20004800 0x7f1c20004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:51.649 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:51.643+0000 7f1c3f740640 1 --2- 172.21.15.88:0/2963128071 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1c200039b0 0x7f1c20003db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:51.649 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:51.643+0000 7f1c3f740640 1 -- 172.21.15.88:0/2963128071 >> 172.21.15.88:0/2963128071 conn(0x7f1c380c6d80 msgr2=0x7f1c380c7160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:48:51.649 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:51.644+0000 7f1c3f740640 1 -- 172.21.15.88:0/2963128071 shutdown_connections 2024-04-26T23:48:51.649 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:51.644+0000 7f1c3f740640 1 -- 172.21.15.88:0/2963128071 wait complete. 2024-04-26T23:48:51.650 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:51.645+0000 7f1c3f740640 1 Processor -- start 2024-04-26T23:48:51.650 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:51.646+0000 7f1c3f740640 1 -- start start 2024-04-26T23:48:51.652 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:51.647+0000 7f1c3f740640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1c200039b0 0x7f1c380ad8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:51.653 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:51.647+0000 7f1c3f740640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1c20004800 0x7f1c380ab6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:51.653 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:51.648+0000 7f1c3d4dc640 1 -- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1c200039b0 msgr2=0x7f1c380ad8b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.88:3300/0 2024-04-26T23:48:51.653 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:51.648+0000 7f1c3d4dc640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1c200039b0 0x7f1c380ad8b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:48:51.653 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:51.648+0000 7f1c3f740640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1c20005210 0x7f1c381f3eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:51.653 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:51.648+0000 7f1c3f740640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f1c3815bcf0 con 0x7f1c200039b0 2024-04-26T23:48:51.653 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:51.648+0000 7f1c3f740640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f1c3815b7d0 con 0x7f1c20005210 2024-04-26T23:48:51.653 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:51.648+0000 7f1c3f740640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f1c3815be70 con 0x7f1c20004800 2024-04-26T23:48:51.654 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:51.648+0000 7f1c3ccdb640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1c20004800 0x7f1c380ab6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:51.654 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:51.648+0000 7f1c3ccdb640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1c20004800 0x7f1c380ab6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.88:42436/0 (socket says 172.21.15.88:42436) 2024-04-26T23:48:51.654 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:51.648+0000 7f1c3ccdb640 1 -- 172.21.15.88:0/1558726152 learned_addr learned my addr 172.21.15.88:0/1558726152 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:48:51.654 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:51.649+0000 7f1c3ccdb640 1 -- 172.21.15.88:0/1558726152 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1c20005210 msgr2=0x7f1c381f3eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:51.654 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:51.649+0000 7f1c3ccdb640 1 --2- 172.21.15.88:0/1558726152 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1c20005210 0x7f1c381f3eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:51.654 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:51.649+0000 7f1c3ccdb640 1 -- 172.21.15.88:0/1558726152 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1c200039b0 msgr2=0x7f1c380ad8b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T23:48:51.654 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:51.649+0000 7f1c3ccdb640 1 --2- 172.21.15.88:0/1558726152 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1c200039b0 0x7f1c380ad8b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:51.654 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:51.649+0000 7f1c3ccdb640 1 -- 172.21.15.88:0/1558726152 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c380af4b0 con 0x7f1c20004800 2024-04-26T23:48:51.654 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:51.649+0000 7f1c3ccdb640 1 --2- 172.21.15.88:0/1558726152 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1c20004800 0x7f1c380ab6e0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f1c2c007420 tx=0x7f1c2c00fd40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:48:51.659 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:51.655+0000 7f1c35ffb640 1 -- 172.21.15.88:0/1558726152 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c2c017020 con 0x7f1c20004800 2024-04-26T23:48:51.659 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:51.655+0000 7f1c35ffb640 1 -- 172.21.15.88:0/1558726152 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c2c00d910 con 0x7f1c20004800 2024-04-26T23:48:51.660 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:51.655+0000 7f1c35ffb640 1 -- 172.21.15.88:0/1558726152 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c2c00dce0 con 0x7f1c20004800 2024-04-26T23:48:51.660 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:51.656+0000 7f1c3f740640 1 -- 172.21.15.88:0/1558726152 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c381f36b0 con 0x7f1c20004800 2024-04-26T23:48:51.660 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:51.656+0000 7f1c3f740640 1 -- 172.21.15.88:0/1558726152 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c380af790 con 0x7f1c20004800 2024-04-26T23:48:51.662 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:51.658+0000 7f1c3f740640 1 -- 172.21.15.88:0/1558726152 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c38076650 con 0x7f1c20004800 2024-04-26T23:48:51.670 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:51.664+0000 7f1c35ffb640 1 -- 172.21.15.88:0/1558726152 <== mon.2 v2:172.21.15.175:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f1c2c01a020 con 0x7f1c20004800 2024-04-26T23:48:51.671 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:51.664+0000 7f1c35ffb640 1 --2- 172.21.15.88:0/1558726152 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f1c2406d060 0x7f1c2406f520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:51.671 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:51.664+0000 7f1c35ffb640 1 -- 172.21.15.88:0/1558726152 <== mon.2 v2:172.21.15.175:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6666+0+0 (secure 0 0 0) 0x7f1c2c08ca50 con 0x7f1c20004800 2024-04-26T23:48:51.671 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:51.665+0000 7f1c3d4dc640 1 --2- 172.21.15.88:0/1558726152 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f1c2406d060 0x7f1c2406f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:51.671 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:51.666+0000 7f1c3d4dc640 1 --2- 172.21.15.88:0/1558726152 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f1c2406d060 0x7f1c2406f520 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f1c28003ac0 tx=0x7f1c28005040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:48:51.680 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:51.673+0000 7f1c35ffb640 1 -- 172.21.15.88:0/1558726152 <== mon.2 v2:172.21.15.175:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f1c2c05aaa0 con 0x7f1c20004800 2024-04-26T23:48:52.187 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:52.180+0000 7f1c3f740640 1 -- 172.21.15.88:0/1558726152 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f1c380507a0 con 0x7f1c20004800 2024-04-26T23:48:52.187 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:52.183+0000 7f1c35ffb640 1 -- 172.21.15.88:0/1558726152 <== mon.2 v2:172.21.15.175:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1558 (secure 0 0 0) 0x7f1c2c05a3a0 con 0x7f1c20004800 2024-04-26T23:48:52.188 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":78,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"555255e9-7ef9-4454-8dc9-35e96b70035c","modified":"2024-04-26T23:39:34.291658Z","created":"2024-04-26T23:39:34.291658Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:3300","nonce":0},{"type":"v1","addr":"172.21.15.175:6789","nonce":0}]},"addr":"172.21.15.175:6789/0","public_addr":"172.21.15.175:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:3301","nonce":0},{"type":"v1","addr":"172.21.15.175:6790","nonce":0}]},"addr":"172.21.15.175:6790/0","public_addr":"172.21.15.175:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-04-26T23:48:52.196 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:52.191+0000 7f1c3f740640 1 -- 172.21.15.88:0/1558726152 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f1c2406d060 msgr2=0x7f1c2406f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:52.196 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:52.191+0000 7f1c3f740640 1 --2- 172.21.15.88:0/1558726152 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f1c2406d060 0x7f1c2406f520 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f1c28003ac0 tx=0x7f1c28005040 comp rx=0 tx=0).stop 2024-04-26T23:48:52.196 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:52.191+0000 7f1c3f740640 1 -- 172.21.15.88:0/1558726152 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1c20004800 msgr2=0x7f1c380ab6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:52.196 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:52.191+0000 7f1c3f740640 1 --2- 172.21.15.88:0/1558726152 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1c20004800 0x7f1c380ab6e0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f1c2c007420 tx=0x7f1c2c00fd40 comp rx=0 tx=0).stop 2024-04-26T23:48:52.196 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:52.192+0000 7f1c3f740640 1 -- 172.21.15.88:0/1558726152 shutdown_connections 2024-04-26T23:48:52.197 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:52.192+0000 7f1c3f740640 1 --2- 172.21.15.88:0/1558726152 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f1c2406d060 0x7f1c2406f520 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:52.197 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:52.192+0000 7f1c3f740640 1 --2- 172.21.15.88:0/1558726152 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1c20004800 0x7f1c380ab6e0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:52.197 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:52.192+0000 7f1c3f740640 1 --2- 172.21.15.88:0/1558726152 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1c20005210 0x7f1c381f3eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:52.197 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:52.192+0000 7f1c3f740640 1 --2- 172.21.15.88:0/1558726152 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1c200039b0 0x7f1c380ad8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:52.197 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:52.192+0000 7f1c3f740640 1 -- 172.21.15.88:0/1558726152 >> 172.21.15.88:0/1558726152 conn(0x7f1c380c6d80 msgr2=0x7f1c38070980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:48:52.197 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:52.192+0000 7f1c3f740640 1 -- 172.21.15.88:0/1558726152 shutdown_connections 2024-04-26T23:48:52.197 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:52.192+0000 7f1c3f740640 1 -- 172.21.15.88:0/1558726152 wait complete. 2024-04-26T23:48:52.218 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2024-04-26T23:48:52.218 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon b 2024-04-26T23:48:52.219 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-04-26T23:48:52.396 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:52.392+0000 7f79294c0640 1 Processor -- start 2024-04-26T23:48:52.400 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:52.393+0000 7f79294c0640 1 -- start start 2024-04-26T23:48:52.400 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:52.394+0000 7f79294c0640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f791c0d3c40 0x7f791c04ac70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:52.400 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:52.394+0000 7f79294c0640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f791c0decc0 0x7f791c0e10b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:52.400 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:52.394+0000 7f79294c0640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f791c0468d0 con 0x7f791c04b1b0 2024-04-26T23:48:52.400 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:52.394+0000 7f79294c0640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f791c047660 con 0x7f791c0d3c40 2024-04-26T23:48:52.400 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:52.394+0000 7f79294c0640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f791c0d65d0 con 0x7f791c0decc0 2024-04-26T23:48:52.401 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:52.394+0000 7f79237fe640 1 -- >> v1:172.21.15.88:6789/0 conn(0x7f791c04b1b0 legacy=0x7f791c0d6a60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.88:6789/0 2024-04-26T23:48:52.401 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:52.395+0000 7f7923fff640 1 -- >> v2:172.21.15.88:3300/0 conn(0x7f791c0d3c40 msgr2=0x7f791c04ac70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.88:3300/0 2024-04-26T23:48:52.401 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:52.395+0000 7f7923fff640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f791c0d3c40 0x7f791c04ac70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:48:52.402 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:52.398+0000 7f7928cbf640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f791c0decc0 0x7f791c0e10b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:52.403 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:52.398+0000 7f7928cbf640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f791c0decc0 0x7f791c0e10b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.88:58972/0 (socket says 172.21.15.88:58972) 2024-04-26T23:48:52.403 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:52.398+0000 7f7928cbf640 1 -- 172.21.15.88:0/3840882598 learned_addr learned my addr 172.21.15.88:0/3840882598 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:48:52.408 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:52.402+0000 7f7928cbf640 1 -- 172.21.15.88:0/3840882598 >> v2:172.21.15.88:3300/0 conn(0x7f791c0d3c40 msgr2=0x7f791c04ac70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T23:48:52.408 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:52.402+0000 7f7928cbf640 1 --2- 172.21.15.88:0/3840882598 >> v2:172.21.15.88:3300/0 conn(0x7f791c0d3c40 0x7f791c04ac70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:52.408 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:52.402+0000 7f7928cbf640 1 -- 172.21.15.88:0/3840882598 >> v1:172.21.15.88:6789/0 conn(0x7f791c04b1b0 legacy=0x7f791c0d6a60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T23:48:52.408 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:52.402+0000 7f7928cbf640 1 -- 172.21.15.88:0/3840882598 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f791c046bb0 con 0x7f791c0decc0 2024-04-26T23:48:52.408 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:52.403+0000 7f7928cbf640 1 --2- 172.21.15.88:0/3840882598 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f791c0decc0 0x7f791c0e10b0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f791c00d940 tx=0x7f791002c6c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bbd0a0ee0cab1ca3 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:48:52.412 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:52.404+0000 7f7922ffd640 1 -- 172.21.15.88:0/3840882598 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f791003a070 con 0x7f791c0decc0 2024-04-26T23:48:52.412 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:52.405+0000 7f7922ffd640 1 -- 172.21.15.88:0/3840882598 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7910032480 con 0x7f791c0decc0 2024-04-26T23:48:52.412 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:52.405+0000 7f7922ffd640 1 -- 172.21.15.88:0/3840882598 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7910032830 con 0x7f791c0decc0 2024-04-26T23:48:52.413 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:52.408+0000 7f79294c0640 1 -- 172.21.15.88:0/3840882598 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f791c0decc0 msgr2=0x7f791c0e10b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:52.413 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:52.408+0000 7f79294c0640 1 --2- 172.21.15.88:0/3840882598 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f791c0decc0 0x7f791c0e10b0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f791c00d940 tx=0x7f791002c6c0 comp rx=0 tx=0).stop 2024-04-26T23:48:52.413 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:52.408+0000 7f79294c0640 1 -- 172.21.15.88:0/3840882598 shutdown_connections 2024-04-26T23:48:52.413 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:52.408+0000 7f79294c0640 1 --2- 172.21.15.88:0/3840882598 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f791c0decc0 0x7f791c0e10b0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:52.413 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:52.408+0000 7f79294c0640 1 --2- 172.21.15.88:0/3840882598 >> v2:172.21.15.88:3300/0 conn(0x7f791c0d3c40 0x7f791c04ac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:52.413 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:52.408+0000 7f79294c0640 1 -- 172.21.15.88:0/3840882598 >> 172.21.15.88:0/3840882598 conn(0x7f791c005e90 msgr2=0x7f791c0062a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:48:52.413 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:52.409+0000 7f79294c0640 1 -- 172.21.15.88:0/3840882598 shutdown_connections 2024-04-26T23:48:52.414 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:52.409+0000 7f79294c0640 1 -- 172.21.15.88:0/3840882598 wait complete. 2024-04-26T23:48:52.415 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:52.411+0000 7f79294c0640 1 Processor -- start 2024-04-26T23:48:52.417 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:52.411+0000 7f79294c0640 1 -- start start 2024-04-26T23:48:52.420 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:52.412+0000 7f79294c0640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f791c04b1b0 0x7f791c171140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:52.420 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:52.412+0000 7f79294c0640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f791c0d3c40 0x7f791c171680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:52.420 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:52.412+0000 7f79294c0640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f791c0decc0 0x7f791c02c260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:52.420 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:52.412+0000 7f7928cbf640 1 -- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f791c0decc0 msgr2=0x7f791c02c260 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.88:3300/0 2024-04-26T23:48:52.421 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:52.412+0000 7f7928cbf640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f791c0decc0 0x7f791c02c260 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:48:52.421 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:52.412+0000 7f79294c0640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f791c046360 con 0x7f791c0decc0 2024-04-26T23:48:52.421 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:52.412+0000 7f79294c0640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f791c0461e0 con 0x7f791c0d3c40 2024-04-26T23:48:52.421 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:52.412+0000 7f79294c0640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f791c046e90 con 0x7f791c04b1b0 2024-04-26T23:48:52.421 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:52.414+0000 7f79237fe640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f791c0d3c40 0x7f791c171680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:52.421 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:52.414+0000 7f79237fe640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f791c0d3c40 0x7f791c171680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.88:58978/0 (socket says 172.21.15.88:58978) 2024-04-26T23:48:52.421 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:52.414+0000 7f79237fe640 1 -- 172.21.15.88:0/3668482583 learned_addr learned my addr 172.21.15.88:0/3668482583 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:48:52.421 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:52.414+0000 7f7923fff640 1 --2- 172.21.15.88:0/3668482583 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f791c04b1b0 0x7f791c171140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:52.421 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:52.417+0000 7f7923fff640 1 -- 172.21.15.88:0/3668482583 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f791c0d3c40 msgr2=0x7f791c171680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:52.422 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:52.417+0000 7f7923fff640 1 --2- 172.21.15.88:0/3668482583 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f791c0d3c40 0x7f791c171680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:52.422 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:52.417+0000 7f7923fff640 1 -- 172.21.15.88:0/3668482583 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f791c0decc0 msgr2=0x7f791c02c260 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T23:48:52.422 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:52.417+0000 7f7923fff640 1 --2- 172.21.15.88:0/3668482583 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f791c0decc0 0x7f791c02c260 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:52.422 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:52.417+0000 7f7923fff640 1 -- 172.21.15.88:0/3668482583 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f791c02f0f0 con 0x7f791c04b1b0 2024-04-26T23:48:52.423 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:52.419+0000 7f7923fff640 1 --2- 172.21.15.88:0/3668482583 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f791c04b1b0 0x7f791c171140 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f792406acf0 tx=0x7f7924069f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:48:52.424 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:52.419+0000 7f7920ff9640 1 -- 172.21.15.88:0/3668482583 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f792406f840 con 0x7f791c04b1b0 2024-04-26T23:48:52.424 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:52.419+0000 7f79294c0640 1 -- 172.21.15.88:0/3668482583 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f791c030bd0 con 0x7f791c04b1b0 2024-04-26T23:48:52.424 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:52.419+0000 7f79294c0640 1 -- 172.21.15.88:0/3668482583 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f791c02fdb0 con 0x7f791c04b1b0 2024-04-26T23:48:52.424 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:52.419+0000 7f7920ff9640 1 -- 172.21.15.88:0/3668482583 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f792406f9e0 con 0x7f791c04b1b0 2024-04-26T23:48:52.424 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:52.419+0000 7f7920ff9640 1 -- 172.21.15.88:0/3668482583 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f792406fe30 con 0x7f791c04b1b0 2024-04-26T23:48:52.427 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:52.423+0000 7f79294c0640 1 --2- 172.21.15.88:0/3668482583 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7904002a70 0x7f7904004f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:52.427 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:52.423+0000 7f79294c0640 1 -- 172.21.15.88:0/3668482583 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f7904007ec0 con 0x7f7904002a70 2024-04-26T23:48:52.430 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:52.425+0000 7f7920ff9640 1 -- 172.21.15.88:0/3668482583 <== mon.2 v2:172.21.15.175:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f7924071420 con 0x7f791c04b1b0 2024-04-26T23:48:52.430 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:52.425+0000 7f7920ff9640 1 --2- 172.21.15.88:0/3668482583 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f790806c8a0 0x7f790806ed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:52.430 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:52.425+0000 7f79237fe640 1 --2- 172.21.15.88:0/3668482583 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7904002a70 0x7f7904004f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:52.430 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:52.425+0000 7f7928cbf640 1 --2- 172.21.15.88:0/3668482583 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f790806c8a0 0x7f790806ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:52.430 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:52.426+0000 7f7920ff9640 1 -- 172.21.15.88:0/3668482583 <== mon.2 v2:172.21.15.175:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6666+0+0 (secure 0 0 0) 0x7f79241080d0 con 0x7f791c04b1b0 2024-04-26T23:48:52.431 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:52.426+0000 7f7928cbf640 1 --2- 172.21.15.88:0/3668482583 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f790806c8a0 0x7f790806ed60 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f7910037000 tx=0x7f7910030000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:48:52.431 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:52.427+0000 7f79237fe640 1 -- 172.21.15.88:0/3668482583 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f79040080c0 con 0x7f7904002a70 2024-04-26T23:48:52.432 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:52.428+0000 7f79237fe640 1 --2- 172.21.15.88:0/3668482583 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7904002a70 0x7f7904004f30 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f791c0459d0 tx=0x7f7918009b20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:48:52.434 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:52.429+0000 7f7920ff9640 1 -- 172.21.15.88:0/3668482583 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7918016070 con 0x7f7904002a70 2024-04-26T23:48:52.434 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:52.429+0000 7f7920ff9640 1 -- 172.21.15.88:0/3668482583 <== mon.1 v2:172.21.15.175:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f7918009e60 con 0x7f7904002a70 2024-04-26T23:48:52.434 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:52.429+0000 7f7920ff9640 1 -- 172.21.15.88:0/3668482583 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7904002a70 msgr2=0x7f7904004f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:52.434 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:52.429+0000 7f7920ff9640 1 --2- 172.21.15.88:0/3668482583 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7904002a70 0x7f7904004f30 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f791c0459d0 tx=0x7f7918009b20 comp rx=0 tx=0).stop 2024-04-26T23:48:52.434 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:52.429+0000 7f7920ff9640 1 -- 172.21.15.88:0/3668482583 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7904002a70 msgr2=0x7f7904004f30 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:48:52.434 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:52.429+0000 7f7920ff9640 1 --2- 172.21.15.88:0/3668482583 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7904002a70 0x7f7904004f30 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:52.450 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:52.446+0000 7f79294c0640 1 --2- 172.21.15.88:0/3668482583 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7904006ee0 0x7f7904007370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:52.450 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:52.446+0000 7f79294c0640 1 -- 172.21.15.88:0/3668482583 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f790400a4a0 con 0x7f7904006ee0 2024-04-26T23:48:52.451 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:52.446+0000 7f79237fe640 1 --2- 172.21.15.88:0/3668482583 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7904006ee0 0x7f7904007370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:52.451 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:52.447+0000 7f79237fe640 1 -- 172.21.15.88:0/3668482583 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f79040078b0 con 0x7f7904006ee0 2024-04-26T23:48:52.452 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:52.448+0000 7f79237fe640 1 --2- 172.21.15.88:0/3668482583 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7904006ee0 0x7f7904007370 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f791c0459d0 tx=0x7f79180059d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:48:52.453 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:52.449+0000 7f7920ff9640 1 -- 172.21.15.88:0/3668482583 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7918016040 con 0x7f7904006ee0 2024-04-26T23:48:52.453 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:52.449+0000 7f7920ff9640 1 -- 172.21.15.88:0/3668482583 <== mon.1 v2:172.21.15.175:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4545 (secure 0 0 0) 0x7f791801c0d0 con 0x7f7904006ee0 2024-04-26T23:48:52.453 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:52.449+0000 7f7920ff9640 1 -- 172.21.15.88:0/3668482583 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7904006ee0 msgr2=0x7f7904007370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:52.454 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:52.449+0000 7f7920ff9640 1 --2- 172.21.15.88:0/3668482583 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7904006ee0 0x7f7904007370 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f791c0459d0 tx=0x7f79180059d0 comp rx=0 tx=0).stop 2024-04-26T23:48:52.454 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:52.449+0000 7f7920ff9640 1 -- 172.21.15.88:0/3668482583 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7904006ee0 msgr2=0x7f7904007370 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:48:52.454 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:52.449+0000 7f7920ff9640 1 --2- 172.21.15.88:0/3668482583 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7904006ee0 0x7f7904007370 secure :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f791c0459d0 tx=0x7f79180059d0 comp rx=0 tx=0).stop 2024-04-26T23:48:52.455 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-04-26T23:48:52.455 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2024-04-26T23:48:52.455 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2024-04-26T23:48:52.455 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "leader", 2024-04-26T23:48:52.455 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 78, 2024-04-26T23:48:52.455 INFO:teuthology.orchestra.run.smithi088.stdout: "uptime": 41998, 2024-04-26T23:48:52.455 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2024-04-26T23:48:52.456 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2024-04-26T23:48:52.456 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2024-04-26T23:48:52.456 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:48:52.456 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 0, 2024-04-26T23:48:52.456 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2024-04-26T23:48:52.456 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2450521708007866372", 2024-04-26T23:48:52.456 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2024-04-26T23:48:52.456 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-04-26T23:48:52.456 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-04-26T23:48:52.456 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-04-26T23:48:52.456 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-04-26T23:48:52.456 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-04-26T23:48:52.456 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-04-26T23:48:52.456 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-04-26T23:48:52.456 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-04-26T23:48:52.457 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-04-26T23:48:52.457 INFO:teuthology.orchestra.run.smithi088.stdout: "reef", 2024-04-26T23:48:52.457 INFO:teuthology.orchestra.run.smithi088.stdout: "squid" 2024-04-26T23:48:52.457 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:48:52.457 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540701547738038271", 2024-04-26T23:48:52.457 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2024-04-26T23:48:52.457 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-04-26T23:48:52.457 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-04-26T23:48:52.457 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-04-26T23:48:52.457 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-04-26T23:48:52.457 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-04-26T23:48:52.457 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-04-26T23:48:52.457 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-04-26T23:48:52.457 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-04-26T23:48:52.458 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-04-26T23:48:52.458 INFO:teuthology.orchestra.run.smithi088.stdout: "reef", 2024-04-26T23:48:52.458 INFO:teuthology.orchestra.run.smithi088.stdout: "squid" 2024-04-26T23:48:52.458 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:48:52.458 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:48:52.458 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2024-04-26T23:48:52.458 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2024-04-26T23:48:52.458 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2024-04-26T23:48:52.458 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2024-04-26T23:48:52.458 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2024-04-26T23:48:52.458 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "555255e9-7ef9-4454-8dc9-35e96b70035c", 2024-04-26T23:48:52.458 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2024-04-26T23:39:34.291658Z", 2024-04-26T23:48:52.458 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2024-04-26T23:39:34.291658Z", 2024-04-26T23:48:52.458 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 19, 2024-04-26T23:48:52.459 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "squid", 2024-04-26T23:48:52.459 INFO:teuthology.orchestra.run.smithi088.stdout: "election_strategy": 1, 2024-04-26T23:48:52.459 INFO:teuthology.orchestra.run.smithi088.stdout: "disallowed_leaders: ": "", 2024-04-26T23:48:52.459 INFO:teuthology.orchestra.run.smithi088.stdout: "stretch_mode": false, 2024-04-26T23:48:52.459 INFO:teuthology.orchestra.run.smithi088.stdout: "tiebreaker_mon": "", 2024-04-26T23:48:52.459 INFO:teuthology.orchestra.run.smithi088.stdout: "removed_ranks: ": "", 2024-04-26T23:48:52.459 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2024-04-26T23:48:52.459 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2024-04-26T23:48:52.459 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-04-26T23:48:52.459 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-04-26T23:48:52.459 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-04-26T23:48:52.459 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-04-26T23:48:52.459 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-04-26T23:48:52.459 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-04-26T23:48:52.460 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-04-26T23:48:52.460 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-04-26T23:48:52.460 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-04-26T23:48:52.460 INFO:teuthology.orchestra.run.smithi088.stdout: "reef", 2024-04-26T23:48:52.460 INFO:teuthology.orchestra.run.smithi088.stdout: "squid" 2024-04-26T23:48:52.460 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:48:52.460 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2024-04-26T23:48:52.460 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:48:52.460 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2024-04-26T23:48:52.460 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:48:52.460 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2024-04-26T23:48:52.460 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2024-04-26T23:48:52.460 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-04-26T23:48:52.460 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-04-26T23:48:52.460 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:48:52.461 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-04-26T23:48:52.461 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2024-04-26T23:48:52.461 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:48:52.461 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:48:52.461 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:48:52.461 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-04-26T23:48:52.461 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2024-04-26T23:48:52.461 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:48:52.461 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:48:52.461 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:48:52.461 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:48:52.461 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2024-04-26T23:48:52.461 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2024-04-26T23:48:52.461 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-04-26T23:48:52.462 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-04-26T23:48:52.462 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-04-26T23:48:52.462 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:48:52.462 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:48:52.462 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2024-04-26T23:48:52.462 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2024-04-26T23:48:52.462 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-04-26T23:48:52.462 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-04-26T23:48:52.462 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:48:52.462 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-04-26T23:48:52.462 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:3300", 2024-04-26T23:48:52.462 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:48:52.462 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:48:52.462 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:48:52.462 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-04-26T23:48:52.463 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6789", 2024-04-26T23:48:52.463 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:48:52.463 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:48:52.463 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:48:52.463 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:48:52.463 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6789/0", 2024-04-26T23:48:52.463 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.175:6789/0", 2024-04-26T23:48:52.463 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-04-26T23:48:52.463 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-04-26T23:48:52.463 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-04-26T23:48:52.463 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:48:52.463 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:48:52.463 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2024-04-26T23:48:52.463 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2024-04-26T23:48:52.463 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-04-26T23:48:52.464 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-04-26T23:48:52.464 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:48:52.464 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-04-26T23:48:52.464 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:3301", 2024-04-26T23:48:52.464 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:48:52.464 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:48:52.464 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:48:52.464 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-04-26T23:48:52.464 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6790", 2024-04-26T23:48:52.464 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:48:52.464 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:48:52.464 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:48:52.464 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:48:52.464 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6790/0", 2024-04-26T23:48:52.465 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.175:6790/0", 2024-04-26T23:48:52.465 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-04-26T23:48:52.465 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-04-26T23:48:52.465 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-04-26T23:48:52.465 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:48:52.465 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:48:52.465 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:48:52.465 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2024-04-26T23:48:52.465 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2024-04-26T23:48:52.465 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:48:52.465 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:48:52.465 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:48:52.465 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2024-04-26T23:48:52.465 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:48:52.465 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:48:52.466 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2024-04-26T23:48:52.466 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:48:52.466 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:48:52.466 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:48:52.466 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2024-04-26T23:48:52.466 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:48:52.466 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:48:52.466 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:48:52.466 INFO:teuthology.orchestra.run.smithi088.stdout: "stretch_mode": false 2024-04-26T23:48:52.466 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-04-26T23:48:52.467 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:52.452+0000 7f79294c0640 1 -- 172.21.15.88:0/3668482583 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f790806c8a0 msgr2=0x7f790806ed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:52.467 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:52.452+0000 7f79294c0640 1 --2- 172.21.15.88:0/3668482583 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f790806c8a0 0x7f790806ed60 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f7910037000 tx=0x7f7910030000 comp rx=0 tx=0).stop 2024-04-26T23:48:52.467 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:52.452+0000 7f79294c0640 1 -- 172.21.15.88:0/3668482583 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f791c04b1b0 msgr2=0x7f791c171140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:52.467 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:52.452+0000 7f79294c0640 1 --2- 172.21.15.88:0/3668482583 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f791c04b1b0 0x7f791c171140 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f792406acf0 tx=0x7f7924069f90 comp rx=0 tx=0).stop 2024-04-26T23:48:52.467 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:52.452+0000 7f7928cbf640 1 -- 172.21.15.88:0/3668482583 reap_dead start 2024-04-26T23:48:52.467 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:52.452+0000 7f7928cbf640 1 -- 172.21.15.88:0/3668482583 reap_dead start 2024-04-26T23:48:52.467 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:52.452+0000 7f79294c0640 1 -- 172.21.15.88:0/3668482583 shutdown_connections 2024-04-26T23:48:52.467 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:52.452+0000 7f79294c0640 1 -- 172.21.15.88:0/3668482583 >> 172.21.15.88:0/3668482583 conn(0x7f791c005e90 msgr2=0x7f791c0d5a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:48:52.467 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:52.455+0000 7f79294c0640 1 -- 172.21.15.88:0/3668482583 shutdown_connections 2024-04-26T23:48:52.468 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:52.455+0000 7f79294c0640 1 -- 172.21.15.88:0/3668482583 wait complete. 2024-04-26T23:48:52.486 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-04-26T23:48:52.486 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon c 2024-04-26T23:48:52.486 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-04-26T23:48:52.698 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:52.694+0000 7fa2b83a4640 1 Processor -- start 2024-04-26T23:48:52.701 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:52.694+0000 7fa2b83a4640 1 -- start start 2024-04-26T23:48:52.701 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:52.696+0000 7fa2b83a4640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa2b00c2cd0 0x7fa2b01533b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:52.701 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:52.696+0000 7fa2b83a4640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fa2b00ab6a0 0x7fa2b01538f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:52.701 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:52.696+0000 7fa2b6140640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7fa2b0150200 0x7fa2b00ac140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.88:50878/0 (socket says 172.21.15.88:50878) 2024-04-26T23:48:52.703 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:52.696+0000 7fa2b6140640 1 -- 172.21.15.88:0/2214362383 learned_addr learned my addr 172.21.15.88:0/2214362383 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-26T23:48:52.704 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:52.697+0000 7fa2b6941640 1 --2- 172.21.15.88:0/2214362383 >> v2:172.21.15.175:3300/0 conn(0x7fa2b00ab6a0 0x7fa2b01538f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:52.704 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:52.699+0000 7fa2b593f640 1 --2- 172.21.15.88:0/2214362383 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa2b00c2cd0 0x7fa2b01533b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:52.704 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:52.699+0000 7fa2b83a4640 1 -- 172.21.15.88:0/2214362383 --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa2b006ff20 con 0x7fa2b0150200 2024-04-26T23:48:52.704 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:52.699+0000 7fa2b83a4640 1 -- 172.21.15.88:0/2214362383 --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7fa2b00c4bd0 con 0x7fa2b00ab6a0 2024-04-26T23:48:52.704 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:52.699+0000 7fa2b83a4640 1 -- 172.21.15.88:0/2214362383 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fa2b006f4e0 con 0x7fa2b00c2cd0 2024-04-26T23:48:52.704 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:52.700+0000 7fa2b513e640 1 -- 172.21.15.88:0/2214362383 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 204823703 0 0) 0x7fa2a8001490 con 0x7fa2b0150200 2024-04-26T23:48:52.705 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:52.700+0000 7fa2b513e640 1 -- 172.21.15.88:0/2214362383 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa29c003520 con 0x7fa2b0150200 2024-04-26T23:48:52.705 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:52.700+0000 7fa2b513e640 1 -- 172.21.15.88:0/2214362383 <== mon.1 v1:172.21.15.175:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4065927730 0 0) 0x7fa29c003520 con 0x7fa2b0150200 2024-04-26T23:48:52.705 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:52.700+0000 7fa2b513e640 1 -- 172.21.15.88:0/2214362383 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa2b00c2cd0 msgr2=0x7fa2b01533b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:48:52.705 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:52.701+0000 7fa2b513e640 1 --2- 172.21.15.88:0/2214362383 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa2b00c2cd0 0x7fa2b01533b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:52.705 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:52.701+0000 7fa2b513e640 1 -- 172.21.15.88:0/2214362383 >> v2:172.21.15.175:3300/0 conn(0x7fa2b00ab6a0 msgr2=0x7fa2b01538f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:48:52.705 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:52.701+0000 7fa2b513e640 1 --2- 172.21.15.88:0/2214362383 >> v2:172.21.15.175:3300/0 conn(0x7fa2b00ab6a0 0x7fa2b01538f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:52.705 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:52.701+0000 7fa2b513e640 1 -- 172.21.15.88:0/2214362383 --> v1:172.21.15.175:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2b00c48f0 con 0x7fa2b0150200 2024-04-26T23:48:52.706 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:52.701+0000 7fa2b513e640 1 -- 172.21.15.88:0/2214362383 <== mon.1 v1:172.21.15.175:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 356324787 0 0) 0x7fa2a8001bc0 con 0x7fa2b0150200 2024-04-26T23:48:52.706 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:52.701+0000 7fa2b593f640 1 --2- 172.21.15.88:0/2214362383 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa2b00c2cd0 0x7fa2b01533b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:48:52.706 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:52.701+0000 7fa2b513e640 1 -- 172.21.15.88:0/2214362383 >> v1:172.21.15.175:6789/0 conn(0x7fa2b0150200 legacy=0x7fa2b00ac140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:52.706 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:52.701+0000 7fa2b513e640 1 --2- 172.21.15.88:0/2214362383 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa2b00c2cd0 0x7fa29c0039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:52.706 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:52.701+0000 7fa2b513e640 1 --2- 172.21.15.88:0/2214362383 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa29c004080 0x7fa29c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:52.707 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:52.701+0000 7fa2b513e640 1 --2- 172.21.15.88:0/2214362383 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa29c004d90 0x7fa29c005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:52.707 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:52.701+0000 7fa2b513e640 1 -- 172.21.15.88:0/2214362383 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fa2b00c4bd0 con 0x7fa29c004d90 2024-04-26T23:48:52.707 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:52.701+0000 7fa2b513e640 1 -- 172.21.15.88:0/2214362383 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fa2b006f4e0 con 0x7fa29c004080 2024-04-26T23:48:52.707 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:52.701+0000 7fa2b513e640 1 -- 172.21.15.88:0/2214362383 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fa29c00bcf0 con 0x7fa2b00c2cd0 2024-04-26T23:48:52.707 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:52.701+0000 7fa2b593f640 1 --2- 172.21.15.88:0/2214362383 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa29c004080 0x7fa29c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:52.707 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:52.701+0000 7fa2b6140640 1 --2- 172.21.15.88:0/2214362383 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa2b00c2cd0 0x7fa29c0039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:52.707 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:52.702+0000 7fa2b593f640 1 -- 172.21.15.88:0/2214362383 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa2b00c2cd0 msgr2=0x7fa29c0039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:48:52.707 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:52.702+0000 7fa2b593f640 1 --2- 172.21.15.88:0/2214362383 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa2b00c2cd0 0x7fa29c0039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:52.707 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:52.702+0000 7fa2b593f640 1 -- 172.21.15.88:0/2214362383 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa29c004d90 msgr2=0x7fa29c005210 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T23:48:52.707 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:52.702+0000 7fa2b593f640 1 --2- 172.21.15.88:0/2214362383 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa29c004d90 0x7fa29c005210 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:52.707 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:52.702+0000 7fa2b593f640 1 -- 172.21.15.88:0/2214362383 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa29c003520 con 0x7fa29c004080 2024-04-26T23:48:52.708 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:52.702+0000 7fa2b6941640 1 --2- 172.21.15.88:0/2214362383 >> v2:172.21.15.175:3300/0 conn(0x7fa2b00ab6a0 0x7fa2b01538f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:48:52.711 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:52.707+0000 7fa2b593f640 1 --2- 172.21.15.88:0/2214362383 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa29c004080 0x7fa29c004800 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fa2ac00a610 tx=0x7fa29c005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9bb91123b746cbaf server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:48:52.712 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:52.707+0000 7fa2b513e640 1 -- 172.21.15.88:0/2214362383 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2ac039070 con 0x7fa29c004080 2024-04-26T23:48:52.712 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:52.708+0000 7fa2b513e640 1 -- 172.21.15.88:0/2214362383 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2ac02ce00 con 0x7fa29c004080 2024-04-26T23:48:52.712 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:52.708+0000 7fa2b513e640 1 -- 172.21.15.88:0/2214362383 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2ac00a650 con 0x7fa29c004080 2024-04-26T23:48:52.713 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:52.709+0000 7fa2b83a4640 1 -- 172.21.15.88:0/2214362383 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa29c004080 msgr2=0x7fa29c004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:52.714 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:52.709+0000 7fa2b83a4640 1 --2- 172.21.15.88:0/2214362383 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa29c004080 0x7fa29c004800 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fa2ac00a610 tx=0x7fa29c005830 comp rx=0 tx=0).stop 2024-04-26T23:48:52.714 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:52.709+0000 7fa2b6941640 1 -- 172.21.15.88:0/2214362383 reap_dead start 2024-04-26T23:48:52.714 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:52.709+0000 7fa2b83a4640 1 -- 172.21.15.88:0/2214362383 shutdown_connections 2024-04-26T23:48:52.714 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:52.709+0000 7fa2b83a4640 1 -- 172.21.15.88:0/2214362383 >> 172.21.15.88:0/2214362383 conn(0x7fa2b00c82d0 msgr2=0x7fa2b00c86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:48:52.714 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:52.709+0000 7fa2b83a4640 1 -- 172.21.15.88:0/2214362383 shutdown_connections 2024-04-26T23:48:52.718 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:52.709+0000 7fa2b83a4640 1 -- 172.21.15.88:0/2214362383 wait complete. 2024-04-26T23:48:52.718 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:52.711+0000 7fa2b83a4640 1 Processor -- start 2024-04-26T23:48:52.718 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:52.712+0000 7fa2b83a4640 1 -- start start 2024-04-26T23:48:52.719 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:52.713+0000 7fa2b83a4640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa29c004080 0x7fa2b0152380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:52.719 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:52.713+0000 7fa2b83a4640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa2b014a4a0 0x7fa2b0145450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:52.719 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:52.713+0000 7fa2b593f640 1 -- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa2b014a4a0 msgr2=0x7fa2b0145450 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.88:3300/0 2024-04-26T23:48:52.719 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:52.713+0000 7fa2b593f640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa2b014a4a0 0x7fa2b0145450 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:48:52.719 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:52.713+0000 7fa2b83a4640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa2b01569f0 0x7fa2b0145990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:52.719 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:52.713+0000 7fa2b83a4640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fa2b00ac9d0 con 0x7fa2b014a4a0 2024-04-26T23:48:52.719 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:52.714+0000 7fa2b83a4640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fa2b00ac850 con 0x7fa2b01569f0 2024-04-26T23:48:52.719 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:52.714+0000 7fa2b83a4640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fa2b01505e0 con 0x7fa29c004080 2024-04-26T23:48:52.719 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:52.714+0000 7fa2b6941640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa2b01569f0 0x7fa2b0145990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:52.719 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:52.714+0000 7fa2b6941640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa2b01569f0 0x7fa2b0145990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.88:59024/0 (socket says 172.21.15.88:59024) 2024-04-26T23:48:52.719 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:52.714+0000 7fa2b6941640 1 -- 172.21.15.88:0/1280889397 learned_addr learned my addr 172.21.15.88:0/1280889397 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:48:52.720 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:52.715+0000 7fa2b6140640 1 --2- 172.21.15.88:0/1280889397 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa29c004080 0x7fa2b0152380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:52.720 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:52.715+0000 7fa2b6941640 1 -- 172.21.15.88:0/1280889397 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa29c004080 msgr2=0x7fa2b0152380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:52.720 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:52.715+0000 7fa2b6941640 1 --2- 172.21.15.88:0/1280889397 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa29c004080 0x7fa2b0152380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:52.720 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:52.715+0000 7fa2b6941640 1 -- 172.21.15.88:0/1280889397 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa2b014a4a0 msgr2=0x7fa2b0145450 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T23:48:52.720 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:52.715+0000 7fa2b6941640 1 --2- 172.21.15.88:0/1280889397 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa2b014a4a0 0x7fa2b0145450 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:52.720 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:52.715+0000 7fa2b6941640 1 -- 172.21.15.88:0/1280889397 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2b014c9d0 con 0x7fa2b01569f0 2024-04-26T23:48:52.720 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:52.715+0000 7fa2b6941640 1 --2- 172.21.15.88:0/1280889397 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa2b01569f0 0x7fa2b0145990 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fa2b00768c0 tx=0x7fa2a000c890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:48:52.726 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:52.720+0000 7fa2a6ffd640 1 -- 172.21.15.88:0/1280889397 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2a0004440 con 0x7fa2b01569f0 2024-04-26T23:48:52.726 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:52.721+0000 7fa2a6ffd640 1 -- 172.21.15.88:0/1280889397 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2a0017070 con 0x7fa2b01569f0 2024-04-26T23:48:52.726 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:52.721+0000 7fa2a6ffd640 1 -- 172.21.15.88:0/1280889397 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2a0003850 con 0x7fa2b01569f0 2024-04-26T23:48:52.726 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:52.721+0000 7fa2b83a4640 1 -- 172.21.15.88:0/1280889397 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2b014cc40 con 0x7fa2b01569f0 2024-04-26T23:48:52.726 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:52.721+0000 7fa2b83a4640 1 -- 172.21.15.88:0/1280889397 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2b014d200 con 0x7fa2b01569f0 2024-04-26T23:48:52.728 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:52.724+0000 7fa2a4ff9640 1 --2- 172.21.15.88:0/1280889397 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa2b0068a70 0x7fa2b01e9130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:52.729 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:52.724+0000 7fa2a4ff9640 1 -- 172.21.15.88:0/1280889397 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fa2b01e8640 con 0x7fa2b0068a70 2024-04-26T23:48:52.730 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:52.724+0000 7fa2a6ffd640 1 -- 172.21.15.88:0/1280889397 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa2a00039f0 con 0x7fa2b01569f0 2024-04-26T23:48:52.730 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:52.725+0000 7fa2b6140640 1 --2- 172.21.15.88:0/1280889397 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa2b0068a70 0x7fa2b01e9130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:52.730 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:52.725+0000 7fa2a6ffd640 1 --2- 172.21.15.88:0/1280889397 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fa29406c920 0x7fa29406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:52.730 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:52.725+0000 7fa2a6ffd640 1 -- 172.21.15.88:0/1280889397 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6666+0+0 (secure 0 0 0) 0x7fa2a008b840 con 0x7fa2b01569f0 2024-04-26T23:48:52.730 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:52.725+0000 7fa2b593f640 1 --2- 172.21.15.88:0/1280889397 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fa29406c920 0x7fa29406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:52.731 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:52.726+0000 7fa2b6140640 1 -- 172.21.15.88:0/1280889397 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa2b014d570 con 0x7fa2b0068a70 2024-04-26T23:48:52.731 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:52.726+0000 7fa2b593f640 1 --2- 172.21.15.88:0/1280889397 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fa29406c920 0x7fa29406ede0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fa2ac036000 tx=0x7fa2ac030000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:48:52.731 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:52.726+0000 7fa2b6140640 1 --2- 172.21.15.88:0/1280889397 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa2b0068a70 0x7fa2b01e9130 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fa2a8004be0 tx=0x7fa2a8010640 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:48:52.732 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:52.727+0000 7fa2a6ffd640 1 -- 172.21.15.88:0/1280889397 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2a8019020 con 0x7fa2b0068a70 2024-04-26T23:48:52.732 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:52.728+0000 7fa2a6ffd640 1 -- 172.21.15.88:0/1280889397 <== mon.2 v2:172.21.15.175:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fa2a8012cc0 con 0x7fa2b0068a70 2024-04-26T23:48:52.732 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:52.728+0000 7fa2a6ffd640 1 -- 172.21.15.88:0/1280889397 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa2b0068a70 msgr2=0x7fa2b01e9130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:52.732 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:52.728+0000 7fa2a6ffd640 1 --2- 172.21.15.88:0/1280889397 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa2b0068a70 0x7fa2b01e9130 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fa2a8004be0 tx=0x7fa2a8010640 comp rx=0 tx=0).stop 2024-04-26T23:48:52.732 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:52.728+0000 7fa2a6ffd640 1 -- 172.21.15.88:0/1280889397 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa2b0068a70 msgr2=0x7fa2b01e9130 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:48:52.732 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:52.728+0000 7fa2a6ffd640 1 --2- 172.21.15.88:0/1280889397 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa2b0068a70 0x7fa2b01e9130 secure :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fa2a8004be0 tx=0x7fa2a8010640 comp rx=0 tx=0).stop 2024-04-26T23:48:52.748 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:52.744+0000 7fa2a4ff9640 1 --2- 172.21.15.88:0/1280889397 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa2b01ebbb0 0x7fa2b01ebf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:52.748 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:52.744+0000 7fa2a4ff9640 1 -- 172.21.15.88:0/1280889397 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fa2b0145ed0 con 0x7fa2b01ebbb0 2024-04-26T23:48:52.755 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:52.744+0000 7fa2b6140640 1 --2- 172.21.15.88:0/1280889397 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa2b01ebbb0 0x7fa2b01ebf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:52.755 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:52.745+0000 7fa2b6140640 1 -- 172.21.15.88:0/1280889397 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fa2b00507a0 con 0x7fa2b01ebbb0 2024-04-26T23:48:52.755 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:52.745+0000 7fa2b6140640 1 --2- 172.21.15.88:0/1280889397 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa2b01ebbb0 0x7fa2b01ebf90 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fa2a8004be0 tx=0x7fa2b00719e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:48:52.755 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:52.746+0000 7fa2a6ffd640 1 -- 172.21.15.88:0/1280889397 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2a8019040 con 0x7fa2b01ebbb0 2024-04-26T23:48:52.756 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:52.746+0000 7fa2a6ffd640 1 -- 172.21.15.88:0/1280889397 <== mon.2 v2:172.21.15.175:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5197 (secure 0 0 0) 0x7fa2a802a070 con 0x7fa2b01ebbb0 2024-04-26T23:48:52.756 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:52.746+0000 7fa2a6ffd640 1 -- 172.21.15.88:0/1280889397 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa2b01ebbb0 msgr2=0x7fa2b01ebf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:52.756 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:52.746+0000 7fa2a6ffd640 1 --2- 172.21.15.88:0/1280889397 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa2b01ebbb0 0x7fa2b01ebf90 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fa2a8004be0 tx=0x7fa2b00719e0 comp rx=0 tx=0).stop 2024-04-26T23:48:52.756 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:52.746+0000 7fa2a6ffd640 1 -- 172.21.15.88:0/1280889397 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa2b01ebbb0 msgr2=0x7fa2b01ebf90 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:48:52.756 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:52.746+0000 7fa2a6ffd640 1 --2- 172.21.15.88:0/1280889397 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa2b01ebbb0 0x7fa2b01ebf90 secure :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fa2a8004be0 tx=0x7fa2b00719e0 comp rx=0 tx=0).stop 2024-04-26T23:48:52.756 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-04-26T23:48:52.756 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2024-04-26T23:48:52.756 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2024-04-26T23:48:52.756 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "peon", 2024-04-26T23:48:52.756 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 78, 2024-04-26T23:48:52.756 INFO:teuthology.orchestra.run.smithi088.stdout: "uptime": 301033, 2024-04-26T23:48:52.756 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2024-04-26T23:48:52.757 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2024-04-26T23:48:52.757 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2024-04-26T23:48:52.757 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:48:52.757 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 1, 2024-04-26T23:48:52.757 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2024-04-26T23:48:52.757 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2450521708007866372", 2024-04-26T23:48:52.757 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2024-04-26T23:48:52.757 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-04-26T23:48:52.757 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-04-26T23:48:52.757 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-04-26T23:48:52.757 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-04-26T23:48:52.757 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-04-26T23:48:52.757 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-04-26T23:48:52.757 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-04-26T23:48:52.758 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-04-26T23:48:52.758 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-04-26T23:48:52.758 INFO:teuthology.orchestra.run.smithi088.stdout: "reef", 2024-04-26T23:48:52.758 INFO:teuthology.orchestra.run.smithi088.stdout: "squid" 2024-04-26T23:48:52.758 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:48:52.758 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540701547738038271", 2024-04-26T23:48:52.758 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2024-04-26T23:48:52.758 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-04-26T23:48:52.758 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-04-26T23:48:52.758 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-04-26T23:48:52.758 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-04-26T23:48:52.758 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-04-26T23:48:52.758 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-04-26T23:48:52.758 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-04-26T23:48:52.758 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-04-26T23:48:52.759 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-04-26T23:48:52.759 INFO:teuthology.orchestra.run.smithi088.stdout: "reef", 2024-04-26T23:48:52.759 INFO:teuthology.orchestra.run.smithi088.stdout: "squid" 2024-04-26T23:48:52.759 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:48:52.759 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:48:52.759 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2024-04-26T23:48:52.759 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2024-04-26T23:48:52.759 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2024-04-26T23:48:52.759 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2024-04-26T23:48:52.759 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2024-04-26T23:48:52.759 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "555255e9-7ef9-4454-8dc9-35e96b70035c", 2024-04-26T23:48:52.759 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2024-04-26T23:39:34.291658Z", 2024-04-26T23:48:52.759 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2024-04-26T23:39:34.291658Z", 2024-04-26T23:48:52.759 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 19, 2024-04-26T23:48:52.759 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "squid", 2024-04-26T23:48:52.760 INFO:teuthology.orchestra.run.smithi088.stdout: "election_strategy": 1, 2024-04-26T23:48:52.760 INFO:teuthology.orchestra.run.smithi088.stdout: "disallowed_leaders: ": "", 2024-04-26T23:48:52.760 INFO:teuthology.orchestra.run.smithi088.stdout: "stretch_mode": false, 2024-04-26T23:48:52.760 INFO:teuthology.orchestra.run.smithi088.stdout: "tiebreaker_mon": "", 2024-04-26T23:48:52.760 INFO:teuthology.orchestra.run.smithi088.stdout: "removed_ranks: ": "", 2024-04-26T23:48:52.760 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2024-04-26T23:48:52.760 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2024-04-26T23:48:52.760 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-04-26T23:48:52.760 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-04-26T23:48:52.760 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-04-26T23:48:52.760 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-04-26T23:48:52.760 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-04-26T23:48:52.760 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-04-26T23:48:52.760 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-04-26T23:48:52.761 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-04-26T23:48:52.761 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-04-26T23:48:52.761 INFO:teuthology.orchestra.run.smithi088.stdout: "reef", 2024-04-26T23:48:52.761 INFO:teuthology.orchestra.run.smithi088.stdout: "squid" 2024-04-26T23:48:52.761 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:48:52.761 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2024-04-26T23:48:52.761 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:48:52.761 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2024-04-26T23:48:52.761 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:48:52.761 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2024-04-26T23:48:52.761 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2024-04-26T23:48:52.761 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-04-26T23:48:52.761 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-04-26T23:48:52.761 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:48:52.761 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-04-26T23:48:52.762 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2024-04-26T23:48:52.762 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:48:52.762 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:48:52.762 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:48:52.762 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-04-26T23:48:52.762 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2024-04-26T23:48:52.762 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:48:52.762 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:48:52.762 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:48:52.762 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:48:52.762 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2024-04-26T23:48:52.762 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2024-04-26T23:48:52.762 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-04-26T23:48:52.762 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-04-26T23:48:52.763 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-04-26T23:48:52.763 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:48:52.763 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:48:52.763 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2024-04-26T23:48:52.763 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2024-04-26T23:48:52.763 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-04-26T23:48:52.763 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-04-26T23:48:52.763 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:48:52.763 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-04-26T23:48:52.763 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:3300", 2024-04-26T23:48:52.763 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:48:52.763 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:48:52.763 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:48:52.763 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-04-26T23:48:52.763 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6789", 2024-04-26T23:48:52.764 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:48:52.764 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:48:52.764 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:48:52.764 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:48:52.764 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6789/0", 2024-04-26T23:48:52.764 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.175:6789/0", 2024-04-26T23:48:52.764 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-04-26T23:48:52.764 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-04-26T23:48:52.764 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-04-26T23:48:52.764 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:48:52.764 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:48:52.764 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2024-04-26T23:48:52.764 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2024-04-26T23:48:52.764 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-04-26T23:48:52.764 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-04-26T23:48:52.765 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:48:52.765 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-04-26T23:48:52.765 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:3301", 2024-04-26T23:48:52.765 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:48:52.765 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:48:52.765 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:48:52.765 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-04-26T23:48:52.765 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6790", 2024-04-26T23:48:52.765 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:48:52.765 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:48:52.765 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:48:52.765 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:48:52.765 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6790/0", 2024-04-26T23:48:52.765 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.175:6790/0", 2024-04-26T23:48:52.765 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-04-26T23:48:52.766 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-04-26T23:48:52.766 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-04-26T23:48:52.766 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:48:52.766 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:48:52.766 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:48:52.766 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2024-04-26T23:48:52.766 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2024-04-26T23:48:52.766 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:48:52.766 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:48:52.766 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:48:52.766 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2024-04-26T23:48:52.766 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:48:52.766 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:48:52.766 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": [ 2024-04-26T23:48:52.767 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:48:52.767 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:48:52.767 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:48:52.767 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 4 2024-04-26T23:48:52.767 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:48:52.767 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:48:52.767 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": [ 2024-04-26T23:48:52.767 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:48:52.767 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:48:52.767 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:48:52.767 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 8 2024-04-26T23:48:52.767 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:48:52.767 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:48:52.767 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2024-04-26T23:48:52.767 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:48:52.768 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x2f018fb87aa4aafe", 2024-04-26T23:48:52.768 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:48:52.768 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2024-04-26T23:48:52.768 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:48:52.768 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:48:52.768 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:48:52.768 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:48:52.768 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 5 2024-04-26T23:48:52.768 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:48:52.768 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:48:52.768 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": [ 2024-04-26T23:48:52.768 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:48:52.768 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:48:52.768 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:48:52.769 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2024-04-26T23:48:52.769 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:48:52.769 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:48:52.769 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:48:52.769 INFO:teuthology.orchestra.run.smithi088.stdout: "stretch_mode": false 2024-04-26T23:48:52.769 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-04-26T23:48:52.770 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:52.753+0000 7fa2b83a4640 1 -- 172.21.15.88:0/1280889397 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fa29406c920 msgr2=0x7fa29406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:52.770 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:52.753+0000 7fa2b83a4640 1 --2- 172.21.15.88:0/1280889397 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fa29406c920 0x7fa29406ede0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fa2ac036000 tx=0x7fa2ac030000 comp rx=0 tx=0).stop 2024-04-26T23:48:52.770 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:52.753+0000 7fa2b83a4640 1 -- 172.21.15.88:0/1280889397 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa2b01569f0 msgr2=0x7fa2b0145990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:52.770 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:52.753+0000 7fa2b83a4640 1 --2- 172.21.15.88:0/1280889397 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa2b01569f0 0x7fa2b0145990 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fa2b00768c0 tx=0x7fa2a000c890 comp rx=0 tx=0).stop 2024-04-26T23:48:52.771 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:52.755+0000 7fa2b6941640 1 -- 172.21.15.88:0/1280889397 reap_dead start 2024-04-26T23:48:52.771 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:52.755+0000 7fa2b6941640 1 -- 172.21.15.88:0/1280889397 reap_dead start 2024-04-26T23:48:52.771 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:52.755+0000 7fa2b83a4640 1 -- 172.21.15.88:0/1280889397 shutdown_connections 2024-04-26T23:48:52.771 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:52.755+0000 7fa2b83a4640 1 -- 172.21.15.88:0/1280889397 >> 172.21.15.88:0/1280889397 conn(0x7fa2b00c82d0 msgr2=0x7fa2b0149cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:48:52.771 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:52.757+0000 7fa2b83a4640 1 -- 172.21.15.88:0/1280889397 shutdown_connections 2024-04-26T23:48:52.771 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:48:52.758+0000 7fa2b83a4640 1 -- 172.21.15.88:0/1280889397 wait complete. 2024-04-26T23:48:52.790 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-04-26T23:48:52.790 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2024-04-26T23:49:05.654 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:49:05.658 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:49:12.791 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2024-04-26T23:49:12.791 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.a 2024-04-26T23:49:12.791 INFO:tasks.ceph.mon.a:Restarting daemon 2024-04-26T23:49:12.791 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-04-26T23:49:12.794 INFO:tasks.ceph.mon.a:Started 2024-04-26T23:49:12.794 INFO:tasks.mon_thrash:Sending STOP to mon b 2024-04-26T23:49:12.795 INFO:tasks.ceph.mon.b:Sent signal 19 2024-04-26T23:49:12.795 INFO:tasks.mon_thrash.mon_thrasher:waiting for 15.0 secs to unfreeze mons 2024-04-26T23:49:23.113 INFO:tasks.workunit.client.1.smithi175.stdout:Syncing()...59 sec 2024-04-26T23:49:23.113 INFO:tasks.workunit.client.1.smithi175.stdout:FFSB benchmark finished at: Fri Apr 26 23:49:23 2024 2024-04-26T23:49:23.113 INFO:tasks.workunit.client.1.smithi175.stdout: 2024-04-26T23:49:23.113 INFO:tasks.workunit.client.1.smithi175.stdout:Results: 2024-04-26T23:49:23.113 INFO:tasks.workunit.client.1.smithi175.stdout:Benchmark took 367.47 sec 2024-04-26T23:49:23.113 INFO:tasks.workunit.client.1.smithi175.stdout: 2024-04-26T23:49:23.113 INFO:tasks.workunit.client.1.smithi175.stdout:Total Results 2024-04-26T23:49:23.113 INFO:tasks.workunit.client.1.smithi175.stdout:=============== 2024-04-26T23:49:23.113 INFO:tasks.workunit.client.1.smithi175.stdout: Op Name Transactions Trans/sec % Trans % Op Weight Throughput 2024-04-26T23:49:23.114 INFO:tasks.workunit.client.1.smithi175.stdout: ======= ============ ========= ======= =========== ========== 2024-04-26T23:49:23.114 INFO:tasks.workunit.client.1.smithi175.stdout: write : 17267200 46989.62 100.000% 100.000% 184MB/sec 2024-04-26T23:49:23.114 INFO:tasks.workunit.client.1.smithi175.stdout:- 2024-04-26T23:49:23.114 INFO:tasks.workunit.client.1.smithi175.stdout:46989.62 Transactions per Second 2024-04-26T23:49:23.114 INFO:tasks.workunit.client.1.smithi175.stdout: 2024-04-26T23:49:23.114 INFO:tasks.workunit.client.1.smithi175.stdout:Throughput Results 2024-04-26T23:49:23.114 INFO:tasks.workunit.client.1.smithi175.stdout:=================== 2024-04-26T23:49:23.114 INFO:tasks.workunit.client.1.smithi175.stdout:Write Throughput: 184MB/sec 2024-04-26T23:49:23.195 INFO:tasks.workunit.client.1.smithi175.stdout: 2024-04-26T23:49:23.195 INFO:tasks.workunit.client.1.smithi175.stdout:System Call Latency statistics in millisecs 2024-04-26T23:49:23.195 INFO:tasks.workunit.client.1.smithi175.stdout:===== 2024-04-26T23:49:23.195 INFO:tasks.workunit.client.1.smithi175.stdout: Min Avg Max Total Calls 2024-04-26T23:49:23.195 INFO:tasks.workunit.client.1.smithi175.stdout: ======== ======== ======== ============ 2024-04-26T23:49:23.195 INFO:tasks.workunit.client.1.smithi175.stdout:[ open] 0.004000 0.042145 29.240999 13490 2024-04-26T23:49:23.195 INFO:tasks.workunit.client.1.smithi175.stdout: msec_range[0] 5000.000000 - 10000.000000 : 0 2024-04-26T23:49:23.195 INFO:tasks.workunit.client.1.smithi175.stdout: msec_range[1] 2000.000000 - 5000.000000 : 0 2024-04-26T23:49:23.195 INFO:tasks.workunit.client.1.smithi175.stdout: msec_range[2] 1000.000000 - 2000.000000 : 0 2024-04-26T23:49:23.195 INFO:tasks.workunit.client.1.smithi175.stdout: msec_range[3] 500.000000 - 1000.000000 : 0 2024-04-26T23:49:23.195 INFO:tasks.workunit.client.1.smithi175.stdout: msec_range[4] 200.000000 - 500.000000 : 0 2024-04-26T23:49:23.196 INFO:tasks.workunit.client.1.smithi175.stdout: msec_range[5] 100.000000 - 200.000000 : 0 2024-04-26T23:49:23.196 INFO:tasks.workunit.client.1.smithi175.stdout: msec_range[6] 50.000000 - 100.000000 : 0 2024-04-26T23:49:23.196 INFO:tasks.workunit.client.1.smithi175.stdout: msec_range[7] 20.000000 - 50.000000 : 8 2024-04-26T23:49:23.196 INFO:tasks.workunit.client.1.smithi175.stdout: msec_range[8] 10.000000 - 20.000000 : 3 2024-04-26T23:49:23.196 INFO:tasks.workunit.client.1.smithi175.stdout: msec_range[9] 5.000000 - 10.000000 : 8 2024-04-26T23:49:23.196 INFO:tasks.workunit.client.1.smithi175.stdout: msec_range[10] 2.000000 - 5.000000 : 8 2024-04-26T23:49:23.196 INFO:tasks.workunit.client.1.smithi175.stdout: msec_range[11] 1.000000 - 2.000000 : 6 2024-04-26T23:49:23.196 INFO:tasks.workunit.client.1.smithi175.stdout: msec_range[12] 0.500000 - 1.000000 : 6 2024-04-26T23:49:23.196 INFO:tasks.workunit.client.1.smithi175.stdout: msec_range[13] 0.200000 - 0.500000 : 14 2024-04-26T23:49:23.196 INFO:tasks.workunit.client.1.smithi175.stdout: msec_range[14] 0.100000 - 0.200000 : 16 2024-04-26T23:49:23.196 INFO:tasks.workunit.client.1.smithi175.stdout: msec_range[15] 0.050000 - 0.100000 : 74 2024-04-26T23:49:23.196 INFO:tasks.workunit.client.1.smithi175.stdout: msec_range[16] 0.020000 - 0.050000 : 3871 2024-04-26T23:49:23.196 INFO:tasks.workunit.client.1.smithi175.stdout: msec_range[17] 0.010000 - 0.020000 : 8898 2024-04-26T23:49:23.196 INFO:tasks.workunit.client.1.smithi175.stdout: msec_range[18] 0.000000 - 0.010000 : 578 2024-04-26T23:49:23.197 INFO:tasks.workunit.client.1.smithi175.stdout: 2024-04-26T23:49:23.197 INFO:tasks.workunit.client.1.smithi175.stdout:[ write] 0.001000 0.560674 18371.179688 17267200 2024-04-26T23:49:23.197 INFO:tasks.workunit.client.1.smithi175.stdout: msec_range[0] 5000.000000 - 10000.000000 : 238 2024-04-26T23:49:23.197 INFO:tasks.workunit.client.1.smithi175.stdout: msec_range[1] 2000.000000 - 5000.000000 : 642 2024-04-26T23:49:23.197 INFO:tasks.workunit.client.1.smithi175.stdout: msec_range[2] 1000.000000 - 2000.000000 : 440 2024-04-26T23:49:23.197 INFO:tasks.workunit.client.1.smithi175.stdout: msec_range[3] 500.000000 - 1000.000000 : 415 2024-04-26T23:49:23.197 INFO:tasks.workunit.client.1.smithi175.stdout: msec_range[4] 200.000000 - 500.000000 : 1318 2024-04-26T23:49:23.197 INFO:tasks.workunit.client.1.smithi175.stdout: msec_range[5] 100.000000 - 200.000000 : 12760 2024-04-26T23:49:23.197 INFO:tasks.workunit.client.1.smithi175.stdout: msec_range[6] 50.000000 - 100.000000 : 27562 2024-04-26T23:49:23.197 INFO:tasks.workunit.client.1.smithi175.stdout: msec_range[7] 20.000000 - 50.000000 : 7929 2024-04-26T23:49:23.197 INFO:tasks.workunit.client.1.smithi175.stdout: msec_range[8] 10.000000 - 20.000000 : 1144 2024-04-26T23:49:23.197 INFO:tasks.workunit.client.1.smithi175.stdout: msec_range[9] 5.000000 - 10.000000 : 1197 2024-04-26T23:49:23.197 INFO:tasks.workunit.client.1.smithi175.stdout: msec_range[10] 2.000000 - 5.000000 : 1805 2024-04-26T23:49:23.197 INFO:tasks.workunit.client.1.smithi175.stdout: msec_range[11] 1.000000 - 2.000000 : 1330 2024-04-26T23:49:23.198 INFO:tasks.workunit.client.1.smithi175.stdout: msec_range[12] 0.500000 - 1.000000 : 1382 2024-04-26T23:49:23.198 INFO:tasks.workunit.client.1.smithi175.stdout: msec_range[13] 0.200000 - 0.500000 : 1766 2024-04-26T23:49:23.198 INFO:tasks.workunit.client.1.smithi175.stdout: msec_range[14] 0.100000 - 0.200000 : 1799 2024-04-26T23:49:23.198 INFO:tasks.workunit.client.1.smithi175.stdout: msec_range[15] 0.050000 - 0.100000 : 3731 2024-04-26T23:49:23.198 INFO:tasks.workunit.client.1.smithi175.stdout: msec_range[16] 0.020000 - 0.050000 : 24568 2024-04-26T23:49:23.198 INFO:tasks.workunit.client.1.smithi175.stdout: msec_range[17] 0.010000 - 0.020000 : 81537 2024-04-26T23:49:23.198 INFO:tasks.workunit.client.1.smithi175.stdout: msec_range[18] 0.000000 - 0.010000 : 17095584 2024-04-26T23:49:23.198 INFO:tasks.workunit.client.1.smithi175.stdout: 2024-04-26T23:49:23.198 INFO:tasks.workunit.client.1.smithi175.stdout:[ lseek] 0.000000 0.000517 63.235001 17267200 2024-04-26T23:49:23.198 INFO:tasks.workunit.client.1.smithi175.stdout: msec_range[0] 5000.000000 - 10000.000000 : 0 2024-04-26T23:49:23.198 INFO:tasks.workunit.client.1.smithi175.stdout: msec_range[1] 2000.000000 - 5000.000000 : 0 2024-04-26T23:49:23.198 INFO:tasks.workunit.client.1.smithi175.stdout: msec_range[2] 1000.000000 - 2000.000000 : 0 2024-04-26T23:49:23.198 INFO:tasks.workunit.client.1.smithi175.stdout: msec_range[3] 500.000000 - 1000.000000 : 0 2024-04-26T23:49:23.198 INFO:tasks.workunit.client.1.smithi175.stdout: msec_range[4] 200.000000 - 500.000000 : 0 2024-04-26T23:49:23.199 INFO:tasks.workunit.client.1.smithi175.stdout: msec_range[5] 100.000000 - 200.000000 : 0 2024-04-26T23:49:23.199 INFO:tasks.workunit.client.1.smithi175.stdout: msec_range[6] 50.000000 - 100.000000 : 4 2024-04-26T23:49:23.199 INFO:tasks.workunit.client.1.smithi175.stdout: msec_range[7] 20.000000 - 50.000000 : 22 2024-04-26T23:49:23.199 INFO:tasks.workunit.client.1.smithi175.stdout: msec_range[8] 10.000000 - 20.000000 : 26 2024-04-26T23:49:23.199 INFO:tasks.workunit.client.1.smithi175.stdout: msec_range[9] 5.000000 - 10.000000 : 47 2024-04-26T23:49:23.199 INFO:tasks.workunit.client.1.smithi175.stdout: msec_range[10] 2.000000 - 5.000000 : 93 2024-04-26T23:49:23.199 INFO:tasks.workunit.client.1.smithi175.stdout: msec_range[11] 1.000000 - 2.000000 : 87 2024-04-26T23:49:23.199 INFO:tasks.workunit.client.1.smithi175.stdout: msec_range[12] 0.500000 - 1.000000 : 115 2024-04-26T23:49:23.199 INFO:tasks.workunit.client.1.smithi175.stdout: msec_range[13] 0.200000 - 0.500000 : 184 2024-04-26T23:49:23.199 INFO:tasks.workunit.client.1.smithi175.stdout: msec_range[14] 0.100000 - 0.200000 : 181 2024-04-26T23:49:23.199 INFO:tasks.workunit.client.1.smithi175.stdout: msec_range[15] 0.050000 - 0.100000 : 340 2024-04-26T23:49:23.199 INFO:tasks.workunit.client.1.smithi175.stdout: msec_range[16] 0.020000 - 0.050000 : 1981 2024-04-26T23:49:23.199 INFO:tasks.workunit.client.1.smithi175.stdout: msec_range[17] 0.010000 - 0.020000 : 4776 2024-04-26T23:49:23.199 INFO:tasks.workunit.client.1.smithi175.stdout: msec_range[18] 0.000000 - 0.010000 : 17259344 2024-04-26T23:49:23.200 INFO:tasks.workunit.client.1.smithi175.stdout: 2024-04-26T23:49:23.200 INFO:tasks.workunit.client.1.smithi175.stdout:[ close] 0.001000 0.007050 7.094000 13490 2024-04-26T23:49:23.200 INFO:tasks.workunit.client.1.smithi175.stdout: msec_range[0] 5000.000000 - 10000.000000 : 0 2024-04-26T23:49:23.200 INFO:tasks.workunit.client.1.smithi175.stdout: msec_range[1] 2000.000000 - 5000.000000 : 0 2024-04-26T23:49:23.200 INFO:tasks.workunit.client.1.smithi175.stdout: msec_range[2] 1000.000000 - 2000.000000 : 0 2024-04-26T23:49:23.200 INFO:tasks.workunit.client.1.smithi175.stdout: msec_range[3] 500.000000 - 1000.000000 : 0 2024-04-26T23:49:23.200 INFO:tasks.workunit.client.1.smithi175.stdout: msec_range[4] 200.000000 - 500.000000 : 0 2024-04-26T23:49:23.200 INFO:tasks.workunit.client.1.smithi175.stdout: msec_range[5] 100.000000 - 200.000000 : 0 2024-04-26T23:49:23.200 INFO:tasks.workunit.client.1.smithi175.stdout: msec_range[6] 50.000000 - 100.000000 : 0 2024-04-26T23:49:23.200 INFO:tasks.workunit.client.1.smithi175.stdout: msec_range[7] 20.000000 - 50.000000 : 0 2024-04-26T23:49:23.200 INFO:tasks.workunit.client.1.smithi175.stdout: msec_range[8] 10.000000 - 20.000000 : 0 2024-04-26T23:49:23.200 INFO:tasks.workunit.client.1.smithi175.stdout: msec_range[9] 5.000000 - 10.000000 : 1 2024-04-26T23:49:23.200 INFO:tasks.workunit.client.1.smithi175.stdout: msec_range[10] 2.000000 - 5.000000 : 1 2024-04-26T23:49:23.200 INFO:tasks.workunit.client.1.smithi175.stdout: msec_range[11] 1.000000 - 2.000000 : 1 2024-04-26T23:49:23.200 INFO:tasks.workunit.client.1.smithi175.stdout: msec_range[12] 0.500000 - 1.000000 : 0 2024-04-26T23:49:23.201 INFO:tasks.workunit.client.1.smithi175.stdout: msec_range[13] 0.200000 - 0.500000 : 3 2024-04-26T23:49:23.201 INFO:tasks.workunit.client.1.smithi175.stdout: msec_range[14] 0.100000 - 0.200000 : 2 2024-04-26T23:49:23.201 INFO:tasks.workunit.client.1.smithi175.stdout: msec_range[15] 0.050000 - 0.100000 : 6 2024-04-26T23:49:23.201 INFO:tasks.workunit.client.1.smithi175.stdout: msec_range[16] 0.020000 - 0.050000 : 58 2024-04-26T23:49:23.201 INFO:tasks.workunit.client.1.smithi175.stdout: msec_range[17] 0.010000 - 0.020000 : 205 2024-04-26T23:49:23.201 INFO:tasks.workunit.client.1.smithi175.stdout: msec_range[18] 0.000000 - 0.010000 : 13213 2024-04-26T23:49:23.201 INFO:tasks.workunit.client.1.smithi175.stdout: 2024-04-26T23:49:23.201 INFO:tasks.workunit.client.1.smithi175.stdout: 2024-04-26T23:49:23.201 INFO:tasks.workunit.client.1.smithi175.stdout: 2024-04-26T23:49:23.201 INFO:tasks.workunit.client.1.smithi175.stdout: 2024-04-26T23:49:23.201 INFO:tasks.workunit.client.1.smithi175.stdout:2.0% User Time 2024-04-26T23:49:23.201 INFO:tasks.workunit.client.1.smithi175.stdout:16.0% System Time 2024-04-26T23:49:23.201 INFO:tasks.workunit.client.1.smithi175.stdout:18.0% CPU Utilization 2024-04-26T23:49:23.217 INFO:tasks.workunit.client.1.smithi175.stderr:+ cd .. 2024-04-26T23:49:23.218 INFO:tasks.workunit.client.1.smithi175.stderr:+ rm -r tmp ffsb 2024-04-26T23:49:26.189 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-04-26T23:49:26.190 DEBUG:teuthology.orchestra.run.smithi175:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1/tmp 2024-04-26T23:49:26.223 INFO:tasks.workunit:Stopping ['suites/ffsb.sh'] on client.1... 2024-04-26T23:49:26.223 DEBUG:teuthology.orchestra.run.smithi175:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.1 /home/ubuntu/cephtest/clone.client.1 2024-04-26T23:49:27.107 DEBUG:teuthology.parallel:result is None 2024-04-26T23:49:27.795 INFO:tasks.mon_thrash:Sending CONT to mon b 2024-04-26T23:49:27.796 INFO:tasks.ceph.mon.b:Sent signal 18 2024-04-26T23:49:27.796 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-04-26T23:49:27.796 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-04-26T23:49:27.948 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:27.943+0000 7f9e99e93640 1 Processor -- start 2024-04-26T23:49:27.948 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:27.943+0000 7f9e99e93640 1 -- start start 2024-04-26T23:49:27.950 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:27.945+0000 7f9e99e93640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f9e940c3650 0x7f9e9406e760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:27.950 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:27.945+0000 7f9e99e93640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9e940aa8c0 0x7f9e940c3a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:27.950 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:27.945+0000 7f9e99e93640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9e9415c0d0 con 0x7f9e940c3f70 2024-04-26T23:49:27.950 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:27.945+0000 7f9e99e93640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f9e940ab4b0 con 0x7f9e940c3650 2024-04-26T23:49:27.950 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:27.945+0000 7f9e99e93640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f9e9415bdf0 con 0x7f9e940aa8c0 2024-04-26T23:49:27.950 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:27.945+0000 7f9e93fff640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f9e940c3f70 0x7f9e940abf50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:41110/0 (socket says 172.21.15.88:41110) 2024-04-26T23:49:27.950 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:27.945+0000 7f9e93fff640 1 -- 172.21.15.88:0/1670833448 learned_addr learned my addr 172.21.15.88:0/1670833448 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-26T23:49:27.950 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:27.945+0000 7f9e937fe640 1 --2- 172.21.15.88:0/1670833448 >> v2:172.21.15.175:3300/0 conn(0x7f9e940c3650 0x7f9e9406e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:27.950 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:27.945+0000 7f9e927fc640 1 -- 172.21.15.88:0/1670833448 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 351704759 0 0) 0x7f9e9415c0d0 con 0x7f9e940c3f70 2024-04-26T23:49:27.950 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:27.945+0000 7f9e927fc640 1 -- 172.21.15.88:0/1670833448 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9e7c003520 con 0x7f9e940c3f70 2024-04-26T23:49:27.951 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:27.946+0000 7f9e937fe640 1 -- 172.21.15.88:0/1670833448 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9e940aa8c0 msgr2=0x7f9e940c3a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:49:27.951 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:27.946+0000 7f9e937fe640 1 --2- 172.21.15.88:0/1670833448 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9e940aa8c0 0x7f9e940c3a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:27.951 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:27.946+0000 7f9e937fe640 1 -- 172.21.15.88:0/1670833448 >> v1:172.21.15.88:6789/0 conn(0x7f9e940c3f70 legacy=0x7f9e940abf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:27.951 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:27.946+0000 7f9e937fe640 1 -- 172.21.15.88:0/1670833448 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e940ab750 con 0x7f9e940c3650 2024-04-26T23:49:27.952 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:27.947+0000 7f9e937fe640 1 --2- 172.21.15.88:0/1670833448 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9e940c3650 0x7f9e9406e760 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f9e840097a0 tx=0x7f9e8402a060 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f57d17d0f95ca35c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:49:27.952 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:27.947+0000 7f9e927fc640 1 -- 172.21.15.88:0/1670833448 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e84037070 con 0x7f9e940c3650 2024-04-26T23:49:27.952 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:27.948+0000 7f9e927fc640 1 -- 172.21.15.88:0/1670833448 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e8402adb0 con 0x7f9e940c3650 2024-04-26T23:49:27.952 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:27.948+0000 7f9e927fc640 1 -- 172.21.15.88:0/1670833448 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e84032640 con 0x7f9e940c3650 2024-04-26T23:49:27.953 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:27.949+0000 7f9e99e93640 1 -- 172.21.15.88:0/1670833448 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9e940c3650 msgr2=0x7f9e9406e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:27.953 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:27.949+0000 7f9e99e93640 1 --2- 172.21.15.88:0/1670833448 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9e940c3650 0x7f9e9406e760 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f9e840097a0 tx=0x7f9e8402a060 comp rx=0 tx=0).stop 2024-04-26T23:49:27.954 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:27.950+0000 7f9e99e93640 1 -- 172.21.15.88:0/1670833448 shutdown_connections 2024-04-26T23:49:27.954 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:27.950+0000 7f9e99e93640 1 --2- 172.21.15.88:0/1670833448 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9e940aa8c0 0x7f9e940c3a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:27.954 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:27.950+0000 7f9e99e93640 1 --2- 172.21.15.88:0/1670833448 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9e940c3650 0x7f9e9406e760 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:27.954 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:27.950+0000 7f9e99e93640 1 -- 172.21.15.88:0/1670833448 >> 172.21.15.88:0/1670833448 conn(0x7f9e940c82d0 msgr2=0x7f9e940c86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:49:27.954 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:27.950+0000 7f9e99e93640 1 -- 172.21.15.88:0/1670833448 shutdown_connections 2024-04-26T23:49:27.956 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:27.950+0000 7f9e99e93640 1 -- 172.21.15.88:0/1670833448 wait complete. 2024-04-26T23:49:27.956 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:27.952+0000 7f9e99e93640 1 Processor -- start 2024-04-26T23:49:27.957 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:27.952+0000 7f9e99e93640 1 -- start start 2024-04-26T23:49:27.958 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:27.953+0000 7f9e99e93640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9e940aa8c0 0x7f9e9415e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:27.958 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:27.953+0000 7f9e99e93640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9e940c3650 0x7f9e94151740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:27.958 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:27.953+0000 7f9e99e93640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9e940c3f70 0x7f9e94151c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:27.958 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:27.953+0000 7f9e99e93640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f9e940ac7e0 con 0x7f9e940c3f70 2024-04-26T23:49:27.958 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:27.953+0000 7f9e99e93640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f9e940ac660 con 0x7f9e940aa8c0 2024-04-26T23:49:27.958 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:27.954+0000 7f9e99e93640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f9e9415a6a0 con 0x7f9e940c3650 2024-04-26T23:49:27.960 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:27.954+0000 7f9e92ffd640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9e940c3650 0x7f9e94151740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:27.960 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:27.954+0000 7f9e92ffd640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9e940c3650 0x7f9e94151740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.88:48364/0 (socket says 172.21.15.88:48364) 2024-04-26T23:49:27.960 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:27.954+0000 7f9e92ffd640 1 -- 172.21.15.88:0/1022628425 learned_addr learned my addr 172.21.15.88:0/1022628425 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:49:27.960 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:27.954+0000 7f9e93fff640 1 --2- 172.21.15.88:0/1022628425 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9e940c3f70 0x7f9e94151c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:27.960 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:27.955+0000 7f9e92ffd640 1 -- 172.21.15.88:0/1022628425 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9e940aa8c0 msgr2=0x7f9e9415e9c0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-26T23:49:27.960 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:27.955+0000 7f9e92ffd640 1 --2- 172.21.15.88:0/1022628425 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9e940aa8c0 0x7f9e9415e9c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:27.960 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:27.955+0000 7f9e92ffd640 1 -- 172.21.15.88:0/1022628425 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9e940c3f70 msgr2=0x7f9e94151c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:27.960 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:27.955+0000 7f9e92ffd640 1 --2- 172.21.15.88:0/1022628425 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9e940c3f70 0x7f9e94151c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:27.961 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:27.955+0000 7f9e92ffd640 1 -- 172.21.15.88:0/1022628425 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e941536b0 con 0x7f9e940c3650 2024-04-26T23:49:27.961 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:27.955+0000 7f9e93fff640 1 --2- 172.21.15.88:0/1022628425 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9e940c3f70 0x7f9e94151c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:49:27.961 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:27.956+0000 7f9e92ffd640 1 --2- 172.21.15.88:0/1022628425 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9e940c3650 0x7f9e94151740 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f9e8800b480 tx=0x7f9e8800b940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:49:27.961 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:27.956+0000 7f9e7bfff640 1 -- 172.21.15.88:0/1022628425 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e88014070 con 0x7f9e940c3650 2024-04-26T23:49:27.962 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:27.956+0000 7f9e99e93640 1 -- 172.21.15.88:0/1022628425 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e941e84e0 con 0x7f9e940c3650 2024-04-26T23:49:27.962 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:27.956+0000 7f9e99e93640 1 -- 172.21.15.88:0/1022628425 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e9415c5e0 con 0x7f9e940c3650 2024-04-26T23:49:27.962 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:27.956+0000 7f9e7bfff640 1 -- 172.21.15.88:0/1022628425 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e88010870 con 0x7f9e940c3650 2024-04-26T23:49:27.962 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:27.956+0000 7f9e7bfff640 1 -- 172.21.15.88:0/1022628425 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e88010c40 con 0x7f9e940c3650 2024-04-26T23:49:27.963 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:27.959+0000 7f9e7bfff640 1 -- 172.21.15.88:0/1022628425 <== mon.2 v2:172.21.15.175:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f9e88017070 con 0x7f9e940c3650 2024-04-26T23:49:27.964 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:27.959+0000 7f9e7bfff640 1 --2- 172.21.15.88:0/1022628425 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f9e8006c8f0 0x7f9e8006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:27.964 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:27.959+0000 7f9e99e93640 1 -- 172.21.15.88:0/1022628425 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e74005290 con 0x7f9e940c3650 2024-04-26T23:49:27.964 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:27.959+0000 7f9e7bfff640 1 -- 172.21.15.88:0/1022628425 <== mon.2 v2:172.21.15.175:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6666+0+0 (secure 0 0 0) 0x7f9e8808bd20 con 0x7f9e940c3650 2024-04-26T23:49:27.964 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:27.960+0000 7f9e937fe640 1 --2- 172.21.15.88:0/1022628425 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f9e8006c8f0 0x7f9e8006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:27.965 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:27.961+0000 7f9e937fe640 1 --2- 172.21.15.88:0/1022628425 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f9e8006c8f0 0x7f9e8006edb0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f9e84034000 tx=0x7f9e8402e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:49:27.972 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:27.968+0000 7f9e7bfff640 1 -- 172.21.15.88:0/1022628425 <== mon.2 v2:172.21.15.175:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f9e88059d80 con 0x7f9e940c3650 2024-04-26T23:49:28.417 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:28.412+0000 7f9e99e93640 1 -- 172.21.15.88:0/1022628425 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f9e74005580 con 0x7f9e940c3650 2024-04-26T23:49:28.420 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:28.416+0000 7f9e7bfff640 1 -- 172.21.15.88:0/1022628425 <== mon.2 v2:172.21.15.175:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1564 (secure 0 0 0) 0x7f9e88059680 con 0x7f9e940c3650 2024-04-26T23:49:28.421 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":84,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"555255e9-7ef9-4454-8dc9-35e96b70035c","modified":"2024-04-26T23:39:34.291658Z","created":"2024-04-26T23:39:34.291658Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:3300","nonce":0},{"type":"v1","addr":"172.21.15.175:6789","nonce":0}]},"addr":"172.21.15.175:6789/0","public_addr":"172.21.15.175:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:3301","nonce":0},{"type":"v1","addr":"172.21.15.175:6790","nonce":0}]},"addr":"172.21.15.175:6790/0","public_addr":"172.21.15.175:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-04-26T23:49:28.424 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:28.419+0000 7f9e99e93640 1 -- 172.21.15.88:0/1022628425 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f9e8006c8f0 msgr2=0x7f9e8006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:28.424 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:28.419+0000 7f9e99e93640 1 --2- 172.21.15.88:0/1022628425 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f9e8006c8f0 0x7f9e8006edb0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f9e84034000 tx=0x7f9e8402e000 comp rx=0 tx=0).stop 2024-04-26T23:49:28.424 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:28.419+0000 7f9e99e93640 1 -- 172.21.15.88:0/1022628425 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9e940c3650 msgr2=0x7f9e94151740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:28.424 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:28.419+0000 7f9e99e93640 1 --2- 172.21.15.88:0/1022628425 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9e940c3650 0x7f9e94151740 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f9e8800b480 tx=0x7f9e8800b940 comp rx=0 tx=0).stop 2024-04-26T23:49:28.424 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:28.419+0000 7f9e99e93640 1 -- 172.21.15.88:0/1022628425 shutdown_connections 2024-04-26T23:49:28.424 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:28.419+0000 7f9e99e93640 1 --2- 172.21.15.88:0/1022628425 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f9e8006c8f0 0x7f9e8006edb0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:28.424 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:28.419+0000 7f9e99e93640 1 --2- 172.21.15.88:0/1022628425 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9e940c3650 0x7f9e94151740 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:28.425 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:28.419+0000 7f9e99e93640 1 --2- 172.21.15.88:0/1022628425 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9e940c3f70 0x7f9e94151c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:28.425 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:28.419+0000 7f9e99e93640 1 --2- 172.21.15.88:0/1022628425 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9e940aa8c0 0x7f9e9415e9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:28.425 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:28.419+0000 7f9e99e93640 1 -- 172.21.15.88:0/1022628425 >> 172.21.15.88:0/1022628425 conn(0x7f9e940c82d0 msgr2=0x7f9e940c4590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:49:28.425 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:28.420+0000 7f9e99e93640 1 -- 172.21.15.88:0/1022628425 shutdown_connections 2024-04-26T23:49:28.425 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:28.420+0000 7f9e99e93640 1 -- 172.21.15.88:0/1022628425 wait complete. 2024-04-26T23:49:28.443 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-04-26T23:49:28.443 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-04-26T23:49:28.443 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-04-26T23:49:28.609 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:28.604+0000 7fdfee683640 1 Processor -- start 2024-04-26T23:49:28.609 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:28.604+0000 7fdfee683640 1 -- start start 2024-04-26T23:49:28.610 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:28.606+0000 7fdfee683640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fdfe80ac710 0x7fdfe81555a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:28.610 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:28.606+0000 7fdfee683640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fdfe8073690 0x7fdfe8073b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:28.610 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:28.606+0000 7fdfee683640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdfe814f0b0 con 0x7fdfe814ecd0 2024-04-26T23:49:28.611 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:28.606+0000 7fdfee683640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7fdfe8074c90 con 0x7fdfe8073690 2024-04-26T23:49:28.611 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:28.606+0000 7fdfee683640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7fdfe80c6400 con 0x7fdfe80ac710 2024-04-26T23:49:28.611 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:28.607+0000 7fdfecc20640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fdfe8073690 0x7fdfe8073b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:28.611 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:28.607+0000 7fdfe7fff640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fdfe814ecd0 0x7fdfe80ab470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:60928/0 (socket says 172.21.15.88:60928) 2024-04-26T23:49:28.611 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:28.607+0000 7fdfe7fff640 1 -- 172.21.15.88:0/63540770 learned_addr learned my addr 172.21.15.88:0/63540770 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-26T23:49:28.611 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:28.607+0000 7fdfe77fe640 1 --2- 172.21.15.88:0/63540770 >> v2:172.21.15.175:3300/0 conn(0x7fdfe80ac710 0x7fdfe81555a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:28.612 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:28.607+0000 7fdfecc20640 1 -- 172.21.15.88:0/63540770 >> v2:172.21.15.175:3300/0 conn(0x7fdfe80ac710 msgr2=0x7fdfe81555a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:49:28.612 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:28.607+0000 7fdfecc20640 1 --2- 172.21.15.88:0/63540770 >> v2:172.21.15.175:3300/0 conn(0x7fdfe80ac710 0x7fdfe81555a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:28.612 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:28.607+0000 7fdfecc20640 1 -- 172.21.15.88:0/63540770 >> v1:172.21.15.88:6789/0 conn(0x7fdfe814ecd0 legacy=0x7fdfe80ab470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:49:28.612 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:28.607+0000 7fdfecc20640 1 -- 172.21.15.88:0/63540770 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfe80c66e0 con 0x7fdfe8073690 2024-04-26T23:49:28.613 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:28.608+0000 7fdfe77fe640 1 --2- 172.21.15.88:0/63540770 >> v2:172.21.15.175:3300/0 conn(0x7fdfe80ac710 0x7fdfe81555a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:49:28.613 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:28.608+0000 7fdfecc20640 1 --2- 172.21.15.88:0/63540770 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdfe8073690 0x7fdfe8073b40 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fdfe80c7c80 tx=0x7fdfdc02a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=359b2897e4a03e39 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:49:28.614 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:28.609+0000 7fdfe6ffd640 1 -- 172.21.15.88:0/63540770 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfdc037070 con 0x7fdfe8073690 2024-04-26T23:49:28.614 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:28.610+0000 7fdfe6ffd640 1 -- 172.21.15.88:0/63540770 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdfdc02ad70 con 0x7fdfe8073690 2024-04-26T23:49:28.614 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:28.610+0000 7fdfe6ffd640 1 -- 172.21.15.88:0/63540770 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfdc032660 con 0x7fdfe8073690 2024-04-26T23:49:28.616 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:28.611+0000 7fdfee683640 1 -- 172.21.15.88:0/63540770 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdfe8073690 msgr2=0x7fdfe8073b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:28.616 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:28.611+0000 7fdfee683640 1 --2- 172.21.15.88:0/63540770 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdfe8073690 0x7fdfe8073b40 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fdfe80c7c80 tx=0x7fdfdc02a060 comp rx=0 tx=0).stop 2024-04-26T23:49:28.616 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:28.611+0000 7fdfee683640 1 -- 172.21.15.88:0/63540770 shutdown_connections 2024-04-26T23:49:28.616 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:28.611+0000 7fdfee683640 1 --2- 172.21.15.88:0/63540770 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdfe8073690 0x7fdfe8073b40 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:28.616 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:28.611+0000 7fdfee683640 1 --2- 172.21.15.88:0/63540770 >> v2:172.21.15.175:3300/0 conn(0x7fdfe80ac710 0x7fdfe81555a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:28.616 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:28.611+0000 7fdfee683640 1 -- 172.21.15.88:0/63540770 >> 172.21.15.88:0/63540770 conn(0x7fdfe80c6d80 msgr2=0x7fdfe80c7160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:49:28.616 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:28.611+0000 7fdfee683640 1 -- 172.21.15.88:0/63540770 shutdown_connections 2024-04-26T23:49:28.617 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:28.611+0000 7fdfee683640 1 -- 172.21.15.88:0/63540770 wait complete. 2024-04-26T23:49:28.618 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:28.613+0000 7fdfee683640 1 Processor -- start 2024-04-26T23:49:28.618 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:28.613+0000 7fdfee683640 1 -- start start 2024-04-26T23:49:28.621 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:28.615+0000 7fdfee683640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdfe8073690 0x7fdfe806d320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:28.621 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:28.615+0000 7fdfee683640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdfe80ac710 0x7fdfe806d860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:28.621 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:28.615+0000 7fdfee683640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdfe814ecd0 0x7fdfe81eb830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:28.621 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:28.615+0000 7fdfee683640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fdfe8155080 con 0x7fdfe814ecd0 2024-04-26T23:49:28.621 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:28.615+0000 7fdfee683640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fdfe8154da0 con 0x7fdfe80ac710 2024-04-26T23:49:28.621 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:28.615+0000 7fdfee683640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fdfe80c69c0 con 0x7fdfe8073690 2024-04-26T23:49:28.623 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:28.615+0000 7fdfecc20640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdfe814ecd0 0x7fdfe81eb830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:28.623 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:28.615+0000 7fdfecc20640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdfe814ecd0 0x7fdfe81eb830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:40730/0 (socket says 172.21.15.88:40730) 2024-04-26T23:49:28.623 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:28.615+0000 7fdfe77fe640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdfe80ac710 0x7fdfe806d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:28.623 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:28.615+0000 7fdfecc20640 1 -- 172.21.15.88:0/1131816073 learned_addr learned my addr 172.21.15.88:0/1131816073 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:49:28.623 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:28.616+0000 7fdfe7fff640 1 --2- 172.21.15.88:0/1131816073 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdfe8073690 0x7fdfe806d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:28.623 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:28.616+0000 7fdfe77fe640 1 -- 172.21.15.88:0/1131816073 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdfe8073690 msgr2=0x7fdfe806d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:28.623 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:28.616+0000 7fdfe77fe640 1 --2- 172.21.15.88:0/1131816073 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdfe8073690 0x7fdfe806d320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:28.623 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:28.616+0000 7fdfe77fe640 1 -- 172.21.15.88:0/1131816073 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdfe814ecd0 msgr2=0x7fdfe81eb830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:28.623 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:28.616+0000 7fdfe77fe640 1 --2- 172.21.15.88:0/1131816073 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdfe814ecd0 0x7fdfe81eb830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:28.623 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:28.616+0000 7fdfe77fe640 1 -- 172.21.15.88:0/1131816073 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfe806e220 con 0x7fdfe80ac710 2024-04-26T23:49:28.624 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:28.616+0000 7fdfecc20640 1 --2- 172.21.15.88:0/1131816073 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdfe814ecd0 0x7fdfe81eb830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:49:28.624 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:28.616+0000 7fdfe77fe640 1 --2- 172.21.15.88:0/1131816073 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdfe80ac710 0x7fdfe806d860 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fdfe0007e30 tx=0x7fdfe000e4b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:49:28.624 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:28.617+0000 7fdfe4ff9640 1 -- 172.21.15.88:0/1131816073 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfe0014420 con 0x7fdfe80ac710 2024-04-26T23:49:28.624 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:28.617+0000 7fdfe4ff9640 1 -- 172.21.15.88:0/1131816073 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdfe0019070 con 0x7fdfe80ac710 2024-04-26T23:49:28.624 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:28.617+0000 7fdfe4ff9640 1 -- 172.21.15.88:0/1131816073 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfe00147e0 con 0x7fdfe80ac710 2024-04-26T23:49:28.624 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:28.617+0000 7fdfee683640 1 -- 172.21.15.88:0/1131816073 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdfe806cc90 con 0x7fdfe80ac710 2024-04-26T23:49:28.624 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:28.617+0000 7fdfee683640 1 -- 172.21.15.88:0/1131816073 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdfe806df40 con 0x7fdfe80ac710 2024-04-26T23:49:28.624 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:28.618+0000 7fdfee683640 1 --2- 172.21.15.88:0/1131816073 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdfc8002a70 0x7fdfc8004f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:28.624 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:28.618+0000 7fdfee683640 1 -- 172.21.15.88:0/1131816073 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fdfc8007ec0 con 0x7fdfc8002a70 2024-04-26T23:49:28.624 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:28.618+0000 7fdfe7fff640 1 --2- 172.21.15.88:0/1131816073 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdfc8002a70 0x7fdfc8004f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:28.626 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:28.619+0000 7fdfe7fff640 1 -- 172.21.15.88:0/1131816073 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fdfc80080c0 con 0x7fdfc8002a70 2024-04-26T23:49:28.626 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:28.619+0000 7fdfe7fff640 1 --2- 172.21.15.88:0/1131816073 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdfc8002a70 0x7fdfc8004f30 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fdfd800e500 tx=0x7fdfd800e9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:49:28.626 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:28.619+0000 7fdfe4ff9640 1 -- 172.21.15.88:0/1131816073 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfd8004c20 con 0x7fdfc8002a70 2024-04-26T23:49:28.626 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:28.619+0000 7fdfe4ff9640 1 -- 172.21.15.88:0/1131816073 <== mon.0 v2:172.21.15.88:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fdfd8018070 con 0x7fdfc8002a70 2024-04-26T23:49:28.626 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:28.619+0000 7fdfe4ff9640 1 -- 172.21.15.88:0/1131816073 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdfc8002a70 msgr2=0x7fdfc8004f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:28.626 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:28.619+0000 7fdfe4ff9640 1 --2- 172.21.15.88:0/1131816073 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdfc8002a70 0x7fdfc8004f30 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fdfd800e500 tx=0x7fdfd800e9c0 comp rx=0 tx=0).stop 2024-04-26T23:49:28.626 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:28.620+0000 7fdfe4ff9640 1 -- 172.21.15.88:0/1131816073 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdfc8002a70 msgr2=0x7fdfc8004f30 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:49:28.626 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:28.620+0000 7fdfe4ff9640 1 --2- 172.21.15.88:0/1131816073 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdfc8002a70 0x7fdfc8004f30 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:28.626 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:28.620+0000 7fdfe4ff9640 1 -- 172.21.15.88:0/1131816073 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fdfe0014980 con 0x7fdfe80ac710 2024-04-26T23:49:28.626 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:28.620+0000 7fdfe4ff9640 1 --2- 172.21.15.88:0/1131816073 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fdfd406c360 0x7fdfd406e820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:28.626 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:28.620+0000 7fdfe4ff9640 1 -- 172.21.15.88:0/1131816073 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6666+0+0 (secure 0 0 0) 0x7fdfe008c5d0 con 0x7fdfe80ac710 2024-04-26T23:49:28.627 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:28.620+0000 7fdfe7fff640 1 --2- 172.21.15.88:0/1131816073 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fdfd406c360 0x7fdfd406e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:28.627 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:28.621+0000 7fdfe7fff640 1 --2- 172.21.15.88:0/1131816073 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fdfd406c360 0x7fdfd406e820 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fdfd800e500 tx=0x7fdfd8006000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:49:28.636 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:28.631+0000 7fdfee683640 1 --2- 172.21.15.88:0/1131816073 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdfc8006ee0 0x7fdfc8007350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:28.636 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:28.631+0000 7fdfee683640 1 -- 172.21.15.88:0/1131816073 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fdfc800a4a0 con 0x7fdfc8006ee0 2024-04-26T23:49:28.636 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:28.632+0000 7fdfecc20640 1 --2- 172.21.15.88:0/1131816073 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdfc8006ee0 0x7fdfc8007350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:28.637 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:28.633+0000 7fdfecc20640 1 -- 172.21.15.88:0/1131816073 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fdfc8007890 con 0x7fdfc8006ee0 2024-04-26T23:49:28.638 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:28.633+0000 7fdfecc20640 1 --2- 172.21.15.88:0/1131816073 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdfc8006ee0 0x7fdfc8007350 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fdfe8148c20 tx=0x7fdfdc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:49:28.639 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:28.634+0000 7fdfe4ff9640 1 -- 172.21.15.88:0/1131816073 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfdc042070 con 0x7fdfc8006ee0 2024-04-26T23:49:28.639 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:28.634+0000 7fdfe4ff9640 1 -- 172.21.15.88:0/1131816073 <== mon.0 v2:172.21.15.88:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4556 (secure 0 0 0) 0x7fdfdc046610 con 0x7fdfc8006ee0 2024-04-26T23:49:28.639 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:28.634+0000 7fdfe4ff9640 1 -- 172.21.15.88:0/1131816073 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdfc8006ee0 msgr2=0x7fdfc8007350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:28.639 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:28.634+0000 7fdfe4ff9640 1 --2- 172.21.15.88:0/1131816073 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdfc8006ee0 0x7fdfc8007350 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fdfe8148c20 tx=0x7fdfdc0046c0 comp rx=0 tx=0).stop 2024-04-26T23:49:28.639 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:28.634+0000 7fdfe4ff9640 1 -- 172.21.15.88:0/1131816073 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdfc8006ee0 msgr2=0x7fdfc8007350 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:49:28.639 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:28.634+0000 7fdfe4ff9640 1 --2- 172.21.15.88:0/1131816073 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdfc8006ee0 0x7fdfc8007350 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:28.639 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-04-26T23:49:28.640 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2024-04-26T23:49:28.640 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2024-04-26T23:49:28.640 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "leader", 2024-04-26T23:49:28.640 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 84, 2024-04-26T23:49:28.640 INFO:teuthology.orchestra.run.smithi088.stdout: "uptime": 15637, 2024-04-26T23:49:28.640 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2024-04-26T23:49:28.640 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2024-04-26T23:49:28.640 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2024-04-26T23:49:28.640 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2024-04-26T23:49:28.640 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:49:28.640 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 0, 2024-04-26T23:49:28.640 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2024-04-26T23:49:28.640 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2450521708007866372", 2024-04-26T23:49:28.641 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2024-04-26T23:49:28.641 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-04-26T23:49:28.641 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-04-26T23:49:28.641 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-04-26T23:49:28.641 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-04-26T23:49:28.641 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-04-26T23:49:28.641 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-04-26T23:49:28.641 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-04-26T23:49:28.641 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-04-26T23:49:28.641 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-04-26T23:49:28.641 INFO:teuthology.orchestra.run.smithi088.stdout: "reef", 2024-04-26T23:49:28.641 INFO:teuthology.orchestra.run.smithi088.stdout: "squid" 2024-04-26T23:49:28.641 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:49:28.641 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540701547738038271", 2024-04-26T23:49:28.641 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2024-04-26T23:49:28.642 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-04-26T23:49:28.642 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-04-26T23:49:28.642 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-04-26T23:49:28.642 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-04-26T23:49:28.642 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-04-26T23:49:28.642 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-04-26T23:49:28.642 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-04-26T23:49:28.642 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-04-26T23:49:28.642 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-04-26T23:49:28.642 INFO:teuthology.orchestra.run.smithi088.stdout: "reef", 2024-04-26T23:49:28.642 INFO:teuthology.orchestra.run.smithi088.stdout: "squid" 2024-04-26T23:49:28.642 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:49:28.642 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:49:28.642 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2024-04-26T23:49:28.643 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2024-04-26T23:49:28.643 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2024-04-26T23:49:28.643 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2024-04-26T23:49:28.643 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2024-04-26T23:49:28.643 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "555255e9-7ef9-4454-8dc9-35e96b70035c", 2024-04-26T23:49:28.643 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2024-04-26T23:39:34.291658Z", 2024-04-26T23:49:28.643 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2024-04-26T23:39:34.291658Z", 2024-04-26T23:49:28.643 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 19, 2024-04-26T23:49:28.643 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "squid", 2024-04-26T23:49:28.643 INFO:teuthology.orchestra.run.smithi088.stdout: "election_strategy": 1, 2024-04-26T23:49:28.643 INFO:teuthology.orchestra.run.smithi088.stdout: "disallowed_leaders: ": "", 2024-04-26T23:49:28.643 INFO:teuthology.orchestra.run.smithi088.stdout: "stretch_mode": false, 2024-04-26T23:49:28.643 INFO:teuthology.orchestra.run.smithi088.stdout: "tiebreaker_mon": "", 2024-04-26T23:49:28.644 INFO:teuthology.orchestra.run.smithi088.stdout: "removed_ranks: ": "", 2024-04-26T23:49:28.644 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2024-04-26T23:49:28.644 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2024-04-26T23:49:28.644 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-04-26T23:49:28.644 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-04-26T23:49:28.644 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-04-26T23:49:28.644 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-04-26T23:49:28.644 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-04-26T23:49:28.644 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-04-26T23:49:28.644 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-04-26T23:49:28.644 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-04-26T23:49:28.644 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-04-26T23:49:28.644 INFO:teuthology.orchestra.run.smithi088.stdout: "reef", 2024-04-26T23:49:28.645 INFO:teuthology.orchestra.run.smithi088.stdout: "squid" 2024-04-26T23:49:28.645 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:49:28.645 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2024-04-26T23:49:28.645 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:49:28.645 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2024-04-26T23:49:28.645 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:49:28.645 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2024-04-26T23:49:28.645 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2024-04-26T23:49:28.645 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-04-26T23:49:28.645 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-04-26T23:49:28.645 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:49:28.645 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-04-26T23:49:28.645 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2024-04-26T23:49:28.645 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:49:28.646 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:49:28.646 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:49:28.646 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-04-26T23:49:28.646 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2024-04-26T23:49:28.646 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:49:28.646 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:49:28.646 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:49:28.646 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:49:28.646 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2024-04-26T23:49:28.646 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2024-04-26T23:49:28.646 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-04-26T23:49:28.646 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-04-26T23:49:28.646 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-04-26T23:49:28.646 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:49:28.646 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:49:28.647 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2024-04-26T23:49:28.647 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2024-04-26T23:49:28.647 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-04-26T23:49:28.647 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-04-26T23:49:28.647 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:49:28.647 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-04-26T23:49:28.647 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:3300", 2024-04-26T23:49:28.647 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:49:28.647 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:49:28.647 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:49:28.647 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-04-26T23:49:28.647 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6789", 2024-04-26T23:49:28.647 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:49:28.647 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:49:28.647 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:49:28.648 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:49:28.648 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6789/0", 2024-04-26T23:49:28.648 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.175:6789/0", 2024-04-26T23:49:28.648 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-04-26T23:49:28.648 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-04-26T23:49:28.648 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-04-26T23:49:28.648 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:49:28.648 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:49:28.648 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2024-04-26T23:49:28.648 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2024-04-26T23:49:28.648 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-04-26T23:49:28.648 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-04-26T23:49:28.648 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:49:28.648 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-04-26T23:49:28.648 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:3301", 2024-04-26T23:49:28.649 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:49:28.649 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:49:28.649 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:49:28.649 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-04-26T23:49:28.649 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6790", 2024-04-26T23:49:28.649 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:49:28.649 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:49:28.649 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:49:28.649 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:49:28.649 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6790/0", 2024-04-26T23:49:28.649 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.175:6790/0", 2024-04-26T23:49:28.649 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-04-26T23:49:28.649 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-04-26T23:49:28.649 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-04-26T23:49:28.650 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:49:28.650 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:49:28.650 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:49:28.650 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2024-04-26T23:49:28.650 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2024-04-26T23:49:28.650 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:49:28.650 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:49:28.650 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:49:28.650 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2024-04-26T23:49:28.650 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:49:28.650 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:49:28.650 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2024-04-26T23:49:28.650 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:49:28.650 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:49:28.651 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:49:28.651 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2024-04-26T23:49:28.651 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:49:28.651 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:49:28.651 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:49:28.651 INFO:teuthology.orchestra.run.smithi088.stdout: "stretch_mode": false 2024-04-26T23:49:28.651 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-04-26T23:49:28.652 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:28.635+0000 7fdfee683640 1 -- 172.21.15.88:0/1131816073 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fdfd406c360 msgr2=0x7fdfd406e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:28.652 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:28.635+0000 7fdfee683640 1 --2- 172.21.15.88:0/1131816073 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fdfd406c360 0x7fdfd406e820 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fdfd800e500 tx=0x7fdfd8006000 comp rx=0 tx=0).stop 2024-04-26T23:49:28.652 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:28.635+0000 7fdfecc20640 1 -- 172.21.15.88:0/1131816073 reap_dead start 2024-04-26T23:49:28.652 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:28.636+0000 7fdfee683640 1 -- 172.21.15.88:0/1131816073 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdfe80ac710 msgr2=0x7fdfe806d860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:28.652 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:28.636+0000 7fdfee683640 1 --2- 172.21.15.88:0/1131816073 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdfe80ac710 0x7fdfe806d860 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fdfe0007e30 tx=0x7fdfe000e4b0 comp rx=0 tx=0).stop 2024-04-26T23:49:28.652 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:28.637+0000 7fdfee683640 1 -- 172.21.15.88:0/1131816073 shutdown_connections 2024-04-26T23:49:28.653 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:28.637+0000 7fdfee683640 1 --2- 172.21.15.88:0/1131816073 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdfe80ac710 0x7fdfe806d860 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:28.653 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:28.637+0000 7fdfee683640 1 -- 172.21.15.88:0/1131816073 >> 172.21.15.88:0/1131816073 conn(0x7fdfe80c6d80 msgr2=0x7fdfe80c7160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:49:28.653 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:28.638+0000 7fdfee683640 1 -- 172.21.15.88:0/1131816073 shutdown_connections 2024-04-26T23:49:28.653 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:28.640+0000 7fdfee683640 1 -- 172.21.15.88:0/1131816073 wait complete. 2024-04-26T23:49:28.666 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-04-26T23:49:28.666 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-04-26T23:49:28.666 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-04-26T23:49:28.826 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:28.821+0000 7f3ec37c9640 1 Processor -- start 2024-04-26T23:49:28.826 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:28.821+0000 7f3ec37c9640 1 -- start start 2024-04-26T23:49:28.827 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:28.822+0000 7f3ec37c9640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3ebc0c4fd0 0x7f3ebc0c4270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:28.827 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:28.822+0000 7f3ec37c9640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f3ebc0c47b0 0x7f3ebc151d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:28.827 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:28.822+0000 7f3ec37c9640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3ebc1583c0 con 0x7f3ebc0722c0 2024-04-26T23:49:28.828 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:28.822+0000 7f3ec37c9640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f3ebc158170 con 0x7f3ebc0c47b0 2024-04-26T23:49:28.828 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:28.822+0000 7f3ec37c9640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f3ebc158cf0 con 0x7f3ebc0c4fd0 2024-04-26T23:49:28.828 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:28.823+0000 7f3ec1d66640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f3ebc0722c0 0x7f3ebc1522d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:60936/0 (socket says 172.21.15.88:60936) 2024-04-26T23:49:28.828 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:28.823+0000 7f3ec1d66640 1 -- 172.21.15.88:0/665452099 learned_addr learned my addr 172.21.15.88:0/665452099 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-26T23:49:28.828 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:28.823+0000 7f3ec1565640 1 --2- 172.21.15.88:0/665452099 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3ebc0c4fd0 0x7f3ebc0c4270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:28.828 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:28.823+0000 7f3ec0d64640 1 --2- 172.21.15.88:0/665452099 >> v2:172.21.15.88:3300/0 conn(0x7f3ebc0c47b0 0x7f3ebc151d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:28.828 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:28.823+0000 7f3ec1565640 1 -- 172.21.15.88:0/665452099 >> v2:172.21.15.88:3300/0 conn(0x7f3ebc0c47b0 msgr2=0x7f3ebc151d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:49:28.829 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:28.824+0000 7f3ec1565640 1 --2- 172.21.15.88:0/665452099 >> v2:172.21.15.88:3300/0 conn(0x7f3ebc0c47b0 0x7f3ebc151d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:28.829 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:28.824+0000 7f3ec1565640 1 -- 172.21.15.88:0/665452099 >> v1:172.21.15.88:6789/0 conn(0x7f3ebc0722c0 legacy=0x7f3ebc1522d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:28.829 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:28.824+0000 7f3ec1565640 1 -- 172.21.15.88:0/665452099 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ebc1586a0 con 0x7f3ebc0c4fd0 2024-04-26T23:49:28.829 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:28.825+0000 7f3ec0d64640 1 --2- 172.21.15.88:0/665452099 >> v2:172.21.15.88:3300/0 conn(0x7f3ebc0c47b0 0x7f3ebc151d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:49:28.829 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:28.825+0000 7f3ec1565640 1 --2- 172.21.15.88:0/665452099 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3ebc0c4fd0 0x7f3ebc0c4270 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f3eb4009d90 tx=0x7f3eb402a570 comp rx=0 tx=0).ready entity=mon.2 client_cookie=831aefac2e709dbe server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:49:28.832 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:28.828+0000 7f3eb3fff640 1 -- 172.21.15.88:0/665452099 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3eb4007740 con 0x7f3ebc0c4fd0 2024-04-26T23:49:28.832 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:28.828+0000 7f3eb3fff640 1 -- 172.21.15.88:0/665452099 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3eb40078e0 con 0x7f3ebc0c4fd0 2024-04-26T23:49:28.834 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:28.829+0000 7f3ec37c9640 1 -- 172.21.15.88:0/665452099 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3ebc0c4fd0 msgr2=0x7f3ebc0c4270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:28.834 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:28.829+0000 7f3ec37c9640 1 --2- 172.21.15.88:0/665452099 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3ebc0c4fd0 0x7f3ebc0c4270 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f3eb4009d90 tx=0x7f3eb402a570 comp rx=0 tx=0).stop 2024-04-26T23:49:28.834 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:28.829+0000 7f3ec37c9640 1 -- 172.21.15.88:0/665452099 shutdown_connections 2024-04-26T23:49:28.834 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:28.829+0000 7f3ec37c9640 1 --2- 172.21.15.88:0/665452099 >> v2:172.21.15.88:3300/0 conn(0x7f3ebc0c47b0 0x7f3ebc151d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:28.834 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:28.829+0000 7f3ec37c9640 1 --2- 172.21.15.88:0/665452099 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3ebc0c4fd0 0x7f3ebc0c4270 secure :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f3eb4009d90 tx=0x7f3eb402a570 comp rx=0 tx=0).stop 2024-04-26T23:49:28.834 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:28.829+0000 7f3ec37c9640 1 -- 172.21.15.88:0/665452099 >> 172.21.15.88:0/665452099 conn(0x7f3ebc06c310 msgr2=0x7f3ebc06c6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:49:28.835 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:28.830+0000 7f3ec37c9640 1 -- 172.21.15.88:0/665452099 shutdown_connections 2024-04-26T23:49:28.836 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:28.830+0000 7f3ec37c9640 1 -- 172.21.15.88:0/665452099 wait complete. 2024-04-26T23:49:28.836 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:28.831+0000 7f3ec37c9640 1 Processor -- start 2024-04-26T23:49:28.837 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:28.832+0000 7f3ec37c9640 1 -- start start 2024-04-26T23:49:28.838 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:28.833+0000 7f3ec37c9640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3ebc0722c0 0x7f3ebc0c5ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:28.838 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:28.833+0000 7f3ec37c9640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3ebc0c47b0 0x7f3ebc0accc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:28.838 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:28.833+0000 7f3ec37c9640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3ebc1521e0 0x7f3ebc1f5d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:28.838 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:28.834+0000 7f3ec0d64640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3ebc0c47b0 0x7f3ebc0accc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:28.838 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:28.834+0000 7f3ec0d64640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3ebc0c47b0 0x7f3ebc0accc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:40756/0 (socket says 172.21.15.88:40756) 2024-04-26T23:49:28.838 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:28.834+0000 7f3ec37c9640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f3ebc0c5530 con 0x7f3ebc0c47b0 2024-04-26T23:49:28.838 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:28.834+0000 7f3ec0d64640 1 -- 172.21.15.88:0/197099568 learned_addr learned my addr 172.21.15.88:0/197099568 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:49:28.839 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:28.834+0000 7f3ec37c9640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f3ebc0c53b0 con 0x7f3ebc0722c0 2024-04-26T23:49:28.839 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:28.834+0000 7f3ec37c9640 1 -- 172.21.15.88:0/197099568 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f3ebc154c00 con 0x7f3ebc1521e0 2024-04-26T23:49:28.839 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:28.834+0000 7f3ec0d64640 1 -- 172.21.15.88:0/197099568 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3ebc1521e0 msgr2=0x7f3ebc1f5d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:28.839 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:28.834+0000 7f3ec0d64640 1 --2- 172.21.15.88:0/197099568 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3ebc1521e0 0x7f3ebc1f5d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:28.840 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:28.834+0000 7f3ec0d64640 1 -- 172.21.15.88:0/197099568 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3ebc0722c0 msgr2=0x7f3ebc0c5ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:28.840 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:28.834+0000 7f3ec0d64640 1 --2- 172.21.15.88:0/197099568 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3ebc0722c0 0x7f3ebc0c5ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:28.840 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:28.834+0000 7f3ec0d64640 1 -- 172.21.15.88:0/197099568 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ebc0c36b0 con 0x7f3ebc0c47b0 2024-04-26T23:49:28.840 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:28.835+0000 7f3ec0d64640 1 --2- 172.21.15.88:0/197099568 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3ebc0c47b0 0x7f3ebc0accc0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f3eb800ebe0 tx=0x7f3eb800c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:49:28.840 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:28.835+0000 7f3eb1ffb640 1 -- 172.21.15.88:0/197099568 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3eb8017070 con 0x7f3ebc0c47b0 2024-04-26T23:49:28.840 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:28.835+0000 7f3eb1ffb640 1 -- 172.21.15.88:0/197099568 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3eb800ed90 con 0x7f3ebc0c47b0 2024-04-26T23:49:28.840 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:28.835+0000 7f3eb1ffb640 1 -- 172.21.15.88:0/197099568 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3eb800ce30 con 0x7f3ebc0c47b0 2024-04-26T23:49:28.840 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:28.835+0000 7f3ec37c9640 1 -- 172.21.15.88:0/197099568 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ebc14f000 con 0x7f3ebc0c47b0 2024-04-26T23:49:28.841 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:28.835+0000 7f3ec37c9640 1 -- 172.21.15.88:0/197099568 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ebc0ad200 con 0x7f3ebc0c47b0 2024-04-26T23:49:28.842 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:28.837+0000 7f3ec37c9640 1 --2- 172.21.15.88:0/197099568 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3e9c002a70 0x7f3e9c004f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:28.842 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:28.837+0000 7f3ec37c9640 1 -- 172.21.15.88:0/197099568 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f3e9c007ec0 con 0x7f3e9c002a70 2024-04-26T23:49:28.844 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:28.839+0000 7f3eb1ffb640 1 -- 172.21.15.88:0/197099568 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f3eb801a070 con 0x7f3ebc0c47b0 2024-04-26T23:49:28.844 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:28.839+0000 7f3eb1ffb640 1 --2- 172.21.15.88:0/197099568 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f3ea006c9c0 0x7f3ea006ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:28.844 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:28.839+0000 7f3ec1565640 1 --2- 172.21.15.88:0/197099568 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3e9c002a70 0x7f3e9c004f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:28.844 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:28.839+0000 7f3eb1ffb640 1 -- 172.21.15.88:0/197099568 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6666+0+0 (secure 0 0 0) 0x7f3eb808c020 con 0x7f3ebc0c47b0 2024-04-26T23:49:28.845 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:28.840+0000 7f3ec1d66640 1 --2- 172.21.15.88:0/197099568 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f3ea006c9c0 0x7f3ea006ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:28.845 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:28.840+0000 7f3ec1565640 1 -- 172.21.15.88:0/197099568 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3e9c0080c0 con 0x7f3e9c002a70 2024-04-26T23:49:28.846 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:28.841+0000 7f3ec1d66640 1 --2- 172.21.15.88:0/197099568 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f3ea006c9c0 0x7f3ea006ee80 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f3eac007fd0 tx=0x7f3eac007a20 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:49:28.846 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:28.841+0000 7f3ec1565640 1 --2- 172.21.15.88:0/197099568 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3e9c002a70 0x7f3e9c004f30 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f3ebc069060 tx=0x7f3eb4009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:49:28.846 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:28.841+0000 7f3eb1ffb640 1 -- 172.21.15.88:0/197099568 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3eb403f070 con 0x7f3e9c002a70 2024-04-26T23:49:28.847 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:28.842+0000 7f3eb1ffb640 1 -- 172.21.15.88:0/197099568 <== mon.1 v2:172.21.15.175:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f3eb403b820 con 0x7f3e9c002a70 2024-04-26T23:49:28.847 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:28.842+0000 7f3eb1ffb640 1 -- 172.21.15.88:0/197099568 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3e9c002a70 msgr2=0x7f3e9c004f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:28.847 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:28.842+0000 7f3eb1ffb640 1 --2- 172.21.15.88:0/197099568 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3e9c002a70 0x7f3e9c004f30 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f3ebc069060 tx=0x7f3eb4009b80 comp rx=0 tx=0).stop 2024-04-26T23:49:28.847 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:28.842+0000 7f3eb1ffb640 1 -- 172.21.15.88:0/197099568 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3e9c002a70 msgr2=0x7f3e9c004f30 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:49:28.847 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:28.842+0000 7f3eb1ffb640 1 --2- 172.21.15.88:0/197099568 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3e9c002a70 0x7f3e9c004f30 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:28.860 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:28.855+0000 7f3ec37c9640 1 --2- 172.21.15.88:0/197099568 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3e9c006f40 0x7f3e9c0073d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:28.860 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:28.855+0000 7f3ec37c9640 1 -- 172.21.15.88:0/197099568 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f3e9c00a4a0 con 0x7f3e9c006f40 2024-04-26T23:49:28.860 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:28.856+0000 7f3ec1565640 1 --2- 172.21.15.88:0/197099568 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3e9c006f40 0x7f3e9c0073d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:28.861 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:28.857+0000 7f3ec1565640 1 -- 172.21.15.88:0/197099568 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f3e9c007910 con 0x7f3e9c006f40 2024-04-26T23:49:28.861 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:28.857+0000 7f3ec1565640 1 --2- 172.21.15.88:0/197099568 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3e9c006f40 0x7f3e9c0073d0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f3eb402a5b0 tx=0x7f3eb4030000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:49:28.862 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:28.857+0000 7f3eb1ffb640 1 -- 172.21.15.88:0/197099568 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3eb4004040 con 0x7f3e9c006f40 2024-04-26T23:49:28.862 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:28.858+0000 7f3eb1ffb640 1 -- 172.21.15.88:0/197099568 <== mon.1 v2:172.21.15.175:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4554 (secure 0 0 0) 0x7f3eb4049570 con 0x7f3e9c006f40 2024-04-26T23:49:28.862 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:28.858+0000 7f3eb1ffb640 1 -- 172.21.15.88:0/197099568 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3e9c006f40 msgr2=0x7f3e9c0073d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:28.862 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:28.858+0000 7f3eb1ffb640 1 --2- 172.21.15.88:0/197099568 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3e9c006f40 0x7f3e9c0073d0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f3eb402a5b0 tx=0x7f3eb4030000 comp rx=0 tx=0).stop 2024-04-26T23:49:28.862 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:28.858+0000 7f3eb1ffb640 1 -- 172.21.15.88:0/197099568 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3e9c006f40 msgr2=0x7f3e9c0073d0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:49:28.862 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:28.858+0000 7f3eb1ffb640 1 --2- 172.21.15.88:0/197099568 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3e9c006f40 0x7f3e9c0073d0 secure :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f3eb402a5b0 tx=0x7f3eb4030000 comp rx=0 tx=0).stop 2024-04-26T23:49:28.865 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-04-26T23:49:28.865 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2024-04-26T23:49:28.865 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2024-04-26T23:49:28.865 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "peon", 2024-04-26T23:49:28.865 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 84, 2024-04-26T23:49:28.865 INFO:teuthology.orchestra.run.smithi088.stdout: "uptime": 78408, 2024-04-26T23:49:28.865 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2024-04-26T23:49:28.866 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2024-04-26T23:49:28.866 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2024-04-26T23:49:28.866 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2024-04-26T23:49:28.866 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:49:28.866 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 1, 2024-04-26T23:49:28.866 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2024-04-26T23:49:28.866 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2450521708007866372", 2024-04-26T23:49:28.866 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2024-04-26T23:49:28.866 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-04-26T23:49:28.866 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-04-26T23:49:28.866 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-04-26T23:49:28.866 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-04-26T23:49:28.866 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-04-26T23:49:28.866 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-04-26T23:49:28.867 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-04-26T23:49:28.867 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-04-26T23:49:28.867 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-04-26T23:49:28.867 INFO:teuthology.orchestra.run.smithi088.stdout: "reef", 2024-04-26T23:49:28.867 INFO:teuthology.orchestra.run.smithi088.stdout: "squid" 2024-04-26T23:49:28.867 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:49:28.867 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540701547738038271", 2024-04-26T23:49:28.867 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2024-04-26T23:49:28.867 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-04-26T23:49:28.867 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-04-26T23:49:28.867 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-04-26T23:49:28.867 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-04-26T23:49:28.867 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-04-26T23:49:28.867 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-04-26T23:49:28.867 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-04-26T23:49:28.868 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-04-26T23:49:28.868 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-04-26T23:49:28.868 INFO:teuthology.orchestra.run.smithi088.stdout: "reef", 2024-04-26T23:49:28.868 INFO:teuthology.orchestra.run.smithi088.stdout: "squid" 2024-04-26T23:49:28.868 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:49:28.868 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:49:28.868 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2024-04-26T23:49:28.868 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2024-04-26T23:49:28.868 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2024-04-26T23:49:28.868 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2024-04-26T23:49:28.868 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2024-04-26T23:49:28.868 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "555255e9-7ef9-4454-8dc9-35e96b70035c", 2024-04-26T23:49:28.868 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2024-04-26T23:39:34.291658Z", 2024-04-26T23:49:28.868 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2024-04-26T23:39:34.291658Z", 2024-04-26T23:49:28.869 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 19, 2024-04-26T23:49:28.869 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "squid", 2024-04-26T23:49:28.869 INFO:teuthology.orchestra.run.smithi088.stdout: "election_strategy": 1, 2024-04-26T23:49:28.869 INFO:teuthology.orchestra.run.smithi088.stdout: "disallowed_leaders: ": "", 2024-04-26T23:49:28.869 INFO:teuthology.orchestra.run.smithi088.stdout: "stretch_mode": false, 2024-04-26T23:49:28.869 INFO:teuthology.orchestra.run.smithi088.stdout: "tiebreaker_mon": "", 2024-04-26T23:49:28.869 INFO:teuthology.orchestra.run.smithi088.stdout: "removed_ranks: ": "", 2024-04-26T23:49:28.869 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2024-04-26T23:49:28.869 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2024-04-26T23:49:28.869 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-04-26T23:49:28.869 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-04-26T23:49:28.869 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-04-26T23:49:28.869 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-04-26T23:49:28.869 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-04-26T23:49:28.869 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-04-26T23:49:28.869 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-04-26T23:49:28.870 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-04-26T23:49:28.870 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-04-26T23:49:28.870 INFO:teuthology.orchestra.run.smithi088.stdout: "reef", 2024-04-26T23:49:28.870 INFO:teuthology.orchestra.run.smithi088.stdout: "squid" 2024-04-26T23:49:28.870 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:49:28.870 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2024-04-26T23:49:28.870 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:49:28.870 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2024-04-26T23:49:28.870 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:49:28.870 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2024-04-26T23:49:28.870 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2024-04-26T23:49:28.870 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-04-26T23:49:28.870 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-04-26T23:49:28.870 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:49:28.870 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-04-26T23:49:28.871 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2024-04-26T23:49:28.871 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:49:28.871 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:49:28.871 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:49:28.871 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-04-26T23:49:28.871 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2024-04-26T23:49:28.871 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:49:28.871 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:49:28.871 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:49:28.871 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:49:28.871 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2024-04-26T23:49:28.871 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2024-04-26T23:49:28.871 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-04-26T23:49:28.871 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-04-26T23:49:28.871 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-04-26T23:49:28.872 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:49:28.872 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:49:28.872 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2024-04-26T23:49:28.872 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2024-04-26T23:49:28.872 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-04-26T23:49:28.872 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-04-26T23:49:28.872 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:49:28.872 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-04-26T23:49:28.872 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:3300", 2024-04-26T23:49:28.872 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:49:28.872 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:49:28.872 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:49:28.872 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-04-26T23:49:28.872 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6789", 2024-04-26T23:49:28.872 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:49:28.873 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:49:28.873 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:49:28.873 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:49:28.873 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6789/0", 2024-04-26T23:49:28.873 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.175:6789/0", 2024-04-26T23:49:28.873 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-04-26T23:49:28.873 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-04-26T23:49:28.873 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-04-26T23:49:28.873 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:49:28.873 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:49:28.873 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2024-04-26T23:49:28.873 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2024-04-26T23:49:28.873 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-04-26T23:49:28.873 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-04-26T23:49:28.874 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:49:28.874 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-04-26T23:49:28.874 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:3301", 2024-04-26T23:49:28.874 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:49:28.874 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:49:28.874 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:49:28.874 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-04-26T23:49:28.874 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6790", 2024-04-26T23:49:28.874 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:49:28.874 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:49:28.875 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:49:28.875 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:49:28.875 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6790/0", 2024-04-26T23:49:28.875 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.175:6790/0", 2024-04-26T23:49:28.875 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-04-26T23:49:28.875 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-04-26T23:49:28.875 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-04-26T23:49:28.875 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:49:28.875 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:49:28.875 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:49:28.875 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2024-04-26T23:49:28.875 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2024-04-26T23:49:28.875 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:49:28.875 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:49:28.875 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:49:28.876 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2024-04-26T23:49:28.876 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:49:28.876 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:49:28.876 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2024-04-26T23:49:28.876 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:49:28.876 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:49:28.876 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:49:28.876 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2024-04-26T23:49:28.876 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:49:28.876 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:49:28.877 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:49:28.877 INFO:teuthology.orchestra.run.smithi088.stdout: "stretch_mode": false 2024-04-26T23:49:28.877 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-04-26T23:49:28.877 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:28.861+0000 7f3ec37c9640 1 -- 172.21.15.88:0/197099568 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f3ea006c9c0 msgr2=0x7f3ea006ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:28.878 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:28.861+0000 7f3ec37c9640 1 --2- 172.21.15.88:0/197099568 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f3ea006c9c0 0x7f3ea006ee80 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f3eac007fd0 tx=0x7f3eac007a20 comp rx=0 tx=0).stop 2024-04-26T23:49:28.878 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:28.862+0000 7f3ec1d66640 1 -- 172.21.15.88:0/197099568 reap_dead start 2024-04-26T23:49:28.878 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:28.862+0000 7f3ec37c9640 1 -- 172.21.15.88:0/197099568 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3ebc0c47b0 msgr2=0x7f3ebc0accc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:28.878 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:28.862+0000 7f3ec37c9640 1 --2- 172.21.15.88:0/197099568 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3ebc0c47b0 0x7f3ebc0accc0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f3eb800ebe0 tx=0x7f3eb800c520 comp rx=0 tx=0).stop 2024-04-26T23:49:28.878 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:28.862+0000 7f3ec37c9640 1 -- 172.21.15.88:0/197099568 shutdown_connections 2024-04-26T23:49:28.878 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:28.862+0000 7f3ec37c9640 1 --2- 172.21.15.88:0/197099568 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3ebc0c47b0 0x7f3ebc0accc0 secure :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f3eb800ebe0 tx=0x7f3eb800c520 comp rx=0 tx=0).stop 2024-04-26T23:49:28.878 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:28.862+0000 7f3ec37c9640 1 -- 172.21.15.88:0/197099568 >> 172.21.15.88:0/197099568 conn(0x7f3ebc06c310 msgr2=0x7f3ebc152a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:49:28.878 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:28.865+0000 7f3ec37c9640 1 -- 172.21.15.88:0/197099568 shutdown_connections 2024-04-26T23:49:28.878 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:28.866+0000 7f3ec37c9640 1 -- 172.21.15.88:0/197099568 wait complete. 2024-04-26T23:49:28.889 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-04-26T23:49:28.890 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-04-26T23:49:28.890 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-04-26T23:49:29.046 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:29.042+0000 7f49fac9a640 1 Processor -- start 2024-04-26T23:49:29.048 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:29.043+0000 7f49fac9a640 1 -- start start 2024-04-26T23:49:29.050 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:29.045+0000 7f49fac9a640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f49f415b940 0x7f49f40c3230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:29.050 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:29.045+0000 7f49fac9a640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f49f40aa7c0 0x7f49f40c3770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:29.051 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:29.045+0000 7f49fac9a640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f49f406dec0 con 0x7f49f40c3cb0 2024-04-26T23:49:29.051 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:29.045+0000 7f49fac9a640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f49f40c2ac0 con 0x7f49f40aa7c0 2024-04-26T23:49:29.051 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:29.045+0000 7f49fac9a640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f49f406e1a0 con 0x7f49f415b940 2024-04-26T23:49:29.051 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:29.045+0000 7f49f9c98640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f49f415b940 0x7f49f40c3230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:29.051 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:29.045+0000 7f49fa499640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f49f40c3cb0 0x7f49f40abdc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:60940/0 (socket says 172.21.15.88:60940) 2024-04-26T23:49:29.051 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:29.045+0000 7f49fa499640 1 -- 172.21.15.88:0/3547695381 learned_addr learned my addr 172.21.15.88:0/3547695381 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-26T23:49:29.051 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:29.046+0000 7f49f8c96640 1 -- 172.21.15.88:0/3547695381 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3525327789 0 0) 0x7f49f406dec0 con 0x7f49f40c3cb0 2024-04-26T23:49:29.051 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:29.046+0000 7f49f9c98640 1 -- 172.21.15.88:0/3547695381 >> v2:172.21.15.88:3300/0 conn(0x7f49f40aa7c0 msgr2=0x7f49f40c3770 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T23:49:29.052 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:29.046+0000 7f49f9c98640 1 --2- 172.21.15.88:0/3547695381 >> v2:172.21.15.88:3300/0 conn(0x7f49f40aa7c0 0x7f49f40c3770 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:29.052 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:29.046+0000 7f49f9c98640 1 -- 172.21.15.88:0/3547695381 >> v1:172.21.15.88:6789/0 conn(0x7f49f40c3cb0 legacy=0x7f49f40abdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:29.052 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:29.046+0000 7f49f9c98640 1 -- 172.21.15.88:0/3547695381 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49f406e480 con 0x7f49f415b940 2024-04-26T23:49:29.052 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:29.047+0000 7f49f9c98640 1 --2- 172.21.15.88:0/3547695381 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f49f415b940 0x7f49f40c3230 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f49e40097a0 tx=0x7f49e402a110 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3f0dc4b945a68e19 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:49:29.052 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:29.048+0000 7f49f8c96640 1 -- 172.21.15.88:0/3547695381 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49e4037070 con 0x7f49f415b940 2024-04-26T23:49:29.052 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:29.048+0000 7f49f8c96640 1 -- 172.21.15.88:0/3547695381 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49e4032440 con 0x7f49f415b940 2024-04-26T23:49:29.052 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:29.048+0000 7f49f8c96640 1 -- 172.21.15.88:0/3547695381 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49e402ae60 con 0x7f49f415b940 2024-04-26T23:49:29.054 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:29.049+0000 7f49fac9a640 1 -- 172.21.15.88:0/3547695381 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f49f415b940 msgr2=0x7f49f40c3230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:29.054 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:29.049+0000 7f49fac9a640 1 --2- 172.21.15.88:0/3547695381 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f49f415b940 0x7f49f40c3230 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f49e40097a0 tx=0x7f49e402a110 comp rx=0 tx=0).stop 2024-04-26T23:49:29.054 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:29.049+0000 7f49fac9a640 1 -- 172.21.15.88:0/3547695381 shutdown_connections 2024-04-26T23:49:29.054 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:29.049+0000 7f49fac9a640 1 --2- 172.21.15.88:0/3547695381 >> v2:172.21.15.88:3300/0 conn(0x7f49f40aa7c0 0x7f49f40c3770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:29.054 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:29.049+0000 7f49fac9a640 1 --2- 172.21.15.88:0/3547695381 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f49f415b940 0x7f49f40c3230 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:29.054 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:29.049+0000 7f49fac9a640 1 -- 172.21.15.88:0/3547695381 >> 172.21.15.88:0/3547695381 conn(0x7f49f40c80c0 msgr2=0x7f49f40c84a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:49:29.054 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:29.049+0000 7f49fac9a640 1 -- 172.21.15.88:0/3547695381 shutdown_connections 2024-04-26T23:49:29.054 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:29.049+0000 7f49fac9a640 1 -- 172.21.15.88:0/3547695381 wait complete. 2024-04-26T23:49:29.055 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:29.050+0000 7f49fac9a640 1 Processor -- start 2024-04-26T23:49:29.055 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:29.050+0000 7f49fac9a640 1 -- start start 2024-04-26T23:49:29.057 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:29.051+0000 7f49fac9a640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f49f40aa7c0 0x7f49f41e7d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:29.057 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:29.051+0000 7f49fac9a640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f49f40c3cb0 0x7f49f4071b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:29.058 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:29.051+0000 7f49fac9a640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f49f415b940 0x7f49f415d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:29.058 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:29.051+0000 7f49f9c98640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f49f40aa7c0 0x7f49f41e7d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:29.058 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:29.051+0000 7f49f9c98640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f49f40aa7c0 0x7f49f41e7d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:40758/0 (socket says 172.21.15.88:40758) 2024-04-26T23:49:29.058 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:29.051+0000 7f49f9c98640 1 -- 172.21.15.88:0/260057922 learned_addr learned my addr 172.21.15.88:0/260057922 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:49:29.058 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:29.051+0000 7f49f9497640 1 --2- 172.21.15.88:0/260057922 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f49f40c3cb0 0x7f49f4071b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:29.058 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:29.051+0000 7f49fac9a640 1 -- 172.21.15.88:0/260057922 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f49f40ac650 con 0x7f49f40aa7c0 2024-04-26T23:49:29.058 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:29.051+0000 7f49fac9a640 1 -- 172.21.15.88:0/260057922 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f49f40ac4d0 con 0x7f49f40c3cb0 2024-04-26T23:49:29.058 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:29.051+0000 7f49fac9a640 1 -- 172.21.15.88:0/260057922 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f49f40ac7d0 con 0x7f49f415b940 2024-04-26T23:49:29.058 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:29.052+0000 7f49fa499640 1 --2- 172.21.15.88:0/260057922 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f49f415b940 0x7f49f415d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:29.058 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:29.052+0000 7f49f9c98640 1 -- 172.21.15.88:0/260057922 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f49f415b940 msgr2=0x7f49f415d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:29.058 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:29.052+0000 7f49f9c98640 1 --2- 172.21.15.88:0/260057922 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f49f415b940 0x7f49f415d270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:29.058 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:29.052+0000 7f49f9c98640 1 -- 172.21.15.88:0/260057922 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f49f40c3cb0 msgr2=0x7f49f4071b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:29.059 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:29.052+0000 7f49f9c98640 1 --2- 172.21.15.88:0/260057922 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f49f40c3cb0 0x7f49f4071b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:29.059 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:29.052+0000 7f49f9c98640 1 -- 172.21.15.88:0/260057922 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49f40745b0 con 0x7f49f40aa7c0 2024-04-26T23:49:29.059 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:29.052+0000 7f49fa499640 1 --2- 172.21.15.88:0/260057922 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f49f415b940 0x7f49f415d270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:49:29.059 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:29.052+0000 7f49f9c98640 1 --2- 172.21.15.88:0/260057922 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f49f40aa7c0 0x7f49f41e7d70 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f49e40098c0 tx=0x7f49e40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:49:29.059 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:29.052+0000 7f49ea7fc640 1 -- 172.21.15.88:0/260057922 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49e4042020 con 0x7f49f40aa7c0 2024-04-26T23:49:29.059 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:29.053+0000 7f49fac9a640 1 -- 172.21.15.88:0/260057922 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49f40735d0 con 0x7f49f40aa7c0 2024-04-26T23:49:29.059 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:29.053+0000 7f49fac9a640 1 -- 172.21.15.88:0/260057922 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49f4073b90 con 0x7f49f40aa7c0 2024-04-26T23:49:29.059 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:29.053+0000 7f49ea7fc640 1 -- 172.21.15.88:0/260057922 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49e4032440 con 0x7f49f40aa7c0 2024-04-26T23:49:29.059 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:29.053+0000 7f49ea7fc640 1 -- 172.21.15.88:0/260057922 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49e4037040 con 0x7f49f40aa7c0 2024-04-26T23:49:29.061 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:29.054+0000 7f49fac9a640 1 --2- 172.21.15.88:0/260057922 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f49dc002a70 0x7f49dc004f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:29.061 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:29.054+0000 7f49fac9a640 1 -- 172.21.15.88:0/260057922 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f49dc007ec0 con 0x7f49dc002a70 2024-04-26T23:49:29.061 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:29.054+0000 7f49f9497640 1 --2- 172.21.15.88:0/260057922 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f49dc002a70 0x7f49dc004f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:29.061 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:29.054+0000 7f49f9497640 1 -- 172.21.15.88:0/260057922 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f49dc0080c0 con 0x7f49dc002a70 2024-04-26T23:49:29.061 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:29.054+0000 7f49ea7fc640 1 -- 172.21.15.88:0/260057922 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f49e4045020 con 0x7f49f40aa7c0 2024-04-26T23:49:29.061 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:29.054+0000 7f49f9497640 1 --2- 172.21.15.88:0/260057922 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f49dc002a70 0x7f49dc004f30 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f49f406f710 tx=0x7f49f000ec00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:49:29.061 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:29.055+0000 7f49ea7fc640 1 --2- 172.21.15.88:0/260057922 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f49d806c8f0 0x7f49d806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:29.061 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:29.055+0000 7f49ea7fc640 1 -- 172.21.15.88:0/260057922 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6666+0+0 (secure 0 0 0) 0x7f49e40aca30 con 0x7f49f40aa7c0 2024-04-26T23:49:29.061 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:29.055+0000 7f49fa499640 1 --2- 172.21.15.88:0/260057922 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f49d806c8f0 0x7f49d806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:29.061 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:29.055+0000 7f49ea7fc640 1 -- 172.21.15.88:0/260057922 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49f0017070 con 0x7f49dc002a70 2024-04-26T23:49:29.061 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:29.055+0000 7f49ea7fc640 1 -- 172.21.15.88:0/260057922 <== mon.2 v2:172.21.15.175:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f49f000c7a0 con 0x7f49dc002a70 2024-04-26T23:49:29.061 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:29.055+0000 7f49ea7fc640 1 -- 172.21.15.88:0/260057922 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f49dc002a70 msgr2=0x7f49dc004f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:29.061 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:29.055+0000 7f49ea7fc640 1 --2- 172.21.15.88:0/260057922 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f49dc002a70 0x7f49dc004f30 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f49f406f710 tx=0x7f49f000ec00 comp rx=0 tx=0).stop 2024-04-26T23:49:29.062 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:29.055+0000 7f49ea7fc640 1 -- 172.21.15.88:0/260057922 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f49dc002a70 msgr2=0x7f49dc004f30 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:49:29.062 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:29.055+0000 7f49ea7fc640 1 --2- 172.21.15.88:0/260057922 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f49dc002a70 0x7f49dc004f30 secure :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f49f406f710 tx=0x7f49f000ec00 comp rx=0 tx=0).stop 2024-04-26T23:49:29.063 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:29.056+0000 7f49fa499640 1 --2- 172.21.15.88:0/260057922 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f49d806c8f0 0x7f49d806edb0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f49f4074c50 tx=0x7f49ec001630 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:49:29.072 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:29.067+0000 7f49fac9a640 1 --2- 172.21.15.88:0/260057922 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f49dc006f00 0x7f49dc007390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:29.072 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:29.067+0000 7f49fac9a640 1 -- 172.21.15.88:0/260057922 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f49dc00a4a0 con 0x7f49dc006f00 2024-04-26T23:49:29.072 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:29.068+0000 7f49f9497640 1 --2- 172.21.15.88:0/260057922 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f49dc006f00 0x7f49dc007390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:29.073 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:29.068+0000 7f49f9497640 1 -- 172.21.15.88:0/260057922 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f49dc0078d0 con 0x7f49dc006f00 2024-04-26T23:49:29.073 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:29.068+0000 7f49f9497640 1 --2- 172.21.15.88:0/260057922 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f49dc006f00 0x7f49dc007390 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f49f406f710 tx=0x7f49f0004770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:49:29.080 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:29.071+0000 7f49ea7fc640 1 -- 172.21.15.88:0/260057922 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49f0017070 con 0x7f49dc006f00 2024-04-26T23:49:29.080 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:29.071+0000 7f49ea7fc640 1 -- 172.21.15.88:0/260057922 <== mon.2 v2:172.21.15.175:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5208 (secure 0 0 0) 0x7f49f0006310 con 0x7f49dc006f00 2024-04-26T23:49:29.081 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:29.071+0000 7f49ea7fc640 1 -- 172.21.15.88:0/260057922 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f49dc006f00 msgr2=0x7f49dc007390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:29.081 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:29.071+0000 7f49ea7fc640 1 --2- 172.21.15.88:0/260057922 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f49dc006f00 0x7f49dc007390 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f49f406f710 tx=0x7f49f0004770 comp rx=0 tx=0).stop 2024-04-26T23:49:29.081 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:29.071+0000 7f49ea7fc640 1 -- 172.21.15.88:0/260057922 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f49dc006f00 msgr2=0x7f49dc007390 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T23:49:29.081 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:29.071+0000 7f49ea7fc640 1 --2- 172.21.15.88:0/260057922 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f49dc006f00 0x7f49dc007390 secure :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f49f406f710 tx=0x7f49f0004770 comp rx=0 tx=0).stop 2024-04-26T23:49:29.081 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-04-26T23:49:29.081 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2024-04-26T23:49:29.081 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2024-04-26T23:49:29.081 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "peon", 2024-04-26T23:49:29.081 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 84, 2024-04-26T23:49:29.081 INFO:teuthology.orchestra.run.smithi088.stdout: "uptime": 337356, 2024-04-26T23:49:29.081 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2024-04-26T23:49:29.082 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2024-04-26T23:49:29.082 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2024-04-26T23:49:29.082 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2024-04-26T23:49:29.082 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:49:29.082 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 1, 2024-04-26T23:49:29.082 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2024-04-26T23:49:29.082 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2450521708007866372", 2024-04-26T23:49:29.082 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2024-04-26T23:49:29.082 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-04-26T23:49:29.082 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-04-26T23:49:29.082 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-04-26T23:49:29.082 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-04-26T23:49:29.082 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-04-26T23:49:29.083 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-04-26T23:49:29.083 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-04-26T23:49:29.083 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-04-26T23:49:29.083 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-04-26T23:49:29.083 INFO:teuthology.orchestra.run.smithi088.stdout: "reef", 2024-04-26T23:49:29.083 INFO:teuthology.orchestra.run.smithi088.stdout: "squid" 2024-04-26T23:49:29.083 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:49:29.083 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540701547738038271", 2024-04-26T23:49:29.083 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2024-04-26T23:49:29.083 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-04-26T23:49:29.083 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-04-26T23:49:29.084 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-04-26T23:49:29.084 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-04-26T23:49:29.084 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-04-26T23:49:29.084 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-04-26T23:49:29.084 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-04-26T23:49:29.084 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-04-26T23:49:29.084 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-04-26T23:49:29.084 INFO:teuthology.orchestra.run.smithi088.stdout: "reef", 2024-04-26T23:49:29.084 INFO:teuthology.orchestra.run.smithi088.stdout: "squid" 2024-04-26T23:49:29.084 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:49:29.084 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:49:29.084 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2024-04-26T23:49:29.084 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2024-04-26T23:49:29.084 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2024-04-26T23:49:29.085 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2024-04-26T23:49:29.085 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2024-04-26T23:49:29.085 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "555255e9-7ef9-4454-8dc9-35e96b70035c", 2024-04-26T23:49:29.085 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2024-04-26T23:39:34.291658Z", 2024-04-26T23:49:29.085 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2024-04-26T23:39:34.291658Z", 2024-04-26T23:49:29.085 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 19, 2024-04-26T23:49:29.085 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "squid", 2024-04-26T23:49:29.085 INFO:teuthology.orchestra.run.smithi088.stdout: "election_strategy": 1, 2024-04-26T23:49:29.085 INFO:teuthology.orchestra.run.smithi088.stdout: "disallowed_leaders: ": "", 2024-04-26T23:49:29.085 INFO:teuthology.orchestra.run.smithi088.stdout: "stretch_mode": false, 2024-04-26T23:49:29.085 INFO:teuthology.orchestra.run.smithi088.stdout: "tiebreaker_mon": "", 2024-04-26T23:49:29.085 INFO:teuthology.orchestra.run.smithi088.stdout: "removed_ranks: ": "", 2024-04-26T23:49:29.085 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2024-04-26T23:49:29.085 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2024-04-26T23:49:29.085 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-04-26T23:49:29.086 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-04-26T23:49:29.086 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-04-26T23:49:29.086 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-04-26T23:49:29.086 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-04-26T23:49:29.086 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-04-26T23:49:29.086 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-04-26T23:49:29.086 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-04-26T23:49:29.086 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-04-26T23:49:29.086 INFO:teuthology.orchestra.run.smithi088.stdout: "reef", 2024-04-26T23:49:29.086 INFO:teuthology.orchestra.run.smithi088.stdout: "squid" 2024-04-26T23:49:29.086 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:49:29.086 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2024-04-26T23:49:29.086 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:49:29.086 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2024-04-26T23:49:29.087 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:49:29.087 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2024-04-26T23:49:29.087 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2024-04-26T23:49:29.087 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-04-26T23:49:29.087 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-04-26T23:49:29.087 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:49:29.087 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-04-26T23:49:29.087 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2024-04-26T23:49:29.087 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:49:29.087 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:49:29.087 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:49:29.087 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-04-26T23:49:29.087 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2024-04-26T23:49:29.087 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:49:29.088 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:49:29.088 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:49:29.088 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:49:29.088 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2024-04-26T23:49:29.088 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2024-04-26T23:49:29.088 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-04-26T23:49:29.088 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-04-26T23:49:29.088 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-04-26T23:49:29.088 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:49:29.088 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:49:29.088 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2024-04-26T23:49:29.088 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2024-04-26T23:49:29.088 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-04-26T23:49:29.088 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-04-26T23:49:29.089 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:49:29.089 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-04-26T23:49:29.089 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:3300", 2024-04-26T23:49:29.089 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:49:29.089 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:49:29.089 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:49:29.089 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-04-26T23:49:29.089 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6789", 2024-04-26T23:49:29.089 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:49:29.089 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:49:29.089 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:49:29.089 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:49:29.089 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6789/0", 2024-04-26T23:49:29.090 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.175:6789/0", 2024-04-26T23:49:29.090 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-04-26T23:49:29.090 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-04-26T23:49:29.090 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-04-26T23:49:29.090 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:49:29.090 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:49:29.090 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2024-04-26T23:49:29.090 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2024-04-26T23:49:29.090 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-04-26T23:49:29.090 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-04-26T23:49:29.090 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:49:29.090 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-04-26T23:49:29.090 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:3301", 2024-04-26T23:49:29.090 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:49:29.091 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:49:29.091 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:49:29.091 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-04-26T23:49:29.091 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6790", 2024-04-26T23:49:29.091 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-04-26T23:49:29.091 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:49:29.091 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:49:29.091 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:49:29.091 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.175:6790/0", 2024-04-26T23:49:29.091 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.175:6790/0", 2024-04-26T23:49:29.091 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-04-26T23:49:29.091 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-04-26T23:49:29.091 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-04-26T23:49:29.091 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:49:29.092 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:49:29.092 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:49:29.092 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2024-04-26T23:49:29.092 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2024-04-26T23:49:29.092 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:49:29.092 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:49:29.092 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:49:29.092 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2024-04-26T23:49:29.092 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:49:29.092 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:49:29.092 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": [ 2024-04-26T23:49:29.092 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:49:29.092 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:49:29.092 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:49:29.092 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 4 2024-04-26T23:49:29.092 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:49:29.093 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:49:29.093 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": [ 2024-04-26T23:49:29.093 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:49:29.093 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:49:29.093 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:49:29.093 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 8 2024-04-26T23:49:29.093 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:49:29.093 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:49:29.093 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2024-04-26T23:49:29.093 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:49:29.093 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x2f018fb87aa4aafe", 2024-04-26T23:49:29.093 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:49:29.093 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2024-04-26T23:49:29.093 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:49:29.093 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:49:29.093 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:49:29.093 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:49:29.094 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 5 2024-04-26T23:49:29.094 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:49:29.094 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-04-26T23:49:29.094 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": [ 2024-04-26T23:49:29.094 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T23:49:29.094 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T23:49:29.094 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "luminous", 2024-04-26T23:49:29.094 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2024-04-26T23:49:29.094 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T23:49:29.094 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T23:49:29.094 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T23:49:29.094 INFO:teuthology.orchestra.run.smithi088.stdout: "stretch_mode": false 2024-04-26T23:49:29.094 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-04-26T23:49:29.095 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:29.077+0000 7f49d7fff640 1 -- 172.21.15.88:0/260057922 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f49d806c8f0 msgr2=0x7f49d806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:29.096 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:29.077+0000 7f49d7fff640 1 --2- 172.21.15.88:0/260057922 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f49d806c8f0 0x7f49d806edb0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f49f4074c50 tx=0x7f49ec001630 comp rx=0 tx=0).stop 2024-04-26T23:49:29.096 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:29.077+0000 7f49d7fff640 1 -- 172.21.15.88:0/260057922 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f49f40aa7c0 msgr2=0x7f49f41e7d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:29.096 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:29.077+0000 7f49d7fff640 1 --2- 172.21.15.88:0/260057922 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f49f40aa7c0 0x7f49f41e7d70 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f49e40098c0 tx=0x7f49e40046c0 comp rx=0 tx=0).stop 2024-04-26T23:49:29.096 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:29.080+0000 7f49fa499640 1 -- 172.21.15.88:0/260057922 reap_dead start 2024-04-26T23:49:29.096 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:29.080+0000 7f49fa499640 1 -- 172.21.15.88:0/260057922 reap_dead start 2024-04-26T23:49:29.096 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:29.080+0000 7f49d7fff640 1 -- 172.21.15.88:0/260057922 shutdown_connections 2024-04-26T23:49:29.096 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:29.080+0000 7f49d7fff640 1 -- 172.21.15.88:0/260057922 >> 172.21.15.88:0/260057922 conn(0x7f49f40c80c0 msgr2=0x7f49f406d2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:49:29.096 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:29.081+0000 7f49d7fff640 1 -- 172.21.15.88:0/260057922 shutdown_connections 2024-04-26T23:49:29.096 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:29.081+0000 7f49d7fff640 1 -- 172.21.15.88:0/260057922 wait complete. 2024-04-26T23:49:29.106 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-04-26T23:49:29.107 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2024-04-26T23:49:29.107 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2024-04-26T23:49:29.253 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:29.248+0000 7f89fc220640 1 Processor -- start 2024-04-26T23:49:29.253 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:29.248+0000 7f89fc220640 1 -- start start 2024-04-26T23:49:29.256 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:29.249+0000 7f89fc220640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f89f41510c0 0x7f89f4072f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:29.256 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:29.249+0000 7f89fc220640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f89f40734d0 0x7f89f406d320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:29.256 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:29.249+0000 7f89fc220640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89f40c4b50 con 0x7f89f40c4160 2024-04-26T23:49:29.256 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:29.249+0000 7f89fc220640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f89f40c50d0 con 0x7f89f40734d0 2024-04-26T23:49:29.256 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:29.249+0000 7f89fc220640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f89f41514a0 con 0x7f89f41510c0 2024-04-26T23:49:29.257 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:29.249+0000 7f89fa7bd640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f89f40c4160 0x7f89f4157070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:60956/0 (socket says 172.21.15.88:60956) 2024-04-26T23:49:29.257 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:29.249+0000 7f89fa7bd640 1 -- 172.21.15.88:0/1508777985 learned_addr learned my addr 172.21.15.88:0/1508777985 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-26T23:49:29.257 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:29.250+0000 7f89f8fba640 1 -- 172.21.15.88:0/1508777985 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 139387086 0 0) 0x7f89f40c4b50 con 0x7f89f40c4160 2024-04-26T23:49:29.257 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:29.250+0000 7f89f8fba640 1 -- 172.21.15.88:0/1508777985 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f89e0003520 con 0x7f89f40c4160 2024-04-26T23:49:29.257 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:29.250+0000 7f89f8fba640 1 -- 172.21.15.88:0/1508777985 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1790180494 0 0) 0x7f89e0003520 con 0x7f89f40c4160 2024-04-26T23:49:29.257 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:29.250+0000 7f89f8fba640 1 -- 172.21.15.88:0/1508777985 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f89f41510c0 msgr2=0x7f89f4072f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:49:29.257 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:29.250+0000 7f89f8fba640 1 --2- 172.21.15.88:0/1508777985 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f89f41510c0 0x7f89f4072f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:29.257 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:29.250+0000 7f89f8fba640 1 -- 172.21.15.88:0/1508777985 >> v2:172.21.15.175:3300/0 conn(0x7f89f40734d0 msgr2=0x7f89f406d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:49:29.257 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:29.250+0000 7f89f8fba640 1 --2- 172.21.15.88:0/1508777985 >> v2:172.21.15.175:3300/0 conn(0x7f89f40734d0 0x7f89f406d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:29.257 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:29.250+0000 7f89f8fba640 1 -- 172.21.15.88:0/1508777985 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89f4154920 con 0x7f89f40c4160 2024-04-26T23:49:29.257 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:29.250+0000 7f89f8fba640 1 -- 172.21.15.88:0/1508777985 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 356324787 0 0) 0x7f89ec0019f0 con 0x7f89f40c4160 2024-04-26T23:49:29.257 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:29.250+0000 7f89f8fba640 1 -- 172.21.15.88:0/1508777985 >> v1:172.21.15.88:6789/0 conn(0x7f89f40c4160 legacy=0x7f89f4157070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:29.257 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:29.250+0000 7f89f8fba640 1 --2- 172.21.15.88:0/1508777985 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f89e00039b0 0x7f89e0003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:29.257 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:29.250+0000 7f89f8fba640 1 --2- 172.21.15.88:0/1508777985 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f89e0004800 0x7f89e0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:29.258 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:29.250+0000 7f89f8fba640 1 --2- 172.21.15.88:0/1508777985 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f89e00053c0 0x7f89e000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:29.258 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:29.250+0000 7f89f8fba640 1 -- 172.21.15.88:0/1508777985 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f89f40c50d0 con 0x7f89e0004800 2024-04-26T23:49:29.258 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:29.250+0000 7f89f8fba640 1 -- 172.21.15.88:0/1508777985 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f89f41514a0 con 0x7f89e00053c0 2024-04-26T23:49:29.258 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:29.250+0000 7f89f8fba640 1 -- 172.21.15.88:0/1508777985 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f89e000e510 con 0x7f89e00039b0 2024-04-26T23:49:29.258 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:29.250+0000 7f89f97bb640 1 --2- 172.21.15.88:0/1508777985 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f89e0004800 0x7f89e0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:29.258 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:29.250+0000 7f89fa7bd640 1 --2- 172.21.15.88:0/1508777985 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f89e00053c0 0x7f89e000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:29.258 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:29.251+0000 7f89f97bb640 1 -- 172.21.15.88:0/1508777985 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f89e00039b0 msgr2=0x7f89e0003df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:49:29.258 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:29.251+0000 7f89f97bb640 1 --2- 172.21.15.88:0/1508777985 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f89e00039b0 0x7f89e0003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:29.258 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:29.251+0000 7f89f97bb640 1 -- 172.21.15.88:0/1508777985 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f89e00053c0 msgr2=0x7f89e000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:49:29.258 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:29.251+0000 7f89f97bb640 1 --2- 172.21.15.88:0/1508777985 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f89e00053c0 0x7f89e000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:29.258 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:29.251+0000 7f89f97bb640 1 -- 172.21.15.88:0/1508777985 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89e0003520 con 0x7f89e0004800 2024-04-26T23:49:29.258 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:29.251+0000 7f89f97bb640 1 --2- 172.21.15.88:0/1508777985 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f89e0004800 0x7f89e0004c80 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f89e4009860 tx=0x7f89e0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e419e47b2f7ae09 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:49:29.258 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:29.252+0000 7f89f8fba640 1 -- 172.21.15.88:0/1508777985 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89e4037070 con 0x7f89e0004800 2024-04-26T23:49:29.259 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:29.252+0000 7f89f8fba640 1 -- 172.21.15.88:0/1508777985 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89e402aaa0 con 0x7f89e0004800 2024-04-26T23:49:29.259 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:29.252+0000 7f89f8fba640 1 -- 172.21.15.88:0/1508777985 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89e4009460 con 0x7f89e0004800 2024-04-26T23:49:29.261 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:29.252+0000 7f89fc220640 1 -- 172.21.15.88:0/1508777985 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f89e0004800 msgr2=0x7f89e0004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:29.261 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:29.252+0000 7f89fc220640 1 --2- 172.21.15.88:0/1508777985 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f89e0004800 0x7f89e0004c80 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f89e4009860 tx=0x7f89e0005830 comp rx=0 tx=0).stop 2024-04-26T23:49:29.261 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:29.252+0000 7f89fa7bd640 1 -- 172.21.15.88:0/1508777985 reap_dead start 2024-04-26T23:49:29.261 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:29.253+0000 7f89fc220640 1 -- 172.21.15.88:0/1508777985 shutdown_connections 2024-04-26T23:49:29.261 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:29.253+0000 7f89fc220640 1 -- 172.21.15.88:0/1508777985 >> 172.21.15.88:0/1508777985 conn(0x7f89f40c5ce0 msgr2=0x7f89f40c60f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:49:29.262 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:29.253+0000 7f89fc220640 1 -- 172.21.15.88:0/1508777985 shutdown_connections 2024-04-26T23:49:29.262 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:29.253+0000 7f89fc220640 1 -- 172.21.15.88:0/1508777985 wait complete. 2024-04-26T23:49:29.262 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:29.254+0000 7f89fc220640 1 Processor -- start 2024-04-26T23:49:29.262 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:29.255+0000 7f89fc220640 1 -- start start 2024-04-26T23:49:29.262 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:29.255+0000 7f89fc220640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f89e0004800 0x7f89f41561d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:29.262 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:29.256+0000 7f89fc220640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f89f4157680 0x7f89f4142d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:29.262 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:29.256+0000 7f89fc220640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f89f4143dc0 0x7f89f4143260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:29.262 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:29.256+0000 7f89f9fbc640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f89e0004800 0x7f89f41561d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:29.262 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:29.256+0000 7f89f9fbc640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f89e0004800 0x7f89f41561d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:40780/0 (socket says 172.21.15.88:40780) 2024-04-26T23:49:29.262 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:29.256+0000 7f89f97bb640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f89f4157680 0x7f89f4142d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:29.262 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:29.256+0000 7f89f97bb640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f89f4157680 0x7f89f4142d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.88:45380/0 (socket says 172.21.15.88:45380) 2024-04-26T23:49:29.262 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:29.256+0000 7f89fa7bd640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f89f4143dc0 0x7f89f4143260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:29.262 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:29.256+0000 7f89fa7bd640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f89f4143dc0 0x7f89f4143260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.88:48028/0 (socket says 172.21.15.88:48028) 2024-04-26T23:49:29.262 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:29.256+0000 7f89f9fbc640 1 -- 172.21.15.88:0/4124553280 learned_addr learned my addr 172.21.15.88:0/4124553280 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:49:29.263 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:29.256+0000 7f89fc220640 1 -- 172.21.15.88:0/4124553280 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f89f40c5920 con 0x7f89e0004800 2024-04-26T23:49:29.263 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:29.256+0000 7f89fc220640 1 -- 172.21.15.88:0/4124553280 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f89f40c5400 con 0x7f89f4157680 2024-04-26T23:49:29.263 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:29.256+0000 7f89fc220640 1 -- 172.21.15.88:0/4124553280 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f89f406f500 con 0x7f89f4143dc0 2024-04-26T23:49:29.263 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:29.257+0000 7f89fa7bd640 1 -- 172.21.15.88:0/4124553280 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f89f4157680 msgr2=0x7f89f4142d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:29.263 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:29.257+0000 7f89fa7bd640 1 --2- 172.21.15.88:0/4124553280 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f89f4157680 0x7f89f4142d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:29.264 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:29.257+0000 7f89fa7bd640 1 -- 172.21.15.88:0/4124553280 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f89e0004800 msgr2=0x7f89f41561d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:29.264 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:29.257+0000 7f89fa7bd640 1 --2- 172.21.15.88:0/4124553280 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f89e0004800 0x7f89f41561d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:29.264 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:29.257+0000 7f89fa7bd640 1 -- 172.21.15.88:0/4124553280 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89f4143ae0 con 0x7f89f4143dc0 2024-04-26T23:49:29.264 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:29.257+0000 7f89fa7bd640 1 --2- 172.21.15.88:0/4124553280 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f89f4143dc0 0x7f89f4143260 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f89f40c6a70 tx=0x7f89ec007790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:49:29.264 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:29.258+0000 7f89ea7fc640 1 -- 172.21.15.88:0/4124553280 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89ec007ad0 con 0x7f89f4143dc0 2024-04-26T23:49:29.264 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:29.258+0000 7f89ea7fc640 1 -- 172.21.15.88:0/4124553280 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89ec00c850 con 0x7f89f4143dc0 2024-04-26T23:49:29.265 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:29.261+0000 7f89fc220640 1 -- 172.21.15.88:0/4124553280 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89f41468b0 con 0x7f89f4143dc0 2024-04-26T23:49:29.265 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:29.261+0000 7f89fc220640 1 -- 172.21.15.88:0/4124553280 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f89f4145860 con 0x7f89f4143dc0 2024-04-26T23:49:29.265 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:29.261+0000 7f89ea7fc640 1 -- 172.21.15.88:0/4124553280 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89ec00cc40 con 0x7f89f4143dc0 2024-04-26T23:49:29.268 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:29.263+0000 7f89fc220640 1 -- 172.21.15.88:0/4124553280 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f89f40507a0 con 0x7f89f4143dc0 2024-04-26T23:49:29.270 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:29.265+0000 7f89ea7fc640 1 -- 172.21.15.88:0/4124553280 <== mon.2 v2:172.21.15.175:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f89ec03e790 con 0x7f89f4143dc0 2024-04-26T23:49:29.270 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:29.266+0000 7f89ea7fc640 1 --2- 172.21.15.88:0/4124553280 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f89d806c920 0x7f89d806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:29.271 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:29.266+0000 7f89f9fbc640 1 --2- 172.21.15.88:0/4124553280 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f89d806c920 0x7f89d806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:29.271 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:29.267+0000 7f89ea7fc640 1 -- 172.21.15.88:0/4124553280 <== mon.2 v2:172.21.15.175:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6666+0+0 (secure 0 0 0) 0x7f89ec0941d0 con 0x7f89f4143dc0 2024-04-26T23:49:29.272 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:29.267+0000 7f89f9fbc640 1 --2- 172.21.15.88:0/4124553280 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f89d806c920 0x7f89d806ede0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f89f414e620 tx=0x7f89f0009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:49:29.276 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:29.272+0000 7f89ea7fc640 1 -- 172.21.15.88:0/4124553280 <== mon.2 v2:172.21.15.175:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f89ec01b070 con 0x7f89f4143dc0 2024-04-26T23:49:29.744 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:29.740+0000 7f89fc220640 1 -- 172.21.15.88:0/4124553280 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7f89f40c3ed0 con 0x7f89f4143dc0 2024-04-26T23:49:29.748 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:29.743+0000 7f89ea7fc640 1 -- 172.21.15.88:0/4124553280 <== mon.2 v2:172.21.15.175:3301/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (secure 0 0 0) 0x7f89ec061be0 con 0x7f89f4143dc0 2024-04-26T23:49:29.751 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:29.747+0000 7f89fc220640 1 -- 172.21.15.88:0/4124553280 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f89d806c920 msgr2=0x7f89d806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:29.752 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:29.747+0000 7f89fc220640 1 --2- 172.21.15.88:0/4124553280 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f89d806c920 0x7f89d806ede0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f89f414e620 tx=0x7f89f0009190 comp rx=0 tx=0).stop 2024-04-26T23:49:29.752 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:29.747+0000 7f89fc220640 1 -- 172.21.15.88:0/4124553280 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f89f4143dc0 msgr2=0x7f89f4143260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:29.752 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:29.747+0000 7f89fc220640 1 --2- 172.21.15.88:0/4124553280 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f89f4143dc0 0x7f89f4143260 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f89f40c6a70 tx=0x7f89ec007790 comp rx=0 tx=0).stop 2024-04-26T23:49:29.752 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:29.747+0000 7f89fc220640 1 -- 172.21.15.88:0/4124553280 shutdown_connections 2024-04-26T23:49:29.752 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:29.747+0000 7f89fc220640 1 --2- 172.21.15.88:0/4124553280 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f89d806c920 0x7f89d806ede0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:29.752 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:29.747+0000 7f89fc220640 1 --2- 172.21.15.88:0/4124553280 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f89f4143dc0 0x7f89f4143260 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:29.752 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:29.747+0000 7f89fc220640 1 --2- 172.21.15.88:0/4124553280 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f89f4157680 0x7f89f4142d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:29.752 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:29.747+0000 7f89fc220640 1 --2- 172.21.15.88:0/4124553280 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f89e0004800 0x7f89f41561d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:29.752 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:29.747+0000 7f89fc220640 1 -- 172.21.15.88:0/4124553280 >> 172.21.15.88:0/4124553280 conn(0x7f89f40c5ce0 msgr2=0x7f89f406fa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:49:29.752 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:29.747+0000 7f89fc220640 1 -- 172.21.15.88:0/4124553280 shutdown_connections 2024-04-26T23:49:29.752 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:29.747+0000 7f89fc220640 1 -- 172.21.15.88:0/4124553280 wait complete. 2024-04-26T23:49:29.769 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2024-04-26T23:49:30.493 INFO:tasks.workunit.client.0.smithi088.stdout:Syncing()...36 sec 2024-04-26T23:49:30.493 INFO:tasks.workunit.client.0.smithi088.stdout:FFSB benchmark finished at: Fri Apr 26 23:49:30 2024 2024-04-26T23:49:30.493 INFO:tasks.workunit.client.0.smithi088.stdout: 2024-04-26T23:49:30.493 INFO:tasks.workunit.client.0.smithi088.stdout:Results: 2024-04-26T23:49:30.493 INFO:tasks.workunit.client.0.smithi088.stdout:Benchmark took 345.48 sec 2024-04-26T23:49:30.493 INFO:tasks.workunit.client.0.smithi088.stdout: 2024-04-26T23:49:30.493 INFO:tasks.workunit.client.0.smithi088.stdout:Total Results 2024-04-26T23:49:30.494 INFO:tasks.workunit.client.0.smithi088.stdout:=============== 2024-04-26T23:49:30.494 INFO:tasks.workunit.client.0.smithi088.stdout: Op Name Transactions Trans/sec % Trans % Op Weight Throughput 2024-04-26T23:49:30.494 INFO:tasks.workunit.client.0.smithi088.stdout: ======= ============ ========= ======= =========== ========== 2024-04-26T23:49:30.494 INFO:tasks.workunit.client.0.smithi088.stdout: write : 15398400 44571.30 100.000% 100.000% 174MB/sec 2024-04-26T23:49:30.494 INFO:tasks.workunit.client.0.smithi088.stdout:- 2024-04-26T23:49:30.494 INFO:tasks.workunit.client.0.smithi088.stdout:44571.30 Transactions per Second 2024-04-26T23:49:30.494 INFO:tasks.workunit.client.0.smithi088.stdout: 2024-04-26T23:49:30.494 INFO:tasks.workunit.client.0.smithi088.stdout:Throughput Results 2024-04-26T23:49:30.494 INFO:tasks.workunit.client.0.smithi088.stdout:=================== 2024-04-26T23:49:30.494 INFO:tasks.workunit.client.0.smithi088.stdout:Write Throughput: 174MB/sec 2024-04-26T23:49:30.553 INFO:tasks.workunit.client.0.smithi088.stdout: 2024-04-26T23:49:30.553 INFO:tasks.workunit.client.0.smithi088.stdout:System Call Latency statistics in millisecs 2024-04-26T23:49:30.553 INFO:tasks.workunit.client.0.smithi088.stdout:===== 2024-04-26T23:49:30.553 INFO:tasks.workunit.client.0.smithi088.stdout: Min Avg Max Total Calls 2024-04-26T23:49:30.553 INFO:tasks.workunit.client.0.smithi088.stdout: ======== ======== ======== ============ 2024-04-26T23:49:30.553 INFO:tasks.workunit.client.0.smithi088.stdout:[ open] 0.003000 0.053919 157.056000 12030 2024-04-26T23:49:30.553 INFO:tasks.workunit.client.0.smithi088.stdout: msec_range[0] 5000.000000 - 10000.000000 : 0 2024-04-26T23:49:30.553 INFO:tasks.workunit.client.0.smithi088.stdout: msec_range[1] 2000.000000 - 5000.000000 : 0 2024-04-26T23:49:30.553 INFO:tasks.workunit.client.0.smithi088.stdout: msec_range[2] 1000.000000 - 2000.000000 : 0 2024-04-26T23:49:30.554 INFO:tasks.workunit.client.0.smithi088.stdout: msec_range[3] 500.000000 - 1000.000000 : 0 2024-04-26T23:49:30.554 INFO:tasks.workunit.client.0.smithi088.stdout: msec_range[4] 200.000000 - 500.000000 : 0 2024-04-26T23:49:30.554 INFO:tasks.workunit.client.0.smithi088.stdout: msec_range[5] 100.000000 - 200.000000 : 1 2024-04-26T23:49:30.554 INFO:tasks.workunit.client.0.smithi088.stdout: msec_range[6] 50.000000 - 100.000000 : 1 2024-04-26T23:49:30.554 INFO:tasks.workunit.client.0.smithi088.stdout: msec_range[7] 20.000000 - 50.000000 : 2 2024-04-26T23:49:30.554 INFO:tasks.workunit.client.0.smithi088.stdout: msec_range[8] 10.000000 - 20.000000 : 5 2024-04-26T23:49:30.554 INFO:tasks.workunit.client.0.smithi088.stdout: msec_range[9] 5.000000 - 10.000000 : 7 2024-04-26T23:49:30.554 INFO:tasks.workunit.client.0.smithi088.stdout: msec_range[10] 2.000000 - 5.000000 : 9 2024-04-26T23:49:30.554 INFO:tasks.workunit.client.0.smithi088.stdout: msec_range[11] 1.000000 - 2.000000 : 7 2024-04-26T23:49:30.554 INFO:tasks.workunit.client.0.smithi088.stdout: msec_range[12] 0.500000 - 1.000000 : 2 2024-04-26T23:49:30.554 INFO:tasks.workunit.client.0.smithi088.stdout: msec_range[13] 0.200000 - 0.500000 : 8 2024-04-26T23:49:30.554 INFO:tasks.workunit.client.0.smithi088.stdout: msec_range[14] 0.100000 - 0.200000 : 15 2024-04-26T23:49:30.554 INFO:tasks.workunit.client.0.smithi088.stdout: msec_range[15] 0.050000 - 0.100000 : 52 2024-04-26T23:49:30.554 INFO:tasks.workunit.client.0.smithi088.stdout: msec_range[16] 0.020000 - 0.050000 : 802 2024-04-26T23:49:30.554 INFO:tasks.workunit.client.0.smithi088.stdout: msec_range[17] 0.010000 - 0.020000 : 10397 2024-04-26T23:49:30.555 INFO:tasks.workunit.client.0.smithi088.stdout: msec_range[18] 0.000000 - 0.010000 : 722 2024-04-26T23:49:30.555 INFO:tasks.workunit.client.0.smithi088.stdout: 2024-04-26T23:49:30.555 INFO:tasks.workunit.client.0.smithi088.stdout:[ write] 0.001000 0.628156 18207.535156 15398400 2024-04-26T23:49:30.555 INFO:tasks.workunit.client.0.smithi088.stdout: msec_range[0] 5000.000000 - 10000.000000 : 293 2024-04-26T23:49:30.555 INFO:tasks.workunit.client.0.smithi088.stdout: msec_range[1] 2000.000000 - 5000.000000 : 846 2024-04-26T23:49:30.555 INFO:tasks.workunit.client.0.smithi088.stdout: msec_range[2] 1000.000000 - 2000.000000 : 412 2024-04-26T23:49:30.555 INFO:tasks.workunit.client.0.smithi088.stdout: msec_range[3] 500.000000 - 1000.000000 : 376 2024-04-26T23:49:30.555 INFO:tasks.workunit.client.0.smithi088.stdout: msec_range[4] 200.000000 - 500.000000 : 798 2024-04-26T23:49:30.555 INFO:tasks.workunit.client.0.smithi088.stdout: msec_range[5] 100.000000 - 200.000000 : 6195 2024-04-26T23:49:30.555 INFO:tasks.workunit.client.0.smithi088.stdout: msec_range[6] 50.000000 - 100.000000 : 24730 2024-04-26T23:49:30.555 INFO:tasks.workunit.client.0.smithi088.stdout: msec_range[7] 20.000000 - 50.000000 : 17919 2024-04-26T23:49:30.555 INFO:tasks.workunit.client.0.smithi088.stdout: msec_range[8] 10.000000 - 20.000000 : 1132 2024-04-26T23:49:30.555 INFO:tasks.workunit.client.0.smithi088.stdout: msec_range[9] 5.000000 - 10.000000 : 812 2024-04-26T23:49:30.555 INFO:tasks.workunit.client.0.smithi088.stdout: msec_range[10] 2.000000 - 5.000000 : 1317 2024-04-26T23:49:30.556 INFO:tasks.workunit.client.0.smithi088.stdout: msec_range[11] 1.000000 - 2.000000 : 851 2024-04-26T23:49:30.556 INFO:tasks.workunit.client.0.smithi088.stdout: msec_range[12] 0.500000 - 1.000000 : 863 2024-04-26T23:49:30.556 INFO:tasks.workunit.client.0.smithi088.stdout: msec_range[13] 0.200000 - 0.500000 : 1069 2024-04-26T23:49:30.556 INFO:tasks.workunit.client.0.smithi088.stdout: msec_range[14] 0.100000 - 0.200000 : 1103 2024-04-26T23:49:30.556 INFO:tasks.workunit.client.0.smithi088.stdout: msec_range[15] 0.050000 - 0.100000 : 2767 2024-04-26T23:49:30.556 INFO:tasks.workunit.client.0.smithi088.stdout: msec_range[16] 0.020000 - 0.050000 : 20388 2024-04-26T23:49:30.556 INFO:tasks.workunit.client.0.smithi088.stdout: msec_range[17] 0.010000 - 0.020000 : 88051 2024-04-26T23:49:30.556 INFO:tasks.workunit.client.0.smithi088.stdout: msec_range[18] 0.000000 - 0.010000 : 15228429 2024-04-26T23:49:30.556 INFO:tasks.workunit.client.0.smithi088.stdout: 2024-04-26T23:49:30.556 INFO:tasks.workunit.client.0.smithi088.stdout:[ lseek] 0.000000 0.000515 121.027000 15398400 2024-04-26T23:49:30.556 INFO:tasks.workunit.client.0.smithi088.stdout: msec_range[0] 5000.000000 - 10000.000000 : 0 2024-04-26T23:49:30.556 INFO:tasks.workunit.client.0.smithi088.stdout: msec_range[1] 2000.000000 - 5000.000000 : 0 2024-04-26T23:49:30.556 INFO:tasks.workunit.client.0.smithi088.stdout: msec_range[2] 1000.000000 - 2000.000000 : 0 2024-04-26T23:49:30.556 INFO:tasks.workunit.client.0.smithi088.stdout: msec_range[3] 500.000000 - 1000.000000 : 0 2024-04-26T23:49:30.556 INFO:tasks.workunit.client.0.smithi088.stdout: msec_range[4] 200.000000 - 500.000000 : 0 2024-04-26T23:49:30.556 INFO:tasks.workunit.client.0.smithi088.stdout: msec_range[5] 100.000000 - 200.000000 : 2 2024-04-26T23:49:30.557 INFO:tasks.workunit.client.0.smithi088.stdout: msec_range[6] 50.000000 - 100.000000 : 6 2024-04-26T23:49:30.557 INFO:tasks.workunit.client.0.smithi088.stdout: msec_range[7] 20.000000 - 50.000000 : 15 2024-04-26T23:49:30.557 INFO:tasks.workunit.client.0.smithi088.stdout: msec_range[8] 10.000000 - 20.000000 : 25 2024-04-26T23:49:30.557 INFO:tasks.workunit.client.0.smithi088.stdout: msec_range[9] 5.000000 - 10.000000 : 33 2024-04-26T23:49:30.557 INFO:tasks.workunit.client.0.smithi088.stdout: msec_range[10] 2.000000 - 5.000000 : 67 2024-04-26T23:49:30.557 INFO:tasks.workunit.client.0.smithi088.stdout: msec_range[11] 1.000000 - 2.000000 : 41 2024-04-26T23:49:30.557 INFO:tasks.workunit.client.0.smithi088.stdout: msec_range[12] 0.500000 - 1.000000 : 55 2024-04-26T23:49:30.557 INFO:tasks.workunit.client.0.smithi088.stdout: msec_range[13] 0.200000 - 0.500000 : 113 2024-04-26T23:49:30.557 INFO:tasks.workunit.client.0.smithi088.stdout: msec_range[14] 0.100000 - 0.200000 : 86 2024-04-26T23:49:30.557 INFO:tasks.workunit.client.0.smithi088.stdout: msec_range[15] 0.050000 - 0.100000 : 238 2024-04-26T23:49:30.557 INFO:tasks.workunit.client.0.smithi088.stdout: msec_range[16] 0.020000 - 0.050000 : 1498 2024-04-26T23:49:30.557 INFO:tasks.workunit.client.0.smithi088.stdout: msec_range[17] 0.010000 - 0.020000 : 3724 2024-04-26T23:49:30.557 INFO:tasks.workunit.client.0.smithi088.stdout: msec_range[18] 0.000000 - 0.010000 : 15392497 2024-04-26T23:49:30.557 INFO:tasks.workunit.client.0.smithi088.stdout: 2024-04-26T23:49:30.557 INFO:tasks.workunit.client.0.smithi088.stdout:[ close] 0.001000 0.020828 98.042000 12030 2024-04-26T23:49:30.558 INFO:tasks.workunit.client.0.smithi088.stdout: msec_range[0] 5000.000000 - 10000.000000 : 0 2024-04-26T23:49:30.558 INFO:tasks.workunit.client.0.smithi088.stdout: msec_range[1] 2000.000000 - 5000.000000 : 0 2024-04-26T23:49:30.558 INFO:tasks.workunit.client.0.smithi088.stdout: msec_range[2] 1000.000000 - 2000.000000 : 0 2024-04-26T23:49:30.558 INFO:tasks.workunit.client.0.smithi088.stdout: msec_range[3] 500.000000 - 1000.000000 : 0 2024-04-26T23:49:30.558 INFO:tasks.workunit.client.0.smithi088.stdout: msec_range[4] 200.000000 - 500.000000 : 0 2024-04-26T23:49:30.558 INFO:tasks.workunit.client.0.smithi088.stdout: msec_range[5] 100.000000 - 200.000000 : 0 2024-04-26T23:49:30.558 INFO:tasks.workunit.client.0.smithi088.stdout: msec_range[6] 50.000000 - 100.000000 : 2 2024-04-26T23:49:30.558 INFO:tasks.workunit.client.0.smithi088.stdout: msec_range[7] 20.000000 - 50.000000 : 0 2024-04-26T23:49:30.558 INFO:tasks.workunit.client.0.smithi088.stdout: msec_range[8] 10.000000 - 20.000000 : 0 2024-04-26T23:49:30.558 INFO:tasks.workunit.client.0.smithi088.stdout: msec_range[9] 5.000000 - 10.000000 : 0 2024-04-26T23:49:30.558 INFO:tasks.workunit.client.0.smithi088.stdout: msec_range[10] 2.000000 - 5.000000 : 1 2024-04-26T23:49:30.558 INFO:tasks.workunit.client.0.smithi088.stdout: msec_range[11] 1.000000 - 2.000000 : 1 2024-04-26T23:49:30.558 INFO:tasks.workunit.client.0.smithi088.stdout: msec_range[12] 0.500000 - 1.000000 : 0 2024-04-26T23:49:30.558 INFO:tasks.workunit.client.0.smithi088.stdout: msec_range[13] 0.200000 - 0.500000 : 1 2024-04-26T23:49:30.558 INFO:tasks.workunit.client.0.smithi088.stdout: msec_range[14] 0.100000 - 0.200000 : 0 2024-04-26T23:49:30.559 INFO:tasks.workunit.client.0.smithi088.stdout: msec_range[15] 0.050000 - 0.100000 : 1 2024-04-26T23:49:30.559 INFO:tasks.workunit.client.0.smithi088.stdout: msec_range[16] 0.020000 - 0.050000 : 41 2024-04-26T23:49:30.559 INFO:tasks.workunit.client.0.smithi088.stdout: msec_range[17] 0.010000 - 0.020000 : 80 2024-04-26T23:49:30.559 INFO:tasks.workunit.client.0.smithi088.stdout: msec_range[18] 0.000000 - 0.010000 : 11903 2024-04-26T23:49:30.559 INFO:tasks.workunit.client.0.smithi088.stdout: 2024-04-26T23:49:30.559 INFO:tasks.workunit.client.0.smithi088.stdout: 2024-04-26T23:49:30.559 INFO:tasks.workunit.client.0.smithi088.stdout: 2024-04-26T23:49:30.559 INFO:tasks.workunit.client.0.smithi088.stdout: 2024-04-26T23:49:30.559 INFO:tasks.workunit.client.0.smithi088.stdout:1.8% User Time 2024-04-26T23:49:30.559 INFO:tasks.workunit.client.0.smithi088.stdout:14.6% System Time 2024-04-26T23:49:30.559 INFO:tasks.workunit.client.0.smithi088.stdout:16.4% CPU Utilization 2024-04-26T23:49:30.577 INFO:tasks.workunit.client.0.smithi088.stderr:+ cd .. 2024-04-26T23:49:30.578 INFO:tasks.workunit.client.0.smithi088.stderr:+ rm -r tmp ffsb 2024-04-26T23:49:32.025 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-04-26T23:49:32.025 DEBUG:teuthology.orchestra.run.smithi088:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-04-26T23:49:32.055 INFO:tasks.workunit:Stopping ['suites/ffsb.sh'] on client.0... 2024-04-26T23:49:32.055 DEBUG:teuthology.orchestra.run.smithi088:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-04-26T23:49:32.380 DEBUG:teuthology.parallel:result is None 2024-04-26T23:49:32.380 DEBUG:teuthology.orchestra.run.smithi088:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-04-26T23:49:32.408 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-04-26T23:49:32.409 DEBUG:teuthology.orchestra.run.smithi175:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1 2024-04-26T23:49:32.435 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.1/client.1 2024-04-26T23:49:32.435 DEBUG:teuthology.run_tasks:Unwinding manager mon_thrash 2024-04-26T23:49:32.448 INFO:tasks.mon_thrash:joining mon_thrasher 2024-04-26T23:49:36.021 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:49:36.023 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:49:39.770 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T23:49:39.884 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:39.879+0000 7f653216a640 1 Processor -- start 2024-04-26T23:49:39.884 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:39.879+0000 7f653216a640 1 -- start start 2024-04-26T23:49:39.885 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:39.880+0000 7f653216a640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f652c0c5140 0x7f652c156c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:39.885 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:39.880+0000 7f653216a640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f652c15b010 con 0x7f652c0ac620 2024-04-26T23:49:39.886 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:39.880+0000 7f653216a640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f652c06f0c0 con 0x7f652c0c5520 2024-04-26T23:49:39.886 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:39.880+0000 7f653216a640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f652c15a190 con 0x7f652c0c5140 2024-04-26T23:49:39.886 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:39.880+0000 7f652b7fe640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f652c0c5140 0x7f652c156c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:39.886 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:39.880+0000 7f652bfff640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f652c0ac620 0x7f652c15a900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:51222/0 (socket says 172.21.15.88:51222) 2024-04-26T23:49:39.886 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:39.880+0000 7f652bfff640 1 -- 172.21.15.88:0/2816384846 learned_addr learned my addr 172.21.15.88:0/2816384846 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-26T23:49:39.886 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:39.881+0000 7f652b7fe640 1 -- 172.21.15.88:0/2816384846 >> v1:172.21.15.175:6789/0 conn(0x7f652c0c5520 legacy=0x7f652c06e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:49:39.886 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:39.881+0000 7f652b7fe640 1 -- 172.21.15.88:0/2816384846 >> v1:172.21.15.88:6789/0 conn(0x7f652c0ac620 legacy=0x7f652c15a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:39.886 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:39.881+0000 7f652b7fe640 1 -- 172.21.15.88:0/2816384846 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f652c06f3a0 con 0x7f652c0c5140 2024-04-26T23:49:39.886 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:39.881+0000 7f652a7fc640 1 -- 172.21.15.88:0/2816384846 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1884378142 0 0) 0x7f652c15b010 con 0x7f652c0ac620 2024-04-26T23:49:39.888 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:39.881+0000 7f652b7fe640 1 --2- 172.21.15.88:0/2816384846 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f652c0c5140 0x7f652c156c00 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f651c009d90 tx=0x7f651c02a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b115637f2225413 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:49:39.888 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:39.882+0000 7f652a7fc640 1 -- 172.21.15.88:0/2816384846 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f651c031600 con 0x7f652c0c5140 2024-04-26T23:49:39.888 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:39.882+0000 7f652a7fc640 1 -- 172.21.15.88:0/2816384846 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f651c0317a0 con 0x7f652c0c5140 2024-04-26T23:49:39.888 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:39.882+0000 7f652a7fc640 1 -- 172.21.15.88:0/2816384846 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f651c031b70 con 0x7f652c0c5140 2024-04-26T23:49:39.888 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:39.882+0000 7f653216a640 1 -- 172.21.15.88:0/2816384846 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f652c0c5140 msgr2=0x7f652c156c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:39.889 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:39.882+0000 7f653216a640 1 --2- 172.21.15.88:0/2816384846 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f652c0c5140 0x7f652c156c00 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f651c009d90 tx=0x7f651c02a610 comp rx=0 tx=0).stop 2024-04-26T23:49:39.889 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:39.882+0000 7f653216a640 1 -- 172.21.15.88:0/2816384846 shutdown_connections 2024-04-26T23:49:39.889 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:39.882+0000 7f653216a640 1 --2- 172.21.15.88:0/2816384846 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f652c0c5140 0x7f652c156c00 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:39.889 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:39.882+0000 7f653216a640 1 -- 172.21.15.88:0/2816384846 >> 172.21.15.88:0/2816384846 conn(0x7f652c06e090 msgr2=0x7f652c06c310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:49:39.889 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:39.882+0000 7f653216a640 1 -- 172.21.15.88:0/2816384846 shutdown_connections 2024-04-26T23:49:39.889 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:39.882+0000 7f653216a640 1 -- 172.21.15.88:0/2816384846 wait complete. 2024-04-26T23:49:39.889 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:39.883+0000 7f653216a640 1 Processor -- start 2024-04-26T23:49:39.889 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:39.884+0000 7f653216a640 1 -- start start 2024-04-26T23:49:39.892 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:39.884+0000 7f653216a640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f652c0ac620 0x7f652c0c7410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:39.892 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:39.884+0000 7f653216a640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f652c0c5140 0x7f652c073210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:39.892 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:39.884+0000 7f653216a640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f652c0c5520 0x7f652c073750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:39.892 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:39.884+0000 7f653216a640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f652c153f30 con 0x7f652c0c5520 2024-04-26T23:49:39.893 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:39.884+0000 7f653216a640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f652c15a470 con 0x7f652c0ac620 2024-04-26T23:49:39.893 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:39.884+0000 7f653216a640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f652c1540b0 con 0x7f652c0c5140 2024-04-26T23:49:39.893 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:39.884+0000 7f652bfff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f652c0c5520 0x7f652c073750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:39.893 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:39.884+0000 7f652bfff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f652c0c5520 0x7f652c073750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:59260/0 (socket says 172.21.15.88:59260) 2024-04-26T23:49:39.893 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:39.884+0000 7f652bfff640 1 -- 172.21.15.88:0/4170835145 learned_addr learned my addr 172.21.15.88:0/4170835145 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:49:39.893 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:39.885+0000 7f652b7fe640 1 --2- 172.21.15.88:0/4170835145 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f652c0ac620 0x7f652c0c7410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:39.893 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:39.885+0000 7f652affd640 1 --2- 172.21.15.88:0/4170835145 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f652c0c5140 0x7f652c073210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:39.893 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:39.885+0000 7f652bfff640 1 -- 172.21.15.88:0/4170835145 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f652c0c5140 msgr2=0x7f652c073210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:39.893 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:39.885+0000 7f652bfff640 1 --2- 172.21.15.88:0/4170835145 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f652c0c5140 0x7f652c073210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:39.893 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:39.885+0000 7f652bfff640 1 -- 172.21.15.88:0/4170835145 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f652c0ac620 msgr2=0x7f652c0c7410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:39.893 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:39.885+0000 7f652bfff640 1 --2- 172.21.15.88:0/4170835145 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f652c0ac620 0x7f652c0c7410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:39.893 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:39.885+0000 7f652bfff640 1 -- 172.21.15.88:0/4170835145 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f652c074860 con 0x7f652c0c5520 2024-04-26T23:49:39.893 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:39.885+0000 7f652bfff640 1 --2- 172.21.15.88:0/4170835145 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f652c0c5520 0x7f652c073750 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f652400c450 tx=0x7f652400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:49:39.893 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:39.885+0000 7f6513fff640 1 -- 172.21.15.88:0/4170835145 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6524018070 con 0x7f652c0c5520 2024-04-26T23:49:39.894 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:39.885+0000 7f6513fff640 1 -- 172.21.15.88:0/4170835145 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6524007500 con 0x7f652c0c5520 2024-04-26T23:49:39.894 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:39.885+0000 7f653216a640 1 -- 172.21.15.88:0/4170835145 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f652c1f0330 con 0x7f652c0c5520 2024-04-26T23:49:39.894 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:39.885+0000 7f6513fff640 1 -- 172.21.15.88:0/4170835145 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6524004a20 con 0x7f652c0c5520 2024-04-26T23:49:39.894 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:39.885+0000 7f653216a640 1 -- 172.21.15.88:0/4170835145 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f652c1f0bd0 con 0x7f652c0c5520 2024-04-26T23:49:39.894 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:39.886+0000 7f653216a640 1 -- 172.21.15.88:0/4170835145 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f652c0aafb0 con 0x7f652c0c5520 2024-04-26T23:49:39.894 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:39.887+0000 7f6513fff640 1 -- 172.21.15.88:0/4170835145 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f652401b070 con 0x7f652c0c5520 2024-04-26T23:49:39.894 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:39.887+0000 7f6513fff640 1 --2- 172.21.15.88:0/4170835145 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f651806c8f0 0x7f651806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:39.894 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:39.887+0000 7f6513fff640 1 -- 172.21.15.88:0/4170835145 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6666+0+0 (secure 0 0 0) 0x7f652408b1e0 con 0x7f652c0c5520 2024-04-26T23:49:39.894 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:39.887+0000 7f652b7fe640 1 --2- 172.21.15.88:0/4170835145 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f651806c8f0 0x7f651806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:39.894 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:39.888+0000 7f652b7fe640 1 --2- 172.21.15.88:0/4170835145 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f651806c8f0 0x7f651806edb0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f651c034000 tx=0x7f651c02f000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:49:39.896 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:39.892+0000 7f6513fff640 1 -- 172.21.15.88:0/4170835145 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f6524059250 con 0x7f652c0c5520 2024-04-26T23:49:40.110 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:40.105+0000 7f653216a640 1 -- 172.21.15.88:0/4170835145 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f652c0abdd0 con 0x7f652c0c5520 2024-04-26T23:49:40.110 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:40.106+0000 7f6513fff640 1 -- 172.21.15.88:0/4170835145 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+6488 (secure 0 0 0) 0x7f6524058b50 con 0x7f652c0c5520 2024-04-26T23:49:40.111 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-26T23:49:40.111 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":12,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6834/3199540397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":3199540397},{"type":"v1","addr":"172.21.15.175:6834","nonce":3199540397}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4270,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6837/2790134952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6835","nonce":2790134952},{"type":"v1","addr":"172.21.15.88:6837","nonce":2790134952}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T23:40:31.909505+0000","modified":"2024-04-26T23:40:34.974455+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4279},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4279":{"gid":4279,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.175:6835/3932058274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6833","nonce":3932058274},{"type":"v1","addr":"172.21.15.175:6835","nonce":3932058274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4279,"qdb_cluster":[4279]},"id":1},{"mdsmap":{"epoch":12,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T23:40:41.008364+0000","modified":"2024-04-26T23:40:44.027288+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4272":{"gid":4272,"name":"c","rank":0,"incarnation":9,"state":"up:active","state_seq":6,"addr":"172.21.15.88:6836/4159390276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6834","nonce":4159390276},{"type":"v1","addr":"172.21.15.88:6836","nonce":4159390276}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4272,"qdb_cluster":[4272]},"id":2}]} 2024-04-26T23:49:40.111 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 12 2024-04-26T23:49:40.113 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:40.108+0000 7f653216a640 1 -- 172.21.15.88:0/4170835145 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f651806c8f0 msgr2=0x7f651806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:40.113 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:40.108+0000 7f653216a640 1 --2- 172.21.15.88:0/4170835145 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f651806c8f0 0x7f651806edb0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f651c034000 tx=0x7f651c02f000 comp rx=0 tx=0).stop 2024-04-26T23:49:40.113 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:40.108+0000 7f653216a640 1 -- 172.21.15.88:0/4170835145 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f652c0c5520 msgr2=0x7f652c073750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:40.113 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:40.108+0000 7f653216a640 1 --2- 172.21.15.88:0/4170835145 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f652c0c5520 0x7f652c073750 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f652400c450 tx=0x7f652400c910 comp rx=0 tx=0).stop 2024-04-26T23:49:40.113 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:40.108+0000 7f653216a640 1 -- 172.21.15.88:0/4170835145 shutdown_connections 2024-04-26T23:49:40.113 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:40.108+0000 7f653216a640 1 --2- 172.21.15.88:0/4170835145 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f651806c8f0 0x7f651806edb0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:40.113 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:40.108+0000 7f653216a640 1 --2- 172.21.15.88:0/4170835145 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f652c0c5140 0x7f652c073210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:40.114 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:40.108+0000 7f653216a640 1 --2- 172.21.15.88:0/4170835145 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f652c0c5520 0x7f652c073750 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:40.114 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:40.108+0000 7f653216a640 1 --2- 172.21.15.88:0/4170835145 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f652c0ac620 0x7f652c0c7410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:40.114 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:40.108+0000 7f653216a640 1 -- 172.21.15.88:0/4170835145 >> 172.21.15.88:0/4170835145 conn(0x7f652c06e090 msgr2=0x7f652c0c2cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:49:40.114 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:40.108+0000 7f653216a640 1 -- 172.21.15.88:0/4170835145 shutdown_connections 2024-04-26T23:49:40.114 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:40.108+0000 7f653216a640 1 -- 172.21.15.88:0/4170835145 wait complete. 2024-04-26T23:49:40.124 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-04-26T23:49:40.124 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-04-26T23:49:40.219 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:40.215+0000 7f3527946640 1 Processor -- start 2024-04-26T23:49:40.220 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:40.215+0000 7f3527946640 1 -- start start 2024-04-26T23:49:40.221 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:40.216+0000 7f3527946640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f35200c6960 0x7f3520158370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:40.221 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:40.216+0000 7f3527946640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f3520070c20 0x7f35201588b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:40.221 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:40.216+0000 7f3527946640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3520158df0 con 0x7f35201521f0 2024-04-26T23:49:40.222 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:40.216+0000 7f3527946640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f352006f660 con 0x7f3520070c20 2024-04-26T23:49:40.222 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:40.216+0000 7f3527946640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f3520070410 con 0x7f35200c6960 2024-04-26T23:49:40.222 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:40.216+0000 7f3525ee3640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f3520070c20 0x7f35201588b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:40.222 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:40.216+0000 7f3525ee3640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f3520070c20 0x7f35201588b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:59270/0 (socket says 172.21.15.88:59270) 2024-04-26T23:49:40.222 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:40.216+0000 7f3525ee3640 1 -- 172.21.15.88:0/2205563259 learned_addr learned my addr 172.21.15.88:0/2205563259 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:49:40.222 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:40.216+0000 7f3524ee1640 1 --2- 172.21.15.88:0/2205563259 >> v2:172.21.15.175:3300/0 conn(0x7f35200c6960 0x7f3520158370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:40.222 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:40.216+0000 7f3525ee3640 1 -- 172.21.15.88:0/2205563259 >> v2:172.21.15.175:3300/0 conn(0x7f35200c6960 msgr2=0x7f3520158370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:49:40.222 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:40.216+0000 7f3525ee3640 1 --2- 172.21.15.88:0/2205563259 >> v2:172.21.15.175:3300/0 conn(0x7f35200c6960 0x7f3520158370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:40.222 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:40.216+0000 7f3525ee3640 1 -- 172.21.15.88:0/2205563259 >> v1:172.21.15.175:6789/0 conn(0x7f35201521f0 legacy=0x7f352006d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:49:40.222 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:40.216+0000 7f3525ee3640 1 -- 172.21.15.88:0/2205563259 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f352006f8b0 con 0x7f3520070c20 2024-04-26T23:49:40.222 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:40.217+0000 7f3525ee3640 1 --2- 172.21.15.88:0/2205563259 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3520070c20 0x7f35201588b0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f3520068f10 tx=0x7f351802a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b434a4a507a03d7 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:49:40.222 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:40.217+0000 7f3517fff640 1 -- 172.21.15.88:0/2205563259 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3518036070 con 0x7f3520070c20 2024-04-26T23:49:40.222 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:40.217+0000 7f3517fff640 1 -- 172.21.15.88:0/2205563259 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3518031600 con 0x7f3520070c20 2024-04-26T23:49:40.222 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:40.217+0000 7f3517fff640 1 -- 172.21.15.88:0/2205563259 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35180319d0 con 0x7f3520070c20 2024-04-26T23:49:40.226 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:40.217+0000 7f3527946640 1 -- 172.21.15.88:0/2205563259 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3520070c20 msgr2=0x7f35201588b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:40.227 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:40.217+0000 7f3527946640 1 --2- 172.21.15.88:0/2205563259 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3520070c20 0x7f35201588b0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f3520068f10 tx=0x7f351802a6a0 comp rx=0 tx=0).stop 2024-04-26T23:49:40.227 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:40.217+0000 7f3527946640 1 -- 172.21.15.88:0/2205563259 shutdown_connections 2024-04-26T23:49:40.227 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:40.217+0000 7f3527946640 1 --2- 172.21.15.88:0/2205563259 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3520070c20 0x7f35201588b0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:40.227 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:40.217+0000 7f3527946640 1 --2- 172.21.15.88:0/2205563259 >> v2:172.21.15.175:3300/0 conn(0x7f35200c6960 0x7f3520158370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:40.227 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:40.217+0000 7f3527946640 1 -- 172.21.15.88:0/2205563259 >> 172.21.15.88:0/2205563259 conn(0x7f35200c5ce0 msgr2=0x7f35200c60c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:49:40.227 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:40.218+0000 7f3527946640 1 -- 172.21.15.88:0/2205563259 shutdown_connections 2024-04-26T23:49:40.227 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:40.218+0000 7f3527946640 1 -- 172.21.15.88:0/2205563259 wait complete. 2024-04-26T23:49:40.227 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:40.219+0000 7f3527946640 1 Processor -- start 2024-04-26T23:49:40.227 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:40.219+0000 7f3527946640 1 -- start start 2024-04-26T23:49:40.227 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:40.219+0000 7f3527946640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3520070c20 0x7f3520147900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:40.227 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:40.219+0000 7f3527946640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f35200c6960 0x7f3520147e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:40.227 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:40.219+0000 7f3527946640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f35201521f0 0x7f352014af70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:40.227 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:40.219+0000 7f3527946640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f352006da30 con 0x7f35200c6960 2024-04-26T23:49:40.228 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:40.219+0000 7f3527946640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f3520154a20 con 0x7f35201521f0 2024-04-26T23:49:40.228 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:40.219+0000 7f3527946640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f352006dbb0 con 0x7f3520070c20 2024-04-26T23:49:40.228 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:40.219+0000 7f3524ee1640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f35200c6960 0x7f3520147e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:40.228 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:40.219+0000 7f3524ee1640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f35200c6960 0x7f3520147e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:59274/0 (socket says 172.21.15.88:59274) 2024-04-26T23:49:40.228 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:40.219+0000 7f3524ee1640 1 -- 172.21.15.88:0/3064484679 learned_addr learned my addr 172.21.15.88:0/3064484679 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:49:40.228 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:40.219+0000 7f35256e2640 1 --2- 172.21.15.88:0/3064484679 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3520070c20 0x7f3520147900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:40.228 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:40.220+0000 7f3525ee3640 1 --2- 172.21.15.88:0/3064484679 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f35201521f0 0x7f352014af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:40.228 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:40.220+0000 7f3524ee1640 1 -- 172.21.15.88:0/3064484679 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3520070c20 msgr2=0x7f3520147900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:40.228 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:40.220+0000 7f3524ee1640 1 --2- 172.21.15.88:0/3064484679 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3520070c20 0x7f3520147900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:40.228 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:40.220+0000 7f3524ee1640 1 -- 172.21.15.88:0/3064484679 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f35201521f0 msgr2=0x7f352014af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:40.228 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:40.220+0000 7f3524ee1640 1 --2- 172.21.15.88:0/3064484679 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f35201521f0 0x7f352014af70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:40.228 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:40.220+0000 7f3524ee1640 1 -- 172.21.15.88:0/3064484679 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35201f0b50 con 0x7f35200c6960 2024-04-26T23:49:40.228 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:40.220+0000 7f35256e2640 1 --2- 172.21.15.88:0/3064484679 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3520070c20 0x7f3520147900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:49:40.228 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:40.220+0000 7f3525ee3640 1 --2- 172.21.15.88:0/3064484679 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f35201521f0 0x7f352014af70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:49:40.229 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:40.220+0000 7f3524ee1640 1 --2- 172.21.15.88:0/3064484679 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f35200c6960 0x7f3520147e40 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f351000d800 tx=0x7f351000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:49:40.229 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:40.220+0000 7f3515ffb640 1 -- 172.21.15.88:0/3064484679 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f351000b6c0 con 0x7f35200c6960 2024-04-26T23:49:40.229 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:40.220+0000 7f3515ffb640 1 -- 172.21.15.88:0/3064484679 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3510019070 con 0x7f35200c6960 2024-04-26T23:49:40.229 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:40.220+0000 7f3515ffb640 1 -- 172.21.15.88:0/3064484679 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f351000ba80 con 0x7f35200c6960 2024-04-26T23:49:40.229 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:40.220+0000 7f3527946640 1 -- 172.21.15.88:0/3064484679 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35201ecb80 con 0x7f35200c6960 2024-04-26T23:49:40.229 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:40.220+0000 7f3527946640 1 -- 172.21.15.88:0/3064484679 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35201ec830 con 0x7f35200c6960 2024-04-26T23:49:40.229 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:40.221+0000 7f3527946640 1 -- 172.21.15.88:0/3064484679 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3520158b00 con 0x7f35200c6960 2024-04-26T23:49:40.229 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:40.221+0000 7f3515ffb640 1 -- 172.21.15.88:0/3064484679 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f351000bc20 con 0x7f35200c6960 2024-04-26T23:49:40.229 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:40.222+0000 7f3515ffb640 1 --2- 172.21.15.88:0/3064484679 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f350406c8f0 0x7f350406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:40.229 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:40.222+0000 7f3515ffb640 1 -- 172.21.15.88:0/3064484679 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6666+0+0 (secure 0 0 0) 0x7f351008c410 con 0x7f35200c6960 2024-04-26T23:49:40.229 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:40.222+0000 7f35256e2640 1 --2- 172.21.15.88:0/3064484679 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f350406c8f0 0x7f350406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:40.229 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:40.222+0000 7f35256e2640 1 --2- 172.21.15.88:0/3064484679 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f350406c8f0 0x7f350406edb0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f35200c9170 tx=0x7f351c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:49:40.230 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:40.226+0000 7f3515ffb640 1 -- 172.21.15.88:0/3064484679 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f3520158b00 con 0x7f35200c6960 2024-04-26T23:49:40.479 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:40.475+0000 7f3527946640 1 -- 172.21.15.88:0/3064484679 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f35200507a0 con 0x7f35200c6960 2024-04-26T23:49:40.479 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:40.475+0000 7f3515ffb640 1 -- 172.21.15.88:0/3064484679 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1565 (secure 0 0 0) 0x7f351001c360 con 0x7f35200c6960 2024-04-26T23:49:40.480 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":84,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":12,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"555255e9-7ef9-4454-8dc9-35e96b70035c","modified":"2024-04-26T23:39:34.291658Z","created":"2024-04-26T23:39:34.291658Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:3300","nonce":0},{"type":"v1","addr":"172.21.15.175:6789","nonce":0}]},"addr":"172.21.15.175:6789/0","public_addr":"172.21.15.175:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:3301","nonce":0},{"type":"v1","addr":"172.21.15.175:6790","nonce":0}]},"addr":"172.21.15.175:6790/0","public_addr":"172.21.15.175:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-04-26T23:49:40.482 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:40.477+0000 7f3527946640 1 -- 172.21.15.88:0/3064484679 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f350406c8f0 msgr2=0x7f350406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:40.482 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:40.477+0000 7f3527946640 1 --2- 172.21.15.88:0/3064484679 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f350406c8f0 0x7f350406edb0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f35200c9170 tx=0x7f351c009040 comp rx=0 tx=0).stop 2024-04-26T23:49:40.482 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:40.477+0000 7f3527946640 1 -- 172.21.15.88:0/3064484679 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f35200c6960 msgr2=0x7f3520147e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:40.482 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:40.477+0000 7f3527946640 1 --2- 172.21.15.88:0/3064484679 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f35200c6960 0x7f3520147e40 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f351000d800 tx=0x7f351000dcc0 comp rx=0 tx=0).stop 2024-04-26T23:49:40.482 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:40.477+0000 7f3527946640 1 -- 172.21.15.88:0/3064484679 shutdown_connections 2024-04-26T23:49:40.482 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:40.477+0000 7f3527946640 1 --2- 172.21.15.88:0/3064484679 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f350406c8f0 0x7f350406edb0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:40.482 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:40.477+0000 7f3527946640 1 --2- 172.21.15.88:0/3064484679 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f35201521f0 0x7f352014af70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:40.482 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:40.477+0000 7f3527946640 1 --2- 172.21.15.88:0/3064484679 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f35200c6960 0x7f3520147e40 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:40.483 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:40.477+0000 7f3527946640 1 --2- 172.21.15.88:0/3064484679 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3520070c20 0x7f3520147900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:40.483 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:40.477+0000 7f3527946640 1 -- 172.21.15.88:0/3064484679 >> 172.21.15.88:0/3064484679 conn(0x7f35200c5ce0 msgr2=0x7f352006c310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:49:40.483 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:40.477+0000 7f3527946640 1 -- 172.21.15.88:0/3064484679 shutdown_connections 2024-04-26T23:49:40.483 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:40.477+0000 7f3527946640 1 -- 172.21.15.88:0/3064484679 wait complete. 2024-04-26T23:49:40.493 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-04-26T23:49:40.493 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-04-26T23:49:40.503 INFO:tasks.kclient:Unmounting kernel clients... 2024-04-26T23:49:40.503 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-04-26T23:49:40.503 DEBUG:teuthology.orchestra.run.smithi088:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:49:40.532 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-04-26T23:49:40.532 DEBUG:teuthology.orchestra.run.smithi088:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:49:40.588 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T23:49:40.725 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:40.721+0000 7f5c7f09b640 1 Processor -- start 2024-04-26T23:49:40.725 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:40.721+0000 7f5c7f09b640 1 -- start start 2024-04-26T23:49:40.727 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:40.721+0000 7f5c7f09b640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5c781570d0 0x7f5c78150a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:40.727 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:40.721+0000 7f5c7f09b640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f5c780ab3f0 0x7f5c78150f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:40.727 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:40.721+0000 7f5c7f09b640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5c780c3810 con 0x7f5c780c4d80 2024-04-26T23:49:40.727 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:40.721+0000 7f5c7f09b640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f5c780c4330 con 0x7f5c780ab3f0 2024-04-26T23:49:40.727 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:40.721+0000 7f5c7f09b640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f5c780c3ab0 con 0x7f5c781570d0 2024-04-26T23:49:40.727 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:40.722+0000 7f5c77fff640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f5c780ab3f0 0x7f5c78150f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:40.727 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:40.722+0000 7f5c7ce37640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5c781570d0 0x7f5c78150a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:40.727 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:40.722+0000 7f5c7d638640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f5c780c4d80 0x7f5c781574b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.88:46066/0 (socket says 172.21.15.88:46066) 2024-04-26T23:49:40.727 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:40.722+0000 7f5c7d638640 1 -- 172.21.15.88:0/3944726560 learned_addr learned my addr 172.21.15.88:0/3944726560 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-26T23:49:40.727 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:40.722+0000 7f5c77fff640 1 -- 172.21.15.88:0/3944726560 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5c781570d0 msgr2=0x7f5c78150a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:49:40.727 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:40.722+0000 7f5c77fff640 1 --2- 172.21.15.88:0/3944726560 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5c781570d0 0x7f5c78150a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:40.727 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:40.722+0000 7f5c77fff640 1 -- 172.21.15.88:0/3944726560 >> v1:172.21.15.175:6789/0 conn(0x7f5c780c4d80 legacy=0x7f5c781574b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:40.728 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:40.722+0000 7f5c77fff640 1 -- 172.21.15.88:0/3944726560 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c780c4580 con 0x7f5c780ab3f0 2024-04-26T23:49:40.728 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:40.722+0000 7f5c7ce37640 1 --2- 172.21.15.88:0/3944726560 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5c781570d0 0x7f5c78150a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:49:40.729 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:40.723+0000 7f5c77fff640 1 --2- 172.21.15.88:0/3944726560 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5c780ab3f0 0x7f5c78150f90 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f5c640097a0 tx=0x7f5c64029f60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b619b243c9a91bb server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:49:40.729 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:40.723+0000 7f5c777fe640 1 -- 172.21.15.88:0/3944726560 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c64037070 con 0x7f5c780ab3f0 2024-04-26T23:49:40.730 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:40.723+0000 7f5c777fe640 1 -- 172.21.15.88:0/3944726560 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c6402abf0 con 0x7f5c780ab3f0 2024-04-26T23:49:40.730 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:40.723+0000 7f5c777fe640 1 -- 172.21.15.88:0/3944726560 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c64032440 con 0x7f5c780ab3f0 2024-04-26T23:49:40.730 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:40.724+0000 7f5c7f09b640 1 -- 172.21.15.88:0/3944726560 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5c780ab3f0 msgr2=0x7f5c78150f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:40.730 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:40.724+0000 7f5c7f09b640 1 --2- 172.21.15.88:0/3944726560 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5c780ab3f0 0x7f5c78150f90 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f5c640097a0 tx=0x7f5c64029f60 comp rx=0 tx=0).stop 2024-04-26T23:49:40.730 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:40.724+0000 7f5c7f09b640 1 -- 172.21.15.88:0/3944726560 shutdown_connections 2024-04-26T23:49:40.730 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:40.724+0000 7f5c7f09b640 1 --2- 172.21.15.88:0/3944726560 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5c780ab3f0 0x7f5c78150f90 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:40.730 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:40.724+0000 7f5c7f09b640 1 --2- 172.21.15.88:0/3944726560 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5c781570d0 0x7f5c78150a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:40.730 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:40.724+0000 7f5c7f09b640 1 -- 172.21.15.88:0/3944726560 >> 172.21.15.88:0/3944726560 conn(0x7f5c7806c310 msgr2=0x7f5c7806c6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:49:40.730 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:40.724+0000 7f5c7f09b640 1 -- 172.21.15.88:0/3944726560 shutdown_connections 2024-04-26T23:49:40.730 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:40.724+0000 7f5c7f09b640 1 -- 172.21.15.88:0/3944726560 wait complete. 2024-04-26T23:49:40.730 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:40.725+0000 7f5c7f09b640 1 Processor -- start 2024-04-26T23:49:40.730 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:40.725+0000 7f5c7f09b640 1 -- start start 2024-04-26T23:49:40.733 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:40.726+0000 7f5c7f09b640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5c780ab3f0 0x7f5c7815c840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:40.733 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:40.726+0000 7f5c7f09b640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5c780c4d80 0x7f5c78156030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:40.733 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:40.726+0000 7f5c7f09b640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5c781570d0 0x7f5c78156570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:40.733 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:40.726+0000 7f5c7f09b640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f5c780abbe0 con 0x7f5c781570d0 2024-04-26T23:49:40.733 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:40.726+0000 7f5c7f09b640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f5c780aba60 con 0x7f5c780c4d80 2024-04-26T23:49:40.733 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:40.726+0000 7f5c7f09b640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f5c78157bc0 con 0x7f5c780ab3f0 2024-04-26T23:49:40.733 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:40.726+0000 7f5c7d638640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5c781570d0 0x7f5c78156570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:40.733 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:40.726+0000 7f5c7d638640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5c781570d0 0x7f5c78156570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:59280/0 (socket says 172.21.15.88:59280) 2024-04-26T23:49:40.733 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:40.726+0000 7f5c7d638640 1 -- 172.21.15.88:0/2208572101 learned_addr learned my addr 172.21.15.88:0/2208572101 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:49:40.733 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:40.726+0000 7f5c7ce37640 1 --2- 172.21.15.88:0/2208572101 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5c780ab3f0 0x7f5c7815c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:40.733 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:40.726+0000 7f5c77fff640 1 --2- 172.21.15.88:0/2208572101 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5c780c4d80 0x7f5c78156030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:40.733 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:40.726+0000 7f5c7d638640 1 -- 172.21.15.88:0/2208572101 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5c780ab3f0 msgr2=0x7f5c7815c840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:40.734 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:40.726+0000 7f5c7d638640 1 --2- 172.21.15.88:0/2208572101 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5c780ab3f0 0x7f5c7815c840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:40.734 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:40.726+0000 7f5c7d638640 1 -- 172.21.15.88:0/2208572101 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5c780c4d80 msgr2=0x7f5c78156030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:40.734 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:40.726+0000 7f5c7d638640 1 --2- 172.21.15.88:0/2208572101 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5c780c4d80 0x7f5c78156030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:40.734 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:40.726+0000 7f5c7d638640 1 -- 172.21.15.88:0/2208572101 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c7815f2f0 con 0x7f5c781570d0 2024-04-26T23:49:40.734 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:40.726+0000 7f5c7d638640 1 --2- 172.21.15.88:0/2208572101 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5c781570d0 0x7f5c78156570 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f5c70001fd0 tx=0x7f5c7000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:49:40.734 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:40.726+0000 7f5c757fa640 1 -- 172.21.15.88:0/2208572101 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c70017070 con 0x7f5c781570d0 2024-04-26T23:49:40.734 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:40.726+0000 7f5c757fa640 1 -- 172.21.15.88:0/2208572101 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c70012400 con 0x7f5c781570d0 2024-04-26T23:49:40.734 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:40.726+0000 7f5c7f09b640 1 -- 172.21.15.88:0/2208572101 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c7815f5d0 con 0x7f5c781570d0 2024-04-26T23:49:40.734 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:40.726+0000 7f5c757fa640 1 -- 172.21.15.88:0/2208572101 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c700127d0 con 0x7f5c781570d0 2024-04-26T23:49:40.734 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:40.726+0000 7f5c7f09b640 1 -- 172.21.15.88:0/2208572101 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c78155830 con 0x7f5c781570d0 2024-04-26T23:49:40.734 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:40.727+0000 7f5c7f09b640 1 -- 172.21.15.88:0/2208572101 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5c7806e700 con 0x7f5c781570d0 2024-04-26T23:49:40.734 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:40.728+0000 7f5c757fa640 1 -- 172.21.15.88:0/2208572101 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f5c7001a070 con 0x7f5c781570d0 2024-04-26T23:49:40.734 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:40.728+0000 7f5c757fa640 1 --2- 172.21.15.88:0/2208572101 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f5c5c06c920 0x7f5c5c06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:40.734 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:40.728+0000 7f5c757fa640 1 -- 172.21.15.88:0/2208572101 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6666+0+0 (secure 0 0 0) 0x7f5c7008be40 con 0x7f5c781570d0 2024-04-26T23:49:40.735 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:40.728+0000 7f5c7ce37640 1 --2- 172.21.15.88:0/2208572101 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f5c5c06c920 0x7f5c5c06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:40.735 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:40.728+0000 7f5c7ce37640 1 --2- 172.21.15.88:0/2208572101 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f5c5c06c920 0x7f5c5c06ede0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f5c7815d070 tx=0x7f5c6c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:49:40.737 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:40.732+0000 7f5c757fa640 1 -- 172.21.15.88:0/2208572101 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f5c70059eb0 con 0x7f5c781570d0 2024-04-26T23:49:40.915 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:40.910+0000 7f5c7f09b640 1 -- 172.21.15.88:0/2208572101 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5c780507a0 con 0x7f5c781570d0 2024-04-26T23:49:40.916 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:40.912+0000 7f5c757fa640 1 -- 172.21.15.88:0/2208572101 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+20640 (secure 0 0 0) 0x7f5c700597b0 con 0x7f5c781570d0 2024-04-26T23:49:40.916 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-26T23:49:40.917 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":26,"fsid":"555255e9-7ef9-4454-8dc9-35e96b70035c","created":"2024-04-26T23:40:07.836009+0000","modified":"2024-04-26T23:41:30.360444+0000","last_up_change":"2024-04-26T23:40:18.831369+0000","last_in_change":"2024-04-26T23:40:09.944777+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T23:40:19.936127+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"a_metadata","create_time":"2024-04-26T23:40:29.837465+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"a_data","create_time":"2024-04-26T23:40:30.868651+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"b_metadata","create_time":"2024-04-26T23:40:38.753441+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"b_data","create_time":"2024-04-26T23:40:39.974557+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"92aecea3-ed62-4a29-87c0-76758a0816a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":2803186054},{"type":"v1","addr":"172.21.15.88:6801","nonce":2803186054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":2803186054},{"type":"v1","addr":"172.21.15.88:6803","nonce":2803186054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":2803186054},{"type":"v1","addr":"172.21.15.88:6807","nonce":2803186054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":2803186054},{"type":"v1","addr":"172.21.15.88:6805","nonce":2803186054}]},"public_addr":"172.21.15.88:6801/2803186054","cluster_addr":"172.21.15.88:6803/2803186054","heartbeat_back_addr":"172.21.15.88:6807/2803186054","heartbeat_front_addr":"172.21.15.88:6805/2803186054","state":["exists","up"]},{"osd":1,"uuid":"7a6f0fa9-23d0-4747-880f-798d45ec5eeb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":1897380484},{"type":"v1","addr":"172.21.15.88:6817","nonce":1897380484}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":1897380484},{"type":"v1","addr":"172.21.15.88:6819","nonce":1897380484}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1897380484},{"type":"v1","addr":"172.21.15.88:6823","nonce":1897380484}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":1897380484},{"type":"v1","addr":"172.21.15.88:6821","nonce":1897380484}]},"public_addr":"172.21.15.88:6817/1897380484","cluster_addr":"172.21.15.88:6819/1897380484","heartbeat_back_addr":"172.21.15.88:6823/1897380484","heartbeat_front_addr":"172.21.15.88:6821/1897380484","state":["exists","up"]},{"osd":2,"uuid":"6be88ea0-e133-4200-a4b5-f92d664b248a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":648396269},{"type":"v1","addr":"172.21.15.88:6809","nonce":648396269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":648396269},{"type":"v1","addr":"172.21.15.88:6811","nonce":648396269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":648396269},{"type":"v1","addr":"172.21.15.88:6815","nonce":648396269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":648396269},{"type":"v1","addr":"172.21.15.88:6813","nonce":648396269}]},"public_addr":"172.21.15.88:6809/648396269","cluster_addr":"172.21.15.88:6811/648396269","heartbeat_back_addr":"172.21.15.88:6815/648396269","heartbeat_front_addr":"172.21.15.88:6813/648396269","state":["exists","up"]},{"osd":3,"uuid":"dcb0746b-7b3d-4ecf-8089-2493a5d1857c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":2328028922},{"type":"v1","addr":"172.21.15.88:6825","nonce":2328028922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":2328028922},{"type":"v1","addr":"172.21.15.88:6827","nonce":2328028922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":2328028922},{"type":"v1","addr":"172.21.15.88:6831","nonce":2328028922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":2328028922},{"type":"v1","addr":"172.21.15.88:6829","nonce":2328028922}]},"public_addr":"172.21.15.88:6825/2328028922","cluster_addr":"172.21.15.88:6827/2328028922","heartbeat_back_addr":"172.21.15.88:6831/2328028922","heartbeat_front_addr":"172.21.15.88:6829/2328028922","state":["exists","up"]},{"osd":4,"uuid":"c483de66-c44f-450e-a4ce-b132d50882c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":3929617402},{"type":"v1","addr":"172.21.15.175:6809","nonce":3929617402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":3929617402},{"type":"v1","addr":"172.21.15.175:6811","nonce":3929617402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":3929617402},{"type":"v1","addr":"172.21.15.175:6815","nonce":3929617402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":3929617402},{"type":"v1","addr":"172.21.15.175:6813","nonce":3929617402}]},"public_addr":"172.21.15.175:6809/3929617402","cluster_addr":"172.21.15.175:6811/3929617402","heartbeat_back_addr":"172.21.15.175:6815/3929617402","heartbeat_front_addr":"172.21.15.175:6813/3929617402","state":["exists","up"]},{"osd":5,"uuid":"ac3b1669-d228-40dd-9f9a-cb46aa73dd6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":2476644457},{"type":"v1","addr":"172.21.15.175:6801","nonce":2476644457}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":2476644457},{"type":"v1","addr":"172.21.15.175:6803","nonce":2476644457}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":2476644457},{"type":"v1","addr":"172.21.15.175:6807","nonce":2476644457}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":2476644457},{"type":"v1","addr":"172.21.15.175:6805","nonce":2476644457}]},"public_addr":"172.21.15.175:6801/2476644457","cluster_addr":"172.21.15.175:6803/2476644457","heartbeat_back_addr":"172.21.15.175:6807/2476644457","heartbeat_front_addr":"172.21.15.175:6805/2476644457","state":["exists","up"]},{"osd":6,"uuid":"7bef4896-857e-4c11-b3b2-c2e9a8548338","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":3824112919},{"type":"v1","addr":"172.21.15.175:6819","nonce":3824112919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6821","nonce":3824112919},{"type":"v1","addr":"172.21.15.175:6824","nonce":3824112919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":3824112919},{"type":"v1","addr":"172.21.15.175:6831","nonce":3824112919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":3824112919},{"type":"v1","addr":"172.21.15.175:6829","nonce":3824112919}]},"public_addr":"172.21.15.175:6819/3824112919","cluster_addr":"172.21.15.175:6824/3824112919","heartbeat_back_addr":"172.21.15.175:6831/3824112919","heartbeat_front_addr":"172.21.15.175:6829/3824112919","state":["exists","up"]},{"osd":7,"uuid":"e18d9e09-8673-470d-b9dc-280a409b63f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6817","nonce":3319361162},{"type":"v1","addr":"172.21.15.175:6818","nonce":3319361162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":3319361162},{"type":"v1","addr":"172.21.15.175:6822","nonce":3319361162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6827","nonce":3319361162},{"type":"v1","addr":"172.21.15.175:6828","nonce":3319361162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6823","nonce":3319361162},{"type":"v1","addr":"172.21.15.175:6825","nonce":3319361162}]},"public_addr":"172.21.15.175:6818/3319361162","cluster_addr":"172.21.15.175:6822/3319361162","heartbeat_back_addr":"172.21.15.175:6828/3319361162","heartbeat_front_addr":"172.21.15.175:6825/3319361162","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:40:15.126268+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:40:15.050614+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:40:14.995164+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:40:15.078112+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:40:15.159637+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:40:15.091226+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:40:15.140316+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:40:15.089431+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.16","mappings":[{"from":5,"to":2}]},{"pgid":"3.17","mappings":[{"from":5,"to":1}]},{"pgid":"3.1f","mappings":[{"from":0,"to":2}]},{"pgid":"3.23","mappings":[{"from":3,"to":1}]},{"pgid":"3.39","mappings":[{"from":7,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:49:40.918 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:40.914+0000 7f5c7f09b640 1 -- 172.21.15.88:0/2208572101 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f5c5c06c920 msgr2=0x7f5c5c06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:40.919 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:40.914+0000 7f5c7f09b640 1 --2- 172.21.15.88:0/2208572101 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f5c5c06c920 0x7f5c5c06ede0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f5c7815d070 tx=0x7f5c6c008040 comp rx=0 tx=0).stop 2024-04-26T23:49:40.919 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:40.914+0000 7f5c7f09b640 1 -- 172.21.15.88:0/2208572101 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5c781570d0 msgr2=0x7f5c78156570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:40.919 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:40.914+0000 7f5c7f09b640 1 --2- 172.21.15.88:0/2208572101 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5c781570d0 0x7f5c78156570 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f5c70001fd0 tx=0x7f5c7000a430 comp rx=0 tx=0).stop 2024-04-26T23:49:40.919 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:40.914+0000 7f5c7f09b640 1 -- 172.21.15.88:0/2208572101 shutdown_connections 2024-04-26T23:49:40.919 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:40.914+0000 7f5c7f09b640 1 --2- 172.21.15.88:0/2208572101 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f5c5c06c920 0x7f5c5c06ede0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:40.919 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:40.914+0000 7f5c7f09b640 1 --2- 172.21.15.88:0/2208572101 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5c781570d0 0x7f5c78156570 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:40.919 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:40.914+0000 7f5c7f09b640 1 --2- 172.21.15.88:0/2208572101 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5c780c4d80 0x7f5c78156030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:40.919 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:40.914+0000 7f5c7f09b640 1 --2- 172.21.15.88:0/2208572101 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5c780ab3f0 0x7f5c7815c840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:40.919 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:40.914+0000 7f5c7f09b640 1 -- 172.21.15.88:0/2208572101 >> 172.21.15.88:0/2208572101 conn(0x7f5c7806c310 msgr2=0x7f5c781574b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:49:40.919 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:40.914+0000 7f5c7f09b640 1 -- 172.21.15.88:0/2208572101 shutdown_connections 2024-04-26T23:49:40.919 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:40.914+0000 7f5c7f09b640 1 -- 172.21.15.88:0/2208572101 wait complete. 2024-04-26T23:49:40.930 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T23:40:19.936127+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'a_metadata', 'create_time': '2024-04-26T23:40:29.837465+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'a'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'a_data', 'create_time': '2024-04-26T23:40:30.868651+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'a'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'b_metadata', 'create_time': '2024-04-26T23:40:38.753441+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'b'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'b_data', 'create_time': '2024-04-26T23:40:39.974557+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'b'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T23:49:40.930 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T23:49:41.030 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.025+0000 7f22dfcc4640 1 Processor -- start 2024-04-26T23:49:41.030 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.025+0000 7f22dfcc4640 1 -- start start 2024-04-26T23:49:41.032 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.026+0000 7f22dfcc4640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f22d81570d0 0x7f22d8150a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:41.032 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.026+0000 7f22dfcc4640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f22d8150f90 0x7f22d81574b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:41.032 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.026+0000 7f22dfcc4640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f22d80c3810 con 0x7f22d80ab3f0 2024-04-26T23:49:41.033 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.026+0000 7f22dfcc4640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f22d80c4330 con 0x7f22d81570d0 2024-04-26T23:49:41.033 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.026+0000 7f22dfcc4640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f22d80c3ab0 con 0x7f22d8150f90 2024-04-26T23:49:41.033 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.026+0000 7f22dda60640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f22d81570d0 0x7f22d8150a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:41.033 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.026+0000 7f22dd25f640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f22d80ab3f0 0x7f22d80c4d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:51228/0 (socket says 172.21.15.88:51228) 2024-04-26T23:49:41.033 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.026+0000 7f22dd25f640 1 -- 172.21.15.88:0/969200745 learned_addr learned my addr 172.21.15.88:0/969200745 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-26T23:49:41.033 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.026+0000 7f22de261640 1 --2- 172.21.15.88:0/969200745 >> v2:172.21.15.175:3300/0 conn(0x7f22d8150f90 0x7f22d81574b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:41.033 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.026+0000 7f22dda60640 1 -- 172.21.15.88:0/969200745 >> v2:172.21.15.175:3300/0 conn(0x7f22d8150f90 msgr2=0x7f22d81574b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:49:41.033 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.026+0000 7f22dda60640 1 --2- 172.21.15.88:0/969200745 >> v2:172.21.15.175:3300/0 conn(0x7f22d8150f90 0x7f22d81574b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:41.033 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.026+0000 7f22dda60640 1 -- 172.21.15.88:0/969200745 >> v1:172.21.15.88:6789/0 conn(0x7f22d80ab3f0 legacy=0x7f22d80c4d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:41.033 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.026+0000 7f22dca5e640 1 -- 172.21.15.88:0/969200745 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 381489206 0 0) 0x7f22d80c3810 con 0x7f22d80ab3f0 2024-04-26T23:49:41.033 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.026+0000 7f22dda60640 1 -- 172.21.15.88:0/969200745 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22d80c4580 con 0x7f22d81570d0 2024-04-26T23:49:41.033 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.026+0000 7f22de261640 1 --2- 172.21.15.88:0/969200745 >> v2:172.21.15.175:3300/0 conn(0x7f22d8150f90 0x7f22d81574b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:49:41.034 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.027+0000 7f22dda60640 1 --2- 172.21.15.88:0/969200745 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f22d81570d0 0x7f22d8150a50 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f22d80c44b0 tx=0x7f22d402a080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c339df790c18dcb8 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:49:41.034 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.027+0000 7f22dca5e640 1 -- 172.21.15.88:0/969200745 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22d4037070 con 0x7f22d81570d0 2024-04-26T23:49:41.034 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.027+0000 7f22dca5e640 1 -- 172.21.15.88:0/969200745 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22d402add0 con 0x7f22d81570d0 2024-04-26T23:49:41.034 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.027+0000 7f22dca5e640 1 -- 172.21.15.88:0/969200745 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22d4032660 con 0x7f22d81570d0 2024-04-26T23:49:41.034 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.028+0000 7f22dfcc4640 1 -- 172.21.15.88:0/969200745 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f22d81570d0 msgr2=0x7f22d8150a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:41.034 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.028+0000 7f22dfcc4640 1 --2- 172.21.15.88:0/969200745 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f22d81570d0 0x7f22d8150a50 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f22d80c44b0 tx=0x7f22d402a080 comp rx=0 tx=0).stop 2024-04-26T23:49:41.034 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.028+0000 7f22dfcc4640 1 -- 172.21.15.88:0/969200745 shutdown_connections 2024-04-26T23:49:41.034 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.028+0000 7f22dfcc4640 1 --2- 172.21.15.88:0/969200745 >> v2:172.21.15.175:3300/0 conn(0x7f22d8150f90 0x7f22d81574b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:41.034 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.028+0000 7f22dfcc4640 1 --2- 172.21.15.88:0/969200745 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f22d81570d0 0x7f22d8150a50 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:41.034 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.028+0000 7f22dfcc4640 1 -- 172.21.15.88:0/969200745 >> 172.21.15.88:0/969200745 conn(0x7f22d806c310 msgr2=0x7f22d806c6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:49:41.034 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.028+0000 7f22dfcc4640 1 -- 172.21.15.88:0/969200745 shutdown_connections 2024-04-26T23:49:41.035 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.028+0000 7f22dfcc4640 1 -- 172.21.15.88:0/969200745 wait complete. 2024-04-26T23:49:41.037 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.029+0000 7f22dfcc4640 1 Processor -- start 2024-04-26T23:49:41.037 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.029+0000 7f22dfcc4640 1 -- start start 2024-04-26T23:49:41.037 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.029+0000 7f22dfcc4640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f22d80ab3f0 0x7f22d80c7bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:41.038 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.029+0000 7f22dfcc4640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f22d8150f90 0x7f22d814e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:41.038 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.030+0000 7f22dfcc4640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f22d81570d0 0x7f22d814b800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:41.038 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.030+0000 7f22dfcc4640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f22d80abbe0 con 0x7f22d8150f90 2024-04-26T23:49:41.038 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.030+0000 7f22dfcc4640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f22d80aba60 con 0x7f22d80ab3f0 2024-04-26T23:49:41.038 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.030+0000 7f22dfcc4640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f22d80c5490 con 0x7f22d81570d0 2024-04-26T23:49:41.038 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.030+0000 7f22dd25f640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f22d8150f90 0x7f22d814e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:41.038 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.030+0000 7f22dd25f640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f22d8150f90 0x7f22d814e4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:59300/0 (socket says 172.21.15.88:59300) 2024-04-26T23:49:41.038 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.030+0000 7f22dd25f640 1 -- 172.21.15.88:0/742882911 learned_addr learned my addr 172.21.15.88:0/742882911 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:49:41.038 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.030+0000 7f22de261640 1 --2- 172.21.15.88:0/742882911 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f22d81570d0 0x7f22d814b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:41.038 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.030+0000 7f22dda60640 1 --2- 172.21.15.88:0/742882911 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f22d80ab3f0 0x7f22d80c7bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:41.038 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.030+0000 7f22dd25f640 1 -- 172.21.15.88:0/742882911 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f22d81570d0 msgr2=0x7f22d814b800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:41.038 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.030+0000 7f22dd25f640 1 --2- 172.21.15.88:0/742882911 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f22d81570d0 0x7f22d814b800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:41.038 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.030+0000 7f22dd25f640 1 -- 172.21.15.88:0/742882911 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f22d80ab3f0 msgr2=0x7f22d80c7bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:41.039 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.030+0000 7f22dd25f640 1 --2- 172.21.15.88:0/742882911 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f22d80ab3f0 0x7f22d80c7bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:41.039 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.030+0000 7f22dd25f640 1 -- 172.21.15.88:0/742882911 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22d80c77d0 con 0x7f22d8150f90 2024-04-26T23:49:41.039 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.030+0000 7f22dda60640 1 --2- 172.21.15.88:0/742882911 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f22d80ab3f0 0x7f22d80c7bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:49:41.039 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.030+0000 7f22dd25f640 1 --2- 172.21.15.88:0/742882911 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f22d8150f90 0x7f22d814e4e0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f22c800c4a0 tx=0x7f22c800c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:49:41.039 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.030+0000 7f22ce7fc640 1 -- 172.21.15.88:0/742882911 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22c8018070 con 0x7f22d8150f90 2024-04-26T23:49:41.039 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.030+0000 7f22ce7fc640 1 -- 172.21.15.88:0/742882911 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22c80074e0 con 0x7f22d8150f90 2024-04-26T23:49:41.039 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.030+0000 7f22ce7fc640 1 -- 172.21.15.88:0/742882911 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22c8004a20 con 0x7f22d8150f90 2024-04-26T23:49:41.039 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.030+0000 7f22dfcc4640 1 -- 172.21.15.88:0/742882911 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22d814ea20 con 0x7f22d8150f90 2024-04-26T23:49:41.039 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.030+0000 7f22dfcc4640 1 -- 172.21.15.88:0/742882911 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22d81eaed0 con 0x7f22d8150f90 2024-04-26T23:49:41.039 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.031+0000 7f22dfcc4640 1 -- 172.21.15.88:0/742882911 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f22d80c9170 con 0x7f22d8150f90 2024-04-26T23:49:41.039 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.031+0000 7f22ce7fc640 1 -- 172.21.15.88:0/742882911 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f22c801b070 con 0x7f22d8150f90 2024-04-26T23:49:41.039 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.032+0000 7f22ce7fc640 1 --2- 172.21.15.88:0/742882911 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f22bc06c920 0x7f22bc06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:41.039 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.032+0000 7f22dda60640 1 --2- 172.21.15.88:0/742882911 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f22bc06c920 0x7f22bc06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:41.040 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.032+0000 7f22ce7fc640 1 -- 172.21.15.88:0/742882911 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6666+0+0 (secure 0 0 0) 0x7f22c808b170 con 0x7f22d8150f90 2024-04-26T23:49:41.040 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.032+0000 7f22dda60640 1 --2- 172.21.15.88:0/742882911 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f22bc06c920 0x7f22bc06ede0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f22d4034000 tx=0x7f22d402e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:49:41.040 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.036+0000 7f22ce7fc640 1 -- 172.21.15.88:0/742882911 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f22c8059270 con 0x7f22d8150f90 2024-04-26T23:49:41.215 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.210+0000 7f22dfcc4640 1 -- 172.21.15.88:0/742882911 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f22d80507a0 con 0x7f22d8150f90 2024-04-26T23:49:41.215 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.210+0000 7f22ce7fc640 1 -- 172.21.15.88:0/742882911 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) ==== 93+0+10 (secure 0 0 0) 0x7f22c8058b70 con 0x7f22d8150f90 2024-04-26T23:49:41.215 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 1 2024-04-26T23:49:41.217 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.212+0000 7f22dfcc4640 1 -- 172.21.15.88:0/742882911 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f22bc06c920 msgr2=0x7f22bc06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:41.217 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.212+0000 7f22dfcc4640 1 --2- 172.21.15.88:0/742882911 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f22bc06c920 0x7f22bc06ede0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f22d4034000 tx=0x7f22d402e000 comp rx=0 tx=0).stop 2024-04-26T23:49:41.217 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.212+0000 7f22dfcc4640 1 -- 172.21.15.88:0/742882911 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f22d8150f90 msgr2=0x7f22d814e4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:41.217 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.212+0000 7f22dfcc4640 1 --2- 172.21.15.88:0/742882911 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f22d8150f90 0x7f22d814e4e0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f22c800c4a0 tx=0x7f22c800c960 comp rx=0 tx=0).stop 2024-04-26T23:49:41.217 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.212+0000 7f22dfcc4640 1 -- 172.21.15.88:0/742882911 shutdown_connections 2024-04-26T23:49:41.218 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.212+0000 7f22dfcc4640 1 --2- 172.21.15.88:0/742882911 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f22bc06c920 0x7f22bc06ede0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:41.218 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.212+0000 7f22dfcc4640 1 --2- 172.21.15.88:0/742882911 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f22d81570d0 0x7f22d814b800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:41.218 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.212+0000 7f22dfcc4640 1 --2- 172.21.15.88:0/742882911 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f22d8150f90 0x7f22d814e4e0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:41.218 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.212+0000 7f22dfcc4640 1 --2- 172.21.15.88:0/742882911 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f22d80ab3f0 0x7f22d80c7bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:41.218 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.212+0000 7f22dfcc4640 1 -- 172.21.15.88:0/742882911 >> 172.21.15.88:0/742882911 conn(0x7f22d806c310 msgr2=0x7f22d806c6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:49:41.218 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.212+0000 7f22dfcc4640 1 -- 172.21.15.88:0/742882911 shutdown_connections 2024-04-26T23:49:41.218 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.212+0000 7f22dfcc4640 1 -- 172.21.15.88:0/742882911 wait complete. 2024-04-26T23:49:41.228 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get a_metadata pg_num 2024-04-26T23:49:41.328 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.323+0000 7fb007314640 1 Processor -- start 2024-04-26T23:49:41.328 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.323+0000 7fb007314640 1 -- start start 2024-04-26T23:49:41.330 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.324+0000 7fb007314640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fb0000c6e20 0x7fb0000c7200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:41.330 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.324+0000 7fb007314640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fb0000740e0 0x7fb000156f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:41.330 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.324+0000 7fb007314640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb0000ca3a0 0x7fb000157460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:41.330 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.324+0000 7fb007314640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7fb000072930 con 0x7fb0000740e0 2024-04-26T23:49:41.331 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.324+0000 7fb007314640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7fb00015a530 con 0x7fb0000c6e20 2024-04-26T23:49:41.331 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.324+0000 7fb007314640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fb00015a810 con 0x7fb0000ca3a0 2024-04-26T23:49:41.331 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.324+0000 7fb0048af640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fb0000740e0 0x7fb000156f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:41.331 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.324+0000 7fb0048af640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fb0000740e0 0x7fb000156f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:59312/0 (socket says 172.21.15.88:59312) 2024-04-26T23:49:41.331 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.324+0000 7fb0048af640 1 -- 172.21.15.88:0/1780116421 learned_addr learned my addr 172.21.15.88:0/1780116421 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:49:41.331 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.324+0000 7fb0058b1640 1 --2- 172.21.15.88:0/1780116421 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb0000ca3a0 0x7fb000157460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:41.331 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.324+0000 7fb0050b0640 1 --2- 172.21.15.88:0/1780116421 >> v2:172.21.15.175:3300/0 conn(0x7fb0000c6e20 0x7fb0000c7200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:41.331 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.324+0000 7fb0048af640 1 -- 172.21.15.88:0/1780116421 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb0000ca3a0 msgr2=0x7fb000157460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:49:41.331 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.324+0000 7fb0048af640 1 --2- 172.21.15.88:0/1780116421 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb0000ca3a0 0x7fb000157460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:41.331 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.324+0000 7fb0048af640 1 -- 172.21.15.88:0/1780116421 >> v2:172.21.15.175:3300/0 conn(0x7fb0000c6e20 msgr2=0x7fb0000c7200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:49:41.331 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.324+0000 7fb0048af640 1 --2- 172.21.15.88:0/1780116421 >> v2:172.21.15.175:3300/0 conn(0x7fb0000c6e20 0x7fb0000c7200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:41.331 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.324+0000 7fb0048af640 1 -- 172.21.15.88:0/1780116421 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb00015aaf0 con 0x7fb0000740e0 2024-04-26T23:49:41.331 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.325+0000 7fb0048af640 1 --2- 172.21.15.88:0/1780116421 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb0000740e0 0x7fb000156f20 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fb0000af0b0 tx=0x7faff002a0b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c811598d35da6777 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:49:41.331 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.325+0000 7faff7fff640 1 -- 172.21.15.88:0/1780116421 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faff0037070 con 0x7fb0000740e0 2024-04-26T23:49:41.332 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.325+0000 7faff7fff640 1 -- 172.21.15.88:0/1780116421 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faff002ae00 con 0x7fb0000740e0 2024-04-26T23:49:41.332 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.325+0000 7faff7fff640 1 -- 172.21.15.88:0/1780116421 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faff0032660 con 0x7fb0000740e0 2024-04-26T23:49:41.332 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.326+0000 7fb007314640 1 -- 172.21.15.88:0/1780116421 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb0000740e0 msgr2=0x7fb000156f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:41.332 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.326+0000 7fb007314640 1 --2- 172.21.15.88:0/1780116421 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb0000740e0 0x7fb000156f20 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fb0000af0b0 tx=0x7faff002a0b0 comp rx=0 tx=0).stop 2024-04-26T23:49:41.332 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.326+0000 7fb007314640 1 -- 172.21.15.88:0/1780116421 shutdown_connections 2024-04-26T23:49:41.332 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.326+0000 7fb007314640 1 --2- 172.21.15.88:0/1780116421 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb0000ca3a0 0x7fb000157460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:41.332 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.326+0000 7fb007314640 1 --2- 172.21.15.88:0/1780116421 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb0000740e0 0x7fb000156f20 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:41.332 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.326+0000 7fb007314640 1 --2- 172.21.15.88:0/1780116421 >> v2:172.21.15.175:3300/0 conn(0x7fb0000c6e20 0x7fb0000c7200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:41.332 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.326+0000 7fb007314640 1 -- 172.21.15.88:0/1780116421 >> 172.21.15.88:0/1780116421 conn(0x7fb0000ae0b0 msgr2=0x7fb0000ae490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:49:41.332 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.326+0000 7fb007314640 1 -- 172.21.15.88:0/1780116421 shutdown_connections 2024-04-26T23:49:41.332 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.326+0000 7fb007314640 1 -- 172.21.15.88:0/1780116421 wait complete. 2024-04-26T23:49:41.336 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.327+0000 7fb007314640 1 Processor -- start 2024-04-26T23:49:41.336 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.327+0000 7fb007314640 1 -- start start 2024-04-26T23:49:41.336 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.327+0000 7fb007314640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb0000740e0 0x7fb0000c25e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:41.336 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.327+0000 7fb007314640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb0000c6e20 0x7fb000146ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:41.336 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.328+0000 7fb007314640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb0000ca3a0 0x7fb000158fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:41.336 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.328+0000 7fb007314640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fb0001543c0 con 0x7fb0000740e0 2024-04-26T23:49:41.336 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.328+0000 7fb007314640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fb0001579a0 con 0x7fb0000ca3a0 2024-04-26T23:49:41.336 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.328+0000 7fb007314640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fb000154540 con 0x7fb0000c6e20 2024-04-26T23:49:41.336 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.328+0000 7fb0050b0640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb0000740e0 0x7fb0000c25e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:41.336 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.328+0000 7fb0050b0640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb0000740e0 0x7fb0000c25e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:59320/0 (socket says 172.21.15.88:59320) 2024-04-26T23:49:41.336 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.328+0000 7fb0050b0640 1 -- 172.21.15.88:0/1122523786 learned_addr learned my addr 172.21.15.88:0/1122523786 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:49:41.337 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.328+0000 7fb0048af640 1 --2- 172.21.15.88:0/1122523786 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb0000c6e20 0x7fb000146ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:41.337 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.328+0000 7fb0058b1640 1 --2- 172.21.15.88:0/1122523786 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb0000ca3a0 0x7fb000158fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:41.337 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.328+0000 7fb0050b0640 1 -- 172.21.15.88:0/1122523786 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb0000c6e20 msgr2=0x7fb000146ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:41.337 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.328+0000 7fb0050b0640 1 --2- 172.21.15.88:0/1122523786 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb0000c6e20 0x7fb000146ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:41.337 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.328+0000 7fb0050b0640 1 -- 172.21.15.88:0/1122523786 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb0000ca3a0 msgr2=0x7fb000158fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:41.337 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.328+0000 7fb0050b0640 1 --2- 172.21.15.88:0/1122523786 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb0000ca3a0 0x7fb000158fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:41.337 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.328+0000 7fb0050b0640 1 -- 172.21.15.88:0/1122523786 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0001ee070 con 0x7fb0000740e0 2024-04-26T23:49:41.337 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.328+0000 7fb0050b0640 1 --2- 172.21.15.88:0/1122523786 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb0000740e0 0x7fb0000c25e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7faff800cbb0 tx=0x7faff800a0f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:49:41.337 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.328+0000 7faff5ffb640 1 -- 172.21.15.88:0/1122523786 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faff8015070 con 0x7fb0000740e0 2024-04-26T23:49:41.337 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.328+0000 7faff5ffb640 1 -- 172.21.15.88:0/1122523786 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faff8003b90 con 0x7fb0000740e0 2024-04-26T23:49:41.337 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.328+0000 7fb007314640 1 -- 172.21.15.88:0/1122523786 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0001ecf50 con 0x7fb0000740e0 2024-04-26T23:49:41.338 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.328+0000 7faff5ffb640 1 -- 172.21.15.88:0/1122523786 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faff800d040 con 0x7fb0000740e0 2024-04-26T23:49:41.338 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.328+0000 7fb007314640 1 -- 172.21.15.88:0/1122523786 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0001584e0 con 0x7fb0000740e0 2024-04-26T23:49:41.338 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.329+0000 7fb007314640 1 -- 172.21.15.88:0/1122523786 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb0000766c0 con 0x7fb0000740e0 2024-04-26T23:49:41.338 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.330+0000 7faff5ffb640 1 -- 172.21.15.88:0/1122523786 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7faff800a920 con 0x7fb0000740e0 2024-04-26T23:49:41.338 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.330+0000 7faff5ffb640 1 --2- 172.21.15.88:0/1122523786 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fafe406c8f0 0x7fafe406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:41.338 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.330+0000 7faff5ffb640 1 -- 172.21.15.88:0/1122523786 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6666+0+0 (secure 0 0 0) 0x7faff808c1f0 con 0x7fb0000740e0 2024-04-26T23:49:41.338 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.330+0000 7fb0048af640 1 --2- 172.21.15.88:0/1122523786 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fafe406c8f0 0x7fafe406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:41.338 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.331+0000 7fb0048af640 1 --2- 172.21.15.88:0/1122523786 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fafe406c8f0 0x7fafe406edb0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7faff0034000 tx=0x7faff002e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:49:41.339 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.334+0000 7faff5ffb640 1 -- 172.21.15.88:0/1122523786 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7faff805a260 con 0x7fb0000740e0 2024-04-26T23:49:41.518 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.513+0000 7fb007314640 1 -- 172.21.15.88:0/1122523786 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "a_metadata", "var": "pg_num"} v 0) -- 0x7fb000158be0 con 0x7fb0000740e0 2024-04-26T23:49:41.518 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.514+0000 7faff5ffb640 1 -- 172.21.15.88:0/1122523786 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "a_metadata", "var": "pg_num"}]=0 v26) ==== 99+0+11 (secure 0 0 0) 0x7faff8059b60 con 0x7fb0000740e0 2024-04-26T23:49:41.518 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 32 2024-04-26T23:49:41.520 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.516+0000 7fb007314640 1 -- 172.21.15.88:0/1122523786 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fafe406c8f0 msgr2=0x7fafe406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:41.521 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.516+0000 7fb007314640 1 --2- 172.21.15.88:0/1122523786 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fafe406c8f0 0x7fafe406edb0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7faff0034000 tx=0x7faff002e000 comp rx=0 tx=0).stop 2024-04-26T23:49:41.521 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.516+0000 7fb007314640 1 -- 172.21.15.88:0/1122523786 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb0000740e0 msgr2=0x7fb0000c25e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:41.521 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.516+0000 7fb007314640 1 --2- 172.21.15.88:0/1122523786 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb0000740e0 0x7fb0000c25e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7faff800cbb0 tx=0x7faff800a0f0 comp rx=0 tx=0).stop 2024-04-26T23:49:41.521 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.516+0000 7fb007314640 1 -- 172.21.15.88:0/1122523786 shutdown_connections 2024-04-26T23:49:41.521 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.516+0000 7fb007314640 1 --2- 172.21.15.88:0/1122523786 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fafe406c8f0 0x7fafe406edb0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:41.521 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.516+0000 7fb007314640 1 --2- 172.21.15.88:0/1122523786 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb0000c6e20 0x7fb000146ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:41.521 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.516+0000 7fb007314640 1 --2- 172.21.15.88:0/1122523786 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb0000ca3a0 0x7fb000158fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:41.521 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.516+0000 7fb007314640 1 --2- 172.21.15.88:0/1122523786 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb0000740e0 0x7fb0000c25e0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:41.521 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.516+0000 7fb007314640 1 -- 172.21.15.88:0/1122523786 >> 172.21.15.88:0/1122523786 conn(0x7fb0000ae0b0 msgr2=0x7fb0000acae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:49:41.521 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.516+0000 7fb007314640 1 -- 172.21.15.88:0/1122523786 shutdown_connections 2024-04-26T23:49:41.521 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.516+0000 7fb007314640 1 -- 172.21.15.88:0/1122523786 wait complete. 2024-04-26T23:49:41.531 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get a_data pg_num 2024-04-26T23:49:41.632 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.627+0000 7f615bec5640 1 Processor -- start 2024-04-26T23:49:41.632 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.627+0000 7f615bec5640 1 -- start start 2024-04-26T23:49:41.634 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.628+0000 7f615bec5640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f6154070c20 0x7f6154158a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:41.634 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.628+0000 7f615bec5640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6154070410 con 0x7f61540c6960 2024-04-26T23:49:41.634 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.628+0000 7f615bec5640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f615406f8b0 con 0x7f61541521f0 2024-04-26T23:49:41.634 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.628+0000 7f615bec5640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f615406f660 con 0x7f6154070c20 2024-04-26T23:49:41.634 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.628+0000 7f615a462640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f6154070c20 0x7f6154158a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:41.634 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.628+0000 7f6159460640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f61540c6960 0x7f6154158370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:51232/0 (socket says 172.21.15.88:51232) 2024-04-26T23:49:41.634 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.628+0000 7f6159460640 1 -- 172.21.15.88:0/1090422892 learned_addr learned my addr 172.21.15.88:0/1090422892 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-26T23:49:41.634 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.628+0000 7f615a462640 1 -- 172.21.15.88:0/1090422892 >> v1:172.21.15.175:6789/0 conn(0x7f61541521f0 legacy=0x7f615406d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:49:41.634 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.628+0000 7f615a462640 1 -- 172.21.15.88:0/1090422892 >> v1:172.21.15.88:6789/0 conn(0x7f61540c6960 legacy=0x7f6154158370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:41.634 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.628+0000 7f615a462640 1 -- 172.21.15.88:0/1090422892 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f615406fb90 con 0x7f6154070c20 2024-04-26T23:49:41.634 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.628+0000 7f6158c5f640 1 -- 172.21.15.88:0/1090422892 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4251675292 0 0) 0x7f6154070410 con 0x7f61540c6960 2024-04-26T23:49:41.635 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.629+0000 7f615a462640 1 --2- 172.21.15.88:0/1090422892 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6154070c20 0x7f6154158a80 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f614c0097a0 tx=0x7f614c02a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6f6f643236a30d2 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:49:41.635 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.629+0000 7f6158c5f640 1 -- 172.21.15.88:0/1090422892 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f614c037070 con 0x7f6154070c20 2024-04-26T23:49:41.635 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.629+0000 7f6158c5f640 1 -- 172.21.15.88:0/1090422892 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f614c02ae50 con 0x7f6154070c20 2024-04-26T23:49:41.635 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.629+0000 7f6158c5f640 1 -- 172.21.15.88:0/1090422892 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f614c032660 con 0x7f6154070c20 2024-04-26T23:49:41.637 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.630+0000 7f615bec5640 1 -- 172.21.15.88:0/1090422892 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6154070c20 msgr2=0x7f6154158a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:41.638 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.630+0000 7f615bec5640 1 --2- 172.21.15.88:0/1090422892 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6154070c20 0x7f6154158a80 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f614c0097a0 tx=0x7f614c02a140 comp rx=0 tx=0).stop 2024-04-26T23:49:41.638 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.630+0000 7f615bec5640 1 -- 172.21.15.88:0/1090422892 shutdown_connections 2024-04-26T23:49:41.638 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.630+0000 7f615bec5640 1 --2- 172.21.15.88:0/1090422892 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6154070c20 0x7f6154158a80 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:41.638 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.630+0000 7f615bec5640 1 -- 172.21.15.88:0/1090422892 >> 172.21.15.88:0/1090422892 conn(0x7f61540c5ce0 msgr2=0x7f61540c60c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:49:41.638 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.630+0000 7f615bec5640 1 -- 172.21.15.88:0/1090422892 shutdown_connections 2024-04-26T23:49:41.638 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.630+0000 7f615bec5640 1 -- 172.21.15.88:0/1090422892 wait complete. 2024-04-26T23:49:41.638 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.631+0000 7f615bec5640 1 Processor -- start 2024-04-26T23:49:41.638 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.631+0000 7f615bec5640 1 -- start start 2024-04-26T23:49:41.638 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.631+0000 7f615bec5640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6154070c20 0x7f6154150b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:41.638 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.631+0000 7f615bec5640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f61540c6960 0x7f61540c33b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:41.638 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.631+0000 7f615bec5640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f61541521f0 0x7f615414bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:41.638 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.631+0000 7f615bec5640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f615406dbb0 con 0x7f61541521f0 2024-04-26T23:49:41.638 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.631+0000 7f615bec5640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f615406da30 con 0x7f61540c6960 2024-04-26T23:49:41.639 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.631+0000 7f615bec5640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f6154070030 con 0x7f6154070c20 2024-04-26T23:49:41.639 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.632+0000 7f615a462640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f61541521f0 0x7f615414bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:41.639 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.632+0000 7f615a462640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f61541521f0 0x7f615414bcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:59326/0 (socket says 172.21.15.88:59326) 2024-04-26T23:49:41.639 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.632+0000 7f615a462640 1 -- 172.21.15.88:0/292740131 learned_addr learned my addr 172.21.15.88:0/292740131 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:49:41.639 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.632+0000 7f6159c61640 1 --2- 172.21.15.88:0/292740131 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6154070c20 0x7f6154150b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:41.639 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.632+0000 7f6159460640 1 --2- 172.21.15.88:0/292740131 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f61540c6960 0x7f61540c33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:41.639 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.632+0000 7f615a462640 1 -- 172.21.15.88:0/292740131 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6154070c20 msgr2=0x7f6154150b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:41.639 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.632+0000 7f615a462640 1 --2- 172.21.15.88:0/292740131 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6154070c20 0x7f6154150b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:41.639 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.632+0000 7f615a462640 1 -- 172.21.15.88:0/292740131 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f61540c6960 msgr2=0x7f61540c33b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:41.639 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.632+0000 7f615a462640 1 --2- 172.21.15.88:0/292740131 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f61540c6960 0x7f61540c33b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:41.639 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.632+0000 7f615a462640 1 -- 172.21.15.88:0/292740131 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61541ed340 con 0x7f61541521f0 2024-04-26T23:49:41.639 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.632+0000 7f615a462640 1 --2- 172.21.15.88:0/292740131 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f61541521f0 0x7f615414bcf0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f614c0097a0 tx=0x7f614c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:49:41.640 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.632+0000 7f614a7fc640 1 -- 172.21.15.88:0/292740131 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f614c037040 con 0x7f61541521f0 2024-04-26T23:49:41.640 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.632+0000 7f614a7fc640 1 -- 172.21.15.88:0/292740131 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f614c004030 con 0x7f61541521f0 2024-04-26T23:49:41.640 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.632+0000 7f615bec5640 1 -- 172.21.15.88:0/292740131 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61541ed620 con 0x7f61541521f0 2024-04-26T23:49:41.640 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.632+0000 7f614a7fc640 1 -- 172.21.15.88:0/292740131 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f614c006e10 con 0x7f61541521f0 2024-04-26T23:49:41.640 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.632+0000 7f615bec5640 1 -- 172.21.15.88:0/292740131 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61541efff0 con 0x7f61541521f0 2024-04-26T23:49:41.640 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.633+0000 7f615bec5640 1 -- 172.21.15.88:0/292740131 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f61540507a0 con 0x7f61541521f0 2024-04-26T23:49:41.641 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.633+0000 7f614a7fc640 1 -- 172.21.15.88:0/292740131 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f614c03d650 con 0x7f61541521f0 2024-04-26T23:49:41.641 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.634+0000 7f614a7fc640 1 --2- 172.21.15.88:0/292740131 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f613806c920 0x7f613806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:41.641 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.634+0000 7f6159c61640 1 --2- 172.21.15.88:0/292740131 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f613806c920 0x7f613806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:41.641 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.634+0000 7f614a7fc640 1 -- 172.21.15.88:0/292740131 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6666+0+0 (secure 0 0 0) 0x7f614c0ac7c0 con 0x7f61541521f0 2024-04-26T23:49:41.641 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.634+0000 7f6159c61640 1 --2- 172.21.15.88:0/292740131 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f613806c920 0x7f613806ede0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f6150009f20 tx=0x7f61500094d0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:49:41.643 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.638+0000 7f614a7fc640 1 -- 172.21.15.88:0/292740131 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f614c042020 con 0x7f61541521f0 2024-04-26T23:49:41.820 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.815+0000 7f615bec5640 1 -- 172.21.15.88:0/292740131 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "a_data", "var": "pg_num"} v 0) -- 0x7f615406f440 con 0x7f61541521f0 2024-04-26T23:49:41.820 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.815+0000 7f614a7fc640 1 -- 172.21.15.88:0/292740131 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "a_data", "var": "pg_num"}]=0 v26) ==== 95+0+11 (secure 0 0 0) 0x7f614c07a7b0 con 0x7f61541521f0 2024-04-26T23:49:41.820 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 64 2024-04-26T23:49:41.822 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.817+0000 7f615bec5640 1 -- 172.21.15.88:0/292740131 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f613806c920 msgr2=0x7f613806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:41.823 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.817+0000 7f615bec5640 1 --2- 172.21.15.88:0/292740131 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f613806c920 0x7f613806ede0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f6150009f20 tx=0x7f61500094d0 comp rx=0 tx=0).stop 2024-04-26T23:49:41.823 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.817+0000 7f615bec5640 1 -- 172.21.15.88:0/292740131 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f61541521f0 msgr2=0x7f615414bcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:41.823 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.817+0000 7f615bec5640 1 --2- 172.21.15.88:0/292740131 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f61541521f0 0x7f615414bcf0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f614c0097a0 tx=0x7f614c0046c0 comp rx=0 tx=0).stop 2024-04-26T23:49:41.823 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.817+0000 7f615bec5640 1 -- 172.21.15.88:0/292740131 shutdown_connections 2024-04-26T23:49:41.823 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.817+0000 7f615bec5640 1 --2- 172.21.15.88:0/292740131 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f613806c920 0x7f613806ede0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:41.823 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.817+0000 7f615bec5640 1 --2- 172.21.15.88:0/292740131 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f61541521f0 0x7f615414bcf0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:41.823 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.817+0000 7f615bec5640 1 --2- 172.21.15.88:0/292740131 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f61540c6960 0x7f61540c33b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:41.823 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.817+0000 7f615bec5640 1 --2- 172.21.15.88:0/292740131 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6154070c20 0x7f6154150b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:41.823 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.817+0000 7f615bec5640 1 -- 172.21.15.88:0/292740131 >> 172.21.15.88:0/292740131 conn(0x7f61540c5ce0 msgr2=0x7f615414d210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:49:41.823 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.818+0000 7f615bec5640 1 -- 172.21.15.88:0/292740131 shutdown_connections 2024-04-26T23:49:41.823 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.818+0000 7f615bec5640 1 -- 172.21.15.88:0/292740131 wait complete. 2024-04-26T23:49:41.833 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get b_metadata pg_num 2024-04-26T23:49:41.933 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.928+0000 7ff05459d640 1 Processor -- start 2024-04-26T23:49:41.933 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.928+0000 7ff05459d640 1 -- start start 2024-04-26T23:49:41.937 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.929+0000 7ff05459d640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7ff04c0c7000 0x7ff04c0ca460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:41.937 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.929+0000 7ff05459d640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff04c156de0 con 0x7ff04c1543f0 2024-04-26T23:49:41.937 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.929+0000 7ff05459d640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff04c157b60 con 0x7ff04c0c9830 2024-04-26T23:49:41.937 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.929+0000 7ff05459d640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7ff04c0cad40 con 0x7ff04c0c7000 2024-04-26T23:49:41.938 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.929+0000 7ff052b3a640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7ff04c1543f0 0x7ff04c072930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:51238/0 (socket says 172.21.15.88:51238) 2024-04-26T23:49:41.938 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.929+0000 7ff052b3a640 1 -- 172.21.15.88:0/2502409293 learned_addr learned my addr 172.21.15.88:0/2502409293 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-26T23:49:41.938 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.929+0000 7ff051337640 1 -- 172.21.15.88:0/2502409293 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1589127888 0 0) 0x7ff04c156de0 con 0x7ff04c1543f0 2024-04-26T23:49:41.938 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.929+0000 7ff051337640 1 -- 172.21.15.88:0/2502409293 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff038003520 con 0x7ff04c1543f0 2024-04-26T23:49:41.938 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.929+0000 7ff052339640 1 --2- 172.21.15.88:0/2502409293 >> v2:172.21.15.175:3300/0 conn(0x7ff04c0c7000 0x7ff04c0ca460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:41.938 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.930+0000 7ff051337640 1 -- 172.21.15.88:0/2502409293 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3657633875 0 0) 0x7ff038003520 con 0x7ff04c1543f0 2024-04-26T23:49:41.938 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.930+0000 7ff051337640 1 -- 172.21.15.88:0/2502409293 >> v2:172.21.15.175:3300/0 conn(0x7ff04c0c7000 msgr2=0x7ff04c0ca460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:49:41.938 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.930+0000 7ff051337640 1 --2- 172.21.15.88:0/2502409293 >> v2:172.21.15.175:3300/0 conn(0x7ff04c0c7000 0x7ff04c0ca460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:41.938 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.930+0000 7ff051337640 1 -- 172.21.15.88:0/2502409293 >> v1:172.21.15.175:6789/0 conn(0x7ff04c0c9830 legacy=0x7ff04c153ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:41.938 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.930+0000 7ff051337640 1 -- 172.21.15.88:0/2502409293 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff04c157080 con 0x7ff04c1543f0 2024-04-26T23:49:41.938 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.930+0000 7ff051337640 1 -- 172.21.15.88:0/2502409293 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 356324787 0 0) 0x7ff044001690 con 0x7ff04c1543f0 2024-04-26T23:49:41.938 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.930+0000 7ff051337640 1 -- 172.21.15.88:0/2502409293 >> v1:172.21.15.88:6789/0 conn(0x7ff04c1543f0 legacy=0x7ff04c072930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:41.938 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.930+0000 7ff051337640 1 --2- 172.21.15.88:0/2502409293 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff0380039b0 0x7ff038003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:41.939 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.930+0000 7ff051337640 1 --2- 172.21.15.88:0/2502409293 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff038004800 0x7ff038004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:41.939 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.930+0000 7ff051337640 1 --2- 172.21.15.88:0/2502409293 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff0380051c0 0x7ff03800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:41.939 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.930+0000 7ff051337640 1 -- 172.21.15.88:0/2502409293 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7ff04c0cad40 con 0x7ff038004800 2024-04-26T23:49:41.939 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.930+0000 7ff051337640 1 -- 172.21.15.88:0/2502409293 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff03800c110 con 0x7ff0380039b0 2024-04-26T23:49:41.939 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.930+0000 7ff051337640 1 -- 172.21.15.88:0/2502409293 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7ff03800c310 con 0x7ff0380051c0 2024-04-26T23:49:41.939 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.930+0000 7ff052339640 1 --2- 172.21.15.88:0/2502409293 >> v2:172.21.15.175:3300/0 conn(0x7ff04c0c7000 0x7ff04c0ca460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:49:41.939 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.930+0000 7ff051b38640 1 --2- 172.21.15.88:0/2502409293 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff038004800 0x7ff038004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:41.939 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.930+0000 7ff052b3a640 1 --2- 172.21.15.88:0/2502409293 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff0380051c0 0x7ff03800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:41.939 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.930+0000 7ff052339640 1 --2- 172.21.15.88:0/2502409293 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff0380039b0 0x7ff038003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:41.939 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.930+0000 7ff051b38640 1 -- 172.21.15.88:0/2502409293 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff0380051c0 msgr2=0x7ff03800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:49:41.939 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.930+0000 7ff051b38640 1 --2- 172.21.15.88:0/2502409293 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff0380051c0 0x7ff03800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:41.939 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.930+0000 7ff051b38640 1 -- 172.21.15.88:0/2502409293 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff0380039b0 msgr2=0x7ff038003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:49:41.939 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.930+0000 7ff051b38640 1 --2- 172.21.15.88:0/2502409293 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff0380039b0 0x7ff038003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:41.939 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.930+0000 7ff051b38640 1 -- 172.21.15.88:0/2502409293 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff038003520 con 0x7ff038004800 2024-04-26T23:49:41.940 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.930+0000 7ff052b3a640 1 -- 172.21.15.88:0/2502409293 reap_dead start 2024-04-26T23:49:41.940 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.930+0000 7ff052339640 1 --2- 172.21.15.88:0/2502409293 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff0380039b0 0x7ff038003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:49:41.940 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.931+0000 7ff051b38640 1 --2- 172.21.15.88:0/2502409293 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff038004800 0x7ff038004c80 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7ff03c001720 tx=0x7ff038005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a1ca5e6f52eef46 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:49:41.940 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.931+0000 7ff051337640 1 -- 172.21.15.88:0/2502409293 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff03c001370 con 0x7ff038004800 2024-04-26T23:49:41.940 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.931+0000 7ff051337640 1 -- 172.21.15.88:0/2502409293 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff03c0052d0 con 0x7ff038004800 2024-04-26T23:49:41.940 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.931+0000 7ff051337640 1 -- 172.21.15.88:0/2502409293 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff03c02ab90 con 0x7ff038004800 2024-04-26T23:49:41.940 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.931+0000 7ff05459d640 1 -- 172.21.15.88:0/2502409293 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff038004800 msgr2=0x7ff038004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:41.940 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.931+0000 7ff05459d640 1 --2- 172.21.15.88:0/2502409293 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff038004800 0x7ff038004c80 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7ff03c001720 tx=0x7ff038005830 comp rx=0 tx=0).stop 2024-04-26T23:49:41.940 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.932+0000 7ff05459d640 1 -- 172.21.15.88:0/2502409293 shutdown_connections 2024-04-26T23:49:41.940 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.932+0000 7ff05459d640 1 --2- 172.21.15.88:0/2502409293 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff038004800 0x7ff038004c80 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:41.940 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.932+0000 7ff05459d640 1 -- 172.21.15.88:0/2502409293 >> 172.21.15.88:0/2502409293 conn(0x7ff04c0adf20 msgr2=0x7ff04c0ae330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:49:41.940 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.932+0000 7ff05459d640 1 -- 172.21.15.88:0/2502409293 shutdown_connections 2024-04-26T23:49:41.940 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.932+0000 7ff05459d640 1 -- 172.21.15.88:0/2502409293 wait complete. 2024-04-26T23:49:41.941 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.933+0000 7ff05459d640 1 Processor -- start 2024-04-26T23:49:41.941 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.933+0000 7ff05459d640 1 -- start start 2024-04-26T23:49:41.943 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.933+0000 7ff05459d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff038004800 0x7ff04c1e3640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:41.943 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.933+0000 7ff05459d640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff04c0c5160 0x7ff04c1f0120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:41.943 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.933+0000 7ff05459d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff04c0c2cd0 0x7ff04c14d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:41.943 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.933+0000 7ff05459d640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7ff04c0c73e0 con 0x7ff038004800 2024-04-26T23:49:41.944 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.933+0000 7ff05459d640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff04c157640 con 0x7ff04c0c2cd0 2024-04-26T23:49:41.944 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.933+0000 7ff05459d640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7ff04c0c7560 con 0x7ff04c0c5160 2024-04-26T23:49:41.944 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.933+0000 7ff052339640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff038004800 0x7ff04c1e3640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:41.944 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.933+0000 7ff052339640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff038004800 0x7ff04c1e3640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:59338/0 (socket says 172.21.15.88:59338) 2024-04-26T23:49:41.944 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.933+0000 7ff052339640 1 -- 172.21.15.88:0/1695334751 learned_addr learned my addr 172.21.15.88:0/1695334751 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:49:41.944 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.934+0000 7ff051b38640 1 --2- 172.21.15.88:0/1695334751 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff04c0c5160 0x7ff04c1f0120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:41.944 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.934+0000 7ff052b3a640 1 --2- 172.21.15.88:0/1695334751 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff04c0c2cd0 0x7ff04c14d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:41.944 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.934+0000 7ff052339640 1 -- 172.21.15.88:0/1695334751 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff04c0c5160 msgr2=0x7ff04c1f0120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:41.944 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.934+0000 7ff052339640 1 --2- 172.21.15.88:0/1695334751 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff04c0c5160 0x7ff04c1f0120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:41.944 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.934+0000 7ff052339640 1 -- 172.21.15.88:0/1695334751 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff04c0c2cd0 msgr2=0x7ff04c14d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:41.944 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.934+0000 7ff052339640 1 --2- 172.21.15.88:0/1695334751 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff04c0c2cd0 0x7ff04c14d1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:41.944 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.934+0000 7ff052339640 1 -- 172.21.15.88:0/1695334751 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff04c1ecda0 con 0x7ff038004800 2024-04-26T23:49:41.944 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.934+0000 7ff052339640 1 --2- 172.21.15.88:0/1695334751 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff038004800 0x7ff04c1e3640 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7ff048007ea0 tx=0x7ff048007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:49:41.945 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.934+0000 7ff042ffd640 1 -- 172.21.15.88:0/1695334751 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff048003b90 con 0x7ff038004800 2024-04-26T23:49:41.945 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.934+0000 7ff042ffd640 1 -- 172.21.15.88:0/1695334751 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff04800fe90 con 0x7ff038004800 2024-04-26T23:49:41.945 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.934+0000 7ff05459d640 1 -- 172.21.15.88:0/1695334751 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff04c0c6110 con 0x7ff038004800 2024-04-26T23:49:41.945 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.934+0000 7ff042ffd640 1 -- 172.21.15.88:0/1695334751 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff048004030 con 0x7ff038004800 2024-04-26T23:49:41.945 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.934+0000 7ff05459d640 1 -- 172.21.15.88:0/1695334751 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff04c1e3b80 con 0x7ff038004800 2024-04-26T23:49:41.945 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.935+0000 7ff05459d640 1 -- 172.21.15.88:0/1695334751 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff04c1ecbb0 con 0x7ff038004800 2024-04-26T23:49:41.945 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.935+0000 7ff042ffd640 1 -- 172.21.15.88:0/1695334751 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff0480041d0 con 0x7ff038004800 2024-04-26T23:49:41.945 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.936+0000 7ff042ffd640 1 --2- 172.21.15.88:0/1695334751 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7ff03006c920 0x7ff03006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:41.945 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.936+0000 7ff051b38640 1 --2- 172.21.15.88:0/1695334751 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7ff03006c920 0x7ff03006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:41.945 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.936+0000 7ff042ffd640 1 -- 172.21.15.88:0/1695334751 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6666+0+0 (secure 0 0 0) 0x7ff04808cc80 con 0x7ff038004800 2024-04-26T23:49:41.945 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.936+0000 7ff051b38640 1 --2- 172.21.15.88:0/1695334751 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7ff03006c920 0x7ff03006ede0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7ff03c032000 tx=0x7ff03c02e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:49:41.946 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:41.940+0000 7ff042ffd640 1 -- 172.21.15.88:0/1695334751 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7ff04805ad80 con 0x7ff038004800 2024-04-26T23:49:42.121 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:42.116+0000 7ff05459d640 1 -- 172.21.15.88:0/1695334751 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "b_metadata", "var": "pg_num"} v 0) -- 0x7ff04c0766c0 con 0x7ff038004800 2024-04-26T23:49:42.121 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:42.117+0000 7ff042ffd640 1 -- 172.21.15.88:0/1695334751 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "b_metadata", "var": "pg_num"}]=0 v26) ==== 99+0+11 (secure 0 0 0) 0x7ff04805a680 con 0x7ff038004800 2024-04-26T23:49:42.121 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 32 2024-04-26T23:49:42.124 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:42.119+0000 7ff05459d640 1 -- 172.21.15.88:0/1695334751 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7ff03006c920 msgr2=0x7ff03006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:42.124 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:42.119+0000 7ff05459d640 1 --2- 172.21.15.88:0/1695334751 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7ff03006c920 0x7ff03006ede0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7ff03c032000 tx=0x7ff03c02e000 comp rx=0 tx=0).stop 2024-04-26T23:49:42.124 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:42.119+0000 7ff05459d640 1 -- 172.21.15.88:0/1695334751 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff038004800 msgr2=0x7ff04c1e3640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:42.124 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:42.119+0000 7ff05459d640 1 --2- 172.21.15.88:0/1695334751 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff038004800 0x7ff04c1e3640 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7ff048007ea0 tx=0x7ff048007f90 comp rx=0 tx=0).stop 2024-04-26T23:49:42.124 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:42.119+0000 7ff05459d640 1 -- 172.21.15.88:0/1695334751 shutdown_connections 2024-04-26T23:49:42.124 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:42.119+0000 7ff05459d640 1 --2- 172.21.15.88:0/1695334751 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7ff03006c920 0x7ff03006ede0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:42.124 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:42.119+0000 7ff05459d640 1 --2- 172.21.15.88:0/1695334751 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff04c0c5160 0x7ff04c1f0120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:42.124 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:42.119+0000 7ff05459d640 1 --2- 172.21.15.88:0/1695334751 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff04c0c2cd0 0x7ff04c14d1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:42.124 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:42.119+0000 7ff05459d640 1 --2- 172.21.15.88:0/1695334751 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff038004800 0x7ff04c1e3640 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:42.124 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:42.119+0000 7ff05459d640 1 -- 172.21.15.88:0/1695334751 >> 172.21.15.88:0/1695334751 conn(0x7ff04c0adf20 msgr2=0x7ff04c0ae4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:49:42.124 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:42.119+0000 7ff05459d640 1 -- 172.21.15.88:0/1695334751 shutdown_connections 2024-04-26T23:49:42.124 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:42.119+0000 7ff05459d640 1 -- 172.21.15.88:0/1695334751 wait complete. 2024-04-26T23:49:42.134 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get b_data pg_num 2024-04-26T23:49:42.233 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:42.229+0000 7fa3436cc640 1 Processor -- start 2024-04-26T23:49:42.234 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:42.229+0000 7fa3436cc640 1 -- start start 2024-04-26T23:49:42.237 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:42.230+0000 7fa3436cc640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa33c0c6e20 0x7fa33c0c7200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:42.237 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:42.230+0000 7fa3436cc640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fa33c0ca3a0 0x7fa33c157630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:42.237 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:42.230+0000 7fa3436cc640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa33c15a530 con 0x7fa33c0740e0 2024-04-26T23:49:42.237 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:42.230+0000 7fa3436cc640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7fa33c072930 con 0x7fa33c0ca3a0 2024-04-26T23:49:42.237 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:42.230+0000 7fa3436cc640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fa33c15a810 con 0x7fa33c0c6e20 2024-04-26T23:49:42.237 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:42.230+0000 7fa340c67640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fa33c0740e0 0x7fa33c156f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:51246/0 (socket says 172.21.15.88:51246) 2024-04-26T23:49:42.237 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:42.230+0000 7fa340c67640 1 -- 172.21.15.88:0/1169330716 learned_addr learned my addr 172.21.15.88:0/1169330716 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-26T23:49:42.237 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:42.230+0000 7fa341c69640 1 --2- 172.21.15.88:0/1169330716 >> v2:172.21.15.175:3300/0 conn(0x7fa33c0ca3a0 0x7fa33c157630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:42.238 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:42.230+0000 7fa341468640 1 --2- 172.21.15.88:0/1169330716 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa33c0c6e20 0x7fa33c0c7200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:42.238 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:42.230+0000 7fa333fff640 1 -- 172.21.15.88:0/1169330716 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2814617732 0 0) 0x7fa33c15a530 con 0x7fa33c0740e0 2024-04-26T23:49:42.238 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:42.230+0000 7fa333fff640 1 -- 172.21.15.88:0/1169330716 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa328003520 con 0x7fa33c0740e0 2024-04-26T23:49:42.238 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:42.230+0000 7fa333fff640 1 -- 172.21.15.88:0/1169330716 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 22416889 0 0) 0x7fa328003520 con 0x7fa33c0740e0 2024-04-26T23:49:42.238 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:42.230+0000 7fa333fff640 1 -- 172.21.15.88:0/1169330716 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa33c0c6e20 msgr2=0x7fa33c0c7200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:49:42.238 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:42.230+0000 7fa333fff640 1 --2- 172.21.15.88:0/1169330716 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa33c0c6e20 0x7fa33c0c7200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:42.238 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:42.230+0000 7fa333fff640 1 -- 172.21.15.88:0/1169330716 >> v2:172.21.15.175:3300/0 conn(0x7fa33c0ca3a0 msgr2=0x7fa33c157630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:49:42.238 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:42.230+0000 7fa333fff640 1 --2- 172.21.15.88:0/1169330716 >> v2:172.21.15.175:3300/0 conn(0x7fa33c0ca3a0 0x7fa33c157630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:42.238 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:42.230+0000 7fa333fff640 1 -- 172.21.15.88:0/1169330716 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa33c15aaf0 con 0x7fa33c0740e0 2024-04-26T23:49:42.238 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:42.230+0000 7fa333fff640 1 -- 172.21.15.88:0/1169330716 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 356324787 0 0) 0x7fa32c001670 con 0x7fa33c0740e0 2024-04-26T23:49:42.238 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:42.230+0000 7fa333fff640 1 -- 172.21.15.88:0/1169330716 >> v1:172.21.15.88:6789/0 conn(0x7fa33c0740e0 legacy=0x7fa33c156f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:42.238 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:42.230+0000 7fa333fff640 1 --2- 172.21.15.88:0/1169330716 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa3280039b0 0x7fa328003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:42.238 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:42.231+0000 7fa333fff640 1 --2- 172.21.15.88:0/1169330716 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa33c0c6e20 0x7fa328004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:42.239 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:42.231+0000 7fa333fff640 1 --2- 172.21.15.88:0/1169330716 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa328004d40 0x7fa3280051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:42.239 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:42.231+0000 7fa333fff640 1 -- 172.21.15.88:0/1169330716 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fa33c15a810 con 0x7fa328004d40 2024-04-26T23:49:42.239 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:42.231+0000 7fa333fff640 1 -- 172.21.15.88:0/1169330716 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fa32800b9c0 con 0x7fa3280039b0 2024-04-26T23:49:42.239 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:42.231+0000 7fa333fff640 1 -- 172.21.15.88:0/1169330716 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fa32800bb40 con 0x7fa33c0c6e20 2024-04-26T23:49:42.239 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:42.231+0000 7fa341c69640 1 --2- 172.21.15.88:0/1169330716 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa328004d40 0x7fa3280051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:42.239 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:42.231+0000 7fa341468640 1 --2- 172.21.15.88:0/1169330716 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa3280039b0 0x7fa328003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:42.239 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:42.231+0000 7fa340c67640 1 --2- 172.21.15.88:0/1169330716 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa33c0c6e20 0x7fa328004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:42.239 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:42.231+0000 7fa341c69640 1 -- 172.21.15.88:0/1169330716 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa33c0c6e20 msgr2=0x7fa328004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:49:42.239 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:42.231+0000 7fa341c69640 1 --2- 172.21.15.88:0/1169330716 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa33c0c6e20 0x7fa328004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:42.239 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:42.231+0000 7fa341c69640 1 -- 172.21.15.88:0/1169330716 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa3280039b0 msgr2=0x7fa328003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:49:42.239 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:42.231+0000 7fa341c69640 1 --2- 172.21.15.88:0/1169330716 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa3280039b0 0x7fa328003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:42.239 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:42.231+0000 7fa341c69640 1 -- 172.21.15.88:0/1169330716 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa328003520 con 0x7fa328004d40 2024-04-26T23:49:42.239 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:42.232+0000 7fa341c69640 1 --2- 172.21.15.88:0/1169330716 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa328004d40 0x7fa3280051c0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fa338009ac0 tx=0x7fa328005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3821d8878bc2847 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:49:42.239 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:42.232+0000 7fa333fff640 1 -- 172.21.15.88:0/1169330716 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa338036070 con 0x7fa328004d40 2024-04-26T23:49:42.240 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:42.232+0000 7fa333fff640 1 -- 172.21.15.88:0/1169330716 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa338031400 con 0x7fa328004d40 2024-04-26T23:49:42.240 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:42.232+0000 7fa333fff640 1 -- 172.21.15.88:0/1169330716 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa338009690 con 0x7fa328004d40 2024-04-26T23:49:42.240 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:42.232+0000 7fa3436cc640 1 -- 172.21.15.88:0/1169330716 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa328004d40 msgr2=0x7fa3280051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:42.240 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:42.232+0000 7fa3436cc640 1 --2- 172.21.15.88:0/1169330716 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa328004d40 0x7fa3280051c0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fa338009ac0 tx=0x7fa328005830 comp rx=0 tx=0).stop 2024-04-26T23:49:42.240 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:42.232+0000 7fa341c69640 1 -- 172.21.15.88:0/1169330716 reap_dead start 2024-04-26T23:49:42.240 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:42.232+0000 7fa3436cc640 1 -- 172.21.15.88:0/1169330716 shutdown_connections 2024-04-26T23:49:42.240 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:42.232+0000 7fa3436cc640 1 -- 172.21.15.88:0/1169330716 >> 172.21.15.88:0/1169330716 conn(0x7fa33c0ae0b0 msgr2=0x7fa33c0ae490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:49:42.240 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:42.232+0000 7fa3436cc640 1 -- 172.21.15.88:0/1169330716 shutdown_connections 2024-04-26T23:49:42.240 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:42.232+0000 7fa3436cc640 1 -- 172.21.15.88:0/1169330716 wait complete. 2024-04-26T23:49:42.243 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:42.233+0000 7fa3436cc640 1 Processor -- start 2024-04-26T23:49:42.243 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:42.234+0000 7fa3436cc640 1 -- start start 2024-04-26T23:49:42.243 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:42.234+0000 7fa3436cc640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa328004d40 0x7fa33c0ad310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:42.243 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:42.234+0000 7fa3436cc640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa33c158380 0x7fa33c142d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:42.243 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:42.234+0000 7fa3436cc640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa33c157f30 0x7fa33c143250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:42.244 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:42.234+0000 7fa3436cc640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fa33c154540 con 0x7fa33c158380 2024-04-26T23:49:42.244 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:42.234+0000 7fa3436cc640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fa33c1543c0 con 0x7fa33c157f30 2024-04-26T23:49:42.244 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:42.234+0000 7fa3436cc640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fa33c15a0c0 con 0x7fa328004d40 2024-04-26T23:49:42.244 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:42.234+0000 7fa340c67640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa33c158380 0x7fa33c142d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:42.244 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:42.234+0000 7fa340c67640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa33c158380 0x7fa33c142d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:59356/0 (socket says 172.21.15.88:59356) 2024-04-26T23:49:42.244 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:42.234+0000 7fa340c67640 1 -- 172.21.15.88:0/3706068225 learned_addr learned my addr 172.21.15.88:0/3706068225 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:49:42.244 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:42.234+0000 7fa341468640 1 --2- 172.21.15.88:0/3706068225 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa328004d40 0x7fa33c0ad310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:42.244 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:42.234+0000 7fa341c69640 1 --2- 172.21.15.88:0/3706068225 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa33c157f30 0x7fa33c143250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:42.244 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:42.234+0000 7fa340c67640 1 -- 172.21.15.88:0/3706068225 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa328004d40 msgr2=0x7fa33c0ad310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:42.244 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:42.234+0000 7fa340c67640 1 --2- 172.21.15.88:0/3706068225 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa328004d40 0x7fa33c0ad310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:42.244 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:42.235+0000 7fa340c67640 1 -- 172.21.15.88:0/3706068225 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa33c157f30 msgr2=0x7fa33c143250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:42.244 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:42.235+0000 7fa340c67640 1 --2- 172.21.15.88:0/3706068225 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa33c157f30 0x7fa33c143250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:42.244 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:42.235+0000 7fa340c67640 1 -- 172.21.15.88:0/3706068225 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa33c1efa90 con 0x7fa33c158380 2024-04-26T23:49:42.244 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:42.235+0000 7fa341c69640 1 --2- 172.21.15.88:0/3706068225 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa33c157f30 0x7fa33c143250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:49:42.245 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:42.235+0000 7fa340c67640 1 --2- 172.21.15.88:0/3706068225 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa33c158380 0x7fa33c142d10 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fa32c007340 tx=0x7fa32c007800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:49:42.245 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:42.235+0000 7fa331ffb640 1 -- 172.21.15.88:0/3706068225 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa32c00fa00 con 0x7fa33c158380 2024-04-26T23:49:42.245 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:42.235+0000 7fa331ffb640 1 -- 172.21.15.88:0/3706068225 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa32c018070 con 0x7fa33c158380 2024-04-26T23:49:42.245 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:42.235+0000 7fa3436cc640 1 -- 172.21.15.88:0/3706068225 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa33c1efd30 con 0x7fa33c158380 2024-04-26T23:49:42.245 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:42.235+0000 7fa331ffb640 1 -- 172.21.15.88:0/3706068225 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa32c00fde0 con 0x7fa33c158380 2024-04-26T23:49:42.245 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:42.235+0000 7fa3436cc640 1 -- 172.21.15.88:0/3706068225 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa33c1f02f0 con 0x7fa33c158380 2024-04-26T23:49:42.245 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:42.236+0000 7fa3436cc640 1 -- 172.21.15.88:0/3706068225 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa33c0766c0 con 0x7fa33c158380 2024-04-26T23:49:42.245 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:42.236+0000 7fa331ffb640 1 -- 172.21.15.88:0/3706068225 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa32c01d460 con 0x7fa33c158380 2024-04-26T23:49:42.245 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:42.237+0000 7fa331ffb640 1 --2- 172.21.15.88:0/3706068225 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fa32006c8f0 0x7fa32006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:42.245 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:42.237+0000 7fa331ffb640 1 -- 172.21.15.88:0/3706068225 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6666+0+0 (secure 0 0 0) 0x7fa32c08bfd0 con 0x7fa33c158380 2024-04-26T23:49:42.245 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:42.237+0000 7fa341468640 1 --2- 172.21.15.88:0/3706068225 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fa32006c8f0 0x7fa32006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:42.245 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:42.237+0000 7fa341468640 1 --2- 172.21.15.88:0/3706068225 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fa32006c8f0 0x7fa32006edb0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fa33c0b2370 tx=0x7fa33400b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:49:42.246 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:42.241+0000 7fa331ffb640 1 -- 172.21.15.88:0/3706068225 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fa32c05a0d0 con 0x7fa33c158380 2024-04-26T23:49:42.421 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:42.416+0000 7fa3436cc640 1 -- 172.21.15.88:0/3706068225 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "b_data", "var": "pg_num"} v 0) -- 0x7fa33c0507a0 con 0x7fa33c158380 2024-04-26T23:49:42.421 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:42.417+0000 7fa331ffb640 1 -- 172.21.15.88:0/3706068225 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "b_data", "var": "pg_num"}]=0 v26) ==== 95+0+11 (secure 0 0 0) 0x7fa32c0599d0 con 0x7fa33c158380 2024-04-26T23:49:42.421 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 64 2024-04-26T23:49:42.423 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:42.418+0000 7fa3436cc640 1 -- 172.21.15.88:0/3706068225 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fa32006c8f0 msgr2=0x7fa32006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:42.424 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:42.418+0000 7fa3436cc640 1 --2- 172.21.15.88:0/3706068225 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fa32006c8f0 0x7fa32006edb0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fa33c0b2370 tx=0x7fa33400b040 comp rx=0 tx=0).stop 2024-04-26T23:49:42.424 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:42.419+0000 7fa3436cc640 1 -- 172.21.15.88:0/3706068225 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa33c158380 msgr2=0x7fa33c142d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:42.424 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:42.419+0000 7fa3436cc640 1 --2- 172.21.15.88:0/3706068225 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa33c158380 0x7fa33c142d10 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fa32c007340 tx=0x7fa32c007800 comp rx=0 tx=0).stop 2024-04-26T23:49:42.424 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:42.419+0000 7fa3436cc640 1 -- 172.21.15.88:0/3706068225 shutdown_connections 2024-04-26T23:49:42.424 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:42.419+0000 7fa3436cc640 1 --2- 172.21.15.88:0/3706068225 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fa32006c8f0 0x7fa32006edb0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:42.424 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:42.419+0000 7fa3436cc640 1 --2- 172.21.15.88:0/3706068225 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa33c157f30 0x7fa33c143250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:42.424 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:42.419+0000 7fa3436cc640 1 --2- 172.21.15.88:0/3706068225 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa33c158380 0x7fa33c142d10 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:42.424 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:42.419+0000 7fa3436cc640 1 --2- 172.21.15.88:0/3706068225 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa328004d40 0x7fa33c0ad310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:42.424 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:42.419+0000 7fa3436cc640 1 -- 172.21.15.88:0/3706068225 >> 172.21.15.88:0/3706068225 conn(0x7fa33c0ae0b0 msgr2=0x7fa33c0c7200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:49:42.424 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:42.419+0000 7fa3436cc640 1 -- 172.21.15.88:0/3706068225 shutdown_connections 2024-04-26T23:49:42.424 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:42.419+0000 7fa3436cc640 1 -- 172.21.15.88:0/3706068225 wait complete. 2024-04-26T23:49:42.435 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-26T23:49:42.533 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:42.528+0000 7f3586b96640 1 Processor -- start 2024-04-26T23:49:42.533 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:42.528+0000 7f3586b96640 1 -- start start 2024-04-26T23:49:42.535 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:42.529+0000 7f3586b96640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f358013feb0 0x7f35801576d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:42.535 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:42.529+0000 7f3586b96640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f35800c5050 0x7f358015a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:42.535 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:42.529+0000 7f3586b96640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3580156c10 con 0x7f35800c2b80 2024-04-26T23:49:42.536 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:42.529+0000 7f3586b96640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f3580157240 con 0x7f358013feb0 2024-04-26T23:49:42.536 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:42.529+0000 7f3586b96640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f35800c5570 con 0x7f35800c5050 2024-04-26T23:49:42.536 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:42.529+0000 7f3584932640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f358013feb0 0x7f35801576d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:42.536 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:42.529+0000 7f3584932640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f358013feb0 0x7f35801576d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:59360/0 (socket says 172.21.15.88:59360) 2024-04-26T23:49:42.536 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:42.529+0000 7f3584932640 1 -- 172.21.15.88:0/4025039297 learned_addr learned my addr 172.21.15.88:0/4025039297 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:49:42.536 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:42.529+0000 7f357ffff640 1 --2- 172.21.15.88:0/4025039297 >> v2:172.21.15.175:3300/0 conn(0x7f35800c5050 0x7f358015a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:42.536 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:42.529+0000 7f3584932640 1 -- 172.21.15.88:0/4025039297 >> v2:172.21.15.175:3300/0 conn(0x7f35800c5050 msgr2=0x7f358015a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:49:42.536 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:42.529+0000 7f3584932640 1 --2- 172.21.15.88:0/4025039297 >> v2:172.21.15.175:3300/0 conn(0x7f35800c5050 0x7f358015a1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:42.536 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:42.529+0000 7f3584932640 1 -- 172.21.15.88:0/4025039297 >> v1:172.21.15.175:6789/0 conn(0x7f35800c2b80 legacy=0x7f358006d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:49:42.536 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:42.529+0000 7f3584932640 1 -- 172.21.15.88:0/4025039297 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35800c5850 con 0x7f358013feb0 2024-04-26T23:49:42.536 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:42.529+0000 7f357ffff640 1 --2- 172.21.15.88:0/4025039297 >> v2:172.21.15.175:3300/0 conn(0x7f35800c5050 0x7f358015a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:49:42.536 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:42.530+0000 7f3584932640 1 --2- 172.21.15.88:0/4025039297 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f358013feb0 0x7f35801576d0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f3580070760 tx=0x7f357402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=401e55628e775e57 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:49:42.536 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:42.530+0000 7f357f7fe640 1 -- 172.21.15.88:0/4025039297 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3574037070 con 0x7f358013feb0 2024-04-26T23:49:42.536 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:42.530+0000 7f357f7fe640 1 -- 172.21.15.88:0/4025039297 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f357402ae20 con 0x7f358013feb0 2024-04-26T23:49:42.536 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:42.530+0000 7f357f7fe640 1 -- 172.21.15.88:0/4025039297 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3574032660 con 0x7f358013feb0 2024-04-26T23:49:42.537 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:42.530+0000 7f3586b96640 1 -- 172.21.15.88:0/4025039297 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f358013feb0 msgr2=0x7f35801576d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:42.537 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:42.530+0000 7f3586b96640 1 --2- 172.21.15.88:0/4025039297 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f358013feb0 0x7f35801576d0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f3580070760 tx=0x7f357402a110 comp rx=0 tx=0).stop 2024-04-26T23:49:42.537 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:42.530+0000 7f3586b96640 1 -- 172.21.15.88:0/4025039297 shutdown_connections 2024-04-26T23:49:42.537 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:42.530+0000 7f3586b96640 1 --2- 172.21.15.88:0/4025039297 >> v2:172.21.15.175:3300/0 conn(0x7f35800c5050 0x7f358015a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:42.537 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:42.530+0000 7f3586b96640 1 --2- 172.21.15.88:0/4025039297 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f358013feb0 0x7f35801576d0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:42.537 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:42.530+0000 7f3586b96640 1 -- 172.21.15.88:0/4025039297 >> 172.21.15.88:0/4025039297 conn(0x7f35800c5ce0 msgr2=0x7f35800c60c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:49:42.537 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:42.531+0000 7f3586b96640 1 -- 172.21.15.88:0/4025039297 shutdown_connections 2024-04-26T23:49:42.537 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:42.531+0000 7f3586b96640 1 -- 172.21.15.88:0/4025039297 wait complete. 2024-04-26T23:49:42.540 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:42.532+0000 7f3586b96640 1 Processor -- start 2024-04-26T23:49:42.540 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:42.532+0000 7f3586b96640 1 -- start start 2024-04-26T23:49:42.540 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:42.532+0000 7f3586b96640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f35800c2b80 0x7f35800c83d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:42.540 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:42.532+0000 7f3586b96640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f35800c5050 0x7f35801392b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:42.540 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:42.532+0000 7f3586b96640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f358013feb0 0x7f35801397f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:42.540 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:42.532+0000 7f3586b96640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f358006dbb0 con 0x7f35800c5050 2024-04-26T23:49:42.540 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:42.532+0000 7f3586b96640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f358006da30 con 0x7f358013feb0 2024-04-26T23:49:42.540 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:42.532+0000 7f3586b96640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f3580140290 con 0x7f35800c2b80 2024-04-26T23:49:42.541 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:42.532+0000 7f357ffff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f35800c5050 0x7f35801392b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:42.541 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:42.533+0000 7f357ffff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f35800c5050 0x7f35801392b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:59368/0 (socket says 172.21.15.88:59368) 2024-04-26T23:49:42.541 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:42.533+0000 7f357ffff640 1 -- 172.21.15.88:0/695190078 learned_addr learned my addr 172.21.15.88:0/695190078 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:49:42.541 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:42.533+0000 7f3584932640 1 --2- 172.21.15.88:0/695190078 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f35800c2b80 0x7f35800c83d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:42.541 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:42.533+0000 7f3585133640 1 --2- 172.21.15.88:0/695190078 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f358013feb0 0x7f35801397f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:42.541 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:42.533+0000 7f357ffff640 1 -- 172.21.15.88:0/695190078 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f35800c2b80 msgr2=0x7f35800c83d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:42.541 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:42.533+0000 7f357ffff640 1 --2- 172.21.15.88:0/695190078 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f35800c2b80 0x7f35800c83d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:42.541 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:42.533+0000 7f357ffff640 1 -- 172.21.15.88:0/695190078 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f358013feb0 msgr2=0x7f35801397f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:42.541 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:42.533+0000 7f357ffff640 1 --2- 172.21.15.88:0/695190078 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f358013feb0 0x7f35801397f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:42.541 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:42.533+0000 7f357ffff640 1 -- 172.21.15.88:0/695190078 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3580159c50 con 0x7f35800c5050 2024-04-26T23:49:42.541 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:42.533+0000 7f3584932640 1 --2- 172.21.15.88:0/695190078 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f35800c2b80 0x7f35800c83d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:49:42.541 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:42.533+0000 7f357ffff640 1 --2- 172.21.15.88:0/695190078 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f35800c5050 0x7f35801392b0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f356c00c820 tx=0x7f356c00cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:49:42.541 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:42.533+0000 7f357d7fa640 1 -- 172.21.15.88:0/695190078 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f356c015070 con 0x7f35800c5050 2024-04-26T23:49:42.542 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:42.533+0000 7f357d7fa640 1 -- 172.21.15.88:0/695190078 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f356c007a30 con 0x7f35800c5050 2024-04-26T23:49:42.542 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:42.533+0000 7f357d7fa640 1 -- 172.21.15.88:0/695190078 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f356c007de0 con 0x7f35800c5050 2024-04-26T23:49:42.542 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:42.533+0000 7f3586b96640 1 -- 172.21.15.88:0/695190078 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3580139e80 con 0x7f35800c5050 2024-04-26T23:49:42.542 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:42.533+0000 7f3586b96640 1 -- 172.21.15.88:0/695190078 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35800c8910 con 0x7f35800c5050 2024-04-26T23:49:42.542 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:42.534+0000 7f3586b96640 1 -- 172.21.15.88:0/695190078 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f35800507a0 con 0x7f35800c5050 2024-04-26T23:49:42.542 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:42.535+0000 7f357d7fa640 1 -- 172.21.15.88:0/695190078 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f356c018070 con 0x7f35800c5050 2024-04-26T23:49:42.542 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:42.535+0000 7f357d7fa640 1 --2- 172.21.15.88:0/695190078 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f356406c8f0 0x7f356406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:42.542 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:42.535+0000 7f3584932640 1 --2- 172.21.15.88:0/695190078 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f356406c8f0 0x7f356406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:42.542 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:42.535+0000 7f357d7fa640 1 -- 172.21.15.88:0/695190078 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6666+0+0 (secure 0 0 0) 0x7f356c08bd20 con 0x7f35800c5050 2024-04-26T23:49:42.542 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:42.536+0000 7f3584932640 1 --2- 172.21.15.88:0/695190078 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f356406c8f0 0x7f356406edb0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f3574034000 tx=0x7f357402e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:49:42.544 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:42.540+0000 7f357d7fa640 1 -- 172.21.15.88:0/695190078 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f356c059e20 con 0x7f35800c5050 2024-04-26T23:49:42.729 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:42.725+0000 7f3586b96640 1 -- 172.21.15.88:0/695190078 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f35800c27b0 con 0x7f35800c5050 2024-04-26T23:49:42.730 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:42.725+0000 7f357d7fa640 1 -- 172.21.15.88:0/695190078 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) ==== 80+0+0 (secure 0 0 0) 0x7f356c059720 con 0x7f35800c5050 2024-04-26T23:49:42.730 INFO:teuthology.orchestra.run.smithi088.stderr:listed 0 entries 2024-04-26T23:49:42.731 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:42.727+0000 7f3586b96640 1 -- 172.21.15.88:0/695190078 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f356406c8f0 msgr2=0x7f356406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:42.732 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:42.727+0000 7f3586b96640 1 --2- 172.21.15.88:0/695190078 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f356406c8f0 0x7f356406edb0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f3574034000 tx=0x7f357402e000 comp rx=0 tx=0).stop 2024-04-26T23:49:42.732 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:42.727+0000 7f3586b96640 1 -- 172.21.15.88:0/695190078 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f35800c5050 msgr2=0x7f35801392b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:42.732 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:42.727+0000 7f3586b96640 1 --2- 172.21.15.88:0/695190078 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f35800c5050 0x7f35801392b0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f356c00c820 tx=0x7f356c00cce0 comp rx=0 tx=0).stop 2024-04-26T23:49:42.732 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:42.727+0000 7f3586b96640 1 -- 172.21.15.88:0/695190078 shutdown_connections 2024-04-26T23:49:42.732 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:42.727+0000 7f3586b96640 1 --2- 172.21.15.88:0/695190078 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f356406c8f0 0x7f356406edb0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:42.732 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:42.727+0000 7f3586b96640 1 --2- 172.21.15.88:0/695190078 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f358013feb0 0x7f35801397f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:42.732 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:42.727+0000 7f3586b96640 1 --2- 172.21.15.88:0/695190078 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f35800c5050 0x7f35801392b0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:42.732 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:42.727+0000 7f3586b96640 1 --2- 172.21.15.88:0/695190078 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f35800c2b80 0x7f35800c83d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:42.732 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:42.727+0000 7f3586b96640 1 -- 172.21.15.88:0/695190078 >> 172.21.15.88:0/695190078 conn(0x7f35800c5ce0 msgr2=0x7f358006f440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:49:42.732 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:42.727+0000 7f3586b96640 1 -- 172.21.15.88:0/695190078 shutdown_connections 2024-04-26T23:49:42.732 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:42.727+0000 7f3586b96640 1 -- 172.21.15.88:0/695190078 wait complete. 2024-04-26T23:49:42.743 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-26T23:49:42.743 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:49:42.743 DEBUG:teuthology.orchestra.run.smithi088:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-04-26T23:49:42.804 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi088.front.sepia.ceph.com 2024-04-26T23:49:42.804 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:49:42.804 DEBUG:teuthology.orchestra.run.smithi088:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-26T23:49:42.828 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-26T23:49:42.828 DEBUG:teuthology.orchestra.run.smithi175:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:49:42.878 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-26T23:49:42.878 DEBUG:teuthology.orchestra.run.smithi175:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:49:42.949 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T23:49:43.047 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.042+0000 7f6a2b971640 1 Processor -- start 2024-04-26T23:49:43.047 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.043+0000 7f6a2b971640 1 -- start start 2024-04-26T23:49:43.048 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.043+0000 7f6a2b971640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6a240ab3f0 0x7f6a240c4d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:43.048 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.043+0000 7f6a2b971640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6a240c3810 con 0x7f6a240c52c0 2024-04-26T23:49:43.049 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.043+0000 7f6a2b971640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6a240c3ab0 con 0x7f6a241570d0 2024-04-26T23:49:43.049 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.043+0000 7f6a2b971640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f6a240c4330 con 0x7f6a240ab3f0 2024-04-26T23:49:43.049 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.043+0000 7f6a29f0e640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f6a240c52c0 0x7f6a241574b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:51254/0 (socket says 172.21.15.88:51254) 2024-04-26T23:49:43.049 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.043+0000 7f6a29f0e640 1 -- 172.21.15.88:0/2795056783 learned_addr learned my addr 172.21.15.88:0/2795056783 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-26T23:49:43.049 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.044+0000 7f6a28f0c640 1 --2- 172.21.15.88:0/2795056783 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6a240ab3f0 0x7f6a240c4d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:43.049 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.044+0000 7f6a1bfff640 1 -- 172.21.15.88:0/2795056783 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1574301063 0 0) 0x7f6a240c3810 con 0x7f6a240c52c0 2024-04-26T23:49:43.049 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.044+0000 7f6a1bfff640 1 -- 172.21.15.88:0/2795056783 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6a10003520 con 0x7f6a240c52c0 2024-04-26T23:49:43.049 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.044+0000 7f6a1bfff640 1 -- 172.21.15.88:0/2795056783 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 848823434 0 0) 0x7f6a240c3ab0 con 0x7f6a241570d0 2024-04-26T23:49:43.049 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.044+0000 7f6a1bfff640 1 -- 172.21.15.88:0/2795056783 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6a240c3810 con 0x7f6a241570d0 2024-04-26T23:49:43.049 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.044+0000 7f6a1bfff640 1 -- 172.21.15.88:0/2795056783 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1091273296 0 0) 0x7f6a10003520 con 0x7f6a240c52c0 2024-04-26T23:49:43.049 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.044+0000 7f6a28f0c640 1 -- 172.21.15.88:0/2795056783 >> v1:172.21.15.175:6789/0 conn(0x7f6a241570d0 legacy=0x7f6a24150a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:43.049 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.044+0000 7f6a28f0c640 1 -- 172.21.15.88:0/2795056783 >> v1:172.21.15.88:6789/0 conn(0x7f6a240c52c0 legacy=0x7f6a241574b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:43.049 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.044+0000 7f6a28f0c640 1 -- 172.21.15.88:0/2795056783 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a240c4580 con 0x7f6a240ab3f0 2024-04-26T23:49:43.053 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.045+0000 7f6a28f0c640 1 --2- 172.21.15.88:0/2795056783 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6a240ab3f0 0x7f6a240c4d80 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f6a140097d0 tx=0x7f6a1402a080 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d1722112f1edafd2 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:49:43.053 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.045+0000 7f6a1bfff640 1 -- 172.21.15.88:0/2795056783 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a14037070 con 0x7f6a240ab3f0 2024-04-26T23:49:43.053 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.045+0000 7f6a1bfff640 1 -- 172.21.15.88:0/2795056783 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a1402ab10 con 0x7f6a240ab3f0 2024-04-26T23:49:43.053 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.045+0000 7f6a1bfff640 1 -- 172.21.15.88:0/2795056783 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a1c0019f0 con 0x7f6a240ab3f0 2024-04-26T23:49:43.053 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.045+0000 7f6a2b971640 1 -- 172.21.15.88:0/2795056783 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6a240ab3f0 msgr2=0x7f6a240c4d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:43.053 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.045+0000 7f6a2b971640 1 --2- 172.21.15.88:0/2795056783 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6a240ab3f0 0x7f6a240c4d80 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f6a140097d0 tx=0x7f6a1402a080 comp rx=0 tx=0).stop 2024-04-26T23:49:43.053 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.045+0000 7f6a2b971640 1 -- 172.21.15.88:0/2795056783 shutdown_connections 2024-04-26T23:49:43.053 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.045+0000 7f6a2b971640 1 --2- 172.21.15.88:0/2795056783 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6a240ab3f0 0x7f6a240c4d80 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:43.053 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.045+0000 7f6a2b971640 1 -- 172.21.15.88:0/2795056783 >> 172.21.15.88:0/2795056783 conn(0x7f6a2406c310 msgr2=0x7f6a2406c6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:49:43.053 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.045+0000 7f6a2b971640 1 -- 172.21.15.88:0/2795056783 shutdown_connections 2024-04-26T23:49:43.053 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.045+0000 7f6a2b971640 1 -- 172.21.15.88:0/2795056783 wait complete. 2024-04-26T23:49:43.053 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.046+0000 7f6a2b971640 1 Processor -- start 2024-04-26T23:49:43.053 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.046+0000 7f6a2b971640 1 -- start start 2024-04-26T23:49:43.054 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.047+0000 7f6a2b971640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6a240ab3f0 0x7f6a24142a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:43.054 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.047+0000 7f6a2b971640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6a240c52c0 0x7f6a24155040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:43.054 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.047+0000 7f6a2b971640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6a241570d0 0x7f6a24155580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:43.054 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.047+0000 7f6a2b971640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f6a241512e0 con 0x7f6a241570d0 2024-04-26T23:49:43.054 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.047+0000 7f6a2b971640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f6a24151160 con 0x7f6a240ab3f0 2024-04-26T23:49:43.054 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.047+0000 7f6a2b971640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f6a240aba60 con 0x7f6a240c52c0 2024-04-26T23:49:43.054 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.047+0000 7f6a29f0e640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6a241570d0 0x7f6a24155580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:43.054 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.047+0000 7f6a29f0e640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6a241570d0 0x7f6a24155580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:59374/0 (socket says 172.21.15.88:59374) 2024-04-26T23:49:43.054 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.047+0000 7f6a29f0e640 1 -- 172.21.15.88:0/776063171 learned_addr learned my addr 172.21.15.88:0/776063171 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:49:43.054 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.047+0000 7f6a2970d640 1 --2- 172.21.15.88:0/776063171 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6a240ab3f0 0x7f6a24142a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:43.054 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.047+0000 7f6a28f0c640 1 --2- 172.21.15.88:0/776063171 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6a240c52c0 0x7f6a24155040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:43.054 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.047+0000 7f6a29f0e640 1 -- 172.21.15.88:0/776063171 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6a240c52c0 msgr2=0x7f6a24155040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:43.054 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.047+0000 7f6a29f0e640 1 --2- 172.21.15.88:0/776063171 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6a240c52c0 0x7f6a24155040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:43.054 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.047+0000 7f6a29f0e640 1 -- 172.21.15.88:0/776063171 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6a240ab3f0 msgr2=0x7f6a24142a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:43.055 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.047+0000 7f6a29f0e640 1 --2- 172.21.15.88:0/776063171 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6a240ab3f0 0x7f6a24142a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:43.055 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.048+0000 7f6a29f0e640 1 -- 172.21.15.88:0/776063171 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a2414e810 con 0x7f6a241570d0 2024-04-26T23:49:43.055 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.048+0000 7f6a28f0c640 1 --2- 172.21.15.88:0/776063171 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6a240c52c0 0x7f6a24155040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:49:43.055 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.048+0000 7f6a29f0e640 1 --2- 172.21.15.88:0/776063171 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6a241570d0 0x7f6a24155580 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f6a1c001f60 tx=0x7f6a1c00cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:49:43.055 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.048+0000 7f6a19ffb640 1 -- 172.21.15.88:0/776063171 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a1c017070 con 0x7f6a241570d0 2024-04-26T23:49:43.055 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.048+0000 7f6a19ffb640 1 -- 172.21.15.88:0/776063171 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a1c012400 con 0x7f6a241570d0 2024-04-26T23:49:43.055 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.048+0000 7f6a2b971640 1 -- 172.21.15.88:0/776063171 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a24156b70 con 0x7f6a241570d0 2024-04-26T23:49:43.055 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.048+0000 7f6a19ffb640 1 -- 172.21.15.88:0/776063171 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a1c0127f0 con 0x7f6a241570d0 2024-04-26T23:49:43.055 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.048+0000 7f6a2b971640 1 -- 172.21.15.88:0/776063171 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a24156000 con 0x7f6a241570d0 2024-04-26T23:49:43.056 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.049+0000 7f6a2b971640 1 -- 172.21.15.88:0/776063171 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a24154d20 con 0x7f6a241570d0 2024-04-26T23:49:43.056 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.049+0000 7f6a19ffb640 1 -- 172.21.15.88:0/776063171 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6a1c01a070 con 0x7f6a241570d0 2024-04-26T23:49:43.056 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.050+0000 7f6a19ffb640 1 --2- 172.21.15.88:0/776063171 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f6a0806c8f0 0x7f6a0806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:43.056 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.050+0000 7f6a19ffb640 1 -- 172.21.15.88:0/776063171 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6666+0+0 (secure 0 0 0) 0x7f6a1c08bce0 con 0x7f6a241570d0 2024-04-26T23:49:43.056 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.050+0000 7f6a2970d640 1 --2- 172.21.15.88:0/776063171 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f6a0806c8f0 0x7f6a0806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:43.056 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.050+0000 7f6a2970d640 1 --2- 172.21.15.88:0/776063171 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f6a0806c8f0 0x7f6a0806edb0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f6a200011e0 tx=0x7f6a20009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:49:43.058 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.054+0000 7f6a19ffb640 1 -- 172.21.15.88:0/776063171 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f6a24154d20 con 0x7f6a241570d0 2024-04-26T23:49:43.236 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.231+0000 7f6a2b971640 1 -- 172.21.15.88:0/776063171 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6a24155ac0 con 0x7f6a241570d0 2024-04-26T23:49:43.237 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.232+0000 7f6a19ffb640 1 -- 172.21.15.88:0/776063171 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+20640 (secure 0 0 0) 0x7f6a1c059700 con 0x7f6a241570d0 2024-04-26T23:49:43.237 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-26T23:49:43.237 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":26,"fsid":"555255e9-7ef9-4454-8dc9-35e96b70035c","created":"2024-04-26T23:40:07.836009+0000","modified":"2024-04-26T23:41:30.360444+0000","last_up_change":"2024-04-26T23:40:18.831369+0000","last_in_change":"2024-04-26T23:40:09.944777+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T23:40:19.936127+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"a_metadata","create_time":"2024-04-26T23:40:29.837465+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"a_data","create_time":"2024-04-26T23:40:30.868651+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"b_metadata","create_time":"2024-04-26T23:40:38.753441+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"b_data","create_time":"2024-04-26T23:40:39.974557+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"92aecea3-ed62-4a29-87c0-76758a0816a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":2803186054},{"type":"v1","addr":"172.21.15.88:6801","nonce":2803186054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":2803186054},{"type":"v1","addr":"172.21.15.88:6803","nonce":2803186054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":2803186054},{"type":"v1","addr":"172.21.15.88:6807","nonce":2803186054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":2803186054},{"type":"v1","addr":"172.21.15.88:6805","nonce":2803186054}]},"public_addr":"172.21.15.88:6801/2803186054","cluster_addr":"172.21.15.88:6803/2803186054","heartbeat_back_addr":"172.21.15.88:6807/2803186054","heartbeat_front_addr":"172.21.15.88:6805/2803186054","state":["exists","up"]},{"osd":1,"uuid":"7a6f0fa9-23d0-4747-880f-798d45ec5eeb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":1897380484},{"type":"v1","addr":"172.21.15.88:6817","nonce":1897380484}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":1897380484},{"type":"v1","addr":"172.21.15.88:6819","nonce":1897380484}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1897380484},{"type":"v1","addr":"172.21.15.88:6823","nonce":1897380484}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":1897380484},{"type":"v1","addr":"172.21.15.88:6821","nonce":1897380484}]},"public_addr":"172.21.15.88:6817/1897380484","cluster_addr":"172.21.15.88:6819/1897380484","heartbeat_back_addr":"172.21.15.88:6823/1897380484","heartbeat_front_addr":"172.21.15.88:6821/1897380484","state":["exists","up"]},{"osd":2,"uuid":"6be88ea0-e133-4200-a4b5-f92d664b248a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":648396269},{"type":"v1","addr":"172.21.15.88:6809","nonce":648396269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":648396269},{"type":"v1","addr":"172.21.15.88:6811","nonce":648396269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":648396269},{"type":"v1","addr":"172.21.15.88:6815","nonce":648396269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":648396269},{"type":"v1","addr":"172.21.15.88:6813","nonce":648396269}]},"public_addr":"172.21.15.88:6809/648396269","cluster_addr":"172.21.15.88:6811/648396269","heartbeat_back_addr":"172.21.15.88:6815/648396269","heartbeat_front_addr":"172.21.15.88:6813/648396269","state":["exists","up"]},{"osd":3,"uuid":"dcb0746b-7b3d-4ecf-8089-2493a5d1857c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":2328028922},{"type":"v1","addr":"172.21.15.88:6825","nonce":2328028922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":2328028922},{"type":"v1","addr":"172.21.15.88:6827","nonce":2328028922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":2328028922},{"type":"v1","addr":"172.21.15.88:6831","nonce":2328028922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":2328028922},{"type":"v1","addr":"172.21.15.88:6829","nonce":2328028922}]},"public_addr":"172.21.15.88:6825/2328028922","cluster_addr":"172.21.15.88:6827/2328028922","heartbeat_back_addr":"172.21.15.88:6831/2328028922","heartbeat_front_addr":"172.21.15.88:6829/2328028922","state":["exists","up"]},{"osd":4,"uuid":"c483de66-c44f-450e-a4ce-b132d50882c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":3929617402},{"type":"v1","addr":"172.21.15.175:6809","nonce":3929617402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":3929617402},{"type":"v1","addr":"172.21.15.175:6811","nonce":3929617402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":3929617402},{"type":"v1","addr":"172.21.15.175:6815","nonce":3929617402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":3929617402},{"type":"v1","addr":"172.21.15.175:6813","nonce":3929617402}]},"public_addr":"172.21.15.175:6809/3929617402","cluster_addr":"172.21.15.175:6811/3929617402","heartbeat_back_addr":"172.21.15.175:6815/3929617402","heartbeat_front_addr":"172.21.15.175:6813/3929617402","state":["exists","up"]},{"osd":5,"uuid":"ac3b1669-d228-40dd-9f9a-cb46aa73dd6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":2476644457},{"type":"v1","addr":"172.21.15.175:6801","nonce":2476644457}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":2476644457},{"type":"v1","addr":"172.21.15.175:6803","nonce":2476644457}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":2476644457},{"type":"v1","addr":"172.21.15.175:6807","nonce":2476644457}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":2476644457},{"type":"v1","addr":"172.21.15.175:6805","nonce":2476644457}]},"public_addr":"172.21.15.175:6801/2476644457","cluster_addr":"172.21.15.175:6803/2476644457","heartbeat_back_addr":"172.21.15.175:6807/2476644457","heartbeat_front_addr":"172.21.15.175:6805/2476644457","state":["exists","up"]},{"osd":6,"uuid":"7bef4896-857e-4c11-b3b2-c2e9a8548338","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":3824112919},{"type":"v1","addr":"172.21.15.175:6819","nonce":3824112919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6821","nonce":3824112919},{"type":"v1","addr":"172.21.15.175:6824","nonce":3824112919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":3824112919},{"type":"v1","addr":"172.21.15.175:6831","nonce":3824112919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":3824112919},{"type":"v1","addr":"172.21.15.175:6829","nonce":3824112919}]},"public_addr":"172.21.15.175:6819/3824112919","cluster_addr":"172.21.15.175:6824/3824112919","heartbeat_back_addr":"172.21.15.175:6831/3824112919","heartbeat_front_addr":"172.21.15.175:6829/3824112919","state":["exists","up"]},{"osd":7,"uuid":"e18d9e09-8673-470d-b9dc-280a409b63f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6817","nonce":3319361162},{"type":"v1","addr":"172.21.15.175:6818","nonce":3319361162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":3319361162},{"type":"v1","addr":"172.21.15.175:6822","nonce":3319361162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6827","nonce":3319361162},{"type":"v1","addr":"172.21.15.175:6828","nonce":3319361162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6823","nonce":3319361162},{"type":"v1","addr":"172.21.15.175:6825","nonce":3319361162}]},"public_addr":"172.21.15.175:6818/3319361162","cluster_addr":"172.21.15.175:6822/3319361162","heartbeat_back_addr":"172.21.15.175:6828/3319361162","heartbeat_front_addr":"172.21.15.175:6825/3319361162","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:40:15.126268+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:40:15.050614+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:40:14.995164+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:40:15.078112+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:40:15.159637+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:40:15.091226+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:40:15.140316+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:40:15.089431+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.16","mappings":[{"from":5,"to":2}]},{"pgid":"3.17","mappings":[{"from":5,"to":1}]},{"pgid":"3.1f","mappings":[{"from":0,"to":2}]},{"pgid":"3.23","mappings":[{"from":3,"to":1}]},{"pgid":"3.39","mappings":[{"from":7,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:49:43.239 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.235+0000 7f6a2b971640 1 -- 172.21.15.88:0/776063171 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f6a0806c8f0 msgr2=0x7f6a0806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:43.240 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.235+0000 7f6a2b971640 1 --2- 172.21.15.88:0/776063171 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f6a0806c8f0 0x7f6a0806edb0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f6a200011e0 tx=0x7f6a20009040 comp rx=0 tx=0).stop 2024-04-26T23:49:43.240 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.235+0000 7f6a2b971640 1 -- 172.21.15.88:0/776063171 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6a241570d0 msgr2=0x7f6a24155580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:43.240 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.235+0000 7f6a2b971640 1 --2- 172.21.15.88:0/776063171 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6a241570d0 0x7f6a24155580 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f6a1c001f60 tx=0x7f6a1c00cf90 comp rx=0 tx=0).stop 2024-04-26T23:49:43.240 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.235+0000 7f6a2b971640 1 -- 172.21.15.88:0/776063171 shutdown_connections 2024-04-26T23:49:43.240 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.235+0000 7f6a2b971640 1 --2- 172.21.15.88:0/776063171 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f6a0806c8f0 0x7f6a0806edb0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:43.240 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.235+0000 7f6a2b971640 1 --2- 172.21.15.88:0/776063171 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6a240c52c0 0x7f6a24155040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:43.240 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.235+0000 7f6a2b971640 1 --2- 172.21.15.88:0/776063171 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6a241570d0 0x7f6a24155580 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:43.240 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.235+0000 7f6a2b971640 1 --2- 172.21.15.88:0/776063171 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6a240ab3f0 0x7f6a24142a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:43.240 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.235+0000 7f6a2b971640 1 -- 172.21.15.88:0/776063171 >> 172.21.15.88:0/776063171 conn(0x7f6a2406c310 msgr2=0x7f6a241574b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:49:43.240 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.235+0000 7f6a2b971640 1 -- 172.21.15.88:0/776063171 shutdown_connections 2024-04-26T23:49:43.240 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.235+0000 7f6a2b971640 1 -- 172.21.15.88:0/776063171 wait complete. 2024-04-26T23:49:43.251 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T23:40:19.936127+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'a_metadata', 'create_time': '2024-04-26T23:40:29.837465+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'a'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'a_data', 'create_time': '2024-04-26T23:40:30.868651+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'a'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'b_metadata', 'create_time': '2024-04-26T23:40:38.753441+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'b'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'b_data', 'create_time': '2024-04-26T23:40:39.974557+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'b'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T23:49:43.251 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T23:49:43.351 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.347+0000 7f3513d5f640 1 Processor -- start 2024-04-26T23:49:43.352 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.347+0000 7f3513d5f640 1 -- start start 2024-04-26T23:49:43.354 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.348+0000 7f3513d5f640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f350c151df0 0x7f350c0c7d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:43.354 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.348+0000 7f3513d5f640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f350c0c8280 0x7f350c0c7170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:43.354 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.348+0000 7f3513d5f640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f350c0c3120 con 0x7f350c06fd10 2024-04-26T23:49:43.354 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.348+0000 7f3513d5f640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f350c154a80 con 0x7f350c151df0 2024-04-26T23:49:43.355 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.348+0000 7f3513d5f640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f350c154d60 con 0x7f350c0c8280 2024-04-26T23:49:43.355 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.348+0000 7f3511afb640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f350c151df0 0x7f350c0c7d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:43.355 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.348+0000 7f35112fa640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f350c06fd10 0x7f350c0c6a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:51270/0 (socket says 172.21.15.88:51270) 2024-04-26T23:49:43.355 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.348+0000 7f35112fa640 1 -- 172.21.15.88:0/2960907468 learned_addr learned my addr 172.21.15.88:0/2960907468 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-26T23:49:43.355 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.348+0000 7f35122fc640 1 --2- 172.21.15.88:0/2960907468 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f350c0c8280 0x7f350c0c7170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:43.355 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.348+0000 7f3511afb640 1 -- 172.21.15.88:0/2960907468 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f350c0c8280 msgr2=0x7f350c0c7170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:49:43.355 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.348+0000 7f3511afb640 1 --2- 172.21.15.88:0/2960907468 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f350c0c8280 0x7f350c0c7170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:43.355 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.348+0000 7f3511afb640 1 -- 172.21.15.88:0/2960907468 >> v1:172.21.15.88:6789/0 conn(0x7f350c06fd10 legacy=0x7f350c0c6a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:43.355 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.348+0000 7f3510af9640 1 -- 172.21.15.88:0/2960907468 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1489338551 0 0) 0x7f350c0c3120 con 0x7f350c06fd10 2024-04-26T23:49:43.355 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.348+0000 7f3511afb640 1 -- 172.21.15.88:0/2960907468 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f350c155040 con 0x7f350c151df0 2024-04-26T23:49:43.355 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.348+0000 7f35122fc640 1 --2- 172.21.15.88:0/2960907468 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f350c0c8280 0x7f350c0c7170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:49:43.355 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.349+0000 7f3511afb640 1 --2- 172.21.15.88:0/2960907468 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f350c151df0 0x7f350c0c7d40 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f35080097a0 tx=0x7f350802a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abd83ce5d3ae09f2 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:49:43.355 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.349+0000 7f3510af9640 1 -- 172.21.15.88:0/2960907468 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3508037070 con 0x7f350c151df0 2024-04-26T23:49:43.355 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.349+0000 7f3510af9640 1 -- 172.21.15.88:0/2960907468 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f350802adb0 con 0x7f350c151df0 2024-04-26T23:49:43.355 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.349+0000 7f3510af9640 1 -- 172.21.15.88:0/2960907468 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3508032660 con 0x7f350c151df0 2024-04-26T23:49:43.356 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.349+0000 7f3513d5f640 1 -- 172.21.15.88:0/2960907468 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f350c151df0 msgr2=0x7f350c0c7d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:43.356 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.349+0000 7f3513d5f640 1 --2- 172.21.15.88:0/2960907468 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f350c151df0 0x7f350c0c7d40 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f35080097a0 tx=0x7f350802a060 comp rx=0 tx=0).stop 2024-04-26T23:49:43.356 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.349+0000 7f3513d5f640 1 -- 172.21.15.88:0/2960907468 shutdown_connections 2024-04-26T23:49:43.356 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.349+0000 7f3513d5f640 1 --2- 172.21.15.88:0/2960907468 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f350c0c8280 0x7f350c0c7170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:43.356 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.349+0000 7f3513d5f640 1 --2- 172.21.15.88:0/2960907468 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f350c151df0 0x7f350c0c7d40 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:43.356 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.349+0000 7f3513d5f640 1 -- 172.21.15.88:0/2960907468 >> 172.21.15.88:0/2960907468 conn(0x7f350c0c8c40 msgr2=0x7f350c0c9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:49:43.356 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.350+0000 7f3513d5f640 1 -- 172.21.15.88:0/2960907468 shutdown_connections 2024-04-26T23:49:43.356 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.350+0000 7f3513d5f640 1 -- 172.21.15.88:0/2960907468 wait complete. 2024-04-26T23:49:43.359 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.351+0000 7f3513d5f640 1 Processor -- start 2024-04-26T23:49:43.359 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.351+0000 7f3513d5f640 1 -- start start 2024-04-26T23:49:43.359 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.351+0000 7f3513d5f640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f350c06fd10 0x7f350c153a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:43.359 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.351+0000 7f3513d5f640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f350c0c8280 0x7f350c071e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:43.359 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.351+0000 7f3513d5f640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f350c151df0 0x7f350c0723c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:43.359 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.351+0000 7f3513d5f640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f350c1521d0 con 0x7f350c0c8280 2024-04-26T23:49:43.359 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.351+0000 7f3513d5f640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f350c0c76b0 con 0x7f350c06fd10 2024-04-26T23:49:43.360 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.351+0000 7f3513d5f640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f350c0703c0 con 0x7f350c151df0 2024-04-26T23:49:43.360 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.351+0000 7f35112fa640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f350c0c8280 0x7f350c071e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:43.360 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.351+0000 7f35112fa640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f350c0c8280 0x7f350c071e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:59394/0 (socket says 172.21.15.88:59394) 2024-04-26T23:49:43.360 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.351+0000 7f35112fa640 1 -- 172.21.15.88:0/125805575 learned_addr learned my addr 172.21.15.88:0/125805575 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:49:43.360 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.352+0000 7f3511afb640 1 --2- 172.21.15.88:0/125805575 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f350c06fd10 0x7f350c153a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:43.360 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.352+0000 7f35122fc640 1 --2- 172.21.15.88:0/125805575 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f350c151df0 0x7f350c0723c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:43.360 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.352+0000 7f35112fa640 1 -- 172.21.15.88:0/125805575 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f350c151df0 msgr2=0x7f350c0723c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:43.360 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.352+0000 7f35112fa640 1 --2- 172.21.15.88:0/125805575 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f350c151df0 0x7f350c0723c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:43.360 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.352+0000 7f35112fa640 1 -- 172.21.15.88:0/125805575 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f350c06fd10 msgr2=0x7f350c153a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:43.360 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.352+0000 7f35112fa640 1 --2- 172.21.15.88:0/125805575 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f350c06fd10 0x7f350c153a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:43.360 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.352+0000 7f35112fa640 1 -- 172.21.15.88:0/125805575 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f350c074d80 con 0x7f350c0c8280 2024-04-26T23:49:43.360 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.352+0000 7f3511afb640 1 --2- 172.21.15.88:0/125805575 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f350c06fd10 0x7f350c153a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:49:43.360 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.352+0000 7f35112fa640 1 --2- 172.21.15.88:0/125805575 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f350c0c8280 0x7f350c071e80 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f34fc005880 tx=0x7f34fc00c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:49:43.360 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.352+0000 7f35027fc640 1 -- 172.21.15.88:0/125805575 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34fc017070 con 0x7f350c0c8280 2024-04-26T23:49:43.361 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.352+0000 7f35027fc640 1 -- 172.21.15.88:0/125805575 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34fc005ce0 con 0x7f350c0c8280 2024-04-26T23:49:43.361 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.352+0000 7f35027fc640 1 -- 172.21.15.88:0/125805575 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34fc007290 con 0x7f350c0c8280 2024-04-26T23:49:43.361 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.352+0000 7f3513d5f640 1 -- 172.21.15.88:0/125805575 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f350c1ed830 con 0x7f350c0c8280 2024-04-26T23:49:43.361 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.352+0000 7f3513d5f640 1 -- 172.21.15.88:0/125805575 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f350c1eddf0 con 0x7f350c0c8280 2024-04-26T23:49:43.361 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.353+0000 7f3513d5f640 1 -- 172.21.15.88:0/125805575 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f350c076690 con 0x7f350c0c8280 2024-04-26T23:49:43.361 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.353+0000 7f35027fc640 1 -- 172.21.15.88:0/125805575 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f34fc01a070 con 0x7f350c0c8280 2024-04-26T23:49:43.361 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.354+0000 7f35027fc640 1 --2- 172.21.15.88:0/125805575 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f34f006c8f0 0x7f34f006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:43.361 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.354+0000 7f3511afb640 1 --2- 172.21.15.88:0/125805575 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f34f006c8f0 0x7f34f006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:43.361 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.354+0000 7f35027fc640 1 -- 172.21.15.88:0/125805575 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6666+0+0 (secure 0 0 0) 0x7f34fc08b1d0 con 0x7f350c0c8280 2024-04-26T23:49:43.361 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.354+0000 7f3511afb640 1 --2- 172.21.15.88:0/125805575 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f34f006c8f0 0x7f34f006edb0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f3508034000 tx=0x7f350802e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:49:43.363 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.358+0000 7f35027fc640 1 -- 172.21.15.88:0/125805575 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f34fc0592d0 con 0x7f350c0c8280 2024-04-26T23:49:43.536 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.532+0000 7f3513d5f640 1 -- 172.21.15.88:0/125805575 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f350c0507a0 con 0x7f350c0c8280 2024-04-26T23:49:43.536 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.532+0000 7f35027fc640 1 -- 172.21.15.88:0/125805575 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) ==== 93+0+10 (secure 0 0 0) 0x7f34fc058bd0 con 0x7f350c0c8280 2024-04-26T23:49:43.537 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 1 2024-04-26T23:49:43.539 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.534+0000 7f3513d5f640 1 -- 172.21.15.88:0/125805575 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f34f006c8f0 msgr2=0x7f34f006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:43.539 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.534+0000 7f3513d5f640 1 --2- 172.21.15.88:0/125805575 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f34f006c8f0 0x7f34f006edb0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f3508034000 tx=0x7f350802e000 comp rx=0 tx=0).stop 2024-04-26T23:49:43.539 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.534+0000 7f3513d5f640 1 -- 172.21.15.88:0/125805575 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f350c0c8280 msgr2=0x7f350c071e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:43.539 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.534+0000 7f3513d5f640 1 --2- 172.21.15.88:0/125805575 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f350c0c8280 0x7f350c071e80 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f34fc005880 tx=0x7f34fc00c900 comp rx=0 tx=0).stop 2024-04-26T23:49:43.539 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.534+0000 7f3513d5f640 1 -- 172.21.15.88:0/125805575 shutdown_connections 2024-04-26T23:49:43.539 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.534+0000 7f3513d5f640 1 --2- 172.21.15.88:0/125805575 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f34f006c8f0 0x7f34f006edb0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:43.539 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.534+0000 7f3513d5f640 1 --2- 172.21.15.88:0/125805575 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f350c151df0 0x7f350c0723c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:43.539 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.534+0000 7f3513d5f640 1 --2- 172.21.15.88:0/125805575 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f350c0c8280 0x7f350c071e80 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:43.539 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.534+0000 7f3513d5f640 1 --2- 172.21.15.88:0/125805575 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f350c06fd10 0x7f350c153a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:43.539 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.534+0000 7f3513d5f640 1 -- 172.21.15.88:0/125805575 >> 172.21.15.88:0/125805575 conn(0x7f350c0c8c40 msgr2=0x7f350c0c2bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:49:43.539 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.534+0000 7f3513d5f640 1 -- 172.21.15.88:0/125805575 shutdown_connections 2024-04-26T23:49:43.539 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.534+0000 7f3513d5f640 1 -- 172.21.15.88:0/125805575 wait complete. 2024-04-26T23:49:43.550 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get a_metadata pg_num 2024-04-26T23:49:43.648 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.644+0000 7f4d5407b640 1 Processor -- start 2024-04-26T23:49:43.648 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.644+0000 7f4d5407b640 1 -- start start 2024-04-26T23:49:43.651 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.644+0000 7f4d5407b640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f4d4c0ab3f0 0x7f4d4c0c4d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:43.651 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.644+0000 7f4d5407b640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f4d4c0c52c0 0x7f4d4c1574b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:43.651 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.644+0000 7f4d5407b640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d4c0c3810 con 0x7f4d4c1570d0 2024-04-26T23:49:43.651 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.644+0000 7f4d5407b640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f4d4c0c4330 con 0x7f4d4c0c52c0 2024-04-26T23:49:43.651 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.644+0000 7f4d5407b640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f4d4c0c3ab0 con 0x7f4d4c0ab3f0 2024-04-26T23:49:43.651 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.645+0000 7f4d52618640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f4d4c0c52c0 0x7f4d4c1574b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:43.651 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.645+0000 7f4d52618640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f4d4c0c52c0 0x7f4d4c1574b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:59398/0 (socket says 172.21.15.88:59398) 2024-04-26T23:49:43.652 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.645+0000 7f4d52618640 1 -- 172.21.15.88:0/2298247129 learned_addr learned my addr 172.21.15.88:0/2298247129 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:49:43.652 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.645+0000 7f4d51616640 1 --2- 172.21.15.88:0/2298247129 >> v2:172.21.15.175:3300/0 conn(0x7f4d4c0ab3f0 0x7f4d4c0c4d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:43.652 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.645+0000 7f4d52618640 1 -- 172.21.15.88:0/2298247129 >> v2:172.21.15.175:3300/0 conn(0x7f4d4c0ab3f0 msgr2=0x7f4d4c0c4d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:49:43.652 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.645+0000 7f4d52618640 1 --2- 172.21.15.88:0/2298247129 >> v2:172.21.15.175:3300/0 conn(0x7f4d4c0ab3f0 0x7f4d4c0c4d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:43.652 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.645+0000 7f4d52618640 1 -- 172.21.15.88:0/2298247129 >> v1:172.21.15.175:6789/0 conn(0x7f4d4c1570d0 legacy=0x7f4d4c150a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:43.652 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.645+0000 7f4d52618640 1 -- 172.21.15.88:0/2298247129 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d4c0c4580 con 0x7f4d4c0c52c0 2024-04-26T23:49:43.652 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.645+0000 7f4d50e15640 1 -- 172.21.15.88:0/2298247129 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2862538961 0 0) 0x7f4d4c0c3810 con 0x7f4d4c1570d0 2024-04-26T23:49:43.652 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.646+0000 7f4d52618640 1 --2- 172.21.15.88:0/2298247129 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4d4c0c52c0 0x7f4d4c1574b0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f4d4c0c44b0 tx=0x7f4d3c02a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0d9da3ff9ab4da1 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:49:43.652 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.646+0000 7f4d50e15640 1 -- 172.21.15.88:0/2298247129 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d3c037070 con 0x7f4d4c0c52c0 2024-04-26T23:49:43.652 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.646+0000 7f4d50e15640 1 -- 172.21.15.88:0/2298247129 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d3c032440 con 0x7f4d4c0c52c0 2024-04-26T23:49:43.652 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.646+0000 7f4d50e15640 1 -- 172.21.15.88:0/2298247129 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d3c032810 con 0x7f4d4c0c52c0 2024-04-26T23:49:43.652 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.646+0000 7f4d5407b640 1 -- 172.21.15.88:0/2298247129 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4d4c0c52c0 msgr2=0x7f4d4c1574b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:43.652 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.646+0000 7f4d5407b640 1 --2- 172.21.15.88:0/2298247129 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4d4c0c52c0 0x7f4d4c1574b0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f4d4c0c44b0 tx=0x7f4d3c02a140 comp rx=0 tx=0).stop 2024-04-26T23:49:43.652 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.646+0000 7f4d5407b640 1 -- 172.21.15.88:0/2298247129 shutdown_connections 2024-04-26T23:49:43.652 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.646+0000 7f4d5407b640 1 --2- 172.21.15.88:0/2298247129 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4d4c0c52c0 0x7f4d4c1574b0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:43.653 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.646+0000 7f4d5407b640 1 --2- 172.21.15.88:0/2298247129 >> v2:172.21.15.175:3300/0 conn(0x7f4d4c0ab3f0 0x7f4d4c0c4d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:43.653 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.646+0000 7f4d5407b640 1 -- 172.21.15.88:0/2298247129 >> 172.21.15.88:0/2298247129 conn(0x7f4d4c06c310 msgr2=0x7f4d4c06c6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:49:43.653 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.646+0000 7f4d5407b640 1 -- 172.21.15.88:0/2298247129 shutdown_connections 2024-04-26T23:49:43.653 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.646+0000 7f4d5407b640 1 -- 172.21.15.88:0/2298247129 wait complete. 2024-04-26T23:49:43.655 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.647+0000 7f4d5407b640 1 Processor -- start 2024-04-26T23:49:43.655 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.647+0000 7f4d5407b640 1 -- start start 2024-04-26T23:49:43.655 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.648+0000 7f4d5407b640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4d4c0ab3f0 0x7f4d4c1e9810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:43.656 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.648+0000 7f4d5407b640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4d4c0c52c0 0x7f4d4c0c7ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:43.656 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.648+0000 7f4d5407b640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4d4c1570d0 0x7f4d4c14b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:43.656 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.648+0000 7f4d5407b640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f4d4c1512e0 con 0x7f4d4c0ab3f0 2024-04-26T23:49:43.656 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.648+0000 7f4d5407b640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f4d4c151160 con 0x7f4d4c1570d0 2024-04-26T23:49:43.656 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.648+0000 7f4d5407b640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f4d4c0aba60 con 0x7f4d4c0c52c0 2024-04-26T23:49:43.656 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.648+0000 7f4d51e17640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4d4c0ab3f0 0x7f4d4c1e9810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:43.656 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.648+0000 7f4d51e17640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4d4c0ab3f0 0x7f4d4c1e9810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:59400/0 (socket says 172.21.15.88:59400) 2024-04-26T23:49:43.656 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.648+0000 7f4d51e17640 1 -- 172.21.15.88:0/2367853781 learned_addr learned my addr 172.21.15.88:0/2367853781 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:49:43.656 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.648+0000 7f4d52618640 1 --2- 172.21.15.88:0/2367853781 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4d4c1570d0 0x7f4d4c14b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:43.656 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.648+0000 7f4d51616640 1 --2- 172.21.15.88:0/2367853781 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4d4c0c52c0 0x7f4d4c0c7ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:43.656 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.648+0000 7f4d51e17640 1 -- 172.21.15.88:0/2367853781 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4d4c0c52c0 msgr2=0x7f4d4c0c7ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:43.656 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.648+0000 7f4d51e17640 1 --2- 172.21.15.88:0/2367853781 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4d4c0c52c0 0x7f4d4c0c7ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:43.656 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.648+0000 7f4d51e17640 1 -- 172.21.15.88:0/2367853781 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4d4c1570d0 msgr2=0x7f4d4c14b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:43.656 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.648+0000 7f4d51e17640 1 --2- 172.21.15.88:0/2367853781 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4d4c1570d0 0x7f4d4c14b9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:43.657 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.648+0000 7f4d51e17640 1 -- 172.21.15.88:0/2367853781 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d4c0c8000 con 0x7f4d4c0ab3f0 2024-04-26T23:49:43.657 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.648+0000 7f4d51616640 1 --2- 172.21.15.88:0/2367853781 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4d4c0c52c0 0x7f4d4c0c7ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:49:43.657 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.649+0000 7f4d51e17640 1 --2- 172.21.15.88:0/2367853781 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4d4c0ab3f0 0x7f4d4c1e9810 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f4d4400c820 tx=0x7f4d4400cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:49:43.657 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.649+0000 7f4d4a7fc640 1 -- 172.21.15.88:0/2367853781 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d44017070 con 0x7f4d4c0ab3f0 2024-04-26T23:49:43.657 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.649+0000 7f4d4a7fc640 1 -- 172.21.15.88:0/2367853781 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d44003da0 con 0x7f4d4c0ab3f0 2024-04-26T23:49:43.657 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.649+0000 7f4d4a7fc640 1 -- 172.21.15.88:0/2367853781 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d44005290 con 0x7f4d4c0ab3f0 2024-04-26T23:49:43.657 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.649+0000 7f4d5407b640 1 -- 172.21.15.88:0/2367853781 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d4c1e8d50 con 0x7f4d4c0ab3f0 2024-04-26T23:49:43.657 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.649+0000 7f4d5407b640 1 -- 172.21.15.88:0/2367853781 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d4c147730 con 0x7f4d4c0ab3f0 2024-04-26T23:49:43.657 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.650+0000 7f4d5407b640 1 -- 172.21.15.88:0/2367853781 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d4c0507a0 con 0x7f4d4c0ab3f0 2024-04-26T23:49:43.657 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.650+0000 7f4d4a7fc640 1 -- 172.21.15.88:0/2367853781 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4d4401a070 con 0x7f4d4c0ab3f0 2024-04-26T23:49:43.657 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.651+0000 7f4d4a7fc640 1 --2- 172.21.15.88:0/2367853781 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f4d3806c8f0 0x7f4d3806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:43.657 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.651+0000 7f4d51616640 1 --2- 172.21.15.88:0/2367853781 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f4d3806c8f0 0x7f4d3806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:43.657 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.651+0000 7f4d4a7fc640 1 -- 172.21.15.88:0/2367853781 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6666+0+0 (secure 0 0 0) 0x7f4d4408b510 con 0x7f4d4c0ab3f0 2024-04-26T23:49:43.658 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.651+0000 7f4d51616640 1 --2- 172.21.15.88:0/2367853781 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f4d3806c8f0 0x7f4d3806edb0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f4d4c1e6940 tx=0x7f4d40008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:49:43.659 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.655+0000 7f4d4a7fc640 1 -- 172.21.15.88:0/2367853781 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f4d44059610 con 0x7f4d4c0ab3f0 2024-04-26T23:49:43.837 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.832+0000 7f4d5407b640 1 -- 172.21.15.88:0/2367853781 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "a_metadata", "var": "pg_num"} v 0) -- 0x7f4d4c0c4110 con 0x7f4d4c0ab3f0 2024-04-26T23:49:43.837 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.832+0000 7f4d4a7fc640 1 -- 172.21.15.88:0/2367853781 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "a_metadata", "var": "pg_num"}]=0 v26) ==== 99+0+11 (secure 0 0 0) 0x7f4d44058f10 con 0x7f4d4c0ab3f0 2024-04-26T23:49:43.837 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 32 2024-04-26T23:49:43.839 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.834+0000 7f4d5407b640 1 -- 172.21.15.88:0/2367853781 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f4d3806c8f0 msgr2=0x7f4d3806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:43.839 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.834+0000 7f4d5407b640 1 --2- 172.21.15.88:0/2367853781 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f4d3806c8f0 0x7f4d3806edb0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f4d4c1e6940 tx=0x7f4d40008040 comp rx=0 tx=0).stop 2024-04-26T23:49:43.839 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.834+0000 7f4d5407b640 1 -- 172.21.15.88:0/2367853781 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4d4c0ab3f0 msgr2=0x7f4d4c1e9810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:43.839 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.834+0000 7f4d5407b640 1 --2- 172.21.15.88:0/2367853781 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4d4c0ab3f0 0x7f4d4c1e9810 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f4d4400c820 tx=0x7f4d4400cce0 comp rx=0 tx=0).stop 2024-04-26T23:49:43.839 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.834+0000 7f4d5407b640 1 -- 172.21.15.88:0/2367853781 shutdown_connections 2024-04-26T23:49:43.839 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.834+0000 7f4d5407b640 1 --2- 172.21.15.88:0/2367853781 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f4d3806c8f0 0x7f4d3806edb0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:43.840 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.834+0000 7f4d5407b640 1 --2- 172.21.15.88:0/2367853781 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4d4c0c52c0 0x7f4d4c0c7ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:43.840 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.834+0000 7f4d5407b640 1 --2- 172.21.15.88:0/2367853781 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4d4c1570d0 0x7f4d4c14b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:43.840 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.834+0000 7f4d5407b640 1 --2- 172.21.15.88:0/2367853781 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4d4c0ab3f0 0x7f4d4c1e9810 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:43.840 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.834+0000 7f4d5407b640 1 -- 172.21.15.88:0/2367853781 >> 172.21.15.88:0/2367853781 conn(0x7f4d4c06c310 msgr2=0x7f4d4c0ac890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:49:43.840 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.834+0000 7f4d5407b640 1 -- 172.21.15.88:0/2367853781 shutdown_connections 2024-04-26T23:49:43.840 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.834+0000 7f4d5407b640 1 -- 172.21.15.88:0/2367853781 wait complete. 2024-04-26T23:49:43.850 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get a_data pg_num 2024-04-26T23:49:43.951 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.946+0000 7f3a320f1640 1 Processor -- start 2024-04-26T23:49:43.951 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.946+0000 7f3a320f1640 1 -- start start 2024-04-26T23:49:43.953 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.947+0000 7f3a320f1640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f3a2c0c7000 0x7f3a2c0ca460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:43.953 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.947+0000 7f3a320f1640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f3a2c0c9830 0x7f3a2c153ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:43.953 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.947+0000 7f3a320f1640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3a2c156de0 con 0x7f3a2c154220 2024-04-26T23:49:43.953 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.947+0000 7f3a320f1640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f3a2c157b60 con 0x7f3a2c0c9830 2024-04-26T23:49:43.954 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.947+0000 7f3a320f1640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f3a2c0cad40 con 0x7f3a2c0c7000 2024-04-26T23:49:43.954 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.947+0000 7f3a2affd640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f3a2c0c9830 0x7f3a2c153ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:43.954 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.947+0000 7f3a2bfff640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f3a2c154220 0x7f3a2c072930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:51274/0 (socket says 172.21.15.88:51274) 2024-04-26T23:49:43.954 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.947+0000 7f3a2bfff640 1 -- 172.21.15.88:0/2680404722 learned_addr learned my addr 172.21.15.88:0/2680404722 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-26T23:49:43.954 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.947+0000 7f3a2b7fe640 1 --2- 172.21.15.88:0/2680404722 >> v2:172.21.15.175:3300/0 conn(0x7f3a2c0c7000 0x7f3a2c0ca460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:43.954 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.947+0000 7f3a2affd640 1 -- 172.21.15.88:0/2680404722 >> v2:172.21.15.175:3300/0 conn(0x7f3a2c0c7000 msgr2=0x7f3a2c0ca460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:49:43.954 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.947+0000 7f3a2affd640 1 --2- 172.21.15.88:0/2680404722 >> v2:172.21.15.175:3300/0 conn(0x7f3a2c0c7000 0x7f3a2c0ca460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:43.954 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.947+0000 7f3a2affd640 1 -- 172.21.15.88:0/2680404722 >> v1:172.21.15.88:6789/0 conn(0x7f3a2c154220 legacy=0x7f3a2c072930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:43.954 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.947+0000 7f3a2affd640 1 -- 172.21.15.88:0/2680404722 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a2c157080 con 0x7f3a2c0c9830 2024-04-26T23:49:43.954 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.948+0000 7f3a2affd640 1 --2- 172.21.15.88:0/2680404722 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3a2c0c9830 0x7f3a2c153ce0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f3a2c08e1c0 tx=0x7f3a2002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0d11a9cdd136f11 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:49:43.954 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.948+0000 7f3a2a7fc640 1 -- 172.21.15.88:0/2680404722 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a20037070 con 0x7f3a2c0c9830 2024-04-26T23:49:43.954 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.948+0000 7f3a2a7fc640 1 -- 172.21.15.88:0/2680404722 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a20032440 con 0x7f3a2c0c9830 2024-04-26T23:49:43.954 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.948+0000 7f3a2a7fc640 1 -- 172.21.15.88:0/2680404722 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a20032810 con 0x7f3a2c0c9830 2024-04-26T23:49:43.955 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.948+0000 7f3a320f1640 1 -- 172.21.15.88:0/2680404722 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3a2c0c9830 msgr2=0x7f3a2c153ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:43.955 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.948+0000 7f3a320f1640 1 --2- 172.21.15.88:0/2680404722 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3a2c0c9830 0x7f3a2c153ce0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f3a2c08e1c0 tx=0x7f3a2002a1a0 comp rx=0 tx=0).stop 2024-04-26T23:49:43.955 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.948+0000 7f3a320f1640 1 -- 172.21.15.88:0/2680404722 shutdown_connections 2024-04-26T23:49:43.955 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.948+0000 7f3a320f1640 1 --2- 172.21.15.88:0/2680404722 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3a2c0c9830 0x7f3a2c153ce0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:43.955 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.948+0000 7f3a320f1640 1 --2- 172.21.15.88:0/2680404722 >> v2:172.21.15.175:3300/0 conn(0x7f3a2c0c7000 0x7f3a2c0ca460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:43.955 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.948+0000 7f3a320f1640 1 -- 172.21.15.88:0/2680404722 >> 172.21.15.88:0/2680404722 conn(0x7f3a2c0adf20 msgr2=0x7f3a2c0ae330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:49:43.955 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.949+0000 7f3a320f1640 1 -- 172.21.15.88:0/2680404722 shutdown_connections 2024-04-26T23:49:43.955 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.949+0000 7f3a320f1640 1 -- 172.21.15.88:0/2680404722 wait complete. 2024-04-26T23:49:43.957 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.950+0000 7f3a320f1640 1 Processor -- start 2024-04-26T23:49:43.958 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.950+0000 7f3a320f1640 1 -- start start 2024-04-26T23:49:43.958 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.950+0000 7f3a320f1640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3a2c0c7000 0x7f3a2c1ed530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:43.958 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.950+0000 7f3a320f1640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3a2c0c9830 0x7f3a2c0c5ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:43.958 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.950+0000 7f3a320f1640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3a2c154220 0x7f3a2c0b0400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:43.958 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.950+0000 7f3a320f1640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f3a2c0ca9a0 con 0x7f3a2c0c7000 2024-04-26T23:49:43.958 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.950+0000 7f3a320f1640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f3a2c157640 con 0x7f3a2c0c9830 2024-04-26T23:49:43.958 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.950+0000 7f3a320f1640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f3a2c0cab20 con 0x7f3a2c154220 2024-04-26T23:49:43.958 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.950+0000 7f3a2b7fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3a2c0c7000 0x7f3a2c1ed530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:43.958 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.950+0000 7f3a2b7fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3a2c0c7000 0x7f3a2c1ed530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:59416/0 (socket says 172.21.15.88:59416) 2024-04-26T23:49:43.958 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.950+0000 7f3a2b7fe640 1 -- 172.21.15.88:0/672339564 learned_addr learned my addr 172.21.15.88:0/672339564 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:49:43.958 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.951+0000 7f3a2bfff640 1 --2- 172.21.15.88:0/672339564 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3a2c154220 0x7f3a2c0b0400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:43.958 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.951+0000 7f3a2affd640 1 --2- 172.21.15.88:0/672339564 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3a2c0c9830 0x7f3a2c0c5ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:43.959 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.951+0000 7f3a2b7fe640 1 -- 172.21.15.88:0/672339564 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3a2c154220 msgr2=0x7f3a2c0b0400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:43.959 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.951+0000 7f3a2b7fe640 1 --2- 172.21.15.88:0/672339564 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3a2c154220 0x7f3a2c0b0400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:43.959 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.951+0000 7f3a2b7fe640 1 -- 172.21.15.88:0/672339564 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3a2c0c9830 msgr2=0x7f3a2c0c5ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:43.959 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.951+0000 7f3a2b7fe640 1 --2- 172.21.15.88:0/672339564 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3a2c0c9830 0x7f3a2c0c5ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:43.959 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.951+0000 7f3a2b7fe640 1 -- 172.21.15.88:0/672339564 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a2c0af640 con 0x7f3a2c0c7000 2024-04-26T23:49:43.959 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.951+0000 7f3a2bfff640 1 --2- 172.21.15.88:0/672339564 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3a2c154220 0x7f3a2c0b0400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:49:43.959 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.951+0000 7f3a2affd640 1 --2- 172.21.15.88:0/672339564 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3a2c0c9830 0x7f3a2c0c5ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:49:43.959 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.951+0000 7f3a2b7fe640 1 --2- 172.21.15.88:0/672339564 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3a2c0c7000 0x7f3a2c1ed530 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f3a1c00d5f0 tx=0x7f3a1c00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:49:43.959 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.951+0000 7f3a13fff640 1 -- 172.21.15.88:0/672339564 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a1c0125f0 con 0x7f3a2c0c7000 2024-04-26T23:49:43.959 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.951+0000 7f3a13fff640 1 -- 172.21.15.88:0/672339564 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a1c019070 con 0x7f3a2c0c7000 2024-04-26T23:49:43.959 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.951+0000 7f3a320f1640 1 -- 172.21.15.88:0/672339564 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a2c0af920 con 0x7f3a2c0c7000 2024-04-26T23:49:43.959 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.951+0000 7f3a13fff640 1 -- 172.21.15.88:0/672339564 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a1c0129d0 con 0x7f3a2c0c7000 2024-04-26T23:49:43.959 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.951+0000 7f3a320f1640 1 -- 172.21.15.88:0/672339564 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a2c0c60e0 con 0x7f3a2c0c7000 2024-04-26T23:49:43.959 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.952+0000 7f3a320f1640 1 -- 172.21.15.88:0/672339564 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a2c0ac0c0 con 0x7f3a2c0c7000 2024-04-26T23:49:43.960 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.952+0000 7f3a13fff640 1 -- 172.21.15.88:0/672339564 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f3a1c012b70 con 0x7f3a2c0c7000 2024-04-26T23:49:43.960 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.953+0000 7f3a13fff640 1 --2- 172.21.15.88:0/672339564 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f3a1806c8f0 0x7f3a1806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:43.960 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.953+0000 7f3a2affd640 1 --2- 172.21.15.88:0/672339564 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f3a1806c8f0 0x7f3a1806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:43.960 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.953+0000 7f3a13fff640 1 -- 172.21.15.88:0/672339564 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6666+0+0 (secure 0 0 0) 0x7f3a1c08c350 con 0x7f3a2c0c7000 2024-04-26T23:49:43.960 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.953+0000 7f3a2affd640 1 --2- 172.21.15.88:0/672339564 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f3a1806c8f0 0x7f3a1806edb0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f3a20034000 tx=0x7f3a2002e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:49:43.961 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:43.957+0000 7f3a13fff640 1 -- 172.21.15.88:0/672339564 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f3a2c0ac0c0 con 0x7f3a2c0c7000 2024-04-26T23:49:44.139 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.134+0000 7f3a320f1640 1 -- 172.21.15.88:0/672339564 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "a_data", "var": "pg_num"} v 0) -- 0x7f3a2c0766c0 con 0x7f3a2c0c7000 2024-04-26T23:49:44.139 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.134+0000 7f3a13fff640 1 -- 172.21.15.88:0/672339564 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "a_data", "var": "pg_num"}]=0 v26) ==== 95+0+11 (secure 0 0 0) 0x7f3a1c05a3d0 con 0x7f3a2c0c7000 2024-04-26T23:49:44.139 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 64 2024-04-26T23:49:44.141 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.136+0000 7f3a320f1640 1 -- 172.21.15.88:0/672339564 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f3a1806c8f0 msgr2=0x7f3a1806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:44.141 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.136+0000 7f3a320f1640 1 --2- 172.21.15.88:0/672339564 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f3a1806c8f0 0x7f3a1806edb0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f3a20034000 tx=0x7f3a2002e000 comp rx=0 tx=0).stop 2024-04-26T23:49:44.141 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.136+0000 7f3a320f1640 1 -- 172.21.15.88:0/672339564 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3a2c0c7000 msgr2=0x7f3a2c1ed530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:44.141 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.136+0000 7f3a320f1640 1 --2- 172.21.15.88:0/672339564 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3a2c0c7000 0x7f3a2c1ed530 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f3a1c00d5f0 tx=0x7f3a1c00dab0 comp rx=0 tx=0).stop 2024-04-26T23:49:44.141 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.136+0000 7f3a320f1640 1 -- 172.21.15.88:0/672339564 shutdown_connections 2024-04-26T23:49:44.142 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.136+0000 7f3a320f1640 1 --2- 172.21.15.88:0/672339564 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f3a1806c8f0 0x7f3a1806edb0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:44.142 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.136+0000 7f3a320f1640 1 --2- 172.21.15.88:0/672339564 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3a2c154220 0x7f3a2c0b0400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:44.142 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.136+0000 7f3a320f1640 1 --2- 172.21.15.88:0/672339564 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3a2c0c9830 0x7f3a2c0c5ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:44.142 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.136+0000 7f3a320f1640 1 --2- 172.21.15.88:0/672339564 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3a2c0c7000 0x7f3a2c1ed530 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:44.142 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.136+0000 7f3a320f1640 1 -- 172.21.15.88:0/672339564 >> 172.21.15.88:0/672339564 conn(0x7f3a2c0adf20 msgr2=0x7f3a2c0ac310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:49:44.142 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.136+0000 7f3a320f1640 1 -- 172.21.15.88:0/672339564 shutdown_connections 2024-04-26T23:49:44.142 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.136+0000 7f3a320f1640 1 -- 172.21.15.88:0/672339564 wait complete. 2024-04-26T23:49:44.152 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get b_metadata pg_num 2024-04-26T23:49:44.253 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.248+0000 7fd727589640 1 Processor -- start 2024-04-26T23:49:44.253 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.248+0000 7fd727589640 1 -- start start 2024-04-26T23:49:44.257 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.249+0000 7fd727589640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd7200c4250 0x7fd7200c3790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:44.257 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.249+0000 7fd727589640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fd7200c3cd0 0x7fd7201572e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:44.257 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.249+0000 7fd727589640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd7200ad010 con 0x7fd7200acc30 2024-04-26T23:49:44.257 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.249+0000 7fd727589640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7fd7200c8ba0 con 0x7fd7200c3cd0 2024-04-26T23:49:44.257 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.249+0000 7fd727589640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fd720156e50 con 0x7fd7200c4250 2024-04-26T23:49:44.257 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.249+0000 7fd725325640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fd7200acc30 0x7fd72015abf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:51280/0 (socket says 172.21.15.88:51280) 2024-04-26T23:49:44.257 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.249+0000 7fd725325640 1 -- 172.21.15.88:0/2242661787 learned_addr learned my addr 172.21.15.88:0/2242661787 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-26T23:49:44.257 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.249+0000 7fd724b24640 1 --2- 172.21.15.88:0/2242661787 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd7200c4250 0x7fd7200c3790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:44.258 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.249+0000 7fd725b26640 1 --2- 172.21.15.88:0/2242661787 >> v2:172.21.15.175:3300/0 conn(0x7fd7200c3cd0 0x7fd7201572e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:44.258 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.249+0000 7fd717fff640 1 -- 172.21.15.88:0/2242661787 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1933292609 0 0) 0x7fd7200ad010 con 0x7fd7200acc30 2024-04-26T23:49:44.258 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.249+0000 7fd717fff640 1 -- 172.21.15.88:0/2242661787 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd70c003520 con 0x7fd7200acc30 2024-04-26T23:49:44.258 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.250+0000 7fd717fff640 1 -- 172.21.15.88:0/2242661787 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3850753476 0 0) 0x7fd70c003520 con 0x7fd7200acc30 2024-04-26T23:49:44.258 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.250+0000 7fd717fff640 1 -- 172.21.15.88:0/2242661787 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd7200c4250 msgr2=0x7fd7200c3790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:49:44.258 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.250+0000 7fd717fff640 1 --2- 172.21.15.88:0/2242661787 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd7200c4250 0x7fd7200c3790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:44.258 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.250+0000 7fd717fff640 1 -- 172.21.15.88:0/2242661787 >> v2:172.21.15.175:3300/0 conn(0x7fd7200c3cd0 msgr2=0x7fd7201572e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:49:44.258 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.250+0000 7fd717fff640 1 --2- 172.21.15.88:0/2242661787 >> v2:172.21.15.175:3300/0 conn(0x7fd7200c3cd0 0x7fd7201572e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:44.258 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.250+0000 7fd717fff640 1 -- 172.21.15.88:0/2242661787 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7200c8300 con 0x7fd7200acc30 2024-04-26T23:49:44.258 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.250+0000 7fd717fff640 1 -- 172.21.15.88:0/2242661787 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 356324787 0 0) 0x7fd7180019f0 con 0x7fd7200acc30 2024-04-26T23:49:44.258 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.250+0000 7fd717fff640 1 -- 172.21.15.88:0/2242661787 >> v1:172.21.15.88:6789/0 conn(0x7fd7200acc30 legacy=0x7fd72015abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:44.258 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.250+0000 7fd717fff640 1 --2- 172.21.15.88:0/2242661787 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd70c0039b0 0x7fd70c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:44.258 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.250+0000 7fd717fff640 1 --2- 172.21.15.88:0/2242661787 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd70c004800 0x7fd70c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:44.259 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.250+0000 7fd717fff640 1 --2- 172.21.15.88:0/2242661787 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd7200c4250 0x7fd70c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:44.259 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.250+0000 7fd725325640 1 --2- 172.21.15.88:0/2242661787 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd70c0039b0 0x7fd70c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:44.259 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.250+0000 7fd717fff640 1 -- 172.21.15.88:0/2242661787 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fd7200c8ba0 con 0x7fd70c0039b0 2024-04-26T23:49:44.259 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.250+0000 7fd717fff640 1 -- 172.21.15.88:0/2242661787 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fd720156e50 con 0x7fd70c004800 2024-04-26T23:49:44.259 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.250+0000 7fd717fff640 1 -- 172.21.15.88:0/2242661787 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fd70c00b9c0 con 0x7fd7200c4250 2024-04-26T23:49:44.259 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.250+0000 7fd724b24640 1 --2- 172.21.15.88:0/2242661787 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd70c004800 0x7fd70c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:44.259 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.250+0000 7fd725b26640 1 --2- 172.21.15.88:0/2242661787 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd7200c4250 0x7fd70c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:44.259 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.250+0000 7fd725325640 1 -- 172.21.15.88:0/2242661787 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd7200c4250 msgr2=0x7fd70c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:49:44.259 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.250+0000 7fd725325640 1 --2- 172.21.15.88:0/2242661787 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd7200c4250 0x7fd70c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:44.259 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.250+0000 7fd725325640 1 -- 172.21.15.88:0/2242661787 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd70c004800 msgr2=0x7fd70c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:49:44.259 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.250+0000 7fd725325640 1 --2- 172.21.15.88:0/2242661787 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd70c004800 0x7fd70c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:44.259 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.250+0000 7fd725325640 1 -- 172.21.15.88:0/2242661787 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd70c003520 con 0x7fd70c0039b0 2024-04-26T23:49:44.259 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.250+0000 7fd724b24640 1 --2- 172.21.15.88:0/2242661787 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd70c004800 0x7fd70c004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:49:44.259 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.251+0000 7fd725325640 1 --2- 172.21.15.88:0/2242661787 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd70c0039b0 0x7fd70c003dd0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fd71800a8d0 tx=0x7fd70c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8c0250bba82a42b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:49:44.260 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.251+0000 7fd717fff640 1 -- 172.21.15.88:0/2242661787 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd71800a4c0 con 0x7fd70c0039b0 2024-04-26T23:49:44.260 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.251+0000 7fd717fff640 1 -- 172.21.15.88:0/2242661787 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd71802f070 con 0x7fd70c0039b0 2024-04-26T23:49:44.260 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.251+0000 7fd717fff640 1 -- 172.21.15.88:0/2242661787 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd71802bd00 con 0x7fd70c0039b0 2024-04-26T23:49:44.260 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.251+0000 7fd727589640 1 -- 172.21.15.88:0/2242661787 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd70c0039b0 msgr2=0x7fd70c003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:44.260 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.251+0000 7fd727589640 1 --2- 172.21.15.88:0/2242661787 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd70c0039b0 0x7fd70c003dd0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fd71800a8d0 tx=0x7fd70c005830 comp rx=0 tx=0).stop 2024-04-26T23:49:44.260 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.251+0000 7fd725b26640 1 -- 172.21.15.88:0/2242661787 reap_dead start 2024-04-26T23:49:44.260 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.252+0000 7fd727589640 1 -- 172.21.15.88:0/2242661787 shutdown_connections 2024-04-26T23:49:44.260 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.252+0000 7fd727589640 1 -- 172.21.15.88:0/2242661787 >> 172.21.15.88:0/2242661787 conn(0x7fd7200c6e60 msgr2=0x7fd7200c7270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:49:44.260 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.252+0000 7fd727589640 1 -- 172.21.15.88:0/2242661787 shutdown_connections 2024-04-26T23:49:44.260 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.252+0000 7fd727589640 1 -- 172.21.15.88:0/2242661787 wait complete. 2024-04-26T23:49:44.260 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.253+0000 7fd727589640 1 Processor -- start 2024-04-26T23:49:44.260 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.253+0000 7fd727589640 1 -- start start 2024-04-26T23:49:44.263 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.253+0000 7fd727589640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd70c0039b0 0x7fd7201498d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:44.263 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.253+0000 7fd727589640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd7200af370 0x7fd7201f02c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:44.263 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.253+0000 7fd727589640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd72014bb80 0x7fd7201ed5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:44.263 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.253+0000 7fd727589640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fd7200abec0 con 0x7fd7200af370 2024-04-26T23:49:44.263 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.253+0000 7fd727589640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fd7200c88c0 con 0x7fd72014bb80 2024-04-26T23:49:44.263 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.253+0000 7fd727589640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fd7200ac040 con 0x7fd70c0039b0 2024-04-26T23:49:44.263 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.253+0000 7fd724b24640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd7200af370 0x7fd7201f02c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:44.264 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.253+0000 7fd724b24640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd7200af370 0x7fd7201f02c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:59434/0 (socket says 172.21.15.88:59434) 2024-04-26T23:49:44.264 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.253+0000 7fd724b24640 1 -- 172.21.15.88:0/1732040373 learned_addr learned my addr 172.21.15.88:0/1732040373 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:49:44.264 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.254+0000 7fd725325640 1 --2- 172.21.15.88:0/1732040373 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd70c0039b0 0x7fd7201498d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:44.264 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.254+0000 7fd725b26640 1 --2- 172.21.15.88:0/1732040373 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd72014bb80 0x7fd7201ed5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:44.264 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.254+0000 7fd724b24640 1 -- 172.21.15.88:0/1732040373 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd70c0039b0 msgr2=0x7fd7201498d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:44.264 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.254+0000 7fd724b24640 1 --2- 172.21.15.88:0/1732040373 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd70c0039b0 0x7fd7201498d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:44.264 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.254+0000 7fd724b24640 1 -- 172.21.15.88:0/1732040373 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd72014bb80 msgr2=0x7fd7201ed5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:44.264 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.254+0000 7fd724b24640 1 --2- 172.21.15.88:0/1732040373 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd72014bb80 0x7fd7201ed5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:44.264 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.254+0000 7fd724b24640 1 -- 172.21.15.88:0/1732040373 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd72014fa30 con 0x7fd7200af370 2024-04-26T23:49:44.264 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.254+0000 7fd725325640 1 --2- 172.21.15.88:0/1732040373 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd70c0039b0 0x7fd7201498d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:49:44.265 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.254+0000 7fd724b24640 1 --2- 172.21.15.88:0/1732040373 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd7200af370 0x7fd7201f02c0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fd710011510 tx=0x7fd7100119d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:49:44.265 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.254+0000 7fd715ffb640 1 -- 172.21.15.88:0/1732040373 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd710015870 con 0x7fd7200af370 2024-04-26T23:49:44.265 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.254+0000 7fd715ffb640 1 -- 172.21.15.88:0/1732040373 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd710015a10 con 0x7fd7200af370 2024-04-26T23:49:44.265 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.254+0000 7fd727589640 1 -- 172.21.15.88:0/1732040373 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd72014fcd0 con 0x7fd7200af370 2024-04-26T23:49:44.265 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.254+0000 7fd715ffb640 1 -- 172.21.15.88:0/1732040373 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd710015dc0 con 0x7fd7200af370 2024-04-26T23:49:44.265 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.254+0000 7fd727589640 1 -- 172.21.15.88:0/1732040373 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7200ae510 con 0x7fd7200af370 2024-04-26T23:49:44.265 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.255+0000 7fd727589640 1 -- 172.21.15.88:0/1732040373 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd7200507a0 con 0x7fd7200af370 2024-04-26T23:49:44.265 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.256+0000 7fd715ffb640 1 -- 172.21.15.88:0/1732040373 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd71001d400 con 0x7fd7200af370 2024-04-26T23:49:44.265 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.256+0000 7fd715ffb640 1 --2- 172.21.15.88:0/1732040373 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fd70406c920 0x7fd70406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:44.265 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.256+0000 7fd715ffb640 1 -- 172.21.15.88:0/1732040373 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6666+0+0 (secure 0 0 0) 0x7fd71008c5f0 con 0x7fd7200af370 2024-04-26T23:49:44.265 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.256+0000 7fd725325640 1 --2- 172.21.15.88:0/1732040373 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fd70406c920 0x7fd70406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:44.265 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.256+0000 7fd725325640 1 --2- 172.21.15.88:0/1732040373 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fd70406c920 0x7fd70406ede0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fd718033000 tx=0x7fd718007000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:49:44.266 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.260+0000 7fd715ffb640 1 -- 172.21.15.88:0/1732040373 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fd710019030 con 0x7fd7200af370 2024-04-26T23:49:44.442 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.437+0000 7fd727589640 1 -- 172.21.15.88:0/1732040373 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "b_metadata", "var": "pg_num"} v 0) -- 0x7fd7200c46f0 con 0x7fd7200af370 2024-04-26T23:49:44.442 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.437+0000 7fd715ffb640 1 -- 172.21.15.88:0/1732040373 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "b_metadata", "var": "pg_num"}]=0 v26) ==== 99+0+11 (secure 0 0 0) 0x7fd71005a6f0 con 0x7fd7200af370 2024-04-26T23:49:44.442 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 32 2024-04-26T23:49:44.444 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.439+0000 7fd727589640 1 -- 172.21.15.88:0/1732040373 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fd70406c920 msgr2=0x7fd70406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:44.444 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.439+0000 7fd727589640 1 --2- 172.21.15.88:0/1732040373 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fd70406c920 0x7fd70406ede0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fd718033000 tx=0x7fd718007000 comp rx=0 tx=0).stop 2024-04-26T23:49:44.444 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.439+0000 7fd727589640 1 -- 172.21.15.88:0/1732040373 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd7200af370 msgr2=0x7fd7201f02c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:44.445 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.439+0000 7fd727589640 1 --2- 172.21.15.88:0/1732040373 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd7200af370 0x7fd7201f02c0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fd710011510 tx=0x7fd7100119d0 comp rx=0 tx=0).stop 2024-04-26T23:49:44.445 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.439+0000 7fd727589640 1 -- 172.21.15.88:0/1732040373 shutdown_connections 2024-04-26T23:49:44.445 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.439+0000 7fd727589640 1 --2- 172.21.15.88:0/1732040373 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fd70406c920 0x7fd70406ede0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:44.445 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.439+0000 7fd727589640 1 --2- 172.21.15.88:0/1732040373 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd72014bb80 0x7fd7201ed5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:44.445 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.439+0000 7fd727589640 1 --2- 172.21.15.88:0/1732040373 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd7200af370 0x7fd7201f02c0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:44.445 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.439+0000 7fd727589640 1 --2- 172.21.15.88:0/1732040373 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd70c0039b0 0x7fd7201498d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:44.445 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.439+0000 7fd727589640 1 -- 172.21.15.88:0/1732040373 >> 172.21.15.88:0/1732040373 conn(0x7fd7200c6e60 msgr2=0x7fd720156470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:49:44.445 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.440+0000 7fd727589640 1 -- 172.21.15.88:0/1732040373 shutdown_connections 2024-04-26T23:49:44.445 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.440+0000 7fd727589640 1 -- 172.21.15.88:0/1732040373 wait complete. 2024-04-26T23:49:44.455 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get b_data pg_num 2024-04-26T23:49:44.555 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.550+0000 7f2fbb546640 1 Processor -- start 2024-04-26T23:49:44.555 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.550+0000 7f2fbb546640 1 -- start start 2024-04-26T23:49:44.557 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.551+0000 7f2fbb546640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f2fb40ab3f0 0x7f2fb40c4d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:44.557 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.551+0000 7f2fbb546640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f2fb40c52c0 0x7f2fb41574b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:44.557 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.551+0000 7f2fbb546640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2fb40c3810 con 0x7f2fb41570d0 2024-04-26T23:49:44.557 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.551+0000 7f2fbb546640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f2fb40c4330 con 0x7f2fb40c52c0 2024-04-26T23:49:44.557 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.551+0000 7f2fbb546640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f2fb40c3ab0 con 0x7f2fb40ab3f0 2024-04-26T23:49:44.557 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.551+0000 7f2fb9ae3640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f2fb40c52c0 0x7f2fb41574b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:44.557 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.551+0000 7f2fb9ae3640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f2fb40c52c0 0x7f2fb41574b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:59442/0 (socket says 172.21.15.88:59442) 2024-04-26T23:49:44.557 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.551+0000 7f2fb9ae3640 1 -- 172.21.15.88:0/176493494 learned_addr learned my addr 172.21.15.88:0/176493494 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:49:44.557 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.551+0000 7f2fb8ae1640 1 --2- 172.21.15.88:0/176493494 >> v2:172.21.15.175:3300/0 conn(0x7f2fb40ab3f0 0x7f2fb40c4d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:44.557 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.551+0000 7f2fb9ae3640 1 -- 172.21.15.88:0/176493494 >> v2:172.21.15.175:3300/0 conn(0x7f2fb40ab3f0 msgr2=0x7f2fb40c4d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:49:44.558 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.551+0000 7f2fb9ae3640 1 --2- 172.21.15.88:0/176493494 >> v2:172.21.15.175:3300/0 conn(0x7f2fb40ab3f0 0x7f2fb40c4d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:44.558 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.551+0000 7f2fb9ae3640 1 -- 172.21.15.88:0/176493494 >> v1:172.21.15.175:6789/0 conn(0x7f2fb41570d0 legacy=0x7f2fb4150a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:49:44.558 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.551+0000 7f2fb9ae3640 1 -- 172.21.15.88:0/176493494 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fb40c4580 con 0x7f2fb40c52c0 2024-04-26T23:49:44.558 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.552+0000 7f2fb9ae3640 1 --2- 172.21.15.88:0/176493494 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2fb40c52c0 0x7f2fb41574b0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f2fb40c44b0 tx=0x7f2fac02c7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=447cd0162a90b535 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:49:44.558 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.552+0000 7f2fabfff640 1 -- 172.21.15.88:0/176493494 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fac009600 con 0x7f2fb40c52c0 2024-04-26T23:49:44.558 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.552+0000 7f2fabfff640 1 -- 172.21.15.88:0/176493494 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2fac0097a0 con 0x7f2fb40c52c0 2024-04-26T23:49:44.558 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.552+0000 7f2fabfff640 1 -- 172.21.15.88:0/176493494 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fac009b70 con 0x7f2fb40c52c0 2024-04-26T23:49:44.561 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.553+0000 7f2fbb546640 1 -- 172.21.15.88:0/176493494 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2fb40c52c0 msgr2=0x7f2fb41574b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:44.561 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.553+0000 7f2fbb546640 1 --2- 172.21.15.88:0/176493494 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2fb40c52c0 0x7f2fb41574b0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f2fb40c44b0 tx=0x7f2fac02c7c0 comp rx=0 tx=0).stop 2024-04-26T23:49:44.561 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.553+0000 7f2fbb546640 1 -- 172.21.15.88:0/176493494 shutdown_connections 2024-04-26T23:49:44.561 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.553+0000 7f2fbb546640 1 --2- 172.21.15.88:0/176493494 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2fb40c52c0 0x7f2fb41574b0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:44.561 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.553+0000 7f2fbb546640 1 --2- 172.21.15.88:0/176493494 >> v2:172.21.15.175:3300/0 conn(0x7f2fb40ab3f0 0x7f2fb40c4d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:44.561 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.553+0000 7f2fbb546640 1 -- 172.21.15.88:0/176493494 >> 172.21.15.88:0/176493494 conn(0x7f2fb406c310 msgr2=0x7f2fb406c6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:49:44.561 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.553+0000 7f2fbb546640 1 -- 172.21.15.88:0/176493494 shutdown_connections 2024-04-26T23:49:44.561 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.553+0000 7f2fbb546640 1 -- 172.21.15.88:0/176493494 wait complete. 2024-04-26T23:49:44.561 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.554+0000 7f2fbb546640 1 Processor -- start 2024-04-26T23:49:44.561 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.554+0000 7f2fbb546640 1 -- start start 2024-04-26T23:49:44.561 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.555+0000 7f2fbb546640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2fb40ab3f0 0x7f2fb4143db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:44.561 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.555+0000 7f2fbb546640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2fb40c52c0 0x7f2fb414fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:44.561 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.555+0000 7f2fbb546640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2fb41570d0 0x7f2fb40c1700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:44.562 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.555+0000 7f2fbb546640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f2fb41512e0 con 0x7f2fb40ab3f0 2024-04-26T23:49:44.562 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.555+0000 7f2fbb546640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f2fb4151160 con 0x7f2fb41570d0 2024-04-26T23:49:44.562 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.555+0000 7f2fbb546640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f2fb40aba60 con 0x7f2fb40c52c0 2024-04-26T23:49:44.562 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.555+0000 7f2fb92e2640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2fb40ab3f0 0x7f2fb4143db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:44.562 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.555+0000 7f2fb92e2640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2fb40ab3f0 0x7f2fb4143db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:59450/0 (socket says 172.21.15.88:59450) 2024-04-26T23:49:44.562 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.555+0000 7f2fb92e2640 1 -- 172.21.15.88:0/3340980073 learned_addr learned my addr 172.21.15.88:0/3340980073 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:49:44.562 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.555+0000 7f2fb92e2640 1 -- 172.21.15.88:0/3340980073 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2fb40c52c0 msgr2=0x7f2fb414fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:44.562 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.555+0000 7f2fb92e2640 1 --2- 172.21.15.88:0/3340980073 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2fb40c52c0 0x7f2fb414fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:44.562 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.555+0000 7f2fb92e2640 1 -- 172.21.15.88:0/3340980073 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2fb41570d0 msgr2=0x7f2fb40c1700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:44.562 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.555+0000 7f2fb92e2640 1 --2- 172.21.15.88:0/3340980073 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2fb41570d0 0x7f2fb40c1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:44.562 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.555+0000 7f2fb92e2640 1 -- 172.21.15.88:0/3340980073 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fb414ffa0 con 0x7f2fb40ab3f0 2024-04-26T23:49:44.562 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.555+0000 7f2fb92e2640 1 --2- 172.21.15.88:0/3340980073 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2fb40ab3f0 0x7f2fb4143db0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f2fb000b420 tx=0x7f2fb000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:49:44.562 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.555+0000 7f2fa9ffb640 1 -- 172.21.15.88:0/3340980073 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fb0011830 con 0x7f2fb40ab3f0 2024-04-26T23:49:44.562 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.555+0000 7f2fa9ffb640 1 -- 172.21.15.88:0/3340980073 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2fb0016070 con 0x7f2fb40ab3f0 2024-04-26T23:49:44.563 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.555+0000 7f2fa9ffb640 1 -- 172.21.15.88:0/3340980073 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fb0011c10 con 0x7f2fb40ab3f0 2024-04-26T23:49:44.563 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.555+0000 7f2fbb546640 1 -- 172.21.15.88:0/3340980073 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2fb414f160 con 0x7f2fb40ab3f0 2024-04-26T23:49:44.563 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.556+0000 7f2fbb546640 1 -- 172.21.15.88:0/3340980073 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2fb414e680 con 0x7f2fb40ab3f0 2024-04-26T23:49:44.564 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.557+0000 7f2fbb546640 1 -- 172.21.15.88:0/3340980073 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2fb40ace20 con 0x7f2fb40ab3f0 2024-04-26T23:49:44.564 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.557+0000 7f2fa9ffb640 1 -- 172.21.15.88:0/3340980073 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2fb001b460 con 0x7f2fb40ab3f0 2024-04-26T23:49:44.564 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.557+0000 7f2fa9ffb640 1 --2- 172.21.15.88:0/3340980073 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f2f9806c8f0 0x7f2f9806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:44.564 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.557+0000 7f2fa9ffb640 1 -- 172.21.15.88:0/3340980073 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6666+0+0 (secure 0 0 0) 0x7f2fb008b910 con 0x7f2fb40ab3f0 2024-04-26T23:49:44.564 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.557+0000 7f2fb8ae1640 1 --2- 172.21.15.88:0/3340980073 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f2f9806c8f0 0x7f2f9806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:44.564 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.558+0000 7f2fb8ae1640 1 --2- 172.21.15.88:0/3340980073 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f2f9806c8f0 0x7f2f9806edb0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f2fb41ed730 tx=0x7f2fa4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:49:44.566 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.562+0000 7f2fa9ffb640 1 -- 172.21.15.88:0/3340980073 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f2fb40ace20 con 0x7f2fb40ab3f0 2024-04-26T23:49:44.741 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.736+0000 7f2fbb546640 1 -- 172.21.15.88:0/3340980073 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "b_data", "var": "pg_num"} v 0) -- 0x7f2fb40507a0 con 0x7f2fb40ab3f0 2024-04-26T23:49:44.741 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.736+0000 7f2fa9ffb640 1 -- 172.21.15.88:0/3340980073 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "b_data", "var": "pg_num"}]=0 v26) ==== 95+0+11 (secure 0 0 0) 0x7f2fb0020020 con 0x7f2fb40ab3f0 2024-04-26T23:49:44.742 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 64 2024-04-26T23:49:44.744 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.739+0000 7f2fbb546640 1 -- 172.21.15.88:0/3340980073 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f2f9806c8f0 msgr2=0x7f2f9806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:44.744 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.739+0000 7f2fbb546640 1 --2- 172.21.15.88:0/3340980073 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f2f9806c8f0 0x7f2f9806edb0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f2fb41ed730 tx=0x7f2fa4008040 comp rx=0 tx=0).stop 2024-04-26T23:49:44.744 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.739+0000 7f2fbb546640 1 -- 172.21.15.88:0/3340980073 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2fb40ab3f0 msgr2=0x7f2fb4143db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:44.744 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.739+0000 7f2fbb546640 1 --2- 172.21.15.88:0/3340980073 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2fb40ab3f0 0x7f2fb4143db0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f2fb000b420 tx=0x7f2fb000b8e0 comp rx=0 tx=0).stop 2024-04-26T23:49:44.744 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.739+0000 7f2fbb546640 1 -- 172.21.15.88:0/3340980073 shutdown_connections 2024-04-26T23:49:44.744 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.739+0000 7f2fbb546640 1 --2- 172.21.15.88:0/3340980073 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f2f9806c8f0 0x7f2f9806edb0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:44.744 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.739+0000 7f2fbb546640 1 --2- 172.21.15.88:0/3340980073 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2fb40c52c0 0x7f2fb414fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:44.744 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.739+0000 7f2fbb546640 1 --2- 172.21.15.88:0/3340980073 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2fb41570d0 0x7f2fb40c1700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:44.744 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.739+0000 7f2fbb546640 1 --2- 172.21.15.88:0/3340980073 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2fb40ab3f0 0x7f2fb4143db0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:44.744 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.739+0000 7f2fbb546640 1 -- 172.21.15.88:0/3340980073 >> 172.21.15.88:0/3340980073 conn(0x7f2fb406c310 msgr2=0x7f2fb40c2bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:49:44.744 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.739+0000 7f2fbb546640 1 -- 172.21.15.88:0/3340980073 shutdown_connections 2024-04-26T23:49:44.744 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.739+0000 7f2fbb546640 1 -- 172.21.15.88:0/3340980073 wait complete. 2024-04-26T23:49:44.755 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-26T23:49:44.853 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.849+0000 7f964c893640 1 Processor -- start 2024-04-26T23:49:44.853 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.849+0000 7f964c893640 1 -- start start 2024-04-26T23:49:44.854 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.849+0000 7f964c893640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f96480c4250 0x7f96480c3790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:44.855 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.849+0000 7f964c893640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f96480c3cd0 0x7f96481572e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:44.855 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.849+0000 7f964c893640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f96480ad010 con 0x7f96480acc30 2024-04-26T23:49:44.855 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.849+0000 7f964c893640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f96480c8ba0 con 0x7f96480c3cd0 2024-04-26T23:49:44.855 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.849+0000 7f964c893640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f9648156e50 con 0x7f96480c4250 2024-04-26T23:49:44.855 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.850+0000 7f9646d9d640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f96480c3cd0 0x7f96481572e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:44.855 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.850+0000 7f9646d9d640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f96480c3cd0 0x7f96481572e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:59464/0 (socket says 172.21.15.88:59464) 2024-04-26T23:49:44.855 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.850+0000 7f9646d9d640 1 -- 172.21.15.88:0/2522871359 learned_addr learned my addr 172.21.15.88:0/2522871359 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:49:44.855 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.850+0000 7f9645d9b640 1 --2- 172.21.15.88:0/2522871359 >> v2:172.21.15.175:3300/0 conn(0x7f96480c4250 0x7f96480c3790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:44.855 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.850+0000 7f9646d9d640 1 -- 172.21.15.88:0/2522871359 >> v2:172.21.15.175:3300/0 conn(0x7f96480c4250 msgr2=0x7f96480c3790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:49:44.855 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.850+0000 7f9646d9d640 1 --2- 172.21.15.88:0/2522871359 >> v2:172.21.15.175:3300/0 conn(0x7f96480c4250 0x7f96480c3790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:44.855 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.850+0000 7f9646d9d640 1 -- 172.21.15.88:0/2522871359 >> v1:172.21.15.175:6789/0 conn(0x7f96480acc30 legacy=0x7f964815abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:49:44.855 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.850+0000 7f9646d9d640 1 -- 172.21.15.88:0/2522871359 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96480c8300 con 0x7f96480c3cd0 2024-04-26T23:49:44.857 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.851+0000 7f9646d9d640 1 --2- 172.21.15.88:0/2522871359 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f96480c3cd0 0x7f96481572e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f9648071a50 tx=0x7f964002a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57c30e0e2e94dc50 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:49:44.857 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.851+0000 7f964559a640 1 -- 172.21.15.88:0/2522871359 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9640036070 con 0x7f96480c3cd0 2024-04-26T23:49:44.857 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.851+0000 7f964559a640 1 -- 172.21.15.88:0/2522871359 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9640031600 con 0x7f96480c3cd0 2024-04-26T23:49:44.857 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.851+0000 7f964559a640 1 -- 172.21.15.88:0/2522871359 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96400319d0 con 0x7f96480c3cd0 2024-04-26T23:49:44.857 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.851+0000 7f964c893640 1 -- 172.21.15.88:0/2522871359 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f96480c3cd0 msgr2=0x7f96481572e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:44.857 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.851+0000 7f964c893640 1 --2- 172.21.15.88:0/2522871359 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f96480c3cd0 0x7f96481572e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f9648071a50 tx=0x7f964002a660 comp rx=0 tx=0).stop 2024-04-26T23:49:44.857 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.851+0000 7f964c893640 1 -- 172.21.15.88:0/2522871359 shutdown_connections 2024-04-26T23:49:44.857 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.851+0000 7f964c893640 1 --2- 172.21.15.88:0/2522871359 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f96480c3cd0 0x7f96481572e0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:44.857 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.851+0000 7f964c893640 1 --2- 172.21.15.88:0/2522871359 >> v2:172.21.15.175:3300/0 conn(0x7f96480c4250 0x7f96480c3790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:44.857 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.851+0000 7f964c893640 1 -- 172.21.15.88:0/2522871359 >> 172.21.15.88:0/2522871359 conn(0x7f96480c6e60 msgr2=0x7f96480c7270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:49:44.857 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.851+0000 7f964c893640 1 -- 172.21.15.88:0/2522871359 shutdown_connections 2024-04-26T23:49:44.857 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.851+0000 7f964c893640 1 -- 172.21.15.88:0/2522871359 wait complete. 2024-04-26T23:49:44.860 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.853+0000 7f964c893640 1 Processor -- start 2024-04-26T23:49:44.860 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.853+0000 7f964c893640 1 -- start start 2024-04-26T23:49:44.860 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.853+0000 7f964c893640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f96480acc30 0x7f96480ae540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:44.860 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.853+0000 7f964c893640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f96480c3cd0 0x7f96481efd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:44.860 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.853+0000 7f964c893640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f96480c4250 0x7f96481e0280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:44.860 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.853+0000 7f964c893640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f96480abec0 con 0x7f96480acc30 2024-04-26T23:49:44.860 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.853+0000 7f964c893640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f96480c88c0 con 0x7f96480c4250 2024-04-26T23:49:44.860 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.853+0000 7f964c893640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f96480ac040 con 0x7f96480c3cd0 2024-04-26T23:49:44.861 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.853+0000 7f964659c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f96480acc30 0x7f96480ae540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:44.861 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.853+0000 7f964659c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f96480acc30 0x7f96480ae540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:59466/0 (socket says 172.21.15.88:59466) 2024-04-26T23:49:44.861 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.853+0000 7f964659c640 1 -- 172.21.15.88:0/1765175045 learned_addr learned my addr 172.21.15.88:0/1765175045 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:49:44.861 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.853+0000 7f9645d9b640 1 --2- 172.21.15.88:0/1765175045 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f96480c3cd0 0x7f96481efd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:44.861 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.854+0000 7f9646d9d640 1 --2- 172.21.15.88:0/1765175045 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f96480c4250 0x7f96481e0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:44.861 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.854+0000 7f964659c640 1 -- 172.21.15.88:0/1765175045 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f96480c3cd0 msgr2=0x7f96481efd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:44.861 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.854+0000 7f964659c640 1 --2- 172.21.15.88:0/1765175045 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f96480c3cd0 0x7f96481efd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:44.861 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.854+0000 7f964659c640 1 -- 172.21.15.88:0/1765175045 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f96480c4250 msgr2=0x7f96481e0280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:44.861 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.854+0000 7f964659c640 1 --2- 172.21.15.88:0/1765175045 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f96480c4250 0x7f96481e0280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:44.861 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.854+0000 7f964659c640 1 -- 172.21.15.88:0/1765175045 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96481f0720 con 0x7f96480acc30 2024-04-26T23:49:44.861 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.854+0000 7f9646d9d640 1 --2- 172.21.15.88:0/1765175045 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f96480c4250 0x7f96481e0280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:49:44.861 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.854+0000 7f964659c640 1 --2- 172.21.15.88:0/1765175045 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f96480acc30 0x7f96480ae540 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f963000c430 tx=0x7f963000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:49:44.861 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.854+0000 7f963effd640 1 -- 172.21.15.88:0/1765175045 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9630011790 con 0x7f96480acc30 2024-04-26T23:49:44.861 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.854+0000 7f963effd640 1 -- 172.21.15.88:0/1765175045 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9630017070 con 0x7f96480acc30 2024-04-26T23:49:44.862 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.854+0000 7f964c893640 1 -- 172.21.15.88:0/1765175045 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96480af070 con 0x7f96480acc30 2024-04-26T23:49:44.862 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.854+0000 7f963effd640 1 -- 172.21.15.88:0/1765175045 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9630011bb0 con 0x7f96480acc30 2024-04-26T23:49:44.862 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.854+0000 7f964c893640 1 -- 172.21.15.88:0/1765175045 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96480ad490 con 0x7f96480acc30 2024-04-26T23:49:44.862 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.855+0000 7f964c893640 1 -- 172.21.15.88:0/1765175045 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f96480507a0 con 0x7f96480acc30 2024-04-26T23:49:44.862 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.855+0000 7f963effd640 1 -- 172.21.15.88:0/1765175045 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f963001c460 con 0x7f96480acc30 2024-04-26T23:49:44.863 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.856+0000 7f963effd640 1 --2- 172.21.15.88:0/1765175045 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f962806c920 0x7f962806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:44.863 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.856+0000 7f9645d9b640 1 --2- 172.21.15.88:0/1765175045 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f962806c920 0x7f962806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:44.863 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.856+0000 7f963effd640 1 -- 172.21.15.88:0/1765175045 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6666+0+0 (secure 0 0 0) 0x7f963008bc40 con 0x7f96480acc30 2024-04-26T23:49:44.863 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.856+0000 7f9645d9b640 1 --2- 172.21.15.88:0/1765175045 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f962806c920 0x7f962806ede0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f96480c4d40 tx=0x7f9638008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:49:44.865 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:44.860+0000 7f963effd640 1 -- 172.21.15.88:0/1765175045 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f9630059d40 con 0x7f96480acc30 2024-04-26T23:49:45.055 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:45.051+0000 7f964c893640 1 -- 172.21.15.88:0/1765175045 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f96480c46f0 con 0x7f96480acc30 2024-04-26T23:49:45.055 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:45.051+0000 7f963effd640 1 -- 172.21.15.88:0/1765175045 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) ==== 80+0+0 (secure 0 0 0) 0x7f9630059640 con 0x7f96480acc30 2024-04-26T23:49:45.056 INFO:teuthology.orchestra.run.smithi088.stderr:listed 0 entries 2024-04-26T23:49:45.058 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:45.053+0000 7f964c893640 1 -- 172.21.15.88:0/1765175045 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f962806c920 msgr2=0x7f962806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:45.058 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:45.053+0000 7f964c893640 1 --2- 172.21.15.88:0/1765175045 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f962806c920 0x7f962806ede0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f96480c4d40 tx=0x7f9638008040 comp rx=0 tx=0).stop 2024-04-26T23:49:45.058 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:45.053+0000 7f964c893640 1 -- 172.21.15.88:0/1765175045 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f96480acc30 msgr2=0x7f96480ae540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:45.058 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:45.053+0000 7f964c893640 1 --2- 172.21.15.88:0/1765175045 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f96480acc30 0x7f96480ae540 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f963000c430 tx=0x7f963000c8f0 comp rx=0 tx=0).stop 2024-04-26T23:49:45.058 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:45.053+0000 7f964c893640 1 -- 172.21.15.88:0/1765175045 shutdown_connections 2024-04-26T23:49:45.058 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:45.053+0000 7f964c893640 1 --2- 172.21.15.88:0/1765175045 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f962806c920 0x7f962806ede0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:45.058 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:45.053+0000 7f964c893640 1 --2- 172.21.15.88:0/1765175045 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f96480c3cd0 0x7f96481efd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:45.059 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:45.053+0000 7f964c893640 1 --2- 172.21.15.88:0/1765175045 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f96480c4250 0x7f96481e0280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:45.059 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:45.053+0000 7f964c893640 1 --2- 172.21.15.88:0/1765175045 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f96480acc30 0x7f96480ae540 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:45.059 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:45.053+0000 7f964c893640 1 -- 172.21.15.88:0/1765175045 >> 172.21.15.88:0/1765175045 conn(0x7f96480c6e60 msgr2=0x7f96481572e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:49:45.059 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:45.053+0000 7f964c893640 1 -- 172.21.15.88:0/1765175045 shutdown_connections 2024-04-26T23:49:45.059 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:45.053+0000 7f964c893640 1 -- 172.21.15.88:0/1765175045 wait complete. 2024-04-26T23:49:45.069 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-04-26T23:49:45.069 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:49:45.069 DEBUG:teuthology.orchestra.run.smithi175:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-04-26T23:49:45.140 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi175.front.sepia.ceph.com 2024-04-26T23:49:45.141 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:49:45.141 DEBUG:teuthology.orchestra.run.smithi175:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-04-26T23:49:45.171 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:49:45.171 DEBUG:teuthology.orchestra.run.smithi088:> ip netns list 2024-04-26T23:49:45.203 INFO:teuthology.orchestra.run.smithi088.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-26T23:49:45.203 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:49:45.203 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-26T23:49:45.284 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:49:45.285 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip link delete ceph-brx 2024-04-26T23:49:45.390 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:49:45.390 DEBUG:teuthology.orchestra.run.smithi175:> ip netns list 2024-04-26T23:49:45.406 INFO:teuthology.orchestra.run.smithi175.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-04-26T23:49:45.406 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:49:45.406 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-26T23:49:45.470 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:49:45.471 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip link delete ceph-brx 2024-04-26T23:49:45.577 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-04-26T23:49:45.586 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-26T23:49:45.586 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T23:49:45.684 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:45.680+0000 7f8d3b76a640 1 Processor -- start 2024-04-26T23:49:45.684 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:45.680+0000 7f8d3b76a640 1 -- start start 2024-04-26T23:49:45.685 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:45.681+0000 7f8d3b76a640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f8d341541d0 0x7f8d340c8400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:45.686 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:45.681+0000 7f8d3b76a640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8d340c3fc0 con 0x7f8d34070490 2024-04-26T23:49:45.686 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:45.681+0000 7f8d3b76a640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8d340c3500 con 0x7f8d3415a3c0 2024-04-26T23:49:45.686 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:45.681+0000 7f8d3b76a640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f8d340c37e0 con 0x7f8d341541d0 2024-04-26T23:49:45.686 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:45.681+0000 7f8d39506640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f8d341541d0 0x7f8d340c8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:45.686 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:45.681+0000 7f8d38d05640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f8d34070490 0x7f8d340c7420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:51290/0 (socket says 172.21.15.88:51290) 2024-04-26T23:49:45.686 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:45.681+0000 7f8d38d05640 1 -- 172.21.15.88:0/868830312 learned_addr learned my addr 172.21.15.88:0/868830312 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-26T23:49:45.686 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:45.681+0000 7f8d39506640 1 -- 172.21.15.88:0/868830312 >> v1:172.21.15.175:6789/0 conn(0x7f8d3415a3c0 legacy=0x7f8d3415a7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:49:45.686 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:45.681+0000 7f8d39506640 1 -- 172.21.15.88:0/868830312 >> v1:172.21.15.88:6789/0 conn(0x7f8d34070490 legacy=0x7f8d340c7420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:45.686 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:45.681+0000 7f8d2bfff640 1 -- 172.21.15.88:0/868830312 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2623268773 0 0) 0x7f8d340c3fc0 con 0x7f8d34070490 2024-04-26T23:49:45.686 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:45.681+0000 7f8d39506640 1 -- 172.21.15.88:0/868830312 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d340c3ac0 con 0x7f8d341541d0 2024-04-26T23:49:45.688 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:45.682+0000 7f8d39506640 1 --2- 172.21.15.88:0/868830312 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8d341541d0 0x7f8d340c8400 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f8d300097a0 tx=0x7f8d3002a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef7b1ed13a5fa332 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:49:45.688 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:45.682+0000 7f8d2bfff640 1 -- 172.21.15.88:0/868830312 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d30037070 con 0x7f8d341541d0 2024-04-26T23:49:45.688 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:45.682+0000 7f8d2bfff640 1 -- 172.21.15.88:0/868830312 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d3002ae50 con 0x7f8d341541d0 2024-04-26T23:49:45.688 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:45.682+0000 7f8d2bfff640 1 -- 172.21.15.88:0/868830312 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d30032660 con 0x7f8d341541d0 2024-04-26T23:49:45.688 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:45.682+0000 7f8d3b76a640 1 -- 172.21.15.88:0/868830312 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8d341541d0 msgr2=0x7f8d340c8400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:45.688 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:45.682+0000 7f8d3b76a640 1 --2- 172.21.15.88:0/868830312 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8d341541d0 0x7f8d340c8400 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f8d300097a0 tx=0x7f8d3002a140 comp rx=0 tx=0).stop 2024-04-26T23:49:45.688 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:45.682+0000 7f8d3b76a640 1 -- 172.21.15.88:0/868830312 shutdown_connections 2024-04-26T23:49:45.688 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:45.682+0000 7f8d3b76a640 1 --2- 172.21.15.88:0/868830312 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8d341541d0 0x7f8d340c8400 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:45.688 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:45.682+0000 7f8d3b76a640 1 -- 172.21.15.88:0/868830312 >> 172.21.15.88:0/868830312 conn(0x7f8d340c8c40 msgr2=0x7f8d340c9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:49:45.688 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:45.683+0000 7f8d3b76a640 1 -- 172.21.15.88:0/868830312 shutdown_connections 2024-04-26T23:49:45.688 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:45.683+0000 7f8d3b76a640 1 -- 172.21.15.88:0/868830312 wait complete. 2024-04-26T23:49:45.690 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:45.684+0000 7f8d3b76a640 1 Processor -- start 2024-04-26T23:49:45.691 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:45.684+0000 7f8d3b76a640 1 -- start start 2024-04-26T23:49:45.691 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:45.684+0000 7f8d3b76a640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8d34070490 0x7f8d341f0b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:45.691 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:45.684+0000 7f8d3b76a640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8d341541d0 0x7f8d34074570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:45.691 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:45.684+0000 7f8d3b76a640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8d3415a3c0 0x7f8d34150490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:45.691 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:45.684+0000 7f8d3b76a640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f8d340c7cb0 con 0x7f8d3415a3c0 2024-04-26T23:49:45.691 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:45.684+0000 7f8d3b76a640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f8d340c7b30 con 0x7f8d34070490 2024-04-26T23:49:45.691 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:45.684+0000 7f8d3b76a640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f8d3415aef0 con 0x7f8d341541d0 2024-04-26T23:49:45.691 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:45.684+0000 7f8d39d07640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8d3415a3c0 0x7f8d34150490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:45.691 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:45.684+0000 7f8d39d07640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8d3415a3c0 0x7f8d34150490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:59494/0 (socket says 172.21.15.88:59494) 2024-04-26T23:49:45.691 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:45.684+0000 7f8d39d07640 1 -- 172.21.15.88:0/2787303455 learned_addr learned my addr 172.21.15.88:0/2787303455 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:49:45.691 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:45.684+0000 7f8d39506640 1 --2- 172.21.15.88:0/2787303455 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8d34070490 0x7f8d341f0b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:45.691 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:45.685+0000 7f8d38d05640 1 --2- 172.21.15.88:0/2787303455 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8d341541d0 0x7f8d34074570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:45.692 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:45.685+0000 7f8d39d07640 1 -- 172.21.15.88:0/2787303455 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8d341541d0 msgr2=0x7f8d34074570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:45.692 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:45.685+0000 7f8d39d07640 1 --2- 172.21.15.88:0/2787303455 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8d341541d0 0x7f8d34074570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:45.692 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:45.685+0000 7f8d39d07640 1 -- 172.21.15.88:0/2787303455 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8d34070490 msgr2=0x7f8d341f0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:45.692 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:45.685+0000 7f8d39d07640 1 --2- 172.21.15.88:0/2787303455 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8d34070490 0x7f8d341f0b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:45.692 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:45.685+0000 7f8d39d07640 1 -- 172.21.15.88:0/2787303455 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d3406fa80 con 0x7f8d3415a3c0 2024-04-26T23:49:45.692 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:45.685+0000 7f8d39d07640 1 --2- 172.21.15.88:0/2787303455 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8d3415a3c0 0x7f8d34150490 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f8d2c00b9c0 tx=0x7f8d2c00be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:49:45.692 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:45.685+0000 7f8d29ffb640 1 -- 172.21.15.88:0/2787303455 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d2c019070 con 0x7f8d3415a3c0 2024-04-26T23:49:45.692 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:45.685+0000 7f8d29ffb640 1 -- 172.21.15.88:0/2787303455 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d2c00cba0 con 0x7f8d3415a3c0 2024-04-26T23:49:45.692 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:45.685+0000 7f8d3b76a640 1 -- 172.21.15.88:0/2787303455 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d3406fd60 con 0x7f8d3415a3c0 2024-04-26T23:49:45.692 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:45.685+0000 7f8d29ffb640 1 -- 172.21.15.88:0/2787303455 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d2c014440 con 0x7f8d3415a3c0 2024-04-26T23:49:45.692 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:45.685+0000 7f8d3b76a640 1 -- 172.21.15.88:0/2787303455 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d34074ab0 con 0x7f8d3415a3c0 2024-04-26T23:49:45.692 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:45.686+0000 7f8d3b76a640 1 -- 172.21.15.88:0/2787303455 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d34076690 con 0x7f8d3415a3c0 2024-04-26T23:49:45.692 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:45.686+0000 7f8d29ffb640 1 -- 172.21.15.88:0/2787303455 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8d2c01c070 con 0x7f8d3415a3c0 2024-04-26T23:49:45.693 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:45.687+0000 7f8d29ffb640 1 --2- 172.21.15.88:0/2787303455 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f8d1806c8f0 0x7f8d1806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:45.693 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:45.687+0000 7f8d29ffb640 1 -- 172.21.15.88:0/2787303455 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6666+0+0 (secure 0 0 0) 0x7f8d2c08bb20 con 0x7f8d3415a3c0 2024-04-26T23:49:45.693 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:45.687+0000 7f8d39506640 1 --2- 172.21.15.88:0/2787303455 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f8d1806c8f0 0x7f8d1806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:45.693 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:45.687+0000 7f8d39506640 1 --2- 172.21.15.88:0/2787303455 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f8d1806c8f0 0x7f8d1806edb0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f8d30034000 tx=0x7f8d3002e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:49:45.695 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:45.691+0000 7f8d29ffb640 1 -- 172.21.15.88:0/2787303455 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f8d2c0595d0 con 0x7f8d3415a3c0 2024-04-26T23:49:45.866 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:45.862+0000 7f8d3b76a640 1 -- 172.21.15.88:0/2787303455 --> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f8d341f10c0 con 0x7f8d1806c8f0 2024-04-26T23:49:45.878 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:45.873+0000 7f8d29ffb640 1 -- 172.21.15.88:0/2787303455 <== mgr.4104 v2:172.21.15.88:6832/651674297 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+494261 (secure 0 0 0) 0x7f8d30032750 con 0x7f8d1806c8f0 2024-04-26T23:49:45.884 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-26T23:49:45.888 INFO:teuthology.orchestra.run.smithi088.stderr:dumped all 2024-04-26T23:49:45.890 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:45.877+0000 7f8d3b76a640 1 -- 172.21.15.88:0/2787303455 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f8d1806c8f0 msgr2=0x7f8d1806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:45.890 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:45.877+0000 7f8d3b76a640 1 --2- 172.21.15.88:0/2787303455 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f8d1806c8f0 0x7f8d1806edb0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f8d30034000 tx=0x7f8d3002e000 comp rx=0 tx=0).stop 2024-04-26T23:49:45.890 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:45.877+0000 7f8d3b76a640 1 -- 172.21.15.88:0/2787303455 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8d3415a3c0 msgr2=0x7f8d34150490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:45.890 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:45.877+0000 7f8d3b76a640 1 --2- 172.21.15.88:0/2787303455 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8d3415a3c0 0x7f8d34150490 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f8d2c00b9c0 tx=0x7f8d2c00be80 comp rx=0 tx=0).stop 2024-04-26T23:49:45.890 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:45.877+0000 7f8d3b76a640 1 -- 172.21.15.88:0/2787303455 shutdown_connections 2024-04-26T23:49:45.890 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:45.877+0000 7f8d3b76a640 1 --2- 172.21.15.88:0/2787303455 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f8d1806c8f0 0x7f8d1806edb0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:45.890 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:45.877+0000 7f8d3b76a640 1 --2- 172.21.15.88:0/2787303455 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8d341541d0 0x7f8d34074570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:45.890 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:45.877+0000 7f8d3b76a640 1 --2- 172.21.15.88:0/2787303455 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8d3415a3c0 0x7f8d34150490 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:45.890 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:45.877+0000 7f8d3b76a640 1 --2- 172.21.15.88:0/2787303455 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8d34070490 0x7f8d341f0b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:45.890 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:45.877+0000 7f8d3b76a640 1 -- 172.21.15.88:0/2787303455 >> 172.21.15.88:0/2787303455 conn(0x7f8d340c8c40 msgr2=0x7f8d340c7f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:49:45.890 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:45.877+0000 7f8d3b76a640 1 -- 172.21.15.88:0/2787303455 shutdown_connections 2024-04-26T23:49:45.890 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:45.878+0000 7f8d3b76a640 1 -- 172.21.15.88:0/2787303455 wait complete. 2024-04-26T23:49:45.893 INFO:teuthology.orchestra.run.smithi088.stdout:{"pg_ready":true,"pg_map":{"version":302,"stamp":"2024-04-26T23:49:44.107749+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":308985640,"num_objects":120,"num_object_clones":0,"num_object_copies":240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":120,"num_whiteouts":0,"num_read":149,"num_read_kb":293,"num_write":8375219,"num_write_kb":107315375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":560506,"ondisk_log_size":560506,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":386,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":5718880,"kb_used_data":605792,"kb_used_omap":12,"kb_used_meta":5113011,"kb_avail":749255840,"statfs":{"total":773094113280,"available":767237980160,"internally_reserved":0,"allocated":620331008,"data_stored":618875563,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":5235723824},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1,1,1],"upper_bound":32},"perf_stat":{"commit_latency_ms":43,"apply_latency_ms":43,"commit_latency_ns":43000000,"apply_latency_ns":43000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-17635592210,"num_objects":-4604,"num_object_clones":0,"num_object_copies":-9208,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-4604,"num_whiteouts":0,"num_read":9,"num_read_kb":57,"num_write":4734,"num_write_kb":2186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004260"},"pg_stats":[{"pgid":"5.18","version":"26'4247","reported_seq":4266,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:32.356515+0000","last_change":"2024-04-26T23:40:41.683801+0000","last_active":"2024-04-26T23:49:32.356515+0000","last_peered":"2024-04-26T23:49:32.356515+0000","last_clean":"2024-04-26T23:49:32.356515+0000","last_became_active":"2024-04-26T23:40:41.683484+0000","last_became_peered":"2024-04-26T23:40:41.683484+0000","last_unstale":"2024-04-26T23:49:32.356515+0000","last_undegraded":"2024-04-26T23:49:32.356515+0000","last_fullsized":"2024-04-26T23:49:32.356515+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":4247,"log_dups_size":0,"ondisk_log_size":4247,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:02:27.160408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":63732,"num_write_kb":854695,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1f","version":"26'15","reported_seq":45,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:47:58.449743+0000","last_change":"2024-04-26T23:40:31.576688+0000","last_active":"2024-04-26T23:47:58.449743+0000","last_peered":"2024-04-26T23:47:58.449743+0000","last_clean":"2024-04-26T23:47:58.449743+0000","last_became_active":"2024-04-26T23:40:31.576429+0000","last_became_peered":"2024-04-26T23:40:31.576429+0000","last_unstale":"2024-04-26T23:47:58.449743+0000","last_undegraded":"2024-04-26T23:47:58.449743+0000","last_fullsized":"2024-04-26T23:47:58.449743+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:47:42.681376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":4100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"26'4407","reported_seq":4435,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:36.334044+0000","last_change":"2024-04-26T23:40:32.578489+0000","last_active":"2024-04-26T23:49:36.334044+0000","last_peered":"2024-04-26T23:49:36.334044+0000","last_clean":"2024-04-26T23:49:36.334044+0000","last_became_active":"2024-04-26T23:40:32.578205+0000","last_became_peered":"2024-04-26T23:40:32.578205+0000","last_unstale":"2024-04-26T23:49:36.334044+0000","last_undegraded":"2024-04-26T23:49:36.334044+0000","last_fullsized":"2024-04-26T23:49:36.334044+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":4407,"log_dups_size":0,"ondisk_log_size":4407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:56:04.309611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":66444,"num_write_kb":860244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"26'23","reported_seq":44,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:48:00.741422+0000","last_change":"2024-04-26T23:40:40.666861+0000","last_active":"2024-04-26T23:48:00.741422+0000","last_peered":"2024-04-26T23:48:00.741422+0000","last_clean":"2024-04-26T23:48:00.741422+0000","last_became_active":"2024-04-26T23:40:40.666547+0000","last_became_peered":"2024-04-26T23:40:40.666547+0000","last_unstale":"2024-04-26T23:48:00.741422+0000","last_undegraded":"2024-04-26T23:48:00.741422+0000","last_fullsized":"2024-04-26T23:48:00.741422+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:27:47.818055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":4105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"26'5301","reported_seq":5320,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:32.359614+0000","last_change":"2024-04-26T23:40:41.689530+0000","last_active":"2024-04-26T23:49:32.359614+0000","last_peered":"2024-04-26T23:49:32.359614+0000","last_clean":"2024-04-26T23:49:32.359614+0000","last_became_active":"2024-04-26T23:40:41.687652+0000","last_became_peered":"2024-04-26T23:40:41.687652+0000","last_unstale":"2024-04-26T23:49:32.359614+0000","last_undegraded":"2024-04-26T23:49:32.359614+0000","last_fullsized":"2024-04-26T23:49:32.359614+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":5301,"log_dups_size":0,"ondisk_log_size":5301,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:58:45.972045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79884,"num_write_kb":1001634,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1e","version":"26'29","reported_seq":59,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:36.407374+0000","last_change":"2024-04-26T23:40:31.576867+0000","last_active":"2024-04-26T23:49:36.407374+0000","last_peered":"2024-04-26T23:49:36.407374+0000","last_clean":"2024-04-26T23:49:36.407374+0000","last_became_active":"2024-04-26T23:40:31.576342+0000","last_became_peered":"2024-04-26T23:40:31.576342+0000","last_unstale":"2024-04-26T23:49:36.407374+0000","last_undegraded":"2024-04-26T23:49:36.407374+0000","last_fullsized":"2024-04-26T23:49:36.407374+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:35:54.439397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":4114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"26'5109","reported_seq":5122,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.890952+0000","last_change":"2024-04-26T23:41:30.628386+0000","last_active":"2024-04-26T23:49:42.890952+0000","last_peered":"2024-04-26T23:49:42.890952+0000","last_clean":"2024-04-26T23:49:42.890952+0000","last_became_active":"2024-04-26T23:41:30.628139+0000","last_became_peered":"2024-04-26T23:41:30.628139+0000","last_unstale":"2024-04-26T23:49:42.890952+0000","last_undegraded":"2024-04-26T23:49:42.890952+0000","last_fullsized":"2024-04-26T23:49:42.890952+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":5109,"log_dups_size":0,"ondisk_log_size":5109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:10:21.873566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":76507,"num_write_kb":979233,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"26'25","reported_seq":46,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:30.276499+0000","last_change":"2024-04-26T23:40:40.672310+0000","last_active":"2024-04-26T23:49:30.276499+0000","last_peered":"2024-04-26T23:49:30.276499+0000","last_clean":"2024-04-26T23:49:30.276499+0000","last_became_active":"2024-04-26T23:40:40.672018+0000","last_became_peered":"2024-04-26T23:40:40.672018+0000","last_unstale":"2024-04-26T23:49:30.276499+0000","last_undegraded":"2024-04-26T23:49:30.276499+0000","last_fullsized":"2024-04-26T23:49:30.276499+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:01:10.835670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":8211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"26'3919","reported_seq":3938,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:30.326944+0000","last_change":"2024-04-26T23:40:41.686743+0000","last_active":"2024-04-26T23:49:30.326944+0000","last_peered":"2024-04-26T23:49:30.326944+0000","last_clean":"2024-04-26T23:49:30.326944+0000","last_became_active":"2024-04-26T23:40:41.686419+0000","last_became_peered":"2024-04-26T23:40:41.686419+0000","last_unstale":"2024-04-26T23:49:30.326944+0000","last_undegraded":"2024-04-26T23:49:30.326944+0000","last_fullsized":"2024-04-26T23:49:30.326944+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":3919,"log_dups_size":0,"ondisk_log_size":3919,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:08:35.027584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":59060,"num_write_kb":735586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1d","version":"26'46","reported_seq":75,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:36.404066+0000","last_change":"2024-04-26T23:40:31.578735+0000","last_active":"2024-04-26T23:49:36.404066+0000","last_peered":"2024-04-26T23:49:36.404066+0000","last_clean":"2024-04-26T23:49:36.404066+0000","last_became_active":"2024-04-26T23:40:31.578438+0000","last_became_peered":"2024-04-26T23:40:31.578438+0000","last_unstale":"2024-04-26T23:49:36.404066+0000","last_undegraded":"2024-04-26T23:49:36.404066+0000","last_fullsized":"2024-04-26T23:49:36.404066+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:30:10.397569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37,"num_write_kb":12306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"26'2979","reported_seq":3006,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:36.339571+0000","last_change":"2024-04-26T23:40:32.590624+0000","last_active":"2024-04-26T23:49:36.339571+0000","last_peered":"2024-04-26T23:49:36.339571+0000","last_clean":"2024-04-26T23:49:36.339571+0000","last_became_active":"2024-04-26T23:40:32.589687+0000","last_became_peered":"2024-04-26T23:40:32.589687+0000","last_unstale":"2024-04-26T23:49:36.339571+0000","last_undegraded":"2024-04-26T23:49:36.339571+0000","last_fullsized":"2024-04-26T23:49:36.339571+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":2979,"log_dups_size":0,"ondisk_log_size":2979,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:01:02.741964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44847,"num_write_kb":570063,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"26'1255","reported_seq":1276,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.843735+0000","last_change":"2024-04-26T23:40:40.677899+0000","last_active":"2024-04-26T23:48:13.843735+0000","last_peered":"2024-04-26T23:48:13.843735+0000","last_clean":"2024-04-26T23:48:13.843735+0000","last_became_active":"2024-04-26T23:40:40.677388+0000","last_became_peered":"2024-04-26T23:40:40.677388+0000","last_unstale":"2024-04-26T23:48:13.843735+0000","last_undegraded":"2024-04-26T23:48:13.843735+0000","last_fullsized":"2024-04-26T23:48:13.843735+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":1255,"log_dups_size":0,"ondisk_log_size":1255,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:52:34.793496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1253,"num_write_kb":5260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"26'3551","reported_seq":3570,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:30.305496+0000","last_change":"2024-04-26T23:40:41.680097+0000","last_active":"2024-04-26T23:49:30.305496+0000","last_peered":"2024-04-26T23:49:30.305496+0000","last_clean":"2024-04-26T23:49:30.305496+0000","last_became_active":"2024-04-26T23:40:41.679815+0000","last_became_peered":"2024-04-26T23:40:41.679815+0000","last_unstale":"2024-04-26T23:49:30.305496+0000","last_undegraded":"2024-04-26T23:49:30.305496+0000","last_fullsized":"2024-04-26T23:49:30.305496+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":3551,"log_dups_size":0,"ondisk_log_size":3551,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:10:30.972726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53503,"num_write_kb":665423,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"26'17","reported_seq":46,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:48:02.410604+0000","last_change":"2024-04-26T23:40:31.573648+0000","last_active":"2024-04-26T23:48:02.410604+0000","last_peered":"2024-04-26T23:48:02.410604+0000","last_clean":"2024-04-26T23:48:02.410604+0000","last_became_active":"2024-04-26T23:40:31.573347+0000","last_became_peered":"2024-04-26T23:40:31.573347+0000","last_unstale":"2024-04-26T23:48:02.410604+0000","last_undegraded":"2024-04-26T23:48:02.410604+0000","last_fullsized":"2024-04-26T23:48:02.410604+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:20:28.103413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":4100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"26'5042","reported_seq":5069,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:36.393746+0000","last_change":"2024-04-26T23:40:32.588309+0000","last_active":"2024-04-26T23:49:36.393746+0000","last_peered":"2024-04-26T23:49:36.393746+0000","last_clean":"2024-04-26T23:49:36.393746+0000","last_became_active":"2024-04-26T23:40:32.588007+0000","last_became_peered":"2024-04-26T23:40:32.588007+0000","last_unstale":"2024-04-26T23:49:36.393746+0000","last_undegraded":"2024-04-26T23:49:36.393746+0000","last_fullsized":"2024-04-26T23:49:36.393746+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":5042,"log_dups_size":0,"ondisk_log_size":5042,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:52:26.699790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":75905,"num_write_kb":967615,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"26'33","reported_seq":54,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:30.327673+0000","last_change":"2024-04-26T23:40:40.678547+0000","last_active":"2024-04-26T23:49:30.327673+0000","last_peered":"2024-04-26T23:49:30.327673+0000","last_clean":"2024-04-26T23:49:30.327673+0000","last_became_active":"2024-04-26T23:40:40.677668+0000","last_became_peered":"2024-04-26T23:40:40.677668+0000","last_unstale":"2024-04-26T23:49:30.327673+0000","last_undegraded":"2024-04-26T23:49:30.327673+0000","last_fullsized":"2024-04-26T23:49:30.327673+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:34:22.905623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":12307,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"26'4797","reported_seq":4817,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:32.355924+0000","last_change":"2024-04-26T23:40:41.689525+0000","last_active":"2024-04-26T23:49:32.355924+0000","last_peered":"2024-04-26T23:49:32.355924+0000","last_clean":"2024-04-26T23:49:32.355924+0000","last_became_active":"2024-04-26T23:40:41.687433+0000","last_became_peered":"2024-04-26T23:40:41.687433+0000","last_unstale":"2024-04-26T23:49:32.355924+0000","last_undegraded":"2024-04-26T23:49:32.355924+0000","last_fullsized":"2024-04-26T23:49:32.355924+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":4797,"log_dups_size":0,"ondisk_log_size":4797,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:38:42.155257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":72371,"num_write_kb":916696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"26'3820","reported_seq":3848,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.852304+0000","last_change":"2024-04-26T23:40:32.590053+0000","last_active":"2024-04-26T23:49:42.852304+0000","last_peered":"2024-04-26T23:49:42.852304+0000","last_clean":"2024-04-26T23:49:42.852304+0000","last_became_active":"2024-04-26T23:40:32.589802+0000","last_became_peered":"2024-04-26T23:40:32.589802+0000","last_unstale":"2024-04-26T23:49:42.852304+0000","last_undegraded":"2024-04-26T23:49:42.852304+0000","last_fullsized":"2024-04-26T23:49:42.852304+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":3820,"log_dups_size":0,"ondisk_log_size":3820,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:16:46.547536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":57277,"num_write_kb":731452,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"26'244","reported_seq":274,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:36.412818+0000","last_change":"2024-04-26T23:40:31.578524+0000","last_active":"2024-04-26T23:49:36.412818+0000","last_peered":"2024-04-26T23:49:36.412818+0000","last_clean":"2024-04-26T23:49:36.412818+0000","last_became_active":"2024-04-26T23:40:31.578230+0000","last_became_peered":"2024-04-26T23:40:31.578230+0000","last_unstale":"2024-04-26T23:49:36.412818+0000","last_undegraded":"2024-04-26T23:49:36.412818+0000","last_fullsized":"2024-04-26T23:49:36.412818+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":244,"log_dups_size":0,"ondisk_log_size":244,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:15:51.937774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":234,"num_write_kb":8395,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"26'20","reported_seq":41,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:47:31.547871+0000","last_change":"2024-04-26T23:40:40.676459+0000","last_active":"2024-04-26T23:47:31.547871+0000","last_peered":"2024-04-26T23:47:31.547871+0000","last_clean":"2024-04-26T23:47:31.547871+0000","last_became_active":"2024-04-26T23:40:40.675997+0000","last_became_peered":"2024-04-26T23:40:40.675997+0000","last_unstale":"2024-04-26T23:47:31.547871+0000","last_undegraded":"2024-04-26T23:47:31.547871+0000","last_fullsized":"2024-04-26T23:47:31.547871+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:37:38.455501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":4105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"26'4636","reported_seq":4655,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:32.358383+0000","last_change":"2024-04-26T23:40:41.679334+0000","last_active":"2024-04-26T23:49:32.358383+0000","last_peered":"2024-04-26T23:49:32.358383+0000","last_clean":"2024-04-26T23:49:32.358383+0000","last_became_active":"2024-04-26T23:40:41.679098+0000","last_became_peered":"2024-04-26T23:40:41.679098+0000","last_unstale":"2024-04-26T23:49:32.358383+0000","last_undegraded":"2024-04-26T23:49:32.358383+0000","last_fullsized":"2024-04-26T23:49:32.358383+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":4636,"log_dups_size":0,"ondisk_log_size":4636,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:52:35.798951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69716,"num_write_kb":886548,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"26'3476","reported_seq":3504,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:36.408877+0000","last_change":"2024-04-26T23:40:32.585827+0000","last_active":"2024-04-26T23:49:36.408877+0000","last_peered":"2024-04-26T23:49:36.408877+0000","last_clean":"2024-04-26T23:49:36.408877+0000","last_became_active":"2024-04-26T23:40:32.585522+0000","last_became_peered":"2024-04-26T23:40:32.585522+0000","last_unstale":"2024-04-26T23:49:36.408877+0000","last_undegraded":"2024-04-26T23:49:36.408877+0000","last_fullsized":"2024-04-26T23:49:36.408877+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":3476,"log_dups_size":0,"ondisk_log_size":3476,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:40:17.167353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":52204,"num_write_kb":651184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"26'16","reported_seq":46,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:36.407078+0000","last_change":"2024-04-26T23:40:31.575121+0000","last_active":"2024-04-26T23:49:36.407078+0000","last_peered":"2024-04-26T23:49:36.407078+0000","last_clean":"2024-04-26T23:49:36.407078+0000","last_became_active":"2024-04-26T23:40:31.574827+0000","last_became_peered":"2024-04-26T23:40:31.574827+0000","last_unstale":"2024-04-26T23:49:36.407078+0000","last_undegraded":"2024-04-26T23:49:36.407078+0000","last_fullsized":"2024-04-26T23:49:36.407078+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:43:13.740214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":4101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"26'4","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:32.344791+0000","last_change":"2024-04-26T23:40:40.678613+0000","last_active":"2024-04-26T23:49:32.344791+0000","last_peered":"2024-04-26T23:49:32.344791+0000","last_clean":"2024-04-26T23:49:32.344791+0000","last_became_active":"2024-04-26T23:40:40.677867+0000","last_became_peered":"2024-04-26T23:40:40.677867+0000","last_unstale":"2024-04-26T23:49:32.344791+0000","last_undegraded":"2024-04-26T23:49:32.344791+0000","last_fullsized":"2024-04-26T23:49:32.344791+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:35:16.288571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"26'4217","reported_seq":4236,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:30.298167+0000","last_change":"2024-04-26T23:40:41.685042+0000","last_active":"2024-04-26T23:49:30.298167+0000","last_peered":"2024-04-26T23:49:30.298167+0000","last_clean":"2024-04-26T23:49:30.298167+0000","last_became_active":"2024-04-26T23:40:41.684699+0000","last_became_peered":"2024-04-26T23:40:41.684699+0000","last_unstale":"2024-04-26T23:49:30.298167+0000","last_undegraded":"2024-04-26T23:49:30.298167+0000","last_fullsized":"2024-04-26T23:49:30.298167+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":4217,"log_dups_size":0,"ondisk_log_size":4217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:10:57.826183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":63591,"num_write_kb":826339,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"26'4038","reported_seq":4066,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:36.349708+0000","last_change":"2024-04-26T23:40:32.582721+0000","last_active":"2024-04-26T23:49:36.349708+0000","last_peered":"2024-04-26T23:49:36.349708+0000","last_clean":"2024-04-26T23:49:36.349708+0000","last_became_active":"2024-04-26T23:40:32.582438+0000","last_became_peered":"2024-04-26T23:40:32.582438+0000","last_unstale":"2024-04-26T23:49:36.349708+0000","last_undegraded":"2024-04-26T23:49:36.349708+0000","last_fullsized":"2024-04-26T23:49:36.349708+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":4038,"log_dups_size":0,"ondisk_log_size":4038,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:38:10.884592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":60599,"num_write_kb":814129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"26'16","reported_seq":46,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:36.396171+0000","last_change":"2024-04-26T23:40:31.575508+0000","last_active":"2024-04-26T23:49:36.396171+0000","last_peered":"2024-04-26T23:49:36.396171+0000","last_clean":"2024-04-26T23:49:36.396171+0000","last_became_active":"2024-04-26T23:40:31.575242+0000","last_became_peered":"2024-04-26T23:40:31.575242+0000","last_unstale":"2024-04-26T23:49:36.396171+0000","last_undegraded":"2024-04-26T23:49:36.396171+0000","last_fullsized":"2024-04-26T23:49:36.396171+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:48:32.015654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":4101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"26'16","reported_seq":37,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:32.336622+0000","last_change":"2024-04-26T23:40:40.679196+0000","last_active":"2024-04-26T23:49:32.336622+0000","last_peered":"2024-04-26T23:49:32.336622+0000","last_clean":"2024-04-26T23:49:32.336622+0000","last_became_active":"2024-04-26T23:40:40.678740+0000","last_became_peered":"2024-04-26T23:40:40.678740+0000","last_unstale":"2024-04-26T23:49:32.336622+0000","last_undegraded":"2024-04-26T23:49:32.336622+0000","last_fullsized":"2024-04-26T23:49:32.336622+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:40:14.479631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":4110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"26'5261","reported_seq":5280,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:30.318331+0000","last_change":"2024-04-26T23:40:41.686638+0000","last_active":"2024-04-26T23:49:30.318331+0000","last_peered":"2024-04-26T23:49:30.318331+0000","last_clean":"2024-04-26T23:49:30.318331+0000","last_became_active":"2024-04-26T23:40:41.686354+0000","last_became_peered":"2024-04-26T23:40:41.686354+0000","last_unstale":"2024-04-26T23:49:30.318331+0000","last_undegraded":"2024-04-26T23:49:30.318331+0000","last_fullsized":"2024-04-26T23:49:30.318331+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":5261,"log_dups_size":0,"ondisk_log_size":5261,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:06:12.755431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79283,"num_write_kb":1000134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"26'4022","reported_seq":4050,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.889538+0000","last_change":"2024-04-26T23:40:32.583019+0000","last_active":"2024-04-26T23:49:42.889538+0000","last_peered":"2024-04-26T23:49:42.889538+0000","last_clean":"2024-04-26T23:49:42.889538+0000","last_became_active":"2024-04-26T23:40:32.582719+0000","last_became_peered":"2024-04-26T23:40:32.582719+0000","last_unstale":"2024-04-26T23:49:42.889538+0000","last_undegraded":"2024-04-26T23:49:42.889538+0000","last_fullsized":"2024-04-26T23:49:42.889538+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":4022,"log_dups_size":0,"ondisk_log_size":4022,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:25:02.319783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":60741,"num_write_kb":745879,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"26'19","reported_seq":49,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:36.391367+0000","last_change":"2024-04-26T23:40:31.576866+0000","last_active":"2024-04-26T23:49:36.391367+0000","last_peered":"2024-04-26T23:49:36.391367+0000","last_clean":"2024-04-26T23:49:36.391367+0000","last_became_active":"2024-04-26T23:40:31.576419+0000","last_became_peered":"2024-04-26T23:40:31.576419+0000","last_unstale":"2024-04-26T23:49:36.391367+0000","last_undegraded":"2024-04-26T23:49:36.391367+0000","last_fullsized":"2024-04-26T23:49:36.391367+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:45:49.295198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":4102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"26'18","reported_seq":39,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:32.332148+0000","last_change":"2024-04-26T23:40:40.675262+0000","last_active":"2024-04-26T23:49:32.332148+0000","last_peered":"2024-04-26T23:49:32.332148+0000","last_clean":"2024-04-26T23:49:32.332148+0000","last_became_active":"2024-04-26T23:40:40.674721+0000","last_became_peered":"2024-04-26T23:40:40.674721+0000","last_unstale":"2024-04-26T23:49:32.332148+0000","last_undegraded":"2024-04-26T23:49:32.332148+0000","last_fullsized":"2024-04-26T23:49:32.332148+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:56:12.403317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":4101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"26'4206","reported_seq":4226,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:32.327428+0000","last_change":"2024-04-26T23:40:41.691494+0000","last_active":"2024-04-26T23:49:32.327428+0000","last_peered":"2024-04-26T23:49:32.327428+0000","last_clean":"2024-04-26T23:49:32.327428+0000","last_became_active":"2024-04-26T23:40:41.691241+0000","last_became_peered":"2024-04-26T23:40:41.691241+0000","last_unstale":"2024-04-26T23:49:32.327428+0000","last_undegraded":"2024-04-26T23:49:32.327428+0000","last_fullsized":"2024-04-26T23:49:32.327428+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":4206,"log_dups_size":0,"ondisk_log_size":4206,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:08:35.027584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":63038,"num_write_kb":829161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"26'3470","reported_seq":3498,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.886281+0000","last_change":"2024-04-26T23:40:32.584988+0000","last_active":"2024-04-26T23:49:42.886281+0000","last_peered":"2024-04-26T23:49:42.886281+0000","last_clean":"2024-04-26T23:49:42.886281+0000","last_became_active":"2024-04-26T23:40:32.584467+0000","last_became_peered":"2024-04-26T23:40:32.584467+0000","last_unstale":"2024-04-26T23:49:42.886281+0000","last_undegraded":"2024-04-26T23:49:42.886281+0000","last_fullsized":"2024-04-26T23:49:42.886281+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":3470,"log_dups_size":0,"ondisk_log_size":3470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:51:30.677247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51752,"num_write_kb":657341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"26'115","reported_seq":145,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.784144+0000","last_change":"2024-04-26T23:40:31.573721+0000","last_active":"2024-04-26T23:49:42.784144+0000","last_peered":"2024-04-26T23:49:42.784144+0000","last_clean":"2024-04-26T23:49:42.784144+0000","last_became_active":"2024-04-26T23:40:31.573434+0000","last_became_peered":"2024-04-26T23:40:31.573434+0000","last_unstale":"2024-04-26T23:49:42.784144+0000","last_undegraded":"2024-04-26T23:49:42.784144+0000","last_fullsized":"2024-04-26T23:49:42.784144+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":115,"log_dups_size":0,"ondisk_log_size":115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:20:28.103413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2675866,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":112,"num_write_kb":2659,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"26'20","reported_seq":60,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:37.321768+0000","last_change":"2024-04-26T23:40:40.678020+0000","last_active":"2024-04-26T23:49:37.321768+0000","last_peered":"2024-04-26T23:49:37.321768+0000","last_clean":"2024-04-26T23:49:37.321768+0000","last_became_active":"2024-04-26T23:40:40.677410+0000","last_became_peered":"2024-04-26T23:40:40.677410+0000","last_unstale":"2024-04-26T23:49:37.321768+0000","last_undegraded":"2024-04-26T23:49:37.321768+0000","last_fullsized":"2024-04-26T23:49:37.321768+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:44:50.588556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88181,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":98,"num_write":18,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"26'4391","reported_seq":4411,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:30.315363+0000","last_change":"2024-04-26T23:40:41.689839+0000","last_active":"2024-04-26T23:49:30.315363+0000","last_peered":"2024-04-26T23:49:30.315363+0000","last_clean":"2024-04-26T23:49:30.315363+0000","last_became_active":"2024-04-26T23:40:41.689508+0000","last_became_peered":"2024-04-26T23:40:41.689508+0000","last_unstale":"2024-04-26T23:49:30.315363+0000","last_undegraded":"2024-04-26T23:49:30.315363+0000","last_fullsized":"2024-04-26T23:49:30.315363+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":4391,"log_dups_size":0,"ondisk_log_size":4391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:17:28.672777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":66189,"num_write_kb":852725,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"26'4071","reported_seq":4099,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:36.399643+0000","last_change":"2024-04-26T23:40:32.594913+0000","last_active":"2024-04-26T23:49:36.399643+0000","last_peered":"2024-04-26T23:49:36.399643+0000","last_clean":"2024-04-26T23:49:36.399643+0000","last_became_active":"2024-04-26T23:40:32.594616+0000","last_became_peered":"2024-04-26T23:40:32.594616+0000","last_unstale":"2024-04-26T23:49:36.399643+0000","last_undegraded":"2024-04-26T23:49:36.399643+0000","last_fullsized":"2024-04-26T23:49:36.399643+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":4071,"log_dups_size":0,"ondisk_log_size":4071,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:04:30.553552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":61223,"num_write_kb":789949,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"26'260","reported_seq":290,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:36.406667+0000","last_change":"2024-04-26T23:40:31.576299+0000","last_active":"2024-04-26T23:49:36.406667+0000","last_peered":"2024-04-26T23:49:36.406667+0000","last_clean":"2024-04-26T23:49:36.406667+0000","last_became_active":"2024-04-26T23:40:31.576006+0000","last_became_peered":"2024-04-26T23:40:31.576006+0000","last_unstale":"2024-04-26T23:49:36.406667+0000","last_undegraded":"2024-04-26T23:49:36.406667+0000","last_fullsized":"2024-04-26T23:49:36.406667+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":260,"log_dups_size":0,"ondisk_log_size":260,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:15:51.937774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":515,"num_write_kb":200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"26'25","reported_seq":47,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:32.330189+0000","last_change":"2024-04-26T23:40:40.674806+0000","last_active":"2024-04-26T23:49:32.330189+0000","last_peered":"2024-04-26T23:49:32.330189+0000","last_clean":"2024-04-26T23:49:32.330189+0000","last_became_active":"2024-04-26T23:40:40.674557+0000","last_became_peered":"2024-04-26T23:40:40.674557+0000","last_unstale":"2024-04-26T23:49:32.330189+0000","last_undegraded":"2024-04-26T23:49:32.330189+0000","last_fullsized":"2024-04-26T23:49:32.330189+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:45:33.226487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":12298,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"26'4697","reported_seq":4717,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:30.264413+0000","last_change":"2024-04-26T23:40:41.688941+0000","last_active":"2024-04-26T23:49:30.264413+0000","last_peered":"2024-04-26T23:49:30.264413+0000","last_clean":"2024-04-26T23:49:30.264413+0000","last_became_active":"2024-04-26T23:40:41.688653+0000","last_became_peered":"2024-04-26T23:40:41.688653+0000","last_unstale":"2024-04-26T23:49:30.264413+0000","last_undegraded":"2024-04-26T23:49:30.264413+0000","last_fullsized":"2024-04-26T23:49:30.264413+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":4697,"log_dups_size":0,"ondisk_log_size":4697,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:53:13.531466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":70754,"num_write_kb":894410,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"26'4233","reported_seq":4261,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:36.407740+0000","last_change":"2024-04-26T23:40:32.582442+0000","last_active":"2024-04-26T23:49:36.407740+0000","last_peered":"2024-04-26T23:49:36.407740+0000","last_clean":"2024-04-26T23:49:36.407740+0000","last_became_active":"2024-04-26T23:40:32.582140+0000","last_became_peered":"2024-04-26T23:40:32.582140+0000","last_unstale":"2024-04-26T23:49:36.407740+0000","last_undegraded":"2024-04-26T23:49:36.407740+0000","last_fullsized":"2024-04-26T23:49:36.407740+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":4233,"log_dups_size":0,"ondisk_log_size":4233,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:18:09.706875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":63708,"num_write_kb":831213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"26'16","reported_seq":46,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:36.405509+0000","last_change":"2024-04-26T23:40:31.576565+0000","last_active":"2024-04-26T23:49:36.405509+0000","last_peered":"2024-04-26T23:49:36.405509+0000","last_clean":"2024-04-26T23:49:36.405509+0000","last_became_active":"2024-04-26T23:40:31.576313+0000","last_became_peered":"2024-04-26T23:40:31.576313+0000","last_unstale":"2024-04-26T23:49:36.405509+0000","last_undegraded":"2024-04-26T23:49:36.405509+0000","last_fullsized":"2024-04-26T23:49:36.405509+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:25:01.315397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":4100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"26'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:47:32.117231+0000","last_change":"2024-04-26T23:40:40.671047+0000","last_active":"2024-04-26T23:47:32.117231+0000","last_peered":"2024-04-26T23:47:32.117231+0000","last_clean":"2024-04-26T23:47:32.117231+0000","last_became_active":"2024-04-26T23:40:40.670630+0000","last_became_peered":"2024-04-26T23:40:40.670630+0000","last_unstale":"2024-04-26T23:47:32.117231+0000","last_undegraded":"2024-04-26T23:47:32.117231+0000","last_fullsized":"2024-04-26T23:47:32.117231+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:45:07.071050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"26'4137","reported_seq":4157,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:30.321424+0000","last_change":"2024-04-26T23:40:41.686221+0000","last_active":"2024-04-26T23:49:30.321424+0000","last_peered":"2024-04-26T23:49:30.321424+0000","last_clean":"2024-04-26T23:49:30.321424+0000","last_became_active":"2024-04-26T23:40:41.685961+0000","last_became_peered":"2024-04-26T23:40:41.685961+0000","last_unstale":"2024-04-26T23:49:30.321424+0000","last_undegraded":"2024-04-26T23:49:30.321424+0000","last_fullsized":"2024-04-26T23:49:30.321424+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":4137,"log_dups_size":0,"ondisk_log_size":4137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:28:34.920939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":62474,"num_write_kb":825561,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"26'3715","reported_seq":3743,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:36.385273+0000","last_change":"2024-04-26T23:40:32.584363+0000","last_active":"2024-04-26T23:49:36.385273+0000","last_peered":"2024-04-26T23:49:36.385273+0000","last_clean":"2024-04-26T23:49:36.385273+0000","last_became_active":"2024-04-26T23:40:32.584082+0000","last_became_peered":"2024-04-26T23:40:32.584082+0000","last_unstale":"2024-04-26T23:49:36.385273+0000","last_undegraded":"2024-04-26T23:49:36.385273+0000","last_fullsized":"2024-04-26T23:49:36.385273+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":3715,"log_dups_size":0,"ondisk_log_size":3715,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:35:08.194865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55724,"num_write_kb":725978,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"26'6","reported_seq":36,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:36.393573+0000","last_change":"2024-04-26T23:40:31.576711+0000","last_active":"2024-04-26T23:49:36.393573+0000","last_peered":"2024-04-26T23:49:36.393573+0000","last_clean":"2024-04-26T23:49:36.393573+0000","last_became_active":"2024-04-26T23:40:31.576404+0000","last_became_peered":"2024-04-26T23:40:31.576404+0000","last_unstale":"2024-04-26T23:49:36.393573+0000","last_undegraded":"2024-04-26T23:49:36.393573+0000","last_fullsized":"2024-04-26T23:49:36.393573+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:45:49.295198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"26'31","reported_seq":53,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:32.328269+0000","last_change":"2024-04-26T23:40:40.675296+0000","last_active":"2024-04-26T23:49:32.328269+0000","last_peered":"2024-04-26T23:49:32.328269+0000","last_clean":"2024-04-26T23:49:32.328269+0000","last_became_active":"2024-04-26T23:40:40.674935+0000","last_became_peered":"2024-04-26T23:40:40.674935+0000","last_unstale":"2024-04-26T23:49:32.328269+0000","last_undegraded":"2024-04-26T23:49:32.328269+0000","last_fullsized":"2024-04-26T23:49:32.328269+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:10:10.722905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":8205,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"26'3986","reported_seq":4006,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:30.313667+0000","last_change":"2024-04-26T23:40:41.691510+0000","last_active":"2024-04-26T23:49:30.313667+0000","last_peered":"2024-04-26T23:49:30.313667+0000","last_clean":"2024-04-26T23:49:30.313667+0000","last_became_active":"2024-04-26T23:40:41.691242+0000","last_became_peered":"2024-04-26T23:40:41.691242+0000","last_unstale":"2024-04-26T23:49:30.313667+0000","last_undegraded":"2024-04-26T23:49:30.313667+0000","last_fullsized":"2024-04-26T23:49:30.313667+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":3986,"log_dups_size":0,"ondisk_log_size":3986,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:27:48.823509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":59849,"num_write_kb":777586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"26'3874","reported_seq":3902,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.917138+0000","last_change":"2024-04-26T23:40:32.590069+0000","last_active":"2024-04-26T23:49:42.917138+0000","last_peered":"2024-04-26T23:49:42.917138+0000","last_clean":"2024-04-26T23:49:42.917138+0000","last_became_active":"2024-04-26T23:40:32.589790+0000","last_became_peered":"2024-04-26T23:40:32.589790+0000","last_unstale":"2024-04-26T23:49:42.917138+0000","last_undegraded":"2024-04-26T23:49:42.917138+0000","last_fullsized":"2024-04-26T23:49:42.917138+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":3874,"log_dups_size":0,"ondisk_log_size":3874,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:15:52.942160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":58064,"num_write_kb":769321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"26'25","reported_seq":55,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:36.421096+0000","last_change":"2024-04-26T23:40:31.572432+0000","last_active":"2024-04-26T23:49:36.421096+0000","last_peered":"2024-04-26T23:49:36.421096+0000","last_clean":"2024-04-26T23:49:36.421096+0000","last_became_active":"2024-04-26T23:40:31.572121+0000","last_became_peered":"2024-04-26T23:40:31.572121+0000","last_unstale":"2024-04-26T23:49:36.421096+0000","last_undegraded":"2024-04-26T23:49:36.421096+0000","last_fullsized":"2024-04-26T23:49:36.421096+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:45:49.295198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":8200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"26'6","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:30.319370+0000","last_change":"2024-04-26T23:40:40.678404+0000","last_active":"2024-04-26T23:49:30.319370+0000","last_peered":"2024-04-26T23:49:30.319370+0000","last_clean":"2024-04-26T23:49:30.319370+0000","last_became_active":"2024-04-26T23:40:40.678136+0000","last_became_peered":"2024-04-26T23:40:40.678136+0000","last_unstale":"2024-04-26T23:49:30.319370+0000","last_undegraded":"2024-04-26T23:49:30.319370+0000","last_fullsized":"2024-04-26T23:49:30.319370+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:45:11.058699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"26'3869","reported_seq":3889,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:30.287388+0000","last_change":"2024-04-26T23:40:41.673542+0000","last_active":"2024-04-26T23:49:30.287388+0000","last_peered":"2024-04-26T23:49:30.287388+0000","last_clean":"2024-04-26T23:49:30.287388+0000","last_became_active":"2024-04-26T23:40:41.673254+0000","last_became_peered":"2024-04-26T23:40:41.673254+0000","last_unstale":"2024-04-26T23:49:30.287388+0000","last_undegraded":"2024-04-26T23:49:30.287388+0000","last_fullsized":"2024-04-26T23:49:30.287388+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":3869,"log_dups_size":0,"ondisk_log_size":3869,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:10:11.728359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":58020,"num_write_kb":724597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"26'3912","reported_seq":3940,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:36.411894+0000","last_change":"2024-04-26T23:40:32.576783+0000","last_active":"2024-04-26T23:49:36.411894+0000","last_peered":"2024-04-26T23:49:36.411894+0000","last_clean":"2024-04-26T23:49:36.411894+0000","last_became_active":"2024-04-26T23:40:32.576481+0000","last_became_peered":"2024-04-26T23:40:32.576481+0000","last_unstale":"2024-04-26T23:49:36.411894+0000","last_undegraded":"2024-04-26T23:49:36.411894+0000","last_fullsized":"2024-04-26T23:49:36.411894+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":3912,"log_dups_size":0,"ondisk_log_size":3912,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:16:46.547536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":58555,"num_write_kb":772397,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"26'17","reported_seq":62,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:40.459144+0000","last_change":"2024-04-26T23:40:31.570775+0000","last_active":"2024-04-26T23:49:40.459144+0000","last_peered":"2024-04-26T23:49:40.459144+0000","last_clean":"2024-04-26T23:49:40.459144+0000","last_became_active":"2024-04-26T23:40:31.570493+0000","last_became_peered":"2024-04-26T23:40:31.570493+0000","last_unstale":"2024-04-26T23:49:40.459144+0000","last_undegraded":"2024-04-26T23:49:40.459144+0000","last_fullsized":"2024-04-26T23:49:40.459144+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:45:49.295198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88181,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":95,"num_write":15,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"26'23","reported_seq":45,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:30.334159+0000","last_change":"2024-04-26T23:40:40.675115+0000","last_active":"2024-04-26T23:49:30.334159+0000","last_peered":"2024-04-26T23:49:30.334159+0000","last_clean":"2024-04-26T23:49:30.334159+0000","last_became_active":"2024-04-26T23:40:40.674828+0000","last_became_peered":"2024-04-26T23:40:40.674828+0000","last_unstale":"2024-04-26T23:49:30.334159+0000","last_undegraded":"2024-04-26T23:49:30.334159+0000","last_fullsized":"2024-04-26T23:49:30.334159+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:45:07.071050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":4104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"26'4508","reported_seq":4528,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:30.332520+0000","last_change":"2024-04-26T23:40:41.691098+0000","last_active":"2024-04-26T23:49:30.332520+0000","last_peered":"2024-04-26T23:49:30.332520+0000","last_clean":"2024-04-26T23:49:30.332520+0000","last_became_active":"2024-04-26T23:40:41.690803+0000","last_became_peered":"2024-04-26T23:40:41.690803+0000","last_unstale":"2024-04-26T23:49:30.332520+0000","last_undegraded":"2024-04-26T23:49:30.332520+0000","last_fullsized":"2024-04-26T23:49:30.332520+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":4508,"log_dups_size":0,"ondisk_log_size":4508,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:38:51.195172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":67888,"num_write_kb":829373,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"26'4011","reported_seq":4039,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.893538+0000","last_change":"2024-04-26T23:40:32.593262+0000","last_active":"2024-04-26T23:49:42.893538+0000","last_peered":"2024-04-26T23:49:42.893538+0000","last_clean":"2024-04-26T23:49:42.893538+0000","last_became_active":"2024-04-26T23:40:32.593003+0000","last_became_peered":"2024-04-26T23:40:32.593003+0000","last_unstale":"2024-04-26T23:49:42.893538+0000","last_undegraded":"2024-04-26T23:49:42.893538+0000","last_fullsized":"2024-04-26T23:49:42.893538+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":4011,"log_dups_size":0,"ondisk_log_size":4011,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:47:51.559918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":60122,"num_write_kb":778045,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"26'35","reported_seq":65,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:36.408525+0000","last_change":"2024-04-26T23:40:31.573864+0000","last_active":"2024-04-26T23:49:36.408525+0000","last_peered":"2024-04-26T23:49:36.408525+0000","last_clean":"2024-04-26T23:49:36.408525+0000","last_became_active":"2024-04-26T23:40:31.573594+0000","last_became_peered":"2024-04-26T23:40:31.573594+0000","last_unstale":"2024-04-26T23:49:36.408525+0000","last_undegraded":"2024-04-26T23:49:36.408525+0000","last_fullsized":"2024-04-26T23:49:36.408525+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:48:32.015654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":8204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"26'252","reported_seq":274,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:36.228459+0000","last_change":"2024-04-26T23:40:40.677258+0000","last_active":"2024-04-26T23:49:36.228459+0000","last_peered":"2024-04-26T23:49:36.228459+0000","last_clean":"2024-04-26T23:49:36.228459+0000","last_became_active":"2024-04-26T23:40:40.676937+0000","last_became_peered":"2024-04-26T23:40:40.676937+0000","last_unstale":"2024-04-26T23:49:36.228459+0000","last_undegraded":"2024-04-26T23:49:36.228459+0000","last_fullsized":"2024-04-26T23:49:36.228459+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":252,"log_dups_size":0,"ondisk_log_size":252,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:44:50.588556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":473,"num_write_kb":168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"26'4519","reported_seq":4539,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:30.334012+0000","last_change":"2024-04-26T23:40:41.684731+0000","last_active":"2024-04-26T23:49:30.334012+0000","last_peered":"2024-04-26T23:49:30.334012+0000","last_clean":"2024-04-26T23:49:30.334012+0000","last_became_active":"2024-04-26T23:40:41.684459+0000","last_became_peered":"2024-04-26T23:40:41.684459+0000","last_unstale":"2024-04-26T23:49:30.334012+0000","last_undegraded":"2024-04-26T23:49:30.334012+0000","last_fullsized":"2024-04-26T23:49:30.334012+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":4519,"log_dups_size":0,"ondisk_log_size":4519,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:24:07.784468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":68252,"num_write_kb":886817,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"26'4324","reported_seq":4352,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:36.353026+0000","last_change":"2024-04-26T23:40:32.593216+0000","last_active":"2024-04-26T23:49:36.353026+0000","last_peered":"2024-04-26T23:49:36.353026+0000","last_clean":"2024-04-26T23:49:36.353026+0000","last_became_active":"2024-04-26T23:40:32.592929+0000","last_became_peered":"2024-04-26T23:40:32.592929+0000","last_unstale":"2024-04-26T23:49:36.353026+0000","last_undegraded":"2024-04-26T23:49:36.353026+0000","last_fullsized":"2024-04-26T23:49:36.353026+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":4324,"log_dups_size":0,"ondisk_log_size":4324,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:12:45.093169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":65153,"num_write_kb":829422,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"26'2","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:48:10.239534+0000","last_change":"2024-04-26T23:40:31.570118+0000","last_active":"2024-04-26T23:48:10.239534+0000","last_peered":"2024-04-26T23:48:10.239534+0000","last_clean":"2024-04-26T23:48:10.239534+0000","last_became_active":"2024-04-26T23:40:31.569764+0000","last_became_peered":"2024-04-26T23:40:31.569764+0000","last_unstale":"2024-04-26T23:48:10.239534+0000","last_undegraded":"2024-04-26T23:48:10.239534+0000","last_fullsized":"2024-04-26T23:48:10.239534+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:15:30.884135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":186,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:46:31.335185+0000","last_change":"2024-04-26T23:40:20.966672+0000","last_active":"2024-04-26T23:46:31.335185+0000","last_peered":"2024-04-26T23:46:31.335185+0000","last_clean":"2024-04-26T23:46:31.335185+0000","last_became_active":"2024-04-26T23:40:20.963937+0000","last_became_peered":"2024-04-26T23:40:20.963937+0000","last_unstale":"2024-04-26T23:46:31.335185+0000","last_undegraded":"2024-04-26T23:46:31.335185+0000","last_fullsized":"2024-04-26T23:46:31.335185+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:19.950137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:19.950137+0000","last_clean_scrub_stamp":"2024-04-26T23:40:19.950137+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:23:39.166579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"26'7","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:30.322697+0000","last_change":"2024-04-26T23:40:40.671995+0000","last_active":"2024-04-26T23:49:30.322697+0000","last_peered":"2024-04-26T23:49:30.322697+0000","last_clean":"2024-04-26T23:49:30.322697+0000","last_became_active":"2024-04-26T23:40:40.671642+0000","last_became_peered":"2024-04-26T23:40:40.671642+0000","last_unstale":"2024-04-26T23:49:30.322697+0000","last_undegraded":"2024-04-26T23:49:30.322697+0000","last_fullsized":"2024-04-26T23:49:30.322697+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:35:16.288571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"26'3788","reported_seq":3808,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:32.348847+0000","last_change":"2024-04-26T23:40:41.680852+0000","last_active":"2024-04-26T23:49:32.348847+0000","last_peered":"2024-04-26T23:49:32.348847+0000","last_clean":"2024-04-26T23:49:32.348847+0000","last_became_active":"2024-04-26T23:40:41.680567+0000","last_became_peered":"2024-04-26T23:40:41.680567+0000","last_unstale":"2024-04-26T23:49:32.348847+0000","last_undegraded":"2024-04-26T23:49:32.348847+0000","last_fullsized":"2024-04-26T23:49:32.348847+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":3788,"log_dups_size":0,"ondisk_log_size":3788,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:40:15.485085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":57172,"num_write_kb":707056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"26'4186","reported_seq":4214,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.944934+0000","last_change":"2024-04-26T23:40:32.591906+0000","last_active":"2024-04-26T23:49:42.944934+0000","last_peered":"2024-04-26T23:49:42.944934+0000","last_clean":"2024-04-26T23:49:42.944934+0000","last_became_active":"2024-04-26T23:40:32.590867+0000","last_became_peered":"2024-04-26T23:40:32.590867+0000","last_unstale":"2024-04-26T23:49:42.944934+0000","last_undegraded":"2024-04-26T23:49:42.944934+0000","last_fullsized":"2024-04-26T23:49:42.944934+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":4186,"log_dups_size":0,"ondisk_log_size":4186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:56:04.309611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":62827,"num_write_kb":810912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"26'3","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:36.388158+0000","last_change":"2024-04-26T23:40:31.572391+0000","last_active":"2024-04-26T23:49:36.388158+0000","last_peered":"2024-04-26T23:49:36.388158+0000","last_clean":"2024-04-26T23:49:36.388158+0000","last_became_active":"2024-04-26T23:40:31.571849+0000","last_became_peered":"2024-04-26T23:40:31.571849+0000","last_unstale":"2024-04-26T23:49:36.388158+0000","last_undegraded":"2024-04-26T23:49:36.388158+0000","last_fullsized":"2024-04-26T23:49:36.388158+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:35:54.439397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"26'6","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:30.330522+0000","last_change":"2024-04-26T23:40:40.676464+0000","last_active":"2024-04-26T23:49:30.330522+0000","last_peered":"2024-04-26T23:49:30.330522+0000","last_clean":"2024-04-26T23:49:30.330522+0000","last_became_active":"2024-04-26T23:40:40.676154+0000","last_became_peered":"2024-04-26T23:40:40.676154+0000","last_unstale":"2024-04-26T23:49:30.330522+0000","last_undegraded":"2024-04-26T23:49:30.330522+0000","last_fullsized":"2024-04-26T23:49:30.330522+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:52:34.793496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"26'3982","reported_seq":4002,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:30.199676+0000","last_change":"2024-04-26T23:40:41.688065+0000","last_active":"2024-04-26T23:49:30.199676+0000","last_peered":"2024-04-26T23:49:30.199676+0000","last_clean":"2024-04-26T23:49:30.199676+0000","last_became_active":"2024-04-26T23:40:41.687693+0000","last_became_peered":"2024-04-26T23:40:41.687693+0000","last_unstale":"2024-04-26T23:49:30.199676+0000","last_undegraded":"2024-04-26T23:49:30.199676+0000","last_fullsized":"2024-04-26T23:49:30.199676+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":3982,"log_dups_size":0,"ondisk_log_size":3982,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:35:17.294025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":60042,"num_write_kb":782772,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"26'4281","reported_seq":4309,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:36.415092+0000","last_change":"2024-04-26T23:40:32.583469+0000","last_active":"2024-04-26T23:49:36.415092+0000","last_peered":"2024-04-26T23:49:36.415092+0000","last_clean":"2024-04-26T23:49:36.415092+0000","last_became_active":"2024-04-26T23:40:32.583174+0000","last_became_peered":"2024-04-26T23:40:32.583174+0000","last_unstale":"2024-04-26T23:49:36.415092+0000","last_undegraded":"2024-04-26T23:49:36.415092+0000","last_fullsized":"2024-04-26T23:49:36.415092+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":4281,"log_dups_size":0,"ondisk_log_size":4281,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:34:14.811917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":64102,"num_write_kb":832828,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"26'6","reported_seq":36,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:34.388816+0000","last_change":"2024-04-26T23:40:31.571749+0000","last_active":"2024-04-26T23:49:34.388816+0000","last_peered":"2024-04-26T23:49:34.388816+0000","last_clean":"2024-04-26T23:49:34.388816+0000","last_became_active":"2024-04-26T23:40:31.571427+0000","last_became_peered":"2024-04-26T23:40:31.571427+0000","last_unstale":"2024-04-26T23:49:34.388816+0000","last_undegraded":"2024-04-26T23:49:34.388816+0000","last_fullsized":"2024-04-26T23:49:34.388816+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:20:28.103413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"26'155","reported_seq":177,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:32.342498+0000","last_change":"2024-04-26T23:40:40.675987+0000","last_active":"2024-04-26T23:49:32.342498+0000","last_peered":"2024-04-26T23:49:32.342498+0000","last_clean":"2024-04-26T23:49:32.342498+0000","last_became_active":"2024-04-26T23:40:40.675682+0000","last_became_peered":"2024-04-26T23:40:40.675682+0000","last_unstale":"2024-04-26T23:49:32.342498+0000","last_undegraded":"2024-04-26T23:49:32.342498+0000","last_fullsized":"2024-04-26T23:49:32.342498+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":155,"log_dups_size":0,"ondisk_log_size":155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:10:10.722905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":145,"num_write_kb":8318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"26'4188","reported_seq":4208,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:32.332216+0000","last_change":"2024-04-26T23:40:41.681408+0000","last_active":"2024-04-26T23:49:32.332216+0000","last_peered":"2024-04-26T23:49:32.332216+0000","last_clean":"2024-04-26T23:49:32.332216+0000","last_became_active":"2024-04-26T23:40:41.681069+0000","last_became_peered":"2024-04-26T23:40:41.681069+0000","last_unstale":"2024-04-26T23:49:32.332216+0000","last_undegraded":"2024-04-26T23:49:32.332216+0000","last_fullsized":"2024-04-26T23:49:32.332216+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":4188,"log_dups_size":0,"ondisk_log_size":4188,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:10:30.972726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":63216,"num_write_kb":796499,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"26'4864","reported_seq":4892,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.993843+0000","last_change":"2024-04-26T23:40:32.596306+0000","last_active":"2024-04-26T23:49:42.993843+0000","last_peered":"2024-04-26T23:49:42.993843+0000","last_clean":"2024-04-26T23:49:42.993843+0000","last_became_active":"2024-04-26T23:40:32.595625+0000","last_became_peered":"2024-04-26T23:40:32.595625+0000","last_unstale":"2024-04-26T23:49:42.993843+0000","last_undegraded":"2024-04-26T23:49:42.993843+0000","last_fullsized":"2024-04-26T23:49:42.993843+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":4864,"log_dups_size":0,"ondisk_log_size":4864,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:10:02.629199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":72976,"num_write_kb":927582,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"26'23","reported_seq":53,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:36.412667+0000","last_change":"2024-04-26T23:40:31.570870+0000","last_active":"2024-04-26T23:49:36.412667+0000","last_peered":"2024-04-26T23:49:36.412667+0000","last_clean":"2024-04-26T23:49:36.412667+0000","last_became_active":"2024-04-26T23:40:31.570592+0000","last_became_peered":"2024-04-26T23:40:31.570592+0000","last_unstale":"2024-04-26T23:49:36.412667+0000","last_undegraded":"2024-04-26T23:49:36.412667+0000","last_fullsized":"2024-04-26T23:49:36.412667+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:43:13.740214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":4104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"26'8","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:30.313360+0000","last_change":"2024-04-26T23:40:40.673142+0000","last_active":"2024-04-26T23:49:30.313360+0000","last_peered":"2024-04-26T23:49:30.313360+0000","last_clean":"2024-04-26T23:49:30.313360+0000","last_became_active":"2024-04-26T23:40:40.672816+0000","last_became_peered":"2024-04-26T23:40:40.672816+0000","last_unstale":"2024-04-26T23:49:30.313360+0000","last_undegraded":"2024-04-26T23:49:30.313360+0000","last_fullsized":"2024-04-26T23:49:30.313360+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:53:12.526011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"26'4528","reported_seq":4548,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:30.271481+0000","last_change":"2024-04-26T23:40:41.678588+0000","last_active":"2024-04-26T23:49:30.271481+0000","last_peered":"2024-04-26T23:49:30.271481+0000","last_clean":"2024-04-26T23:49:30.271481+0000","last_became_active":"2024-04-26T23:40:41.678039+0000","last_became_peered":"2024-04-26T23:40:41.678039+0000","last_unstale":"2024-04-26T23:49:30.271481+0000","last_undegraded":"2024-04-26T23:49:30.271481+0000","last_fullsized":"2024-04-26T23:49:30.271481+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":4528,"log_dups_size":0,"ondisk_log_size":4528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:04:39.652713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":68234,"num_write_kb":870585,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"26'4022","reported_seq":4050,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.887550+0000","last_change":"2024-04-26T23:40:32.593577+0000","last_active":"2024-04-26T23:49:42.887550+0000","last_peered":"2024-04-26T23:49:42.887550+0000","last_clean":"2024-04-26T23:49:42.887550+0000","last_became_active":"2024-04-26T23:40:32.593235+0000","last_became_peered":"2024-04-26T23:40:32.593235+0000","last_unstale":"2024-04-26T23:49:42.887550+0000","last_undegraded":"2024-04-26T23:49:42.887550+0000","last_fullsized":"2024-04-26T23:49:42.887550+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":4022,"log_dups_size":0,"ondisk_log_size":4022,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:01:02.741964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":60538,"num_write_kb":762431,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"26'9","reported_seq":39,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:36.422094+0000","last_change":"2024-04-26T23:40:31.575943+0000","last_active":"2024-04-26T23:49:36.422094+0000","last_peered":"2024-04-26T23:49:36.422094+0000","last_clean":"2024-04-26T23:49:36.422094+0000","last_became_active":"2024-04-26T23:40:31.575632+0000","last_became_peered":"2024-04-26T23:40:31.575632+0000","last_unstale":"2024-04-26T23:49:36.422094+0000","last_undegraded":"2024-04-26T23:49:36.422094+0000","last_fullsized":"2024-04-26T23:49:36.422094+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:11:08.189634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"26'7","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:30.331487+0000","last_change":"2024-04-26T23:40:40.676297+0000","last_active":"2024-04-26T23:49:30.331487+0000","last_peered":"2024-04-26T23:49:30.331487+0000","last_clean":"2024-04-26T23:49:30.331487+0000","last_became_active":"2024-04-26T23:40:40.675888+0000","last_became_peered":"2024-04-26T23:40:40.675888+0000","last_unstale":"2024-04-26T23:49:30.331487+0000","last_undegraded":"2024-04-26T23:49:30.331487+0000","last_fullsized":"2024-04-26T23:49:30.331487+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:04:38.647258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.17","version":"26'3925","reported_seq":3944,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:32.356196+0000","last_change":"2024-04-26T23:40:41.688506+0000","last_active":"2024-04-26T23:49:32.356196+0000","last_peered":"2024-04-26T23:49:32.356196+0000","last_clean":"2024-04-26T23:49:32.356196+0000","last_became_active":"2024-04-26T23:40:41.688224+0000","last_became_peered":"2024-04-26T23:40:41.688224+0000","last_unstale":"2024-04-26T23:49:32.356196+0000","last_undegraded":"2024-04-26T23:49:32.356196+0000","last_fullsized":"2024-04-26T23:49:32.356196+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":3925,"log_dups_size":0,"ondisk_log_size":3925,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:05:34.008024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":58974,"num_write_kb":744310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"26'3924","reported_seq":3951,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.884380+0000","last_change":"2024-04-26T23:40:32.593528+0000","last_active":"2024-04-26T23:49:42.884380+0000","last_peered":"2024-04-26T23:49:42.884380+0000","last_clean":"2024-04-26T23:49:42.884380+0000","last_became_active":"2024-04-26T23:40:32.593220+0000","last_became_peered":"2024-04-26T23:40:32.593220+0000","last_unstale":"2024-04-26T23:49:42.884380+0000","last_undegraded":"2024-04-26T23:49:42.884380+0000","last_fullsized":"2024-04-26T23:49:42.884380+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":3924,"log_dups_size":0,"ondisk_log_size":3924,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:04:30.553552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":58510,"num_write_kb":806052,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"26'50","reported_seq":80,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:40.460675+0000","last_change":"2024-04-26T23:40:31.572685+0000","last_active":"2024-04-26T23:49:40.460675+0000","last_peered":"2024-04-26T23:49:40.460675+0000","last_clean":"2024-04-26T23:49:40.460675+0000","last_became_active":"2024-04-26T23:40:31.572169+0000","last_became_peered":"2024-04-26T23:40:31.572169+0000","last_unstale":"2024-04-26T23:49:40.460675+0000","last_undegraded":"2024-04-26T23:49:40.460675+0000","last_fullsized":"2024-04-26T23:49:40.460675+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:15:30.884135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":8207,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"26'31","reported_seq":52,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:30.331813+0000","last_change":"2024-04-26T23:40:40.672160+0000","last_active":"2024-04-26T23:49:30.331813+0000","last_peered":"2024-04-26T23:49:30.331813+0000","last_clean":"2024-04-26T23:49:30.331813+0000","last_became_active":"2024-04-26T23:40:40.671875+0000","last_became_peered":"2024-04-26T23:40:40.671875+0000","last_unstale":"2024-04-26T23:49:30.331813+0000","last_undegraded":"2024-04-26T23:49:30.331813+0000","last_fullsized":"2024-04-26T23:49:30.331813+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:35:16.288571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":4110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"26'4508","reported_seq":4527,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:30.329720+0000","last_change":"2024-04-26T23:40:41.688445+0000","last_active":"2024-04-26T23:49:30.329720+0000","last_peered":"2024-04-26T23:49:30.329720+0000","last_clean":"2024-04-26T23:49:30.329720+0000","last_became_active":"2024-04-26T23:40:41.688053+0000","last_became_peered":"2024-04-26T23:40:41.688053+0000","last_unstale":"2024-04-26T23:49:30.329720+0000","last_undegraded":"2024-04-26T23:49:30.329720+0000","last_fullsized":"2024-04-26T23:49:30.329720+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":4508,"log_dups_size":0,"ondisk_log_size":4508,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:08:35.027584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":67755,"num_write_kb":851157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"26'4530","reported_seq":4558,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.907543+0000","last_change":"2024-04-26T23:40:32.586832+0000","last_active":"2024-04-26T23:49:42.907543+0000","last_peered":"2024-04-26T23:49:42.907543+0000","last_clean":"2024-04-26T23:49:42.907543+0000","last_became_active":"2024-04-26T23:40:32.585809+0000","last_became_peered":"2024-04-26T23:40:32.585809+0000","last_unstale":"2024-04-26T23:49:42.907543+0000","last_undegraded":"2024-04-26T23:49:42.907543+0000","last_fullsized":"2024-04-26T23:49:42.907543+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":4530,"log_dups_size":0,"ondisk_log_size":4530,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:51:30.677247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":67909,"num_write_kb":843744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"26'6","reported_seq":35,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:36.408234+0000","last_change":"2024-04-26T23:40:31.569512+0000","last_active":"2024-04-26T23:49:36.408234+0000","last_peered":"2024-04-26T23:49:36.408234+0000","last_clean":"2024-04-26T23:49:36.408234+0000","last_became_active":"2024-04-26T23:40:31.568598+0000","last_became_peered":"2024-04-26T23:40:31.568598+0000","last_unstale":"2024-04-26T23:49:36.408234+0000","last_undegraded":"2024-04-26T23:49:36.408234+0000","last_fullsized":"2024-04-26T23:49:36.408234+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:48:32.015654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"26'2","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:48:00.796748+0000","last_change":"2024-04-26T23:40:40.673986+0000","last_active":"2024-04-26T23:48:00.796748+0000","last_peered":"2024-04-26T23:48:00.796748+0000","last_clean":"2024-04-26T23:48:00.796748+0000","last_became_active":"2024-04-26T23:40:40.673704+0000","last_became_peered":"2024-04-26T23:40:40.673704+0000","last_unstale":"2024-04-26T23:48:00.796748+0000","last_undegraded":"2024-04-26T23:48:00.796748+0000","last_fullsized":"2024-04-26T23:48:00.796748+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:37:24.000775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"26'4209","reported_seq":4228,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:30.142174+0000","last_change":"2024-04-26T23:40:41.691441+0000","last_active":"2024-04-26T23:49:30.142174+0000","last_peered":"2024-04-26T23:49:30.142174+0000","last_clean":"2024-04-26T23:49:30.142174+0000","last_became_active":"2024-04-26T23:40:41.691160+0000","last_became_peered":"2024-04-26T23:40:41.691160+0000","last_unstale":"2024-04-26T23:49:30.142174+0000","last_undegraded":"2024-04-26T23:49:30.142174+0000","last_fullsized":"2024-04-26T23:49:30.142174+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":4209,"log_dups_size":0,"ondisk_log_size":4209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:41:52.386084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":63478,"num_write_kb":811778,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"26'4684","reported_seq":4711,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.927995+0000","last_change":"2024-04-26T23:40:32.595377+0000","last_active":"2024-04-26T23:49:42.927995+0000","last_peered":"2024-04-26T23:49:42.927995+0000","last_clean":"2024-04-26T23:49:42.927995+0000","last_became_active":"2024-04-26T23:40:32.595032+0000","last_became_peered":"2024-04-26T23:40:32.595032+0000","last_unstale":"2024-04-26T23:49:42.927995+0000","last_undegraded":"2024-04-26T23:49:42.927995+0000","last_fullsized":"2024-04-26T23:49:42.927995+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":4684,"log_dups_size":0,"ondisk_log_size":4684,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:44:42.494850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":70001,"num_write_kb":901416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"26'5","reported_seq":34,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:36.432793+0000","last_change":"2024-04-26T23:40:31.575493+0000","last_active":"2024-04-26T23:49:36.432793+0000","last_peered":"2024-04-26T23:49:36.432793+0000","last_clean":"2024-04-26T23:49:36.432793+0000","last_became_active":"2024-04-26T23:40:31.575039+0000","last_became_peered":"2024-04-26T23:40:31.575039+0000","last_unstale":"2024-04-26T23:49:36.432793+0000","last_undegraded":"2024-04-26T23:49:36.432793+0000","last_fullsized":"2024-04-26T23:49:36.432793+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:43:13.740214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"26'244","reported_seq":265,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:30.332951+0000","last_change":"2024-04-26T23:40:40.676493+0000","last_active":"2024-04-26T23:49:30.332951+0000","last_peered":"2024-04-26T23:49:30.332951+0000","last_clean":"2024-04-26T23:49:30.332951+0000","last_became_active":"2024-04-26T23:40:40.676124+0000","last_became_peered":"2024-04-26T23:40:40.676124+0000","last_unstale":"2024-04-26T23:49:30.332951+0000","last_undegraded":"2024-04-26T23:49:30.332951+0000","last_fullsized":"2024-04-26T23:49:30.332951+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":244,"log_dups_size":0,"ondisk_log_size":244,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:28:33.915485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583584,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":238,"num_write_kb":12457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"26'6168","reported_seq":6187,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:30.300205+0000","last_change":"2024-04-26T23:40:41.680735+0000","last_active":"2024-04-26T23:49:30.300205+0000","last_peered":"2024-04-26T23:49:30.300205+0000","last_clean":"2024-04-26T23:49:30.300205+0000","last_became_active":"2024-04-26T23:40:41.680485+0000","last_became_peered":"2024-04-26T23:40:41.680485+0000","last_unstale":"2024-04-26T23:49:30.300205+0000","last_undegraded":"2024-04-26T23:49:30.300205+0000","last_fullsized":"2024-04-26T23:49:30.300205+0000","mapping_epoch":22,"log_start":"26'900","ondisk_log_start":"26'900","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":5268,"log_dups_size":0,"ondisk_log_size":5268,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:38:51.195172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":93116,"num_write_kb":1152811,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"26'3934","reported_seq":3961,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.892973+0000","last_change":"2024-04-26T23:40:32.589706+0000","last_active":"2024-04-26T23:49:42.892973+0000","last_peered":"2024-04-26T23:49:42.892973+0000","last_clean":"2024-04-26T23:49:42.892973+0000","last_became_active":"2024-04-26T23:40:32.589452+0000","last_became_peered":"2024-04-26T23:40:32.589452+0000","last_unstale":"2024-04-26T23:49:42.892973+0000","last_undegraded":"2024-04-26T23:49:42.892973+0000","last_fullsized":"2024-04-26T23:49:42.892973+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":3934,"log_dups_size":0,"ondisk_log_size":3934,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:15:01.970308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":58864,"num_write_kb":755351,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"26'27","reported_seq":56,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:36.415333+0000","last_change":"2024-04-26T23:40:31.573941+0000","last_active":"2024-04-26T23:49:36.415333+0000","last_peered":"2024-04-26T23:49:36.415333+0000","last_clean":"2024-04-26T23:49:36.415333+0000","last_became_active":"2024-04-26T23:40:31.573668+0000","last_became_peered":"2024-04-26T23:40:31.573668+0000","last_unstale":"2024-04-26T23:49:36.415333+0000","last_undegraded":"2024-04-26T23:49:36.415333+0000","last_fullsized":"2024-04-26T23:49:36.415333+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:58:06.477730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":8209,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"26'27","reported_seq":48,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:32.365002+0000","last_change":"2024-04-26T23:40:40.676408+0000","last_active":"2024-04-26T23:49:32.365002+0000","last_peered":"2024-04-26T23:49:32.365002+0000","last_clean":"2024-04-26T23:49:32.365002+0000","last_became_active":"2024-04-26T23:40:40.676147+0000","last_became_peered":"2024-04-26T23:40:40.676147+0000","last_unstale":"2024-04-26T23:49:32.365002+0000","last_undegraded":"2024-04-26T23:49:32.365002+0000","last_fullsized":"2024-04-26T23:49:32.365002+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:27:47.818055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194394,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":4110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.13","version":"26'4979","reported_seq":4998,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:32.348016+0000","last_change":"2024-04-26T23:40:41.685829+0000","last_active":"2024-04-26T23:49:32.348016+0000","last_peered":"2024-04-26T23:49:32.348016+0000","last_clean":"2024-04-26T23:49:32.348016+0000","last_became_active":"2024-04-26T23:40:41.685403+0000","last_became_peered":"2024-04-26T23:40:41.685403+0000","last_unstale":"2024-04-26T23:49:32.348016+0000","last_undegraded":"2024-04-26T23:49:32.348016+0000","last_fullsized":"2024-04-26T23:49:32.348016+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":4979,"log_dups_size":0,"ondisk_log_size":4979,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:24:07.784468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":74752,"num_write_kb":961504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"26'3907","reported_seq":3934,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.911201+0000","last_change":"2024-04-26T23:40:32.587513+0000","last_active":"2024-04-26T23:49:42.911201+0000","last_peered":"2024-04-26T23:49:42.911201+0000","last_clean":"2024-04-26T23:49:42.911201+0000","last_became_active":"2024-04-26T23:40:32.587200+0000","last_became_peered":"2024-04-26T23:40:32.587200+0000","last_unstale":"2024-04-26T23:49:42.911201+0000","last_undegraded":"2024-04-26T23:49:42.911201+0000","last_fullsized":"2024-04-26T23:49:42.911201+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":3907,"log_dups_size":0,"ondisk_log_size":3907,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:37:30.361795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":58714,"num_write_kb":750642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"26'240","reported_seq":269,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:36.399847+0000","last_change":"2024-04-26T23:40:31.572331+0000","last_active":"2024-04-26T23:49:36.399847+0000","last_peered":"2024-04-26T23:49:36.399847+0000","last_clean":"2024-04-26T23:49:36.399847+0000","last_became_active":"2024-04-26T23:40:31.572074+0000","last_became_peered":"2024-04-26T23:40:31.572074+0000","last_unstale":"2024-04-26T23:49:36.399847+0000","last_undegraded":"2024-04-26T23:49:36.399847+0000","last_fullsized":"2024-04-26T23:49:36.399847+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:45:49.295198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583584,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":234,"num_write_kb":12453,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"26'5","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:32.351402+0000","last_change":"2024-04-26T23:40:40.677978+0000","last_active":"2024-04-26T23:49:32.351402+0000","last_peered":"2024-04-26T23:49:32.351402+0000","last_clean":"2024-04-26T23:49:32.351402+0000","last_became_active":"2024-04-26T23:40:40.677714+0000","last_became_peered":"2024-04-26T23:40:40.677714+0000","last_unstale":"2024-04-26T23:49:32.351402+0000","last_undegraded":"2024-04-26T23:49:32.351402+0000","last_fullsized":"2024-04-26T23:49:32.351402+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:44:50.588556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"26'4186","reported_seq":4205,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:30.218788+0000","last_change":"2024-04-26T23:40:41.685431+0000","last_active":"2024-04-26T23:49:30.218788+0000","last_peered":"2024-04-26T23:49:30.218788+0000","last_clean":"2024-04-26T23:49:30.218788+0000","last_became_active":"2024-04-26T23:40:41.685147+0000","last_became_peered":"2024-04-26T23:40:41.685147+0000","last_unstale":"2024-04-26T23:49:30.218788+0000","last_undegraded":"2024-04-26T23:49:30.218788+0000","last_fullsized":"2024-04-26T23:49:30.218788+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":4186,"log_dups_size":0,"ondisk_log_size":4186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:33:16.389626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":62805,"num_write_kb":801211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"26'5530","reported_seq":5557,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.978334+0000","last_change":"2024-04-26T23:40:32.593298+0000","last_active":"2024-04-26T23:49:42.978334+0000","last_peered":"2024-04-26T23:49:42.978334+0000","last_clean":"2024-04-26T23:49:42.978334+0000","last_became_active":"2024-04-26T23:40:32.593030+0000","last_became_peered":"2024-04-26T23:40:32.593030+0000","last_unstale":"2024-04-26T23:49:42.978334+0000","last_undegraded":"2024-04-26T23:49:42.978334+0000","last_fullsized":"2024-04-26T23:49:42.978334+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":5530,"log_dups_size":0,"ondisk_log_size":5530,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:20:29.107798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":83076,"num_write_kb":1053123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"26'24","reported_seq":53,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:36.423309+0000","last_change":"2024-04-26T23:40:31.574234+0000","last_active":"2024-04-26T23:49:36.423309+0000","last_peered":"2024-04-26T23:49:36.423309+0000","last_clean":"2024-04-26T23:49:36.423309+0000","last_became_active":"2024-04-26T23:40:31.572218+0000","last_became_peered":"2024-04-26T23:40:31.572218+0000","last_unstale":"2024-04-26T23:49:36.423309+0000","last_undegraded":"2024-04-26T23:49:36.423309+0000","last_fullsized":"2024-04-26T23:49:36.423309+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:25:01.315397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194394,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":4107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"26'31","reported_seq":52,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:32.332248+0000","last_change":"2024-04-26T23:40:40.674778+0000","last_active":"2024-04-26T23:49:32.332248+0000","last_peered":"2024-04-26T23:49:32.332248+0000","last_clean":"2024-04-26T23:49:32.332248+0000","last_became_active":"2024-04-26T23:40:40.674487+0000","last_became_peered":"2024-04-26T23:40:40.674487+0000","last_unstale":"2024-04-26T23:49:32.332248+0000","last_undegraded":"2024-04-26T23:49:32.332248+0000","last_fullsized":"2024-04-26T23:49:32.332248+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:10:10.722905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":8207,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"26'4271","reported_seq":4290,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:32.333272+0000","last_change":"2024-04-26T23:40:41.686531+0000","last_active":"2024-04-26T23:49:32.333272+0000","last_peered":"2024-04-26T23:49:32.333272+0000","last_clean":"2024-04-26T23:49:32.333272+0000","last_became_active":"2024-04-26T23:40:41.686259+0000","last_became_peered":"2024-04-26T23:40:41.686259+0000","last_unstale":"2024-04-26T23:49:32.333272+0000","last_undegraded":"2024-04-26T23:49:32.333272+0000","last_fullsized":"2024-04-26T23:49:32.333272+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":4271,"log_dups_size":0,"ondisk_log_size":4271,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:45:34.231942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":64273,"num_write_kb":853172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"26'3697","reported_seq":3729,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.884964+0000","last_change":"2024-04-26T23:41:30.513928+0000","last_active":"2024-04-26T23:49:42.884964+0000","last_peered":"2024-04-26T23:49:42.884964+0000","last_clean":"2024-04-26T23:49:42.884964+0000","last_became_active":"2024-04-26T23:41:30.513492+0000","last_became_peered":"2024-04-26T23:41:30.513492+0000","last_unstale":"2024-04-26T23:49:42.884964+0000","last_undegraded":"2024-04-26T23:49:42.884964+0000","last_fullsized":"2024-04-26T23:49:42.884964+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":3697,"log_dups_size":0,"ondisk_log_size":3697,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:41:43.286923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55355,"num_write_kb":693310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"26'22","reported_seq":51,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:36.405506+0000","last_change":"2024-04-26T23:40:31.575616+0000","last_active":"2024-04-26T23:49:36.405506+0000","last_peered":"2024-04-26T23:49:36.405506+0000","last_clean":"2024-04-26T23:49:36.405506+0000","last_became_active":"2024-04-26T23:40:31.575211+0000","last_became_peered":"2024-04-26T23:40:31.575211+0000","last_unstale":"2024-04-26T23:49:36.405506+0000","last_undegraded":"2024-04-26T23:49:36.405506+0000","last_fullsized":"2024-04-26T23:49:36.405506+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:48:32.015654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":4104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"26'38","reported_seq":59,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:30.334226+0000","last_change":"2024-04-26T23:40:40.675694+0000","last_active":"2024-04-26T23:49:30.334226+0000","last_peered":"2024-04-26T23:49:30.334226+0000","last_clean":"2024-04-26T23:49:30.334226+0000","last_became_active":"2024-04-26T23:40:40.675459+0000","last_became_peered":"2024-04-26T23:40:40.675459+0000","last_unstale":"2024-04-26T23:49:30.334226+0000","last_undegraded":"2024-04-26T23:49:30.334226+0000","last_fullsized":"2024-04-26T23:49:30.334226+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:30:03.993564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36,"num_write_kb":8203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"26'4893","reported_seq":4912,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:32.330028+0000","last_change":"2024-04-26T23:40:41.687488+0000","last_active":"2024-04-26T23:49:32.330028+0000","last_peered":"2024-04-26T23:49:32.330028+0000","last_clean":"2024-04-26T23:49:32.330028+0000","last_became_active":"2024-04-26T23:40:41.687210+0000","last_became_peered":"2024-04-26T23:40:41.687210+0000","last_unstale":"2024-04-26T23:49:32.330028+0000","last_undegraded":"2024-04-26T23:49:32.330028+0000","last_fullsized":"2024-04-26T23:49:32.330028+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":4893,"log_dups_size":0,"ondisk_log_size":4893,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:36:21.487122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":73846,"num_write_kb":901080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"26'4194","reported_seq":4207,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.872278+0000","last_change":"2024-04-26T23:41:30.751583+0000","last_active":"2024-04-26T23:49:42.872278+0000","last_peered":"2024-04-26T23:49:42.872278+0000","last_clean":"2024-04-26T23:49:42.872278+0000","last_became_active":"2024-04-26T23:41:30.751285+0000","last_became_peered":"2024-04-26T23:41:30.751285+0000","last_unstale":"2024-04-26T23:49:42.872278+0000","last_undegraded":"2024-04-26T23:49:42.872278+0000","last_fullsized":"2024-04-26T23:49:42.872278+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":4194,"log_dups_size":0,"ondisk_log_size":4194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:36:12.387962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":63007,"num_write_kb":791881,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"26'2","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:47:52.159460+0000","last_change":"2024-04-26T23:40:31.573794+0000","last_active":"2024-04-26T23:47:52.159460+0000","last_peered":"2024-04-26T23:47:52.159460+0000","last_clean":"2024-04-26T23:47:52.159460+0000","last_became_active":"2024-04-26T23:40:31.573164+0000","last_became_peered":"2024-04-26T23:40:31.573164+0000","last_unstale":"2024-04-26T23:47:52.159460+0000","last_undegraded":"2024-04-26T23:47:52.159460+0000","last_fullsized":"2024-04-26T23:47:52.159460+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:15:30.884135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"26'6","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:30.333939+0000","last_change":"2024-04-26T23:40:40.674127+0000","last_active":"2024-04-26T23:49:30.333939+0000","last_peered":"2024-04-26T23:49:30.333939+0000","last_clean":"2024-04-26T23:49:30.333939+0000","last_became_active":"2024-04-26T23:40:40.673793+0000","last_became_peered":"2024-04-26T23:40:40.673793+0000","last_unstale":"2024-04-26T23:49:30.333939+0000","last_undegraded":"2024-04-26T23:49:30.333939+0000","last_fullsized":"2024-04-26T23:49:30.333939+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:53:12.526011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"26'5246","reported_seq":5266,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:32.332088+0000","last_change":"2024-04-26T23:40:41.686867+0000","last_active":"2024-04-26T23:49:32.332088+0000","last_peered":"2024-04-26T23:49:32.332088+0000","last_clean":"2024-04-26T23:49:32.332088+0000","last_became_active":"2024-04-26T23:40:41.686536+0000","last_became_peered":"2024-04-26T23:40:41.686536+0000","last_unstale":"2024-04-26T23:49:32.332088+0000","last_undegraded":"2024-04-26T23:49:32.332088+0000","last_fullsized":"2024-04-26T23:49:32.332088+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":5246,"log_dups_size":0,"ondisk_log_size":5246,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:28:34.920939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":78945,"num_write_kb":1046825,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"26'13","reported_seq":35,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:30.333687+0000","last_change":"2024-04-26T23:40:40.674915+0000","last_active":"2024-04-26T23:49:30.333687+0000","last_peered":"2024-04-26T23:49:30.333687+0000","last_clean":"2024-04-26T23:49:30.333687+0000","last_became_active":"2024-04-26T23:40:40.674639+0000","last_became_peered":"2024-04-26T23:40:40.674639+0000","last_unstale":"2024-04-26T23:49:30.333687+0000","last_undegraded":"2024-04-26T23:49:30.333687+0000","last_fullsized":"2024-04-26T23:49:30.333687+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:52:34.793496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":4106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"26'4877","reported_seq":4904,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:36.436681+0000","last_change":"2024-04-26T23:40:32.583014+0000","last_active":"2024-04-26T23:49:36.436681+0000","last_peered":"2024-04-26T23:49:36.436681+0000","last_clean":"2024-04-26T23:49:36.436681+0000","last_became_active":"2024-04-26T23:40:32.582751+0000","last_became_peered":"2024-04-26T23:40:32.582751+0000","last_unstale":"2024-04-26T23:49:36.436681+0000","last_undegraded":"2024-04-26T23:49:36.436681+0000","last_fullsized":"2024-04-26T23:49:36.436681+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":4877,"log_dups_size":0,"ondisk_log_size":4877,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:38:10.884592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":73256,"num_write_kb":928290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"26'27","reported_seq":56,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:36.360432+0000","last_change":"2024-04-26T23:40:31.572402+0000","last_active":"2024-04-26T23:49:36.360432+0000","last_peered":"2024-04-26T23:49:36.360432+0000","last_clean":"2024-04-26T23:49:36.360432+0000","last_became_active":"2024-04-26T23:40:31.572111+0000","last_became_peered":"2024-04-26T23:40:31.572111+0000","last_unstale":"2024-04-26T23:49:36.360432+0000","last_undegraded":"2024-04-26T23:49:36.360432+0000","last_fullsized":"2024-04-26T23:49:36.360432+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:20:28.103413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":8213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"26'4749","reported_seq":4769,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:30.243878+0000","last_change":"2024-04-26T23:40:41.684524+0000","last_active":"2024-04-26T23:49:30.243878+0000","last_peered":"2024-04-26T23:49:30.243878+0000","last_clean":"2024-04-26T23:49:30.243878+0000","last_became_active":"2024-04-26T23:40:41.684207+0000","last_became_peered":"2024-04-26T23:40:41.684207+0000","last_unstale":"2024-04-26T23:49:30.243878+0000","last_undegraded":"2024-04-26T23:49:30.243878+0000","last_fullsized":"2024-04-26T23:49:30.243878+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":4749,"log_dups_size":0,"ondisk_log_size":4749,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:30:04.999018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":71582,"num_write_kb":928660,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"26'143","reported_seq":165,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:35.863318+0000","last_change":"2024-04-26T23:40:40.674934+0000","last_active":"2024-04-26T23:49:35.863318+0000","last_peered":"2024-04-26T23:49:35.863318+0000","last_clean":"2024-04-26T23:49:35.863318+0000","last_became_active":"2024-04-26T23:40:40.674628+0000","last_became_peered":"2024-04-26T23:40:40.674628+0000","last_unstale":"2024-04-26T23:49:35.863318+0000","last_undegraded":"2024-04-26T23:49:35.863318+0000","last_fullsized":"2024-04-26T23:49:35.863318+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":143,"log_dups_size":0,"ondisk_log_size":143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:44:50.588556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7745102,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":140,"num_write_kb":7620,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"26'4148","reported_seq":4175,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:36.438879+0000","last_change":"2024-04-26T23:40:32.586204+0000","last_active":"2024-04-26T23:49:36.438879+0000","last_peered":"2024-04-26T23:49:36.438879+0000","last_clean":"2024-04-26T23:49:36.438879+0000","last_became_active":"2024-04-26T23:40:32.585725+0000","last_became_peered":"2024-04-26T23:40:32.585725+0000","last_unstale":"2024-04-26T23:49:36.438879+0000","last_undegraded":"2024-04-26T23:49:36.438879+0000","last_fullsized":"2024-04-26T23:49:36.438879+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":4148,"log_dups_size":0,"ondisk_log_size":4148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:51:30.677247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":62294,"num_write_kb":802311,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"26'20","reported_seq":49,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:47:55.248638+0000","last_change":"2024-04-26T23:40:31.578929+0000","last_active":"2024-04-26T23:47:55.248638+0000","last_peered":"2024-04-26T23:47:55.248638+0000","last_clean":"2024-04-26T23:47:55.248638+0000","last_became_active":"2024-04-26T23:40:31.578623+0000","last_became_peered":"2024-04-26T23:40:31.578623+0000","last_unstale":"2024-04-26T23:47:55.248638+0000","last_undegraded":"2024-04-26T23:47:55.248638+0000","last_fullsized":"2024-04-26T23:47:55.248638+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:50:21.330821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":4105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"26'5403","reported_seq":5422,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:30.316265+0000","last_change":"2024-04-26T23:40:41.689697+0000","last_active":"2024-04-26T23:49:30.316265+0000","last_peered":"2024-04-26T23:49:30.316265+0000","last_clean":"2024-04-26T23:49:30.316265+0000","last_became_active":"2024-04-26T23:40:41.688428+0000","last_became_peered":"2024-04-26T23:40:41.688428+0000","last_unstale":"2024-04-26T23:49:30.316265+0000","last_undegraded":"2024-04-26T23:49:30.316265+0000","last_fullsized":"2024-04-26T23:49:30.316265+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":5403,"log_dups_size":0,"ondisk_log_size":5403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:36:21.487122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":81566,"num_write_kb":1040251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1a","version":"26'33","reported_seq":62,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:36.399499+0000","last_change":"2024-04-26T23:40:31.567755+0000","last_active":"2024-04-26T23:49:36.399499+0000","last_peered":"2024-04-26T23:49:36.399499+0000","last_clean":"2024-04-26T23:49:36.399499+0000","last_became_active":"2024-04-26T23:40:31.567484+0000","last_became_peered":"2024-04-26T23:40:31.567484+0000","last_unstale":"2024-04-26T23:49:36.399499+0000","last_undegraded":"2024-04-26T23:49:36.399499+0000","last_fullsized":"2024-04-26T23:49:36.399499+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:43:13.740214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":12305,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"26'3282","reported_seq":3309,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.939435+0000","last_change":"2024-04-26T23:40:32.594689+0000","last_active":"2024-04-26T23:49:42.939435+0000","last_peered":"2024-04-26T23:49:42.939435+0000","last_clean":"2024-04-26T23:49:42.939435+0000","last_became_active":"2024-04-26T23:40:32.592365+0000","last_became_peered":"2024-04-26T23:40:32.592365+0000","last_unstale":"2024-04-26T23:49:42.939435+0000","last_undegraded":"2024-04-26T23:49:42.939435+0000","last_fullsized":"2024-04-26T23:49:42.939435+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":3282,"log_dups_size":0,"ondisk_log_size":3282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:17:46.135806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49199,"num_write_kb":619171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"26'14","reported_seq":35,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:48:17.852707+0000","last_change":"2024-04-26T23:40:40.676028+0000","last_active":"2024-04-26T23:48:17.852707+0000","last_peered":"2024-04-26T23:48:17.852707+0000","last_clean":"2024-04-26T23:48:17.852707+0000","last_became_active":"2024-04-26T23:40:40.675736+0000","last_became_peered":"2024-04-26T23:40:40.675736+0000","last_unstale":"2024-04-26T23:48:17.852707+0000","last_undegraded":"2024-04-26T23:48:17.852707+0000","last_fullsized":"2024-04-26T23:48:17.852707+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:51:38.770953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":4102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"26'3294","reported_seq":3313,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:30.269215+0000","last_change":"2024-04-26T23:40:41.690148+0000","last_active":"2024-04-26T23:49:30.269215+0000","last_peered":"2024-04-26T23:49:30.269215+0000","last_clean":"2024-04-26T23:49:30.269215+0000","last_became_active":"2024-04-26T23:40:41.689765+0000","last_became_peered":"2024-04-26T23:40:41.689765+0000","last_unstale":"2024-04-26T23:49:30.269215+0000","last_undegraded":"2024-04-26T23:49:30.269215+0000","last_fullsized":"2024-04-26T23:49:30.269215+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":3294,"log_dups_size":0,"ondisk_log_size":3294,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:33:16.389626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49600,"num_write_kb":609763,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"26'1221","reported_seq":1250,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:48:05.908044+0000","last_change":"2024-04-26T23:40:31.576749+0000","last_active":"2024-04-26T23:48:05.908044+0000","last_peered":"2024-04-26T23:48:05.908044+0000","last_clean":"2024-04-26T23:48:05.908044+0000","last_became_active":"2024-04-26T23:40:31.576178+0000","last_became_peered":"2024-04-26T23:40:31.576178+0000","last_unstale":"2024-04-26T23:48:05.908044+0000","last_undegraded":"2024-04-26T23:48:05.908044+0000","last_fullsized":"2024-04-26T23:48:05.908044+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":1221,"log_dups_size":0,"ondisk_log_size":1221,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:15:30.884135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1219,"num_write_kb":5208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"26'3626","reported_seq":3653,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.865111+0000","last_change":"2024-04-26T23:40:32.589208+0000","last_active":"2024-04-26T23:49:42.865111+0000","last_peered":"2024-04-26T23:49:42.865111+0000","last_clean":"2024-04-26T23:49:42.865111+0000","last_became_active":"2024-04-26T23:40:32.588927+0000","last_became_peered":"2024-04-26T23:40:32.588927+0000","last_unstale":"2024-04-26T23:49:42.865111+0000","last_undegraded":"2024-04-26T23:49:42.865111+0000","last_fullsized":"2024-04-26T23:49:42.865111+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":3626,"log_dups_size":0,"ondisk_log_size":3626,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:45:50.299583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":54465,"num_write_kb":670678,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"26'32","reported_seq":53,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:30.332987+0000","last_change":"2024-04-26T23:40:40.676809+0000","last_active":"2024-04-26T23:49:30.332987+0000","last_peered":"2024-04-26T23:49:30.332987+0000","last_clean":"2024-04-26T23:49:30.332987+0000","last_became_active":"2024-04-26T23:40:40.676070+0000","last_became_peered":"2024-04-26T23:40:40.676070+0000","last_unstale":"2024-04-26T23:49:30.332987+0000","last_undegraded":"2024-04-26T23:49:30.332987+0000","last_fullsized":"2024-04-26T23:49:30.332987+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:17:27.667323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":12296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.26","version":"26'3995","reported_seq":4015,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:30.333672+0000","last_change":"2024-04-26T23:40:41.679796+0000","last_active":"2024-04-26T23:49:30.333672+0000","last_peered":"2024-04-26T23:49:30.333672+0000","last_clean":"2024-04-26T23:49:30.333672+0000","last_became_active":"2024-04-26T23:40:41.679523+0000","last_became_peered":"2024-04-26T23:40:41.679523+0000","last_unstale":"2024-04-26T23:49:30.333672+0000","last_undegraded":"2024-04-26T23:49:30.333672+0000","last_fullsized":"2024-04-26T23:49:30.333672+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":3995,"log_dups_size":0,"ondisk_log_size":3995,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:43:02.137315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":60148,"num_write_kb":773318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"26'5261","reported_seq":5289,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.924918+0000","last_change":"2024-04-26T23:40:32.586672+0000","last_active":"2024-04-26T23:49:42.924918+0000","last_peered":"2024-04-26T23:49:42.924918+0000","last_clean":"2024-04-26T23:49:42.924918+0000","last_became_active":"2024-04-26T23:40:32.586399+0000","last_became_peered":"2024-04-26T23:40:32.586399+0000","last_unstale":"2024-04-26T23:49:42.924918+0000","last_undegraded":"2024-04-26T23:49:42.924918+0000","last_fullsized":"2024-04-26T23:49:42.924918+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":5261,"log_dups_size":0,"ondisk_log_size":5261,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:15:01.970308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":78910,"num_write_kb":993537,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.27","version":"26'5342","reported_seq":5362,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:32.336840+0000","last_change":"2024-04-26T23:40:41.687529+0000","last_active":"2024-04-26T23:49:32.336840+0000","last_peered":"2024-04-26T23:49:32.336840+0000","last_clean":"2024-04-26T23:49:32.336840+0000","last_became_active":"2024-04-26T23:40:41.686974+0000","last_became_peered":"2024-04-26T23:40:41.686974+0000","last_unstale":"2024-04-26T23:49:32.336840+0000","last_undegraded":"2024-04-26T23:49:32.336840+0000","last_fullsized":"2024-04-26T23:49:32.336840+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":5342,"log_dups_size":0,"ondisk_log_size":5342,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:21:56.950703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":80446,"num_write_kb":1002267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"26'4431","reported_seq":4459,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.901911+0000","last_change":"2024-04-26T23:40:32.584590+0000","last_active":"2024-04-26T23:49:42.901911+0000","last_peered":"2024-04-26T23:49:42.901911+0000","last_clean":"2024-04-26T23:49:42.901911+0000","last_became_active":"2024-04-26T23:40:32.584234+0000","last_became_peered":"2024-04-26T23:40:32.584234+0000","last_unstale":"2024-04-26T23:49:42.901911+0000","last_undegraded":"2024-04-26T23:49:42.901911+0000","last_fullsized":"2024-04-26T23:49:42.901911+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":4431,"log_dups_size":0,"ondisk_log_size":4431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:15:52.942160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":66416,"num_write_kb":857324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.24","version":"26'4128","reported_seq":4148,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:30.314565+0000","last_change":"2024-04-26T23:40:41.679549+0000","last_active":"2024-04-26T23:49:30.314565+0000","last_peered":"2024-04-26T23:49:30.314565+0000","last_clean":"2024-04-26T23:49:30.314565+0000","last_became_active":"2024-04-26T23:40:41.679254+0000","last_became_peered":"2024-04-26T23:40:41.679254+0000","last_unstale":"2024-04-26T23:49:30.314565+0000","last_undegraded":"2024-04-26T23:49:30.314565+0000","last_fullsized":"2024-04-26T23:49:30.314565+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":4128,"log_dups_size":0,"ondisk_log_size":4128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:48:09.126894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":62260,"num_write_kb":792966,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"26'5012","reported_seq":5040,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:36.372170+0000","last_change":"2024-04-26T23:40:32.580453+0000","last_active":"2024-04-26T23:49:36.372170+0000","last_peered":"2024-04-26T23:49:36.372170+0000","last_clean":"2024-04-26T23:49:36.372170+0000","last_became_active":"2024-04-26T23:40:32.580196+0000","last_became_peered":"2024-04-26T23:40:32.580196+0000","last_unstale":"2024-04-26T23:49:36.372170+0000","last_undegraded":"2024-04-26T23:49:36.372170+0000","last_fullsized":"2024-04-26T23:49:36.372170+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":5012,"log_dups_size":0,"ondisk_log_size":5012,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:18:09.706875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":75519,"num_write_kb":963103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.25","version":"26'4758","reported_seq":4778,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:30.266028+0000","last_change":"2024-04-26T23:40:41.690579+0000","last_active":"2024-04-26T23:49:30.266028+0000","last_peered":"2024-04-26T23:49:30.266028+0000","last_clean":"2024-04-26T23:49:30.266028+0000","last_became_active":"2024-04-26T23:40:41.690262+0000","last_became_peered":"2024-04-26T23:40:41.690262+0000","last_unstale":"2024-04-26T23:49:30.266028+0000","last_undegraded":"2024-04-26T23:49:30.266028+0000","last_fullsized":"2024-04-26T23:49:30.266028+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":4758,"log_dups_size":0,"ondisk_log_size":4758,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:10:30.972726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":71706,"num_write_kb":928511,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"26'3562","reported_seq":3595,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.923518+0000","last_change":"2024-04-26T23:41:30.513890+0000","last_active":"2024-04-26T23:49:42.923518+0000","last_peered":"2024-04-26T23:49:42.923518+0000","last_clean":"2024-04-26T23:49:42.923518+0000","last_became_active":"2024-04-26T23:41:30.513571+0000","last_became_peered":"2024-04-26T23:41:30.513571+0000","last_unstale":"2024-04-26T23:49:42.923518+0000","last_undegraded":"2024-04-26T23:49:42.923518+0000","last_fullsized":"2024-04-26T23:49:42.923518+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":3562,"log_dups_size":0,"ondisk_log_size":3562,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:42:04.655425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53479,"num_write_kb":687907,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.22","version":"26'5430","reported_seq":5450,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:30.293286+0000","last_change":"2024-04-26T23:40:41.677679+0000","last_active":"2024-04-26T23:49:30.293286+0000","last_peered":"2024-04-26T23:49:30.293286+0000","last_clean":"2024-04-26T23:49:30.293286+0000","last_became_active":"2024-04-26T23:40:41.677398+0000","last_became_peered":"2024-04-26T23:40:41.677398+0000","last_unstale":"2024-04-26T23:49:30.293286+0000","last_undegraded":"2024-04-26T23:49:30.293286+0000","last_fullsized":"2024-04-26T23:49:30.293286+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":5430,"log_dups_size":0,"ondisk_log_size":5430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:42:13.754586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":81903,"num_write_kb":1031435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.24","version":"26'3686","reported_seq":3714,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:36.391458+0000","last_change":"2024-04-26T23:40:32.587921+0000","last_active":"2024-04-26T23:49:36.391458+0000","last_peered":"2024-04-26T23:49:36.391458+0000","last_clean":"2024-04-26T23:49:36.391458+0000","last_became_active":"2024-04-26T23:40:32.587630+0000","last_became_peered":"2024-04-26T23:40:32.587630+0000","last_unstale":"2024-04-26T23:49:36.391458+0000","last_undegraded":"2024-04-26T23:49:36.391458+0000","last_fullsized":"2024-04-26T23:49:36.391458+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":3686,"log_dups_size":0,"ondisk_log_size":3686,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:01:02.741964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55280,"num_write_kb":715530,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.23","version":"26'3835","reported_seq":3855,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:30.335543+0000","last_change":"2024-04-26T23:40:41.690235+0000","last_active":"2024-04-26T23:49:30.335543+0000","last_peered":"2024-04-26T23:49:30.335543+0000","last_clean":"2024-04-26T23:49:30.335543+0000","last_became_active":"2024-04-26T23:40:41.689911+0000","last_became_peered":"2024-04-26T23:40:41.689911+0000","last_unstale":"2024-04-26T23:49:30.335543+0000","last_undegraded":"2024-04-26T23:49:30.335543+0000","last_fullsized":"2024-04-26T23:49:30.335543+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":3835,"log_dups_size":0,"ondisk_log_size":3835,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:21:56.950703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":57757,"num_write_kb":753623,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"26'4510","reported_seq":4538,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:36.340926+0000","last_change":"2024-04-26T23:40:32.583376+0000","last_active":"2024-04-26T23:49:36.340926+0000","last_peered":"2024-04-26T23:49:36.340926+0000","last_clean":"2024-04-26T23:49:36.340926+0000","last_became_active":"2024-04-26T23:40:32.583089+0000","last_became_peered":"2024-04-26T23:40:32.583089+0000","last_unstale":"2024-04-26T23:49:36.340926+0000","last_undegraded":"2024-04-26T23:49:36.340926+0000","last_fullsized":"2024-04-26T23:49:36.340926+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":4510,"log_dups_size":0,"ondisk_log_size":4510,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:17:46.135806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":67860,"num_write_kb":874899,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.20","version":"26'5603","reported_seq":5623,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:30.329561+0000","last_change":"2024-04-26T23:40:41.688464+0000","last_active":"2024-04-26T23:49:30.329561+0000","last_peered":"2024-04-26T23:49:30.329561+0000","last_clean":"2024-04-26T23:49:30.329561+0000","last_became_active":"2024-04-26T23:40:41.688028+0000","last_became_peered":"2024-04-26T23:40:41.688028+0000","last_unstale":"2024-04-26T23:49:30.329561+0000","last_undegraded":"2024-04-26T23:49:30.329561+0000","last_fullsized":"2024-04-26T23:49:30.329561+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":5603,"log_dups_size":0,"ondisk_log_size":5603,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:21:56.950703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":84399,"num_write_kb":1068733,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.26","version":"26'3757","reported_seq":3785,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.964764+0000","last_change":"2024-04-26T23:40:32.589080+0000","last_active":"2024-04-26T23:49:42.964764+0000","last_peered":"2024-04-26T23:49:42.964764+0000","last_clean":"2024-04-26T23:49:42.964764+0000","last_became_active":"2024-04-26T23:40:32.588793+0000","last_became_peered":"2024-04-26T23:40:32.588793+0000","last_unstale":"2024-04-26T23:49:42.964764+0000","last_undegraded":"2024-04-26T23:49:42.964764+0000","last_fullsized":"2024-04-26T23:49:42.964764+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":3757,"log_dups_size":0,"ondisk_log_size":3757,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:18:09.706875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":56209,"num_write_kb":727106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.21","version":"26'4815","reported_seq":4835,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:30.212082+0000","last_change":"2024-04-26T23:40:41.688445+0000","last_active":"2024-04-26T23:49:30.212082+0000","last_peered":"2024-04-26T23:49:30.212082+0000","last_clean":"2024-04-26T23:49:30.212082+0000","last_became_active":"2024-04-26T23:40:41.688163+0000","last_became_peered":"2024-04-26T23:40:41.688163+0000","last_unstale":"2024-04-26T23:49:30.212082+0000","last_undegraded":"2024-04-26T23:49:30.212082+0000","last_fullsized":"2024-04-26T23:49:30.212082+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":4815,"log_dups_size":0,"ondisk_log_size":4815,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:30:04.999018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":72614,"num_write_kb":926316,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"26'4895","reported_seq":4923,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:36.418850+0000","last_change":"2024-04-26T23:40:32.588177+0000","last_active":"2024-04-26T23:49:36.418850+0000","last_peered":"2024-04-26T23:49:36.418850+0000","last_clean":"2024-04-26T23:49:36.418850+0000","last_became_active":"2024-04-26T23:40:32.586926+0000","last_became_peered":"2024-04-26T23:40:32.586926+0000","last_unstale":"2024-04-26T23:49:36.418850+0000","last_undegraded":"2024-04-26T23:49:36.418850+0000","last_fullsized":"2024-04-26T23:49:36.418850+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":4895,"log_dups_size":0,"ondisk_log_size":4895,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:34:14.811917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":73419,"num_write_kb":930971,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2e","version":"26'3617","reported_seq":3636,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:32.348057+0000","last_change":"2024-04-26T23:40:41.688396+0000","last_active":"2024-04-26T23:49:32.348057+0000","last_peered":"2024-04-26T23:49:32.348057+0000","last_clean":"2024-04-26T23:49:32.348057+0000","last_became_active":"2024-04-26T23:40:41.688087+0000","last_became_peered":"2024-04-26T23:40:41.688087+0000","last_unstale":"2024-04-26T23:49:32.348057+0000","last_undegraded":"2024-04-26T23:49:32.348057+0000","last_fullsized":"2024-04-26T23:49:32.348057+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":3617,"log_dups_size":0,"ondisk_log_size":3617,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:00:49.397610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":54377,"num_write_kb":682463,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"26'3679","reported_seq":3707,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:36.424832+0000","last_change":"2024-04-26T23:40:32.582959+0000","last_active":"2024-04-26T23:49:36.424832+0000","last_peered":"2024-04-26T23:49:36.424832+0000","last_clean":"2024-04-26T23:49:36.424832+0000","last_became_active":"2024-04-26T23:40:32.582100+0000","last_became_peered":"2024-04-26T23:40:32.582100+0000","last_unstale":"2024-04-26T23:49:36.424832+0000","last_undegraded":"2024-04-26T23:49:36.424832+0000","last_fullsized":"2024-04-26T23:49:36.424832+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":3679,"log_dups_size":0,"ondisk_log_size":3679,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:37:30.361795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55124,"num_write_kb":707502,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2f","version":"26'5393","reported_seq":5412,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:30.296296+0000","last_change":"2024-04-26T23:40:41.681088+0000","last_active":"2024-04-26T23:49:30.296296+0000","last_peered":"2024-04-26T23:49:30.296296+0000","last_clean":"2024-04-26T23:49:30.296296+0000","last_became_active":"2024-04-26T23:40:41.680581+0000","last_became_peered":"2024-04-26T23:40:41.680581+0000","last_unstale":"2024-04-26T23:49:30.296296+0000","last_undegraded":"2024-04-26T23:49:30.296296+0000","last_fullsized":"2024-04-26T23:49:30.296296+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":5393,"log_dups_size":0,"ondisk_log_size":5393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:41:52.386084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":81323,"num_write_kb":1040915,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.29","version":"26'4127","reported_seq":4155,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:36.289955+0000","last_change":"2024-04-26T23:40:32.593958+0000","last_active":"2024-04-26T23:49:36.289955+0000","last_peered":"2024-04-26T23:49:36.289955+0000","last_clean":"2024-04-26T23:49:36.289955+0000","last_became_active":"2024-04-26T23:40:32.593639+0000","last_became_peered":"2024-04-26T23:40:32.593639+0000","last_unstale":"2024-04-26T23:49:36.289955+0000","last_undegraded":"2024-04-26T23:49:36.289955+0000","last_fullsized":"2024-04-26T23:49:36.289955+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":4127,"log_dups_size":0,"ondisk_log_size":4127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:17:46.135806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":62129,"num_write_kb":797085,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"26'4458","reported_seq":4477,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:32.334321+0000","last_change":"2024-04-26T23:40:41.674573+0000","last_active":"2024-04-26T23:49:32.334321+0000","last_peered":"2024-04-26T23:49:32.334321+0000","last_clean":"2024-04-26T23:49:32.334321+0000","last_became_active":"2024-04-26T23:40:41.674274+0000","last_became_peered":"2024-04-26T23:40:41.674274+0000","last_unstale":"2024-04-26T23:49:32.334321+0000","last_undegraded":"2024-04-26T23:49:32.334321+0000","last_fullsized":"2024-04-26T23:49:32.334321+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":4458,"log_dups_size":0,"ondisk_log_size":4458,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:37:39.460955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":67376,"num_write_kb":867303,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"26'4502","reported_seq":4530,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:36.400068+0000","last_change":"2024-04-26T23:40:32.591700+0000","last_active":"2024-04-26T23:49:36.400068+0000","last_peered":"2024-04-26T23:49:36.400068+0000","last_clean":"2024-04-26T23:49:36.400068+0000","last_became_active":"2024-04-26T23:40:32.591366+0000","last_became_peered":"2024-04-26T23:40:32.591366+0000","last_unstale":"2024-04-26T23:49:36.400068+0000","last_undegraded":"2024-04-26T23:49:36.400068+0000","last_fullsized":"2024-04-26T23:49:36.400068+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":4502,"log_dups_size":0,"ondisk_log_size":4502,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:10:02.629199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":67679,"num_write_kb":882467,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2d","version":"26'4489","reported_seq":4508,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:32.352572+0000","last_change":"2024-04-26T23:40:41.692402+0000","last_active":"2024-04-26T23:49:32.352572+0000","last_peered":"2024-04-26T23:49:32.352572+0000","last_clean":"2024-04-26T23:49:32.352572+0000","last_became_active":"2024-04-26T23:40:41.692122+0000","last_became_peered":"2024-04-26T23:40:41.692122+0000","last_unstale":"2024-04-26T23:49:32.352572+0000","last_undegraded":"2024-04-26T23:49:32.352572+0000","last_fullsized":"2024-04-26T23:49:32.352572+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":4489,"log_dups_size":0,"ondisk_log_size":4489,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:06:12.755431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":67600,"num_write_kb":861109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2b","version":"26'4261","reported_seq":4289,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.949551+0000","last_change":"2024-04-26T23:40:32.590443+0000","last_active":"2024-04-26T23:49:42.949551+0000","last_peered":"2024-04-26T23:49:42.949551+0000","last_clean":"2024-04-26T23:49:42.949551+0000","last_became_active":"2024-04-26T23:40:32.590193+0000","last_became_peered":"2024-04-26T23:40:32.590193+0000","last_unstale":"2024-04-26T23:49:42.949551+0000","last_undegraded":"2024-04-26T23:49:42.949551+0000","last_fullsized":"2024-04-26T23:49:42.949551+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":4261,"log_dups_size":0,"ondisk_log_size":4261,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:14:04.372681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":63685,"num_write_kb":822261,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2a","version":"26'4995","reported_seq":5015,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:32.335489+0000","last_change":"2024-04-26T23:40:41.692194+0000","last_active":"2024-04-26T23:49:32.335489+0000","last_peered":"2024-04-26T23:49:32.335489+0000","last_clean":"2024-04-26T23:49:32.335489+0000","last_became_active":"2024-04-26T23:40:41.691837+0000","last_became_peered":"2024-04-26T23:40:41.691837+0000","last_unstale":"2024-04-26T23:49:32.335489+0000","last_undegraded":"2024-04-26T23:49:32.335489+0000","last_fullsized":"2024-04-26T23:49:32.335489+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":4995,"log_dups_size":0,"ondisk_log_size":4995,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:58:45.972045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":75356,"num_write_kb":950203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"26'4090","reported_seq":4118,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.876315+0000","last_change":"2024-04-26T23:40:32.590538+0000","last_active":"2024-04-26T23:49:42.876315+0000","last_peered":"2024-04-26T23:49:42.876315+0000","last_clean":"2024-04-26T23:49:42.876315+0000","last_became_active":"2024-04-26T23:40:32.590241+0000","last_became_peered":"2024-04-26T23:40:32.590241+0000","last_unstale":"2024-04-26T23:49:42.876315+0000","last_undegraded":"2024-04-26T23:49:42.876315+0000","last_fullsized":"2024-04-26T23:49:42.876315+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":4090,"log_dups_size":0,"ondisk_log_size":4090,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:38:10.884592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":61267,"num_write_kb":785631,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"26'4580","reported_seq":4599,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:32.335187+0000","last_change":"2024-04-26T23:40:41.689529+0000","last_active":"2024-04-26T23:49:32.335187+0000","last_peered":"2024-04-26T23:49:32.335187+0000","last_clean":"2024-04-26T23:49:32.335187+0000","last_became_active":"2024-04-26T23:40:41.689215+0000","last_became_peered":"2024-04-26T23:40:41.689215+0000","last_unstale":"2024-04-26T23:49:32.335187+0000","last_undegraded":"2024-04-26T23:49:32.335187+0000","last_fullsized":"2024-04-26T23:49:32.335187+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":4580,"log_dups_size":0,"ondisk_log_size":4580,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:38:42.155257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":68781,"num_write_kb":892789,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2d","version":"26'4171","reported_seq":4199,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.943207+0000","last_change":"2024-04-26T23:40:32.588445+0000","last_active":"2024-04-26T23:49:42.943207+0000","last_peered":"2024-04-26T23:49:42.943207+0000","last_clean":"2024-04-26T23:49:42.943207+0000","last_became_active":"2024-04-26T23:40:32.588063+0000","last_became_peered":"2024-04-26T23:40:32.588063+0000","last_unstale":"2024-04-26T23:49:42.943207+0000","last_undegraded":"2024-04-26T23:49:42.943207+0000","last_fullsized":"2024-04-26T23:49:42.943207+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":4171,"log_dups_size":0,"ondisk_log_size":4171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:44:58.977344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":62428,"num_write_kb":793377,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.28","version":"26'4022","reported_seq":4042,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:32.335817+0000","last_change":"2024-04-26T23:40:41.674893+0000","last_active":"2024-04-26T23:49:32.335817+0000","last_peered":"2024-04-26T23:49:32.335817+0000","last_clean":"2024-04-26T23:49:32.335817+0000","last_became_active":"2024-04-26T23:40:41.674573+0000","last_became_peered":"2024-04-26T23:40:41.674573+0000","last_unstale":"2024-04-26T23:49:32.335817+0000","last_undegraded":"2024-04-26T23:49:32.335817+0000","last_fullsized":"2024-04-26T23:49:32.335817+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":4022,"log_dups_size":0,"ondisk_log_size":4022,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:36:21.487122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":60451,"num_write_kb":760274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"26'3337","reported_seq":3365,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.873346+0000","last_change":"2024-04-26T23:40:32.574795+0000","last_active":"2024-04-26T23:49:42.873346+0000","last_peered":"2024-04-26T23:49:42.873346+0000","last_clean":"2024-04-26T23:49:42.873346+0000","last_became_active":"2024-04-26T23:40:32.574503+0000","last_became_peered":"2024-04-26T23:40:32.574503+0000","last_unstale":"2024-04-26T23:49:42.873346+0000","last_undegraded":"2024-04-26T23:49:42.873346+0000","last_fullsized":"2024-04-26T23:49:42.873346+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":3337,"log_dups_size":0,"ondisk_log_size":3337,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:30:11.401955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49634,"num_write_kb":627043,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.29","version":"26'4402","reported_seq":4422,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:32.356793+0000","last_change":"2024-04-26T23:40:41.680247+0000","last_active":"2024-04-26T23:49:32.356793+0000","last_peered":"2024-04-26T23:49:32.356793+0000","last_clean":"2024-04-26T23:49:32.356793+0000","last_became_active":"2024-04-26T23:40:41.679920+0000","last_became_peered":"2024-04-26T23:40:41.679920+0000","last_unstale":"2024-04-26T23:49:32.356793+0000","last_undegraded":"2024-04-26T23:49:32.356793+0000","last_fullsized":"2024-04-26T23:49:32.356793+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":4402,"log_dups_size":0,"ondisk_log_size":4402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:53:13.531466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":66255,"num_write_kb":845549,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2f","version":"26'5159","reported_seq":5186,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:36.383654+0000","last_change":"2024-04-26T23:40:32.593432+0000","last_active":"2024-04-26T23:49:36.383654+0000","last_peered":"2024-04-26T23:49:36.383654+0000","last_clean":"2024-04-26T23:49:36.383654+0000","last_became_active":"2024-04-26T23:40:32.593169+0000","last_became_peered":"2024-04-26T23:40:32.593169+0000","last_unstale":"2024-04-26T23:49:36.383654+0000","last_undegraded":"2024-04-26T23:49:36.383654+0000","last_fullsized":"2024-04-26T23:49:36.383654+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":5159,"log_dups_size":0,"ondisk_log_size":5159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:44:42.494850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":77406,"num_write_kb":981579,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.36","version":"26'5039","reported_seq":5058,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:30.332524+0000","last_change":"2024-04-26T23:40:41.694551+0000","last_active":"2024-04-26T23:49:30.332524+0000","last_peered":"2024-04-26T23:49:30.332524+0000","last_clean":"2024-04-26T23:49:30.332524+0000","last_became_active":"2024-04-26T23:40:41.694297+0000","last_became_peered":"2024-04-26T23:40:41.694297+0000","last_unstale":"2024-04-26T23:49:30.332524+0000","last_undegraded":"2024-04-26T23:49:30.332524+0000","last_fullsized":"2024-04-26T23:49:30.332524+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":5039,"log_dups_size":0,"ondisk_log_size":5039,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:02:27.160408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":75865,"num_write_kb":998838,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"26'3713","reported_seq":3740,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:36.381382+0000","last_change":"2024-04-26T23:40:32.585137+0000","last_active":"2024-04-26T23:49:36.381382+0000","last_peered":"2024-04-26T23:49:36.381382+0000","last_clean":"2024-04-26T23:49:36.381382+0000","last_became_active":"2024-04-26T23:40:32.584678+0000","last_became_peered":"2024-04-26T23:40:32.584678+0000","last_unstale":"2024-04-26T23:49:36.381382+0000","last_undegraded":"2024-04-26T23:49:36.381382+0000","last_fullsized":"2024-04-26T23:49:36.381382+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":3713,"log_dups_size":0,"ondisk_log_size":3713,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:04:30.553552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55693,"num_write_kb":722935,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.37","version":"26'5530","reported_seq":5549,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:30.272220+0000","last_change":"2024-04-26T23:40:41.692433+0000","last_active":"2024-04-26T23:49:30.272220+0000","last_peered":"2024-04-26T23:49:30.272220+0000","last_clean":"2024-04-26T23:49:30.272220+0000","last_became_active":"2024-04-26T23:40:41.692090+0000","last_became_peered":"2024-04-26T23:40:41.692090+0000","last_unstale":"2024-04-26T23:49:30.272220+0000","last_undegraded":"2024-04-26T23:49:30.272220+0000","last_fullsized":"2024-04-26T23:49:30.272220+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":5530,"log_dups_size":0,"ondisk_log_size":5530,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:37:25.006229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":83365,"num_write_kb":1062103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"26'4283","reported_seq":4310,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:36.410456+0000","last_change":"2024-04-26T23:40:32.590452+0000","last_active":"2024-04-26T23:49:36.410456+0000","last_peered":"2024-04-26T23:49:36.410456+0000","last_clean":"2024-04-26T23:49:36.410456+0000","last_became_active":"2024-04-26T23:40:32.590162+0000","last_became_peered":"2024-04-26T23:40:32.590162+0000","last_unstale":"2024-04-26T23:49:36.410456+0000","last_undegraded":"2024-04-26T23:49:36.410456+0000","last_fullsized":"2024-04-26T23:49:36.410456+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":4283,"log_dups_size":0,"ondisk_log_size":4283,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:51:30.677247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":64302,"num_write_kb":811481,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.34","version":"26'3752","reported_seq":3771,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:30.302344+0000","last_change":"2024-04-26T23:40:41.687270+0000","last_active":"2024-04-26T23:49:30.302344+0000","last_peered":"2024-04-26T23:49:30.302344+0000","last_clean":"2024-04-26T23:49:30.302344+0000","last_became_active":"2024-04-26T23:40:41.686999+0000","last_became_peered":"2024-04-26T23:40:41.686999+0000","last_unstale":"2024-04-26T23:49:30.302344+0000","last_undegraded":"2024-04-26T23:49:30.302344+0000","last_fullsized":"2024-04-26T23:49:30.302344+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":3752,"log_dups_size":0,"ondisk_log_size":3752,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:21:42.565349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":56674,"num_write_kb":713071,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"26'4299","reported_seq":4326,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.893101+0000","last_change":"2024-04-26T23:40:32.586436+0000","last_active":"2024-04-26T23:49:42.893101+0000","last_peered":"2024-04-26T23:49:42.893101+0000","last_clean":"2024-04-26T23:49:42.893101+0000","last_became_active":"2024-04-26T23:40:32.585995+0000","last_became_peered":"2024-04-26T23:40:32.585995+0000","last_unstale":"2024-04-26T23:49:42.893101+0000","last_undegraded":"2024-04-26T23:49:42.893101+0000","last_fullsized":"2024-04-26T23:49:42.893101+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":4299,"log_dups_size":0,"ondisk_log_size":4299,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:10:42.603833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":64455,"num_write_kb":829744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.35","version":"26'4326","reported_seq":4345,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:30.253006+0000","last_change":"2024-04-26T23:40:41.691693+0000","last_active":"2024-04-26T23:49:30.253006+0000","last_peered":"2024-04-26T23:49:30.253006+0000","last_clean":"2024-04-26T23:49:30.253006+0000","last_became_active":"2024-04-26T23:40:41.691437+0000","last_became_peered":"2024-04-26T23:40:41.691437+0000","last_unstale":"2024-04-26T23:49:30.253006+0000","last_undegraded":"2024-04-26T23:49:30.253006+0000","last_fullsized":"2024-04-26T23:49:30.253006+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":4326,"log_dups_size":0,"ondisk_log_size":4326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:06:12.755431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":65307,"num_write_kb":818233,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.33","version":"26'3776","reported_seq":3803,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:36.425553+0000","last_change":"2024-04-26T23:40:32.592988+0000","last_active":"2024-04-26T23:49:36.425553+0000","last_peered":"2024-04-26T23:49:36.425553+0000","last_clean":"2024-04-26T23:49:36.425553+0000","last_became_active":"2024-04-26T23:40:32.592717+0000","last_became_peered":"2024-04-26T23:40:32.592717+0000","last_unstale":"2024-04-26T23:49:36.425553+0000","last_undegraded":"2024-04-26T23:49:36.425553+0000","last_fullsized":"2024-04-26T23:49:36.425553+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":3776,"log_dups_size":0,"ondisk_log_size":3776,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:18:09.706875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":56607,"num_write_kb":740250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.32","version":"26'4725","reported_seq":4744,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:30.304871+0000","last_change":"2024-04-26T23:40:41.675335+0000","last_active":"2024-04-26T23:49:30.304871+0000","last_peered":"2024-04-26T23:49:30.304871+0000","last_clean":"2024-04-26T23:49:30.304871+0000","last_became_active":"2024-04-26T23:40:41.675042+0000","last_became_peered":"2024-04-26T23:40:41.675042+0000","last_unstale":"2024-04-26T23:49:30.304871+0000","last_undegraded":"2024-04-26T23:49:30.304871+0000","last_fullsized":"2024-04-26T23:49:30.304871+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":4725,"log_dups_size":0,"ondisk_log_size":4725,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:41:52.386084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":71116,"num_write_kb":894316,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"26'3513","reported_seq":3540,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.972217+0000","last_change":"2024-04-26T23:40:32.595129+0000","last_active":"2024-04-26T23:49:42.972217+0000","last_peered":"2024-04-26T23:49:42.972217+0000","last_clean":"2024-04-26T23:49:42.972217+0000","last_became_active":"2024-04-26T23:40:32.594802+0000","last_became_peered":"2024-04-26T23:40:32.594802+0000","last_unstale":"2024-04-26T23:49:42.972217+0000","last_undegraded":"2024-04-26T23:49:42.972217+0000","last_fullsized":"2024-04-26T23:49:42.972217+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":3513,"log_dups_size":0,"ondisk_log_size":3513,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:48:33.020039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":52734,"num_write_kb":670887,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.33","version":"26'4035","reported_seq":4054,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:32.342105+0000","last_change":"2024-04-26T23:40:41.691159+0000","last_active":"2024-04-26T23:49:32.342105+0000","last_peered":"2024-04-26T23:49:32.342105+0000","last_clean":"2024-04-26T23:49:32.342105+0000","last_became_active":"2024-04-26T23:40:41.690846+0000","last_became_peered":"2024-04-26T23:40:41.690846+0000","last_unstale":"2024-04-26T23:49:32.342105+0000","last_undegraded":"2024-04-26T23:49:32.342105+0000","last_fullsized":"2024-04-26T23:49:32.342105+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":4035,"log_dups_size":0,"ondisk_log_size":4035,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:45:08.076505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":60666,"num_write_kb":797602,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.35","version":"26'4035","reported_seq":4062,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.914117+0000","last_change":"2024-04-26T23:40:32.578819+0000","last_active":"2024-04-26T23:49:42.914117+0000","last_peered":"2024-04-26T23:49:42.914117+0000","last_clean":"2024-04-26T23:49:42.914117+0000","last_became_active":"2024-04-26T23:40:32.578556+0000","last_became_peered":"2024-04-26T23:40:32.578556+0000","last_unstale":"2024-04-26T23:49:42.914117+0000","last_undegraded":"2024-04-26T23:49:42.914117+0000","last_fullsized":"2024-04-26T23:49:42.914117+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":4035,"log_dups_size":0,"ondisk_log_size":4035,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:17:46.135806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":60570,"num_write_kb":769077,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.30","version":"26'3960","reported_seq":3979,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:30.310152+0000","last_change":"2024-04-26T23:40:41.689812+0000","last_active":"2024-04-26T23:49:30.310152+0000","last_peered":"2024-04-26T23:49:30.310152+0000","last_clean":"2024-04-26T23:49:30.310152+0000","last_became_active":"2024-04-26T23:40:41.689267+0000","last_became_peered":"2024-04-26T23:40:41.689267+0000","last_unstale":"2024-04-26T23:49:30.310152+0000","last_undegraded":"2024-04-26T23:49:30.310152+0000","last_fullsized":"2024-04-26T23:49:30.310152+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":3960,"log_dups_size":0,"ondisk_log_size":3960,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:21:42.565349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":59630,"num_write_kb":775739,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"26'4731","reported_seq":4758,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.972370+0000","last_change":"2024-04-26T23:40:32.578155+0000","last_active":"2024-04-26T23:49:42.972370+0000","last_peered":"2024-04-26T23:49:42.972370+0000","last_clean":"2024-04-26T23:49:42.972370+0000","last_became_active":"2024-04-26T23:40:32.577865+0000","last_became_peered":"2024-04-26T23:40:32.577865+0000","last_unstale":"2024-04-26T23:49:42.972370+0000","last_undegraded":"2024-04-26T23:49:42.972370+0000","last_fullsized":"2024-04-26T23:49:42.972370+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":4731,"log_dups_size":0,"ondisk_log_size":4731,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:40:17.167353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":70795,"num_write_kb":915734,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.31","version":"26'4435","reported_seq":4454,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:30.334396+0000","last_change":"2024-04-26T23:40:41.680962+0000","last_active":"2024-04-26T23:49:30.334396+0000","last_peered":"2024-04-26T23:49:30.334396+0000","last_clean":"2024-04-26T23:49:30.334396+0000","last_became_active":"2024-04-26T23:40:41.680676+0000","last_became_peered":"2024-04-26T23:40:41.680676+0000","last_unstale":"2024-04-26T23:49:30.334396+0000","last_undegraded":"2024-04-26T23:49:30.334396+0000","last_fullsized":"2024-04-26T23:49:30.334396+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":4435,"log_dups_size":0,"ondisk_log_size":4435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:42:13.754586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":66738,"num_write_kb":853261,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"26'4979","reported_seq":5006,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.990989+0000","last_change":"2024-04-26T23:40:32.591487+0000","last_active":"2024-04-26T23:49:42.990989+0000","last_peered":"2024-04-26T23:49:42.990989+0000","last_clean":"2024-04-26T23:49:42.990989+0000","last_became_active":"2024-04-26T23:40:32.591209+0000","last_became_peered":"2024-04-26T23:40:32.591209+0000","last_unstale":"2024-04-26T23:49:42.990989+0000","last_undegraded":"2024-04-26T23:49:42.990989+0000","last_fullsized":"2024-04-26T23:49:42.990989+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":4979,"log_dups_size":0,"ondisk_log_size":4979,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:52:26.699790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":74710,"num_write_kb":992211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3e","version":"26'5666","reported_seq":5686,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:32.348852+0000","last_change":"2024-04-26T23:40:41.686089+0000","last_active":"2024-04-26T23:49:32.348852+0000","last_peered":"2024-04-26T23:49:32.348852+0000","last_clean":"2024-04-26T23:49:32.348852+0000","last_became_active":"2024-04-26T23:40:41.685786+0000","last_became_peered":"2024-04-26T23:40:41.685786+0000","last_unstale":"2024-04-26T23:49:32.348852+0000","last_undegraded":"2024-04-26T23:49:32.348852+0000","last_fullsized":"2024-04-26T23:49:32.348852+0000","mapping_epoch":22,"log_start":"26'400","ondisk_log_start":"26'400","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":5266,"log_dups_size":0,"ondisk_log_size":5266,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:36:02.931532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":85672,"num_write_kb":1105852,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.38","version":"26'4528","reported_seq":4555,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:36.297642+0000","last_change":"2024-04-26T23:40:32.592543+0000","last_active":"2024-04-26T23:49:36.297642+0000","last_peered":"2024-04-26T23:49:36.297642+0000","last_clean":"2024-04-26T23:49:36.297642+0000","last_became_active":"2024-04-26T23:40:32.592282+0000","last_became_peered":"2024-04-26T23:40:32.592282+0000","last_unstale":"2024-04-26T23:49:36.297642+0000","last_undegraded":"2024-04-26T23:49:36.297642+0000","last_fullsized":"2024-04-26T23:49:36.297642+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":4528,"log_dups_size":0,"ondisk_log_size":4528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:16:46.547536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":68313,"num_write_kb":849602,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3f","version":"26'3830","reported_seq":3850,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:32.345828+0000","last_change":"2024-04-26T23:40:41.679306+0000","last_active":"2024-04-26T23:49:32.345828+0000","last_peered":"2024-04-26T23:49:32.345828+0000","last_clean":"2024-04-26T23:49:32.345828+0000","last_became_active":"2024-04-26T23:40:41.678926+0000","last_became_peered":"2024-04-26T23:40:41.678926+0000","last_unstale":"2024-04-26T23:49:32.345828+0000","last_undegraded":"2024-04-26T23:49:32.345828+0000","last_fullsized":"2024-04-26T23:49:32.345828+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":3830,"log_dups_size":0,"ondisk_log_size":3830,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:27:48.823509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":57629,"num_write_kb":750507,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.39","version":"26'4047","reported_seq":4060,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.888642+0000","last_change":"2024-04-26T23:41:30.373208+0000","last_active":"2024-04-26T23:49:42.888642+0000","last_peered":"2024-04-26T23:49:42.888642+0000","last_clean":"2024-04-26T23:49:42.888642+0000","last_became_active":"2024-04-26T23:41:30.372928+0000","last_became_peered":"2024-04-26T23:41:30.372928+0000","last_unstale":"2024-04-26T23:49:42.888642+0000","last_undegraded":"2024-04-26T23:49:42.888642+0000","last_fullsized":"2024-04-26T23:49:42.888642+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":4047,"log_dups_size":0,"ondisk_log_size":4047,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:21:47.851542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":60897,"num_write_kb":776135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3c","version":"26'4068","reported_seq":4088,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:29.935386+0000","last_change":"2024-04-26T23:40:41.689567+0000","last_active":"2024-04-26T23:49:29.935386+0000","last_peered":"2024-04-26T23:49:29.935386+0000","last_clean":"2024-04-26T23:49:29.935386+0000","last_became_active":"2024-04-26T23:40:41.688585+0000","last_became_peered":"2024-04-26T23:40:41.688585+0000","last_unstale":"2024-04-26T23:49:29.935386+0000","last_undegraded":"2024-04-26T23:49:29.935386+0000","last_fullsized":"2024-04-26T23:49:29.935386+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":4068,"log_dups_size":0,"ondisk_log_size":4068,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:10:57.826183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":61409,"num_write_kb":797665,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"26'3604","reported_seq":3631,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:36.319486+0000","last_change":"2024-04-26T23:40:32.584619+0000","last_active":"2024-04-26T23:49:36.319486+0000","last_peered":"2024-04-26T23:49:36.319486+0000","last_clean":"2024-04-26T23:49:36.319486+0000","last_became_active":"2024-04-26T23:40:32.584293+0000","last_became_peered":"2024-04-26T23:40:32.584293+0000","last_unstale":"2024-04-26T23:49:36.319486+0000","last_undegraded":"2024-04-26T23:49:36.319486+0000","last_fullsized":"2024-04-26T23:49:36.319486+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":3604,"log_dups_size":0,"ondisk_log_size":3604,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:40:17.167353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":54297,"num_write_kb":686705,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3d","version":"26'4614","reported_seq":4634,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:30.334531+0000","last_change":"2024-04-26T23:40:41.691614+0000","last_active":"2024-04-26T23:49:30.334531+0000","last_peered":"2024-04-26T23:49:30.334531+0000","last_clean":"2024-04-26T23:49:30.334531+0000","last_became_active":"2024-04-26T23:40:41.691081+0000","last_became_peered":"2024-04-26T23:40:41.691081+0000","last_unstale":"2024-04-26T23:49:30.334531+0000","last_undegraded":"2024-04-26T23:49:30.334531+0000","last_fullsized":"2024-04-26T23:49:30.334531+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":4614,"log_dups_size":0,"ondisk_log_size":4614,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:24:07.784468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69615,"num_write_kb":867426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"26'4911","reported_seq":4938,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.888073+0000","last_change":"2024-04-26T23:40:32.588894+0000","last_active":"2024-04-26T23:49:42.888073+0000","last_peered":"2024-04-26T23:49:42.888073+0000","last_clean":"2024-04-26T23:49:42.888073+0000","last_became_active":"2024-04-26T23:40:32.588409+0000","last_became_peered":"2024-04-26T23:40:32.588409+0000","last_unstale":"2024-04-26T23:49:42.888073+0000","last_undegraded":"2024-04-26T23:49:42.888073+0000","last_fullsized":"2024-04-26T23:49:42.888073+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":4911,"log_dups_size":0,"ondisk_log_size":4911,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:35:08.194865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":73569,"num_write_kb":917520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3a","version":"26'3809","reported_seq":3828,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:30.230648+0000","last_change":"2024-04-26T23:40:41.678639+0000","last_active":"2024-04-26T23:49:30.230648+0000","last_peered":"2024-04-26T23:49:30.230648+0000","last_clean":"2024-04-26T23:49:30.230648+0000","last_became_active":"2024-04-26T23:40:41.678333+0000","last_became_peered":"2024-04-26T23:40:41.678333+0000","last_unstale":"2024-04-26T23:49:30.230648+0000","last_undegraded":"2024-04-26T23:49:30.230648+0000","last_fullsized":"2024-04-26T23:49:30.230648+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":3809,"log_dups_size":0,"ondisk_log_size":3809,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:42:13.754586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":57471,"num_write_kb":738181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"26'3675","reported_seq":3703,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:36.024149+0000","last_change":"2024-04-26T23:40:32.581875+0000","last_active":"2024-04-26T23:49:36.024149+0000","last_peered":"2024-04-26T23:49:36.024149+0000","last_clean":"2024-04-26T23:49:36.024149+0000","last_became_active":"2024-04-26T23:40:32.580987+0000","last_became_peered":"2024-04-26T23:40:32.580987+0000","last_unstale":"2024-04-26T23:49:36.024149+0000","last_undegraded":"2024-04-26T23:49:36.024149+0000","last_fullsized":"2024-04-26T23:49:36.024149+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":3675,"log_dups_size":0,"ondisk_log_size":3675,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:12:45.093169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55303,"num_write_kb":749693,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3b","version":"26'5307","reported_seq":5326,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:32.363761+0000","last_change":"2024-04-26T23:40:41.678366+0000","last_active":"2024-04-26T23:49:32.363761+0000","last_peered":"2024-04-26T23:49:32.363761+0000","last_clean":"2024-04-26T23:49:32.363761+0000","last_became_active":"2024-04-26T23:40:41.678067+0000","last_became_peered":"2024-04-26T23:40:41.678067+0000","last_unstale":"2024-04-26T23:49:32.363761+0000","last_undegraded":"2024-04-26T23:49:32.363761+0000","last_fullsized":"2024-04-26T23:49:32.363761+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":5307,"log_dups_size":0,"ondisk_log_size":5307,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:44:51.594010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79871,"num_write_kb":1001680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"26'4313","reported_seq":4341,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.885657+0000","last_change":"2024-04-26T23:40:32.579870+0000","last_active":"2024-04-26T23:49:42.885657+0000","last_peered":"2024-04-26T23:49:42.885657+0000","last_clean":"2024-04-26T23:49:42.885657+0000","last_became_active":"2024-04-26T23:40:32.579569+0000","last_became_peered":"2024-04-26T23:40:32.579569+0000","last_unstale":"2024-04-26T23:49:42.885657+0000","last_undegraded":"2024-04-26T23:49:42.885657+0000","last_fullsized":"2024-04-26T23:49:42.885657+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":4313,"log_dups_size":0,"ondisk_log_size":4313,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:25:30.040358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":64676,"num_write_kb":807158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.38","version":"26'4943","reported_seq":4962,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:30.217576+0000","last_change":"2024-04-26T23:40:41.684020+0000","last_active":"2024-04-26T23:49:30.217576+0000","last_peered":"2024-04-26T23:49:30.217576+0000","last_clean":"2024-04-26T23:49:30.217576+0000","last_became_active":"2024-04-26T23:40:41.683734+0000","last_became_peered":"2024-04-26T23:40:41.683734+0000","last_unstale":"2024-04-26T23:49:30.217576+0000","last_undegraded":"2024-04-26T23:49:30.217576+0000","last_fullsized":"2024-04-26T23:49:30.217576+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":4943,"log_dups_size":0,"ondisk_log_size":4943,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:38:42.155257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":74716,"num_write_kb":913038,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"26'5191","reported_seq":5219,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:36.430921+0000","last_change":"2024-04-26T23:40:32.583944+0000","last_active":"2024-04-26T23:49:36.430921+0000","last_peered":"2024-04-26T23:49:36.430921+0000","last_clean":"2024-04-26T23:49:36.430921+0000","last_became_active":"2024-04-26T23:40:32.583655+0000","last_became_peered":"2024-04-26T23:40:32.583655+0000","last_unstale":"2024-04-26T23:49:36.430921+0000","last_undegraded":"2024-04-26T23:49:36.430921+0000","last_fullsized":"2024-04-26T23:49:36.430921+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":5191,"log_dups_size":0,"ondisk_log_size":5191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:40:17.167353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":78237,"num_write_kb":1038116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.39","version":"26'4256","reported_seq":4275,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:32.355519+0000","last_change":"2024-04-26T23:40:41.681412+0000","last_active":"2024-04-26T23:49:32.355519+0000","last_peered":"2024-04-26T23:49:32.355519+0000","last_clean":"2024-04-26T23:49:32.355519+0000","last_became_active":"2024-04-26T23:40:41.681092+0000","last_became_peered":"2024-04-26T23:40:41.681092+0000","last_unstale":"2024-04-26T23:49:32.355519+0000","last_undegraded":"2024-04-26T23:49:32.355519+0000","last_fullsized":"2024-04-26T23:49:32.355519+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":4256,"log_dups_size":0,"ondisk_log_size":4256,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:48:09.126894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":64162,"num_write_kb":832623,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"26'3628","reported_seq":3656,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.980742+0000","last_change":"2024-04-26T23:40:32.596351+0000","last_active":"2024-04-26T23:49:42.980742+0000","last_peered":"2024-04-26T23:49:42.980742+0000","last_clean":"2024-04-26T23:49:42.980742+0000","last_became_active":"2024-04-26T23:40:32.596050+0000","last_became_peered":"2024-04-26T23:40:32.596050+0000","last_unstale":"2024-04-26T23:49:42.980742+0000","last_undegraded":"2024-04-26T23:49:42.980742+0000","last_fullsized":"2024-04-26T23:49:42.980742+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":3628,"log_dups_size":0,"ondisk_log_size":3628,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:34:14.811917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":54568,"num_write_kb":695399,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4349618,"num_write_kb":55464628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":287416,"ondisk_log_size":287416,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":158829115,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":18,"num_read_kb":98,"num_write":2622,"num_write_kb":157090,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":317718528,"data_stored":317657631,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2522,"ondisk_log_size":2522,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4020088,"num_write_kb":51543156,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":267855,"ondisk_log_size":267855,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":149566157,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":15,"num_read_kb":95,"num_write":2732,"num_write_kb":148085,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":299196416,"data_stored":299132213,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2596,"ondisk_log_size":2596,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574959,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":835292,"kb_used_data":81300,"kb_used_omap":1,"kb_used_meta":753982,"kb_avail":93536548,"statfs":{"total":96636764160,"available":95781425152,"internally_reserved":0,"allocated":83251200,"data_stored":83071587,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":772078026},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574964,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":602412,"kb_used_data":84196,"kb_used_omap":1,"kb_used_meta":518206,"kb_avail":93769428,"statfs":{"total":96636764160,"available":96019894272,"internally_reserved":0,"allocated":86216704,"data_stored":86032300,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":530643398},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574960,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":738632,"kb_used_data":57088,"kb_used_omap":1,"kb_used_meta":681534,"kb_avail":93633208,"statfs":{"total":96636764160,"available":95880404992,"internally_reserved":0,"allocated":58458112,"data_stored":58277666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":697891269},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1,1,1],"upper_bound":32},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574962,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":822852,"kb_used_data":94588,"kb_used_omap":1,"kb_used_meta":728254,"kb_avail":93548988,"statfs":{"total":96636764160,"available":95794163712,"internally_reserved":0,"allocated":96858112,"data_stored":96670557,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":745732549},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574960,"num_pgs":58,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":843140,"kb_used_data":106876,"kb_used_omap":1,"kb_used_meta":736254,"kb_avail":93528700,"statfs":{"total":96636764160,"available":95773388800,"internally_reserved":0,"allocated":109441024,"data_stored":109254504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":753924551},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574963,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":520948,"kb_used_data":24940,"kb_used_omap":1,"kb_used_meta":495998,"kb_avail":93850892,"statfs":{"total":96636764160,"available":96103313408,"internally_reserved":0,"allocated":25538560,"data_stored":25367229,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":507902405},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574961,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":751212,"kb_used_data":110884,"kb_used_omap":1,"kb_used_meta":640318,"kb_avail":93620628,"statfs":{"total":96636764160,"available":95867523072,"internally_reserved":0,"allocated":113545216,"data_stored":113360216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":655686085},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574965,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":604392,"kb_used_data":45920,"kb_used_omap":1,"kb_used_meta":558462,"kb_avail":93767448,"statfs":{"total":96636764160,"available":96017866752,"internally_reserved":0,"allocated":47022080,"data_stored":46841504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":571865541},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":29372416,"data_stored":29360766,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":41951232,"data_stored":41943200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12673024,"data_stored":12671093,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":33652736,"data_stored":33643184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":46149632,"data_stored":46137470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":29364224,"data_stored":29360218,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":48824320,"data_stored":48813882,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":57208832,"data_stored":57202400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16777216,"data_stored":16777216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":71315456,"data_stored":71303862,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12587008,"data_stored":12582982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":75509760,"data_stored":75498166,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":50429952,"data_stored":50419933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28815360,"data_stored":28804294,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":37113856,"data_stored":37105264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":25169920,"data_stored":25165914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T23:49:45.902 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T23:49:46.033 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:46.026+0000 7f65f1e59640 1 Processor -- start 2024-04-26T23:49:46.033 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:46.026+0000 7f65f1e59640 1 -- start start 2024-04-26T23:49:46.033 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:46.027+0000 7f65f1e59640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f65ec13ffb0 0x7f65ec0c82a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:46.033 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:46.027+0000 7f65f1e59640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f65ec15a280 0x7f65ec072ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:46.033 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:46.027+0000 7f65f1e59640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f65ec0c8a30 con 0x7f65ec073530 2024-04-26T23:49:46.033 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:46.027+0000 7f65f1e59640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f65ec072be0 con 0x7f65ec15a280 2024-04-26T23:49:46.033 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:46.027+0000 7f65f1e59640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f65ec0c9640 con 0x7f65ec13ffb0 2024-04-26T23:49:46.033 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:46.027+0000 7f65eaffd640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f65ec15a280 0x7f65ec072ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:46.033 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:46.027+0000 7f65ebfff640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f65ec073530 0x7f65ec158180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:51306/0 (socket says 172.21.15.88:51306) 2024-04-26T23:49:46.033 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:46.027+0000 7f65eaffd640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f65ec15a280 0x7f65ec072ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:59508/0 (socket says 172.21.15.88:59508) 2024-04-26T23:49:46.034 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:46.027+0000 7f65ebfff640 1 -- 172.21.15.88:0/425891406 learned_addr learned my addr 172.21.15.88:0/425891406 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-26T23:49:46.034 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:46.027+0000 7f65eb7fe640 1 --2- 172.21.15.88:0/425891406 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f65ec13ffb0 0x7f65ec0c82a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:46.034 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:46.028+0000 7f65eaffd640 1 -- 172.21.15.88:0/425891406 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f65ec13ffb0 msgr2=0x7f65ec0c82a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:49:46.034 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:46.028+0000 7f65eaffd640 1 --2- 172.21.15.88:0/425891406 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f65ec13ffb0 0x7f65ec0c82a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:46.034 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:46.028+0000 7f65eaffd640 1 -- 172.21.15.88:0/425891406 >> v1:172.21.15.88:6789/0 conn(0x7f65ec073530 legacy=0x7f65ec158180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:46.034 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:46.028+0000 7f65eaffd640 1 -- 172.21.15.88:0/425891406 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65ec0c8d10 con 0x7f65ec15a280 2024-04-26T23:49:46.034 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:46.028+0000 7f65ea7fc640 1 -- 172.21.15.88:0/425891406 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1674367862 0 0) 0x7f65ec0c8a30 con 0x7f65ec073530 2024-04-26T23:49:46.034 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:46.028+0000 7f65eaffd640 1 --2- 172.21.15.88:0/425891406 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f65ec15a280 0x7f65ec072ff0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f65d40097a0 tx=0x7f65d402a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=659a3bcccb309f13 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:49:46.034 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:46.028+0000 7f65ea7fc640 1 -- 172.21.15.88:0/425891406 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65d4037070 con 0x7f65ec15a280 2024-04-26T23:49:46.034 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:46.028+0000 7f65ea7fc640 1 -- 172.21.15.88:0/425891406 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65d402ae50 con 0x7f65ec15a280 2024-04-26T23:49:46.034 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:46.028+0000 7f65ea7fc640 1 -- 172.21.15.88:0/425891406 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65d4032660 con 0x7f65ec15a280 2024-04-26T23:49:46.037 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:46.029+0000 7f65f1e59640 1 -- 172.21.15.88:0/425891406 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f65ec15a280 msgr2=0x7f65ec072ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:46.037 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:46.029+0000 7f65f1e59640 1 --2- 172.21.15.88:0/425891406 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f65ec15a280 0x7f65ec072ff0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f65d40097a0 tx=0x7f65d402a100 comp rx=0 tx=0).stop 2024-04-26T23:49:46.037 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:46.029+0000 7f65f1e59640 1 -- 172.21.15.88:0/425891406 shutdown_connections 2024-04-26T23:49:46.037 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:46.029+0000 7f65f1e59640 1 --2- 172.21.15.88:0/425891406 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f65ec15a280 0x7f65ec072ff0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:46.037 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:46.029+0000 7f65f1e59640 1 --2- 172.21.15.88:0/425891406 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f65ec13ffb0 0x7f65ec0c82a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:46.038 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:46.029+0000 7f65f1e59640 1 -- 172.21.15.88:0/425891406 >> 172.21.15.88:0/425891406 conn(0x7f65ec06dc10 msgr2=0x7f65ec06c310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:49:46.038 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:46.029+0000 7f65f1e59640 1 -- 172.21.15.88:0/425891406 shutdown_connections 2024-04-26T23:49:46.038 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:46.029+0000 7f65f1e59640 1 -- 172.21.15.88:0/425891406 wait complete. 2024-04-26T23:49:46.038 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:46.030+0000 7f65f1e59640 1 Processor -- start 2024-04-26T23:49:46.038 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:46.030+0000 7f65f1e59640 1 -- start start 2024-04-26T23:49:46.038 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:46.031+0000 7f65f1e59640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f65ec073530 0x7f65ec157020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:46.038 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:46.031+0000 7f65f1e59640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f65ec13ffb0 0x7f65ec1ef540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:46.038 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:46.031+0000 7f65f1e59640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f65ec15a280 0x7f65ec0ac590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:46.038 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:46.031+0000 7f65f1e59640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f65ec0c92d0 con 0x7f65ec15a280 2024-04-26T23:49:46.038 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:46.031+0000 7f65f1e59640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f65ec0c87e0 con 0x7f65ec073530 2024-04-26T23:49:46.038 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:46.031+0000 7f65f1e59640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f65ec140390 con 0x7f65ec13ffb0 2024-04-26T23:49:46.038 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:46.031+0000 7f65ebfff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f65ec15a280 0x7f65ec0ac590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:46.038 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:46.031+0000 7f65ebfff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f65ec15a280 0x7f65ec0ac590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:59520/0 (socket says 172.21.15.88:59520) 2024-04-26T23:49:46.038 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:46.031+0000 7f65ebfff640 1 -- 172.21.15.88:0/3188008576 learned_addr learned my addr 172.21.15.88:0/3188008576 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:49:46.039 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:46.031+0000 7f65eaffd640 1 --2- 172.21.15.88:0/3188008576 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f65ec13ffb0 0x7f65ec1ef540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:46.039 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:46.031+0000 7f65ebfff640 1 -- 172.21.15.88:0/3188008576 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f65ec13ffb0 msgr2=0x7f65ec1ef540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:46.039 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:46.031+0000 7f65eb7fe640 1 --2- 172.21.15.88:0/3188008576 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f65ec073530 0x7f65ec157020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:46.039 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:46.031+0000 7f65ebfff640 1 --2- 172.21.15.88:0/3188008576 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f65ec13ffb0 0x7f65ec1ef540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:46.039 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:46.031+0000 7f65ebfff640 1 -- 172.21.15.88:0/3188008576 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f65ec073530 msgr2=0x7f65ec157020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:46.039 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:46.031+0000 7f65ebfff640 1 --2- 172.21.15.88:0/3188008576 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f65ec073530 0x7f65ec157020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:46.039 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:46.031+0000 7f65ebfff640 1 -- 172.21.15.88:0/3188008576 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65ec1efff0 con 0x7f65ec15a280 2024-04-26T23:49:46.039 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:46.031+0000 7f65ebfff640 1 --2- 172.21.15.88:0/3188008576 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f65ec15a280 0x7f65ec0ac590 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f65e400c480 tx=0x7f65e400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:49:46.039 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:46.032+0000 7f65e3fff640 1 -- 172.21.15.88:0/3188008576 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65e4018070 con 0x7f65ec15a280 2024-04-26T23:49:46.039 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:46.032+0000 7f65e3fff640 1 -- 172.21.15.88:0/3188008576 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65e4007500 con 0x7f65ec15a280 2024-04-26T23:49:46.039 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:46.032+0000 7f65f1e59640 1 -- 172.21.15.88:0/3188008576 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65ec134d00 con 0x7f65ec15a280 2024-04-26T23:49:46.039 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:46.032+0000 7f65e3fff640 1 -- 172.21.15.88:0/3188008576 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65e4004a20 con 0x7f65ec15a280 2024-04-26T23:49:46.039 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:46.032+0000 7f65f1e59640 1 -- 172.21.15.88:0/3188008576 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65ec134fe0 con 0x7f65ec15a280 2024-04-26T23:49:46.039 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:46.033+0000 7f65f1e59640 1 -- 172.21.15.88:0/3188008576 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f65ec076650 con 0x7f65ec15a280 2024-04-26T23:49:46.039 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:46.033+0000 7f65e3fff640 1 -- 172.21.15.88:0/3188008576 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f65e401b070 con 0x7f65ec15a280 2024-04-26T23:49:46.040 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:46.033+0000 7f65e3fff640 1 --2- 172.21.15.88:0/3188008576 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f65cc06c8f0 0x7f65cc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:46.040 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:46.034+0000 7f65e3fff640 1 -- 172.21.15.88:0/3188008576 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6666+0+0 (secure 0 0 0) 0x7f65e408b1b0 con 0x7f65ec15a280 2024-04-26T23:49:46.040 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:46.034+0000 7f65eb7fe640 1 --2- 172.21.15.88:0/3188008576 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f65cc06c8f0 0x7f65cc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:46.040 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:46.034+0000 7f65eb7fe640 1 --2- 172.21.15.88:0/3188008576 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f65cc06c8f0 0x7f65cc06edb0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f65ec0c6640 tx=0x7f65dc00b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:49:46.042 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:46.038+0000 7f65e3fff640 1 -- 172.21.15.88:0/3188008576 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f65e4059370 con 0x7f65ec15a280 2024-04-26T23:49:46.221 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:46.217+0000 7f65f1e59640 1 -- 172.21.15.88:0/3188008576 --> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f65ec0ad7d0 con 0x7f65cc06c8f0 2024-04-26T23:49:46.232 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:46.227+0000 7f65e3fff640 1 -- 172.21.15.88:0/3188008576 <== mgr.4104 v2:172.21.15.88:6832/651674297 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+494239 (secure 0 0 0) 0x7f65ec0ad7d0 con 0x7f65cc06c8f0 2024-04-26T23:49:46.238 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-26T23:49:46.241 INFO:teuthology.orchestra.run.smithi088.stderr:dumped all 2024-04-26T23:49:46.243 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:46.232+0000 7f65f1e59640 1 -- 172.21.15.88:0/3188008576 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f65cc06c8f0 msgr2=0x7f65cc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:46.243 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:46.232+0000 7f65f1e59640 1 --2- 172.21.15.88:0/3188008576 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f65cc06c8f0 0x7f65cc06edb0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f65ec0c6640 tx=0x7f65dc00b040 comp rx=0 tx=0).stop 2024-04-26T23:49:46.243 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:46.232+0000 7f65f1e59640 1 -- 172.21.15.88:0/3188008576 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f65ec15a280 msgr2=0x7f65ec0ac590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:46.243 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:46.232+0000 7f65f1e59640 1 --2- 172.21.15.88:0/3188008576 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f65ec15a280 0x7f65ec0ac590 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f65e400c480 tx=0x7f65e400c940 comp rx=0 tx=0).stop 2024-04-26T23:49:46.243 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:46.232+0000 7f65f1e59640 1 -- 172.21.15.88:0/3188008576 shutdown_connections 2024-04-26T23:49:46.243 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:46.232+0000 7f65f1e59640 1 --2- 172.21.15.88:0/3188008576 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f65cc06c8f0 0x7f65cc06edb0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:46.243 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:46.232+0000 7f65f1e59640 1 --2- 172.21.15.88:0/3188008576 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f65ec13ffb0 0x7f65ec1ef540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:46.243 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:46.232+0000 7f65f1e59640 1 --2- 172.21.15.88:0/3188008576 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f65ec15a280 0x7f65ec0ac590 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:46.243 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:46.232+0000 7f65f1e59640 1 --2- 172.21.15.88:0/3188008576 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f65ec073530 0x7f65ec157020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:46.243 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:46.232+0000 7f65f1e59640 1 -- 172.21.15.88:0/3188008576 >> 172.21.15.88:0/3188008576 conn(0x7f65ec06dc10 msgr2=0x7f65ec0cadb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:49:46.243 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:46.232+0000 7f65f1e59640 1 -- 172.21.15.88:0/3188008576 shutdown_connections 2024-04-26T23:49:46.243 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:46.232+0000 7f65f1e59640 1 -- 172.21.15.88:0/3188008576 wait complete. 2024-04-26T23:49:46.248 INFO:teuthology.orchestra.run.smithi088.stdout:{"pg_ready":true,"pg_map":{"version":303,"stamp":"2024-04-26T23:49:46.108223+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":308985640,"num_objects":120,"num_object_clones":0,"num_object_copies":240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":120,"num_whiteouts":0,"num_read":149,"num_read_kb":293,"num_write":8375225,"num_write_kb":107315377,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":560720,"ondisk_log_size":560720,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":386,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":5736928,"kb_used_data":605792,"kb_used_omap":12,"kb_used_meta":5131059,"kb_avail":749237792,"statfs":{"total":773094113280,"available":767219499008,"internally_reserved":0,"allocated":620331008,"data_stored":618876263,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":5254204976},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":36,"apply_latency_ms":36,"commit_latency_ns":36000000,"apply_latency_ns":36000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-12024434849,"num_objects":-3159,"num_object_clones":0,"num_object_copies":-6318,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-3159,"num_whiteouts":0,"num_read":3,"num_read_kb":9,"num_write":3197,"num_write_kb":339,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003518"},"pg_stats":[{"pgid":"5.18","version":"26'4247","reported_seq":4266,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:32.356515+0000","last_change":"2024-04-26T23:40:41.683801+0000","last_active":"2024-04-26T23:49:32.356515+0000","last_peered":"2024-04-26T23:49:32.356515+0000","last_clean":"2024-04-26T23:49:32.356515+0000","last_became_active":"2024-04-26T23:40:41.683484+0000","last_became_peered":"2024-04-26T23:40:41.683484+0000","last_unstale":"2024-04-26T23:49:32.356515+0000","last_undegraded":"2024-04-26T23:49:32.356515+0000","last_fullsized":"2024-04-26T23:49:32.356515+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":4247,"log_dups_size":0,"ondisk_log_size":4247,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:02:27.160408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":63732,"num_write_kb":854695,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1f","version":"26'15","reported_seq":45,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:47:58.449743+0000","last_change":"2024-04-26T23:40:31.576688+0000","last_active":"2024-04-26T23:47:58.449743+0000","last_peered":"2024-04-26T23:47:58.449743+0000","last_clean":"2024-04-26T23:47:58.449743+0000","last_became_active":"2024-04-26T23:40:31.576429+0000","last_became_peered":"2024-04-26T23:40:31.576429+0000","last_unstale":"2024-04-26T23:47:58.449743+0000","last_undegraded":"2024-04-26T23:47:58.449743+0000","last_fullsized":"2024-04-26T23:47:58.449743+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:47:42.681376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":4100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"26'4412","reported_seq":4440,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.856465+0000","last_change":"2024-04-26T23:40:32.578489+0000","last_active":"2024-04-26T23:49:42.856465+0000","last_peered":"2024-04-26T23:49:42.856465+0000","last_clean":"2024-04-26T23:49:42.856465+0000","last_became_active":"2024-04-26T23:40:32.578205+0000","last_became_peered":"2024-04-26T23:40:32.578205+0000","last_unstale":"2024-04-26T23:49:42.856465+0000","last_undegraded":"2024-04-26T23:49:42.856465+0000","last_fullsized":"2024-04-26T23:49:42.856465+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":4412,"log_dups_size":0,"ondisk_log_size":4412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:56:04.309611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":66444,"num_write_kb":860244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"26'23","reported_seq":44,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:48:00.741422+0000","last_change":"2024-04-26T23:40:40.666861+0000","last_active":"2024-04-26T23:48:00.741422+0000","last_peered":"2024-04-26T23:48:00.741422+0000","last_clean":"2024-04-26T23:48:00.741422+0000","last_became_active":"2024-04-26T23:40:40.666547+0000","last_became_peered":"2024-04-26T23:40:40.666547+0000","last_unstale":"2024-04-26T23:48:00.741422+0000","last_undegraded":"2024-04-26T23:48:00.741422+0000","last_fullsized":"2024-04-26T23:48:00.741422+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:27:47.818055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":4105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"26'5301","reported_seq":5320,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:32.359614+0000","last_change":"2024-04-26T23:40:41.689530+0000","last_active":"2024-04-26T23:49:32.359614+0000","last_peered":"2024-04-26T23:49:32.359614+0000","last_clean":"2024-04-26T23:49:32.359614+0000","last_became_active":"2024-04-26T23:40:41.687652+0000","last_became_peered":"2024-04-26T23:40:41.687652+0000","last_unstale":"2024-04-26T23:49:32.359614+0000","last_undegraded":"2024-04-26T23:49:32.359614+0000","last_fullsized":"2024-04-26T23:49:32.359614+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":5301,"log_dups_size":0,"ondisk_log_size":5301,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:58:45.972045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79884,"num_write_kb":1001634,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1e","version":"26'29","reported_seq":59,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:36.407374+0000","last_change":"2024-04-26T23:40:31.576867+0000","last_active":"2024-04-26T23:49:36.407374+0000","last_peered":"2024-04-26T23:49:36.407374+0000","last_clean":"2024-04-26T23:49:36.407374+0000","last_became_active":"2024-04-26T23:40:31.576342+0000","last_became_peered":"2024-04-26T23:40:31.576342+0000","last_unstale":"2024-04-26T23:49:36.407374+0000","last_undegraded":"2024-04-26T23:49:36.407374+0000","last_fullsized":"2024-04-26T23:49:36.407374+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:35:54.439397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":4114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"26'5109","reported_seq":5122,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.890952+0000","last_change":"2024-04-26T23:41:30.628386+0000","last_active":"2024-04-26T23:49:42.890952+0000","last_peered":"2024-04-26T23:49:42.890952+0000","last_clean":"2024-04-26T23:49:42.890952+0000","last_became_active":"2024-04-26T23:41:30.628139+0000","last_became_peered":"2024-04-26T23:41:30.628139+0000","last_unstale":"2024-04-26T23:49:42.890952+0000","last_undegraded":"2024-04-26T23:49:42.890952+0000","last_fullsized":"2024-04-26T23:49:42.890952+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":5109,"log_dups_size":0,"ondisk_log_size":5109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:10:21.873566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":76507,"num_write_kb":979233,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"26'25","reported_seq":46,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:30.276499+0000","last_change":"2024-04-26T23:40:40.672310+0000","last_active":"2024-04-26T23:49:30.276499+0000","last_peered":"2024-04-26T23:49:30.276499+0000","last_clean":"2024-04-26T23:49:30.276499+0000","last_became_active":"2024-04-26T23:40:40.672018+0000","last_became_peered":"2024-04-26T23:40:40.672018+0000","last_unstale":"2024-04-26T23:49:30.276499+0000","last_undegraded":"2024-04-26T23:49:30.276499+0000","last_fullsized":"2024-04-26T23:49:30.276499+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:01:10.835670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":8211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"26'3919","reported_seq":3938,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:30.326944+0000","last_change":"2024-04-26T23:40:41.686743+0000","last_active":"2024-04-26T23:49:30.326944+0000","last_peered":"2024-04-26T23:49:30.326944+0000","last_clean":"2024-04-26T23:49:30.326944+0000","last_became_active":"2024-04-26T23:40:41.686419+0000","last_became_peered":"2024-04-26T23:40:41.686419+0000","last_unstale":"2024-04-26T23:49:30.326944+0000","last_undegraded":"2024-04-26T23:49:30.326944+0000","last_fullsized":"2024-04-26T23:49:30.326944+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":3919,"log_dups_size":0,"ondisk_log_size":3919,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:08:35.027584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":59060,"num_write_kb":735586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1d","version":"26'46","reported_seq":75,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:36.404066+0000","last_change":"2024-04-26T23:40:31.578735+0000","last_active":"2024-04-26T23:49:36.404066+0000","last_peered":"2024-04-26T23:49:36.404066+0000","last_clean":"2024-04-26T23:49:36.404066+0000","last_became_active":"2024-04-26T23:40:31.578438+0000","last_became_peered":"2024-04-26T23:40:31.578438+0000","last_unstale":"2024-04-26T23:49:36.404066+0000","last_undegraded":"2024-04-26T23:49:36.404066+0000","last_fullsized":"2024-04-26T23:49:36.404066+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:30:10.397569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37,"num_write_kb":12306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"26'2988","reported_seq":3015,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.975858+0000","last_change":"2024-04-26T23:40:32.590624+0000","last_active":"2024-04-26T23:49:42.975858+0000","last_peered":"2024-04-26T23:49:42.975858+0000","last_clean":"2024-04-26T23:49:42.975858+0000","last_became_active":"2024-04-26T23:40:32.589687+0000","last_became_peered":"2024-04-26T23:40:32.589687+0000","last_unstale":"2024-04-26T23:49:42.975858+0000","last_undegraded":"2024-04-26T23:49:42.975858+0000","last_fullsized":"2024-04-26T23:49:42.975858+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":2988,"log_dups_size":0,"ondisk_log_size":2988,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:01:02.741964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44847,"num_write_kb":570063,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"26'1255","reported_seq":1276,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.843735+0000","last_change":"2024-04-26T23:40:40.677899+0000","last_active":"2024-04-26T23:48:13.843735+0000","last_peered":"2024-04-26T23:48:13.843735+0000","last_clean":"2024-04-26T23:48:13.843735+0000","last_became_active":"2024-04-26T23:40:40.677388+0000","last_became_peered":"2024-04-26T23:40:40.677388+0000","last_unstale":"2024-04-26T23:48:13.843735+0000","last_undegraded":"2024-04-26T23:48:13.843735+0000","last_fullsized":"2024-04-26T23:48:13.843735+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":1255,"log_dups_size":0,"ondisk_log_size":1255,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:52:34.793496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1253,"num_write_kb":5260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"26'3551","reported_seq":3570,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:30.305496+0000","last_change":"2024-04-26T23:40:41.680097+0000","last_active":"2024-04-26T23:49:30.305496+0000","last_peered":"2024-04-26T23:49:30.305496+0000","last_clean":"2024-04-26T23:49:30.305496+0000","last_became_active":"2024-04-26T23:40:41.679815+0000","last_became_peered":"2024-04-26T23:40:41.679815+0000","last_unstale":"2024-04-26T23:49:30.305496+0000","last_undegraded":"2024-04-26T23:49:30.305496+0000","last_fullsized":"2024-04-26T23:49:30.305496+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":3551,"log_dups_size":0,"ondisk_log_size":3551,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:10:30.972726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53503,"num_write_kb":665423,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"26'17","reported_seq":46,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:48:02.410604+0000","last_change":"2024-04-26T23:40:31.573648+0000","last_active":"2024-04-26T23:48:02.410604+0000","last_peered":"2024-04-26T23:48:02.410604+0000","last_clean":"2024-04-26T23:48:02.410604+0000","last_became_active":"2024-04-26T23:40:31.573347+0000","last_became_peered":"2024-04-26T23:40:31.573347+0000","last_unstale":"2024-04-26T23:48:02.410604+0000","last_undegraded":"2024-04-26T23:48:02.410604+0000","last_fullsized":"2024-04-26T23:48:02.410604+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:20:28.103413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":4100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"26'5057","reported_seq":5084,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.997446+0000","last_change":"2024-04-26T23:40:32.588309+0000","last_active":"2024-04-26T23:49:42.997446+0000","last_peered":"2024-04-26T23:49:42.997446+0000","last_clean":"2024-04-26T23:49:42.997446+0000","last_became_active":"2024-04-26T23:40:32.588007+0000","last_became_peered":"2024-04-26T23:40:32.588007+0000","last_unstale":"2024-04-26T23:49:42.997446+0000","last_undegraded":"2024-04-26T23:49:42.997446+0000","last_fullsized":"2024-04-26T23:49:42.997446+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":5057,"log_dups_size":0,"ondisk_log_size":5057,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:52:26.699790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":75905,"num_write_kb":967615,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"26'33","reported_seq":54,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:30.327673+0000","last_change":"2024-04-26T23:40:40.678547+0000","last_active":"2024-04-26T23:49:30.327673+0000","last_peered":"2024-04-26T23:49:30.327673+0000","last_clean":"2024-04-26T23:49:30.327673+0000","last_became_active":"2024-04-26T23:40:40.677668+0000","last_became_peered":"2024-04-26T23:40:40.677668+0000","last_unstale":"2024-04-26T23:49:30.327673+0000","last_undegraded":"2024-04-26T23:49:30.327673+0000","last_fullsized":"2024-04-26T23:49:30.327673+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:34:22.905623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":12307,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"26'4797","reported_seq":4817,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:32.355924+0000","last_change":"2024-04-26T23:40:41.689525+0000","last_active":"2024-04-26T23:49:32.355924+0000","last_peered":"2024-04-26T23:49:32.355924+0000","last_clean":"2024-04-26T23:49:32.355924+0000","last_became_active":"2024-04-26T23:40:41.687433+0000","last_became_peered":"2024-04-26T23:40:41.687433+0000","last_unstale":"2024-04-26T23:49:32.355924+0000","last_undegraded":"2024-04-26T23:49:32.355924+0000","last_fullsized":"2024-04-26T23:49:32.355924+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":4797,"log_dups_size":0,"ondisk_log_size":4797,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:38:42.155257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":72371,"num_write_kb":916696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"26'3820","reported_seq":3848,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.852304+0000","last_change":"2024-04-26T23:40:32.590053+0000","last_active":"2024-04-26T23:49:42.852304+0000","last_peered":"2024-04-26T23:49:42.852304+0000","last_clean":"2024-04-26T23:49:42.852304+0000","last_became_active":"2024-04-26T23:40:32.589802+0000","last_became_peered":"2024-04-26T23:40:32.589802+0000","last_unstale":"2024-04-26T23:49:42.852304+0000","last_undegraded":"2024-04-26T23:49:42.852304+0000","last_fullsized":"2024-04-26T23:49:42.852304+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":3820,"log_dups_size":0,"ondisk_log_size":3820,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:16:46.547536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":57277,"num_write_kb":731452,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"26'244","reported_seq":274,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:36.412818+0000","last_change":"2024-04-26T23:40:31.578524+0000","last_active":"2024-04-26T23:49:36.412818+0000","last_peered":"2024-04-26T23:49:36.412818+0000","last_clean":"2024-04-26T23:49:36.412818+0000","last_became_active":"2024-04-26T23:40:31.578230+0000","last_became_peered":"2024-04-26T23:40:31.578230+0000","last_unstale":"2024-04-26T23:49:36.412818+0000","last_undegraded":"2024-04-26T23:49:36.412818+0000","last_fullsized":"2024-04-26T23:49:36.412818+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":244,"log_dups_size":0,"ondisk_log_size":244,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:15:51.937774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":234,"num_write_kb":8395,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"26'20","reported_seq":41,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:47:31.547871+0000","last_change":"2024-04-26T23:40:40.676459+0000","last_active":"2024-04-26T23:47:31.547871+0000","last_peered":"2024-04-26T23:47:31.547871+0000","last_clean":"2024-04-26T23:47:31.547871+0000","last_became_active":"2024-04-26T23:40:40.675997+0000","last_became_peered":"2024-04-26T23:40:40.675997+0000","last_unstale":"2024-04-26T23:47:31.547871+0000","last_undegraded":"2024-04-26T23:47:31.547871+0000","last_fullsized":"2024-04-26T23:47:31.547871+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:37:38.455501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":4105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"26'4636","reported_seq":4655,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:32.358383+0000","last_change":"2024-04-26T23:40:41.679334+0000","last_active":"2024-04-26T23:49:32.358383+0000","last_peered":"2024-04-26T23:49:32.358383+0000","last_clean":"2024-04-26T23:49:32.358383+0000","last_became_active":"2024-04-26T23:40:41.679098+0000","last_became_peered":"2024-04-26T23:40:41.679098+0000","last_unstale":"2024-04-26T23:49:32.358383+0000","last_undegraded":"2024-04-26T23:49:32.358383+0000","last_fullsized":"2024-04-26T23:49:32.358383+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":4636,"log_dups_size":0,"ondisk_log_size":4636,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:52:35.798951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69716,"num_write_kb":886548,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"26'3484","reported_seq":3512,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.905029+0000","last_change":"2024-04-26T23:40:32.585827+0000","last_active":"2024-04-26T23:49:42.905029+0000","last_peered":"2024-04-26T23:49:42.905029+0000","last_clean":"2024-04-26T23:49:42.905029+0000","last_became_active":"2024-04-26T23:40:32.585522+0000","last_became_peered":"2024-04-26T23:40:32.585522+0000","last_unstale":"2024-04-26T23:49:42.905029+0000","last_undegraded":"2024-04-26T23:49:42.905029+0000","last_fullsized":"2024-04-26T23:49:42.905029+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":3484,"log_dups_size":0,"ondisk_log_size":3484,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:40:17.167353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":52204,"num_write_kb":651184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"26'16","reported_seq":46,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:36.407078+0000","last_change":"2024-04-26T23:40:31.575121+0000","last_active":"2024-04-26T23:49:36.407078+0000","last_peered":"2024-04-26T23:49:36.407078+0000","last_clean":"2024-04-26T23:49:36.407078+0000","last_became_active":"2024-04-26T23:40:31.574827+0000","last_became_peered":"2024-04-26T23:40:31.574827+0000","last_unstale":"2024-04-26T23:49:36.407078+0000","last_undegraded":"2024-04-26T23:49:36.407078+0000","last_fullsized":"2024-04-26T23:49:36.407078+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:43:13.740214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":4101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"26'4","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:32.344791+0000","last_change":"2024-04-26T23:40:40.678613+0000","last_active":"2024-04-26T23:49:32.344791+0000","last_peered":"2024-04-26T23:49:32.344791+0000","last_clean":"2024-04-26T23:49:32.344791+0000","last_became_active":"2024-04-26T23:40:40.677867+0000","last_became_peered":"2024-04-26T23:40:40.677867+0000","last_unstale":"2024-04-26T23:49:32.344791+0000","last_undegraded":"2024-04-26T23:49:32.344791+0000","last_fullsized":"2024-04-26T23:49:32.344791+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:35:16.288571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"26'4217","reported_seq":4236,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:30.298167+0000","last_change":"2024-04-26T23:40:41.685042+0000","last_active":"2024-04-26T23:49:30.298167+0000","last_peered":"2024-04-26T23:49:30.298167+0000","last_clean":"2024-04-26T23:49:30.298167+0000","last_became_active":"2024-04-26T23:40:41.684699+0000","last_became_peered":"2024-04-26T23:40:41.684699+0000","last_unstale":"2024-04-26T23:49:30.298167+0000","last_undegraded":"2024-04-26T23:49:30.298167+0000","last_fullsized":"2024-04-26T23:49:30.298167+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":4217,"log_dups_size":0,"ondisk_log_size":4217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:10:57.826183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":63591,"num_write_kb":826339,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"26'4047","reported_seq":4075,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.908595+0000","last_change":"2024-04-26T23:40:32.582721+0000","last_active":"2024-04-26T23:49:42.908595+0000","last_peered":"2024-04-26T23:49:42.908595+0000","last_clean":"2024-04-26T23:49:42.908595+0000","last_became_active":"2024-04-26T23:40:32.582438+0000","last_became_peered":"2024-04-26T23:40:32.582438+0000","last_unstale":"2024-04-26T23:49:42.908595+0000","last_undegraded":"2024-04-26T23:49:42.908595+0000","last_fullsized":"2024-04-26T23:49:42.908595+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":4047,"log_dups_size":0,"ondisk_log_size":4047,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:38:10.884592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":60599,"num_write_kb":814129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"26'16","reported_seq":46,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:36.396171+0000","last_change":"2024-04-26T23:40:31.575508+0000","last_active":"2024-04-26T23:49:36.396171+0000","last_peered":"2024-04-26T23:49:36.396171+0000","last_clean":"2024-04-26T23:49:36.396171+0000","last_became_active":"2024-04-26T23:40:31.575242+0000","last_became_peered":"2024-04-26T23:40:31.575242+0000","last_unstale":"2024-04-26T23:49:36.396171+0000","last_undegraded":"2024-04-26T23:49:36.396171+0000","last_fullsized":"2024-04-26T23:49:36.396171+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:48:32.015654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":4101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"26'16","reported_seq":37,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:32.336622+0000","last_change":"2024-04-26T23:40:40.679196+0000","last_active":"2024-04-26T23:49:32.336622+0000","last_peered":"2024-04-26T23:49:32.336622+0000","last_clean":"2024-04-26T23:49:32.336622+0000","last_became_active":"2024-04-26T23:40:40.678740+0000","last_became_peered":"2024-04-26T23:40:40.678740+0000","last_unstale":"2024-04-26T23:49:32.336622+0000","last_undegraded":"2024-04-26T23:49:32.336622+0000","last_fullsized":"2024-04-26T23:49:32.336622+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:40:14.479631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":4110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"26'5261","reported_seq":5280,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:30.318331+0000","last_change":"2024-04-26T23:40:41.686638+0000","last_active":"2024-04-26T23:49:30.318331+0000","last_peered":"2024-04-26T23:49:30.318331+0000","last_clean":"2024-04-26T23:49:30.318331+0000","last_became_active":"2024-04-26T23:40:41.686354+0000","last_became_peered":"2024-04-26T23:40:41.686354+0000","last_unstale":"2024-04-26T23:49:30.318331+0000","last_undegraded":"2024-04-26T23:49:30.318331+0000","last_fullsized":"2024-04-26T23:49:30.318331+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":5261,"log_dups_size":0,"ondisk_log_size":5261,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:06:12.755431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79283,"num_write_kb":1000134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"26'4022","reported_seq":4050,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.889538+0000","last_change":"2024-04-26T23:40:32.583019+0000","last_active":"2024-04-26T23:49:42.889538+0000","last_peered":"2024-04-26T23:49:42.889538+0000","last_clean":"2024-04-26T23:49:42.889538+0000","last_became_active":"2024-04-26T23:40:32.582719+0000","last_became_peered":"2024-04-26T23:40:32.582719+0000","last_unstale":"2024-04-26T23:49:42.889538+0000","last_undegraded":"2024-04-26T23:49:42.889538+0000","last_fullsized":"2024-04-26T23:49:42.889538+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":4022,"log_dups_size":0,"ondisk_log_size":4022,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:25:02.319783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":60741,"num_write_kb":745879,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"26'19","reported_seq":49,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:36.391367+0000","last_change":"2024-04-26T23:40:31.576866+0000","last_active":"2024-04-26T23:49:36.391367+0000","last_peered":"2024-04-26T23:49:36.391367+0000","last_clean":"2024-04-26T23:49:36.391367+0000","last_became_active":"2024-04-26T23:40:31.576419+0000","last_became_peered":"2024-04-26T23:40:31.576419+0000","last_unstale":"2024-04-26T23:49:36.391367+0000","last_undegraded":"2024-04-26T23:49:36.391367+0000","last_fullsized":"2024-04-26T23:49:36.391367+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:45:49.295198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":4102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"26'18","reported_seq":39,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:32.332148+0000","last_change":"2024-04-26T23:40:40.675262+0000","last_active":"2024-04-26T23:49:32.332148+0000","last_peered":"2024-04-26T23:49:32.332148+0000","last_clean":"2024-04-26T23:49:32.332148+0000","last_became_active":"2024-04-26T23:40:40.674721+0000","last_became_peered":"2024-04-26T23:40:40.674721+0000","last_unstale":"2024-04-26T23:49:32.332148+0000","last_undegraded":"2024-04-26T23:49:32.332148+0000","last_fullsized":"2024-04-26T23:49:32.332148+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:56:12.403317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":4101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"26'4206","reported_seq":4226,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:32.327428+0000","last_change":"2024-04-26T23:40:41.691494+0000","last_active":"2024-04-26T23:49:32.327428+0000","last_peered":"2024-04-26T23:49:32.327428+0000","last_clean":"2024-04-26T23:49:32.327428+0000","last_became_active":"2024-04-26T23:40:41.691241+0000","last_became_peered":"2024-04-26T23:40:41.691241+0000","last_unstale":"2024-04-26T23:49:32.327428+0000","last_undegraded":"2024-04-26T23:49:32.327428+0000","last_fullsized":"2024-04-26T23:49:32.327428+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":4206,"log_dups_size":0,"ondisk_log_size":4206,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:08:35.027584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":63038,"num_write_kb":829161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"26'3470","reported_seq":3498,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.886281+0000","last_change":"2024-04-26T23:40:32.584988+0000","last_active":"2024-04-26T23:49:42.886281+0000","last_peered":"2024-04-26T23:49:42.886281+0000","last_clean":"2024-04-26T23:49:42.886281+0000","last_became_active":"2024-04-26T23:40:32.584467+0000","last_became_peered":"2024-04-26T23:40:32.584467+0000","last_unstale":"2024-04-26T23:49:42.886281+0000","last_undegraded":"2024-04-26T23:49:42.886281+0000","last_fullsized":"2024-04-26T23:49:42.886281+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":3470,"log_dups_size":0,"ondisk_log_size":3470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:51:30.677247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51752,"num_write_kb":657341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"26'115","reported_seq":145,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.784144+0000","last_change":"2024-04-26T23:40:31.573721+0000","last_active":"2024-04-26T23:49:42.784144+0000","last_peered":"2024-04-26T23:49:42.784144+0000","last_clean":"2024-04-26T23:49:42.784144+0000","last_became_active":"2024-04-26T23:40:31.573434+0000","last_became_peered":"2024-04-26T23:40:31.573434+0000","last_unstale":"2024-04-26T23:49:42.784144+0000","last_undegraded":"2024-04-26T23:49:42.784144+0000","last_fullsized":"2024-04-26T23:49:42.784144+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":115,"log_dups_size":0,"ondisk_log_size":115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:20:28.103413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2675866,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":112,"num_write_kb":2659,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"26'20","reported_seq":60,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:37.321768+0000","last_change":"2024-04-26T23:40:40.678020+0000","last_active":"2024-04-26T23:49:37.321768+0000","last_peered":"2024-04-26T23:49:37.321768+0000","last_clean":"2024-04-26T23:49:37.321768+0000","last_became_active":"2024-04-26T23:40:40.677410+0000","last_became_peered":"2024-04-26T23:40:40.677410+0000","last_unstale":"2024-04-26T23:49:37.321768+0000","last_undegraded":"2024-04-26T23:49:37.321768+0000","last_fullsized":"2024-04-26T23:49:37.321768+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:44:50.588556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88181,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":98,"num_write":18,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"26'4391","reported_seq":4411,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:30.315363+0000","last_change":"2024-04-26T23:40:41.689839+0000","last_active":"2024-04-26T23:49:30.315363+0000","last_peered":"2024-04-26T23:49:30.315363+0000","last_clean":"2024-04-26T23:49:30.315363+0000","last_became_active":"2024-04-26T23:40:41.689508+0000","last_became_peered":"2024-04-26T23:40:41.689508+0000","last_unstale":"2024-04-26T23:49:30.315363+0000","last_undegraded":"2024-04-26T23:49:30.315363+0000","last_fullsized":"2024-04-26T23:49:30.315363+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":4391,"log_dups_size":0,"ondisk_log_size":4391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:17:28.672777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":66189,"num_write_kb":852725,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"26'4076","reported_seq":4104,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.946960+0000","last_change":"2024-04-26T23:40:32.594913+0000","last_active":"2024-04-26T23:49:42.946960+0000","last_peered":"2024-04-26T23:49:42.946960+0000","last_clean":"2024-04-26T23:49:42.946960+0000","last_became_active":"2024-04-26T23:40:32.594616+0000","last_became_peered":"2024-04-26T23:40:32.594616+0000","last_unstale":"2024-04-26T23:49:42.946960+0000","last_undegraded":"2024-04-26T23:49:42.946960+0000","last_fullsized":"2024-04-26T23:49:42.946960+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":4076,"log_dups_size":0,"ondisk_log_size":4076,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:04:30.553552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":61223,"num_write_kb":789949,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"26'262","reported_seq":292,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:40.290090+0000","last_change":"2024-04-26T23:40:31.576299+0000","last_active":"2024-04-26T23:49:40.290090+0000","last_peered":"2024-04-26T23:49:40.290090+0000","last_clean":"2024-04-26T23:49:40.290090+0000","last_became_active":"2024-04-26T23:40:31.576006+0000","last_became_peered":"2024-04-26T23:40:31.576006+0000","last_unstale":"2024-04-26T23:49:40.290090+0000","last_undegraded":"2024-04-26T23:49:40.290090+0000","last_fullsized":"2024-04-26T23:49:40.290090+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":262,"log_dups_size":0,"ondisk_log_size":262,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:15:51.937774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":519,"num_write_kb":200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"26'25","reported_seq":47,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:32.330189+0000","last_change":"2024-04-26T23:40:40.674806+0000","last_active":"2024-04-26T23:49:32.330189+0000","last_peered":"2024-04-26T23:49:32.330189+0000","last_clean":"2024-04-26T23:49:32.330189+0000","last_became_active":"2024-04-26T23:40:40.674557+0000","last_became_peered":"2024-04-26T23:40:40.674557+0000","last_unstale":"2024-04-26T23:49:32.330189+0000","last_undegraded":"2024-04-26T23:49:32.330189+0000","last_fullsized":"2024-04-26T23:49:32.330189+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:45:33.226487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":12298,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"26'4697","reported_seq":4717,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:30.264413+0000","last_change":"2024-04-26T23:40:41.688941+0000","last_active":"2024-04-26T23:49:30.264413+0000","last_peered":"2024-04-26T23:49:30.264413+0000","last_clean":"2024-04-26T23:49:30.264413+0000","last_became_active":"2024-04-26T23:40:41.688653+0000","last_became_peered":"2024-04-26T23:40:41.688653+0000","last_unstale":"2024-04-26T23:49:30.264413+0000","last_undegraded":"2024-04-26T23:49:30.264413+0000","last_fullsized":"2024-04-26T23:49:30.264413+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":4697,"log_dups_size":0,"ondisk_log_size":4697,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:53:13.531466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":70754,"num_write_kb":894410,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"26'4242","reported_seq":4270,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.856648+0000","last_change":"2024-04-26T23:40:32.582442+0000","last_active":"2024-04-26T23:49:42.856648+0000","last_peered":"2024-04-26T23:49:42.856648+0000","last_clean":"2024-04-26T23:49:42.856648+0000","last_became_active":"2024-04-26T23:40:32.582140+0000","last_became_peered":"2024-04-26T23:40:32.582140+0000","last_unstale":"2024-04-26T23:49:42.856648+0000","last_undegraded":"2024-04-26T23:49:42.856648+0000","last_fullsized":"2024-04-26T23:49:42.856648+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":4242,"log_dups_size":0,"ondisk_log_size":4242,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:18:09.706875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":63708,"num_write_kb":831213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"26'16","reported_seq":46,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:36.405509+0000","last_change":"2024-04-26T23:40:31.576565+0000","last_active":"2024-04-26T23:49:36.405509+0000","last_peered":"2024-04-26T23:49:36.405509+0000","last_clean":"2024-04-26T23:49:36.405509+0000","last_became_active":"2024-04-26T23:40:31.576313+0000","last_became_peered":"2024-04-26T23:40:31.576313+0000","last_unstale":"2024-04-26T23:49:36.405509+0000","last_undegraded":"2024-04-26T23:49:36.405509+0000","last_fullsized":"2024-04-26T23:49:36.405509+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:25:01.315397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":4100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"26'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:47:32.117231+0000","last_change":"2024-04-26T23:40:40.671047+0000","last_active":"2024-04-26T23:47:32.117231+0000","last_peered":"2024-04-26T23:47:32.117231+0000","last_clean":"2024-04-26T23:47:32.117231+0000","last_became_active":"2024-04-26T23:40:40.670630+0000","last_became_peered":"2024-04-26T23:40:40.670630+0000","last_unstale":"2024-04-26T23:47:32.117231+0000","last_undegraded":"2024-04-26T23:47:32.117231+0000","last_fullsized":"2024-04-26T23:47:32.117231+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:45:07.071050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"26'4137","reported_seq":4157,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:30.321424+0000","last_change":"2024-04-26T23:40:41.686221+0000","last_active":"2024-04-26T23:49:30.321424+0000","last_peered":"2024-04-26T23:49:30.321424+0000","last_clean":"2024-04-26T23:49:30.321424+0000","last_became_active":"2024-04-26T23:40:41.685961+0000","last_became_peered":"2024-04-26T23:40:41.685961+0000","last_unstale":"2024-04-26T23:49:30.321424+0000","last_undegraded":"2024-04-26T23:49:30.321424+0000","last_fullsized":"2024-04-26T23:49:30.321424+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":4137,"log_dups_size":0,"ondisk_log_size":4137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:28:34.920939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":62474,"num_write_kb":825561,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"26'3719","reported_seq":3747,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.995441+0000","last_change":"2024-04-26T23:40:32.584363+0000","last_active":"2024-04-26T23:49:42.995441+0000","last_peered":"2024-04-26T23:49:42.995441+0000","last_clean":"2024-04-26T23:49:42.995441+0000","last_became_active":"2024-04-26T23:40:32.584082+0000","last_became_peered":"2024-04-26T23:40:32.584082+0000","last_unstale":"2024-04-26T23:49:42.995441+0000","last_undegraded":"2024-04-26T23:49:42.995441+0000","last_fullsized":"2024-04-26T23:49:42.995441+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":3719,"log_dups_size":0,"ondisk_log_size":3719,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:35:08.194865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55724,"num_write_kb":725978,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"26'6","reported_seq":36,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:36.393573+0000","last_change":"2024-04-26T23:40:31.576711+0000","last_active":"2024-04-26T23:49:36.393573+0000","last_peered":"2024-04-26T23:49:36.393573+0000","last_clean":"2024-04-26T23:49:36.393573+0000","last_became_active":"2024-04-26T23:40:31.576404+0000","last_became_peered":"2024-04-26T23:40:31.576404+0000","last_unstale":"2024-04-26T23:49:36.393573+0000","last_undegraded":"2024-04-26T23:49:36.393573+0000","last_fullsized":"2024-04-26T23:49:36.393573+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:45:49.295198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"26'31","reported_seq":53,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:32.328269+0000","last_change":"2024-04-26T23:40:40.675296+0000","last_active":"2024-04-26T23:49:32.328269+0000","last_peered":"2024-04-26T23:49:32.328269+0000","last_clean":"2024-04-26T23:49:32.328269+0000","last_became_active":"2024-04-26T23:40:40.674935+0000","last_became_peered":"2024-04-26T23:40:40.674935+0000","last_unstale":"2024-04-26T23:49:32.328269+0000","last_undegraded":"2024-04-26T23:49:32.328269+0000","last_fullsized":"2024-04-26T23:49:32.328269+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:10:10.722905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":8205,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"26'3986","reported_seq":4006,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:30.313667+0000","last_change":"2024-04-26T23:40:41.691510+0000","last_active":"2024-04-26T23:49:30.313667+0000","last_peered":"2024-04-26T23:49:30.313667+0000","last_clean":"2024-04-26T23:49:30.313667+0000","last_became_active":"2024-04-26T23:40:41.691242+0000","last_became_peered":"2024-04-26T23:40:41.691242+0000","last_unstale":"2024-04-26T23:49:30.313667+0000","last_undegraded":"2024-04-26T23:49:30.313667+0000","last_fullsized":"2024-04-26T23:49:30.313667+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":3986,"log_dups_size":0,"ondisk_log_size":3986,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:27:48.823509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":59849,"num_write_kb":777586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"26'3874","reported_seq":3902,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.917138+0000","last_change":"2024-04-26T23:40:32.590069+0000","last_active":"2024-04-26T23:49:42.917138+0000","last_peered":"2024-04-26T23:49:42.917138+0000","last_clean":"2024-04-26T23:49:42.917138+0000","last_became_active":"2024-04-26T23:40:32.589790+0000","last_became_peered":"2024-04-26T23:40:32.589790+0000","last_unstale":"2024-04-26T23:49:42.917138+0000","last_undegraded":"2024-04-26T23:49:42.917138+0000","last_fullsized":"2024-04-26T23:49:42.917138+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":3874,"log_dups_size":0,"ondisk_log_size":3874,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:15:52.942160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":58064,"num_write_kb":769321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"26'25","reported_seq":55,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:36.421096+0000","last_change":"2024-04-26T23:40:31.572432+0000","last_active":"2024-04-26T23:49:36.421096+0000","last_peered":"2024-04-26T23:49:36.421096+0000","last_clean":"2024-04-26T23:49:36.421096+0000","last_became_active":"2024-04-26T23:40:31.572121+0000","last_became_peered":"2024-04-26T23:40:31.572121+0000","last_unstale":"2024-04-26T23:49:36.421096+0000","last_undegraded":"2024-04-26T23:49:36.421096+0000","last_fullsized":"2024-04-26T23:49:36.421096+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:45:49.295198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":8200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"26'6","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:30.319370+0000","last_change":"2024-04-26T23:40:40.678404+0000","last_active":"2024-04-26T23:49:30.319370+0000","last_peered":"2024-04-26T23:49:30.319370+0000","last_clean":"2024-04-26T23:49:30.319370+0000","last_became_active":"2024-04-26T23:40:40.678136+0000","last_became_peered":"2024-04-26T23:40:40.678136+0000","last_unstale":"2024-04-26T23:49:30.319370+0000","last_undegraded":"2024-04-26T23:49:30.319370+0000","last_fullsized":"2024-04-26T23:49:30.319370+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:45:11.058699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"26'3869","reported_seq":3889,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:30.287388+0000","last_change":"2024-04-26T23:40:41.673542+0000","last_active":"2024-04-26T23:49:30.287388+0000","last_peered":"2024-04-26T23:49:30.287388+0000","last_clean":"2024-04-26T23:49:30.287388+0000","last_became_active":"2024-04-26T23:40:41.673254+0000","last_became_peered":"2024-04-26T23:40:41.673254+0000","last_unstale":"2024-04-26T23:49:30.287388+0000","last_undegraded":"2024-04-26T23:49:30.287388+0000","last_fullsized":"2024-04-26T23:49:30.287388+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":3869,"log_dups_size":0,"ondisk_log_size":3869,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:10:11.728359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":58020,"num_write_kb":724597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"26'3920","reported_seq":3948,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.908644+0000","last_change":"2024-04-26T23:40:32.576783+0000","last_active":"2024-04-26T23:49:42.908644+0000","last_peered":"2024-04-26T23:49:42.908644+0000","last_clean":"2024-04-26T23:49:42.908644+0000","last_became_active":"2024-04-26T23:40:32.576481+0000","last_became_peered":"2024-04-26T23:40:32.576481+0000","last_unstale":"2024-04-26T23:49:42.908644+0000","last_undegraded":"2024-04-26T23:49:42.908644+0000","last_fullsized":"2024-04-26T23:49:42.908644+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":3920,"log_dups_size":0,"ondisk_log_size":3920,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:16:46.547536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":58555,"num_write_kb":772397,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"26'17","reported_seq":62,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:40.459144+0000","last_change":"2024-04-26T23:40:31.570775+0000","last_active":"2024-04-26T23:49:40.459144+0000","last_peered":"2024-04-26T23:49:40.459144+0000","last_clean":"2024-04-26T23:49:40.459144+0000","last_became_active":"2024-04-26T23:40:31.570493+0000","last_became_peered":"2024-04-26T23:40:31.570493+0000","last_unstale":"2024-04-26T23:49:40.459144+0000","last_undegraded":"2024-04-26T23:49:40.459144+0000","last_fullsized":"2024-04-26T23:49:40.459144+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:45:49.295198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88181,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":95,"num_write":15,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"26'23","reported_seq":45,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:30.334159+0000","last_change":"2024-04-26T23:40:40.675115+0000","last_active":"2024-04-26T23:49:30.334159+0000","last_peered":"2024-04-26T23:49:30.334159+0000","last_clean":"2024-04-26T23:49:30.334159+0000","last_became_active":"2024-04-26T23:40:40.674828+0000","last_became_peered":"2024-04-26T23:40:40.674828+0000","last_unstale":"2024-04-26T23:49:30.334159+0000","last_undegraded":"2024-04-26T23:49:30.334159+0000","last_fullsized":"2024-04-26T23:49:30.334159+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:45:07.071050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":4104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"26'4508","reported_seq":4528,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:30.332520+0000","last_change":"2024-04-26T23:40:41.691098+0000","last_active":"2024-04-26T23:49:30.332520+0000","last_peered":"2024-04-26T23:49:30.332520+0000","last_clean":"2024-04-26T23:49:30.332520+0000","last_became_active":"2024-04-26T23:40:41.690803+0000","last_became_peered":"2024-04-26T23:40:41.690803+0000","last_unstale":"2024-04-26T23:49:30.332520+0000","last_undegraded":"2024-04-26T23:49:30.332520+0000","last_fullsized":"2024-04-26T23:49:30.332520+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":4508,"log_dups_size":0,"ondisk_log_size":4508,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:38:51.195172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":67888,"num_write_kb":829373,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"26'4011","reported_seq":4039,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.893538+0000","last_change":"2024-04-26T23:40:32.593262+0000","last_active":"2024-04-26T23:49:42.893538+0000","last_peered":"2024-04-26T23:49:42.893538+0000","last_clean":"2024-04-26T23:49:42.893538+0000","last_became_active":"2024-04-26T23:40:32.593003+0000","last_became_peered":"2024-04-26T23:40:32.593003+0000","last_unstale":"2024-04-26T23:49:42.893538+0000","last_undegraded":"2024-04-26T23:49:42.893538+0000","last_fullsized":"2024-04-26T23:49:42.893538+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":4011,"log_dups_size":0,"ondisk_log_size":4011,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:47:51.559918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":60122,"num_write_kb":778045,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"26'35","reported_seq":65,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:36.408525+0000","last_change":"2024-04-26T23:40:31.573864+0000","last_active":"2024-04-26T23:49:36.408525+0000","last_peered":"2024-04-26T23:49:36.408525+0000","last_clean":"2024-04-26T23:49:36.408525+0000","last_became_active":"2024-04-26T23:40:31.573594+0000","last_became_peered":"2024-04-26T23:40:31.573594+0000","last_unstale":"2024-04-26T23:49:36.408525+0000","last_undegraded":"2024-04-26T23:49:36.408525+0000","last_fullsized":"2024-04-26T23:49:36.408525+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:48:32.015654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":8204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"26'252","reported_seq":274,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:36.228459+0000","last_change":"2024-04-26T23:40:40.677258+0000","last_active":"2024-04-26T23:49:36.228459+0000","last_peered":"2024-04-26T23:49:36.228459+0000","last_clean":"2024-04-26T23:49:36.228459+0000","last_became_active":"2024-04-26T23:40:40.676937+0000","last_became_peered":"2024-04-26T23:40:40.676937+0000","last_unstale":"2024-04-26T23:49:36.228459+0000","last_undegraded":"2024-04-26T23:49:36.228459+0000","last_fullsized":"2024-04-26T23:49:36.228459+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":252,"log_dups_size":0,"ondisk_log_size":252,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:44:50.588556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":473,"num_write_kb":168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"26'4519","reported_seq":4539,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:30.334012+0000","last_change":"2024-04-26T23:40:41.684731+0000","last_active":"2024-04-26T23:49:30.334012+0000","last_peered":"2024-04-26T23:49:30.334012+0000","last_clean":"2024-04-26T23:49:30.334012+0000","last_became_active":"2024-04-26T23:40:41.684459+0000","last_became_peered":"2024-04-26T23:40:41.684459+0000","last_unstale":"2024-04-26T23:49:30.334012+0000","last_undegraded":"2024-04-26T23:49:30.334012+0000","last_fullsized":"2024-04-26T23:49:30.334012+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":4519,"log_dups_size":0,"ondisk_log_size":4519,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:24:07.784468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":68252,"num_write_kb":886817,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"26'4332","reported_seq":4360,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.920042+0000","last_change":"2024-04-26T23:40:32.593216+0000","last_active":"2024-04-26T23:49:42.920042+0000","last_peered":"2024-04-26T23:49:42.920042+0000","last_clean":"2024-04-26T23:49:42.920042+0000","last_became_active":"2024-04-26T23:40:32.592929+0000","last_became_peered":"2024-04-26T23:40:32.592929+0000","last_unstale":"2024-04-26T23:49:42.920042+0000","last_undegraded":"2024-04-26T23:49:42.920042+0000","last_fullsized":"2024-04-26T23:49:42.920042+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":4332,"log_dups_size":0,"ondisk_log_size":4332,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:12:45.093169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":65153,"num_write_kb":829422,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"26'2","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:48:10.239534+0000","last_change":"2024-04-26T23:40:31.570118+0000","last_active":"2024-04-26T23:48:10.239534+0000","last_peered":"2024-04-26T23:48:10.239534+0000","last_clean":"2024-04-26T23:48:10.239534+0000","last_became_active":"2024-04-26T23:40:31.569764+0000","last_became_peered":"2024-04-26T23:40:31.569764+0000","last_unstale":"2024-04-26T23:48:10.239534+0000","last_undegraded":"2024-04-26T23:48:10.239534+0000","last_fullsized":"2024-04-26T23:48:10.239534+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:15:30.884135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":186,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:46:31.335185+0000","last_change":"2024-04-26T23:40:20.966672+0000","last_active":"2024-04-26T23:46:31.335185+0000","last_peered":"2024-04-26T23:46:31.335185+0000","last_clean":"2024-04-26T23:46:31.335185+0000","last_became_active":"2024-04-26T23:40:20.963937+0000","last_became_peered":"2024-04-26T23:40:20.963937+0000","last_unstale":"2024-04-26T23:46:31.335185+0000","last_undegraded":"2024-04-26T23:46:31.335185+0000","last_fullsized":"2024-04-26T23:46:31.335185+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:19.950137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:19.950137+0000","last_clean_scrub_stamp":"2024-04-26T23:40:19.950137+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:23:39.166579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"26'7","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:30.322697+0000","last_change":"2024-04-26T23:40:40.671995+0000","last_active":"2024-04-26T23:49:30.322697+0000","last_peered":"2024-04-26T23:49:30.322697+0000","last_clean":"2024-04-26T23:49:30.322697+0000","last_became_active":"2024-04-26T23:40:40.671642+0000","last_became_peered":"2024-04-26T23:40:40.671642+0000","last_unstale":"2024-04-26T23:49:30.322697+0000","last_undegraded":"2024-04-26T23:49:30.322697+0000","last_fullsized":"2024-04-26T23:49:30.322697+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:35:16.288571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"26'3788","reported_seq":3808,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:32.348847+0000","last_change":"2024-04-26T23:40:41.680852+0000","last_active":"2024-04-26T23:49:32.348847+0000","last_peered":"2024-04-26T23:49:32.348847+0000","last_clean":"2024-04-26T23:49:32.348847+0000","last_became_active":"2024-04-26T23:40:41.680567+0000","last_became_peered":"2024-04-26T23:40:41.680567+0000","last_unstale":"2024-04-26T23:49:32.348847+0000","last_undegraded":"2024-04-26T23:49:32.348847+0000","last_fullsized":"2024-04-26T23:49:32.348847+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":3788,"log_dups_size":0,"ondisk_log_size":3788,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:40:15.485085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":57172,"num_write_kb":707056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"26'4186","reported_seq":4214,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.944934+0000","last_change":"2024-04-26T23:40:32.591906+0000","last_active":"2024-04-26T23:49:42.944934+0000","last_peered":"2024-04-26T23:49:42.944934+0000","last_clean":"2024-04-26T23:49:42.944934+0000","last_became_active":"2024-04-26T23:40:32.590867+0000","last_became_peered":"2024-04-26T23:40:32.590867+0000","last_unstale":"2024-04-26T23:49:42.944934+0000","last_undegraded":"2024-04-26T23:49:42.944934+0000","last_fullsized":"2024-04-26T23:49:42.944934+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":4186,"log_dups_size":0,"ondisk_log_size":4186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:56:04.309611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":62827,"num_write_kb":810912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"26'3","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:36.388158+0000","last_change":"2024-04-26T23:40:31.572391+0000","last_active":"2024-04-26T23:49:36.388158+0000","last_peered":"2024-04-26T23:49:36.388158+0000","last_clean":"2024-04-26T23:49:36.388158+0000","last_became_active":"2024-04-26T23:40:31.571849+0000","last_became_peered":"2024-04-26T23:40:31.571849+0000","last_unstale":"2024-04-26T23:49:36.388158+0000","last_undegraded":"2024-04-26T23:49:36.388158+0000","last_fullsized":"2024-04-26T23:49:36.388158+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:35:54.439397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"26'6","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:30.330522+0000","last_change":"2024-04-26T23:40:40.676464+0000","last_active":"2024-04-26T23:49:30.330522+0000","last_peered":"2024-04-26T23:49:30.330522+0000","last_clean":"2024-04-26T23:49:30.330522+0000","last_became_active":"2024-04-26T23:40:40.676154+0000","last_became_peered":"2024-04-26T23:40:40.676154+0000","last_unstale":"2024-04-26T23:49:30.330522+0000","last_undegraded":"2024-04-26T23:49:30.330522+0000","last_fullsized":"2024-04-26T23:49:30.330522+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:52:34.793496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"26'3982","reported_seq":4002,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:30.199676+0000","last_change":"2024-04-26T23:40:41.688065+0000","last_active":"2024-04-26T23:49:30.199676+0000","last_peered":"2024-04-26T23:49:30.199676+0000","last_clean":"2024-04-26T23:49:30.199676+0000","last_became_active":"2024-04-26T23:40:41.687693+0000","last_became_peered":"2024-04-26T23:40:41.687693+0000","last_unstale":"2024-04-26T23:49:30.199676+0000","last_undegraded":"2024-04-26T23:49:30.199676+0000","last_fullsized":"2024-04-26T23:49:30.199676+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":3982,"log_dups_size":0,"ondisk_log_size":3982,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:35:17.294025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":60042,"num_write_kb":782772,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"26'4287","reported_seq":4315,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.934302+0000","last_change":"2024-04-26T23:40:32.583469+0000","last_active":"2024-04-26T23:49:42.934302+0000","last_peered":"2024-04-26T23:49:42.934302+0000","last_clean":"2024-04-26T23:49:42.934302+0000","last_became_active":"2024-04-26T23:40:32.583174+0000","last_became_peered":"2024-04-26T23:40:32.583174+0000","last_unstale":"2024-04-26T23:49:42.934302+0000","last_undegraded":"2024-04-26T23:49:42.934302+0000","last_fullsized":"2024-04-26T23:49:42.934302+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":4287,"log_dups_size":0,"ondisk_log_size":4287,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:34:14.811917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":64102,"num_write_kb":832828,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"26'6","reported_seq":36,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:34.388816+0000","last_change":"2024-04-26T23:40:31.571749+0000","last_active":"2024-04-26T23:49:34.388816+0000","last_peered":"2024-04-26T23:49:34.388816+0000","last_clean":"2024-04-26T23:49:34.388816+0000","last_became_active":"2024-04-26T23:40:31.571427+0000","last_became_peered":"2024-04-26T23:40:31.571427+0000","last_unstale":"2024-04-26T23:49:34.388816+0000","last_undegraded":"2024-04-26T23:49:34.388816+0000","last_fullsized":"2024-04-26T23:49:34.388816+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:20:28.103413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"26'155","reported_seq":177,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:32.342498+0000","last_change":"2024-04-26T23:40:40.675987+0000","last_active":"2024-04-26T23:49:32.342498+0000","last_peered":"2024-04-26T23:49:32.342498+0000","last_clean":"2024-04-26T23:49:32.342498+0000","last_became_active":"2024-04-26T23:40:40.675682+0000","last_became_peered":"2024-04-26T23:40:40.675682+0000","last_unstale":"2024-04-26T23:49:32.342498+0000","last_undegraded":"2024-04-26T23:49:32.342498+0000","last_fullsized":"2024-04-26T23:49:32.342498+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":155,"log_dups_size":0,"ondisk_log_size":155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:10:10.722905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":145,"num_write_kb":8318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"26'4188","reported_seq":4208,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:32.332216+0000","last_change":"2024-04-26T23:40:41.681408+0000","last_active":"2024-04-26T23:49:32.332216+0000","last_peered":"2024-04-26T23:49:32.332216+0000","last_clean":"2024-04-26T23:49:32.332216+0000","last_became_active":"2024-04-26T23:40:41.681069+0000","last_became_peered":"2024-04-26T23:40:41.681069+0000","last_unstale":"2024-04-26T23:49:32.332216+0000","last_undegraded":"2024-04-26T23:49:32.332216+0000","last_fullsized":"2024-04-26T23:49:32.332216+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":4188,"log_dups_size":0,"ondisk_log_size":4188,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:10:30.972726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":63216,"num_write_kb":796499,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"26'4864","reported_seq":4892,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.993843+0000","last_change":"2024-04-26T23:40:32.596306+0000","last_active":"2024-04-26T23:49:42.993843+0000","last_peered":"2024-04-26T23:49:42.993843+0000","last_clean":"2024-04-26T23:49:42.993843+0000","last_became_active":"2024-04-26T23:40:32.595625+0000","last_became_peered":"2024-04-26T23:40:32.595625+0000","last_unstale":"2024-04-26T23:49:42.993843+0000","last_undegraded":"2024-04-26T23:49:42.993843+0000","last_fullsized":"2024-04-26T23:49:42.993843+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":4864,"log_dups_size":0,"ondisk_log_size":4864,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:10:02.629199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":72976,"num_write_kb":927582,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"26'23","reported_seq":53,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:36.412667+0000","last_change":"2024-04-26T23:40:31.570870+0000","last_active":"2024-04-26T23:49:36.412667+0000","last_peered":"2024-04-26T23:49:36.412667+0000","last_clean":"2024-04-26T23:49:36.412667+0000","last_became_active":"2024-04-26T23:40:31.570592+0000","last_became_peered":"2024-04-26T23:40:31.570592+0000","last_unstale":"2024-04-26T23:49:36.412667+0000","last_undegraded":"2024-04-26T23:49:36.412667+0000","last_fullsized":"2024-04-26T23:49:36.412667+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:43:13.740214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":4104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"26'8","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:30.313360+0000","last_change":"2024-04-26T23:40:40.673142+0000","last_active":"2024-04-26T23:49:30.313360+0000","last_peered":"2024-04-26T23:49:30.313360+0000","last_clean":"2024-04-26T23:49:30.313360+0000","last_became_active":"2024-04-26T23:40:40.672816+0000","last_became_peered":"2024-04-26T23:40:40.672816+0000","last_unstale":"2024-04-26T23:49:30.313360+0000","last_undegraded":"2024-04-26T23:49:30.313360+0000","last_fullsized":"2024-04-26T23:49:30.313360+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:53:12.526011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"26'4528","reported_seq":4548,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:30.271481+0000","last_change":"2024-04-26T23:40:41.678588+0000","last_active":"2024-04-26T23:49:30.271481+0000","last_peered":"2024-04-26T23:49:30.271481+0000","last_clean":"2024-04-26T23:49:30.271481+0000","last_became_active":"2024-04-26T23:40:41.678039+0000","last_became_peered":"2024-04-26T23:40:41.678039+0000","last_unstale":"2024-04-26T23:49:30.271481+0000","last_undegraded":"2024-04-26T23:49:30.271481+0000","last_fullsized":"2024-04-26T23:49:30.271481+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":4528,"log_dups_size":0,"ondisk_log_size":4528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:04:39.652713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":68234,"num_write_kb":870585,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"26'4022","reported_seq":4050,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.887550+0000","last_change":"2024-04-26T23:40:32.593577+0000","last_active":"2024-04-26T23:49:42.887550+0000","last_peered":"2024-04-26T23:49:42.887550+0000","last_clean":"2024-04-26T23:49:42.887550+0000","last_became_active":"2024-04-26T23:40:32.593235+0000","last_became_peered":"2024-04-26T23:40:32.593235+0000","last_unstale":"2024-04-26T23:49:42.887550+0000","last_undegraded":"2024-04-26T23:49:42.887550+0000","last_fullsized":"2024-04-26T23:49:42.887550+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":4022,"log_dups_size":0,"ondisk_log_size":4022,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:01:02.741964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":60538,"num_write_kb":762431,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"26'9","reported_seq":39,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:36.422094+0000","last_change":"2024-04-26T23:40:31.575943+0000","last_active":"2024-04-26T23:49:36.422094+0000","last_peered":"2024-04-26T23:49:36.422094+0000","last_clean":"2024-04-26T23:49:36.422094+0000","last_became_active":"2024-04-26T23:40:31.575632+0000","last_became_peered":"2024-04-26T23:40:31.575632+0000","last_unstale":"2024-04-26T23:49:36.422094+0000","last_undegraded":"2024-04-26T23:49:36.422094+0000","last_fullsized":"2024-04-26T23:49:36.422094+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:11:08.189634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"26'7","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:30.331487+0000","last_change":"2024-04-26T23:40:40.676297+0000","last_active":"2024-04-26T23:49:30.331487+0000","last_peered":"2024-04-26T23:49:30.331487+0000","last_clean":"2024-04-26T23:49:30.331487+0000","last_became_active":"2024-04-26T23:40:40.675888+0000","last_became_peered":"2024-04-26T23:40:40.675888+0000","last_unstale":"2024-04-26T23:49:30.331487+0000","last_undegraded":"2024-04-26T23:49:30.331487+0000","last_fullsized":"2024-04-26T23:49:30.331487+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:04:38.647258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.17","version":"26'3925","reported_seq":3944,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:32.356196+0000","last_change":"2024-04-26T23:40:41.688506+0000","last_active":"2024-04-26T23:49:32.356196+0000","last_peered":"2024-04-26T23:49:32.356196+0000","last_clean":"2024-04-26T23:49:32.356196+0000","last_became_active":"2024-04-26T23:40:41.688224+0000","last_became_peered":"2024-04-26T23:40:41.688224+0000","last_unstale":"2024-04-26T23:49:32.356196+0000","last_undegraded":"2024-04-26T23:49:32.356196+0000","last_fullsized":"2024-04-26T23:49:32.356196+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":3925,"log_dups_size":0,"ondisk_log_size":3925,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:05:34.008024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":58974,"num_write_kb":744310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"26'3924","reported_seq":3951,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.884380+0000","last_change":"2024-04-26T23:40:32.593528+0000","last_active":"2024-04-26T23:49:42.884380+0000","last_peered":"2024-04-26T23:49:42.884380+0000","last_clean":"2024-04-26T23:49:42.884380+0000","last_became_active":"2024-04-26T23:40:32.593220+0000","last_became_peered":"2024-04-26T23:40:32.593220+0000","last_unstale":"2024-04-26T23:49:42.884380+0000","last_undegraded":"2024-04-26T23:49:42.884380+0000","last_fullsized":"2024-04-26T23:49:42.884380+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":3924,"log_dups_size":0,"ondisk_log_size":3924,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:04:30.553552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":58510,"num_write_kb":806052,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"26'50","reported_seq":80,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:40.460675+0000","last_change":"2024-04-26T23:40:31.572685+0000","last_active":"2024-04-26T23:49:40.460675+0000","last_peered":"2024-04-26T23:49:40.460675+0000","last_clean":"2024-04-26T23:49:40.460675+0000","last_became_active":"2024-04-26T23:40:31.572169+0000","last_became_peered":"2024-04-26T23:40:31.572169+0000","last_unstale":"2024-04-26T23:49:40.460675+0000","last_undegraded":"2024-04-26T23:49:40.460675+0000","last_fullsized":"2024-04-26T23:49:40.460675+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:15:30.884135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":8207,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"26'31","reported_seq":52,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:30.331813+0000","last_change":"2024-04-26T23:40:40.672160+0000","last_active":"2024-04-26T23:49:30.331813+0000","last_peered":"2024-04-26T23:49:30.331813+0000","last_clean":"2024-04-26T23:49:30.331813+0000","last_became_active":"2024-04-26T23:40:40.671875+0000","last_became_peered":"2024-04-26T23:40:40.671875+0000","last_unstale":"2024-04-26T23:49:30.331813+0000","last_undegraded":"2024-04-26T23:49:30.331813+0000","last_fullsized":"2024-04-26T23:49:30.331813+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:35:16.288571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":4110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"26'4508","reported_seq":4527,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:30.329720+0000","last_change":"2024-04-26T23:40:41.688445+0000","last_active":"2024-04-26T23:49:30.329720+0000","last_peered":"2024-04-26T23:49:30.329720+0000","last_clean":"2024-04-26T23:49:30.329720+0000","last_became_active":"2024-04-26T23:40:41.688053+0000","last_became_peered":"2024-04-26T23:40:41.688053+0000","last_unstale":"2024-04-26T23:49:30.329720+0000","last_undegraded":"2024-04-26T23:49:30.329720+0000","last_fullsized":"2024-04-26T23:49:30.329720+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":4508,"log_dups_size":0,"ondisk_log_size":4508,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:08:35.027584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":67755,"num_write_kb":851157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"26'4530","reported_seq":4558,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.907543+0000","last_change":"2024-04-26T23:40:32.586832+0000","last_active":"2024-04-26T23:49:42.907543+0000","last_peered":"2024-04-26T23:49:42.907543+0000","last_clean":"2024-04-26T23:49:42.907543+0000","last_became_active":"2024-04-26T23:40:32.585809+0000","last_became_peered":"2024-04-26T23:40:32.585809+0000","last_unstale":"2024-04-26T23:49:42.907543+0000","last_undegraded":"2024-04-26T23:49:42.907543+0000","last_fullsized":"2024-04-26T23:49:42.907543+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":4530,"log_dups_size":0,"ondisk_log_size":4530,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:51:30.677247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":67909,"num_write_kb":843744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"26'6","reported_seq":35,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:36.408234+0000","last_change":"2024-04-26T23:40:31.569512+0000","last_active":"2024-04-26T23:49:36.408234+0000","last_peered":"2024-04-26T23:49:36.408234+0000","last_clean":"2024-04-26T23:49:36.408234+0000","last_became_active":"2024-04-26T23:40:31.568598+0000","last_became_peered":"2024-04-26T23:40:31.568598+0000","last_unstale":"2024-04-26T23:49:36.408234+0000","last_undegraded":"2024-04-26T23:49:36.408234+0000","last_fullsized":"2024-04-26T23:49:36.408234+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:48:32.015654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"26'2","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:48:00.796748+0000","last_change":"2024-04-26T23:40:40.673986+0000","last_active":"2024-04-26T23:48:00.796748+0000","last_peered":"2024-04-26T23:48:00.796748+0000","last_clean":"2024-04-26T23:48:00.796748+0000","last_became_active":"2024-04-26T23:40:40.673704+0000","last_became_peered":"2024-04-26T23:40:40.673704+0000","last_unstale":"2024-04-26T23:48:00.796748+0000","last_undegraded":"2024-04-26T23:48:00.796748+0000","last_fullsized":"2024-04-26T23:48:00.796748+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:37:24.000775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"26'4209","reported_seq":4228,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:30.142174+0000","last_change":"2024-04-26T23:40:41.691441+0000","last_active":"2024-04-26T23:49:30.142174+0000","last_peered":"2024-04-26T23:49:30.142174+0000","last_clean":"2024-04-26T23:49:30.142174+0000","last_became_active":"2024-04-26T23:40:41.691160+0000","last_became_peered":"2024-04-26T23:40:41.691160+0000","last_unstale":"2024-04-26T23:49:30.142174+0000","last_undegraded":"2024-04-26T23:49:30.142174+0000","last_fullsized":"2024-04-26T23:49:30.142174+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":4209,"log_dups_size":0,"ondisk_log_size":4209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:41:52.386084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":63478,"num_write_kb":811778,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"26'4684","reported_seq":4711,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.927995+0000","last_change":"2024-04-26T23:40:32.595377+0000","last_active":"2024-04-26T23:49:42.927995+0000","last_peered":"2024-04-26T23:49:42.927995+0000","last_clean":"2024-04-26T23:49:42.927995+0000","last_became_active":"2024-04-26T23:40:32.595032+0000","last_became_peered":"2024-04-26T23:40:32.595032+0000","last_unstale":"2024-04-26T23:49:42.927995+0000","last_undegraded":"2024-04-26T23:49:42.927995+0000","last_fullsized":"2024-04-26T23:49:42.927995+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":4684,"log_dups_size":0,"ondisk_log_size":4684,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:44:42.494850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":70001,"num_write_kb":901416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"26'5","reported_seq":34,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:36.432793+0000","last_change":"2024-04-26T23:40:31.575493+0000","last_active":"2024-04-26T23:49:36.432793+0000","last_peered":"2024-04-26T23:49:36.432793+0000","last_clean":"2024-04-26T23:49:36.432793+0000","last_became_active":"2024-04-26T23:40:31.575039+0000","last_became_peered":"2024-04-26T23:40:31.575039+0000","last_unstale":"2024-04-26T23:49:36.432793+0000","last_undegraded":"2024-04-26T23:49:36.432793+0000","last_fullsized":"2024-04-26T23:49:36.432793+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:43:13.740214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"26'245","reported_seq":266,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:32.329332+0000","last_change":"2024-04-26T23:40:40.676493+0000","last_active":"2024-04-26T23:49:32.329332+0000","last_peered":"2024-04-26T23:49:32.329332+0000","last_clean":"2024-04-26T23:49:32.329332+0000","last_became_active":"2024-04-26T23:40:40.676124+0000","last_became_peered":"2024-04-26T23:40:40.676124+0000","last_unstale":"2024-04-26T23:49:32.329332+0000","last_undegraded":"2024-04-26T23:49:32.329332+0000","last_fullsized":"2024-04-26T23:49:32.329332+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":245,"log_dups_size":0,"ondisk_log_size":245,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:28:33.915485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583584,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":239,"num_write_kb":12458,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"26'6168","reported_seq":6187,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:30.300205+0000","last_change":"2024-04-26T23:40:41.680735+0000","last_active":"2024-04-26T23:49:30.300205+0000","last_peered":"2024-04-26T23:49:30.300205+0000","last_clean":"2024-04-26T23:49:30.300205+0000","last_became_active":"2024-04-26T23:40:41.680485+0000","last_became_peered":"2024-04-26T23:40:41.680485+0000","last_unstale":"2024-04-26T23:49:30.300205+0000","last_undegraded":"2024-04-26T23:49:30.300205+0000","last_fullsized":"2024-04-26T23:49:30.300205+0000","mapping_epoch":22,"log_start":"26'900","ondisk_log_start":"26'900","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":5268,"log_dups_size":0,"ondisk_log_size":5268,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:38:51.195172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":93116,"num_write_kb":1152811,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"26'3934","reported_seq":3961,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.892973+0000","last_change":"2024-04-26T23:40:32.589706+0000","last_active":"2024-04-26T23:49:42.892973+0000","last_peered":"2024-04-26T23:49:42.892973+0000","last_clean":"2024-04-26T23:49:42.892973+0000","last_became_active":"2024-04-26T23:40:32.589452+0000","last_became_peered":"2024-04-26T23:40:32.589452+0000","last_unstale":"2024-04-26T23:49:42.892973+0000","last_undegraded":"2024-04-26T23:49:42.892973+0000","last_fullsized":"2024-04-26T23:49:42.892973+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":3934,"log_dups_size":0,"ondisk_log_size":3934,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:15:01.970308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":58864,"num_write_kb":755351,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"26'27","reported_seq":56,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:36.415333+0000","last_change":"2024-04-26T23:40:31.573941+0000","last_active":"2024-04-26T23:49:36.415333+0000","last_peered":"2024-04-26T23:49:36.415333+0000","last_clean":"2024-04-26T23:49:36.415333+0000","last_became_active":"2024-04-26T23:40:31.573668+0000","last_became_peered":"2024-04-26T23:40:31.573668+0000","last_unstale":"2024-04-26T23:49:36.415333+0000","last_undegraded":"2024-04-26T23:49:36.415333+0000","last_fullsized":"2024-04-26T23:49:36.415333+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:58:06.477730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":8209,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"26'27","reported_seq":48,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:32.365002+0000","last_change":"2024-04-26T23:40:40.676408+0000","last_active":"2024-04-26T23:49:32.365002+0000","last_peered":"2024-04-26T23:49:32.365002+0000","last_clean":"2024-04-26T23:49:32.365002+0000","last_became_active":"2024-04-26T23:40:40.676147+0000","last_became_peered":"2024-04-26T23:40:40.676147+0000","last_unstale":"2024-04-26T23:49:32.365002+0000","last_undegraded":"2024-04-26T23:49:32.365002+0000","last_fullsized":"2024-04-26T23:49:32.365002+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:27:47.818055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194394,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":4110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.13","version":"26'4979","reported_seq":4998,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:32.348016+0000","last_change":"2024-04-26T23:40:41.685829+0000","last_active":"2024-04-26T23:49:32.348016+0000","last_peered":"2024-04-26T23:49:32.348016+0000","last_clean":"2024-04-26T23:49:32.348016+0000","last_became_active":"2024-04-26T23:40:41.685403+0000","last_became_peered":"2024-04-26T23:40:41.685403+0000","last_unstale":"2024-04-26T23:49:32.348016+0000","last_undegraded":"2024-04-26T23:49:32.348016+0000","last_fullsized":"2024-04-26T23:49:32.348016+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":4979,"log_dups_size":0,"ondisk_log_size":4979,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:24:07.784468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":74752,"num_write_kb":961504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"26'3907","reported_seq":3934,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.911201+0000","last_change":"2024-04-26T23:40:32.587513+0000","last_active":"2024-04-26T23:49:42.911201+0000","last_peered":"2024-04-26T23:49:42.911201+0000","last_clean":"2024-04-26T23:49:42.911201+0000","last_became_active":"2024-04-26T23:40:32.587200+0000","last_became_peered":"2024-04-26T23:40:32.587200+0000","last_unstale":"2024-04-26T23:49:42.911201+0000","last_undegraded":"2024-04-26T23:49:42.911201+0000","last_fullsized":"2024-04-26T23:49:42.911201+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":3907,"log_dups_size":0,"ondisk_log_size":3907,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:37:30.361795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":58714,"num_write_kb":750642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"26'240","reported_seq":269,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:36.399847+0000","last_change":"2024-04-26T23:40:31.572331+0000","last_active":"2024-04-26T23:49:36.399847+0000","last_peered":"2024-04-26T23:49:36.399847+0000","last_clean":"2024-04-26T23:49:36.399847+0000","last_became_active":"2024-04-26T23:40:31.572074+0000","last_became_peered":"2024-04-26T23:40:31.572074+0000","last_unstale":"2024-04-26T23:49:36.399847+0000","last_undegraded":"2024-04-26T23:49:36.399847+0000","last_fullsized":"2024-04-26T23:49:36.399847+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:45:49.295198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583584,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":234,"num_write_kb":12453,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"26'5","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:32.351402+0000","last_change":"2024-04-26T23:40:40.677978+0000","last_active":"2024-04-26T23:49:32.351402+0000","last_peered":"2024-04-26T23:49:32.351402+0000","last_clean":"2024-04-26T23:49:32.351402+0000","last_became_active":"2024-04-26T23:40:40.677714+0000","last_became_peered":"2024-04-26T23:40:40.677714+0000","last_unstale":"2024-04-26T23:49:32.351402+0000","last_undegraded":"2024-04-26T23:49:32.351402+0000","last_fullsized":"2024-04-26T23:49:32.351402+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:44:50.588556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"26'4186","reported_seq":4205,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:30.218788+0000","last_change":"2024-04-26T23:40:41.685431+0000","last_active":"2024-04-26T23:49:30.218788+0000","last_peered":"2024-04-26T23:49:30.218788+0000","last_clean":"2024-04-26T23:49:30.218788+0000","last_became_active":"2024-04-26T23:40:41.685147+0000","last_became_peered":"2024-04-26T23:40:41.685147+0000","last_unstale":"2024-04-26T23:49:30.218788+0000","last_undegraded":"2024-04-26T23:49:30.218788+0000","last_fullsized":"2024-04-26T23:49:30.218788+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":4186,"log_dups_size":0,"ondisk_log_size":4186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:33:16.389626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":62805,"num_write_kb":801211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"26'5530","reported_seq":5557,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.978334+0000","last_change":"2024-04-26T23:40:32.593298+0000","last_active":"2024-04-26T23:49:42.978334+0000","last_peered":"2024-04-26T23:49:42.978334+0000","last_clean":"2024-04-26T23:49:42.978334+0000","last_became_active":"2024-04-26T23:40:32.593030+0000","last_became_peered":"2024-04-26T23:40:32.593030+0000","last_unstale":"2024-04-26T23:49:42.978334+0000","last_undegraded":"2024-04-26T23:49:42.978334+0000","last_fullsized":"2024-04-26T23:49:42.978334+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":5530,"log_dups_size":0,"ondisk_log_size":5530,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:20:29.107798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":83076,"num_write_kb":1053123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"26'25","reported_seq":54,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:36.443568+0000","last_change":"2024-04-26T23:40:31.574234+0000","last_active":"2024-04-26T23:49:36.443568+0000","last_peered":"2024-04-26T23:49:36.443568+0000","last_clean":"2024-04-26T23:49:36.443568+0000","last_became_active":"2024-04-26T23:40:31.572218+0000","last_became_peered":"2024-04-26T23:40:31.572218+0000","last_unstale":"2024-04-26T23:49:36.443568+0000","last_undegraded":"2024-04-26T23:49:36.443568+0000","last_fullsized":"2024-04-26T23:49:36.443568+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:25:01.315397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194394,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":4108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"26'31","reported_seq":52,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:32.332248+0000","last_change":"2024-04-26T23:40:40.674778+0000","last_active":"2024-04-26T23:49:32.332248+0000","last_peered":"2024-04-26T23:49:32.332248+0000","last_clean":"2024-04-26T23:49:32.332248+0000","last_became_active":"2024-04-26T23:40:40.674487+0000","last_became_peered":"2024-04-26T23:40:40.674487+0000","last_unstale":"2024-04-26T23:49:32.332248+0000","last_undegraded":"2024-04-26T23:49:32.332248+0000","last_fullsized":"2024-04-26T23:49:32.332248+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:10:10.722905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":8207,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"26'4271","reported_seq":4290,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:32.333272+0000","last_change":"2024-04-26T23:40:41.686531+0000","last_active":"2024-04-26T23:49:32.333272+0000","last_peered":"2024-04-26T23:49:32.333272+0000","last_clean":"2024-04-26T23:49:32.333272+0000","last_became_active":"2024-04-26T23:40:41.686259+0000","last_became_peered":"2024-04-26T23:40:41.686259+0000","last_unstale":"2024-04-26T23:49:32.333272+0000","last_undegraded":"2024-04-26T23:49:32.333272+0000","last_fullsized":"2024-04-26T23:49:32.333272+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":4271,"log_dups_size":0,"ondisk_log_size":4271,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:45:34.231942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":64273,"num_write_kb":853172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"26'3697","reported_seq":3729,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.884964+0000","last_change":"2024-04-26T23:41:30.513928+0000","last_active":"2024-04-26T23:49:42.884964+0000","last_peered":"2024-04-26T23:49:42.884964+0000","last_clean":"2024-04-26T23:49:42.884964+0000","last_became_active":"2024-04-26T23:41:30.513492+0000","last_became_peered":"2024-04-26T23:41:30.513492+0000","last_unstale":"2024-04-26T23:49:42.884964+0000","last_undegraded":"2024-04-26T23:49:42.884964+0000","last_fullsized":"2024-04-26T23:49:42.884964+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":3697,"log_dups_size":0,"ondisk_log_size":3697,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:41:43.286923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55355,"num_write_kb":693310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"26'22","reported_seq":51,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:36.405506+0000","last_change":"2024-04-26T23:40:31.575616+0000","last_active":"2024-04-26T23:49:36.405506+0000","last_peered":"2024-04-26T23:49:36.405506+0000","last_clean":"2024-04-26T23:49:36.405506+0000","last_became_active":"2024-04-26T23:40:31.575211+0000","last_became_peered":"2024-04-26T23:40:31.575211+0000","last_unstale":"2024-04-26T23:49:36.405506+0000","last_undegraded":"2024-04-26T23:49:36.405506+0000","last_fullsized":"2024-04-26T23:49:36.405506+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:48:32.015654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":4104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"26'38","reported_seq":59,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:30.334226+0000","last_change":"2024-04-26T23:40:40.675694+0000","last_active":"2024-04-26T23:49:30.334226+0000","last_peered":"2024-04-26T23:49:30.334226+0000","last_clean":"2024-04-26T23:49:30.334226+0000","last_became_active":"2024-04-26T23:40:40.675459+0000","last_became_peered":"2024-04-26T23:40:40.675459+0000","last_unstale":"2024-04-26T23:49:30.334226+0000","last_undegraded":"2024-04-26T23:49:30.334226+0000","last_fullsized":"2024-04-26T23:49:30.334226+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:30:03.993564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36,"num_write_kb":8203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"26'4893","reported_seq":4912,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:32.330028+0000","last_change":"2024-04-26T23:40:41.687488+0000","last_active":"2024-04-26T23:49:32.330028+0000","last_peered":"2024-04-26T23:49:32.330028+0000","last_clean":"2024-04-26T23:49:32.330028+0000","last_became_active":"2024-04-26T23:40:41.687210+0000","last_became_peered":"2024-04-26T23:40:41.687210+0000","last_unstale":"2024-04-26T23:49:32.330028+0000","last_undegraded":"2024-04-26T23:49:32.330028+0000","last_fullsized":"2024-04-26T23:49:32.330028+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":4893,"log_dups_size":0,"ondisk_log_size":4893,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:36:21.487122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":73846,"num_write_kb":901080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"26'4194","reported_seq":4207,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.872278+0000","last_change":"2024-04-26T23:41:30.751583+0000","last_active":"2024-04-26T23:49:42.872278+0000","last_peered":"2024-04-26T23:49:42.872278+0000","last_clean":"2024-04-26T23:49:42.872278+0000","last_became_active":"2024-04-26T23:41:30.751285+0000","last_became_peered":"2024-04-26T23:41:30.751285+0000","last_unstale":"2024-04-26T23:49:42.872278+0000","last_undegraded":"2024-04-26T23:49:42.872278+0000","last_fullsized":"2024-04-26T23:49:42.872278+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":4194,"log_dups_size":0,"ondisk_log_size":4194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:36:12.387962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":63007,"num_write_kb":791881,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"26'2","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:47:52.159460+0000","last_change":"2024-04-26T23:40:31.573794+0000","last_active":"2024-04-26T23:47:52.159460+0000","last_peered":"2024-04-26T23:47:52.159460+0000","last_clean":"2024-04-26T23:47:52.159460+0000","last_became_active":"2024-04-26T23:40:31.573164+0000","last_became_peered":"2024-04-26T23:40:31.573164+0000","last_unstale":"2024-04-26T23:47:52.159460+0000","last_undegraded":"2024-04-26T23:47:52.159460+0000","last_fullsized":"2024-04-26T23:47:52.159460+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:15:30.884135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"26'6","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:30.333939+0000","last_change":"2024-04-26T23:40:40.674127+0000","last_active":"2024-04-26T23:49:30.333939+0000","last_peered":"2024-04-26T23:49:30.333939+0000","last_clean":"2024-04-26T23:49:30.333939+0000","last_became_active":"2024-04-26T23:40:40.673793+0000","last_became_peered":"2024-04-26T23:40:40.673793+0000","last_unstale":"2024-04-26T23:49:30.333939+0000","last_undegraded":"2024-04-26T23:49:30.333939+0000","last_fullsized":"2024-04-26T23:49:30.333939+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:53:12.526011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"26'5246","reported_seq":5266,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:32.332088+0000","last_change":"2024-04-26T23:40:41.686867+0000","last_active":"2024-04-26T23:49:32.332088+0000","last_peered":"2024-04-26T23:49:32.332088+0000","last_clean":"2024-04-26T23:49:32.332088+0000","last_became_active":"2024-04-26T23:40:41.686536+0000","last_became_peered":"2024-04-26T23:40:41.686536+0000","last_unstale":"2024-04-26T23:49:32.332088+0000","last_undegraded":"2024-04-26T23:49:32.332088+0000","last_fullsized":"2024-04-26T23:49:32.332088+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":5246,"log_dups_size":0,"ondisk_log_size":5246,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:28:34.920939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":78945,"num_write_kb":1046825,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"26'13","reported_seq":35,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:30.333687+0000","last_change":"2024-04-26T23:40:40.674915+0000","last_active":"2024-04-26T23:49:30.333687+0000","last_peered":"2024-04-26T23:49:30.333687+0000","last_clean":"2024-04-26T23:49:30.333687+0000","last_became_active":"2024-04-26T23:40:40.674639+0000","last_became_peered":"2024-04-26T23:40:40.674639+0000","last_unstale":"2024-04-26T23:49:30.333687+0000","last_undegraded":"2024-04-26T23:49:30.333687+0000","last_fullsized":"2024-04-26T23:49:30.333687+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:52:34.793496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":4106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"26'4888","reported_seq":4915,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.913026+0000","last_change":"2024-04-26T23:40:32.583014+0000","last_active":"2024-04-26T23:49:42.913026+0000","last_peered":"2024-04-26T23:49:42.913026+0000","last_clean":"2024-04-26T23:49:42.913026+0000","last_became_active":"2024-04-26T23:40:32.582751+0000","last_became_peered":"2024-04-26T23:40:32.582751+0000","last_unstale":"2024-04-26T23:49:42.913026+0000","last_undegraded":"2024-04-26T23:49:42.913026+0000","last_fullsized":"2024-04-26T23:49:42.913026+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":4888,"log_dups_size":0,"ondisk_log_size":4888,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:38:10.884592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":73256,"num_write_kb":928290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"26'27","reported_seq":56,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:36.360432+0000","last_change":"2024-04-26T23:40:31.572402+0000","last_active":"2024-04-26T23:49:36.360432+0000","last_peered":"2024-04-26T23:49:36.360432+0000","last_clean":"2024-04-26T23:49:36.360432+0000","last_became_active":"2024-04-26T23:40:31.572111+0000","last_became_peered":"2024-04-26T23:40:31.572111+0000","last_unstale":"2024-04-26T23:49:36.360432+0000","last_undegraded":"2024-04-26T23:49:36.360432+0000","last_fullsized":"2024-04-26T23:49:36.360432+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:20:28.103413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":8213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"26'4749","reported_seq":4769,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:30.243878+0000","last_change":"2024-04-26T23:40:41.684524+0000","last_active":"2024-04-26T23:49:30.243878+0000","last_peered":"2024-04-26T23:49:30.243878+0000","last_clean":"2024-04-26T23:49:30.243878+0000","last_became_active":"2024-04-26T23:40:41.684207+0000","last_became_peered":"2024-04-26T23:40:41.684207+0000","last_unstale":"2024-04-26T23:49:30.243878+0000","last_undegraded":"2024-04-26T23:49:30.243878+0000","last_fullsized":"2024-04-26T23:49:30.243878+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":4749,"log_dups_size":0,"ondisk_log_size":4749,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:30:04.999018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":71582,"num_write_kb":928660,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"26'143","reported_seq":165,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:35.863318+0000","last_change":"2024-04-26T23:40:40.674934+0000","last_active":"2024-04-26T23:49:35.863318+0000","last_peered":"2024-04-26T23:49:35.863318+0000","last_clean":"2024-04-26T23:49:35.863318+0000","last_became_active":"2024-04-26T23:40:40.674628+0000","last_became_peered":"2024-04-26T23:40:40.674628+0000","last_unstale":"2024-04-26T23:49:35.863318+0000","last_undegraded":"2024-04-26T23:49:35.863318+0000","last_fullsized":"2024-04-26T23:49:35.863318+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":143,"log_dups_size":0,"ondisk_log_size":143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:44:50.588556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7745102,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":140,"num_write_kb":7620,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"26'4156","reported_seq":4183,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.919386+0000","last_change":"2024-04-26T23:40:32.586204+0000","last_active":"2024-04-26T23:49:42.919386+0000","last_peered":"2024-04-26T23:49:42.919386+0000","last_clean":"2024-04-26T23:49:42.919386+0000","last_became_active":"2024-04-26T23:40:32.585725+0000","last_became_peered":"2024-04-26T23:40:32.585725+0000","last_unstale":"2024-04-26T23:49:42.919386+0000","last_undegraded":"2024-04-26T23:49:42.919386+0000","last_fullsized":"2024-04-26T23:49:42.919386+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":4156,"log_dups_size":0,"ondisk_log_size":4156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:51:30.677247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":62294,"num_write_kb":802311,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"26'20","reported_seq":49,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:47:55.248638+0000","last_change":"2024-04-26T23:40:31.578929+0000","last_active":"2024-04-26T23:47:55.248638+0000","last_peered":"2024-04-26T23:47:55.248638+0000","last_clean":"2024-04-26T23:47:55.248638+0000","last_became_active":"2024-04-26T23:40:31.578623+0000","last_became_peered":"2024-04-26T23:40:31.578623+0000","last_unstale":"2024-04-26T23:47:55.248638+0000","last_undegraded":"2024-04-26T23:47:55.248638+0000","last_fullsized":"2024-04-26T23:47:55.248638+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:50:21.330821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":4105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"26'5403","reported_seq":5422,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:30.316265+0000","last_change":"2024-04-26T23:40:41.689697+0000","last_active":"2024-04-26T23:49:30.316265+0000","last_peered":"2024-04-26T23:49:30.316265+0000","last_clean":"2024-04-26T23:49:30.316265+0000","last_became_active":"2024-04-26T23:40:41.688428+0000","last_became_peered":"2024-04-26T23:40:41.688428+0000","last_unstale":"2024-04-26T23:49:30.316265+0000","last_undegraded":"2024-04-26T23:49:30.316265+0000","last_fullsized":"2024-04-26T23:49:30.316265+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":5403,"log_dups_size":0,"ondisk_log_size":5403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:36:21.487122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":81566,"num_write_kb":1040251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1a","version":"26'33","reported_seq":62,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:36.399499+0000","last_change":"2024-04-26T23:40:31.567755+0000","last_active":"2024-04-26T23:49:36.399499+0000","last_peered":"2024-04-26T23:49:36.399499+0000","last_clean":"2024-04-26T23:49:36.399499+0000","last_became_active":"2024-04-26T23:40:31.567484+0000","last_became_peered":"2024-04-26T23:40:31.567484+0000","last_unstale":"2024-04-26T23:49:36.399499+0000","last_undegraded":"2024-04-26T23:49:36.399499+0000","last_fullsized":"2024-04-26T23:49:36.399499+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:43:13.740214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":12305,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"26'3282","reported_seq":3309,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.939435+0000","last_change":"2024-04-26T23:40:32.594689+0000","last_active":"2024-04-26T23:49:42.939435+0000","last_peered":"2024-04-26T23:49:42.939435+0000","last_clean":"2024-04-26T23:49:42.939435+0000","last_became_active":"2024-04-26T23:40:32.592365+0000","last_became_peered":"2024-04-26T23:40:32.592365+0000","last_unstale":"2024-04-26T23:49:42.939435+0000","last_undegraded":"2024-04-26T23:49:42.939435+0000","last_fullsized":"2024-04-26T23:49:42.939435+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":3282,"log_dups_size":0,"ondisk_log_size":3282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:17:46.135806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49199,"num_write_kb":619171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"26'14","reported_seq":35,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:48:17.852707+0000","last_change":"2024-04-26T23:40:40.676028+0000","last_active":"2024-04-26T23:48:17.852707+0000","last_peered":"2024-04-26T23:48:17.852707+0000","last_clean":"2024-04-26T23:48:17.852707+0000","last_became_active":"2024-04-26T23:40:40.675736+0000","last_became_peered":"2024-04-26T23:40:40.675736+0000","last_unstale":"2024-04-26T23:48:17.852707+0000","last_undegraded":"2024-04-26T23:48:17.852707+0000","last_fullsized":"2024-04-26T23:48:17.852707+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:51:38.770953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":4102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"26'3294","reported_seq":3313,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:30.269215+0000","last_change":"2024-04-26T23:40:41.690148+0000","last_active":"2024-04-26T23:49:30.269215+0000","last_peered":"2024-04-26T23:49:30.269215+0000","last_clean":"2024-04-26T23:49:30.269215+0000","last_became_active":"2024-04-26T23:40:41.689765+0000","last_became_peered":"2024-04-26T23:40:41.689765+0000","last_unstale":"2024-04-26T23:49:30.269215+0000","last_undegraded":"2024-04-26T23:49:30.269215+0000","last_fullsized":"2024-04-26T23:49:30.269215+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":3294,"log_dups_size":0,"ondisk_log_size":3294,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:33:16.389626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49600,"num_write_kb":609763,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"26'1221","reported_seq":1250,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:48:05.908044+0000","last_change":"2024-04-26T23:40:31.576749+0000","last_active":"2024-04-26T23:48:05.908044+0000","last_peered":"2024-04-26T23:48:05.908044+0000","last_clean":"2024-04-26T23:48:05.908044+0000","last_became_active":"2024-04-26T23:40:31.576178+0000","last_became_peered":"2024-04-26T23:40:31.576178+0000","last_unstale":"2024-04-26T23:48:05.908044+0000","last_undegraded":"2024-04-26T23:48:05.908044+0000","last_fullsized":"2024-04-26T23:48:05.908044+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":1221,"log_dups_size":0,"ondisk_log_size":1221,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:15:30.884135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1219,"num_write_kb":5208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"26'3626","reported_seq":3653,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.865111+0000","last_change":"2024-04-26T23:40:32.589208+0000","last_active":"2024-04-26T23:49:42.865111+0000","last_peered":"2024-04-26T23:49:42.865111+0000","last_clean":"2024-04-26T23:49:42.865111+0000","last_became_active":"2024-04-26T23:40:32.588927+0000","last_became_peered":"2024-04-26T23:40:32.588927+0000","last_unstale":"2024-04-26T23:49:42.865111+0000","last_undegraded":"2024-04-26T23:49:42.865111+0000","last_fullsized":"2024-04-26T23:49:42.865111+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":3626,"log_dups_size":0,"ondisk_log_size":3626,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:45:50.299583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":54465,"num_write_kb":670678,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"26'32","reported_seq":53,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:30.332987+0000","last_change":"2024-04-26T23:40:40.676809+0000","last_active":"2024-04-26T23:49:30.332987+0000","last_peered":"2024-04-26T23:49:30.332987+0000","last_clean":"2024-04-26T23:49:30.332987+0000","last_became_active":"2024-04-26T23:40:40.676070+0000","last_became_peered":"2024-04-26T23:40:40.676070+0000","last_unstale":"2024-04-26T23:49:30.332987+0000","last_undegraded":"2024-04-26T23:49:30.332987+0000","last_fullsized":"2024-04-26T23:49:30.332987+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:17:27.667323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":12296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.26","version":"26'3995","reported_seq":4015,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:30.333672+0000","last_change":"2024-04-26T23:40:41.679796+0000","last_active":"2024-04-26T23:49:30.333672+0000","last_peered":"2024-04-26T23:49:30.333672+0000","last_clean":"2024-04-26T23:49:30.333672+0000","last_became_active":"2024-04-26T23:40:41.679523+0000","last_became_peered":"2024-04-26T23:40:41.679523+0000","last_unstale":"2024-04-26T23:49:30.333672+0000","last_undegraded":"2024-04-26T23:49:30.333672+0000","last_fullsized":"2024-04-26T23:49:30.333672+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":3995,"log_dups_size":0,"ondisk_log_size":3995,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:43:02.137315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":60148,"num_write_kb":773318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"26'5261","reported_seq":5289,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.924918+0000","last_change":"2024-04-26T23:40:32.586672+0000","last_active":"2024-04-26T23:49:42.924918+0000","last_peered":"2024-04-26T23:49:42.924918+0000","last_clean":"2024-04-26T23:49:42.924918+0000","last_became_active":"2024-04-26T23:40:32.586399+0000","last_became_peered":"2024-04-26T23:40:32.586399+0000","last_unstale":"2024-04-26T23:49:42.924918+0000","last_undegraded":"2024-04-26T23:49:42.924918+0000","last_fullsized":"2024-04-26T23:49:42.924918+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":5261,"log_dups_size":0,"ondisk_log_size":5261,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:15:01.970308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":78910,"num_write_kb":993537,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.27","version":"26'5342","reported_seq":5362,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:32.336840+0000","last_change":"2024-04-26T23:40:41.687529+0000","last_active":"2024-04-26T23:49:32.336840+0000","last_peered":"2024-04-26T23:49:32.336840+0000","last_clean":"2024-04-26T23:49:32.336840+0000","last_became_active":"2024-04-26T23:40:41.686974+0000","last_became_peered":"2024-04-26T23:40:41.686974+0000","last_unstale":"2024-04-26T23:49:32.336840+0000","last_undegraded":"2024-04-26T23:49:32.336840+0000","last_fullsized":"2024-04-26T23:49:32.336840+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":5342,"log_dups_size":0,"ondisk_log_size":5342,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:21:56.950703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":80446,"num_write_kb":1002267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"26'4431","reported_seq":4459,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.901911+0000","last_change":"2024-04-26T23:40:32.584590+0000","last_active":"2024-04-26T23:49:42.901911+0000","last_peered":"2024-04-26T23:49:42.901911+0000","last_clean":"2024-04-26T23:49:42.901911+0000","last_became_active":"2024-04-26T23:40:32.584234+0000","last_became_peered":"2024-04-26T23:40:32.584234+0000","last_unstale":"2024-04-26T23:49:42.901911+0000","last_undegraded":"2024-04-26T23:49:42.901911+0000","last_fullsized":"2024-04-26T23:49:42.901911+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":4431,"log_dups_size":0,"ondisk_log_size":4431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:15:52.942160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":66416,"num_write_kb":857324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.24","version":"26'4128","reported_seq":4148,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:30.314565+0000","last_change":"2024-04-26T23:40:41.679549+0000","last_active":"2024-04-26T23:49:30.314565+0000","last_peered":"2024-04-26T23:49:30.314565+0000","last_clean":"2024-04-26T23:49:30.314565+0000","last_became_active":"2024-04-26T23:40:41.679254+0000","last_became_peered":"2024-04-26T23:40:41.679254+0000","last_unstale":"2024-04-26T23:49:30.314565+0000","last_undegraded":"2024-04-26T23:49:30.314565+0000","last_fullsized":"2024-04-26T23:49:30.314565+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":4128,"log_dups_size":0,"ondisk_log_size":4128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:48:09.126894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":62260,"num_write_kb":792966,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"26'5020","reported_seq":5048,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.980032+0000","last_change":"2024-04-26T23:40:32.580453+0000","last_active":"2024-04-26T23:49:42.980032+0000","last_peered":"2024-04-26T23:49:42.980032+0000","last_clean":"2024-04-26T23:49:42.980032+0000","last_became_active":"2024-04-26T23:40:32.580196+0000","last_became_peered":"2024-04-26T23:40:32.580196+0000","last_unstale":"2024-04-26T23:49:42.980032+0000","last_undegraded":"2024-04-26T23:49:42.980032+0000","last_fullsized":"2024-04-26T23:49:42.980032+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":5020,"log_dups_size":0,"ondisk_log_size":5020,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:18:09.706875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":75519,"num_write_kb":963103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.25","version":"26'4758","reported_seq":4778,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:30.266028+0000","last_change":"2024-04-26T23:40:41.690579+0000","last_active":"2024-04-26T23:49:30.266028+0000","last_peered":"2024-04-26T23:49:30.266028+0000","last_clean":"2024-04-26T23:49:30.266028+0000","last_became_active":"2024-04-26T23:40:41.690262+0000","last_became_peered":"2024-04-26T23:40:41.690262+0000","last_unstale":"2024-04-26T23:49:30.266028+0000","last_undegraded":"2024-04-26T23:49:30.266028+0000","last_fullsized":"2024-04-26T23:49:30.266028+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":4758,"log_dups_size":0,"ondisk_log_size":4758,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:10:30.972726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":71706,"num_write_kb":928511,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"26'3562","reported_seq":3595,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.923518+0000","last_change":"2024-04-26T23:41:30.513890+0000","last_active":"2024-04-26T23:49:42.923518+0000","last_peered":"2024-04-26T23:49:42.923518+0000","last_clean":"2024-04-26T23:49:42.923518+0000","last_became_active":"2024-04-26T23:41:30.513571+0000","last_became_peered":"2024-04-26T23:41:30.513571+0000","last_unstale":"2024-04-26T23:49:42.923518+0000","last_undegraded":"2024-04-26T23:49:42.923518+0000","last_fullsized":"2024-04-26T23:49:42.923518+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":3562,"log_dups_size":0,"ondisk_log_size":3562,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:42:04.655425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53479,"num_write_kb":687907,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.22","version":"26'5430","reported_seq":5450,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:30.293286+0000","last_change":"2024-04-26T23:40:41.677679+0000","last_active":"2024-04-26T23:49:30.293286+0000","last_peered":"2024-04-26T23:49:30.293286+0000","last_clean":"2024-04-26T23:49:30.293286+0000","last_became_active":"2024-04-26T23:40:41.677398+0000","last_became_peered":"2024-04-26T23:40:41.677398+0000","last_unstale":"2024-04-26T23:49:30.293286+0000","last_undegraded":"2024-04-26T23:49:30.293286+0000","last_fullsized":"2024-04-26T23:49:30.293286+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":5430,"log_dups_size":0,"ondisk_log_size":5430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:42:13.754586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":81903,"num_write_kb":1031435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.24","version":"26'3690","reported_seq":3718,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.912529+0000","last_change":"2024-04-26T23:40:32.587921+0000","last_active":"2024-04-26T23:49:42.912529+0000","last_peered":"2024-04-26T23:49:42.912529+0000","last_clean":"2024-04-26T23:49:42.912529+0000","last_became_active":"2024-04-26T23:40:32.587630+0000","last_became_peered":"2024-04-26T23:40:32.587630+0000","last_unstale":"2024-04-26T23:49:42.912529+0000","last_undegraded":"2024-04-26T23:49:42.912529+0000","last_fullsized":"2024-04-26T23:49:42.912529+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":3690,"log_dups_size":0,"ondisk_log_size":3690,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:01:02.741964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55280,"num_write_kb":715530,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.23","version":"26'3835","reported_seq":3855,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:30.335543+0000","last_change":"2024-04-26T23:40:41.690235+0000","last_active":"2024-04-26T23:49:30.335543+0000","last_peered":"2024-04-26T23:49:30.335543+0000","last_clean":"2024-04-26T23:49:30.335543+0000","last_became_active":"2024-04-26T23:40:41.689911+0000","last_became_peered":"2024-04-26T23:40:41.689911+0000","last_unstale":"2024-04-26T23:49:30.335543+0000","last_undegraded":"2024-04-26T23:49:30.335543+0000","last_fullsized":"2024-04-26T23:49:30.335543+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":3835,"log_dups_size":0,"ondisk_log_size":3835,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:21:56.950703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":57757,"num_write_kb":753623,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"26'4516","reported_seq":4544,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.888176+0000","last_change":"2024-04-26T23:40:32.583376+0000","last_active":"2024-04-26T23:49:42.888176+0000","last_peered":"2024-04-26T23:49:42.888176+0000","last_clean":"2024-04-26T23:49:42.888176+0000","last_became_active":"2024-04-26T23:40:32.583089+0000","last_became_peered":"2024-04-26T23:40:32.583089+0000","last_unstale":"2024-04-26T23:49:42.888176+0000","last_undegraded":"2024-04-26T23:49:42.888176+0000","last_fullsized":"2024-04-26T23:49:42.888176+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":4516,"log_dups_size":0,"ondisk_log_size":4516,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:17:46.135806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":67860,"num_write_kb":874899,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.20","version":"26'5603","reported_seq":5623,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:30.329561+0000","last_change":"2024-04-26T23:40:41.688464+0000","last_active":"2024-04-26T23:49:30.329561+0000","last_peered":"2024-04-26T23:49:30.329561+0000","last_clean":"2024-04-26T23:49:30.329561+0000","last_became_active":"2024-04-26T23:40:41.688028+0000","last_became_peered":"2024-04-26T23:40:41.688028+0000","last_unstale":"2024-04-26T23:49:30.329561+0000","last_undegraded":"2024-04-26T23:49:30.329561+0000","last_fullsized":"2024-04-26T23:49:30.329561+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":5603,"log_dups_size":0,"ondisk_log_size":5603,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:21:56.950703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":84399,"num_write_kb":1068733,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.26","version":"26'3757","reported_seq":3785,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.964764+0000","last_change":"2024-04-26T23:40:32.589080+0000","last_active":"2024-04-26T23:49:42.964764+0000","last_peered":"2024-04-26T23:49:42.964764+0000","last_clean":"2024-04-26T23:49:42.964764+0000","last_became_active":"2024-04-26T23:40:32.588793+0000","last_became_peered":"2024-04-26T23:40:32.588793+0000","last_unstale":"2024-04-26T23:49:42.964764+0000","last_undegraded":"2024-04-26T23:49:42.964764+0000","last_fullsized":"2024-04-26T23:49:42.964764+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":3757,"log_dups_size":0,"ondisk_log_size":3757,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:18:09.706875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":56209,"num_write_kb":727106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.21","version":"26'4815","reported_seq":4835,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:30.212082+0000","last_change":"2024-04-26T23:40:41.688445+0000","last_active":"2024-04-26T23:49:30.212082+0000","last_peered":"2024-04-26T23:49:30.212082+0000","last_clean":"2024-04-26T23:49:30.212082+0000","last_became_active":"2024-04-26T23:40:41.688163+0000","last_became_peered":"2024-04-26T23:40:41.688163+0000","last_unstale":"2024-04-26T23:49:30.212082+0000","last_undegraded":"2024-04-26T23:49:30.212082+0000","last_fullsized":"2024-04-26T23:49:30.212082+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":4815,"log_dups_size":0,"ondisk_log_size":4815,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:30:04.999018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":72614,"num_write_kb":926316,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"26'4897","reported_seq":4925,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.894719+0000","last_change":"2024-04-26T23:40:32.588177+0000","last_active":"2024-04-26T23:49:42.894719+0000","last_peered":"2024-04-26T23:49:42.894719+0000","last_clean":"2024-04-26T23:49:42.894719+0000","last_became_active":"2024-04-26T23:40:32.586926+0000","last_became_peered":"2024-04-26T23:40:32.586926+0000","last_unstale":"2024-04-26T23:49:42.894719+0000","last_undegraded":"2024-04-26T23:49:42.894719+0000","last_fullsized":"2024-04-26T23:49:42.894719+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":4897,"log_dups_size":0,"ondisk_log_size":4897,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:34:14.811917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":73419,"num_write_kb":930971,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2e","version":"26'3617","reported_seq":3636,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:32.348057+0000","last_change":"2024-04-26T23:40:41.688396+0000","last_active":"2024-04-26T23:49:32.348057+0000","last_peered":"2024-04-26T23:49:32.348057+0000","last_clean":"2024-04-26T23:49:32.348057+0000","last_became_active":"2024-04-26T23:40:41.688087+0000","last_became_peered":"2024-04-26T23:40:41.688087+0000","last_unstale":"2024-04-26T23:49:32.348057+0000","last_undegraded":"2024-04-26T23:49:32.348057+0000","last_fullsized":"2024-04-26T23:49:32.348057+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":3617,"log_dups_size":0,"ondisk_log_size":3617,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:00:49.397610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":54377,"num_write_kb":682463,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"26'3685","reported_seq":3713,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.949922+0000","last_change":"2024-04-26T23:40:32.582959+0000","last_active":"2024-04-26T23:49:42.949922+0000","last_peered":"2024-04-26T23:49:42.949922+0000","last_clean":"2024-04-26T23:49:42.949922+0000","last_became_active":"2024-04-26T23:40:32.582100+0000","last_became_peered":"2024-04-26T23:40:32.582100+0000","last_unstale":"2024-04-26T23:49:42.949922+0000","last_undegraded":"2024-04-26T23:49:42.949922+0000","last_fullsized":"2024-04-26T23:49:42.949922+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":3685,"log_dups_size":0,"ondisk_log_size":3685,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:37:30.361795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55124,"num_write_kb":707502,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2f","version":"26'5393","reported_seq":5412,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:30.296296+0000","last_change":"2024-04-26T23:40:41.681088+0000","last_active":"2024-04-26T23:49:30.296296+0000","last_peered":"2024-04-26T23:49:30.296296+0000","last_clean":"2024-04-26T23:49:30.296296+0000","last_became_active":"2024-04-26T23:40:41.680581+0000","last_became_peered":"2024-04-26T23:40:41.680581+0000","last_unstale":"2024-04-26T23:49:30.296296+0000","last_undegraded":"2024-04-26T23:49:30.296296+0000","last_fullsized":"2024-04-26T23:49:30.296296+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":5393,"log_dups_size":0,"ondisk_log_size":5393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:41:52.386084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":81323,"num_write_kb":1040915,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.29","version":"26'4135","reported_seq":4163,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.944650+0000","last_change":"2024-04-26T23:40:32.593958+0000","last_active":"2024-04-26T23:49:42.944650+0000","last_peered":"2024-04-26T23:49:42.944650+0000","last_clean":"2024-04-26T23:49:42.944650+0000","last_became_active":"2024-04-26T23:40:32.593639+0000","last_became_peered":"2024-04-26T23:40:32.593639+0000","last_unstale":"2024-04-26T23:49:42.944650+0000","last_undegraded":"2024-04-26T23:49:42.944650+0000","last_fullsized":"2024-04-26T23:49:42.944650+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":4135,"log_dups_size":0,"ondisk_log_size":4135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:17:46.135806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":62129,"num_write_kb":797085,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"26'4458","reported_seq":4477,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:32.334321+0000","last_change":"2024-04-26T23:40:41.674573+0000","last_active":"2024-04-26T23:49:32.334321+0000","last_peered":"2024-04-26T23:49:32.334321+0000","last_clean":"2024-04-26T23:49:32.334321+0000","last_became_active":"2024-04-26T23:40:41.674274+0000","last_became_peered":"2024-04-26T23:40:41.674274+0000","last_unstale":"2024-04-26T23:49:32.334321+0000","last_undegraded":"2024-04-26T23:49:32.334321+0000","last_fullsized":"2024-04-26T23:49:32.334321+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":4458,"log_dups_size":0,"ondisk_log_size":4458,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:37:39.460955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":67376,"num_write_kb":867303,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"26'4512","reported_seq":4540,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.995030+0000","last_change":"2024-04-26T23:40:32.591700+0000","last_active":"2024-04-26T23:49:42.995030+0000","last_peered":"2024-04-26T23:49:42.995030+0000","last_clean":"2024-04-26T23:49:42.995030+0000","last_became_active":"2024-04-26T23:40:32.591366+0000","last_became_peered":"2024-04-26T23:40:32.591366+0000","last_unstale":"2024-04-26T23:49:42.995030+0000","last_undegraded":"2024-04-26T23:49:42.995030+0000","last_fullsized":"2024-04-26T23:49:42.995030+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":4512,"log_dups_size":0,"ondisk_log_size":4512,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:10:02.629199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":67679,"num_write_kb":882467,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2d","version":"26'4489","reported_seq":4508,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:32.352572+0000","last_change":"2024-04-26T23:40:41.692402+0000","last_active":"2024-04-26T23:49:32.352572+0000","last_peered":"2024-04-26T23:49:32.352572+0000","last_clean":"2024-04-26T23:49:32.352572+0000","last_became_active":"2024-04-26T23:40:41.692122+0000","last_became_peered":"2024-04-26T23:40:41.692122+0000","last_unstale":"2024-04-26T23:49:32.352572+0000","last_undegraded":"2024-04-26T23:49:32.352572+0000","last_fullsized":"2024-04-26T23:49:32.352572+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":4489,"log_dups_size":0,"ondisk_log_size":4489,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:06:12.755431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":67600,"num_write_kb":861109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2b","version":"26'4261","reported_seq":4289,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.949551+0000","last_change":"2024-04-26T23:40:32.590443+0000","last_active":"2024-04-26T23:49:42.949551+0000","last_peered":"2024-04-26T23:49:42.949551+0000","last_clean":"2024-04-26T23:49:42.949551+0000","last_became_active":"2024-04-26T23:40:32.590193+0000","last_became_peered":"2024-04-26T23:40:32.590193+0000","last_unstale":"2024-04-26T23:49:42.949551+0000","last_undegraded":"2024-04-26T23:49:42.949551+0000","last_fullsized":"2024-04-26T23:49:42.949551+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":4261,"log_dups_size":0,"ondisk_log_size":4261,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:14:04.372681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":63685,"num_write_kb":822261,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2a","version":"26'4995","reported_seq":5015,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:32.335489+0000","last_change":"2024-04-26T23:40:41.692194+0000","last_active":"2024-04-26T23:49:32.335489+0000","last_peered":"2024-04-26T23:49:32.335489+0000","last_clean":"2024-04-26T23:49:32.335489+0000","last_became_active":"2024-04-26T23:40:41.691837+0000","last_became_peered":"2024-04-26T23:40:41.691837+0000","last_unstale":"2024-04-26T23:49:32.335489+0000","last_undegraded":"2024-04-26T23:49:32.335489+0000","last_fullsized":"2024-04-26T23:49:32.335489+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":4995,"log_dups_size":0,"ondisk_log_size":4995,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:58:45.972045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":75356,"num_write_kb":950203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"26'4090","reported_seq":4118,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.876315+0000","last_change":"2024-04-26T23:40:32.590538+0000","last_active":"2024-04-26T23:49:42.876315+0000","last_peered":"2024-04-26T23:49:42.876315+0000","last_clean":"2024-04-26T23:49:42.876315+0000","last_became_active":"2024-04-26T23:40:32.590241+0000","last_became_peered":"2024-04-26T23:40:32.590241+0000","last_unstale":"2024-04-26T23:49:42.876315+0000","last_undegraded":"2024-04-26T23:49:42.876315+0000","last_fullsized":"2024-04-26T23:49:42.876315+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":4090,"log_dups_size":0,"ondisk_log_size":4090,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:38:10.884592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":61267,"num_write_kb":785631,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"26'4580","reported_seq":4599,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:32.335187+0000","last_change":"2024-04-26T23:40:41.689529+0000","last_active":"2024-04-26T23:49:32.335187+0000","last_peered":"2024-04-26T23:49:32.335187+0000","last_clean":"2024-04-26T23:49:32.335187+0000","last_became_active":"2024-04-26T23:40:41.689215+0000","last_became_peered":"2024-04-26T23:40:41.689215+0000","last_unstale":"2024-04-26T23:49:32.335187+0000","last_undegraded":"2024-04-26T23:49:32.335187+0000","last_fullsized":"2024-04-26T23:49:32.335187+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":4580,"log_dups_size":0,"ondisk_log_size":4580,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:38:42.155257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":68781,"num_write_kb":892789,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2d","version":"26'4171","reported_seq":4199,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.943207+0000","last_change":"2024-04-26T23:40:32.588445+0000","last_active":"2024-04-26T23:49:42.943207+0000","last_peered":"2024-04-26T23:49:42.943207+0000","last_clean":"2024-04-26T23:49:42.943207+0000","last_became_active":"2024-04-26T23:40:32.588063+0000","last_became_peered":"2024-04-26T23:40:32.588063+0000","last_unstale":"2024-04-26T23:49:42.943207+0000","last_undegraded":"2024-04-26T23:49:42.943207+0000","last_fullsized":"2024-04-26T23:49:42.943207+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":4171,"log_dups_size":0,"ondisk_log_size":4171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:44:58.977344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":62428,"num_write_kb":793377,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.28","version":"26'4022","reported_seq":4042,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:32.335817+0000","last_change":"2024-04-26T23:40:41.674893+0000","last_active":"2024-04-26T23:49:32.335817+0000","last_peered":"2024-04-26T23:49:32.335817+0000","last_clean":"2024-04-26T23:49:32.335817+0000","last_became_active":"2024-04-26T23:40:41.674573+0000","last_became_peered":"2024-04-26T23:40:41.674573+0000","last_unstale":"2024-04-26T23:49:32.335817+0000","last_undegraded":"2024-04-26T23:49:32.335817+0000","last_fullsized":"2024-04-26T23:49:32.335817+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":4022,"log_dups_size":0,"ondisk_log_size":4022,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:36:21.487122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":60451,"num_write_kb":760274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"26'3337","reported_seq":3365,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.873346+0000","last_change":"2024-04-26T23:40:32.574795+0000","last_active":"2024-04-26T23:49:42.873346+0000","last_peered":"2024-04-26T23:49:42.873346+0000","last_clean":"2024-04-26T23:49:42.873346+0000","last_became_active":"2024-04-26T23:40:32.574503+0000","last_became_peered":"2024-04-26T23:40:32.574503+0000","last_unstale":"2024-04-26T23:49:42.873346+0000","last_undegraded":"2024-04-26T23:49:42.873346+0000","last_fullsized":"2024-04-26T23:49:42.873346+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":3337,"log_dups_size":0,"ondisk_log_size":3337,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:30:11.401955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49634,"num_write_kb":627043,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.29","version":"26'4402","reported_seq":4422,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:32.356793+0000","last_change":"2024-04-26T23:40:41.680247+0000","last_active":"2024-04-26T23:49:32.356793+0000","last_peered":"2024-04-26T23:49:32.356793+0000","last_clean":"2024-04-26T23:49:32.356793+0000","last_became_active":"2024-04-26T23:40:41.679920+0000","last_became_peered":"2024-04-26T23:40:41.679920+0000","last_unstale":"2024-04-26T23:49:32.356793+0000","last_undegraded":"2024-04-26T23:49:32.356793+0000","last_fullsized":"2024-04-26T23:49:32.356793+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":4402,"log_dups_size":0,"ondisk_log_size":4402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:53:13.531466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":66255,"num_write_kb":845549,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2f","version":"26'5167","reported_seq":5194,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.941421+0000","last_change":"2024-04-26T23:40:32.593432+0000","last_active":"2024-04-26T23:49:42.941421+0000","last_peered":"2024-04-26T23:49:42.941421+0000","last_clean":"2024-04-26T23:49:42.941421+0000","last_became_active":"2024-04-26T23:40:32.593169+0000","last_became_peered":"2024-04-26T23:40:32.593169+0000","last_unstale":"2024-04-26T23:49:42.941421+0000","last_undegraded":"2024-04-26T23:49:42.941421+0000","last_fullsized":"2024-04-26T23:49:42.941421+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":5167,"log_dups_size":0,"ondisk_log_size":5167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:44:42.494850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":77406,"num_write_kb":981579,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.36","version":"26'5039","reported_seq":5058,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:30.332524+0000","last_change":"2024-04-26T23:40:41.694551+0000","last_active":"2024-04-26T23:49:30.332524+0000","last_peered":"2024-04-26T23:49:30.332524+0000","last_clean":"2024-04-26T23:49:30.332524+0000","last_became_active":"2024-04-26T23:40:41.694297+0000","last_became_peered":"2024-04-26T23:40:41.694297+0000","last_unstale":"2024-04-26T23:49:30.332524+0000","last_undegraded":"2024-04-26T23:49:30.332524+0000","last_fullsized":"2024-04-26T23:49:30.332524+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":5039,"log_dups_size":0,"ondisk_log_size":5039,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:02:27.160408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":75865,"num_write_kb":998838,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"26'3722","reported_seq":3749,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.950014+0000","last_change":"2024-04-26T23:40:32.585137+0000","last_active":"2024-04-26T23:49:42.950014+0000","last_peered":"2024-04-26T23:49:42.950014+0000","last_clean":"2024-04-26T23:49:42.950014+0000","last_became_active":"2024-04-26T23:40:32.584678+0000","last_became_peered":"2024-04-26T23:40:32.584678+0000","last_unstale":"2024-04-26T23:49:42.950014+0000","last_undegraded":"2024-04-26T23:49:42.950014+0000","last_fullsized":"2024-04-26T23:49:42.950014+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":3722,"log_dups_size":0,"ondisk_log_size":3722,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:04:30.553552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55693,"num_write_kb":722935,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.37","version":"26'5530","reported_seq":5549,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:30.272220+0000","last_change":"2024-04-26T23:40:41.692433+0000","last_active":"2024-04-26T23:49:30.272220+0000","last_peered":"2024-04-26T23:49:30.272220+0000","last_clean":"2024-04-26T23:49:30.272220+0000","last_became_active":"2024-04-26T23:40:41.692090+0000","last_became_peered":"2024-04-26T23:40:41.692090+0000","last_unstale":"2024-04-26T23:49:30.272220+0000","last_undegraded":"2024-04-26T23:49:30.272220+0000","last_fullsized":"2024-04-26T23:49:30.272220+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":5530,"log_dups_size":0,"ondisk_log_size":5530,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:37:25.006229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":83365,"num_write_kb":1062103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"26'4290","reported_seq":4317,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.900241+0000","last_change":"2024-04-26T23:40:32.590452+0000","last_active":"2024-04-26T23:49:42.900241+0000","last_peered":"2024-04-26T23:49:42.900241+0000","last_clean":"2024-04-26T23:49:42.900241+0000","last_became_active":"2024-04-26T23:40:32.590162+0000","last_became_peered":"2024-04-26T23:40:32.590162+0000","last_unstale":"2024-04-26T23:49:42.900241+0000","last_undegraded":"2024-04-26T23:49:42.900241+0000","last_fullsized":"2024-04-26T23:49:42.900241+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":4290,"log_dups_size":0,"ondisk_log_size":4290,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:51:30.677247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":64302,"num_write_kb":811481,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.34","version":"26'3752","reported_seq":3771,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:30.302344+0000","last_change":"2024-04-26T23:40:41.687270+0000","last_active":"2024-04-26T23:49:30.302344+0000","last_peered":"2024-04-26T23:49:30.302344+0000","last_clean":"2024-04-26T23:49:30.302344+0000","last_became_active":"2024-04-26T23:40:41.686999+0000","last_became_peered":"2024-04-26T23:40:41.686999+0000","last_unstale":"2024-04-26T23:49:30.302344+0000","last_undegraded":"2024-04-26T23:49:30.302344+0000","last_fullsized":"2024-04-26T23:49:30.302344+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":3752,"log_dups_size":0,"ondisk_log_size":3752,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:21:42.565349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":56674,"num_write_kb":713071,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"26'4299","reported_seq":4326,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.893101+0000","last_change":"2024-04-26T23:40:32.586436+0000","last_active":"2024-04-26T23:49:42.893101+0000","last_peered":"2024-04-26T23:49:42.893101+0000","last_clean":"2024-04-26T23:49:42.893101+0000","last_became_active":"2024-04-26T23:40:32.585995+0000","last_became_peered":"2024-04-26T23:40:32.585995+0000","last_unstale":"2024-04-26T23:49:42.893101+0000","last_undegraded":"2024-04-26T23:49:42.893101+0000","last_fullsized":"2024-04-26T23:49:42.893101+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":4299,"log_dups_size":0,"ondisk_log_size":4299,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:10:42.603833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":64455,"num_write_kb":829744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.35","version":"26'4326","reported_seq":4345,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:30.253006+0000","last_change":"2024-04-26T23:40:41.691693+0000","last_active":"2024-04-26T23:49:30.253006+0000","last_peered":"2024-04-26T23:49:30.253006+0000","last_clean":"2024-04-26T23:49:30.253006+0000","last_became_active":"2024-04-26T23:40:41.691437+0000","last_became_peered":"2024-04-26T23:40:41.691437+0000","last_unstale":"2024-04-26T23:49:30.253006+0000","last_undegraded":"2024-04-26T23:49:30.253006+0000","last_fullsized":"2024-04-26T23:49:30.253006+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":4326,"log_dups_size":0,"ondisk_log_size":4326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:06:12.755431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":65307,"num_write_kb":818233,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.33","version":"26'3786","reported_seq":3813,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.909367+0000","last_change":"2024-04-26T23:40:32.592988+0000","last_active":"2024-04-26T23:49:42.909367+0000","last_peered":"2024-04-26T23:49:42.909367+0000","last_clean":"2024-04-26T23:49:42.909367+0000","last_became_active":"2024-04-26T23:40:32.592717+0000","last_became_peered":"2024-04-26T23:40:32.592717+0000","last_unstale":"2024-04-26T23:49:42.909367+0000","last_undegraded":"2024-04-26T23:49:42.909367+0000","last_fullsized":"2024-04-26T23:49:42.909367+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":3786,"log_dups_size":0,"ondisk_log_size":3786,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:18:09.706875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":56607,"num_write_kb":740250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.32","version":"26'4725","reported_seq":4744,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:30.304871+0000","last_change":"2024-04-26T23:40:41.675335+0000","last_active":"2024-04-26T23:49:30.304871+0000","last_peered":"2024-04-26T23:49:30.304871+0000","last_clean":"2024-04-26T23:49:30.304871+0000","last_became_active":"2024-04-26T23:40:41.675042+0000","last_became_peered":"2024-04-26T23:40:41.675042+0000","last_unstale":"2024-04-26T23:49:30.304871+0000","last_undegraded":"2024-04-26T23:49:30.304871+0000","last_fullsized":"2024-04-26T23:49:30.304871+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":4725,"log_dups_size":0,"ondisk_log_size":4725,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:41:52.386084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":71116,"num_write_kb":894316,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"26'3513","reported_seq":3540,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.972217+0000","last_change":"2024-04-26T23:40:32.595129+0000","last_active":"2024-04-26T23:49:42.972217+0000","last_peered":"2024-04-26T23:49:42.972217+0000","last_clean":"2024-04-26T23:49:42.972217+0000","last_became_active":"2024-04-26T23:40:32.594802+0000","last_became_peered":"2024-04-26T23:40:32.594802+0000","last_unstale":"2024-04-26T23:49:42.972217+0000","last_undegraded":"2024-04-26T23:49:42.972217+0000","last_fullsized":"2024-04-26T23:49:42.972217+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":3513,"log_dups_size":0,"ondisk_log_size":3513,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:48:33.020039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":52734,"num_write_kb":670887,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.33","version":"26'4035","reported_seq":4054,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:32.342105+0000","last_change":"2024-04-26T23:40:41.691159+0000","last_active":"2024-04-26T23:49:32.342105+0000","last_peered":"2024-04-26T23:49:32.342105+0000","last_clean":"2024-04-26T23:49:32.342105+0000","last_became_active":"2024-04-26T23:40:41.690846+0000","last_became_peered":"2024-04-26T23:40:41.690846+0000","last_unstale":"2024-04-26T23:49:32.342105+0000","last_undegraded":"2024-04-26T23:49:32.342105+0000","last_fullsized":"2024-04-26T23:49:32.342105+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":4035,"log_dups_size":0,"ondisk_log_size":4035,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:45:08.076505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":60666,"num_write_kb":797602,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.35","version":"26'4035","reported_seq":4062,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.914117+0000","last_change":"2024-04-26T23:40:32.578819+0000","last_active":"2024-04-26T23:49:42.914117+0000","last_peered":"2024-04-26T23:49:42.914117+0000","last_clean":"2024-04-26T23:49:42.914117+0000","last_became_active":"2024-04-26T23:40:32.578556+0000","last_became_peered":"2024-04-26T23:40:32.578556+0000","last_unstale":"2024-04-26T23:49:42.914117+0000","last_undegraded":"2024-04-26T23:49:42.914117+0000","last_fullsized":"2024-04-26T23:49:42.914117+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":4035,"log_dups_size":0,"ondisk_log_size":4035,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:17:46.135806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":60570,"num_write_kb":769077,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.30","version":"26'3960","reported_seq":3979,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:30.310152+0000","last_change":"2024-04-26T23:40:41.689812+0000","last_active":"2024-04-26T23:49:30.310152+0000","last_peered":"2024-04-26T23:49:30.310152+0000","last_clean":"2024-04-26T23:49:30.310152+0000","last_became_active":"2024-04-26T23:40:41.689267+0000","last_became_peered":"2024-04-26T23:40:41.689267+0000","last_unstale":"2024-04-26T23:49:30.310152+0000","last_undegraded":"2024-04-26T23:49:30.310152+0000","last_fullsized":"2024-04-26T23:49:30.310152+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":3960,"log_dups_size":0,"ondisk_log_size":3960,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:21:42.565349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":59630,"num_write_kb":775739,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"26'4731","reported_seq":4758,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.972370+0000","last_change":"2024-04-26T23:40:32.578155+0000","last_active":"2024-04-26T23:49:42.972370+0000","last_peered":"2024-04-26T23:49:42.972370+0000","last_clean":"2024-04-26T23:49:42.972370+0000","last_became_active":"2024-04-26T23:40:32.577865+0000","last_became_peered":"2024-04-26T23:40:32.577865+0000","last_unstale":"2024-04-26T23:49:42.972370+0000","last_undegraded":"2024-04-26T23:49:42.972370+0000","last_fullsized":"2024-04-26T23:49:42.972370+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":4731,"log_dups_size":0,"ondisk_log_size":4731,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:40:17.167353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":70795,"num_write_kb":915734,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.31","version":"26'4435","reported_seq":4454,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:30.334396+0000","last_change":"2024-04-26T23:40:41.680962+0000","last_active":"2024-04-26T23:49:30.334396+0000","last_peered":"2024-04-26T23:49:30.334396+0000","last_clean":"2024-04-26T23:49:30.334396+0000","last_became_active":"2024-04-26T23:40:41.680676+0000","last_became_peered":"2024-04-26T23:40:41.680676+0000","last_unstale":"2024-04-26T23:49:30.334396+0000","last_undegraded":"2024-04-26T23:49:30.334396+0000","last_fullsized":"2024-04-26T23:49:30.334396+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":4435,"log_dups_size":0,"ondisk_log_size":4435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:42:13.754586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":66738,"num_write_kb":853261,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"26'4979","reported_seq":5006,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.990989+0000","last_change":"2024-04-26T23:40:32.591487+0000","last_active":"2024-04-26T23:49:42.990989+0000","last_peered":"2024-04-26T23:49:42.990989+0000","last_clean":"2024-04-26T23:49:42.990989+0000","last_became_active":"2024-04-26T23:40:32.591209+0000","last_became_peered":"2024-04-26T23:40:32.591209+0000","last_unstale":"2024-04-26T23:49:42.990989+0000","last_undegraded":"2024-04-26T23:49:42.990989+0000","last_fullsized":"2024-04-26T23:49:42.990989+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":4979,"log_dups_size":0,"ondisk_log_size":4979,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:52:26.699790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":74710,"num_write_kb":992211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3e","version":"26'5666","reported_seq":5686,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:32.348852+0000","last_change":"2024-04-26T23:40:41.686089+0000","last_active":"2024-04-26T23:49:32.348852+0000","last_peered":"2024-04-26T23:49:32.348852+0000","last_clean":"2024-04-26T23:49:32.348852+0000","last_became_active":"2024-04-26T23:40:41.685786+0000","last_became_peered":"2024-04-26T23:40:41.685786+0000","last_unstale":"2024-04-26T23:49:32.348852+0000","last_undegraded":"2024-04-26T23:49:32.348852+0000","last_fullsized":"2024-04-26T23:49:32.348852+0000","mapping_epoch":22,"log_start":"26'400","ondisk_log_start":"26'400","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":5266,"log_dups_size":0,"ondisk_log_size":5266,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:36:02.931532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":85672,"num_write_kb":1105852,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.38","version":"26'4537","reported_seq":4564,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.908212+0000","last_change":"2024-04-26T23:40:32.592543+0000","last_active":"2024-04-26T23:49:42.908212+0000","last_peered":"2024-04-26T23:49:42.908212+0000","last_clean":"2024-04-26T23:49:42.908212+0000","last_became_active":"2024-04-26T23:40:32.592282+0000","last_became_peered":"2024-04-26T23:40:32.592282+0000","last_unstale":"2024-04-26T23:49:42.908212+0000","last_undegraded":"2024-04-26T23:49:42.908212+0000","last_fullsized":"2024-04-26T23:49:42.908212+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":4537,"log_dups_size":0,"ondisk_log_size":4537,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:16:46.547536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":68313,"num_write_kb":849602,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3f","version":"26'3830","reported_seq":3850,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:32.345828+0000","last_change":"2024-04-26T23:40:41.679306+0000","last_active":"2024-04-26T23:49:32.345828+0000","last_peered":"2024-04-26T23:49:32.345828+0000","last_clean":"2024-04-26T23:49:32.345828+0000","last_became_active":"2024-04-26T23:40:41.678926+0000","last_became_peered":"2024-04-26T23:40:41.678926+0000","last_unstale":"2024-04-26T23:49:32.345828+0000","last_undegraded":"2024-04-26T23:49:32.345828+0000","last_fullsized":"2024-04-26T23:49:32.345828+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":3830,"log_dups_size":0,"ondisk_log_size":3830,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:27:48.823509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":57629,"num_write_kb":750507,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.39","version":"26'4047","reported_seq":4060,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.888642+0000","last_change":"2024-04-26T23:41:30.373208+0000","last_active":"2024-04-26T23:49:42.888642+0000","last_peered":"2024-04-26T23:49:42.888642+0000","last_clean":"2024-04-26T23:49:42.888642+0000","last_became_active":"2024-04-26T23:41:30.372928+0000","last_became_peered":"2024-04-26T23:41:30.372928+0000","last_unstale":"2024-04-26T23:49:42.888642+0000","last_undegraded":"2024-04-26T23:49:42.888642+0000","last_fullsized":"2024-04-26T23:49:42.888642+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":4047,"log_dups_size":0,"ondisk_log_size":4047,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:21:47.851542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":60897,"num_write_kb":776135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3c","version":"26'4068","reported_seq":4088,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:29.935386+0000","last_change":"2024-04-26T23:40:41.689567+0000","last_active":"2024-04-26T23:49:29.935386+0000","last_peered":"2024-04-26T23:49:29.935386+0000","last_clean":"2024-04-26T23:49:29.935386+0000","last_became_active":"2024-04-26T23:40:41.688585+0000","last_became_peered":"2024-04-26T23:40:41.688585+0000","last_unstale":"2024-04-26T23:49:29.935386+0000","last_undegraded":"2024-04-26T23:49:29.935386+0000","last_fullsized":"2024-04-26T23:49:29.935386+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":4068,"log_dups_size":0,"ondisk_log_size":4068,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:10:57.826183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":61409,"num_write_kb":797665,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"26'3610","reported_seq":3637,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.991991+0000","last_change":"2024-04-26T23:40:32.584619+0000","last_active":"2024-04-26T23:49:42.991991+0000","last_peered":"2024-04-26T23:49:42.991991+0000","last_clean":"2024-04-26T23:49:42.991991+0000","last_became_active":"2024-04-26T23:40:32.584293+0000","last_became_peered":"2024-04-26T23:40:32.584293+0000","last_unstale":"2024-04-26T23:49:42.991991+0000","last_undegraded":"2024-04-26T23:49:42.991991+0000","last_fullsized":"2024-04-26T23:49:42.991991+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":3610,"log_dups_size":0,"ondisk_log_size":3610,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:40:17.167353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":54297,"num_write_kb":686705,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3d","version":"26'4614","reported_seq":4634,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:30.334531+0000","last_change":"2024-04-26T23:40:41.691614+0000","last_active":"2024-04-26T23:49:30.334531+0000","last_peered":"2024-04-26T23:49:30.334531+0000","last_clean":"2024-04-26T23:49:30.334531+0000","last_became_active":"2024-04-26T23:40:41.691081+0000","last_became_peered":"2024-04-26T23:40:41.691081+0000","last_unstale":"2024-04-26T23:49:30.334531+0000","last_undegraded":"2024-04-26T23:49:30.334531+0000","last_fullsized":"2024-04-26T23:49:30.334531+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":4614,"log_dups_size":0,"ondisk_log_size":4614,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:24:07.784468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69615,"num_write_kb":867426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"26'4911","reported_seq":4938,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.888073+0000","last_change":"2024-04-26T23:40:32.588894+0000","last_active":"2024-04-26T23:49:42.888073+0000","last_peered":"2024-04-26T23:49:42.888073+0000","last_clean":"2024-04-26T23:49:42.888073+0000","last_became_active":"2024-04-26T23:40:32.588409+0000","last_became_peered":"2024-04-26T23:40:32.588409+0000","last_unstale":"2024-04-26T23:49:42.888073+0000","last_undegraded":"2024-04-26T23:49:42.888073+0000","last_fullsized":"2024-04-26T23:49:42.888073+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":4911,"log_dups_size":0,"ondisk_log_size":4911,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:35:08.194865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":73569,"num_write_kb":917520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3a","version":"26'3809","reported_seq":3828,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:30.230648+0000","last_change":"2024-04-26T23:40:41.678639+0000","last_active":"2024-04-26T23:49:30.230648+0000","last_peered":"2024-04-26T23:49:30.230648+0000","last_clean":"2024-04-26T23:49:30.230648+0000","last_became_active":"2024-04-26T23:40:41.678333+0000","last_became_peered":"2024-04-26T23:40:41.678333+0000","last_unstale":"2024-04-26T23:49:30.230648+0000","last_undegraded":"2024-04-26T23:49:30.230648+0000","last_fullsized":"2024-04-26T23:49:30.230648+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":3809,"log_dups_size":0,"ondisk_log_size":3809,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:42:13.754586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":57471,"num_write_kb":738181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"26'3683","reported_seq":3711,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.956847+0000","last_change":"2024-04-26T23:40:32.581875+0000","last_active":"2024-04-26T23:49:42.956847+0000","last_peered":"2024-04-26T23:49:42.956847+0000","last_clean":"2024-04-26T23:49:42.956847+0000","last_became_active":"2024-04-26T23:40:32.580987+0000","last_became_peered":"2024-04-26T23:40:32.580987+0000","last_unstale":"2024-04-26T23:49:42.956847+0000","last_undegraded":"2024-04-26T23:49:42.956847+0000","last_fullsized":"2024-04-26T23:49:42.956847+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":3683,"log_dups_size":0,"ondisk_log_size":3683,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:12:45.093169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55303,"num_write_kb":749693,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3b","version":"26'5307","reported_seq":5326,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:32.363761+0000","last_change":"2024-04-26T23:40:41.678366+0000","last_active":"2024-04-26T23:49:32.363761+0000","last_peered":"2024-04-26T23:49:32.363761+0000","last_clean":"2024-04-26T23:49:32.363761+0000","last_became_active":"2024-04-26T23:40:41.678067+0000","last_became_peered":"2024-04-26T23:40:41.678067+0000","last_unstale":"2024-04-26T23:49:32.363761+0000","last_undegraded":"2024-04-26T23:49:32.363761+0000","last_fullsized":"2024-04-26T23:49:32.363761+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":5307,"log_dups_size":0,"ondisk_log_size":5307,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:44:51.594010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79871,"num_write_kb":1001680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"26'4313","reported_seq":4341,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.885657+0000","last_change":"2024-04-26T23:40:32.579870+0000","last_active":"2024-04-26T23:49:42.885657+0000","last_peered":"2024-04-26T23:49:42.885657+0000","last_clean":"2024-04-26T23:49:42.885657+0000","last_became_active":"2024-04-26T23:40:32.579569+0000","last_became_peered":"2024-04-26T23:40:32.579569+0000","last_unstale":"2024-04-26T23:49:42.885657+0000","last_undegraded":"2024-04-26T23:49:42.885657+0000","last_fullsized":"2024-04-26T23:49:42.885657+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":4313,"log_dups_size":0,"ondisk_log_size":4313,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:25:30.040358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":64676,"num_write_kb":807158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.38","version":"26'4943","reported_seq":4962,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:30.217576+0000","last_change":"2024-04-26T23:40:41.684020+0000","last_active":"2024-04-26T23:49:30.217576+0000","last_peered":"2024-04-26T23:49:30.217576+0000","last_clean":"2024-04-26T23:49:30.217576+0000","last_became_active":"2024-04-26T23:40:41.683734+0000","last_became_peered":"2024-04-26T23:40:41.683734+0000","last_unstale":"2024-04-26T23:49:30.217576+0000","last_undegraded":"2024-04-26T23:49:30.217576+0000","last_fullsized":"2024-04-26T23:49:30.217576+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":4943,"log_dups_size":0,"ondisk_log_size":4943,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:38:42.155257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":74716,"num_write_kb":913038,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"26'5195","reported_seq":5223,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.887041+0000","last_change":"2024-04-26T23:40:32.583944+0000","last_active":"2024-04-26T23:49:42.887041+0000","last_peered":"2024-04-26T23:49:42.887041+0000","last_clean":"2024-04-26T23:49:42.887041+0000","last_became_active":"2024-04-26T23:40:32.583655+0000","last_became_peered":"2024-04-26T23:40:32.583655+0000","last_unstale":"2024-04-26T23:49:42.887041+0000","last_undegraded":"2024-04-26T23:49:42.887041+0000","last_fullsized":"2024-04-26T23:49:42.887041+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":5195,"log_dups_size":0,"ondisk_log_size":5195,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:40:17.167353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":78237,"num_write_kb":1038116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.39","version":"26'4256","reported_seq":4275,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:32.355519+0000","last_change":"2024-04-26T23:40:41.681412+0000","last_active":"2024-04-26T23:49:32.355519+0000","last_peered":"2024-04-26T23:49:32.355519+0000","last_clean":"2024-04-26T23:49:32.355519+0000","last_became_active":"2024-04-26T23:40:41.681092+0000","last_became_peered":"2024-04-26T23:40:41.681092+0000","last_unstale":"2024-04-26T23:49:32.355519+0000","last_undegraded":"2024-04-26T23:49:32.355519+0000","last_fullsized":"2024-04-26T23:49:32.355519+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":4256,"log_dups_size":0,"ondisk_log_size":4256,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:48:09.126894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":64162,"num_write_kb":832623,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"26'3628","reported_seq":3656,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.980742+0000","last_change":"2024-04-26T23:40:32.596351+0000","last_active":"2024-04-26T23:49:42.980742+0000","last_peered":"2024-04-26T23:49:42.980742+0000","last_clean":"2024-04-26T23:49:42.980742+0000","last_became_active":"2024-04-26T23:40:32.596050+0000","last_became_peered":"2024-04-26T23:40:32.596050+0000","last_unstale":"2024-04-26T23:49:42.980742+0000","last_undegraded":"2024-04-26T23:49:42.980742+0000","last_fullsized":"2024-04-26T23:49:42.980742+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":3628,"log_dups_size":0,"ondisk_log_size":3628,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:34:14.811917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":54568,"num_write_kb":695399,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4349618,"num_write_kb":55464628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":287416,"ondisk_log_size":287416,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":158829115,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":18,"num_read_kb":98,"num_write":2623,"num_write_kb":157091,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":317718528,"data_stored":317658230,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2523,"ondisk_log_size":2523,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4020088,"num_write_kb":51543156,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":268065,"ondisk_log_size":268065,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":149566157,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":15,"num_read_kb":95,"num_write":2737,"num_write_kb":148086,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":299196416,"data_stored":299132314,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2599,"ondisk_log_size":2599,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574959,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":835292,"kb_used_data":81300,"kb_used_omap":1,"kb_used_meta":753982,"kb_avail":93536548,"statfs":{"total":96636764160,"available":95781425152,"internally_reserved":0,"allocated":83251200,"data_stored":83071587,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":772078026},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574964,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":602412,"kb_used_data":84196,"kb_used_omap":1,"kb_used_meta":518206,"kb_avail":93769428,"statfs":{"total":96636764160,"available":96019894272,"internally_reserved":0,"allocated":86216704,"data_stored":86032300,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":530643398},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574961,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":756680,"kb_used_data":57088,"kb_used_omap":1,"kb_used_meta":699582,"kb_avail":93615160,"statfs":{"total":96636764160,"available":95861923840,"internally_reserved":0,"allocated":58458112,"data_stored":58278265,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":716372421},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574962,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":822852,"kb_used_data":94588,"kb_used_omap":1,"kb_used_meta":728254,"kb_avail":93548988,"statfs":{"total":96636764160,"available":95794163712,"internally_reserved":0,"allocated":96858112,"data_stored":96670557,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":745732549},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574961,"num_pgs":58,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":843140,"kb_used_data":106876,"kb_used_omap":1,"kb_used_meta":736254,"kb_avail":93528700,"statfs":{"total":96636764160,"available":95773388800,"internally_reserved":0,"allocated":109441024,"data_stored":109254605,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":753924551},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574963,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":520948,"kb_used_data":24940,"kb_used_omap":1,"kb_used_meta":495998,"kb_avail":93850892,"statfs":{"total":96636764160,"available":96103313408,"internally_reserved":0,"allocated":25538560,"data_stored":25367229,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":507902405},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574962,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":751212,"kb_used_data":110884,"kb_used_omap":1,"kb_used_meta":640318,"kb_avail":93620628,"statfs":{"total":96636764160,"available":95867523072,"internally_reserved":0,"allocated":113545216,"data_stored":113360216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":655686085},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574965,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":604392,"kb_used_data":45920,"kb_used_omap":1,"kb_used_meta":558462,"kb_avail":93767448,"statfs":{"total":96636764160,"available":96017866752,"internally_reserved":0,"allocated":47022080,"data_stored":46841504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":571865541},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":29372416,"data_stored":29360766,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":41951232,"data_stored":41943200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12673024,"data_stored":12671093,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":33652736,"data_stored":33643285,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":46149632,"data_stored":46137470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":29364224,"data_stored":29360218,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":48824320,"data_stored":48813882,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":57208832,"data_stored":57202400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16777216,"data_stored":16777216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":71315456,"data_stored":71303862,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12587008,"data_stored":12582982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":75509760,"data_stored":75498166,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":50429952,"data_stored":50419933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28815360,"data_stored":28804893,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":37113856,"data_stored":37105264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":25169920,"data_stored":25165914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T23:49:46.255 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-26T23:49:46.255 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T23:49:46.386 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:46.382+0000 7f1448f7f640 1 Processor -- start 2024-04-26T23:49:46.386 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:46.382+0000 7f1448f7f640 1 -- start start 2024-04-26T23:49:46.394 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:46.382+0000 7f1448f7f640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f14440c3060 0x7f14440720a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:46.394 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:46.382+0000 7f1448f7f640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f14440c46e0 0x7f14440c4b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:46.394 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:46.382+0000 7f1448f7f640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1444154ba0 con 0x7f14440c40e0 2024-04-26T23:49:46.394 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:46.382+0000 7f1448f7f640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f1444154e80 con 0x7f14440c3060 2024-04-26T23:49:46.394 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:46.382+0000 7f1448f7f640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f1444155160 con 0x7f14440c46e0 2024-04-26T23:49:46.394 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:46.383+0000 7f1442d9d640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f14440c46e0 0x7f14440c4b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:46.394 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:46.383+0000 7f144259c640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f14440c3060 0x7f14440720a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:46.394 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:46.383+0000 7f1441d9b640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f14440c40e0 0x7f1444151e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.88:46128/0 (socket says 172.21.15.88:46128) 2024-04-26T23:49:46.395 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:46.383+0000 7f1441d9b640 1 -- 172.21.15.88:0/3957054328 learned_addr learned my addr 172.21.15.88:0/3957054328 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-26T23:49:46.395 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:46.383+0000 7f144259c640 1 -- 172.21.15.88:0/3957054328 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f14440c46e0 msgr2=0x7f14440c4b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:49:46.395 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:46.383+0000 7f144259c640 1 --2- 172.21.15.88:0/3957054328 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f14440c46e0 0x7f14440c4b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:46.395 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:46.383+0000 7f144259c640 1 -- 172.21.15.88:0/3957054328 >> v1:172.21.15.175:6789/0 conn(0x7f14440c40e0 legacy=0x7f1444151e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:46.395 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:46.383+0000 7f144259c640 1 -- 172.21.15.88:0/3957054328 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1444155440 con 0x7f14440c3060 2024-04-26T23:49:46.395 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:46.383+0000 7f144159a640 1 -- 172.21.15.88:0/3957054328 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 116585243 0 0) 0x7f1444154ba0 con 0x7f14440c40e0 2024-04-26T23:49:46.395 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:46.384+0000 7f144259c640 1 --2- 172.21.15.88:0/3957054328 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f14440c3060 0x7f14440720a0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f143c0097a0 tx=0x7f143c02a100 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ff105d621a883dbe server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:49:46.395 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:46.384+0000 7f144159a640 1 -- 172.21.15.88:0/3957054328 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f143c037070 con 0x7f14440c3060 2024-04-26T23:49:46.395 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:46.384+0000 7f144159a640 1 -- 172.21.15.88:0/3957054328 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f143c02ae50 con 0x7f14440c3060 2024-04-26T23:49:46.395 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:46.384+0000 7f144159a640 1 -- 172.21.15.88:0/3957054328 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f143c032660 con 0x7f14440c3060 2024-04-26T23:49:46.395 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:46.384+0000 7f1448f7f640 1 -- 172.21.15.88:0/3957054328 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f14440c3060 msgr2=0x7f14440720a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:46.395 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:46.384+0000 7f1448f7f640 1 --2- 172.21.15.88:0/3957054328 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f14440c3060 0x7f14440720a0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f143c0097a0 tx=0x7f143c02a100 comp rx=0 tx=0).stop 2024-04-26T23:49:46.395 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:46.385+0000 7f1448f7f640 1 -- 172.21.15.88:0/3957054328 shutdown_connections 2024-04-26T23:49:46.395 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:46.385+0000 7f1448f7f640 1 --2- 172.21.15.88:0/3957054328 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f14440c46e0 0x7f14440c4b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:46.395 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:46.385+0000 7f1448f7f640 1 --2- 172.21.15.88:0/3957054328 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f14440c3060 0x7f14440720a0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:46.396 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:46.385+0000 7f1448f7f640 1 -- 172.21.15.88:0/3957054328 >> 172.21.15.88:0/3957054328 conn(0x7f144406c310 msgr2=0x7f144406c6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:49:46.396 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:46.385+0000 7f1448f7f640 1 -- 172.21.15.88:0/3957054328 shutdown_connections 2024-04-26T23:49:46.396 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:46.385+0000 7f1448f7f640 1 -- 172.21.15.88:0/3957054328 wait complete. 2024-04-26T23:49:46.396 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:46.386+0000 7f1448f7f640 1 Processor -- start 2024-04-26T23:49:46.396 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:46.386+0000 7f1448f7f640 1 -- start start 2024-04-26T23:49:46.396 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:46.386+0000 7f1448f7f640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f14440c3060 0x7f1444151110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:46.396 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:46.386+0000 7f1448f7f640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f14440c40e0 0x7f14441e93f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:46.396 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:46.386+0000 7f1448f7f640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f14440c46e0 0x7f14441e9930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:46.396 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:46.386+0000 7f1448f7f640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f14440c3440 con 0x7f14440c46e0 2024-04-26T23:49:46.396 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:46.386+0000 7f1448f7f640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f14440c3aa0 con 0x7f14440c3060 2024-04-26T23:49:46.396 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:46.386+0000 7f1448f7f640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f14440c35c0 con 0x7f14440c40e0 2024-04-26T23:49:46.396 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:46.387+0000 7f1442d9d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f14440c46e0 0x7f14441e9930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:46.396 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:46.387+0000 7f1442d9d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f14440c46e0 0x7f14441e9930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:59536/0 (socket says 172.21.15.88:59536) 2024-04-26T23:49:46.396 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:46.387+0000 7f1442d9d640 1 -- 172.21.15.88:0/300716761 learned_addr learned my addr 172.21.15.88:0/300716761 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:49:46.396 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:46.387+0000 7f1441d9b640 1 --2- 172.21.15.88:0/300716761 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f14440c40e0 0x7f14441e93f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:46.396 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:46.387+0000 7f144259c640 1 --2- 172.21.15.88:0/300716761 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f14440c3060 0x7f1444151110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:46.397 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:46.387+0000 7f1442d9d640 1 -- 172.21.15.88:0/300716761 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f14440c40e0 msgr2=0x7f14441e93f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:46.397 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:46.387+0000 7f1442d9d640 1 --2- 172.21.15.88:0/300716761 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f14440c40e0 0x7f14441e93f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:46.397 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:46.387+0000 7f1442d9d640 1 -- 172.21.15.88:0/300716761 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f14440c3060 msgr2=0x7f1444151110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:46.397 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:46.387+0000 7f1442d9d640 1 --2- 172.21.15.88:0/300716761 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f14440c3060 0x7f1444151110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:46.397 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:46.387+0000 7f1442d9d640 1 -- 172.21.15.88:0/300716761 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1444071860 con 0x7f14440c46e0 2024-04-26T23:49:46.397 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:46.387+0000 7f1442d9d640 1 --2- 172.21.15.88:0/300716761 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f14440c46e0 0x7f14441e9930 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f143400e960 tx=0x7f143400ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:49:46.397 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:46.387+0000 7f1432ffd640 1 -- 172.21.15.88:0/300716761 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1434017070 con 0x7f14440c46e0 2024-04-26T23:49:46.397 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:46.387+0000 7f1432ffd640 1 -- 172.21.15.88:0/300716761 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f143400c980 con 0x7f14440c46e0 2024-04-26T23:49:46.397 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:46.387+0000 7f1432ffd640 1 -- 172.21.15.88:0/300716761 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f143400cd70 con 0x7f14440c46e0 2024-04-26T23:49:46.397 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:46.387+0000 7f1448f7f640 1 -- 172.21.15.88:0/300716761 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14441ef860 con 0x7f14440c46e0 2024-04-26T23:49:46.397 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:46.387+0000 7f1448f7f640 1 -- 172.21.15.88:0/300716761 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14441efe20 con 0x7f14440c46e0 2024-04-26T23:49:46.397 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:46.388+0000 7f1448f7f640 1 -- 172.21.15.88:0/300716761 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f14440507a0 con 0x7f14440c46e0 2024-04-26T23:49:46.397 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:46.389+0000 7f1432ffd640 1 -- 172.21.15.88:0/300716761 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f143401a070 con 0x7f14440c46e0 2024-04-26T23:49:46.397 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:46.389+0000 7f1432ffd640 1 --2- 172.21.15.88:0/300716761 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f142406c8f0 0x7f142406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:46.398 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:46.389+0000 7f1432ffd640 1 -- 172.21.15.88:0/300716761 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6666+0+0 (secure 0 0 0) 0x7f143408bdd0 con 0x7f14440c46e0 2024-04-26T23:49:46.398 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:46.389+0000 7f144259c640 1 --2- 172.21.15.88:0/300716761 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f142406c8f0 0x7f142406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:46.398 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:46.389+0000 7f144259c640 1 --2- 172.21.15.88:0/300716761 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f142406c8f0 0x7f142406edb0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f143c034000 tx=0x7f143c02e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:49:46.398 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:46.393+0000 7f1432ffd640 1 -- 172.21.15.88:0/300716761 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f1434059880 con 0x7f14440c46e0 2024-04-26T23:49:46.571 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:46.566+0000 7f1448f7f640 1 -- 172.21.15.88:0/300716761 --> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f14441ec500 con 0x7f142406c8f0 2024-04-26T23:49:46.582 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:46.577+0000 7f1432ffd640 1 -- 172.21.15.88:0/300716761 <== mgr.4104 v2:172.21.15.88:6832/651674297 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+494239 (secure 0 0 0) 0x7f14441ec500 con 0x7f142406c8f0 2024-04-26T23:49:46.587 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-26T23:49:46.593 INFO:teuthology.orchestra.run.smithi088.stderr:dumped all 2024-04-26T23:49:46.594 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:46.581+0000 7f1448f7f640 1 -- 172.21.15.88:0/300716761 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f142406c8f0 msgr2=0x7f142406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:46.594 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:46.581+0000 7f1448f7f640 1 --2- 172.21.15.88:0/300716761 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f142406c8f0 0x7f142406edb0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f143c034000 tx=0x7f143c02e000 comp rx=0 tx=0).stop 2024-04-26T23:49:46.594 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:46.581+0000 7f1448f7f640 1 -- 172.21.15.88:0/300716761 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f14440c46e0 msgr2=0x7f14441e9930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:46.594 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:46.581+0000 7f1448f7f640 1 --2- 172.21.15.88:0/300716761 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f14440c46e0 0x7f14441e9930 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f143400e960 tx=0x7f143400ee20 comp rx=0 tx=0).stop 2024-04-26T23:49:46.595 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:46.581+0000 7f1448f7f640 1 -- 172.21.15.88:0/300716761 shutdown_connections 2024-04-26T23:49:46.595 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:46.581+0000 7f1448f7f640 1 --2- 172.21.15.88:0/300716761 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f142406c8f0 0x7f142406edb0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:46.595 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:46.581+0000 7f1448f7f640 1 --2- 172.21.15.88:0/300716761 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f14440c40e0 0x7f14441e93f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:46.595 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:46.581+0000 7f1448f7f640 1 --2- 172.21.15.88:0/300716761 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f14440c46e0 0x7f14441e9930 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:46.595 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:46.581+0000 7f1448f7f640 1 --2- 172.21.15.88:0/300716761 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f14440c3060 0x7f1444151110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:46.595 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:46.582+0000 7f1448f7f640 1 -- 172.21.15.88:0/300716761 >> 172.21.15.88:0/300716761 conn(0x7f144406c310 msgr2=0x7f1444071be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:49:46.595 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:46.582+0000 7f1448f7f640 1 -- 172.21.15.88:0/300716761 shutdown_connections 2024-04-26T23:49:46.595 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:46.582+0000 7f1448f7f640 1 -- 172.21.15.88:0/300716761 wait complete. 2024-04-26T23:49:46.597 INFO:teuthology.orchestra.run.smithi088.stdout:{"pg_ready":true,"pg_map":{"version":303,"stamp":"2024-04-26T23:49:46.108223+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":308985640,"num_objects":120,"num_object_clones":0,"num_object_copies":240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":120,"num_whiteouts":0,"num_read":149,"num_read_kb":293,"num_write":8375225,"num_write_kb":107315377,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":560720,"ondisk_log_size":560720,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":386,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":5736928,"kb_used_data":605792,"kb_used_omap":12,"kb_used_meta":5131059,"kb_avail":749237792,"statfs":{"total":773094113280,"available":767219499008,"internally_reserved":0,"allocated":620331008,"data_stored":618876263,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":5254204976},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":36,"apply_latency_ms":36,"commit_latency_ns":36000000,"apply_latency_ns":36000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-12024434849,"num_objects":-3159,"num_object_clones":0,"num_object_copies":-6318,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-3159,"num_whiteouts":0,"num_read":3,"num_read_kb":9,"num_write":3197,"num_write_kb":339,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003518"},"pg_stats":[{"pgid":"5.18","version":"26'4247","reported_seq":4266,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:32.356515+0000","last_change":"2024-04-26T23:40:41.683801+0000","last_active":"2024-04-26T23:49:32.356515+0000","last_peered":"2024-04-26T23:49:32.356515+0000","last_clean":"2024-04-26T23:49:32.356515+0000","last_became_active":"2024-04-26T23:40:41.683484+0000","last_became_peered":"2024-04-26T23:40:41.683484+0000","last_unstale":"2024-04-26T23:49:32.356515+0000","last_undegraded":"2024-04-26T23:49:32.356515+0000","last_fullsized":"2024-04-26T23:49:32.356515+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":4247,"log_dups_size":0,"ondisk_log_size":4247,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:02:27.160408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":63732,"num_write_kb":854695,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1f","version":"26'15","reported_seq":45,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:47:58.449743+0000","last_change":"2024-04-26T23:40:31.576688+0000","last_active":"2024-04-26T23:47:58.449743+0000","last_peered":"2024-04-26T23:47:58.449743+0000","last_clean":"2024-04-26T23:47:58.449743+0000","last_became_active":"2024-04-26T23:40:31.576429+0000","last_became_peered":"2024-04-26T23:40:31.576429+0000","last_unstale":"2024-04-26T23:47:58.449743+0000","last_undegraded":"2024-04-26T23:47:58.449743+0000","last_fullsized":"2024-04-26T23:47:58.449743+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:47:42.681376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":4100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"26'4412","reported_seq":4440,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.856465+0000","last_change":"2024-04-26T23:40:32.578489+0000","last_active":"2024-04-26T23:49:42.856465+0000","last_peered":"2024-04-26T23:49:42.856465+0000","last_clean":"2024-04-26T23:49:42.856465+0000","last_became_active":"2024-04-26T23:40:32.578205+0000","last_became_peered":"2024-04-26T23:40:32.578205+0000","last_unstale":"2024-04-26T23:49:42.856465+0000","last_undegraded":"2024-04-26T23:49:42.856465+0000","last_fullsized":"2024-04-26T23:49:42.856465+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":4412,"log_dups_size":0,"ondisk_log_size":4412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:56:04.309611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":66444,"num_write_kb":860244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"26'23","reported_seq":44,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:48:00.741422+0000","last_change":"2024-04-26T23:40:40.666861+0000","last_active":"2024-04-26T23:48:00.741422+0000","last_peered":"2024-04-26T23:48:00.741422+0000","last_clean":"2024-04-26T23:48:00.741422+0000","last_became_active":"2024-04-26T23:40:40.666547+0000","last_became_peered":"2024-04-26T23:40:40.666547+0000","last_unstale":"2024-04-26T23:48:00.741422+0000","last_undegraded":"2024-04-26T23:48:00.741422+0000","last_fullsized":"2024-04-26T23:48:00.741422+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:27:47.818055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":4105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"26'5301","reported_seq":5320,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:32.359614+0000","last_change":"2024-04-26T23:40:41.689530+0000","last_active":"2024-04-26T23:49:32.359614+0000","last_peered":"2024-04-26T23:49:32.359614+0000","last_clean":"2024-04-26T23:49:32.359614+0000","last_became_active":"2024-04-26T23:40:41.687652+0000","last_became_peered":"2024-04-26T23:40:41.687652+0000","last_unstale":"2024-04-26T23:49:32.359614+0000","last_undegraded":"2024-04-26T23:49:32.359614+0000","last_fullsized":"2024-04-26T23:49:32.359614+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":5301,"log_dups_size":0,"ondisk_log_size":5301,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:58:45.972045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79884,"num_write_kb":1001634,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1e","version":"26'29","reported_seq":59,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:36.407374+0000","last_change":"2024-04-26T23:40:31.576867+0000","last_active":"2024-04-26T23:49:36.407374+0000","last_peered":"2024-04-26T23:49:36.407374+0000","last_clean":"2024-04-26T23:49:36.407374+0000","last_became_active":"2024-04-26T23:40:31.576342+0000","last_became_peered":"2024-04-26T23:40:31.576342+0000","last_unstale":"2024-04-26T23:49:36.407374+0000","last_undegraded":"2024-04-26T23:49:36.407374+0000","last_fullsized":"2024-04-26T23:49:36.407374+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:35:54.439397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":4114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"26'5109","reported_seq":5122,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.890952+0000","last_change":"2024-04-26T23:41:30.628386+0000","last_active":"2024-04-26T23:49:42.890952+0000","last_peered":"2024-04-26T23:49:42.890952+0000","last_clean":"2024-04-26T23:49:42.890952+0000","last_became_active":"2024-04-26T23:41:30.628139+0000","last_became_peered":"2024-04-26T23:41:30.628139+0000","last_unstale":"2024-04-26T23:49:42.890952+0000","last_undegraded":"2024-04-26T23:49:42.890952+0000","last_fullsized":"2024-04-26T23:49:42.890952+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":5109,"log_dups_size":0,"ondisk_log_size":5109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:10:21.873566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":76507,"num_write_kb":979233,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"26'25","reported_seq":46,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:30.276499+0000","last_change":"2024-04-26T23:40:40.672310+0000","last_active":"2024-04-26T23:49:30.276499+0000","last_peered":"2024-04-26T23:49:30.276499+0000","last_clean":"2024-04-26T23:49:30.276499+0000","last_became_active":"2024-04-26T23:40:40.672018+0000","last_became_peered":"2024-04-26T23:40:40.672018+0000","last_unstale":"2024-04-26T23:49:30.276499+0000","last_undegraded":"2024-04-26T23:49:30.276499+0000","last_fullsized":"2024-04-26T23:49:30.276499+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:01:10.835670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":8211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"26'3919","reported_seq":3938,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:30.326944+0000","last_change":"2024-04-26T23:40:41.686743+0000","last_active":"2024-04-26T23:49:30.326944+0000","last_peered":"2024-04-26T23:49:30.326944+0000","last_clean":"2024-04-26T23:49:30.326944+0000","last_became_active":"2024-04-26T23:40:41.686419+0000","last_became_peered":"2024-04-26T23:40:41.686419+0000","last_unstale":"2024-04-26T23:49:30.326944+0000","last_undegraded":"2024-04-26T23:49:30.326944+0000","last_fullsized":"2024-04-26T23:49:30.326944+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":3919,"log_dups_size":0,"ondisk_log_size":3919,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:08:35.027584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":59060,"num_write_kb":735586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1d","version":"26'46","reported_seq":75,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:36.404066+0000","last_change":"2024-04-26T23:40:31.578735+0000","last_active":"2024-04-26T23:49:36.404066+0000","last_peered":"2024-04-26T23:49:36.404066+0000","last_clean":"2024-04-26T23:49:36.404066+0000","last_became_active":"2024-04-26T23:40:31.578438+0000","last_became_peered":"2024-04-26T23:40:31.578438+0000","last_unstale":"2024-04-26T23:49:36.404066+0000","last_undegraded":"2024-04-26T23:49:36.404066+0000","last_fullsized":"2024-04-26T23:49:36.404066+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:30:10.397569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37,"num_write_kb":12306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"26'2988","reported_seq":3015,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.975858+0000","last_change":"2024-04-26T23:40:32.590624+0000","last_active":"2024-04-26T23:49:42.975858+0000","last_peered":"2024-04-26T23:49:42.975858+0000","last_clean":"2024-04-26T23:49:42.975858+0000","last_became_active":"2024-04-26T23:40:32.589687+0000","last_became_peered":"2024-04-26T23:40:32.589687+0000","last_unstale":"2024-04-26T23:49:42.975858+0000","last_undegraded":"2024-04-26T23:49:42.975858+0000","last_fullsized":"2024-04-26T23:49:42.975858+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":2988,"log_dups_size":0,"ondisk_log_size":2988,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:01:02.741964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44847,"num_write_kb":570063,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"26'1255","reported_seq":1276,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.843735+0000","last_change":"2024-04-26T23:40:40.677899+0000","last_active":"2024-04-26T23:48:13.843735+0000","last_peered":"2024-04-26T23:48:13.843735+0000","last_clean":"2024-04-26T23:48:13.843735+0000","last_became_active":"2024-04-26T23:40:40.677388+0000","last_became_peered":"2024-04-26T23:40:40.677388+0000","last_unstale":"2024-04-26T23:48:13.843735+0000","last_undegraded":"2024-04-26T23:48:13.843735+0000","last_fullsized":"2024-04-26T23:48:13.843735+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":1255,"log_dups_size":0,"ondisk_log_size":1255,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:52:34.793496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1253,"num_write_kb":5260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"26'3551","reported_seq":3570,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:30.305496+0000","last_change":"2024-04-26T23:40:41.680097+0000","last_active":"2024-04-26T23:49:30.305496+0000","last_peered":"2024-04-26T23:49:30.305496+0000","last_clean":"2024-04-26T23:49:30.305496+0000","last_became_active":"2024-04-26T23:40:41.679815+0000","last_became_peered":"2024-04-26T23:40:41.679815+0000","last_unstale":"2024-04-26T23:49:30.305496+0000","last_undegraded":"2024-04-26T23:49:30.305496+0000","last_fullsized":"2024-04-26T23:49:30.305496+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":3551,"log_dups_size":0,"ondisk_log_size":3551,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:10:30.972726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53503,"num_write_kb":665423,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"26'17","reported_seq":46,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:48:02.410604+0000","last_change":"2024-04-26T23:40:31.573648+0000","last_active":"2024-04-26T23:48:02.410604+0000","last_peered":"2024-04-26T23:48:02.410604+0000","last_clean":"2024-04-26T23:48:02.410604+0000","last_became_active":"2024-04-26T23:40:31.573347+0000","last_became_peered":"2024-04-26T23:40:31.573347+0000","last_unstale":"2024-04-26T23:48:02.410604+0000","last_undegraded":"2024-04-26T23:48:02.410604+0000","last_fullsized":"2024-04-26T23:48:02.410604+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:20:28.103413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":4100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"26'5057","reported_seq":5084,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.997446+0000","last_change":"2024-04-26T23:40:32.588309+0000","last_active":"2024-04-26T23:49:42.997446+0000","last_peered":"2024-04-26T23:49:42.997446+0000","last_clean":"2024-04-26T23:49:42.997446+0000","last_became_active":"2024-04-26T23:40:32.588007+0000","last_became_peered":"2024-04-26T23:40:32.588007+0000","last_unstale":"2024-04-26T23:49:42.997446+0000","last_undegraded":"2024-04-26T23:49:42.997446+0000","last_fullsized":"2024-04-26T23:49:42.997446+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":5057,"log_dups_size":0,"ondisk_log_size":5057,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:52:26.699790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":75905,"num_write_kb":967615,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"26'33","reported_seq":54,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:30.327673+0000","last_change":"2024-04-26T23:40:40.678547+0000","last_active":"2024-04-26T23:49:30.327673+0000","last_peered":"2024-04-26T23:49:30.327673+0000","last_clean":"2024-04-26T23:49:30.327673+0000","last_became_active":"2024-04-26T23:40:40.677668+0000","last_became_peered":"2024-04-26T23:40:40.677668+0000","last_unstale":"2024-04-26T23:49:30.327673+0000","last_undegraded":"2024-04-26T23:49:30.327673+0000","last_fullsized":"2024-04-26T23:49:30.327673+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:34:22.905623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":12307,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"26'4797","reported_seq":4817,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:32.355924+0000","last_change":"2024-04-26T23:40:41.689525+0000","last_active":"2024-04-26T23:49:32.355924+0000","last_peered":"2024-04-26T23:49:32.355924+0000","last_clean":"2024-04-26T23:49:32.355924+0000","last_became_active":"2024-04-26T23:40:41.687433+0000","last_became_peered":"2024-04-26T23:40:41.687433+0000","last_unstale":"2024-04-26T23:49:32.355924+0000","last_undegraded":"2024-04-26T23:49:32.355924+0000","last_fullsized":"2024-04-26T23:49:32.355924+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":4797,"log_dups_size":0,"ondisk_log_size":4797,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:38:42.155257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":72371,"num_write_kb":916696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"26'3820","reported_seq":3848,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.852304+0000","last_change":"2024-04-26T23:40:32.590053+0000","last_active":"2024-04-26T23:49:42.852304+0000","last_peered":"2024-04-26T23:49:42.852304+0000","last_clean":"2024-04-26T23:49:42.852304+0000","last_became_active":"2024-04-26T23:40:32.589802+0000","last_became_peered":"2024-04-26T23:40:32.589802+0000","last_unstale":"2024-04-26T23:49:42.852304+0000","last_undegraded":"2024-04-26T23:49:42.852304+0000","last_fullsized":"2024-04-26T23:49:42.852304+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":3820,"log_dups_size":0,"ondisk_log_size":3820,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:16:46.547536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":57277,"num_write_kb":731452,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"26'244","reported_seq":274,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:36.412818+0000","last_change":"2024-04-26T23:40:31.578524+0000","last_active":"2024-04-26T23:49:36.412818+0000","last_peered":"2024-04-26T23:49:36.412818+0000","last_clean":"2024-04-26T23:49:36.412818+0000","last_became_active":"2024-04-26T23:40:31.578230+0000","last_became_peered":"2024-04-26T23:40:31.578230+0000","last_unstale":"2024-04-26T23:49:36.412818+0000","last_undegraded":"2024-04-26T23:49:36.412818+0000","last_fullsized":"2024-04-26T23:49:36.412818+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":244,"log_dups_size":0,"ondisk_log_size":244,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:15:51.937774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":234,"num_write_kb":8395,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"26'20","reported_seq":41,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:47:31.547871+0000","last_change":"2024-04-26T23:40:40.676459+0000","last_active":"2024-04-26T23:47:31.547871+0000","last_peered":"2024-04-26T23:47:31.547871+0000","last_clean":"2024-04-26T23:47:31.547871+0000","last_became_active":"2024-04-26T23:40:40.675997+0000","last_became_peered":"2024-04-26T23:40:40.675997+0000","last_unstale":"2024-04-26T23:47:31.547871+0000","last_undegraded":"2024-04-26T23:47:31.547871+0000","last_fullsized":"2024-04-26T23:47:31.547871+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:37:38.455501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":4105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"26'4636","reported_seq":4655,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:32.358383+0000","last_change":"2024-04-26T23:40:41.679334+0000","last_active":"2024-04-26T23:49:32.358383+0000","last_peered":"2024-04-26T23:49:32.358383+0000","last_clean":"2024-04-26T23:49:32.358383+0000","last_became_active":"2024-04-26T23:40:41.679098+0000","last_became_peered":"2024-04-26T23:40:41.679098+0000","last_unstale":"2024-04-26T23:49:32.358383+0000","last_undegraded":"2024-04-26T23:49:32.358383+0000","last_fullsized":"2024-04-26T23:49:32.358383+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":4636,"log_dups_size":0,"ondisk_log_size":4636,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:52:35.798951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69716,"num_write_kb":886548,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"26'3484","reported_seq":3512,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.905029+0000","last_change":"2024-04-26T23:40:32.585827+0000","last_active":"2024-04-26T23:49:42.905029+0000","last_peered":"2024-04-26T23:49:42.905029+0000","last_clean":"2024-04-26T23:49:42.905029+0000","last_became_active":"2024-04-26T23:40:32.585522+0000","last_became_peered":"2024-04-26T23:40:32.585522+0000","last_unstale":"2024-04-26T23:49:42.905029+0000","last_undegraded":"2024-04-26T23:49:42.905029+0000","last_fullsized":"2024-04-26T23:49:42.905029+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":3484,"log_dups_size":0,"ondisk_log_size":3484,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:40:17.167353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":52204,"num_write_kb":651184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"26'16","reported_seq":46,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:36.407078+0000","last_change":"2024-04-26T23:40:31.575121+0000","last_active":"2024-04-26T23:49:36.407078+0000","last_peered":"2024-04-26T23:49:36.407078+0000","last_clean":"2024-04-26T23:49:36.407078+0000","last_became_active":"2024-04-26T23:40:31.574827+0000","last_became_peered":"2024-04-26T23:40:31.574827+0000","last_unstale":"2024-04-26T23:49:36.407078+0000","last_undegraded":"2024-04-26T23:49:36.407078+0000","last_fullsized":"2024-04-26T23:49:36.407078+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:43:13.740214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":4101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"26'4","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:32.344791+0000","last_change":"2024-04-26T23:40:40.678613+0000","last_active":"2024-04-26T23:49:32.344791+0000","last_peered":"2024-04-26T23:49:32.344791+0000","last_clean":"2024-04-26T23:49:32.344791+0000","last_became_active":"2024-04-26T23:40:40.677867+0000","last_became_peered":"2024-04-26T23:40:40.677867+0000","last_unstale":"2024-04-26T23:49:32.344791+0000","last_undegraded":"2024-04-26T23:49:32.344791+0000","last_fullsized":"2024-04-26T23:49:32.344791+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:35:16.288571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"26'4217","reported_seq":4236,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:30.298167+0000","last_change":"2024-04-26T23:40:41.685042+0000","last_active":"2024-04-26T23:49:30.298167+0000","last_peered":"2024-04-26T23:49:30.298167+0000","last_clean":"2024-04-26T23:49:30.298167+0000","last_became_active":"2024-04-26T23:40:41.684699+0000","last_became_peered":"2024-04-26T23:40:41.684699+0000","last_unstale":"2024-04-26T23:49:30.298167+0000","last_undegraded":"2024-04-26T23:49:30.298167+0000","last_fullsized":"2024-04-26T23:49:30.298167+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":4217,"log_dups_size":0,"ondisk_log_size":4217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:10:57.826183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":63591,"num_write_kb":826339,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"26'4047","reported_seq":4075,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.908595+0000","last_change":"2024-04-26T23:40:32.582721+0000","last_active":"2024-04-26T23:49:42.908595+0000","last_peered":"2024-04-26T23:49:42.908595+0000","last_clean":"2024-04-26T23:49:42.908595+0000","last_became_active":"2024-04-26T23:40:32.582438+0000","last_became_peered":"2024-04-26T23:40:32.582438+0000","last_unstale":"2024-04-26T23:49:42.908595+0000","last_undegraded":"2024-04-26T23:49:42.908595+0000","last_fullsized":"2024-04-26T23:49:42.908595+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":4047,"log_dups_size":0,"ondisk_log_size":4047,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:38:10.884592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":60599,"num_write_kb":814129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"26'16","reported_seq":46,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:36.396171+0000","last_change":"2024-04-26T23:40:31.575508+0000","last_active":"2024-04-26T23:49:36.396171+0000","last_peered":"2024-04-26T23:49:36.396171+0000","last_clean":"2024-04-26T23:49:36.396171+0000","last_became_active":"2024-04-26T23:40:31.575242+0000","last_became_peered":"2024-04-26T23:40:31.575242+0000","last_unstale":"2024-04-26T23:49:36.396171+0000","last_undegraded":"2024-04-26T23:49:36.396171+0000","last_fullsized":"2024-04-26T23:49:36.396171+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:48:32.015654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":4101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"26'16","reported_seq":37,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:32.336622+0000","last_change":"2024-04-26T23:40:40.679196+0000","last_active":"2024-04-26T23:49:32.336622+0000","last_peered":"2024-04-26T23:49:32.336622+0000","last_clean":"2024-04-26T23:49:32.336622+0000","last_became_active":"2024-04-26T23:40:40.678740+0000","last_became_peered":"2024-04-26T23:40:40.678740+0000","last_unstale":"2024-04-26T23:49:32.336622+0000","last_undegraded":"2024-04-26T23:49:32.336622+0000","last_fullsized":"2024-04-26T23:49:32.336622+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:40:14.479631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":4110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"26'5261","reported_seq":5280,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:30.318331+0000","last_change":"2024-04-26T23:40:41.686638+0000","last_active":"2024-04-26T23:49:30.318331+0000","last_peered":"2024-04-26T23:49:30.318331+0000","last_clean":"2024-04-26T23:49:30.318331+0000","last_became_active":"2024-04-26T23:40:41.686354+0000","last_became_peered":"2024-04-26T23:40:41.686354+0000","last_unstale":"2024-04-26T23:49:30.318331+0000","last_undegraded":"2024-04-26T23:49:30.318331+0000","last_fullsized":"2024-04-26T23:49:30.318331+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":5261,"log_dups_size":0,"ondisk_log_size":5261,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:06:12.755431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79283,"num_write_kb":1000134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"26'4022","reported_seq":4050,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.889538+0000","last_change":"2024-04-26T23:40:32.583019+0000","last_active":"2024-04-26T23:49:42.889538+0000","last_peered":"2024-04-26T23:49:42.889538+0000","last_clean":"2024-04-26T23:49:42.889538+0000","last_became_active":"2024-04-26T23:40:32.582719+0000","last_became_peered":"2024-04-26T23:40:32.582719+0000","last_unstale":"2024-04-26T23:49:42.889538+0000","last_undegraded":"2024-04-26T23:49:42.889538+0000","last_fullsized":"2024-04-26T23:49:42.889538+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":4022,"log_dups_size":0,"ondisk_log_size":4022,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:25:02.319783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":60741,"num_write_kb":745879,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"26'19","reported_seq":49,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:36.391367+0000","last_change":"2024-04-26T23:40:31.576866+0000","last_active":"2024-04-26T23:49:36.391367+0000","last_peered":"2024-04-26T23:49:36.391367+0000","last_clean":"2024-04-26T23:49:36.391367+0000","last_became_active":"2024-04-26T23:40:31.576419+0000","last_became_peered":"2024-04-26T23:40:31.576419+0000","last_unstale":"2024-04-26T23:49:36.391367+0000","last_undegraded":"2024-04-26T23:49:36.391367+0000","last_fullsized":"2024-04-26T23:49:36.391367+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:45:49.295198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":4102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"26'18","reported_seq":39,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:32.332148+0000","last_change":"2024-04-26T23:40:40.675262+0000","last_active":"2024-04-26T23:49:32.332148+0000","last_peered":"2024-04-26T23:49:32.332148+0000","last_clean":"2024-04-26T23:49:32.332148+0000","last_became_active":"2024-04-26T23:40:40.674721+0000","last_became_peered":"2024-04-26T23:40:40.674721+0000","last_unstale":"2024-04-26T23:49:32.332148+0000","last_undegraded":"2024-04-26T23:49:32.332148+0000","last_fullsized":"2024-04-26T23:49:32.332148+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:56:12.403317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":4101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"26'4206","reported_seq":4226,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:32.327428+0000","last_change":"2024-04-26T23:40:41.691494+0000","last_active":"2024-04-26T23:49:32.327428+0000","last_peered":"2024-04-26T23:49:32.327428+0000","last_clean":"2024-04-26T23:49:32.327428+0000","last_became_active":"2024-04-26T23:40:41.691241+0000","last_became_peered":"2024-04-26T23:40:41.691241+0000","last_unstale":"2024-04-26T23:49:32.327428+0000","last_undegraded":"2024-04-26T23:49:32.327428+0000","last_fullsized":"2024-04-26T23:49:32.327428+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":4206,"log_dups_size":0,"ondisk_log_size":4206,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:08:35.027584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":63038,"num_write_kb":829161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"26'3470","reported_seq":3498,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.886281+0000","last_change":"2024-04-26T23:40:32.584988+0000","last_active":"2024-04-26T23:49:42.886281+0000","last_peered":"2024-04-26T23:49:42.886281+0000","last_clean":"2024-04-26T23:49:42.886281+0000","last_became_active":"2024-04-26T23:40:32.584467+0000","last_became_peered":"2024-04-26T23:40:32.584467+0000","last_unstale":"2024-04-26T23:49:42.886281+0000","last_undegraded":"2024-04-26T23:49:42.886281+0000","last_fullsized":"2024-04-26T23:49:42.886281+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":3470,"log_dups_size":0,"ondisk_log_size":3470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:51:30.677247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51752,"num_write_kb":657341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"26'115","reported_seq":145,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.784144+0000","last_change":"2024-04-26T23:40:31.573721+0000","last_active":"2024-04-26T23:49:42.784144+0000","last_peered":"2024-04-26T23:49:42.784144+0000","last_clean":"2024-04-26T23:49:42.784144+0000","last_became_active":"2024-04-26T23:40:31.573434+0000","last_became_peered":"2024-04-26T23:40:31.573434+0000","last_unstale":"2024-04-26T23:49:42.784144+0000","last_undegraded":"2024-04-26T23:49:42.784144+0000","last_fullsized":"2024-04-26T23:49:42.784144+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":115,"log_dups_size":0,"ondisk_log_size":115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:20:28.103413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2675866,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":112,"num_write_kb":2659,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"26'20","reported_seq":60,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:37.321768+0000","last_change":"2024-04-26T23:40:40.678020+0000","last_active":"2024-04-26T23:49:37.321768+0000","last_peered":"2024-04-26T23:49:37.321768+0000","last_clean":"2024-04-26T23:49:37.321768+0000","last_became_active":"2024-04-26T23:40:40.677410+0000","last_became_peered":"2024-04-26T23:40:40.677410+0000","last_unstale":"2024-04-26T23:49:37.321768+0000","last_undegraded":"2024-04-26T23:49:37.321768+0000","last_fullsized":"2024-04-26T23:49:37.321768+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:44:50.588556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88181,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":98,"num_write":18,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"26'4391","reported_seq":4411,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:30.315363+0000","last_change":"2024-04-26T23:40:41.689839+0000","last_active":"2024-04-26T23:49:30.315363+0000","last_peered":"2024-04-26T23:49:30.315363+0000","last_clean":"2024-04-26T23:49:30.315363+0000","last_became_active":"2024-04-26T23:40:41.689508+0000","last_became_peered":"2024-04-26T23:40:41.689508+0000","last_unstale":"2024-04-26T23:49:30.315363+0000","last_undegraded":"2024-04-26T23:49:30.315363+0000","last_fullsized":"2024-04-26T23:49:30.315363+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":4391,"log_dups_size":0,"ondisk_log_size":4391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:17:28.672777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":66189,"num_write_kb":852725,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"26'4076","reported_seq":4104,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.946960+0000","last_change":"2024-04-26T23:40:32.594913+0000","last_active":"2024-04-26T23:49:42.946960+0000","last_peered":"2024-04-26T23:49:42.946960+0000","last_clean":"2024-04-26T23:49:42.946960+0000","last_became_active":"2024-04-26T23:40:32.594616+0000","last_became_peered":"2024-04-26T23:40:32.594616+0000","last_unstale":"2024-04-26T23:49:42.946960+0000","last_undegraded":"2024-04-26T23:49:42.946960+0000","last_fullsized":"2024-04-26T23:49:42.946960+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":4076,"log_dups_size":0,"ondisk_log_size":4076,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:04:30.553552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":61223,"num_write_kb":789949,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"26'262","reported_seq":292,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:40.290090+0000","last_change":"2024-04-26T23:40:31.576299+0000","last_active":"2024-04-26T23:49:40.290090+0000","last_peered":"2024-04-26T23:49:40.290090+0000","last_clean":"2024-04-26T23:49:40.290090+0000","last_became_active":"2024-04-26T23:40:31.576006+0000","last_became_peered":"2024-04-26T23:40:31.576006+0000","last_unstale":"2024-04-26T23:49:40.290090+0000","last_undegraded":"2024-04-26T23:49:40.290090+0000","last_fullsized":"2024-04-26T23:49:40.290090+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":262,"log_dups_size":0,"ondisk_log_size":262,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:15:51.937774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":519,"num_write_kb":200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"26'25","reported_seq":47,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:32.330189+0000","last_change":"2024-04-26T23:40:40.674806+0000","last_active":"2024-04-26T23:49:32.330189+0000","last_peered":"2024-04-26T23:49:32.330189+0000","last_clean":"2024-04-26T23:49:32.330189+0000","last_became_active":"2024-04-26T23:40:40.674557+0000","last_became_peered":"2024-04-26T23:40:40.674557+0000","last_unstale":"2024-04-26T23:49:32.330189+0000","last_undegraded":"2024-04-26T23:49:32.330189+0000","last_fullsized":"2024-04-26T23:49:32.330189+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:45:33.226487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":12298,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"26'4697","reported_seq":4717,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:30.264413+0000","last_change":"2024-04-26T23:40:41.688941+0000","last_active":"2024-04-26T23:49:30.264413+0000","last_peered":"2024-04-26T23:49:30.264413+0000","last_clean":"2024-04-26T23:49:30.264413+0000","last_became_active":"2024-04-26T23:40:41.688653+0000","last_became_peered":"2024-04-26T23:40:41.688653+0000","last_unstale":"2024-04-26T23:49:30.264413+0000","last_undegraded":"2024-04-26T23:49:30.264413+0000","last_fullsized":"2024-04-26T23:49:30.264413+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":4697,"log_dups_size":0,"ondisk_log_size":4697,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:53:13.531466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":70754,"num_write_kb":894410,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"26'4242","reported_seq":4270,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.856648+0000","last_change":"2024-04-26T23:40:32.582442+0000","last_active":"2024-04-26T23:49:42.856648+0000","last_peered":"2024-04-26T23:49:42.856648+0000","last_clean":"2024-04-26T23:49:42.856648+0000","last_became_active":"2024-04-26T23:40:32.582140+0000","last_became_peered":"2024-04-26T23:40:32.582140+0000","last_unstale":"2024-04-26T23:49:42.856648+0000","last_undegraded":"2024-04-26T23:49:42.856648+0000","last_fullsized":"2024-04-26T23:49:42.856648+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":4242,"log_dups_size":0,"ondisk_log_size":4242,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:18:09.706875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":63708,"num_write_kb":831213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"26'16","reported_seq":46,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:36.405509+0000","last_change":"2024-04-26T23:40:31.576565+0000","last_active":"2024-04-26T23:49:36.405509+0000","last_peered":"2024-04-26T23:49:36.405509+0000","last_clean":"2024-04-26T23:49:36.405509+0000","last_became_active":"2024-04-26T23:40:31.576313+0000","last_became_peered":"2024-04-26T23:40:31.576313+0000","last_unstale":"2024-04-26T23:49:36.405509+0000","last_undegraded":"2024-04-26T23:49:36.405509+0000","last_fullsized":"2024-04-26T23:49:36.405509+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:25:01.315397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":4100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"26'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:47:32.117231+0000","last_change":"2024-04-26T23:40:40.671047+0000","last_active":"2024-04-26T23:47:32.117231+0000","last_peered":"2024-04-26T23:47:32.117231+0000","last_clean":"2024-04-26T23:47:32.117231+0000","last_became_active":"2024-04-26T23:40:40.670630+0000","last_became_peered":"2024-04-26T23:40:40.670630+0000","last_unstale":"2024-04-26T23:47:32.117231+0000","last_undegraded":"2024-04-26T23:47:32.117231+0000","last_fullsized":"2024-04-26T23:47:32.117231+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:45:07.071050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"26'4137","reported_seq":4157,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:30.321424+0000","last_change":"2024-04-26T23:40:41.686221+0000","last_active":"2024-04-26T23:49:30.321424+0000","last_peered":"2024-04-26T23:49:30.321424+0000","last_clean":"2024-04-26T23:49:30.321424+0000","last_became_active":"2024-04-26T23:40:41.685961+0000","last_became_peered":"2024-04-26T23:40:41.685961+0000","last_unstale":"2024-04-26T23:49:30.321424+0000","last_undegraded":"2024-04-26T23:49:30.321424+0000","last_fullsized":"2024-04-26T23:49:30.321424+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":4137,"log_dups_size":0,"ondisk_log_size":4137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:28:34.920939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":62474,"num_write_kb":825561,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"26'3719","reported_seq":3747,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.995441+0000","last_change":"2024-04-26T23:40:32.584363+0000","last_active":"2024-04-26T23:49:42.995441+0000","last_peered":"2024-04-26T23:49:42.995441+0000","last_clean":"2024-04-26T23:49:42.995441+0000","last_became_active":"2024-04-26T23:40:32.584082+0000","last_became_peered":"2024-04-26T23:40:32.584082+0000","last_unstale":"2024-04-26T23:49:42.995441+0000","last_undegraded":"2024-04-26T23:49:42.995441+0000","last_fullsized":"2024-04-26T23:49:42.995441+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":3719,"log_dups_size":0,"ondisk_log_size":3719,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:35:08.194865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55724,"num_write_kb":725978,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"26'6","reported_seq":36,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:36.393573+0000","last_change":"2024-04-26T23:40:31.576711+0000","last_active":"2024-04-26T23:49:36.393573+0000","last_peered":"2024-04-26T23:49:36.393573+0000","last_clean":"2024-04-26T23:49:36.393573+0000","last_became_active":"2024-04-26T23:40:31.576404+0000","last_became_peered":"2024-04-26T23:40:31.576404+0000","last_unstale":"2024-04-26T23:49:36.393573+0000","last_undegraded":"2024-04-26T23:49:36.393573+0000","last_fullsized":"2024-04-26T23:49:36.393573+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:45:49.295198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"26'31","reported_seq":53,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:32.328269+0000","last_change":"2024-04-26T23:40:40.675296+0000","last_active":"2024-04-26T23:49:32.328269+0000","last_peered":"2024-04-26T23:49:32.328269+0000","last_clean":"2024-04-26T23:49:32.328269+0000","last_became_active":"2024-04-26T23:40:40.674935+0000","last_became_peered":"2024-04-26T23:40:40.674935+0000","last_unstale":"2024-04-26T23:49:32.328269+0000","last_undegraded":"2024-04-26T23:49:32.328269+0000","last_fullsized":"2024-04-26T23:49:32.328269+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:10:10.722905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":8205,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"26'3986","reported_seq":4006,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:30.313667+0000","last_change":"2024-04-26T23:40:41.691510+0000","last_active":"2024-04-26T23:49:30.313667+0000","last_peered":"2024-04-26T23:49:30.313667+0000","last_clean":"2024-04-26T23:49:30.313667+0000","last_became_active":"2024-04-26T23:40:41.691242+0000","last_became_peered":"2024-04-26T23:40:41.691242+0000","last_unstale":"2024-04-26T23:49:30.313667+0000","last_undegraded":"2024-04-26T23:49:30.313667+0000","last_fullsized":"2024-04-26T23:49:30.313667+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":3986,"log_dups_size":0,"ondisk_log_size":3986,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:27:48.823509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":59849,"num_write_kb":777586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"26'3874","reported_seq":3902,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.917138+0000","last_change":"2024-04-26T23:40:32.590069+0000","last_active":"2024-04-26T23:49:42.917138+0000","last_peered":"2024-04-26T23:49:42.917138+0000","last_clean":"2024-04-26T23:49:42.917138+0000","last_became_active":"2024-04-26T23:40:32.589790+0000","last_became_peered":"2024-04-26T23:40:32.589790+0000","last_unstale":"2024-04-26T23:49:42.917138+0000","last_undegraded":"2024-04-26T23:49:42.917138+0000","last_fullsized":"2024-04-26T23:49:42.917138+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":3874,"log_dups_size":0,"ondisk_log_size":3874,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:15:52.942160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":58064,"num_write_kb":769321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"26'25","reported_seq":55,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:36.421096+0000","last_change":"2024-04-26T23:40:31.572432+0000","last_active":"2024-04-26T23:49:36.421096+0000","last_peered":"2024-04-26T23:49:36.421096+0000","last_clean":"2024-04-26T23:49:36.421096+0000","last_became_active":"2024-04-26T23:40:31.572121+0000","last_became_peered":"2024-04-26T23:40:31.572121+0000","last_unstale":"2024-04-26T23:49:36.421096+0000","last_undegraded":"2024-04-26T23:49:36.421096+0000","last_fullsized":"2024-04-26T23:49:36.421096+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:45:49.295198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":8200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"26'6","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:30.319370+0000","last_change":"2024-04-26T23:40:40.678404+0000","last_active":"2024-04-26T23:49:30.319370+0000","last_peered":"2024-04-26T23:49:30.319370+0000","last_clean":"2024-04-26T23:49:30.319370+0000","last_became_active":"2024-04-26T23:40:40.678136+0000","last_became_peered":"2024-04-26T23:40:40.678136+0000","last_unstale":"2024-04-26T23:49:30.319370+0000","last_undegraded":"2024-04-26T23:49:30.319370+0000","last_fullsized":"2024-04-26T23:49:30.319370+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:45:11.058699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"26'3869","reported_seq":3889,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:30.287388+0000","last_change":"2024-04-26T23:40:41.673542+0000","last_active":"2024-04-26T23:49:30.287388+0000","last_peered":"2024-04-26T23:49:30.287388+0000","last_clean":"2024-04-26T23:49:30.287388+0000","last_became_active":"2024-04-26T23:40:41.673254+0000","last_became_peered":"2024-04-26T23:40:41.673254+0000","last_unstale":"2024-04-26T23:49:30.287388+0000","last_undegraded":"2024-04-26T23:49:30.287388+0000","last_fullsized":"2024-04-26T23:49:30.287388+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":3869,"log_dups_size":0,"ondisk_log_size":3869,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:10:11.728359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":58020,"num_write_kb":724597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"26'3920","reported_seq":3948,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.908644+0000","last_change":"2024-04-26T23:40:32.576783+0000","last_active":"2024-04-26T23:49:42.908644+0000","last_peered":"2024-04-26T23:49:42.908644+0000","last_clean":"2024-04-26T23:49:42.908644+0000","last_became_active":"2024-04-26T23:40:32.576481+0000","last_became_peered":"2024-04-26T23:40:32.576481+0000","last_unstale":"2024-04-26T23:49:42.908644+0000","last_undegraded":"2024-04-26T23:49:42.908644+0000","last_fullsized":"2024-04-26T23:49:42.908644+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":3920,"log_dups_size":0,"ondisk_log_size":3920,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:16:46.547536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":58555,"num_write_kb":772397,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"26'17","reported_seq":62,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:40.459144+0000","last_change":"2024-04-26T23:40:31.570775+0000","last_active":"2024-04-26T23:49:40.459144+0000","last_peered":"2024-04-26T23:49:40.459144+0000","last_clean":"2024-04-26T23:49:40.459144+0000","last_became_active":"2024-04-26T23:40:31.570493+0000","last_became_peered":"2024-04-26T23:40:31.570493+0000","last_unstale":"2024-04-26T23:49:40.459144+0000","last_undegraded":"2024-04-26T23:49:40.459144+0000","last_fullsized":"2024-04-26T23:49:40.459144+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:45:49.295198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88181,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":95,"num_write":15,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"26'23","reported_seq":45,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:30.334159+0000","last_change":"2024-04-26T23:40:40.675115+0000","last_active":"2024-04-26T23:49:30.334159+0000","last_peered":"2024-04-26T23:49:30.334159+0000","last_clean":"2024-04-26T23:49:30.334159+0000","last_became_active":"2024-04-26T23:40:40.674828+0000","last_became_peered":"2024-04-26T23:40:40.674828+0000","last_unstale":"2024-04-26T23:49:30.334159+0000","last_undegraded":"2024-04-26T23:49:30.334159+0000","last_fullsized":"2024-04-26T23:49:30.334159+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:45:07.071050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":4104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"26'4508","reported_seq":4528,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:30.332520+0000","last_change":"2024-04-26T23:40:41.691098+0000","last_active":"2024-04-26T23:49:30.332520+0000","last_peered":"2024-04-26T23:49:30.332520+0000","last_clean":"2024-04-26T23:49:30.332520+0000","last_became_active":"2024-04-26T23:40:41.690803+0000","last_became_peered":"2024-04-26T23:40:41.690803+0000","last_unstale":"2024-04-26T23:49:30.332520+0000","last_undegraded":"2024-04-26T23:49:30.332520+0000","last_fullsized":"2024-04-26T23:49:30.332520+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":4508,"log_dups_size":0,"ondisk_log_size":4508,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:38:51.195172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":67888,"num_write_kb":829373,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"26'4011","reported_seq":4039,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.893538+0000","last_change":"2024-04-26T23:40:32.593262+0000","last_active":"2024-04-26T23:49:42.893538+0000","last_peered":"2024-04-26T23:49:42.893538+0000","last_clean":"2024-04-26T23:49:42.893538+0000","last_became_active":"2024-04-26T23:40:32.593003+0000","last_became_peered":"2024-04-26T23:40:32.593003+0000","last_unstale":"2024-04-26T23:49:42.893538+0000","last_undegraded":"2024-04-26T23:49:42.893538+0000","last_fullsized":"2024-04-26T23:49:42.893538+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":4011,"log_dups_size":0,"ondisk_log_size":4011,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:47:51.559918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":60122,"num_write_kb":778045,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"26'35","reported_seq":65,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:36.408525+0000","last_change":"2024-04-26T23:40:31.573864+0000","last_active":"2024-04-26T23:49:36.408525+0000","last_peered":"2024-04-26T23:49:36.408525+0000","last_clean":"2024-04-26T23:49:36.408525+0000","last_became_active":"2024-04-26T23:40:31.573594+0000","last_became_peered":"2024-04-26T23:40:31.573594+0000","last_unstale":"2024-04-26T23:49:36.408525+0000","last_undegraded":"2024-04-26T23:49:36.408525+0000","last_fullsized":"2024-04-26T23:49:36.408525+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:48:32.015654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":8204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"26'252","reported_seq":274,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:36.228459+0000","last_change":"2024-04-26T23:40:40.677258+0000","last_active":"2024-04-26T23:49:36.228459+0000","last_peered":"2024-04-26T23:49:36.228459+0000","last_clean":"2024-04-26T23:49:36.228459+0000","last_became_active":"2024-04-26T23:40:40.676937+0000","last_became_peered":"2024-04-26T23:40:40.676937+0000","last_unstale":"2024-04-26T23:49:36.228459+0000","last_undegraded":"2024-04-26T23:49:36.228459+0000","last_fullsized":"2024-04-26T23:49:36.228459+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":252,"log_dups_size":0,"ondisk_log_size":252,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:44:50.588556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":473,"num_write_kb":168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"26'4519","reported_seq":4539,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:30.334012+0000","last_change":"2024-04-26T23:40:41.684731+0000","last_active":"2024-04-26T23:49:30.334012+0000","last_peered":"2024-04-26T23:49:30.334012+0000","last_clean":"2024-04-26T23:49:30.334012+0000","last_became_active":"2024-04-26T23:40:41.684459+0000","last_became_peered":"2024-04-26T23:40:41.684459+0000","last_unstale":"2024-04-26T23:49:30.334012+0000","last_undegraded":"2024-04-26T23:49:30.334012+0000","last_fullsized":"2024-04-26T23:49:30.334012+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":4519,"log_dups_size":0,"ondisk_log_size":4519,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:24:07.784468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":68252,"num_write_kb":886817,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"26'4332","reported_seq":4360,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.920042+0000","last_change":"2024-04-26T23:40:32.593216+0000","last_active":"2024-04-26T23:49:42.920042+0000","last_peered":"2024-04-26T23:49:42.920042+0000","last_clean":"2024-04-26T23:49:42.920042+0000","last_became_active":"2024-04-26T23:40:32.592929+0000","last_became_peered":"2024-04-26T23:40:32.592929+0000","last_unstale":"2024-04-26T23:49:42.920042+0000","last_undegraded":"2024-04-26T23:49:42.920042+0000","last_fullsized":"2024-04-26T23:49:42.920042+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":4332,"log_dups_size":0,"ondisk_log_size":4332,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:12:45.093169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":65153,"num_write_kb":829422,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"26'2","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:48:10.239534+0000","last_change":"2024-04-26T23:40:31.570118+0000","last_active":"2024-04-26T23:48:10.239534+0000","last_peered":"2024-04-26T23:48:10.239534+0000","last_clean":"2024-04-26T23:48:10.239534+0000","last_became_active":"2024-04-26T23:40:31.569764+0000","last_became_peered":"2024-04-26T23:40:31.569764+0000","last_unstale":"2024-04-26T23:48:10.239534+0000","last_undegraded":"2024-04-26T23:48:10.239534+0000","last_fullsized":"2024-04-26T23:48:10.239534+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:15:30.884135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":186,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:46:31.335185+0000","last_change":"2024-04-26T23:40:20.966672+0000","last_active":"2024-04-26T23:46:31.335185+0000","last_peered":"2024-04-26T23:46:31.335185+0000","last_clean":"2024-04-26T23:46:31.335185+0000","last_became_active":"2024-04-26T23:40:20.963937+0000","last_became_peered":"2024-04-26T23:40:20.963937+0000","last_unstale":"2024-04-26T23:46:31.335185+0000","last_undegraded":"2024-04-26T23:46:31.335185+0000","last_fullsized":"2024-04-26T23:46:31.335185+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:19.950137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:19.950137+0000","last_clean_scrub_stamp":"2024-04-26T23:40:19.950137+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:23:39.166579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"26'7","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:30.322697+0000","last_change":"2024-04-26T23:40:40.671995+0000","last_active":"2024-04-26T23:49:30.322697+0000","last_peered":"2024-04-26T23:49:30.322697+0000","last_clean":"2024-04-26T23:49:30.322697+0000","last_became_active":"2024-04-26T23:40:40.671642+0000","last_became_peered":"2024-04-26T23:40:40.671642+0000","last_unstale":"2024-04-26T23:49:30.322697+0000","last_undegraded":"2024-04-26T23:49:30.322697+0000","last_fullsized":"2024-04-26T23:49:30.322697+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:35:16.288571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"26'3788","reported_seq":3808,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:32.348847+0000","last_change":"2024-04-26T23:40:41.680852+0000","last_active":"2024-04-26T23:49:32.348847+0000","last_peered":"2024-04-26T23:49:32.348847+0000","last_clean":"2024-04-26T23:49:32.348847+0000","last_became_active":"2024-04-26T23:40:41.680567+0000","last_became_peered":"2024-04-26T23:40:41.680567+0000","last_unstale":"2024-04-26T23:49:32.348847+0000","last_undegraded":"2024-04-26T23:49:32.348847+0000","last_fullsized":"2024-04-26T23:49:32.348847+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":3788,"log_dups_size":0,"ondisk_log_size":3788,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:40:15.485085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":57172,"num_write_kb":707056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"26'4186","reported_seq":4214,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.944934+0000","last_change":"2024-04-26T23:40:32.591906+0000","last_active":"2024-04-26T23:49:42.944934+0000","last_peered":"2024-04-26T23:49:42.944934+0000","last_clean":"2024-04-26T23:49:42.944934+0000","last_became_active":"2024-04-26T23:40:32.590867+0000","last_became_peered":"2024-04-26T23:40:32.590867+0000","last_unstale":"2024-04-26T23:49:42.944934+0000","last_undegraded":"2024-04-26T23:49:42.944934+0000","last_fullsized":"2024-04-26T23:49:42.944934+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":4186,"log_dups_size":0,"ondisk_log_size":4186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:56:04.309611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":62827,"num_write_kb":810912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"26'3","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:36.388158+0000","last_change":"2024-04-26T23:40:31.572391+0000","last_active":"2024-04-26T23:49:36.388158+0000","last_peered":"2024-04-26T23:49:36.388158+0000","last_clean":"2024-04-26T23:49:36.388158+0000","last_became_active":"2024-04-26T23:40:31.571849+0000","last_became_peered":"2024-04-26T23:40:31.571849+0000","last_unstale":"2024-04-26T23:49:36.388158+0000","last_undegraded":"2024-04-26T23:49:36.388158+0000","last_fullsized":"2024-04-26T23:49:36.388158+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:35:54.439397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"26'6","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:30.330522+0000","last_change":"2024-04-26T23:40:40.676464+0000","last_active":"2024-04-26T23:49:30.330522+0000","last_peered":"2024-04-26T23:49:30.330522+0000","last_clean":"2024-04-26T23:49:30.330522+0000","last_became_active":"2024-04-26T23:40:40.676154+0000","last_became_peered":"2024-04-26T23:40:40.676154+0000","last_unstale":"2024-04-26T23:49:30.330522+0000","last_undegraded":"2024-04-26T23:49:30.330522+0000","last_fullsized":"2024-04-26T23:49:30.330522+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:52:34.793496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"26'3982","reported_seq":4002,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:30.199676+0000","last_change":"2024-04-26T23:40:41.688065+0000","last_active":"2024-04-26T23:49:30.199676+0000","last_peered":"2024-04-26T23:49:30.199676+0000","last_clean":"2024-04-26T23:49:30.199676+0000","last_became_active":"2024-04-26T23:40:41.687693+0000","last_became_peered":"2024-04-26T23:40:41.687693+0000","last_unstale":"2024-04-26T23:49:30.199676+0000","last_undegraded":"2024-04-26T23:49:30.199676+0000","last_fullsized":"2024-04-26T23:49:30.199676+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":3982,"log_dups_size":0,"ondisk_log_size":3982,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:35:17.294025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":60042,"num_write_kb":782772,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"26'4287","reported_seq":4315,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.934302+0000","last_change":"2024-04-26T23:40:32.583469+0000","last_active":"2024-04-26T23:49:42.934302+0000","last_peered":"2024-04-26T23:49:42.934302+0000","last_clean":"2024-04-26T23:49:42.934302+0000","last_became_active":"2024-04-26T23:40:32.583174+0000","last_became_peered":"2024-04-26T23:40:32.583174+0000","last_unstale":"2024-04-26T23:49:42.934302+0000","last_undegraded":"2024-04-26T23:49:42.934302+0000","last_fullsized":"2024-04-26T23:49:42.934302+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":4287,"log_dups_size":0,"ondisk_log_size":4287,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:34:14.811917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":64102,"num_write_kb":832828,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"26'6","reported_seq":36,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:34.388816+0000","last_change":"2024-04-26T23:40:31.571749+0000","last_active":"2024-04-26T23:49:34.388816+0000","last_peered":"2024-04-26T23:49:34.388816+0000","last_clean":"2024-04-26T23:49:34.388816+0000","last_became_active":"2024-04-26T23:40:31.571427+0000","last_became_peered":"2024-04-26T23:40:31.571427+0000","last_unstale":"2024-04-26T23:49:34.388816+0000","last_undegraded":"2024-04-26T23:49:34.388816+0000","last_fullsized":"2024-04-26T23:49:34.388816+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:20:28.103413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"26'155","reported_seq":177,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:32.342498+0000","last_change":"2024-04-26T23:40:40.675987+0000","last_active":"2024-04-26T23:49:32.342498+0000","last_peered":"2024-04-26T23:49:32.342498+0000","last_clean":"2024-04-26T23:49:32.342498+0000","last_became_active":"2024-04-26T23:40:40.675682+0000","last_became_peered":"2024-04-26T23:40:40.675682+0000","last_unstale":"2024-04-26T23:49:32.342498+0000","last_undegraded":"2024-04-26T23:49:32.342498+0000","last_fullsized":"2024-04-26T23:49:32.342498+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":155,"log_dups_size":0,"ondisk_log_size":155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:10:10.722905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":145,"num_write_kb":8318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"26'4188","reported_seq":4208,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:32.332216+0000","last_change":"2024-04-26T23:40:41.681408+0000","last_active":"2024-04-26T23:49:32.332216+0000","last_peered":"2024-04-26T23:49:32.332216+0000","last_clean":"2024-04-26T23:49:32.332216+0000","last_became_active":"2024-04-26T23:40:41.681069+0000","last_became_peered":"2024-04-26T23:40:41.681069+0000","last_unstale":"2024-04-26T23:49:32.332216+0000","last_undegraded":"2024-04-26T23:49:32.332216+0000","last_fullsized":"2024-04-26T23:49:32.332216+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":4188,"log_dups_size":0,"ondisk_log_size":4188,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:10:30.972726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":63216,"num_write_kb":796499,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"26'4864","reported_seq":4892,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.993843+0000","last_change":"2024-04-26T23:40:32.596306+0000","last_active":"2024-04-26T23:49:42.993843+0000","last_peered":"2024-04-26T23:49:42.993843+0000","last_clean":"2024-04-26T23:49:42.993843+0000","last_became_active":"2024-04-26T23:40:32.595625+0000","last_became_peered":"2024-04-26T23:40:32.595625+0000","last_unstale":"2024-04-26T23:49:42.993843+0000","last_undegraded":"2024-04-26T23:49:42.993843+0000","last_fullsized":"2024-04-26T23:49:42.993843+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":4864,"log_dups_size":0,"ondisk_log_size":4864,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:10:02.629199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":72976,"num_write_kb":927582,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"26'23","reported_seq":53,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:36.412667+0000","last_change":"2024-04-26T23:40:31.570870+0000","last_active":"2024-04-26T23:49:36.412667+0000","last_peered":"2024-04-26T23:49:36.412667+0000","last_clean":"2024-04-26T23:49:36.412667+0000","last_became_active":"2024-04-26T23:40:31.570592+0000","last_became_peered":"2024-04-26T23:40:31.570592+0000","last_unstale":"2024-04-26T23:49:36.412667+0000","last_undegraded":"2024-04-26T23:49:36.412667+0000","last_fullsized":"2024-04-26T23:49:36.412667+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:43:13.740214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":4104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"26'8","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:30.313360+0000","last_change":"2024-04-26T23:40:40.673142+0000","last_active":"2024-04-26T23:49:30.313360+0000","last_peered":"2024-04-26T23:49:30.313360+0000","last_clean":"2024-04-26T23:49:30.313360+0000","last_became_active":"2024-04-26T23:40:40.672816+0000","last_became_peered":"2024-04-26T23:40:40.672816+0000","last_unstale":"2024-04-26T23:49:30.313360+0000","last_undegraded":"2024-04-26T23:49:30.313360+0000","last_fullsized":"2024-04-26T23:49:30.313360+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:53:12.526011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"26'4528","reported_seq":4548,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:30.271481+0000","last_change":"2024-04-26T23:40:41.678588+0000","last_active":"2024-04-26T23:49:30.271481+0000","last_peered":"2024-04-26T23:49:30.271481+0000","last_clean":"2024-04-26T23:49:30.271481+0000","last_became_active":"2024-04-26T23:40:41.678039+0000","last_became_peered":"2024-04-26T23:40:41.678039+0000","last_unstale":"2024-04-26T23:49:30.271481+0000","last_undegraded":"2024-04-26T23:49:30.271481+0000","last_fullsized":"2024-04-26T23:49:30.271481+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":4528,"log_dups_size":0,"ondisk_log_size":4528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:04:39.652713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":68234,"num_write_kb":870585,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"26'4022","reported_seq":4050,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.887550+0000","last_change":"2024-04-26T23:40:32.593577+0000","last_active":"2024-04-26T23:49:42.887550+0000","last_peered":"2024-04-26T23:49:42.887550+0000","last_clean":"2024-04-26T23:49:42.887550+0000","last_became_active":"2024-04-26T23:40:32.593235+0000","last_became_peered":"2024-04-26T23:40:32.593235+0000","last_unstale":"2024-04-26T23:49:42.887550+0000","last_undegraded":"2024-04-26T23:49:42.887550+0000","last_fullsized":"2024-04-26T23:49:42.887550+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":4022,"log_dups_size":0,"ondisk_log_size":4022,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:01:02.741964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":60538,"num_write_kb":762431,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"26'9","reported_seq":39,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:36.422094+0000","last_change":"2024-04-26T23:40:31.575943+0000","last_active":"2024-04-26T23:49:36.422094+0000","last_peered":"2024-04-26T23:49:36.422094+0000","last_clean":"2024-04-26T23:49:36.422094+0000","last_became_active":"2024-04-26T23:40:31.575632+0000","last_became_peered":"2024-04-26T23:40:31.575632+0000","last_unstale":"2024-04-26T23:49:36.422094+0000","last_undegraded":"2024-04-26T23:49:36.422094+0000","last_fullsized":"2024-04-26T23:49:36.422094+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:11:08.189634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"26'7","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:30.331487+0000","last_change":"2024-04-26T23:40:40.676297+0000","last_active":"2024-04-26T23:49:30.331487+0000","last_peered":"2024-04-26T23:49:30.331487+0000","last_clean":"2024-04-26T23:49:30.331487+0000","last_became_active":"2024-04-26T23:40:40.675888+0000","last_became_peered":"2024-04-26T23:40:40.675888+0000","last_unstale":"2024-04-26T23:49:30.331487+0000","last_undegraded":"2024-04-26T23:49:30.331487+0000","last_fullsized":"2024-04-26T23:49:30.331487+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:04:38.647258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.17","version":"26'3925","reported_seq":3944,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:32.356196+0000","last_change":"2024-04-26T23:40:41.688506+0000","last_active":"2024-04-26T23:49:32.356196+0000","last_peered":"2024-04-26T23:49:32.356196+0000","last_clean":"2024-04-26T23:49:32.356196+0000","last_became_active":"2024-04-26T23:40:41.688224+0000","last_became_peered":"2024-04-26T23:40:41.688224+0000","last_unstale":"2024-04-26T23:49:32.356196+0000","last_undegraded":"2024-04-26T23:49:32.356196+0000","last_fullsized":"2024-04-26T23:49:32.356196+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":3925,"log_dups_size":0,"ondisk_log_size":3925,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:05:34.008024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":58974,"num_write_kb":744310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"26'3924","reported_seq":3951,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.884380+0000","last_change":"2024-04-26T23:40:32.593528+0000","last_active":"2024-04-26T23:49:42.884380+0000","last_peered":"2024-04-26T23:49:42.884380+0000","last_clean":"2024-04-26T23:49:42.884380+0000","last_became_active":"2024-04-26T23:40:32.593220+0000","last_became_peered":"2024-04-26T23:40:32.593220+0000","last_unstale":"2024-04-26T23:49:42.884380+0000","last_undegraded":"2024-04-26T23:49:42.884380+0000","last_fullsized":"2024-04-26T23:49:42.884380+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":3924,"log_dups_size":0,"ondisk_log_size":3924,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:04:30.553552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":58510,"num_write_kb":806052,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"26'50","reported_seq":80,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:40.460675+0000","last_change":"2024-04-26T23:40:31.572685+0000","last_active":"2024-04-26T23:49:40.460675+0000","last_peered":"2024-04-26T23:49:40.460675+0000","last_clean":"2024-04-26T23:49:40.460675+0000","last_became_active":"2024-04-26T23:40:31.572169+0000","last_became_peered":"2024-04-26T23:40:31.572169+0000","last_unstale":"2024-04-26T23:49:40.460675+0000","last_undegraded":"2024-04-26T23:49:40.460675+0000","last_fullsized":"2024-04-26T23:49:40.460675+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:15:30.884135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":8207,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"26'31","reported_seq":52,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:30.331813+0000","last_change":"2024-04-26T23:40:40.672160+0000","last_active":"2024-04-26T23:49:30.331813+0000","last_peered":"2024-04-26T23:49:30.331813+0000","last_clean":"2024-04-26T23:49:30.331813+0000","last_became_active":"2024-04-26T23:40:40.671875+0000","last_became_peered":"2024-04-26T23:40:40.671875+0000","last_unstale":"2024-04-26T23:49:30.331813+0000","last_undegraded":"2024-04-26T23:49:30.331813+0000","last_fullsized":"2024-04-26T23:49:30.331813+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:35:16.288571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":4110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"26'4508","reported_seq":4527,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:30.329720+0000","last_change":"2024-04-26T23:40:41.688445+0000","last_active":"2024-04-26T23:49:30.329720+0000","last_peered":"2024-04-26T23:49:30.329720+0000","last_clean":"2024-04-26T23:49:30.329720+0000","last_became_active":"2024-04-26T23:40:41.688053+0000","last_became_peered":"2024-04-26T23:40:41.688053+0000","last_unstale":"2024-04-26T23:49:30.329720+0000","last_undegraded":"2024-04-26T23:49:30.329720+0000","last_fullsized":"2024-04-26T23:49:30.329720+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":4508,"log_dups_size":0,"ondisk_log_size":4508,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:08:35.027584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":67755,"num_write_kb":851157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"26'4530","reported_seq":4558,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.907543+0000","last_change":"2024-04-26T23:40:32.586832+0000","last_active":"2024-04-26T23:49:42.907543+0000","last_peered":"2024-04-26T23:49:42.907543+0000","last_clean":"2024-04-26T23:49:42.907543+0000","last_became_active":"2024-04-26T23:40:32.585809+0000","last_became_peered":"2024-04-26T23:40:32.585809+0000","last_unstale":"2024-04-26T23:49:42.907543+0000","last_undegraded":"2024-04-26T23:49:42.907543+0000","last_fullsized":"2024-04-26T23:49:42.907543+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":4530,"log_dups_size":0,"ondisk_log_size":4530,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:51:30.677247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":67909,"num_write_kb":843744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"26'6","reported_seq":35,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:36.408234+0000","last_change":"2024-04-26T23:40:31.569512+0000","last_active":"2024-04-26T23:49:36.408234+0000","last_peered":"2024-04-26T23:49:36.408234+0000","last_clean":"2024-04-26T23:49:36.408234+0000","last_became_active":"2024-04-26T23:40:31.568598+0000","last_became_peered":"2024-04-26T23:40:31.568598+0000","last_unstale":"2024-04-26T23:49:36.408234+0000","last_undegraded":"2024-04-26T23:49:36.408234+0000","last_fullsized":"2024-04-26T23:49:36.408234+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:48:32.015654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"26'2","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:48:00.796748+0000","last_change":"2024-04-26T23:40:40.673986+0000","last_active":"2024-04-26T23:48:00.796748+0000","last_peered":"2024-04-26T23:48:00.796748+0000","last_clean":"2024-04-26T23:48:00.796748+0000","last_became_active":"2024-04-26T23:40:40.673704+0000","last_became_peered":"2024-04-26T23:40:40.673704+0000","last_unstale":"2024-04-26T23:48:00.796748+0000","last_undegraded":"2024-04-26T23:48:00.796748+0000","last_fullsized":"2024-04-26T23:48:00.796748+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:37:24.000775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"26'4209","reported_seq":4228,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:30.142174+0000","last_change":"2024-04-26T23:40:41.691441+0000","last_active":"2024-04-26T23:49:30.142174+0000","last_peered":"2024-04-26T23:49:30.142174+0000","last_clean":"2024-04-26T23:49:30.142174+0000","last_became_active":"2024-04-26T23:40:41.691160+0000","last_became_peered":"2024-04-26T23:40:41.691160+0000","last_unstale":"2024-04-26T23:49:30.142174+0000","last_undegraded":"2024-04-26T23:49:30.142174+0000","last_fullsized":"2024-04-26T23:49:30.142174+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":4209,"log_dups_size":0,"ondisk_log_size":4209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:41:52.386084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":63478,"num_write_kb":811778,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"26'4684","reported_seq":4711,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.927995+0000","last_change":"2024-04-26T23:40:32.595377+0000","last_active":"2024-04-26T23:49:42.927995+0000","last_peered":"2024-04-26T23:49:42.927995+0000","last_clean":"2024-04-26T23:49:42.927995+0000","last_became_active":"2024-04-26T23:40:32.595032+0000","last_became_peered":"2024-04-26T23:40:32.595032+0000","last_unstale":"2024-04-26T23:49:42.927995+0000","last_undegraded":"2024-04-26T23:49:42.927995+0000","last_fullsized":"2024-04-26T23:49:42.927995+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":4684,"log_dups_size":0,"ondisk_log_size":4684,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:44:42.494850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":70001,"num_write_kb":901416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"26'5","reported_seq":34,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:36.432793+0000","last_change":"2024-04-26T23:40:31.575493+0000","last_active":"2024-04-26T23:49:36.432793+0000","last_peered":"2024-04-26T23:49:36.432793+0000","last_clean":"2024-04-26T23:49:36.432793+0000","last_became_active":"2024-04-26T23:40:31.575039+0000","last_became_peered":"2024-04-26T23:40:31.575039+0000","last_unstale":"2024-04-26T23:49:36.432793+0000","last_undegraded":"2024-04-26T23:49:36.432793+0000","last_fullsized":"2024-04-26T23:49:36.432793+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:43:13.740214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"26'245","reported_seq":266,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:32.329332+0000","last_change":"2024-04-26T23:40:40.676493+0000","last_active":"2024-04-26T23:49:32.329332+0000","last_peered":"2024-04-26T23:49:32.329332+0000","last_clean":"2024-04-26T23:49:32.329332+0000","last_became_active":"2024-04-26T23:40:40.676124+0000","last_became_peered":"2024-04-26T23:40:40.676124+0000","last_unstale":"2024-04-26T23:49:32.329332+0000","last_undegraded":"2024-04-26T23:49:32.329332+0000","last_fullsized":"2024-04-26T23:49:32.329332+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":245,"log_dups_size":0,"ondisk_log_size":245,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:28:33.915485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583584,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":239,"num_write_kb":12458,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"26'6168","reported_seq":6187,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:30.300205+0000","last_change":"2024-04-26T23:40:41.680735+0000","last_active":"2024-04-26T23:49:30.300205+0000","last_peered":"2024-04-26T23:49:30.300205+0000","last_clean":"2024-04-26T23:49:30.300205+0000","last_became_active":"2024-04-26T23:40:41.680485+0000","last_became_peered":"2024-04-26T23:40:41.680485+0000","last_unstale":"2024-04-26T23:49:30.300205+0000","last_undegraded":"2024-04-26T23:49:30.300205+0000","last_fullsized":"2024-04-26T23:49:30.300205+0000","mapping_epoch":22,"log_start":"26'900","ondisk_log_start":"26'900","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":5268,"log_dups_size":0,"ondisk_log_size":5268,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:38:51.195172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":93116,"num_write_kb":1152811,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"26'3934","reported_seq":3961,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.892973+0000","last_change":"2024-04-26T23:40:32.589706+0000","last_active":"2024-04-26T23:49:42.892973+0000","last_peered":"2024-04-26T23:49:42.892973+0000","last_clean":"2024-04-26T23:49:42.892973+0000","last_became_active":"2024-04-26T23:40:32.589452+0000","last_became_peered":"2024-04-26T23:40:32.589452+0000","last_unstale":"2024-04-26T23:49:42.892973+0000","last_undegraded":"2024-04-26T23:49:42.892973+0000","last_fullsized":"2024-04-26T23:49:42.892973+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":3934,"log_dups_size":0,"ondisk_log_size":3934,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:15:01.970308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":58864,"num_write_kb":755351,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"26'27","reported_seq":56,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:36.415333+0000","last_change":"2024-04-26T23:40:31.573941+0000","last_active":"2024-04-26T23:49:36.415333+0000","last_peered":"2024-04-26T23:49:36.415333+0000","last_clean":"2024-04-26T23:49:36.415333+0000","last_became_active":"2024-04-26T23:40:31.573668+0000","last_became_peered":"2024-04-26T23:40:31.573668+0000","last_unstale":"2024-04-26T23:49:36.415333+0000","last_undegraded":"2024-04-26T23:49:36.415333+0000","last_fullsized":"2024-04-26T23:49:36.415333+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:58:06.477730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":8209,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"26'27","reported_seq":48,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:32.365002+0000","last_change":"2024-04-26T23:40:40.676408+0000","last_active":"2024-04-26T23:49:32.365002+0000","last_peered":"2024-04-26T23:49:32.365002+0000","last_clean":"2024-04-26T23:49:32.365002+0000","last_became_active":"2024-04-26T23:40:40.676147+0000","last_became_peered":"2024-04-26T23:40:40.676147+0000","last_unstale":"2024-04-26T23:49:32.365002+0000","last_undegraded":"2024-04-26T23:49:32.365002+0000","last_fullsized":"2024-04-26T23:49:32.365002+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:27:47.818055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194394,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":4110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.13","version":"26'4979","reported_seq":4998,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:32.348016+0000","last_change":"2024-04-26T23:40:41.685829+0000","last_active":"2024-04-26T23:49:32.348016+0000","last_peered":"2024-04-26T23:49:32.348016+0000","last_clean":"2024-04-26T23:49:32.348016+0000","last_became_active":"2024-04-26T23:40:41.685403+0000","last_became_peered":"2024-04-26T23:40:41.685403+0000","last_unstale":"2024-04-26T23:49:32.348016+0000","last_undegraded":"2024-04-26T23:49:32.348016+0000","last_fullsized":"2024-04-26T23:49:32.348016+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":4979,"log_dups_size":0,"ondisk_log_size":4979,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:24:07.784468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":74752,"num_write_kb":961504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"26'3907","reported_seq":3934,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.911201+0000","last_change":"2024-04-26T23:40:32.587513+0000","last_active":"2024-04-26T23:49:42.911201+0000","last_peered":"2024-04-26T23:49:42.911201+0000","last_clean":"2024-04-26T23:49:42.911201+0000","last_became_active":"2024-04-26T23:40:32.587200+0000","last_became_peered":"2024-04-26T23:40:32.587200+0000","last_unstale":"2024-04-26T23:49:42.911201+0000","last_undegraded":"2024-04-26T23:49:42.911201+0000","last_fullsized":"2024-04-26T23:49:42.911201+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":3907,"log_dups_size":0,"ondisk_log_size":3907,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:37:30.361795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":58714,"num_write_kb":750642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"26'240","reported_seq":269,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:36.399847+0000","last_change":"2024-04-26T23:40:31.572331+0000","last_active":"2024-04-26T23:49:36.399847+0000","last_peered":"2024-04-26T23:49:36.399847+0000","last_clean":"2024-04-26T23:49:36.399847+0000","last_became_active":"2024-04-26T23:40:31.572074+0000","last_became_peered":"2024-04-26T23:40:31.572074+0000","last_unstale":"2024-04-26T23:49:36.399847+0000","last_undegraded":"2024-04-26T23:49:36.399847+0000","last_fullsized":"2024-04-26T23:49:36.399847+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:45:49.295198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583584,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":234,"num_write_kb":12453,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"26'5","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:32.351402+0000","last_change":"2024-04-26T23:40:40.677978+0000","last_active":"2024-04-26T23:49:32.351402+0000","last_peered":"2024-04-26T23:49:32.351402+0000","last_clean":"2024-04-26T23:49:32.351402+0000","last_became_active":"2024-04-26T23:40:40.677714+0000","last_became_peered":"2024-04-26T23:40:40.677714+0000","last_unstale":"2024-04-26T23:49:32.351402+0000","last_undegraded":"2024-04-26T23:49:32.351402+0000","last_fullsized":"2024-04-26T23:49:32.351402+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:44:50.588556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"26'4186","reported_seq":4205,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:30.218788+0000","last_change":"2024-04-26T23:40:41.685431+0000","last_active":"2024-04-26T23:49:30.218788+0000","last_peered":"2024-04-26T23:49:30.218788+0000","last_clean":"2024-04-26T23:49:30.218788+0000","last_became_active":"2024-04-26T23:40:41.685147+0000","last_became_peered":"2024-04-26T23:40:41.685147+0000","last_unstale":"2024-04-26T23:49:30.218788+0000","last_undegraded":"2024-04-26T23:49:30.218788+0000","last_fullsized":"2024-04-26T23:49:30.218788+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":4186,"log_dups_size":0,"ondisk_log_size":4186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:33:16.389626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":62805,"num_write_kb":801211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"26'5530","reported_seq":5557,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.978334+0000","last_change":"2024-04-26T23:40:32.593298+0000","last_active":"2024-04-26T23:49:42.978334+0000","last_peered":"2024-04-26T23:49:42.978334+0000","last_clean":"2024-04-26T23:49:42.978334+0000","last_became_active":"2024-04-26T23:40:32.593030+0000","last_became_peered":"2024-04-26T23:40:32.593030+0000","last_unstale":"2024-04-26T23:49:42.978334+0000","last_undegraded":"2024-04-26T23:49:42.978334+0000","last_fullsized":"2024-04-26T23:49:42.978334+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":5530,"log_dups_size":0,"ondisk_log_size":5530,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:20:29.107798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":83076,"num_write_kb":1053123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"26'25","reported_seq":54,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:36.443568+0000","last_change":"2024-04-26T23:40:31.574234+0000","last_active":"2024-04-26T23:49:36.443568+0000","last_peered":"2024-04-26T23:49:36.443568+0000","last_clean":"2024-04-26T23:49:36.443568+0000","last_became_active":"2024-04-26T23:40:31.572218+0000","last_became_peered":"2024-04-26T23:40:31.572218+0000","last_unstale":"2024-04-26T23:49:36.443568+0000","last_undegraded":"2024-04-26T23:49:36.443568+0000","last_fullsized":"2024-04-26T23:49:36.443568+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:25:01.315397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194394,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":4108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"26'31","reported_seq":52,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:32.332248+0000","last_change":"2024-04-26T23:40:40.674778+0000","last_active":"2024-04-26T23:49:32.332248+0000","last_peered":"2024-04-26T23:49:32.332248+0000","last_clean":"2024-04-26T23:49:32.332248+0000","last_became_active":"2024-04-26T23:40:40.674487+0000","last_became_peered":"2024-04-26T23:40:40.674487+0000","last_unstale":"2024-04-26T23:49:32.332248+0000","last_undegraded":"2024-04-26T23:49:32.332248+0000","last_fullsized":"2024-04-26T23:49:32.332248+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:10:10.722905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":8207,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"26'4271","reported_seq":4290,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:32.333272+0000","last_change":"2024-04-26T23:40:41.686531+0000","last_active":"2024-04-26T23:49:32.333272+0000","last_peered":"2024-04-26T23:49:32.333272+0000","last_clean":"2024-04-26T23:49:32.333272+0000","last_became_active":"2024-04-26T23:40:41.686259+0000","last_became_peered":"2024-04-26T23:40:41.686259+0000","last_unstale":"2024-04-26T23:49:32.333272+0000","last_undegraded":"2024-04-26T23:49:32.333272+0000","last_fullsized":"2024-04-26T23:49:32.333272+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":4271,"log_dups_size":0,"ondisk_log_size":4271,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:45:34.231942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":64273,"num_write_kb":853172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"26'3697","reported_seq":3729,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.884964+0000","last_change":"2024-04-26T23:41:30.513928+0000","last_active":"2024-04-26T23:49:42.884964+0000","last_peered":"2024-04-26T23:49:42.884964+0000","last_clean":"2024-04-26T23:49:42.884964+0000","last_became_active":"2024-04-26T23:41:30.513492+0000","last_became_peered":"2024-04-26T23:41:30.513492+0000","last_unstale":"2024-04-26T23:49:42.884964+0000","last_undegraded":"2024-04-26T23:49:42.884964+0000","last_fullsized":"2024-04-26T23:49:42.884964+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":3697,"log_dups_size":0,"ondisk_log_size":3697,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:41:43.286923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55355,"num_write_kb":693310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"26'22","reported_seq":51,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:36.405506+0000","last_change":"2024-04-26T23:40:31.575616+0000","last_active":"2024-04-26T23:49:36.405506+0000","last_peered":"2024-04-26T23:49:36.405506+0000","last_clean":"2024-04-26T23:49:36.405506+0000","last_became_active":"2024-04-26T23:40:31.575211+0000","last_became_peered":"2024-04-26T23:40:31.575211+0000","last_unstale":"2024-04-26T23:49:36.405506+0000","last_undegraded":"2024-04-26T23:49:36.405506+0000","last_fullsized":"2024-04-26T23:49:36.405506+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:48:32.015654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":4104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"26'38","reported_seq":59,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:30.334226+0000","last_change":"2024-04-26T23:40:40.675694+0000","last_active":"2024-04-26T23:49:30.334226+0000","last_peered":"2024-04-26T23:49:30.334226+0000","last_clean":"2024-04-26T23:49:30.334226+0000","last_became_active":"2024-04-26T23:40:40.675459+0000","last_became_peered":"2024-04-26T23:40:40.675459+0000","last_unstale":"2024-04-26T23:49:30.334226+0000","last_undegraded":"2024-04-26T23:49:30.334226+0000","last_fullsized":"2024-04-26T23:49:30.334226+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:30:03.993564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36,"num_write_kb":8203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"26'4893","reported_seq":4912,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:32.330028+0000","last_change":"2024-04-26T23:40:41.687488+0000","last_active":"2024-04-26T23:49:32.330028+0000","last_peered":"2024-04-26T23:49:32.330028+0000","last_clean":"2024-04-26T23:49:32.330028+0000","last_became_active":"2024-04-26T23:40:41.687210+0000","last_became_peered":"2024-04-26T23:40:41.687210+0000","last_unstale":"2024-04-26T23:49:32.330028+0000","last_undegraded":"2024-04-26T23:49:32.330028+0000","last_fullsized":"2024-04-26T23:49:32.330028+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":4893,"log_dups_size":0,"ondisk_log_size":4893,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:36:21.487122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":73846,"num_write_kb":901080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"26'4194","reported_seq":4207,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.872278+0000","last_change":"2024-04-26T23:41:30.751583+0000","last_active":"2024-04-26T23:49:42.872278+0000","last_peered":"2024-04-26T23:49:42.872278+0000","last_clean":"2024-04-26T23:49:42.872278+0000","last_became_active":"2024-04-26T23:41:30.751285+0000","last_became_peered":"2024-04-26T23:41:30.751285+0000","last_unstale":"2024-04-26T23:49:42.872278+0000","last_undegraded":"2024-04-26T23:49:42.872278+0000","last_fullsized":"2024-04-26T23:49:42.872278+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":4194,"log_dups_size":0,"ondisk_log_size":4194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:36:12.387962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":63007,"num_write_kb":791881,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"26'2","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:47:52.159460+0000","last_change":"2024-04-26T23:40:31.573794+0000","last_active":"2024-04-26T23:47:52.159460+0000","last_peered":"2024-04-26T23:47:52.159460+0000","last_clean":"2024-04-26T23:47:52.159460+0000","last_became_active":"2024-04-26T23:40:31.573164+0000","last_became_peered":"2024-04-26T23:40:31.573164+0000","last_unstale":"2024-04-26T23:47:52.159460+0000","last_undegraded":"2024-04-26T23:47:52.159460+0000","last_fullsized":"2024-04-26T23:47:52.159460+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:15:30.884135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"26'6","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:30.333939+0000","last_change":"2024-04-26T23:40:40.674127+0000","last_active":"2024-04-26T23:49:30.333939+0000","last_peered":"2024-04-26T23:49:30.333939+0000","last_clean":"2024-04-26T23:49:30.333939+0000","last_became_active":"2024-04-26T23:40:40.673793+0000","last_became_peered":"2024-04-26T23:40:40.673793+0000","last_unstale":"2024-04-26T23:49:30.333939+0000","last_undegraded":"2024-04-26T23:49:30.333939+0000","last_fullsized":"2024-04-26T23:49:30.333939+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:53:12.526011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"26'5246","reported_seq":5266,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:32.332088+0000","last_change":"2024-04-26T23:40:41.686867+0000","last_active":"2024-04-26T23:49:32.332088+0000","last_peered":"2024-04-26T23:49:32.332088+0000","last_clean":"2024-04-26T23:49:32.332088+0000","last_became_active":"2024-04-26T23:40:41.686536+0000","last_became_peered":"2024-04-26T23:40:41.686536+0000","last_unstale":"2024-04-26T23:49:32.332088+0000","last_undegraded":"2024-04-26T23:49:32.332088+0000","last_fullsized":"2024-04-26T23:49:32.332088+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":5246,"log_dups_size":0,"ondisk_log_size":5246,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:28:34.920939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":78945,"num_write_kb":1046825,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"26'13","reported_seq":35,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:30.333687+0000","last_change":"2024-04-26T23:40:40.674915+0000","last_active":"2024-04-26T23:49:30.333687+0000","last_peered":"2024-04-26T23:49:30.333687+0000","last_clean":"2024-04-26T23:49:30.333687+0000","last_became_active":"2024-04-26T23:40:40.674639+0000","last_became_peered":"2024-04-26T23:40:40.674639+0000","last_unstale":"2024-04-26T23:49:30.333687+0000","last_undegraded":"2024-04-26T23:49:30.333687+0000","last_fullsized":"2024-04-26T23:49:30.333687+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:52:34.793496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":4106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"26'4888","reported_seq":4915,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.913026+0000","last_change":"2024-04-26T23:40:32.583014+0000","last_active":"2024-04-26T23:49:42.913026+0000","last_peered":"2024-04-26T23:49:42.913026+0000","last_clean":"2024-04-26T23:49:42.913026+0000","last_became_active":"2024-04-26T23:40:32.582751+0000","last_became_peered":"2024-04-26T23:40:32.582751+0000","last_unstale":"2024-04-26T23:49:42.913026+0000","last_undegraded":"2024-04-26T23:49:42.913026+0000","last_fullsized":"2024-04-26T23:49:42.913026+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":4888,"log_dups_size":0,"ondisk_log_size":4888,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:38:10.884592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":73256,"num_write_kb":928290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"26'27","reported_seq":56,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:36.360432+0000","last_change":"2024-04-26T23:40:31.572402+0000","last_active":"2024-04-26T23:49:36.360432+0000","last_peered":"2024-04-26T23:49:36.360432+0000","last_clean":"2024-04-26T23:49:36.360432+0000","last_became_active":"2024-04-26T23:40:31.572111+0000","last_became_peered":"2024-04-26T23:40:31.572111+0000","last_unstale":"2024-04-26T23:49:36.360432+0000","last_undegraded":"2024-04-26T23:49:36.360432+0000","last_fullsized":"2024-04-26T23:49:36.360432+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:20:28.103413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":8213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"26'4749","reported_seq":4769,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:30.243878+0000","last_change":"2024-04-26T23:40:41.684524+0000","last_active":"2024-04-26T23:49:30.243878+0000","last_peered":"2024-04-26T23:49:30.243878+0000","last_clean":"2024-04-26T23:49:30.243878+0000","last_became_active":"2024-04-26T23:40:41.684207+0000","last_became_peered":"2024-04-26T23:40:41.684207+0000","last_unstale":"2024-04-26T23:49:30.243878+0000","last_undegraded":"2024-04-26T23:49:30.243878+0000","last_fullsized":"2024-04-26T23:49:30.243878+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":4749,"log_dups_size":0,"ondisk_log_size":4749,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:30:04.999018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":71582,"num_write_kb":928660,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"26'143","reported_seq":165,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:35.863318+0000","last_change":"2024-04-26T23:40:40.674934+0000","last_active":"2024-04-26T23:49:35.863318+0000","last_peered":"2024-04-26T23:49:35.863318+0000","last_clean":"2024-04-26T23:49:35.863318+0000","last_became_active":"2024-04-26T23:40:40.674628+0000","last_became_peered":"2024-04-26T23:40:40.674628+0000","last_unstale":"2024-04-26T23:49:35.863318+0000","last_undegraded":"2024-04-26T23:49:35.863318+0000","last_fullsized":"2024-04-26T23:49:35.863318+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":143,"log_dups_size":0,"ondisk_log_size":143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:44:50.588556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7745102,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":140,"num_write_kb":7620,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"26'4156","reported_seq":4183,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.919386+0000","last_change":"2024-04-26T23:40:32.586204+0000","last_active":"2024-04-26T23:49:42.919386+0000","last_peered":"2024-04-26T23:49:42.919386+0000","last_clean":"2024-04-26T23:49:42.919386+0000","last_became_active":"2024-04-26T23:40:32.585725+0000","last_became_peered":"2024-04-26T23:40:32.585725+0000","last_unstale":"2024-04-26T23:49:42.919386+0000","last_undegraded":"2024-04-26T23:49:42.919386+0000","last_fullsized":"2024-04-26T23:49:42.919386+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":4156,"log_dups_size":0,"ondisk_log_size":4156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:51:30.677247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":62294,"num_write_kb":802311,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"26'20","reported_seq":49,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:47:55.248638+0000","last_change":"2024-04-26T23:40:31.578929+0000","last_active":"2024-04-26T23:47:55.248638+0000","last_peered":"2024-04-26T23:47:55.248638+0000","last_clean":"2024-04-26T23:47:55.248638+0000","last_became_active":"2024-04-26T23:40:31.578623+0000","last_became_peered":"2024-04-26T23:40:31.578623+0000","last_unstale":"2024-04-26T23:47:55.248638+0000","last_undegraded":"2024-04-26T23:47:55.248638+0000","last_fullsized":"2024-04-26T23:47:55.248638+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:50:21.330821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":4105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"26'5403","reported_seq":5422,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:30.316265+0000","last_change":"2024-04-26T23:40:41.689697+0000","last_active":"2024-04-26T23:49:30.316265+0000","last_peered":"2024-04-26T23:49:30.316265+0000","last_clean":"2024-04-26T23:49:30.316265+0000","last_became_active":"2024-04-26T23:40:41.688428+0000","last_became_peered":"2024-04-26T23:40:41.688428+0000","last_unstale":"2024-04-26T23:49:30.316265+0000","last_undegraded":"2024-04-26T23:49:30.316265+0000","last_fullsized":"2024-04-26T23:49:30.316265+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":5403,"log_dups_size":0,"ondisk_log_size":5403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:36:21.487122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":81566,"num_write_kb":1040251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1a","version":"26'33","reported_seq":62,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:36.399499+0000","last_change":"2024-04-26T23:40:31.567755+0000","last_active":"2024-04-26T23:49:36.399499+0000","last_peered":"2024-04-26T23:49:36.399499+0000","last_clean":"2024-04-26T23:49:36.399499+0000","last_became_active":"2024-04-26T23:40:31.567484+0000","last_became_peered":"2024-04-26T23:40:31.567484+0000","last_unstale":"2024-04-26T23:49:36.399499+0000","last_undegraded":"2024-04-26T23:49:36.399499+0000","last_fullsized":"2024-04-26T23:49:36.399499+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:43:13.740214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":12305,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"26'3282","reported_seq":3309,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.939435+0000","last_change":"2024-04-26T23:40:32.594689+0000","last_active":"2024-04-26T23:49:42.939435+0000","last_peered":"2024-04-26T23:49:42.939435+0000","last_clean":"2024-04-26T23:49:42.939435+0000","last_became_active":"2024-04-26T23:40:32.592365+0000","last_became_peered":"2024-04-26T23:40:32.592365+0000","last_unstale":"2024-04-26T23:49:42.939435+0000","last_undegraded":"2024-04-26T23:49:42.939435+0000","last_fullsized":"2024-04-26T23:49:42.939435+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":3282,"log_dups_size":0,"ondisk_log_size":3282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:17:46.135806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49199,"num_write_kb":619171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"26'14","reported_seq":35,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:48:17.852707+0000","last_change":"2024-04-26T23:40:40.676028+0000","last_active":"2024-04-26T23:48:17.852707+0000","last_peered":"2024-04-26T23:48:17.852707+0000","last_clean":"2024-04-26T23:48:17.852707+0000","last_became_active":"2024-04-26T23:40:40.675736+0000","last_became_peered":"2024-04-26T23:40:40.675736+0000","last_unstale":"2024-04-26T23:48:17.852707+0000","last_undegraded":"2024-04-26T23:48:17.852707+0000","last_fullsized":"2024-04-26T23:48:17.852707+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:51:38.770953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":4102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"26'3294","reported_seq":3313,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:30.269215+0000","last_change":"2024-04-26T23:40:41.690148+0000","last_active":"2024-04-26T23:49:30.269215+0000","last_peered":"2024-04-26T23:49:30.269215+0000","last_clean":"2024-04-26T23:49:30.269215+0000","last_became_active":"2024-04-26T23:40:41.689765+0000","last_became_peered":"2024-04-26T23:40:41.689765+0000","last_unstale":"2024-04-26T23:49:30.269215+0000","last_undegraded":"2024-04-26T23:49:30.269215+0000","last_fullsized":"2024-04-26T23:49:30.269215+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":3294,"log_dups_size":0,"ondisk_log_size":3294,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:33:16.389626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49600,"num_write_kb":609763,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"26'1221","reported_seq":1250,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:48:05.908044+0000","last_change":"2024-04-26T23:40:31.576749+0000","last_active":"2024-04-26T23:48:05.908044+0000","last_peered":"2024-04-26T23:48:05.908044+0000","last_clean":"2024-04-26T23:48:05.908044+0000","last_became_active":"2024-04-26T23:40:31.576178+0000","last_became_peered":"2024-04-26T23:40:31.576178+0000","last_unstale":"2024-04-26T23:48:05.908044+0000","last_undegraded":"2024-04-26T23:48:05.908044+0000","last_fullsized":"2024-04-26T23:48:05.908044+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":1221,"log_dups_size":0,"ondisk_log_size":1221,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:15:30.884135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1219,"num_write_kb":5208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"26'3626","reported_seq":3653,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.865111+0000","last_change":"2024-04-26T23:40:32.589208+0000","last_active":"2024-04-26T23:49:42.865111+0000","last_peered":"2024-04-26T23:49:42.865111+0000","last_clean":"2024-04-26T23:49:42.865111+0000","last_became_active":"2024-04-26T23:40:32.588927+0000","last_became_peered":"2024-04-26T23:40:32.588927+0000","last_unstale":"2024-04-26T23:49:42.865111+0000","last_undegraded":"2024-04-26T23:49:42.865111+0000","last_fullsized":"2024-04-26T23:49:42.865111+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":3626,"log_dups_size":0,"ondisk_log_size":3626,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:45:50.299583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":54465,"num_write_kb":670678,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"26'32","reported_seq":53,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:30.332987+0000","last_change":"2024-04-26T23:40:40.676809+0000","last_active":"2024-04-26T23:49:30.332987+0000","last_peered":"2024-04-26T23:49:30.332987+0000","last_clean":"2024-04-26T23:49:30.332987+0000","last_became_active":"2024-04-26T23:40:40.676070+0000","last_became_peered":"2024-04-26T23:40:40.676070+0000","last_unstale":"2024-04-26T23:49:30.332987+0000","last_undegraded":"2024-04-26T23:49:30.332987+0000","last_fullsized":"2024-04-26T23:49:30.332987+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:17:27.667323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":12296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.26","version":"26'3995","reported_seq":4015,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:30.333672+0000","last_change":"2024-04-26T23:40:41.679796+0000","last_active":"2024-04-26T23:49:30.333672+0000","last_peered":"2024-04-26T23:49:30.333672+0000","last_clean":"2024-04-26T23:49:30.333672+0000","last_became_active":"2024-04-26T23:40:41.679523+0000","last_became_peered":"2024-04-26T23:40:41.679523+0000","last_unstale":"2024-04-26T23:49:30.333672+0000","last_undegraded":"2024-04-26T23:49:30.333672+0000","last_fullsized":"2024-04-26T23:49:30.333672+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":3995,"log_dups_size":0,"ondisk_log_size":3995,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:43:02.137315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":60148,"num_write_kb":773318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"26'5261","reported_seq":5289,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.924918+0000","last_change":"2024-04-26T23:40:32.586672+0000","last_active":"2024-04-26T23:49:42.924918+0000","last_peered":"2024-04-26T23:49:42.924918+0000","last_clean":"2024-04-26T23:49:42.924918+0000","last_became_active":"2024-04-26T23:40:32.586399+0000","last_became_peered":"2024-04-26T23:40:32.586399+0000","last_unstale":"2024-04-26T23:49:42.924918+0000","last_undegraded":"2024-04-26T23:49:42.924918+0000","last_fullsized":"2024-04-26T23:49:42.924918+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":5261,"log_dups_size":0,"ondisk_log_size":5261,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:15:01.970308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":78910,"num_write_kb":993537,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.27","version":"26'5342","reported_seq":5362,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:32.336840+0000","last_change":"2024-04-26T23:40:41.687529+0000","last_active":"2024-04-26T23:49:32.336840+0000","last_peered":"2024-04-26T23:49:32.336840+0000","last_clean":"2024-04-26T23:49:32.336840+0000","last_became_active":"2024-04-26T23:40:41.686974+0000","last_became_peered":"2024-04-26T23:40:41.686974+0000","last_unstale":"2024-04-26T23:49:32.336840+0000","last_undegraded":"2024-04-26T23:49:32.336840+0000","last_fullsized":"2024-04-26T23:49:32.336840+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":5342,"log_dups_size":0,"ondisk_log_size":5342,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:21:56.950703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":80446,"num_write_kb":1002267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"26'4431","reported_seq":4459,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.901911+0000","last_change":"2024-04-26T23:40:32.584590+0000","last_active":"2024-04-26T23:49:42.901911+0000","last_peered":"2024-04-26T23:49:42.901911+0000","last_clean":"2024-04-26T23:49:42.901911+0000","last_became_active":"2024-04-26T23:40:32.584234+0000","last_became_peered":"2024-04-26T23:40:32.584234+0000","last_unstale":"2024-04-26T23:49:42.901911+0000","last_undegraded":"2024-04-26T23:49:42.901911+0000","last_fullsized":"2024-04-26T23:49:42.901911+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":4431,"log_dups_size":0,"ondisk_log_size":4431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:15:52.942160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":66416,"num_write_kb":857324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.24","version":"26'4128","reported_seq":4148,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:30.314565+0000","last_change":"2024-04-26T23:40:41.679549+0000","last_active":"2024-04-26T23:49:30.314565+0000","last_peered":"2024-04-26T23:49:30.314565+0000","last_clean":"2024-04-26T23:49:30.314565+0000","last_became_active":"2024-04-26T23:40:41.679254+0000","last_became_peered":"2024-04-26T23:40:41.679254+0000","last_unstale":"2024-04-26T23:49:30.314565+0000","last_undegraded":"2024-04-26T23:49:30.314565+0000","last_fullsized":"2024-04-26T23:49:30.314565+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":4128,"log_dups_size":0,"ondisk_log_size":4128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:48:09.126894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":62260,"num_write_kb":792966,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"26'5020","reported_seq":5048,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.980032+0000","last_change":"2024-04-26T23:40:32.580453+0000","last_active":"2024-04-26T23:49:42.980032+0000","last_peered":"2024-04-26T23:49:42.980032+0000","last_clean":"2024-04-26T23:49:42.980032+0000","last_became_active":"2024-04-26T23:40:32.580196+0000","last_became_peered":"2024-04-26T23:40:32.580196+0000","last_unstale":"2024-04-26T23:49:42.980032+0000","last_undegraded":"2024-04-26T23:49:42.980032+0000","last_fullsized":"2024-04-26T23:49:42.980032+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":5020,"log_dups_size":0,"ondisk_log_size":5020,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:18:09.706875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":75519,"num_write_kb":963103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.25","version":"26'4758","reported_seq":4778,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:30.266028+0000","last_change":"2024-04-26T23:40:41.690579+0000","last_active":"2024-04-26T23:49:30.266028+0000","last_peered":"2024-04-26T23:49:30.266028+0000","last_clean":"2024-04-26T23:49:30.266028+0000","last_became_active":"2024-04-26T23:40:41.690262+0000","last_became_peered":"2024-04-26T23:40:41.690262+0000","last_unstale":"2024-04-26T23:49:30.266028+0000","last_undegraded":"2024-04-26T23:49:30.266028+0000","last_fullsized":"2024-04-26T23:49:30.266028+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":4758,"log_dups_size":0,"ondisk_log_size":4758,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:10:30.972726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":71706,"num_write_kb":928511,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"26'3562","reported_seq":3595,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.923518+0000","last_change":"2024-04-26T23:41:30.513890+0000","last_active":"2024-04-26T23:49:42.923518+0000","last_peered":"2024-04-26T23:49:42.923518+0000","last_clean":"2024-04-26T23:49:42.923518+0000","last_became_active":"2024-04-26T23:41:30.513571+0000","last_became_peered":"2024-04-26T23:41:30.513571+0000","last_unstale":"2024-04-26T23:49:42.923518+0000","last_undegraded":"2024-04-26T23:49:42.923518+0000","last_fullsized":"2024-04-26T23:49:42.923518+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":3562,"log_dups_size":0,"ondisk_log_size":3562,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:42:04.655425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53479,"num_write_kb":687907,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.22","version":"26'5430","reported_seq":5450,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:30.293286+0000","last_change":"2024-04-26T23:40:41.677679+0000","last_active":"2024-04-26T23:49:30.293286+0000","last_peered":"2024-04-26T23:49:30.293286+0000","last_clean":"2024-04-26T23:49:30.293286+0000","last_became_active":"2024-04-26T23:40:41.677398+0000","last_became_peered":"2024-04-26T23:40:41.677398+0000","last_unstale":"2024-04-26T23:49:30.293286+0000","last_undegraded":"2024-04-26T23:49:30.293286+0000","last_fullsized":"2024-04-26T23:49:30.293286+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":5430,"log_dups_size":0,"ondisk_log_size":5430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:42:13.754586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":81903,"num_write_kb":1031435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.24","version":"26'3690","reported_seq":3718,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.912529+0000","last_change":"2024-04-26T23:40:32.587921+0000","last_active":"2024-04-26T23:49:42.912529+0000","last_peered":"2024-04-26T23:49:42.912529+0000","last_clean":"2024-04-26T23:49:42.912529+0000","last_became_active":"2024-04-26T23:40:32.587630+0000","last_became_peered":"2024-04-26T23:40:32.587630+0000","last_unstale":"2024-04-26T23:49:42.912529+0000","last_undegraded":"2024-04-26T23:49:42.912529+0000","last_fullsized":"2024-04-26T23:49:42.912529+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":3690,"log_dups_size":0,"ondisk_log_size":3690,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:01:02.741964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55280,"num_write_kb":715530,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.23","version":"26'3835","reported_seq":3855,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:30.335543+0000","last_change":"2024-04-26T23:40:41.690235+0000","last_active":"2024-04-26T23:49:30.335543+0000","last_peered":"2024-04-26T23:49:30.335543+0000","last_clean":"2024-04-26T23:49:30.335543+0000","last_became_active":"2024-04-26T23:40:41.689911+0000","last_became_peered":"2024-04-26T23:40:41.689911+0000","last_unstale":"2024-04-26T23:49:30.335543+0000","last_undegraded":"2024-04-26T23:49:30.335543+0000","last_fullsized":"2024-04-26T23:49:30.335543+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":3835,"log_dups_size":0,"ondisk_log_size":3835,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:21:56.950703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":57757,"num_write_kb":753623,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"26'4516","reported_seq":4544,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.888176+0000","last_change":"2024-04-26T23:40:32.583376+0000","last_active":"2024-04-26T23:49:42.888176+0000","last_peered":"2024-04-26T23:49:42.888176+0000","last_clean":"2024-04-26T23:49:42.888176+0000","last_became_active":"2024-04-26T23:40:32.583089+0000","last_became_peered":"2024-04-26T23:40:32.583089+0000","last_unstale":"2024-04-26T23:49:42.888176+0000","last_undegraded":"2024-04-26T23:49:42.888176+0000","last_fullsized":"2024-04-26T23:49:42.888176+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":4516,"log_dups_size":0,"ondisk_log_size":4516,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:17:46.135806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":67860,"num_write_kb":874899,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.20","version":"26'5603","reported_seq":5623,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:30.329561+0000","last_change":"2024-04-26T23:40:41.688464+0000","last_active":"2024-04-26T23:49:30.329561+0000","last_peered":"2024-04-26T23:49:30.329561+0000","last_clean":"2024-04-26T23:49:30.329561+0000","last_became_active":"2024-04-26T23:40:41.688028+0000","last_became_peered":"2024-04-26T23:40:41.688028+0000","last_unstale":"2024-04-26T23:49:30.329561+0000","last_undegraded":"2024-04-26T23:49:30.329561+0000","last_fullsized":"2024-04-26T23:49:30.329561+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":5603,"log_dups_size":0,"ondisk_log_size":5603,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:21:56.950703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":84399,"num_write_kb":1068733,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.26","version":"26'3757","reported_seq":3785,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.964764+0000","last_change":"2024-04-26T23:40:32.589080+0000","last_active":"2024-04-26T23:49:42.964764+0000","last_peered":"2024-04-26T23:49:42.964764+0000","last_clean":"2024-04-26T23:49:42.964764+0000","last_became_active":"2024-04-26T23:40:32.588793+0000","last_became_peered":"2024-04-26T23:40:32.588793+0000","last_unstale":"2024-04-26T23:49:42.964764+0000","last_undegraded":"2024-04-26T23:49:42.964764+0000","last_fullsized":"2024-04-26T23:49:42.964764+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":3757,"log_dups_size":0,"ondisk_log_size":3757,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:18:09.706875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":56209,"num_write_kb":727106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.21","version":"26'4815","reported_seq":4835,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:30.212082+0000","last_change":"2024-04-26T23:40:41.688445+0000","last_active":"2024-04-26T23:49:30.212082+0000","last_peered":"2024-04-26T23:49:30.212082+0000","last_clean":"2024-04-26T23:49:30.212082+0000","last_became_active":"2024-04-26T23:40:41.688163+0000","last_became_peered":"2024-04-26T23:40:41.688163+0000","last_unstale":"2024-04-26T23:49:30.212082+0000","last_undegraded":"2024-04-26T23:49:30.212082+0000","last_fullsized":"2024-04-26T23:49:30.212082+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":4815,"log_dups_size":0,"ondisk_log_size":4815,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:30:04.999018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":72614,"num_write_kb":926316,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"26'4897","reported_seq":4925,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.894719+0000","last_change":"2024-04-26T23:40:32.588177+0000","last_active":"2024-04-26T23:49:42.894719+0000","last_peered":"2024-04-26T23:49:42.894719+0000","last_clean":"2024-04-26T23:49:42.894719+0000","last_became_active":"2024-04-26T23:40:32.586926+0000","last_became_peered":"2024-04-26T23:40:32.586926+0000","last_unstale":"2024-04-26T23:49:42.894719+0000","last_undegraded":"2024-04-26T23:49:42.894719+0000","last_fullsized":"2024-04-26T23:49:42.894719+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":4897,"log_dups_size":0,"ondisk_log_size":4897,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:34:14.811917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":73419,"num_write_kb":930971,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2e","version":"26'3617","reported_seq":3636,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:32.348057+0000","last_change":"2024-04-26T23:40:41.688396+0000","last_active":"2024-04-26T23:49:32.348057+0000","last_peered":"2024-04-26T23:49:32.348057+0000","last_clean":"2024-04-26T23:49:32.348057+0000","last_became_active":"2024-04-26T23:40:41.688087+0000","last_became_peered":"2024-04-26T23:40:41.688087+0000","last_unstale":"2024-04-26T23:49:32.348057+0000","last_undegraded":"2024-04-26T23:49:32.348057+0000","last_fullsized":"2024-04-26T23:49:32.348057+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":3617,"log_dups_size":0,"ondisk_log_size":3617,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:00:49.397610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":54377,"num_write_kb":682463,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"26'3685","reported_seq":3713,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.949922+0000","last_change":"2024-04-26T23:40:32.582959+0000","last_active":"2024-04-26T23:49:42.949922+0000","last_peered":"2024-04-26T23:49:42.949922+0000","last_clean":"2024-04-26T23:49:42.949922+0000","last_became_active":"2024-04-26T23:40:32.582100+0000","last_became_peered":"2024-04-26T23:40:32.582100+0000","last_unstale":"2024-04-26T23:49:42.949922+0000","last_undegraded":"2024-04-26T23:49:42.949922+0000","last_fullsized":"2024-04-26T23:49:42.949922+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":3685,"log_dups_size":0,"ondisk_log_size":3685,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:37:30.361795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55124,"num_write_kb":707502,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2f","version":"26'5393","reported_seq":5412,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:30.296296+0000","last_change":"2024-04-26T23:40:41.681088+0000","last_active":"2024-04-26T23:49:30.296296+0000","last_peered":"2024-04-26T23:49:30.296296+0000","last_clean":"2024-04-26T23:49:30.296296+0000","last_became_active":"2024-04-26T23:40:41.680581+0000","last_became_peered":"2024-04-26T23:40:41.680581+0000","last_unstale":"2024-04-26T23:49:30.296296+0000","last_undegraded":"2024-04-26T23:49:30.296296+0000","last_fullsized":"2024-04-26T23:49:30.296296+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":5393,"log_dups_size":0,"ondisk_log_size":5393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:41:52.386084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":81323,"num_write_kb":1040915,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.29","version":"26'4135","reported_seq":4163,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.944650+0000","last_change":"2024-04-26T23:40:32.593958+0000","last_active":"2024-04-26T23:49:42.944650+0000","last_peered":"2024-04-26T23:49:42.944650+0000","last_clean":"2024-04-26T23:49:42.944650+0000","last_became_active":"2024-04-26T23:40:32.593639+0000","last_became_peered":"2024-04-26T23:40:32.593639+0000","last_unstale":"2024-04-26T23:49:42.944650+0000","last_undegraded":"2024-04-26T23:49:42.944650+0000","last_fullsized":"2024-04-26T23:49:42.944650+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":4135,"log_dups_size":0,"ondisk_log_size":4135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:17:46.135806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":62129,"num_write_kb":797085,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"26'4458","reported_seq":4477,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:32.334321+0000","last_change":"2024-04-26T23:40:41.674573+0000","last_active":"2024-04-26T23:49:32.334321+0000","last_peered":"2024-04-26T23:49:32.334321+0000","last_clean":"2024-04-26T23:49:32.334321+0000","last_became_active":"2024-04-26T23:40:41.674274+0000","last_became_peered":"2024-04-26T23:40:41.674274+0000","last_unstale":"2024-04-26T23:49:32.334321+0000","last_undegraded":"2024-04-26T23:49:32.334321+0000","last_fullsized":"2024-04-26T23:49:32.334321+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":4458,"log_dups_size":0,"ondisk_log_size":4458,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:37:39.460955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":67376,"num_write_kb":867303,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"26'4512","reported_seq":4540,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.995030+0000","last_change":"2024-04-26T23:40:32.591700+0000","last_active":"2024-04-26T23:49:42.995030+0000","last_peered":"2024-04-26T23:49:42.995030+0000","last_clean":"2024-04-26T23:49:42.995030+0000","last_became_active":"2024-04-26T23:40:32.591366+0000","last_became_peered":"2024-04-26T23:40:32.591366+0000","last_unstale":"2024-04-26T23:49:42.995030+0000","last_undegraded":"2024-04-26T23:49:42.995030+0000","last_fullsized":"2024-04-26T23:49:42.995030+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":4512,"log_dups_size":0,"ondisk_log_size":4512,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:10:02.629199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":67679,"num_write_kb":882467,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2d","version":"26'4489","reported_seq":4508,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:32.352572+0000","last_change":"2024-04-26T23:40:41.692402+0000","last_active":"2024-04-26T23:49:32.352572+0000","last_peered":"2024-04-26T23:49:32.352572+0000","last_clean":"2024-04-26T23:49:32.352572+0000","last_became_active":"2024-04-26T23:40:41.692122+0000","last_became_peered":"2024-04-26T23:40:41.692122+0000","last_unstale":"2024-04-26T23:49:32.352572+0000","last_undegraded":"2024-04-26T23:49:32.352572+0000","last_fullsized":"2024-04-26T23:49:32.352572+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":4489,"log_dups_size":0,"ondisk_log_size":4489,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:06:12.755431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":67600,"num_write_kb":861109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2b","version":"26'4261","reported_seq":4289,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.949551+0000","last_change":"2024-04-26T23:40:32.590443+0000","last_active":"2024-04-26T23:49:42.949551+0000","last_peered":"2024-04-26T23:49:42.949551+0000","last_clean":"2024-04-26T23:49:42.949551+0000","last_became_active":"2024-04-26T23:40:32.590193+0000","last_became_peered":"2024-04-26T23:40:32.590193+0000","last_unstale":"2024-04-26T23:49:42.949551+0000","last_undegraded":"2024-04-26T23:49:42.949551+0000","last_fullsized":"2024-04-26T23:49:42.949551+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":4261,"log_dups_size":0,"ondisk_log_size":4261,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:14:04.372681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":63685,"num_write_kb":822261,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2a","version":"26'4995","reported_seq":5015,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:32.335489+0000","last_change":"2024-04-26T23:40:41.692194+0000","last_active":"2024-04-26T23:49:32.335489+0000","last_peered":"2024-04-26T23:49:32.335489+0000","last_clean":"2024-04-26T23:49:32.335489+0000","last_became_active":"2024-04-26T23:40:41.691837+0000","last_became_peered":"2024-04-26T23:40:41.691837+0000","last_unstale":"2024-04-26T23:49:32.335489+0000","last_undegraded":"2024-04-26T23:49:32.335489+0000","last_fullsized":"2024-04-26T23:49:32.335489+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":4995,"log_dups_size":0,"ondisk_log_size":4995,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:58:45.972045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":75356,"num_write_kb":950203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"26'4090","reported_seq":4118,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.876315+0000","last_change":"2024-04-26T23:40:32.590538+0000","last_active":"2024-04-26T23:49:42.876315+0000","last_peered":"2024-04-26T23:49:42.876315+0000","last_clean":"2024-04-26T23:49:42.876315+0000","last_became_active":"2024-04-26T23:40:32.590241+0000","last_became_peered":"2024-04-26T23:40:32.590241+0000","last_unstale":"2024-04-26T23:49:42.876315+0000","last_undegraded":"2024-04-26T23:49:42.876315+0000","last_fullsized":"2024-04-26T23:49:42.876315+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":4090,"log_dups_size":0,"ondisk_log_size":4090,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:38:10.884592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":61267,"num_write_kb":785631,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"26'4580","reported_seq":4599,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:32.335187+0000","last_change":"2024-04-26T23:40:41.689529+0000","last_active":"2024-04-26T23:49:32.335187+0000","last_peered":"2024-04-26T23:49:32.335187+0000","last_clean":"2024-04-26T23:49:32.335187+0000","last_became_active":"2024-04-26T23:40:41.689215+0000","last_became_peered":"2024-04-26T23:40:41.689215+0000","last_unstale":"2024-04-26T23:49:32.335187+0000","last_undegraded":"2024-04-26T23:49:32.335187+0000","last_fullsized":"2024-04-26T23:49:32.335187+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":4580,"log_dups_size":0,"ondisk_log_size":4580,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:38:42.155257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":68781,"num_write_kb":892789,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2d","version":"26'4171","reported_seq":4199,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.943207+0000","last_change":"2024-04-26T23:40:32.588445+0000","last_active":"2024-04-26T23:49:42.943207+0000","last_peered":"2024-04-26T23:49:42.943207+0000","last_clean":"2024-04-26T23:49:42.943207+0000","last_became_active":"2024-04-26T23:40:32.588063+0000","last_became_peered":"2024-04-26T23:40:32.588063+0000","last_unstale":"2024-04-26T23:49:42.943207+0000","last_undegraded":"2024-04-26T23:49:42.943207+0000","last_fullsized":"2024-04-26T23:49:42.943207+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":4171,"log_dups_size":0,"ondisk_log_size":4171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:44:58.977344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":62428,"num_write_kb":793377,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.28","version":"26'4022","reported_seq":4042,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:32.335817+0000","last_change":"2024-04-26T23:40:41.674893+0000","last_active":"2024-04-26T23:49:32.335817+0000","last_peered":"2024-04-26T23:49:32.335817+0000","last_clean":"2024-04-26T23:49:32.335817+0000","last_became_active":"2024-04-26T23:40:41.674573+0000","last_became_peered":"2024-04-26T23:40:41.674573+0000","last_unstale":"2024-04-26T23:49:32.335817+0000","last_undegraded":"2024-04-26T23:49:32.335817+0000","last_fullsized":"2024-04-26T23:49:32.335817+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":4022,"log_dups_size":0,"ondisk_log_size":4022,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:36:21.487122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":60451,"num_write_kb":760274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"26'3337","reported_seq":3365,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.873346+0000","last_change":"2024-04-26T23:40:32.574795+0000","last_active":"2024-04-26T23:49:42.873346+0000","last_peered":"2024-04-26T23:49:42.873346+0000","last_clean":"2024-04-26T23:49:42.873346+0000","last_became_active":"2024-04-26T23:40:32.574503+0000","last_became_peered":"2024-04-26T23:40:32.574503+0000","last_unstale":"2024-04-26T23:49:42.873346+0000","last_undegraded":"2024-04-26T23:49:42.873346+0000","last_fullsized":"2024-04-26T23:49:42.873346+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":3337,"log_dups_size":0,"ondisk_log_size":3337,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:30:11.401955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49634,"num_write_kb":627043,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.29","version":"26'4402","reported_seq":4422,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:32.356793+0000","last_change":"2024-04-26T23:40:41.680247+0000","last_active":"2024-04-26T23:49:32.356793+0000","last_peered":"2024-04-26T23:49:32.356793+0000","last_clean":"2024-04-26T23:49:32.356793+0000","last_became_active":"2024-04-26T23:40:41.679920+0000","last_became_peered":"2024-04-26T23:40:41.679920+0000","last_unstale":"2024-04-26T23:49:32.356793+0000","last_undegraded":"2024-04-26T23:49:32.356793+0000","last_fullsized":"2024-04-26T23:49:32.356793+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":4402,"log_dups_size":0,"ondisk_log_size":4402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:53:13.531466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":66255,"num_write_kb":845549,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2f","version":"26'5167","reported_seq":5194,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.941421+0000","last_change":"2024-04-26T23:40:32.593432+0000","last_active":"2024-04-26T23:49:42.941421+0000","last_peered":"2024-04-26T23:49:42.941421+0000","last_clean":"2024-04-26T23:49:42.941421+0000","last_became_active":"2024-04-26T23:40:32.593169+0000","last_became_peered":"2024-04-26T23:40:32.593169+0000","last_unstale":"2024-04-26T23:49:42.941421+0000","last_undegraded":"2024-04-26T23:49:42.941421+0000","last_fullsized":"2024-04-26T23:49:42.941421+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":5167,"log_dups_size":0,"ondisk_log_size":5167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:44:42.494850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":77406,"num_write_kb":981579,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.36","version":"26'5039","reported_seq":5058,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:30.332524+0000","last_change":"2024-04-26T23:40:41.694551+0000","last_active":"2024-04-26T23:49:30.332524+0000","last_peered":"2024-04-26T23:49:30.332524+0000","last_clean":"2024-04-26T23:49:30.332524+0000","last_became_active":"2024-04-26T23:40:41.694297+0000","last_became_peered":"2024-04-26T23:40:41.694297+0000","last_unstale":"2024-04-26T23:49:30.332524+0000","last_undegraded":"2024-04-26T23:49:30.332524+0000","last_fullsized":"2024-04-26T23:49:30.332524+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":5039,"log_dups_size":0,"ondisk_log_size":5039,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:02:27.160408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":75865,"num_write_kb":998838,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"26'3722","reported_seq":3749,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.950014+0000","last_change":"2024-04-26T23:40:32.585137+0000","last_active":"2024-04-26T23:49:42.950014+0000","last_peered":"2024-04-26T23:49:42.950014+0000","last_clean":"2024-04-26T23:49:42.950014+0000","last_became_active":"2024-04-26T23:40:32.584678+0000","last_became_peered":"2024-04-26T23:40:32.584678+0000","last_unstale":"2024-04-26T23:49:42.950014+0000","last_undegraded":"2024-04-26T23:49:42.950014+0000","last_fullsized":"2024-04-26T23:49:42.950014+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":3722,"log_dups_size":0,"ondisk_log_size":3722,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:04:30.553552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55693,"num_write_kb":722935,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.37","version":"26'5530","reported_seq":5549,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:30.272220+0000","last_change":"2024-04-26T23:40:41.692433+0000","last_active":"2024-04-26T23:49:30.272220+0000","last_peered":"2024-04-26T23:49:30.272220+0000","last_clean":"2024-04-26T23:49:30.272220+0000","last_became_active":"2024-04-26T23:40:41.692090+0000","last_became_peered":"2024-04-26T23:40:41.692090+0000","last_unstale":"2024-04-26T23:49:30.272220+0000","last_undegraded":"2024-04-26T23:49:30.272220+0000","last_fullsized":"2024-04-26T23:49:30.272220+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":5530,"log_dups_size":0,"ondisk_log_size":5530,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:37:25.006229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":83365,"num_write_kb":1062103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"26'4290","reported_seq":4317,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.900241+0000","last_change":"2024-04-26T23:40:32.590452+0000","last_active":"2024-04-26T23:49:42.900241+0000","last_peered":"2024-04-26T23:49:42.900241+0000","last_clean":"2024-04-26T23:49:42.900241+0000","last_became_active":"2024-04-26T23:40:32.590162+0000","last_became_peered":"2024-04-26T23:40:32.590162+0000","last_unstale":"2024-04-26T23:49:42.900241+0000","last_undegraded":"2024-04-26T23:49:42.900241+0000","last_fullsized":"2024-04-26T23:49:42.900241+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":4290,"log_dups_size":0,"ondisk_log_size":4290,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:51:30.677247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":64302,"num_write_kb":811481,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.34","version":"26'3752","reported_seq":3771,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:30.302344+0000","last_change":"2024-04-26T23:40:41.687270+0000","last_active":"2024-04-26T23:49:30.302344+0000","last_peered":"2024-04-26T23:49:30.302344+0000","last_clean":"2024-04-26T23:49:30.302344+0000","last_became_active":"2024-04-26T23:40:41.686999+0000","last_became_peered":"2024-04-26T23:40:41.686999+0000","last_unstale":"2024-04-26T23:49:30.302344+0000","last_undegraded":"2024-04-26T23:49:30.302344+0000","last_fullsized":"2024-04-26T23:49:30.302344+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":3752,"log_dups_size":0,"ondisk_log_size":3752,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:21:42.565349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":56674,"num_write_kb":713071,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"26'4299","reported_seq":4326,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.893101+0000","last_change":"2024-04-26T23:40:32.586436+0000","last_active":"2024-04-26T23:49:42.893101+0000","last_peered":"2024-04-26T23:49:42.893101+0000","last_clean":"2024-04-26T23:49:42.893101+0000","last_became_active":"2024-04-26T23:40:32.585995+0000","last_became_peered":"2024-04-26T23:40:32.585995+0000","last_unstale":"2024-04-26T23:49:42.893101+0000","last_undegraded":"2024-04-26T23:49:42.893101+0000","last_fullsized":"2024-04-26T23:49:42.893101+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":4299,"log_dups_size":0,"ondisk_log_size":4299,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:10:42.603833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":64455,"num_write_kb":829744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.35","version":"26'4326","reported_seq":4345,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:30.253006+0000","last_change":"2024-04-26T23:40:41.691693+0000","last_active":"2024-04-26T23:49:30.253006+0000","last_peered":"2024-04-26T23:49:30.253006+0000","last_clean":"2024-04-26T23:49:30.253006+0000","last_became_active":"2024-04-26T23:40:41.691437+0000","last_became_peered":"2024-04-26T23:40:41.691437+0000","last_unstale":"2024-04-26T23:49:30.253006+0000","last_undegraded":"2024-04-26T23:49:30.253006+0000","last_fullsized":"2024-04-26T23:49:30.253006+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":4326,"log_dups_size":0,"ondisk_log_size":4326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:06:12.755431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":65307,"num_write_kb":818233,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.33","version":"26'3786","reported_seq":3813,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.909367+0000","last_change":"2024-04-26T23:40:32.592988+0000","last_active":"2024-04-26T23:49:42.909367+0000","last_peered":"2024-04-26T23:49:42.909367+0000","last_clean":"2024-04-26T23:49:42.909367+0000","last_became_active":"2024-04-26T23:40:32.592717+0000","last_became_peered":"2024-04-26T23:40:32.592717+0000","last_unstale":"2024-04-26T23:49:42.909367+0000","last_undegraded":"2024-04-26T23:49:42.909367+0000","last_fullsized":"2024-04-26T23:49:42.909367+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":3786,"log_dups_size":0,"ondisk_log_size":3786,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:18:09.706875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":56607,"num_write_kb":740250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.32","version":"26'4725","reported_seq":4744,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:30.304871+0000","last_change":"2024-04-26T23:40:41.675335+0000","last_active":"2024-04-26T23:49:30.304871+0000","last_peered":"2024-04-26T23:49:30.304871+0000","last_clean":"2024-04-26T23:49:30.304871+0000","last_became_active":"2024-04-26T23:40:41.675042+0000","last_became_peered":"2024-04-26T23:40:41.675042+0000","last_unstale":"2024-04-26T23:49:30.304871+0000","last_undegraded":"2024-04-26T23:49:30.304871+0000","last_fullsized":"2024-04-26T23:49:30.304871+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":4725,"log_dups_size":0,"ondisk_log_size":4725,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:41:52.386084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":71116,"num_write_kb":894316,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"26'3513","reported_seq":3540,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.972217+0000","last_change":"2024-04-26T23:40:32.595129+0000","last_active":"2024-04-26T23:49:42.972217+0000","last_peered":"2024-04-26T23:49:42.972217+0000","last_clean":"2024-04-26T23:49:42.972217+0000","last_became_active":"2024-04-26T23:40:32.594802+0000","last_became_peered":"2024-04-26T23:40:32.594802+0000","last_unstale":"2024-04-26T23:49:42.972217+0000","last_undegraded":"2024-04-26T23:49:42.972217+0000","last_fullsized":"2024-04-26T23:49:42.972217+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":3513,"log_dups_size":0,"ondisk_log_size":3513,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:48:33.020039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":52734,"num_write_kb":670887,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.33","version":"26'4035","reported_seq":4054,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:32.342105+0000","last_change":"2024-04-26T23:40:41.691159+0000","last_active":"2024-04-26T23:49:32.342105+0000","last_peered":"2024-04-26T23:49:32.342105+0000","last_clean":"2024-04-26T23:49:32.342105+0000","last_became_active":"2024-04-26T23:40:41.690846+0000","last_became_peered":"2024-04-26T23:40:41.690846+0000","last_unstale":"2024-04-26T23:49:32.342105+0000","last_undegraded":"2024-04-26T23:49:32.342105+0000","last_fullsized":"2024-04-26T23:49:32.342105+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":4035,"log_dups_size":0,"ondisk_log_size":4035,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:45:08.076505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":60666,"num_write_kb":797602,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.35","version":"26'4035","reported_seq":4062,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.914117+0000","last_change":"2024-04-26T23:40:32.578819+0000","last_active":"2024-04-26T23:49:42.914117+0000","last_peered":"2024-04-26T23:49:42.914117+0000","last_clean":"2024-04-26T23:49:42.914117+0000","last_became_active":"2024-04-26T23:40:32.578556+0000","last_became_peered":"2024-04-26T23:40:32.578556+0000","last_unstale":"2024-04-26T23:49:42.914117+0000","last_undegraded":"2024-04-26T23:49:42.914117+0000","last_fullsized":"2024-04-26T23:49:42.914117+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":4035,"log_dups_size":0,"ondisk_log_size":4035,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:17:46.135806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":60570,"num_write_kb":769077,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.30","version":"26'3960","reported_seq":3979,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:30.310152+0000","last_change":"2024-04-26T23:40:41.689812+0000","last_active":"2024-04-26T23:49:30.310152+0000","last_peered":"2024-04-26T23:49:30.310152+0000","last_clean":"2024-04-26T23:49:30.310152+0000","last_became_active":"2024-04-26T23:40:41.689267+0000","last_became_peered":"2024-04-26T23:40:41.689267+0000","last_unstale":"2024-04-26T23:49:30.310152+0000","last_undegraded":"2024-04-26T23:49:30.310152+0000","last_fullsized":"2024-04-26T23:49:30.310152+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":3960,"log_dups_size":0,"ondisk_log_size":3960,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:21:42.565349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":59630,"num_write_kb":775739,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"26'4731","reported_seq":4758,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.972370+0000","last_change":"2024-04-26T23:40:32.578155+0000","last_active":"2024-04-26T23:49:42.972370+0000","last_peered":"2024-04-26T23:49:42.972370+0000","last_clean":"2024-04-26T23:49:42.972370+0000","last_became_active":"2024-04-26T23:40:32.577865+0000","last_became_peered":"2024-04-26T23:40:32.577865+0000","last_unstale":"2024-04-26T23:49:42.972370+0000","last_undegraded":"2024-04-26T23:49:42.972370+0000","last_fullsized":"2024-04-26T23:49:42.972370+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":4731,"log_dups_size":0,"ondisk_log_size":4731,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:40:17.167353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":70795,"num_write_kb":915734,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.31","version":"26'4435","reported_seq":4454,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:30.334396+0000","last_change":"2024-04-26T23:40:41.680962+0000","last_active":"2024-04-26T23:49:30.334396+0000","last_peered":"2024-04-26T23:49:30.334396+0000","last_clean":"2024-04-26T23:49:30.334396+0000","last_became_active":"2024-04-26T23:40:41.680676+0000","last_became_peered":"2024-04-26T23:40:41.680676+0000","last_unstale":"2024-04-26T23:49:30.334396+0000","last_undegraded":"2024-04-26T23:49:30.334396+0000","last_fullsized":"2024-04-26T23:49:30.334396+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":4435,"log_dups_size":0,"ondisk_log_size":4435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:42:13.754586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":66738,"num_write_kb":853261,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"26'4979","reported_seq":5006,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.990989+0000","last_change":"2024-04-26T23:40:32.591487+0000","last_active":"2024-04-26T23:49:42.990989+0000","last_peered":"2024-04-26T23:49:42.990989+0000","last_clean":"2024-04-26T23:49:42.990989+0000","last_became_active":"2024-04-26T23:40:32.591209+0000","last_became_peered":"2024-04-26T23:40:32.591209+0000","last_unstale":"2024-04-26T23:49:42.990989+0000","last_undegraded":"2024-04-26T23:49:42.990989+0000","last_fullsized":"2024-04-26T23:49:42.990989+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":4979,"log_dups_size":0,"ondisk_log_size":4979,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:52:26.699790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":74710,"num_write_kb":992211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3e","version":"26'5666","reported_seq":5686,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:32.348852+0000","last_change":"2024-04-26T23:40:41.686089+0000","last_active":"2024-04-26T23:49:32.348852+0000","last_peered":"2024-04-26T23:49:32.348852+0000","last_clean":"2024-04-26T23:49:32.348852+0000","last_became_active":"2024-04-26T23:40:41.685786+0000","last_became_peered":"2024-04-26T23:40:41.685786+0000","last_unstale":"2024-04-26T23:49:32.348852+0000","last_undegraded":"2024-04-26T23:49:32.348852+0000","last_fullsized":"2024-04-26T23:49:32.348852+0000","mapping_epoch":22,"log_start":"26'400","ondisk_log_start":"26'400","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":5266,"log_dups_size":0,"ondisk_log_size":5266,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:36:02.931532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":85672,"num_write_kb":1105852,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.38","version":"26'4537","reported_seq":4564,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.908212+0000","last_change":"2024-04-26T23:40:32.592543+0000","last_active":"2024-04-26T23:49:42.908212+0000","last_peered":"2024-04-26T23:49:42.908212+0000","last_clean":"2024-04-26T23:49:42.908212+0000","last_became_active":"2024-04-26T23:40:32.592282+0000","last_became_peered":"2024-04-26T23:40:32.592282+0000","last_unstale":"2024-04-26T23:49:42.908212+0000","last_undegraded":"2024-04-26T23:49:42.908212+0000","last_fullsized":"2024-04-26T23:49:42.908212+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":4537,"log_dups_size":0,"ondisk_log_size":4537,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:16:46.547536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":68313,"num_write_kb":849602,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3f","version":"26'3830","reported_seq":3850,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:32.345828+0000","last_change":"2024-04-26T23:40:41.679306+0000","last_active":"2024-04-26T23:49:32.345828+0000","last_peered":"2024-04-26T23:49:32.345828+0000","last_clean":"2024-04-26T23:49:32.345828+0000","last_became_active":"2024-04-26T23:40:41.678926+0000","last_became_peered":"2024-04-26T23:40:41.678926+0000","last_unstale":"2024-04-26T23:49:32.345828+0000","last_undegraded":"2024-04-26T23:49:32.345828+0000","last_fullsized":"2024-04-26T23:49:32.345828+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":3830,"log_dups_size":0,"ondisk_log_size":3830,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:27:48.823509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":57629,"num_write_kb":750507,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.39","version":"26'4047","reported_seq":4060,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.888642+0000","last_change":"2024-04-26T23:41:30.373208+0000","last_active":"2024-04-26T23:49:42.888642+0000","last_peered":"2024-04-26T23:49:42.888642+0000","last_clean":"2024-04-26T23:49:42.888642+0000","last_became_active":"2024-04-26T23:41:30.372928+0000","last_became_peered":"2024-04-26T23:41:30.372928+0000","last_unstale":"2024-04-26T23:49:42.888642+0000","last_undegraded":"2024-04-26T23:49:42.888642+0000","last_fullsized":"2024-04-26T23:49:42.888642+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":4047,"log_dups_size":0,"ondisk_log_size":4047,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:21:47.851542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":60897,"num_write_kb":776135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3c","version":"26'4068","reported_seq":4088,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:29.935386+0000","last_change":"2024-04-26T23:40:41.689567+0000","last_active":"2024-04-26T23:49:29.935386+0000","last_peered":"2024-04-26T23:49:29.935386+0000","last_clean":"2024-04-26T23:49:29.935386+0000","last_became_active":"2024-04-26T23:40:41.688585+0000","last_became_peered":"2024-04-26T23:40:41.688585+0000","last_unstale":"2024-04-26T23:49:29.935386+0000","last_undegraded":"2024-04-26T23:49:29.935386+0000","last_fullsized":"2024-04-26T23:49:29.935386+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":4068,"log_dups_size":0,"ondisk_log_size":4068,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:10:57.826183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":61409,"num_write_kb":797665,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"26'3610","reported_seq":3637,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.991991+0000","last_change":"2024-04-26T23:40:32.584619+0000","last_active":"2024-04-26T23:49:42.991991+0000","last_peered":"2024-04-26T23:49:42.991991+0000","last_clean":"2024-04-26T23:49:42.991991+0000","last_became_active":"2024-04-26T23:40:32.584293+0000","last_became_peered":"2024-04-26T23:40:32.584293+0000","last_unstale":"2024-04-26T23:49:42.991991+0000","last_undegraded":"2024-04-26T23:49:42.991991+0000","last_fullsized":"2024-04-26T23:49:42.991991+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":3610,"log_dups_size":0,"ondisk_log_size":3610,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:40:17.167353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":54297,"num_write_kb":686705,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3d","version":"26'4614","reported_seq":4634,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:30.334531+0000","last_change":"2024-04-26T23:40:41.691614+0000","last_active":"2024-04-26T23:49:30.334531+0000","last_peered":"2024-04-26T23:49:30.334531+0000","last_clean":"2024-04-26T23:49:30.334531+0000","last_became_active":"2024-04-26T23:40:41.691081+0000","last_became_peered":"2024-04-26T23:40:41.691081+0000","last_unstale":"2024-04-26T23:49:30.334531+0000","last_undegraded":"2024-04-26T23:49:30.334531+0000","last_fullsized":"2024-04-26T23:49:30.334531+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":4614,"log_dups_size":0,"ondisk_log_size":4614,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:24:07.784468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69615,"num_write_kb":867426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"26'4911","reported_seq":4938,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.888073+0000","last_change":"2024-04-26T23:40:32.588894+0000","last_active":"2024-04-26T23:49:42.888073+0000","last_peered":"2024-04-26T23:49:42.888073+0000","last_clean":"2024-04-26T23:49:42.888073+0000","last_became_active":"2024-04-26T23:40:32.588409+0000","last_became_peered":"2024-04-26T23:40:32.588409+0000","last_unstale":"2024-04-26T23:49:42.888073+0000","last_undegraded":"2024-04-26T23:49:42.888073+0000","last_fullsized":"2024-04-26T23:49:42.888073+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":4911,"log_dups_size":0,"ondisk_log_size":4911,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:35:08.194865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":73569,"num_write_kb":917520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3a","version":"26'3809","reported_seq":3828,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:30.230648+0000","last_change":"2024-04-26T23:40:41.678639+0000","last_active":"2024-04-26T23:49:30.230648+0000","last_peered":"2024-04-26T23:49:30.230648+0000","last_clean":"2024-04-26T23:49:30.230648+0000","last_became_active":"2024-04-26T23:40:41.678333+0000","last_became_peered":"2024-04-26T23:40:41.678333+0000","last_unstale":"2024-04-26T23:49:30.230648+0000","last_undegraded":"2024-04-26T23:49:30.230648+0000","last_fullsized":"2024-04-26T23:49:30.230648+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":3809,"log_dups_size":0,"ondisk_log_size":3809,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:42:13.754586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":57471,"num_write_kb":738181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"26'3683","reported_seq":3711,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.956847+0000","last_change":"2024-04-26T23:40:32.581875+0000","last_active":"2024-04-26T23:49:42.956847+0000","last_peered":"2024-04-26T23:49:42.956847+0000","last_clean":"2024-04-26T23:49:42.956847+0000","last_became_active":"2024-04-26T23:40:32.580987+0000","last_became_peered":"2024-04-26T23:40:32.580987+0000","last_unstale":"2024-04-26T23:49:42.956847+0000","last_undegraded":"2024-04-26T23:49:42.956847+0000","last_fullsized":"2024-04-26T23:49:42.956847+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":3683,"log_dups_size":0,"ondisk_log_size":3683,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:12:45.093169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55303,"num_write_kb":749693,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3b","version":"26'5307","reported_seq":5326,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:32.363761+0000","last_change":"2024-04-26T23:40:41.678366+0000","last_active":"2024-04-26T23:49:32.363761+0000","last_peered":"2024-04-26T23:49:32.363761+0000","last_clean":"2024-04-26T23:49:32.363761+0000","last_became_active":"2024-04-26T23:40:41.678067+0000","last_became_peered":"2024-04-26T23:40:41.678067+0000","last_unstale":"2024-04-26T23:49:32.363761+0000","last_undegraded":"2024-04-26T23:49:32.363761+0000","last_fullsized":"2024-04-26T23:49:32.363761+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":5307,"log_dups_size":0,"ondisk_log_size":5307,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:44:51.594010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79871,"num_write_kb":1001680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"26'4313","reported_seq":4341,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.885657+0000","last_change":"2024-04-26T23:40:32.579870+0000","last_active":"2024-04-26T23:49:42.885657+0000","last_peered":"2024-04-26T23:49:42.885657+0000","last_clean":"2024-04-26T23:49:42.885657+0000","last_became_active":"2024-04-26T23:40:32.579569+0000","last_became_peered":"2024-04-26T23:40:32.579569+0000","last_unstale":"2024-04-26T23:49:42.885657+0000","last_undegraded":"2024-04-26T23:49:42.885657+0000","last_fullsized":"2024-04-26T23:49:42.885657+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":4313,"log_dups_size":0,"ondisk_log_size":4313,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:25:30.040358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":64676,"num_write_kb":807158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.38","version":"26'4943","reported_seq":4962,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:30.217576+0000","last_change":"2024-04-26T23:40:41.684020+0000","last_active":"2024-04-26T23:49:30.217576+0000","last_peered":"2024-04-26T23:49:30.217576+0000","last_clean":"2024-04-26T23:49:30.217576+0000","last_became_active":"2024-04-26T23:40:41.683734+0000","last_became_peered":"2024-04-26T23:40:41.683734+0000","last_unstale":"2024-04-26T23:49:30.217576+0000","last_undegraded":"2024-04-26T23:49:30.217576+0000","last_fullsized":"2024-04-26T23:49:30.217576+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":4943,"log_dups_size":0,"ondisk_log_size":4943,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:38:42.155257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":74716,"num_write_kb":913038,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"26'5195","reported_seq":5223,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.887041+0000","last_change":"2024-04-26T23:40:32.583944+0000","last_active":"2024-04-26T23:49:42.887041+0000","last_peered":"2024-04-26T23:49:42.887041+0000","last_clean":"2024-04-26T23:49:42.887041+0000","last_became_active":"2024-04-26T23:40:32.583655+0000","last_became_peered":"2024-04-26T23:40:32.583655+0000","last_unstale":"2024-04-26T23:49:42.887041+0000","last_undegraded":"2024-04-26T23:49:42.887041+0000","last_fullsized":"2024-04-26T23:49:42.887041+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":5195,"log_dups_size":0,"ondisk_log_size":5195,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:40:17.167353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":78237,"num_write_kb":1038116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.39","version":"26'4256","reported_seq":4275,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:32.355519+0000","last_change":"2024-04-26T23:40:41.681412+0000","last_active":"2024-04-26T23:49:32.355519+0000","last_peered":"2024-04-26T23:49:32.355519+0000","last_clean":"2024-04-26T23:49:32.355519+0000","last_became_active":"2024-04-26T23:40:41.681092+0000","last_became_peered":"2024-04-26T23:40:41.681092+0000","last_unstale":"2024-04-26T23:49:32.355519+0000","last_undegraded":"2024-04-26T23:49:32.355519+0000","last_fullsized":"2024-04-26T23:49:32.355519+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":4256,"log_dups_size":0,"ondisk_log_size":4256,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:48:09.126894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":64162,"num_write_kb":832623,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"26'3628","reported_seq":3656,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.980742+0000","last_change":"2024-04-26T23:40:32.596351+0000","last_active":"2024-04-26T23:49:42.980742+0000","last_peered":"2024-04-26T23:49:42.980742+0000","last_clean":"2024-04-26T23:49:42.980742+0000","last_became_active":"2024-04-26T23:40:32.596050+0000","last_became_peered":"2024-04-26T23:40:32.596050+0000","last_unstale":"2024-04-26T23:49:42.980742+0000","last_undegraded":"2024-04-26T23:49:42.980742+0000","last_fullsized":"2024-04-26T23:49:42.980742+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":3628,"log_dups_size":0,"ondisk_log_size":3628,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:34:14.811917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":54568,"num_write_kb":695399,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4349618,"num_write_kb":55464628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":287416,"ondisk_log_size":287416,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":158829115,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":18,"num_read_kb":98,"num_write":2623,"num_write_kb":157091,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":317718528,"data_stored":317658230,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2523,"ondisk_log_size":2523,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4020088,"num_write_kb":51543156,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":268065,"ondisk_log_size":268065,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":149566157,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":15,"num_read_kb":95,"num_write":2737,"num_write_kb":148086,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":299196416,"data_stored":299132314,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2599,"ondisk_log_size":2599,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574959,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":835292,"kb_used_data":81300,"kb_used_omap":1,"kb_used_meta":753982,"kb_avail":93536548,"statfs":{"total":96636764160,"available":95781425152,"internally_reserved":0,"allocated":83251200,"data_stored":83071587,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":772078026},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574964,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":602412,"kb_used_data":84196,"kb_used_omap":1,"kb_used_meta":518206,"kb_avail":93769428,"statfs":{"total":96636764160,"available":96019894272,"internally_reserved":0,"allocated":86216704,"data_stored":86032300,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":530643398},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574961,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":756680,"kb_used_data":57088,"kb_used_omap":1,"kb_used_meta":699582,"kb_avail":93615160,"statfs":{"total":96636764160,"available":95861923840,"internally_reserved":0,"allocated":58458112,"data_stored":58278265,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":716372421},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574962,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":822852,"kb_used_data":94588,"kb_used_omap":1,"kb_used_meta":728254,"kb_avail":93548988,"statfs":{"total":96636764160,"available":95794163712,"internally_reserved":0,"allocated":96858112,"data_stored":96670557,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":745732549},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574961,"num_pgs":58,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":843140,"kb_used_data":106876,"kb_used_omap":1,"kb_used_meta":736254,"kb_avail":93528700,"statfs":{"total":96636764160,"available":95773388800,"internally_reserved":0,"allocated":109441024,"data_stored":109254605,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":753924551},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574963,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":520948,"kb_used_data":24940,"kb_used_omap":1,"kb_used_meta":495998,"kb_avail":93850892,"statfs":{"total":96636764160,"available":96103313408,"internally_reserved":0,"allocated":25538560,"data_stored":25367229,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":507902405},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574962,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":751212,"kb_used_data":110884,"kb_used_omap":1,"kb_used_meta":640318,"kb_avail":93620628,"statfs":{"total":96636764160,"available":95867523072,"internally_reserved":0,"allocated":113545216,"data_stored":113360216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":655686085},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574965,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":604392,"kb_used_data":45920,"kb_used_omap":1,"kb_used_meta":558462,"kb_avail":93767448,"statfs":{"total":96636764160,"available":96017866752,"internally_reserved":0,"allocated":47022080,"data_stored":46841504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":571865541},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":29372416,"data_stored":29360766,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":41951232,"data_stored":41943200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12673024,"data_stored":12671093,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":33652736,"data_stored":33643285,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":46149632,"data_stored":46137470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":29364224,"data_stored":29360218,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":48824320,"data_stored":48813882,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":57208832,"data_stored":57202400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16777216,"data_stored":16777216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":71315456,"data_stored":71303862,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12587008,"data_stored":12582982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":75509760,"data_stored":75498166,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":50429952,"data_stored":50419933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28815360,"data_stored":28804893,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":37113856,"data_stored":37105264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":25169920,"data_stored":25165914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T23:49:46.604 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T23:49:46.734 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:46.729+0000 7f975419d640 1 Processor -- start 2024-04-26T23:49:46.734 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:46.729+0000 7f975419d640 1 -- start start 2024-04-26T23:49:46.735 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:46.730+0000 7f975419d640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f974c0740e0 0x7f974c157630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:46.736 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:46.730+0000 7f975419d640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f974c0ca3a0 0x7f974c0c7200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:46.736 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:46.730+0000 7f975419d640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f974c15a530 con 0x7f974c0c6e20 2024-04-26T23:49:46.736 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:46.730+0000 7f975419d640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f974c072930 con 0x7f974c0740e0 2024-04-26T23:49:46.736 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:46.730+0000 7f975419d640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f974c15a810 con 0x7f974c0ca3a0 2024-04-26T23:49:46.736 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:46.730+0000 7f9751738640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f974c0740e0 0x7f974c157630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:46.736 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:46.730+0000 7f9751738640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f974c0740e0 0x7f974c157630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:59540/0 (socket says 172.21.15.88:59540) 2024-04-26T23:49:46.736 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:46.730+0000 7f9751738640 1 -- 172.21.15.88:0/3997471674 learned_addr learned my addr 172.21.15.88:0/3997471674 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:49:46.736 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:46.730+0000 7f975273a640 1 --2- 172.21.15.88:0/3997471674 >> v2:172.21.15.175:3300/0 conn(0x7f974c0ca3a0 0x7f974c0c7200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:46.736 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:46.730+0000 7f9751738640 1 -- 172.21.15.88:0/3997471674 >> v2:172.21.15.175:3300/0 conn(0x7f974c0ca3a0 msgr2=0x7f974c0c7200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:49:46.736 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:46.730+0000 7f9751738640 1 --2- 172.21.15.88:0/3997471674 >> v2:172.21.15.175:3300/0 conn(0x7f974c0ca3a0 0x7f974c0c7200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:46.736 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:46.730+0000 7f9751738640 1 -- 172.21.15.88:0/3997471674 >> v1:172.21.15.175:6789/0 conn(0x7f974c0c6e20 legacy=0x7f974c156f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:46.736 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:46.730+0000 7f9751738640 1 -- 172.21.15.88:0/3997471674 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f974c15aaf0 con 0x7f974c0740e0 2024-04-26T23:49:46.737 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:46.731+0000 7f9751738640 1 --2- 172.21.15.88:0/3997471674 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f974c0740e0 0x7f974c157630 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f974c0af150 tx=0x7f973c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f15027c1c5a489 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:49:46.737 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:46.731+0000 7f9750f37640 1 -- 172.21.15.88:0/3997471674 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f973c037070 con 0x7f974c0740e0 2024-04-26T23:49:46.737 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:46.731+0000 7f9750f37640 1 -- 172.21.15.88:0/3997471674 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f973c032440 con 0x7f974c0740e0 2024-04-26T23:49:46.737 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:46.731+0000 7f9750f37640 1 -- 172.21.15.88:0/3997471674 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f973c032810 con 0x7f974c0740e0 2024-04-26T23:49:46.740 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:46.732+0000 7f975419d640 1 -- 172.21.15.88:0/3997471674 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f974c0740e0 msgr2=0x7f974c157630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:46.740 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:46.732+0000 7f975419d640 1 --2- 172.21.15.88:0/3997471674 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f974c0740e0 0x7f974c157630 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f974c0af150 tx=0x7f973c02a1e0 comp rx=0 tx=0).stop 2024-04-26T23:49:46.740 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:46.732+0000 7f975419d640 1 -- 172.21.15.88:0/3997471674 shutdown_connections 2024-04-26T23:49:46.740 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:46.732+0000 7f975419d640 1 --2- 172.21.15.88:0/3997471674 >> v2:172.21.15.175:3300/0 conn(0x7f974c0ca3a0 0x7f974c0c7200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:46.740 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:46.732+0000 7f975419d640 1 --2- 172.21.15.88:0/3997471674 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f974c0740e0 0x7f974c157630 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:46.740 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:46.732+0000 7f975419d640 1 -- 172.21.15.88:0/3997471674 >> 172.21.15.88:0/3997471674 conn(0x7f974c0ae0b0 msgr2=0x7f974c0ae490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:49:46.740 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:46.732+0000 7f975419d640 1 -- 172.21.15.88:0/3997471674 shutdown_connections 2024-04-26T23:49:46.740 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:46.732+0000 7f975419d640 1 -- 172.21.15.88:0/3997471674 wait complete. 2024-04-26T23:49:46.740 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:46.733+0000 7f975419d640 1 Processor -- start 2024-04-26T23:49:46.740 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:46.733+0000 7f975419d640 1 -- start start 2024-04-26T23:49:46.740 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:46.733+0000 7f975419d640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f974c0740e0 0x7f974c144c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:46.740 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:46.733+0000 7f975419d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f974c0c6e20 0x7f974c159910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:46.740 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:46.733+0000 7f975419d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f974c0ca3a0 0x7f974c1f0240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:46.740 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:46.733+0000 7f975419d640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f974c154540 con 0x7f974c0ca3a0 2024-04-26T23:49:46.741 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:46.733+0000 7f975419d640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f974c1543c0 con 0x7f974c0c6e20 2024-04-26T23:49:46.741 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:46.733+0000 7f975419d640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f974c15a0c0 con 0x7f974c0740e0 2024-04-26T23:49:46.741 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:46.734+0000 7f975273a640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f974c0ca3a0 0x7f974c1f0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:46.741 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:46.734+0000 7f975273a640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f974c0ca3a0 0x7f974c1f0240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:59550/0 (socket says 172.21.15.88:59550) 2024-04-26T23:49:46.741 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:46.734+0000 7f975273a640 1 -- 172.21.15.88:0/1904024044 learned_addr learned my addr 172.21.15.88:0/1904024044 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:49:46.741 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:46.734+0000 7f9751738640 1 --2- 172.21.15.88:0/1904024044 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f974c0c6e20 0x7f974c159910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:46.741 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:46.734+0000 7f9751f39640 1 --2- 172.21.15.88:0/1904024044 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f974c0740e0 0x7f974c144c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:46.741 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:46.734+0000 7f975273a640 1 -- 172.21.15.88:0/1904024044 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f974c0740e0 msgr2=0x7f974c144c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:46.741 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:46.734+0000 7f975273a640 1 --2- 172.21.15.88:0/1904024044 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f974c0740e0 0x7f974c144c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:46.741 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:46.734+0000 7f975273a640 1 -- 172.21.15.88:0/1904024044 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f974c0c6e20 msgr2=0x7f974c159910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:46.741 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:46.734+0000 7f975273a640 1 --2- 172.21.15.88:0/1904024044 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f974c0c6e20 0x7f974c159910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:46.741 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:46.734+0000 7f975273a640 1 -- 172.21.15.88:0/1904024044 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f974c1ec960 con 0x7f974c0ca3a0 2024-04-26T23:49:46.741 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:46.734+0000 7f9751f39640 1 --2- 172.21.15.88:0/1904024044 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f974c0740e0 0x7f974c144c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:49:46.741 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:46.734+0000 7f975273a640 1 --2- 172.21.15.88:0/1904024044 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f974c0ca3a0 0x7f974c1f0240 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f974400d600 tx=0x7f974400dac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:49:46.741 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:46.734+0000 7f97427fc640 1 -- 172.21.15.88:0/1904024044 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97440125f0 con 0x7f974c0ca3a0 2024-04-26T23:49:46.742 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:46.734+0000 7f97427fc640 1 -- 172.21.15.88:0/1904024044 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9744019070 con 0x7f974c0ca3a0 2024-04-26T23:49:46.742 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:46.734+0000 7f97427fc640 1 -- 172.21.15.88:0/1904024044 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97440129f0 con 0x7f974c0ca3a0 2024-04-26T23:49:46.742 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:46.734+0000 7f975419d640 1 -- 172.21.15.88:0/1904024044 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f974c0c16a0 con 0x7f974c0ca3a0 2024-04-26T23:49:46.742 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:46.734+0000 7f975419d640 1 -- 172.21.15.88:0/1904024044 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f974c0c2d90 con 0x7f974c0ca3a0 2024-04-26T23:49:46.742 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:46.735+0000 7f975419d640 1 -- 172.21.15.88:0/1904024044 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f974c0766c0 con 0x7f974c0ca3a0 2024-04-26T23:49:46.742 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:46.736+0000 7f97427fc640 1 -- 172.21.15.88:0/1904024044 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f9744012b90 con 0x7f974c0ca3a0 2024-04-26T23:49:46.743 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:46.736+0000 7f97427fc640 1 --2- 172.21.15.88:0/1904024044 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f973006c8f0 0x7f973006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:46.743 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:46.736+0000 7f9751f39640 1 --2- 172.21.15.88:0/1904024044 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f973006c8f0 0x7f973006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:46.743 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:46.736+0000 7f97427fc640 1 -- 172.21.15.88:0/1904024044 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6666+0+0 (secure 0 0 0) 0x7f974408c240 con 0x7f974c0ca3a0 2024-04-26T23:49:46.743 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:46.736+0000 7f9751f39640 1 --2- 172.21.15.88:0/1904024044 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f973006c8f0 0x7f973006edb0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f9748001e00 tx=0x7f9748009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:49:46.745 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:46.740+0000 7f97427fc640 1 -- 172.21.15.88:0/1904024044 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f974405a2c0 con 0x7f974c0ca3a0 2024-04-26T23:49:46.922 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:46.918+0000 7f975419d640 1 -- 172.21.15.88:0/1904024044 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f974c0507a0 con 0x7f974c0ca3a0 2024-04-26T23:49:46.924 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:46.919+0000 7f97427fc640 1 -- 172.21.15.88:0/1904024044 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+20640 (secure 0 0 0) 0x7f9744059bc0 con 0x7f974c0ca3a0 2024-04-26T23:49:46.924 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-26T23:49:46.924 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":26,"fsid":"555255e9-7ef9-4454-8dc9-35e96b70035c","created":"2024-04-26T23:40:07.836009+0000","modified":"2024-04-26T23:41:30.360444+0000","last_up_change":"2024-04-26T23:40:18.831369+0000","last_in_change":"2024-04-26T23:40:09.944777+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T23:40:19.936127+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"a_metadata","create_time":"2024-04-26T23:40:29.837465+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"a_data","create_time":"2024-04-26T23:40:30.868651+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"b_metadata","create_time":"2024-04-26T23:40:38.753441+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"b_data","create_time":"2024-04-26T23:40:39.974557+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"92aecea3-ed62-4a29-87c0-76758a0816a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":2803186054},{"type":"v1","addr":"172.21.15.88:6801","nonce":2803186054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":2803186054},{"type":"v1","addr":"172.21.15.88:6803","nonce":2803186054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":2803186054},{"type":"v1","addr":"172.21.15.88:6807","nonce":2803186054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":2803186054},{"type":"v1","addr":"172.21.15.88:6805","nonce":2803186054}]},"public_addr":"172.21.15.88:6801/2803186054","cluster_addr":"172.21.15.88:6803/2803186054","heartbeat_back_addr":"172.21.15.88:6807/2803186054","heartbeat_front_addr":"172.21.15.88:6805/2803186054","state":["exists","up"]},{"osd":1,"uuid":"7a6f0fa9-23d0-4747-880f-798d45ec5eeb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":1897380484},{"type":"v1","addr":"172.21.15.88:6817","nonce":1897380484}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":1897380484},{"type":"v1","addr":"172.21.15.88:6819","nonce":1897380484}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1897380484},{"type":"v1","addr":"172.21.15.88:6823","nonce":1897380484}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":1897380484},{"type":"v1","addr":"172.21.15.88:6821","nonce":1897380484}]},"public_addr":"172.21.15.88:6817/1897380484","cluster_addr":"172.21.15.88:6819/1897380484","heartbeat_back_addr":"172.21.15.88:6823/1897380484","heartbeat_front_addr":"172.21.15.88:6821/1897380484","state":["exists","up"]},{"osd":2,"uuid":"6be88ea0-e133-4200-a4b5-f92d664b248a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":648396269},{"type":"v1","addr":"172.21.15.88:6809","nonce":648396269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":648396269},{"type":"v1","addr":"172.21.15.88:6811","nonce":648396269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":648396269},{"type":"v1","addr":"172.21.15.88:6815","nonce":648396269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":648396269},{"type":"v1","addr":"172.21.15.88:6813","nonce":648396269}]},"public_addr":"172.21.15.88:6809/648396269","cluster_addr":"172.21.15.88:6811/648396269","heartbeat_back_addr":"172.21.15.88:6815/648396269","heartbeat_front_addr":"172.21.15.88:6813/648396269","state":["exists","up"]},{"osd":3,"uuid":"dcb0746b-7b3d-4ecf-8089-2493a5d1857c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":2328028922},{"type":"v1","addr":"172.21.15.88:6825","nonce":2328028922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":2328028922},{"type":"v1","addr":"172.21.15.88:6827","nonce":2328028922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":2328028922},{"type":"v1","addr":"172.21.15.88:6831","nonce":2328028922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":2328028922},{"type":"v1","addr":"172.21.15.88:6829","nonce":2328028922}]},"public_addr":"172.21.15.88:6825/2328028922","cluster_addr":"172.21.15.88:6827/2328028922","heartbeat_back_addr":"172.21.15.88:6831/2328028922","heartbeat_front_addr":"172.21.15.88:6829/2328028922","state":["exists","up"]},{"osd":4,"uuid":"c483de66-c44f-450e-a4ce-b132d50882c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":3929617402},{"type":"v1","addr":"172.21.15.175:6809","nonce":3929617402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":3929617402},{"type":"v1","addr":"172.21.15.175:6811","nonce":3929617402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":3929617402},{"type":"v1","addr":"172.21.15.175:6815","nonce":3929617402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":3929617402},{"type":"v1","addr":"172.21.15.175:6813","nonce":3929617402}]},"public_addr":"172.21.15.175:6809/3929617402","cluster_addr":"172.21.15.175:6811/3929617402","heartbeat_back_addr":"172.21.15.175:6815/3929617402","heartbeat_front_addr":"172.21.15.175:6813/3929617402","state":["exists","up"]},{"osd":5,"uuid":"ac3b1669-d228-40dd-9f9a-cb46aa73dd6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":2476644457},{"type":"v1","addr":"172.21.15.175:6801","nonce":2476644457}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":2476644457},{"type":"v1","addr":"172.21.15.175:6803","nonce":2476644457}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":2476644457},{"type":"v1","addr":"172.21.15.175:6807","nonce":2476644457}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":2476644457},{"type":"v1","addr":"172.21.15.175:6805","nonce":2476644457}]},"public_addr":"172.21.15.175:6801/2476644457","cluster_addr":"172.21.15.175:6803/2476644457","heartbeat_back_addr":"172.21.15.175:6807/2476644457","heartbeat_front_addr":"172.21.15.175:6805/2476644457","state":["exists","up"]},{"osd":6,"uuid":"7bef4896-857e-4c11-b3b2-c2e9a8548338","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":3824112919},{"type":"v1","addr":"172.21.15.175:6819","nonce":3824112919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6821","nonce":3824112919},{"type":"v1","addr":"172.21.15.175:6824","nonce":3824112919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":3824112919},{"type":"v1","addr":"172.21.15.175:6831","nonce":3824112919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":3824112919},{"type":"v1","addr":"172.21.15.175:6829","nonce":3824112919}]},"public_addr":"172.21.15.175:6819/3824112919","cluster_addr":"172.21.15.175:6824/3824112919","heartbeat_back_addr":"172.21.15.175:6831/3824112919","heartbeat_front_addr":"172.21.15.175:6829/3824112919","state":["exists","up"]},{"osd":7,"uuid":"e18d9e09-8673-470d-b9dc-280a409b63f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6817","nonce":3319361162},{"type":"v1","addr":"172.21.15.175:6818","nonce":3319361162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":3319361162},{"type":"v1","addr":"172.21.15.175:6822","nonce":3319361162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6827","nonce":3319361162},{"type":"v1","addr":"172.21.15.175:6828","nonce":3319361162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6823","nonce":3319361162},{"type":"v1","addr":"172.21.15.175:6825","nonce":3319361162}]},"public_addr":"172.21.15.175:6818/3319361162","cluster_addr":"172.21.15.175:6822/3319361162","heartbeat_back_addr":"172.21.15.175:6828/3319361162","heartbeat_front_addr":"172.21.15.175:6825/3319361162","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:40:15.126268+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:40:15.050614+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:40:14.995164+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:40:15.078112+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:40:15.159637+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:40:15.091226+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:40:15.140316+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:40:15.089431+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.16","mappings":[{"from":5,"to":2}]},{"pgid":"3.17","mappings":[{"from":5,"to":1}]},{"pgid":"3.1f","mappings":[{"from":0,"to":2}]},{"pgid":"3.23","mappings":[{"from":3,"to":1}]},{"pgid":"3.39","mappings":[{"from":7,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:49:46.926 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:46.921+0000 7f975419d640 1 -- 172.21.15.88:0/1904024044 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f973006c8f0 msgr2=0x7f973006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:46.926 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:46.921+0000 7f975419d640 1 --2- 172.21.15.88:0/1904024044 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f973006c8f0 0x7f973006edb0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f9748001e00 tx=0x7f9748009040 comp rx=0 tx=0).stop 2024-04-26T23:49:46.926 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:46.921+0000 7f975419d640 1 -- 172.21.15.88:0/1904024044 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f974c0ca3a0 msgr2=0x7f974c1f0240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:46.926 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:46.921+0000 7f975419d640 1 --2- 172.21.15.88:0/1904024044 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f974c0ca3a0 0x7f974c1f0240 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f974400d600 tx=0x7f974400dac0 comp rx=0 tx=0).stop 2024-04-26T23:49:46.926 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:46.921+0000 7f975419d640 1 -- 172.21.15.88:0/1904024044 shutdown_connections 2024-04-26T23:49:46.926 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:46.921+0000 7f975419d640 1 --2- 172.21.15.88:0/1904024044 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f973006c8f0 0x7f973006edb0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:46.927 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:46.921+0000 7f975419d640 1 --2- 172.21.15.88:0/1904024044 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f974c0ca3a0 0x7f974c1f0240 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:46.927 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:46.921+0000 7f975419d640 1 --2- 172.21.15.88:0/1904024044 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f974c0c6e20 0x7f974c159910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:46.927 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:46.921+0000 7f975419d640 1 --2- 172.21.15.88:0/1904024044 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f974c0740e0 0x7f974c144c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:46.927 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:46.921+0000 7f975419d640 1 -- 172.21.15.88:0/1904024044 >> 172.21.15.88:0/1904024044 conn(0x7f974c0ae0b0 msgr2=0x7f974c0ae490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:49:46.927 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:46.921+0000 7f975419d640 1 -- 172.21.15.88:0/1904024044 shutdown_connections 2024-04-26T23:49:46.927 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:46.921+0000 7f975419d640 1 -- 172.21.15.88:0/1904024044 wait complete. 2024-04-26T23:49:47.938 INFO:tasks.ceph:Scrubbing osd.0 2024-04-26T23:49:47.938 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-04-26T23:49:48.047 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.042+0000 7fc146f51640 1 Processor -- start 2024-04-26T23:49:48.047 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.042+0000 7fc146f51640 1 -- start start 2024-04-26T23:49:48.048 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.043+0000 7fc146f51640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fc1400cbd80 0x7fc1400ca2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:48.048 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.043+0000 7fc146f51640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc1400c8a10 0x7fc1400c6f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:48.048 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.043+0000 7fc146f51640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc140154790 con 0x7fc1401543b0 2024-04-26T23:49:48.048 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.043+0000 7fc146f51640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7fc1400cc210 con 0x7fc1400cbd80 2024-04-26T23:49:48.048 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.043+0000 7fc146f51640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fc140157ca0 con 0x7fc1400c8a10 2024-04-26T23:49:48.049 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.043+0000 7fc13ffff640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fc1400cbd80 0x7fc1400ca2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:48.049 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.043+0000 7fc1454ee640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc1400c8a10 0x7fc1400c6f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:48.050 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.044+0000 7fc144ced640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7fc1401543b0 0x7fc140157590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.88:46150/0 (socket says 172.21.15.88:46150) 2024-04-26T23:49:48.050 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.044+0000 7fc144ced640 1 -- 172.21.15.88:0/3034147057 learned_addr learned my addr 172.21.15.88:0/3034147057 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-26T23:49:48.050 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.044+0000 7fc13ffff640 1 -- 172.21.15.88:0/3034147057 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc1400c8a10 msgr2=0x7fc1400c6f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:49:48.050 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.044+0000 7fc13ffff640 1 --2- 172.21.15.88:0/3034147057 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc1400c8a10 0x7fc1400c6f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:48.050 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.044+0000 7fc13ffff640 1 -- 172.21.15.88:0/3034147057 >> v1:172.21.15.175:6789/0 conn(0x7fc1401543b0 legacy=0x7fc140157590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:48.050 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.044+0000 7fc13ffff640 1 -- 172.21.15.88:0/3034147057 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc14006c4b0 con 0x7fc1400cbd80 2024-04-26T23:49:48.050 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.044+0000 7fc1454ee640 1 --2- 172.21.15.88:0/3034147057 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc1400c8a10 0x7fc1400c6f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:49:48.050 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.045+0000 7fc13ffff640 1 --2- 172.21.15.88:0/3034147057 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc1400cbd80 0x7fc1400ca2b0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fc1340097a0 tx=0x7fc13402a100 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a5ac7fd7a94af1ec server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:49:48.050 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.045+0000 7fc13f7fe640 1 -- 172.21.15.88:0/3034147057 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc134037070 con 0x7fc1400cbd80 2024-04-26T23:49:48.050 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.045+0000 7fc13f7fe640 1 -- 172.21.15.88:0/3034147057 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc13402ae50 con 0x7fc1400cbd80 2024-04-26T23:49:48.050 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.045+0000 7fc13f7fe640 1 -- 172.21.15.88:0/3034147057 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc134032660 con 0x7fc1400cbd80 2024-04-26T23:49:48.053 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.045+0000 7fc146f51640 1 -- 172.21.15.88:0/3034147057 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc1400cbd80 msgr2=0x7fc1400ca2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:48.053 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.045+0000 7fc146f51640 1 --2- 172.21.15.88:0/3034147057 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc1400cbd80 0x7fc1400ca2b0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fc1340097a0 tx=0x7fc13402a100 comp rx=0 tx=0).stop 2024-04-26T23:49:48.053 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.046+0000 7fc146f51640 1 -- 172.21.15.88:0/3034147057 shutdown_connections 2024-04-26T23:49:48.054 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.046+0000 7fc146f51640 1 --2- 172.21.15.88:0/3034147057 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc1400c8a10 0x7fc1400c6f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:48.054 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.046+0000 7fc146f51640 1 --2- 172.21.15.88:0/3034147057 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc1400cbd80 0x7fc1400ca2b0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:48.054 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.046+0000 7fc146f51640 1 -- 172.21.15.88:0/3034147057 >> 172.21.15.88:0/3034147057 conn(0x7fc1400c8e30 msgr2=0x7fc1400c9240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:49:48.054 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.046+0000 7fc146f51640 1 -- 172.21.15.88:0/3034147057 shutdown_connections 2024-04-26T23:49:48.054 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.046+0000 7fc146f51640 1 -- 172.21.15.88:0/3034147057 wait complete. 2024-04-26T23:49:48.054 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.047+0000 7fc146f51640 1 Processor -- start 2024-04-26T23:49:48.054 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.047+0000 7fc146f51640 1 -- start start 2024-04-26T23:49:48.054 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.047+0000 7fc146f51640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc1400c8a10 0x7fc1401ed140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:48.054 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.047+0000 7fc146f51640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc1401543b0 0x7fc14014c620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:48.054 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.047+0000 7fc146f51640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc14014cb60 0x7fc1401508a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:48.054 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.047+0000 7fc146f51640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fc140156d20 con 0x7fc1400c8a10 2024-04-26T23:49:48.054 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.047+0000 7fc146f51640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc140157070 con 0x7fc14014cb60 2024-04-26T23:49:48.054 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.047+0000 7fc146f51640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fc1400c7490 con 0x7fc1401543b0 2024-04-26T23:49:48.054 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.048+0000 7fc144ced640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc1400c8a10 0x7fc1401ed140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:48.055 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.048+0000 7fc144ced640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc1400c8a10 0x7fc1401ed140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:59558/0 (socket says 172.21.15.88:59558) 2024-04-26T23:49:48.055 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.048+0000 7fc144ced640 1 -- 172.21.15.88:0/3153891071 learned_addr learned my addr 172.21.15.88:0/3153891071 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:49:48.055 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.048+0000 7fc1454ee640 1 --2- 172.21.15.88:0/3153891071 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc14014cb60 0x7fc1401508a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:48.055 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.048+0000 7fc13ffff640 1 --2- 172.21.15.88:0/3153891071 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc1401543b0 0x7fc14014c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:48.055 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.048+0000 7fc144ced640 1 -- 172.21.15.88:0/3153891071 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc1401543b0 msgr2=0x7fc14014c620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:48.055 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.048+0000 7fc144ced640 1 --2- 172.21.15.88:0/3153891071 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc1401543b0 0x7fc14014c620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:48.055 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.048+0000 7fc144ced640 1 -- 172.21.15.88:0/3153891071 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc14014cb60 msgr2=0x7fc1401508a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:48.055 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.048+0000 7fc144ced640 1 --2- 172.21.15.88:0/3153891071 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc14014cb60 0x7fc1401508a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:48.055 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.048+0000 7fc144ced640 1 -- 172.21.15.88:0/3153891071 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1401f08e0 con 0x7fc1400c8a10 2024-04-26T23:49:48.055 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.048+0000 7fc1454ee640 1 --2- 172.21.15.88:0/3153891071 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc14014cb60 0x7fc1401508a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:49:48.055 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.048+0000 7fc13ffff640 1 --2- 172.21.15.88:0/3153891071 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc1401543b0 0x7fc14014c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:49:48.055 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.048+0000 7fc144ced640 1 --2- 172.21.15.88:0/3153891071 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc1400c8a10 0x7fc1401ed140 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fc13000c3f0 tx=0x7fc13000c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:49:48.055 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.048+0000 7fc13d7fa640 1 -- 172.21.15.88:0/3153891071 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc130017070 con 0x7fc1400c8a10 2024-04-26T23:49:48.055 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.048+0000 7fc13d7fa640 1 -- 172.21.15.88:0/3153891071 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc130005ce0 con 0x7fc1400c8a10 2024-04-26T23:49:48.056 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.048+0000 7fc146f51640 1 -- 172.21.15.88:0/3153891071 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1401ec940 con 0x7fc1400c8a10 2024-04-26T23:49:48.056 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.048+0000 7fc13d7fa640 1 -- 172.21.15.88:0/3153891071 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1300072f0 con 0x7fc1400c8a10 2024-04-26T23:49:48.056 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.048+0000 7fc146f51640 1 -- 172.21.15.88:0/3153891071 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1401f0bc0 con 0x7fc1400c8a10 2024-04-26T23:49:48.056 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.049+0000 7fc146f51640 1 -- 172.21.15.88:0/3153891071 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc140149b70 con 0x7fc1400c8a10 2024-04-26T23:49:48.057 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.050+0000 7fc13d7fa640 1 -- 172.21.15.88:0/3153891071 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc13001a070 con 0x7fc1400c8a10 2024-04-26T23:49:48.057 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.050+0000 7fc13d7fa640 1 --2- 172.21.15.88:0/3153891071 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fc12c06c8f0 0x7fc12c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:48.057 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.050+0000 7fc13d7fa640 1 -- 172.21.15.88:0/3153891071 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6666+0+0 (secure 0 0 0) 0x7fc13008b200 con 0x7fc1400c8a10 2024-04-26T23:49:48.057 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.050+0000 7fc13ffff640 1 --2- 172.21.15.88:0/3153891071 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fc12c06c8f0 0x7fc12c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:48.057 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.050+0000 7fc13d7fa640 1 --2- 172.21.15.88:0/3153891071 >> [v2:172.21.15.88:6800/2803186054,v1:172.21.15.88:6801/2803186054] conn(0x7fc12c0772e0 0x7fc12c079780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:48.057 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.050+0000 7fc13d7fa640 1 -- 172.21.15.88:0/3153891071 --> [v2:172.21.15.88:6800/2803186054,v1:172.21.15.88:6801/2803186054] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc12c079e50 con 0x7fc12c0772e0 2024-04-26T23:49:48.058 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.050+0000 7fc13d7fa640 1 -- 172.21.15.88:0/3153891071 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fc130092050 con 0x7fc1400c8a10 2024-04-26T23:49:48.058 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.050+0000 7fc1454ee640 1 --2- 172.21.15.88:0/3153891071 >> [v2:172.21.15.88:6800/2803186054,v1:172.21.15.88:6801/2803186054] conn(0x7fc12c0772e0 0x7fc12c079780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:48.058 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.050+0000 7fc13ffff640 1 --2- 172.21.15.88:0/3153891071 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fc12c06c8f0 0x7fc12c06edb0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fc134034000 tx=0x7fc13402e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:49:48.058 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.051+0000 7fc1454ee640 1 --2- 172.21.15.88:0/3153891071 >> [v2:172.21.15.88:6800/2803186054,v1:172.21.15.88:6801/2803186054] conn(0x7fc12c0772e0 0x7fc12c079780 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:49:48.058 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.051+0000 7fc13d7fa640 1 -- 172.21.15.88:0/3153891071 <== osd.0 v2:172.21.15.88:6800/2803186054 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc12c079e50 con 0x7fc12c0772e0 2024-04-26T23:49:48.069 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.064+0000 7fc146f51640 1 -- 172.21.15.88:0/3153891071 --> [v2:172.21.15.88:6800/2803186054,v1:172.21.15.88:6801/2803186054] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fc1400694b0 con 0x7fc12c0772e0 2024-04-26T23:49:48.069 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.065+0000 7fc13d7fa640 1 -- 172.21.15.88:0/3153891071 <== osd.0 v2:172.21.15.88:6800/2803186054 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fc1400694b0 con 0x7fc12c0772e0 2024-04-26T23:49:48.069 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-04-26T23:49:48.069 INFO:teuthology.orchestra.run.smithi088.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-26T23:49:48.069 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-04-26T23:49:48.070 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.065+0000 7fc146f51640 1 -- 172.21.15.88:0/3153891071 >> [v2:172.21.15.88:6800/2803186054,v1:172.21.15.88:6801/2803186054] conn(0x7fc12c0772e0 msgr2=0x7fc12c079780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:48.071 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.065+0000 7fc146f51640 1 --2- 172.21.15.88:0/3153891071 >> [v2:172.21.15.88:6800/2803186054,v1:172.21.15.88:6801/2803186054] conn(0x7fc12c0772e0 0x7fc12c079780 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:48.071 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.065+0000 7fc146f51640 1 -- 172.21.15.88:0/3153891071 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fc12c06c8f0 msgr2=0x7fc12c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:48.071 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.065+0000 7fc146f51640 1 --2- 172.21.15.88:0/3153891071 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fc12c06c8f0 0x7fc12c06edb0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fc134034000 tx=0x7fc13402e000 comp rx=0 tx=0).stop 2024-04-26T23:49:48.071 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.065+0000 7fc146f51640 1 -- 172.21.15.88:0/3153891071 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc1400c8a10 msgr2=0x7fc1401ed140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:48.071 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.065+0000 7fc146f51640 1 --2- 172.21.15.88:0/3153891071 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc1400c8a10 0x7fc1401ed140 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fc13000c3f0 tx=0x7fc13000c8b0 comp rx=0 tx=0).stop 2024-04-26T23:49:48.071 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.065+0000 7fc1454ee640 1 -- 172.21.15.88:0/3153891071 reap_dead start 2024-04-26T23:49:48.071 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.065+0000 7fc146f51640 1 -- 172.21.15.88:0/3153891071 shutdown_connections 2024-04-26T23:49:48.071 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.065+0000 7fc146f51640 1 -- 172.21.15.88:0/3153891071 >> 172.21.15.88:0/3153891071 conn(0x7fc1400c8e30 msgr2=0x7fc1401554f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:49:48.071 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.065+0000 7fc146f51640 1 -- 172.21.15.88:0/3153891071 shutdown_connections 2024-04-26T23:49:48.071 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.065+0000 7fc146f51640 1 -- 172.21.15.88:0/3153891071 wait complete. 2024-04-26T23:49:48.080 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-04-26T23:49:48.179 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.174+0000 7f55b1a6d640 1 Processor -- start 2024-04-26T23:49:48.179 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.174+0000 7f55b1a6d640 1 -- start start 2024-04-26T23:49:48.183 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.175+0000 7f55b1a6d640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f55ac0c4820 0x7f55ac073a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:48.183 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.175+0000 7f55b1a6d640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f55ac156f60 con 0x7f55ac0aecf0 2024-04-26T23:49:48.183 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.175+0000 7f55b1a6d640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f55ac157240 con 0x7f55ac0ab630 2024-04-26T23:49:48.183 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.175+0000 7f55b1a6d640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f55ac157520 con 0x7f55ac0c4820 2024-04-26T23:49:48.183 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.175+0000 7f55ab7fe640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f55ac0aecf0 0x7f55ac0c3800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:51322/0 (socket says 172.21.15.88:51322) 2024-04-26T23:49:48.183 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.175+0000 7f55ab7fe640 1 -- 172.21.15.88:0/610094310 learned_addr learned my addr 172.21.15.88:0/610094310 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-26T23:49:48.183 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.175+0000 7f55aa7fc640 1 -- 172.21.15.88:0/610094310 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3967769431 0 0) 0x7f55ac156f60 con 0x7f55ac0aecf0 2024-04-26T23:49:48.183 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.175+0000 7f55aa7fc640 1 -- 172.21.15.88:0/610094310 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5594003520 con 0x7f55ac0aecf0 2024-04-26T23:49:48.183 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.175+0000 7f55aaffd640 1 --2- 172.21.15.88:0/610094310 >> v2:172.21.15.175:3300/0 conn(0x7f55ac0c4820 0x7f55ac073a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:48.183 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.176+0000 7f55aa7fc640 1 -- 172.21.15.88:0/610094310 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4175533671 0 0) 0x7f5594003520 con 0x7f55ac0aecf0 2024-04-26T23:49:48.183 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.176+0000 7f55aa7fc640 1 -- 172.21.15.88:0/610094310 >> v2:172.21.15.175:3300/0 conn(0x7f55ac0c4820 msgr2=0x7f55ac073a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:49:48.184 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.176+0000 7f55aa7fc640 1 --2- 172.21.15.88:0/610094310 >> v2:172.21.15.175:3300/0 conn(0x7f55ac0c4820 0x7f55ac073a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:48.184 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.176+0000 7f55aa7fc640 1 -- 172.21.15.88:0/610094310 >> v1:172.21.15.175:6789/0 conn(0x7f55ac0ab630 legacy=0x7f55ac073fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:49:48.184 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.176+0000 7f55aa7fc640 1 -- 172.21.15.88:0/610094310 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55ac157800 con 0x7f55ac0aecf0 2024-04-26T23:49:48.184 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.176+0000 7f55aa7fc640 1 -- 172.21.15.88:0/610094310 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 356324787 0 0) 0x7f559c001670 con 0x7f55ac0aecf0 2024-04-26T23:49:48.184 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.176+0000 7f55aa7fc640 1 -- 172.21.15.88:0/610094310 >> v1:172.21.15.88:6789/0 conn(0x7f55ac0aecf0 legacy=0x7f55ac0c3800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:48.184 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.176+0000 7f55aa7fc640 1 --2- 172.21.15.88:0/610094310 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f55940039b0 0x7f5594003db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:48.184 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.176+0000 7f55aa7fc640 1 --2- 172.21.15.88:0/610094310 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5594004800 0x7f5594004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:48.184 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.176+0000 7f55aa7fc640 1 --2- 172.21.15.88:0/610094310 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f55940052e0 0x7f559400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:48.184 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.176+0000 7f55aa7fc640 1 -- 172.21.15.88:0/610094310 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f55ac157520 con 0x7f5594004800 2024-04-26T23:49:48.184 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.176+0000 7f55aa7fc640 1 -- 172.21.15.88:0/610094310 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f559400c190 con 0x7f55940052e0 2024-04-26T23:49:48.184 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.176+0000 7f55aa7fc640 1 -- 172.21.15.88:0/610094310 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f559400c390 con 0x7f55940039b0 2024-04-26T23:49:48.184 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.176+0000 7f55aaffd640 1 --2- 172.21.15.88:0/610094310 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5594004800 0x7f5594004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:48.184 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.176+0000 7f55ab7fe640 1 --2- 172.21.15.88:0/610094310 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f55940039b0 0x7f5594003db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:48.184 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.176+0000 7f55abfff640 1 --2- 172.21.15.88:0/610094310 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f55940052e0 0x7f559400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:48.185 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.176+0000 7f55aaffd640 1 -- 172.21.15.88:0/610094310 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f55940039b0 msgr2=0x7f5594003db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:49:48.185 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.176+0000 7f55aaffd640 1 --2- 172.21.15.88:0/610094310 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f55940039b0 0x7f5594003db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:48.185 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.176+0000 7f55aaffd640 1 -- 172.21.15.88:0/610094310 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f55940052e0 msgr2=0x7f559400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:49:48.185 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.176+0000 7f55aaffd640 1 --2- 172.21.15.88:0/610094310 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f55940052e0 0x7f559400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:48.185 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.176+0000 7f55abfff640 1 -- 172.21.15.88:0/610094310 reap_dead start 2024-04-26T23:49:48.185 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.176+0000 7f55aaffd640 1 -- 172.21.15.88:0/610094310 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5594003520 con 0x7f5594004800 2024-04-26T23:49:48.185 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.177+0000 7f55aaffd640 1 --2- 172.21.15.88:0/610094310 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5594004800 0x7f5594004c80 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f55a000ba00 tx=0x7f5594005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a3b991b7494a731 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:49:48.185 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.177+0000 7f55aa7fc640 1 -- 172.21.15.88:0/610094310 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55a0030070 con 0x7f5594004800 2024-04-26T23:49:48.185 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.177+0000 7f55aa7fc640 1 -- 172.21.15.88:0/610094310 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55a002adb0 con 0x7f5594004800 2024-04-26T23:49:48.185 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.177+0000 7f55aa7fc640 1 -- 172.21.15.88:0/610094310 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55a000b600 con 0x7f5594004800 2024-04-26T23:49:48.185 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.177+0000 7f55b1a6d640 1 -- 172.21.15.88:0/610094310 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5594004800 msgr2=0x7f5594004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:48.185 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.177+0000 7f55b1a6d640 1 --2- 172.21.15.88:0/610094310 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5594004800 0x7f5594004c80 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f55a000ba00 tx=0x7f5594005830 comp rx=0 tx=0).stop 2024-04-26T23:49:48.185 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.177+0000 7f55b1a6d640 1 -- 172.21.15.88:0/610094310 shutdown_connections 2024-04-26T23:49:48.185 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.177+0000 7f55b1a6d640 1 --2- 172.21.15.88:0/610094310 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5594004800 0x7f5594004c80 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:48.185 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.177+0000 7f55b1a6d640 1 -- 172.21.15.88:0/610094310 >> 172.21.15.88:0/610094310 conn(0x7f55ac0c6ed0 msgr2=0x7f55ac0c72b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:49:48.186 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.177+0000 7f55b1a6d640 1 -- 172.21.15.88:0/610094310 shutdown_connections 2024-04-26T23:49:48.186 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.177+0000 7f55b1a6d640 1 -- 172.21.15.88:0/610094310 wait complete. 2024-04-26T23:49:48.186 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.178+0000 7f55b1a6d640 1 Processor -- start 2024-04-26T23:49:48.186 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.179+0000 7f55b1a6d640 1 -- start start 2024-04-26T23:49:48.188 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.179+0000 7f55b1a6d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5594004800 0x7f55ac15a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:48.188 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.179+0000 7f55b1a6d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f55ac15ae20 0x7f55ac146d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:48.188 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.179+0000 7f55b1a6d640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f55ac159070 0x7f55ac147240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:48.188 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.179+0000 7f55b1a6d640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f55ac0af0d0 con 0x7f5594004800 2024-04-26T23:49:48.188 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.179+0000 7f55b1a6d640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f55ac156c10 con 0x7f55ac15ae20 2024-04-26T23:49:48.188 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.179+0000 7f55b1a6d640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f55ac0af250 con 0x7f55ac159070 2024-04-26T23:49:48.189 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.179+0000 7f55ab7fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5594004800 0x7f55ac15a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:48.189 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.179+0000 7f55ab7fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5594004800 0x7f55ac15a8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:59564/0 (socket says 172.21.15.88:59564) 2024-04-26T23:49:48.189 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.179+0000 7f55ab7fe640 1 -- 172.21.15.88:0/1978479182 learned_addr learned my addr 172.21.15.88:0/1978479182 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:49:48.189 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.180+0000 7f55ab7fe640 1 -- 172.21.15.88:0/1978479182 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f55ac159070 msgr2=0x7f55ac147240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:48.189 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.180+0000 7f55ab7fe640 1 --2- 172.21.15.88:0/1978479182 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f55ac159070 0x7f55ac147240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:48.189 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.180+0000 7f55ab7fe640 1 -- 172.21.15.88:0/1978479182 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f55ac15ae20 msgr2=0x7f55ac146d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:48.189 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.180+0000 7f55aaffd640 1 --2- 172.21.15.88:0/1978479182 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f55ac15ae20 0x7f55ac146d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:48.189 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.180+0000 7f55ab7fe640 1 --2- 172.21.15.88:0/1978479182 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f55ac15ae20 0x7f55ac146d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:48.189 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.180+0000 7f55ab7fe640 1 -- 172.21.15.88:0/1978479182 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55ac149670 con 0x7f5594004800 2024-04-26T23:49:48.189 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.180+0000 7f55ab7fe640 1 --2- 172.21.15.88:0/1978479182 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5594004800 0x7f55ac15a8e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f559c00e870 tx=0x7f559c00ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:49:48.189 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.180+0000 7f5593fff640 1 -- 172.21.15.88:0/1978479182 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f559c00c8d0 con 0x7f5594004800 2024-04-26T23:49:48.189 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.180+0000 7f5593fff640 1 -- 172.21.15.88:0/1978479182 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f559c018070 con 0x7f5594004800 2024-04-26T23:49:48.189 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.180+0000 7f55b1a6d640 1 -- 172.21.15.88:0/1978479182 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55ac147fa0 con 0x7f5594004800 2024-04-26T23:49:48.189 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.180+0000 7f5593fff640 1 -- 172.21.15.88:0/1978479182 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f559c00ccd0 con 0x7f5594004800 2024-04-26T23:49:48.189 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.180+0000 7f55b1a6d640 1 -- 172.21.15.88:0/1978479182 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55ac149910 con 0x7f5594004800 2024-04-26T23:49:48.190 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.181+0000 7f55b1a6d640 1 -- 172.21.15.88:0/1978479182 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f55ac1478b0 con 0x7f5594004800 2024-04-26T23:49:48.190 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.181+0000 7f5593fff640 1 -- 172.21.15.88:0/1978479182 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f559c013420 con 0x7f5594004800 2024-04-26T23:49:48.190 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.182+0000 7f5593fff640 1 --2- 172.21.15.88:0/1978479182 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f559806c920 0x7f559806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:48.190 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.182+0000 7f55aaffd640 1 --2- 172.21.15.88:0/1978479182 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f559806c920 0x7f559806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:48.190 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.182+0000 7f5593fff640 1 -- 172.21.15.88:0/1978479182 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6666+0+0 (secure 0 0 0) 0x7f559c08bb60 con 0x7f5594004800 2024-04-26T23:49:48.190 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.182+0000 7f55aaffd640 1 --2- 172.21.15.88:0/1978479182 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f559806c920 0x7f559806ede0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f55940057e0 tx=0x7f55a0030000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:49:48.190 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.187+0000 7f5593fff640 1 -- 172.21.15.88:0/1978479182 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f559c059bd0 con 0x7f5594004800 2024-04-26T23:49:48.364 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.360+0000 7f55b1a6d640 1 -- 172.21.15.88:0/1978479182 --> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7f55ac0507a0 con 0x7f559806c920 2024-04-26T23:49:48.365 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.360+0000 7f5593fff640 1 -- 172.21.15.88:0/1978479182 <== mgr.4104 v2:172.21.15.88:6832/651674297 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f55ac0507a0 con 0x7f559806c920 2024-04-26T23:49:48.365 INFO:teuthology.orchestra.run.smithi088.stderr:instructed osd(s) 0 to deep-scrub 2024-04-26T23:49:48.367 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.362+0000 7f55b1a6d640 1 -- 172.21.15.88:0/1978479182 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f559806c920 msgr2=0x7f559806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:48.367 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.362+0000 7f55b1a6d640 1 --2- 172.21.15.88:0/1978479182 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f559806c920 0x7f559806ede0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f55940057e0 tx=0x7f55a0030000 comp rx=0 tx=0).stop 2024-04-26T23:49:48.367 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.362+0000 7f55b1a6d640 1 -- 172.21.15.88:0/1978479182 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5594004800 msgr2=0x7f55ac15a8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:48.367 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.362+0000 7f55b1a6d640 1 --2- 172.21.15.88:0/1978479182 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5594004800 0x7f55ac15a8e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f559c00e870 tx=0x7f559c00ed30 comp rx=0 tx=0).stop 2024-04-26T23:49:48.367 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.362+0000 7f55b1a6d640 1 -- 172.21.15.88:0/1978479182 shutdown_connections 2024-04-26T23:49:48.367 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.362+0000 7f55b1a6d640 1 --2- 172.21.15.88:0/1978479182 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f559806c920 0x7f559806ede0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:48.367 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.362+0000 7f55b1a6d640 1 --2- 172.21.15.88:0/1978479182 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f55ac159070 0x7f55ac147240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:48.367 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.362+0000 7f55b1a6d640 1 --2- 172.21.15.88:0/1978479182 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f55ac15ae20 0x7f55ac146d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:48.367 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.362+0000 7f55b1a6d640 1 --2- 172.21.15.88:0/1978479182 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5594004800 0x7f55ac15a8e0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:48.368 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.362+0000 7f55b1a6d640 1 -- 172.21.15.88:0/1978479182 >> 172.21.15.88:0/1978479182 conn(0x7f55ac0c6ed0 msgr2=0x7f55ac0680c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:49:48.368 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.362+0000 7f55b1a6d640 1 -- 172.21.15.88:0/1978479182 shutdown_connections 2024-04-26T23:49:48.368 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.362+0000 7f55b1a6d640 1 -- 172.21.15.88:0/1978479182 wait complete. 2024-04-26T23:49:48.378 INFO:tasks.ceph:Scrubbing osd.1 2024-04-26T23:49:48.378 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-04-26T23:49:48.479 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.474+0000 7fbee41b4640 1 Processor -- start 2024-04-26T23:49:48.479 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.474+0000 7fbee41b4640 1 -- start start 2024-04-26T23:49:48.480 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.475+0000 7fbee41b4640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbedc06e720 0x7fbedc0c4150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:48.480 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.475+0000 7fbee41b4640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fbedc1541f0 0x7fbedc1559f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:48.480 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.475+0000 7fbee41b4640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbedc1511e0 con 0x7fbedc0c3d70 2024-04-26T23:49:48.480 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.475+0000 7fbee41b4640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7fbedc06f540 con 0x7fbedc1541f0 2024-04-26T23:49:48.480 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.475+0000 7fbee41b4640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fbedc0ae0c0 con 0x7fbedc06e720 2024-04-26T23:49:48.480 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.475+0000 7fbee2751640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fbedc1541f0 0x7fbedc1559f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:48.480 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.475+0000 7fbee174f640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbedc06e720 0x7fbedc0c4150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:48.480 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.475+0000 7fbee2751640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fbedc1541f0 0x7fbedc1559f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.88:40038/0 (socket says 172.21.15.88:40038) 2024-04-26T23:49:48.480 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.475+0000 7fbee2751640 1 -- 172.21.15.88:0/1711567242 learned_addr learned my addr 172.21.15.88:0/1711567242 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:49:48.480 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.475+0000 7fbee1f50640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7fbedc0c3d70 0x7fbedc1552e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.88:46158/0 (socket says 172.21.15.88:46158) 2024-04-26T23:49:48.480 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.475+0000 7fbee174f640 1 -- 172.21.15.88:0/1711567242 >> v2:172.21.15.175:3300/0 conn(0x7fbedc1541f0 msgr2=0x7fbedc1559f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:49:48.481 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.475+0000 7fbee174f640 1 --2- 172.21.15.88:0/1711567242 >> v2:172.21.15.175:3300/0 conn(0x7fbedc1541f0 0x7fbedc1559f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:48.481 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.475+0000 7fbee174f640 1 -- 172.21.15.88:0/1711567242 >> v1:172.21.15.175:6789/0 conn(0x7fbedc0c3d70 legacy=0x7fbedc1552e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:48.481 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.475+0000 7fbee174f640 1 -- 172.21.15.88:0/1711567242 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbedc1546f0 con 0x7fbedc06e720 2024-04-26T23:49:48.481 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.475+0000 7fbee2751640 1 --2- 172.21.15.88:0/1711567242 >> v2:172.21.15.175:3300/0 conn(0x7fbedc1541f0 0x7fbedc1559f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:49:48.482 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.476+0000 7fbee174f640 1 --2- 172.21.15.88:0/1711567242 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbedc06e720 0x7fbedc0c4150 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fbed80097a0 tx=0x7fbed802a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5bbb2ef7cd25e061 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:49:48.482 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.476+0000 7fbee0f4e640 1 -- 172.21.15.88:0/1711567242 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbed8037070 con 0x7fbedc06e720 2024-04-26T23:49:48.482 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.476+0000 7fbee0f4e640 1 -- 172.21.15.88:0/1711567242 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbed802ae50 con 0x7fbedc06e720 2024-04-26T23:49:48.482 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.476+0000 7fbee0f4e640 1 -- 172.21.15.88:0/1711567242 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbed8032660 con 0x7fbedc06e720 2024-04-26T23:49:48.483 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.477+0000 7fbee41b4640 1 -- 172.21.15.88:0/1711567242 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbedc06e720 msgr2=0x7fbedc0c4150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:48.483 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.477+0000 7fbee41b4640 1 --2- 172.21.15.88:0/1711567242 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbedc06e720 0x7fbedc0c4150 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fbed80097a0 tx=0x7fbed802a100 comp rx=0 tx=0).stop 2024-04-26T23:49:48.483 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.477+0000 7fbee41b4640 1 -- 172.21.15.88:0/1711567242 shutdown_connections 2024-04-26T23:49:48.483 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.477+0000 7fbee41b4640 1 --2- 172.21.15.88:0/1711567242 >> v2:172.21.15.175:3300/0 conn(0x7fbedc1541f0 0x7fbedc1559f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:48.483 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.477+0000 7fbee41b4640 1 --2- 172.21.15.88:0/1711567242 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbedc06e720 0x7fbedc0c4150 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:48.483 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.477+0000 7fbee41b4640 1 -- 172.21.15.88:0/1711567242 >> 172.21.15.88:0/1711567242 conn(0x7fbedc06c310 msgr2=0x7fbedc06c720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:49:48.483 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.477+0000 7fbee41b4640 1 -- 172.21.15.88:0/1711567242 shutdown_connections 2024-04-26T23:49:48.483 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.477+0000 7fbee41b4640 1 -- 172.21.15.88:0/1711567242 wait complete. 2024-04-26T23:49:48.483 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.478+0000 7fbee41b4640 1 Processor -- start 2024-04-26T23:49:48.483 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.478+0000 7fbee41b4640 1 -- start start 2024-04-26T23:49:48.487 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.479+0000 7fbee41b4640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbedc06e720 0x7fbedc1edbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:48.487 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.479+0000 7fbee41b4640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbedc0c3d70 0x7fbedc1ee100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:48.487 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.479+0000 7fbee41b4640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbedc1541f0 0x7fbedc14ad70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:48.487 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.479+0000 7fbee41b4640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fbedc155f30 con 0x7fbedc06e720 2024-04-26T23:49:48.487 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.479+0000 7fbee41b4640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fbedc06f260 con 0x7fbedc0c3d70 2024-04-26T23:49:48.487 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.479+0000 7fbee41b4640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fbedc0c2700 con 0x7fbedc1541f0 2024-04-26T23:49:48.487 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.479+0000 7fbee1f50640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbedc06e720 0x7fbedc1edbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:48.487 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.479+0000 7fbee1f50640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbedc06e720 0x7fbedc1edbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:59572/0 (socket says 172.21.15.88:59572) 2024-04-26T23:49:48.487 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.479+0000 7fbee1f50640 1 -- 172.21.15.88:0/514390216 learned_addr learned my addr 172.21.15.88:0/514390216 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:49:48.487 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.479+0000 7fbee174f640 1 --2- 172.21.15.88:0/514390216 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbedc0c3d70 0x7fbedc1ee100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:48.487 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.479+0000 7fbee2751640 1 --2- 172.21.15.88:0/514390216 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbedc1541f0 0x7fbedc14ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:48.487 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.479+0000 7fbee1f50640 1 -- 172.21.15.88:0/514390216 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbedc1541f0 msgr2=0x7fbedc14ad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:48.488 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.479+0000 7fbee1f50640 1 --2- 172.21.15.88:0/514390216 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbedc1541f0 0x7fbedc14ad70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:48.488 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.479+0000 7fbee1f50640 1 -- 172.21.15.88:0/514390216 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbedc0c3d70 msgr2=0x7fbedc1ee100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:48.488 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.479+0000 7fbee1f50640 1 --2- 172.21.15.88:0/514390216 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbedc0c3d70 0x7fbedc1ee100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:48.488 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.479+0000 7fbee1f50640 1 -- 172.21.15.88:0/514390216 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbedc0c67e0 con 0x7fbedc06e720 2024-04-26T23:49:48.488 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.479+0000 7fbee2751640 1 --2- 172.21.15.88:0/514390216 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbedc1541f0 0x7fbedc14ad70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:49:48.488 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.479+0000 7fbee174f640 1 --2- 172.21.15.88:0/514390216 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbedc0c3d70 0x7fbedc1ee100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:49:48.488 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.479+0000 7fbee1f50640 1 --2- 172.21.15.88:0/514390216 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbedc06e720 0x7fbedc1edbc0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fbecc00c400 tx=0x7fbecc00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:49:48.488 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.479+0000 7fbed27fc640 1 -- 172.21.15.88:0/514390216 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbecc0074e0 con 0x7fbedc06e720 2024-04-26T23:49:48.488 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.479+0000 7fbed27fc640 1 -- 172.21.15.88:0/514390216 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbecc007680 con 0x7fbedc06e720 2024-04-26T23:49:48.488 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.479+0000 7fbee41b4640 1 -- 172.21.15.88:0/514390216 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbedc14d760 con 0x7fbedc06e720 2024-04-26T23:49:48.488 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.479+0000 7fbed27fc640 1 -- 172.21.15.88:0/514390216 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbecc004a00 con 0x7fbedc06e720 2024-04-26T23:49:48.488 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.479+0000 7fbee41b4640 1 -- 172.21.15.88:0/514390216 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbedc1518c0 con 0x7fbedc06e720 2024-04-26T23:49:48.488 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.480+0000 7fbee41b4640 1 -- 172.21.15.88:0/514390216 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fbedc0694b0 con 0x7fbedc06e720 2024-04-26T23:49:48.488 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.481+0000 7fbed27fc640 1 -- 172.21.15.88:0/514390216 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fbecc01a020 con 0x7fbedc06e720 2024-04-26T23:49:48.489 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.481+0000 7fbed27fc640 1 --2- 172.21.15.88:0/514390216 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fbec006c8f0 0x7fbec006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:48.489 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.481+0000 7fbed27fc640 1 -- 172.21.15.88:0/514390216 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6666+0+0 (secure 0 0 0) 0x7fbecc08b770 con 0x7fbedc06e720 2024-04-26T23:49:48.489 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.481+0000 7fbee174f640 1 --2- 172.21.15.88:0/514390216 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fbec006c8f0 0x7fbec006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:48.489 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.481+0000 7fbed27fc640 1 --2- 172.21.15.88:0/514390216 >> [v2:172.21.15.88:6816/1897380484,v1:172.21.15.88:6817/1897380484] conn(0x7fbec00772f0 0x7fbec0079790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:48.489 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.481+0000 7fbed27fc640 1 -- 172.21.15.88:0/514390216 --> [v2:172.21.15.88:6816/1897380484,v1:172.21.15.88:6817/1897380484] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fbec0079e60 con 0x7fbec00772f0 2024-04-26T23:49:48.489 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.481+0000 7fbed27fc640 1 -- 172.21.15.88:0/514390216 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fbecc092050 con 0x7fbedc06e720 2024-04-26T23:49:48.489 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.482+0000 7fbee2751640 1 --2- 172.21.15.88:0/514390216 >> [v2:172.21.15.88:6816/1897380484,v1:172.21.15.88:6817/1897380484] conn(0x7fbec00772f0 0x7fbec0079790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:48.489 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.482+0000 7fbee174f640 1 --2- 172.21.15.88:0/514390216 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fbec006c8f0 0x7fbec006edb0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fbed8034000 tx=0x7fbed802e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:49:48.489 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.482+0000 7fbee2751640 1 --2- 172.21.15.88:0/514390216 >> [v2:172.21.15.88:6816/1897380484,v1:172.21.15.88:6817/1897380484] conn(0x7fbec00772f0 0x7fbec0079790 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:49:48.489 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.482+0000 7fbed27fc640 1 -- 172.21.15.88:0/514390216 <== osd.1 v2:172.21.15.88:6816/1897380484 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fbec0079e60 con 0x7fbec00772f0 2024-04-26T23:49:48.500 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.495+0000 7fbee41b4640 1 -- 172.21.15.88:0/514390216 --> [v2:172.21.15.88:6816/1897380484,v1:172.21.15.88:6817/1897380484] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fbedc06d1b0 con 0x7fbec00772f0 2024-04-26T23:49:48.500 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.496+0000 7fbed27fc640 1 -- 172.21.15.88:0/514390216 <== osd.1 v2:172.21.15.88:6816/1897380484 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fbedc06d1b0 con 0x7fbec00772f0 2024-04-26T23:49:48.500 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-04-26T23:49:48.500 INFO:teuthology.orchestra.run.smithi088.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-26T23:49:48.500 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-04-26T23:49:48.501 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.496+0000 7fbee41b4640 1 -- 172.21.15.88:0/514390216 >> [v2:172.21.15.88:6816/1897380484,v1:172.21.15.88:6817/1897380484] conn(0x7fbec00772f0 msgr2=0x7fbec0079790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:48.501 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.496+0000 7fbee41b4640 1 --2- 172.21.15.88:0/514390216 >> [v2:172.21.15.88:6816/1897380484,v1:172.21.15.88:6817/1897380484] conn(0x7fbec00772f0 0x7fbec0079790 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:48.501 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.496+0000 7fbee41b4640 1 -- 172.21.15.88:0/514390216 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fbec006c8f0 msgr2=0x7fbec006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:48.501 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.496+0000 7fbee41b4640 1 --2- 172.21.15.88:0/514390216 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fbec006c8f0 0x7fbec006edb0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fbed8034000 tx=0x7fbed802e000 comp rx=0 tx=0).stop 2024-04-26T23:49:48.501 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.496+0000 7fbee41b4640 1 -- 172.21.15.88:0/514390216 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbedc06e720 msgr2=0x7fbedc1edbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:48.502 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.496+0000 7fbee41b4640 1 --2- 172.21.15.88:0/514390216 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbedc06e720 0x7fbedc1edbc0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fbecc00c400 tx=0x7fbecc00c8c0 comp rx=0 tx=0).stop 2024-04-26T23:49:48.502 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.496+0000 7fbee2751640 1 -- 172.21.15.88:0/514390216 reap_dead start 2024-04-26T23:49:48.502 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.496+0000 7fbee41b4640 1 -- 172.21.15.88:0/514390216 shutdown_connections 2024-04-26T23:49:48.502 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.496+0000 7fbee41b4640 1 -- 172.21.15.88:0/514390216 >> 172.21.15.88:0/514390216 conn(0x7fbedc06c310 msgr2=0x7fbedc068150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:49:48.502 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.496+0000 7fbee41b4640 1 -- 172.21.15.88:0/514390216 shutdown_connections 2024-04-26T23:49:48.502 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.496+0000 7fbee41b4640 1 -- 172.21.15.88:0/514390216 wait complete. 2024-04-26T23:49:48.511 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-04-26T23:49:48.609 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.604+0000 7f39ff114640 1 Processor -- start 2024-04-26T23:49:48.609 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.604+0000 7f39ff114640 1 -- start start 2024-04-26T23:49:48.610 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.605+0000 7f39ff114640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f39f813ffb0 0x7f39f80c82a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:48.610 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.605+0000 7f39ff114640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f39f80c8a30 con 0x7f39f8158180 2024-04-26T23:49:48.610 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.605+0000 7f39ff114640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f39f80c8d10 con 0x7f39f815a280 2024-04-26T23:49:48.610 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.605+0000 7f39ff114640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f39f8072be0 con 0x7f39f813ffb0 2024-04-26T23:49:48.610 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.605+0000 7f39fceb0640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f39f813ffb0 0x7f39f80c82a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:48.610 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.605+0000 7f39fd6b1640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f39f8158180 0x7f39f8161610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:43844/0 (socket says 172.21.15.88:43844) 2024-04-26T23:49:48.610 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.605+0000 7f39fd6b1640 1 -- 172.21.15.88:0/3151258440 learned_addr learned my addr 172.21.15.88:0/3151258440 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-26T23:49:48.611 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.606+0000 7f39fceb0640 1 -- 172.21.15.88:0/3151258440 >> v1:172.21.15.175:6789/0 conn(0x7f39f815a280 legacy=0x7f39f8072ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:49:48.611 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.606+0000 7f39fceb0640 1 -- 172.21.15.88:0/3151258440 >> v1:172.21.15.88:6789/0 conn(0x7f39f8158180 legacy=0x7f39f8161610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:48.611 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.606+0000 7f39fceb0640 1 -- 172.21.15.88:0/3151258440 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39f80c8ff0 con 0x7f39f813ffb0 2024-04-26T23:49:48.612 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.606+0000 7f39fceb0640 1 --2- 172.21.15.88:0/3151258440 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f39f813ffb0 0x7f39f80c82a0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f39e80097a0 tx=0x7f39e802a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4159bb20ceb30286 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:49:48.612 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.606+0000 7f39f77fe640 1 -- 172.21.15.88:0/3151258440 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39e8037070 con 0x7f39f813ffb0 2024-04-26T23:49:48.612 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.606+0000 7f39f77fe640 1 -- 172.21.15.88:0/3151258440 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39e802ae50 con 0x7f39f813ffb0 2024-04-26T23:49:48.612 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.606+0000 7f39f77fe640 1 -- 172.21.15.88:0/3151258440 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39e8032660 con 0x7f39f813ffb0 2024-04-26T23:49:48.612 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.607+0000 7f39ff114640 1 -- 172.21.15.88:0/3151258440 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f39f813ffb0 msgr2=0x7f39f80c82a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:48.612 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.607+0000 7f39ff114640 1 --2- 172.21.15.88:0/3151258440 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f39f813ffb0 0x7f39f80c82a0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f39e80097a0 tx=0x7f39e802a140 comp rx=0 tx=0).stop 2024-04-26T23:49:48.612 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.607+0000 7f39ff114640 1 -- 172.21.15.88:0/3151258440 shutdown_connections 2024-04-26T23:49:48.612 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.607+0000 7f39ff114640 1 --2- 172.21.15.88:0/3151258440 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f39f813ffb0 0x7f39f80c82a0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:48.612 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.607+0000 7f39ff114640 1 -- 172.21.15.88:0/3151258440 >> 172.21.15.88:0/3151258440 conn(0x7f39f806dc10 msgr2=0x7f39f806c310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:49:48.613 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.607+0000 7f39ff114640 1 -- 172.21.15.88:0/3151258440 shutdown_connections 2024-04-26T23:49:48.613 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.607+0000 7f39ff114640 1 -- 172.21.15.88:0/3151258440 wait complete. 2024-04-26T23:49:48.614 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.608+0000 7f39ff114640 1 Processor -- start 2024-04-26T23:49:48.614 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.608+0000 7f39ff114640 1 -- start start 2024-04-26T23:49:48.615 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.609+0000 7f39ff114640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f39f813ffb0 0x7f39f81f0290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:48.615 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.609+0000 7f39ff114640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f39f8158180 0x7f39f80ad390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:48.615 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.609+0000 7f39ff114640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f39f815a280 0x7f39f8138830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:48.615 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.609+0000 7f39ff114640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f39f80c87e0 con 0x7f39f8158180 2024-04-26T23:49:48.615 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.609+0000 7f39ff114640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f39f80c9640 con 0x7f39f815a280 2024-04-26T23:49:48.615 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.609+0000 7f39ff114640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f39f8073700 con 0x7f39f813ffb0 2024-04-26T23:49:48.615 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.609+0000 7f39f7fff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f39f8158180 0x7f39f80ad390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:48.615 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.609+0000 7f39f7fff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f39f8158180 0x7f39f80ad390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:50168/0 (socket says 172.21.15.88:50168) 2024-04-26T23:49:48.615 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.609+0000 7f39f7fff640 1 -- 172.21.15.88:0/2834602322 learned_addr learned my addr 172.21.15.88:0/2834602322 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:49:48.615 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.609+0000 7f39f7fff640 1 -- 172.21.15.88:0/2834602322 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f39f813ffb0 msgr2=0x7f39f81f0290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:48.615 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.609+0000 7f39f7fff640 1 --2- 172.21.15.88:0/2834602322 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f39f813ffb0 0x7f39f81f0290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:48.615 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.609+0000 7f39f7fff640 1 -- 172.21.15.88:0/2834602322 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f39f815a280 msgr2=0x7f39f8138830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:48.615 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.609+0000 7f39f7fff640 1 --2- 172.21.15.88:0/2834602322 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f39f815a280 0x7f39f8138830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:48.615 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.609+0000 7f39f7fff640 1 -- 172.21.15.88:0/2834602322 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39f81f07d0 con 0x7f39f8158180 2024-04-26T23:49:48.616 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.609+0000 7f39f7fff640 1 --2- 172.21.15.88:0/2834602322 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f39f8158180 0x7f39f80ad390 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f39ec00b3f0 tx=0x7f39ec00b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:49:48.616 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.610+0000 7f39f57fa640 1 -- 172.21.15.88:0/2834602322 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39ec015020 con 0x7f39f8158180 2024-04-26T23:49:48.616 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.610+0000 7f39f57fa640 1 -- 172.21.15.88:0/2834602322 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39ec011830 con 0x7f39f8158180 2024-04-26T23:49:48.616 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.610+0000 7f39ff114640 1 -- 172.21.15.88:0/2834602322 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39f8134c00 con 0x7f39f8158180 2024-04-26T23:49:48.616 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.610+0000 7f39f57fa640 1 -- 172.21.15.88:0/2834602322 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39ec011c20 con 0x7f39f8158180 2024-04-26T23:49:48.616 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.610+0000 7f39ff114640 1 -- 172.21.15.88:0/2834602322 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39f813afa0 con 0x7f39f8158180 2024-04-26T23:49:48.617 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.611+0000 7f39ff114640 1 -- 172.21.15.88:0/2834602322 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39f813b1e0 con 0x7f39f8158180 2024-04-26T23:49:48.617 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.611+0000 7f39f57fa640 1 -- 172.21.15.88:0/2834602322 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f39ec018020 con 0x7f39f8158180 2024-04-26T23:49:48.617 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.611+0000 7f39f57fa640 1 --2- 172.21.15.88:0/2834602322 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f39e406c8f0 0x7f39e406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:48.617 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.611+0000 7f39f57fa640 1 -- 172.21.15.88:0/2834602322 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6666+0+0 (secure 0 0 0) 0x7f39ec08be70 con 0x7f39f8158180 2024-04-26T23:49:48.617 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.611+0000 7f39fceb0640 1 --2- 172.21.15.88:0/2834602322 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f39e406c8f0 0x7f39e406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:48.617 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.612+0000 7f39fceb0640 1 --2- 172.21.15.88:0/2834602322 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f39e406c8f0 0x7f39e406edb0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f39e8034000 tx=0x7f39e802c000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:49:48.620 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.616+0000 7f39f57fa640 1 -- 172.21.15.88:0/2834602322 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f39f813b1e0 con 0x7f39f8158180 2024-04-26T23:49:48.804 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.799+0000 7f39ff114640 1 -- 172.21.15.88:0/2834602322 --> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7f39f8076650 con 0x7f39e406c8f0 2024-04-26T23:49:48.804 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.800+0000 7f39f57fa640 1 -- 172.21.15.88:0/2834602322 <== mgr.4104 v2:172.21.15.88:6832/651674297 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f39f8076650 con 0x7f39e406c8f0 2024-04-26T23:49:48.804 INFO:teuthology.orchestra.run.smithi088.stderr:instructed osd(s) 1 to deep-scrub 2024-04-26T23:49:48.807 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.802+0000 7f39ff114640 1 -- 172.21.15.88:0/2834602322 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f39e406c8f0 msgr2=0x7f39e406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:48.807 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.802+0000 7f39ff114640 1 --2- 172.21.15.88:0/2834602322 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f39e406c8f0 0x7f39e406edb0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f39e8034000 tx=0x7f39e802c000 comp rx=0 tx=0).stop 2024-04-26T23:49:48.807 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.802+0000 7f39ff114640 1 -- 172.21.15.88:0/2834602322 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f39f8158180 msgr2=0x7f39f80ad390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:48.807 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.802+0000 7f39ff114640 1 --2- 172.21.15.88:0/2834602322 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f39f8158180 0x7f39f80ad390 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f39ec00b3f0 tx=0x7f39ec00b8b0 comp rx=0 tx=0).stop 2024-04-26T23:49:48.807 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.802+0000 7f39ff114640 1 -- 172.21.15.88:0/2834602322 shutdown_connections 2024-04-26T23:49:48.807 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.802+0000 7f39ff114640 1 --2- 172.21.15.88:0/2834602322 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f39e406c8f0 0x7f39e406edb0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:48.807 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.802+0000 7f39ff114640 1 --2- 172.21.15.88:0/2834602322 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f39f815a280 0x7f39f8138830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:48.808 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.802+0000 7f39ff114640 1 --2- 172.21.15.88:0/2834602322 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f39f8158180 0x7f39f80ad390 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:48.808 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.802+0000 7f39ff114640 1 --2- 172.21.15.88:0/2834602322 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f39f813ffb0 0x7f39f81f0290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:48.808 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.802+0000 7f39ff114640 1 -- 172.21.15.88:0/2834602322 >> 172.21.15.88:0/2834602322 conn(0x7f39f806dc10 msgr2=0x7f39f80b1140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:49:48.808 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.802+0000 7f39ff114640 1 -- 172.21.15.88:0/2834602322 shutdown_connections 2024-04-26T23:49:48.808 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.802+0000 7f39ff114640 1 -- 172.21.15.88:0/2834602322 wait complete. 2024-04-26T23:49:48.818 INFO:tasks.ceph:Scrubbing osd.2 2024-04-26T23:49:48.818 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-04-26T23:49:48.918 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.914+0000 7f3efb151640 1 Processor -- start 2024-04-26T23:49:48.918 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.914+0000 7f3efb151640 1 -- start start 2024-04-26T23:49:48.920 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.914+0000 7f3efb151640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f3ef406ff80 0x7f3ef40c3410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:48.920 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.914+0000 7f3efb151640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f3ef4152240 0x7f3ef4157e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:48.920 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.915+0000 7f3efb151640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3ef40abe30 con 0x7f3ef40ab9a0 2024-04-26T23:49:48.920 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.915+0000 7f3efb151640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f3ef40ade60 con 0x7f3ef406ff80 2024-04-26T23:49:48.920 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.915+0000 7f3efb151640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f3ef40ad810 con 0x7f3ef4152240 2024-04-26T23:49:48.920 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.915+0000 7f3ef8eed640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f3ef406ff80 0x7f3ef40c3410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:48.921 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.915+0000 7f3ef8eed640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f3ef406ff80 0x7f3ef40c3410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:50170/0 (socket says 172.21.15.88:50170) 2024-04-26T23:49:48.921 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.915+0000 7f3ef8eed640 1 -- 172.21.15.88:0/292594495 learned_addr learned my addr 172.21.15.88:0/292594495 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:49:48.921 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.915+0000 7f3ef96ee640 1 --2- 172.21.15.88:0/292594495 >> v2:172.21.15.175:3300/0 conn(0x7f3ef4152240 0x7f3ef4157e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:48.921 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.915+0000 7f3ef8eed640 1 -- 172.21.15.88:0/292594495 >> v2:172.21.15.175:3300/0 conn(0x7f3ef4152240 msgr2=0x7f3ef4157e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:49:48.921 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.915+0000 7f3ef8eed640 1 --2- 172.21.15.88:0/292594495 >> v2:172.21.15.175:3300/0 conn(0x7f3ef4152240 0x7f3ef4157e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:48.921 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.915+0000 7f3ef8eed640 1 -- 172.21.15.88:0/292594495 >> v1:172.21.15.175:6789/0 conn(0x7f3ef40ab9a0 legacy=0x7f3ef4151b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:48.921 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.915+0000 7f3ef8eed640 1 -- 172.21.15.88:0/292594495 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ef40adaf0 con 0x7f3ef406ff80 2024-04-26T23:49:48.921 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.916+0000 7f3ef8eed640 1 --2- 172.21.15.88:0/292594495 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3ef406ff80 0x7f3ef40c3410 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f3ef4155890 tx=0x7f3ee802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b6a4ca531f46e0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:49:48.921 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.916+0000 7f3ef37fe640 1 -- 172.21.15.88:0/292594495 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ee8037070 con 0x7f3ef406ff80 2024-04-26T23:49:48.921 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.916+0000 7f3ef37fe640 1 -- 172.21.15.88:0/292594495 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ee8032440 con 0x7f3ef406ff80 2024-04-26T23:49:48.921 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.916+0000 7f3ef37fe640 1 -- 172.21.15.88:0/292594495 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ee8032810 con 0x7f3ef406ff80 2024-04-26T23:49:48.924 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.916+0000 7f3efb151640 1 -- 172.21.15.88:0/292594495 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3ef406ff80 msgr2=0x7f3ef40c3410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:48.924 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.916+0000 7f3efb151640 1 --2- 172.21.15.88:0/292594495 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3ef406ff80 0x7f3ef40c3410 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f3ef4155890 tx=0x7f3ee802a270 comp rx=0 tx=0).stop 2024-04-26T23:49:48.924 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.916+0000 7f3efb151640 1 -- 172.21.15.88:0/292594495 shutdown_connections 2024-04-26T23:49:48.924 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.916+0000 7f3efb151640 1 --2- 172.21.15.88:0/292594495 >> v2:172.21.15.175:3300/0 conn(0x7f3ef4152240 0x7f3ef4157e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:48.924 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.916+0000 7f3efb151640 1 --2- 172.21.15.88:0/292594495 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3ef406ff80 0x7f3ef40c3410 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:48.925 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.916+0000 7f3efb151640 1 -- 172.21.15.88:0/292594495 >> 172.21.15.88:0/292594495 conn(0x7f3ef40aa6a0 msgr2=0x7f3ef40aaab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:49:48.925 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.916+0000 7f3efb151640 1 -- 172.21.15.88:0/292594495 shutdown_connections 2024-04-26T23:49:48.925 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.916+0000 7f3efb151640 1 -- 172.21.15.88:0/292594495 wait complete. 2024-04-26T23:49:48.925 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.917+0000 7f3efb151640 1 Processor -- start 2024-04-26T23:49:48.925 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.917+0000 7f3efb151640 1 -- start start 2024-04-26T23:49:48.925 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.918+0000 7f3efb151640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3ef406ff80 0x7f3ef414c690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:48.925 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.918+0000 7f3efb151640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3ef4152240 0x7f3ef414e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:48.925 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.918+0000 7f3efb151640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3ef41ee230 0x7f3ef4157a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:48.925 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.918+0000 7f3efb151640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f3ef4070360 con 0x7f3ef406ff80 2024-04-26T23:49:48.925 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.918+0000 7f3efb151640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f3ef40ad4c0 con 0x7f3ef4152240 2024-04-26T23:49:48.925 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.918+0000 7f3efb151640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f3ef40704e0 con 0x7f3ef41ee230 2024-04-26T23:49:48.925 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.918+0000 7f3ef8eed640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3ef406ff80 0x7f3ef414c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:48.925 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.918+0000 7f3ef8eed640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3ef406ff80 0x7f3ef414c690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:50176/0 (socket says 172.21.15.88:50176) 2024-04-26T23:49:48.925 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.918+0000 7f3ef8eed640 1 -- 172.21.15.88:0/1908987194 learned_addr learned my addr 172.21.15.88:0/1908987194 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:49:48.925 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.919+0000 7f3ef3fff640 1 --2- 172.21.15.88:0/1908987194 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3ef4152240 0x7f3ef414e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:48.926 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.919+0000 7f3ef8eed640 1 -- 172.21.15.88:0/1908987194 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3ef41ee230 msgr2=0x7f3ef4157a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:48.926 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.919+0000 7f3ef8eed640 1 --2- 172.21.15.88:0/1908987194 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3ef41ee230 0x7f3ef4157a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:48.926 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.919+0000 7f3ef8eed640 1 -- 172.21.15.88:0/1908987194 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3ef4152240 msgr2=0x7f3ef414e4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:48.926 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.919+0000 7f3ef8eed640 1 --2- 172.21.15.88:0/1908987194 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3ef4152240 0x7f3ef414e4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:48.926 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.919+0000 7f3ef8eed640 1 -- 172.21.15.88:0/1908987194 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ef40c2e40 con 0x7f3ef406ff80 2024-04-26T23:49:48.926 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.919+0000 7f3ef8eed640 1 --2- 172.21.15.88:0/1908987194 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3ef406ff80 0x7f3ef414c690 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f3ee8000c00 tx=0x7f3ee80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:49:48.926 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.919+0000 7f3ef17fa640 1 -- 172.21.15.88:0/1908987194 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ee8041020 con 0x7f3ef406ff80 2024-04-26T23:49:48.926 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.919+0000 7f3ef17fa640 1 -- 172.21.15.88:0/1908987194 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ee80306c0 con 0x7f3ef406ff80 2024-04-26T23:49:48.926 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.919+0000 7f3efb151640 1 -- 172.21.15.88:0/1908987194 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ef41ee6d0 con 0x7f3ef406ff80 2024-04-26T23:49:48.926 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.919+0000 7f3ef17fa640 1 -- 172.21.15.88:0/1908987194 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ee8037040 con 0x7f3ef406ff80 2024-04-26T23:49:48.926 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.919+0000 7f3efb151640 1 -- 172.21.15.88:0/1908987194 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ef41ea6d0 con 0x7f3ef406ff80 2024-04-26T23:49:48.926 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.920+0000 7f3efb151640 1 -- 172.21.15.88:0/1908987194 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f3ef41ead80 con 0x7f3ef406ff80 2024-04-26T23:49:48.928 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.920+0000 7f3ef17fa640 1 -- 172.21.15.88:0/1908987194 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f3ee8044020 con 0x7f3ef406ff80 2024-04-26T23:49:48.928 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.921+0000 7f3ef17fa640 1 --2- 172.21.15.88:0/1908987194 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f3ed806c8f0 0x7f3ed806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:48.928 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.921+0000 7f3ef17fa640 1 -- 172.21.15.88:0/1908987194 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6666+0+0 (secure 0 0 0) 0x7f3ee80ac660 con 0x7f3ef406ff80 2024-04-26T23:49:48.928 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.921+0000 7f3ef3fff640 1 --2- 172.21.15.88:0/1908987194 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f3ed806c8f0 0x7f3ed806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:48.928 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.921+0000 7f3ef17fa640 1 --2- 172.21.15.88:0/1908987194 >> [v2:172.21.15.88:6808/648396269,v1:172.21.15.88:6809/648396269] conn(0x7f3ed80772e0 0x7f3ed8079780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:48.928 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.921+0000 7f3ef17fa640 1 -- 172.21.15.88:0/1908987194 --> [v2:172.21.15.88:6808/648396269,v1:172.21.15.88:6809/648396269] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3ee804de50 con 0x7f3ed80772e0 2024-04-26T23:49:48.928 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.921+0000 7f3ef17fa640 1 -- 172.21.15.88:0/1908987194 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f3ee80b3050 con 0x7f3ef406ff80 2024-04-26T23:49:48.928 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.921+0000 7f3ef96ee640 1 --2- 172.21.15.88:0/1908987194 >> [v2:172.21.15.88:6808/648396269,v1:172.21.15.88:6809/648396269] conn(0x7f3ed80772e0 0x7f3ed8079780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:48.928 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.921+0000 7f3ef3fff640 1 --2- 172.21.15.88:0/1908987194 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f3ed806c8f0 0x7f3ed806edb0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f3ef40c2c80 tx=0x7f3ee0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:49:48.929 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.921+0000 7f3ef96ee640 1 --2- 172.21.15.88:0/1908987194 >> [v2:172.21.15.88:6808/648396269,v1:172.21.15.88:6809/648396269] conn(0x7f3ed80772e0 0x7f3ed8079780 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:49:48.929 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.922+0000 7f3ef17fa640 1 -- 172.21.15.88:0/1908987194 <== osd.2 v2:172.21.15.88:6808/648396269 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f3ee804de50 con 0x7f3ed80772e0 2024-04-26T23:49:48.939 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.935+0000 7f3efb151640 1 -- 172.21.15.88:0/1908987194 --> [v2:172.21.15.88:6808/648396269,v1:172.21.15.88:6809/648396269] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f3ef40694b0 con 0x7f3ed80772e0 2024-04-26T23:49:48.940 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.935+0000 7f3ef17fa640 1 -- 172.21.15.88:0/1908987194 <== osd.2 v2:172.21.15.88:6808/648396269 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f3ef40694b0 con 0x7f3ed80772e0 2024-04-26T23:49:48.940 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-04-26T23:49:48.940 INFO:teuthology.orchestra.run.smithi088.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-26T23:49:48.940 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-04-26T23:49:48.941 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.935+0000 7f3efb151640 1 -- 172.21.15.88:0/1908987194 >> [v2:172.21.15.88:6808/648396269,v1:172.21.15.88:6809/648396269] conn(0x7f3ed80772e0 msgr2=0x7f3ed8079780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:48.941 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.935+0000 7f3efb151640 1 --2- 172.21.15.88:0/1908987194 >> [v2:172.21.15.88:6808/648396269,v1:172.21.15.88:6809/648396269] conn(0x7f3ed80772e0 0x7f3ed8079780 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:48.941 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.935+0000 7f3efb151640 1 -- 172.21.15.88:0/1908987194 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f3ed806c8f0 msgr2=0x7f3ed806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:48.941 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.935+0000 7f3efb151640 1 --2- 172.21.15.88:0/1908987194 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f3ed806c8f0 0x7f3ed806edb0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f3ef40c2c80 tx=0x7f3ee0009040 comp rx=0 tx=0).stop 2024-04-26T23:49:48.941 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.936+0000 7f3efb151640 1 -- 172.21.15.88:0/1908987194 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3ef406ff80 msgr2=0x7f3ef414c690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:48.941 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.936+0000 7f3efb151640 1 --2- 172.21.15.88:0/1908987194 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3ef406ff80 0x7f3ef414c690 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f3ee8000c00 tx=0x7f3ee80046c0 comp rx=0 tx=0).stop 2024-04-26T23:49:48.941 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.936+0000 7f3ef96ee640 1 -- 172.21.15.88:0/1908987194 reap_dead start 2024-04-26T23:49:48.941 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.936+0000 7f3efb151640 1 -- 172.21.15.88:0/1908987194 shutdown_connections 2024-04-26T23:49:48.941 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.936+0000 7f3efb151640 1 -- 172.21.15.88:0/1908987194 >> 172.21.15.88:0/1908987194 conn(0x7f3ef40aa6a0 msgr2=0x7f3ef40c4e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:49:48.942 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.936+0000 7f3efb151640 1 -- 172.21.15.88:0/1908987194 shutdown_connections 2024-04-26T23:49:48.942 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:48.936+0000 7f3efb151640 1 -- 172.21.15.88:0/1908987194 wait complete. 2024-04-26T23:49:48.951 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-04-26T23:49:49.048 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.043+0000 7fc42dd5f640 1 Processor -- start 2024-04-26T23:49:49.048 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.043+0000 7fc42dd5f640 1 -- start start 2024-04-26T23:49:49.051 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.044+0000 7fc42dd5f640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fc42813ddd0 0x7fc428154b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:49.051 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.044+0000 7fc42dd5f640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc428070f70 0x7fc4280713c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:49.051 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.044+0000 7fc42dd5f640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc4280707e0 con 0x7fc428071cc0 2024-04-26T23:49:49.051 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.044+0000 7fc42dd5f640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7fc428071900 con 0x7fc428070f70 2024-04-26T23:49:49.051 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.044+0000 7fc42dd5f640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7fc428155450 con 0x7fc42813ddd0 2024-04-26T23:49:49.051 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.044+0000 7fc426ffd640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fc428071cc0 0x7fc428073700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:43858/0 (socket says 172.21.15.88:43858) 2024-04-26T23:49:49.051 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.044+0000 7fc426ffd640 1 -- 172.21.15.88:0/2541461414 learned_addr learned my addr 172.21.15.88:0/2541461414 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-26T23:49:49.051 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.044+0000 7fc427fff640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc428070f70 0x7fc4280713c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:49.051 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.044+0000 7fc4277fe640 1 --2- 172.21.15.88:0/2541461414 >> v2:172.21.15.175:3300/0 conn(0x7fc42813ddd0 0x7fc428154b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:49.051 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.045+0000 7fc427fff640 1 -- 172.21.15.88:0/2541461414 >> v2:172.21.15.175:3300/0 conn(0x7fc42813ddd0 msgr2=0x7fc428154b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:49:49.051 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.045+0000 7fc427fff640 1 --2- 172.21.15.88:0/2541461414 >> v2:172.21.15.175:3300/0 conn(0x7fc42813ddd0 0x7fc428154b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:49.051 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.045+0000 7fc427fff640 1 -- 172.21.15.88:0/2541461414 >> v1:172.21.15.88:6789/0 conn(0x7fc428071cc0 legacy=0x7fc428073700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:49.051 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.045+0000 7fc427fff640 1 -- 172.21.15.88:0/2541461414 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc428155730 con 0x7fc428070f70 2024-04-26T23:49:49.052 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.045+0000 7fc4267fc640 1 -- 172.21.15.88:0/2541461414 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2214674219 0 0) 0x7fc4280707e0 con 0x7fc428071cc0 2024-04-26T23:49:49.052 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.045+0000 7fc4277fe640 1 --2- 172.21.15.88:0/2541461414 >> v2:172.21.15.175:3300/0 conn(0x7fc42813ddd0 0x7fc428154b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:49:49.052 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.045+0000 7fc427fff640 1 --2- 172.21.15.88:0/2541461414 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc428070f70 0x7fc4280713c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fc428075020 tx=0x7fc42002a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3744157550aa1074 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:49:49.052 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.045+0000 7fc4267fc640 1 -- 172.21.15.88:0/2541461414 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc420007740 con 0x7fc428070f70 2024-04-26T23:49:49.052 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.045+0000 7fc4267fc640 1 -- 172.21.15.88:0/2541461414 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4200078e0 con 0x7fc428070f70 2024-04-26T23:49:49.052 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.045+0000 7fc4267fc640 1 -- 172.21.15.88:0/2541461414 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc420007cb0 con 0x7fc428070f70 2024-04-26T23:49:49.052 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.046+0000 7fc42dd5f640 1 -- 172.21.15.88:0/2541461414 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc428070f70 msgr2=0x7fc4280713c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:49.052 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.046+0000 7fc42dd5f640 1 --2- 172.21.15.88:0/2541461414 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc428070f70 0x7fc4280713c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fc428075020 tx=0x7fc42002a5f0 comp rx=0 tx=0).stop 2024-04-26T23:49:49.052 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.046+0000 7fc42dd5f640 1 -- 172.21.15.88:0/2541461414 shutdown_connections 2024-04-26T23:49:49.052 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.046+0000 7fc42dd5f640 1 --2- 172.21.15.88:0/2541461414 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc428070f70 0x7fc4280713c0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:49.052 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.046+0000 7fc42dd5f640 1 --2- 172.21.15.88:0/2541461414 >> v2:172.21.15.175:3300/0 conn(0x7fc42813ddd0 0x7fc428154b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:49.052 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.046+0000 7fc42dd5f640 1 -- 172.21.15.88:0/2541461414 >> 172.21.15.88:0/2541461414 conn(0x7fc4280ca2f0 msgr2=0x7fc4280ca6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:49:49.052 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.046+0000 7fc42dd5f640 1 -- 172.21.15.88:0/2541461414 shutdown_connections 2024-04-26T23:49:49.052 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.046+0000 7fc42dd5f640 1 -- 172.21.15.88:0/2541461414 wait complete. 2024-04-26T23:49:49.055 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.047+0000 7fc42dd5f640 1 Processor -- start 2024-04-26T23:49:49.056 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.047+0000 7fc42dd5f640 1 -- start start 2024-04-26T23:49:49.056 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.048+0000 7fc42dd5f640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc428070f70 0x7fc428156ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:49.056 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.048+0000 7fc42dd5f640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc428071cc0 0x7fc4281560c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:49.056 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.048+0000 7fc42dd5f640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc42813ddd0 0x7fc428154400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:49.056 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.048+0000 7fc42dd5f640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fc428073f90 con 0x7fc428070f70 2024-04-26T23:49:49.056 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.048+0000 7fc42dd5f640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc428073e10 con 0x7fc42813ddd0 2024-04-26T23:49:49.056 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.048+0000 7fc42dd5f640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fc42813e1b0 con 0x7fc428071cc0 2024-04-26T23:49:49.056 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.048+0000 7fc4277fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc428070f70 0x7fc428156ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:49.056 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.048+0000 7fc4277fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc428070f70 0x7fc428156ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:50180/0 (socket says 172.21.15.88:50180) 2024-04-26T23:49:49.056 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.048+0000 7fc4277fe640 1 -- 172.21.15.88:0/2754099413 learned_addr learned my addr 172.21.15.88:0/2754099413 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:49:49.056 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.048+0000 7fc427fff640 1 --2- 172.21.15.88:0/2754099413 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc42813ddd0 0x7fc428154400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:49.056 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.048+0000 7fc426ffd640 1 --2- 172.21.15.88:0/2754099413 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc428071cc0 0x7fc4281560c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:49.057 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.048+0000 7fc4277fe640 1 -- 172.21.15.88:0/2754099413 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc428071cc0 msgr2=0x7fc4281560c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:49.057 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.048+0000 7fc4277fe640 1 --2- 172.21.15.88:0/2754099413 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc428071cc0 0x7fc4281560c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:49.057 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.048+0000 7fc4277fe640 1 -- 172.21.15.88:0/2754099413 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc42813ddd0 msgr2=0x7fc428154400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:49.057 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.048+0000 7fc4277fe640 1 --2- 172.21.15.88:0/2754099413 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc42813ddd0 0x7fc428154400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:49.057 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.048+0000 7fc4277fe640 1 -- 172.21.15.88:0/2754099413 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4281ed3b0 con 0x7fc428070f70 2024-04-26T23:49:49.057 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.048+0000 7fc427fff640 1 --2- 172.21.15.88:0/2754099413 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc42813ddd0 0x7fc428154400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:49:49.057 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.049+0000 7fc4277fe640 1 --2- 172.21.15.88:0/2754099413 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc428070f70 0x7fc428156ac0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fc41800c820 tx=0x7fc41800cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:49:49.057 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.049+0000 7fc40ffff640 1 -- 172.21.15.88:0/2754099413 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc418015070 con 0x7fc428070f70 2024-04-26T23:49:49.057 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.049+0000 7fc40ffff640 1 -- 172.21.15.88:0/2754099413 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc418007a30 con 0x7fc428070f70 2024-04-26T23:49:49.057 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.049+0000 7fc40ffff640 1 -- 172.21.15.88:0/2754099413 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc418007e00 con 0x7fc428070f70 2024-04-26T23:49:49.057 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.049+0000 7fc42dd5f640 1 -- 172.21.15.88:0/2754099413 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4280c4260 con 0x7fc428070f70 2024-04-26T23:49:49.057 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.049+0000 7fc42dd5f640 1 -- 172.21.15.88:0/2754099413 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4280c4820 con 0x7fc428070f70 2024-04-26T23:49:49.057 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.050+0000 7fc42dd5f640 1 -- 172.21.15.88:0/2754099413 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc4280507a0 con 0x7fc428070f70 2024-04-26T23:49:49.057 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.050+0000 7fc40ffff640 1 -- 172.21.15.88:0/2754099413 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc418018070 con 0x7fc428070f70 2024-04-26T23:49:49.058 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.051+0000 7fc40ffff640 1 --2- 172.21.15.88:0/2754099413 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fc41406c8f0 0x7fc41406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:49.058 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.051+0000 7fc426ffd640 1 --2- 172.21.15.88:0/2754099413 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fc41406c8f0 0x7fc41406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:49.058 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.051+0000 7fc40ffff640 1 -- 172.21.15.88:0/2754099413 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6666+0+0 (secure 0 0 0) 0x7fc41808be60 con 0x7fc428070f70 2024-04-26T23:49:49.058 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.051+0000 7fc426ffd640 1 --2- 172.21.15.88:0/2754099413 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fc41406c8f0 0x7fc41406edb0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fc4281526c0 tx=0x7fc41c007b50 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:49:49.059 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.055+0000 7fc40ffff640 1 -- 172.21.15.88:0/2754099413 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fc418059ed0 con 0x7fc428070f70 2024-04-26T23:49:49.240 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.235+0000 7fc42dd5f640 1 -- 172.21.15.88:0/2754099413 --> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7fc428154940 con 0x7fc41406c8f0 2024-04-26T23:49:49.240 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.235+0000 7fc40ffff640 1 -- 172.21.15.88:0/2754099413 <== mgr.4104 v2:172.21.15.88:6832/651674297 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fc41c007170 con 0x7fc41406c8f0 2024-04-26T23:49:49.240 INFO:teuthology.orchestra.run.smithi088.stderr:instructed osd(s) 2 to deep-scrub 2024-04-26T23:49:49.242 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.237+0000 7fc42dd5f640 1 -- 172.21.15.88:0/2754099413 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fc41406c8f0 msgr2=0x7fc41406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:49.242 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.237+0000 7fc42dd5f640 1 --2- 172.21.15.88:0/2754099413 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fc41406c8f0 0x7fc41406edb0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fc4281526c0 tx=0x7fc41c007b50 comp rx=0 tx=0).stop 2024-04-26T23:49:49.242 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.237+0000 7fc42dd5f640 1 -- 172.21.15.88:0/2754099413 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc428070f70 msgr2=0x7fc428156ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:49.242 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.237+0000 7fc42dd5f640 1 --2- 172.21.15.88:0/2754099413 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc428070f70 0x7fc428156ac0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fc41800c820 tx=0x7fc41800cc20 comp rx=0 tx=0).stop 2024-04-26T23:49:49.243 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.237+0000 7fc42dd5f640 1 -- 172.21.15.88:0/2754099413 shutdown_connections 2024-04-26T23:49:49.243 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.237+0000 7fc42dd5f640 1 --2- 172.21.15.88:0/2754099413 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fc41406c8f0 0x7fc41406edb0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:49.243 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.237+0000 7fc42dd5f640 1 --2- 172.21.15.88:0/2754099413 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc428071cc0 0x7fc4281560c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:49.243 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.237+0000 7fc42dd5f640 1 --2- 172.21.15.88:0/2754099413 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc42813ddd0 0x7fc428154400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:49.243 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.237+0000 7fc42dd5f640 1 --2- 172.21.15.88:0/2754099413 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc428070f70 0x7fc428156ac0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:49.243 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.237+0000 7fc42dd5f640 1 -- 172.21.15.88:0/2754099413 >> 172.21.15.88:0/2754099413 conn(0x7fc4280ca2f0 msgr2=0x7fc42813cfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:49:49.243 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.238+0000 7fc42dd5f640 1 -- 172.21.15.88:0/2754099413 shutdown_connections 2024-04-26T23:49:49.243 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.238+0000 7fc42dd5f640 1 -- 172.21.15.88:0/2754099413 wait complete. 2024-04-26T23:49:49.253 INFO:tasks.ceph:Scrubbing osd.3 2024-04-26T23:49:49.254 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-04-26T23:49:49.355 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.350+0000 7f84ec4c8640 1 Processor -- start 2024-04-26T23:49:49.355 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.350+0000 7f84ec4c8640 1 -- start start 2024-04-26T23:49:49.356 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.351+0000 7f84ec4c8640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f84e40ca520 0x7f84e415ac00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:49.356 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.351+0000 7f84ec4c8640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f84e4072930 0x7f84e4072dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:49.356 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.351+0000 7f84ec4c8640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f84e4073560 con 0x7f84e4154200 2024-04-26T23:49:49.356 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.351+0000 7f84ec4c8640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f84e4157c20 con 0x7f84e4072930 2024-04-26T23:49:49.356 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.351+0000 7f84ec4c8640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f84e415b140 con 0x7f84e40ca520 2024-04-26T23:49:49.357 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.351+0000 7f84eaa65640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f84e4072930 0x7f84e4072dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:49.357 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.351+0000 7f84eaa65640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f84e4072930 0x7f84e4072dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:50190/0 (socket says 172.21.15.88:50190) 2024-04-26T23:49:49.357 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.351+0000 7f84eaa65640 1 -- 172.21.15.88:0/2749490768 learned_addr learned my addr 172.21.15.88:0/2749490768 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:49:49.357 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.351+0000 7f84e9a63640 1 --2- 172.21.15.88:0/2749490768 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f84e40ca520 0x7f84e415ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:49.357 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.351+0000 7f84eaa65640 1 -- 172.21.15.88:0/2749490768 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f84e40ca520 msgr2=0x7f84e415ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:49:49.357 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.351+0000 7f84eaa65640 1 --2- 172.21.15.88:0/2749490768 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f84e40ca520 0x7f84e415ac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:49.357 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.351+0000 7f84eaa65640 1 -- 172.21.15.88:0/2749490768 >> v1:172.21.15.175:6789/0 conn(0x7f84e4154200 legacy=0x7f84e4157510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:49.357 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.351+0000 7f84eaa65640 1 -- 172.21.15.88:0/2749490768 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84e40c7790 con 0x7f84e4072930 2024-04-26T23:49:49.359 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.352+0000 7f84eaa65640 1 --2- 172.21.15.88:0/2749490768 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f84e4072930 0x7f84e4072dc0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f84dc009870 tx=0x7f84dc02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d2f963789a19b32 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:49:49.359 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.352+0000 7f84e9262640 1 -- 172.21.15.88:0/2749490768 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84dc037070 con 0x7f84e4072930 2024-04-26T23:49:49.359 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.352+0000 7f84e9262640 1 -- 172.21.15.88:0/2749490768 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84dc032440 con 0x7f84e4072930 2024-04-26T23:49:49.359 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.352+0000 7f84e9262640 1 -- 172.21.15.88:0/2749490768 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84dc032810 con 0x7f84e4072930 2024-04-26T23:49:49.359 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.353+0000 7f84ec4c8640 1 -- 172.21.15.88:0/2749490768 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f84e4072930 msgr2=0x7f84e4072dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:49.359 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.353+0000 7f84ec4c8640 1 --2- 172.21.15.88:0/2749490768 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f84e4072930 0x7f84e4072dc0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f84dc009870 tx=0x7f84dc02a270 comp rx=0 tx=0).stop 2024-04-26T23:49:49.359 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.353+0000 7f84ec4c8640 1 -- 172.21.15.88:0/2749490768 shutdown_connections 2024-04-26T23:49:49.359 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.353+0000 7f84ec4c8640 1 --2- 172.21.15.88:0/2749490768 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f84e4072930 0x7f84e4072dc0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:49.359 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.353+0000 7f84ec4c8640 1 --2- 172.21.15.88:0/2749490768 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f84e40ca520 0x7f84e415ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:49.359 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.353+0000 7f84ec4c8640 1 -- 172.21.15.88:0/2749490768 >> 172.21.15.88:0/2749490768 conn(0x7f84e40cc400 msgr2=0x7f84e40cc810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:49:49.359 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.353+0000 7f84ec4c8640 1 -- 172.21.15.88:0/2749490768 shutdown_connections 2024-04-26T23:49:49.359 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.353+0000 7f84ec4c8640 1 -- 172.21.15.88:0/2749490768 wait complete. 2024-04-26T23:49:49.359 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.354+0000 7f84ec4c8640 1 Processor -- start 2024-04-26T23:49:49.359 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.354+0000 7f84ec4c8640 1 -- start start 2024-04-26T23:49:49.362 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.355+0000 7f84ec4c8640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f84e4072930 0x7f84e414d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:49.362 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.355+0000 7f84ec4c8640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f84e40ca520 0x7f84e41efe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:49.363 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.355+0000 7f84ec4c8640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f84e4154200 0x7f84e414eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:49.363 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.355+0000 7f84ec4c8640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f84e4156d10 con 0x7f84e40ca520 2024-04-26T23:49:49.363 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.355+0000 7f84ec4c8640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f84e40c74b0 con 0x7f84e4072930 2024-04-26T23:49:49.363 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.355+0000 7f84ec4c8640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f84e4156ff0 con 0x7f84e4154200 2024-04-26T23:49:49.363 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.355+0000 7f84e9a63640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f84e40ca520 0x7f84e41efe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:49.363 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.355+0000 7f84e9a63640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f84e40ca520 0x7f84e41efe10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:50200/0 (socket says 172.21.15.88:50200) 2024-04-26T23:49:49.363 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.355+0000 7f84e9a63640 1 -- 172.21.15.88:0/152162389 learned_addr learned my addr 172.21.15.88:0/152162389 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:49:49.363 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.355+0000 7f84eaa65640 1 --2- 172.21.15.88:0/152162389 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f84e4154200 0x7f84e414eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:49.363 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.355+0000 7f84ea264640 1 --2- 172.21.15.88:0/152162389 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f84e4072930 0x7f84e414d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:49.363 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.355+0000 7f84e9a63640 1 -- 172.21.15.88:0/152162389 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f84e4154200 msgr2=0x7f84e414eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:49.363 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.355+0000 7f84e9a63640 1 --2- 172.21.15.88:0/152162389 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f84e4154200 0x7f84e414eeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:49.363 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.355+0000 7f84e9a63640 1 -- 172.21.15.88:0/152162389 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f84e4072930 msgr2=0x7f84e414d7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:49.363 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.355+0000 7f84e9a63640 1 --2- 172.21.15.88:0/152162389 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f84e4072930 0x7f84e414d7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:49.363 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.355+0000 7f84e9a63640 1 -- 172.21.15.88:0/152162389 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84e414dce0 con 0x7f84e40ca520 2024-04-26T23:49:49.363 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.355+0000 7f84e9a63640 1 --2- 172.21.15.88:0/152162389 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f84e40ca520 0x7f84e41efe10 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f84d400d800 tx=0x7f84d400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:49:49.364 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.355+0000 7f84daffd640 1 -- 172.21.15.88:0/152162389 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84d400b6c0 con 0x7f84e40ca520 2024-04-26T23:49:49.364 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.355+0000 7f84daffd640 1 -- 172.21.15.88:0/152162389 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84d4019070 con 0x7f84e40ca520 2024-04-26T23:49:49.364 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.355+0000 7f84daffd640 1 -- 172.21.15.88:0/152162389 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84d400ba80 con 0x7f84e40ca520 2024-04-26T23:49:49.364 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.355+0000 7f84ec4c8640 1 -- 172.21.15.88:0/152162389 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84e414d500 con 0x7f84e40ca520 2024-04-26T23:49:49.364 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.355+0000 7f84ec4c8640 1 -- 172.21.15.88:0/152162389 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84e41f0980 con 0x7f84e40ca520 2024-04-26T23:49:49.364 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.356+0000 7f84ec4c8640 1 -- 172.21.15.88:0/152162389 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f84e40c6240 con 0x7f84e40ca520 2024-04-26T23:49:49.364 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.357+0000 7f84daffd640 1 -- 172.21.15.88:0/152162389 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f84d400bc20 con 0x7f84e40ca520 2024-04-26T23:49:49.364 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.357+0000 7f84daffd640 1 --2- 172.21.15.88:0/152162389 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f84c806c8f0 0x7f84c806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:49.364 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.357+0000 7f84daffd640 1 -- 172.21.15.88:0/152162389 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6666+0+0 (secure 0 0 0) 0x7f84d408c330 con 0x7f84e40ca520 2024-04-26T23:49:49.364 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.357+0000 7f84ea264640 1 --2- 172.21.15.88:0/152162389 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f84c806c8f0 0x7f84c806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:49.364 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.357+0000 7f84daffd640 1 --2- 172.21.15.88:0/152162389 >> [v2:172.21.15.88:6824/2328028922,v1:172.21.15.88:6825/2328028922] conn(0x7f84c80772f0 0x7f84c8079790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:49.364 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.357+0000 7f84daffd640 1 -- 172.21.15.88:0/152162389 --> [v2:172.21.15.88:6824/2328028922,v1:172.21.15.88:6825/2328028922] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f84d4016e50 con 0x7f84c80772f0 2024-04-26T23:49:49.364 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.357+0000 7f84daffd640 1 -- 172.21.15.88:0/152162389 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f84d4093050 con 0x7f84e40ca520 2024-04-26T23:49:49.364 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.357+0000 7f84eaa65640 1 --2- 172.21.15.88:0/152162389 >> [v2:172.21.15.88:6824/2328028922,v1:172.21.15.88:6825/2328028922] conn(0x7f84c80772f0 0x7f84c8079790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:49.365 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.358+0000 7f84ea264640 1 --2- 172.21.15.88:0/152162389 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f84c806c8f0 0x7f84c806edb0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f84e40ad580 tx=0x7f84e0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:49:49.365 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.358+0000 7f84eaa65640 1 --2- 172.21.15.88:0/152162389 >> [v2:172.21.15.88:6824/2328028922,v1:172.21.15.88:6825/2328028922] conn(0x7f84c80772f0 0x7f84c8079790 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:49:49.365 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.358+0000 7f84daffd640 1 -- 172.21.15.88:0/152162389 <== osd.3 v2:172.21.15.88:6824/2328028922 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f84d4016e50 con 0x7f84c80772f0 2024-04-26T23:49:49.376 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.371+0000 7f84ec4c8640 1 -- 172.21.15.88:0/152162389 --> [v2:172.21.15.88:6824/2328028922,v1:172.21.15.88:6825/2328028922] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f84e40694b0 con 0x7f84c80772f0 2024-04-26T23:49:49.376 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.372+0000 7f84daffd640 1 -- 172.21.15.88:0/152162389 <== osd.3 v2:172.21.15.88:6824/2328028922 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f84e40694b0 con 0x7f84c80772f0 2024-04-26T23:49:49.376 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-04-26T23:49:49.376 INFO:teuthology.orchestra.run.smithi088.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-26T23:49:49.376 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-04-26T23:49:49.377 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.372+0000 7f84ec4c8640 1 -- 172.21.15.88:0/152162389 >> [v2:172.21.15.88:6824/2328028922,v1:172.21.15.88:6825/2328028922] conn(0x7f84c80772f0 msgr2=0x7f84c8079790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:49.377 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.372+0000 7f84ec4c8640 1 --2- 172.21.15.88:0/152162389 >> [v2:172.21.15.88:6824/2328028922,v1:172.21.15.88:6825/2328028922] conn(0x7f84c80772f0 0x7f84c8079790 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:49.377 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.372+0000 7f84ec4c8640 1 -- 172.21.15.88:0/152162389 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f84c806c8f0 msgr2=0x7f84c806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:49.377 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.372+0000 7f84ec4c8640 1 --2- 172.21.15.88:0/152162389 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f84c806c8f0 0x7f84c806edb0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f84e40ad580 tx=0x7f84e0009040 comp rx=0 tx=0).stop 2024-04-26T23:49:49.378 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.372+0000 7f84ec4c8640 1 -- 172.21.15.88:0/152162389 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f84e40ca520 msgr2=0x7f84e41efe10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:49.378 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.372+0000 7f84ec4c8640 1 --2- 172.21.15.88:0/152162389 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f84e40ca520 0x7f84e41efe10 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f84d400d800 tx=0x7f84d400dcc0 comp rx=0 tx=0).stop 2024-04-26T23:49:49.378 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.372+0000 7f84eaa65640 1 -- 172.21.15.88:0/152162389 reap_dead start 2024-04-26T23:49:49.378 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.372+0000 7f84ec4c8640 1 -- 172.21.15.88:0/152162389 shutdown_connections 2024-04-26T23:49:49.378 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.372+0000 7f84ec4c8640 1 -- 172.21.15.88:0/152162389 >> 172.21.15.88:0/152162389 conn(0x7f84e40cc400 msgr2=0x7f84e40c95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:49:49.378 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.372+0000 7f84ec4c8640 1 -- 172.21.15.88:0/152162389 shutdown_connections 2024-04-26T23:49:49.378 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.372+0000 7f84ec4c8640 1 -- 172.21.15.88:0/152162389 wait complete. 2024-04-26T23:49:49.387 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-04-26T23:49:49.490 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.485+0000 7f3622dc1640 1 Processor -- start 2024-04-26T23:49:49.490 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.485+0000 7f3622dc1640 1 -- start start 2024-04-26T23:49:49.491 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.486+0000 7f3622dc1640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f361c0c7000 0x7f361c0ca460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:49.491 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.486+0000 7f3622dc1640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f361c0c9830 0x7f361c153ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:49.491 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.486+0000 7f3622dc1640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f361c154220 0x7f361c072930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:49.491 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.486+0000 7f3622dc1640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f361c156de0 con 0x7f361c0c7000 2024-04-26T23:49:49.492 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.486+0000 7f3622dc1640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f361c157b60 con 0x7f361c0c9830 2024-04-26T23:49:49.492 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.486+0000 7f3622dc1640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f361c0cad40 con 0x7f361c154220 2024-04-26T23:49:49.492 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.486+0000 7f3620b5d640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f361c0c7000 0x7f361c0ca460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:49.492 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.486+0000 7f3620b5d640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f361c0c7000 0x7f361c0ca460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:50206/0 (socket says 172.21.15.88:50206) 2024-04-26T23:49:49.492 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.486+0000 7f3620b5d640 1 -- 172.21.15.88:0/3575948221 learned_addr learned my addr 172.21.15.88:0/3575948221 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:49:49.492 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.486+0000 7f3620b5d640 1 -- 172.21.15.88:0/3575948221 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f361c154220 msgr2=0x7f361c072930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:49:49.492 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.486+0000 7f3620b5d640 1 --2- 172.21.15.88:0/3575948221 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f361c154220 0x7f361c072930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:49.492 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.486+0000 7f3620b5d640 1 -- 172.21.15.88:0/3575948221 >> v2:172.21.15.175:3300/0 conn(0x7f361c0c9830 msgr2=0x7f361c153ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:49:49.492 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.486+0000 7f3620b5d640 1 --2- 172.21.15.88:0/3575948221 >> v2:172.21.15.175:3300/0 conn(0x7f361c0c9830 0x7f361c153ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:49.492 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.486+0000 7f3620b5d640 1 -- 172.21.15.88:0/3575948221 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f361c157080 con 0x7f361c0c7000 2024-04-26T23:49:49.492 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.487+0000 7f3620b5d640 1 --2- 172.21.15.88:0/3575948221 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f361c0c7000 0x7f361c0ca460 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f361c0c8df0 tx=0x7f361002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77bcfcb9d1f5fed5 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:49:49.492 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.487+0000 7f361b7fe640 1 -- 172.21.15.88:0/3575948221 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3610037070 con 0x7f361c0c7000 2024-04-26T23:49:49.492 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.487+0000 7f361b7fe640 1 -- 172.21.15.88:0/3575948221 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3610032440 con 0x7f361c0c7000 2024-04-26T23:49:49.492 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.487+0000 7f361b7fe640 1 -- 172.21.15.88:0/3575948221 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3610032810 con 0x7f361c0c7000 2024-04-26T23:49:49.495 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.487+0000 7f3622dc1640 1 -- 172.21.15.88:0/3575948221 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f361c0c7000 msgr2=0x7f361c0ca460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:49.495 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.487+0000 7f3622dc1640 1 --2- 172.21.15.88:0/3575948221 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f361c0c7000 0x7f361c0ca460 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f361c0c8df0 tx=0x7f361002a1e0 comp rx=0 tx=0).stop 2024-04-26T23:49:49.495 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.487+0000 7f3622dc1640 1 -- 172.21.15.88:0/3575948221 shutdown_connections 2024-04-26T23:49:49.495 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.487+0000 7f3622dc1640 1 --2- 172.21.15.88:0/3575948221 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f361c154220 0x7f361c072930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:49.496 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.487+0000 7f3622dc1640 1 --2- 172.21.15.88:0/3575948221 >> v2:172.21.15.175:3300/0 conn(0x7f361c0c9830 0x7f361c153ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:49.496 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.487+0000 7f3622dc1640 1 --2- 172.21.15.88:0/3575948221 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f361c0c7000 0x7f361c0ca460 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:49.496 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.487+0000 7f3622dc1640 1 -- 172.21.15.88:0/3575948221 >> 172.21.15.88:0/3575948221 conn(0x7f361c0adf20 msgr2=0x7f361c0ae330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:49:49.496 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.487+0000 7f3622dc1640 1 -- 172.21.15.88:0/3575948221 shutdown_connections 2024-04-26T23:49:49.496 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.487+0000 7f3622dc1640 1 -- 172.21.15.88:0/3575948221 wait complete. 2024-04-26T23:49:49.496 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.488+0000 7f3622dc1640 1 Processor -- start 2024-04-26T23:49:49.496 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.488+0000 7f3622dc1640 1 -- start start 2024-04-26T23:49:49.496 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.489+0000 7f3622dc1640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f361c0c7000 0x7f361c0c2360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:49.496 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.489+0000 7f3622dc1640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f361c0c9830 0x7f361c1f01e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:49.496 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.489+0000 7f3622dc1640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f361c154220 0x7f361c1f0720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:49.496 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.489+0000 7f3622dc1640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f361c0ca9a0 con 0x7f361c0c7000 2024-04-26T23:49:49.496 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.489+0000 7f3622dc1640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f361c157640 con 0x7f361c154220 2024-04-26T23:49:49.496 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.489+0000 7f3622dc1640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f361c0cab20 con 0x7f361c0c9830 2024-04-26T23:49:49.496 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.489+0000 7f3620b5d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f361c0c7000 0x7f361c0c2360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:49.497 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.489+0000 7f3620b5d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f361c0c7000 0x7f361c0c2360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:50210/0 (socket says 172.21.15.88:50210) 2024-04-26T23:49:49.497 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.489+0000 7f3620b5d640 1 -- 172.21.15.88:0/1318978062 learned_addr learned my addr 172.21.15.88:0/1318978062 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:49:49.497 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.490+0000 7f361bfff640 1 --2- 172.21.15.88:0/1318978062 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f361c0c9830 0x7f361c1f01e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:49.497 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.490+0000 7f362135e640 1 --2- 172.21.15.88:0/1318978062 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f361c154220 0x7f361c1f0720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:49.497 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.490+0000 7f3620b5d640 1 -- 172.21.15.88:0/1318978062 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f361c0c9830 msgr2=0x7f361c1f01e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:49.497 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.490+0000 7f3620b5d640 1 --2- 172.21.15.88:0/1318978062 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f361c0c9830 0x7f361c1f01e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:49.497 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.490+0000 7f3620b5d640 1 -- 172.21.15.88:0/1318978062 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f361c154220 msgr2=0x7f361c1f0720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:49.497 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.490+0000 7f3620b5d640 1 --2- 172.21.15.88:0/1318978062 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f361c154220 0x7f361c1f0720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:49.497 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.490+0000 7f3620b5d640 1 -- 172.21.15.88:0/1318978062 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f361c1ed540 con 0x7f361c0c7000 2024-04-26T23:49:49.497 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.490+0000 7f3620b5d640 1 --2- 172.21.15.88:0/1318978062 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f361c0c7000 0x7f361c0c2360 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f361002a220 tx=0x7f36100046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:49:49.497 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.490+0000 7f36197fa640 1 -- 172.21.15.88:0/1318978062 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3610041070 con 0x7f361c0c7000 2024-04-26T23:49:49.497 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.490+0000 7f36197fa640 1 -- 172.21.15.88:0/1318978062 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f361003c870 con 0x7f361c0c7000 2024-04-26T23:49:49.497 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.490+0000 7f3622dc1640 1 -- 172.21.15.88:0/1318978062 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f361c0c3730 con 0x7f361c0c7000 2024-04-26T23:49:49.497 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.490+0000 7f36197fa640 1 -- 172.21.15.88:0/1318978062 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3610037040 con 0x7f361c0c7000 2024-04-26T23:49:49.498 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.490+0000 7f3622dc1640 1 -- 172.21.15.88:0/1318978062 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f361c1efcc0 con 0x7f361c0c7000 2024-04-26T23:49:49.498 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.491+0000 7f3622dc1640 1 -- 172.21.15.88:0/1318978062 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f361c0766c0 con 0x7f361c0c7000 2024-04-26T23:49:49.498 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.491+0000 7f36197fa640 1 -- 172.21.15.88:0/1318978062 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f3610044070 con 0x7f361c0c7000 2024-04-26T23:49:49.498 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.492+0000 7f36197fa640 1 --2- 172.21.15.88:0/1318978062 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f360006c8f0 0x7f360006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:49.498 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.492+0000 7f36197fa640 1 -- 172.21.15.88:0/1318978062 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6666+0+0 (secure 0 0 0) 0x7f36100aca90 con 0x7f361c0c7000 2024-04-26T23:49:49.498 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.492+0000 7f361bfff640 1 --2- 172.21.15.88:0/1318978062 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f360006c8f0 0x7f360006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:49.499 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.492+0000 7f361bfff640 1 --2- 172.21.15.88:0/1318978062 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f360006c8f0 0x7f360006edb0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f361c0c4170 tx=0x7f3608008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:49:49.500 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.496+0000 7f36197fa640 1 -- 172.21.15.88:0/1318978062 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f361007ab90 con 0x7f361c0c7000 2024-04-26T23:49:49.677 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.672+0000 7f3622dc1640 1 -- 172.21.15.88:0/1318978062 --> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7f361c0507a0 con 0x7f360006c8f0 2024-04-26T23:49:49.677 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.672+0000 7f36197fa640 1 -- 172.21.15.88:0/1318978062 <== mgr.4104 v2:172.21.15.88:6832/651674297 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f361c0507a0 con 0x7f360006c8f0 2024-04-26T23:49:49.677 INFO:teuthology.orchestra.run.smithi088.stderr:instructed osd(s) 3 to deep-scrub 2024-04-26T23:49:49.679 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.674+0000 7f3622dc1640 1 -- 172.21.15.88:0/1318978062 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f360006c8f0 msgr2=0x7f360006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:49.679 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.674+0000 7f3622dc1640 1 --2- 172.21.15.88:0/1318978062 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f360006c8f0 0x7f360006edb0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f361c0c4170 tx=0x7f3608008040 comp rx=0 tx=0).stop 2024-04-26T23:49:49.679 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.674+0000 7f3622dc1640 1 -- 172.21.15.88:0/1318978062 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f361c0c7000 msgr2=0x7f361c0c2360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:49.679 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.674+0000 7f3622dc1640 1 --2- 172.21.15.88:0/1318978062 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f361c0c7000 0x7f361c0c2360 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f361002a220 tx=0x7f36100046c0 comp rx=0 tx=0).stop 2024-04-26T23:49:49.679 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.674+0000 7f3622dc1640 1 -- 172.21.15.88:0/1318978062 shutdown_connections 2024-04-26T23:49:49.680 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.674+0000 7f3622dc1640 1 --2- 172.21.15.88:0/1318978062 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f360006c8f0 0x7f360006edb0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:49.680 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.674+0000 7f3622dc1640 1 --2- 172.21.15.88:0/1318978062 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f361c0c9830 0x7f361c1f01e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:49.680 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.674+0000 7f3622dc1640 1 --2- 172.21.15.88:0/1318978062 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f361c154220 0x7f361c1f0720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:49.680 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.674+0000 7f3622dc1640 1 --2- 172.21.15.88:0/1318978062 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f361c0c7000 0x7f361c0c2360 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:49.680 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.674+0000 7f3622dc1640 1 -- 172.21.15.88:0/1318978062 >> 172.21.15.88:0/1318978062 conn(0x7f361c0adf20 msgr2=0x7f361c152310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:49:49.680 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.674+0000 7f3622dc1640 1 -- 172.21.15.88:0/1318978062 shutdown_connections 2024-04-26T23:49:49.680 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.674+0000 7f3622dc1640 1 -- 172.21.15.88:0/1318978062 wait complete. 2024-04-26T23:49:49.690 INFO:tasks.ceph:Scrubbing osd.4 2024-04-26T23:49:49.690 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-04-26T23:49:49.791 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.788+0000 7fac68d80640 1 Processor -- start 2024-04-26T23:49:49.791 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.788+0000 7fac68d80640 1 -- start start 2024-04-26T23:49:49.793 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.788+0000 7fac68d80640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fac64151ef0 0x7fac640c6bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:49.793 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.788+0000 7fac68d80640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fac64074a20 0x7fac640c7110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:49.793 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.788+0000 7fac68d80640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fac641522d0 con 0x7fac64073ac0 2024-04-26T23:49:49.793 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.788+0000 7fac68d80640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7fac641557e0 con 0x7fac64151ef0 2024-04-26T23:49:49.793 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.788+0000 7fac68d80640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7fac640c7650 con 0x7fac64074a20 2024-04-26T23:49:49.793 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.788+0000 7fac6259c640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fac64151ef0 0x7fac640c6bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:49.793 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.788+0000 7fac6259c640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fac64151ef0 0x7fac640c6bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:50218/0 (socket says 172.21.15.88:50218) 2024-04-26T23:49:49.794 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.788+0000 7fac6259c640 1 -- 172.21.15.88:0/470571185 learned_addr learned my addr 172.21.15.88:0/470571185 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:49:49.794 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.788+0000 7fac5bfff640 1 --2- 172.21.15.88:0/470571185 >> v2:172.21.15.175:3300/0 conn(0x7fac64074a20 0x7fac640c7110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:49.794 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.788+0000 7fac6259c640 1 -- 172.21.15.88:0/470571185 >> v2:172.21.15.175:3300/0 conn(0x7fac64074a20 msgr2=0x7fac640c7110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:49:49.794 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.788+0000 7fac6259c640 1 --2- 172.21.15.88:0/470571185 >> v2:172.21.15.175:3300/0 conn(0x7fac64074a20 0x7fac640c7110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:49.794 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.788+0000 7fac6259c640 1 -- 172.21.15.88:0/470571185 >> v1:172.21.15.175:6789/0 conn(0x7fac64073ac0 legacy=0x7fac64070780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:49:49.794 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.788+0000 7fac6259c640 1 -- 172.21.15.88:0/470571185 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac64154bd0 con 0x7fac64151ef0 2024-04-26T23:49:49.794 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.788+0000 7fac6259c640 1 --2- 172.21.15.88:0/470571185 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fac64151ef0 0x7fac640c6bd0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fac640c5400 tx=0x7fac5402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9a7e214f33bdae1 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:49:49.794 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.789+0000 7fac61d9b640 1 -- 172.21.15.88:0/470571185 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac54037070 con 0x7fac64151ef0 2024-04-26T23:49:49.794 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.789+0000 7fac61d9b640 1 -- 172.21.15.88:0/470571185 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac54032440 con 0x7fac64151ef0 2024-04-26T23:49:49.794 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.789+0000 7fac61d9b640 1 -- 172.21.15.88:0/470571185 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac54032810 con 0x7fac64151ef0 2024-04-26T23:49:49.797 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.789+0000 7fac68d80640 1 -- 172.21.15.88:0/470571185 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fac64151ef0 msgr2=0x7fac640c6bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:49.797 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.789+0000 7fac68d80640 1 --2- 172.21.15.88:0/470571185 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fac64151ef0 0x7fac640c6bd0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fac640c5400 tx=0x7fac5402a1a0 comp rx=0 tx=0).stop 2024-04-26T23:49:49.797 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.789+0000 7fac68d80640 1 -- 172.21.15.88:0/470571185 shutdown_connections 2024-04-26T23:49:49.797 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.789+0000 7fac68d80640 1 --2- 172.21.15.88:0/470571185 >> v2:172.21.15.175:3300/0 conn(0x7fac64074a20 0x7fac640c7110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:49.797 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.789+0000 7fac68d80640 1 --2- 172.21.15.88:0/470571185 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fac64151ef0 0x7fac640c6bd0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:49.797 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.789+0000 7fac68d80640 1 -- 172.21.15.88:0/470571185 >> 172.21.15.88:0/470571185 conn(0x7fac64075d50 msgr2=0x7fac6406e520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:49:49.797 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.789+0000 7fac68d80640 1 -- 172.21.15.88:0/470571185 shutdown_connections 2024-04-26T23:49:49.797 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.789+0000 7fac68d80640 1 -- 172.21.15.88:0/470571185 wait complete. 2024-04-26T23:49:49.797 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.790+0000 7fac68d80640 1 Processor -- start 2024-04-26T23:49:49.798 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.790+0000 7fac68d80640 1 -- start start 2024-04-26T23:49:49.798 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.791+0000 7fac68d80640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fac64073ac0 0x7fac640c3a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:49.798 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.791+0000 7fac68d80640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fac64074a20 0x7fac641ecc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:49.798 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.791+0000 7fac68d80640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fac64151ef0 0x7fac641ed1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:49.798 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.791+0000 7fac68d80640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fac64155470 con 0x7fac64073ac0 2024-04-26T23:49:49.798 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.791+0000 7fac68d80640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fac64155190 con 0x7fac64151ef0 2024-04-26T23:49:49.798 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.791+0000 7fac68d80640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fac64154880 con 0x7fac64074a20 2024-04-26T23:49:49.798 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.791+0000 7fac6259c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fac64073ac0 0x7fac640c3a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:49.798 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.791+0000 7fac6259c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fac64073ac0 0x7fac640c3a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:50222/0 (socket says 172.21.15.88:50222) 2024-04-26T23:49:49.798 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.791+0000 7fac6259c640 1 -- 172.21.15.88:0/743916139 learned_addr learned my addr 172.21.15.88:0/743916139 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:49:49.798 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.791+0000 7fac6259c640 1 -- 172.21.15.88:0/743916139 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fac64074a20 msgr2=0x7fac641ecc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:49.798 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.791+0000 7fac6259c640 1 --2- 172.21.15.88:0/743916139 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fac64074a20 0x7fac641ecc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:49.798 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.791+0000 7fac6259c640 1 -- 172.21.15.88:0/743916139 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fac64151ef0 msgr2=0x7fac641ed1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:49.798 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.791+0000 7fac6259c640 1 --2- 172.21.15.88:0/743916139 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fac64151ef0 0x7fac641ed1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:49.799 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.791+0000 7fac6259c640 1 -- 172.21.15.88:0/743916139 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac640c4380 con 0x7fac64073ac0 2024-04-26T23:49:49.799 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.792+0000 7fac6259c640 1 --2- 172.21.15.88:0/743916139 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fac64073ac0 0x7fac640c3a00 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fac54000c00 tx=0x7fac540046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:49:49.799 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.792+0000 7fac5affd640 1 -- 172.21.15.88:0/743916139 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac54041020 con 0x7fac64073ac0 2024-04-26T23:49:49.799 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.792+0000 7fac5affd640 1 -- 172.21.15.88:0/743916139 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac54030970 con 0x7fac64073ac0 2024-04-26T23:49:49.799 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.792+0000 7fac68d80640 1 -- 172.21.15.88:0/743916139 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac640ad8e0 con 0x7fac64073ac0 2024-04-26T23:49:49.799 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.792+0000 7fac5affd640 1 -- 172.21.15.88:0/743916139 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac54037040 con 0x7fac64073ac0 2024-04-26T23:49:49.799 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.792+0000 7fac68d80640 1 -- 172.21.15.88:0/743916139 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac6406deb0 con 0x7fac64073ac0 2024-04-26T23:49:49.799 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.793+0000 7fac68d80640 1 -- 172.21.15.88:0/743916139 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fac641f0c00 con 0x7fac64073ac0 2024-04-26T23:49:49.800 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.793+0000 7fac5affd640 1 -- 172.21.15.88:0/743916139 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fac54044020 con 0x7fac64073ac0 2024-04-26T23:49:49.800 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.794+0000 7fac5affd640 1 --2- 172.21.15.88:0/743916139 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fac4406c8f0 0x7fac4406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:49.800 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.794+0000 7fac5affd640 1 -- 172.21.15.88:0/743916139 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6666+0+0 (secure 0 0 0) 0x7fac540ace50 con 0x7fac64073ac0 2024-04-26T23:49:49.800 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.794+0000 7fac5bfff640 1 --2- 172.21.15.88:0/743916139 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fac4406c8f0 0x7fac4406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:49.800 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.794+0000 7fac5affd640 1 --2- 172.21.15.88:0/743916139 >> [v2:172.21.15.175:6808/3929617402,v1:172.21.15.175:6809/3929617402] conn(0x7fac440772e0 0x7fac44079780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:49.801 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.794+0000 7fac5affd640 1 -- 172.21.15.88:0/743916139 --> [v2:172.21.15.175:6808/3929617402,v1:172.21.15.175:6809/3929617402] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fac54032440 con 0x7fac440772e0 2024-04-26T23:49:49.801 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.794+0000 7fac5affd640 1 -- 172.21.15.88:0/743916139 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fac540ad2e0 con 0x7fac64073ac0 2024-04-26T23:49:49.801 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.794+0000 7fac5bfff640 1 --2- 172.21.15.88:0/743916139 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fac4406c8f0 0x7fac4406edb0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fac4c006fd0 tx=0x7fac4c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:49:49.801 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.794+0000 7fac62d9d640 1 --2- 172.21.15.88:0/743916139 >> [v2:172.21.15.175:6808/3929617402,v1:172.21.15.175:6809/3929617402] conn(0x7fac440772e0 0x7fac44079780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:49.801 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.795+0000 7fac62d9d640 1 --2- 172.21.15.88:0/743916139 >> [v2:172.21.15.175:6808/3929617402,v1:172.21.15.175:6809/3929617402] conn(0x7fac440772e0 0x7fac44079780 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:49:49.801 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.795+0000 7fac5affd640 1 -- 172.21.15.88:0/743916139 <== osd.4 v2:172.21.15.175:6808/3929617402 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fac54032440 con 0x7fac440772e0 2024-04-26T23:49:49.813 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.809+0000 7fac68d80640 1 -- 172.21.15.88:0/743916139 --> [v2:172.21.15.175:6808/3929617402,v1:172.21.15.175:6809/3929617402] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fac641ec7a0 con 0x7fac440772e0 2024-04-26T23:49:49.813 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.809+0000 7fac5affd640 1 -- 172.21.15.88:0/743916139 <== osd.4 v2:172.21.15.175:6808/3929617402 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fac5c006b50 con 0x7fac440772e0 2024-04-26T23:49:49.814 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-04-26T23:49:49.814 INFO:teuthology.orchestra.run.smithi088.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-26T23:49:49.814 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-04-26T23:49:49.815 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.809+0000 7fac68d80640 1 -- 172.21.15.88:0/743916139 >> [v2:172.21.15.175:6808/3929617402,v1:172.21.15.175:6809/3929617402] conn(0x7fac440772e0 msgr2=0x7fac44079780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:49.815 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.809+0000 7fac68d80640 1 --2- 172.21.15.88:0/743916139 >> [v2:172.21.15.175:6808/3929617402,v1:172.21.15.175:6809/3929617402] conn(0x7fac440772e0 0x7fac44079780 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:49.815 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.809+0000 7fac68d80640 1 -- 172.21.15.88:0/743916139 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fac4406c8f0 msgr2=0x7fac4406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:49.815 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.809+0000 7fac68d80640 1 --2- 172.21.15.88:0/743916139 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fac4406c8f0 0x7fac4406edb0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fac4c006fd0 tx=0x7fac4c008040 comp rx=0 tx=0).stop 2024-04-26T23:49:49.815 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.809+0000 7fac68d80640 1 -- 172.21.15.88:0/743916139 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fac64073ac0 msgr2=0x7fac640c3a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:49.815 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.809+0000 7fac68d80640 1 --2- 172.21.15.88:0/743916139 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fac64073ac0 0x7fac640c3a00 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fac54000c00 tx=0x7fac540046c0 comp rx=0 tx=0).stop 2024-04-26T23:49:49.815 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.810+0000 7fac62d9d640 1 -- 172.21.15.88:0/743916139 reap_dead start 2024-04-26T23:49:49.815 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.810+0000 7fac68d80640 1 -- 172.21.15.88:0/743916139 shutdown_connections 2024-04-26T23:49:49.815 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.810+0000 7fac68d80640 1 -- 172.21.15.88:0/743916139 >> 172.21.15.88:0/743916139 conn(0x7fac64075d50 msgr2=0x7fac640ab5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:49:49.816 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.810+0000 7fac68d80640 1 -- 172.21.15.88:0/743916139 shutdown_connections 2024-04-26T23:49:49.816 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.810+0000 7fac68d80640 1 -- 172.21.15.88:0/743916139 wait complete. 2024-04-26T23:49:49.825 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-04-26T23:49:49.921 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.917+0000 7f8b5814e640 1 Processor -- start 2024-04-26T23:49:49.922 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.917+0000 7f8b5814e640 1 -- start start 2024-04-26T23:49:49.923 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.918+0000 7f8b5814e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8b501570d0 0x7f8b50150a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:49.923 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.918+0000 7f8b5814e640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f8b500ab3f0 0x7f8b50150f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:49.923 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.918+0000 7f8b5814e640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8b500c3810 con 0x7f8b500c4d80 2024-04-26T23:49:49.923 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.918+0000 7f8b5814e640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f8b500c4330 con 0x7f8b500ab3f0 2024-04-26T23:49:49.923 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.918+0000 7f8b5814e640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f8b500c3ab0 con 0x7f8b501570d0 2024-04-26T23:49:49.923 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.918+0000 7f8b556e9640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f8b500ab3f0 0x7f8b50150f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:49.923 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.918+0000 7f8b556e9640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f8b500ab3f0 0x7f8b50150f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:50232/0 (socket says 172.21.15.88:50232) 2024-04-26T23:49:49.923 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.918+0000 7f8b556e9640 1 -- 172.21.15.88:0/1821683416 learned_addr learned my addr 172.21.15.88:0/1821683416 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:49:49.923 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.918+0000 7f8b566eb640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f8b500c4d80 0x7f8b501574b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:43860/0 (socket says 172.21.15.88:43860) 2024-04-26T23:49:49.923 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.918+0000 7f8b556e9640 1 -- 172.21.15.88:0/1821683416 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8b501570d0 msgr2=0x7f8b50150a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:49:49.923 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.918+0000 7f8b556e9640 1 --2- 172.21.15.88:0/1821683416 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8b501570d0 0x7f8b50150a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:49.923 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.918+0000 7f8b556e9640 1 -- 172.21.15.88:0/1821683416 >> v1:172.21.15.88:6789/0 conn(0x7f8b500c4d80 legacy=0x7f8b501574b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:49.923 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.918+0000 7f8b556e9640 1 -- 172.21.15.88:0/1821683416 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b500c4580 con 0x7f8b500ab3f0 2024-04-26T23:49:49.925 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.919+0000 7f8b556e9640 1 --2- 172.21.15.88:0/1821683416 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8b500ab3f0 0x7f8b50150f90 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f8b40009870 tx=0x7f8b4002a130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a9398ae15cd85fc server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:49:49.925 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.919+0000 7f8b54ee8640 1 -- 172.21.15.88:0/1821683416 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b40037070 con 0x7f8b500ab3f0 2024-04-26T23:49:49.925 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.919+0000 7f8b54ee8640 1 -- 172.21.15.88:0/1821683416 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b40032440 con 0x7f8b500ab3f0 2024-04-26T23:49:49.925 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.919+0000 7f8b54ee8640 1 -- 172.21.15.88:0/1821683416 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b40032810 con 0x7f8b500ab3f0 2024-04-26T23:49:49.925 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.919+0000 7f8b5814e640 1 -- 172.21.15.88:0/1821683416 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8b500ab3f0 msgr2=0x7f8b50150f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:49.925 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.919+0000 7f8b5814e640 1 --2- 172.21.15.88:0/1821683416 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8b500ab3f0 0x7f8b50150f90 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f8b40009870 tx=0x7f8b4002a130 comp rx=0 tx=0).stop 2024-04-26T23:49:49.925 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.920+0000 7f8b5814e640 1 -- 172.21.15.88:0/1821683416 shutdown_connections 2024-04-26T23:49:49.925 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.920+0000 7f8b5814e640 1 --2- 172.21.15.88:0/1821683416 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8b500ab3f0 0x7f8b50150f90 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:49.925 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.920+0000 7f8b5814e640 1 --2- 172.21.15.88:0/1821683416 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8b501570d0 0x7f8b50150a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:49.926 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.920+0000 7f8b5814e640 1 -- 172.21.15.88:0/1821683416 >> 172.21.15.88:0/1821683416 conn(0x7f8b5006c310 msgr2=0x7f8b5006c6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:49:49.926 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.920+0000 7f8b5814e640 1 -- 172.21.15.88:0/1821683416 shutdown_connections 2024-04-26T23:49:49.926 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.920+0000 7f8b5814e640 1 -- 172.21.15.88:0/1821683416 wait complete. 2024-04-26T23:49:49.926 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.921+0000 7f8b5814e640 1 Processor -- start 2024-04-26T23:49:49.926 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.921+0000 7f8b5814e640 1 -- start start 2024-04-26T23:49:49.929 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.921+0000 7f8b5814e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8b500ab3f0 0x7f8b501474e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:49.929 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.921+0000 7f8b5814e640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8b500c4d80 0x7f8b50147a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:49.929 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.921+0000 7f8b5814e640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8b501570d0 0x7f8b501ebd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:49.929 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.921+0000 7f8b5814e640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f8b500abbe0 con 0x7f8b501570d0 2024-04-26T23:49:49.929 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.921+0000 7f8b5814e640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f8b500aba60 con 0x7f8b500c4d80 2024-04-26T23:49:49.929 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.921+0000 7f8b5814e640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f8b50157bc0 con 0x7f8b500ab3f0 2024-04-26T23:49:49.929 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.921+0000 7f8b566eb640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8b501570d0 0x7f8b501ebd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:49.929 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.921+0000 7f8b566eb640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8b501570d0 0x7f8b501ebd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:50244/0 (socket says 172.21.15.88:50244) 2024-04-26T23:49:49.929 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.921+0000 7f8b566eb640 1 -- 172.21.15.88:0/1686375963 learned_addr learned my addr 172.21.15.88:0/1686375963 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:49:49.930 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.922+0000 7f8b55eea640 1 --2- 172.21.15.88:0/1686375963 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8b500ab3f0 0x7f8b501474e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:49.930 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.922+0000 7f8b566eb640 1 -- 172.21.15.88:0/1686375963 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8b500ab3f0 msgr2=0x7f8b501474e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:49.930 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.922+0000 7f8b556e9640 1 --2- 172.21.15.88:0/1686375963 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8b500c4d80 0x7f8b50147a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:49.930 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.922+0000 7f8b566eb640 1 --2- 172.21.15.88:0/1686375963 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8b500ab3f0 0x7f8b501474e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:49.930 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.922+0000 7f8b566eb640 1 -- 172.21.15.88:0/1686375963 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8b500c4d80 msgr2=0x7f8b50147a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:49.930 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.922+0000 7f8b566eb640 1 --2- 172.21.15.88:0/1686375963 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8b500c4d80 0x7f8b50147a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:49.930 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.922+0000 7f8b566eb640 1 -- 172.21.15.88:0/1686375963 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b50154c60 con 0x7f8b501570d0 2024-04-26T23:49:49.930 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.922+0000 7f8b55eea640 1 --2- 172.21.15.88:0/1686375963 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8b500ab3f0 0x7f8b501474e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:49:49.930 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.922+0000 7f8b566eb640 1 --2- 172.21.15.88:0/1686375963 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8b501570d0 0x7f8b501ebd60 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f8b4800eba0 tx=0x7f8b4800c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:49:49.930 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.922+0000 7f8b467fc640 1 -- 172.21.15.88:0/1686375963 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b48019070 con 0x7f8b501570d0 2024-04-26T23:49:49.930 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.922+0000 7f8b467fc640 1 -- 172.21.15.88:0/1686375963 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b4800cd60 con 0x7f8b501570d0 2024-04-26T23:49:49.930 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.922+0000 7f8b5814e640 1 -- 172.21.15.88:0/1686375963 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b500738e0 con 0x7f8b501570d0 2024-04-26T23:49:49.930 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.922+0000 7f8b467fc640 1 -- 172.21.15.88:0/1686375963 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b48014640 con 0x7f8b501570d0 2024-04-26T23:49:49.930 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.922+0000 7f8b5814e640 1 -- 172.21.15.88:0/1686375963 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b50073ea0 con 0x7f8b501570d0 2024-04-26T23:49:49.931 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.923+0000 7f8b5814e640 1 -- 172.21.15.88:0/1686375963 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b501576c0 con 0x7f8b501570d0 2024-04-26T23:49:49.931 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.923+0000 7f8b467fc640 1 -- 172.21.15.88:0/1686375963 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8b4801c070 con 0x7f8b501570d0 2024-04-26T23:49:49.931 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.924+0000 7f8b467fc640 1 --2- 172.21.15.88:0/1686375963 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f8b3406c8f0 0x7f8b3406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:49.931 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.924+0000 7f8b467fc640 1 -- 172.21.15.88:0/1686375963 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6666+0+0 (secure 0 0 0) 0x7f8b4808db10 con 0x7f8b501570d0 2024-04-26T23:49:49.931 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.924+0000 7f8b55eea640 1 --2- 172.21.15.88:0/1686375963 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f8b3406c8f0 0x7f8b3406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:49.931 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.924+0000 7f8b55eea640 1 --2- 172.21.15.88:0/1686375963 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f8b3406c8f0 0x7f8b3406edb0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f8b500c7950 tx=0x7f8b4c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:49:49.932 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:49.928+0000 7f8b467fc640 1 -- 172.21.15.88:0/1686375963 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f8b4805bc10 con 0x7f8b501570d0 2024-04-26T23:49:50.110 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.105+0000 7f8b5814e640 1 -- 172.21.15.88:0/1686375963 --> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) -- 0x7f8b501eca00 con 0x7f8b3406c8f0 2024-04-26T23:49:50.110 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.105+0000 7f8b467fc640 1 -- 172.21.15.88:0/1686375963 <== mgr.4104 v2:172.21.15.88:6832/651674297 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f8b501eca00 con 0x7f8b3406c8f0 2024-04-26T23:49:50.110 INFO:teuthology.orchestra.run.smithi088.stderr:instructed osd(s) 4 to deep-scrub 2024-04-26T23:49:50.112 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.107+0000 7f8b5814e640 1 -- 172.21.15.88:0/1686375963 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f8b3406c8f0 msgr2=0x7f8b3406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:50.112 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.107+0000 7f8b5814e640 1 --2- 172.21.15.88:0/1686375963 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f8b3406c8f0 0x7f8b3406edb0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f8b500c7950 tx=0x7f8b4c008040 comp rx=0 tx=0).stop 2024-04-26T23:49:50.112 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.107+0000 7f8b5814e640 1 -- 172.21.15.88:0/1686375963 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8b501570d0 msgr2=0x7f8b501ebd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:50.112 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.107+0000 7f8b5814e640 1 --2- 172.21.15.88:0/1686375963 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8b501570d0 0x7f8b501ebd60 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f8b4800eba0 tx=0x7f8b4800c430 comp rx=0 tx=0).stop 2024-04-26T23:49:50.112 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.107+0000 7f8b5814e640 1 -- 172.21.15.88:0/1686375963 shutdown_connections 2024-04-26T23:49:50.112 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.107+0000 7f8b5814e640 1 --2- 172.21.15.88:0/1686375963 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f8b3406c8f0 0x7f8b3406edb0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:50.112 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.107+0000 7f8b5814e640 1 --2- 172.21.15.88:0/1686375963 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8b501570d0 0x7f8b501ebd60 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:50.112 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.107+0000 7f8b5814e640 1 --2- 172.21.15.88:0/1686375963 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8b500c4d80 0x7f8b50147a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:50.112 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.107+0000 7f8b5814e640 1 --2- 172.21.15.88:0/1686375963 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8b500ab3f0 0x7f8b501474e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:50.112 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.107+0000 7f8b5814e640 1 -- 172.21.15.88:0/1686375963 >> 172.21.15.88:0/1686375963 conn(0x7f8b5006c310 msgr2=0x7f8b5014d800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:49:50.112 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.107+0000 7f8b5814e640 1 -- 172.21.15.88:0/1686375963 shutdown_connections 2024-04-26T23:49:50.112 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.107+0000 7f8b5814e640 1 -- 172.21.15.88:0/1686375963 wait complete. 2024-04-26T23:49:50.123 INFO:tasks.ceph:Scrubbing osd.5 2024-04-26T23:49:50.123 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-04-26T23:49:50.224 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.220+0000 7f9433ec8640 1 Processor -- start 2024-04-26T23:49:50.224 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.220+0000 7f9433ec8640 1 -- start start 2024-04-26T23:49:50.228 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.220+0000 7f9433ec8640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f942c06d320 0x7f942c1549d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:50.228 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.220+0000 7f9433ec8640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f942c071020 con 0x7f942c0c3ce0 2024-04-26T23:49:50.228 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.220+0000 7f9433ec8640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f942c158ae0 con 0x7f942c06f720 2024-04-26T23:49:50.228 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.220+0000 7f9433ec8640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f942c158d80 con 0x7f942c06d320 2024-04-26T23:49:50.228 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.221+0000 7f9432465640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f942c0c3ce0 0x7f942c15f330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:43870/0 (socket says 172.21.15.88:43870) 2024-04-26T23:49:50.228 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.221+0000 7f9432465640 1 -- 172.21.15.88:0/2845786192 learned_addr learned my addr 172.21.15.88:0/2845786192 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-26T23:49:50.228 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.221+0000 7f9430c62640 1 -- 172.21.15.88:0/2845786192 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2015707662 0 0) 0x7f942c071020 con 0x7f942c0c3ce0 2024-04-26T23:49:50.228 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.221+0000 7f9430c62640 1 -- 172.21.15.88:0/2845786192 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9418003520 con 0x7f942c0c3ce0 2024-04-26T23:49:50.228 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.221+0000 7f9431c64640 1 --2- 172.21.15.88:0/2845786192 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f942c06d320 0x7f942c1549d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:50.228 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.221+0000 7f9430c62640 1 -- 172.21.15.88:0/2845786192 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 371474948 0 0) 0x7f9418003520 con 0x7f942c0c3ce0 2024-04-26T23:49:50.229 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.221+0000 7f9430c62640 1 -- 172.21.15.88:0/2845786192 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f942c06d320 msgr2=0x7f942c1549d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:49:50.229 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.221+0000 7f9430c62640 1 --2- 172.21.15.88:0/2845786192 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f942c06d320 0x7f942c1549d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:50.229 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.221+0000 7f9430c62640 1 -- 172.21.15.88:0/2845786192 >> v1:172.21.15.175:6789/0 conn(0x7f942c06f720 legacy=0x7f942c0c4250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:50.229 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.221+0000 7f9430c62640 1 -- 172.21.15.88:0/2845786192 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f942c06fd60 con 0x7f942c0c3ce0 2024-04-26T23:49:50.229 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.221+0000 7f9430c62640 1 -- 172.21.15.88:0/2845786192 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 356324787 0 0) 0x7f94240019f0 con 0x7f942c0c3ce0 2024-04-26T23:49:50.229 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.221+0000 7f9430c62640 1 -- 172.21.15.88:0/2845786192 >> v1:172.21.15.88:6789/0 conn(0x7f942c0c3ce0 legacy=0x7f942c15f330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:50.229 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.221+0000 7f9430c62640 1 --2- 172.21.15.88:0/2845786192 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f94180039e0 0x7f9418003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:50.229 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.221+0000 7f9430c62640 1 --2- 172.21.15.88:0/2845786192 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9418004800 0x7f9418004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:50.229 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.221+0000 7f9430c62640 1 --2- 172.21.15.88:0/2845786192 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f942c06d320 0x7f9418005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:50.229 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.221+0000 7f9430c62640 1 -- 172.21.15.88:0/2845786192 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f942c158d80 con 0x7f9418004800 2024-04-26T23:49:50.229 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.221+0000 7f9430c62640 1 -- 172.21.15.88:0/2845786192 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f941800baf0 con 0x7f94180039e0 2024-04-26T23:49:50.230 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.221+0000 7f9430c62640 1 -- 172.21.15.88:0/2845786192 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f941800bcf0 con 0x7f942c06d320 2024-04-26T23:49:50.230 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.221+0000 7f9431463640 1 --2- 172.21.15.88:0/2845786192 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9418004800 0x7f9418004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:50.230 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.221+0000 7f9431c64640 1 --2- 172.21.15.88:0/2845786192 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f94180039e0 0x7f9418003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:50.230 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.221+0000 7f9432465640 1 --2- 172.21.15.88:0/2845786192 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f942c06d320 0x7f9418005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:50.230 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.222+0000 7f9431463640 1 -- 172.21.15.88:0/2845786192 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f942c06d320 msgr2=0x7f9418005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:49:50.230 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.222+0000 7f9431463640 1 --2- 172.21.15.88:0/2845786192 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f942c06d320 0x7f9418005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:50.230 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.222+0000 7f9431463640 1 -- 172.21.15.88:0/2845786192 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f94180039e0 msgr2=0x7f9418003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:49:50.230 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.222+0000 7f9431463640 1 --2- 172.21.15.88:0/2845786192 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f94180039e0 0x7f9418003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:50.230 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.222+0000 7f9431463640 1 -- 172.21.15.88:0/2845786192 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9418003520 con 0x7f9418004800 2024-04-26T23:49:50.230 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.222+0000 7f9432465640 1 --2- 172.21.15.88:0/2845786192 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f942c06d320 0x7f9418005200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:49:50.230 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.222+0000 7f9431463640 1 --2- 172.21.15.88:0/2845786192 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9418004800 0x7f9418004c80 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f941c001720 tx=0x7f9418005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8ddb75c04ee731f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:49:50.230 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.222+0000 7f9430c62640 1 -- 172.21.15.88:0/2845786192 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f941c001370 con 0x7f9418004800 2024-04-26T23:49:50.230 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.222+0000 7f9430c62640 1 -- 172.21.15.88:0/2845786192 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f941c0052d0 con 0x7f9418004800 2024-04-26T23:49:50.231 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.222+0000 7f9430c62640 1 -- 172.21.15.88:0/2845786192 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f941c02abc0 con 0x7f9418004800 2024-04-26T23:49:50.231 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.223+0000 7f9433ec8640 1 -- 172.21.15.88:0/2845786192 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9418004800 msgr2=0x7f9418004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:50.231 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.223+0000 7f9433ec8640 1 --2- 172.21.15.88:0/2845786192 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9418004800 0x7f9418004c80 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f941c001720 tx=0x7f9418005830 comp rx=0 tx=0).stop 2024-04-26T23:49:50.231 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.223+0000 7f9432465640 1 -- 172.21.15.88:0/2845786192 reap_dead start 2024-04-26T23:49:50.231 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.223+0000 7f9433ec8640 1 -- 172.21.15.88:0/2845786192 shutdown_connections 2024-04-26T23:49:50.231 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.223+0000 7f9433ec8640 1 -- 172.21.15.88:0/2845786192 >> 172.21.15.88:0/2845786192 conn(0x7f942c0c5ce0 msgr2=0x7f942c0c60c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:49:50.231 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.223+0000 7f9433ec8640 1 -- 172.21.15.88:0/2845786192 shutdown_connections 2024-04-26T23:49:50.231 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.223+0000 7f9433ec8640 1 -- 172.21.15.88:0/2845786192 wait complete. 2024-04-26T23:49:50.234 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.224+0000 7f9433ec8640 1 Processor -- start 2024-04-26T23:49:50.234 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.224+0000 7f9433ec8640 1 -- start start 2024-04-26T23:49:50.234 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.225+0000 7f9433ec8640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9418004800 0x7f942c0738f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:50.234 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.225+0000 7f9433ec8640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f942c0c7300 0x7f942c06c580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:50.235 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.225+0000 7f9433ec8640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f942c1eff90 0x7f942c147b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:50.235 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.225+0000 7f9433ec8640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f942c070c60 con 0x7f9418004800 2024-04-26T23:49:50.235 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.225+0000 7f9433ec8640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f942c152360 con 0x7f942c1eff90 2024-04-26T23:49:50.235 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.225+0000 7f9433ec8640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f942c070de0 con 0x7f942c0c7300 2024-04-26T23:49:50.235 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.225+0000 7f9431c64640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9418004800 0x7f942c0738f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:50.235 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.225+0000 7f9431c64640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9418004800 0x7f942c0738f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:50256/0 (socket says 172.21.15.88:50256) 2024-04-26T23:49:50.235 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.225+0000 7f9431c64640 1 -- 172.21.15.88:0/365623820 learned_addr learned my addr 172.21.15.88:0/365623820 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:49:50.235 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.225+0000 7f9431c64640 1 -- 172.21.15.88:0/365623820 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f942c0c7300 msgr2=0x7f942c06c580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:50.235 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.225+0000 7f9431c64640 1 --2- 172.21.15.88:0/365623820 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f942c0c7300 0x7f942c06c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:50.235 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.225+0000 7f9431c64640 1 -- 172.21.15.88:0/365623820 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f942c1eff90 msgr2=0x7f942c147b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:50.235 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.225+0000 7f9431c64640 1 --2- 172.21.15.88:0/365623820 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f942c1eff90 0x7f942c147b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:50.235 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.225+0000 7f9431c64640 1 -- 172.21.15.88:0/365623820 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f942c074140 con 0x7f9418004800 2024-04-26T23:49:50.235 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.225+0000 7f9431c64640 1 --2- 172.21.15.88:0/365623820 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9418004800 0x7f942c0738f0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f94280119d0 tx=0x7f9428011e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:49:50.235 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.225+0000 7f94227fc640 1 -- 172.21.15.88:0/365623820 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f942800fad0 con 0x7f9418004800 2024-04-26T23:49:50.236 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.225+0000 7f94227fc640 1 -- 172.21.15.88:0/365623820 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f942800fc70 con 0x7f9418004800 2024-04-26T23:49:50.236 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.225+0000 7f94227fc640 1 -- 172.21.15.88:0/365623820 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9428014440 con 0x7f9418004800 2024-04-26T23:49:50.236 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.225+0000 7f9433ec8640 1 -- 172.21.15.88:0/365623820 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f942c074420 con 0x7f9418004800 2024-04-26T23:49:50.236 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.226+0000 7f9433ec8640 1 -- 172.21.15.88:0/365623820 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f942c06cac0 con 0x7f9418004800 2024-04-26T23:49:50.236 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.226+0000 7f9433ec8640 1 -- 172.21.15.88:0/365623820 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f942c069bc0 con 0x7f9418004800 2024-04-26T23:49:50.236 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.227+0000 7f94227fc640 1 -- 172.21.15.88:0/365623820 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f9428012040 con 0x7f9418004800 2024-04-26T23:49:50.236 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.227+0000 7f94227fc640 1 --2- 172.21.15.88:0/365623820 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f941006c8f0 0x7f941006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:50.236 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.227+0000 7f94227fc640 1 -- 172.21.15.88:0/365623820 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6666+0+0 (secure 0 0 0) 0x7f942808c530 con 0x7f9418004800 2024-04-26T23:49:50.236 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.227+0000 7f9431463640 1 --2- 172.21.15.88:0/365623820 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f941006c8f0 0x7f941006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:50.236 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.227+0000 7f94227fc640 1 --2- 172.21.15.88:0/365623820 >> [v2:172.21.15.175:6800/2476644457,v1:172.21.15.175:6801/2476644457] conn(0x7f94100772e0 0x7f9410079780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:50.236 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.227+0000 7f94227fc640 1 -- 172.21.15.88:0/365623820 --> [v2:172.21.15.175:6800/2476644457,v1:172.21.15.175:6801/2476644457] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9410079e50 con 0x7f94100772e0 2024-04-26T23:49:50.236 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.227+0000 7f94227fc640 1 -- 172.21.15.88:0/365623820 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f9428093050 con 0x7f9418004800 2024-04-26T23:49:50.236 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.228+0000 7f9431463640 1 --2- 172.21.15.88:0/365623820 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f941006c8f0 0x7f941006edb0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f941c032000 tx=0x7f941c02c000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:49:50.236 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.228+0000 7f9432465640 1 --2- 172.21.15.88:0/365623820 >> [v2:172.21.15.175:6800/2476644457,v1:172.21.15.175:6801/2476644457] conn(0x7f94100772e0 0x7f9410079780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:50.236 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.228+0000 7f9432465640 1 --2- 172.21.15.88:0/365623820 >> [v2:172.21.15.175:6800/2476644457,v1:172.21.15.175:6801/2476644457] conn(0x7f94100772e0 0x7f9410079780 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:49:50.237 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.229+0000 7f94227fc640 1 -- 172.21.15.88:0/365623820 <== osd.5 v2:172.21.15.175:6800/2476644457 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f9410079e50 con 0x7f94100772e0 2024-04-26T23:49:50.246 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.242+0000 7f9433ec8640 1 -- 172.21.15.88:0/365623820 --> [v2:172.21.15.175:6800/2476644457,v1:172.21.15.175:6801/2476644457] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f942c14a2c0 con 0x7f94100772e0 2024-04-26T23:49:50.246 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.242+0000 7f94227fc640 1 -- 172.21.15.88:0/365623820 <== osd.5 v2:172.21.15.175:6800/2476644457 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f942c14a2c0 con 0x7f94100772e0 2024-04-26T23:49:50.247 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-04-26T23:49:50.247 INFO:teuthology.orchestra.run.smithi088.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-26T23:49:50.247 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-04-26T23:49:50.248 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.242+0000 7f9433ec8640 1 -- 172.21.15.88:0/365623820 >> [v2:172.21.15.175:6800/2476644457,v1:172.21.15.175:6801/2476644457] conn(0x7f94100772e0 msgr2=0x7f9410079780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:50.248 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.242+0000 7f9433ec8640 1 --2- 172.21.15.88:0/365623820 >> [v2:172.21.15.175:6800/2476644457,v1:172.21.15.175:6801/2476644457] conn(0x7f94100772e0 0x7f9410079780 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:50.248 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.243+0000 7f9433ec8640 1 -- 172.21.15.88:0/365623820 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f941006c8f0 msgr2=0x7f941006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:50.248 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.243+0000 7f9433ec8640 1 --2- 172.21.15.88:0/365623820 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f941006c8f0 0x7f941006edb0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f941c032000 tx=0x7f941c02c000 comp rx=0 tx=0).stop 2024-04-26T23:49:50.248 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.243+0000 7f9433ec8640 1 -- 172.21.15.88:0/365623820 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9418004800 msgr2=0x7f942c0738f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:50.248 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.243+0000 7f9433ec8640 1 --2- 172.21.15.88:0/365623820 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9418004800 0x7f942c0738f0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f94280119d0 tx=0x7f9428011e90 comp rx=0 tx=0).stop 2024-04-26T23:49:50.248 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.243+0000 7f9432465640 1 -- 172.21.15.88:0/365623820 reap_dead start 2024-04-26T23:49:50.248 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.243+0000 7f9433ec8640 1 -- 172.21.15.88:0/365623820 shutdown_connections 2024-04-26T23:49:50.248 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.243+0000 7f9433ec8640 1 -- 172.21.15.88:0/365623820 >> 172.21.15.88:0/365623820 conn(0x7f942c0c5ce0 msgr2=0x7f942c1505c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:49:50.248 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.243+0000 7f9433ec8640 1 -- 172.21.15.88:0/365623820 shutdown_connections 2024-04-26T23:49:50.248 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.243+0000 7f9433ec8640 1 -- 172.21.15.88:0/365623820 wait complete. 2024-04-26T23:49:50.258 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-04-26T23:49:50.355 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.351+0000 7faabb3da640 1 Processor -- start 2024-04-26T23:49:50.356 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.351+0000 7faabb3da640 1 -- start start 2024-04-26T23:49:50.357 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.352+0000 7faabb3da640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7faab41570d0 0x7faab4150a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:50.358 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.352+0000 7faabb3da640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7faab40ab3f0 0x7faab4150f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:50.358 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.352+0000 7faabb3da640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faab40c4d80 0x7faab40c5180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:50.358 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.352+0000 7faabb3da640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7faab40c56c0 con 0x7faab41570d0 2024-04-26T23:49:50.358 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.352+0000 7faabb3da640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7faab40c4330 con 0x7faab40ab3f0 2024-04-26T23:49:50.358 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.352+0000 7faabb3da640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7faab40c3810 con 0x7faab40c4d80 2024-04-26T23:49:50.358 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.352+0000 7faab9176640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7faab41570d0 0x7faab4150a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:50.358 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.352+0000 7faab9176640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7faab41570d0 0x7faab4150a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:50270/0 (socket says 172.21.15.88:50270) 2024-04-26T23:49:50.358 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.352+0000 7faab9176640 1 -- 172.21.15.88:0/2377418680 learned_addr learned my addr 172.21.15.88:0/2377418680 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:49:50.358 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.352+0000 7faab9176640 1 -- 172.21.15.88:0/2377418680 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faab40c4d80 msgr2=0x7faab40c5180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:49:50.358 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.352+0000 7faab9977640 1 --2- 172.21.15.88:0/2377418680 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faab40c4d80 0x7faab40c5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:50.358 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.352+0000 7faab8975640 1 --2- 172.21.15.88:0/2377418680 >> v2:172.21.15.175:3300/0 conn(0x7faab40ab3f0 0x7faab4150f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:50.358 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.352+0000 7faab9176640 1 --2- 172.21.15.88:0/2377418680 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faab40c4d80 0x7faab40c5180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:50.358 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.352+0000 7faab9176640 1 -- 172.21.15.88:0/2377418680 >> v2:172.21.15.175:3300/0 conn(0x7faab40ab3f0 msgr2=0x7faab4150f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:49:50.358 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.352+0000 7faab9176640 1 --2- 172.21.15.88:0/2377418680 >> v2:172.21.15.175:3300/0 conn(0x7faab40ab3f0 0x7faab4150f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:50.359 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.352+0000 7faab9176640 1 -- 172.21.15.88:0/2377418680 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faab40c3ab0 con 0x7faab41570d0 2024-04-26T23:49:50.359 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.352+0000 7faab9977640 1 --2- 172.21.15.88:0/2377418680 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faab40c4d80 0x7faab40c5180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:49:50.359 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.352+0000 7faab8975640 1 --2- 172.21.15.88:0/2377418680 >> v2:172.21.15.175:3300/0 conn(0x7faab40ab3f0 0x7faab4150f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:49:50.359 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.353+0000 7faab9176640 1 --2- 172.21.15.88:0/2377418680 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faab41570d0 0x7faab4150a50 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7faab40c40c0 tx=0x7faab002a0b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a6684fd37b096ec server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:49:50.359 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.353+0000 7faaabfff640 1 -- 172.21.15.88:0/2377418680 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faab0037070 con 0x7faab41570d0 2024-04-26T23:49:50.359 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.353+0000 7faaabfff640 1 -- 172.21.15.88:0/2377418680 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faab002ae00 con 0x7faab41570d0 2024-04-26T23:49:50.359 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.353+0000 7faaabfff640 1 -- 172.21.15.88:0/2377418680 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faab0032660 con 0x7faab41570d0 2024-04-26T23:49:50.362 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.354+0000 7faabb3da640 1 -- 172.21.15.88:0/2377418680 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faab41570d0 msgr2=0x7faab4150a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:50.362 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.354+0000 7faabb3da640 1 --2- 172.21.15.88:0/2377418680 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faab41570d0 0x7faab4150a50 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7faab40c40c0 tx=0x7faab002a0b0 comp rx=0 tx=0).stop 2024-04-26T23:49:50.362 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.354+0000 7faabb3da640 1 -- 172.21.15.88:0/2377418680 shutdown_connections 2024-04-26T23:49:50.362 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.354+0000 7faabb3da640 1 --2- 172.21.15.88:0/2377418680 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faab40c4d80 0x7faab40c5180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:50.362 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.354+0000 7faabb3da640 1 --2- 172.21.15.88:0/2377418680 >> v2:172.21.15.175:3300/0 conn(0x7faab40ab3f0 0x7faab4150f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:50.362 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.354+0000 7faabb3da640 1 --2- 172.21.15.88:0/2377418680 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faab41570d0 0x7faab4150a50 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:50.362 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.354+0000 7faabb3da640 1 -- 172.21.15.88:0/2377418680 >> 172.21.15.88:0/2377418680 conn(0x7faab406c310 msgr2=0x7faab406c6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:49:50.362 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.354+0000 7faabb3da640 1 -- 172.21.15.88:0/2377418680 shutdown_connections 2024-04-26T23:49:50.362 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.354+0000 7faabb3da640 1 -- 172.21.15.88:0/2377418680 wait complete. 2024-04-26T23:49:50.362 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.355+0000 7faabb3da640 1 Processor -- start 2024-04-26T23:49:50.363 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.355+0000 7faabb3da640 1 -- start start 2024-04-26T23:49:50.363 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.355+0000 7faabb3da640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faab40ab3f0 0x7faab40c1980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:50.363 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.355+0000 7faabb3da640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faab40c4d80 0x7faab4155f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:50.363 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.355+0000 7faabb3da640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faab41570d0 0x7faab41ec6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:50.363 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.355+0000 7faabb3da640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7faab40aba60 con 0x7faab40ab3f0 2024-04-26T23:49:50.363 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.355+0000 7faabb3da640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7faab40c4860 con 0x7faab40c4d80 2024-04-26T23:49:50.363 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.355+0000 7faabb3da640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7faab40abbe0 con 0x7faab41570d0 2024-04-26T23:49:50.363 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.356+0000 7faab9176640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faab40ab3f0 0x7faab40c1980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:50.363 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.356+0000 7faab9176640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faab40ab3f0 0x7faab40c1980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:50272/0 (socket says 172.21.15.88:50272) 2024-04-26T23:49:50.363 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.356+0000 7faab9176640 1 -- 172.21.15.88:0/917135793 learned_addr learned my addr 172.21.15.88:0/917135793 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:49:50.363 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.356+0000 7faab8975640 1 --2- 172.21.15.88:0/917135793 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faab40c4d80 0x7faab4155f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:50.363 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.356+0000 7faab9977640 1 --2- 172.21.15.88:0/917135793 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faab41570d0 0x7faab41ec6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:50.363 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.356+0000 7faab9176640 1 -- 172.21.15.88:0/917135793 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faab41570d0 msgr2=0x7faab41ec6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:50.363 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.356+0000 7faab9176640 1 --2- 172.21.15.88:0/917135793 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faab41570d0 0x7faab41ec6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:50.363 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.356+0000 7faab9176640 1 -- 172.21.15.88:0/917135793 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faab40c4d80 msgr2=0x7faab4155f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:50.364 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.356+0000 7faab9176640 1 --2- 172.21.15.88:0/917135793 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faab40c4d80 0x7faab4155f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:50.364 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.356+0000 7faab9176640 1 -- 172.21.15.88:0/917135793 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faab40c1f60 con 0x7faab40ab3f0 2024-04-26T23:49:50.364 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.356+0000 7faab8975640 1 --2- 172.21.15.88:0/917135793 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faab40c4d80 0x7faab4155f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:49:50.364 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.356+0000 7faab9176640 1 --2- 172.21.15.88:0/917135793 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faab40ab3f0 0x7faab40c1980 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7faab0000c00 tx=0x7faab00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:49:50.364 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.356+0000 7faaa9ffb640 1 -- 172.21.15.88:0/917135793 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faab0041030 con 0x7faab40ab3f0 2024-04-26T23:49:50.364 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.356+0000 7faaa9ffb640 1 -- 172.21.15.88:0/917135793 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faab003c670 con 0x7faab40ab3f0 2024-04-26T23:49:50.364 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.356+0000 7faabb3da640 1 -- 172.21.15.88:0/917135793 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faab41efdb0 con 0x7faab40ab3f0 2024-04-26T23:49:50.364 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.356+0000 7faaa9ffb640 1 -- 172.21.15.88:0/917135793 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faab0037040 con 0x7faab40ab3f0 2024-04-26T23:49:50.364 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.356+0000 7faabb3da640 1 -- 172.21.15.88:0/917135793 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faab4156460 con 0x7faab40ab3f0 2024-04-26T23:49:50.364 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.357+0000 7faabb3da640 1 -- 172.21.15.88:0/917135793 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faab40ac7f0 con 0x7faab40ab3f0 2024-04-26T23:49:50.365 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.358+0000 7faaa9ffb640 1 -- 172.21.15.88:0/917135793 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7faab0044070 con 0x7faab40ab3f0 2024-04-26T23:49:50.365 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.358+0000 7faaa9ffb640 1 --2- 172.21.15.88:0/917135793 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7faa9806c8f0 0x7faa9806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:50.365 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.358+0000 7faaa9ffb640 1 -- 172.21.15.88:0/917135793 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6666+0+0 (secure 0 0 0) 0x7faab00ac400 con 0x7faab40ab3f0 2024-04-26T23:49:50.365 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.358+0000 7faab8975640 1 --2- 172.21.15.88:0/917135793 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7faa9806c8f0 0x7faa9806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:50.365 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.359+0000 7faab8975640 1 --2- 172.21.15.88:0/917135793 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7faa9806c8f0 0x7faa9806edb0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7faab40c2360 tx=0x7faaa4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:49:50.367 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.363+0000 7faaa9ffb640 1 -- 172.21.15.88:0/917135793 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7faab007a500 con 0x7faab40ab3f0 2024-04-26T23:49:50.551 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.547+0000 7faabb3da640 1 -- 172.21.15.88:0/917135793 --> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) -- 0x7faab40507a0 con 0x7faa9806c8f0 2024-04-26T23:49:50.551 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.548+0000 7faaa9ffb640 1 -- 172.21.15.88:0/917135793 <== mgr.4104 v2:172.21.15.88:6832/651674297 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7faab40507a0 con 0x7faa9806c8f0 2024-04-26T23:49:50.551 INFO:teuthology.orchestra.run.smithi088.stderr:instructed osd(s) 5 to deep-scrub 2024-04-26T23:49:50.553 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.550+0000 7faabb3da640 1 -- 172.21.15.88:0/917135793 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7faa9806c8f0 msgr2=0x7faa9806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:50.553 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.550+0000 7faabb3da640 1 --2- 172.21.15.88:0/917135793 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7faa9806c8f0 0x7faa9806edb0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7faab40c2360 tx=0x7faaa4008040 comp rx=0 tx=0).stop 2024-04-26T23:49:50.554 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.550+0000 7faabb3da640 1 -- 172.21.15.88:0/917135793 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faab40ab3f0 msgr2=0x7faab40c1980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:50.554 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.550+0000 7faabb3da640 1 --2- 172.21.15.88:0/917135793 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faab40ab3f0 0x7faab40c1980 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7faab0000c00 tx=0x7faab00046c0 comp rx=0 tx=0).stop 2024-04-26T23:49:50.554 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.550+0000 7faabb3da640 1 -- 172.21.15.88:0/917135793 shutdown_connections 2024-04-26T23:49:50.554 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.550+0000 7faabb3da640 1 --2- 172.21.15.88:0/917135793 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7faa9806c8f0 0x7faa9806edb0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:50.554 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.550+0000 7faabb3da640 1 --2- 172.21.15.88:0/917135793 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faab41570d0 0x7faab41ec6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:50.554 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.550+0000 7faabb3da640 1 --2- 172.21.15.88:0/917135793 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faab40c4d80 0x7faab4155f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:50.554 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.550+0000 7faabb3da640 1 --2- 172.21.15.88:0/917135793 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faab40ab3f0 0x7faab40c1980 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:50.554 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.550+0000 7faabb3da640 1 -- 172.21.15.88:0/917135793 >> 172.21.15.88:0/917135793 conn(0x7faab406c310 msgr2=0x7faab40c2bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:49:50.554 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.550+0000 7faabb3da640 1 -- 172.21.15.88:0/917135793 shutdown_connections 2024-04-26T23:49:50.554 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.550+0000 7faabb3da640 1 -- 172.21.15.88:0/917135793 wait complete. 2024-04-26T23:49:50.564 INFO:tasks.ceph:Scrubbing osd.6 2024-04-26T23:49:50.565 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-04-26T23:49:50.665 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.661+0000 7f3082a25640 1 Processor -- start 2024-04-26T23:49:50.665 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.661+0000 7f3082a25640 1 -- start start 2024-04-26T23:49:50.667 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.662+0000 7f3082a25640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f307c0ad690 0x7f307c0735c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:50.667 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.662+0000 7f3082a25640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f307c0adb70 con 0x7f307c14ea10 2024-04-26T23:49:50.667 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.662+0000 7f3082a25640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f307c0ade50 con 0x7f307c06e720 2024-04-26T23:49:50.667 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.662+0000 7f3082a25640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f307c154de0 con 0x7f307c0ad690 2024-04-26T23:49:50.667 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.662+0000 7f307b7fe640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f307c0ad690 0x7f307c0735c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:50.667 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.662+0000 7f307bfff640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f307c14ea10 0x7f307c155270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:43872/0 (socket says 172.21.15.88:43872) 2024-04-26T23:49:50.667 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.662+0000 7f307bfff640 1 -- 172.21.15.88:0/1158891804 learned_addr learned my addr 172.21.15.88:0/1158891804 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-26T23:49:50.667 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.662+0000 7f307b7fe640 1 -- 172.21.15.88:0/1158891804 >> v1:172.21.15.175:6789/0 conn(0x7f307c06e720 legacy=0x7f307c06ec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:49:50.667 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.662+0000 7f307b7fe640 1 -- 172.21.15.88:0/1158891804 >> v1:172.21.15.88:6789/0 conn(0x7f307c14ea10 legacy=0x7f307c155270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:50.667 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.662+0000 7f307b7fe640 1 -- 172.21.15.88:0/1158891804 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f307c154a70 con 0x7f307c0ad690 2024-04-26T23:49:50.667 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.662+0000 7f307affd640 1 -- 172.21.15.88:0/1158891804 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3271910364 0 0) 0x7f307c0adb70 con 0x7f307c14ea10 2024-04-26T23:49:50.667 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.663+0000 7f307b7fe640 1 --2- 172.21.15.88:0/1158891804 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f307c0ad690 0x7f307c0735c0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f30700097a0 tx=0x7f307002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4dafb07c5c1a0fc6 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:49:50.668 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.663+0000 7f307affd640 1 -- 172.21.15.88:0/1158891804 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3070037070 con 0x7f307c0ad690 2024-04-26T23:49:50.668 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.663+0000 7f307affd640 1 -- 172.21.15.88:0/1158891804 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3070032440 con 0x7f307c0ad690 2024-04-26T23:49:50.668 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.663+0000 7f307affd640 1 -- 172.21.15.88:0/1158891804 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3070032810 con 0x7f307c0ad690 2024-04-26T23:49:50.669 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.664+0000 7f3082a25640 1 -- 172.21.15.88:0/1158891804 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f307c0ad690 msgr2=0x7f307c0735c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:50.669 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.664+0000 7f3082a25640 1 --2- 172.21.15.88:0/1158891804 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f307c0ad690 0x7f307c0735c0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f30700097a0 tx=0x7f307002a1e0 comp rx=0 tx=0).stop 2024-04-26T23:49:50.669 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.664+0000 7f3082a25640 1 -- 172.21.15.88:0/1158891804 shutdown_connections 2024-04-26T23:49:50.669 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.664+0000 7f3082a25640 1 --2- 172.21.15.88:0/1158891804 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f307c0ad690 0x7f307c0735c0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:50.669 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.664+0000 7f3082a25640 1 -- 172.21.15.88:0/1158891804 >> 172.21.15.88:0/1158891804 conn(0x7f307c06c310 msgr2=0x7f307c06c720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:49:50.669 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.664+0000 7f3082a25640 1 -- 172.21.15.88:0/1158891804 shutdown_connections 2024-04-26T23:49:50.669 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.664+0000 7f3082a25640 1 -- 172.21.15.88:0/1158891804 wait complete. 2024-04-26T23:49:50.669 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.665+0000 7f3082a25640 1 Processor -- start 2024-04-26T23:49:50.669 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.665+0000 7f3082a25640 1 -- start start 2024-04-26T23:49:50.671 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.666+0000 7f3082a25640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f307c06e720 0x7f307c1586f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:50.671 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.666+0000 7f3082a25640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f307c0ad690 0x7f307c153950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:50.671 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.666+0000 7f3082a25640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f307c14ea10 0x7f307c1486d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:50.672 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.666+0000 7f3082a25640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f307c06f4c0 con 0x7f307c14ea10 2024-04-26T23:49:50.672 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.666+0000 7f3082a25640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f307c06f340 con 0x7f307c0ad690 2024-04-26T23:49:50.672 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.666+0000 7f3082a25640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f307c06d390 con 0x7f307c06e720 2024-04-26T23:49:50.672 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.666+0000 7f3080fc2640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f307c14ea10 0x7f307c1486d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:50.672 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.666+0000 7f3080fc2640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f307c14ea10 0x7f307c1486d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:50296/0 (socket says 172.21.15.88:50296) 2024-04-26T23:49:50.672 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.666+0000 7f3080fc2640 1 -- 172.21.15.88:0/897527383 learned_addr learned my addr 172.21.15.88:0/897527383 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:49:50.672 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.666+0000 7f3080fc2640 1 -- 172.21.15.88:0/897527383 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f307c06e720 msgr2=0x7f307c1586f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:50.672 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.666+0000 7f3080fc2640 1 --2- 172.21.15.88:0/897527383 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f307c06e720 0x7f307c1586f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:50.672 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.666+0000 7f3080fc2640 1 -- 172.21.15.88:0/897527383 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f307c0ad690 msgr2=0x7f307c153950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:50.672 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.666+0000 7f3080fc2640 1 --2- 172.21.15.88:0/897527383 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f307c0ad690 0x7f307c153950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:50.672 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.666+0000 7f3080fc2640 1 -- 172.21.15.88:0/897527383 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f307c158cf0 con 0x7f307c14ea10 2024-04-26T23:49:50.672 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.666+0000 7f3080fc2640 1 --2- 172.21.15.88:0/897527383 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f307c14ea10 0x7f307c1486d0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f307400ba10 tx=0x7f307400bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:49:50.672 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.666+0000 7f3078ff9640 1 -- 172.21.15.88:0/897527383 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3074019070 con 0x7f307c14ea10 2024-04-26T23:49:50.672 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.666+0000 7f3078ff9640 1 -- 172.21.15.88:0/897527383 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f307400cba0 con 0x7f307c14ea10 2024-04-26T23:49:50.673 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.666+0000 7f3082a25640 1 -- 172.21.15.88:0/897527383 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f307c156660 con 0x7f307c14ea10 2024-04-26T23:49:50.673 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.666+0000 7f3078ff9640 1 -- 172.21.15.88:0/897527383 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3074014440 con 0x7f307c14ea10 2024-04-26T23:49:50.673 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.666+0000 7f3082a25640 1 -- 172.21.15.88:0/897527383 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f307c156c20 con 0x7f307c14ea10 2024-04-26T23:49:50.673 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.667+0000 7f3082a25640 1 -- 172.21.15.88:0/897527383 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f307c157000 con 0x7f307c14ea10 2024-04-26T23:49:50.673 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.668+0000 7f3078ff9640 1 -- 172.21.15.88:0/897527383 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f307401c070 con 0x7f307c14ea10 2024-04-26T23:49:50.673 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.668+0000 7f3078ff9640 1 --2- 172.21.15.88:0/897527383 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f306806c8f0 0x7f306806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:50.673 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.668+0000 7f307bfff640 1 --2- 172.21.15.88:0/897527383 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f306806c8f0 0x7f306806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:50.673 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.668+0000 7f3078ff9640 1 -- 172.21.15.88:0/897527383 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6666+0+0 (secure 0 0 0) 0x7f307408bb80 con 0x7f307c14ea10 2024-04-26T23:49:50.674 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.668+0000 7f3078ff9640 1 --2- 172.21.15.88:0/897527383 >> [v2:172.21.15.175:6816/3824112919,v1:172.21.15.175:6819/3824112919] conn(0x7f30680772e0 0x7f3068079780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:50.674 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.668+0000 7f3078ff9640 1 -- 172.21.15.88:0/897527383 --> [v2:172.21.15.175:6816/3824112919,v1:172.21.15.175:6819/3824112919] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3068079e50 con 0x7f30680772e0 2024-04-26T23:49:50.674 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.668+0000 7f3078ff9640 1 -- 172.21.15.88:0/897527383 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f30740902a0 con 0x7f307c14ea10 2024-04-26T23:49:50.674 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.668+0000 7f307bfff640 1 --2- 172.21.15.88:0/897527383 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f306806c8f0 0x7f306806edb0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f306c007fd0 tx=0x7f306c007920 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:49:50.674 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.668+0000 7f307b7fe640 1 --2- 172.21.15.88:0/897527383 >> [v2:172.21.15.175:6816/3824112919,v1:172.21.15.175:6819/3824112919] conn(0x7f30680772e0 0x7f3068079780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:50.674 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.669+0000 7f307b7fe640 1 --2- 172.21.15.88:0/897527383 >> [v2:172.21.15.175:6816/3824112919,v1:172.21.15.175:6819/3824112919] conn(0x7f30680772e0 0x7f3068079780 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:49:50.674 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.670+0000 7f3078ff9640 1 -- 172.21.15.88:0/897527383 <== osd.6 v2:172.21.15.175:6816/3824112919 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f3068079e50 con 0x7f30680772e0 2024-04-26T23:49:50.686 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.683+0000 7f3082a25640 1 -- 172.21.15.88:0/897527383 --> [v2:172.21.15.175:6816/3824112919,v1:172.21.15.175:6819/3824112919] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f307c0694b0 con 0x7f30680772e0 2024-04-26T23:49:50.687 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.683+0000 7f3078ff9640 1 -- 172.21.15.88:0/897527383 <== osd.6 v2:172.21.15.175:6816/3824112919 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f307c0694b0 con 0x7f30680772e0 2024-04-26T23:49:50.687 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-04-26T23:49:50.687 INFO:teuthology.orchestra.run.smithi088.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-26T23:49:50.687 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-04-26T23:49:50.688 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.684+0000 7f3082a25640 1 -- 172.21.15.88:0/897527383 >> [v2:172.21.15.175:6816/3824112919,v1:172.21.15.175:6819/3824112919] conn(0x7f30680772e0 msgr2=0x7f3068079780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:50.688 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.684+0000 7f3082a25640 1 --2- 172.21.15.88:0/897527383 >> [v2:172.21.15.175:6816/3824112919,v1:172.21.15.175:6819/3824112919] conn(0x7f30680772e0 0x7f3068079780 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:50.688 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.684+0000 7f3082a25640 1 -- 172.21.15.88:0/897527383 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f306806c8f0 msgr2=0x7f306806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:50.689 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.684+0000 7f3082a25640 1 --2- 172.21.15.88:0/897527383 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f306806c8f0 0x7f306806edb0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f306c007fd0 tx=0x7f306c007920 comp rx=0 tx=0).stop 2024-04-26T23:49:50.689 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.684+0000 7f3082a25640 1 -- 172.21.15.88:0/897527383 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f307c14ea10 msgr2=0x7f307c1486d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:50.689 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.684+0000 7f3082a25640 1 --2- 172.21.15.88:0/897527383 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f307c14ea10 0x7f307c1486d0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f307400ba10 tx=0x7f307400bed0 comp rx=0 tx=0).stop 2024-04-26T23:49:50.689 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.684+0000 7f3080fc2640 1 -- 172.21.15.88:0/897527383 reap_dead start 2024-04-26T23:49:50.689 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.684+0000 7f3082a25640 1 -- 172.21.15.88:0/897527383 shutdown_connections 2024-04-26T23:49:50.689 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.684+0000 7f3082a25640 1 -- 172.21.15.88:0/897527383 >> 172.21.15.88:0/897527383 conn(0x7f307c06c310 msgr2=0x7f307c06ec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:49:50.689 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.684+0000 7f3082a25640 1 -- 172.21.15.88:0/897527383 shutdown_connections 2024-04-26T23:49:50.689 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.684+0000 7f3082a25640 1 -- 172.21.15.88:0/897527383 wait complete. 2024-04-26T23:49:50.698 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-04-26T23:49:50.797 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.793+0000 7eff3d740640 1 Processor -- start 2024-04-26T23:49:50.797 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.793+0000 7eff3d740640 1 -- start start 2024-04-26T23:49:50.800 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.794+0000 7eff3d740640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7eff38154160 0x7eff38156bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:50.800 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.794+0000 7eff3d740640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff380c8df0 con 0x7eff380ca5a0 2024-04-26T23:49:50.800 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.794+0000 7eff3d740640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff38154540 con 0x7eff3815a1a0 2024-04-26T23:49:50.800 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.794+0000 7eff3d740640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7eff380c9100 con 0x7eff38154160 2024-04-26T23:49:50.800 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.794+0000 7eff367fc640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7eff380ca5a0 0x7eff380c6e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:43882/0 (socket says 172.21.15.88:43882) 2024-04-26T23:49:50.801 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.794+0000 7eff367fc640 1 -- 172.21.15.88:0/18862181 learned_addr learned my addr 172.21.15.88:0/18862181 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-26T23:49:50.801 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.794+0000 7eff35ffb640 1 -- 172.21.15.88:0/18862181 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2252605060 0 0) 0x7eff2c001110 con 0x7eff380ca5a0 2024-04-26T23:49:50.801 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.794+0000 7eff35ffb640 1 -- 172.21.15.88:0/18862181 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7eff20003520 con 0x7eff380ca5a0 2024-04-26T23:49:50.801 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.794+0000 7eff36ffd640 1 --2- 172.21.15.88:0/18862181 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7eff38154160 0x7eff38156bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:50.801 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.794+0000 7eff35ffb640 1 -- 172.21.15.88:0/18862181 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2976284849 0 0) 0x7eff20003520 con 0x7eff380ca5a0 2024-04-26T23:49:50.801 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.794+0000 7eff35ffb640 1 -- 172.21.15.88:0/18862181 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7eff38154160 msgr2=0x7eff38156bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:49:50.801 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.794+0000 7eff35ffb640 1 --2- 172.21.15.88:0/18862181 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7eff38154160 0x7eff38156bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:50.801 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.794+0000 7eff35ffb640 1 -- 172.21.15.88:0/18862181 >> v1:172.21.15.175:6789/0 conn(0x7eff3815a1a0 legacy=0x7eff380c9590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:50.801 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.794+0000 7eff35ffb640 1 -- 172.21.15.88:0/18862181 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff3815a910 con 0x7eff380ca5a0 2024-04-26T23:49:50.801 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.794+0000 7eff35ffb640 1 -- 172.21.15.88:0/18862181 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 356324787 0 0) 0x7eff2c001840 con 0x7eff380ca5a0 2024-04-26T23:49:50.801 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.794+0000 7eff35ffb640 1 -- 172.21.15.88:0/18862181 >> v1:172.21.15.88:6789/0 conn(0x7eff380ca5a0 legacy=0x7eff380c6e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:50.801 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.794+0000 7eff35ffb640 1 --2- 172.21.15.88:0/18862181 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7eff200039e0 0x7eff20003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:50.801 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.794+0000 7eff35ffb640 1 --2- 172.21.15.88:0/18862181 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7eff20004800 0x7eff20004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:50.801 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.795+0000 7eff35ffb640 1 --2- 172.21.15.88:0/18862181 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7eff38154160 0x7eff20005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:50.802 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.795+0000 7eff35ffb640 1 -- 172.21.15.88:0/18862181 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7eff380c9100 con 0x7eff200039e0 2024-04-26T23:49:50.802 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.795+0000 7eff35ffb640 1 -- 172.21.15.88:0/18862181 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7eff2000baf0 con 0x7eff20004800 2024-04-26T23:49:50.802 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.795+0000 7eff35ffb640 1 -- 172.21.15.88:0/18862181 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7eff2000bcf0 con 0x7eff38154160 2024-04-26T23:49:50.802 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.795+0000 7eff36ffd640 1 --2- 172.21.15.88:0/18862181 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7eff200039e0 0x7eff20003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:50.802 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.795+0000 7eff367fc640 1 --2- 172.21.15.88:0/18862181 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7eff20004800 0x7eff20004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:50.802 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.795+0000 7eff377fe640 1 --2- 172.21.15.88:0/18862181 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7eff38154160 0x7eff20005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:50.802 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.795+0000 7eff36ffd640 1 -- 172.21.15.88:0/18862181 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7eff38154160 msgr2=0x7eff20005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:49:50.802 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.795+0000 7eff36ffd640 1 --2- 172.21.15.88:0/18862181 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7eff38154160 0x7eff20005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:50.802 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.795+0000 7eff36ffd640 1 -- 172.21.15.88:0/18862181 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7eff20004800 msgr2=0x7eff20004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:49:50.802 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.795+0000 7eff36ffd640 1 --2- 172.21.15.88:0/18862181 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7eff20004800 0x7eff20004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:50.802 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.795+0000 7eff36ffd640 1 -- 172.21.15.88:0/18862181 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff20003520 con 0x7eff200039e0 2024-04-26T23:49:50.802 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.796+0000 7eff36ffd640 1 --2- 172.21.15.88:0/18862181 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7eff200039e0 0x7eff20003e00 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7eff2800ba30 tx=0x7eff20005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5165887bfc3241ef server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:49:50.802 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.796+0000 7eff35ffb640 1 -- 172.21.15.88:0/18862181 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff28030070 con 0x7eff200039e0 2024-04-26T23:49:50.802 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.796+0000 7eff35ffb640 1 -- 172.21.15.88:0/18862181 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff2802ade0 con 0x7eff200039e0 2024-04-26T23:49:50.802 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.796+0000 7eff35ffb640 1 -- 172.21.15.88:0/18862181 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff2800b600 con 0x7eff200039e0 2024-04-26T23:49:50.803 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.796+0000 7eff3d740640 1 -- 172.21.15.88:0/18862181 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7eff200039e0 msgr2=0x7eff20003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:50.803 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.796+0000 7eff3d740640 1 --2- 172.21.15.88:0/18862181 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7eff200039e0 0x7eff20003e00 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7eff2800ba30 tx=0x7eff20005830 comp rx=0 tx=0).stop 2024-04-26T23:49:50.803 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.796+0000 7eff377fe640 1 -- 172.21.15.88:0/18862181 reap_dead start 2024-04-26T23:49:50.803 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.796+0000 7eff3d740640 1 -- 172.21.15.88:0/18862181 shutdown_connections 2024-04-26T23:49:50.803 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.796+0000 7eff3d740640 1 -- 172.21.15.88:0/18862181 >> 172.21.15.88:0/18862181 conn(0x7eff380ae010 msgr2=0x7eff380ae3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:49:50.803 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.796+0000 7eff3d740640 1 -- 172.21.15.88:0/18862181 shutdown_connections 2024-04-26T23:49:50.803 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.796+0000 7eff3d740640 1 -- 172.21.15.88:0/18862181 wait complete. 2024-04-26T23:49:50.806 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.798+0000 7eff3d740640 1 Processor -- start 2024-04-26T23:49:50.806 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.798+0000 7eff3d740640 1 -- start start 2024-04-26T23:49:50.806 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.798+0000 7eff3d740640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7eff200039e0 0x7eff381ed060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:50.806 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.798+0000 7eff3d740640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7eff38152b00 0x7eff38152100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:50.806 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.798+0000 7eff3d740640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7eff380bffb0 0x7eff38155c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:50.806 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.798+0000 7eff3d740640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7eff3815a630 con 0x7eff380bffb0 2024-04-26T23:49:50.806 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.798+0000 7eff3d740640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7eff3815aed0 con 0x7eff38152b00 2024-04-26T23:49:50.806 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.798+0000 7eff3d740640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7eff380c7510 con 0x7eff200039e0 2024-04-26T23:49:50.806 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.798+0000 7eff377fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7eff380bffb0 0x7eff38155c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:50.806 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.798+0000 7eff377fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7eff380bffb0 0x7eff38155c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:50314/0 (socket says 172.21.15.88:50314) 2024-04-26T23:49:50.806 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.798+0000 7eff377fe640 1 -- 172.21.15.88:0/3856349801 learned_addr learned my addr 172.21.15.88:0/3856349801 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:49:50.806 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.798+0000 7eff367fc640 1 --2- 172.21.15.88:0/3856349801 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7eff38152b00 0x7eff38152100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:50.806 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.798+0000 7eff36ffd640 1 --2- 172.21.15.88:0/3856349801 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7eff200039e0 0x7eff381ed060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:50.806 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.799+0000 7eff377fe640 1 -- 172.21.15.88:0/3856349801 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7eff200039e0 msgr2=0x7eff381ed060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:50.807 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.799+0000 7eff377fe640 1 --2- 172.21.15.88:0/3856349801 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7eff200039e0 0x7eff381ed060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:50.807 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.799+0000 7eff377fe640 1 -- 172.21.15.88:0/3856349801 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7eff38152b00 msgr2=0x7eff38152100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:50.807 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.799+0000 7eff377fe640 1 --2- 172.21.15.88:0/3856349801 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7eff38152b00 0x7eff38152100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:50.807 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.799+0000 7eff377fe640 1 -- 172.21.15.88:0/3856349801 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff38152640 con 0x7eff380bffb0 2024-04-26T23:49:50.807 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.799+0000 7eff377fe640 1 --2- 172.21.15.88:0/3856349801 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7eff380bffb0 0x7eff38155c10 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7eff3815a580 tx=0x7eff3000fc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:49:50.807 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.799+0000 7eff1f7fe640 1 -- 172.21.15.88:0/3856349801 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff3001a070 con 0x7eff380bffb0 2024-04-26T23:49:50.807 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.799+0000 7eff1f7fe640 1 -- 172.21.15.88:0/3856349801 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff30006d60 con 0x7eff380bffb0 2024-04-26T23:49:50.807 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.799+0000 7eff3d740640 1 -- 172.21.15.88:0/3856349801 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff38153270 con 0x7eff380bffb0 2024-04-26T23:49:50.807 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.799+0000 7eff1f7fe640 1 -- 172.21.15.88:0/3856349801 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff3000fea0 con 0x7eff380bffb0 2024-04-26T23:49:50.807 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.799+0000 7eff3d740640 1 -- 172.21.15.88:0/3856349801 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff38152f90 con 0x7eff380bffb0 2024-04-26T23:49:50.807 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.800+0000 7eff3d740640 1 -- 172.21.15.88:0/3856349801 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff38076650 con 0x7eff380bffb0 2024-04-26T23:49:50.807 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.800+0000 7eff1f7fe640 1 -- 172.21.15.88:0/3856349801 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7eff3001d070 con 0x7eff380bffb0 2024-04-26T23:49:50.807 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.801+0000 7eff1f7fe640 1 --2- 172.21.15.88:0/3856349801 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7eff2406c8f0 0x7eff2406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:50.807 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.801+0000 7eff1f7fe640 1 -- 172.21.15.88:0/3856349801 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6666+0+0 (secure 0 0 0) 0x7eff3008b560 con 0x7eff380bffb0 2024-04-26T23:49:50.807 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.801+0000 7eff36ffd640 1 --2- 172.21.15.88:0/3856349801 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7eff2406c8f0 0x7eff2406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:50.808 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.801+0000 7eff36ffd640 1 --2- 172.21.15.88:0/3856349801 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7eff2406c8f0 0x7eff2406edb0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7eff2800ba00 tx=0x7eff28030000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:49:50.808 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.805+0000 7eff1f7fe640 1 -- 172.21.15.88:0/3856349801 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7eff30059010 con 0x7eff380bffb0 2024-04-26T23:49:50.984 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.980+0000 7eff3d740640 1 -- 172.21.15.88:0/3856349801 --> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) -- 0x7eff380507a0 con 0x7eff2406c8f0 2024-04-26T23:49:50.984 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.980+0000 7eff1f7fe640 1 -- 172.21.15.88:0/3856349801 <== mgr.4104 v2:172.21.15.88:6832/651674297 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7eff380507a0 con 0x7eff2406c8f0 2024-04-26T23:49:50.984 INFO:teuthology.orchestra.run.smithi088.stderr:instructed osd(s) 6 to deep-scrub 2024-04-26T23:49:50.986 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.982+0000 7eff3d740640 1 -- 172.21.15.88:0/3856349801 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7eff2406c8f0 msgr2=0x7eff2406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:50.986 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.982+0000 7eff3d740640 1 --2- 172.21.15.88:0/3856349801 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7eff2406c8f0 0x7eff2406edb0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7eff2800ba00 tx=0x7eff28030000 comp rx=0 tx=0).stop 2024-04-26T23:49:50.986 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.982+0000 7eff3d740640 1 -- 172.21.15.88:0/3856349801 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7eff380bffb0 msgr2=0x7eff38155c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:50.986 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.982+0000 7eff3d740640 1 --2- 172.21.15.88:0/3856349801 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7eff380bffb0 0x7eff38155c10 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7eff3815a580 tx=0x7eff3000fc50 comp rx=0 tx=0).stop 2024-04-26T23:49:50.986 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.982+0000 7eff3d740640 1 -- 172.21.15.88:0/3856349801 shutdown_connections 2024-04-26T23:49:50.986 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.982+0000 7eff3d740640 1 --2- 172.21.15.88:0/3856349801 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7eff2406c8f0 0x7eff2406edb0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:50.986 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.982+0000 7eff3d740640 1 --2- 172.21.15.88:0/3856349801 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7eff380bffb0 0x7eff38155c10 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:50.987 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.982+0000 7eff3d740640 1 --2- 172.21.15.88:0/3856349801 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7eff38152b00 0x7eff38152100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:50.987 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.982+0000 7eff3d740640 1 --2- 172.21.15.88:0/3856349801 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7eff200039e0 0x7eff381ed060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:50.987 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.982+0000 7eff3d740640 1 -- 172.21.15.88:0/3856349801 >> 172.21.15.88:0/3856349801 conn(0x7eff380ae010 msgr2=0x7eff3814f790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:49:50.987 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.982+0000 7eff3d740640 1 -- 172.21.15.88:0/3856349801 shutdown_connections 2024-04-26T23:49:50.987 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:50.982+0000 7eff3d740640 1 -- 172.21.15.88:0/3856349801 wait complete. 2024-04-26T23:49:50.997 INFO:tasks.ceph:Scrubbing osd.7 2024-04-26T23:49:50.997 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-04-26T23:49:51.097 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.093+0000 7f18461f7640 1 Processor -- start 2024-04-26T23:49:51.097 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.094+0000 7f18461f7640 1 -- start start 2024-04-26T23:49:51.099 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.094+0000 7f18461f7640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f1840154200 0x7f18400ca520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:51.099 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.094+0000 7f18461f7640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1840072930 0x7f1840072dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:51.099 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.094+0000 7f18461f7640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1840073560 con 0x7f184015ac00 2024-04-26T23:49:51.099 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.094+0000 7f18461f7640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f1840157c20 con 0x7f1840154200 2024-04-26T23:49:51.099 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.094+0000 7f18461f7640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f18400c7790 con 0x7f1840072930 2024-04-26T23:49:51.099 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.095+0000 7f183f7fe640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f1840154200 0x7f18400ca520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:51.099 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.095+0000 7f183ffff640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1840072930 0x7f1840072dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:51.099 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.095+0000 7f183effd640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f184015ac00 0x7f1840157510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.88:36556/0 (socket says 172.21.15.88:36556) 2024-04-26T23:49:51.099 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.095+0000 7f183ffff640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1840072930 0x7f1840072dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.88:47734/0 (socket says 172.21.15.88:47734) 2024-04-26T23:49:51.099 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.095+0000 7f183effd640 1 -- 172.21.15.88:0/2417153309 learned_addr learned my addr 172.21.15.88:0/2417153309 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-26T23:49:51.099 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.095+0000 7f183f7fe640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f1840154200 0x7f18400ca520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.88:57194/0 (socket says 172.21.15.88:57194) 2024-04-26T23:49:51.099 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.095+0000 7f183f7fe640 1 -- 172.21.15.88:0/2417153309 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1840072930 msgr2=0x7f1840072dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:49:51.100 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.095+0000 7f183f7fe640 1 --2- 172.21.15.88:0/2417153309 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1840072930 0x7f1840072dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:51.100 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.095+0000 7f183f7fe640 1 -- 172.21.15.88:0/2417153309 >> v1:172.21.15.175:6789/0 conn(0x7f184015ac00 legacy=0x7f1840157510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:51.100 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.095+0000 7f183f7fe640 1 -- 172.21.15.88:0/2417153309 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18400c71d0 con 0x7f1840154200 2024-04-26T23:49:51.100 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.095+0000 7f183ffff640 1 --2- 172.21.15.88:0/2417153309 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1840072930 0x7f1840072dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:49:51.101 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.096+0000 7f183f7fe640 1 --2- 172.21.15.88:0/2417153309 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1840154200 0x7f18400ca520 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f18300097a0 tx=0x7f183002a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1956d4d84204abba server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:49:51.101 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.096+0000 7f183e7fc640 1 -- 172.21.15.88:0/2417153309 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1830037070 con 0x7f1840154200 2024-04-26T23:49:51.101 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.096+0000 7f183e7fc640 1 -- 172.21.15.88:0/2417153309 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1830032440 con 0x7f1840154200 2024-04-26T23:49:51.101 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.096+0000 7f183e7fc640 1 -- 172.21.15.88:0/2417153309 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1830032810 con 0x7f1840154200 2024-04-26T23:49:51.101 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.097+0000 7f18461f7640 1 -- 172.21.15.88:0/2417153309 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1840154200 msgr2=0x7f18400ca520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:51.101 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.097+0000 7f18461f7640 1 --2- 172.21.15.88:0/2417153309 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1840154200 0x7f18400ca520 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f18300097a0 tx=0x7f183002a180 comp rx=0 tx=0).stop 2024-04-26T23:49:51.102 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.097+0000 7f18461f7640 1 -- 172.21.15.88:0/2417153309 shutdown_connections 2024-04-26T23:49:51.102 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.097+0000 7f18461f7640 1 --2- 172.21.15.88:0/2417153309 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1840072930 0x7f1840072dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:51.102 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.097+0000 7f18461f7640 1 --2- 172.21.15.88:0/2417153309 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1840154200 0x7f18400ca520 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:51.102 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.097+0000 7f18461f7640 1 -- 172.21.15.88:0/2417153309 >> 172.21.15.88:0/2417153309 conn(0x7f18400cc400 msgr2=0x7f18400cc810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:49:51.102 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.097+0000 7f18461f7640 1 -- 172.21.15.88:0/2417153309 shutdown_connections 2024-04-26T23:49:51.102 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.097+0000 7f18461f7640 1 -- 172.21.15.88:0/2417153309 wait complete. 2024-04-26T23:49:51.102 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.098+0000 7f18461f7640 1 Processor -- start 2024-04-26T23:49:51.102 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.098+0000 7f18461f7640 1 -- start start 2024-04-26T23:49:51.104 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.098+0000 7f18461f7640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1840072930 0x7f1840151250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:51.104 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.099+0000 7f18461f7640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1840154200 0x7f184014a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:51.104 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.099+0000 7f18461f7640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f184015ac00 0x7f18401494e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:51.104 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.099+0000 7f18461f7640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f1840156ff0 con 0x7f1840154200 2024-04-26T23:49:51.104 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.099+0000 7f18461f7640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f1840156d10 con 0x7f184015ac00 2024-04-26T23:49:51.104 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.099+0000 7f18461f7640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f18401545e0 con 0x7f1840072930 2024-04-26T23:49:51.104 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.099+0000 7f183effd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1840154200 0x7f184014a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:51.105 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.099+0000 7f183effd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1840154200 0x7f184014a9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:50326/0 (socket says 172.21.15.88:50326) 2024-04-26T23:49:51.105 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.099+0000 7f183effd640 1 -- 172.21.15.88:0/1615016279 learned_addr learned my addr 172.21.15.88:0/1615016279 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:49:51.105 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.099+0000 7f183f7fe640 1 --2- 172.21.15.88:0/1615016279 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1840072930 0x7f1840151250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:51.105 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.099+0000 7f183ffff640 1 --2- 172.21.15.88:0/1615016279 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f184015ac00 0x7f18401494e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:51.105 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.099+0000 7f183effd640 1 -- 172.21.15.88:0/1615016279 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1840072930 msgr2=0x7f1840151250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:51.105 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.099+0000 7f183effd640 1 --2- 172.21.15.88:0/1615016279 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1840072930 0x7f1840151250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:51.105 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.099+0000 7f183effd640 1 -- 172.21.15.88:0/1615016279 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f184015ac00 msgr2=0x7f18401494e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:51.105 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.099+0000 7f183effd640 1 --2- 172.21.15.88:0/1615016279 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f184015ac00 0x7f18401494e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:51.105 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.099+0000 7f183effd640 1 -- 172.21.15.88:0/1615016279 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18400c61a0 con 0x7f1840154200 2024-04-26T23:49:51.105 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.099+0000 7f183effd640 1 --2- 172.21.15.88:0/1615016279 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1840154200 0x7f184014a9f0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f183400c400 tx=0x7f183400c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:49:51.105 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.099+0000 7f1827fff640 1 -- 172.21.15.88:0/1615016279 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1834017070 con 0x7f1840154200 2024-04-26T23:49:51.105 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.099+0000 7f1827fff640 1 -- 172.21.15.88:0/1615016279 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1834005ce0 con 0x7f1840154200 2024-04-26T23:49:51.105 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.099+0000 7f18461f7640 1 -- 172.21.15.88:0/1615016279 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18400c6480 con 0x7f1840154200 2024-04-26T23:49:51.105 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.099+0000 7f1827fff640 1 -- 172.21.15.88:0/1615016279 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18340072f0 con 0x7f1840154200 2024-04-26T23:49:51.106 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.099+0000 7f18461f7640 1 -- 172.21.15.88:0/1615016279 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f184014af30 con 0x7f1840154200 2024-04-26T23:49:51.106 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.100+0000 7f18461f7640 1 -- 172.21.15.88:0/1615016279 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f184014ec10 con 0x7f1840154200 2024-04-26T23:49:51.106 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.101+0000 7f1827fff640 1 -- 172.21.15.88:0/1615016279 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f183401a070 con 0x7f1840154200 2024-04-26T23:49:51.107 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.101+0000 7f1827fff640 1 --2- 172.21.15.88:0/1615016279 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f182c06c8f0 0x7f182c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:51.107 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.101+0000 7f1827fff640 1 -- 172.21.15.88:0/1615016279 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6666+0+0 (secure 0 0 0) 0x7f183408b150 con 0x7f1840154200 2024-04-26T23:49:51.107 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.101+0000 7f183f7fe640 1 --2- 172.21.15.88:0/1615016279 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f182c06c8f0 0x7f182c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:51.107 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.101+0000 7f1827fff640 1 --2- 172.21.15.88:0/1615016279 >> [v2:172.21.15.175:6817/3319361162,v1:172.21.15.175:6818/3319361162] conn(0x7f182c0772f0 0x7f182c079790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:51.107 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.101+0000 7f1827fff640 1 -- 172.21.15.88:0/1615016279 --> [v2:172.21.15.175:6817/3319361162,v1:172.21.15.175:6818/3319361162] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1834015e70 con 0x7f182c0772f0 2024-04-26T23:49:51.107 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.101+0000 7f1827fff640 1 -- 172.21.15.88:0/1615016279 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f1834092050 con 0x7f1840154200 2024-04-26T23:49:51.107 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.102+0000 7f183ffff640 1 --2- 172.21.15.88:0/1615016279 >> [v2:172.21.15.175:6817/3319361162,v1:172.21.15.175:6818/3319361162] conn(0x7f182c0772f0 0x7f182c079790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:51.107 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.102+0000 7f183f7fe640 1 --2- 172.21.15.88:0/1615016279 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f182c06c8f0 0x7f182c06edb0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f1830034000 tx=0x7f183002e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:49:51.107 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.102+0000 7f183ffff640 1 --2- 172.21.15.88:0/1615016279 >> [v2:172.21.15.175:6817/3319361162,v1:172.21.15.175:6818/3319361162] conn(0x7f182c0772f0 0x7f182c079790 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:49:51.108 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.103+0000 7f1827fff640 1 -- 172.21.15.88:0/1615016279 <== osd.7 v2:172.21.15.175:6817/3319361162 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f1834015e70 con 0x7f182c0772f0 2024-04-26T23:49:51.119 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.116+0000 7f18461f7640 1 -- 172.21.15.88:0/1615016279 --> [v2:172.21.15.175:6817/3319361162,v1:172.21.15.175:6818/3319361162] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f18400694b0 con 0x7f182c0772f0 2024-04-26T23:49:51.120 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.116+0000 7f1827fff640 1 -- 172.21.15.88:0/1615016279 <== osd.7 v2:172.21.15.175:6817/3319361162 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f18400694b0 con 0x7f182c0772f0 2024-04-26T23:49:51.120 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-04-26T23:49:51.120 INFO:teuthology.orchestra.run.smithi088.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-26T23:49:51.120 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-04-26T23:49:51.121 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.116+0000 7f18461f7640 1 -- 172.21.15.88:0/1615016279 >> [v2:172.21.15.175:6817/3319361162,v1:172.21.15.175:6818/3319361162] conn(0x7f182c0772f0 msgr2=0x7f182c079790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:51.121 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.117+0000 7f18461f7640 1 --2- 172.21.15.88:0/1615016279 >> [v2:172.21.15.175:6817/3319361162,v1:172.21.15.175:6818/3319361162] conn(0x7f182c0772f0 0x7f182c079790 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:51.121 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.117+0000 7f18461f7640 1 -- 172.21.15.88:0/1615016279 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f182c06c8f0 msgr2=0x7f182c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:51.121 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.117+0000 7f18461f7640 1 --2- 172.21.15.88:0/1615016279 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f182c06c8f0 0x7f182c06edb0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f1830034000 tx=0x7f183002e000 comp rx=0 tx=0).stop 2024-04-26T23:49:51.121 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.117+0000 7f18461f7640 1 -- 172.21.15.88:0/1615016279 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1840154200 msgr2=0x7f184014a9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:51.121 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.117+0000 7f18461f7640 1 --2- 172.21.15.88:0/1615016279 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1840154200 0x7f184014a9f0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f183400c400 tx=0x7f183400c800 comp rx=0 tx=0).stop 2024-04-26T23:49:51.121 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.117+0000 7f183ffff640 1 -- 172.21.15.88:0/1615016279 reap_dead start 2024-04-26T23:49:51.122 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.117+0000 7f18461f7640 1 -- 172.21.15.88:0/1615016279 shutdown_connections 2024-04-26T23:49:51.122 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.117+0000 7f18461f7640 1 -- 172.21.15.88:0/1615016279 >> 172.21.15.88:0/1615016279 conn(0x7f18400cc400 msgr2=0x7f184014c8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:49:51.122 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.117+0000 7f18461f7640 1 -- 172.21.15.88:0/1615016279 shutdown_connections 2024-04-26T23:49:51.122 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.117+0000 7f18461f7640 1 -- 172.21.15.88:0/1615016279 wait complete. 2024-04-26T23:49:51.131 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-04-26T23:49:51.229 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.226+0000 7faa0c0bd640 1 Processor -- start 2024-04-26T23:49:51.230 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.226+0000 7faa0c0bd640 1 -- start start 2024-04-26T23:49:51.231 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.227+0000 7faa0c0bd640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faa041541d0 0x7faa040c8400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:51.231 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.227+0000 7faa0c0bd640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7faa04070490 0x7faa040c7420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:51.232 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.227+0000 7faa0c0bd640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7faa040c7960 0x7faa0415a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:51.232 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.227+0000 7faa0c0bd640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7faa040c3fc0 con 0x7faa040c7960 2024-04-26T23:49:51.232 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.227+0000 7faa0c0bd640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7faa040c3500 con 0x7faa04070490 2024-04-26T23:49:51.232 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.227+0000 7faa0c0bd640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7faa040c37e0 con 0x7faa041541d0 2024-04-26T23:49:51.232 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.227+0000 7faa0a65a640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7faa040c7960 0x7faa0415a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:51.232 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.227+0000 7faa0a65a640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7faa040c7960 0x7faa0415a3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:50342/0 (socket says 172.21.15.88:50342) 2024-04-26T23:49:51.232 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.227+0000 7faa0a65a640 1 -- 172.21.15.88:0/1795932291 learned_addr learned my addr 172.21.15.88:0/1795932291 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:49:51.232 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.227+0000 7faa09658640 1 --2- 172.21.15.88:0/1795932291 >> v2:172.21.15.175:3300/0 conn(0x7faa04070490 0x7faa040c7420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:51.232 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.227+0000 7faa09e59640 1 --2- 172.21.15.88:0/1795932291 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faa041541d0 0x7faa040c8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:51.232 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.227+0000 7faa0a65a640 1 -- 172.21.15.88:0/1795932291 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faa041541d0 msgr2=0x7faa040c8400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:49:51.232 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.227+0000 7faa0a65a640 1 --2- 172.21.15.88:0/1795932291 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faa041541d0 0x7faa040c8400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:51.232 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.227+0000 7faa0a65a640 1 -- 172.21.15.88:0/1795932291 >> v2:172.21.15.175:3300/0 conn(0x7faa04070490 msgr2=0x7faa040c7420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:49:51.232 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.227+0000 7faa0a65a640 1 --2- 172.21.15.88:0/1795932291 >> v2:172.21.15.175:3300/0 conn(0x7faa04070490 0x7faa040c7420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:51.232 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.227+0000 7faa0a65a640 1 -- 172.21.15.88:0/1795932291 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa040c3ac0 con 0x7faa040c7960 2024-04-26T23:49:51.232 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.228+0000 7faa0a65a640 1 --2- 172.21.15.88:0/1795932291 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faa040c7960 0x7faa0415a3c0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7faa040c2fb0 tx=0x7fa9fc02a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c29c010415bbde0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:49:51.233 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.228+0000 7faa08e57640 1 -- 172.21.15.88:0/1795932291 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9fc036070 con 0x7faa040c7960 2024-04-26T23:49:51.233 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.228+0000 7faa08e57640 1 -- 172.21.15.88:0/1795932291 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9fc031600 con 0x7faa040c7960 2024-04-26T23:49:51.233 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.228+0000 7faa08e57640 1 -- 172.21.15.88:0/1795932291 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9fc0319d0 con 0x7faa040c7960 2024-04-26T23:49:51.235 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.229+0000 7faa0c0bd640 1 -- 172.21.15.88:0/1795932291 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faa040c7960 msgr2=0x7faa0415a3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:51.235 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.229+0000 7faa0c0bd640 1 --2- 172.21.15.88:0/1795932291 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faa040c7960 0x7faa0415a3c0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7faa040c2fb0 tx=0x7fa9fc02a610 comp rx=0 tx=0).stop 2024-04-26T23:49:51.236 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.229+0000 7faa0c0bd640 1 -- 172.21.15.88:0/1795932291 shutdown_connections 2024-04-26T23:49:51.236 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.229+0000 7faa0c0bd640 1 --2- 172.21.15.88:0/1795932291 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faa040c7960 0x7faa0415a3c0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:51.236 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.229+0000 7faa0c0bd640 1 --2- 172.21.15.88:0/1795932291 >> v2:172.21.15.175:3300/0 conn(0x7faa04070490 0x7faa040c7420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:51.236 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.229+0000 7faa0c0bd640 1 --2- 172.21.15.88:0/1795932291 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faa041541d0 0x7faa040c8400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:51.236 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.229+0000 7faa0c0bd640 1 -- 172.21.15.88:0/1795932291 >> 172.21.15.88:0/1795932291 conn(0x7faa040c8c40 msgr2=0x7faa040c9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:49:51.236 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.229+0000 7faa0c0bd640 1 -- 172.21.15.88:0/1795932291 shutdown_connections 2024-04-26T23:49:51.236 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.229+0000 7faa0c0bd640 1 -- 172.21.15.88:0/1795932291 wait complete. 2024-04-26T23:49:51.236 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.230+0000 7faa0c0bd640 1 Processor -- start 2024-04-26T23:49:51.236 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.230+0000 7faa0c0bd640 1 -- start start 2024-04-26T23:49:51.236 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.231+0000 7faa0c0bd640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faa04070490 0x7faa040ad6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:51.236 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.231+0000 7faa0c0bd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faa040c7960 0x7faa041ec870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:51.236 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.231+0000 7faa0c0bd640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faa041541d0 0x7faa041ecdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:51.236 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.231+0000 7faa0c0bd640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7faa040c4420 con 0x7faa040c7960 2024-04-26T23:49:51.237 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.231+0000 7faa0c0bd640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7faa040c42a0 con 0x7faa04070490 2024-04-26T23:49:51.237 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.231+0000 7faa0c0bd640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7faa0415a900 con 0x7faa041541d0 2024-04-26T23:49:51.237 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.231+0000 7faa09658640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faa040c7960 0x7faa041ec870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:51.237 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.231+0000 7faa09658640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faa040c7960 0x7faa041ec870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:50346/0 (socket says 172.21.15.88:50346) 2024-04-26T23:49:51.237 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.231+0000 7faa09658640 1 -- 172.21.15.88:0/2393806920 learned_addr learned my addr 172.21.15.88:0/2393806920 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:49:51.237 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.231+0000 7faa09e59640 1 --2- 172.21.15.88:0/2393806920 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faa04070490 0x7faa040ad6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:51.237 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.231+0000 7faa0a65a640 1 --2- 172.21.15.88:0/2393806920 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faa041541d0 0x7faa041ecdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:51.237 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.231+0000 7faa09658640 1 -- 172.21.15.88:0/2393806920 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faa041541d0 msgr2=0x7faa041ecdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:51.237 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.231+0000 7faa09658640 1 --2- 172.21.15.88:0/2393806920 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faa041541d0 0x7faa041ecdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:51.237 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.231+0000 7faa09658640 1 -- 172.21.15.88:0/2393806920 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faa04070490 msgr2=0x7faa040ad6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:51.237 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.231+0000 7faa09658640 1 --2- 172.21.15.88:0/2393806920 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faa04070490 0x7faa040ad6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:51.237 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.231+0000 7faa09658640 1 -- 172.21.15.88:0/2393806920 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa040a92e0 con 0x7faa040c7960 2024-04-26T23:49:51.237 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.231+0000 7faa09658640 1 --2- 172.21.15.88:0/2393806920 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faa040c7960 0x7faa041ec870 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fa9f400e890 tx=0x7fa9f400ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:49:51.237 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.231+0000 7fa9fa7fc640 1 -- 172.21.15.88:0/2393806920 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9f4017070 con 0x7faa040c7960 2024-04-26T23:49:51.237 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.232+0000 7fa9fa7fc640 1 -- 172.21.15.88:0/2393806920 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9f400c940 con 0x7faa040c7960 2024-04-26T23:49:51.237 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.232+0000 7fa9fa7fc640 1 -- 172.21.15.88:0/2393806920 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9f400cd10 con 0x7faa040c7960 2024-04-26T23:49:51.238 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.232+0000 7faa0c0bd640 1 -- 172.21.15.88:0/2393806920 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa04159dc0 con 0x7faa040c7960 2024-04-26T23:49:51.238 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.232+0000 7faa0c0bd640 1 -- 172.21.15.88:0/2393806920 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa040a7e90 con 0x7faa040c7960 2024-04-26T23:49:51.238 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.233+0000 7faa0c0bd640 1 -- 172.21.15.88:0/2393806920 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa04152f50 con 0x7faa040c7960 2024-04-26T23:49:51.238 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.233+0000 7fa9fa7fc640 1 -- 172.21.15.88:0/2393806920 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa9f401a070 con 0x7faa040c7960 2024-04-26T23:49:51.239 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.233+0000 7fa9fa7fc640 1 --2- 172.21.15.88:0/2393806920 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fa9e806c8f0 0x7fa9e806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:51.239 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.233+0000 7fa9fa7fc640 1 -- 172.21.15.88:0/2393806920 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6666+0+0 (secure 0 0 0) 0x7fa9f408bd30 con 0x7faa040c7960 2024-04-26T23:49:51.239 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.234+0000 7faa09e59640 1 --2- 172.21.15.88:0/2393806920 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fa9e806c8f0 0x7fa9e806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:51.239 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.234+0000 7faa09e59640 1 --2- 172.21.15.88:0/2393806920 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fa9e806c8f0 0x7fa9e806edb0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7faa04151990 tx=0x7faa00009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:49:51.241 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.238+0000 7fa9fa7fc640 1 -- 172.21.15.88:0/2393806920 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7faa04152f50 con 0x7faa040c7960 2024-04-26T23:49:51.429 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.425+0000 7faa0c0bd640 1 -- 172.21.15.88:0/2393806920 --> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) -- 0x7faa040507a0 con 0x7fa9e806c8f0 2024-04-26T23:49:51.429 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.426+0000 7fa9fa7fc640 1 -- 172.21.15.88:0/2393806920 <== mgr.4104 v2:172.21.15.88:6832/651674297 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7faa040507a0 con 0x7fa9e806c8f0 2024-04-26T23:49:51.429 INFO:teuthology.orchestra.run.smithi088.stderr:instructed osd(s) 7 to deep-scrub 2024-04-26T23:49:51.431 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.427+0000 7faa0c0bd640 1 -- 172.21.15.88:0/2393806920 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fa9e806c8f0 msgr2=0x7fa9e806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:51.431 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.427+0000 7faa0c0bd640 1 --2- 172.21.15.88:0/2393806920 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fa9e806c8f0 0x7fa9e806edb0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7faa04151990 tx=0x7faa00009190 comp rx=0 tx=0).stop 2024-04-26T23:49:51.431 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.427+0000 7faa0c0bd640 1 -- 172.21.15.88:0/2393806920 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faa040c7960 msgr2=0x7faa041ec870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:51.431 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.427+0000 7faa0c0bd640 1 --2- 172.21.15.88:0/2393806920 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faa040c7960 0x7faa041ec870 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fa9f400e890 tx=0x7fa9f400ed50 comp rx=0 tx=0).stop 2024-04-26T23:49:51.431 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.427+0000 7faa0c0bd640 1 -- 172.21.15.88:0/2393806920 shutdown_connections 2024-04-26T23:49:51.432 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.427+0000 7faa0c0bd640 1 --2- 172.21.15.88:0/2393806920 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fa9e806c8f0 0x7fa9e806edb0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:51.432 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.427+0000 7faa0c0bd640 1 --2- 172.21.15.88:0/2393806920 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faa041541d0 0x7faa041ecdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:51.432 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.427+0000 7faa0c0bd640 1 --2- 172.21.15.88:0/2393806920 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faa040c7960 0x7faa041ec870 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:51.432 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.427+0000 7faa0c0bd640 1 --2- 172.21.15.88:0/2393806920 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faa04070490 0x7faa040ad6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:51.432 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.427+0000 7faa0c0bd640 1 -- 172.21.15.88:0/2393806920 >> 172.21.15.88:0/2393806920 conn(0x7faa040c8c40 msgr2=0x7faa040c7f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:49:51.432 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.428+0000 7faa0c0bd640 1 -- 172.21.15.88:0/2393806920 shutdown_connections 2024-04-26T23:49:51.432 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.428+0000 7faa0c0bd640 1 -- 172.21.15.88:0/2393806920 wait complete. 2024-04-26T23:49:51.443 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T23:49:51.539 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.535+0000 7f92ef62a640 1 Processor -- start 2024-04-26T23:49:51.539 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.535+0000 7f92ef62a640 1 -- start start 2024-04-26T23:49:51.542 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.536+0000 7f92ef62a640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f92e8156bb0 0x7f92e815a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:51.542 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.536+0000 7f92ef62a640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f92e80c8df0 con 0x7f92e80ca5a0 2024-04-26T23:49:51.542 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.536+0000 7f92ef62a640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f92e8154540 con 0x7f92e8154160 2024-04-26T23:49:51.543 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.536+0000 7f92ef62a640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f92e815a6e0 con 0x7f92e8156bb0 2024-04-26T23:49:51.543 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.536+0000 7f92ecbc5640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f92e80ca5a0 0x7f92e80c9590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:43896/0 (socket says 172.21.15.88:43896) 2024-04-26T23:49:51.543 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.536+0000 7f92ecbc5640 1 -- 172.21.15.88:0/4210267754 learned_addr learned my addr 172.21.15.88:0/4210267754 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-26T23:49:51.543 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.536+0000 7f92dffff640 1 -- 172.21.15.88:0/4210267754 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2177419347 0 0) 0x7f92d8001110 con 0x7f92e80ca5a0 2024-04-26T23:49:51.543 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.537+0000 7f92dffff640 1 -- 172.21.15.88:0/4210267754 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f92d4003520 con 0x7f92e80ca5a0 2024-04-26T23:49:51.543 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.537+0000 7f92edbc7640 1 --2- 172.21.15.88:0/4210267754 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f92e8156bb0 0x7f92e815a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:51.543 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.537+0000 7f92dffff640 1 -- 172.21.15.88:0/4210267754 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 625457413 0 0) 0x7f92d4003520 con 0x7f92e80ca5a0 2024-04-26T23:49:51.543 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.537+0000 7f92dffff640 1 -- 172.21.15.88:0/4210267754 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f92e8156bb0 msgr2=0x7f92e815a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:49:51.543 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.537+0000 7f92dffff640 1 --2- 172.21.15.88:0/4210267754 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f92e8156bb0 0x7f92e815a1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:51.543 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.537+0000 7f92dffff640 1 -- 172.21.15.88:0/4210267754 >> v1:172.21.15.175:6789/0 conn(0x7f92e8154160 legacy=0x7f92e80c6e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:51.543 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.537+0000 7f92dffff640 1 -- 172.21.15.88:0/4210267754 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92e815a910 con 0x7f92e80ca5a0 2024-04-26T23:49:51.543 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.537+0000 7f92dffff640 1 -- 172.21.15.88:0/4210267754 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 356324787 0 0) 0x7f92d8001840 con 0x7f92e80ca5a0 2024-04-26T23:49:51.543 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.537+0000 7f92dffff640 1 -- 172.21.15.88:0/4210267754 >> v1:172.21.15.88:6789/0 conn(0x7f92e80ca5a0 legacy=0x7f92e80c9590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:51.544 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.537+0000 7f92dffff640 1 --2- 172.21.15.88:0/4210267754 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f92e8156bb0 0x7f92d40039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:51.544 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.537+0000 7f92dffff640 1 --2- 172.21.15.88:0/4210267754 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f92d4003f60 0x7f92d4004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:51.544 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.537+0000 7f92dffff640 1 --2- 172.21.15.88:0/4210267754 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f92d4004d40 0x7f92d40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:51.544 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.537+0000 7f92dffff640 1 -- 172.21.15.88:0/4210267754 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f92d400ba70 con 0x7f92d4004d40 2024-04-26T23:49:51.544 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.537+0000 7f92dffff640 1 -- 172.21.15.88:0/4210267754 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f92d400bc20 con 0x7f92d4003f60 2024-04-26T23:49:51.544 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.537+0000 7f92dffff640 1 -- 172.21.15.88:0/4210267754 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f92d400be20 con 0x7f92e8156bb0 2024-04-26T23:49:51.544 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.537+0000 7f92edbc7640 1 --2- 172.21.15.88:0/4210267754 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f92d4004d40 0x7f92d40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:51.544 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.537+0000 7f92ecbc5640 1 --2- 172.21.15.88:0/4210267754 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f92d4003f60 0x7f92d4004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:51.544 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.537+0000 7f92ed3c6640 1 --2- 172.21.15.88:0/4210267754 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f92e8156bb0 0x7f92d40039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:51.544 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.537+0000 7f92edbc7640 1 -- 172.21.15.88:0/4210267754 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f92e8156bb0 msgr2=0x7f92d40039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:49:51.544 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.537+0000 7f92edbc7640 1 --2- 172.21.15.88:0/4210267754 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f92e8156bb0 0x7f92d40039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:51.544 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.537+0000 7f92edbc7640 1 -- 172.21.15.88:0/4210267754 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f92d4003f60 msgr2=0x7f92d4004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:49:51.544 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.537+0000 7f92edbc7640 1 --2- 172.21.15.88:0/4210267754 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f92d4003f60 0x7f92d4004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:51.544 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.537+0000 7f92edbc7640 1 -- 172.21.15.88:0/4210267754 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92d4003520 con 0x7f92d4004d40 2024-04-26T23:49:51.544 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.538+0000 7f92edbc7640 1 --2- 172.21.15.88:0/4210267754 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f92d4004d40 0x7f92d40051c0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f92e0009ac0 tx=0x7f92d4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31987cb1dde3d7a0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:49:51.545 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.538+0000 7f92dffff640 1 -- 172.21.15.88:0/4210267754 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92e0036070 con 0x7f92d4004d40 2024-04-26T23:49:51.545 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.538+0000 7f92dffff640 1 -- 172.21.15.88:0/4210267754 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92e0031400 con 0x7f92d4004d40 2024-04-26T23:49:51.545 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.538+0000 7f92dffff640 1 -- 172.21.15.88:0/4210267754 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92e0009690 con 0x7f92d4004d40 2024-04-26T23:49:51.545 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.539+0000 7f92ef62a640 1 -- 172.21.15.88:0/4210267754 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f92d4004d40 msgr2=0x7f92d40051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:51.545 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.539+0000 7f92ef62a640 1 --2- 172.21.15.88:0/4210267754 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f92d4004d40 0x7f92d40051c0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f92e0009ac0 tx=0x7f92d4005830 comp rx=0 tx=0).stop 2024-04-26T23:49:51.545 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.539+0000 7f92edbc7640 1 -- 172.21.15.88:0/4210267754 reap_dead start 2024-04-26T23:49:51.545 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.539+0000 7f92ef62a640 1 -- 172.21.15.88:0/4210267754 shutdown_connections 2024-04-26T23:49:51.545 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.539+0000 7f92ef62a640 1 -- 172.21.15.88:0/4210267754 >> 172.21.15.88:0/4210267754 conn(0x7f92e80ae010 msgr2=0x7f92e80ae3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:49:51.545 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.539+0000 7f92ef62a640 1 -- 172.21.15.88:0/4210267754 shutdown_connections 2024-04-26T23:49:51.545 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.539+0000 7f92ef62a640 1 -- 172.21.15.88:0/4210267754 wait complete. 2024-04-26T23:49:51.548 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.540+0000 7f92ef62a640 1 Processor -- start 2024-04-26T23:49:51.548 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.540+0000 7f92ef62a640 1 -- start start 2024-04-26T23:49:51.548 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.540+0000 7f92ef62a640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f92e814e700 0x7f92e80b1760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:51.548 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.540+0000 7f92ef62a640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f92e81500d0 0x7f92e8150510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:51.548 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.540+0000 7f92ef62a640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f92e8150a50 0x7f92e814f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:51.548 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.540+0000 7f92ef62a640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f92e815aed0 con 0x7f92e8150a50 2024-04-26T23:49:51.549 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.540+0000 7f92ef62a640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f92e80c9100 con 0x7f92e814e700 2024-04-26T23:49:51.549 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.540+0000 7f92ef62a640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f92e80c7510 con 0x7f92e81500d0 2024-04-26T23:49:51.549 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.540+0000 7f92edbc7640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f92e8150a50 0x7f92e814f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:51.549 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.540+0000 7f92edbc7640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f92e8150a50 0x7f92e814f090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:50378/0 (socket says 172.21.15.88:50378) 2024-04-26T23:49:51.549 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.540+0000 7f92edbc7640 1 -- 172.21.15.88:0/3696388513 learned_addr learned my addr 172.21.15.88:0/3696388513 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:49:51.549 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.541+0000 7f92ecbc5640 1 --2- 172.21.15.88:0/3696388513 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f92e81500d0 0x7f92e8150510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:51.549 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.541+0000 7f92ed3c6640 1 --2- 172.21.15.88:0/3696388513 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f92e814e700 0x7f92e80b1760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:51.549 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.541+0000 7f92edbc7640 1 -- 172.21.15.88:0/3696388513 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f92e81500d0 msgr2=0x7f92e8150510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:51.549 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.541+0000 7f92edbc7640 1 --2- 172.21.15.88:0/3696388513 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f92e81500d0 0x7f92e8150510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:51.549 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.541+0000 7f92edbc7640 1 -- 172.21.15.88:0/3696388513 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f92e814e700 msgr2=0x7f92e80b1760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:51.549 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.541+0000 7f92edbc7640 1 --2- 172.21.15.88:0/3696388513 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f92e814e700 0x7f92e80b1760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:51.549 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.541+0000 7f92edbc7640 1 -- 172.21.15.88:0/3696388513 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92e8151440 con 0x7f92e8150a50 2024-04-26T23:49:51.549 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.541+0000 7f92ed3c6640 1 --2- 172.21.15.88:0/3696388513 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f92e814e700 0x7f92e80b1760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:49:51.549 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.541+0000 7f92edbc7640 1 --2- 172.21.15.88:0/3696388513 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f92e8150a50 0x7f92e814f090 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f92e0034040 tx=0x7f92e0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:49:51.549 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.541+0000 7f92ddffb640 1 -- 172.21.15.88:0/3696388513 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92e0041070 con 0x7f92e8150a50 2024-04-26T23:49:51.550 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.541+0000 7f92ddffb640 1 -- 172.21.15.88:0/3696388513 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92e0037040 con 0x7f92e8150a50 2024-04-26T23:49:51.550 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.541+0000 7f92ef62a640 1 -- 172.21.15.88:0/3696388513 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92e80afc40 con 0x7f92e8150a50 2024-04-26T23:49:51.550 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.541+0000 7f92ddffb640 1 -- 172.21.15.88:0/3696388513 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92e0036070 con 0x7f92e8150a50 2024-04-26T23:49:51.550 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.541+0000 7f92ef62a640 1 -- 172.21.15.88:0/3696388513 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92e80b01c0 con 0x7f92e8150a50 2024-04-26T23:49:51.550 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.542+0000 7f92ef62a640 1 -- 172.21.15.88:0/3696388513 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f92e8076650 con 0x7f92e8150a50 2024-04-26T23:49:51.550 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.543+0000 7f92ddffb640 1 -- 172.21.15.88:0/3696388513 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f92e0044070 con 0x7f92e8150a50 2024-04-26T23:49:51.550 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.543+0000 7f92ddffb640 1 --2- 172.21.15.88:0/3696388513 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f92cc06c8f0 0x7f92cc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:49:51.550 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.543+0000 7f92ddffb640 1 -- 172.21.15.88:0/3696388513 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6666+0+0 (secure 0 0 0) 0x7f92e00ab550 con 0x7f92e8150a50 2024-04-26T23:49:51.550 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.543+0000 7f92ed3c6640 1 --2- 172.21.15.88:0/3696388513 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f92cc06c8f0 0x7f92cc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:49:51.550 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.543+0000 7f92ed3c6640 1 --2- 172.21.15.88:0/3696388513 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f92cc06c8f0 0x7f92cc06edb0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f92e4003fc0 tx=0x7f92e4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:49:51.550 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.547+0000 7f92ddffb640 1 -- 172.21.15.88:0/3696388513 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f92e0078ee0 con 0x7f92e8150a50 2024-04-26T23:49:51.723 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.720+0000 7f92ef62a640 1 -- 172.21.15.88:0/3696388513 --> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f92e80bfbd0 con 0x7f92cc06c8f0 2024-04-26T23:49:51.734 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.731+0000 7f92ddffb640 1 -- 172.21.15.88:0/3696388513 <== mgr.4104 v2:172.21.15.88:6832/651674297 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+491511 (secure 0 0 0) 0x7f92e80bfbd0 con 0x7f92cc06c8f0 2024-04-26T23:49:51.739 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-26T23:49:51.742 INFO:teuthology.orchestra.run.smithi088.stderr:dumped all 2024-04-26T23:49:51.744 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.735+0000 7f92ef62a640 1 -- 172.21.15.88:0/3696388513 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f92cc06c8f0 msgr2=0x7f92cc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:51.744 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.735+0000 7f92ef62a640 1 --2- 172.21.15.88:0/3696388513 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f92cc06c8f0 0x7f92cc06edb0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f92e4003fc0 tx=0x7f92e4009040 comp rx=0 tx=0).stop 2024-04-26T23:49:51.744 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.735+0000 7f92ef62a640 1 -- 172.21.15.88:0/3696388513 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f92e8150a50 msgr2=0x7f92e814f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:49:51.745 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.735+0000 7f92ef62a640 1 --2- 172.21.15.88:0/3696388513 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f92e8150a50 0x7f92e814f090 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f92e0034040 tx=0x7f92e0004730 comp rx=0 tx=0).stop 2024-04-26T23:49:51.745 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.735+0000 7f92ef62a640 1 -- 172.21.15.88:0/3696388513 shutdown_connections 2024-04-26T23:49:51.745 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.735+0000 7f92ef62a640 1 --2- 172.21.15.88:0/3696388513 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f92cc06c8f0 0x7f92cc06edb0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:51.745 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.735+0000 7f92ef62a640 1 --2- 172.21.15.88:0/3696388513 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f92e81500d0 0x7f92e8150510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:51.745 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.735+0000 7f92ef62a640 1 --2- 172.21.15.88:0/3696388513 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f92e8150a50 0x7f92e814f090 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:51.745 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.735+0000 7f92ef62a640 1 --2- 172.21.15.88:0/3696388513 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f92e814e700 0x7f92e80b1760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:49:51.745 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.735+0000 7f92ef62a640 1 -- 172.21.15.88:0/3696388513 >> 172.21.15.88:0/3696388513 conn(0x7f92e80ae010 msgr2=0x7f92e81553a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:49:51.745 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.735+0000 7f92ef62a640 1 -- 172.21.15.88:0/3696388513 shutdown_connections 2024-04-26T23:49:51.745 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:49:51.735+0000 7f92ef62a640 1 -- 172.21.15.88:0/3696388513 wait complete. 2024-04-26T23:49:51.750 INFO:teuthology.orchestra.run.smithi088.stdout:{"pg_ready":true,"pg_map":{"version":305,"stamp":"2024-04-26T23:49:50.109002+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":308985889,"num_objects":120,"num_object_clones":0,"num_object_copies":240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":120,"num_whiteouts":0,"num_read":149,"num_read_kb":293,"num_write":8375229,"num_write_kb":107315379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":561126,"ondisk_log_size":561126,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":386,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":5741088,"kb_used_data":605792,"kb_used_omap":12,"kb_used_meta":5135219,"kb_avail":749233632,"statfs":{"total":773094113280,"available":767215239168,"internally_reserved":0,"allocated":620331008,"data_stored":618877010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":5258464816},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":21,"apply_latency_ms":21,"commit_latency_ns":21000000,"apply_latency_ns":21000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-7749011381,"num_objects":-2047,"num_object_clones":0,"num_object_copies":-4094,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-2047,"num_whiteouts":0,"num_read":3,"num_read_kb":9,"num_write":2077,"num_write_kb":334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002720"},"pg_stats":[{"pgid":"5.18","version":"26'4255","reported_seq":4274,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:45.187251+0000","last_change":"2024-04-26T23:40:41.683801+0000","last_active":"2024-04-26T23:49:45.187251+0000","last_peered":"2024-04-26T23:49:45.187251+0000","last_clean":"2024-04-26T23:49:45.187251+0000","last_became_active":"2024-04-26T23:40:41.683484+0000","last_became_peered":"2024-04-26T23:40:41.683484+0000","last_unstale":"2024-04-26T23:49:45.187251+0000","last_undegraded":"2024-04-26T23:49:45.187251+0000","last_fullsized":"2024-04-26T23:49:45.187251+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":4255,"log_dups_size":0,"ondisk_log_size":4255,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:02:27.160408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":63732,"num_write_kb":854695,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1f","version":"26'15","reported_seq":46,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:48:43.487038+0000","last_change":"2024-04-26T23:40:31.576688+0000","last_active":"2024-04-26T23:48:43.487038+0000","last_peered":"2024-04-26T23:48:43.487038+0000","last_clean":"2024-04-26T23:48:43.487038+0000","last_became_active":"2024-04-26T23:40:31.576429+0000","last_became_peered":"2024-04-26T23:40:31.576429+0000","last_unstale":"2024-04-26T23:48:43.487038+0000","last_undegraded":"2024-04-26T23:48:43.487038+0000","last_fullsized":"2024-04-26T23:48:43.487038+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":4100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"26'4412","reported_seq":4441,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.865922+0000","last_change":"2024-04-26T23:40:32.578489+0000","last_active":"2024-04-26T23:49:42.865922+0000","last_peered":"2024-04-26T23:49:42.865922+0000","last_clean":"2024-04-26T23:49:42.865922+0000","last_became_active":"2024-04-26T23:40:32.578205+0000","last_became_peered":"2024-04-26T23:40:32.578205+0000","last_unstale":"2024-04-26T23:49:42.865922+0000","last_undegraded":"2024-04-26T23:49:42.865922+0000","last_fullsized":"2024-04-26T23:49:42.865922+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":4412,"log_dups_size":0,"ondisk_log_size":4412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":66444,"num_write_kb":860244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"26'23","reported_seq":45,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:30.311768+0000","last_change":"2024-04-26T23:40:40.666861+0000","last_active":"2024-04-26T23:49:30.311768+0000","last_peered":"2024-04-26T23:49:30.311768+0000","last_clean":"2024-04-26T23:49:30.311768+0000","last_became_active":"2024-04-26T23:40:40.666547+0000","last_became_peered":"2024-04-26T23:40:40.666547+0000","last_unstale":"2024-04-26T23:49:30.311768+0000","last_undegraded":"2024-04-26T23:49:30.311768+0000","last_fullsized":"2024-04-26T23:49:30.311768+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":4105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"26'5312","reported_seq":5332,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:45.270848+0000","last_change":"2024-04-26T23:40:41.689530+0000","last_active":"2024-04-26T23:49:45.270848+0000","last_peered":"2024-04-26T23:49:45.270848+0000","last_clean":"2024-04-26T23:49:45.270848+0000","last_became_active":"2024-04-26T23:40:41.687652+0000","last_became_peered":"2024-04-26T23:40:41.687652+0000","last_unstale":"2024-04-26T23:49:45.270848+0000","last_undegraded":"2024-04-26T23:49:45.270848+0000","last_fullsized":"2024-04-26T23:49:45.270848+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":5312,"log_dups_size":0,"ondisk_log_size":5312,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79884,"num_write_kb":1001634,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1e","version":"26'29","reported_seq":60,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:36.421129+0000","last_change":"2024-04-26T23:40:31.576867+0000","last_active":"2024-04-26T23:49:36.421129+0000","last_peered":"2024-04-26T23:49:36.421129+0000","last_clean":"2024-04-26T23:49:36.421129+0000","last_became_active":"2024-04-26T23:40:31.576342+0000","last_became_peered":"2024-04-26T23:40:31.576342+0000","last_unstale":"2024-04-26T23:49:36.421129+0000","last_undegraded":"2024-04-26T23:49:36.421129+0000","last_fullsized":"2024-04-26T23:49:36.421129+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":4114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"26'5109","reported_seq":5123,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.891036+0000","last_change":"2024-04-26T23:41:30.628386+0000","last_active":"2024-04-26T23:49:42.891036+0000","last_peered":"2024-04-26T23:49:42.891036+0000","last_clean":"2024-04-26T23:49:42.891036+0000","last_became_active":"2024-04-26T23:41:30.628139+0000","last_became_peered":"2024-04-26T23:41:30.628139+0000","last_unstale":"2024-04-26T23:49:42.891036+0000","last_undegraded":"2024-04-26T23:49:42.891036+0000","last_fullsized":"2024-04-26T23:49:42.891036+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":5109,"log_dups_size":0,"ondisk_log_size":5109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:10:21.873566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":76507,"num_write_kb":979233,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"26'25","reported_seq":46,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:30.276499+0000","last_change":"2024-04-26T23:40:40.672310+0000","last_active":"2024-04-26T23:49:30.276499+0000","last_peered":"2024-04-26T23:49:30.276499+0000","last_clean":"2024-04-26T23:49:30.276499+0000","last_became_active":"2024-04-26T23:40:40.672018+0000","last_became_peered":"2024-04-26T23:40:40.672018+0000","last_unstale":"2024-04-26T23:49:30.276499+0000","last_undegraded":"2024-04-26T23:49:30.276499+0000","last_fullsized":"2024-04-26T23:49:30.276499+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:01:10.835670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":8211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"26'3926","reported_seq":3945,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:45.273676+0000","last_change":"2024-04-26T23:40:41.686743+0000","last_active":"2024-04-26T23:49:45.273676+0000","last_peered":"2024-04-26T23:49:45.273676+0000","last_clean":"2024-04-26T23:49:45.273676+0000","last_became_active":"2024-04-26T23:40:41.686419+0000","last_became_peered":"2024-04-26T23:40:41.686419+0000","last_unstale":"2024-04-26T23:49:45.273676+0000","last_undegraded":"2024-04-26T23:49:45.273676+0000","last_fullsized":"2024-04-26T23:49:45.273676+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":3926,"log_dups_size":0,"ondisk_log_size":3926,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:08:35.027584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":59060,"num_write_kb":735586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1d","version":"26'46","reported_seq":75,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:36.404066+0000","last_change":"2024-04-26T23:40:31.578735+0000","last_active":"2024-04-26T23:49:36.404066+0000","last_peered":"2024-04-26T23:49:36.404066+0000","last_clean":"2024-04-26T23:49:36.404066+0000","last_became_active":"2024-04-26T23:40:31.578438+0000","last_became_peered":"2024-04-26T23:40:31.578438+0000","last_unstale":"2024-04-26T23:49:36.404066+0000","last_undegraded":"2024-04-26T23:49:36.404066+0000","last_fullsized":"2024-04-26T23:49:36.404066+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:30:10.397569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37,"num_write_kb":12306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"26'2988","reported_seq":3015,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.975858+0000","last_change":"2024-04-26T23:40:32.590624+0000","last_active":"2024-04-26T23:49:42.975858+0000","last_peered":"2024-04-26T23:49:42.975858+0000","last_clean":"2024-04-26T23:49:42.975858+0000","last_became_active":"2024-04-26T23:40:32.589687+0000","last_became_peered":"2024-04-26T23:40:32.589687+0000","last_unstale":"2024-04-26T23:49:42.975858+0000","last_undegraded":"2024-04-26T23:49:42.975858+0000","last_fullsized":"2024-04-26T23:49:42.975858+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":2988,"log_dups_size":0,"ondisk_log_size":2988,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:01:02.741964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44847,"num_write_kb":570063,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"26'1255","reported_seq":1276,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.843735+0000","last_change":"2024-04-26T23:40:40.677899+0000","last_active":"2024-04-26T23:48:13.843735+0000","last_peered":"2024-04-26T23:48:13.843735+0000","last_clean":"2024-04-26T23:48:13.843735+0000","last_became_active":"2024-04-26T23:40:40.677388+0000","last_became_peered":"2024-04-26T23:40:40.677388+0000","last_unstale":"2024-04-26T23:48:13.843735+0000","last_undegraded":"2024-04-26T23:48:13.843735+0000","last_fullsized":"2024-04-26T23:48:13.843735+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":1255,"log_dups_size":0,"ondisk_log_size":1255,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:52:34.793496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1253,"num_write_kb":5260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"26'3559","reported_seq":3578,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:45.204701+0000","last_change":"2024-04-26T23:40:41.680097+0000","last_active":"2024-04-26T23:49:45.204701+0000","last_peered":"2024-04-26T23:49:45.204701+0000","last_clean":"2024-04-26T23:49:45.204701+0000","last_became_active":"2024-04-26T23:40:41.679815+0000","last_became_peered":"2024-04-26T23:40:41.679815+0000","last_unstale":"2024-04-26T23:49:45.204701+0000","last_undegraded":"2024-04-26T23:49:45.204701+0000","last_fullsized":"2024-04-26T23:49:45.204701+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":3559,"log_dups_size":0,"ondisk_log_size":3559,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:10:30.972726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53503,"num_write_kb":665423,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"26'17","reported_seq":46,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:48:02.410604+0000","last_change":"2024-04-26T23:40:31.573648+0000","last_active":"2024-04-26T23:48:02.410604+0000","last_peered":"2024-04-26T23:48:02.410604+0000","last_clean":"2024-04-26T23:48:02.410604+0000","last_became_active":"2024-04-26T23:40:31.573347+0000","last_became_peered":"2024-04-26T23:40:31.573347+0000","last_unstale":"2024-04-26T23:48:02.410604+0000","last_undegraded":"2024-04-26T23:48:02.410604+0000","last_fullsized":"2024-04-26T23:48:02.410604+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:20:28.103413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":4100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"26'5057","reported_seq":5084,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.997446+0000","last_change":"2024-04-26T23:40:32.588309+0000","last_active":"2024-04-26T23:49:42.997446+0000","last_peered":"2024-04-26T23:49:42.997446+0000","last_clean":"2024-04-26T23:49:42.997446+0000","last_became_active":"2024-04-26T23:40:32.588007+0000","last_became_peered":"2024-04-26T23:40:32.588007+0000","last_unstale":"2024-04-26T23:49:42.997446+0000","last_undegraded":"2024-04-26T23:49:42.997446+0000","last_fullsized":"2024-04-26T23:49:42.997446+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":5057,"log_dups_size":0,"ondisk_log_size":5057,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:52:26.699790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":75905,"num_write_kb":967615,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"26'33","reported_seq":54,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:30.327673+0000","last_change":"2024-04-26T23:40:40.678547+0000","last_active":"2024-04-26T23:49:30.327673+0000","last_peered":"2024-04-26T23:49:30.327673+0000","last_clean":"2024-04-26T23:49:30.327673+0000","last_became_active":"2024-04-26T23:40:40.677668+0000","last_became_peered":"2024-04-26T23:40:40.677668+0000","last_unstale":"2024-04-26T23:49:30.327673+0000","last_undegraded":"2024-04-26T23:49:30.327673+0000","last_fullsized":"2024-04-26T23:49:30.327673+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:34:22.905623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":12307,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"26'4803","reported_seq":4824,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:45.245720+0000","last_change":"2024-04-26T23:40:41.689525+0000","last_active":"2024-04-26T23:49:45.245720+0000","last_peered":"2024-04-26T23:49:45.245720+0000","last_clean":"2024-04-26T23:49:45.245720+0000","last_became_active":"2024-04-26T23:40:41.687433+0000","last_became_peered":"2024-04-26T23:40:41.687433+0000","last_unstale":"2024-04-26T23:49:45.245720+0000","last_undegraded":"2024-04-26T23:49:45.245720+0000","last_fullsized":"2024-04-26T23:49:45.245720+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":4803,"log_dups_size":0,"ondisk_log_size":4803,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":72371,"num_write_kb":916696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"26'3820","reported_seq":3848,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.852304+0000","last_change":"2024-04-26T23:40:32.590053+0000","last_active":"2024-04-26T23:49:42.852304+0000","last_peered":"2024-04-26T23:49:42.852304+0000","last_clean":"2024-04-26T23:49:42.852304+0000","last_became_active":"2024-04-26T23:40:32.589802+0000","last_became_peered":"2024-04-26T23:40:32.589802+0000","last_unstale":"2024-04-26T23:49:42.852304+0000","last_undegraded":"2024-04-26T23:49:42.852304+0000","last_fullsized":"2024-04-26T23:49:42.852304+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":3820,"log_dups_size":0,"ondisk_log_size":3820,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:16:46.547536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":57277,"num_write_kb":731452,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"26'244","reported_seq":274,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:36.412818+0000","last_change":"2024-04-26T23:40:31.578524+0000","last_active":"2024-04-26T23:49:36.412818+0000","last_peered":"2024-04-26T23:49:36.412818+0000","last_clean":"2024-04-26T23:49:36.412818+0000","last_became_active":"2024-04-26T23:40:31.578230+0000","last_became_peered":"2024-04-26T23:40:31.578230+0000","last_unstale":"2024-04-26T23:49:36.412818+0000","last_undegraded":"2024-04-26T23:49:36.412818+0000","last_fullsized":"2024-04-26T23:49:36.412818+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":244,"log_dups_size":0,"ondisk_log_size":244,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:15:51.937774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":234,"num_write_kb":8395,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"26'20","reported_seq":42,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:30.306579+0000","last_change":"2024-04-26T23:40:40.676459+0000","last_active":"2024-04-26T23:49:30.306579+0000","last_peered":"2024-04-26T23:49:30.306579+0000","last_clean":"2024-04-26T23:49:30.306579+0000","last_became_active":"2024-04-26T23:40:40.675997+0000","last_became_peered":"2024-04-26T23:40:40.675997+0000","last_unstale":"2024-04-26T23:49:30.306579+0000","last_undegraded":"2024-04-26T23:49:30.306579+0000","last_fullsized":"2024-04-26T23:49:30.306579+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:37:38.455501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":4105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"26'4643","reported_seq":4663,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:45.231580+0000","last_change":"2024-04-26T23:40:41.679334+0000","last_active":"2024-04-26T23:49:45.231580+0000","last_peered":"2024-04-26T23:49:45.231580+0000","last_clean":"2024-04-26T23:49:45.231580+0000","last_became_active":"2024-04-26T23:40:41.679098+0000","last_became_peered":"2024-04-26T23:40:41.679098+0000","last_unstale":"2024-04-26T23:49:45.231580+0000","last_undegraded":"2024-04-26T23:49:45.231580+0000","last_fullsized":"2024-04-26T23:49:45.231580+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":4643,"log_dups_size":0,"ondisk_log_size":4643,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:52:35.798951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69716,"num_write_kb":886548,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"26'3484","reported_seq":3513,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.915893+0000","last_change":"2024-04-26T23:40:32.585827+0000","last_active":"2024-04-26T23:49:42.915893+0000","last_peered":"2024-04-26T23:49:42.915893+0000","last_clean":"2024-04-26T23:49:42.915893+0000","last_became_active":"2024-04-26T23:40:32.585522+0000","last_became_peered":"2024-04-26T23:40:32.585522+0000","last_unstale":"2024-04-26T23:49:42.915893+0000","last_undegraded":"2024-04-26T23:49:42.915893+0000","last_fullsized":"2024-04-26T23:49:42.915893+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":3484,"log_dups_size":0,"ondisk_log_size":3484,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":52204,"num_write_kb":651184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"26'16","reported_seq":47,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:36.411174+0000","last_change":"2024-04-26T23:40:31.575121+0000","last_active":"2024-04-26T23:49:36.411174+0000","last_peered":"2024-04-26T23:49:36.411174+0000","last_clean":"2024-04-26T23:49:36.411174+0000","last_became_active":"2024-04-26T23:40:31.574827+0000","last_became_peered":"2024-04-26T23:40:31.574827+0000","last_unstale":"2024-04-26T23:49:36.411174+0000","last_undegraded":"2024-04-26T23:49:36.411174+0000","last_fullsized":"2024-04-26T23:49:36.411174+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":4101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"26'4","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:32.344791+0000","last_change":"2024-04-26T23:40:40.678613+0000","last_active":"2024-04-26T23:49:32.344791+0000","last_peered":"2024-04-26T23:49:32.344791+0000","last_clean":"2024-04-26T23:49:32.344791+0000","last_became_active":"2024-04-26T23:40:40.677867+0000","last_became_peered":"2024-04-26T23:40:40.677867+0000","last_unstale":"2024-04-26T23:49:32.344791+0000","last_undegraded":"2024-04-26T23:49:32.344791+0000","last_fullsized":"2024-04-26T23:49:32.344791+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:35:16.288571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"26'4222","reported_seq":4242,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:45.267588+0000","last_change":"2024-04-26T23:40:41.685042+0000","last_active":"2024-04-26T23:49:45.267588+0000","last_peered":"2024-04-26T23:49:45.267588+0000","last_clean":"2024-04-26T23:49:45.267588+0000","last_became_active":"2024-04-26T23:40:41.684699+0000","last_became_peered":"2024-04-26T23:40:41.684699+0000","last_unstale":"2024-04-26T23:49:45.267588+0000","last_undegraded":"2024-04-26T23:49:45.267588+0000","last_fullsized":"2024-04-26T23:49:45.267588+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":4222,"log_dups_size":0,"ondisk_log_size":4222,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:10:57.826183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":63591,"num_write_kb":826339,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"26'4047","reported_seq":4076,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.908703+0000","last_change":"2024-04-26T23:40:32.582721+0000","last_active":"2024-04-26T23:49:42.908703+0000","last_peered":"2024-04-26T23:49:42.908703+0000","last_clean":"2024-04-26T23:49:42.908703+0000","last_became_active":"2024-04-26T23:40:32.582438+0000","last_became_peered":"2024-04-26T23:40:32.582438+0000","last_unstale":"2024-04-26T23:49:42.908703+0000","last_undegraded":"2024-04-26T23:49:42.908703+0000","last_fullsized":"2024-04-26T23:49:42.908703+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":4047,"log_dups_size":0,"ondisk_log_size":4047,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":60599,"num_write_kb":814129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"26'16","reported_seq":47,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:36.406581+0000","last_change":"2024-04-26T23:40:31.575508+0000","last_active":"2024-04-26T23:49:36.406581+0000","last_peered":"2024-04-26T23:49:36.406581+0000","last_clean":"2024-04-26T23:49:36.406581+0000","last_became_active":"2024-04-26T23:40:31.575242+0000","last_became_peered":"2024-04-26T23:40:31.575242+0000","last_unstale":"2024-04-26T23:49:36.406581+0000","last_undegraded":"2024-04-26T23:49:36.406581+0000","last_fullsized":"2024-04-26T23:49:36.406581+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":4101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"26'16","reported_seq":38,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:32.352424+0000","last_change":"2024-04-26T23:40:40.679196+0000","last_active":"2024-04-26T23:49:32.352424+0000","last_peered":"2024-04-26T23:49:32.352424+0000","last_clean":"2024-04-26T23:49:32.352424+0000","last_became_active":"2024-04-26T23:40:40.678740+0000","last_became_peered":"2024-04-26T23:40:40.678740+0000","last_unstale":"2024-04-26T23:49:32.352424+0000","last_undegraded":"2024-04-26T23:49:32.352424+0000","last_fullsized":"2024-04-26T23:49:32.352424+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":4110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"26'5270","reported_seq":5290,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:45.285898+0000","last_change":"2024-04-26T23:40:41.686638+0000","last_active":"2024-04-26T23:49:45.285898+0000","last_peered":"2024-04-26T23:49:45.285898+0000","last_clean":"2024-04-26T23:49:45.285898+0000","last_became_active":"2024-04-26T23:40:41.686354+0000","last_became_peered":"2024-04-26T23:40:41.686354+0000","last_unstale":"2024-04-26T23:49:45.285898+0000","last_undegraded":"2024-04-26T23:49:45.285898+0000","last_fullsized":"2024-04-26T23:49:45.285898+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":5270,"log_dups_size":0,"ondisk_log_size":5270,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:06:12.755431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79283,"num_write_kb":1000134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"26'4022","reported_seq":4050,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.889538+0000","last_change":"2024-04-26T23:40:32.583019+0000","last_active":"2024-04-26T23:49:42.889538+0000","last_peered":"2024-04-26T23:49:42.889538+0000","last_clean":"2024-04-26T23:49:42.889538+0000","last_became_active":"2024-04-26T23:40:32.582719+0000","last_became_peered":"2024-04-26T23:40:32.582719+0000","last_unstale":"2024-04-26T23:49:42.889538+0000","last_undegraded":"2024-04-26T23:49:42.889538+0000","last_fullsized":"2024-04-26T23:49:42.889538+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":4022,"log_dups_size":0,"ondisk_log_size":4022,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:25:02.319783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":60741,"num_write_kb":745879,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"26'19","reported_seq":49,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:36.391367+0000","last_change":"2024-04-26T23:40:31.576866+0000","last_active":"2024-04-26T23:49:36.391367+0000","last_peered":"2024-04-26T23:49:36.391367+0000","last_clean":"2024-04-26T23:49:36.391367+0000","last_became_active":"2024-04-26T23:40:31.576419+0000","last_became_peered":"2024-04-26T23:40:31.576419+0000","last_unstale":"2024-04-26T23:49:36.391367+0000","last_undegraded":"2024-04-26T23:49:36.391367+0000","last_fullsized":"2024-04-26T23:49:36.391367+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:45:49.295198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":4102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"26'18","reported_seq":40,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:32.332275+0000","last_change":"2024-04-26T23:40:40.675262+0000","last_active":"2024-04-26T23:49:32.332275+0000","last_peered":"2024-04-26T23:49:32.332275+0000","last_clean":"2024-04-26T23:49:32.332275+0000","last_became_active":"2024-04-26T23:40:40.674721+0000","last_became_peered":"2024-04-26T23:40:40.674721+0000","last_unstale":"2024-04-26T23:49:32.332275+0000","last_undegraded":"2024-04-26T23:49:32.332275+0000","last_fullsized":"2024-04-26T23:49:32.332275+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:56:12.403317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":4101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"26'4214","reported_seq":4235,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:45.257544+0000","last_change":"2024-04-26T23:40:41.691494+0000","last_active":"2024-04-26T23:49:45.257544+0000","last_peered":"2024-04-26T23:49:45.257544+0000","last_clean":"2024-04-26T23:49:45.257544+0000","last_became_active":"2024-04-26T23:40:41.691241+0000","last_became_peered":"2024-04-26T23:40:41.691241+0000","last_unstale":"2024-04-26T23:49:45.257544+0000","last_undegraded":"2024-04-26T23:49:45.257544+0000","last_fullsized":"2024-04-26T23:49:45.257544+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":4214,"log_dups_size":0,"ondisk_log_size":4214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":63038,"num_write_kb":829161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"26'3470","reported_seq":3499,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.893321+0000","last_change":"2024-04-26T23:40:32.584988+0000","last_active":"2024-04-26T23:49:42.893321+0000","last_peered":"2024-04-26T23:49:42.893321+0000","last_clean":"2024-04-26T23:49:42.893321+0000","last_became_active":"2024-04-26T23:40:32.584467+0000","last_became_peered":"2024-04-26T23:40:32.584467+0000","last_unstale":"2024-04-26T23:49:42.893321+0000","last_undegraded":"2024-04-26T23:49:42.893321+0000","last_fullsized":"2024-04-26T23:49:42.893321+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":3470,"log_dups_size":0,"ondisk_log_size":3470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51752,"num_write_kb":657341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"26'115","reported_seq":145,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.784144+0000","last_change":"2024-04-26T23:40:31.573721+0000","last_active":"2024-04-26T23:49:42.784144+0000","last_peered":"2024-04-26T23:49:42.784144+0000","last_clean":"2024-04-26T23:49:42.784144+0000","last_became_active":"2024-04-26T23:40:31.573434+0000","last_became_peered":"2024-04-26T23:40:31.573434+0000","last_unstale":"2024-04-26T23:49:42.784144+0000","last_undegraded":"2024-04-26T23:49:42.784144+0000","last_fullsized":"2024-04-26T23:49:42.784144+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":115,"log_dups_size":0,"ondisk_log_size":115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:20:28.103413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2675866,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":112,"num_write_kb":2659,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"26'20","reported_seq":60,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:37.321768+0000","last_change":"2024-04-26T23:40:40.678020+0000","last_active":"2024-04-26T23:49:37.321768+0000","last_peered":"2024-04-26T23:49:37.321768+0000","last_clean":"2024-04-26T23:49:37.321768+0000","last_became_active":"2024-04-26T23:40:40.677410+0000","last_became_peered":"2024-04-26T23:40:40.677410+0000","last_unstale":"2024-04-26T23:49:37.321768+0000","last_undegraded":"2024-04-26T23:49:37.321768+0000","last_fullsized":"2024-04-26T23:49:37.321768+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:44:50.588556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88181,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":98,"num_write":18,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"26'4396","reported_seq":4416,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:45.203677+0000","last_change":"2024-04-26T23:40:41.689839+0000","last_active":"2024-04-26T23:49:45.203677+0000","last_peered":"2024-04-26T23:49:45.203677+0000","last_clean":"2024-04-26T23:49:45.203677+0000","last_became_active":"2024-04-26T23:40:41.689508+0000","last_became_peered":"2024-04-26T23:40:41.689508+0000","last_unstale":"2024-04-26T23:49:45.203677+0000","last_undegraded":"2024-04-26T23:49:45.203677+0000","last_fullsized":"2024-04-26T23:49:45.203677+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":4396,"log_dups_size":0,"ondisk_log_size":4396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:17:28.672777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":66189,"num_write_kb":852725,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"26'4076","reported_seq":4105,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.949327+0000","last_change":"2024-04-26T23:40:32.594913+0000","last_active":"2024-04-26T23:49:42.949327+0000","last_peered":"2024-04-26T23:49:42.949327+0000","last_clean":"2024-04-26T23:49:42.949327+0000","last_became_active":"2024-04-26T23:40:32.594616+0000","last_became_peered":"2024-04-26T23:40:32.594616+0000","last_unstale":"2024-04-26T23:49:42.949327+0000","last_undegraded":"2024-04-26T23:49:42.949327+0000","last_fullsized":"2024-04-26T23:49:42.949327+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":4076,"log_dups_size":0,"ondisk_log_size":4076,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":61223,"num_write_kb":789949,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"26'262","reported_seq":293,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:43.290146+0000","last_change":"2024-04-26T23:40:31.576299+0000","last_active":"2024-04-26T23:49:43.290146+0000","last_peered":"2024-04-26T23:49:43.290146+0000","last_clean":"2024-04-26T23:49:43.290146+0000","last_became_active":"2024-04-26T23:40:31.576006+0000","last_became_peered":"2024-04-26T23:40:31.576006+0000","last_unstale":"2024-04-26T23:49:43.290146+0000","last_undegraded":"2024-04-26T23:49:43.290146+0000","last_fullsized":"2024-04-26T23:49:43.290146+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":262,"log_dups_size":0,"ondisk_log_size":262,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":519,"num_write_kb":200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"26'25","reported_seq":48,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:32.345008+0000","last_change":"2024-04-26T23:40:40.674806+0000","last_active":"2024-04-26T23:49:32.345008+0000","last_peered":"2024-04-26T23:49:32.345008+0000","last_clean":"2024-04-26T23:49:32.345008+0000","last_became_active":"2024-04-26T23:40:40.674557+0000","last_became_peered":"2024-04-26T23:40:40.674557+0000","last_unstale":"2024-04-26T23:49:32.345008+0000","last_undegraded":"2024-04-26T23:49:32.345008+0000","last_fullsized":"2024-04-26T23:49:32.345008+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":12298,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"26'4705","reported_seq":4725,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:45.220208+0000","last_change":"2024-04-26T23:40:41.688941+0000","last_active":"2024-04-26T23:49:45.220208+0000","last_peered":"2024-04-26T23:49:45.220208+0000","last_clean":"2024-04-26T23:49:45.220208+0000","last_became_active":"2024-04-26T23:40:41.688653+0000","last_became_peered":"2024-04-26T23:40:41.688653+0000","last_unstale":"2024-04-26T23:49:45.220208+0000","last_undegraded":"2024-04-26T23:49:45.220208+0000","last_fullsized":"2024-04-26T23:49:45.220208+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":4705,"log_dups_size":0,"ondisk_log_size":4705,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:53:13.531466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":70754,"num_write_kb":894410,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"26'4242","reported_seq":4271,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.859591+0000","last_change":"2024-04-26T23:40:32.582442+0000","last_active":"2024-04-26T23:49:42.859591+0000","last_peered":"2024-04-26T23:49:42.859591+0000","last_clean":"2024-04-26T23:49:42.859591+0000","last_became_active":"2024-04-26T23:40:32.582140+0000","last_became_peered":"2024-04-26T23:40:32.582140+0000","last_unstale":"2024-04-26T23:49:42.859591+0000","last_undegraded":"2024-04-26T23:49:42.859591+0000","last_fullsized":"2024-04-26T23:49:42.859591+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":4242,"log_dups_size":0,"ondisk_log_size":4242,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":63708,"num_write_kb":831213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"26'16","reported_seq":46,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:36.405509+0000","last_change":"2024-04-26T23:40:31.576565+0000","last_active":"2024-04-26T23:49:36.405509+0000","last_peered":"2024-04-26T23:49:36.405509+0000","last_clean":"2024-04-26T23:49:36.405509+0000","last_became_active":"2024-04-26T23:40:31.576313+0000","last_became_peered":"2024-04-26T23:40:31.576313+0000","last_unstale":"2024-04-26T23:49:36.405509+0000","last_undegraded":"2024-04-26T23:49:36.405509+0000","last_fullsized":"2024-04-26T23:49:36.405509+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:25:01.315397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":4100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"26'2","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:08.812667+0000","last_change":"2024-04-26T23:40:40.671047+0000","last_active":"2024-04-26T23:49:08.812667+0000","last_peered":"2024-04-26T23:49:08.812667+0000","last_clean":"2024-04-26T23:49:08.812667+0000","last_became_active":"2024-04-26T23:40:40.670630+0000","last_became_peered":"2024-04-26T23:40:40.670630+0000","last_unstale":"2024-04-26T23:49:08.812667+0000","last_undegraded":"2024-04-26T23:49:08.812667+0000","last_fullsized":"2024-04-26T23:49:08.812667+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"26'4144","reported_seq":4165,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:45.243700+0000","last_change":"2024-04-26T23:40:41.686221+0000","last_active":"2024-04-26T23:49:45.243700+0000","last_peered":"2024-04-26T23:49:45.243700+0000","last_clean":"2024-04-26T23:49:45.243700+0000","last_became_active":"2024-04-26T23:40:41.685961+0000","last_became_peered":"2024-04-26T23:40:41.685961+0000","last_unstale":"2024-04-26T23:49:45.243700+0000","last_undegraded":"2024-04-26T23:49:45.243700+0000","last_fullsized":"2024-04-26T23:49:45.243700+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":4144,"log_dups_size":0,"ondisk_log_size":4144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":62474,"num_write_kb":825561,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"26'3719","reported_seq":3747,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.995441+0000","last_change":"2024-04-26T23:40:32.584363+0000","last_active":"2024-04-26T23:49:42.995441+0000","last_peered":"2024-04-26T23:49:42.995441+0000","last_clean":"2024-04-26T23:49:42.995441+0000","last_became_active":"2024-04-26T23:40:32.584082+0000","last_became_peered":"2024-04-26T23:40:32.584082+0000","last_unstale":"2024-04-26T23:49:42.995441+0000","last_undegraded":"2024-04-26T23:49:42.995441+0000","last_fullsized":"2024-04-26T23:49:42.995441+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":3719,"log_dups_size":0,"ondisk_log_size":3719,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:35:08.194865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55724,"num_write_kb":725978,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"26'6","reported_seq":37,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:36.411577+0000","last_change":"2024-04-26T23:40:31.576711+0000","last_active":"2024-04-26T23:49:36.411577+0000","last_peered":"2024-04-26T23:49:36.411577+0000","last_clean":"2024-04-26T23:49:36.411577+0000","last_became_active":"2024-04-26T23:40:31.576404+0000","last_became_peered":"2024-04-26T23:40:31.576404+0000","last_unstale":"2024-04-26T23:49:36.411577+0000","last_undegraded":"2024-04-26T23:49:36.411577+0000","last_fullsized":"2024-04-26T23:49:36.411577+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"26'31","reported_seq":54,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:32.331962+0000","last_change":"2024-04-26T23:40:40.675296+0000","last_active":"2024-04-26T23:49:32.331962+0000","last_peered":"2024-04-26T23:49:32.331962+0000","last_clean":"2024-04-26T23:49:32.331962+0000","last_became_active":"2024-04-26T23:40:40.674935+0000","last_became_peered":"2024-04-26T23:40:40.674935+0000","last_unstale":"2024-04-26T23:49:32.331962+0000","last_undegraded":"2024-04-26T23:49:32.331962+0000","last_fullsized":"2024-04-26T23:49:32.331962+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":8205,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"26'3990","reported_seq":4011,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:45.235261+0000","last_change":"2024-04-26T23:40:41.691510+0000","last_active":"2024-04-26T23:49:45.235261+0000","last_peered":"2024-04-26T23:49:45.235261+0000","last_clean":"2024-04-26T23:49:45.235261+0000","last_became_active":"2024-04-26T23:40:41.691242+0000","last_became_peered":"2024-04-26T23:40:41.691242+0000","last_unstale":"2024-04-26T23:49:45.235261+0000","last_undegraded":"2024-04-26T23:49:45.235261+0000","last_fullsized":"2024-04-26T23:49:45.235261+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":3990,"log_dups_size":0,"ondisk_log_size":3990,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":59849,"num_write_kb":777586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"26'3874","reported_seq":3902,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.917138+0000","last_change":"2024-04-26T23:40:32.590069+0000","last_active":"2024-04-26T23:49:42.917138+0000","last_peered":"2024-04-26T23:49:42.917138+0000","last_clean":"2024-04-26T23:49:42.917138+0000","last_became_active":"2024-04-26T23:40:32.589790+0000","last_became_peered":"2024-04-26T23:40:32.589790+0000","last_unstale":"2024-04-26T23:49:42.917138+0000","last_undegraded":"2024-04-26T23:49:42.917138+0000","last_fullsized":"2024-04-26T23:49:42.917138+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":3874,"log_dups_size":0,"ondisk_log_size":3874,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:15:52.942160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":58064,"num_write_kb":769321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"26'25","reported_seq":55,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:36.421096+0000","last_change":"2024-04-26T23:40:31.572432+0000","last_active":"2024-04-26T23:49:36.421096+0000","last_peered":"2024-04-26T23:49:36.421096+0000","last_clean":"2024-04-26T23:49:36.421096+0000","last_became_active":"2024-04-26T23:40:31.572121+0000","last_became_peered":"2024-04-26T23:40:31.572121+0000","last_unstale":"2024-04-26T23:49:36.421096+0000","last_undegraded":"2024-04-26T23:49:36.421096+0000","last_fullsized":"2024-04-26T23:49:36.421096+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:45:49.295198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":8200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"26'6","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:32.328923+0000","last_change":"2024-04-26T23:40:40.678404+0000","last_active":"2024-04-26T23:49:32.328923+0000","last_peered":"2024-04-26T23:49:32.328923+0000","last_clean":"2024-04-26T23:49:32.328923+0000","last_became_active":"2024-04-26T23:40:40.678136+0000","last_became_peered":"2024-04-26T23:40:40.678136+0000","last_unstale":"2024-04-26T23:49:32.328923+0000","last_undegraded":"2024-04-26T23:49:32.328923+0000","last_fullsized":"2024-04-26T23:49:32.328923+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"26'3876","reported_seq":3896,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:45.254549+0000","last_change":"2024-04-26T23:40:41.673542+0000","last_active":"2024-04-26T23:49:45.254549+0000","last_peered":"2024-04-26T23:49:45.254549+0000","last_clean":"2024-04-26T23:49:45.254549+0000","last_became_active":"2024-04-26T23:40:41.673254+0000","last_became_peered":"2024-04-26T23:40:41.673254+0000","last_unstale":"2024-04-26T23:49:45.254549+0000","last_undegraded":"2024-04-26T23:49:45.254549+0000","last_fullsized":"2024-04-26T23:49:45.254549+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":3876,"log_dups_size":0,"ondisk_log_size":3876,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:10:11.728359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":58020,"num_write_kb":724597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"26'3920","reported_seq":3949,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.911817+0000","last_change":"2024-04-26T23:40:32.576783+0000","last_active":"2024-04-26T23:49:42.911817+0000","last_peered":"2024-04-26T23:49:42.911817+0000","last_clean":"2024-04-26T23:49:42.911817+0000","last_became_active":"2024-04-26T23:40:32.576481+0000","last_became_peered":"2024-04-26T23:40:32.576481+0000","last_unstale":"2024-04-26T23:49:42.911817+0000","last_undegraded":"2024-04-26T23:49:42.911817+0000","last_fullsized":"2024-04-26T23:49:42.911817+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":3920,"log_dups_size":0,"ondisk_log_size":3920,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":58555,"num_write_kb":772397,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"26'17","reported_seq":62,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:40.459144+0000","last_change":"2024-04-26T23:40:31.570775+0000","last_active":"2024-04-26T23:49:40.459144+0000","last_peered":"2024-04-26T23:49:40.459144+0000","last_clean":"2024-04-26T23:49:40.459144+0000","last_became_active":"2024-04-26T23:40:31.570493+0000","last_became_peered":"2024-04-26T23:40:31.570493+0000","last_unstale":"2024-04-26T23:49:40.459144+0000","last_undegraded":"2024-04-26T23:49:40.459144+0000","last_fullsized":"2024-04-26T23:49:40.459144+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:45:49.295198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88181,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":95,"num_write":15,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"26'25","reported_seq":56,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:49.177310+0000","last_change":"2024-04-26T23:49:49.177336+0000","last_active":"2024-04-26T23:49:49.177310+0000","last_peered":"2024-04-26T23:49:49.177310+0000","last_clean":"2024-04-26T23:49:49.177310+0000","last_became_active":"2024-04-26T23:40:40.674828+0000","last_became_peered":"2024-04-26T23:40:40.674828+0000","last_unstale":"2024-04-26T23:49:49.177310+0000","last_undegraded":"2024-04-26T23:49:49.177310+0000","last_fullsized":"2024-04-26T23:49:49.177310+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'25","last_scrub_stamp":"2024-04-26T23:49:49.177242+0000","last_deep_scrub":"26'25","last_deep_scrub_stamp":"2024-04-26T23:49:49.177242+0000","last_clean_scrub_stamp":"2024-04-26T23:49:49.177242+0000","objects_scrubbed":2,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:01:37.232954+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":4104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"26'4513","reported_seq":4533,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:45.292335+0000","last_change":"2024-04-26T23:40:41.691098+0000","last_active":"2024-04-26T23:49:45.292335+0000","last_peered":"2024-04-26T23:49:45.292335+0000","last_clean":"2024-04-26T23:49:45.292335+0000","last_became_active":"2024-04-26T23:40:41.690803+0000","last_became_peered":"2024-04-26T23:40:41.690803+0000","last_unstale":"2024-04-26T23:49:45.292335+0000","last_undegraded":"2024-04-26T23:49:45.292335+0000","last_fullsized":"2024-04-26T23:49:45.292335+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":4513,"log_dups_size":0,"ondisk_log_size":4513,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:38:51.195172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":67888,"num_write_kb":829373,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"26'4011","reported_seq":4040,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.898592+0000","last_change":"2024-04-26T23:40:32.593262+0000","last_active":"2024-04-26T23:49:42.898592+0000","last_peered":"2024-04-26T23:49:42.898592+0000","last_clean":"2024-04-26T23:49:42.898592+0000","last_became_active":"2024-04-26T23:40:32.593003+0000","last_became_peered":"2024-04-26T23:40:32.593003+0000","last_unstale":"2024-04-26T23:49:42.898592+0000","last_undegraded":"2024-04-26T23:49:42.898592+0000","last_fullsized":"2024-04-26T23:49:42.898592+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":4011,"log_dups_size":0,"ondisk_log_size":4011,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":60122,"num_write_kb":778045,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"26'35","reported_seq":65,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:36.408525+0000","last_change":"2024-04-26T23:40:31.573864+0000","last_active":"2024-04-26T23:49:36.408525+0000","last_peered":"2024-04-26T23:49:36.408525+0000","last_clean":"2024-04-26T23:49:36.408525+0000","last_became_active":"2024-04-26T23:40:31.573594+0000","last_became_peered":"2024-04-26T23:40:31.573594+0000","last_unstale":"2024-04-26T23:49:36.408525+0000","last_undegraded":"2024-04-26T23:49:36.408525+0000","last_fullsized":"2024-04-26T23:49:36.408525+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:48:32.015654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":8204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"26'253","reported_seq":276,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:45.242118+0000","last_change":"2024-04-26T23:40:40.677258+0000","last_active":"2024-04-26T23:49:45.242118+0000","last_peered":"2024-04-26T23:49:45.242118+0000","last_clean":"2024-04-26T23:49:45.242118+0000","last_became_active":"2024-04-26T23:40:40.676937+0000","last_became_peered":"2024-04-26T23:40:40.676937+0000","last_unstale":"2024-04-26T23:49:45.242118+0000","last_undegraded":"2024-04-26T23:49:45.242118+0000","last_fullsized":"2024-04-26T23:49:45.242118+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":253,"log_dups_size":0,"ondisk_log_size":253,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":475,"num_write_kb":168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"26'4528","reported_seq":4548,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:45.287183+0000","last_change":"2024-04-26T23:40:41.684731+0000","last_active":"2024-04-26T23:49:45.287183+0000","last_peered":"2024-04-26T23:49:45.287183+0000","last_clean":"2024-04-26T23:49:45.287183+0000","last_became_active":"2024-04-26T23:40:41.684459+0000","last_became_peered":"2024-04-26T23:40:41.684459+0000","last_unstale":"2024-04-26T23:49:45.287183+0000","last_undegraded":"2024-04-26T23:49:45.287183+0000","last_fullsized":"2024-04-26T23:49:45.287183+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":4528,"log_dups_size":0,"ondisk_log_size":4528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:24:07.784468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":68252,"num_write_kb":886817,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"26'4332","reported_seq":4361,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.928404+0000","last_change":"2024-04-26T23:40:32.593216+0000","last_active":"2024-04-26T23:49:42.928404+0000","last_peered":"2024-04-26T23:49:42.928404+0000","last_clean":"2024-04-26T23:49:42.928404+0000","last_became_active":"2024-04-26T23:40:32.592929+0000","last_became_peered":"2024-04-26T23:40:32.592929+0000","last_unstale":"2024-04-26T23:49:42.928404+0000","last_undegraded":"2024-04-26T23:49:42.928404+0000","last_fullsized":"2024-04-26T23:49:42.928404+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":4332,"log_dups_size":0,"ondisk_log_size":4332,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":65153,"num_write_kb":829422,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"26'2","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:48:10.239534+0000","last_change":"2024-04-26T23:40:31.570118+0000","last_active":"2024-04-26T23:48:10.239534+0000","last_peered":"2024-04-26T23:48:10.239534+0000","last_clean":"2024-04-26T23:48:10.239534+0000","last_became_active":"2024-04-26T23:40:31.569764+0000","last_became_peered":"2024-04-26T23:40:31.569764+0000","last_unstale":"2024-04-26T23:48:10.239534+0000","last_undegraded":"2024-04-26T23:48:10.239534+0000","last_fullsized":"2024-04-26T23:48:10.239534+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:15:30.884135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":186,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:46:31.335185+0000","last_change":"2024-04-26T23:40:20.966672+0000","last_active":"2024-04-26T23:46:31.335185+0000","last_peered":"2024-04-26T23:46:31.335185+0000","last_clean":"2024-04-26T23:46:31.335185+0000","last_became_active":"2024-04-26T23:40:20.963937+0000","last_became_peered":"2024-04-26T23:40:20.963937+0000","last_unstale":"2024-04-26T23:46:31.335185+0000","last_undegraded":"2024-04-26T23:46:31.335185+0000","last_fullsized":"2024-04-26T23:46:31.335185+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:19.950137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:19.950137+0000","last_clean_scrub_stamp":"2024-04-26T23:40:19.950137+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:23:39.166579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"26'7","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:30.322697+0000","last_change":"2024-04-26T23:40:40.671995+0000","last_active":"2024-04-26T23:49:30.322697+0000","last_peered":"2024-04-26T23:49:30.322697+0000","last_clean":"2024-04-26T23:49:30.322697+0000","last_became_active":"2024-04-26T23:40:40.671642+0000","last_became_peered":"2024-04-26T23:40:40.671642+0000","last_unstale":"2024-04-26T23:49:30.322697+0000","last_undegraded":"2024-04-26T23:49:30.322697+0000","last_fullsized":"2024-04-26T23:49:30.322697+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:35:16.288571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"26'3796","reported_seq":3816,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:45.265723+0000","last_change":"2024-04-26T23:40:41.680852+0000","last_active":"2024-04-26T23:49:45.265723+0000","last_peered":"2024-04-26T23:49:45.265723+0000","last_clean":"2024-04-26T23:49:45.265723+0000","last_became_active":"2024-04-26T23:40:41.680567+0000","last_became_peered":"2024-04-26T23:40:41.680567+0000","last_unstale":"2024-04-26T23:49:45.265723+0000","last_undegraded":"2024-04-26T23:49:45.265723+0000","last_fullsized":"2024-04-26T23:49:45.265723+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":3796,"log_dups_size":0,"ondisk_log_size":3796,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:40:15.485085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":57172,"num_write_kb":707056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"26'4186","reported_seq":4214,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.944934+0000","last_change":"2024-04-26T23:40:32.591906+0000","last_active":"2024-04-26T23:49:42.944934+0000","last_peered":"2024-04-26T23:49:42.944934+0000","last_clean":"2024-04-26T23:49:42.944934+0000","last_became_active":"2024-04-26T23:40:32.590867+0000","last_became_peered":"2024-04-26T23:40:32.590867+0000","last_unstale":"2024-04-26T23:49:42.944934+0000","last_undegraded":"2024-04-26T23:49:42.944934+0000","last_fullsized":"2024-04-26T23:49:42.944934+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":4186,"log_dups_size":0,"ondisk_log_size":4186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:56:04.309611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":62827,"num_write_kb":810912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"26'3","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:36.388158+0000","last_change":"2024-04-26T23:40:31.572391+0000","last_active":"2024-04-26T23:49:36.388158+0000","last_peered":"2024-04-26T23:49:36.388158+0000","last_clean":"2024-04-26T23:49:36.388158+0000","last_became_active":"2024-04-26T23:40:31.571849+0000","last_became_peered":"2024-04-26T23:40:31.571849+0000","last_unstale":"2024-04-26T23:49:36.388158+0000","last_undegraded":"2024-04-26T23:49:36.388158+0000","last_fullsized":"2024-04-26T23:49:36.388158+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:35:54.439397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"26'6","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:30.330522+0000","last_change":"2024-04-26T23:40:40.676464+0000","last_active":"2024-04-26T23:49:30.330522+0000","last_peered":"2024-04-26T23:49:30.330522+0000","last_clean":"2024-04-26T23:49:30.330522+0000","last_became_active":"2024-04-26T23:40:40.676154+0000","last_became_peered":"2024-04-26T23:40:40.676154+0000","last_unstale":"2024-04-26T23:49:30.330522+0000","last_undegraded":"2024-04-26T23:49:30.330522+0000","last_fullsized":"2024-04-26T23:49:30.330522+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:52:34.793496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"26'3987","reported_seq":4007,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:45.198660+0000","last_change":"2024-04-26T23:40:41.688065+0000","last_active":"2024-04-26T23:49:45.198660+0000","last_peered":"2024-04-26T23:49:45.198660+0000","last_clean":"2024-04-26T23:49:45.198660+0000","last_became_active":"2024-04-26T23:40:41.687693+0000","last_became_peered":"2024-04-26T23:40:41.687693+0000","last_unstale":"2024-04-26T23:49:45.198660+0000","last_undegraded":"2024-04-26T23:49:45.198660+0000","last_fullsized":"2024-04-26T23:49:45.198660+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":3987,"log_dups_size":0,"ondisk_log_size":3987,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:35:17.294025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":60042,"num_write_kb":782772,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"26'4287","reported_seq":4315,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.934302+0000","last_change":"2024-04-26T23:40:32.583469+0000","last_active":"2024-04-26T23:49:42.934302+0000","last_peered":"2024-04-26T23:49:42.934302+0000","last_clean":"2024-04-26T23:49:42.934302+0000","last_became_active":"2024-04-26T23:40:32.583174+0000","last_became_peered":"2024-04-26T23:40:32.583174+0000","last_unstale":"2024-04-26T23:49:42.934302+0000","last_undegraded":"2024-04-26T23:49:42.934302+0000","last_fullsized":"2024-04-26T23:49:42.934302+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":4287,"log_dups_size":0,"ondisk_log_size":4287,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:34:14.811917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":64102,"num_write_kb":832828,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"26'6","reported_seq":37,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:36.381680+0000","last_change":"2024-04-26T23:40:31.571749+0000","last_active":"2024-04-26T23:49:36.381680+0000","last_peered":"2024-04-26T23:49:36.381680+0000","last_clean":"2024-04-26T23:49:36.381680+0000","last_became_active":"2024-04-26T23:40:31.571427+0000","last_became_peered":"2024-04-26T23:40:31.571427+0000","last_unstale":"2024-04-26T23:49:36.381680+0000","last_undegraded":"2024-04-26T23:49:36.381680+0000","last_fullsized":"2024-04-26T23:49:36.381680+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"26'155","reported_seq":178,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:33.907717+0000","last_change":"2024-04-26T23:40:40.675987+0000","last_active":"2024-04-26T23:49:33.907717+0000","last_peered":"2024-04-26T23:49:33.907717+0000","last_clean":"2024-04-26T23:49:33.907717+0000","last_became_active":"2024-04-26T23:40:40.675682+0000","last_became_peered":"2024-04-26T23:40:40.675682+0000","last_unstale":"2024-04-26T23:49:33.907717+0000","last_undegraded":"2024-04-26T23:49:33.907717+0000","last_fullsized":"2024-04-26T23:49:33.907717+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":155,"log_dups_size":0,"ondisk_log_size":155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":145,"num_write_kb":8318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"26'4190","reported_seq":4210,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:45.218309+0000","last_change":"2024-04-26T23:40:41.681408+0000","last_active":"2024-04-26T23:49:45.218309+0000","last_peered":"2024-04-26T23:49:45.218309+0000","last_clean":"2024-04-26T23:49:45.218309+0000","last_became_active":"2024-04-26T23:40:41.681069+0000","last_became_peered":"2024-04-26T23:40:41.681069+0000","last_unstale":"2024-04-26T23:49:45.218309+0000","last_undegraded":"2024-04-26T23:49:45.218309+0000","last_fullsized":"2024-04-26T23:49:45.218309+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":4190,"log_dups_size":0,"ondisk_log_size":4190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:10:30.972726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":63216,"num_write_kb":796499,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"26'4864","reported_seq":4892,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.993843+0000","last_change":"2024-04-26T23:40:32.596306+0000","last_active":"2024-04-26T23:49:42.993843+0000","last_peered":"2024-04-26T23:49:42.993843+0000","last_clean":"2024-04-26T23:49:42.993843+0000","last_became_active":"2024-04-26T23:40:32.595625+0000","last_became_peered":"2024-04-26T23:40:32.595625+0000","last_unstale":"2024-04-26T23:49:42.993843+0000","last_undegraded":"2024-04-26T23:49:42.993843+0000","last_fullsized":"2024-04-26T23:49:42.993843+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":4864,"log_dups_size":0,"ondisk_log_size":4864,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:10:02.629199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":72976,"num_write_kb":927582,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"26'23","reported_seq":53,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:36.412667+0000","last_change":"2024-04-26T23:40:31.570870+0000","last_active":"2024-04-26T23:49:36.412667+0000","last_peered":"2024-04-26T23:49:36.412667+0000","last_clean":"2024-04-26T23:49:36.412667+0000","last_became_active":"2024-04-26T23:40:31.570592+0000","last_became_peered":"2024-04-26T23:40:31.570592+0000","last_unstale":"2024-04-26T23:49:36.412667+0000","last_undegraded":"2024-04-26T23:49:36.412667+0000","last_fullsized":"2024-04-26T23:49:36.412667+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:43:13.740214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":4104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"26'8","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:30.313360+0000","last_change":"2024-04-26T23:40:40.673142+0000","last_active":"2024-04-26T23:49:30.313360+0000","last_peered":"2024-04-26T23:49:30.313360+0000","last_clean":"2024-04-26T23:49:30.313360+0000","last_became_active":"2024-04-26T23:40:40.672816+0000","last_became_peered":"2024-04-26T23:40:40.672816+0000","last_unstale":"2024-04-26T23:49:30.313360+0000","last_undegraded":"2024-04-26T23:49:30.313360+0000","last_fullsized":"2024-04-26T23:49:30.313360+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:53:12.526011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"26'4537","reported_seq":4557,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:45.225114+0000","last_change":"2024-04-26T23:40:41.678588+0000","last_active":"2024-04-26T23:49:45.225114+0000","last_peered":"2024-04-26T23:49:45.225114+0000","last_clean":"2024-04-26T23:49:45.225114+0000","last_became_active":"2024-04-26T23:40:41.678039+0000","last_became_peered":"2024-04-26T23:40:41.678039+0000","last_unstale":"2024-04-26T23:49:45.225114+0000","last_undegraded":"2024-04-26T23:49:45.225114+0000","last_fullsized":"2024-04-26T23:49:45.225114+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":4537,"log_dups_size":0,"ondisk_log_size":4537,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:04:39.652713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":68234,"num_write_kb":870585,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"26'4022","reported_seq":4050,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.887550+0000","last_change":"2024-04-26T23:40:32.593577+0000","last_active":"2024-04-26T23:49:42.887550+0000","last_peered":"2024-04-26T23:49:42.887550+0000","last_clean":"2024-04-26T23:49:42.887550+0000","last_became_active":"2024-04-26T23:40:32.593235+0000","last_became_peered":"2024-04-26T23:40:32.593235+0000","last_unstale":"2024-04-26T23:49:42.887550+0000","last_undegraded":"2024-04-26T23:49:42.887550+0000","last_fullsized":"2024-04-26T23:49:42.887550+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":4022,"log_dups_size":0,"ondisk_log_size":4022,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:01:02.741964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":60538,"num_write_kb":762431,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"26'9","reported_seq":39,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:36.422094+0000","last_change":"2024-04-26T23:40:31.575943+0000","last_active":"2024-04-26T23:49:36.422094+0000","last_peered":"2024-04-26T23:49:36.422094+0000","last_clean":"2024-04-26T23:49:36.422094+0000","last_became_active":"2024-04-26T23:40:31.575632+0000","last_became_peered":"2024-04-26T23:40:31.575632+0000","last_unstale":"2024-04-26T23:49:36.422094+0000","last_undegraded":"2024-04-26T23:49:36.422094+0000","last_fullsized":"2024-04-26T23:49:36.422094+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:11:08.189634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"26'7","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:30.331487+0000","last_change":"2024-04-26T23:40:40.676297+0000","last_active":"2024-04-26T23:49:30.331487+0000","last_peered":"2024-04-26T23:49:30.331487+0000","last_clean":"2024-04-26T23:49:30.331487+0000","last_became_active":"2024-04-26T23:40:40.675888+0000","last_became_peered":"2024-04-26T23:40:40.675888+0000","last_unstale":"2024-04-26T23:49:30.331487+0000","last_undegraded":"2024-04-26T23:49:30.331487+0000","last_fullsized":"2024-04-26T23:49:30.331487+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:04:38.647258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.17","version":"26'3934","reported_seq":3954,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:45.250169+0000","last_change":"2024-04-26T23:40:41.688506+0000","last_active":"2024-04-26T23:49:45.250169+0000","last_peered":"2024-04-26T23:49:45.250169+0000","last_clean":"2024-04-26T23:49:45.250169+0000","last_became_active":"2024-04-26T23:40:41.688224+0000","last_became_peered":"2024-04-26T23:40:41.688224+0000","last_unstale":"2024-04-26T23:49:45.250169+0000","last_undegraded":"2024-04-26T23:49:45.250169+0000","last_fullsized":"2024-04-26T23:49:45.250169+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":3934,"log_dups_size":0,"ondisk_log_size":3934,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":58974,"num_write_kb":744310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"26'3924","reported_seq":3951,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.884380+0000","last_change":"2024-04-26T23:40:32.593528+0000","last_active":"2024-04-26T23:49:42.884380+0000","last_peered":"2024-04-26T23:49:42.884380+0000","last_clean":"2024-04-26T23:49:42.884380+0000","last_became_active":"2024-04-26T23:40:32.593220+0000","last_became_peered":"2024-04-26T23:40:32.593220+0000","last_unstale":"2024-04-26T23:49:42.884380+0000","last_undegraded":"2024-04-26T23:49:42.884380+0000","last_fullsized":"2024-04-26T23:49:42.884380+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":3924,"log_dups_size":0,"ondisk_log_size":3924,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:04:30.553552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":58510,"num_write_kb":806052,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"26'50","reported_seq":80,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:40.460675+0000","last_change":"2024-04-26T23:40:31.572685+0000","last_active":"2024-04-26T23:49:40.460675+0000","last_peered":"2024-04-26T23:49:40.460675+0000","last_clean":"2024-04-26T23:49:40.460675+0000","last_became_active":"2024-04-26T23:40:31.572169+0000","last_became_peered":"2024-04-26T23:40:31.572169+0000","last_unstale":"2024-04-26T23:49:40.460675+0000","last_undegraded":"2024-04-26T23:49:40.460675+0000","last_fullsized":"2024-04-26T23:49:40.460675+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:15:30.884135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":8207,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"26'32","reported_seq":62,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:48.759582+0000","last_change":"2024-04-26T23:49:48.759625+0000","last_active":"2024-04-26T23:49:48.759582+0000","last_peered":"2024-04-26T23:49:48.759582+0000","last_clean":"2024-04-26T23:49:48.759582+0000","last_became_active":"2024-04-26T23:40:40.671875+0000","last_became_peered":"2024-04-26T23:40:40.671875+0000","last_unstale":"2024-04-26T23:49:48.759582+0000","last_undegraded":"2024-04-26T23:49:48.759582+0000","last_fullsized":"2024-04-26T23:49:48.759582+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'32","last_scrub_stamp":"2024-04-26T23:49:48.759477+0000","last_deep_scrub":"26'32","last_deep_scrub_stamp":"2024-04-26T23:49:48.759477+0000","last_clean_scrub_stamp":"2024-04-26T23:49:48.759477+0000","objects_scrubbed":1,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:16:17.563359+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":4110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"26'4518","reported_seq":4537,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:45.293413+0000","last_change":"2024-04-26T23:40:41.688445+0000","last_active":"2024-04-26T23:49:45.293413+0000","last_peered":"2024-04-26T23:49:45.293413+0000","last_clean":"2024-04-26T23:49:45.293413+0000","last_became_active":"2024-04-26T23:40:41.688053+0000","last_became_peered":"2024-04-26T23:40:41.688053+0000","last_unstale":"2024-04-26T23:49:45.293413+0000","last_undegraded":"2024-04-26T23:49:45.293413+0000","last_fullsized":"2024-04-26T23:49:45.293413+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":4518,"log_dups_size":0,"ondisk_log_size":4518,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:08:35.027584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":67755,"num_write_kb":851157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"26'4530","reported_seq":4558,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.907543+0000","last_change":"2024-04-26T23:40:32.586832+0000","last_active":"2024-04-26T23:49:42.907543+0000","last_peered":"2024-04-26T23:49:42.907543+0000","last_clean":"2024-04-26T23:49:42.907543+0000","last_became_active":"2024-04-26T23:40:32.585809+0000","last_became_peered":"2024-04-26T23:40:32.585809+0000","last_unstale":"2024-04-26T23:49:42.907543+0000","last_undegraded":"2024-04-26T23:49:42.907543+0000","last_fullsized":"2024-04-26T23:49:42.907543+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":4530,"log_dups_size":0,"ondisk_log_size":4530,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:51:30.677247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":67909,"num_write_kb":843744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"26'6","reported_seq":35,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:36.408234+0000","last_change":"2024-04-26T23:40:31.569512+0000","last_active":"2024-04-26T23:49:36.408234+0000","last_peered":"2024-04-26T23:49:36.408234+0000","last_clean":"2024-04-26T23:49:36.408234+0000","last_became_active":"2024-04-26T23:40:31.568598+0000","last_became_peered":"2024-04-26T23:40:31.568598+0000","last_unstale":"2024-04-26T23:49:36.408234+0000","last_undegraded":"2024-04-26T23:49:36.408234+0000","last_fullsized":"2024-04-26T23:49:36.408234+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:48:32.015654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"26'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:32.323651+0000","last_change":"2024-04-26T23:40:40.673986+0000","last_active":"2024-04-26T23:49:32.323651+0000","last_peered":"2024-04-26T23:49:32.323651+0000","last_clean":"2024-04-26T23:49:32.323651+0000","last_became_active":"2024-04-26T23:40:40.673704+0000","last_became_peered":"2024-04-26T23:40:40.673704+0000","last_unstale":"2024-04-26T23:49:32.323651+0000","last_undegraded":"2024-04-26T23:49:32.323651+0000","last_fullsized":"2024-04-26T23:49:32.323651+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"26'4215","reported_seq":4234,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:45.286157+0000","last_change":"2024-04-26T23:40:41.691441+0000","last_active":"2024-04-26T23:49:45.286157+0000","last_peered":"2024-04-26T23:49:45.286157+0000","last_clean":"2024-04-26T23:49:45.286157+0000","last_became_active":"2024-04-26T23:40:41.691160+0000","last_became_peered":"2024-04-26T23:40:41.691160+0000","last_unstale":"2024-04-26T23:49:45.286157+0000","last_undegraded":"2024-04-26T23:49:45.286157+0000","last_fullsized":"2024-04-26T23:49:45.286157+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":4215,"log_dups_size":0,"ondisk_log_size":4215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:41:52.386084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":63478,"num_write_kb":811778,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"26'4684","reported_seq":4711,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.927995+0000","last_change":"2024-04-26T23:40:32.595377+0000","last_active":"2024-04-26T23:49:42.927995+0000","last_peered":"2024-04-26T23:49:42.927995+0000","last_clean":"2024-04-26T23:49:42.927995+0000","last_became_active":"2024-04-26T23:40:32.595032+0000","last_became_peered":"2024-04-26T23:40:32.595032+0000","last_unstale":"2024-04-26T23:49:42.927995+0000","last_undegraded":"2024-04-26T23:49:42.927995+0000","last_fullsized":"2024-04-26T23:49:42.927995+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":4684,"log_dups_size":0,"ondisk_log_size":4684,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:44:42.494850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":70001,"num_write_kb":901416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"26'5","reported_seq":34,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:36.432793+0000","last_change":"2024-04-26T23:40:31.575493+0000","last_active":"2024-04-26T23:49:36.432793+0000","last_peered":"2024-04-26T23:49:36.432793+0000","last_clean":"2024-04-26T23:49:36.432793+0000","last_became_active":"2024-04-26T23:40:31.575039+0000","last_became_peered":"2024-04-26T23:40:31.575039+0000","last_unstale":"2024-04-26T23:49:36.432793+0000","last_undegraded":"2024-04-26T23:49:36.432793+0000","last_fullsized":"2024-04-26T23:49:36.432793+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:43:13.740214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"26'245","reported_seq":267,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:40.833551+0000","last_change":"2024-04-26T23:40:40.676493+0000","last_active":"2024-04-26T23:49:40.833551+0000","last_peered":"2024-04-26T23:49:40.833551+0000","last_clean":"2024-04-26T23:49:40.833551+0000","last_became_active":"2024-04-26T23:40:40.676124+0000","last_became_peered":"2024-04-26T23:40:40.676124+0000","last_unstale":"2024-04-26T23:49:40.833551+0000","last_undegraded":"2024-04-26T23:49:40.833551+0000","last_fullsized":"2024-04-26T23:49:40.833551+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":245,"log_dups_size":0,"ondisk_log_size":245,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583584,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":239,"num_write_kb":12458,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"26'6179","reported_seq":6199,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:45.284910+0000","last_change":"2024-04-26T23:40:41.680735+0000","last_active":"2024-04-26T23:49:45.284910+0000","last_peered":"2024-04-26T23:49:45.284910+0000","last_clean":"2024-04-26T23:49:45.284910+0000","last_became_active":"2024-04-26T23:40:41.680485+0000","last_became_peered":"2024-04-26T23:40:41.680485+0000","last_unstale":"2024-04-26T23:49:45.284910+0000","last_undegraded":"2024-04-26T23:49:45.284910+0000","last_fullsized":"2024-04-26T23:49:45.284910+0000","mapping_epoch":22,"log_start":"26'1000","ondisk_log_start":"26'1000","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":5179,"log_dups_size":0,"ondisk_log_size":5179,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":93116,"num_write_kb":1152811,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"26'3934","reported_seq":3962,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.893077+0000","last_change":"2024-04-26T23:40:32.589706+0000","last_active":"2024-04-26T23:49:42.893077+0000","last_peered":"2024-04-26T23:49:42.893077+0000","last_clean":"2024-04-26T23:49:42.893077+0000","last_became_active":"2024-04-26T23:40:32.589452+0000","last_became_peered":"2024-04-26T23:40:32.589452+0000","last_unstale":"2024-04-26T23:49:42.893077+0000","last_undegraded":"2024-04-26T23:49:42.893077+0000","last_fullsized":"2024-04-26T23:49:42.893077+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":3934,"log_dups_size":0,"ondisk_log_size":3934,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":58864,"num_write_kb":755351,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"26'27","reported_seq":57,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:36.437233+0000","last_change":"2024-04-26T23:40:31.573941+0000","last_active":"2024-04-26T23:49:36.437233+0000","last_peered":"2024-04-26T23:49:36.437233+0000","last_clean":"2024-04-26T23:49:36.437233+0000","last_became_active":"2024-04-26T23:40:31.573668+0000","last_became_peered":"2024-04-26T23:40:31.573668+0000","last_unstale":"2024-04-26T23:49:36.437233+0000","last_undegraded":"2024-04-26T23:49:36.437233+0000","last_fullsized":"2024-04-26T23:49:36.437233+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":8209,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"26'27","reported_seq":48,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:32.365002+0000","last_change":"2024-04-26T23:40:40.676408+0000","last_active":"2024-04-26T23:49:32.365002+0000","last_peered":"2024-04-26T23:49:32.365002+0000","last_clean":"2024-04-26T23:49:32.365002+0000","last_became_active":"2024-04-26T23:40:40.676147+0000","last_became_peered":"2024-04-26T23:40:40.676147+0000","last_unstale":"2024-04-26T23:49:32.365002+0000","last_undegraded":"2024-04-26T23:49:32.365002+0000","last_fullsized":"2024-04-26T23:49:32.365002+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:27:47.818055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194394,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":4110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.13","version":"26'4994","reported_seq":5014,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:45.298121+0000","last_change":"2024-04-26T23:40:41.685829+0000","last_active":"2024-04-26T23:49:45.298121+0000","last_peered":"2024-04-26T23:49:45.298121+0000","last_clean":"2024-04-26T23:49:45.298121+0000","last_became_active":"2024-04-26T23:40:41.685403+0000","last_became_peered":"2024-04-26T23:40:41.685403+0000","last_unstale":"2024-04-26T23:49:45.298121+0000","last_undegraded":"2024-04-26T23:49:45.298121+0000","last_fullsized":"2024-04-26T23:49:45.298121+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":4994,"log_dups_size":0,"ondisk_log_size":4994,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":74752,"num_write_kb":961504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"26'3907","reported_seq":3934,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.911201+0000","last_change":"2024-04-26T23:40:32.587513+0000","last_active":"2024-04-26T23:49:42.911201+0000","last_peered":"2024-04-26T23:49:42.911201+0000","last_clean":"2024-04-26T23:49:42.911201+0000","last_became_active":"2024-04-26T23:40:32.587200+0000","last_became_peered":"2024-04-26T23:40:32.587200+0000","last_unstale":"2024-04-26T23:49:42.911201+0000","last_undegraded":"2024-04-26T23:49:42.911201+0000","last_fullsized":"2024-04-26T23:49:42.911201+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":3907,"log_dups_size":0,"ondisk_log_size":3907,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:37:30.361795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":58714,"num_write_kb":750642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"26'240","reported_seq":269,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:36.399847+0000","last_change":"2024-04-26T23:40:31.572331+0000","last_active":"2024-04-26T23:49:36.399847+0000","last_peered":"2024-04-26T23:49:36.399847+0000","last_clean":"2024-04-26T23:49:36.399847+0000","last_became_active":"2024-04-26T23:40:31.572074+0000","last_became_peered":"2024-04-26T23:40:31.572074+0000","last_unstale":"2024-04-26T23:49:36.399847+0000","last_undegraded":"2024-04-26T23:49:36.399847+0000","last_fullsized":"2024-04-26T23:49:36.399847+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:45:49.295198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583584,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":234,"num_write_kb":12453,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"26'5","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:32.361809+0000","last_change":"2024-04-26T23:40:40.677978+0000","last_active":"2024-04-26T23:49:32.361809+0000","last_peered":"2024-04-26T23:49:32.361809+0000","last_clean":"2024-04-26T23:49:32.361809+0000","last_became_active":"2024-04-26T23:40:40.677714+0000","last_became_peered":"2024-04-26T23:40:40.677714+0000","last_unstale":"2024-04-26T23:49:32.361809+0000","last_undegraded":"2024-04-26T23:49:32.361809+0000","last_fullsized":"2024-04-26T23:49:32.361809+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"26'4195","reported_seq":4215,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:45.234378+0000","last_change":"2024-04-26T23:40:41.685431+0000","last_active":"2024-04-26T23:49:45.234378+0000","last_peered":"2024-04-26T23:49:45.234378+0000","last_clean":"2024-04-26T23:49:45.234378+0000","last_became_active":"2024-04-26T23:40:41.685147+0000","last_became_peered":"2024-04-26T23:40:41.685147+0000","last_unstale":"2024-04-26T23:49:45.234378+0000","last_undegraded":"2024-04-26T23:49:45.234378+0000","last_fullsized":"2024-04-26T23:49:45.234378+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":4195,"log_dups_size":0,"ondisk_log_size":4195,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":62805,"num_write_kb":801211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"26'5530","reported_seq":5557,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.978334+0000","last_change":"2024-04-26T23:40:32.593298+0000","last_active":"2024-04-26T23:49:42.978334+0000","last_peered":"2024-04-26T23:49:42.978334+0000","last_clean":"2024-04-26T23:49:42.978334+0000","last_became_active":"2024-04-26T23:40:32.593030+0000","last_became_peered":"2024-04-26T23:40:32.593030+0000","last_unstale":"2024-04-26T23:49:42.978334+0000","last_undegraded":"2024-04-26T23:49:42.978334+0000","last_fullsized":"2024-04-26T23:49:42.978334+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":5530,"log_dups_size":0,"ondisk_log_size":5530,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:20:29.107798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":83076,"num_write_kb":1053123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"26'25","reported_seq":55,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:40.462501+0000","last_change":"2024-04-26T23:40:31.574234+0000","last_active":"2024-04-26T23:49:40.462501+0000","last_peered":"2024-04-26T23:49:40.462501+0000","last_clean":"2024-04-26T23:49:40.462501+0000","last_became_active":"2024-04-26T23:40:31.572218+0000","last_became_peered":"2024-04-26T23:40:31.572218+0000","last_unstale":"2024-04-26T23:49:40.462501+0000","last_undegraded":"2024-04-26T23:49:40.462501+0000","last_fullsized":"2024-04-26T23:49:40.462501+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194394,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":4108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"26'31","reported_seq":52,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:32.332248+0000","last_change":"2024-04-26T23:40:40.674778+0000","last_active":"2024-04-26T23:49:32.332248+0000","last_peered":"2024-04-26T23:49:32.332248+0000","last_clean":"2024-04-26T23:49:32.332248+0000","last_became_active":"2024-04-26T23:40:40.674487+0000","last_became_peered":"2024-04-26T23:40:40.674487+0000","last_unstale":"2024-04-26T23:49:32.332248+0000","last_undegraded":"2024-04-26T23:49:32.332248+0000","last_fullsized":"2024-04-26T23:49:32.332248+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:10:10.722905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":8207,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"26'4277","reported_seq":4296,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:45.269375+0000","last_change":"2024-04-26T23:40:41.686531+0000","last_active":"2024-04-26T23:49:45.269375+0000","last_peered":"2024-04-26T23:49:45.269375+0000","last_clean":"2024-04-26T23:49:45.269375+0000","last_became_active":"2024-04-26T23:40:41.686259+0000","last_became_peered":"2024-04-26T23:40:41.686259+0000","last_unstale":"2024-04-26T23:49:45.269375+0000","last_undegraded":"2024-04-26T23:49:45.269375+0000","last_fullsized":"2024-04-26T23:49:45.269375+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":4277,"log_dups_size":0,"ondisk_log_size":4277,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:45:34.231942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":64273,"num_write_kb":853172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"26'3697","reported_seq":3730,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.893194+0000","last_change":"2024-04-26T23:41:30.513928+0000","last_active":"2024-04-26T23:49:42.893194+0000","last_peered":"2024-04-26T23:49:42.893194+0000","last_clean":"2024-04-26T23:49:42.893194+0000","last_became_active":"2024-04-26T23:41:30.513492+0000","last_became_peered":"2024-04-26T23:41:30.513492+0000","last_unstale":"2024-04-26T23:49:42.893194+0000","last_undegraded":"2024-04-26T23:49:42.893194+0000","last_fullsized":"2024-04-26T23:49:42.893194+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":3697,"log_dups_size":0,"ondisk_log_size":3697,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55355,"num_write_kb":693310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"26'22","reported_seq":51,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:36.405506+0000","last_change":"2024-04-26T23:40:31.575616+0000","last_active":"2024-04-26T23:49:36.405506+0000","last_peered":"2024-04-26T23:49:36.405506+0000","last_clean":"2024-04-26T23:49:36.405506+0000","last_became_active":"2024-04-26T23:40:31.575211+0000","last_became_peered":"2024-04-26T23:40:31.575211+0000","last_unstale":"2024-04-26T23:49:36.405506+0000","last_undegraded":"2024-04-26T23:49:36.405506+0000","last_fullsized":"2024-04-26T23:49:36.405506+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:48:32.015654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":4104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"26'38","reported_seq":60,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:37.323373+0000","last_change":"2024-04-26T23:40:40.675694+0000","last_active":"2024-04-26T23:49:37.323373+0000","last_peered":"2024-04-26T23:49:37.323373+0000","last_clean":"2024-04-26T23:49:37.323373+0000","last_became_active":"2024-04-26T23:40:40.675459+0000","last_became_peered":"2024-04-26T23:40:40.675459+0000","last_unstale":"2024-04-26T23:49:37.323373+0000","last_undegraded":"2024-04-26T23:49:37.323373+0000","last_fullsized":"2024-04-26T23:49:37.323373+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36,"num_write_kb":8203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"26'4899","reported_seq":4918,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:45.275421+0000","last_change":"2024-04-26T23:40:41.687488+0000","last_active":"2024-04-26T23:49:45.275421+0000","last_peered":"2024-04-26T23:49:45.275421+0000","last_clean":"2024-04-26T23:49:45.275421+0000","last_became_active":"2024-04-26T23:40:41.687210+0000","last_became_peered":"2024-04-26T23:40:41.687210+0000","last_unstale":"2024-04-26T23:49:45.275421+0000","last_undegraded":"2024-04-26T23:49:45.275421+0000","last_fullsized":"2024-04-26T23:49:45.275421+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":4899,"log_dups_size":0,"ondisk_log_size":4899,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:36:21.487122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":73846,"num_write_kb":901080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"26'4194","reported_seq":4207,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.872278+0000","last_change":"2024-04-26T23:41:30.751583+0000","last_active":"2024-04-26T23:49:42.872278+0000","last_peered":"2024-04-26T23:49:42.872278+0000","last_clean":"2024-04-26T23:49:42.872278+0000","last_became_active":"2024-04-26T23:41:30.751285+0000","last_became_peered":"2024-04-26T23:41:30.751285+0000","last_unstale":"2024-04-26T23:49:42.872278+0000","last_undegraded":"2024-04-26T23:49:42.872278+0000","last_fullsized":"2024-04-26T23:49:42.872278+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":4194,"log_dups_size":0,"ondisk_log_size":4194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:36:12.387962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":63007,"num_write_kb":791881,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"26'2","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:47:52.159460+0000","last_change":"2024-04-26T23:40:31.573794+0000","last_active":"2024-04-26T23:47:52.159460+0000","last_peered":"2024-04-26T23:47:52.159460+0000","last_clean":"2024-04-26T23:47:52.159460+0000","last_became_active":"2024-04-26T23:40:31.573164+0000","last_became_peered":"2024-04-26T23:40:31.573164+0000","last_unstale":"2024-04-26T23:47:52.159460+0000","last_undegraded":"2024-04-26T23:47:52.159460+0000","last_fullsized":"2024-04-26T23:47:52.159460+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:15:30.884135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"26'6","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:32.323570+0000","last_change":"2024-04-26T23:40:40.674127+0000","last_active":"2024-04-26T23:49:32.323570+0000","last_peered":"2024-04-26T23:49:32.323570+0000","last_clean":"2024-04-26T23:49:32.323570+0000","last_became_active":"2024-04-26T23:40:40.673793+0000","last_became_peered":"2024-04-26T23:40:40.673793+0000","last_unstale":"2024-04-26T23:49:32.323570+0000","last_undegraded":"2024-04-26T23:49:32.323570+0000","last_fullsized":"2024-04-26T23:49:32.323570+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"26'5252","reported_seq":5272,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:45.245634+0000","last_change":"2024-04-26T23:40:41.686867+0000","last_active":"2024-04-26T23:49:45.245634+0000","last_peered":"2024-04-26T23:49:45.245634+0000","last_clean":"2024-04-26T23:49:45.245634+0000","last_became_active":"2024-04-26T23:40:41.686536+0000","last_became_peered":"2024-04-26T23:40:41.686536+0000","last_unstale":"2024-04-26T23:49:45.245634+0000","last_undegraded":"2024-04-26T23:49:45.245634+0000","last_fullsized":"2024-04-26T23:49:45.245634+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":5252,"log_dups_size":0,"ondisk_log_size":5252,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:28:34.920939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":78945,"num_write_kb":1046825,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"26'13","reported_seq":36,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:32.341240+0000","last_change":"2024-04-26T23:40:40.674915+0000","last_active":"2024-04-26T23:49:32.341240+0000","last_peered":"2024-04-26T23:49:32.341240+0000","last_clean":"2024-04-26T23:49:32.341240+0000","last_became_active":"2024-04-26T23:40:40.674639+0000","last_became_peered":"2024-04-26T23:40:40.674639+0000","last_unstale":"2024-04-26T23:49:32.341240+0000","last_undegraded":"2024-04-26T23:49:32.341240+0000","last_fullsized":"2024-04-26T23:49:32.341240+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":4106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"26'4888","reported_seq":4916,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.921944+0000","last_change":"2024-04-26T23:40:32.583014+0000","last_active":"2024-04-26T23:49:42.921944+0000","last_peered":"2024-04-26T23:49:42.921944+0000","last_clean":"2024-04-26T23:49:42.921944+0000","last_became_active":"2024-04-26T23:40:32.582751+0000","last_became_peered":"2024-04-26T23:40:32.582751+0000","last_unstale":"2024-04-26T23:49:42.921944+0000","last_undegraded":"2024-04-26T23:49:42.921944+0000","last_fullsized":"2024-04-26T23:49:42.921944+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":4888,"log_dups_size":0,"ondisk_log_size":4888,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":73256,"num_write_kb":928290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"26'27","reported_seq":56,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:36.360432+0000","last_change":"2024-04-26T23:40:31.572402+0000","last_active":"2024-04-26T23:49:36.360432+0000","last_peered":"2024-04-26T23:49:36.360432+0000","last_clean":"2024-04-26T23:49:36.360432+0000","last_became_active":"2024-04-26T23:40:31.572111+0000","last_became_peered":"2024-04-26T23:40:31.572111+0000","last_unstale":"2024-04-26T23:49:36.360432+0000","last_undegraded":"2024-04-26T23:49:36.360432+0000","last_fullsized":"2024-04-26T23:49:36.360432+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:20:28.103413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":8213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"26'4754","reported_seq":4775,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:45.210017+0000","last_change":"2024-04-26T23:40:41.684524+0000","last_active":"2024-04-26T23:49:45.210017+0000","last_peered":"2024-04-26T23:49:45.210017+0000","last_clean":"2024-04-26T23:49:45.210017+0000","last_became_active":"2024-04-26T23:40:41.684207+0000","last_became_peered":"2024-04-26T23:40:41.684207+0000","last_unstale":"2024-04-26T23:49:45.210017+0000","last_undegraded":"2024-04-26T23:49:45.210017+0000","last_fullsized":"2024-04-26T23:49:45.210017+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":4754,"log_dups_size":0,"ondisk_log_size":4754,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":71582,"num_write_kb":928660,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"26'145","reported_seq":167,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:45.114569+0000","last_change":"2024-04-26T23:40:40.674934+0000","last_active":"2024-04-26T23:49:45.114569+0000","last_peered":"2024-04-26T23:49:45.114569+0000","last_clean":"2024-04-26T23:49:45.114569+0000","last_became_active":"2024-04-26T23:40:40.674628+0000","last_became_peered":"2024-04-26T23:40:40.674628+0000","last_unstale":"2024-04-26T23:49:45.114569+0000","last_undegraded":"2024-04-26T23:49:45.114569+0000","last_fullsized":"2024-04-26T23:49:45.114569+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":145,"log_dups_size":0,"ondisk_log_size":145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:44:50.588556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7745351,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":142,"num_write_kb":7622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"26'4156","reported_seq":4184,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.923364+0000","last_change":"2024-04-26T23:40:32.586204+0000","last_active":"2024-04-26T23:49:42.923364+0000","last_peered":"2024-04-26T23:49:42.923364+0000","last_clean":"2024-04-26T23:49:42.923364+0000","last_became_active":"2024-04-26T23:40:32.585725+0000","last_became_peered":"2024-04-26T23:40:32.585725+0000","last_unstale":"2024-04-26T23:49:42.923364+0000","last_undegraded":"2024-04-26T23:49:42.923364+0000","last_fullsized":"2024-04-26T23:49:42.923364+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":4156,"log_dups_size":0,"ondisk_log_size":4156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":62294,"num_write_kb":802311,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"26'20","reported_seq":50,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:36.393259+0000","last_change":"2024-04-26T23:40:31.578929+0000","last_active":"2024-04-26T23:49:36.393259+0000","last_peered":"2024-04-26T23:49:36.393259+0000","last_clean":"2024-04-26T23:49:36.393259+0000","last_became_active":"2024-04-26T23:40:31.578623+0000","last_became_peered":"2024-04-26T23:40:31.578623+0000","last_unstale":"2024-04-26T23:49:36.393259+0000","last_undegraded":"2024-04-26T23:49:36.393259+0000","last_fullsized":"2024-04-26T23:49:36.393259+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":4105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"26'5418","reported_seq":5438,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:45.325695+0000","last_change":"2024-04-26T23:40:41.689697+0000","last_active":"2024-04-26T23:49:45.325695+0000","last_peered":"2024-04-26T23:49:45.325695+0000","last_clean":"2024-04-26T23:49:45.325695+0000","last_became_active":"2024-04-26T23:40:41.688428+0000","last_became_peered":"2024-04-26T23:40:41.688428+0000","last_unstale":"2024-04-26T23:49:45.325695+0000","last_undegraded":"2024-04-26T23:49:45.325695+0000","last_fullsized":"2024-04-26T23:49:45.325695+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":5418,"log_dups_size":0,"ondisk_log_size":5418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":81566,"num_write_kb":1040251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1a","version":"26'33","reported_seq":62,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:36.399499+0000","last_change":"2024-04-26T23:40:31.567755+0000","last_active":"2024-04-26T23:49:36.399499+0000","last_peered":"2024-04-26T23:49:36.399499+0000","last_clean":"2024-04-26T23:49:36.399499+0000","last_became_active":"2024-04-26T23:40:31.567484+0000","last_became_peered":"2024-04-26T23:40:31.567484+0000","last_unstale":"2024-04-26T23:49:36.399499+0000","last_undegraded":"2024-04-26T23:49:36.399499+0000","last_fullsized":"2024-04-26T23:49:36.399499+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:43:13.740214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":12305,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"26'3282","reported_seq":3310,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.939836+0000","last_change":"2024-04-26T23:40:32.594689+0000","last_active":"2024-04-26T23:49:42.939836+0000","last_peered":"2024-04-26T23:49:42.939836+0000","last_clean":"2024-04-26T23:49:42.939836+0000","last_became_active":"2024-04-26T23:40:32.592365+0000","last_became_peered":"2024-04-26T23:40:32.592365+0000","last_unstale":"2024-04-26T23:49:42.939836+0000","last_undegraded":"2024-04-26T23:49:42.939836+0000","last_fullsized":"2024-04-26T23:49:42.939836+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":3282,"log_dups_size":0,"ondisk_log_size":3282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49199,"num_write_kb":619171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"26'14","reported_seq":35,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:48:17.852707+0000","last_change":"2024-04-26T23:40:40.676028+0000","last_active":"2024-04-26T23:48:17.852707+0000","last_peered":"2024-04-26T23:48:17.852707+0000","last_clean":"2024-04-26T23:48:17.852707+0000","last_became_active":"2024-04-26T23:40:40.675736+0000","last_became_peered":"2024-04-26T23:40:40.675736+0000","last_unstale":"2024-04-26T23:48:17.852707+0000","last_undegraded":"2024-04-26T23:48:17.852707+0000","last_fullsized":"2024-04-26T23:48:17.852707+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:51:38.770953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":4102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"26'3303","reported_seq":3322,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:45.274816+0000","last_change":"2024-04-26T23:40:41.690148+0000","last_active":"2024-04-26T23:49:45.274816+0000","last_peered":"2024-04-26T23:49:45.274816+0000","last_clean":"2024-04-26T23:49:45.274816+0000","last_became_active":"2024-04-26T23:40:41.689765+0000","last_became_peered":"2024-04-26T23:40:41.689765+0000","last_unstale":"2024-04-26T23:49:45.274816+0000","last_undegraded":"2024-04-26T23:49:45.274816+0000","last_fullsized":"2024-04-26T23:49:45.274816+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":3303,"log_dups_size":0,"ondisk_log_size":3303,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:33:16.389626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49600,"num_write_kb":609763,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"26'1221","reported_seq":1251,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:36.388662+0000","last_change":"2024-04-26T23:40:31.576749+0000","last_active":"2024-04-26T23:49:36.388662+0000","last_peered":"2024-04-26T23:49:36.388662+0000","last_clean":"2024-04-26T23:49:36.388662+0000","last_became_active":"2024-04-26T23:40:31.576178+0000","last_became_peered":"2024-04-26T23:40:31.576178+0000","last_unstale":"2024-04-26T23:49:36.388662+0000","last_undegraded":"2024-04-26T23:49:36.388662+0000","last_fullsized":"2024-04-26T23:49:36.388662+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":1221,"log_dups_size":0,"ondisk_log_size":1221,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1219,"num_write_kb":5208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"26'3626","reported_seq":3653,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.865111+0000","last_change":"2024-04-26T23:40:32.589208+0000","last_active":"2024-04-26T23:49:42.865111+0000","last_peered":"2024-04-26T23:49:42.865111+0000","last_clean":"2024-04-26T23:49:42.865111+0000","last_became_active":"2024-04-26T23:40:32.588927+0000","last_became_peered":"2024-04-26T23:40:32.588927+0000","last_unstale":"2024-04-26T23:49:42.865111+0000","last_undegraded":"2024-04-26T23:49:42.865111+0000","last_fullsized":"2024-04-26T23:49:42.865111+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":3626,"log_dups_size":0,"ondisk_log_size":3626,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:45:50.299583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":54465,"num_write_kb":670678,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"26'32","reported_seq":54,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:32.352442+0000","last_change":"2024-04-26T23:40:40.676809+0000","last_active":"2024-04-26T23:49:32.352442+0000","last_peered":"2024-04-26T23:49:32.352442+0000","last_clean":"2024-04-26T23:49:32.352442+0000","last_became_active":"2024-04-26T23:40:40.676070+0000","last_became_peered":"2024-04-26T23:40:40.676070+0000","last_unstale":"2024-04-26T23:49:32.352442+0000","last_undegraded":"2024-04-26T23:49:32.352442+0000","last_fullsized":"2024-04-26T23:49:32.352442+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:39.646413+0000","last_clean_scrub_stamp":"2024-04-26T23:40:39.646413+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":12296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.26","version":"26'4010","reported_seq":4031,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:45.322611+0000","last_change":"2024-04-26T23:40:41.679796+0000","last_active":"2024-04-26T23:49:45.322611+0000","last_peered":"2024-04-26T23:49:45.322611+0000","last_clean":"2024-04-26T23:49:45.322611+0000","last_became_active":"2024-04-26T23:40:41.679523+0000","last_became_peered":"2024-04-26T23:40:41.679523+0000","last_unstale":"2024-04-26T23:49:45.322611+0000","last_undegraded":"2024-04-26T23:49:45.322611+0000","last_fullsized":"2024-04-26T23:49:45.322611+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":4010,"log_dups_size":0,"ondisk_log_size":4010,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":60148,"num_write_kb":773318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"26'5261","reported_seq":5289,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.924918+0000","last_change":"2024-04-26T23:40:32.586672+0000","last_active":"2024-04-26T23:49:42.924918+0000","last_peered":"2024-04-26T23:49:42.924918+0000","last_clean":"2024-04-26T23:49:42.924918+0000","last_became_active":"2024-04-26T23:40:32.586399+0000","last_became_peered":"2024-04-26T23:40:32.586399+0000","last_unstale":"2024-04-26T23:49:42.924918+0000","last_undegraded":"2024-04-26T23:49:42.924918+0000","last_fullsized":"2024-04-26T23:49:42.924918+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":5261,"log_dups_size":0,"ondisk_log_size":5261,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:15:01.970308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":78910,"num_write_kb":993537,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.27","version":"26'5344","reported_seq":5365,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:45.246024+0000","last_change":"2024-04-26T23:40:41.687529+0000","last_active":"2024-04-26T23:49:45.246024+0000","last_peered":"2024-04-26T23:49:45.246024+0000","last_clean":"2024-04-26T23:49:45.246024+0000","last_became_active":"2024-04-26T23:40:41.686974+0000","last_became_peered":"2024-04-26T23:40:41.686974+0000","last_unstale":"2024-04-26T23:49:45.246024+0000","last_undegraded":"2024-04-26T23:49:45.246024+0000","last_fullsized":"2024-04-26T23:49:45.246024+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":5344,"log_dups_size":0,"ondisk_log_size":5344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":80446,"num_write_kb":1002267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"26'4431","reported_seq":4459,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.901911+0000","last_change":"2024-04-26T23:40:32.584590+0000","last_active":"2024-04-26T23:49:42.901911+0000","last_peered":"2024-04-26T23:49:42.901911+0000","last_clean":"2024-04-26T23:49:42.901911+0000","last_became_active":"2024-04-26T23:40:32.584234+0000","last_became_peered":"2024-04-26T23:40:32.584234+0000","last_unstale":"2024-04-26T23:49:42.901911+0000","last_undegraded":"2024-04-26T23:49:42.901911+0000","last_fullsized":"2024-04-26T23:49:42.901911+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":4431,"log_dups_size":0,"ondisk_log_size":4431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:15:52.942160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":66416,"num_write_kb":857324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.24","version":"26'4132","reported_seq":4152,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:45.249103+0000","last_change":"2024-04-26T23:40:41.679549+0000","last_active":"2024-04-26T23:49:45.249103+0000","last_peered":"2024-04-26T23:49:45.249103+0000","last_clean":"2024-04-26T23:49:45.249103+0000","last_became_active":"2024-04-26T23:40:41.679254+0000","last_became_peered":"2024-04-26T23:40:41.679254+0000","last_unstale":"2024-04-26T23:49:45.249103+0000","last_undegraded":"2024-04-26T23:49:45.249103+0000","last_fullsized":"2024-04-26T23:49:45.249103+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":4132,"log_dups_size":0,"ondisk_log_size":4132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:48:09.126894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":62260,"num_write_kb":792966,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"26'5020","reported_seq":5048,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.980032+0000","last_change":"2024-04-26T23:40:32.580453+0000","last_active":"2024-04-26T23:49:42.980032+0000","last_peered":"2024-04-26T23:49:42.980032+0000","last_clean":"2024-04-26T23:49:42.980032+0000","last_became_active":"2024-04-26T23:40:32.580196+0000","last_became_peered":"2024-04-26T23:40:32.580196+0000","last_unstale":"2024-04-26T23:49:42.980032+0000","last_undegraded":"2024-04-26T23:49:42.980032+0000","last_fullsized":"2024-04-26T23:49:42.980032+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":5020,"log_dups_size":0,"ondisk_log_size":5020,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:18:09.706875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":75519,"num_write_kb":963103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.25","version":"26'4764","reported_seq":4785,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:45.316226+0000","last_change":"2024-04-26T23:40:41.690579+0000","last_active":"2024-04-26T23:49:45.316226+0000","last_peered":"2024-04-26T23:49:45.316226+0000","last_clean":"2024-04-26T23:49:45.316226+0000","last_became_active":"2024-04-26T23:40:41.690262+0000","last_became_peered":"2024-04-26T23:40:41.690262+0000","last_unstale":"2024-04-26T23:49:45.316226+0000","last_undegraded":"2024-04-26T23:49:45.316226+0000","last_fullsized":"2024-04-26T23:49:45.316226+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":4764,"log_dups_size":0,"ondisk_log_size":4764,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":71706,"num_write_kb":928511,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"26'3562","reported_seq":3596,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.923583+0000","last_change":"2024-04-26T23:41:30.513890+0000","last_active":"2024-04-26T23:49:42.923583+0000","last_peered":"2024-04-26T23:49:42.923583+0000","last_clean":"2024-04-26T23:49:42.923583+0000","last_became_active":"2024-04-26T23:41:30.513571+0000","last_became_peered":"2024-04-26T23:41:30.513571+0000","last_unstale":"2024-04-26T23:49:42.923583+0000","last_undegraded":"2024-04-26T23:49:42.923583+0000","last_fullsized":"2024-04-26T23:49:42.923583+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":3562,"log_dups_size":0,"ondisk_log_size":3562,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53479,"num_write_kb":687907,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.22","version":"26'5438","reported_seq":5458,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:45.267287+0000","last_change":"2024-04-26T23:40:41.677679+0000","last_active":"2024-04-26T23:49:45.267287+0000","last_peered":"2024-04-26T23:49:45.267287+0000","last_clean":"2024-04-26T23:49:45.267287+0000","last_became_active":"2024-04-26T23:40:41.677398+0000","last_became_peered":"2024-04-26T23:40:41.677398+0000","last_unstale":"2024-04-26T23:49:45.267287+0000","last_undegraded":"2024-04-26T23:49:45.267287+0000","last_fullsized":"2024-04-26T23:49:45.267287+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":5438,"log_dups_size":0,"ondisk_log_size":5438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:42:13.754586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":81903,"num_write_kb":1031435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.24","version":"26'3690","reported_seq":3719,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.925640+0000","last_change":"2024-04-26T23:40:32.587921+0000","last_active":"2024-04-26T23:49:42.925640+0000","last_peered":"2024-04-26T23:49:42.925640+0000","last_clean":"2024-04-26T23:49:42.925640+0000","last_became_active":"2024-04-26T23:40:32.587630+0000","last_became_peered":"2024-04-26T23:40:32.587630+0000","last_unstale":"2024-04-26T23:49:42.925640+0000","last_undegraded":"2024-04-26T23:49:42.925640+0000","last_fullsized":"2024-04-26T23:49:42.925640+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":3690,"log_dups_size":0,"ondisk_log_size":3690,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55280,"num_write_kb":715530,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.23","version":"26'3842","reported_seq":3862,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:45.263271+0000","last_change":"2024-04-26T23:40:41.690235+0000","last_active":"2024-04-26T23:49:45.263271+0000","last_peered":"2024-04-26T23:49:45.263271+0000","last_clean":"2024-04-26T23:49:45.263271+0000","last_became_active":"2024-04-26T23:40:41.689911+0000","last_became_peered":"2024-04-26T23:40:41.689911+0000","last_unstale":"2024-04-26T23:49:45.263271+0000","last_undegraded":"2024-04-26T23:49:45.263271+0000","last_fullsized":"2024-04-26T23:49:45.263271+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":3842,"log_dups_size":0,"ondisk_log_size":3842,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:21:56.950703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":57757,"num_write_kb":753623,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"26'4516","reported_seq":4545,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.888257+0000","last_change":"2024-04-26T23:40:32.583376+0000","last_active":"2024-04-26T23:49:42.888257+0000","last_peered":"2024-04-26T23:49:42.888257+0000","last_clean":"2024-04-26T23:49:42.888257+0000","last_became_active":"2024-04-26T23:40:32.583089+0000","last_became_peered":"2024-04-26T23:40:32.583089+0000","last_unstale":"2024-04-26T23:49:42.888257+0000","last_undegraded":"2024-04-26T23:49:42.888257+0000","last_fullsized":"2024-04-26T23:49:42.888257+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":4516,"log_dups_size":0,"ondisk_log_size":4516,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":67860,"num_write_kb":874899,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.20","version":"26'5612","reported_seq":5632,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:45.291716+0000","last_change":"2024-04-26T23:40:41.688464+0000","last_active":"2024-04-26T23:49:45.291716+0000","last_peered":"2024-04-26T23:49:45.291716+0000","last_clean":"2024-04-26T23:49:45.291716+0000","last_became_active":"2024-04-26T23:40:41.688028+0000","last_became_peered":"2024-04-26T23:40:41.688028+0000","last_unstale":"2024-04-26T23:49:45.291716+0000","last_undegraded":"2024-04-26T23:49:45.291716+0000","last_fullsized":"2024-04-26T23:49:45.291716+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":5612,"log_dups_size":0,"ondisk_log_size":5612,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:21:56.950703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":84399,"num_write_kb":1068733,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.26","version":"26'3757","reported_seq":3785,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.964764+0000","last_change":"2024-04-26T23:40:32.589080+0000","last_active":"2024-04-26T23:49:42.964764+0000","last_peered":"2024-04-26T23:49:42.964764+0000","last_clean":"2024-04-26T23:49:42.964764+0000","last_became_active":"2024-04-26T23:40:32.588793+0000","last_became_peered":"2024-04-26T23:40:32.588793+0000","last_unstale":"2024-04-26T23:49:42.964764+0000","last_undegraded":"2024-04-26T23:49:42.964764+0000","last_fullsized":"2024-04-26T23:49:42.964764+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":3757,"log_dups_size":0,"ondisk_log_size":3757,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:18:09.706875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":56209,"num_write_kb":727106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.21","version":"26'4827","reported_seq":4847,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:45.272597+0000","last_change":"2024-04-26T23:40:41.688445+0000","last_active":"2024-04-26T23:49:45.272597+0000","last_peered":"2024-04-26T23:49:45.272597+0000","last_clean":"2024-04-26T23:49:45.272597+0000","last_became_active":"2024-04-26T23:40:41.688163+0000","last_became_peered":"2024-04-26T23:40:41.688163+0000","last_unstale":"2024-04-26T23:49:45.272597+0000","last_undegraded":"2024-04-26T23:49:45.272597+0000","last_fullsized":"2024-04-26T23:49:45.272597+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":4827,"log_dups_size":0,"ondisk_log_size":4827,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:30:04.999018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":72614,"num_write_kb":926316,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"26'4897","reported_seq":4926,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.900631+0000","last_change":"2024-04-26T23:40:32.588177+0000","last_active":"2024-04-26T23:49:42.900631+0000","last_peered":"2024-04-26T23:49:42.900631+0000","last_clean":"2024-04-26T23:49:42.900631+0000","last_became_active":"2024-04-26T23:40:32.586926+0000","last_became_peered":"2024-04-26T23:40:32.586926+0000","last_unstale":"2024-04-26T23:49:42.900631+0000","last_undegraded":"2024-04-26T23:49:42.900631+0000","last_fullsized":"2024-04-26T23:49:42.900631+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":4897,"log_dups_size":0,"ondisk_log_size":4897,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":73419,"num_write_kb":930971,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2e","version":"26'3627","reported_seq":3647,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:45.322716+0000","last_change":"2024-04-26T23:40:41.688396+0000","last_active":"2024-04-26T23:49:45.322716+0000","last_peered":"2024-04-26T23:49:45.322716+0000","last_clean":"2024-04-26T23:49:45.322716+0000","last_became_active":"2024-04-26T23:40:41.688087+0000","last_became_peered":"2024-04-26T23:40:41.688087+0000","last_unstale":"2024-04-26T23:49:45.322716+0000","last_undegraded":"2024-04-26T23:49:45.322716+0000","last_fullsized":"2024-04-26T23:49:45.322716+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":3627,"log_dups_size":0,"ondisk_log_size":3627,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":54377,"num_write_kb":682463,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"26'3685","reported_seq":3713,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.949922+0000","last_change":"2024-04-26T23:40:32.582959+0000","last_active":"2024-04-26T23:49:42.949922+0000","last_peered":"2024-04-26T23:49:42.949922+0000","last_clean":"2024-04-26T23:49:42.949922+0000","last_became_active":"2024-04-26T23:40:32.582100+0000","last_became_peered":"2024-04-26T23:40:32.582100+0000","last_unstale":"2024-04-26T23:49:42.949922+0000","last_undegraded":"2024-04-26T23:49:42.949922+0000","last_fullsized":"2024-04-26T23:49:42.949922+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":3685,"log_dups_size":0,"ondisk_log_size":3685,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:37:30.361795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55124,"num_write_kb":707502,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2f","version":"26'5401","reported_seq":5420,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:45.272131+0000","last_change":"2024-04-26T23:40:41.681088+0000","last_active":"2024-04-26T23:49:45.272131+0000","last_peered":"2024-04-26T23:49:45.272131+0000","last_clean":"2024-04-26T23:49:45.272131+0000","last_became_active":"2024-04-26T23:40:41.680581+0000","last_became_peered":"2024-04-26T23:40:41.680581+0000","last_unstale":"2024-04-26T23:49:45.272131+0000","last_undegraded":"2024-04-26T23:49:45.272131+0000","last_fullsized":"2024-04-26T23:49:45.272131+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":5401,"log_dups_size":0,"ondisk_log_size":5401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:41:52.386084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":81323,"num_write_kb":1040915,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.29","version":"26'4135","reported_seq":4164,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.944745+0000","last_change":"2024-04-26T23:40:32.593958+0000","last_active":"2024-04-26T23:49:42.944745+0000","last_peered":"2024-04-26T23:49:42.944745+0000","last_clean":"2024-04-26T23:49:42.944745+0000","last_became_active":"2024-04-26T23:40:32.593639+0000","last_became_peered":"2024-04-26T23:40:32.593639+0000","last_unstale":"2024-04-26T23:49:42.944745+0000","last_undegraded":"2024-04-26T23:49:42.944745+0000","last_fullsized":"2024-04-26T23:49:42.944745+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":4135,"log_dups_size":0,"ondisk_log_size":4135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":62129,"num_write_kb":797085,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"26'4466","reported_seq":4486,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:45.235041+0000","last_change":"2024-04-26T23:40:41.674573+0000","last_active":"2024-04-26T23:49:45.235041+0000","last_peered":"2024-04-26T23:49:45.235041+0000","last_clean":"2024-04-26T23:49:45.235041+0000","last_became_active":"2024-04-26T23:40:41.674274+0000","last_became_peered":"2024-04-26T23:40:41.674274+0000","last_unstale":"2024-04-26T23:49:45.235041+0000","last_undegraded":"2024-04-26T23:49:45.235041+0000","last_fullsized":"2024-04-26T23:49:45.235041+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":4466,"log_dups_size":0,"ondisk_log_size":4466,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:37:39.460955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":67376,"num_write_kb":867303,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"26'4512","reported_seq":4540,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.995030+0000","last_change":"2024-04-26T23:40:32.591700+0000","last_active":"2024-04-26T23:49:42.995030+0000","last_peered":"2024-04-26T23:49:42.995030+0000","last_clean":"2024-04-26T23:49:42.995030+0000","last_became_active":"2024-04-26T23:40:32.591366+0000","last_became_peered":"2024-04-26T23:40:32.591366+0000","last_unstale":"2024-04-26T23:49:42.995030+0000","last_undegraded":"2024-04-26T23:49:42.995030+0000","last_fullsized":"2024-04-26T23:49:42.995030+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":4512,"log_dups_size":0,"ondisk_log_size":4512,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:10:02.629199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":67679,"num_write_kb":882467,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2d","version":"26'4496","reported_seq":4517,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:49.674555+0000","last_change":"2024-04-26T23:40:41.692402+0000","last_active":"2024-04-26T23:49:49.674555+0000","last_peered":"2024-04-26T23:49:49.674555+0000","last_clean":"2024-04-26T23:49:49.674555+0000","last_became_active":"2024-04-26T23:40:41.692122+0000","last_became_peered":"2024-04-26T23:40:41.692122+0000","last_unstale":"2024-04-26T23:49:49.674555+0000","last_undegraded":"2024-04-26T23:49:49.674555+0000","last_fullsized":"2024-04-26T23:49:49.674555+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":4496,"log_dups_size":0,"ondisk_log_size":4496,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":67600,"num_write_kb":861109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2b","version":"26'4261","reported_seq":4290,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.949644+0000","last_change":"2024-04-26T23:40:32.590443+0000","last_active":"2024-04-26T23:49:42.949644+0000","last_peered":"2024-04-26T23:49:42.949644+0000","last_clean":"2024-04-26T23:49:42.949644+0000","last_became_active":"2024-04-26T23:40:32.590193+0000","last_became_peered":"2024-04-26T23:40:32.590193+0000","last_unstale":"2024-04-26T23:49:42.949644+0000","last_undegraded":"2024-04-26T23:49:42.949644+0000","last_fullsized":"2024-04-26T23:49:42.949644+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":4261,"log_dups_size":0,"ondisk_log_size":4261,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":63685,"num_write_kb":822261,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2a","version":"26'5005","reported_seq":5025,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:45.242060+0000","last_change":"2024-04-26T23:40:41.692194+0000","last_active":"2024-04-26T23:49:45.242060+0000","last_peered":"2024-04-26T23:49:45.242060+0000","last_clean":"2024-04-26T23:49:45.242060+0000","last_became_active":"2024-04-26T23:40:41.691837+0000","last_became_peered":"2024-04-26T23:40:41.691837+0000","last_unstale":"2024-04-26T23:49:45.242060+0000","last_undegraded":"2024-04-26T23:49:45.242060+0000","last_fullsized":"2024-04-26T23:49:45.242060+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":5005,"log_dups_size":0,"ondisk_log_size":5005,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:58:45.972045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":75356,"num_write_kb":950203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"26'4090","reported_seq":4118,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.876315+0000","last_change":"2024-04-26T23:40:32.590538+0000","last_active":"2024-04-26T23:49:42.876315+0000","last_peered":"2024-04-26T23:49:42.876315+0000","last_clean":"2024-04-26T23:49:42.876315+0000","last_became_active":"2024-04-26T23:40:32.590241+0000","last_became_peered":"2024-04-26T23:40:32.590241+0000","last_unstale":"2024-04-26T23:49:42.876315+0000","last_undegraded":"2024-04-26T23:49:42.876315+0000","last_fullsized":"2024-04-26T23:49:42.876315+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":4090,"log_dups_size":0,"ondisk_log_size":4090,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:38:10.884592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":61267,"num_write_kb":785631,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"26'4591","reported_seq":4611,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:45.270124+0000","last_change":"2024-04-26T23:40:41.689529+0000","last_active":"2024-04-26T23:49:45.270124+0000","last_peered":"2024-04-26T23:49:45.270124+0000","last_clean":"2024-04-26T23:49:45.270124+0000","last_became_active":"2024-04-26T23:40:41.689215+0000","last_became_peered":"2024-04-26T23:40:41.689215+0000","last_unstale":"2024-04-26T23:49:45.270124+0000","last_undegraded":"2024-04-26T23:49:45.270124+0000","last_fullsized":"2024-04-26T23:49:45.270124+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":4591,"log_dups_size":0,"ondisk_log_size":4591,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:38:42.155257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":68781,"num_write_kb":892789,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2d","version":"26'4171","reported_seq":4199,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.943207+0000","last_change":"2024-04-26T23:40:32.588445+0000","last_active":"2024-04-26T23:49:42.943207+0000","last_peered":"2024-04-26T23:49:42.943207+0000","last_clean":"2024-04-26T23:49:42.943207+0000","last_became_active":"2024-04-26T23:40:32.588063+0000","last_became_peered":"2024-04-26T23:40:32.588063+0000","last_unstale":"2024-04-26T23:49:42.943207+0000","last_undegraded":"2024-04-26T23:49:42.943207+0000","last_fullsized":"2024-04-26T23:49:42.943207+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":4171,"log_dups_size":0,"ondisk_log_size":4171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:44:58.977344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":62428,"num_write_kb":793377,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.28","version":"26'4028","reported_seq":4048,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:45.221465+0000","last_change":"2024-04-26T23:40:41.674893+0000","last_active":"2024-04-26T23:49:45.221465+0000","last_peered":"2024-04-26T23:49:45.221465+0000","last_clean":"2024-04-26T23:49:45.221465+0000","last_became_active":"2024-04-26T23:40:41.674573+0000","last_became_peered":"2024-04-26T23:40:41.674573+0000","last_unstale":"2024-04-26T23:49:45.221465+0000","last_undegraded":"2024-04-26T23:49:45.221465+0000","last_fullsized":"2024-04-26T23:49:45.221465+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":4028,"log_dups_size":0,"ondisk_log_size":4028,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:36:21.487122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":60451,"num_write_kb":760274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"26'3337","reported_seq":3365,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.873346+0000","last_change":"2024-04-26T23:40:32.574795+0000","last_active":"2024-04-26T23:49:42.873346+0000","last_peered":"2024-04-26T23:49:42.873346+0000","last_clean":"2024-04-26T23:49:42.873346+0000","last_became_active":"2024-04-26T23:40:32.574503+0000","last_became_peered":"2024-04-26T23:40:32.574503+0000","last_unstale":"2024-04-26T23:49:42.873346+0000","last_undegraded":"2024-04-26T23:49:42.873346+0000","last_fullsized":"2024-04-26T23:49:42.873346+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":3337,"log_dups_size":0,"ondisk_log_size":3337,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:30:11.401955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49634,"num_write_kb":627043,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.29","version":"26'4410","reported_seq":4431,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:45.250932+0000","last_change":"2024-04-26T23:40:41.680247+0000","last_active":"2024-04-26T23:49:45.250932+0000","last_peered":"2024-04-26T23:49:45.250932+0000","last_clean":"2024-04-26T23:49:45.250932+0000","last_became_active":"2024-04-26T23:40:41.679920+0000","last_became_peered":"2024-04-26T23:40:41.679920+0000","last_unstale":"2024-04-26T23:49:45.250932+0000","last_undegraded":"2024-04-26T23:49:45.250932+0000","last_fullsized":"2024-04-26T23:49:45.250932+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":4410,"log_dups_size":0,"ondisk_log_size":4410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":66255,"num_write_kb":845549,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2f","version":"26'5167","reported_seq":5194,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.941421+0000","last_change":"2024-04-26T23:40:32.593432+0000","last_active":"2024-04-26T23:49:42.941421+0000","last_peered":"2024-04-26T23:49:42.941421+0000","last_clean":"2024-04-26T23:49:42.941421+0000","last_became_active":"2024-04-26T23:40:32.593169+0000","last_became_peered":"2024-04-26T23:40:32.593169+0000","last_unstale":"2024-04-26T23:49:42.941421+0000","last_undegraded":"2024-04-26T23:49:42.941421+0000","last_fullsized":"2024-04-26T23:49:42.941421+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":5167,"log_dups_size":0,"ondisk_log_size":5167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:44:42.494850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":77406,"num_write_kb":981579,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.36","version":"26'5055","reported_seq":5075,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:45.292873+0000","last_change":"2024-04-26T23:40:41.694551+0000","last_active":"2024-04-26T23:49:45.292873+0000","last_peered":"2024-04-26T23:49:45.292873+0000","last_clean":"2024-04-26T23:49:45.292873+0000","last_became_active":"2024-04-26T23:40:41.694297+0000","last_became_peered":"2024-04-26T23:40:41.694297+0000","last_unstale":"2024-04-26T23:49:45.292873+0000","last_undegraded":"2024-04-26T23:49:45.292873+0000","last_fullsized":"2024-04-26T23:49:45.292873+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":5055,"log_dups_size":0,"ondisk_log_size":5055,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":75865,"num_write_kb":998838,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"26'3722","reported_seq":3749,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.950014+0000","last_change":"2024-04-26T23:40:32.585137+0000","last_active":"2024-04-26T23:49:42.950014+0000","last_peered":"2024-04-26T23:49:42.950014+0000","last_clean":"2024-04-26T23:49:42.950014+0000","last_became_active":"2024-04-26T23:40:32.584678+0000","last_became_peered":"2024-04-26T23:40:32.584678+0000","last_unstale":"2024-04-26T23:49:42.950014+0000","last_undegraded":"2024-04-26T23:49:42.950014+0000","last_fullsized":"2024-04-26T23:49:42.950014+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":3722,"log_dups_size":0,"ondisk_log_size":3722,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:04:30.553552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55693,"num_write_kb":722935,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.37","version":"26'5541","reported_seq":5560,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:45.277633+0000","last_change":"2024-04-26T23:40:41.692433+0000","last_active":"2024-04-26T23:49:45.277633+0000","last_peered":"2024-04-26T23:49:45.277633+0000","last_clean":"2024-04-26T23:49:45.277633+0000","last_became_active":"2024-04-26T23:40:41.692090+0000","last_became_peered":"2024-04-26T23:40:41.692090+0000","last_unstale":"2024-04-26T23:49:45.277633+0000","last_undegraded":"2024-04-26T23:49:45.277633+0000","last_fullsized":"2024-04-26T23:49:45.277633+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":5541,"log_dups_size":0,"ondisk_log_size":5541,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:37:25.006229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":83365,"num_write_kb":1062103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"26'4290","reported_seq":4318,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.900342+0000","last_change":"2024-04-26T23:40:32.590452+0000","last_active":"2024-04-26T23:49:42.900342+0000","last_peered":"2024-04-26T23:49:42.900342+0000","last_clean":"2024-04-26T23:49:42.900342+0000","last_became_active":"2024-04-26T23:40:32.590162+0000","last_became_peered":"2024-04-26T23:40:32.590162+0000","last_unstale":"2024-04-26T23:49:42.900342+0000","last_undegraded":"2024-04-26T23:49:42.900342+0000","last_fullsized":"2024-04-26T23:49:42.900342+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":4290,"log_dups_size":0,"ondisk_log_size":4290,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":64302,"num_write_kb":811481,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.34","version":"26'3759","reported_seq":3778,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:45.226682+0000","last_change":"2024-04-26T23:40:41.687270+0000","last_active":"2024-04-26T23:49:45.226682+0000","last_peered":"2024-04-26T23:49:45.226682+0000","last_clean":"2024-04-26T23:49:45.226682+0000","last_became_active":"2024-04-26T23:40:41.686999+0000","last_became_peered":"2024-04-26T23:40:41.686999+0000","last_unstale":"2024-04-26T23:49:45.226682+0000","last_undegraded":"2024-04-26T23:49:45.226682+0000","last_fullsized":"2024-04-26T23:49:45.226682+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":3759,"log_dups_size":0,"ondisk_log_size":3759,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:21:42.565349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":56674,"num_write_kb":713071,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"26'4299","reported_seq":4327,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.893397+0000","last_change":"2024-04-26T23:40:32.586436+0000","last_active":"2024-04-26T23:49:42.893397+0000","last_peered":"2024-04-26T23:49:42.893397+0000","last_clean":"2024-04-26T23:49:42.893397+0000","last_became_active":"2024-04-26T23:40:32.585995+0000","last_became_peered":"2024-04-26T23:40:32.585995+0000","last_unstale":"2024-04-26T23:49:42.893397+0000","last_undegraded":"2024-04-26T23:49:42.893397+0000","last_fullsized":"2024-04-26T23:49:42.893397+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":4299,"log_dups_size":0,"ondisk_log_size":4299,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":64455,"num_write_kb":829744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.35","version":"26'4332","reported_seq":4351,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:45.246101+0000","last_change":"2024-04-26T23:40:41.691693+0000","last_active":"2024-04-26T23:49:45.246101+0000","last_peered":"2024-04-26T23:49:45.246101+0000","last_clean":"2024-04-26T23:49:45.246101+0000","last_became_active":"2024-04-26T23:40:41.691437+0000","last_became_peered":"2024-04-26T23:40:41.691437+0000","last_unstale":"2024-04-26T23:49:45.246101+0000","last_undegraded":"2024-04-26T23:49:45.246101+0000","last_fullsized":"2024-04-26T23:49:45.246101+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":4332,"log_dups_size":0,"ondisk_log_size":4332,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:06:12.755431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":65307,"num_write_kb":818233,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.33","version":"26'3786","reported_seq":3814,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.914778+0000","last_change":"2024-04-26T23:40:32.592988+0000","last_active":"2024-04-26T23:49:42.914778+0000","last_peered":"2024-04-26T23:49:42.914778+0000","last_clean":"2024-04-26T23:49:42.914778+0000","last_became_active":"2024-04-26T23:40:32.592717+0000","last_became_peered":"2024-04-26T23:40:32.592717+0000","last_unstale":"2024-04-26T23:49:42.914778+0000","last_undegraded":"2024-04-26T23:49:42.914778+0000","last_fullsized":"2024-04-26T23:49:42.914778+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":3786,"log_dups_size":0,"ondisk_log_size":3786,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":56607,"num_write_kb":740250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.32","version":"26'4732","reported_seq":4752,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:45.279900+0000","last_change":"2024-04-26T23:40:41.675335+0000","last_active":"2024-04-26T23:49:45.279900+0000","last_peered":"2024-04-26T23:49:45.279900+0000","last_clean":"2024-04-26T23:49:45.279900+0000","last_became_active":"2024-04-26T23:40:41.675042+0000","last_became_peered":"2024-04-26T23:40:41.675042+0000","last_unstale":"2024-04-26T23:49:45.279900+0000","last_undegraded":"2024-04-26T23:49:45.279900+0000","last_fullsized":"2024-04-26T23:49:45.279900+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":4732,"log_dups_size":0,"ondisk_log_size":4732,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":71116,"num_write_kb":894316,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"26'3513","reported_seq":3540,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.972217+0000","last_change":"2024-04-26T23:40:32.595129+0000","last_active":"2024-04-26T23:49:42.972217+0000","last_peered":"2024-04-26T23:49:42.972217+0000","last_clean":"2024-04-26T23:49:42.972217+0000","last_became_active":"2024-04-26T23:40:32.594802+0000","last_became_peered":"2024-04-26T23:40:32.594802+0000","last_unstale":"2024-04-26T23:49:42.972217+0000","last_undegraded":"2024-04-26T23:49:42.972217+0000","last_fullsized":"2024-04-26T23:49:42.972217+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":3513,"log_dups_size":0,"ondisk_log_size":3513,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:48:33.020039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":52734,"num_write_kb":670887,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.33","version":"26'4045","reported_seq":4064,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:45.253703+0000","last_change":"2024-04-26T23:40:41.691159+0000","last_active":"2024-04-26T23:49:45.253703+0000","last_peered":"2024-04-26T23:49:45.253703+0000","last_clean":"2024-04-26T23:49:45.253703+0000","last_became_active":"2024-04-26T23:40:41.690846+0000","last_became_peered":"2024-04-26T23:40:41.690846+0000","last_unstale":"2024-04-26T23:49:45.253703+0000","last_undegraded":"2024-04-26T23:49:45.253703+0000","last_fullsized":"2024-04-26T23:49:45.253703+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":4045,"log_dups_size":0,"ondisk_log_size":4045,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:45:08.076505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":60666,"num_write_kb":797602,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.35","version":"26'4035","reported_seq":4062,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.914117+0000","last_change":"2024-04-26T23:40:32.578819+0000","last_active":"2024-04-26T23:49:42.914117+0000","last_peered":"2024-04-26T23:49:42.914117+0000","last_clean":"2024-04-26T23:49:42.914117+0000","last_became_active":"2024-04-26T23:40:32.578556+0000","last_became_peered":"2024-04-26T23:40:32.578556+0000","last_unstale":"2024-04-26T23:49:42.914117+0000","last_undegraded":"2024-04-26T23:49:42.914117+0000","last_fullsized":"2024-04-26T23:49:42.914117+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":4035,"log_dups_size":0,"ondisk_log_size":4035,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:17:46.135806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":60570,"num_write_kb":769077,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.30","version":"26'3969","reported_seq":3988,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:45.289261+0000","last_change":"2024-04-26T23:40:41.689812+0000","last_active":"2024-04-26T23:49:45.289261+0000","last_peered":"2024-04-26T23:49:45.289261+0000","last_clean":"2024-04-26T23:49:45.289261+0000","last_became_active":"2024-04-26T23:40:41.689267+0000","last_became_peered":"2024-04-26T23:40:41.689267+0000","last_unstale":"2024-04-26T23:49:45.289261+0000","last_undegraded":"2024-04-26T23:49:45.289261+0000","last_fullsized":"2024-04-26T23:49:45.289261+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":3969,"log_dups_size":0,"ondisk_log_size":3969,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:21:42.565349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":59630,"num_write_kb":775739,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"26'4731","reported_seq":4758,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.972370+0000","last_change":"2024-04-26T23:40:32.578155+0000","last_active":"2024-04-26T23:49:42.972370+0000","last_peered":"2024-04-26T23:49:42.972370+0000","last_clean":"2024-04-26T23:49:42.972370+0000","last_became_active":"2024-04-26T23:40:32.577865+0000","last_became_peered":"2024-04-26T23:40:32.577865+0000","last_unstale":"2024-04-26T23:49:42.972370+0000","last_undegraded":"2024-04-26T23:49:42.972370+0000","last_fullsized":"2024-04-26T23:49:42.972370+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":4731,"log_dups_size":0,"ondisk_log_size":4731,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:40:17.167353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":70795,"num_write_kb":915734,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.31","version":"26'4442","reported_seq":4461,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:45.244899+0000","last_change":"2024-04-26T23:40:41.680962+0000","last_active":"2024-04-26T23:49:45.244899+0000","last_peered":"2024-04-26T23:49:45.244899+0000","last_clean":"2024-04-26T23:49:45.244899+0000","last_became_active":"2024-04-26T23:40:41.680676+0000","last_became_peered":"2024-04-26T23:40:41.680676+0000","last_unstale":"2024-04-26T23:49:45.244899+0000","last_undegraded":"2024-04-26T23:49:45.244899+0000","last_fullsized":"2024-04-26T23:49:45.244899+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":4442,"log_dups_size":0,"ondisk_log_size":4442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:42:13.754586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":66738,"num_write_kb":853261,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"26'4979","reported_seq":5006,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.990989+0000","last_change":"2024-04-26T23:40:32.591487+0000","last_active":"2024-04-26T23:49:42.990989+0000","last_peered":"2024-04-26T23:49:42.990989+0000","last_clean":"2024-04-26T23:49:42.990989+0000","last_became_active":"2024-04-26T23:40:32.591209+0000","last_became_peered":"2024-04-26T23:40:32.591209+0000","last_unstale":"2024-04-26T23:49:42.990989+0000","last_undegraded":"2024-04-26T23:49:42.990989+0000","last_fullsized":"2024-04-26T23:49:42.990989+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":4979,"log_dups_size":0,"ondisk_log_size":4979,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:52:26.699790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":74710,"num_write_kb":992211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3e","version":"26'5670","reported_seq":5691,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:45.324828+0000","last_change":"2024-04-26T23:40:41.686089+0000","last_active":"2024-04-26T23:49:45.324828+0000","last_peered":"2024-04-26T23:49:45.324828+0000","last_clean":"2024-04-26T23:49:45.324828+0000","last_became_active":"2024-04-26T23:40:41.685786+0000","last_became_peered":"2024-04-26T23:40:41.685786+0000","last_unstale":"2024-04-26T23:49:45.324828+0000","last_undegraded":"2024-04-26T23:49:45.324828+0000","last_fullsized":"2024-04-26T23:49:45.324828+0000","mapping_epoch":22,"log_start":"26'400","ondisk_log_start":"26'400","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":5270,"log_dups_size":0,"ondisk_log_size":5270,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":85672,"num_write_kb":1105852,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.38","version":"26'4537","reported_seq":4565,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.914325+0000","last_change":"2024-04-26T23:40:32.592543+0000","last_active":"2024-04-26T23:49:42.914325+0000","last_peered":"2024-04-26T23:49:42.914325+0000","last_clean":"2024-04-26T23:49:42.914325+0000","last_became_active":"2024-04-26T23:40:32.592282+0000","last_became_peered":"2024-04-26T23:40:32.592282+0000","last_unstale":"2024-04-26T23:49:42.914325+0000","last_undegraded":"2024-04-26T23:49:42.914325+0000","last_fullsized":"2024-04-26T23:49:42.914325+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":4537,"log_dups_size":0,"ondisk_log_size":4537,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":68313,"num_write_kb":849602,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3f","version":"26'3838","reported_seq":3858,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:45.260602+0000","last_change":"2024-04-26T23:40:41.679306+0000","last_active":"2024-04-26T23:49:45.260602+0000","last_peered":"2024-04-26T23:49:45.260602+0000","last_clean":"2024-04-26T23:49:45.260602+0000","last_became_active":"2024-04-26T23:40:41.678926+0000","last_became_peered":"2024-04-26T23:40:41.678926+0000","last_unstale":"2024-04-26T23:49:45.260602+0000","last_undegraded":"2024-04-26T23:49:45.260602+0000","last_fullsized":"2024-04-26T23:49:45.260602+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":3838,"log_dups_size":0,"ondisk_log_size":3838,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:27:48.823509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":57629,"num_write_kb":750507,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.39","version":"26'4047","reported_seq":4060,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.888642+0000","last_change":"2024-04-26T23:41:30.373208+0000","last_active":"2024-04-26T23:49:42.888642+0000","last_peered":"2024-04-26T23:49:42.888642+0000","last_clean":"2024-04-26T23:49:42.888642+0000","last_became_active":"2024-04-26T23:41:30.372928+0000","last_became_peered":"2024-04-26T23:41:30.372928+0000","last_unstale":"2024-04-26T23:49:42.888642+0000","last_undegraded":"2024-04-26T23:49:42.888642+0000","last_fullsized":"2024-04-26T23:49:42.888642+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":4047,"log_dups_size":0,"ondisk_log_size":4047,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:21:47.851542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":60897,"num_write_kb":776135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3c","version":"26'4076","reported_seq":4097,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:45.246230+0000","last_change":"2024-04-26T23:40:41.689567+0000","last_active":"2024-04-26T23:49:45.246230+0000","last_peered":"2024-04-26T23:49:45.246230+0000","last_clean":"2024-04-26T23:49:45.246230+0000","last_became_active":"2024-04-26T23:40:41.688585+0000","last_became_peered":"2024-04-26T23:40:41.688585+0000","last_unstale":"2024-04-26T23:49:45.246230+0000","last_undegraded":"2024-04-26T23:49:45.246230+0000","last_fullsized":"2024-04-26T23:49:45.246230+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":4076,"log_dups_size":0,"ondisk_log_size":4076,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":61409,"num_write_kb":797665,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"26'3610","reported_seq":3637,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.991991+0000","last_change":"2024-04-26T23:40:32.584619+0000","last_active":"2024-04-26T23:49:42.991991+0000","last_peered":"2024-04-26T23:49:42.991991+0000","last_clean":"2024-04-26T23:49:42.991991+0000","last_became_active":"2024-04-26T23:40:32.584293+0000","last_became_peered":"2024-04-26T23:40:32.584293+0000","last_unstale":"2024-04-26T23:49:42.991991+0000","last_undegraded":"2024-04-26T23:49:42.991991+0000","last_fullsized":"2024-04-26T23:49:42.991991+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":3610,"log_dups_size":0,"ondisk_log_size":3610,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:40:17.167353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":54297,"num_write_kb":686705,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3d","version":"26'4621","reported_seq":4641,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:45.297777+0000","last_change":"2024-04-26T23:40:41.691614+0000","last_active":"2024-04-26T23:49:45.297777+0000","last_peered":"2024-04-26T23:49:45.297777+0000","last_clean":"2024-04-26T23:49:45.297777+0000","last_became_active":"2024-04-26T23:40:41.691081+0000","last_became_peered":"2024-04-26T23:40:41.691081+0000","last_unstale":"2024-04-26T23:49:45.297777+0000","last_undegraded":"2024-04-26T23:49:45.297777+0000","last_fullsized":"2024-04-26T23:49:45.297777+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":4621,"log_dups_size":0,"ondisk_log_size":4621,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:24:07.784468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69615,"num_write_kb":867426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"26'4911","reported_seq":4938,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.888073+0000","last_change":"2024-04-26T23:40:32.588894+0000","last_active":"2024-04-26T23:49:42.888073+0000","last_peered":"2024-04-26T23:49:42.888073+0000","last_clean":"2024-04-26T23:49:42.888073+0000","last_became_active":"2024-04-26T23:40:32.588409+0000","last_became_peered":"2024-04-26T23:40:32.588409+0000","last_unstale":"2024-04-26T23:49:42.888073+0000","last_undegraded":"2024-04-26T23:49:42.888073+0000","last_fullsized":"2024-04-26T23:49:42.888073+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":4911,"log_dups_size":0,"ondisk_log_size":4911,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:35:08.194865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":73569,"num_write_kb":917520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3a","version":"26'3815","reported_seq":3835,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:45.283856+0000","last_change":"2024-04-26T23:40:41.678639+0000","last_active":"2024-04-26T23:49:45.283856+0000","last_peered":"2024-04-26T23:49:45.283856+0000","last_clean":"2024-04-26T23:49:45.283856+0000","last_became_active":"2024-04-26T23:40:41.678333+0000","last_became_peered":"2024-04-26T23:40:41.678333+0000","last_unstale":"2024-04-26T23:49:45.283856+0000","last_undegraded":"2024-04-26T23:49:45.283856+0000","last_fullsized":"2024-04-26T23:49:45.283856+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":3815,"log_dups_size":0,"ondisk_log_size":3815,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":57471,"num_write_kb":738181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"26'3683","reported_seq":3711,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.956847+0000","last_change":"2024-04-26T23:40:32.581875+0000","last_active":"2024-04-26T23:49:42.956847+0000","last_peered":"2024-04-26T23:49:42.956847+0000","last_clean":"2024-04-26T23:49:42.956847+0000","last_became_active":"2024-04-26T23:40:32.580987+0000","last_became_peered":"2024-04-26T23:40:32.580987+0000","last_unstale":"2024-04-26T23:49:42.956847+0000","last_undegraded":"2024-04-26T23:49:42.956847+0000","last_fullsized":"2024-04-26T23:49:42.956847+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":3683,"log_dups_size":0,"ondisk_log_size":3683,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:12:45.093169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55303,"num_write_kb":749693,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3b","version":"26'5311","reported_seq":5330,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:45.257696+0000","last_change":"2024-04-26T23:40:41.678366+0000","last_active":"2024-04-26T23:49:45.257696+0000","last_peered":"2024-04-26T23:49:45.257696+0000","last_clean":"2024-04-26T23:49:45.257696+0000","last_became_active":"2024-04-26T23:40:41.678067+0000","last_became_peered":"2024-04-26T23:40:41.678067+0000","last_unstale":"2024-04-26T23:49:45.257696+0000","last_undegraded":"2024-04-26T23:49:45.257696+0000","last_fullsized":"2024-04-26T23:49:45.257696+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":5311,"log_dups_size":0,"ondisk_log_size":5311,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:44:51.594010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79871,"num_write_kb":1001680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"26'4313","reported_seq":4342,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.885794+0000","last_change":"2024-04-26T23:40:32.579870+0000","last_active":"2024-04-26T23:49:42.885794+0000","last_peered":"2024-04-26T23:49:42.885794+0000","last_clean":"2024-04-26T23:49:42.885794+0000","last_became_active":"2024-04-26T23:40:32.579569+0000","last_became_peered":"2024-04-26T23:40:32.579569+0000","last_unstale":"2024-04-26T23:49:42.885794+0000","last_undegraded":"2024-04-26T23:49:42.885794+0000","last_fullsized":"2024-04-26T23:49:42.885794+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":4313,"log_dups_size":0,"ondisk_log_size":4313,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":64676,"num_write_kb":807158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.38","version":"26'4952","reported_seq":4971,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:45.297693+0000","last_change":"2024-04-26T23:40:41.684020+0000","last_active":"2024-04-26T23:49:45.297693+0000","last_peered":"2024-04-26T23:49:45.297693+0000","last_clean":"2024-04-26T23:49:45.297693+0000","last_became_active":"2024-04-26T23:40:41.683734+0000","last_became_peered":"2024-04-26T23:40:41.683734+0000","last_unstale":"2024-04-26T23:49:45.297693+0000","last_undegraded":"2024-04-26T23:49:45.297693+0000","last_fullsized":"2024-04-26T23:49:45.297693+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":4952,"log_dups_size":0,"ondisk_log_size":4952,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:38:42.155257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":74716,"num_write_kb":913038,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"26'5195","reported_seq":5224,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.887156+0000","last_change":"2024-04-26T23:40:32.583944+0000","last_active":"2024-04-26T23:49:42.887156+0000","last_peered":"2024-04-26T23:49:42.887156+0000","last_clean":"2024-04-26T23:49:42.887156+0000","last_became_active":"2024-04-26T23:40:32.583655+0000","last_became_peered":"2024-04-26T23:40:32.583655+0000","last_unstale":"2024-04-26T23:49:42.887156+0000","last_undegraded":"2024-04-26T23:49:42.887156+0000","last_fullsized":"2024-04-26T23:49:42.887156+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":5195,"log_dups_size":0,"ondisk_log_size":5195,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":78237,"num_write_kb":1038116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.39","version":"26'4261","reported_seq":4280,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:45.271851+0000","last_change":"2024-04-26T23:40:41.681412+0000","last_active":"2024-04-26T23:49:45.271851+0000","last_peered":"2024-04-26T23:49:45.271851+0000","last_clean":"2024-04-26T23:49:45.271851+0000","last_became_active":"2024-04-26T23:40:41.681092+0000","last_became_peered":"2024-04-26T23:40:41.681092+0000","last_unstale":"2024-04-26T23:49:45.271851+0000","last_undegraded":"2024-04-26T23:49:45.271851+0000","last_fullsized":"2024-04-26T23:49:45.271851+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":4261,"log_dups_size":0,"ondisk_log_size":4261,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:48:09.126894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":64162,"num_write_kb":832623,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"26'3628","reported_seq":3656,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.980742+0000","last_change":"2024-04-26T23:40:32.596351+0000","last_active":"2024-04-26T23:49:42.980742+0000","last_peered":"2024-04-26T23:49:42.980742+0000","last_clean":"2024-04-26T23:49:42.980742+0000","last_became_active":"2024-04-26T23:40:32.596050+0000","last_became_peered":"2024-04-26T23:40:32.596050+0000","last_unstale":"2024-04-26T23:49:42.980742+0000","last_undegraded":"2024-04-26T23:49:42.980742+0000","last_fullsized":"2024-04-26T23:49:42.980742+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":3628,"log_dups_size":0,"ondisk_log_size":3628,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:34:14.811917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":54568,"num_write_kb":695399,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4349618,"num_write_kb":55464628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":287816,"ondisk_log_size":287816,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":158829364,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":18,"num_read_kb":98,"num_write":2627,"num_write_kb":157093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":317718528,"data_stored":317658728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2529,"ondisk_log_size":2529,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4020088,"num_write_kb":51543156,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":268065,"ondisk_log_size":268065,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":149566157,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":15,"num_read_kb":95,"num_write":2737,"num_write_kb":148086,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":299196416,"data_stored":299132314,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2599,"ondisk_log_size":2599,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574960,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":835292,"kb_used_data":81300,"kb_used_omap":1,"kb_used_meta":753982,"kb_avail":93536548,"statfs":{"total":96636764160,"available":95781425152,"internally_reserved":0,"allocated":83251200,"data_stored":83071836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":772078026},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574965,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":602412,"kb_used_data":84196,"kb_used_omap":1,"kb_used_meta":518206,"kb_avail":93769428,"statfs":{"total":96636764160,"available":96019894272,"internally_reserved":0,"allocated":86216704,"data_stored":86032549,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":530643398},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574962,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":756680,"kb_used_data":57088,"kb_used_omap":1,"kb_used_meta":699582,"kb_avail":93615160,"statfs":{"total":96636764160,"available":95861923840,"internally_reserved":0,"allocated":58458112,"data_stored":58278514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":716372421},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574963,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":822852,"kb_used_data":94588,"kb_used_omap":1,"kb_used_meta":728254,"kb_avail":93548988,"statfs":{"total":96636764160,"available":95794163712,"internally_reserved":0,"allocated":96858112,"data_stored":96670557,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":745732549},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574962,"num_pgs":58,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":847300,"kb_used_data":106876,"kb_used_omap":1,"kb_used_meta":740414,"kb_avail":93524540,"statfs":{"total":96636764160,"available":95769128960,"internally_reserved":0,"allocated":109441024,"data_stored":109254605,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":758184391},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574964,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":520948,"kb_used_data":24940,"kb_used_omap":1,"kb_used_meta":495998,"kb_avail":93850892,"statfs":{"total":96636764160,"available":96103313408,"internally_reserved":0,"allocated":25538560,"data_stored":25367229,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":507902405},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574963,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":751212,"kb_used_data":110884,"kb_used_omap":1,"kb_used_meta":640318,"kb_avail":93620628,"statfs":{"total":96636764160,"available":95867523072,"internally_reserved":0,"allocated":113545216,"data_stored":113360216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":655686085},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574966,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":604392,"kb_used_data":45920,"kb_used_omap":1,"kb_used_meta":558462,"kb_avail":93767448,"statfs":{"total":96636764160,"available":96017866752,"internally_reserved":0,"allocated":47022080,"data_stored":46841504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":571865541},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":29372416,"data_stored":29360766,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":41951232,"data_stored":41943200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12673024,"data_stored":12671093,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":33652736,"data_stored":33643285,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":46149632,"data_stored":46137470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":29364224,"data_stored":29360218,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":48824320,"data_stored":48813882,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":57208832,"data_stored":57202400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16777216,"data_stored":16777216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":71315456,"data_stored":71303862,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12587008,"data_stored":12582982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":75509760,"data_stored":75498166,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":50429952,"data_stored":50419933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28815360,"data_stored":28805142,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":37113856,"data_stored":37105513,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":25169920,"data_stored":25165914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T23:49:51.760 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-04-26T23:40:40.651867+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=40, tm_sec=40, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=49, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:49:51.760 INFO:tasks.ceph:pgid 2.1f last_scrub_stamp 2024-04-26T23:40:30.548321+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=40, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=49, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:49:51.760 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-04-26T23:40:31.552707+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=40, tm_sec=31, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=49, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:49:51.760 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-04-26T23:40:39.646413+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=40, tm_sec=39, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=49, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:49:51.760 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2024-04-26T23:40:40.651867+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=40, tm_sec=40, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=49, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:49:51.760 INFO:tasks.ceph:pgid 2.1e last_scrub_stamp 2024-04-26T23:40:30.548321+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=40, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=49, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:49:51.760 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-04-26T23:40:31.552707+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=40, tm_sec=31, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=49, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:49:51.761 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-04-26T23:40:39.646413+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=40, tm_sec=39, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=49, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:49:51.761 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-04-26T23:40:40.651867+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=40, tm_sec=40, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=49, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:49:51.761 INFO:tasks.ceph:pgid 2.1d last_scrub_stamp 2024-04-26T23:40:30.548321+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=40, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=49, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:49:51.761 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-04-26T23:40:31.552707+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=40, tm_sec=31, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=49, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:49:51.761 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-04-26T23:40:39.646413+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=40, tm_sec=39, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=49, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:49:51.761 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-04-26T23:40:40.651867+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=40, tm_sec=40, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=49, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:49:51.761 INFO:tasks.ceph:pgid 2.1c last_scrub_stamp 2024-04-26T23:40:30.548321+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=40, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=49, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:49:51.761 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-04-26T23:40:31.552707+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=40, tm_sec=31, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=49, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:49:51.761 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-04-26T23:40:39.646413+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=40, tm_sec=39, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=49, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:49:51.761 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2024-04-26T23:40:40.651867+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=40, tm_sec=40, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=49, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:49:51.762 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-04-26T23:40:31.552707+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=40, tm_sec=31, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=49, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:49:51.762 INFO:tasks.ceph:pgid 2.b last_scrub_stamp 2024-04-26T23:40:30.548321+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=40, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=49, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:49:51.762 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-04-26T23:40:39.646413+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=40, tm_sec=39, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=49, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:49:51.762 INFO:tasks.ceph:pgid 5.d last_scrub_stamp 2024-04-26T23:40:40.651867+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=40, tm_sec=40, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=49, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:49:51.762 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-04-26T23:40:31.552707+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=40, tm_sec=31, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=49, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:49:51.762 INFO:tasks.ceph:pgid 2.a last_scrub_stamp 2024-04-26T23:40:30.548321+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=40, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=49, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:49:51.762 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-04-26T23:40:39.646413+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=40, tm_sec=39, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=49, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:49:51.762 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-04-26T23:40:40.651867+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=40, tm_sec=40, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=49, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:49:51.762 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-04-26T23:40:31.552707+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=40, tm_sec=31, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=49, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:49:51.763 INFO:tasks.ceph:pgid 2.9 last_scrub_stamp 2024-04-26T23:40:30.548321+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=40, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=49, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:49:51.763 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-04-26T23:40:39.646413+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=40, tm_sec=39, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=49, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:49:51.763 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-04-26T23:40:40.651867+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=40, tm_sec=40, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=49, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:49:51.763 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-04-26T23:40:31.552707+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=40, tm_sec=31, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=49, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:49:51.763 INFO:tasks.ceph:pgid 2.8 last_scrub_stamp 2024-04-26T23:40:30.548321+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=40, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=49, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:49:51.763 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-04-26T23:40:39.646413+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=40, tm_sec=39, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=49, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:49:51.763 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-04-26T23:40:40.651867+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=40, tm_sec=40, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=49, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:49:51.764 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-04-26T23:40:31.552707+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=40, tm_sec=31, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=49, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:49:51.764 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-04-26T23:40:30.548321+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=40, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=49, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:49:51.764 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-04-26T23:40:39.646413+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=40, tm_sec=39, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=49, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:49:51.764 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-04-26T23:40:40.651867+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=40, tm_sec=40, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=49, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:49:51.764 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-04-26T23:40:31.552707+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=40, tm_sec=31, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=49, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:49:51.764 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-04-26T23:40:30.548321+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=40, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=49, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:49:51.764 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-04-26T23:40:39.646413+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=40, tm_sec=39, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=49, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:49:51.764 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2024-04-26T23:40:40.651867+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=40, tm_sec=40, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=49, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:49:51.764 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-04-26T23:40:31.552707+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=40, tm_sec=31, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=49, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:49:51.765 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-04-26T23:40:30.548321+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=40, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=49, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:49:51.765 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-04-26T23:40:39.646413+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=40, tm_sec=39, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=49, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:49:51.765 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-04-26T23:40:40.651867+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=40, tm_sec=40, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=49, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:49:51.765 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-04-26T23:40:31.552707+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=40, tm_sec=31, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=49, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:49:51.765 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-04-26T23:40:30.548321+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=40, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=49, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:49:51.765 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-04-26T23:40:39.646413+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=40, tm_sec=39, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=49, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:49:51.765 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2024-04-26T23:40:40.651867+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=40, tm_sec=40, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=49, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:49:51.765 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-04-26T23:40:31.552707+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=40, tm_sec=31, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=49, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:49:51.765 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-04-26T23:40:30.548321+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=40, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=49, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:49:51.765 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-04-26T23:40:39.646413+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=40, tm_sec=39, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=49, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:49:51.766 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2024-04-26T23:40:40.651867+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=40, tm_sec=40, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=49, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:49:51.766 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-04-26T23:40:31.552707+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=40, tm_sec=31, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=49, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:49:51.766 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-04-26T23:40:30.548321+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=40, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=49, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:49:51.766 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-04-26T23:40:40.651867+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=40, tm_sec=40, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=49, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:49:51.766 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-04-26T23:40:31.552707+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=40, tm_sec=31, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=49, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:49:51.766 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-04-26T23:40:30.548321+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=40, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=49, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:49:51.766 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-04-26T23:40:39.646413+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=40, tm_sec=39, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=49, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:49:51.766 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-04-26T23:40:40.651867+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=40, tm_sec=40, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=49, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:49:51.766 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-04-26T23:40:31.552707+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=40, tm_sec=31, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=49, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:49:51.767 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-04-26T23:40:30.548321+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=40, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=49, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:49:51.767 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-04-26T23:40:19.950137+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=40, tm_sec=19, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=49, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:49:51.767 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-04-26T23:40:39.646413+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=40, tm_sec=39, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=49, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:49:51.767 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2024-04-26T23:40:40.651867+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=40, tm_sec=40, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=49, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:49:51.767 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-04-26T23:40:31.552707+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=40, tm_sec=31, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=49, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:49:51.767 INFO:tasks.ceph:pgid 2.c last_scrub_stamp 2024-04-26T23:40:30.548321+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=40, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=49, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:49:51.767 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-04-26T23:40:39.646413+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=40, tm_sec=39, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=49, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:49:51.767 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2024-04-26T23:40:40.651867+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=40, tm_sec=40, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=49, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:49:51.767 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-04-26T23:40:31.552707+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=40, tm_sec=31, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=49, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:49:51.768 INFO:tasks.ceph:pgid 2.d last_scrub_stamp 2024-04-26T23:40:30.548321+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=40, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=49, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:49:51.768 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-04-26T23:40:39.646413+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=40, tm_sec=39, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=49, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:49:51.768 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2024-04-26T23:40:40.651867+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=40, tm_sec=40, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=49, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:49:51.768 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-04-26T23:40:31.552707+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=40, tm_sec=31, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=49, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:49:51.768 INFO:tasks.ceph:pgid 2.e last_scrub_stamp 2024-04-26T23:40:30.548321+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=40, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=49, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:49:51.768 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-04-26T23:40:39.646413+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=40, tm_sec=39, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=49, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:49:51.768 INFO:tasks.ceph:pgid 5.8 last_scrub_stamp 2024-04-26T23:40:40.651867+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=40, tm_sec=40, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=49, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:49:51.768 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-04-26T23:40:31.552707+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=40, tm_sec=31, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=49, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:49:51.768 INFO:tasks.ceph:pgid 2.f last_scrub_stamp 2024-04-26T23:40:30.548321+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=40, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=49, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:49:51.769 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-04-26T23:40:39.646413+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=40, tm_sec=39, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=49, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:49:51.769 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-04-26T23:40:40.651867+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=40, tm_sec=40, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=49, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:49:51.769 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-04-26T23:40:31.552707+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=40, tm_sec=31, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=49, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:49:51.769 INFO:tasks.ceph:pgid 2.10 last_scrub_stamp 2024-04-26T23:40:30.548321+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=40, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=49, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:49:51.769 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-04-26T23:40:40.651867+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=40, tm_sec=40, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=49, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:49:51.769 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-04-26T23:40:31.552707+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=40, tm_sec=31, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=49, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:49:51.769 INFO:tasks.ceph:pgid 2.11 last_scrub_stamp 2024-04-26T23:40:30.548321+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=40, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=49, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:49:51.769 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-04-26T23:40:39.646413+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=40, tm_sec=39, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=49, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:49:51.769 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-04-26T23:40:40.651867+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=40, tm_sec=40, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=49, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:49:51.769 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-04-26T23:40:31.552707+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=40, tm_sec=31, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=49, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:49:51.770 INFO:tasks.ceph:pgid 2.12 last_scrub_stamp 2024-04-26T23:40:30.548321+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=40, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=49, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:49:51.770 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-04-26T23:40:39.646413+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=40, tm_sec=39, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=49, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:49:51.770 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-04-26T23:40:40.651867+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=40, tm_sec=40, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=49, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:49:51.770 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-04-26T23:40:31.552707+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=40, tm_sec=31, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=49, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:49:51.770 INFO:tasks.ceph:pgid 2.13 last_scrub_stamp 2024-04-26T23:40:30.548321+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=40, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=49, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:49:51.770 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-04-26T23:40:39.646413+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=40, tm_sec=39, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=49, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:49:51.770 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-04-26T23:40:40.651867+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=40, tm_sec=40, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=49, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:49:51.770 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-04-26T23:40:31.552707+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=40, tm_sec=31, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=49, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:49:51.770 INFO:tasks.ceph:pgid 2.14 last_scrub_stamp 2024-04-26T23:40:30.548321+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=40, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=49, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:49:51.771 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-04-26T23:40:39.646413+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=40, tm_sec=39, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=49, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:49:51.771 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2024-04-26T23:40:40.651867+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=40, tm_sec=40, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=49, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:49:51.771 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-04-26T23:40:31.552707+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=40, tm_sec=31, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=49, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:49:51.771 INFO:tasks.ceph:pgid 2.15 last_scrub_stamp 2024-04-26T23:40:30.548321+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=40, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=49, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:49:51.771 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-04-26T23:40:39.646413+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=40, tm_sec=39, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=49, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:49:51.771 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2024-04-26T23:40:40.651867+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=40, tm_sec=40, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=49, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:49:51.771 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-04-26T23:40:31.552707+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=40, tm_sec=31, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=49, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:49:51.771 INFO:tasks.ceph:pgid 2.16 last_scrub_stamp 2024-04-26T23:40:30.548321+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=40, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=49, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:49:51.771 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-04-26T23:40:39.646413+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=40, tm_sec=39, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=49, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:49:51.772 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-04-26T23:40:40.651867+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=40, tm_sec=40, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=49, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:49:51.772 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-04-26T23:40:31.552707+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=40, tm_sec=31, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=49, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:49:51.772 INFO:tasks.ceph:pgid 2.17 last_scrub_stamp 2024-04-26T23:40:30.548321+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=40, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=49, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:49:51.772 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-04-26T23:40:39.646413+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=40, tm_sec=39, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=49, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:49:51.772 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2024-04-26T23:40:40.651867+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=40, tm_sec=40, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=49, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:49:51.772 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-04-26T23:40:39.646413+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=40, tm_sec=39, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=49, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:49:51.772 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-04-26T23:40:31.552707+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=40, tm_sec=31, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=49, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:49:51.772 INFO:tasks.ceph:pgid 2.18 last_scrub_stamp 2024-04-26T23:40:30.548321+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=40, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=49, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:49:51.772 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-04-26T23:40:40.651867+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=40, tm_sec=40, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=49, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:49:51.773 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-04-26T23:40:39.646413+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=40, tm_sec=39, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=49, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:49:51.773 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-04-26T23:40:31.552707+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=40, tm_sec=31, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=49, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:49:51.773 INFO:tasks.ceph:pgid 2.19 last_scrub_stamp 2024-04-26T23:40:30.548321+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=40, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=49, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:49:51.773 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-04-26T23:40:40.651867+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=40, tm_sec=40, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=49, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:49:51.773 INFO:tasks.ceph:pgid 2.1a last_scrub_stamp 2024-04-26T23:40:30.548321+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=40, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=49, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:49:51.773 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-04-26T23:40:31.552707+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=40, tm_sec=31, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=49, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:49:51.773 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-04-26T23:40:39.646413+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=40, tm_sec=39, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=49, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:49:51.773 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-04-26T23:40:40.651867+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=40, tm_sec=40, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=49, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:49:51.773 INFO:tasks.ceph:pgid 2.1b last_scrub_stamp 2024-04-26T23:40:30.548321+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=40, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=49, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:49:51.773 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-04-26T23:40:31.552707+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=40, tm_sec=31, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=49, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:49:51.774 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-04-26T23:40:39.646413+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=40, tm_sec=39, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=49, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:49:51.774 INFO:tasks.ceph:pgid 5.26 last_scrub_stamp 2024-04-26T23:40:40.651867+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=40, tm_sec=40, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=49, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:49:51.774 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-04-26T23:40:31.552707+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=40, tm_sec=31, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=49, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:49:51.774 INFO:tasks.ceph:pgid 5.27 last_scrub_stamp 2024-04-26T23:40:40.651867+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=40, tm_sec=40, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=49, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:49:51.774 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-04-26T23:40:31.552707+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=40, tm_sec=31, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=49, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:49:51.774 INFO:tasks.ceph:pgid 5.24 last_scrub_stamp 2024-04-26T23:40:40.651867+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=40, tm_sec=40, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=49, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:49:51.774 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-04-26T23:40:31.552707+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=40, tm_sec=31, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=49, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:49:51.774 INFO:tasks.ceph:pgid 5.25 last_scrub_stamp 2024-04-26T23:40:40.651867+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=40, tm_sec=40, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=49, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:49:51.774 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-04-26T23:40:31.552707+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=40, tm_sec=31, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=49, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:49:51.775 INFO:tasks.ceph:pgid 5.22 last_scrub_stamp 2024-04-26T23:40:40.651867+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=40, tm_sec=40, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=49, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:49:51.775 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-04-26T23:40:31.552707+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=40, tm_sec=31, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=49, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:49:51.775 INFO:tasks.ceph:pgid 5.23 last_scrub_stamp 2024-04-26T23:40:40.651867+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=40, tm_sec=40, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=49, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:49:51.775 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-04-26T23:40:31.552707+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=40, tm_sec=31, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=49, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:49:51.775 INFO:tasks.ceph:pgid 5.20 last_scrub_stamp 2024-04-26T23:40:40.651867+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=40, tm_sec=40, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=49, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:49:51.775 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-04-26T23:40:31.552707+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=40, tm_sec=31, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=49, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:49:51.775 INFO:tasks.ceph:pgid 5.21 last_scrub_stamp 2024-04-26T23:40:40.651867+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=40, tm_sec=40, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=49, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:49:51.775 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-04-26T23:40:31.552707+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=40, tm_sec=31, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=49, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:49:51.775 INFO:tasks.ceph:pgid 5.2e last_scrub_stamp 2024-04-26T23:40:40.651867+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=40, tm_sec=40, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=49, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:49:51.776 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-04-26T23:40:31.552707+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=40, tm_sec=31, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=49, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:49:51.776 INFO:tasks.ceph:pgid 5.2f last_scrub_stamp 2024-04-26T23:40:40.651867+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=40, tm_sec=40, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=49, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:49:51.776 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-04-26T23:40:31.552707+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=40, tm_sec=31, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=49, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:49:51.776 INFO:tasks.ceph:pgid 5.2c last_scrub_stamp 2024-04-26T23:40:40.651867+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=40, tm_sec=40, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=49, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:49:51.776 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-04-26T23:40:31.552707+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=40, tm_sec=31, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=49, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:49:51.776 INFO:tasks.ceph:pgid 5.2d last_scrub_stamp 2024-04-26T23:40:40.651867+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=40, tm_sec=40, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=49, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:49:51.776 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-04-26T23:40:31.552707+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=40, tm_sec=31, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=49, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:49:51.776 INFO:tasks.ceph:pgid 5.2a last_scrub_stamp 2024-04-26T23:40:40.651867+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=40, tm_sec=40, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=49, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:49:51.776 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-04-26T23:40:31.552707+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=40, tm_sec=31, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=49, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:49:51.776 INFO:tasks.ceph:pgid 5.2b last_scrub_stamp 2024-04-26T23:40:40.651867+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=40, tm_sec=40, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=49, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:49:51.777 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-04-26T23:40:31.552707+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=40, tm_sec=31, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=49, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:49:51.777 INFO:tasks.ceph:pgid 5.28 last_scrub_stamp 2024-04-26T23:40:40.651867+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=40, tm_sec=40, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=49, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:49:51.777 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-04-26T23:40:31.552707+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=40, tm_sec=31, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=49, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:49:51.777 INFO:tasks.ceph:pgid 5.29 last_scrub_stamp 2024-04-26T23:40:40.651867+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=40, tm_sec=40, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=49, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:49:51.777 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-04-26T23:40:31.552707+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=40, tm_sec=31, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=49, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:49:51.777 INFO:tasks.ceph:pgid 5.36 last_scrub_stamp 2024-04-26T23:40:40.651867+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=40, tm_sec=40, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=49, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:49:51.777 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-04-26T23:40:31.552707+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=40, tm_sec=31, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=49, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:49:51.777 INFO:tasks.ceph:pgid 5.37 last_scrub_stamp 2024-04-26T23:40:40.651867+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=40, tm_sec=40, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=49, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:49:51.777 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-04-26T23:40:31.552707+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=40, tm_sec=31, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=49, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:49:51.777 INFO:tasks.ceph:pgid 5.34 last_scrub_stamp 2024-04-26T23:40:40.651867+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=40, tm_sec=40, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=49, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:49:51.778 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-04-26T23:40:31.552707+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=40, tm_sec=31, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=49, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:49:51.778 INFO:tasks.ceph:pgid 5.35 last_scrub_stamp 2024-04-26T23:40:40.651867+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=40, tm_sec=40, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=49, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:49:51.778 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-04-26T23:40:31.552707+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=40, tm_sec=31, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=49, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:49:51.778 INFO:tasks.ceph:pgid 5.32 last_scrub_stamp 2024-04-26T23:40:40.651867+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=40, tm_sec=40, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=49, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:49:51.778 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-04-26T23:40:31.552707+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=40, tm_sec=31, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=49, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:49:51.778 INFO:tasks.ceph:pgid 5.33 last_scrub_stamp 2024-04-26T23:40:40.651867+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=40, tm_sec=40, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=49, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:49:51.778 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-04-26T23:40:31.552707+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=40, tm_sec=31, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=49, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:49:51.778 INFO:tasks.ceph:pgid 5.30 last_scrub_stamp 2024-04-26T23:40:40.651867+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=40, tm_sec=40, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=49, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:49:51.778 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-04-26T23:40:31.552707+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=40, tm_sec=31, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=49, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:49:51.779 INFO:tasks.ceph:pgid 5.31 last_scrub_stamp 2024-04-26T23:40:40.651867+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=40, tm_sec=40, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=49, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:49:51.779 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-04-26T23:40:31.552707+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=40, tm_sec=31, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=49, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:49:51.779 INFO:tasks.ceph:pgid 5.3e last_scrub_stamp 2024-04-26T23:40:40.651867+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=40, tm_sec=40, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=49, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:49:51.779 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-04-26T23:40:31.552707+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=40, tm_sec=31, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=49, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:49:51.779 INFO:tasks.ceph:pgid 5.3f last_scrub_stamp 2024-04-26T23:40:40.651867+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=40, tm_sec=40, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=49, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:49:51.779 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-04-26T23:40:31.552707+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=40, tm_sec=31, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=49, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:49:51.779 INFO:tasks.ceph:pgid 5.3c last_scrub_stamp 2024-04-26T23:40:40.651867+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=40, tm_sec=40, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=49, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:49:51.779 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-04-26T23:40:31.552707+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=40, tm_sec=31, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=49, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:49:51.779 INFO:tasks.ceph:pgid 5.3d last_scrub_stamp 2024-04-26T23:40:40.651867+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=40, tm_sec=40, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=49, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:49:51.780 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-04-26T23:40:31.552707+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=40, tm_sec=31, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=49, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:49:51.780 INFO:tasks.ceph:pgid 5.3a last_scrub_stamp 2024-04-26T23:40:40.651867+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=40, tm_sec=40, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=49, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:49:51.780 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-04-26T23:40:31.552707+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=40, tm_sec=31, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=49, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:49:51.780 INFO:tasks.ceph:pgid 5.3b last_scrub_stamp 2024-04-26T23:40:40.651867+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=40, tm_sec=40, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=49, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:49:51.780 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-04-26T23:40:31.552707+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=40, tm_sec=31, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=49, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:49:51.780 INFO:tasks.ceph:pgid 5.38 last_scrub_stamp 2024-04-26T23:40:40.651867+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=40, tm_sec=40, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=49, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:49:51.780 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-04-26T23:40:31.552707+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=40, tm_sec=31, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=49, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:49:51.780 INFO:tasks.ceph:pgid 5.39 last_scrub_stamp 2024-04-26T23:40:40.651867+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=40, tm_sec=40, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=49, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:49:51.780 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-04-26T23:40:31.552707+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=40, tm_sec=31, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=49, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:49:51.781 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-26T23:50:06.129 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:50:06.133 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:50:11.782 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T23:50:11.892 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:11.888+0000 7f0515ebd640 1 Processor -- start 2024-04-26T23:50:11.893 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:11.888+0000 7f0515ebd640 1 -- start start 2024-04-26T23:50:11.897 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:11.889+0000 7f0515ebd640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f05100ab3f0 0x7f05100c4d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:11.897 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:11.889+0000 7f0515ebd640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f05100c3810 con 0x7f05100c52c0 2024-04-26T23:50:11.897 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:11.889+0000 7f0515ebd640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f05100c3ab0 con 0x7f05101570d0 2024-04-26T23:50:11.897 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:11.889+0000 7f0515ebd640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f05100c4330 con 0x7f05100ab3f0 2024-04-26T23:50:11.897 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:11.889+0000 7f050ffff640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f05100c52c0 0x7f05101574b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:54256/0 (socket says 172.21.15.88:54256) 2024-04-26T23:50:11.897 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:11.889+0000 7f050ffff640 1 -- 172.21.15.88:0/911396306 learned_addr learned my addr 172.21.15.88:0/911396306 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-26T23:50:11.897 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:11.889+0000 7f050e7fc640 1 -- 172.21.15.88:0/911396306 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3156546815 0 0) 0x7f05100c3810 con 0x7f05100c52c0 2024-04-26T23:50:11.897 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:11.889+0000 7f050effd640 1 --2- 172.21.15.88:0/911396306 >> v2:172.21.15.175:3300/0 conn(0x7f05100ab3f0 0x7f05100c4d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:11.898 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:11.889+0000 7f050e7fc640 1 -- 172.21.15.88:0/911396306 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f04f8003520 con 0x7f05100c52c0 2024-04-26T23:50:11.898 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:11.889+0000 7f050e7fc640 1 -- 172.21.15.88:0/911396306 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1147615214 0 0) 0x7f04f8003520 con 0x7f05100c52c0 2024-04-26T23:50:11.898 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:11.889+0000 7f050e7fc640 1 -- 172.21.15.88:0/911396306 >> v2:172.21.15.175:3300/0 conn(0x7f05100ab3f0 msgr2=0x7f05100c4d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:50:11.898 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:11.889+0000 7f050e7fc640 1 --2- 172.21.15.88:0/911396306 >> v2:172.21.15.175:3300/0 conn(0x7f05100ab3f0 0x7f05100c4d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:11.898 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:11.889+0000 7f050e7fc640 1 -- 172.21.15.88:0/911396306 >> v1:172.21.15.175:6789/0 conn(0x7f05101570d0 legacy=0x7f0510150a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:11.898 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:11.889+0000 7f050e7fc640 1 -- 172.21.15.88:0/911396306 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05100c4580 con 0x7f05100c52c0 2024-04-26T23:50:11.898 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:11.889+0000 7f050e7fc640 1 -- 172.21.15.88:0/911396306 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 356324787 0 0) 0x7f05080019f0 con 0x7f05100c52c0 2024-04-26T23:50:11.898 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:11.889+0000 7f050e7fc640 1 -- 172.21.15.88:0/911396306 >> v1:172.21.15.88:6789/0 conn(0x7f05100c52c0 legacy=0x7f05101574b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:11.898 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:11.889+0000 7f050e7fc640 1 --2- 172.21.15.88:0/911396306 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f04f80039b0 0x7f04f8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:11.898 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:11.889+0000 7f050e7fc640 1 --2- 172.21.15.88:0/911396306 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f04f8004800 0x7f04f8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:11.898 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:11.889+0000 7f050e7fc640 1 --2- 172.21.15.88:0/911396306 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f04f80052e0 0x7f04f800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:11.898 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:11.889+0000 7f050e7fc640 1 -- 172.21.15.88:0/911396306 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f05100c4330 con 0x7f04f80039b0 2024-04-26T23:50:11.898 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:11.889+0000 7f050e7fc640 1 -- 172.21.15.88:0/911396306 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f04f800c1b0 con 0x7f04f8004800 2024-04-26T23:50:11.898 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:11.889+0000 7f050e7fc640 1 -- 172.21.15.88:0/911396306 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f04f800e5c0 con 0x7f04f80052e0 2024-04-26T23:50:11.899 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:11.890+0000 7f050f7fe640 1 --2- 172.21.15.88:0/911396306 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f04f80039b0 0x7f04f8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:11.899 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:11.890+0000 7f050effd640 1 --2- 172.21.15.88:0/911396306 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f04f8004800 0x7f04f8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:11.899 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:11.890+0000 7f050ffff640 1 --2- 172.21.15.88:0/911396306 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f04f80052e0 0x7f04f800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:11.899 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:11.890+0000 7f050effd640 1 -- 172.21.15.88:0/911396306 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f04f80052e0 msgr2=0x7f04f800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:50:11.899 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:11.890+0000 7f050effd640 1 --2- 172.21.15.88:0/911396306 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f04f80052e0 0x7f04f800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:11.899 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:11.890+0000 7f050effd640 1 -- 172.21.15.88:0/911396306 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f04f80039b0 msgr2=0x7f04f8003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:50:11.899 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:11.890+0000 7f050effd640 1 --2- 172.21.15.88:0/911396306 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f04f80039b0 0x7f04f8003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:11.899 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:11.890+0000 7f050ffff640 1 -- 172.21.15.88:0/911396306 reap_dead start 2024-04-26T23:50:11.899 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:11.890+0000 7f050effd640 1 -- 172.21.15.88:0/911396306 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04f8003520 con 0x7f04f8004800 2024-04-26T23:50:11.899 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:11.890+0000 7f050f7fe640 1 --2- 172.21.15.88:0/911396306 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f04f80039b0 0x7f04f8003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:50:11.899 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:11.891+0000 7f050effd640 1 --2- 172.21.15.88:0/911396306 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f04f8004800 0x7f04f8004c80 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f0504009a90 tx=0x7f04f8005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4bba6c3049412a26 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:50:11.899 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:11.891+0000 7f050e7fc640 1 -- 172.21.15.88:0/911396306 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0504036070 con 0x7f04f8004800 2024-04-26T23:50:11.899 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:11.891+0000 7f050e7fc640 1 -- 172.21.15.88:0/911396306 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0504031400 con 0x7f04f8004800 2024-04-26T23:50:11.900 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:11.891+0000 7f050e7fc640 1 -- 172.21.15.88:0/911396306 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0504009690 con 0x7f04f8004800 2024-04-26T23:50:11.900 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:11.891+0000 7f0515ebd640 1 -- 172.21.15.88:0/911396306 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f04f8004800 msgr2=0x7f04f8004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:11.900 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:11.891+0000 7f0515ebd640 1 --2- 172.21.15.88:0/911396306 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f04f8004800 0x7f04f8004c80 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f0504009a90 tx=0x7f04f8005830 comp rx=0 tx=0).stop 2024-04-26T23:50:11.900 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:11.892+0000 7f0515ebd640 1 -- 172.21.15.88:0/911396306 shutdown_connections 2024-04-26T23:50:11.900 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:11.892+0000 7f0515ebd640 1 --2- 172.21.15.88:0/911396306 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f04f8004800 0x7f04f8004c80 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:11.900 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:11.892+0000 7f0515ebd640 1 -- 172.21.15.88:0/911396306 >> 172.21.15.88:0/911396306 conn(0x7f051006c310 msgr2=0x7f051006c6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:50:11.900 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:11.892+0000 7f0515ebd640 1 -- 172.21.15.88:0/911396306 shutdown_connections 2024-04-26T23:50:11.900 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:11.892+0000 7f0515ebd640 1 -- 172.21.15.88:0/911396306 wait complete. 2024-04-26T23:50:11.900 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:11.893+0000 7f0515ebd640 1 Processor -- start 2024-04-26T23:50:11.903 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:11.893+0000 7f0515ebd640 1 -- start start 2024-04-26T23:50:11.903 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:11.894+0000 7f0515ebd640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f04f8004800 0x7f05101ebcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:11.903 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:11.894+0000 7f0515ebd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f05100c68d0 0x7f0510149990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:11.903 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:11.894+0000 7f0515ebd640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f05101565c0 0x7f05101e9030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:11.904 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:11.894+0000 7f0515ebd640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f05100abbe0 con 0x7f05100c68d0 2024-04-26T23:50:11.904 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:11.894+0000 7f0515ebd640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f05100aba60 con 0x7f05101565c0 2024-04-26T23:50:11.904 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:11.894+0000 7f0515ebd640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f05100c4d80 con 0x7f04f8004800 2024-04-26T23:50:11.904 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:11.894+0000 7f050effd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f05100c68d0 0x7f0510149990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:11.904 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:11.894+0000 7f050effd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f05100c68d0 0x7f0510149990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:47562/0 (socket says 172.21.15.88:47562) 2024-04-26T23:50:11.904 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:11.894+0000 7f050effd640 1 -- 172.21.15.88:0/730940924 learned_addr learned my addr 172.21.15.88:0/730940924 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:50:11.904 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:11.894+0000 7f050f7fe640 1 --2- 172.21.15.88:0/730940924 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f04f8004800 0x7f05101ebcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:11.904 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:11.894+0000 7f050ffff640 1 --2- 172.21.15.88:0/730940924 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f05101565c0 0x7f05101e9030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:11.904 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:11.894+0000 7f050effd640 1 -- 172.21.15.88:0/730940924 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f04f8004800 msgr2=0x7f05101ebcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:11.904 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:11.894+0000 7f050effd640 1 --2- 172.21.15.88:0/730940924 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f04f8004800 0x7f05101ebcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:11.904 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:11.894+0000 7f050effd640 1 -- 172.21.15.88:0/730940924 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f05101565c0 msgr2=0x7f05101e9030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:11.904 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:11.894+0000 7f050effd640 1 --2- 172.21.15.88:0/730940924 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f05101565c0 0x7f05101e9030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:11.904 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:11.894+0000 7f050effd640 1 -- 172.21.15.88:0/730940924 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05101e8870 con 0x7f05100c68d0 2024-04-26T23:50:11.905 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:11.894+0000 7f050f7fe640 1 --2- 172.21.15.88:0/730940924 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f04f8004800 0x7f05101ebcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:50:11.905 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:11.894+0000 7f050ffff640 1 --2- 172.21.15.88:0/730940924 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f05101565c0 0x7f05101e9030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:50:11.905 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:11.894+0000 7f050effd640 1 --2- 172.21.15.88:0/730940924 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f05100c68d0 0x7f0510149990 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f0504009bb0 tx=0x7f0504004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:50:11.905 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:11.894+0000 7f04f7fff640 1 -- 172.21.15.88:0/730940924 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f050403f020 con 0x7f05100c68d0 2024-04-26T23:50:11.905 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:11.894+0000 7f04f7fff640 1 -- 172.21.15.88:0/730940924 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0504037040 con 0x7f05100c68d0 2024-04-26T23:50:11.905 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:11.894+0000 7f04f7fff640 1 -- 172.21.15.88:0/730940924 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0504036070 con 0x7f05100c68d0 2024-04-26T23:50:11.905 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:11.894+0000 7f0515ebd640 1 -- 172.21.15.88:0/730940924 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05101562e0 con 0x7f05100c68d0 2024-04-26T23:50:11.905 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:11.894+0000 7f0515ebd640 1 -- 172.21.15.88:0/730940924 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0510149ed0 con 0x7f05100c68d0 2024-04-26T23:50:11.905 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:11.896+0000 7f0515ebd640 1 -- 172.21.15.88:0/730940924 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0510157dd0 con 0x7f05100c68d0 2024-04-26T23:50:11.905 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:11.896+0000 7f04f7fff640 1 -- 172.21.15.88:0/730940924 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f0504042020 con 0x7f05100c68d0 2024-04-26T23:50:11.905 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:11.896+0000 7f04f7fff640 1 --2- 172.21.15.88:0/730940924 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f04fc06c920 0x7f04fc06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:11.905 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:11.896+0000 7f04f7fff640 1 -- 172.21.15.88:0/730940924 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6666+0+0 (secure 0 0 0) 0x7f05040ac190 con 0x7f05100c68d0 2024-04-26T23:50:11.905 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:11.896+0000 7f050f7fe640 1 --2- 172.21.15.88:0/730940924 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f04fc06c920 0x7f04fc06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:11.906 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:11.897+0000 7f050f7fe640 1 --2- 172.21.15.88:0/730940924 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f04fc06c920 0x7f04fc06ede0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f0500000c00 tx=0x7f0500009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:50:11.906 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:11.901+0000 7f04f7fff640 1 -- 172.21.15.88:0/730940924 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f0510157dd0 con 0x7f05100c68d0 2024-04-26T23:50:12.077 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:12.072+0000 7f0515ebd640 1 -- 172.21.15.88:0/730940924 --> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f0510156b90 con 0x7f04fc06c920 2024-04-26T23:50:12.087 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:12.083+0000 7f04f7fff640 1 -- 172.21.15.88:0/730940924 <== mgr.4104 v2:172.21.15.88:6832/651674297 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+493654 (secure 0 0 0) 0x7f0500003710 con 0x7f04fc06c920 2024-04-26T23:50:12.093 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-26T23:50:12.098 INFO:teuthology.orchestra.run.smithi088.stderr:dumped all 2024-04-26T23:50:12.099 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:12.087+0000 7f0515ebd640 1 -- 172.21.15.88:0/730940924 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f04fc06c920 msgr2=0x7f04fc06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:12.100 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:12.087+0000 7f0515ebd640 1 --2- 172.21.15.88:0/730940924 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f04fc06c920 0x7f04fc06ede0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f0500000c00 tx=0x7f0500009040 comp rx=0 tx=0).stop 2024-04-26T23:50:12.100 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:12.087+0000 7f0515ebd640 1 -- 172.21.15.88:0/730940924 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f05100c68d0 msgr2=0x7f0510149990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:12.100 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:12.087+0000 7f0515ebd640 1 --2- 172.21.15.88:0/730940924 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f05100c68d0 0x7f0510149990 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f0504009bb0 tx=0x7f0504004730 comp rx=0 tx=0).stop 2024-04-26T23:50:12.100 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:12.087+0000 7f0515ebd640 1 -- 172.21.15.88:0/730940924 shutdown_connections 2024-04-26T23:50:12.100 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:12.087+0000 7f0515ebd640 1 --2- 172.21.15.88:0/730940924 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f04fc06c920 0x7f04fc06ede0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:12.100 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:12.087+0000 7f0515ebd640 1 --2- 172.21.15.88:0/730940924 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f05101565c0 0x7f05101e9030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:12.100 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:12.087+0000 7f0515ebd640 1 --2- 172.21.15.88:0/730940924 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f05100c68d0 0x7f0510149990 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:12.100 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:12.087+0000 7f0515ebd640 1 --2- 172.21.15.88:0/730940924 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f04f8004800 0x7f05101ebcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:12.100 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:12.087+0000 7f0515ebd640 1 -- 172.21.15.88:0/730940924 >> 172.21.15.88:0/730940924 conn(0x7f051006c310 msgr2=0x7f051006e5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:50:12.100 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:12.087+0000 7f0515ebd640 1 -- 172.21.15.88:0/730940924 shutdown_connections 2024-04-26T23:50:12.100 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:12.087+0000 7f0515ebd640 1 -- 172.21.15.88:0/730940924 wait complete. 2024-04-26T23:50:12.103 INFO:teuthology.orchestra.run.smithi088.stdout:{"pg_ready":true,"pg_map":{"version":315,"stamp":"2024-04-26T23:50:10.114973+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":308985889,"num_objects":120,"num_object_clones":0,"num_object_copies":240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":120,"num_whiteouts":0,"num_read":149,"num_read_kb":293,"num_write":8375229,"num_write_kb":107315379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":10000,"num_omap_keys":20,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":561226,"ondisk_log_size":561226,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":386,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":5728608,"kb_used_data":605792,"kb_used_omap":12,"kb_used_meta":5122739,"kb_avail":749246112,"statfs":{"total":773094113280,"available":767228018688,"internally_reserved":0,"allocated":620331008,"data_stored":618877010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":5245685296},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003521"},"pg_stats":[{"pgid":"5.18","version":"26'4255","reported_seq":4283,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:50:05.391785+0000","last_change":"2024-04-26T23:50:05.391812+0000","last_active":"2024-04-26T23:50:05.391785+0000","last_peered":"2024-04-26T23:50:05.391785+0000","last_clean":"2024-04-26T23:50:05.391785+0000","last_became_active":"2024-04-26T23:40:41.683484+0000","last_became_peered":"2024-04-26T23:40:41.683484+0000","last_unstale":"2024-04-26T23:50:05.391785+0000","last_undegraded":"2024-04-26T23:50:05.391785+0000","last_fullsized":"2024-04-26T23:50:05.391785+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4255","last_scrub_stamp":"2024-04-26T23:50:05.391661+0000","last_deep_scrub":"26'4255","last_deep_scrub_stamp":"2024-04-26T23:50:05.391661+0000","last_clean_scrub_stamp":"2024-04-26T23:50:05.391661+0000","objects_scrubbed":0,"log_size":4255,"log_dups_size":0,"ondisk_log_size":4255,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:45:40.130359+0000","scrub_duration":17,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":63732,"num_write_kb":854695,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1f","version":"26'18","reported_seq":57,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:53.754704+0000","last_change":"2024-04-26T23:49:53.754737+0000","last_active":"2024-04-26T23:49:53.754704+0000","last_peered":"2024-04-26T23:49:53.754704+0000","last_clean":"2024-04-26T23:49:53.754704+0000","last_became_active":"2024-04-26T23:40:31.576429+0000","last_became_peered":"2024-04-26T23:40:31.576429+0000","last_unstale":"2024-04-26T23:49:53.754704+0000","last_undegraded":"2024-04-26T23:49:53.754704+0000","last_fullsized":"2024-04-26T23:49:53.754704+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'18","last_scrub_stamp":"2024-04-26T23:49:53.754620+0000","last_deep_scrub":"26'18","last_deep_scrub_stamp":"2024-04-26T23:49:53.754620+0000","last_clean_scrub_stamp":"2024-04-26T23:49:53.754620+0000","objects_scrubbed":3,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:02:11.596734+0000","scrub_duration":40,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":4100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"26'4412","reported_seq":4449,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:50:08.320651+0000","last_change":"2024-04-26T23:50:08.320675+0000","last_active":"2024-04-26T23:50:08.320651+0000","last_peered":"2024-04-26T23:50:08.320651+0000","last_clean":"2024-04-26T23:50:08.320651+0000","last_became_active":"2024-04-26T23:40:32.578205+0000","last_became_peered":"2024-04-26T23:40:32.578205+0000","last_unstale":"2024-04-26T23:50:08.320651+0000","last_undegraded":"2024-04-26T23:50:08.320651+0000","last_fullsized":"2024-04-26T23:50:08.320651+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4412","last_scrub_stamp":"2024-04-26T23:50:08.320560+0000","last_deep_scrub":"26'4412","last_deep_scrub_stamp":"2024-04-26T23:50:08.320560+0000","last_clean_scrub_stamp":"2024-04-26T23:50:08.320560+0000","objects_scrubbed":0,"log_size":4412,"log_dups_size":0,"ondisk_log_size":4412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:27:22.517395+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":66444,"num_write_kb":860244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"26'24","reported_seq":54,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:52.230269+0000","last_change":"2024-04-26T23:49:52.230301+0000","last_active":"2024-04-26T23:49:52.230269+0000","last_peered":"2024-04-26T23:49:52.230269+0000","last_clean":"2024-04-26T23:49:52.230269+0000","last_became_active":"2024-04-26T23:40:40.666547+0000","last_became_peered":"2024-04-26T23:40:40.666547+0000","last_unstale":"2024-04-26T23:49:52.230269+0000","last_undegraded":"2024-04-26T23:49:52.230269+0000","last_fullsized":"2024-04-26T23:49:52.230269+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'24","last_scrub_stamp":"2024-04-26T23:49:52.230163+0000","last_deep_scrub":"26'24","last_deep_scrub_stamp":"2024-04-26T23:49:52.230163+0000","last_clean_scrub_stamp":"2024-04-26T23:49:52.230163+0000","objects_scrubbed":1,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:55:02.271377+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":4105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"26'5312","reported_seq":5340,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:50:08.354214+0000","last_change":"2024-04-26T23:50:08.354262+0000","last_active":"2024-04-26T23:50:08.354214+0000","last_peered":"2024-04-26T23:50:08.354214+0000","last_clean":"2024-04-26T23:50:08.354214+0000","last_became_active":"2024-04-26T23:40:41.687652+0000","last_became_peered":"2024-04-26T23:40:41.687652+0000","last_unstale":"2024-04-26T23:50:08.354214+0000","last_undegraded":"2024-04-26T23:50:08.354214+0000","last_fullsized":"2024-04-26T23:50:08.354214+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5312","last_scrub_stamp":"2024-04-26T23:50:08.354077+0000","last_deep_scrub":"26'5312","last_deep_scrub_stamp":"2024-04-26T23:50:08.354077+0000","last_clean_scrub_stamp":"2024-04-26T23:50:08.354077+0000","objects_scrubbed":0,"log_size":5312,"log_dups_size":0,"ondisk_log_size":5312,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:49:36.192384+0000","scrub_duration":29,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79884,"num_write_kb":1001634,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1e","version":"26'30","reported_seq":69,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:50:06.302999+0000","last_change":"2024-04-26T23:50:06.303029+0000","last_active":"2024-04-26T23:50:06.302999+0000","last_peered":"2024-04-26T23:50:06.302999+0000","last_clean":"2024-04-26T23:50:06.302999+0000","last_became_active":"2024-04-26T23:40:31.576342+0000","last_became_peered":"2024-04-26T23:40:31.576342+0000","last_unstale":"2024-04-26T23:50:06.302999+0000","last_undegraded":"2024-04-26T23:50:06.302999+0000","last_fullsized":"2024-04-26T23:50:06.302999+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'30","last_scrub_stamp":"2024-04-26T23:50:06.302919+0000","last_deep_scrub":"26'30","last_deep_scrub_stamp":"2024-04-26T23:50:06.302919+0000","last_clean_scrub_stamp":"2024-04-26T23:50:06.302919+0000","objects_scrubbed":1,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:02:49.707068+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":4114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"26'5109","reported_seq":5132,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:50:05.431971+0000","last_change":"2024-04-26T23:50:05.431994+0000","last_active":"2024-04-26T23:50:05.431971+0000","last_peered":"2024-04-26T23:50:05.431971+0000","last_clean":"2024-04-26T23:50:05.431971+0000","last_became_active":"2024-04-26T23:41:30.628139+0000","last_became_peered":"2024-04-26T23:41:30.628139+0000","last_unstale":"2024-04-26T23:50:05.431971+0000","last_undegraded":"2024-04-26T23:50:05.431971+0000","last_fullsized":"2024-04-26T23:50:05.431971+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5109","last_scrub_stamp":"2024-04-26T23:50:05.431851+0000","last_deep_scrub":"26'5109","last_deep_scrub_stamp":"2024-04-26T23:50:05.431851+0000","last_clean_scrub_stamp":"2024-04-26T23:50:05.431851+0000","objects_scrubbed":0,"log_size":5109,"log_dups_size":0,"ondisk_log_size":5109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:05:04.383619+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":76507,"num_write_kb":979233,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"26'27","reported_seq":57,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:50:03.379438+0000","last_change":"2024-04-26T23:50:03.379529+0000","last_active":"2024-04-26T23:50:03.379438+0000","last_peered":"2024-04-26T23:50:03.379438+0000","last_clean":"2024-04-26T23:50:03.379438+0000","last_became_active":"2024-04-26T23:40:40.672018+0000","last_became_peered":"2024-04-26T23:40:40.672018+0000","last_unstale":"2024-04-26T23:50:03.379438+0000","last_undegraded":"2024-04-26T23:50:03.379438+0000","last_fullsized":"2024-04-26T23:50:03.379438+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'27","last_scrub_stamp":"2024-04-26T23:50:03.379346+0000","last_deep_scrub":"26'27","last_deep_scrub_stamp":"2024-04-26T23:50:03.379346+0000","last_clean_scrub_stamp":"2024-04-26T23:50:03.379346+0000","objects_scrubbed":2,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:00:30.645844+0000","scrub_duration":22,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":8211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"26'3926","reported_seq":3946,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:45.274225+0000","last_change":"2024-04-26T23:40:41.686743+0000","last_active":"2024-04-26T23:49:45.274225+0000","last_peered":"2024-04-26T23:49:45.274225+0000","last_clean":"2024-04-26T23:49:45.274225+0000","last_became_active":"2024-04-26T23:40:41.686419+0000","last_became_peered":"2024-04-26T23:40:41.686419+0000","last_unstale":"2024-04-26T23:49:45.274225+0000","last_undegraded":"2024-04-26T23:49:45.274225+0000","last_fullsized":"2024-04-26T23:49:45.274225+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":3926,"log_dups_size":0,"ondisk_log_size":3926,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":59060,"num_write_kb":735586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1d","version":"26'46","reported_seq":76,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:36.423048+0000","last_change":"2024-04-26T23:40:31.578735+0000","last_active":"2024-04-26T23:49:36.423048+0000","last_peered":"2024-04-26T23:49:36.423048+0000","last_clean":"2024-04-26T23:49:36.423048+0000","last_became_active":"2024-04-26T23:40:31.578438+0000","last_became_peered":"2024-04-26T23:40:31.578438+0000","last_unstale":"2024-04-26T23:49:36.423048+0000","last_undegraded":"2024-04-26T23:49:36.423048+0000","last_fullsized":"2024-04-26T23:49:36.423048+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37,"num_write_kb":12306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"26'2988","reported_seq":3024,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:51.739362+0000","last_change":"2024-04-26T23:49:51.739434+0000","last_active":"2024-04-26T23:49:51.739362+0000","last_peered":"2024-04-26T23:49:51.739362+0000","last_clean":"2024-04-26T23:49:51.739362+0000","last_became_active":"2024-04-26T23:40:32.589687+0000","last_became_peered":"2024-04-26T23:40:32.589687+0000","last_unstale":"2024-04-26T23:49:51.739362+0000","last_undegraded":"2024-04-26T23:49:51.739362+0000","last_fullsized":"2024-04-26T23:49:51.739362+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2988","last_scrub_stamp":"2024-04-26T23:49:51.739256+0000","last_deep_scrub":"26'2988","last_deep_scrub_stamp":"2024-04-26T23:49:51.739256+0000","last_clean_scrub_stamp":"2024-04-26T23:49:51.739256+0000","objects_scrubbed":0,"log_size":2988,"log_dups_size":0,"ondisk_log_size":2988,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:38:40.981723+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44847,"num_write_kb":570063,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"26'1256","reported_seq":1286,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:50.418998+0000","last_change":"2024-04-26T23:49:50.419054+0000","last_active":"2024-04-26T23:49:50.418998+0000","last_peered":"2024-04-26T23:49:50.418998+0000","last_clean":"2024-04-26T23:49:50.418998+0000","last_became_active":"2024-04-26T23:40:40.677388+0000","last_became_peered":"2024-04-26T23:40:40.677388+0000","last_unstale":"2024-04-26T23:49:50.418998+0000","last_undegraded":"2024-04-26T23:49:50.418998+0000","last_fullsized":"2024-04-26T23:49:50.418998+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'1256","last_scrub_stamp":"2024-04-26T23:49:50.418881+0000","last_deep_scrub":"26'1256","last_deep_scrub_stamp":"2024-04-26T23:49:50.418881+0000","last_clean_scrub_stamp":"2024-04-26T23:49:50.418881+0000","objects_scrubbed":1,"log_size":1256,"log_dups_size":0,"ondisk_log_size":1256,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:59:17.712255+0000","scrub_duration":20,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1253,"num_write_kb":5260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"26'3559","reported_seq":3579,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:45.213588+0000","last_change":"2024-04-26T23:40:41.680097+0000","last_active":"2024-04-26T23:49:45.213588+0000","last_peered":"2024-04-26T23:49:45.213588+0000","last_clean":"2024-04-26T23:49:45.213588+0000","last_became_active":"2024-04-26T23:40:41.679815+0000","last_became_peered":"2024-04-26T23:40:41.679815+0000","last_unstale":"2024-04-26T23:49:45.213588+0000","last_undegraded":"2024-04-26T23:49:45.213588+0000","last_fullsized":"2024-04-26T23:49:45.213588+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":3559,"log_dups_size":0,"ondisk_log_size":3559,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53503,"num_write_kb":665423,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"26'19","reported_seq":57,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:50:04.530084+0000","last_change":"2024-04-26T23:50:04.530118+0000","last_active":"2024-04-26T23:50:04.530084+0000","last_peered":"2024-04-26T23:50:04.530084+0000","last_clean":"2024-04-26T23:50:04.530084+0000","last_became_active":"2024-04-26T23:40:31.573347+0000","last_became_peered":"2024-04-26T23:40:31.573347+0000","last_unstale":"2024-04-26T23:50:04.530084+0000","last_undegraded":"2024-04-26T23:50:04.530084+0000","last_fullsized":"2024-04-26T23:50:04.530084+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'19","last_scrub_stamp":"2024-04-26T23:50:04.530003+0000","last_deep_scrub":"26'19","last_deep_scrub_stamp":"2024-04-26T23:50:04.530003+0000","last_clean_scrub_stamp":"2024-04-26T23:50:04.530003+0000","objects_scrubbed":2,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:30:38.828005+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":4100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"26'5057","reported_seq":5093,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:53.680937+0000","last_change":"2024-04-26T23:49:53.680979+0000","last_active":"2024-04-26T23:49:53.680937+0000","last_peered":"2024-04-26T23:49:53.680937+0000","last_clean":"2024-04-26T23:49:53.680937+0000","last_became_active":"2024-04-26T23:40:32.588007+0000","last_became_peered":"2024-04-26T23:40:32.588007+0000","last_unstale":"2024-04-26T23:49:53.680937+0000","last_undegraded":"2024-04-26T23:49:53.680937+0000","last_fullsized":"2024-04-26T23:49:53.680937+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5057","last_scrub_stamp":"2024-04-26T23:49:53.680823+0000","last_deep_scrub":"26'5057","last_deep_scrub_stamp":"2024-04-26T23:49:53.680823+0000","last_clean_scrub_stamp":"2024-04-26T23:49:53.680823+0000","objects_scrubbed":0,"log_size":5057,"log_dups_size":0,"ondisk_log_size":5057,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:37:07.677729+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":75905,"num_write_kb":967615,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"26'36","reported_seq":66,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:53.477833+0000","last_change":"2024-04-26T23:49:53.477863+0000","last_active":"2024-04-26T23:49:53.477833+0000","last_peered":"2024-04-26T23:49:53.477833+0000","last_clean":"2024-04-26T23:49:53.477833+0000","last_became_active":"2024-04-26T23:40:40.677668+0000","last_became_peered":"2024-04-26T23:40:40.677668+0000","last_unstale":"2024-04-26T23:49:53.477833+0000","last_undegraded":"2024-04-26T23:49:53.477833+0000","last_fullsized":"2024-04-26T23:49:53.477833+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'36","last_scrub_stamp":"2024-04-26T23:49:53.477743+0000","last_deep_scrub":"26'36","last_deep_scrub_stamp":"2024-04-26T23:49:53.477743+0000","last_clean_scrub_stamp":"2024-04-26T23:49:53.477743+0000","objects_scrubbed":3,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:02:54.484361+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":12307,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"26'4803","reported_seq":4824,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:45.245720+0000","last_change":"2024-04-26T23:40:41.689525+0000","last_active":"2024-04-26T23:49:45.245720+0000","last_peered":"2024-04-26T23:49:45.245720+0000","last_clean":"2024-04-26T23:49:45.245720+0000","last_became_active":"2024-04-26T23:40:41.687433+0000","last_became_peered":"2024-04-26T23:40:41.687433+0000","last_unstale":"2024-04-26T23:49:45.245720+0000","last_undegraded":"2024-04-26T23:49:45.245720+0000","last_fullsized":"2024-04-26T23:49:45.245720+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":4803,"log_dups_size":0,"ondisk_log_size":4803,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":72371,"num_write_kb":916696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"26'3820","reported_seq":3857,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:51.734669+0000","last_change":"2024-04-26T23:49:51.734696+0000","last_active":"2024-04-26T23:49:51.734669+0000","last_peered":"2024-04-26T23:49:51.734669+0000","last_clean":"2024-04-26T23:49:51.734669+0000","last_became_active":"2024-04-26T23:40:32.589802+0000","last_became_peered":"2024-04-26T23:40:32.589802+0000","last_unstale":"2024-04-26T23:49:51.734669+0000","last_undegraded":"2024-04-26T23:49:51.734669+0000","last_fullsized":"2024-04-26T23:49:51.734669+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3820","last_scrub_stamp":"2024-04-26T23:49:51.734555+0000","last_deep_scrub":"26'3820","last_deep_scrub_stamp":"2024-04-26T23:49:51.734555+0000","last_clean_scrub_stamp":"2024-04-26T23:49:51.734555+0000","objects_scrubbed":0,"log_size":3820,"log_dups_size":0,"ondisk_log_size":3820,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:31:52.347891+0000","scrub_duration":21,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":57277,"num_write_kb":731452,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"26'244","reported_seq":275,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:36.434043+0000","last_change":"2024-04-26T23:40:31.578524+0000","last_active":"2024-04-26T23:49:36.434043+0000","last_peered":"2024-04-26T23:49:36.434043+0000","last_clean":"2024-04-26T23:49:36.434043+0000","last_became_active":"2024-04-26T23:40:31.578230+0000","last_became_peered":"2024-04-26T23:40:31.578230+0000","last_unstale":"2024-04-26T23:49:36.434043+0000","last_undegraded":"2024-04-26T23:49:36.434043+0000","last_fullsized":"2024-04-26T23:49:36.434043+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:30.548321+0000","last_clean_scrub_stamp":"2024-04-26T23:40:30.548321+0000","objects_scrubbed":0,"log_size":244,"log_dups_size":0,"ondisk_log_size":244,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":234,"num_write_kb":8395,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"26'22","reported_seq":53,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:52.428857+0000","last_change":"2024-04-26T23:49:52.428887+0000","last_active":"2024-04-26T23:49:52.428857+0000","last_peered":"2024-04-26T23:49:52.428857+0000","last_clean":"2024-04-26T23:49:52.428857+0000","last_became_active":"2024-04-26T23:40:40.675997+0000","last_became_peered":"2024-04-26T23:40:40.675997+0000","last_unstale":"2024-04-26T23:49:52.428857+0000","last_undegraded":"2024-04-26T23:49:52.428857+0000","last_fullsized":"2024-04-26T23:49:52.428857+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'22","last_scrub_stamp":"2024-04-26T23:49:52.428766+0000","last_deep_scrub":"26'22","last_deep_scrub_stamp":"2024-04-26T23:49:52.428766+0000","last_clean_scrub_stamp":"2024-04-26T23:49:52.428766+0000","objects_scrubbed":2,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:17:56.678536+0000","scrub_duration":26,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":4105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"26'4643","reported_seq":4672,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:50:00.436807+0000","last_change":"2024-04-26T23:50:00.436853+0000","last_active":"2024-04-26T23:50:00.436807+0000","last_peered":"2024-04-26T23:50:00.436807+0000","last_clean":"2024-04-26T23:50:00.436807+0000","last_became_active":"2024-04-26T23:40:41.679098+0000","last_became_peered":"2024-04-26T23:40:41.679098+0000","last_unstale":"2024-04-26T23:50:00.436807+0000","last_undegraded":"2024-04-26T23:50:00.436807+0000","last_fullsized":"2024-04-26T23:50:00.436807+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4643","last_scrub_stamp":"2024-04-26T23:50:00.436670+0000","last_deep_scrub":"26'4643","last_deep_scrub_stamp":"2024-04-26T23:50:00.436670+0000","last_clean_scrub_stamp":"2024-04-26T23:50:00.436670+0000","objects_scrubbed":0,"log_size":4643,"log_dups_size":0,"ondisk_log_size":4643,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:45:58.911691+0000","scrub_duration":21,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69716,"num_write_kb":886548,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"26'3484","reported_seq":3513,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.915893+0000","last_change":"2024-04-26T23:40:32.585827+0000","last_active":"2024-04-26T23:49:42.915893+0000","last_peered":"2024-04-26T23:49:42.915893+0000","last_clean":"2024-04-26T23:49:42.915893+0000","last_became_active":"2024-04-26T23:40:32.585522+0000","last_became_peered":"2024-04-26T23:40:32.585522+0000","last_unstale":"2024-04-26T23:49:42.915893+0000","last_undegraded":"2024-04-26T23:49:42.915893+0000","last_fullsized":"2024-04-26T23:49:42.915893+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":3484,"log_dups_size":0,"ondisk_log_size":3484,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":52204,"num_write_kb":651184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"26'17","reported_seq":56,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:50:00.125503+0000","last_change":"2024-04-26T23:50:00.125532+0000","last_active":"2024-04-26T23:50:00.125503+0000","last_peered":"2024-04-26T23:50:00.125503+0000","last_clean":"2024-04-26T23:50:00.125503+0000","last_became_active":"2024-04-26T23:40:31.574827+0000","last_became_peered":"2024-04-26T23:40:31.574827+0000","last_unstale":"2024-04-26T23:50:00.125503+0000","last_undegraded":"2024-04-26T23:50:00.125503+0000","last_fullsized":"2024-04-26T23:50:00.125503+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'17","last_scrub_stamp":"2024-04-26T23:50:00.125405+0000","last_deep_scrub":"26'17","last_deep_scrub_stamp":"2024-04-26T23:50:00.125405+0000","last_clean_scrub_stamp":"2024-04-26T23:50:00.125405+0000","objects_scrubbed":1,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:24:19.515037+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":4101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"26'4","reported_seq":35,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:55.441150+0000","last_change":"2024-04-26T23:49:55.441528+0000","last_active":"2024-04-26T23:49:55.441150+0000","last_peered":"2024-04-26T23:49:55.441150+0000","last_clean":"2024-04-26T23:49:55.441150+0000","last_became_active":"2024-04-26T23:40:40.677867+0000","last_became_peered":"2024-04-26T23:40:40.677867+0000","last_unstale":"2024-04-26T23:49:55.441150+0000","last_undegraded":"2024-04-26T23:49:55.441150+0000","last_fullsized":"2024-04-26T23:49:55.441150+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4","last_scrub_stamp":"2024-04-26T23:49:55.441059+0000","last_deep_scrub":"26'4","last_deep_scrub_stamp":"2024-04-26T23:49:55.441059+0000","last_clean_scrub_stamp":"2024-04-26T23:49:55.441059+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:44:17.196965+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"26'4222","reported_seq":4251,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:50:06.356945+0000","last_change":"2024-04-26T23:50:06.356984+0000","last_active":"2024-04-26T23:50:06.356945+0000","last_peered":"2024-04-26T23:50:06.356945+0000","last_clean":"2024-04-26T23:50:06.356945+0000","last_became_active":"2024-04-26T23:40:41.684699+0000","last_became_peered":"2024-04-26T23:40:41.684699+0000","last_unstale":"2024-04-26T23:50:06.356945+0000","last_undegraded":"2024-04-26T23:50:06.356945+0000","last_fullsized":"2024-04-26T23:50:06.356945+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4222","last_scrub_stamp":"2024-04-26T23:50:06.356793+0000","last_deep_scrub":"26'4222","last_deep_scrub_stamp":"2024-04-26T23:50:06.356793+0000","last_clean_scrub_stamp":"2024-04-26T23:50:06.356793+0000","objects_scrubbed":0,"log_size":4222,"log_dups_size":0,"ondisk_log_size":4222,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:57:58.937625+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":63591,"num_write_kb":826339,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"26'4047","reported_seq":4084,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:50:09.323054+0000","last_change":"2024-04-26T23:50:09.323079+0000","last_active":"2024-04-26T23:50:09.323054+0000","last_peered":"2024-04-26T23:50:09.323054+0000","last_clean":"2024-04-26T23:50:09.323054+0000","last_became_active":"2024-04-26T23:40:32.582438+0000","last_became_peered":"2024-04-26T23:40:32.582438+0000","last_unstale":"2024-04-26T23:50:09.323054+0000","last_undegraded":"2024-04-26T23:50:09.323054+0000","last_fullsized":"2024-04-26T23:50:09.323054+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4047","last_scrub_stamp":"2024-04-26T23:50:09.322959+0000","last_deep_scrub":"26'4047","last_deep_scrub_stamp":"2024-04-26T23:50:09.322959+0000","last_clean_scrub_stamp":"2024-04-26T23:50:09.322959+0000","objects_scrubbed":0,"log_size":4047,"log_dups_size":0,"ondisk_log_size":4047,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:24:01.968503+0000","scrub_duration":21,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":60599,"num_write_kb":814129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"26'17","reported_seq":56,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:50:01.165956+0000","last_change":"2024-04-26T23:50:01.165985+0000","last_active":"2024-04-26T23:50:01.165956+0000","last_peered":"2024-04-26T23:50:01.165956+0000","last_clean":"2024-04-26T23:50:01.165956+0000","last_became_active":"2024-04-26T23:40:31.575242+0000","last_became_peered":"2024-04-26T23:40:31.575242+0000","last_unstale":"2024-04-26T23:50:01.165956+0000","last_undegraded":"2024-04-26T23:50:01.165956+0000","last_fullsized":"2024-04-26T23:50:01.165956+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'17","last_scrub_stamp":"2024-04-26T23:50:01.165856+0000","last_deep_scrub":"26'17","last_deep_scrub_stamp":"2024-04-26T23:50:01.165856+0000","last_clean_scrub_stamp":"2024-04-26T23:50:01.165856+0000","objects_scrubbed":1,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:00:28.432354+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":4101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"26'18","reported_seq":49,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:56.110174+0000","last_change":"2024-04-26T23:49:56.110208+0000","last_active":"2024-04-26T23:49:56.110174+0000","last_peered":"2024-04-26T23:49:56.110174+0000","last_clean":"2024-04-26T23:49:56.110174+0000","last_became_active":"2024-04-26T23:40:40.678740+0000","last_became_peered":"2024-04-26T23:40:40.678740+0000","last_unstale":"2024-04-26T23:49:56.110174+0000","last_undegraded":"2024-04-26T23:49:56.110174+0000","last_fullsized":"2024-04-26T23:49:56.110174+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'18","last_scrub_stamp":"2024-04-26T23:49:56.110078+0000","last_deep_scrub":"26'18","last_deep_scrub_stamp":"2024-04-26T23:49:56.110078+0000","last_clean_scrub_stamp":"2024-04-26T23:49:56.110078+0000","objects_scrubbed":2,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:37:10.106984+0000","scrub_duration":26,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":4110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"26'5270","reported_seq":5291,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:50.002713+0000","last_change":"2024-04-26T23:40:41.686638+0000","last_active":"2024-04-26T23:49:50.002713+0000","last_peered":"2024-04-26T23:49:50.002713+0000","last_clean":"2024-04-26T23:49:50.002713+0000","last_became_active":"2024-04-26T23:40:41.686354+0000","last_became_peered":"2024-04-26T23:40:41.686354+0000","last_unstale":"2024-04-26T23:49:50.002713+0000","last_undegraded":"2024-04-26T23:49:50.002713+0000","last_fullsized":"2024-04-26T23:49:50.002713+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":5270,"log_dups_size":0,"ondisk_log_size":5270,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79283,"num_write_kb":1000134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"26'4022","reported_seq":4059,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:58.403572+0000","last_change":"2024-04-26T23:49:58.403601+0000","last_active":"2024-04-26T23:49:58.403572+0000","last_peered":"2024-04-26T23:49:58.403572+0000","last_clean":"2024-04-26T23:49:58.403572+0000","last_became_active":"2024-04-26T23:40:32.582719+0000","last_became_peered":"2024-04-26T23:40:32.582719+0000","last_unstale":"2024-04-26T23:49:58.403572+0000","last_undegraded":"2024-04-26T23:49:58.403572+0000","last_fullsized":"2024-04-26T23:49:58.403572+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4022","last_scrub_stamp":"2024-04-26T23:49:58.403450+0000","last_deep_scrub":"26'4022","last_deep_scrub_stamp":"2024-04-26T23:49:58.403450+0000","last_clean_scrub_stamp":"2024-04-26T23:49:58.403450+0000","objects_scrubbed":0,"log_size":4022,"log_dups_size":0,"ondisk_log_size":4022,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:37:12.400356+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":60741,"num_write_kb":745879,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"26'20","reported_seq":59,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:50:07.637340+0000","last_change":"2024-04-26T23:50:07.637385+0000","last_active":"2024-04-26T23:50:07.637340+0000","last_peered":"2024-04-26T23:50:07.637340+0000","last_clean":"2024-04-26T23:50:07.637340+0000","last_became_active":"2024-04-26T23:40:31.576419+0000","last_became_peered":"2024-04-26T23:40:31.576419+0000","last_unstale":"2024-04-26T23:50:07.637340+0000","last_undegraded":"2024-04-26T23:50:07.637340+0000","last_fullsized":"2024-04-26T23:50:07.637340+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'20","last_scrub_stamp":"2024-04-26T23:50:07.637240+0000","last_deep_scrub":"26'20","last_deep_scrub_stamp":"2024-04-26T23:50:07.637240+0000","last_clean_scrub_stamp":"2024-04-26T23:50:07.637240+0000","objects_scrubbed":1,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:37:36.495897+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":4102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"26'20","reported_seq":51,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:56.422887+0000","last_change":"2024-04-26T23:49:56.422922+0000","last_active":"2024-04-26T23:49:56.422887+0000","last_peered":"2024-04-26T23:49:56.422887+0000","last_clean":"2024-04-26T23:49:56.422887+0000","last_became_active":"2024-04-26T23:40:40.674721+0000","last_became_peered":"2024-04-26T23:40:40.674721+0000","last_unstale":"2024-04-26T23:49:56.422887+0000","last_undegraded":"2024-04-26T23:49:56.422887+0000","last_fullsized":"2024-04-26T23:49:56.422887+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'20","last_scrub_stamp":"2024-04-26T23:49:56.422781+0000","last_deep_scrub":"26'20","last_deep_scrub_stamp":"2024-04-26T23:49:56.422781+0000","last_clean_scrub_stamp":"2024-04-26T23:49:56.422781+0000","objects_scrubbed":2,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:43:11.926125+0000","scrub_duration":18,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":4101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"26'4214","reported_seq":4235,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:45.257544+0000","last_change":"2024-04-26T23:40:41.691494+0000","last_active":"2024-04-26T23:49:45.257544+0000","last_peered":"2024-04-26T23:49:45.257544+0000","last_clean":"2024-04-26T23:49:45.257544+0000","last_became_active":"2024-04-26T23:40:41.691241+0000","last_became_peered":"2024-04-26T23:40:41.691241+0000","last_unstale":"2024-04-26T23:49:45.257544+0000","last_undegraded":"2024-04-26T23:49:45.257544+0000","last_fullsized":"2024-04-26T23:49:45.257544+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":4214,"log_dups_size":0,"ondisk_log_size":4214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":63038,"num_write_kb":829161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"26'3470","reported_seq":3507,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:55.766659+0000","last_change":"2024-04-26T23:49:55.766688+0000","last_active":"2024-04-26T23:49:55.766659+0000","last_peered":"2024-04-26T23:49:55.766659+0000","last_clean":"2024-04-26T23:49:55.766659+0000","last_became_active":"2024-04-26T23:40:32.584467+0000","last_became_peered":"2024-04-26T23:40:32.584467+0000","last_unstale":"2024-04-26T23:49:55.766659+0000","last_undegraded":"2024-04-26T23:49:55.766659+0000","last_fullsized":"2024-04-26T23:49:55.766659+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3470","last_scrub_stamp":"2024-04-26T23:49:55.766549+0000","last_deep_scrub":"26'3470","last_deep_scrub_stamp":"2024-04-26T23:49:55.766549+0000","last_clean_scrub_stamp":"2024-04-26T23:49:55.766549+0000","objects_scrubbed":0,"log_size":3470,"log_dups_size":0,"ondisk_log_size":3470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:47:06.462855+0000","scrub_duration":28,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51752,"num_write_kb":657341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"26'116","reported_seq":155,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:58.726251+0000","last_change":"2024-04-26T23:49:58.726284+0000","last_active":"2024-04-26T23:49:58.726251+0000","last_peered":"2024-04-26T23:49:58.726251+0000","last_clean":"2024-04-26T23:49:58.726251+0000","last_became_active":"2024-04-26T23:40:31.573434+0000","last_became_peered":"2024-04-26T23:40:31.573434+0000","last_unstale":"2024-04-26T23:49:58.726251+0000","last_undegraded":"2024-04-26T23:49:58.726251+0000","last_fullsized":"2024-04-26T23:49:58.726251+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'116","last_scrub_stamp":"2024-04-26T23:49:58.726166+0000","last_deep_scrub":"26'116","last_deep_scrub_stamp":"2024-04-26T23:49:58.726166+0000","last_clean_scrub_stamp":"2024-04-26T23:49:58.726166+0000","objects_scrubbed":2,"log_size":116,"log_dups_size":0,"ondisk_log_size":116,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:01:01.910494+0000","scrub_duration":21,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2675866,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":112,"num_write_kb":2659,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"26'20","reported_seq":69,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:51.399403+0000","last_change":"2024-04-26T23:49:51.399434+0000","last_active":"2024-04-26T23:49:51.399403+0000","last_peered":"2024-04-26T23:49:51.399403+0000","last_clean":"2024-04-26T23:49:51.399403+0000","last_became_active":"2024-04-26T23:40:40.677410+0000","last_became_peered":"2024-04-26T23:40:40.677410+0000","last_unstale":"2024-04-26T23:49:51.399403+0000","last_undegraded":"2024-04-26T23:49:51.399403+0000","last_fullsized":"2024-04-26T23:49:51.399403+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'20","last_scrub_stamp":"2024-04-26T23:49:51.399302+0000","last_deep_scrub":"26'20","last_deep_scrub_stamp":"2024-04-26T23:49:51.399302+0000","last_clean_scrub_stamp":"2024-04-26T23:49:51.399302+0000","objects_scrubbed":1,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:01:39.455014+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88181,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":98,"num_write":18,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"26'4396","reported_seq":4421,"reported_epoch":26,"state":"active+clean+scrubbing+deep","last_fresh":"2024-04-26T23:50:08.245911+0000","last_change":"2024-04-26T23:50:08.245617+0000","last_active":"2024-04-26T23:50:08.245911+0000","last_peered":"2024-04-26T23:50:08.245911+0000","last_clean":"2024-04-26T23:50:08.245911+0000","last_became_active":"2024-04-26T23:40:41.689508+0000","last_became_peered":"2024-04-26T23:40:41.689508+0000","last_unstale":"2024-04-26T23:50:08.245911+0000","last_undegraded":"2024-04-26T23:50:08.245911+0000","last_fullsized":"2024-04-26T23:50:08.245911+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":4396,"log_dups_size":0,"ondisk_log_size":4396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 0s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":66189,"num_write_kb":852725,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"26'4076","reported_seq":4113,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:54.232185+0000","last_change":"2024-04-26T23:49:54.232229+0000","last_active":"2024-04-26T23:49:54.232185+0000","last_peered":"2024-04-26T23:49:54.232185+0000","last_clean":"2024-04-26T23:49:54.232185+0000","last_became_active":"2024-04-26T23:40:32.594616+0000","last_became_peered":"2024-04-26T23:40:32.594616+0000","last_unstale":"2024-04-26T23:49:54.232185+0000","last_undegraded":"2024-04-26T23:49:54.232185+0000","last_fullsized":"2024-04-26T23:49:54.232185+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4076","last_scrub_stamp":"2024-04-26T23:49:54.231708+0000","last_deep_scrub":"26'4076","last_deep_scrub_stamp":"2024-04-26T23:49:54.231708+0000","last_clean_scrub_stamp":"2024-04-26T23:49:54.231708+0000","objects_scrubbed":0,"log_size":4076,"log_dups_size":0,"ondisk_log_size":4076,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:41:53.898700+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":61223,"num_write_kb":789949,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"26'262","reported_seq":301,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:50:02.138857+0000","last_change":"2024-04-26T23:50:02.138887+0000","last_active":"2024-04-26T23:50:02.138857+0000","last_peered":"2024-04-26T23:50:02.138857+0000","last_clean":"2024-04-26T23:50:02.138857+0000","last_became_active":"2024-04-26T23:40:31.576006+0000","last_became_peered":"2024-04-26T23:40:31.576006+0000","last_unstale":"2024-04-26T23:50:02.138857+0000","last_undegraded":"2024-04-26T23:50:02.138857+0000","last_fullsized":"2024-04-26T23:50:02.138857+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'262","last_scrub_stamp":"2024-04-26T23:50:02.138760+0000","last_deep_scrub":"26'262","last_deep_scrub_stamp":"2024-04-26T23:50:02.138760+0000","last_clean_scrub_stamp":"2024-04-26T23:50:02.138760+0000","objects_scrubbed":1,"log_size":262,"log_dups_size":0,"ondisk_log_size":262,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:43:06.700731+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":519,"num_write_kb":200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"26'28","reported_seq":59,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:53.200490+0000","last_change":"2024-04-26T23:49:53.200526+0000","last_active":"2024-04-26T23:49:53.200490+0000","last_peered":"2024-04-26T23:49:53.200490+0000","last_clean":"2024-04-26T23:49:53.200490+0000","last_became_active":"2024-04-26T23:40:40.674557+0000","last_became_peered":"2024-04-26T23:40:40.674557+0000","last_unstale":"2024-04-26T23:49:53.200490+0000","last_undegraded":"2024-04-26T23:49:53.200490+0000","last_fullsized":"2024-04-26T23:49:53.200490+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'28","last_scrub_stamp":"2024-04-26T23:49:53.200403+0000","last_deep_scrub":"26'28","last_deep_scrub_stamp":"2024-04-26T23:49:53.200403+0000","last_clean_scrub_stamp":"2024-04-26T23:49:53.200403+0000","objects_scrubbed":3,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:38:23.348289+0000","scrub_duration":28,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":12298,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"26'4705","reported_seq":4726,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:45.223846+0000","last_change":"2024-04-26T23:40:41.688941+0000","last_active":"2024-04-26T23:49:45.223846+0000","last_peered":"2024-04-26T23:49:45.223846+0000","last_clean":"2024-04-26T23:49:45.223846+0000","last_became_active":"2024-04-26T23:40:41.688653+0000","last_became_peered":"2024-04-26T23:40:41.688653+0000","last_unstale":"2024-04-26T23:49:45.223846+0000","last_undegraded":"2024-04-26T23:49:45.223846+0000","last_fullsized":"2024-04-26T23:49:45.223846+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":4705,"log_dups_size":0,"ondisk_log_size":4705,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":70754,"num_write_kb":894410,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"26'4242","reported_seq":4279,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:50:05.291246+0000","last_change":"2024-04-26T23:50:05.291271+0000","last_active":"2024-04-26T23:50:05.291246+0000","last_peered":"2024-04-26T23:50:05.291246+0000","last_clean":"2024-04-26T23:50:05.291246+0000","last_became_active":"2024-04-26T23:40:32.582140+0000","last_became_peered":"2024-04-26T23:40:32.582140+0000","last_unstale":"2024-04-26T23:50:05.291246+0000","last_undegraded":"2024-04-26T23:50:05.291246+0000","last_fullsized":"2024-04-26T23:50:05.291246+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4242","last_scrub_stamp":"2024-04-26T23:50:05.291125+0000","last_deep_scrub":"26'4242","last_deep_scrub_stamp":"2024-04-26T23:50:05.291125+0000","last_clean_scrub_stamp":"2024-04-26T23:50:05.291125+0000","objects_scrubbed":0,"log_size":4242,"log_dups_size":0,"ondisk_log_size":4242,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:01:01.835552+0000","scrub_duration":37,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":63708,"num_write_kb":831213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"26'17","reported_seq":56,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:50:06.598054+0000","last_change":"2024-04-26T23:50:06.598109+0000","last_active":"2024-04-26T23:50:06.598054+0000","last_peered":"2024-04-26T23:50:06.598054+0000","last_clean":"2024-04-26T23:50:06.598054+0000","last_became_active":"2024-04-26T23:40:31.576313+0000","last_became_peered":"2024-04-26T23:40:31.576313+0000","last_unstale":"2024-04-26T23:50:06.598054+0000","last_undegraded":"2024-04-26T23:50:06.598054+0000","last_fullsized":"2024-04-26T23:50:06.598054+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'17","last_scrub_stamp":"2024-04-26T23:50:06.597921+0000","last_deep_scrub":"26'17","last_deep_scrub_stamp":"2024-04-26T23:50:06.597921+0000","last_clean_scrub_stamp":"2024-04-26T23:50:06.597921+0000","objects_scrubbed":1,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:49:34.436228+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":4100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"26'2","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:49.757336+0000","last_change":"2024-04-26T23:49:49.757369+0000","last_active":"2024-04-26T23:49:49.757336+0000","last_peered":"2024-04-26T23:49:49.757336+0000","last_clean":"2024-04-26T23:49:49.757336+0000","last_became_active":"2024-04-26T23:40:40.670630+0000","last_became_peered":"2024-04-26T23:40:40.670630+0000","last_unstale":"2024-04-26T23:49:49.757336+0000","last_undegraded":"2024-04-26T23:49:49.757336+0000","last_fullsized":"2024-04-26T23:49:49.757336+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2","last_scrub_stamp":"2024-04-26T23:49:49.757262+0000","last_deep_scrub":"26'2","last_deep_scrub_stamp":"2024-04-26T23:49:49.757262+0000","last_clean_scrub_stamp":"2024-04-26T23:49:49.757262+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:09:10.195146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"26'4144","reported_seq":4173,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:50:04.697262+0000","last_change":"2024-04-26T23:50:04.697299+0000","last_active":"2024-04-26T23:50:04.697262+0000","last_peered":"2024-04-26T23:50:04.697262+0000","last_clean":"2024-04-26T23:50:04.697262+0000","last_became_active":"2024-04-26T23:40:41.685961+0000","last_became_peered":"2024-04-26T23:40:41.685961+0000","last_unstale":"2024-04-26T23:50:04.697262+0000","last_undegraded":"2024-04-26T23:50:04.697262+0000","last_fullsized":"2024-04-26T23:50:04.697262+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4144","last_scrub_stamp":"2024-04-26T23:50:04.697159+0000","last_deep_scrub":"26'4144","last_deep_scrub_stamp":"2024-04-26T23:50:04.697159+0000","last_clean_scrub_stamp":"2024-04-26T23:50:04.697159+0000","objects_scrubbed":0,"log_size":4144,"log_dups_size":0,"ondisk_log_size":4144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:33:51.380145+0000","scrub_duration":22,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":62474,"num_write_kb":825561,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"26'3719","reported_seq":3756,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:59.603110+0000","last_change":"2024-04-26T23:49:59.603137+0000","last_active":"2024-04-26T23:49:59.603110+0000","last_peered":"2024-04-26T23:49:59.603110+0000","last_clean":"2024-04-26T23:49:59.603110+0000","last_became_active":"2024-04-26T23:40:32.584082+0000","last_became_peered":"2024-04-26T23:40:32.584082+0000","last_unstale":"2024-04-26T23:49:59.603110+0000","last_undegraded":"2024-04-26T23:49:59.603110+0000","last_fullsized":"2024-04-26T23:49:59.603110+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3719","last_scrub_stamp":"2024-04-26T23:49:59.603012+0000","last_deep_scrub":"26'3719","last_deep_scrub_stamp":"2024-04-26T23:49:59.603012+0000","last_clean_scrub_stamp":"2024-04-26T23:49:59.603012+0000","objects_scrubbed":0,"log_size":3719,"log_dups_size":0,"ondisk_log_size":3719,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:45:34.341711+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55724,"num_write_kb":725978,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"26'6","reported_seq":45,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:50:03.167632+0000","last_change":"2024-04-26T23:50:03.167682+0000","last_active":"2024-04-26T23:50:03.167632+0000","last_peered":"2024-04-26T23:50:03.167632+0000","last_clean":"2024-04-26T23:50:03.167632+0000","last_became_active":"2024-04-26T23:40:31.576404+0000","last_became_peered":"2024-04-26T23:40:31.576404+0000","last_unstale":"2024-04-26T23:50:03.167632+0000","last_undegraded":"2024-04-26T23:50:03.167632+0000","last_fullsized":"2024-04-26T23:50:03.167632+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'6","last_scrub_stamp":"2024-04-26T23:50:03.167517+0000","last_deep_scrub":"26'6","last_deep_scrub_stamp":"2024-04-26T23:50:03.167517+0000","last_clean_scrub_stamp":"2024-04-26T23:50:03.167517+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:45:37.906215+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"26'33","reported_seq":64,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:50.159947+0000","last_change":"2024-04-26T23:49:50.159995+0000","last_active":"2024-04-26T23:49:50.159947+0000","last_peered":"2024-04-26T23:49:50.159947+0000","last_clean":"2024-04-26T23:49:50.159947+0000","last_became_active":"2024-04-26T23:40:40.674935+0000","last_became_peered":"2024-04-26T23:40:40.674935+0000","last_unstale":"2024-04-26T23:49:50.159947+0000","last_undegraded":"2024-04-26T23:49:50.159947+0000","last_fullsized":"2024-04-26T23:49:50.159947+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'33","last_scrub_stamp":"2024-04-26T23:49:50.159840+0000","last_deep_scrub":"26'33","last_deep_scrub_stamp":"2024-04-26T23:49:50.159840+0000","last_clean_scrub_stamp":"2024-04-26T23:49:50.159840+0000","objects_scrubbed":2,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:17:54.409611+0000","scrub_duration":20,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":8205,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"26'3990","reported_seq":4019,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:50:05.742998+0000","last_change":"2024-04-26T23:50:05.743027+0000","last_active":"2024-04-26T23:50:05.742998+0000","last_peered":"2024-04-26T23:50:05.742998+0000","last_clean":"2024-04-26T23:50:05.742998+0000","last_became_active":"2024-04-26T23:40:41.691242+0000","last_became_peered":"2024-04-26T23:40:41.691242+0000","last_unstale":"2024-04-26T23:50:05.742998+0000","last_undegraded":"2024-04-26T23:50:05.742998+0000","last_fullsized":"2024-04-26T23:50:05.742998+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3990","last_scrub_stamp":"2024-04-26T23:50:05.742888+0000","last_deep_scrub":"26'3990","last_deep_scrub_stamp":"2024-04-26T23:50:05.742888+0000","last_clean_scrub_stamp":"2024-04-26T23:50:05.742888+0000","objects_scrubbed":0,"log_size":3990,"log_dups_size":0,"ondisk_log_size":3990,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:21:54.853258+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":59849,"num_write_kb":777586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"26'3874","reported_seq":3911,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:50:00.370272+0000","last_change":"2024-04-26T23:50:00.370302+0000","last_active":"2024-04-26T23:50:00.370272+0000","last_peered":"2024-04-26T23:50:00.370272+0000","last_clean":"2024-04-26T23:50:00.370272+0000","last_became_active":"2024-04-26T23:40:32.589790+0000","last_became_peered":"2024-04-26T23:40:32.589790+0000","last_unstale":"2024-04-26T23:50:00.370272+0000","last_undegraded":"2024-04-26T23:50:00.370272+0000","last_fullsized":"2024-04-26T23:50:00.370272+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3874","last_scrub_stamp":"2024-04-26T23:50:00.370157+0000","last_deep_scrub":"26'3874","last_deep_scrub_stamp":"2024-04-26T23:50:00.370157+0000","last_clean_scrub_stamp":"2024-04-26T23:50:00.370157+0000","objects_scrubbed":0,"log_size":3874,"log_dups_size":0,"ondisk_log_size":3874,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:37:11.024686+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":58064,"num_write_kb":769321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"26'27","reported_seq":66,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:50:04.634272+0000","last_change":"2024-04-26T23:50:04.634302+0000","last_active":"2024-04-26T23:50:04.634272+0000","last_peered":"2024-04-26T23:50:04.634272+0000","last_clean":"2024-04-26T23:50:04.634272+0000","last_became_active":"2024-04-26T23:40:31.572121+0000","last_became_peered":"2024-04-26T23:40:31.572121+0000","last_unstale":"2024-04-26T23:50:04.634272+0000","last_undegraded":"2024-04-26T23:50:04.634272+0000","last_fullsized":"2024-04-26T23:50:04.634272+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'27","last_scrub_stamp":"2024-04-26T23:50:04.634193+0000","last_deep_scrub":"26'27","last_deep_scrub_stamp":"2024-04-26T23:50:04.634193+0000","last_clean_scrub_stamp":"2024-04-26T23:50:04.634193+0000","objects_scrubbed":2,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:49:32.472501+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":8200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"26'6","reported_seq":37,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:54.117590+0000","last_change":"2024-04-26T23:49:54.117618+0000","last_active":"2024-04-26T23:49:54.117590+0000","last_peered":"2024-04-26T23:49:54.117590+0000","last_clean":"2024-04-26T23:49:54.117590+0000","last_became_active":"2024-04-26T23:40:40.678136+0000","last_became_peered":"2024-04-26T23:40:40.678136+0000","last_unstale":"2024-04-26T23:49:54.117590+0000","last_undegraded":"2024-04-26T23:49:54.117590+0000","last_fullsized":"2024-04-26T23:49:54.117590+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'6","last_scrub_stamp":"2024-04-26T23:49:54.117492+0000","last_deep_scrub":"26'6","last_deep_scrub_stamp":"2024-04-26T23:49:54.117492+0000","last_clean_scrub_stamp":"2024-04-26T23:49:54.117492+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:43:09.620836+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"26'3876","reported_seq":3905,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:58.461860+0000","last_change":"2024-04-26T23:49:58.461914+0000","last_active":"2024-04-26T23:49:58.461860+0000","last_peered":"2024-04-26T23:49:58.461860+0000","last_clean":"2024-04-26T23:49:58.461860+0000","last_became_active":"2024-04-26T23:40:41.673254+0000","last_became_peered":"2024-04-26T23:40:41.673254+0000","last_unstale":"2024-04-26T23:49:58.461860+0000","last_undegraded":"2024-04-26T23:49:58.461860+0000","last_fullsized":"2024-04-26T23:49:58.461860+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3876","last_scrub_stamp":"2024-04-26T23:49:58.461736+0000","last_deep_scrub":"26'3876","last_deep_scrub_stamp":"2024-04-26T23:49:58.461736+0000","last_clean_scrub_stamp":"2024-04-26T23:49:58.461736+0000","objects_scrubbed":0,"log_size":3876,"log_dups_size":0,"ondisk_log_size":3876,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:01:01.646064+0000","scrub_duration":22,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":58020,"num_write_kb":724597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"26'3920","reported_seq":3957,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:50:04.226990+0000","last_change":"2024-04-26T23:50:04.227020+0000","last_active":"2024-04-26T23:50:04.226990+0000","last_peered":"2024-04-26T23:50:04.226990+0000","last_clean":"2024-04-26T23:50:04.226990+0000","last_became_active":"2024-04-26T23:40:32.576481+0000","last_became_peered":"2024-04-26T23:40:32.576481+0000","last_unstale":"2024-04-26T23:50:04.226990+0000","last_undegraded":"2024-04-26T23:50:04.226990+0000","last_fullsized":"2024-04-26T23:50:04.226990+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3920","last_scrub_stamp":"2024-04-26T23:50:04.226866+0000","last_deep_scrub":"26'3920","last_deep_scrub_stamp":"2024-04-26T23:50:04.226866+0000","last_clean_scrub_stamp":"2024-04-26T23:50:04.226866+0000","objects_scrubbed":0,"log_size":3920,"log_dups_size":0,"ondisk_log_size":3920,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:49:57.586986+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":58555,"num_write_kb":772397,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"26'17","reported_seq":71,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:51.392090+0000","last_change":"2024-04-26T23:49:51.392116+0000","last_active":"2024-04-26T23:49:51.392090+0000","last_peered":"2024-04-26T23:49:51.392090+0000","last_clean":"2024-04-26T23:49:51.392090+0000","last_became_active":"2024-04-26T23:40:31.570493+0000","last_became_peered":"2024-04-26T23:40:31.570493+0000","last_unstale":"2024-04-26T23:49:51.392090+0000","last_undegraded":"2024-04-26T23:49:51.392090+0000","last_fullsized":"2024-04-26T23:49:51.392090+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'17","last_scrub_stamp":"2024-04-26T23:49:51.392004+0000","last_deep_scrub":"26'17","last_deep_scrub_stamp":"2024-04-26T23:49:51.392004+0000","last_clean_scrub_stamp":"2024-04-26T23:49:51.392004+0000","objects_scrubbed":1,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:51:07.543004+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88181,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":95,"num_write":15,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"26'25","reported_seq":56,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:49.177310+0000","last_change":"2024-04-26T23:49:49.177336+0000","last_active":"2024-04-26T23:49:49.177310+0000","last_peered":"2024-04-26T23:49:49.177310+0000","last_clean":"2024-04-26T23:49:49.177310+0000","last_became_active":"2024-04-26T23:40:40.674828+0000","last_became_peered":"2024-04-26T23:40:40.674828+0000","last_unstale":"2024-04-26T23:49:49.177310+0000","last_undegraded":"2024-04-26T23:49:49.177310+0000","last_fullsized":"2024-04-26T23:49:49.177310+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'25","last_scrub_stamp":"2024-04-26T23:49:49.177242+0000","last_deep_scrub":"26'25","last_deep_scrub_stamp":"2024-04-26T23:49:49.177242+0000","last_clean_scrub_stamp":"2024-04-26T23:49:49.177242+0000","objects_scrubbed":2,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:01:37.232954+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":4104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"26'4513","reported_seq":4534,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:45.292819+0000","last_change":"2024-04-26T23:40:41.691098+0000","last_active":"2024-04-26T23:49:45.292819+0000","last_peered":"2024-04-26T23:49:45.292819+0000","last_clean":"2024-04-26T23:49:45.292819+0000","last_became_active":"2024-04-26T23:40:41.690803+0000","last_became_peered":"2024-04-26T23:40:41.690803+0000","last_unstale":"2024-04-26T23:49:45.292819+0000","last_undegraded":"2024-04-26T23:49:45.292819+0000","last_fullsized":"2024-04-26T23:49:45.292819+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":4513,"log_dups_size":0,"ondisk_log_size":4513,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":67888,"num_write_kb":829373,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"26'4011","reported_seq":4048,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:59.705909+0000","last_change":"2024-04-26T23:49:59.705936+0000","last_active":"2024-04-26T23:49:59.705909+0000","last_peered":"2024-04-26T23:49:59.705909+0000","last_clean":"2024-04-26T23:49:59.705909+0000","last_became_active":"2024-04-26T23:40:32.593003+0000","last_became_peered":"2024-04-26T23:40:32.593003+0000","last_unstale":"2024-04-26T23:49:59.705909+0000","last_undegraded":"2024-04-26T23:49:59.705909+0000","last_fullsized":"2024-04-26T23:49:59.705909+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4011","last_scrub_stamp":"2024-04-26T23:49:59.705466+0000","last_deep_scrub":"26'4011","last_deep_scrub_stamp":"2024-04-26T23:49:59.705466+0000","last_clean_scrub_stamp":"2024-04-26T23:49:59.705466+0000","objects_scrubbed":0,"log_size":4011,"log_dups_size":0,"ondisk_log_size":4011,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:37:13.702371+0000","scrub_duration":17,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":60122,"num_write_kb":778045,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"26'37","reported_seq":76,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:50:05.561243+0000","last_change":"2024-04-26T23:50:05.561276+0000","last_active":"2024-04-26T23:50:05.561243+0000","last_peered":"2024-04-26T23:50:05.561243+0000","last_clean":"2024-04-26T23:50:05.561243+0000","last_became_active":"2024-04-26T23:40:31.573594+0000","last_became_peered":"2024-04-26T23:40:31.573594+0000","last_unstale":"2024-04-26T23:50:05.561243+0000","last_undegraded":"2024-04-26T23:50:05.561243+0000","last_fullsized":"2024-04-26T23:50:05.561243+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'37","last_scrub_stamp":"2024-04-26T23:50:05.561165+0000","last_deep_scrub":"26'37","last_deep_scrub_stamp":"2024-04-26T23:50:05.561165+0000","last_clean_scrub_stamp":"2024-04-26T23:50:05.561165+0000","objects_scrubbed":2,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:07:15.189065+0000","scrub_duration":18,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":8204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"26'253","reported_seq":284,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:50:01.677753+0000","last_change":"2024-04-26T23:50:01.677797+0000","last_active":"2024-04-26T23:50:01.677753+0000","last_peered":"2024-04-26T23:50:01.677753+0000","last_clean":"2024-04-26T23:50:01.677753+0000","last_became_active":"2024-04-26T23:40:40.676937+0000","last_became_peered":"2024-04-26T23:40:40.676937+0000","last_unstale":"2024-04-26T23:50:01.677753+0000","last_undegraded":"2024-04-26T23:50:01.677753+0000","last_fullsized":"2024-04-26T23:50:01.677753+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'253","last_scrub_stamp":"2024-04-26T23:50:01.677655+0000","last_deep_scrub":"26'253","last_deep_scrub_stamp":"2024-04-26T23:50:01.677655+0000","last_clean_scrub_stamp":"2024-04-26T23:50:01.677655+0000","objects_scrubbed":1,"log_size":253,"log_dups_size":0,"ondisk_log_size":253,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:42:01.344647+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":475,"num_write_kb":168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"26'4528","reported_seq":4549,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:45.289804+0000","last_change":"2024-04-26T23:40:41.684731+0000","last_active":"2024-04-26T23:49:45.289804+0000","last_peered":"2024-04-26T23:49:45.289804+0000","last_clean":"2024-04-26T23:49:45.289804+0000","last_became_active":"2024-04-26T23:40:41.684459+0000","last_became_peered":"2024-04-26T23:40:41.684459+0000","last_unstale":"2024-04-26T23:49:45.289804+0000","last_undegraded":"2024-04-26T23:49:45.289804+0000","last_fullsized":"2024-04-26T23:49:45.289804+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":4528,"log_dups_size":0,"ondisk_log_size":4528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":68252,"num_write_kb":886817,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"26'4332","reported_seq":4369,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:58.199178+0000","last_change":"2024-04-26T23:49:58.199205+0000","last_active":"2024-04-26T23:49:58.199178+0000","last_peered":"2024-04-26T23:49:58.199178+0000","last_clean":"2024-04-26T23:49:58.199178+0000","last_became_active":"2024-04-26T23:40:32.592929+0000","last_became_peered":"2024-04-26T23:40:32.592929+0000","last_unstale":"2024-04-26T23:49:58.199178+0000","last_undegraded":"2024-04-26T23:49:58.199178+0000","last_fullsized":"2024-04-26T23:49:58.199178+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4332","last_scrub_stamp":"2024-04-26T23:49:58.199056+0000","last_deep_scrub":"26'4332","last_deep_scrub_stamp":"2024-04-26T23:49:58.199056+0000","last_clean_scrub_stamp":"2024-04-26T23:49:58.199056+0000","objects_scrubbed":0,"log_size":4332,"log_dups_size":0,"ondisk_log_size":4332,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:21:47.309425+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":65153,"num_write_kb":829422,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"26'2","reported_seq":41,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:50:02.632517+0000","last_change":"2024-04-26T23:50:02.632577+0000","last_active":"2024-04-26T23:50:02.632517+0000","last_peered":"2024-04-26T23:50:02.632517+0000","last_clean":"2024-04-26T23:50:02.632517+0000","last_became_active":"2024-04-26T23:40:31.569764+0000","last_became_peered":"2024-04-26T23:40:31.569764+0000","last_unstale":"2024-04-26T23:50:02.632517+0000","last_undegraded":"2024-04-26T23:50:02.632517+0000","last_fullsized":"2024-04-26T23:50:02.632517+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2","last_scrub_stamp":"2024-04-26T23:50:02.632385+0000","last_deep_scrub":"26'2","last_deep_scrub_stamp":"2024-04-26T23:50:02.632385+0000","last_clean_scrub_stamp":"2024-04-26T23:50:02.632385+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:30:36.930387+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"26'119","reported_seq":197,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:50:03.551754+0000","last_change":"2024-04-26T23:50:03.551812+0000","last_active":"2024-04-26T23:50:03.551754+0000","last_peered":"2024-04-26T23:50:03.551754+0000","last_clean":"2024-04-26T23:50:03.551754+0000","last_became_active":"2024-04-26T23:40:20.963937+0000","last_became_peered":"2024-04-26T23:40:20.963937+0000","last_unstale":"2024-04-26T23:50:03.551754+0000","last_undegraded":"2024-04-26T23:50:03.551754+0000","last_fullsized":"2024-04-26T23:50:03.551754+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'119","last_scrub_stamp":"2024-04-26T23:50:03.551669+0000","last_deep_scrub":"26'119","last_deep_scrub_stamp":"2024-04-26T23:50:03.551669+0000","last_clean_scrub_stamp":"2024-04-26T23:50:03.551669+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:01:00.096096+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"26'8","reported_seq":39,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:50:03.789702+0000","last_change":"2024-04-26T23:50:03.789757+0000","last_active":"2024-04-26T23:50:03.789702+0000","last_peered":"2024-04-26T23:50:03.789702+0000","last_clean":"2024-04-26T23:50:03.789702+0000","last_became_active":"2024-04-26T23:40:40.671642+0000","last_became_peered":"2024-04-26T23:40:40.671642+0000","last_unstale":"2024-04-26T23:50:03.789702+0000","last_undegraded":"2024-04-26T23:50:03.789702+0000","last_fullsized":"2024-04-26T23:50:03.789702+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'8","last_scrub_stamp":"2024-04-26T23:50:03.789597+0000","last_deep_scrub":"26'8","last_deep_scrub_stamp":"2024-04-26T23:50:03.789597+0000","last_clean_scrub_stamp":"2024-04-26T23:50:03.789597+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:55:13.830811+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"26'3796","reported_seq":3825,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:50:01.435562+0000","last_change":"2024-04-26T23:50:01.435589+0000","last_active":"2024-04-26T23:50:01.435562+0000","last_peered":"2024-04-26T23:50:01.435562+0000","last_clean":"2024-04-26T23:50:01.435562+0000","last_became_active":"2024-04-26T23:40:41.680567+0000","last_became_peered":"2024-04-26T23:40:41.680567+0000","last_unstale":"2024-04-26T23:50:01.435562+0000","last_undegraded":"2024-04-26T23:50:01.435562+0000","last_fullsized":"2024-04-26T23:50:01.435562+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3796","last_scrub_stamp":"2024-04-26T23:50:01.435455+0000","last_deep_scrub":"26'3796","last_deep_scrub_stamp":"2024-04-26T23:50:01.435455+0000","last_clean_scrub_stamp":"2024-04-26T23:50:01.435455+0000","objects_scrubbed":0,"log_size":3796,"log_dups_size":0,"ondisk_log_size":3796,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:38:50.677922+0000","scrub_duration":18,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":57172,"num_write_kb":707056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"26'4186","reported_seq":4223,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:56.505044+0000","last_change":"2024-04-26T23:49:56.505071+0000","last_active":"2024-04-26T23:49:56.505044+0000","last_peered":"2024-04-26T23:49:56.505044+0000","last_clean":"2024-04-26T23:49:56.505044+0000","last_became_active":"2024-04-26T23:40:32.590867+0000","last_became_peered":"2024-04-26T23:40:32.590867+0000","last_unstale":"2024-04-26T23:49:56.505044+0000","last_undegraded":"2024-04-26T23:49:56.505044+0000","last_fullsized":"2024-04-26T23:49:56.505044+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4186","last_scrub_stamp":"2024-04-26T23:49:56.504473+0000","last_deep_scrub":"26'4186","last_deep_scrub_stamp":"2024-04-26T23:49:56.504473+0000","last_clean_scrub_stamp":"2024-04-26T23:49:56.504473+0000","objects_scrubbed":0,"log_size":4186,"log_dups_size":0,"ondisk_log_size":4186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:38:26.652359+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":62827,"num_write_kb":810912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"26'3","reported_seq":42,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:53.384212+0000","last_change":"2024-04-26T23:49:53.384294+0000","last_active":"2024-04-26T23:49:53.384212+0000","last_peered":"2024-04-26T23:49:53.384212+0000","last_clean":"2024-04-26T23:49:53.384212+0000","last_became_active":"2024-04-26T23:40:31.571849+0000","last_became_peered":"2024-04-26T23:40:31.571849+0000","last_unstale":"2024-04-26T23:49:53.384212+0000","last_undegraded":"2024-04-26T23:49:53.384212+0000","last_fullsized":"2024-04-26T23:49:53.384212+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3","last_scrub_stamp":"2024-04-26T23:49:53.384112+0000","last_deep_scrub":"26'3","last_deep_scrub_stamp":"2024-04-26T23:49:53.384112+0000","last_clean_scrub_stamp":"2024-04-26T23:49:53.384112+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:12:41.482494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"26'7","reported_seq":38,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:50:05.757503+0000","last_change":"2024-04-26T23:50:05.757561+0000","last_active":"2024-04-26T23:50:05.757503+0000","last_peered":"2024-04-26T23:50:05.757503+0000","last_clean":"2024-04-26T23:50:05.757503+0000","last_became_active":"2024-04-26T23:40:40.676154+0000","last_became_peered":"2024-04-26T23:40:40.676154+0000","last_unstale":"2024-04-26T23:50:05.757503+0000","last_undegraded":"2024-04-26T23:50:05.757503+0000","last_fullsized":"2024-04-26T23:50:05.757503+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'7","last_scrub_stamp":"2024-04-26T23:50:05.757397+0000","last_deep_scrub":"26'7","last_deep_scrub_stamp":"2024-04-26T23:50:05.757397+0000","last_clean_scrub_stamp":"2024-04-26T23:50:05.757397+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:05:04.709165+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"26'3987","reported_seq":4016,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:50:02.444484+0000","last_change":"2024-04-26T23:50:02.444546+0000","last_active":"2024-04-26T23:50:02.444484+0000","last_peered":"2024-04-26T23:50:02.444484+0000","last_clean":"2024-04-26T23:50:02.444484+0000","last_became_active":"2024-04-26T23:40:41.687693+0000","last_became_peered":"2024-04-26T23:40:41.687693+0000","last_unstale":"2024-04-26T23:50:02.444484+0000","last_undegraded":"2024-04-26T23:50:02.444484+0000","last_fullsized":"2024-04-26T23:50:02.444484+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3987","last_scrub_stamp":"2024-04-26T23:50:02.444325+0000","last_deep_scrub":"26'3987","last_deep_scrub_stamp":"2024-04-26T23:50:02.444325+0000","last_clean_scrub_stamp":"2024-04-26T23:50:02.444325+0000","objects_scrubbed":0,"log_size":3987,"log_dups_size":0,"ondisk_log_size":3987,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:38:03.464695+0000","scrub_duration":18,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":60042,"num_write_kb":782772,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"26'4287","reported_seq":4324,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:50:01.605555+0000","last_change":"2024-04-26T23:50:01.605578+0000","last_active":"2024-04-26T23:50:01.605555+0000","last_peered":"2024-04-26T23:50:01.605555+0000","last_clean":"2024-04-26T23:50:01.605555+0000","last_became_active":"2024-04-26T23:40:32.583174+0000","last_became_peered":"2024-04-26T23:40:32.583174+0000","last_unstale":"2024-04-26T23:50:01.605555+0000","last_undegraded":"2024-04-26T23:50:01.605555+0000","last_fullsized":"2024-04-26T23:50:01.605555+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4287","last_scrub_stamp":"2024-04-26T23:50:01.605466+0000","last_deep_scrub":"26'4287","last_deep_scrub_stamp":"2024-04-26T23:50:01.605466+0000","last_clean_scrub_stamp":"2024-04-26T23:50:01.605466+0000","objects_scrubbed":0,"log_size":4287,"log_dups_size":0,"ondisk_log_size":4287,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:00:58.149893+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":64102,"num_write_kb":832828,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"26'8","reported_seq":47,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:58.129117+0000","last_change":"2024-04-26T23:49:58.129172+0000","last_active":"2024-04-26T23:49:58.129117+0000","last_peered":"2024-04-26T23:49:58.129117+0000","last_clean":"2024-04-26T23:49:58.129117+0000","last_became_active":"2024-04-26T23:40:31.571427+0000","last_became_peered":"2024-04-26T23:40:31.571427+0000","last_unstale":"2024-04-26T23:49:58.129117+0000","last_undegraded":"2024-04-26T23:49:58.129117+0000","last_fullsized":"2024-04-26T23:49:58.129117+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'8","last_scrub_stamp":"2024-04-26T23:49:58.128984+0000","last_deep_scrub":"26'8","last_deep_scrub_stamp":"2024-04-26T23:49:58.128984+0000","last_clean_scrub_stamp":"2024-04-26T23:49:58.128984+0000","objects_scrubbed":2,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:37:08.783514+0000","scrub_duration":26,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"26'158","reported_seq":189,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:50:00.701715+0000","last_change":"2024-04-26T23:50:00.701753+0000","last_active":"2024-04-26T23:50:00.701715+0000","last_peered":"2024-04-26T23:50:00.701715+0000","last_clean":"2024-04-26T23:50:00.701715+0000","last_became_active":"2024-04-26T23:40:40.675682+0000","last_became_peered":"2024-04-26T23:40:40.675682+0000","last_unstale":"2024-04-26T23:50:00.701715+0000","last_undegraded":"2024-04-26T23:50:00.701715+0000","last_fullsized":"2024-04-26T23:50:00.701715+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'158","last_scrub_stamp":"2024-04-26T23:50:00.701616+0000","last_deep_scrub":"26'158","last_deep_scrub_stamp":"2024-04-26T23:50:00.701616+0000","last_clean_scrub_stamp":"2024-04-26T23:50:00.701616+0000","objects_scrubbed":3,"log_size":158,"log_dups_size":0,"ondisk_log_size":158,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:38:30.849502+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":145,"num_write_kb":8318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"26'4190","reported_seq":4219,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:50:01.561109+0000","last_change":"2024-04-26T23:50:01.561155+0000","last_active":"2024-04-26T23:50:01.561109+0000","last_peered":"2024-04-26T23:50:01.561109+0000","last_clean":"2024-04-26T23:50:01.561109+0000","last_became_active":"2024-04-26T23:40:41.681069+0000","last_became_peered":"2024-04-26T23:40:41.681069+0000","last_unstale":"2024-04-26T23:50:01.561109+0000","last_undegraded":"2024-04-26T23:50:01.561109+0000","last_fullsized":"2024-04-26T23:50:01.561109+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4190","last_scrub_stamp":"2024-04-26T23:50:01.560946+0000","last_deep_scrub":"26'4190","last_deep_scrub_stamp":"2024-04-26T23:50:01.560946+0000","last_clean_scrub_stamp":"2024-04-26T23:50:01.560946+0000","objects_scrubbed":0,"log_size":4190,"log_dups_size":0,"ondisk_log_size":4190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:45:36.299644+0000","scrub_duration":16,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":63216,"num_write_kb":796499,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"26'4864","reported_seq":4901,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:53.473460+0000","last_change":"2024-04-26T23:49:53.473508+0000","last_active":"2024-04-26T23:49:53.473460+0000","last_peered":"2024-04-26T23:49:53.473460+0000","last_clean":"2024-04-26T23:49:53.473460+0000","last_became_active":"2024-04-26T23:40:32.595625+0000","last_became_peered":"2024-04-26T23:40:32.595625+0000","last_unstale":"2024-04-26T23:49:53.473460+0000","last_undegraded":"2024-04-26T23:49:53.473460+0000","last_fullsized":"2024-04-26T23:49:53.473460+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4864","last_scrub_stamp":"2024-04-26T23:49:53.473321+0000","last_deep_scrub":"26'4864","last_deep_scrub_stamp":"2024-04-26T23:49:53.473321+0000","last_clean_scrub_stamp":"2024-04-26T23:49:53.473321+0000","objects_scrubbed":0,"log_size":4864,"log_dups_size":0,"ondisk_log_size":4864,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:22:10.859650+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":72976,"num_write_kb":927582,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"26'25","reported_seq":64,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:52.422770+0000","last_change":"2024-04-26T23:49:52.422806+0000","last_active":"2024-04-26T23:49:52.422770+0000","last_peered":"2024-04-26T23:49:52.422770+0000","last_clean":"2024-04-26T23:49:52.422770+0000","last_became_active":"2024-04-26T23:40:31.570592+0000","last_became_peered":"2024-04-26T23:40:31.570592+0000","last_unstale":"2024-04-26T23:49:52.422770+0000","last_undegraded":"2024-04-26T23:49:52.422770+0000","last_fullsized":"2024-04-26T23:49:52.422770+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'25","last_scrub_stamp":"2024-04-26T23:49:52.422657+0000","last_deep_scrub":"26'25","last_deep_scrub_stamp":"2024-04-26T23:49:52.422657+0000","last_clean_scrub_stamp":"2024-04-26T23:49:52.422657+0000","objects_scrubbed":2,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:16:21.226539+0000","scrub_duration":22,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":4104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"26'9","reported_seq":40,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:54.670078+0000","last_change":"2024-04-26T23:49:54.670107+0000","last_active":"2024-04-26T23:49:54.670078+0000","last_peered":"2024-04-26T23:49:54.670078+0000","last_clean":"2024-04-26T23:49:54.670078+0000","last_became_active":"2024-04-26T23:40:40.672816+0000","last_became_peered":"2024-04-26T23:40:40.672816+0000","last_unstale":"2024-04-26T23:49:54.670078+0000","last_undegraded":"2024-04-26T23:49:54.670078+0000","last_fullsized":"2024-04-26T23:49:54.670078+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'9","last_scrub_stamp":"2024-04-26T23:49:54.669984+0000","last_deep_scrub":"26'9","last_deep_scrub_stamp":"2024-04-26T23:49:54.669984+0000","last_clean_scrub_stamp":"2024-04-26T23:49:54.669984+0000","objects_scrubbed":1,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:38:24.817870+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"26'4537","reported_seq":4566,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:59.474466+0000","last_change":"2024-04-26T23:49:59.474492+0000","last_active":"2024-04-26T23:49:59.474466+0000","last_peered":"2024-04-26T23:49:59.474466+0000","last_clean":"2024-04-26T23:49:59.474466+0000","last_became_active":"2024-04-26T23:40:41.678039+0000","last_became_peered":"2024-04-26T23:40:41.678039+0000","last_unstale":"2024-04-26T23:49:59.474466+0000","last_undegraded":"2024-04-26T23:49:59.474466+0000","last_fullsized":"2024-04-26T23:49:59.474466+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4537","last_scrub_stamp":"2024-04-26T23:49:59.474363+0000","last_deep_scrub":"26'4537","last_deep_scrub_stamp":"2024-04-26T23:49:59.474363+0000","last_clean_scrub_stamp":"2024-04-26T23:49:59.474363+0000","objects_scrubbed":0,"log_size":4537,"log_dups_size":0,"ondisk_log_size":4537,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:45:15.264899+0000","scrub_duration":29,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":68234,"num_write_kb":870585,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"26'4022","reported_seq":4059,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:54.459466+0000","last_change":"2024-04-26T23:49:54.459494+0000","last_active":"2024-04-26T23:49:54.459466+0000","last_peered":"2024-04-26T23:49:54.459466+0000","last_clean":"2024-04-26T23:49:54.459466+0000","last_became_active":"2024-04-26T23:40:32.593235+0000","last_became_peered":"2024-04-26T23:40:32.593235+0000","last_unstale":"2024-04-26T23:49:54.459466+0000","last_undegraded":"2024-04-26T23:49:54.459466+0000","last_fullsized":"2024-04-26T23:49:54.459466+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4022","last_scrub_stamp":"2024-04-26T23:49:54.459345+0000","last_deep_scrub":"26'4022","last_deep_scrub_stamp":"2024-04-26T23:49:54.459345+0000","last_clean_scrub_stamp":"2024-04-26T23:49:54.459345+0000","objects_scrubbed":0,"log_size":4022,"log_dups_size":0,"ondisk_log_size":4022,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:27:18.978881+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":60538,"num_write_kb":762431,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"26'11","reported_seq":50,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:57.427075+0000","last_change":"2024-04-26T23:49:57.427415+0000","last_active":"2024-04-26T23:49:57.427075+0000","last_peered":"2024-04-26T23:49:57.427075+0000","last_clean":"2024-04-26T23:49:57.427075+0000","last_became_active":"2024-04-26T23:40:31.575632+0000","last_became_peered":"2024-04-26T23:40:31.575632+0000","last_unstale":"2024-04-26T23:49:57.427075+0000","last_undegraded":"2024-04-26T23:49:57.427075+0000","last_fullsized":"2024-04-26T23:49:57.427075+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'11","last_scrub_stamp":"2024-04-26T23:49:57.426975+0000","last_deep_scrub":"26'11","last_deep_scrub_stamp":"2024-04-26T23:49:57.426975+0000","last_clean_scrub_stamp":"2024-04-26T23:49:57.426975+0000","objects_scrubbed":2,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:37:58.447345+0000","scrub_duration":17,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"26'8","reported_seq":39,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:54.436962+0000","last_change":"2024-04-26T23:49:54.436993+0000","last_active":"2024-04-26T23:49:54.436962+0000","last_peered":"2024-04-26T23:49:54.436962+0000","last_clean":"2024-04-26T23:49:54.436962+0000","last_became_active":"2024-04-26T23:40:40.675888+0000","last_became_peered":"2024-04-26T23:40:40.675888+0000","last_unstale":"2024-04-26T23:49:54.436962+0000","last_undegraded":"2024-04-26T23:49:54.436962+0000","last_fullsized":"2024-04-26T23:49:54.436962+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'8","last_scrub_stamp":"2024-04-26T23:49:54.436835+0000","last_deep_scrub":"26'8","last_deep_scrub_stamp":"2024-04-26T23:49:54.436835+0000","last_clean_scrub_stamp":"2024-04-26T23:49:54.436835+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:04:49.728016+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.17","version":"26'3934","reported_seq":3954,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:45.250169+0000","last_change":"2024-04-26T23:40:41.688506+0000","last_active":"2024-04-26T23:49:45.250169+0000","last_peered":"2024-04-26T23:49:45.250169+0000","last_clean":"2024-04-26T23:49:45.250169+0000","last_became_active":"2024-04-26T23:40:41.688224+0000","last_became_peered":"2024-04-26T23:40:41.688224+0000","last_unstale":"2024-04-26T23:49:45.250169+0000","last_undegraded":"2024-04-26T23:49:45.250169+0000","last_fullsized":"2024-04-26T23:49:45.250169+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":3934,"log_dups_size":0,"ondisk_log_size":3934,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":58974,"num_write_kb":744310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"26'3924","reported_seq":3961,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:52.521654+0000","last_change":"2024-04-26T23:49:52.521654+0000","last_active":"2024-04-26T23:49:52.521654+0000","last_peered":"2024-04-26T23:49:52.521654+0000","last_clean":"2024-04-26T23:49:52.521654+0000","last_became_active":"2024-04-26T23:40:32.593220+0000","last_became_peered":"2024-04-26T23:40:32.593220+0000","last_unstale":"2024-04-26T23:49:52.521654+0000","last_undegraded":"2024-04-26T23:49:52.521654+0000","last_fullsized":"2024-04-26T23:49:52.521654+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3924","last_scrub_stamp":"2024-04-26T23:49:52.521512+0000","last_deep_scrub":"26'3924","last_deep_scrub_stamp":"2024-04-26T23:49:52.521512+0000","last_clean_scrub_stamp":"2024-04-26T23:49:52.521512+0000","objects_scrubbed":0,"log_size":3924,"log_dups_size":0,"ondisk_log_size":3924,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:45:50.996533+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":58510,"num_write_kb":806052,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"26'56","reported_seq":95,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:54.370259+0000","last_change":"2024-04-26T23:49:54.370302+0000","last_active":"2024-04-26T23:49:54.370259+0000","last_peered":"2024-04-26T23:49:54.370259+0000","last_clean":"2024-04-26T23:49:54.370259+0000","last_became_active":"2024-04-26T23:40:31.572169+0000","last_became_peered":"2024-04-26T23:40:31.572169+0000","last_unstale":"2024-04-26T23:49:54.370259+0000","last_undegraded":"2024-04-26T23:49:54.370259+0000","last_fullsized":"2024-04-26T23:49:54.370259+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'56","last_scrub_stamp":"2024-04-26T23:49:54.370156+0000","last_deep_scrub":"26'56","last_deep_scrub_stamp":"2024-04-26T23:49:54.370156+0000","last_clean_scrub_stamp":"2024-04-26T23:49:54.370156+0000","objects_scrubbed":6,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:45:33.871261+0000","scrub_duration":26,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":8207,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"26'32","reported_seq":62,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:48.759582+0000","last_change":"2024-04-26T23:49:48.759625+0000","last_active":"2024-04-26T23:49:48.759582+0000","last_peered":"2024-04-26T23:49:48.759582+0000","last_clean":"2024-04-26T23:49:48.759582+0000","last_became_active":"2024-04-26T23:40:40.671875+0000","last_became_peered":"2024-04-26T23:40:40.671875+0000","last_unstale":"2024-04-26T23:49:48.759582+0000","last_undegraded":"2024-04-26T23:49:48.759582+0000","last_fullsized":"2024-04-26T23:49:48.759582+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'32","last_scrub_stamp":"2024-04-26T23:49:48.759477+0000","last_deep_scrub":"26'32","last_deep_scrub_stamp":"2024-04-26T23:49:48.759477+0000","last_clean_scrub_stamp":"2024-04-26T23:49:48.759477+0000","objects_scrubbed":1,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:16:17.563359+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":4110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"26'4518","reported_seq":4538,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:45.296261+0000","last_change":"2024-04-26T23:40:41.688445+0000","last_active":"2024-04-26T23:49:45.296261+0000","last_peered":"2024-04-26T23:49:45.296261+0000","last_clean":"2024-04-26T23:49:45.296261+0000","last_became_active":"2024-04-26T23:40:41.688053+0000","last_became_peered":"2024-04-26T23:40:41.688053+0000","last_unstale":"2024-04-26T23:49:45.296261+0000","last_undegraded":"2024-04-26T23:49:45.296261+0000","last_fullsized":"2024-04-26T23:49:45.296261+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":4518,"log_dups_size":0,"ondisk_log_size":4518,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":67755,"num_write_kb":851157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"26'4530","reported_seq":4567,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:54.797355+0000","last_change":"2024-04-26T23:49:54.797380+0000","last_active":"2024-04-26T23:49:54.797355+0000","last_peered":"2024-04-26T23:49:54.797355+0000","last_clean":"2024-04-26T23:49:54.797355+0000","last_became_active":"2024-04-26T23:40:32.585809+0000","last_became_peered":"2024-04-26T23:40:32.585809+0000","last_unstale":"2024-04-26T23:49:54.797355+0000","last_undegraded":"2024-04-26T23:49:54.797355+0000","last_fullsized":"2024-04-26T23:49:54.797355+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4530","last_scrub_stamp":"2024-04-26T23:49:54.797250+0000","last_deep_scrub":"26'4530","last_deep_scrub_stamp":"2024-04-26T23:49:54.797250+0000","last_clean_scrub_stamp":"2024-04-26T23:49:54.797250+0000","objects_scrubbed":0,"log_size":4530,"log_dups_size":0,"ondisk_log_size":4530,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:45:34.298354+0000","scrub_duration":25,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":67909,"num_write_kb":843744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"26'6","reported_seq":45,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:56.723118+0000","last_change":"2024-04-26T23:49:56.723118+0000","last_active":"2024-04-26T23:49:56.723118+0000","last_peered":"2024-04-26T23:49:56.723118+0000","last_clean":"2024-04-26T23:49:56.723118+0000","last_became_active":"2024-04-26T23:40:31.568598+0000","last_became_peered":"2024-04-26T23:40:31.568598+0000","last_unstale":"2024-04-26T23:49:56.723118+0000","last_undegraded":"2024-04-26T23:49:56.723118+0000","last_fullsized":"2024-04-26T23:49:56.723118+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'6","last_scrub_stamp":"2024-04-26T23:49:56.722963+0000","last_deep_scrub":"26'6","last_deep_scrub_stamp":"2024-04-26T23:49:56.722963+0000","last_clean_scrub_stamp":"2024-04-26T23:49:56.722963+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:01:44.778675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"26'2","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:50.255021+0000","last_change":"2024-04-26T23:49:50.255046+0000","last_active":"2024-04-26T23:49:50.255021+0000","last_peered":"2024-04-26T23:49:50.255021+0000","last_clean":"2024-04-26T23:49:50.255021+0000","last_became_active":"2024-04-26T23:40:40.673704+0000","last_became_peered":"2024-04-26T23:40:40.673704+0000","last_unstale":"2024-04-26T23:49:50.255021+0000","last_undegraded":"2024-04-26T23:49:50.255021+0000","last_fullsized":"2024-04-26T23:49:50.255021+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2","last_scrub_stamp":"2024-04-26T23:49:50.254917+0000","last_deep_scrub":"26'2","last_deep_scrub_stamp":"2024-04-26T23:49:50.254917+0000","last_clean_scrub_stamp":"2024-04-26T23:49:50.254917+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:22:07.641246+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"26'4215","reported_seq":4235,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:45.286262+0000","last_change":"2024-04-26T23:40:41.691441+0000","last_active":"2024-04-26T23:49:45.286262+0000","last_peered":"2024-04-26T23:49:45.286262+0000","last_clean":"2024-04-26T23:49:45.286262+0000","last_became_active":"2024-04-26T23:40:41.691160+0000","last_became_peered":"2024-04-26T23:40:41.691160+0000","last_unstale":"2024-04-26T23:49:45.286262+0000","last_undegraded":"2024-04-26T23:49:45.286262+0000","last_fullsized":"2024-04-26T23:49:45.286262+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":4215,"log_dups_size":0,"ondisk_log_size":4215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":63478,"num_write_kb":811778,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"26'4684","reported_seq":4721,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:51.564872+0000","last_change":"2024-04-26T23:49:51.564872+0000","last_active":"2024-04-26T23:49:51.564872+0000","last_peered":"2024-04-26T23:49:51.564872+0000","last_clean":"2024-04-26T23:49:51.564872+0000","last_became_active":"2024-04-26T23:40:32.595032+0000","last_became_peered":"2024-04-26T23:40:32.595032+0000","last_unstale":"2024-04-26T23:49:51.564872+0000","last_undegraded":"2024-04-26T23:49:51.564872+0000","last_fullsized":"2024-04-26T23:49:51.564872+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4684","last_scrub_stamp":"2024-04-26T23:49:51.564727+0000","last_deep_scrub":"26'4684","last_deep_scrub_stamp":"2024-04-26T23:49:51.564727+0000","last_clean_scrub_stamp":"2024-04-26T23:49:51.564727+0000","objects_scrubbed":0,"log_size":4684,"log_dups_size":0,"ondisk_log_size":4684,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:45:07.355262+0000","scrub_duration":16,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":70001,"num_write_kb":901416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"26'5","reported_seq":44,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:50:05.643628+0000","last_change":"2024-04-26T23:50:05.643655+0000","last_active":"2024-04-26T23:50:05.643628+0000","last_peered":"2024-04-26T23:50:05.643628+0000","last_clean":"2024-04-26T23:50:05.643628+0000","last_became_active":"2024-04-26T23:40:31.575039+0000","last_became_peered":"2024-04-26T23:40:31.575039+0000","last_unstale":"2024-04-26T23:50:05.643628+0000","last_undegraded":"2024-04-26T23:50:05.643628+0000","last_fullsized":"2024-04-26T23:50:05.643628+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5","last_scrub_stamp":"2024-04-26T23:50:05.643520+0000","last_deep_scrub":"26'5","last_deep_scrub_stamp":"2024-04-26T23:50:05.643520+0000","last_clean_scrub_stamp":"2024-04-26T23:50:05.643520+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:37:34.502177+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"26'250","reported_seq":281,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:57.201931+0000","last_change":"2024-04-26T23:49:57.201931+0000","last_active":"2024-04-26T23:49:57.201931+0000","last_peered":"2024-04-26T23:49:57.201931+0000","last_clean":"2024-04-26T23:49:57.201931+0000","last_became_active":"2024-04-26T23:40:40.676124+0000","last_became_peered":"2024-04-26T23:40:40.676124+0000","last_unstale":"2024-04-26T23:49:57.201931+0000","last_undegraded":"2024-04-26T23:49:57.201931+0000","last_fullsized":"2024-04-26T23:49:57.201931+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'250","last_scrub_stamp":"2024-04-26T23:49:57.201801+0000","last_deep_scrub":"26'250","last_deep_scrub_stamp":"2024-04-26T23:49:57.201801+0000","last_clean_scrub_stamp":"2024-04-26T23:49:57.201801+0000","objects_scrubbed":6,"log_size":250,"log_dups_size":0,"ondisk_log_size":250,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:33:43.884787+0000","scrub_duration":37,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583584,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":239,"num_write_kb":12458,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"26'6179","reported_seq":6200,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:49.674526+0000","last_change":"2024-04-26T23:40:41.680735+0000","last_active":"2024-04-26T23:49:49.674526+0000","last_peered":"2024-04-26T23:49:49.674526+0000","last_clean":"2024-04-26T23:49:49.674526+0000","last_became_active":"2024-04-26T23:40:41.680485+0000","last_became_peered":"2024-04-26T23:40:41.680485+0000","last_unstale":"2024-04-26T23:49:49.674526+0000","last_undegraded":"2024-04-26T23:49:49.674526+0000","last_fullsized":"2024-04-26T23:49:49.674526+0000","mapping_epoch":22,"log_start":"26'1000","ondisk_log_start":"26'1000","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":5179,"log_dups_size":0,"ondisk_log_size":5179,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":93116,"num_write_kb":1152811,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"26'3934","reported_seq":3971,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:57.742765+0000","last_change":"2024-04-26T23:49:57.742765+0000","last_active":"2024-04-26T23:49:57.742765+0000","last_peered":"2024-04-26T23:49:57.742765+0000","last_clean":"2024-04-26T23:49:57.742765+0000","last_became_active":"2024-04-26T23:40:32.589452+0000","last_became_peered":"2024-04-26T23:40:32.589452+0000","last_unstale":"2024-04-26T23:49:57.742765+0000","last_undegraded":"2024-04-26T23:49:57.742765+0000","last_fullsized":"2024-04-26T23:49:57.742765+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3934","last_scrub_stamp":"2024-04-26T23:49:57.742585+0000","last_deep_scrub":"26'3934","last_deep_scrub_stamp":"2024-04-26T23:49:57.742585+0000","last_clean_scrub_stamp":"2024-04-26T23:49:57.742585+0000","objects_scrubbed":0,"log_size":3934,"log_dups_size":0,"ondisk_log_size":3934,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:38:46.985051+0000","scrub_duration":25,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":58864,"num_write_kb":755351,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"26'31","reported_seq":70,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:52.757879+0000","last_change":"2024-04-26T23:49:52.757879+0000","last_active":"2024-04-26T23:49:52.757879+0000","last_peered":"2024-04-26T23:49:52.757879+0000","last_clean":"2024-04-26T23:49:52.757879+0000","last_became_active":"2024-04-26T23:40:31.573668+0000","last_became_peered":"2024-04-26T23:40:31.573668+0000","last_unstale":"2024-04-26T23:49:52.757879+0000","last_undegraded":"2024-04-26T23:49:52.757879+0000","last_fullsized":"2024-04-26T23:49:52.757879+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'31","last_scrub_stamp":"2024-04-26T23:49:52.757694+0000","last_deep_scrub":"26'31","last_deep_scrub_stamp":"2024-04-26T23:49:52.757694+0000","last_clean_scrub_stamp":"2024-04-26T23:49:52.757694+0000","objects_scrubbed":4,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:01:40.813406+0000","scrub_duration":20,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":8209,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"26'29","reported_seq":59,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:56.664632+0000","last_change":"2024-04-26T23:49:56.664697+0000","last_active":"2024-04-26T23:49:56.664632+0000","last_peered":"2024-04-26T23:49:56.664632+0000","last_clean":"2024-04-26T23:49:56.664632+0000","last_became_active":"2024-04-26T23:40:40.676147+0000","last_became_peered":"2024-04-26T23:40:40.676147+0000","last_unstale":"2024-04-26T23:49:56.664632+0000","last_undegraded":"2024-04-26T23:49:56.664632+0000","last_fullsized":"2024-04-26T23:49:56.664632+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'29","last_scrub_stamp":"2024-04-26T23:49:56.664539+0000","last_deep_scrub":"26'29","last_deep_scrub_stamp":"2024-04-26T23:49:56.664539+0000","last_clean_scrub_stamp":"2024-04-26T23:49:56.664539+0000","objects_scrubbed":3,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:47:21.306973+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194394,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":4110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.13","version":"26'4994","reported_seq":5015,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:49.674590+0000","last_change":"2024-04-26T23:40:41.685829+0000","last_active":"2024-04-26T23:49:49.674590+0000","last_peered":"2024-04-26T23:49:49.674590+0000","last_clean":"2024-04-26T23:49:49.674590+0000","last_became_active":"2024-04-26T23:40:41.685403+0000","last_became_peered":"2024-04-26T23:40:41.685403+0000","last_unstale":"2024-04-26T23:49:49.674590+0000","last_undegraded":"2024-04-26T23:49:49.674590+0000","last_fullsized":"2024-04-26T23:49:49.674590+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":4994,"log_dups_size":0,"ondisk_log_size":4994,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":74752,"num_write_kb":961504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"26'3907","reported_seq":3936,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:51.426737+0000","last_change":"2024-04-26T23:40:32.587513+0000","last_active":"2024-04-26T23:49:51.426737+0000","last_peered":"2024-04-26T23:49:51.426737+0000","last_clean":"2024-04-26T23:49:51.426737+0000","last_became_active":"2024-04-26T23:40:32.587200+0000","last_became_peered":"2024-04-26T23:40:32.587200+0000","last_unstale":"2024-04-26T23:49:51.426737+0000","last_undegraded":"2024-04-26T23:49:51.426737+0000","last_fullsized":"2024-04-26T23:49:51.426737+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":3907,"log_dups_size":0,"ondisk_log_size":3907,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":58714,"num_write_kb":750642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"26'245","reported_seq":284,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:57.783049+0000","last_change":"2024-04-26T23:49:57.783049+0000","last_active":"2024-04-26T23:49:57.783049+0000","last_peered":"2024-04-26T23:49:57.783049+0000","last_clean":"2024-04-26T23:49:57.783049+0000","last_became_active":"2024-04-26T23:40:31.572074+0000","last_became_peered":"2024-04-26T23:40:31.572074+0000","last_unstale":"2024-04-26T23:49:57.783049+0000","last_undegraded":"2024-04-26T23:49:57.783049+0000","last_fullsized":"2024-04-26T23:49:57.783049+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'245","last_scrub_stamp":"2024-04-26T23:49:57.782886+0000","last_deep_scrub":"26'245","last_deep_scrub_stamp":"2024-04-26T23:49:57.782886+0000","last_clean_scrub_stamp":"2024-04-26T23:49:57.782886+0000","objects_scrubbed":6,"log_size":245,"log_dups_size":0,"ondisk_log_size":245,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:18:02.032656+0000","scrub_duration":28,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583584,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":234,"num_write_kb":12453,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"26'5","reported_seq":36,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:52.117618+0000","last_change":"2024-04-26T23:49:52.117618+0000","last_active":"2024-04-26T23:49:52.117618+0000","last_peered":"2024-04-26T23:49:52.117618+0000","last_clean":"2024-04-26T23:49:52.117618+0000","last_became_active":"2024-04-26T23:40:40.677714+0000","last_became_peered":"2024-04-26T23:40:40.677714+0000","last_unstale":"2024-04-26T23:49:52.117618+0000","last_undegraded":"2024-04-26T23:49:52.117618+0000","last_fullsized":"2024-04-26T23:49:52.117618+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5","last_scrub_stamp":"2024-04-26T23:49:52.117499+0000","last_deep_scrub":"26'5","last_deep_scrub_stamp":"2024-04-26T23:49:52.117499+0000","last_clean_scrub_stamp":"2024-04-26T23:49:52.117499+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:47:02.813805+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"26'4195","reported_seq":4224,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:50:06.281794+0000","last_change":"2024-04-26T23:50:06.281822+0000","last_active":"2024-04-26T23:50:06.281794+0000","last_peered":"2024-04-26T23:50:06.281794+0000","last_clean":"2024-04-26T23:50:06.281794+0000","last_became_active":"2024-04-26T23:40:41.685147+0000","last_became_peered":"2024-04-26T23:40:41.685147+0000","last_unstale":"2024-04-26T23:50:06.281794+0000","last_undegraded":"2024-04-26T23:50:06.281794+0000","last_fullsized":"2024-04-26T23:50:06.281794+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4195","last_scrub_stamp":"2024-04-26T23:50:06.281683+0000","last_deep_scrub":"26'4195","last_deep_scrub_stamp":"2024-04-26T23:50:06.281683+0000","last_clean_scrub_stamp":"2024-04-26T23:50:06.281683+0000","objects_scrubbed":0,"log_size":4195,"log_dups_size":0,"ondisk_log_size":4195,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:30:40.579686+0000","scrub_duration":41,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":62805,"num_write_kb":801211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"26'5530","reported_seq":5567,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:50:01.413084+0000","last_change":"2024-04-26T23:50:01.413084+0000","last_active":"2024-04-26T23:50:01.413084+0000","last_peered":"2024-04-26T23:50:01.413084+0000","last_clean":"2024-04-26T23:50:01.413084+0000","last_became_active":"2024-04-26T23:40:32.593030+0000","last_became_peered":"2024-04-26T23:40:32.593030+0000","last_unstale":"2024-04-26T23:50:01.413084+0000","last_undegraded":"2024-04-26T23:50:01.413084+0000","last_fullsized":"2024-04-26T23:50:01.413084+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5530","last_scrub_stamp":"2024-04-26T23:50:01.412932+0000","last_deep_scrub":"26'5530","last_deep_scrub_stamp":"2024-04-26T23:50:01.412932+0000","last_clean_scrub_stamp":"2024-04-26T23:50:01.412932+0000","objects_scrubbed":0,"log_size":5530,"log_dups_size":0,"ondisk_log_size":5530,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:05:00.364700+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":83076,"num_write_kb":1053123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"26'27","reported_seq":66,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:59.094453+0000","last_change":"2024-04-26T23:49:59.094453+0000","last_active":"2024-04-26T23:49:59.094453+0000","last_peered":"2024-04-26T23:49:59.094453+0000","last_clean":"2024-04-26T23:49:59.094453+0000","last_became_active":"2024-04-26T23:40:31.572218+0000","last_became_peered":"2024-04-26T23:40:31.572218+0000","last_unstale":"2024-04-26T23:49:59.094453+0000","last_undegraded":"2024-04-26T23:49:59.094453+0000","last_fullsized":"2024-04-26T23:49:59.094453+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'27","last_scrub_stamp":"2024-04-26T23:49:59.094310+0000","last_deep_scrub":"26'27","last_deep_scrub_stamp":"2024-04-26T23:49:59.094310+0000","last_clean_scrub_stamp":"2024-04-26T23:49:59.094310+0000","objects_scrubbed":3,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:47:23.736744+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194394,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":4108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"26'35","reported_seq":66,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:50:04.392903+0000","last_change":"2024-04-26T23:50:04.392903+0000","last_active":"2024-04-26T23:50:04.392903+0000","last_peered":"2024-04-26T23:50:04.392903+0000","last_clean":"2024-04-26T23:50:04.392903+0000","last_became_active":"2024-04-26T23:40:40.674487+0000","last_became_peered":"2024-04-26T23:40:40.674487+0000","last_unstale":"2024-04-26T23:50:04.392903+0000","last_undegraded":"2024-04-26T23:50:04.392903+0000","last_fullsized":"2024-04-26T23:50:04.392903+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'35","last_scrub_stamp":"2024-04-26T23:50:04.392751+0000","last_deep_scrub":"26'35","last_deep_scrub_stamp":"2024-04-26T23:50:04.392751+0000","last_clean_scrub_stamp":"2024-04-26T23:50:04.392751+0000","objects_scrubbed":4,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:43:08.954722+0000","scrub_duration":22,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":8207,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"26'4277","reported_seq":4306,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:50:07.730698+0000","last_change":"2024-04-26T23:50:07.730698+0000","last_active":"2024-04-26T23:50:07.730698+0000","last_peered":"2024-04-26T23:50:07.730698+0000","last_clean":"2024-04-26T23:50:07.730698+0000","last_became_active":"2024-04-26T23:40:41.686259+0000","last_became_peered":"2024-04-26T23:40:41.686259+0000","last_unstale":"2024-04-26T23:50:07.730698+0000","last_undegraded":"2024-04-26T23:50:07.730698+0000","last_fullsized":"2024-04-26T23:50:07.730698+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4277","last_scrub_stamp":"2024-04-26T23:50:07.730578+0000","last_deep_scrub":"26'4277","last_deep_scrub_stamp":"2024-04-26T23:50:07.730578+0000","last_clean_scrub_stamp":"2024-04-26T23:50:07.730578+0000","objects_scrubbed":0,"log_size":4277,"log_dups_size":0,"ondisk_log_size":4277,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:00:34.997076+0000","scrub_duration":28,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":64273,"num_write_kb":853172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"26'3697","reported_seq":3738,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:50:07.672649+0000","last_change":"2024-04-26T23:50:07.672671+0000","last_active":"2024-04-26T23:50:07.672649+0000","last_peered":"2024-04-26T23:50:07.672649+0000","last_clean":"2024-04-26T23:50:07.672649+0000","last_became_active":"2024-04-26T23:41:30.513492+0000","last_became_peered":"2024-04-26T23:41:30.513492+0000","last_unstale":"2024-04-26T23:50:07.672649+0000","last_undegraded":"2024-04-26T23:50:07.672649+0000","last_fullsized":"2024-04-26T23:50:07.672649+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3697","last_scrub_stamp":"2024-04-26T23:50:07.672563+0000","last_deep_scrub":"26'3697","last_deep_scrub_stamp":"2024-04-26T23:50:07.672563+0000","last_clean_scrub_stamp":"2024-04-26T23:50:07.672563+0000","objects_scrubbed":0,"log_size":3697,"log_dups_size":0,"ondisk_log_size":3697,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:33:31.274279+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55355,"num_write_kb":693310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"26'23","reported_seq":62,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:50:06.626741+0000","last_change":"2024-04-26T23:50:06.626741+0000","last_active":"2024-04-26T23:50:06.626741+0000","last_peered":"2024-04-26T23:50:06.626741+0000","last_clean":"2024-04-26T23:50:06.626741+0000","last_became_active":"2024-04-26T23:40:31.575211+0000","last_became_peered":"2024-04-26T23:40:31.575211+0000","last_unstale":"2024-04-26T23:50:06.626741+0000","last_undegraded":"2024-04-26T23:50:06.626741+0000","last_fullsized":"2024-04-26T23:50:06.626741+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'23","last_scrub_stamp":"2024-04-26T23:50:06.626580+0000","last_deep_scrub":"26'23","last_deep_scrub_stamp":"2024-04-26T23:50:06.626580+0000","last_clean_scrub_stamp":"2024-04-26T23:50:06.626580+0000","objects_scrubbed":1,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:46:10.782838+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":4104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"26'44","reported_seq":75,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:55.230212+0000","last_change":"2024-04-26T23:49:55.230212+0000","last_active":"2024-04-26T23:49:55.230212+0000","last_peered":"2024-04-26T23:49:55.230212+0000","last_clean":"2024-04-26T23:49:55.230212+0000","last_became_active":"2024-04-26T23:40:40.675459+0000","last_became_peered":"2024-04-26T23:40:40.675459+0000","last_unstale":"2024-04-26T23:49:55.230212+0000","last_undegraded":"2024-04-26T23:49:55.230212+0000","last_fullsized":"2024-04-26T23:49:55.230212+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'44","last_scrub_stamp":"2024-04-26T23:49:55.230087+0000","last_deep_scrub":"26'44","last_deep_scrub_stamp":"2024-04-26T23:49:55.230087+0000","last_clean_scrub_stamp":"2024-04-26T23:49:55.230087+0000","objects_scrubbed":6,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:47:19.872521+0000","scrub_duration":25,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36,"num_write_kb":8203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"26'4899","reported_seq":4920,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:51.426930+0000","last_change":"2024-04-26T23:40:41.687488+0000","last_active":"2024-04-26T23:49:51.426930+0000","last_peered":"2024-04-26T23:49:51.426930+0000","last_clean":"2024-04-26T23:49:51.426930+0000","last_became_active":"2024-04-26T23:40:41.687210+0000","last_became_peered":"2024-04-26T23:40:41.687210+0000","last_unstale":"2024-04-26T23:49:51.426930+0000","last_undegraded":"2024-04-26T23:49:51.426930+0000","last_fullsized":"2024-04-26T23:49:51.426930+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":4899,"log_dups_size":0,"ondisk_log_size":4899,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":73846,"num_write_kb":901080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"26'4194","reported_seq":4216,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:50:06.428414+0000","last_change":"2024-04-26T23:50:06.428448+0000","last_active":"2024-04-26T23:50:06.428414+0000","last_peered":"2024-04-26T23:50:06.428414+0000","last_clean":"2024-04-26T23:50:06.428414+0000","last_became_active":"2024-04-26T23:41:30.751285+0000","last_became_peered":"2024-04-26T23:41:30.751285+0000","last_unstale":"2024-04-26T23:50:06.428414+0000","last_undegraded":"2024-04-26T23:50:06.428414+0000","last_fullsized":"2024-04-26T23:50:06.428414+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4194","last_scrub_stamp":"2024-04-26T23:50:06.428283+0000","last_deep_scrub":"26'4194","last_deep_scrub_stamp":"2024-04-26T23:50:06.428283+0000","last_clean_scrub_stamp":"2024-04-26T23:50:06.428283+0000","objects_scrubbed":0,"log_size":4194,"log_dups_size":0,"ondisk_log_size":4194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:24:25.817915+0000","scrub_duration":16,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":63007,"num_write_kb":791881,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"26'2","reported_seq":40,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:59.725096+0000","last_change":"2024-04-26T23:49:59.725122+0000","last_active":"2024-04-26T23:49:59.725096+0000","last_peered":"2024-04-26T23:49:59.725096+0000","last_clean":"2024-04-26T23:49:59.725096+0000","last_became_active":"2024-04-26T23:40:31.573164+0000","last_became_peered":"2024-04-26T23:40:31.573164+0000","last_unstale":"2024-04-26T23:49:59.725096+0000","last_undegraded":"2024-04-26T23:49:59.725096+0000","last_fullsized":"2024-04-26T23:49:59.725096+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2","last_scrub_stamp":"2024-04-26T23:49:59.724973+0000","last_deep_scrub":"26'2","last_deep_scrub_stamp":"2024-04-26T23:49:59.724973+0000","last_clean_scrub_stamp":"2024-04-26T23:49:59.724973+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:45:15.515508+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"26'6","reported_seq":37,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:51.231450+0000","last_change":"2024-04-26T23:49:51.231450+0000","last_active":"2024-04-26T23:49:51.231450+0000","last_peered":"2024-04-26T23:49:51.231450+0000","last_clean":"2024-04-26T23:49:51.231450+0000","last_became_active":"2024-04-26T23:40:40.673793+0000","last_became_peered":"2024-04-26T23:40:40.673793+0000","last_unstale":"2024-04-26T23:49:51.231450+0000","last_undegraded":"2024-04-26T23:49:51.231450+0000","last_fullsized":"2024-04-26T23:49:51.231450+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'6","last_scrub_stamp":"2024-04-26T23:49:51.231353+0000","last_deep_scrub":"26'6","last_deep_scrub_stamp":"2024-04-26T23:49:51.231353+0000","last_clean_scrub_stamp":"2024-04-26T23:49:51.231353+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:27:15.750889+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"26'5252","reported_seq":5273,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:45.248538+0000","last_change":"2024-04-26T23:40:41.686867+0000","last_active":"2024-04-26T23:49:45.248538+0000","last_peered":"2024-04-26T23:49:45.248538+0000","last_clean":"2024-04-26T23:49:45.248538+0000","last_became_active":"2024-04-26T23:40:41.686536+0000","last_became_peered":"2024-04-26T23:40:41.686536+0000","last_unstale":"2024-04-26T23:49:45.248538+0000","last_undegraded":"2024-04-26T23:49:45.248538+0000","last_fullsized":"2024-04-26T23:49:45.248538+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":5252,"log_dups_size":0,"ondisk_log_size":5252,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":78945,"num_write_kb":1046825,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"26'14","reported_seq":45,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:50.729610+0000","last_change":"2024-04-26T23:49:50.729657+0000","last_active":"2024-04-26T23:49:50.729610+0000","last_peered":"2024-04-26T23:49:50.729610+0000","last_clean":"2024-04-26T23:49:50.729610+0000","last_became_active":"2024-04-26T23:40:40.674639+0000","last_became_peered":"2024-04-26T23:40:40.674639+0000","last_unstale":"2024-04-26T23:49:50.729610+0000","last_undegraded":"2024-04-26T23:49:50.729610+0000","last_fullsized":"2024-04-26T23:49:50.729610+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'14","last_scrub_stamp":"2024-04-26T23:49:50.729509+0000","last_deep_scrub":"26'14","last_deep_scrub_stamp":"2024-04-26T23:49:50.729509+0000","last_clean_scrub_stamp":"2024-04-26T23:49:50.729509+0000","objects_scrubbed":1,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:45:30.230613+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":4106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"26'4888","reported_seq":4924,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:57.127169+0000","last_change":"2024-04-26T23:49:57.127212+0000","last_active":"2024-04-26T23:49:57.127169+0000","last_peered":"2024-04-26T23:49:57.127169+0000","last_clean":"2024-04-26T23:49:57.127169+0000","last_became_active":"2024-04-26T23:40:32.582751+0000","last_became_peered":"2024-04-26T23:40:32.582751+0000","last_unstale":"2024-04-26T23:49:57.127169+0000","last_undegraded":"2024-04-26T23:49:57.127169+0000","last_fullsized":"2024-04-26T23:49:57.127169+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4888","last_scrub_stamp":"2024-04-26T23:49:57.127049+0000","last_deep_scrub":"26'4888","last_deep_scrub_stamp":"2024-04-26T23:49:57.127049+0000","last_clean_scrub_stamp":"2024-04-26T23:49:57.127049+0000","objects_scrubbed":0,"log_size":4888,"log_dups_size":0,"ondisk_log_size":4888,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:19:17.141317+0000","scrub_duration":20,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":73256,"num_write_kb":928290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"26'29","reported_seq":67,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:50:03.616088+0000","last_change":"2024-04-26T23:50:03.616152+0000","last_active":"2024-04-26T23:50:03.616088+0000","last_peered":"2024-04-26T23:50:03.616088+0000","last_clean":"2024-04-26T23:50:03.616088+0000","last_became_active":"2024-04-26T23:40:31.572111+0000","last_became_peered":"2024-04-26T23:40:31.572111+0000","last_unstale":"2024-04-26T23:50:03.616088+0000","last_undegraded":"2024-04-26T23:50:03.616088+0000","last_fullsized":"2024-04-26T23:50:03.616088+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'29","last_scrub_stamp":"2024-04-26T23:50:03.615978+0000","last_deep_scrub":"26'29","last_deep_scrub_stamp":"2024-04-26T23:50:03.615978+0000","last_clean_scrub_stamp":"2024-04-26T23:50:03.615978+0000","objects_scrubbed":2,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:07:13.243878+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":8213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"26'4754","reported_seq":4783,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:50:03.668074+0000","last_change":"2024-04-26T23:50:03.668101+0000","last_active":"2024-04-26T23:50:03.668074+0000","last_peered":"2024-04-26T23:50:03.668074+0000","last_clean":"2024-04-26T23:50:03.668074+0000","last_became_active":"2024-04-26T23:40:41.684207+0000","last_became_peered":"2024-04-26T23:40:41.684207+0000","last_unstale":"2024-04-26T23:50:03.668074+0000","last_undegraded":"2024-04-26T23:50:03.668074+0000","last_fullsized":"2024-04-26T23:50:03.668074+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4754","last_scrub_stamp":"2024-04-26T23:50:03.667957+0000","last_deep_scrub":"26'4754","last_deep_scrub_stamp":"2024-04-26T23:50:03.667957+0000","last_clean_scrub_stamp":"2024-04-26T23:50:03.667957+0000","objects_scrubbed":0,"log_size":4754,"log_dups_size":0,"ondisk_log_size":4754,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:24:23.057589+0000","scrub_duration":20,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":71582,"num_write_kb":928660,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"26'148","reported_seq":179,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:50:04.799728+0000","last_change":"2024-04-26T23:50:04.799763+0000","last_active":"2024-04-26T23:50:04.799728+0000","last_peered":"2024-04-26T23:50:04.799728+0000","last_clean":"2024-04-26T23:50:04.799728+0000","last_became_active":"2024-04-26T23:40:40.674628+0000","last_became_peered":"2024-04-26T23:40:40.674628+0000","last_unstale":"2024-04-26T23:50:04.799728+0000","last_undegraded":"2024-04-26T23:50:04.799728+0000","last_fullsized":"2024-04-26T23:50:04.799728+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'148","last_scrub_stamp":"2024-04-26T23:50:04.799609+0000","last_deep_scrub":"26'148","last_deep_scrub_stamp":"2024-04-26T23:50:04.799609+0000","last_clean_scrub_stamp":"2024-04-26T23:50:04.799609+0000","objects_scrubbed":4,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:38:34.947495+0000","scrub_duration":29,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7745351,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":142,"num_write_kb":7622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"26'4156","reported_seq":4184,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.923364+0000","last_change":"2024-04-26T23:40:32.586204+0000","last_active":"2024-04-26T23:49:42.923364+0000","last_peered":"2024-04-26T23:49:42.923364+0000","last_clean":"2024-04-26T23:49:42.923364+0000","last_became_active":"2024-04-26T23:40:32.585725+0000","last_became_peered":"2024-04-26T23:40:32.585725+0000","last_unstale":"2024-04-26T23:49:42.923364+0000","last_undegraded":"2024-04-26T23:49:42.923364+0000","last_fullsized":"2024-04-26T23:49:42.923364+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":4156,"log_dups_size":0,"ondisk_log_size":4156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":62294,"num_write_kb":802311,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"26'21","reported_seq":59,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:50:07.271562+0000","last_change":"2024-04-26T23:50:07.271620+0000","last_active":"2024-04-26T23:50:07.271562+0000","last_peered":"2024-04-26T23:50:07.271562+0000","last_clean":"2024-04-26T23:50:07.271562+0000","last_became_active":"2024-04-26T23:40:31.578623+0000","last_became_peered":"2024-04-26T23:40:31.578623+0000","last_unstale":"2024-04-26T23:50:07.271562+0000","last_undegraded":"2024-04-26T23:50:07.271562+0000","last_fullsized":"2024-04-26T23:50:07.271562+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'21","last_scrub_stamp":"2024-04-26T23:50:07.271479+0000","last_deep_scrub":"26'21","last_deep_scrub_stamp":"2024-04-26T23:50:07.271479+0000","last_clean_scrub_stamp":"2024-04-26T23:50:07.271479+0000","objects_scrubbed":1,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:29:56.825879+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":4105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"26'5418","reported_seq":5438,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:45.325695+0000","last_change":"2024-04-26T23:40:41.689697+0000","last_active":"2024-04-26T23:49:45.325695+0000","last_peered":"2024-04-26T23:49:45.325695+0000","last_clean":"2024-04-26T23:49:45.325695+0000","last_became_active":"2024-04-26T23:40:41.688428+0000","last_became_peered":"2024-04-26T23:40:41.688428+0000","last_unstale":"2024-04-26T23:49:45.325695+0000","last_undegraded":"2024-04-26T23:49:45.325695+0000","last_fullsized":"2024-04-26T23:49:45.325695+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":5418,"log_dups_size":0,"ondisk_log_size":5418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":81566,"num_write_kb":1040251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1a","version":"26'36","reported_seq":74,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:55.800841+0000","last_change":"2024-04-26T23:49:55.800871+0000","last_active":"2024-04-26T23:49:55.800841+0000","last_peered":"2024-04-26T23:49:55.800841+0000","last_clean":"2024-04-26T23:49:55.800841+0000","last_became_active":"2024-04-26T23:40:31.567484+0000","last_became_peered":"2024-04-26T23:40:31.567484+0000","last_unstale":"2024-04-26T23:49:55.800841+0000","last_undegraded":"2024-04-26T23:49:55.800841+0000","last_fullsized":"2024-04-26T23:49:55.800841+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'36","last_scrub_stamp":"2024-04-26T23:49:55.800751+0000","last_deep_scrub":"26'36","last_deep_scrub_stamp":"2024-04-26T23:49:55.800751+0000","last_clean_scrub_stamp":"2024-04-26T23:49:55.800751+0000","objects_scrubbed":3,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:50:52.340698+0000","scrub_duration":30,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":12305,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"26'3282","reported_seq":3318,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:51.719257+0000","last_change":"2024-04-26T23:49:51.719279+0000","last_active":"2024-04-26T23:49:51.719257+0000","last_peered":"2024-04-26T23:49:51.719257+0000","last_clean":"2024-04-26T23:49:51.719257+0000","last_became_active":"2024-04-26T23:40:32.592365+0000","last_became_peered":"2024-04-26T23:40:32.592365+0000","last_unstale":"2024-04-26T23:49:51.719257+0000","last_undegraded":"2024-04-26T23:49:51.719257+0000","last_fullsized":"2024-04-26T23:49:51.719257+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3282","last_scrub_stamp":"2024-04-26T23:49:51.719172+0000","last_deep_scrub":"26'3282","last_deep_scrub_stamp":"2024-04-26T23:49:51.719172+0000","last_clean_scrub_stamp":"2024-04-26T23:49:51.719172+0000","objects_scrubbed":0,"log_size":3282,"log_dups_size":0,"ondisk_log_size":3282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:50:48.259119+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49199,"num_write_kb":619171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"26'16","reported_seq":46,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:57.465757+0000","last_change":"2024-04-26T23:49:57.465791+0000","last_active":"2024-04-26T23:49:57.465757+0000","last_peered":"2024-04-26T23:49:57.465757+0000","last_clean":"2024-04-26T23:49:57.465757+0000","last_became_active":"2024-04-26T23:40:40.675736+0000","last_became_peered":"2024-04-26T23:40:40.675736+0000","last_unstale":"2024-04-26T23:49:57.465757+0000","last_undegraded":"2024-04-26T23:49:57.465757+0000","last_fullsized":"2024-04-26T23:49:57.465757+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'16","last_scrub_stamp":"2024-04-26T23:49:57.465670+0000","last_deep_scrub":"26'16","last_deep_scrub_stamp":"2024-04-26T23:49:57.465670+0000","last_clean_scrub_stamp":"2024-04-26T23:49:57.465670+0000","objects_scrubbed":2,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:02:15.307784+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":4102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"26'3303","reported_seq":3323,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:45.274938+0000","last_change":"2024-04-26T23:40:41.690148+0000","last_active":"2024-04-26T23:49:45.274938+0000","last_peered":"2024-04-26T23:49:45.274938+0000","last_clean":"2024-04-26T23:49:45.274938+0000","last_became_active":"2024-04-26T23:40:41.689765+0000","last_became_peered":"2024-04-26T23:40:41.689765+0000","last_unstale":"2024-04-26T23:49:45.274938+0000","last_undegraded":"2024-04-26T23:49:45.274938+0000","last_fullsized":"2024-04-26T23:49:45.274938+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":3303,"log_dups_size":0,"ondisk_log_size":3303,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49600,"num_write_kb":609763,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"26'1222","reported_seq":1260,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:50:05.276185+0000","last_change":"2024-04-26T23:50:05.276216+0000","last_active":"2024-04-26T23:50:05.276185+0000","last_peered":"2024-04-26T23:50:05.276185+0000","last_clean":"2024-04-26T23:50:05.276185+0000","last_became_active":"2024-04-26T23:40:31.576178+0000","last_became_peered":"2024-04-26T23:40:31.576178+0000","last_unstale":"2024-04-26T23:50:05.276185+0000","last_undegraded":"2024-04-26T23:50:05.276185+0000","last_fullsized":"2024-04-26T23:50:05.276185+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'1222","last_scrub_stamp":"2024-04-26T23:50:05.276080+0000","last_deep_scrub":"26'1222","last_deep_scrub_stamp":"2024-04-26T23:50:05.276080+0000","last_clean_scrub_stamp":"2024-04-26T23:50:05.276080+0000","objects_scrubbed":1,"log_size":1222,"log_dups_size":0,"ondisk_log_size":1222,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:46:09.432338+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1219,"num_write_kb":5208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"26'3626","reported_seq":3662,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:59.399974+0000","last_change":"2024-04-26T23:49:59.400035+0000","last_active":"2024-04-26T23:49:59.399974+0000","last_peered":"2024-04-26T23:49:59.399974+0000","last_clean":"2024-04-26T23:49:59.399974+0000","last_became_active":"2024-04-26T23:40:32.588927+0000","last_became_peered":"2024-04-26T23:40:32.588927+0000","last_unstale":"2024-04-26T23:49:59.399974+0000","last_undegraded":"2024-04-26T23:49:59.399974+0000","last_fullsized":"2024-04-26T23:49:59.399974+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3626","last_scrub_stamp":"2024-04-26T23:49:59.399848+0000","last_deep_scrub":"26'3626","last_deep_scrub_stamp":"2024-04-26T23:49:59.399848+0000","last_clean_scrub_stamp":"2024-04-26T23:49:59.399848+0000","objects_scrubbed":0,"log_size":3626,"log_dups_size":0,"ondisk_log_size":3626,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:19:19.414116+0000","scrub_duration":21,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":54465,"num_write_kb":670678,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"26'36","reported_seq":66,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:59.203203+0000","last_change":"2024-04-26T23:49:59.203238+0000","last_active":"2024-04-26T23:49:59.203203+0000","last_peered":"2024-04-26T23:49:59.203203+0000","last_clean":"2024-04-26T23:49:59.203203+0000","last_became_active":"2024-04-26T23:40:40.676070+0000","last_became_peered":"2024-04-26T23:40:40.676070+0000","last_unstale":"2024-04-26T23:49:59.203203+0000","last_undegraded":"2024-04-26T23:49:59.203203+0000","last_fullsized":"2024-04-26T23:49:59.203203+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'36","last_scrub_stamp":"2024-04-26T23:49:59.203111+0000","last_deep_scrub":"26'36","last_deep_scrub_stamp":"2024-04-26T23:49:59.203111+0000","last_clean_scrub_stamp":"2024-04-26T23:49:59.203111+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:20:21.798228+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":12296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.26","version":"26'4010","reported_seq":4031,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:45.322611+0000","last_change":"2024-04-26T23:40:41.679796+0000","last_active":"2024-04-26T23:49:45.322611+0000","last_peered":"2024-04-26T23:49:45.322611+0000","last_clean":"2024-04-26T23:49:45.322611+0000","last_became_active":"2024-04-26T23:40:41.679523+0000","last_became_peered":"2024-04-26T23:40:41.679523+0000","last_unstale":"2024-04-26T23:49:45.322611+0000","last_undegraded":"2024-04-26T23:49:45.322611+0000","last_fullsized":"2024-04-26T23:49:45.322611+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":4010,"log_dups_size":0,"ondisk_log_size":4010,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":60148,"num_write_kb":773318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"26'5261","reported_seq":5298,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:50:02.806261+0000","last_change":"2024-04-26T23:50:02.806302+0000","last_active":"2024-04-26T23:50:02.806261+0000","last_peered":"2024-04-26T23:50:02.806261+0000","last_clean":"2024-04-26T23:50:02.806261+0000","last_became_active":"2024-04-26T23:40:32.586399+0000","last_became_peered":"2024-04-26T23:40:32.586399+0000","last_unstale":"2024-04-26T23:50:02.806261+0000","last_undegraded":"2024-04-26T23:50:02.806261+0000","last_fullsized":"2024-04-26T23:50:02.806261+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5261","last_scrub_stamp":"2024-04-26T23:50:02.806117+0000","last_deep_scrub":"26'5261","last_deep_scrub_stamp":"2024-04-26T23:50:02.806117+0000","last_clean_scrub_stamp":"2024-04-26T23:50:02.806117+0000","objects_scrubbed":0,"log_size":5261,"log_dups_size":0,"ondisk_log_size":5261,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:38:03.826486+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":78910,"num_write_kb":993537,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.27","version":"26'5344","reported_seq":5373,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:50:07.295026+0000","last_change":"2024-04-26T23:50:07.295050+0000","last_active":"2024-04-26T23:50:07.295026+0000","last_peered":"2024-04-26T23:50:07.295026+0000","last_clean":"2024-04-26T23:50:07.295026+0000","last_became_active":"2024-04-26T23:40:41.686974+0000","last_became_peered":"2024-04-26T23:40:41.686974+0000","last_unstale":"2024-04-26T23:50:07.295026+0000","last_undegraded":"2024-04-26T23:50:07.295026+0000","last_fullsized":"2024-04-26T23:50:07.295026+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5344","last_scrub_stamp":"2024-04-26T23:50:07.294929+0000","last_deep_scrub":"26'5344","last_deep_scrub_stamp":"2024-04-26T23:50:07.294929+0000","last_clean_scrub_stamp":"2024-04-26T23:50:07.294929+0000","objects_scrubbed":0,"log_size":5344,"log_dups_size":0,"ondisk_log_size":5344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:07:16.922829+0000","scrub_duration":17,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":80446,"num_write_kb":1002267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"26'4431","reported_seq":4468,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:56.443586+0000","last_change":"2024-04-26T23:49:56.443613+0000","last_active":"2024-04-26T23:49:56.443586+0000","last_peered":"2024-04-26T23:49:56.443586+0000","last_clean":"2024-04-26T23:49:56.443586+0000","last_became_active":"2024-04-26T23:40:32.584234+0000","last_became_peered":"2024-04-26T23:40:32.584234+0000","last_unstale":"2024-04-26T23:49:56.443586+0000","last_undegraded":"2024-04-26T23:49:56.443586+0000","last_fullsized":"2024-04-26T23:49:56.443586+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4431","last_scrub_stamp":"2024-04-26T23:49:56.443483+0000","last_deep_scrub":"26'4431","last_deep_scrub_stamp":"2024-04-26T23:49:56.443483+0000","last_clean_scrub_stamp":"2024-04-26T23:49:56.443483+0000","objects_scrubbed":0,"log_size":4431,"log_dups_size":0,"ondisk_log_size":4431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:27:14.476629+0000","scrub_duration":16,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":66416,"num_write_kb":857324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.24","version":"26'4132","reported_seq":4161,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:50:00.579416+0000","last_change":"2024-04-26T23:50:00.579467+0000","last_active":"2024-04-26T23:50:00.579416+0000","last_peered":"2024-04-26T23:50:00.579416+0000","last_clean":"2024-04-26T23:50:00.579416+0000","last_became_active":"2024-04-26T23:40:41.679254+0000","last_became_peered":"2024-04-26T23:40:41.679254+0000","last_unstale":"2024-04-26T23:50:00.579416+0000","last_undegraded":"2024-04-26T23:50:00.579416+0000","last_fullsized":"2024-04-26T23:50:00.579416+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4132","last_scrub_stamp":"2024-04-26T23:50:00.579322+0000","last_deep_scrub":"26'4132","last_deep_scrub_stamp":"2024-04-26T23:50:00.579322+0000","last_clean_scrub_stamp":"2024-04-26T23:50:00.579322+0000","objects_scrubbed":0,"log_size":4132,"log_dups_size":0,"ondisk_log_size":4132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:57:53.160154+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":62260,"num_write_kb":792966,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"26'5020","reported_seq":5057,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:50:07.636352+0000","last_change":"2024-04-26T23:50:07.636394+0000","last_active":"2024-04-26T23:50:07.636352+0000","last_peered":"2024-04-26T23:50:07.636352+0000","last_clean":"2024-04-26T23:50:07.636352+0000","last_became_active":"2024-04-26T23:40:32.580196+0000","last_became_peered":"2024-04-26T23:40:32.580196+0000","last_unstale":"2024-04-26T23:50:07.636352+0000","last_undegraded":"2024-04-26T23:50:07.636352+0000","last_fullsized":"2024-04-26T23:50:07.636352+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5020","last_scrub_stamp":"2024-04-26T23:50:07.636218+0000","last_deep_scrub":"26'5020","last_deep_scrub_stamp":"2024-04-26T23:50:07.636218+0000","last_clean_scrub_stamp":"2024-04-26T23:50:07.636218+0000","objects_scrubbed":0,"log_size":5020,"log_dups_size":0,"ondisk_log_size":5020,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:02:51.040367+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":75519,"num_write_kb":963103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.25","version":"26'4764","reported_seq":4785,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:45.316226+0000","last_change":"2024-04-26T23:40:41.690579+0000","last_active":"2024-04-26T23:49:45.316226+0000","last_peered":"2024-04-26T23:49:45.316226+0000","last_clean":"2024-04-26T23:49:45.316226+0000","last_became_active":"2024-04-26T23:40:41.690262+0000","last_became_peered":"2024-04-26T23:40:41.690262+0000","last_unstale":"2024-04-26T23:49:45.316226+0000","last_undegraded":"2024-04-26T23:49:45.316226+0000","last_fullsized":"2024-04-26T23:49:45.316226+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":4764,"log_dups_size":0,"ondisk_log_size":4764,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":71706,"num_write_kb":928511,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"26'3562","reported_seq":3604,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:50:06.697678+0000","last_change":"2024-04-26T23:50:06.697702+0000","last_active":"2024-04-26T23:50:06.697678+0000","last_peered":"2024-04-26T23:50:06.697678+0000","last_clean":"2024-04-26T23:50:06.697678+0000","last_became_active":"2024-04-26T23:41:30.513571+0000","last_became_peered":"2024-04-26T23:41:30.513571+0000","last_unstale":"2024-04-26T23:50:06.697678+0000","last_undegraded":"2024-04-26T23:50:06.697678+0000","last_fullsized":"2024-04-26T23:50:06.697678+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3562","last_scrub_stamp":"2024-04-26T23:50:06.697582+0000","last_deep_scrub":"26'3562","last_deep_scrub_stamp":"2024-04-26T23:50:06.697582+0000","last_clean_scrub_stamp":"2024-04-26T23:50:06.697582+0000","objects_scrubbed":0,"log_size":3562,"log_dups_size":0,"ondisk_log_size":3562,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:20:29.292700+0000","scrub_duration":18,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53479,"num_write_kb":687907,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.22","version":"26'5438","reported_seq":5467,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:57.493283+0000","last_change":"2024-04-26T23:49:57.493307+0000","last_active":"2024-04-26T23:49:57.493283+0000","last_peered":"2024-04-26T23:49:57.493283+0000","last_clean":"2024-04-26T23:49:57.493283+0000","last_became_active":"2024-04-26T23:40:41.677398+0000","last_became_peered":"2024-04-26T23:40:41.677398+0000","last_unstale":"2024-04-26T23:49:57.493283+0000","last_undegraded":"2024-04-26T23:49:57.493283+0000","last_fullsized":"2024-04-26T23:49:57.493283+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5438","last_scrub_stamp":"2024-04-26T23:49:57.493184+0000","last_deep_scrub":"26'5438","last_deep_scrub_stamp":"2024-04-26T23:49:57.493184+0000","last_clean_scrub_stamp":"2024-04-26T23:49:57.493184+0000","objects_scrubbed":0,"log_size":5438,"log_dups_size":0,"ondisk_log_size":5438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:41:57.160176+0000","scrub_duration":16,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":81903,"num_write_kb":1031435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.24","version":"26'3690","reported_seq":3719,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:42.925640+0000","last_change":"2024-04-26T23:40:32.587921+0000","last_active":"2024-04-26T23:49:42.925640+0000","last_peered":"2024-04-26T23:49:42.925640+0000","last_clean":"2024-04-26T23:49:42.925640+0000","last_became_active":"2024-04-26T23:40:32.587630+0000","last_became_peered":"2024-04-26T23:40:32.587630+0000","last_unstale":"2024-04-26T23:49:42.925640+0000","last_undegraded":"2024-04-26T23:49:42.925640+0000","last_fullsized":"2024-04-26T23:49:42.925640+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:31.552707+0000","last_clean_scrub_stamp":"2024-04-26T23:40:31.552707+0000","objects_scrubbed":0,"log_size":3690,"log_dups_size":0,"ondisk_log_size":3690,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55280,"num_write_kb":715530,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.23","version":"26'3842","reported_seq":3863,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:45.267734+0000","last_change":"2024-04-26T23:40:41.690235+0000","last_active":"2024-04-26T23:49:45.267734+0000","last_peered":"2024-04-26T23:49:45.267734+0000","last_clean":"2024-04-26T23:49:45.267734+0000","last_became_active":"2024-04-26T23:40:41.689911+0000","last_became_peered":"2024-04-26T23:40:41.689911+0000","last_unstale":"2024-04-26T23:49:45.267734+0000","last_undegraded":"2024-04-26T23:49:45.267734+0000","last_fullsized":"2024-04-26T23:49:45.267734+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":3842,"log_dups_size":0,"ondisk_log_size":3842,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":57757,"num_write_kb":753623,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"26'4516","reported_seq":4553,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:55.098331+0000","last_change":"2024-04-26T23:49:55.098366+0000","last_active":"2024-04-26T23:49:55.098331+0000","last_peered":"2024-04-26T23:49:55.098331+0000","last_clean":"2024-04-26T23:49:55.098331+0000","last_became_active":"2024-04-26T23:40:32.583089+0000","last_became_peered":"2024-04-26T23:40:32.583089+0000","last_unstale":"2024-04-26T23:49:55.098331+0000","last_undegraded":"2024-04-26T23:49:55.098331+0000","last_fullsized":"2024-04-26T23:49:55.098331+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4516","last_scrub_stamp":"2024-04-26T23:49:55.098179+0000","last_deep_scrub":"26'4516","last_deep_scrub_stamp":"2024-04-26T23:49:55.098179+0000","last_clean_scrub_stamp":"2024-04-26T23:49:55.098179+0000","objects_scrubbed":0,"log_size":4516,"log_dups_size":0,"ondisk_log_size":4516,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:22:12.484508+0000","scrub_duration":16,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":67860,"num_write_kb":874899,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.20","version":"26'5612","reported_seq":5633,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:45.294024+0000","last_change":"2024-04-26T23:40:41.688464+0000","last_active":"2024-04-26T23:49:45.294024+0000","last_peered":"2024-04-26T23:49:45.294024+0000","last_clean":"2024-04-26T23:49:45.294024+0000","last_became_active":"2024-04-26T23:40:41.688028+0000","last_became_peered":"2024-04-26T23:40:41.688028+0000","last_unstale":"2024-04-26T23:49:45.294024+0000","last_undegraded":"2024-04-26T23:49:45.294024+0000","last_fullsized":"2024-04-26T23:49:45.294024+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":5612,"log_dups_size":0,"ondisk_log_size":5612,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":84399,"num_write_kb":1068733,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.26","version":"26'3757","reported_seq":3794,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:52.778509+0000","last_change":"2024-04-26T23:49:52.778534+0000","last_active":"2024-04-26T23:49:52.778509+0000","last_peered":"2024-04-26T23:49:52.778509+0000","last_clean":"2024-04-26T23:49:52.778509+0000","last_became_active":"2024-04-26T23:40:32.588793+0000","last_became_peered":"2024-04-26T23:40:32.588793+0000","last_unstale":"2024-04-26T23:49:52.778509+0000","last_undegraded":"2024-04-26T23:49:52.778509+0000","last_fullsized":"2024-04-26T23:49:52.778509+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3757","last_scrub_stamp":"2024-04-26T23:49:52.778402+0000","last_deep_scrub":"26'3757","last_deep_scrub_stamp":"2024-04-26T23:49:52.778402+0000","last_clean_scrub_stamp":"2024-04-26T23:49:52.778402+0000","objects_scrubbed":0,"log_size":3757,"log_dups_size":0,"ondisk_log_size":3757,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:00:06.766306+0000","scrub_duration":17,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":56209,"num_write_kb":727106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.21","version":"26'4827","reported_seq":4848,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:45.279485+0000","last_change":"2024-04-26T23:40:41.688445+0000","last_active":"2024-04-26T23:49:45.279485+0000","last_peered":"2024-04-26T23:49:45.279485+0000","last_clean":"2024-04-26T23:49:45.279485+0000","last_became_active":"2024-04-26T23:40:41.688163+0000","last_became_peered":"2024-04-26T23:40:41.688163+0000","last_unstale":"2024-04-26T23:49:45.279485+0000","last_undegraded":"2024-04-26T23:49:45.279485+0000","last_fullsized":"2024-04-26T23:49:45.279485+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":4827,"log_dups_size":0,"ondisk_log_size":4827,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":72614,"num_write_kb":926316,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"26'4897","reported_seq":4934,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:50:04.258098+0000","last_change":"2024-04-26T23:50:04.258124+0000","last_active":"2024-04-26T23:50:04.258098+0000","last_peered":"2024-04-26T23:50:04.258098+0000","last_clean":"2024-04-26T23:50:04.258098+0000","last_became_active":"2024-04-26T23:40:32.586926+0000","last_became_peered":"2024-04-26T23:40:32.586926+0000","last_unstale":"2024-04-26T23:50:04.258098+0000","last_undegraded":"2024-04-26T23:50:04.258098+0000","last_fullsized":"2024-04-26T23:50:04.258098+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4897","last_scrub_stamp":"2024-04-26T23:50:04.257990+0000","last_deep_scrub":"26'4897","last_deep_scrub_stamp":"2024-04-26T23:50:04.257990+0000","last_clean_scrub_stamp":"2024-04-26T23:50:04.257990+0000","objects_scrubbed":0,"log_size":4897,"log_dups_size":0,"ondisk_log_size":4897,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:37:33.116648+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":73419,"num_write_kb":930971,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2e","version":"26'3627","reported_seq":3648,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:49.674587+0000","last_change":"2024-04-26T23:40:41.688396+0000","last_active":"2024-04-26T23:49:49.674587+0000","last_peered":"2024-04-26T23:49:49.674587+0000","last_clean":"2024-04-26T23:49:49.674587+0000","last_became_active":"2024-04-26T23:40:41.688087+0000","last_became_peered":"2024-04-26T23:40:41.688087+0000","last_unstale":"2024-04-26T23:49:49.674587+0000","last_undegraded":"2024-04-26T23:49:49.674587+0000","last_fullsized":"2024-04-26T23:49:49.674587+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":3627,"log_dups_size":0,"ondisk_log_size":3627,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":54377,"num_write_kb":682463,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"26'3685","reported_seq":3722,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:50:09.636672+0000","last_change":"2024-04-26T23:50:09.636720+0000","last_active":"2024-04-26T23:50:09.636672+0000","last_peered":"2024-04-26T23:50:09.636672+0000","last_clean":"2024-04-26T23:50:09.636672+0000","last_became_active":"2024-04-26T23:40:32.582100+0000","last_became_peered":"2024-04-26T23:40:32.582100+0000","last_unstale":"2024-04-26T23:50:09.636672+0000","last_undegraded":"2024-04-26T23:50:09.636672+0000","last_fullsized":"2024-04-26T23:50:09.636672+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3685","last_scrub_stamp":"2024-04-26T23:50:09.636526+0000","last_deep_scrub":"26'3685","last_deep_scrub_stamp":"2024-04-26T23:50:09.636526+0000","last_clean_scrub_stamp":"2024-04-26T23:50:09.636526+0000","objects_scrubbed":0,"log_size":3685,"log_dups_size":0,"ondisk_log_size":3685,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:24:02.282070+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55124,"num_write_kb":707502,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2f","version":"26'5401","reported_seq":5430,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:59.576779+0000","last_change":"2024-04-26T23:49:59.576823+0000","last_active":"2024-04-26T23:49:59.576779+0000","last_peered":"2024-04-26T23:49:59.576779+0000","last_clean":"2024-04-26T23:49:59.576779+0000","last_became_active":"2024-04-26T23:40:41.680581+0000","last_became_peered":"2024-04-26T23:40:41.680581+0000","last_unstale":"2024-04-26T23:49:59.576779+0000","last_undegraded":"2024-04-26T23:49:59.576779+0000","last_fullsized":"2024-04-26T23:49:59.576779+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5401","last_scrub_stamp":"2024-04-26T23:49:59.576612+0000","last_deep_scrub":"26'5401","last_deep_scrub_stamp":"2024-04-26T23:49:59.576612+0000","last_clean_scrub_stamp":"2024-04-26T23:49:59.576612+0000","objects_scrubbed":0,"log_size":5401,"log_dups_size":0,"ondisk_log_size":5401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:00:26.843111+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":81323,"num_write_kb":1040915,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.29","version":"26'4135","reported_seq":4172,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:56.201108+0000","last_change":"2024-04-26T23:49:56.201135+0000","last_active":"2024-04-26T23:49:56.201108+0000","last_peered":"2024-04-26T23:49:56.201108+0000","last_clean":"2024-04-26T23:49:56.201108+0000","last_became_active":"2024-04-26T23:40:32.593639+0000","last_became_peered":"2024-04-26T23:40:32.593639+0000","last_unstale":"2024-04-26T23:49:56.201108+0000","last_undegraded":"2024-04-26T23:49:56.201108+0000","last_fullsized":"2024-04-26T23:49:56.201108+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4135","last_scrub_stamp":"2024-04-26T23:49:56.200995+0000","last_deep_scrub":"26'4135","last_deep_scrub_stamp":"2024-04-26T23:49:56.200995+0000","last_clean_scrub_stamp":"2024-04-26T23:49:56.200995+0000","objects_scrubbed":0,"log_size":4135,"log_dups_size":0,"ondisk_log_size":4135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:42:04.223019+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":62129,"num_write_kb":797085,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"26'4466","reported_seq":4495,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:50.424214+0000","last_change":"2024-04-26T23:49:50.424238+0000","last_active":"2024-04-26T23:49:50.424214+0000","last_peered":"2024-04-26T23:49:50.424214+0000","last_clean":"2024-04-26T23:49:50.424214+0000","last_became_active":"2024-04-26T23:40:41.674274+0000","last_became_peered":"2024-04-26T23:40:41.674274+0000","last_unstale":"2024-04-26T23:49:50.424214+0000","last_undegraded":"2024-04-26T23:49:50.424214+0000","last_fullsized":"2024-04-26T23:49:50.424214+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4466","last_scrub_stamp":"2024-04-26T23:49:50.424132+0000","last_deep_scrub":"26'4466","last_deep_scrub_stamp":"2024-04-26T23:49:50.424132+0000","last_clean_scrub_stamp":"2024-04-26T23:49:50.424132+0000","objects_scrubbed":0,"log_size":4466,"log_dups_size":0,"ondisk_log_size":4466,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:06:59.444996+0000","scrub_duration":20,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":67376,"num_write_kb":867303,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"26'4512","reported_seq":4549,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:50.782111+0000","last_change":"2024-04-26T23:49:50.782141+0000","last_active":"2024-04-26T23:49:50.782111+0000","last_peered":"2024-04-26T23:49:50.782111+0000","last_clean":"2024-04-26T23:49:50.782111+0000","last_became_active":"2024-04-26T23:40:32.591366+0000","last_became_peered":"2024-04-26T23:40:32.591366+0000","last_unstale":"2024-04-26T23:49:50.782111+0000","last_undegraded":"2024-04-26T23:49:50.782111+0000","last_fullsized":"2024-04-26T23:49:50.782111+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4512","last_scrub_stamp":"2024-04-26T23:49:50.782003+0000","last_deep_scrub":"26'4512","last_deep_scrub_stamp":"2024-04-26T23:49:50.782003+0000","last_clean_scrub_stamp":"2024-04-26T23:49:50.782003+0000","objects_scrubbed":0,"log_size":4512,"log_dups_size":0,"ondisk_log_size":4512,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:44:12.537910+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":67679,"num_write_kb":882467,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2d","version":"26'4496","reported_seq":4517,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:49.674555+0000","last_change":"2024-04-26T23:40:41.692402+0000","last_active":"2024-04-26T23:49:49.674555+0000","last_peered":"2024-04-26T23:49:49.674555+0000","last_clean":"2024-04-26T23:49:49.674555+0000","last_became_active":"2024-04-26T23:40:41.692122+0000","last_became_peered":"2024-04-26T23:40:41.692122+0000","last_unstale":"2024-04-26T23:49:49.674555+0000","last_undegraded":"2024-04-26T23:49:49.674555+0000","last_fullsized":"2024-04-26T23:49:49.674555+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":4496,"log_dups_size":0,"ondisk_log_size":4496,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":67600,"num_write_kb":861109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2b","version":"26'4261","reported_seq":4298,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:58.725024+0000","last_change":"2024-04-26T23:49:58.725054+0000","last_active":"2024-04-26T23:49:58.725024+0000","last_peered":"2024-04-26T23:49:58.725024+0000","last_clean":"2024-04-26T23:49:58.725024+0000","last_became_active":"2024-04-26T23:40:32.590193+0000","last_became_peered":"2024-04-26T23:40:32.590193+0000","last_unstale":"2024-04-26T23:49:58.725024+0000","last_undegraded":"2024-04-26T23:49:58.725024+0000","last_fullsized":"2024-04-26T23:49:58.725024+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4261","last_scrub_stamp":"2024-04-26T23:49:58.724905+0000","last_deep_scrub":"26'4261","last_deep_scrub_stamp":"2024-04-26T23:49:58.724905+0000","last_clean_scrub_stamp":"2024-04-26T23:49:58.724905+0000","objects_scrubbed":0,"log_size":4261,"log_dups_size":0,"ondisk_log_size":4261,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:37:59.745275+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":63685,"num_write_kb":822261,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2a","version":"26'5005","reported_seq":5026,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:45.249363+0000","last_change":"2024-04-26T23:40:41.692194+0000","last_active":"2024-04-26T23:49:45.249363+0000","last_peered":"2024-04-26T23:49:45.249363+0000","last_clean":"2024-04-26T23:49:45.249363+0000","last_became_active":"2024-04-26T23:40:41.691837+0000","last_became_peered":"2024-04-26T23:40:41.691837+0000","last_unstale":"2024-04-26T23:49:45.249363+0000","last_undegraded":"2024-04-26T23:49:45.249363+0000","last_fullsized":"2024-04-26T23:49:45.249363+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":5005,"log_dups_size":0,"ondisk_log_size":5005,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":75356,"num_write_kb":950203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"26'4090","reported_seq":4127,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:53.766047+0000","last_change":"2024-04-26T23:49:53.766076+0000","last_active":"2024-04-26T23:49:53.766047+0000","last_peered":"2024-04-26T23:49:53.766047+0000","last_clean":"2024-04-26T23:49:53.766047+0000","last_became_active":"2024-04-26T23:40:32.590241+0000","last_became_peered":"2024-04-26T23:40:32.590241+0000","last_unstale":"2024-04-26T23:49:53.766047+0000","last_undegraded":"2024-04-26T23:49:53.766047+0000","last_fullsized":"2024-04-26T23:49:53.766047+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4090","last_scrub_stamp":"2024-04-26T23:49:53.765930+0000","last_deep_scrub":"26'4090","last_deep_scrub_stamp":"2024-04-26T23:49:53.765930+0000","last_clean_scrub_stamp":"2024-04-26T23:49:53.765930+0000","objects_scrubbed":0,"log_size":4090,"log_dups_size":0,"ondisk_log_size":4090,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:09:14.203814+0000","scrub_duration":21,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":61267,"num_write_kb":785631,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"26'4591","reported_seq":4620,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:50:07.303390+0000","last_change":"2024-04-26T23:50:07.303415+0000","last_active":"2024-04-26T23:50:07.303390+0000","last_peered":"2024-04-26T23:50:07.303390+0000","last_clean":"2024-04-26T23:50:07.303390+0000","last_became_active":"2024-04-26T23:40:41.689215+0000","last_became_peered":"2024-04-26T23:40:41.689215+0000","last_unstale":"2024-04-26T23:50:07.303390+0000","last_undegraded":"2024-04-26T23:50:07.303390+0000","last_fullsized":"2024-04-26T23:50:07.303390+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4591","last_scrub_stamp":"2024-04-26T23:50:07.303285+0000","last_deep_scrub":"26'4591","last_deep_scrub_stamp":"2024-04-26T23:50:07.303285+0000","last_clean_scrub_stamp":"2024-04-26T23:50:07.303285+0000","objects_scrubbed":0,"log_size":4591,"log_dups_size":0,"ondisk_log_size":4591,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:01:03.847713+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":68781,"num_write_kb":892789,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2d","version":"26'4171","reported_seq":4208,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:50:02.598710+0000","last_change":"2024-04-26T23:50:02.598737+0000","last_active":"2024-04-26T23:50:02.598710+0000","last_peered":"2024-04-26T23:50:02.598710+0000","last_clean":"2024-04-26T23:50:02.598710+0000","last_became_active":"2024-04-26T23:40:32.588063+0000","last_became_peered":"2024-04-26T23:40:32.588063+0000","last_unstale":"2024-04-26T23:50:02.598710+0000","last_undegraded":"2024-04-26T23:50:02.598710+0000","last_fullsized":"2024-04-26T23:50:02.598710+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4171","last_scrub_stamp":"2024-04-26T23:50:02.598602+0000","last_deep_scrub":"26'4171","last_deep_scrub_stamp":"2024-04-26T23:50:02.598602+0000","last_clean_scrub_stamp":"2024-04-26T23:50:02.598602+0000","objects_scrubbed":0,"log_size":4171,"log_dups_size":0,"ondisk_log_size":4171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:57:55.179434+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":62428,"num_write_kb":793377,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.28","version":"26'4028","reported_seq":4057,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:58.662845+0000","last_change":"2024-04-26T23:49:58.662896+0000","last_active":"2024-04-26T23:49:58.662845+0000","last_peered":"2024-04-26T23:49:58.662845+0000","last_clean":"2024-04-26T23:49:58.662845+0000","last_became_active":"2024-04-26T23:40:41.674573+0000","last_became_peered":"2024-04-26T23:40:41.674573+0000","last_unstale":"2024-04-26T23:49:58.662845+0000","last_undegraded":"2024-04-26T23:49:58.662845+0000","last_fullsized":"2024-04-26T23:49:58.662845+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4028","last_scrub_stamp":"2024-04-26T23:49:58.662739+0000","last_deep_scrub":"26'4028","last_deep_scrub_stamp":"2024-04-26T23:49:58.662739+0000","last_clean_scrub_stamp":"2024-04-26T23:49:58.662739+0000","objects_scrubbed":0,"log_size":4028,"log_dups_size":0,"ondisk_log_size":4028,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:00:25.929238+0000","scrub_duration":18,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":60451,"num_write_kb":760274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"26'3337","reported_seq":3374,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:55.399690+0000","last_change":"2024-04-26T23:49:55.399718+0000","last_active":"2024-04-26T23:49:55.399690+0000","last_peered":"2024-04-26T23:49:55.399690+0000","last_clean":"2024-04-26T23:49:55.399690+0000","last_became_active":"2024-04-26T23:40:32.574503+0000","last_became_peered":"2024-04-26T23:40:32.574503+0000","last_unstale":"2024-04-26T23:49:55.399690+0000","last_undegraded":"2024-04-26T23:49:55.399690+0000","last_fullsized":"2024-04-26T23:49:55.399690+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3337","last_scrub_stamp":"2024-04-26T23:49:55.399592+0000","last_deep_scrub":"26'3337","last_deep_scrub_stamp":"2024-04-26T23:49:55.399592+0000","last_clean_scrub_stamp":"2024-04-26T23:49:55.399592+0000","objects_scrubbed":0,"log_size":3337,"log_dups_size":0,"ondisk_log_size":3337,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:50:51.939539+0000","scrub_duration":17,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49634,"num_write_kb":627043,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.29","version":"26'4410","reported_seq":4439,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:50:02.658165+0000","last_change":"2024-04-26T23:50:02.658193+0000","last_active":"2024-04-26T23:50:02.658165+0000","last_peered":"2024-04-26T23:50:02.658165+0000","last_clean":"2024-04-26T23:50:02.658165+0000","last_became_active":"2024-04-26T23:40:41.679920+0000","last_became_peered":"2024-04-26T23:40:41.679920+0000","last_unstale":"2024-04-26T23:50:02.658165+0000","last_undegraded":"2024-04-26T23:50:02.658165+0000","last_fullsized":"2024-04-26T23:50:02.658165+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4410","last_scrub_stamp":"2024-04-26T23:50:02.658071+0000","last_deep_scrub":"26'4410","last_deep_scrub_stamp":"2024-04-26T23:50:02.658071+0000","last_clean_scrub_stamp":"2024-04-26T23:50:02.658071+0000","objects_scrubbed":0,"log_size":4410,"log_dups_size":0,"ondisk_log_size":4410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:47:27.300505+0000","scrub_duration":16,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":66255,"num_write_kb":845549,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2f","version":"26'5167","reported_seq":5204,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:52.712843+0000","last_change":"2024-04-26T23:49:52.712843+0000","last_active":"2024-04-26T23:49:52.712843+0000","last_peered":"2024-04-26T23:49:52.712843+0000","last_clean":"2024-04-26T23:49:52.712843+0000","last_became_active":"2024-04-26T23:40:32.593169+0000","last_became_peered":"2024-04-26T23:40:32.593169+0000","last_unstale":"2024-04-26T23:49:52.712843+0000","last_undegraded":"2024-04-26T23:49:52.712843+0000","last_fullsized":"2024-04-26T23:49:52.712843+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5167","last_scrub_stamp":"2024-04-26T23:49:52.712701+0000","last_deep_scrub":"26'5167","last_deep_scrub_stamp":"2024-04-26T23:49:52.712701+0000","last_clean_scrub_stamp":"2024-04-26T23:49:52.712701+0000","objects_scrubbed":0,"log_size":5167,"log_dups_size":0,"ondisk_log_size":5167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:37:53.733071+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":77406,"num_write_kb":981579,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.36","version":"26'5055","reported_seq":5075,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:45.292873+0000","last_change":"2024-04-26T23:40:41.694551+0000","last_active":"2024-04-26T23:49:45.292873+0000","last_peered":"2024-04-26T23:49:45.292873+0000","last_clean":"2024-04-26T23:49:45.292873+0000","last_became_active":"2024-04-26T23:40:41.694297+0000","last_became_peered":"2024-04-26T23:40:41.694297+0000","last_unstale":"2024-04-26T23:49:45.292873+0000","last_undegraded":"2024-04-26T23:49:45.292873+0000","last_fullsized":"2024-04-26T23:49:45.292873+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":5055,"log_dups_size":0,"ondisk_log_size":5055,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":75865,"num_write_kb":998838,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"26'3722","reported_seq":3759,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:55.641992+0000","last_change":"2024-04-26T23:49:55.641992+0000","last_active":"2024-04-26T23:49:55.641992+0000","last_peered":"2024-04-26T23:49:55.641992+0000","last_clean":"2024-04-26T23:49:55.641992+0000","last_became_active":"2024-04-26T23:40:32.584678+0000","last_became_peered":"2024-04-26T23:40:32.584678+0000","last_unstale":"2024-04-26T23:49:55.641992+0000","last_undegraded":"2024-04-26T23:49:55.641992+0000","last_fullsized":"2024-04-26T23:49:55.641992+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3722","last_scrub_stamp":"2024-04-26T23:49:55.641842+0000","last_deep_scrub":"26'3722","last_deep_scrub_stamp":"2024-04-26T23:49:55.641842+0000","last_clean_scrub_stamp":"2024-04-26T23:49:55.641842+0000","objects_scrubbed":0,"log_size":3722,"log_dups_size":0,"ondisk_log_size":3722,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:41:55.308834+0000","scrub_duration":21,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55693,"num_write_kb":722935,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.37","version":"26'5541","reported_seq":5561,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:45.290915+0000","last_change":"2024-04-26T23:40:41.692433+0000","last_active":"2024-04-26T23:49:45.290915+0000","last_peered":"2024-04-26T23:49:45.290915+0000","last_clean":"2024-04-26T23:49:45.290915+0000","last_became_active":"2024-04-26T23:40:41.692090+0000","last_became_peered":"2024-04-26T23:40:41.692090+0000","last_unstale":"2024-04-26T23:49:45.290915+0000","last_undegraded":"2024-04-26T23:49:45.290915+0000","last_fullsized":"2024-04-26T23:49:45.290915+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":5541,"log_dups_size":0,"ondisk_log_size":5541,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":83365,"num_write_kb":1062103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"26'4290","reported_seq":4327,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:51.180512+0000","last_change":"2024-04-26T23:49:51.180512+0000","last_active":"2024-04-26T23:49:51.180512+0000","last_peered":"2024-04-26T23:49:51.180512+0000","last_clean":"2024-04-26T23:49:51.180512+0000","last_became_active":"2024-04-26T23:40:32.590162+0000","last_became_peered":"2024-04-26T23:40:32.590162+0000","last_unstale":"2024-04-26T23:49:51.180512+0000","last_undegraded":"2024-04-26T23:49:51.180512+0000","last_fullsized":"2024-04-26T23:49:51.180512+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4290","last_scrub_stamp":"2024-04-26T23:49:51.180393+0000","last_deep_scrub":"26'4290","last_deep_scrub_stamp":"2024-04-26T23:49:51.180393+0000","last_clean_scrub_stamp":"2024-04-26T23:49:51.180393+0000","objects_scrubbed":0,"log_size":4290,"log_dups_size":0,"ondisk_log_size":4290,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:02:52.187012+0000","scrub_duration":24,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":64302,"num_write_kb":811481,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.34","version":"26'3759","reported_seq":3779,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:45.249180+0000","last_change":"2024-04-26T23:40:41.687270+0000","last_active":"2024-04-26T23:49:45.249180+0000","last_peered":"2024-04-26T23:49:45.249180+0000","last_clean":"2024-04-26T23:49:45.249180+0000","last_became_active":"2024-04-26T23:40:41.686999+0000","last_became_peered":"2024-04-26T23:40:41.686999+0000","last_unstale":"2024-04-26T23:49:45.249180+0000","last_undegraded":"2024-04-26T23:49:45.249180+0000","last_fullsized":"2024-04-26T23:49:45.249180+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":3759,"log_dups_size":0,"ondisk_log_size":3759,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":56674,"num_write_kb":713071,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"26'4299","reported_seq":4336,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:56.751622+0000","last_change":"2024-04-26T23:49:56.751622+0000","last_active":"2024-04-26T23:49:56.751622+0000","last_peered":"2024-04-26T23:49:56.751622+0000","last_clean":"2024-04-26T23:49:56.751622+0000","last_became_active":"2024-04-26T23:40:32.585995+0000","last_became_peered":"2024-04-26T23:40:32.585995+0000","last_unstale":"2024-04-26T23:49:56.751622+0000","last_undegraded":"2024-04-26T23:49:56.751622+0000","last_fullsized":"2024-04-26T23:49:56.751622+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4299","last_scrub_stamp":"2024-04-26T23:49:56.751481+0000","last_deep_scrub":"26'4299","last_deep_scrub_stamp":"2024-04-26T23:49:56.751481+0000","last_clean_scrub_stamp":"2024-04-26T23:49:56.751481+0000","objects_scrubbed":0,"log_size":4299,"log_dups_size":0,"ondisk_log_size":4299,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:45:55.226502+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":64455,"num_write_kb":829744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.35","version":"26'4332","reported_seq":4352,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:45.274749+0000","last_change":"2024-04-26T23:40:41.691693+0000","last_active":"2024-04-26T23:49:45.274749+0000","last_peered":"2024-04-26T23:49:45.274749+0000","last_clean":"2024-04-26T23:49:45.274749+0000","last_became_active":"2024-04-26T23:40:41.691437+0000","last_became_peered":"2024-04-26T23:40:41.691437+0000","last_unstale":"2024-04-26T23:49:45.274749+0000","last_undegraded":"2024-04-26T23:49:45.274749+0000","last_fullsized":"2024-04-26T23:49:45.274749+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":4332,"log_dups_size":0,"ondisk_log_size":4332,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":65307,"num_write_kb":818233,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.33","version":"26'3786","reported_seq":3822,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:50:00.233909+0000","last_change":"2024-04-26T23:50:00.233984+0000","last_active":"2024-04-26T23:50:00.233909+0000","last_peered":"2024-04-26T23:50:00.233909+0000","last_clean":"2024-04-26T23:50:00.233909+0000","last_became_active":"2024-04-26T23:40:32.592717+0000","last_became_peered":"2024-04-26T23:40:32.592717+0000","last_unstale":"2024-04-26T23:50:00.233909+0000","last_undegraded":"2024-04-26T23:50:00.233909+0000","last_fullsized":"2024-04-26T23:50:00.233909+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3786","last_scrub_stamp":"2024-04-26T23:50:00.233785+0000","last_deep_scrub":"26'3786","last_deep_scrub_stamp":"2024-04-26T23:50:00.233785+0000","last_clean_scrub_stamp":"2024-04-26T23:50:00.233785+0000","objects_scrubbed":0,"log_size":3786,"log_dups_size":0,"ondisk_log_size":3786,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:57:52.814617+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":56607,"num_write_kb":740250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.32","version":"26'4732","reported_seq":4761,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:50:01.257042+0000","last_change":"2024-04-26T23:50:01.257042+0000","last_active":"2024-04-26T23:50:01.257042+0000","last_peered":"2024-04-26T23:50:01.257042+0000","last_clean":"2024-04-26T23:50:01.257042+0000","last_became_active":"2024-04-26T23:40:41.675042+0000","last_became_peered":"2024-04-26T23:40:41.675042+0000","last_unstale":"2024-04-26T23:50:01.257042+0000","last_undegraded":"2024-04-26T23:50:01.257042+0000","last_fullsized":"2024-04-26T23:50:01.257042+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4732","last_scrub_stamp":"2024-04-26T23:50:01.256864+0000","last_deep_scrub":"26'4732","last_deep_scrub_stamp":"2024-04-26T23:50:01.256864+0000","last_clean_scrub_stamp":"2024-04-26T23:50:01.256864+0000","objects_scrubbed":0,"log_size":4732,"log_dups_size":0,"ondisk_log_size":4732,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:00:57.801291+0000","scrub_duration":17,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":71116,"num_write_kb":894316,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"26'3513","reported_seq":3549,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:50:02.386687+0000","last_change":"2024-04-26T23:50:02.386713+0000","last_active":"2024-04-26T23:50:02.386687+0000","last_peered":"2024-04-26T23:50:02.386687+0000","last_clean":"2024-04-26T23:50:02.386687+0000","last_became_active":"2024-04-26T23:40:32.594802+0000","last_became_peered":"2024-04-26T23:40:32.594802+0000","last_unstale":"2024-04-26T23:50:02.386687+0000","last_undegraded":"2024-04-26T23:50:02.386687+0000","last_fullsized":"2024-04-26T23:50:02.386687+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3513","last_scrub_stamp":"2024-04-26T23:50:02.386576+0000","last_deep_scrub":"26'3513","last_deep_scrub_stamp":"2024-04-26T23:50:02.386576+0000","last_clean_scrub_stamp":"2024-04-26T23:50:02.386576+0000","objects_scrubbed":0,"log_size":3513,"log_dups_size":0,"ondisk_log_size":3513,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:04:50.151949+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":52734,"num_write_kb":670887,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.33","version":"26'4045","reported_seq":4073,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:50:03.422912+0000","last_change":"2024-04-26T23:50:03.422944+0000","last_active":"2024-04-26T23:50:03.422912+0000","last_peered":"2024-04-26T23:50:03.422912+0000","last_clean":"2024-04-26T23:50:03.422912+0000","last_became_active":"2024-04-26T23:40:41.690846+0000","last_became_peered":"2024-04-26T23:40:41.690846+0000","last_unstale":"2024-04-26T23:50:03.422912+0000","last_undegraded":"2024-04-26T23:50:03.422912+0000","last_fullsized":"2024-04-26T23:50:03.422912+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4045","last_scrub_stamp":"2024-04-26T23:50:03.422796+0000","last_deep_scrub":"26'4045","last_deep_scrub_stamp":"2024-04-26T23:50:03.422796+0000","last_clean_scrub_stamp":"2024-04-26T23:50:03.422796+0000","objects_scrubbed":0,"log_size":4045,"log_dups_size":0,"ondisk_log_size":4045,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:55:13.464010+0000","scrub_duration":20,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":60666,"num_write_kb":797602,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.35","version":"26'4035","reported_seq":4071,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:50:01.761446+0000","last_change":"2024-04-26T23:50:01.761473+0000","last_active":"2024-04-26T23:50:01.761446+0000","last_peered":"2024-04-26T23:50:01.761446+0000","last_clean":"2024-04-26T23:50:01.761446+0000","last_became_active":"2024-04-26T23:40:32.578556+0000","last_became_peered":"2024-04-26T23:40:32.578556+0000","last_unstale":"2024-04-26T23:50:01.761446+0000","last_undegraded":"2024-04-26T23:50:01.761446+0000","last_fullsized":"2024-04-26T23:50:01.761446+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4035","last_scrub_stamp":"2024-04-26T23:50:01.761312+0000","last_deep_scrub":"26'4035","last_deep_scrub_stamp":"2024-04-26T23:50:01.761312+0000","last_clean_scrub_stamp":"2024-04-26T23:50:01.761312+0000","objects_scrubbed":0,"log_size":4035,"log_dups_size":0,"ondisk_log_size":4035,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:38:51.003778+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":60570,"num_write_kb":769077,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.30","version":"26'3969","reported_seq":3990,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:51.426998+0000","last_change":"2024-04-26T23:40:41.689812+0000","last_active":"2024-04-26T23:49:51.426998+0000","last_peered":"2024-04-26T23:49:51.426998+0000","last_clean":"2024-04-26T23:49:51.426998+0000","last_became_active":"2024-04-26T23:40:41.689267+0000","last_became_peered":"2024-04-26T23:40:41.689267+0000","last_unstale":"2024-04-26T23:49:51.426998+0000","last_undegraded":"2024-04-26T23:49:51.426998+0000","last_fullsized":"2024-04-26T23:49:51.426998+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":3969,"log_dups_size":0,"ondisk_log_size":3969,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":59630,"num_write_kb":775739,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"26'4731","reported_seq":4767,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:50:00.747128+0000","last_change":"2024-04-26T23:50:00.747156+0000","last_active":"2024-04-26T23:50:00.747128+0000","last_peered":"2024-04-26T23:50:00.747128+0000","last_clean":"2024-04-26T23:50:00.747128+0000","last_became_active":"2024-04-26T23:40:32.577865+0000","last_became_peered":"2024-04-26T23:40:32.577865+0000","last_unstale":"2024-04-26T23:50:00.747128+0000","last_undegraded":"2024-04-26T23:50:00.747128+0000","last_fullsized":"2024-04-26T23:50:00.747128+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4731","last_scrub_stamp":"2024-04-26T23:50:00.747009+0000","last_deep_scrub":"26'4731","last_deep_scrub_stamp":"2024-04-26T23:50:00.747009+0000","last_clean_scrub_stamp":"2024-04-26T23:50:00.747009+0000","objects_scrubbed":0,"log_size":4731,"log_dups_size":0,"ondisk_log_size":4731,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:45:59.222030+0000","scrub_duration":17,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":70795,"num_write_kb":915734,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.31","version":"26'4442","reported_seq":4463,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:50.549195+0000","last_change":"2024-04-26T23:40:41.680962+0000","last_active":"2024-04-26T23:49:50.549195+0000","last_peered":"2024-04-26T23:49:50.549195+0000","last_clean":"2024-04-26T23:49:50.549195+0000","last_became_active":"2024-04-26T23:40:41.680676+0000","last_became_peered":"2024-04-26T23:40:41.680676+0000","last_unstale":"2024-04-26T23:49:50.549195+0000","last_undegraded":"2024-04-26T23:49:50.549195+0000","last_fullsized":"2024-04-26T23:49:50.549195+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":4442,"log_dups_size":0,"ondisk_log_size":4442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":66738,"num_write_kb":853261,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"26'4979","reported_seq":5015,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:58.521360+0000","last_change":"2024-04-26T23:49:58.521386+0000","last_active":"2024-04-26T23:49:58.521360+0000","last_peered":"2024-04-26T23:49:58.521360+0000","last_clean":"2024-04-26T23:49:58.521360+0000","last_became_active":"2024-04-26T23:40:32.591209+0000","last_became_peered":"2024-04-26T23:40:32.591209+0000","last_unstale":"2024-04-26T23:49:58.521360+0000","last_undegraded":"2024-04-26T23:49:58.521360+0000","last_fullsized":"2024-04-26T23:49:58.521360+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4979","last_scrub_stamp":"2024-04-26T23:49:58.521242+0000","last_deep_scrub":"26'4979","last_deep_scrub_stamp":"2024-04-26T23:49:58.521242+0000","last_clean_scrub_stamp":"2024-04-26T23:49:58.521242+0000","objects_scrubbed":0,"log_size":4979,"log_dups_size":0,"ondisk_log_size":4979,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:04:46.286615+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":74710,"num_write_kb":992211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3e","version":"26'5670","reported_seq":5691,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:45.324828+0000","last_change":"2024-04-26T23:40:41.686089+0000","last_active":"2024-04-26T23:49:45.324828+0000","last_peered":"2024-04-26T23:49:45.324828+0000","last_clean":"2024-04-26T23:49:45.324828+0000","last_became_active":"2024-04-26T23:40:41.685786+0000","last_became_peered":"2024-04-26T23:40:41.685786+0000","last_unstale":"2024-04-26T23:49:45.324828+0000","last_undegraded":"2024-04-26T23:49:45.324828+0000","last_fullsized":"2024-04-26T23:49:45.324828+0000","mapping_epoch":22,"log_start":"26'400","ondisk_log_start":"26'400","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":5270,"log_dups_size":0,"ondisk_log_size":5270,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":85672,"num_write_kb":1105852,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.38","version":"26'4537","reported_seq":4573,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:50:02.245307+0000","last_change":"2024-04-26T23:50:02.245335+0000","last_active":"2024-04-26T23:50:02.245307+0000","last_peered":"2024-04-26T23:50:02.245307+0000","last_clean":"2024-04-26T23:50:02.245307+0000","last_became_active":"2024-04-26T23:40:32.592282+0000","last_became_peered":"2024-04-26T23:40:32.592282+0000","last_unstale":"2024-04-26T23:50:02.245307+0000","last_undegraded":"2024-04-26T23:50:02.245307+0000","last_fullsized":"2024-04-26T23:50:02.245307+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4537","last_scrub_stamp":"2024-04-26T23:50:02.245206+0000","last_deep_scrub":"26'4537","last_deep_scrub_stamp":"2024-04-26T23:50:02.245206+0000","last_clean_scrub_stamp":"2024-04-26T23:50:02.245206+0000","objects_scrubbed":0,"log_size":4537,"log_dups_size":0,"ondisk_log_size":4537,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:56:14.580169+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":68313,"num_write_kb":849602,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3f","version":"26'3838","reported_seq":3867,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:50:06.748529+0000","last_change":"2024-04-26T23:50:06.748572+0000","last_active":"2024-04-26T23:50:06.748529+0000","last_peered":"2024-04-26T23:50:06.748529+0000","last_clean":"2024-04-26T23:50:06.748529+0000","last_became_active":"2024-04-26T23:40:41.678926+0000","last_became_peered":"2024-04-26T23:40:41.678926+0000","last_unstale":"2024-04-26T23:50:06.748529+0000","last_undegraded":"2024-04-26T23:50:06.748529+0000","last_fullsized":"2024-04-26T23:50:06.748529+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3838","last_scrub_stamp":"2024-04-26T23:50:06.748423+0000","last_deep_scrub":"26'3838","last_deep_scrub_stamp":"2024-04-26T23:50:06.748423+0000","last_clean_scrub_stamp":"2024-04-26T23:50:06.748423+0000","objects_scrubbed":0,"log_size":3838,"log_dups_size":0,"ondisk_log_size":3838,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:24:26.138055+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":57629,"num_write_kb":750507,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.39","version":"26'4047","reported_seq":4069,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:50:04.445267+0000","last_change":"2024-04-26T23:50:04.445325+0000","last_active":"2024-04-26T23:50:04.445267+0000","last_peered":"2024-04-26T23:50:04.445267+0000","last_clean":"2024-04-26T23:50:04.445267+0000","last_became_active":"2024-04-26T23:41:30.372928+0000","last_became_peered":"2024-04-26T23:41:30.372928+0000","last_unstale":"2024-04-26T23:50:04.445267+0000","last_undegraded":"2024-04-26T23:50:04.445267+0000","last_fullsized":"2024-04-26T23:50:04.445267+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4047","last_scrub_stamp":"2024-04-26T23:50:04.445130+0000","last_deep_scrub":"26'4047","last_deep_scrub_stamp":"2024-04-26T23:50:04.445130+0000","last_clean_scrub_stamp":"2024-04-26T23:50:04.445130+0000","objects_scrubbed":0,"log_size":4047,"log_dups_size":0,"ondisk_log_size":4047,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:38:34.593016+0000","scrub_duration":20,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":60897,"num_write_kb":776135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3c","version":"26'4076","reported_seq":4105,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:50:09.316670+0000","last_change":"2024-04-26T23:50:09.316717+0000","last_active":"2024-04-26T23:50:09.316670+0000","last_peered":"2024-04-26T23:50:09.316670+0000","last_clean":"2024-04-26T23:50:09.316670+0000","last_became_active":"2024-04-26T23:40:41.688585+0000","last_became_peered":"2024-04-26T23:40:41.688585+0000","last_unstale":"2024-04-26T23:50:09.316670+0000","last_undegraded":"2024-04-26T23:50:09.316670+0000","last_fullsized":"2024-04-26T23:50:09.316670+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4076","last_scrub_stamp":"2024-04-26T23:50:09.316552+0000","last_deep_scrub":"26'4076","last_deep_scrub_stamp":"2024-04-26T23:50:09.316552+0000","last_clean_scrub_stamp":"2024-04-26T23:50:09.316552+0000","objects_scrubbed":0,"log_size":4076,"log_dups_size":0,"ondisk_log_size":4076,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:58:59.475904+0000","scrub_duration":39,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":61409,"num_write_kb":797665,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"26'3610","reported_seq":3646,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:57.652428+0000","last_change":"2024-04-26T23:49:57.652457+0000","last_active":"2024-04-26T23:49:57.652428+0000","last_peered":"2024-04-26T23:49:57.652428+0000","last_clean":"2024-04-26T23:49:57.652428+0000","last_became_active":"2024-04-26T23:40:32.584293+0000","last_became_peered":"2024-04-26T23:40:32.584293+0000","last_unstale":"2024-04-26T23:49:57.652428+0000","last_undegraded":"2024-04-26T23:49:57.652428+0000","last_fullsized":"2024-04-26T23:49:57.652428+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3610","last_scrub_stamp":"2024-04-26T23:49:57.652315+0000","last_deep_scrub":"26'3610","last_deep_scrub_stamp":"2024-04-26T23:49:57.652315+0000","last_clean_scrub_stamp":"2024-04-26T23:49:57.652315+0000","objects_scrubbed":0,"log_size":3610,"log_dups_size":0,"ondisk_log_size":3610,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:24:17.041947+0000","scrub_duration":17,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":54297,"num_write_kb":686705,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3d","version":"26'4621","reported_seq":4642,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:45.297906+0000","last_change":"2024-04-26T23:40:41.691614+0000","last_active":"2024-04-26T23:49:45.297906+0000","last_peered":"2024-04-26T23:49:45.297906+0000","last_clean":"2024-04-26T23:49:45.297906+0000","last_became_active":"2024-04-26T23:40:41.691081+0000","last_became_peered":"2024-04-26T23:40:41.691081+0000","last_unstale":"2024-04-26T23:49:45.297906+0000","last_undegraded":"2024-04-26T23:49:45.297906+0000","last_fullsized":"2024-04-26T23:49:45.297906+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":4621,"log_dups_size":0,"ondisk_log_size":4621,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69615,"num_write_kb":867426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"26'4911","reported_seq":4947,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:50:00.554507+0000","last_change":"2024-04-26T23:50:00.554533+0000","last_active":"2024-04-26T23:50:00.554507+0000","last_peered":"2024-04-26T23:50:00.554507+0000","last_clean":"2024-04-26T23:50:00.554507+0000","last_became_active":"2024-04-26T23:40:32.588409+0000","last_became_peered":"2024-04-26T23:40:32.588409+0000","last_unstale":"2024-04-26T23:50:00.554507+0000","last_undegraded":"2024-04-26T23:50:00.554507+0000","last_fullsized":"2024-04-26T23:50:00.554507+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4911","last_scrub_stamp":"2024-04-26T23:50:00.554399+0000","last_deep_scrub":"26'4911","last_deep_scrub_stamp":"2024-04-26T23:50:00.554399+0000","last_clean_scrub_stamp":"2024-04-26T23:50:00.554399+0000","objects_scrubbed":0,"log_size":4911,"log_dups_size":0,"ondisk_log_size":4911,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:43:05.116370+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":73569,"num_write_kb":917520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3a","version":"26'3815","reported_seq":3843,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:50:03.274167+0000","last_change":"2024-04-26T23:50:03.274212+0000","last_active":"2024-04-26T23:50:03.274167+0000","last_peered":"2024-04-26T23:50:03.274167+0000","last_clean":"2024-04-26T23:50:03.274167+0000","last_became_active":"2024-04-26T23:40:41.678333+0000","last_became_peered":"2024-04-26T23:40:41.678333+0000","last_unstale":"2024-04-26T23:50:03.274167+0000","last_undegraded":"2024-04-26T23:50:03.274167+0000","last_fullsized":"2024-04-26T23:50:03.274167+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3815","last_scrub_stamp":"2024-04-26T23:50:03.274029+0000","last_deep_scrub":"26'3815","last_deep_scrub_stamp":"2024-04-26T23:50:03.274029+0000","last_clean_scrub_stamp":"2024-04-26T23:50:03.274029+0000","objects_scrubbed":0,"log_size":3815,"log_dups_size":0,"ondisk_log_size":3815,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:26:36.047072+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":57471,"num_write_kb":738181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"26'3683","reported_seq":3720,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:50:08.625099+0000","last_change":"2024-04-26T23:50:08.625142+0000","last_active":"2024-04-26T23:50:08.625099+0000","last_peered":"2024-04-26T23:50:08.625099+0000","last_clean":"2024-04-26T23:50:08.625099+0000","last_became_active":"2024-04-26T23:40:32.580987+0000","last_became_peered":"2024-04-26T23:40:32.580987+0000","last_unstale":"2024-04-26T23:50:08.625099+0000","last_undegraded":"2024-04-26T23:50:08.625099+0000","last_fullsized":"2024-04-26T23:50:08.625099+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3683","last_scrub_stamp":"2024-04-26T23:50:08.624981+0000","last_deep_scrub":"26'3683","last_deep_scrub_stamp":"2024-04-26T23:50:08.624981+0000","last_clean_scrub_stamp":"2024-04-26T23:50:08.624981+0000","objects_scrubbed":0,"log_size":3683,"log_dups_size":0,"ondisk_log_size":3683,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:54:51.696142+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55303,"num_write_kb":749693,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3b","version":"26'5311","reported_seq":5339,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:49.447748+0000","last_change":"2024-04-26T23:49:49.447775+0000","last_active":"2024-04-26T23:49:49.447748+0000","last_peered":"2024-04-26T23:49:49.447748+0000","last_clean":"2024-04-26T23:49:49.447748+0000","last_became_active":"2024-04-26T23:40:41.678067+0000","last_became_peered":"2024-04-26T23:40:41.678067+0000","last_unstale":"2024-04-26T23:49:49.447748+0000","last_undegraded":"2024-04-26T23:49:49.447748+0000","last_fullsized":"2024-04-26T23:49:49.447748+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5311","last_scrub_stamp":"2024-04-26T23:49:49.447659+0000","last_deep_scrub":"26'5311","last_deep_scrub_stamp":"2024-04-26T23:49:49.447659+0000","last_clean_scrub_stamp":"2024-04-26T23:49:49.447659+0000","objects_scrubbed":0,"log_size":5311,"log_dups_size":0,"ondisk_log_size":5311,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:44:34.964705+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79871,"num_write_kb":1001680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"26'4313","reported_seq":4350,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:54.749758+0000","last_change":"2024-04-26T23:49:54.749786+0000","last_active":"2024-04-26T23:49:54.749758+0000","last_peered":"2024-04-26T23:49:54.749758+0000","last_clean":"2024-04-26T23:49:54.749758+0000","last_became_active":"2024-04-26T23:40:32.579569+0000","last_became_peered":"2024-04-26T23:40:32.579569+0000","last_unstale":"2024-04-26T23:49:54.749758+0000","last_undegraded":"2024-04-26T23:49:54.749758+0000","last_fullsized":"2024-04-26T23:49:54.749758+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4313","last_scrub_stamp":"2024-04-26T23:49:54.749654+0000","last_deep_scrub":"26'4313","last_deep_scrub_stamp":"2024-04-26T23:49:54.749654+0000","last_clean_scrub_stamp":"2024-04-26T23:49:54.749654+0000","objects_scrubbed":0,"log_size":4313,"log_dups_size":0,"ondisk_log_size":4313,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:00:57.933982+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":64676,"num_write_kb":807158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.38","version":"26'4952","reported_seq":4972,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:45.297913+0000","last_change":"2024-04-26T23:40:41.684020+0000","last_active":"2024-04-26T23:49:45.297913+0000","last_peered":"2024-04-26T23:49:45.297913+0000","last_clean":"2024-04-26T23:49:45.297913+0000","last_became_active":"2024-04-26T23:40:41.683734+0000","last_became_peered":"2024-04-26T23:40:41.683734+0000","last_unstale":"2024-04-26T23:49:45.297913+0000","last_undegraded":"2024-04-26T23:49:45.297913+0000","last_fullsized":"2024-04-26T23:49:45.297913+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":4952,"log_dups_size":0,"ondisk_log_size":4952,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":74716,"num_write_kb":913038,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"26'5195","reported_seq":5232,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:53.130712+0000","last_change":"2024-04-26T23:49:53.130759+0000","last_active":"2024-04-26T23:49:53.130712+0000","last_peered":"2024-04-26T23:49:53.130712+0000","last_clean":"2024-04-26T23:49:53.130712+0000","last_became_active":"2024-04-26T23:40:32.583655+0000","last_became_peered":"2024-04-26T23:40:32.583655+0000","last_unstale":"2024-04-26T23:49:53.130712+0000","last_undegraded":"2024-04-26T23:49:53.130712+0000","last_fullsized":"2024-04-26T23:49:53.130712+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5195","last_scrub_stamp":"2024-04-26T23:49:53.130581+0000","last_deep_scrub":"26'5195","last_deep_scrub_stamp":"2024-04-26T23:49:53.130581+0000","last_clean_scrub_stamp":"2024-04-26T23:49:53.130581+0000","objects_scrubbed":0,"log_size":5195,"log_dups_size":0,"ondisk_log_size":5195,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:44:14.886488+0000","scrub_duration":32,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":78237,"num_write_kb":1038116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.39","version":"26'4261","reported_seq":4281,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:45.276583+0000","last_change":"2024-04-26T23:40:41.681412+0000","last_active":"2024-04-26T23:49:45.276583+0000","last_peered":"2024-04-26T23:49:45.276583+0000","last_clean":"2024-04-26T23:49:45.276583+0000","last_became_active":"2024-04-26T23:40:41.681092+0000","last_became_peered":"2024-04-26T23:40:41.681092+0000","last_unstale":"2024-04-26T23:49:45.276583+0000","last_undegraded":"2024-04-26T23:49:45.276583+0000","last_fullsized":"2024-04-26T23:49:45.276583+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:40:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T23:40:40.651867+0000","objects_scrubbed":0,"log_size":4261,"log_dups_size":0,"ondisk_log_size":4261,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":64162,"num_write_kb":832623,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"26'3628","reported_seq":3665,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:55.462502+0000","last_change":"2024-04-26T23:49:55.462530+0000","last_active":"2024-04-26T23:49:55.462502+0000","last_peered":"2024-04-26T23:49:55.462502+0000","last_clean":"2024-04-26T23:49:55.462502+0000","last_became_active":"2024-04-26T23:40:32.596050+0000","last_became_peered":"2024-04-26T23:40:32.596050+0000","last_unstale":"2024-04-26T23:49:55.462502+0000","last_undegraded":"2024-04-26T23:49:55.462502+0000","last_fullsized":"2024-04-26T23:49:55.462502+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3628","last_scrub_stamp":"2024-04-26T23:49:55.462396+0000","last_deep_scrub":"26'3628","last_deep_scrub_stamp":"2024-04-26T23:49:55.462396+0000","last_clean_scrub_stamp":"2024-04-26T23:49:55.462396+0000","objects_scrubbed":0,"log_size":3628,"log_dups_size":0,"ondisk_log_size":3628,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:55:05.503610+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":54568,"num_write_kb":695399,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4349618,"num_write_kb":55464628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":287816,"ondisk_log_size":287816,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":158829364,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":18,"num_read_kb":98,"num_write":2627,"num_write_kb":157093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":317718528,"data_stored":317658728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2581,"ondisk_log_size":2581,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4020088,"num_write_kb":51543156,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":268065,"ondisk_log_size":268065,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":149566157,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":15,"num_read_kb":95,"num_write":2737,"num_write_kb":148086,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":299196416,"data_stored":299132314,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2645,"ondisk_log_size":2645,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574964,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":835292,"kb_used_data":81300,"kb_used_omap":1,"kb_used_meta":753982,"kb_avail":93536548,"statfs":{"total":96636764160,"available":95781425152,"internally_reserved":0,"allocated":83251200,"data_stored":83071836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":772078026},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574969,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":602412,"kb_used_data":84196,"kb_used_omap":1,"kb_used_meta":518206,"kb_avail":93769428,"statfs":{"total":96636764160,"available":96019894272,"internally_reserved":0,"allocated":86216704,"data_stored":86032549,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":530643398},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574966,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":756680,"kb_used_data":57088,"kb_used_omap":1,"kb_used_meta":699582,"kb_avail":93615160,"statfs":{"total":96636764160,"available":95861923840,"internally_reserved":0,"allocated":58458112,"data_stored":58278514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":716372421},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574967,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":827012,"kb_used_data":94588,"kb_used_omap":1,"kb_used_meta":732414,"kb_avail":93544828,"statfs":{"total":96636764160,"available":95789903872,"internally_reserved":0,"allocated":96858112,"data_stored":96670557,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":749992389},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574966,"num_pgs":58,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":830660,"kb_used_data":106876,"kb_used_omap":1,"kb_used_meta":723774,"kb_avail":93541180,"statfs":{"total":96636764160,"available":95786168320,"internally_reserved":0,"allocated":109441024,"data_stored":109254605,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":741145031},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574968,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":520948,"kb_used_data":24940,"kb_used_omap":1,"kb_used_meta":495998,"kb_avail":93850892,"statfs":{"total":96636764160,"available":96103313408,"internally_reserved":0,"allocated":25538560,"data_stored":25367229,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":507902405},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574967,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":751212,"kb_used_data":110884,"kb_used_omap":1,"kb_used_meta":640318,"kb_avail":93620628,"statfs":{"total":96636764160,"available":95867523072,"internally_reserved":0,"allocated":113545216,"data_stored":113360216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":655686085},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574970,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":604392,"kb_used_data":45920,"kb_used_omap":1,"kb_used_meta":558462,"kb_avail":93767448,"statfs":{"total":96636764160,"available":96017866752,"internally_reserved":0,"allocated":47022080,"data_stored":46841504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":571865541},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":29372416,"data_stored":29360766,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":41951232,"data_stored":41943200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12673024,"data_stored":12671093,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":33652736,"data_stored":33643285,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":46149632,"data_stored":46137470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":29364224,"data_stored":29360218,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":48824320,"data_stored":48813882,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":57208832,"data_stored":57202400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16777216,"data_stored":16777216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":71315456,"data_stored":71303862,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12587008,"data_stored":12582982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":75509760,"data_stored":75498166,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":50429952,"data_stored":50419933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28815360,"data_stored":28805142,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":37113856,"data_stored":37105513,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":25169920,"data_stored":25165914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T23:50:12.111 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-04-26T23:40:40.651867+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=40, tm_sec=40, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=49, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:50:12.112 INFO:tasks.ceph:pgid 2.1d last_scrub_stamp 2024-04-26T23:40:30.548321+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=40, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=49, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:50:12.112 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-04-26T23:40:40.651867+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=40, tm_sec=40, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=49, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:50:12.112 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2024-04-26T23:40:40.651867+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=40, tm_sec=40, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=49, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:50:12.112 INFO:tasks.ceph:pgid 2.b last_scrub_stamp 2024-04-26T23:40:30.548321+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=40, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=49, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:50:12.112 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-04-26T23:40:31.552707+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=40, tm_sec=31, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=49, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:50:12.112 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-04-26T23:40:40.651867+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=40, tm_sec=40, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=49, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:50:12.112 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-04-26T23:40:40.651867+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=40, tm_sec=40, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=49, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:50:12.113 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-04-26T23:40:40.651867+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=40, tm_sec=40, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=49, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:50:12.113 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2024-04-26T23:40:40.651867+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=40, tm_sec=40, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=49, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:50:12.113 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-04-26T23:40:40.651867+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=40, tm_sec=40, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=49, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:50:12.113 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-04-26T23:40:40.651867+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=40, tm_sec=40, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=49, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:50:12.113 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-04-26T23:40:40.651867+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=40, tm_sec=40, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=49, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:50:12.114 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-04-26T23:40:40.651867+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=40, tm_sec=40, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=49, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:50:12.114 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-04-26T23:40:40.651867+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=40, tm_sec=40, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=49, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:50:12.114 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-04-26T23:40:40.651867+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=40, tm_sec=40, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=49, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:50:12.114 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-04-26T23:40:40.651867+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=40, tm_sec=40, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=49, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:50:12.114 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-04-26T23:40:31.552707+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=40, tm_sec=31, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=49, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:50:12.114 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-04-26T23:40:40.651867+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=40, tm_sec=40, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=49, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:50:12.115 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2024-04-26T23:40:40.651867+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=40, tm_sec=40, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=49, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:50:12.115 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-04-26T23:40:31.552707+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=40, tm_sec=31, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=49, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:50:12.115 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-04-26T23:40:40.651867+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=40, tm_sec=40, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=49, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:50:12.115 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-04-26T23:40:40.651867+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=40, tm_sec=40, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=49, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:50:12.115 INFO:tasks.ceph:pgid 5.26 last_scrub_stamp 2024-04-26T23:40:40.651867+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=40, tm_sec=40, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=49, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:50:12.115 INFO:tasks.ceph:pgid 5.25 last_scrub_stamp 2024-04-26T23:40:40.651867+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=40, tm_sec=40, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=49, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:50:12.116 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-04-26T23:40:31.552707+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=40, tm_sec=31, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=49, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:50:12.116 INFO:tasks.ceph:pgid 5.23 last_scrub_stamp 2024-04-26T23:40:40.651867+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=40, tm_sec=40, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=49, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:50:12.116 INFO:tasks.ceph:pgid 5.20 last_scrub_stamp 2024-04-26T23:40:40.651867+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=40, tm_sec=40, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=49, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:50:12.116 INFO:tasks.ceph:pgid 5.21 last_scrub_stamp 2024-04-26T23:40:40.651867+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=40, tm_sec=40, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=49, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:50:12.116 INFO:tasks.ceph:pgid 5.2e last_scrub_stamp 2024-04-26T23:40:40.651867+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=40, tm_sec=40, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=49, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:50:12.116 INFO:tasks.ceph:pgid 5.2d last_scrub_stamp 2024-04-26T23:40:40.651867+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=40, tm_sec=40, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=49, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:50:12.116 INFO:tasks.ceph:pgid 5.2a last_scrub_stamp 2024-04-26T23:40:40.651867+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=40, tm_sec=40, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=49, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:50:12.117 INFO:tasks.ceph:pgid 5.36 last_scrub_stamp 2024-04-26T23:40:40.651867+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=40, tm_sec=40, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=49, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:50:12.117 INFO:tasks.ceph:pgid 5.37 last_scrub_stamp 2024-04-26T23:40:40.651867+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=40, tm_sec=40, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=49, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:50:12.117 INFO:tasks.ceph:pgid 5.34 last_scrub_stamp 2024-04-26T23:40:40.651867+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=40, tm_sec=40, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=49, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:50:12.117 INFO:tasks.ceph:pgid 5.35 last_scrub_stamp 2024-04-26T23:40:40.651867+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=40, tm_sec=40, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=49, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:50:12.117 INFO:tasks.ceph:pgid 5.30 last_scrub_stamp 2024-04-26T23:40:40.651867+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=40, tm_sec=40, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=49, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:50:12.117 INFO:tasks.ceph:pgid 5.31 last_scrub_stamp 2024-04-26T23:40:40.651867+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=40, tm_sec=40, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=49, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:50:12.117 INFO:tasks.ceph:pgid 5.3e last_scrub_stamp 2024-04-26T23:40:40.651867+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=40, tm_sec=40, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=49, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:50:12.117 INFO:tasks.ceph:pgid 5.3d last_scrub_stamp 2024-04-26T23:40:40.651867+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=40, tm_sec=40, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=49, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:50:12.118 INFO:tasks.ceph:pgid 5.38 last_scrub_stamp 2024-04-26T23:40:40.651867+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=40, tm_sec=40, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=49, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:50:12.118 INFO:tasks.ceph:pgid 5.39 last_scrub_stamp 2024-04-26T23:40:40.651867+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=40, tm_sec=40, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=49, tm_sec=46, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:50:12.118 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-26T23:50:32.118 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T23:50:32.228 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:32.223+0000 7fc75ae09640 1 Processor -- start 2024-04-26T23:50:32.228 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:32.223+0000 7fc75ae09640 1 -- start start 2024-04-26T23:50:32.229 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:32.224+0000 7fc75ae09640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fc7540ca5a0 0x7fc754156bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:32.229 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:32.224+0000 7fc75ae09640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc75415a1a0 0x7fc7540c9590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:32.229 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:32.224+0000 7fc75ae09640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc7540c8df0 con 0x7fc754154160 2024-04-26T23:50:32.229 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:32.224+0000 7fc75ae09640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7fc7540c9100 con 0x7fc75415a1a0 2024-04-26T23:50:32.229 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:32.224+0000 7fc75ae09640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7fc754154540 con 0x7fc7540ca5a0 2024-04-26T23:50:32.229 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:32.224+0000 7fc7593a6640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc75415a1a0 0x7fc7540c9590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:32.230 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:32.224+0000 7fc7593a6640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc75415a1a0 0x7fc7540c9590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:60644/0 (socket says 172.21.15.88:60644) 2024-04-26T23:50:32.230 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:32.224+0000 7fc7593a6640 1 -- 172.21.15.88:0/2824989713 learned_addr learned my addr 172.21.15.88:0/2824989713 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:50:32.230 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:32.224+0000 7fc753fff640 1 --2- 172.21.15.88:0/2824989713 >> v2:172.21.15.175:3300/0 conn(0x7fc7540ca5a0 0x7fc754156bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:32.230 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:32.225+0000 7fc7593a6640 1 -- 172.21.15.88:0/2824989713 >> v2:172.21.15.175:3300/0 conn(0x7fc7540ca5a0 msgr2=0x7fc754156bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:50:32.230 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:32.225+0000 7fc7593a6640 1 --2- 172.21.15.88:0/2824989713 >> v2:172.21.15.175:3300/0 conn(0x7fc7540ca5a0 0x7fc754156bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:32.230 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:32.225+0000 7fc7593a6640 1 -- 172.21.15.88:0/2824989713 >> v1:172.21.15.175:6789/0 conn(0x7fc754154160 legacy=0x7fc7540c6e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:32.230 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:32.225+0000 7fc7593a6640 1 -- 172.21.15.88:0/2824989713 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc75415a910 con 0x7fc75415a1a0 2024-04-26T23:50:32.231 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:32.225+0000 7fc7593a6640 1 --2- 172.21.15.88:0/2824989713 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc75415a1a0 0x7fc7540c9590 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fc7540c9280 tx=0x7fc74c02a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c916cf66ccc642e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:50:32.232 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:32.225+0000 7fc7537fe640 1 -- 172.21.15.88:0/2824989713 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc74c036070 con 0x7fc75415a1a0 2024-04-26T23:50:32.232 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:32.225+0000 7fc7537fe640 1 -- 172.21.15.88:0/2824989713 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc74c031600 con 0x7fc75415a1a0 2024-04-26T23:50:32.232 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:32.226+0000 7fc7537fe640 1 -- 172.21.15.88:0/2824989713 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc74c0319d0 con 0x7fc75415a1a0 2024-04-26T23:50:32.232 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:32.226+0000 7fc75ae09640 1 -- 172.21.15.88:0/2824989713 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc75415a1a0 msgr2=0x7fc7540c9590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:32.232 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:32.226+0000 7fc75ae09640 1 --2- 172.21.15.88:0/2824989713 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc75415a1a0 0x7fc7540c9590 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fc7540c9280 tx=0x7fc74c02a730 comp rx=0 tx=0).stop 2024-04-26T23:50:32.232 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:32.226+0000 7fc75ae09640 1 -- 172.21.15.88:0/2824989713 shutdown_connections 2024-04-26T23:50:32.232 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:32.226+0000 7fc75ae09640 1 --2- 172.21.15.88:0/2824989713 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc75415a1a0 0x7fc7540c9590 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:32.232 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:32.226+0000 7fc75ae09640 1 --2- 172.21.15.88:0/2824989713 >> v2:172.21.15.175:3300/0 conn(0x7fc7540ca5a0 0x7fc754156bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:32.232 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:32.226+0000 7fc75ae09640 1 -- 172.21.15.88:0/2824989713 >> 172.21.15.88:0/2824989713 conn(0x7fc7540ae010 msgr2=0x7fc7540ae3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:50:32.232 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:32.226+0000 7fc75ae09640 1 -- 172.21.15.88:0/2824989713 shutdown_connections 2024-04-26T23:50:32.232 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:32.226+0000 7fc75ae09640 1 -- 172.21.15.88:0/2824989713 wait complete. 2024-04-26T23:50:32.232 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:32.227+0000 7fc75ae09640 1 Processor -- start 2024-04-26T23:50:32.232 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:32.227+0000 7fc75ae09640 1 -- start start 2024-04-26T23:50:32.235 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:32.228+0000 7fc75ae09640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc7540ca5a0 0x7fc754149d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:32.235 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:32.228+0000 7fc75ae09640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc754154160 0x7fc754156d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:32.235 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:32.228+0000 7fc75ae09640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc75415a1a0 0x7fc7541f01e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:32.235 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:32.228+0000 7fc75ae09640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fc75415a5b0 con 0x7fc754154160 2024-04-26T23:50:32.235 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:32.228+0000 7fc75ae09640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc75415aed0 con 0x7fc75415a1a0 2024-04-26T23:50:32.235 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:32.228+0000 7fc75ae09640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fc7540c7510 con 0x7fc7540ca5a0 2024-04-26T23:50:32.235 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:32.228+0000 7fc753fff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc754154160 0x7fc754156d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:32.235 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:32.228+0000 7fc753fff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc754154160 0x7fc754156d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:60652/0 (socket says 172.21.15.88:60652) 2024-04-26T23:50:32.235 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:32.228+0000 7fc753fff640 1 -- 172.21.15.88:0/3673367293 learned_addr learned my addr 172.21.15.88:0/3673367293 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:50:32.235 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:32.228+0000 7fc7593a6640 1 --2- 172.21.15.88:0/3673367293 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc75415a1a0 0x7fc7541f01e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:32.235 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:32.228+0000 7fc758ba5640 1 --2- 172.21.15.88:0/3673367293 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc7540ca5a0 0x7fc754149d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:32.235 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:32.228+0000 7fc753fff640 1 -- 172.21.15.88:0/3673367293 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc7540ca5a0 msgr2=0x7fc754149d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:32.236 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:32.228+0000 7fc753fff640 1 --2- 172.21.15.88:0/3673367293 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc7540ca5a0 0x7fc754149d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:32.236 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:32.229+0000 7fc753fff640 1 -- 172.21.15.88:0/3673367293 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc75415a1a0 msgr2=0x7fc7541f01e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:32.236 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:32.229+0000 7fc753fff640 1 --2- 172.21.15.88:0/3673367293 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc75415a1a0 0x7fc7541f01e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:32.236 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:32.229+0000 7fc753fff640 1 -- 172.21.15.88:0/3673367293 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7540c3760 con 0x7fc754154160 2024-04-26T23:50:32.236 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:32.229+0000 7fc7593a6640 1 --2- 172.21.15.88:0/3673367293 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc75415a1a0 0x7fc7541f01e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:50:32.236 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:32.229+0000 7fc758ba5640 1 --2- 172.21.15.88:0/3673367293 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc7540ca5a0 0x7fc754149d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:50:32.236 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:32.229+0000 7fc753fff640 1 --2- 172.21.15.88:0/3673367293 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc754154160 0x7fc754156d50 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fc74800d800 tx=0x7fc74800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:50:32.236 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:32.229+0000 7fc7517fa640 1 -- 172.21.15.88:0/3673367293 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc74800b6c0 con 0x7fc754154160 2024-04-26T23:50:32.236 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:32.229+0000 7fc7517fa640 1 -- 172.21.15.88:0/3673367293 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc748019070 con 0x7fc754154160 2024-04-26T23:50:32.236 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:32.229+0000 7fc75ae09640 1 -- 172.21.15.88:0/3673367293 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7540c40d0 con 0x7fc754154160 2024-04-26T23:50:32.236 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:32.229+0000 7fc7517fa640 1 -- 172.21.15.88:0/3673367293 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc74800ba80 con 0x7fc754154160 2024-04-26T23:50:32.236 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:32.229+0000 7fc75ae09640 1 -- 172.21.15.88:0/3673367293 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7540c6440 con 0x7fc754154160 2024-04-26T23:50:32.236 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:32.230+0000 7fc75ae09640 1 -- 172.21.15.88:0/3673367293 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc754076650 con 0x7fc754154160 2024-04-26T23:50:32.236 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:32.230+0000 7fc7517fa640 1 -- 172.21.15.88:0/3673367293 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc74800bc20 con 0x7fc754154160 2024-04-26T23:50:32.237 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:32.231+0000 7fc7517fa640 1 --2- 172.21.15.88:0/3673367293 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fc74006c8f0 0x7fc74006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:32.237 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:32.231+0000 7fc7517fa640 1 -- 172.21.15.88:0/3673367293 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6666+0+0 (secure 0 0 0) 0x7fc74808c400 con 0x7fc754154160 2024-04-26T23:50:32.237 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:32.231+0000 7fc758ba5640 1 --2- 172.21.15.88:0/3673367293 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fc74006c8f0 0x7fc74006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:32.237 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:32.231+0000 7fc758ba5640 1 --2- 172.21.15.88:0/3673367293 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fc74006c8f0 0x7fc74006edb0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fc744001680 tx=0x7fc744009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:50:32.239 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:32.235+0000 7fc7517fa640 1 -- 172.21.15.88:0/3673367293 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fc74801c360 con 0x7fc754154160 2024-04-26T23:50:32.412 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:32.407+0000 7fc75ae09640 1 -- 172.21.15.88:0/3673367293 --> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc7540c7da0 con 0x7fc74006c8f0 2024-04-26T23:50:32.423 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:32.419+0000 7fc7517fa640 1 -- 172.21.15.88:0/3673367293 <== mgr.4104 v2:172.21.15.88:6832/651674297 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+495544 (secure 0 0 0) 0x7fc7540c7da0 con 0x7fc74006c8f0 2024-04-26T23:50:32.429 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-26T23:50:32.432 INFO:teuthology.orchestra.run.smithi088.stderr:dumped all 2024-04-26T23:50:32.434 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:32.423+0000 7fc75ae09640 1 -- 172.21.15.88:0/3673367293 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fc74006c8f0 msgr2=0x7fc74006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:32.434 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:32.423+0000 7fc75ae09640 1 --2- 172.21.15.88:0/3673367293 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fc74006c8f0 0x7fc74006edb0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fc744001680 tx=0x7fc744009040 comp rx=0 tx=0).stop 2024-04-26T23:50:32.434 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:32.423+0000 7fc75ae09640 1 -- 172.21.15.88:0/3673367293 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc754154160 msgr2=0x7fc754156d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:32.434 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:32.423+0000 7fc75ae09640 1 --2- 172.21.15.88:0/3673367293 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc754154160 0x7fc754156d50 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fc74800d800 tx=0x7fc74800dcc0 comp rx=0 tx=0).stop 2024-04-26T23:50:32.434 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:32.423+0000 7fc75ae09640 1 -- 172.21.15.88:0/3673367293 shutdown_connections 2024-04-26T23:50:32.434 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:32.423+0000 7fc75ae09640 1 --2- 172.21.15.88:0/3673367293 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fc74006c8f0 0x7fc74006edb0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:32.434 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:32.423+0000 7fc75ae09640 1 --2- 172.21.15.88:0/3673367293 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc75415a1a0 0x7fc7541f01e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:32.434 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:32.423+0000 7fc75ae09640 1 --2- 172.21.15.88:0/3673367293 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc754154160 0x7fc754156d50 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:32.434 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:32.423+0000 7fc75ae09640 1 --2- 172.21.15.88:0/3673367293 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc7540ca5a0 0x7fc754149d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:32.435 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:32.423+0000 7fc75ae09640 1 -- 172.21.15.88:0/3673367293 >> 172.21.15.88:0/3673367293 conn(0x7fc7540ae010 msgr2=0x7fc7541501b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:50:32.435 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:32.423+0000 7fc75ae09640 1 -- 172.21.15.88:0/3673367293 shutdown_connections 2024-04-26T23:50:32.435 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:32.423+0000 7fc75ae09640 1 -- 172.21.15.88:0/3673367293 wait complete. 2024-04-26T23:50:32.439 INFO:teuthology.orchestra.run.smithi088.stdout:{"pg_ready":true,"pg_map":{"version":326,"stamp":"2024-04-26T23:50:32.121926+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":308985889,"num_objects":120,"num_object_clones":0,"num_object_copies":240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":120,"num_whiteouts":0,"num_read":149,"num_read_kb":293,"num_write":8375229,"num_write_kb":107315379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":10000,"num_omap_keys":20,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":561233,"ondisk_log_size":561233,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":386,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":5728608,"kb_used_data":605792,"kb_used_omap":12,"kb_used_meta":5122739,"kb_avail":749246112,"statfs":{"total":773094113280,"available":767228018688,"internally_reserved":0,"allocated":620331008,"data_stored":618877010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":5245685296},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003817"},"pg_stats":[{"pgid":"5.18","version":"26'4255","reported_seq":4284,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:50:05.391812+0000","last_change":"2024-04-26T23:50:05.391812+0000","last_active":"2024-04-26T23:50:05.391812+0000","last_peered":"2024-04-26T23:50:05.391812+0000","last_clean":"2024-04-26T23:50:05.391812+0000","last_became_active":"2024-04-26T23:40:41.683484+0000","last_became_peered":"2024-04-26T23:40:41.683484+0000","last_unstale":"2024-04-26T23:50:05.391812+0000","last_undegraded":"2024-04-26T23:50:05.391812+0000","last_fullsized":"2024-04-26T23:50:05.391812+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4255","last_scrub_stamp":"2024-04-26T23:50:05.391661+0000","last_deep_scrub":"26'4255","last_deep_scrub_stamp":"2024-04-26T23:50:05.391661+0000","last_clean_scrub_stamp":"2024-04-26T23:50:05.391661+0000","objects_scrubbed":0,"log_size":4255,"log_dups_size":0,"ondisk_log_size":4255,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:45:40.130359+0000","scrub_duration":17,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":63732,"num_write_kb":854695,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1f","version":"26'18","reported_seq":57,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:53.754704+0000","last_change":"2024-04-26T23:49:53.754737+0000","last_active":"2024-04-26T23:49:53.754704+0000","last_peered":"2024-04-26T23:49:53.754704+0000","last_clean":"2024-04-26T23:49:53.754704+0000","last_became_active":"2024-04-26T23:40:31.576429+0000","last_became_peered":"2024-04-26T23:40:31.576429+0000","last_unstale":"2024-04-26T23:49:53.754704+0000","last_undegraded":"2024-04-26T23:49:53.754704+0000","last_fullsized":"2024-04-26T23:49:53.754704+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'18","last_scrub_stamp":"2024-04-26T23:49:53.754620+0000","last_deep_scrub":"26'18","last_deep_scrub_stamp":"2024-04-26T23:49:53.754620+0000","last_clean_scrub_stamp":"2024-04-26T23:49:53.754620+0000","objects_scrubbed":3,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:02:11.596734+0000","scrub_duration":40,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":4100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"26'4412","reported_seq":4449,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:50:08.320651+0000","last_change":"2024-04-26T23:50:08.320675+0000","last_active":"2024-04-26T23:50:08.320651+0000","last_peered":"2024-04-26T23:50:08.320651+0000","last_clean":"2024-04-26T23:50:08.320651+0000","last_became_active":"2024-04-26T23:40:32.578205+0000","last_became_peered":"2024-04-26T23:40:32.578205+0000","last_unstale":"2024-04-26T23:50:08.320651+0000","last_undegraded":"2024-04-26T23:50:08.320651+0000","last_fullsized":"2024-04-26T23:50:08.320651+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4412","last_scrub_stamp":"2024-04-26T23:50:08.320560+0000","last_deep_scrub":"26'4412","last_deep_scrub_stamp":"2024-04-26T23:50:08.320560+0000","last_clean_scrub_stamp":"2024-04-26T23:50:08.320560+0000","objects_scrubbed":0,"log_size":4412,"log_dups_size":0,"ondisk_log_size":4412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:27:22.517395+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":66444,"num_write_kb":860244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"26'24","reported_seq":55,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:52.230301+0000","last_change":"2024-04-26T23:49:52.230301+0000","last_active":"2024-04-26T23:49:52.230301+0000","last_peered":"2024-04-26T23:49:52.230301+0000","last_clean":"2024-04-26T23:49:52.230301+0000","last_became_active":"2024-04-26T23:40:40.666547+0000","last_became_peered":"2024-04-26T23:40:40.666547+0000","last_unstale":"2024-04-26T23:49:52.230301+0000","last_undegraded":"2024-04-26T23:49:52.230301+0000","last_fullsized":"2024-04-26T23:49:52.230301+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'24","last_scrub_stamp":"2024-04-26T23:49:52.230163+0000","last_deep_scrub":"26'24","last_deep_scrub_stamp":"2024-04-26T23:49:52.230163+0000","last_clean_scrub_stamp":"2024-04-26T23:49:52.230163+0000","objects_scrubbed":1,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:55:02.271377+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":4105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"26'5312","reported_seq":5340,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:50:08.354214+0000","last_change":"2024-04-26T23:50:08.354262+0000","last_active":"2024-04-26T23:50:08.354214+0000","last_peered":"2024-04-26T23:50:08.354214+0000","last_clean":"2024-04-26T23:50:08.354214+0000","last_became_active":"2024-04-26T23:40:41.687652+0000","last_became_peered":"2024-04-26T23:40:41.687652+0000","last_unstale":"2024-04-26T23:50:08.354214+0000","last_undegraded":"2024-04-26T23:50:08.354214+0000","last_fullsized":"2024-04-26T23:50:08.354214+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5312","last_scrub_stamp":"2024-04-26T23:50:08.354077+0000","last_deep_scrub":"26'5312","last_deep_scrub_stamp":"2024-04-26T23:50:08.354077+0000","last_clean_scrub_stamp":"2024-04-26T23:50:08.354077+0000","objects_scrubbed":0,"log_size":5312,"log_dups_size":0,"ondisk_log_size":5312,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:49:36.192384+0000","scrub_duration":29,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79884,"num_write_kb":1001634,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1e","version":"26'30","reported_seq":69,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:50:06.302999+0000","last_change":"2024-04-26T23:50:06.303029+0000","last_active":"2024-04-26T23:50:06.302999+0000","last_peered":"2024-04-26T23:50:06.302999+0000","last_clean":"2024-04-26T23:50:06.302999+0000","last_became_active":"2024-04-26T23:40:31.576342+0000","last_became_peered":"2024-04-26T23:40:31.576342+0000","last_unstale":"2024-04-26T23:50:06.302999+0000","last_undegraded":"2024-04-26T23:50:06.302999+0000","last_fullsized":"2024-04-26T23:50:06.302999+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'30","last_scrub_stamp":"2024-04-26T23:50:06.302919+0000","last_deep_scrub":"26'30","last_deep_scrub_stamp":"2024-04-26T23:50:06.302919+0000","last_clean_scrub_stamp":"2024-04-26T23:50:06.302919+0000","objects_scrubbed":1,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:02:49.707068+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":4114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"26'5109","reported_seq":5132,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:50:05.431971+0000","last_change":"2024-04-26T23:50:05.431994+0000","last_active":"2024-04-26T23:50:05.431971+0000","last_peered":"2024-04-26T23:50:05.431971+0000","last_clean":"2024-04-26T23:50:05.431971+0000","last_became_active":"2024-04-26T23:41:30.628139+0000","last_became_peered":"2024-04-26T23:41:30.628139+0000","last_unstale":"2024-04-26T23:50:05.431971+0000","last_undegraded":"2024-04-26T23:50:05.431971+0000","last_fullsized":"2024-04-26T23:50:05.431971+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5109","last_scrub_stamp":"2024-04-26T23:50:05.431851+0000","last_deep_scrub":"26'5109","last_deep_scrub_stamp":"2024-04-26T23:50:05.431851+0000","last_clean_scrub_stamp":"2024-04-26T23:50:05.431851+0000","objects_scrubbed":0,"log_size":5109,"log_dups_size":0,"ondisk_log_size":5109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:05:04.383619+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":76507,"num_write_kb":979233,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"26'27","reported_seq":58,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:50:03.379529+0000","last_change":"2024-04-26T23:50:03.379529+0000","last_active":"2024-04-26T23:50:03.379529+0000","last_peered":"2024-04-26T23:50:03.379529+0000","last_clean":"2024-04-26T23:50:03.379529+0000","last_became_active":"2024-04-26T23:40:40.672018+0000","last_became_peered":"2024-04-26T23:40:40.672018+0000","last_unstale":"2024-04-26T23:50:03.379529+0000","last_undegraded":"2024-04-26T23:50:03.379529+0000","last_fullsized":"2024-04-26T23:50:03.379529+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'27","last_scrub_stamp":"2024-04-26T23:50:03.379346+0000","last_deep_scrub":"26'27","last_deep_scrub_stamp":"2024-04-26T23:50:03.379346+0000","last_clean_scrub_stamp":"2024-04-26T23:50:03.379346+0000","objects_scrubbed":2,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:00:30.645844+0000","scrub_duration":22,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":8211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"26'3926","reported_seq":3954,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:50:14.655824+0000","last_change":"2024-04-26T23:50:14.655871+0000","last_active":"2024-04-26T23:50:14.655824+0000","last_peered":"2024-04-26T23:50:14.655824+0000","last_clean":"2024-04-26T23:50:14.655824+0000","last_became_active":"2024-04-26T23:40:41.686419+0000","last_became_peered":"2024-04-26T23:40:41.686419+0000","last_unstale":"2024-04-26T23:50:14.655824+0000","last_undegraded":"2024-04-26T23:50:14.655824+0000","last_fullsized":"2024-04-26T23:50:14.655824+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3926","last_scrub_stamp":"2024-04-26T23:50:14.655686+0000","last_deep_scrub":"26'3926","last_deep_scrub_stamp":"2024-04-26T23:50:14.655686+0000","last_clean_scrub_stamp":"2024-04-26T23:50:14.655686+0000","objects_scrubbed":0,"log_size":3926,"log_dups_size":0,"ondisk_log_size":3926,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:03:28.722914+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":59060,"num_write_kb":735586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1d","version":"26'50","reported_seq":88,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:50:09.651889+0000","last_change":"2024-04-26T23:50:09.651921+0000","last_active":"2024-04-26T23:50:09.651889+0000","last_peered":"2024-04-26T23:50:09.651889+0000","last_clean":"2024-04-26T23:50:09.651889+0000","last_became_active":"2024-04-26T23:40:31.578438+0000","last_became_peered":"2024-04-26T23:40:31.578438+0000","last_unstale":"2024-04-26T23:50:09.651889+0000","last_undegraded":"2024-04-26T23:50:09.651889+0000","last_fullsized":"2024-04-26T23:50:09.651889+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'50","last_scrub_stamp":"2024-04-26T23:50:09.651801+0000","last_deep_scrub":"26'50","last_deep_scrub_stamp":"2024-04-26T23:50:09.651801+0000","last_clean_scrub_stamp":"2024-04-26T23:50:09.651801+0000","objects_scrubbed":4,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:02:53.055950+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37,"num_write_kb":12306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"26'2988","reported_seq":3024,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:51.739362+0000","last_change":"2024-04-26T23:49:51.739434+0000","last_active":"2024-04-26T23:49:51.739362+0000","last_peered":"2024-04-26T23:49:51.739362+0000","last_clean":"2024-04-26T23:49:51.739362+0000","last_became_active":"2024-04-26T23:40:32.589687+0000","last_became_peered":"2024-04-26T23:40:32.589687+0000","last_unstale":"2024-04-26T23:49:51.739362+0000","last_undegraded":"2024-04-26T23:49:51.739362+0000","last_fullsized":"2024-04-26T23:49:51.739362+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2988","last_scrub_stamp":"2024-04-26T23:49:51.739256+0000","last_deep_scrub":"26'2988","last_deep_scrub_stamp":"2024-04-26T23:49:51.739256+0000","last_clean_scrub_stamp":"2024-04-26T23:49:51.739256+0000","objects_scrubbed":0,"log_size":2988,"log_dups_size":0,"ondisk_log_size":2988,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:38:40.981723+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44847,"num_write_kb":570063,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"26'1256","reported_seq":1286,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:50.418998+0000","last_change":"2024-04-26T23:49:50.419054+0000","last_active":"2024-04-26T23:49:50.418998+0000","last_peered":"2024-04-26T23:49:50.418998+0000","last_clean":"2024-04-26T23:49:50.418998+0000","last_became_active":"2024-04-26T23:40:40.677388+0000","last_became_peered":"2024-04-26T23:40:40.677388+0000","last_unstale":"2024-04-26T23:49:50.418998+0000","last_undegraded":"2024-04-26T23:49:50.418998+0000","last_fullsized":"2024-04-26T23:49:50.418998+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'1256","last_scrub_stamp":"2024-04-26T23:49:50.418881+0000","last_deep_scrub":"26'1256","last_deep_scrub_stamp":"2024-04-26T23:49:50.418881+0000","last_clean_scrub_stamp":"2024-04-26T23:49:50.418881+0000","objects_scrubbed":1,"log_size":1256,"log_dups_size":0,"ondisk_log_size":1256,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:59:17.712255+0000","scrub_duration":20,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1253,"num_write_kb":5260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"26'3559","reported_seq":3587,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:50:10.683682+0000","last_change":"2024-04-26T23:50:10.683716+0000","last_active":"2024-04-26T23:50:10.683682+0000","last_peered":"2024-04-26T23:50:10.683682+0000","last_clean":"2024-04-26T23:50:10.683682+0000","last_became_active":"2024-04-26T23:40:41.679815+0000","last_became_peered":"2024-04-26T23:40:41.679815+0000","last_unstale":"2024-04-26T23:50:10.683682+0000","last_undegraded":"2024-04-26T23:50:10.683682+0000","last_fullsized":"2024-04-26T23:50:10.683682+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3559","last_scrub_stamp":"2024-04-26T23:50:10.683553+0000","last_deep_scrub":"26'3559","last_deep_scrub_stamp":"2024-04-26T23:50:10.683553+0000","last_clean_scrub_stamp":"2024-04-26T23:50:10.683553+0000","objects_scrubbed":0,"log_size":3559,"log_dups_size":0,"ondisk_log_size":3559,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:20:08.786567+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53503,"num_write_kb":665423,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"26'19","reported_seq":57,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:50:04.530084+0000","last_change":"2024-04-26T23:50:04.530118+0000","last_active":"2024-04-26T23:50:04.530084+0000","last_peered":"2024-04-26T23:50:04.530084+0000","last_clean":"2024-04-26T23:50:04.530084+0000","last_became_active":"2024-04-26T23:40:31.573347+0000","last_became_peered":"2024-04-26T23:40:31.573347+0000","last_unstale":"2024-04-26T23:50:04.530084+0000","last_undegraded":"2024-04-26T23:50:04.530084+0000","last_fullsized":"2024-04-26T23:50:04.530084+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'19","last_scrub_stamp":"2024-04-26T23:50:04.530003+0000","last_deep_scrub":"26'19","last_deep_scrub_stamp":"2024-04-26T23:50:04.530003+0000","last_clean_scrub_stamp":"2024-04-26T23:50:04.530003+0000","objects_scrubbed":2,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:30:38.828005+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":4100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"26'5057","reported_seq":5093,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:53.680937+0000","last_change":"2024-04-26T23:49:53.680979+0000","last_active":"2024-04-26T23:49:53.680937+0000","last_peered":"2024-04-26T23:49:53.680937+0000","last_clean":"2024-04-26T23:49:53.680937+0000","last_became_active":"2024-04-26T23:40:32.588007+0000","last_became_peered":"2024-04-26T23:40:32.588007+0000","last_unstale":"2024-04-26T23:49:53.680937+0000","last_undegraded":"2024-04-26T23:49:53.680937+0000","last_fullsized":"2024-04-26T23:49:53.680937+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5057","last_scrub_stamp":"2024-04-26T23:49:53.680823+0000","last_deep_scrub":"26'5057","last_deep_scrub_stamp":"2024-04-26T23:49:53.680823+0000","last_clean_scrub_stamp":"2024-04-26T23:49:53.680823+0000","objects_scrubbed":0,"log_size":5057,"log_dups_size":0,"ondisk_log_size":5057,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:37:07.677729+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":75905,"num_write_kb":967615,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"26'36","reported_seq":66,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:53.477833+0000","last_change":"2024-04-26T23:49:53.477863+0000","last_active":"2024-04-26T23:49:53.477833+0000","last_peered":"2024-04-26T23:49:53.477833+0000","last_clean":"2024-04-26T23:49:53.477833+0000","last_became_active":"2024-04-26T23:40:40.677668+0000","last_became_peered":"2024-04-26T23:40:40.677668+0000","last_unstale":"2024-04-26T23:49:53.477833+0000","last_undegraded":"2024-04-26T23:49:53.477833+0000","last_fullsized":"2024-04-26T23:49:53.477833+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'36","last_scrub_stamp":"2024-04-26T23:49:53.477743+0000","last_deep_scrub":"26'36","last_deep_scrub_stamp":"2024-04-26T23:49:53.477743+0000","last_clean_scrub_stamp":"2024-04-26T23:49:53.477743+0000","objects_scrubbed":3,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:02:54.484361+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":12307,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"26'4803","reported_seq":4832,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:50:10.276287+0000","last_change":"2024-04-26T23:50:10.276314+0000","last_active":"2024-04-26T23:50:10.276287+0000","last_peered":"2024-04-26T23:50:10.276287+0000","last_clean":"2024-04-26T23:50:10.276287+0000","last_became_active":"2024-04-26T23:40:41.687433+0000","last_became_peered":"2024-04-26T23:40:41.687433+0000","last_unstale":"2024-04-26T23:50:10.276287+0000","last_undegraded":"2024-04-26T23:50:10.276287+0000","last_fullsized":"2024-04-26T23:50:10.276287+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4803","last_scrub_stamp":"2024-04-26T23:50:10.276166+0000","last_deep_scrub":"26'4803","last_deep_scrub_stamp":"2024-04-26T23:50:10.276166+0000","last_clean_scrub_stamp":"2024-04-26T23:50:10.276166+0000","objects_scrubbed":0,"log_size":4803,"log_dups_size":0,"ondisk_log_size":4803,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:46:14.432424+0000","scrub_duration":43,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":72371,"num_write_kb":916696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"26'3820","reported_seq":3857,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:51.734669+0000","last_change":"2024-04-26T23:49:51.734696+0000","last_active":"2024-04-26T23:49:51.734669+0000","last_peered":"2024-04-26T23:49:51.734669+0000","last_clean":"2024-04-26T23:49:51.734669+0000","last_became_active":"2024-04-26T23:40:32.589802+0000","last_became_peered":"2024-04-26T23:40:32.589802+0000","last_unstale":"2024-04-26T23:49:51.734669+0000","last_undegraded":"2024-04-26T23:49:51.734669+0000","last_fullsized":"2024-04-26T23:49:51.734669+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3820","last_scrub_stamp":"2024-04-26T23:49:51.734555+0000","last_deep_scrub":"26'3820","last_deep_scrub_stamp":"2024-04-26T23:49:51.734555+0000","last_clean_scrub_stamp":"2024-04-26T23:49:51.734555+0000","objects_scrubbed":0,"log_size":3820,"log_dups_size":0,"ondisk_log_size":3820,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:31:52.347891+0000","scrub_duration":21,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":57277,"num_write_kb":731452,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"26'247","reported_seq":286,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:50:08.661826+0000","last_change":"2024-04-26T23:50:08.661870+0000","last_active":"2024-04-26T23:50:08.661826+0000","last_peered":"2024-04-26T23:50:08.661826+0000","last_clean":"2024-04-26T23:50:08.661826+0000","last_became_active":"2024-04-26T23:40:31.578230+0000","last_became_peered":"2024-04-26T23:40:31.578230+0000","last_unstale":"2024-04-26T23:50:08.661826+0000","last_undegraded":"2024-04-26T23:50:08.661826+0000","last_fullsized":"2024-04-26T23:50:08.661826+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'247","last_scrub_stamp":"2024-04-26T23:50:08.661723+0000","last_deep_scrub":"26'247","last_deep_scrub_stamp":"2024-04-26T23:50:08.661723+0000","last_clean_scrub_stamp":"2024-04-26T23:50:08.661723+0000","objects_scrubbed":3,"log_size":247,"log_dups_size":0,"ondisk_log_size":247,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:46:12.817981+0000","scrub_duration":20,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":234,"num_write_kb":8395,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"26'22","reported_seq":53,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:52.428857+0000","last_change":"2024-04-26T23:49:52.428887+0000","last_active":"2024-04-26T23:49:52.428857+0000","last_peered":"2024-04-26T23:49:52.428857+0000","last_clean":"2024-04-26T23:49:52.428857+0000","last_became_active":"2024-04-26T23:40:40.675997+0000","last_became_peered":"2024-04-26T23:40:40.675997+0000","last_unstale":"2024-04-26T23:49:52.428857+0000","last_undegraded":"2024-04-26T23:49:52.428857+0000","last_fullsized":"2024-04-26T23:49:52.428857+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'22","last_scrub_stamp":"2024-04-26T23:49:52.428766+0000","last_deep_scrub":"26'22","last_deep_scrub_stamp":"2024-04-26T23:49:52.428766+0000","last_clean_scrub_stamp":"2024-04-26T23:49:52.428766+0000","objects_scrubbed":2,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:17:56.678536+0000","scrub_duration":26,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":4105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"26'4643","reported_seq":4672,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:50:00.436807+0000","last_change":"2024-04-26T23:50:00.436853+0000","last_active":"2024-04-26T23:50:00.436807+0000","last_peered":"2024-04-26T23:50:00.436807+0000","last_clean":"2024-04-26T23:50:00.436807+0000","last_became_active":"2024-04-26T23:40:41.679098+0000","last_became_peered":"2024-04-26T23:40:41.679098+0000","last_unstale":"2024-04-26T23:50:00.436807+0000","last_undegraded":"2024-04-26T23:50:00.436807+0000","last_fullsized":"2024-04-26T23:50:00.436807+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4643","last_scrub_stamp":"2024-04-26T23:50:00.436670+0000","last_deep_scrub":"26'4643","last_deep_scrub_stamp":"2024-04-26T23:50:00.436670+0000","last_clean_scrub_stamp":"2024-04-26T23:50:00.436670+0000","objects_scrubbed":0,"log_size":4643,"log_dups_size":0,"ondisk_log_size":4643,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:45:58.911691+0000","scrub_duration":21,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69716,"num_write_kb":886548,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"26'3484","reported_seq":3521,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:50:10.360238+0000","last_change":"2024-04-26T23:50:10.360262+0000","last_active":"2024-04-26T23:50:10.360238+0000","last_peered":"2024-04-26T23:50:10.360238+0000","last_clean":"2024-04-26T23:50:10.360238+0000","last_became_active":"2024-04-26T23:40:32.585522+0000","last_became_peered":"2024-04-26T23:40:32.585522+0000","last_unstale":"2024-04-26T23:50:10.360238+0000","last_undegraded":"2024-04-26T23:50:10.360238+0000","last_fullsized":"2024-04-26T23:50:10.360238+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3484","last_scrub_stamp":"2024-04-26T23:50:10.360138+0000","last_deep_scrub":"26'3484","last_deep_scrub_stamp":"2024-04-26T23:50:10.360138+0000","last_clean_scrub_stamp":"2024-04-26T23:50:10.360138+0000","objects_scrubbed":0,"log_size":3484,"log_dups_size":0,"ondisk_log_size":3484,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:20:08.463152+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":52204,"num_write_kb":651184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"26'17","reported_seq":56,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:50:00.125503+0000","last_change":"2024-04-26T23:50:00.125532+0000","last_active":"2024-04-26T23:50:00.125503+0000","last_peered":"2024-04-26T23:50:00.125503+0000","last_clean":"2024-04-26T23:50:00.125503+0000","last_became_active":"2024-04-26T23:40:31.574827+0000","last_became_peered":"2024-04-26T23:40:31.574827+0000","last_unstale":"2024-04-26T23:50:00.125503+0000","last_undegraded":"2024-04-26T23:50:00.125503+0000","last_fullsized":"2024-04-26T23:50:00.125503+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'17","last_scrub_stamp":"2024-04-26T23:50:00.125405+0000","last_deep_scrub":"26'17","last_deep_scrub_stamp":"2024-04-26T23:50:00.125405+0000","last_clean_scrub_stamp":"2024-04-26T23:50:00.125405+0000","objects_scrubbed":1,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:24:19.515037+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":4101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"26'4","reported_seq":35,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:55.441150+0000","last_change":"2024-04-26T23:49:55.441528+0000","last_active":"2024-04-26T23:49:55.441150+0000","last_peered":"2024-04-26T23:49:55.441150+0000","last_clean":"2024-04-26T23:49:55.441150+0000","last_became_active":"2024-04-26T23:40:40.677867+0000","last_became_peered":"2024-04-26T23:40:40.677867+0000","last_unstale":"2024-04-26T23:49:55.441150+0000","last_undegraded":"2024-04-26T23:49:55.441150+0000","last_fullsized":"2024-04-26T23:49:55.441150+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4","last_scrub_stamp":"2024-04-26T23:49:55.441059+0000","last_deep_scrub":"26'4","last_deep_scrub_stamp":"2024-04-26T23:49:55.441059+0000","last_clean_scrub_stamp":"2024-04-26T23:49:55.441059+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:44:17.196965+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"26'4222","reported_seq":4251,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:50:06.356945+0000","last_change":"2024-04-26T23:50:06.356984+0000","last_active":"2024-04-26T23:50:06.356945+0000","last_peered":"2024-04-26T23:50:06.356945+0000","last_clean":"2024-04-26T23:50:06.356945+0000","last_became_active":"2024-04-26T23:40:41.684699+0000","last_became_peered":"2024-04-26T23:40:41.684699+0000","last_unstale":"2024-04-26T23:50:06.356945+0000","last_undegraded":"2024-04-26T23:50:06.356945+0000","last_fullsized":"2024-04-26T23:50:06.356945+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4222","last_scrub_stamp":"2024-04-26T23:50:06.356793+0000","last_deep_scrub":"26'4222","last_deep_scrub_stamp":"2024-04-26T23:50:06.356793+0000","last_clean_scrub_stamp":"2024-04-26T23:50:06.356793+0000","objects_scrubbed":0,"log_size":4222,"log_dups_size":0,"ondisk_log_size":4222,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:57:58.937625+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":63591,"num_write_kb":826339,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"26'4047","reported_seq":4084,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:50:09.323054+0000","last_change":"2024-04-26T23:50:09.323079+0000","last_active":"2024-04-26T23:50:09.323054+0000","last_peered":"2024-04-26T23:50:09.323054+0000","last_clean":"2024-04-26T23:50:09.323054+0000","last_became_active":"2024-04-26T23:40:32.582438+0000","last_became_peered":"2024-04-26T23:40:32.582438+0000","last_unstale":"2024-04-26T23:50:09.323054+0000","last_undegraded":"2024-04-26T23:50:09.323054+0000","last_fullsized":"2024-04-26T23:50:09.323054+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4047","last_scrub_stamp":"2024-04-26T23:50:09.322959+0000","last_deep_scrub":"26'4047","last_deep_scrub_stamp":"2024-04-26T23:50:09.322959+0000","last_clean_scrub_stamp":"2024-04-26T23:50:09.322959+0000","objects_scrubbed":0,"log_size":4047,"log_dups_size":0,"ondisk_log_size":4047,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:24:01.968503+0000","scrub_duration":21,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":60599,"num_write_kb":814129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"26'17","reported_seq":56,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:50:01.165956+0000","last_change":"2024-04-26T23:50:01.165985+0000","last_active":"2024-04-26T23:50:01.165956+0000","last_peered":"2024-04-26T23:50:01.165956+0000","last_clean":"2024-04-26T23:50:01.165956+0000","last_became_active":"2024-04-26T23:40:31.575242+0000","last_became_peered":"2024-04-26T23:40:31.575242+0000","last_unstale":"2024-04-26T23:50:01.165956+0000","last_undegraded":"2024-04-26T23:50:01.165956+0000","last_fullsized":"2024-04-26T23:50:01.165956+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'17","last_scrub_stamp":"2024-04-26T23:50:01.165856+0000","last_deep_scrub":"26'17","last_deep_scrub_stamp":"2024-04-26T23:50:01.165856+0000","last_clean_scrub_stamp":"2024-04-26T23:50:01.165856+0000","objects_scrubbed":1,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:00:28.432354+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":4101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"26'18","reported_seq":49,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:56.110174+0000","last_change":"2024-04-26T23:49:56.110208+0000","last_active":"2024-04-26T23:49:56.110174+0000","last_peered":"2024-04-26T23:49:56.110174+0000","last_clean":"2024-04-26T23:49:56.110174+0000","last_became_active":"2024-04-26T23:40:40.678740+0000","last_became_peered":"2024-04-26T23:40:40.678740+0000","last_unstale":"2024-04-26T23:49:56.110174+0000","last_undegraded":"2024-04-26T23:49:56.110174+0000","last_fullsized":"2024-04-26T23:49:56.110174+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'18","last_scrub_stamp":"2024-04-26T23:49:56.110078+0000","last_deep_scrub":"26'18","last_deep_scrub_stamp":"2024-04-26T23:49:56.110078+0000","last_clean_scrub_stamp":"2024-04-26T23:49:56.110078+0000","objects_scrubbed":2,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:37:10.106984+0000","scrub_duration":26,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":4110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"26'5270","reported_seq":5299,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:50:12.618482+0000","last_change":"2024-04-26T23:50:12.618508+0000","last_active":"2024-04-26T23:50:12.618482+0000","last_peered":"2024-04-26T23:50:12.618482+0000","last_clean":"2024-04-26T23:50:12.618482+0000","last_became_active":"2024-04-26T23:40:41.686354+0000","last_became_peered":"2024-04-26T23:40:41.686354+0000","last_unstale":"2024-04-26T23:50:12.618482+0000","last_undegraded":"2024-04-26T23:50:12.618482+0000","last_fullsized":"2024-04-26T23:50:12.618482+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5270","last_scrub_stamp":"2024-04-26T23:50:12.618374+0000","last_deep_scrub":"26'5270","last_deep_scrub_stamp":"2024-04-26T23:50:12.618374+0000","last_clean_scrub_stamp":"2024-04-26T23:50:12.618374+0000","objects_scrubbed":0,"log_size":5270,"log_dups_size":0,"ondisk_log_size":5270,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:03:26.685602+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79283,"num_write_kb":1000134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"26'4022","reported_seq":4059,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:58.403572+0000","last_change":"2024-04-26T23:49:58.403601+0000","last_active":"2024-04-26T23:49:58.403572+0000","last_peered":"2024-04-26T23:49:58.403572+0000","last_clean":"2024-04-26T23:49:58.403572+0000","last_became_active":"2024-04-26T23:40:32.582719+0000","last_became_peered":"2024-04-26T23:40:32.582719+0000","last_unstale":"2024-04-26T23:49:58.403572+0000","last_undegraded":"2024-04-26T23:49:58.403572+0000","last_fullsized":"2024-04-26T23:49:58.403572+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4022","last_scrub_stamp":"2024-04-26T23:49:58.403450+0000","last_deep_scrub":"26'4022","last_deep_scrub_stamp":"2024-04-26T23:49:58.403450+0000","last_clean_scrub_stamp":"2024-04-26T23:49:58.403450+0000","objects_scrubbed":0,"log_size":4022,"log_dups_size":0,"ondisk_log_size":4022,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:37:12.400356+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":60741,"num_write_kb":745879,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"26'20","reported_seq":59,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:50:07.637340+0000","last_change":"2024-04-26T23:50:07.637385+0000","last_active":"2024-04-26T23:50:07.637340+0000","last_peered":"2024-04-26T23:50:07.637340+0000","last_clean":"2024-04-26T23:50:07.637340+0000","last_became_active":"2024-04-26T23:40:31.576419+0000","last_became_peered":"2024-04-26T23:40:31.576419+0000","last_unstale":"2024-04-26T23:50:07.637340+0000","last_undegraded":"2024-04-26T23:50:07.637340+0000","last_fullsized":"2024-04-26T23:50:07.637340+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'20","last_scrub_stamp":"2024-04-26T23:50:07.637240+0000","last_deep_scrub":"26'20","last_deep_scrub_stamp":"2024-04-26T23:50:07.637240+0000","last_clean_scrub_stamp":"2024-04-26T23:50:07.637240+0000","objects_scrubbed":1,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:37:36.495897+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":4102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"26'20","reported_seq":51,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:56.422887+0000","last_change":"2024-04-26T23:49:56.422922+0000","last_active":"2024-04-26T23:49:56.422887+0000","last_peered":"2024-04-26T23:49:56.422887+0000","last_clean":"2024-04-26T23:49:56.422887+0000","last_became_active":"2024-04-26T23:40:40.674721+0000","last_became_peered":"2024-04-26T23:40:40.674721+0000","last_unstale":"2024-04-26T23:49:56.422887+0000","last_undegraded":"2024-04-26T23:49:56.422887+0000","last_fullsized":"2024-04-26T23:49:56.422887+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'20","last_scrub_stamp":"2024-04-26T23:49:56.422781+0000","last_deep_scrub":"26'20","last_deep_scrub_stamp":"2024-04-26T23:49:56.422781+0000","last_clean_scrub_stamp":"2024-04-26T23:49:56.422781+0000","objects_scrubbed":2,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:43:11.926125+0000","scrub_duration":18,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":4101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"26'4214","reported_seq":4243,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:50:19.469942+0000","last_change":"2024-04-26T23:50:19.469970+0000","last_active":"2024-04-26T23:50:19.469942+0000","last_peered":"2024-04-26T23:50:19.469942+0000","last_clean":"2024-04-26T23:50:19.469942+0000","last_became_active":"2024-04-26T23:40:41.691241+0000","last_became_peered":"2024-04-26T23:40:41.691241+0000","last_unstale":"2024-04-26T23:50:19.469942+0000","last_undegraded":"2024-04-26T23:50:19.469942+0000","last_fullsized":"2024-04-26T23:50:19.469942+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4214","last_scrub_stamp":"2024-04-26T23:50:19.469833+0000","last_deep_scrub":"26'4214","last_deep_scrub_stamp":"2024-04-26T23:50:19.469833+0000","last_clean_scrub_stamp":"2024-04-26T23:50:19.469833+0000","objects_scrubbed":0,"log_size":4214,"log_dups_size":0,"ondisk_log_size":4214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:48:33.834092+0000","scrub_duration":24,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":63038,"num_write_kb":829161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"26'3470","reported_seq":3507,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:55.766659+0000","last_change":"2024-04-26T23:49:55.766688+0000","last_active":"2024-04-26T23:49:55.766659+0000","last_peered":"2024-04-26T23:49:55.766659+0000","last_clean":"2024-04-26T23:49:55.766659+0000","last_became_active":"2024-04-26T23:40:32.584467+0000","last_became_peered":"2024-04-26T23:40:32.584467+0000","last_unstale":"2024-04-26T23:49:55.766659+0000","last_undegraded":"2024-04-26T23:49:55.766659+0000","last_fullsized":"2024-04-26T23:49:55.766659+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3470","last_scrub_stamp":"2024-04-26T23:49:55.766549+0000","last_deep_scrub":"26'3470","last_deep_scrub_stamp":"2024-04-26T23:49:55.766549+0000","last_clean_scrub_stamp":"2024-04-26T23:49:55.766549+0000","objects_scrubbed":0,"log_size":3470,"log_dups_size":0,"ondisk_log_size":3470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:47:06.462855+0000","scrub_duration":28,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51752,"num_write_kb":657341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"26'116","reported_seq":155,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:58.726251+0000","last_change":"2024-04-26T23:49:58.726284+0000","last_active":"2024-04-26T23:49:58.726251+0000","last_peered":"2024-04-26T23:49:58.726251+0000","last_clean":"2024-04-26T23:49:58.726251+0000","last_became_active":"2024-04-26T23:40:31.573434+0000","last_became_peered":"2024-04-26T23:40:31.573434+0000","last_unstale":"2024-04-26T23:49:58.726251+0000","last_undegraded":"2024-04-26T23:49:58.726251+0000","last_fullsized":"2024-04-26T23:49:58.726251+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'116","last_scrub_stamp":"2024-04-26T23:49:58.726166+0000","last_deep_scrub":"26'116","last_deep_scrub_stamp":"2024-04-26T23:49:58.726166+0000","last_clean_scrub_stamp":"2024-04-26T23:49:58.726166+0000","objects_scrubbed":2,"log_size":116,"log_dups_size":0,"ondisk_log_size":116,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:01:01.910494+0000","scrub_duration":21,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2675866,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":112,"num_write_kb":2659,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"26'20","reported_seq":69,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:51.399403+0000","last_change":"2024-04-26T23:49:51.399434+0000","last_active":"2024-04-26T23:49:51.399403+0000","last_peered":"2024-04-26T23:49:51.399403+0000","last_clean":"2024-04-26T23:49:51.399403+0000","last_became_active":"2024-04-26T23:40:40.677410+0000","last_became_peered":"2024-04-26T23:40:40.677410+0000","last_unstale":"2024-04-26T23:49:51.399403+0000","last_undegraded":"2024-04-26T23:49:51.399403+0000","last_fullsized":"2024-04-26T23:49:51.399403+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'20","last_scrub_stamp":"2024-04-26T23:49:51.399302+0000","last_deep_scrub":"26'20","last_deep_scrub_stamp":"2024-04-26T23:49:51.399302+0000","last_clean_scrub_stamp":"2024-04-26T23:49:51.399302+0000","objects_scrubbed":1,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:01:39.455014+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88181,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":98,"num_write":18,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"26'4396","reported_seq":4426,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:50:08.256610+0000","last_change":"2024-04-26T23:50:08.256657+0000","last_active":"2024-04-26T23:50:08.256610+0000","last_peered":"2024-04-26T23:50:08.256610+0000","last_clean":"2024-04-26T23:50:08.256610+0000","last_became_active":"2024-04-26T23:40:41.689508+0000","last_became_peered":"2024-04-26T23:40:41.689508+0000","last_unstale":"2024-04-26T23:50:08.256610+0000","last_undegraded":"2024-04-26T23:50:08.256610+0000","last_fullsized":"2024-04-26T23:50:08.256610+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4396","last_scrub_stamp":"2024-04-26T23:50:08.256512+0000","last_deep_scrub":"26'4396","last_deep_scrub_stamp":"2024-04-26T23:50:08.256512+0000","last_clean_scrub_stamp":"2024-04-26T23:50:08.256512+0000","objects_scrubbed":0,"log_size":4396,"log_dups_size":0,"ondisk_log_size":4396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:30:42.554514+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":66189,"num_write_kb":852725,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"26'4076","reported_seq":4113,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:54.232185+0000","last_change":"2024-04-26T23:49:54.232229+0000","last_active":"2024-04-26T23:49:54.232185+0000","last_peered":"2024-04-26T23:49:54.232185+0000","last_clean":"2024-04-26T23:49:54.232185+0000","last_became_active":"2024-04-26T23:40:32.594616+0000","last_became_peered":"2024-04-26T23:40:32.594616+0000","last_unstale":"2024-04-26T23:49:54.232185+0000","last_undegraded":"2024-04-26T23:49:54.232185+0000","last_fullsized":"2024-04-26T23:49:54.232185+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4076","last_scrub_stamp":"2024-04-26T23:49:54.231708+0000","last_deep_scrub":"26'4076","last_deep_scrub_stamp":"2024-04-26T23:49:54.231708+0000","last_clean_scrub_stamp":"2024-04-26T23:49:54.231708+0000","objects_scrubbed":0,"log_size":4076,"log_dups_size":0,"ondisk_log_size":4076,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:41:53.898700+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":61223,"num_write_kb":789949,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"26'262","reported_seq":301,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:50:02.138857+0000","last_change":"2024-04-26T23:50:02.138887+0000","last_active":"2024-04-26T23:50:02.138857+0000","last_peered":"2024-04-26T23:50:02.138857+0000","last_clean":"2024-04-26T23:50:02.138857+0000","last_became_active":"2024-04-26T23:40:31.576006+0000","last_became_peered":"2024-04-26T23:40:31.576006+0000","last_unstale":"2024-04-26T23:50:02.138857+0000","last_undegraded":"2024-04-26T23:50:02.138857+0000","last_fullsized":"2024-04-26T23:50:02.138857+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'262","last_scrub_stamp":"2024-04-26T23:50:02.138760+0000","last_deep_scrub":"26'262","last_deep_scrub_stamp":"2024-04-26T23:50:02.138760+0000","last_clean_scrub_stamp":"2024-04-26T23:50:02.138760+0000","objects_scrubbed":1,"log_size":262,"log_dups_size":0,"ondisk_log_size":262,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:43:06.700731+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":519,"num_write_kb":200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"26'28","reported_seq":59,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:53.200490+0000","last_change":"2024-04-26T23:49:53.200526+0000","last_active":"2024-04-26T23:49:53.200490+0000","last_peered":"2024-04-26T23:49:53.200490+0000","last_clean":"2024-04-26T23:49:53.200490+0000","last_became_active":"2024-04-26T23:40:40.674557+0000","last_became_peered":"2024-04-26T23:40:40.674557+0000","last_unstale":"2024-04-26T23:49:53.200490+0000","last_undegraded":"2024-04-26T23:49:53.200490+0000","last_fullsized":"2024-04-26T23:49:53.200490+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'28","last_scrub_stamp":"2024-04-26T23:49:53.200403+0000","last_deep_scrub":"26'28","last_deep_scrub_stamp":"2024-04-26T23:49:53.200403+0000","last_clean_scrub_stamp":"2024-04-26T23:49:53.200403+0000","objects_scrubbed":3,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:38:23.348289+0000","scrub_duration":28,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":12298,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"26'4705","reported_seq":4734,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:50:10.753035+0000","last_change":"2024-04-26T23:50:10.753064+0000","last_active":"2024-04-26T23:50:10.753035+0000","last_peered":"2024-04-26T23:50:10.753035+0000","last_clean":"2024-04-26T23:50:10.753035+0000","last_became_active":"2024-04-26T23:40:41.688653+0000","last_became_peered":"2024-04-26T23:40:41.688653+0000","last_unstale":"2024-04-26T23:50:10.753035+0000","last_undegraded":"2024-04-26T23:50:10.753035+0000","last_fullsized":"2024-04-26T23:50:10.753035+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4705","last_scrub_stamp":"2024-04-26T23:50:10.752924+0000","last_deep_scrub":"26'4705","last_deep_scrub_stamp":"2024-04-26T23:50:10.752924+0000","last_clean_scrub_stamp":"2024-04-26T23:50:10.752924+0000","objects_scrubbed":0,"log_size":4705,"log_dups_size":0,"ondisk_log_size":4705,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:50:04.113043+0000","scrub_duration":26,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":70754,"num_write_kb":894410,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"26'4242","reported_seq":4279,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:50:05.291246+0000","last_change":"2024-04-26T23:50:05.291271+0000","last_active":"2024-04-26T23:50:05.291246+0000","last_peered":"2024-04-26T23:50:05.291246+0000","last_clean":"2024-04-26T23:50:05.291246+0000","last_became_active":"2024-04-26T23:40:32.582140+0000","last_became_peered":"2024-04-26T23:40:32.582140+0000","last_unstale":"2024-04-26T23:50:05.291246+0000","last_undegraded":"2024-04-26T23:50:05.291246+0000","last_fullsized":"2024-04-26T23:50:05.291246+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4242","last_scrub_stamp":"2024-04-26T23:50:05.291125+0000","last_deep_scrub":"26'4242","last_deep_scrub_stamp":"2024-04-26T23:50:05.291125+0000","last_clean_scrub_stamp":"2024-04-26T23:50:05.291125+0000","objects_scrubbed":0,"log_size":4242,"log_dups_size":0,"ondisk_log_size":4242,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:01:01.835552+0000","scrub_duration":37,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":63708,"num_write_kb":831213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"26'17","reported_seq":56,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:50:06.598054+0000","last_change":"2024-04-26T23:50:06.598109+0000","last_active":"2024-04-26T23:50:06.598054+0000","last_peered":"2024-04-26T23:50:06.598054+0000","last_clean":"2024-04-26T23:50:06.598054+0000","last_became_active":"2024-04-26T23:40:31.576313+0000","last_became_peered":"2024-04-26T23:40:31.576313+0000","last_unstale":"2024-04-26T23:50:06.598054+0000","last_undegraded":"2024-04-26T23:50:06.598054+0000","last_fullsized":"2024-04-26T23:50:06.598054+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'17","last_scrub_stamp":"2024-04-26T23:50:06.597921+0000","last_deep_scrub":"26'17","last_deep_scrub_stamp":"2024-04-26T23:50:06.597921+0000","last_clean_scrub_stamp":"2024-04-26T23:50:06.597921+0000","objects_scrubbed":1,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:49:34.436228+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":4100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"26'2","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:49.757336+0000","last_change":"2024-04-26T23:49:49.757369+0000","last_active":"2024-04-26T23:49:49.757336+0000","last_peered":"2024-04-26T23:49:49.757336+0000","last_clean":"2024-04-26T23:49:49.757336+0000","last_became_active":"2024-04-26T23:40:40.670630+0000","last_became_peered":"2024-04-26T23:40:40.670630+0000","last_unstale":"2024-04-26T23:49:49.757336+0000","last_undegraded":"2024-04-26T23:49:49.757336+0000","last_fullsized":"2024-04-26T23:49:49.757336+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2","last_scrub_stamp":"2024-04-26T23:49:49.757262+0000","last_deep_scrub":"26'2","last_deep_scrub_stamp":"2024-04-26T23:49:49.757262+0000","last_clean_scrub_stamp":"2024-04-26T23:49:49.757262+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:09:10.195146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"26'4144","reported_seq":4173,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:50:04.697262+0000","last_change":"2024-04-26T23:50:04.697299+0000","last_active":"2024-04-26T23:50:04.697262+0000","last_peered":"2024-04-26T23:50:04.697262+0000","last_clean":"2024-04-26T23:50:04.697262+0000","last_became_active":"2024-04-26T23:40:41.685961+0000","last_became_peered":"2024-04-26T23:40:41.685961+0000","last_unstale":"2024-04-26T23:50:04.697262+0000","last_undegraded":"2024-04-26T23:50:04.697262+0000","last_fullsized":"2024-04-26T23:50:04.697262+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4144","last_scrub_stamp":"2024-04-26T23:50:04.697159+0000","last_deep_scrub":"26'4144","last_deep_scrub_stamp":"2024-04-26T23:50:04.697159+0000","last_clean_scrub_stamp":"2024-04-26T23:50:04.697159+0000","objects_scrubbed":0,"log_size":4144,"log_dups_size":0,"ondisk_log_size":4144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:33:51.380145+0000","scrub_duration":22,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":62474,"num_write_kb":825561,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"26'3719","reported_seq":3756,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:59.603110+0000","last_change":"2024-04-26T23:49:59.603137+0000","last_active":"2024-04-26T23:49:59.603110+0000","last_peered":"2024-04-26T23:49:59.603110+0000","last_clean":"2024-04-26T23:49:59.603110+0000","last_became_active":"2024-04-26T23:40:32.584082+0000","last_became_peered":"2024-04-26T23:40:32.584082+0000","last_unstale":"2024-04-26T23:49:59.603110+0000","last_undegraded":"2024-04-26T23:49:59.603110+0000","last_fullsized":"2024-04-26T23:49:59.603110+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3719","last_scrub_stamp":"2024-04-26T23:49:59.603012+0000","last_deep_scrub":"26'3719","last_deep_scrub_stamp":"2024-04-26T23:49:59.603012+0000","last_clean_scrub_stamp":"2024-04-26T23:49:59.603012+0000","objects_scrubbed":0,"log_size":3719,"log_dups_size":0,"ondisk_log_size":3719,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:45:34.341711+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55724,"num_write_kb":725978,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"26'6","reported_seq":45,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:50:03.167632+0000","last_change":"2024-04-26T23:50:03.167682+0000","last_active":"2024-04-26T23:50:03.167632+0000","last_peered":"2024-04-26T23:50:03.167632+0000","last_clean":"2024-04-26T23:50:03.167632+0000","last_became_active":"2024-04-26T23:40:31.576404+0000","last_became_peered":"2024-04-26T23:40:31.576404+0000","last_unstale":"2024-04-26T23:50:03.167632+0000","last_undegraded":"2024-04-26T23:50:03.167632+0000","last_fullsized":"2024-04-26T23:50:03.167632+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'6","last_scrub_stamp":"2024-04-26T23:50:03.167517+0000","last_deep_scrub":"26'6","last_deep_scrub_stamp":"2024-04-26T23:50:03.167517+0000","last_clean_scrub_stamp":"2024-04-26T23:50:03.167517+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:45:37.906215+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"26'33","reported_seq":64,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:50.159947+0000","last_change":"2024-04-26T23:49:50.159995+0000","last_active":"2024-04-26T23:49:50.159947+0000","last_peered":"2024-04-26T23:49:50.159947+0000","last_clean":"2024-04-26T23:49:50.159947+0000","last_became_active":"2024-04-26T23:40:40.674935+0000","last_became_peered":"2024-04-26T23:40:40.674935+0000","last_unstale":"2024-04-26T23:49:50.159947+0000","last_undegraded":"2024-04-26T23:49:50.159947+0000","last_fullsized":"2024-04-26T23:49:50.159947+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'33","last_scrub_stamp":"2024-04-26T23:49:50.159840+0000","last_deep_scrub":"26'33","last_deep_scrub_stamp":"2024-04-26T23:49:50.159840+0000","last_clean_scrub_stamp":"2024-04-26T23:49:50.159840+0000","objects_scrubbed":2,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:17:54.409611+0000","scrub_duration":20,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":8205,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"26'3990","reported_seq":4019,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:50:05.742998+0000","last_change":"2024-04-26T23:50:05.743027+0000","last_active":"2024-04-26T23:50:05.742998+0000","last_peered":"2024-04-26T23:50:05.742998+0000","last_clean":"2024-04-26T23:50:05.742998+0000","last_became_active":"2024-04-26T23:40:41.691242+0000","last_became_peered":"2024-04-26T23:40:41.691242+0000","last_unstale":"2024-04-26T23:50:05.742998+0000","last_undegraded":"2024-04-26T23:50:05.742998+0000","last_fullsized":"2024-04-26T23:50:05.742998+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3990","last_scrub_stamp":"2024-04-26T23:50:05.742888+0000","last_deep_scrub":"26'3990","last_deep_scrub_stamp":"2024-04-26T23:50:05.742888+0000","last_clean_scrub_stamp":"2024-04-26T23:50:05.742888+0000","objects_scrubbed":0,"log_size":3990,"log_dups_size":0,"ondisk_log_size":3990,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:21:54.853258+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":59849,"num_write_kb":777586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"26'3874","reported_seq":3911,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:50:00.370272+0000","last_change":"2024-04-26T23:50:00.370302+0000","last_active":"2024-04-26T23:50:00.370272+0000","last_peered":"2024-04-26T23:50:00.370272+0000","last_clean":"2024-04-26T23:50:00.370272+0000","last_became_active":"2024-04-26T23:40:32.589790+0000","last_became_peered":"2024-04-26T23:40:32.589790+0000","last_unstale":"2024-04-26T23:50:00.370272+0000","last_undegraded":"2024-04-26T23:50:00.370272+0000","last_fullsized":"2024-04-26T23:50:00.370272+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3874","last_scrub_stamp":"2024-04-26T23:50:00.370157+0000","last_deep_scrub":"26'3874","last_deep_scrub_stamp":"2024-04-26T23:50:00.370157+0000","last_clean_scrub_stamp":"2024-04-26T23:50:00.370157+0000","objects_scrubbed":0,"log_size":3874,"log_dups_size":0,"ondisk_log_size":3874,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:37:11.024686+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":58064,"num_write_kb":769321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"26'27","reported_seq":66,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:50:04.634272+0000","last_change":"2024-04-26T23:50:04.634302+0000","last_active":"2024-04-26T23:50:04.634272+0000","last_peered":"2024-04-26T23:50:04.634272+0000","last_clean":"2024-04-26T23:50:04.634272+0000","last_became_active":"2024-04-26T23:40:31.572121+0000","last_became_peered":"2024-04-26T23:40:31.572121+0000","last_unstale":"2024-04-26T23:50:04.634272+0000","last_undegraded":"2024-04-26T23:50:04.634272+0000","last_fullsized":"2024-04-26T23:50:04.634272+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'27","last_scrub_stamp":"2024-04-26T23:50:04.634193+0000","last_deep_scrub":"26'27","last_deep_scrub_stamp":"2024-04-26T23:50:04.634193+0000","last_clean_scrub_stamp":"2024-04-26T23:50:04.634193+0000","objects_scrubbed":2,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:49:32.472501+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":8200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"26'6","reported_seq":37,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:54.117590+0000","last_change":"2024-04-26T23:49:54.117618+0000","last_active":"2024-04-26T23:49:54.117590+0000","last_peered":"2024-04-26T23:49:54.117590+0000","last_clean":"2024-04-26T23:49:54.117590+0000","last_became_active":"2024-04-26T23:40:40.678136+0000","last_became_peered":"2024-04-26T23:40:40.678136+0000","last_unstale":"2024-04-26T23:49:54.117590+0000","last_undegraded":"2024-04-26T23:49:54.117590+0000","last_fullsized":"2024-04-26T23:49:54.117590+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'6","last_scrub_stamp":"2024-04-26T23:49:54.117492+0000","last_deep_scrub":"26'6","last_deep_scrub_stamp":"2024-04-26T23:49:54.117492+0000","last_clean_scrub_stamp":"2024-04-26T23:49:54.117492+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:43:09.620836+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"26'3876","reported_seq":3905,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:58.461860+0000","last_change":"2024-04-26T23:49:58.461914+0000","last_active":"2024-04-26T23:49:58.461860+0000","last_peered":"2024-04-26T23:49:58.461860+0000","last_clean":"2024-04-26T23:49:58.461860+0000","last_became_active":"2024-04-26T23:40:41.673254+0000","last_became_peered":"2024-04-26T23:40:41.673254+0000","last_unstale":"2024-04-26T23:49:58.461860+0000","last_undegraded":"2024-04-26T23:49:58.461860+0000","last_fullsized":"2024-04-26T23:49:58.461860+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3876","last_scrub_stamp":"2024-04-26T23:49:58.461736+0000","last_deep_scrub":"26'3876","last_deep_scrub_stamp":"2024-04-26T23:49:58.461736+0000","last_clean_scrub_stamp":"2024-04-26T23:49:58.461736+0000","objects_scrubbed":0,"log_size":3876,"log_dups_size":0,"ondisk_log_size":3876,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:01:01.646064+0000","scrub_duration":22,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":58020,"num_write_kb":724597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"26'3920","reported_seq":3957,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:50:04.226990+0000","last_change":"2024-04-26T23:50:04.227020+0000","last_active":"2024-04-26T23:50:04.226990+0000","last_peered":"2024-04-26T23:50:04.226990+0000","last_clean":"2024-04-26T23:50:04.226990+0000","last_became_active":"2024-04-26T23:40:32.576481+0000","last_became_peered":"2024-04-26T23:40:32.576481+0000","last_unstale":"2024-04-26T23:50:04.226990+0000","last_undegraded":"2024-04-26T23:50:04.226990+0000","last_fullsized":"2024-04-26T23:50:04.226990+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3920","last_scrub_stamp":"2024-04-26T23:50:04.226866+0000","last_deep_scrub":"26'3920","last_deep_scrub_stamp":"2024-04-26T23:50:04.226866+0000","last_clean_scrub_stamp":"2024-04-26T23:50:04.226866+0000","objects_scrubbed":0,"log_size":3920,"log_dups_size":0,"ondisk_log_size":3920,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:49:57.586986+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":58555,"num_write_kb":772397,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"26'17","reported_seq":71,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:51.392090+0000","last_change":"2024-04-26T23:49:51.392116+0000","last_active":"2024-04-26T23:49:51.392090+0000","last_peered":"2024-04-26T23:49:51.392090+0000","last_clean":"2024-04-26T23:49:51.392090+0000","last_became_active":"2024-04-26T23:40:31.570493+0000","last_became_peered":"2024-04-26T23:40:31.570493+0000","last_unstale":"2024-04-26T23:49:51.392090+0000","last_undegraded":"2024-04-26T23:49:51.392090+0000","last_fullsized":"2024-04-26T23:49:51.392090+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'17","last_scrub_stamp":"2024-04-26T23:49:51.392004+0000","last_deep_scrub":"26'17","last_deep_scrub_stamp":"2024-04-26T23:49:51.392004+0000","last_clean_scrub_stamp":"2024-04-26T23:49:51.392004+0000","objects_scrubbed":1,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:51:07.543004+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88181,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":95,"num_write":15,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"26'25","reported_seq":56,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:49.177310+0000","last_change":"2024-04-26T23:49:49.177336+0000","last_active":"2024-04-26T23:49:49.177310+0000","last_peered":"2024-04-26T23:49:49.177310+0000","last_clean":"2024-04-26T23:49:49.177310+0000","last_became_active":"2024-04-26T23:40:40.674828+0000","last_became_peered":"2024-04-26T23:40:40.674828+0000","last_unstale":"2024-04-26T23:49:49.177310+0000","last_undegraded":"2024-04-26T23:49:49.177310+0000","last_fullsized":"2024-04-26T23:49:49.177310+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'25","last_scrub_stamp":"2024-04-26T23:49:49.177242+0000","last_deep_scrub":"26'25","last_deep_scrub_stamp":"2024-04-26T23:49:49.177242+0000","last_clean_scrub_stamp":"2024-04-26T23:49:49.177242+0000","objects_scrubbed":2,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:01:37.232954+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":4104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"26'4513","reported_seq":4542,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:50:15.621402+0000","last_change":"2024-04-26T23:50:15.621447+0000","last_active":"2024-04-26T23:50:15.621402+0000","last_peered":"2024-04-26T23:50:15.621402+0000","last_clean":"2024-04-26T23:50:15.621402+0000","last_became_active":"2024-04-26T23:40:41.690803+0000","last_became_peered":"2024-04-26T23:40:41.690803+0000","last_unstale":"2024-04-26T23:50:15.621402+0000","last_undegraded":"2024-04-26T23:50:15.621402+0000","last_fullsized":"2024-04-26T23:50:15.621402+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4513","last_scrub_stamp":"2024-04-26T23:50:15.621294+0000","last_deep_scrub":"26'4513","last_deep_scrub_stamp":"2024-04-26T23:50:15.621294+0000","last_clean_scrub_stamp":"2024-04-26T23:50:15.621294+0000","objects_scrubbed":0,"log_size":4513,"log_dups_size":0,"ondisk_log_size":4513,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:07:02.896939+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":67888,"num_write_kb":829373,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"26'4011","reported_seq":4048,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:59.705909+0000","last_change":"2024-04-26T23:49:59.705936+0000","last_active":"2024-04-26T23:49:59.705909+0000","last_peered":"2024-04-26T23:49:59.705909+0000","last_clean":"2024-04-26T23:49:59.705909+0000","last_became_active":"2024-04-26T23:40:32.593003+0000","last_became_peered":"2024-04-26T23:40:32.593003+0000","last_unstale":"2024-04-26T23:49:59.705909+0000","last_undegraded":"2024-04-26T23:49:59.705909+0000","last_fullsized":"2024-04-26T23:49:59.705909+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4011","last_scrub_stamp":"2024-04-26T23:49:59.705466+0000","last_deep_scrub":"26'4011","last_deep_scrub_stamp":"2024-04-26T23:49:59.705466+0000","last_clean_scrub_stamp":"2024-04-26T23:49:59.705466+0000","objects_scrubbed":0,"log_size":4011,"log_dups_size":0,"ondisk_log_size":4011,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:37:13.702371+0000","scrub_duration":17,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":60122,"num_write_kb":778045,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"26'37","reported_seq":76,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:50:05.561243+0000","last_change":"2024-04-26T23:50:05.561276+0000","last_active":"2024-04-26T23:50:05.561243+0000","last_peered":"2024-04-26T23:50:05.561243+0000","last_clean":"2024-04-26T23:50:05.561243+0000","last_became_active":"2024-04-26T23:40:31.573594+0000","last_became_peered":"2024-04-26T23:40:31.573594+0000","last_unstale":"2024-04-26T23:50:05.561243+0000","last_undegraded":"2024-04-26T23:50:05.561243+0000","last_fullsized":"2024-04-26T23:50:05.561243+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'37","last_scrub_stamp":"2024-04-26T23:50:05.561165+0000","last_deep_scrub":"26'37","last_deep_scrub_stamp":"2024-04-26T23:50:05.561165+0000","last_clean_scrub_stamp":"2024-04-26T23:50:05.561165+0000","objects_scrubbed":2,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:07:15.189065+0000","scrub_duration":18,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":8204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"26'253","reported_seq":284,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:50:01.677753+0000","last_change":"2024-04-26T23:50:01.677797+0000","last_active":"2024-04-26T23:50:01.677753+0000","last_peered":"2024-04-26T23:50:01.677753+0000","last_clean":"2024-04-26T23:50:01.677753+0000","last_became_active":"2024-04-26T23:40:40.676937+0000","last_became_peered":"2024-04-26T23:40:40.676937+0000","last_unstale":"2024-04-26T23:50:01.677753+0000","last_undegraded":"2024-04-26T23:50:01.677753+0000","last_fullsized":"2024-04-26T23:50:01.677753+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'253","last_scrub_stamp":"2024-04-26T23:50:01.677655+0000","last_deep_scrub":"26'253","last_deep_scrub_stamp":"2024-04-26T23:50:01.677655+0000","last_clean_scrub_stamp":"2024-04-26T23:50:01.677655+0000","objects_scrubbed":1,"log_size":253,"log_dups_size":0,"ondisk_log_size":253,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:42:01.344647+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":475,"num_write_kb":168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"26'4528","reported_seq":4557,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:50:13.666818+0000","last_change":"2024-04-26T23:50:13.666866+0000","last_active":"2024-04-26T23:50:13.666818+0000","last_peered":"2024-04-26T23:50:13.666818+0000","last_clean":"2024-04-26T23:50:13.666818+0000","last_became_active":"2024-04-26T23:40:41.684459+0000","last_became_peered":"2024-04-26T23:40:41.684459+0000","last_unstale":"2024-04-26T23:50:13.666818+0000","last_undegraded":"2024-04-26T23:50:13.666818+0000","last_fullsized":"2024-04-26T23:50:13.666818+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4528","last_scrub_stamp":"2024-04-26T23:50:13.666670+0000","last_deep_scrub":"26'4528","last_deep_scrub_stamp":"2024-04-26T23:50:13.666670+0000","last_clean_scrub_stamp":"2024-04-26T23:50:13.666670+0000","objects_scrubbed":0,"log_size":4528,"log_dups_size":0,"ondisk_log_size":4528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:12:40.447480+0000","scrub_duration":17,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":68252,"num_write_kb":886817,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"26'4332","reported_seq":4369,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:58.199178+0000","last_change":"2024-04-26T23:49:58.199205+0000","last_active":"2024-04-26T23:49:58.199178+0000","last_peered":"2024-04-26T23:49:58.199178+0000","last_clean":"2024-04-26T23:49:58.199178+0000","last_became_active":"2024-04-26T23:40:32.592929+0000","last_became_peered":"2024-04-26T23:40:32.592929+0000","last_unstale":"2024-04-26T23:49:58.199178+0000","last_undegraded":"2024-04-26T23:49:58.199178+0000","last_fullsized":"2024-04-26T23:49:58.199178+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4332","last_scrub_stamp":"2024-04-26T23:49:58.199056+0000","last_deep_scrub":"26'4332","last_deep_scrub_stamp":"2024-04-26T23:49:58.199056+0000","last_clean_scrub_stamp":"2024-04-26T23:49:58.199056+0000","objects_scrubbed":0,"log_size":4332,"log_dups_size":0,"ondisk_log_size":4332,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:21:47.309425+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":65153,"num_write_kb":829422,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"26'2","reported_seq":41,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:50:02.632517+0000","last_change":"2024-04-26T23:50:02.632577+0000","last_active":"2024-04-26T23:50:02.632517+0000","last_peered":"2024-04-26T23:50:02.632517+0000","last_clean":"2024-04-26T23:50:02.632517+0000","last_became_active":"2024-04-26T23:40:31.569764+0000","last_became_peered":"2024-04-26T23:40:31.569764+0000","last_unstale":"2024-04-26T23:50:02.632517+0000","last_undegraded":"2024-04-26T23:50:02.632517+0000","last_fullsized":"2024-04-26T23:50:02.632517+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2","last_scrub_stamp":"2024-04-26T23:50:02.632385+0000","last_deep_scrub":"26'2","last_deep_scrub_stamp":"2024-04-26T23:50:02.632385+0000","last_clean_scrub_stamp":"2024-04-26T23:50:02.632385+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:30:36.930387+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"26'119","reported_seq":197,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:50:03.551754+0000","last_change":"2024-04-26T23:50:03.551812+0000","last_active":"2024-04-26T23:50:03.551754+0000","last_peered":"2024-04-26T23:50:03.551754+0000","last_clean":"2024-04-26T23:50:03.551754+0000","last_became_active":"2024-04-26T23:40:20.963937+0000","last_became_peered":"2024-04-26T23:40:20.963937+0000","last_unstale":"2024-04-26T23:50:03.551754+0000","last_undegraded":"2024-04-26T23:50:03.551754+0000","last_fullsized":"2024-04-26T23:50:03.551754+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'119","last_scrub_stamp":"2024-04-26T23:50:03.551669+0000","last_deep_scrub":"26'119","last_deep_scrub_stamp":"2024-04-26T23:50:03.551669+0000","last_clean_scrub_stamp":"2024-04-26T23:50:03.551669+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:01:00.096096+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"26'8","reported_seq":39,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:50:03.789702+0000","last_change":"2024-04-26T23:50:03.789757+0000","last_active":"2024-04-26T23:50:03.789702+0000","last_peered":"2024-04-26T23:50:03.789702+0000","last_clean":"2024-04-26T23:50:03.789702+0000","last_became_active":"2024-04-26T23:40:40.671642+0000","last_became_peered":"2024-04-26T23:40:40.671642+0000","last_unstale":"2024-04-26T23:50:03.789702+0000","last_undegraded":"2024-04-26T23:50:03.789702+0000","last_fullsized":"2024-04-26T23:50:03.789702+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'8","last_scrub_stamp":"2024-04-26T23:50:03.789597+0000","last_deep_scrub":"26'8","last_deep_scrub_stamp":"2024-04-26T23:50:03.789597+0000","last_clean_scrub_stamp":"2024-04-26T23:50:03.789597+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:55:13.830811+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"26'3796","reported_seq":3825,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:50:01.435562+0000","last_change":"2024-04-26T23:50:01.435589+0000","last_active":"2024-04-26T23:50:01.435562+0000","last_peered":"2024-04-26T23:50:01.435562+0000","last_clean":"2024-04-26T23:50:01.435562+0000","last_became_active":"2024-04-26T23:40:41.680567+0000","last_became_peered":"2024-04-26T23:40:41.680567+0000","last_unstale":"2024-04-26T23:50:01.435562+0000","last_undegraded":"2024-04-26T23:50:01.435562+0000","last_fullsized":"2024-04-26T23:50:01.435562+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3796","last_scrub_stamp":"2024-04-26T23:50:01.435455+0000","last_deep_scrub":"26'3796","last_deep_scrub_stamp":"2024-04-26T23:50:01.435455+0000","last_clean_scrub_stamp":"2024-04-26T23:50:01.435455+0000","objects_scrubbed":0,"log_size":3796,"log_dups_size":0,"ondisk_log_size":3796,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:38:50.677922+0000","scrub_duration":18,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":57172,"num_write_kb":707056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"26'4186","reported_seq":4223,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:56.505044+0000","last_change":"2024-04-26T23:49:56.505071+0000","last_active":"2024-04-26T23:49:56.505044+0000","last_peered":"2024-04-26T23:49:56.505044+0000","last_clean":"2024-04-26T23:49:56.505044+0000","last_became_active":"2024-04-26T23:40:32.590867+0000","last_became_peered":"2024-04-26T23:40:32.590867+0000","last_unstale":"2024-04-26T23:49:56.505044+0000","last_undegraded":"2024-04-26T23:49:56.505044+0000","last_fullsized":"2024-04-26T23:49:56.505044+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4186","last_scrub_stamp":"2024-04-26T23:49:56.504473+0000","last_deep_scrub":"26'4186","last_deep_scrub_stamp":"2024-04-26T23:49:56.504473+0000","last_clean_scrub_stamp":"2024-04-26T23:49:56.504473+0000","objects_scrubbed":0,"log_size":4186,"log_dups_size":0,"ondisk_log_size":4186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:38:26.652359+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":62827,"num_write_kb":810912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"26'3","reported_seq":42,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:53.384212+0000","last_change":"2024-04-26T23:49:53.384294+0000","last_active":"2024-04-26T23:49:53.384212+0000","last_peered":"2024-04-26T23:49:53.384212+0000","last_clean":"2024-04-26T23:49:53.384212+0000","last_became_active":"2024-04-26T23:40:31.571849+0000","last_became_peered":"2024-04-26T23:40:31.571849+0000","last_unstale":"2024-04-26T23:49:53.384212+0000","last_undegraded":"2024-04-26T23:49:53.384212+0000","last_fullsized":"2024-04-26T23:49:53.384212+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3","last_scrub_stamp":"2024-04-26T23:49:53.384112+0000","last_deep_scrub":"26'3","last_deep_scrub_stamp":"2024-04-26T23:49:53.384112+0000","last_clean_scrub_stamp":"2024-04-26T23:49:53.384112+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:12:41.482494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"26'7","reported_seq":38,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:50:05.757503+0000","last_change":"2024-04-26T23:50:05.757561+0000","last_active":"2024-04-26T23:50:05.757503+0000","last_peered":"2024-04-26T23:50:05.757503+0000","last_clean":"2024-04-26T23:50:05.757503+0000","last_became_active":"2024-04-26T23:40:40.676154+0000","last_became_peered":"2024-04-26T23:40:40.676154+0000","last_unstale":"2024-04-26T23:50:05.757503+0000","last_undegraded":"2024-04-26T23:50:05.757503+0000","last_fullsized":"2024-04-26T23:50:05.757503+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'7","last_scrub_stamp":"2024-04-26T23:50:05.757397+0000","last_deep_scrub":"26'7","last_deep_scrub_stamp":"2024-04-26T23:50:05.757397+0000","last_clean_scrub_stamp":"2024-04-26T23:50:05.757397+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:05:04.709165+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"26'3987","reported_seq":4016,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:50:02.444484+0000","last_change":"2024-04-26T23:50:02.444546+0000","last_active":"2024-04-26T23:50:02.444484+0000","last_peered":"2024-04-26T23:50:02.444484+0000","last_clean":"2024-04-26T23:50:02.444484+0000","last_became_active":"2024-04-26T23:40:41.687693+0000","last_became_peered":"2024-04-26T23:40:41.687693+0000","last_unstale":"2024-04-26T23:50:02.444484+0000","last_undegraded":"2024-04-26T23:50:02.444484+0000","last_fullsized":"2024-04-26T23:50:02.444484+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3987","last_scrub_stamp":"2024-04-26T23:50:02.444325+0000","last_deep_scrub":"26'3987","last_deep_scrub_stamp":"2024-04-26T23:50:02.444325+0000","last_clean_scrub_stamp":"2024-04-26T23:50:02.444325+0000","objects_scrubbed":0,"log_size":3987,"log_dups_size":0,"ondisk_log_size":3987,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:38:03.464695+0000","scrub_duration":18,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":60042,"num_write_kb":782772,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"26'4287","reported_seq":4324,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:50:01.605555+0000","last_change":"2024-04-26T23:50:01.605578+0000","last_active":"2024-04-26T23:50:01.605555+0000","last_peered":"2024-04-26T23:50:01.605555+0000","last_clean":"2024-04-26T23:50:01.605555+0000","last_became_active":"2024-04-26T23:40:32.583174+0000","last_became_peered":"2024-04-26T23:40:32.583174+0000","last_unstale":"2024-04-26T23:50:01.605555+0000","last_undegraded":"2024-04-26T23:50:01.605555+0000","last_fullsized":"2024-04-26T23:50:01.605555+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4287","last_scrub_stamp":"2024-04-26T23:50:01.605466+0000","last_deep_scrub":"26'4287","last_deep_scrub_stamp":"2024-04-26T23:50:01.605466+0000","last_clean_scrub_stamp":"2024-04-26T23:50:01.605466+0000","objects_scrubbed":0,"log_size":4287,"log_dups_size":0,"ondisk_log_size":4287,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:00:58.149893+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":64102,"num_write_kb":832828,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"26'8","reported_seq":47,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:58.129117+0000","last_change":"2024-04-26T23:49:58.129172+0000","last_active":"2024-04-26T23:49:58.129117+0000","last_peered":"2024-04-26T23:49:58.129117+0000","last_clean":"2024-04-26T23:49:58.129117+0000","last_became_active":"2024-04-26T23:40:31.571427+0000","last_became_peered":"2024-04-26T23:40:31.571427+0000","last_unstale":"2024-04-26T23:49:58.129117+0000","last_undegraded":"2024-04-26T23:49:58.129117+0000","last_fullsized":"2024-04-26T23:49:58.129117+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'8","last_scrub_stamp":"2024-04-26T23:49:58.128984+0000","last_deep_scrub":"26'8","last_deep_scrub_stamp":"2024-04-26T23:49:58.128984+0000","last_clean_scrub_stamp":"2024-04-26T23:49:58.128984+0000","objects_scrubbed":2,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:37:08.783514+0000","scrub_duration":26,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"26'158","reported_seq":189,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:50:00.701715+0000","last_change":"2024-04-26T23:50:00.701753+0000","last_active":"2024-04-26T23:50:00.701715+0000","last_peered":"2024-04-26T23:50:00.701715+0000","last_clean":"2024-04-26T23:50:00.701715+0000","last_became_active":"2024-04-26T23:40:40.675682+0000","last_became_peered":"2024-04-26T23:40:40.675682+0000","last_unstale":"2024-04-26T23:50:00.701715+0000","last_undegraded":"2024-04-26T23:50:00.701715+0000","last_fullsized":"2024-04-26T23:50:00.701715+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'158","last_scrub_stamp":"2024-04-26T23:50:00.701616+0000","last_deep_scrub":"26'158","last_deep_scrub_stamp":"2024-04-26T23:50:00.701616+0000","last_clean_scrub_stamp":"2024-04-26T23:50:00.701616+0000","objects_scrubbed":3,"log_size":158,"log_dups_size":0,"ondisk_log_size":158,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:38:30.849502+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":145,"num_write_kb":8318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"26'4190","reported_seq":4219,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:50:01.561109+0000","last_change":"2024-04-26T23:50:01.561155+0000","last_active":"2024-04-26T23:50:01.561109+0000","last_peered":"2024-04-26T23:50:01.561109+0000","last_clean":"2024-04-26T23:50:01.561109+0000","last_became_active":"2024-04-26T23:40:41.681069+0000","last_became_peered":"2024-04-26T23:40:41.681069+0000","last_unstale":"2024-04-26T23:50:01.561109+0000","last_undegraded":"2024-04-26T23:50:01.561109+0000","last_fullsized":"2024-04-26T23:50:01.561109+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4190","last_scrub_stamp":"2024-04-26T23:50:01.560946+0000","last_deep_scrub":"26'4190","last_deep_scrub_stamp":"2024-04-26T23:50:01.560946+0000","last_clean_scrub_stamp":"2024-04-26T23:50:01.560946+0000","objects_scrubbed":0,"log_size":4190,"log_dups_size":0,"ondisk_log_size":4190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:45:36.299644+0000","scrub_duration":16,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":63216,"num_write_kb":796499,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"26'4864","reported_seq":4901,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:53.473460+0000","last_change":"2024-04-26T23:49:53.473508+0000","last_active":"2024-04-26T23:49:53.473460+0000","last_peered":"2024-04-26T23:49:53.473460+0000","last_clean":"2024-04-26T23:49:53.473460+0000","last_became_active":"2024-04-26T23:40:32.595625+0000","last_became_peered":"2024-04-26T23:40:32.595625+0000","last_unstale":"2024-04-26T23:49:53.473460+0000","last_undegraded":"2024-04-26T23:49:53.473460+0000","last_fullsized":"2024-04-26T23:49:53.473460+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4864","last_scrub_stamp":"2024-04-26T23:49:53.473321+0000","last_deep_scrub":"26'4864","last_deep_scrub_stamp":"2024-04-26T23:49:53.473321+0000","last_clean_scrub_stamp":"2024-04-26T23:49:53.473321+0000","objects_scrubbed":0,"log_size":4864,"log_dups_size":0,"ondisk_log_size":4864,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:22:10.859650+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":72976,"num_write_kb":927582,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"26'25","reported_seq":64,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:52.422770+0000","last_change":"2024-04-26T23:49:52.422806+0000","last_active":"2024-04-26T23:49:52.422770+0000","last_peered":"2024-04-26T23:49:52.422770+0000","last_clean":"2024-04-26T23:49:52.422770+0000","last_became_active":"2024-04-26T23:40:31.570592+0000","last_became_peered":"2024-04-26T23:40:31.570592+0000","last_unstale":"2024-04-26T23:49:52.422770+0000","last_undegraded":"2024-04-26T23:49:52.422770+0000","last_fullsized":"2024-04-26T23:49:52.422770+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'25","last_scrub_stamp":"2024-04-26T23:49:52.422657+0000","last_deep_scrub":"26'25","last_deep_scrub_stamp":"2024-04-26T23:49:52.422657+0000","last_clean_scrub_stamp":"2024-04-26T23:49:52.422657+0000","objects_scrubbed":2,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:16:21.226539+0000","scrub_duration":22,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":4104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"26'9","reported_seq":40,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:54.670078+0000","last_change":"2024-04-26T23:49:54.670107+0000","last_active":"2024-04-26T23:49:54.670078+0000","last_peered":"2024-04-26T23:49:54.670078+0000","last_clean":"2024-04-26T23:49:54.670078+0000","last_became_active":"2024-04-26T23:40:40.672816+0000","last_became_peered":"2024-04-26T23:40:40.672816+0000","last_unstale":"2024-04-26T23:49:54.670078+0000","last_undegraded":"2024-04-26T23:49:54.670078+0000","last_fullsized":"2024-04-26T23:49:54.670078+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'9","last_scrub_stamp":"2024-04-26T23:49:54.669984+0000","last_deep_scrub":"26'9","last_deep_scrub_stamp":"2024-04-26T23:49:54.669984+0000","last_clean_scrub_stamp":"2024-04-26T23:49:54.669984+0000","objects_scrubbed":1,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:38:24.817870+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"26'4537","reported_seq":4566,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:59.474466+0000","last_change":"2024-04-26T23:49:59.474492+0000","last_active":"2024-04-26T23:49:59.474466+0000","last_peered":"2024-04-26T23:49:59.474466+0000","last_clean":"2024-04-26T23:49:59.474466+0000","last_became_active":"2024-04-26T23:40:41.678039+0000","last_became_peered":"2024-04-26T23:40:41.678039+0000","last_unstale":"2024-04-26T23:49:59.474466+0000","last_undegraded":"2024-04-26T23:49:59.474466+0000","last_fullsized":"2024-04-26T23:49:59.474466+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4537","last_scrub_stamp":"2024-04-26T23:49:59.474363+0000","last_deep_scrub":"26'4537","last_deep_scrub_stamp":"2024-04-26T23:49:59.474363+0000","last_clean_scrub_stamp":"2024-04-26T23:49:59.474363+0000","objects_scrubbed":0,"log_size":4537,"log_dups_size":0,"ondisk_log_size":4537,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:45:15.264899+0000","scrub_duration":29,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":68234,"num_write_kb":870585,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"26'4022","reported_seq":4059,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:54.459466+0000","last_change":"2024-04-26T23:49:54.459494+0000","last_active":"2024-04-26T23:49:54.459466+0000","last_peered":"2024-04-26T23:49:54.459466+0000","last_clean":"2024-04-26T23:49:54.459466+0000","last_became_active":"2024-04-26T23:40:32.593235+0000","last_became_peered":"2024-04-26T23:40:32.593235+0000","last_unstale":"2024-04-26T23:49:54.459466+0000","last_undegraded":"2024-04-26T23:49:54.459466+0000","last_fullsized":"2024-04-26T23:49:54.459466+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4022","last_scrub_stamp":"2024-04-26T23:49:54.459345+0000","last_deep_scrub":"26'4022","last_deep_scrub_stamp":"2024-04-26T23:49:54.459345+0000","last_clean_scrub_stamp":"2024-04-26T23:49:54.459345+0000","objects_scrubbed":0,"log_size":4022,"log_dups_size":0,"ondisk_log_size":4022,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:27:18.978881+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":60538,"num_write_kb":762431,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"26'11","reported_seq":50,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:57.427075+0000","last_change":"2024-04-26T23:49:57.427415+0000","last_active":"2024-04-26T23:49:57.427075+0000","last_peered":"2024-04-26T23:49:57.427075+0000","last_clean":"2024-04-26T23:49:57.427075+0000","last_became_active":"2024-04-26T23:40:31.575632+0000","last_became_peered":"2024-04-26T23:40:31.575632+0000","last_unstale":"2024-04-26T23:49:57.427075+0000","last_undegraded":"2024-04-26T23:49:57.427075+0000","last_fullsized":"2024-04-26T23:49:57.427075+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'11","last_scrub_stamp":"2024-04-26T23:49:57.426975+0000","last_deep_scrub":"26'11","last_deep_scrub_stamp":"2024-04-26T23:49:57.426975+0000","last_clean_scrub_stamp":"2024-04-26T23:49:57.426975+0000","objects_scrubbed":2,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:37:58.447345+0000","scrub_duration":17,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"26'8","reported_seq":39,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:54.436962+0000","last_change":"2024-04-26T23:49:54.436993+0000","last_active":"2024-04-26T23:49:54.436962+0000","last_peered":"2024-04-26T23:49:54.436962+0000","last_clean":"2024-04-26T23:49:54.436962+0000","last_became_active":"2024-04-26T23:40:40.675888+0000","last_became_peered":"2024-04-26T23:40:40.675888+0000","last_unstale":"2024-04-26T23:49:54.436962+0000","last_undegraded":"2024-04-26T23:49:54.436962+0000","last_fullsized":"2024-04-26T23:49:54.436962+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'8","last_scrub_stamp":"2024-04-26T23:49:54.436835+0000","last_deep_scrub":"26'8","last_deep_scrub_stamp":"2024-04-26T23:49:54.436835+0000","last_clean_scrub_stamp":"2024-04-26T23:49:54.436835+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:04:49.728016+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.17","version":"26'3934","reported_seq":3963,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:50:18.427267+0000","last_change":"2024-04-26T23:50:18.427267+0000","last_active":"2024-04-26T23:50:18.427267+0000","last_peered":"2024-04-26T23:50:18.427267+0000","last_clean":"2024-04-26T23:50:18.427267+0000","last_became_active":"2024-04-26T23:40:41.688224+0000","last_became_peered":"2024-04-26T23:40:41.688224+0000","last_unstale":"2024-04-26T23:50:18.427267+0000","last_undegraded":"2024-04-26T23:50:18.427267+0000","last_fullsized":"2024-04-26T23:50:18.427267+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3934","last_scrub_stamp":"2024-04-26T23:50:18.427144+0000","last_deep_scrub":"26'3934","last_deep_scrub_stamp":"2024-04-26T23:50:18.427144+0000","last_clean_scrub_stamp":"2024-04-26T23:50:18.427144+0000","objects_scrubbed":0,"log_size":3934,"log_dups_size":0,"ondisk_log_size":3934,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:56:04.576942+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":58974,"num_write_kb":744310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"26'3924","reported_seq":3961,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:52.521654+0000","last_change":"2024-04-26T23:49:52.521654+0000","last_active":"2024-04-26T23:49:52.521654+0000","last_peered":"2024-04-26T23:49:52.521654+0000","last_clean":"2024-04-26T23:49:52.521654+0000","last_became_active":"2024-04-26T23:40:32.593220+0000","last_became_peered":"2024-04-26T23:40:32.593220+0000","last_unstale":"2024-04-26T23:49:52.521654+0000","last_undegraded":"2024-04-26T23:49:52.521654+0000","last_fullsized":"2024-04-26T23:49:52.521654+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3924","last_scrub_stamp":"2024-04-26T23:49:52.521512+0000","last_deep_scrub":"26'3924","last_deep_scrub_stamp":"2024-04-26T23:49:52.521512+0000","last_clean_scrub_stamp":"2024-04-26T23:49:52.521512+0000","objects_scrubbed":0,"log_size":3924,"log_dups_size":0,"ondisk_log_size":3924,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:45:50.996533+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":58510,"num_write_kb":806052,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"26'56","reported_seq":95,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:54.370259+0000","last_change":"2024-04-26T23:49:54.370302+0000","last_active":"2024-04-26T23:49:54.370259+0000","last_peered":"2024-04-26T23:49:54.370259+0000","last_clean":"2024-04-26T23:49:54.370259+0000","last_became_active":"2024-04-26T23:40:31.572169+0000","last_became_peered":"2024-04-26T23:40:31.572169+0000","last_unstale":"2024-04-26T23:49:54.370259+0000","last_undegraded":"2024-04-26T23:49:54.370259+0000","last_fullsized":"2024-04-26T23:49:54.370259+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'56","last_scrub_stamp":"2024-04-26T23:49:54.370156+0000","last_deep_scrub":"26'56","last_deep_scrub_stamp":"2024-04-26T23:49:54.370156+0000","last_clean_scrub_stamp":"2024-04-26T23:49:54.370156+0000","objects_scrubbed":6,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:45:33.871261+0000","scrub_duration":26,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":8207,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"26'32","reported_seq":63,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:48.759625+0000","last_change":"2024-04-26T23:49:48.759625+0000","last_active":"2024-04-26T23:49:48.759625+0000","last_peered":"2024-04-26T23:49:48.759625+0000","last_clean":"2024-04-26T23:49:48.759625+0000","last_became_active":"2024-04-26T23:40:40.671875+0000","last_became_peered":"2024-04-26T23:40:40.671875+0000","last_unstale":"2024-04-26T23:49:48.759625+0000","last_undegraded":"2024-04-26T23:49:48.759625+0000","last_fullsized":"2024-04-26T23:49:48.759625+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'32","last_scrub_stamp":"2024-04-26T23:49:48.759477+0000","last_deep_scrub":"26'32","last_deep_scrub_stamp":"2024-04-26T23:49:48.759477+0000","last_clean_scrub_stamp":"2024-04-26T23:49:48.759477+0000","objects_scrubbed":1,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:16:17.563359+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":4110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"26'4518","reported_seq":4547,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:50:14.624682+0000","last_change":"2024-04-26T23:50:14.624682+0000","last_active":"2024-04-26T23:50:14.624682+0000","last_peered":"2024-04-26T23:50:14.624682+0000","last_clean":"2024-04-26T23:50:14.624682+0000","last_became_active":"2024-04-26T23:40:41.688053+0000","last_became_peered":"2024-04-26T23:40:41.688053+0000","last_unstale":"2024-04-26T23:50:14.624682+0000","last_undegraded":"2024-04-26T23:50:14.624682+0000","last_fullsized":"2024-04-26T23:50:14.624682+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4518","last_scrub_stamp":"2024-04-26T23:50:14.624558+0000","last_deep_scrub":"26'4518","last_deep_scrub_stamp":"2024-04-26T23:50:14.624558+0000","last_clean_scrub_stamp":"2024-04-26T23:50:14.624558+0000","objects_scrubbed":0,"log_size":4518,"log_dups_size":0,"ondisk_log_size":4518,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:02:51.742448+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":67755,"num_write_kb":851157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"26'4530","reported_seq":4567,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:54.797355+0000","last_change":"2024-04-26T23:49:54.797380+0000","last_active":"2024-04-26T23:49:54.797355+0000","last_peered":"2024-04-26T23:49:54.797355+0000","last_clean":"2024-04-26T23:49:54.797355+0000","last_became_active":"2024-04-26T23:40:32.585809+0000","last_became_peered":"2024-04-26T23:40:32.585809+0000","last_unstale":"2024-04-26T23:49:54.797355+0000","last_undegraded":"2024-04-26T23:49:54.797355+0000","last_fullsized":"2024-04-26T23:49:54.797355+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4530","last_scrub_stamp":"2024-04-26T23:49:54.797250+0000","last_deep_scrub":"26'4530","last_deep_scrub_stamp":"2024-04-26T23:49:54.797250+0000","last_clean_scrub_stamp":"2024-04-26T23:49:54.797250+0000","objects_scrubbed":0,"log_size":4530,"log_dups_size":0,"ondisk_log_size":4530,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:45:34.298354+0000","scrub_duration":25,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":67909,"num_write_kb":843744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"26'6","reported_seq":45,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:56.723118+0000","last_change":"2024-04-26T23:49:56.723118+0000","last_active":"2024-04-26T23:49:56.723118+0000","last_peered":"2024-04-26T23:49:56.723118+0000","last_clean":"2024-04-26T23:49:56.723118+0000","last_became_active":"2024-04-26T23:40:31.568598+0000","last_became_peered":"2024-04-26T23:40:31.568598+0000","last_unstale":"2024-04-26T23:49:56.723118+0000","last_undegraded":"2024-04-26T23:49:56.723118+0000","last_fullsized":"2024-04-26T23:49:56.723118+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'6","last_scrub_stamp":"2024-04-26T23:49:56.722963+0000","last_deep_scrub":"26'6","last_deep_scrub_stamp":"2024-04-26T23:49:56.722963+0000","last_clean_scrub_stamp":"2024-04-26T23:49:56.722963+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:01:44.778675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"26'2","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:50.255046+0000","last_change":"2024-04-26T23:49:50.255046+0000","last_active":"2024-04-26T23:49:50.255046+0000","last_peered":"2024-04-26T23:49:50.255046+0000","last_clean":"2024-04-26T23:49:50.255046+0000","last_became_active":"2024-04-26T23:40:40.673704+0000","last_became_peered":"2024-04-26T23:40:40.673704+0000","last_unstale":"2024-04-26T23:49:50.255046+0000","last_undegraded":"2024-04-26T23:49:50.255046+0000","last_fullsized":"2024-04-26T23:49:50.255046+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2","last_scrub_stamp":"2024-04-26T23:49:50.254917+0000","last_deep_scrub":"26'2","last_deep_scrub_stamp":"2024-04-26T23:49:50.254917+0000","last_clean_scrub_stamp":"2024-04-26T23:49:50.254917+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:22:07.641246+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"26'4215","reported_seq":4244,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:50:16.614632+0000","last_change":"2024-04-26T23:50:16.614632+0000","last_active":"2024-04-26T23:50:16.614632+0000","last_peered":"2024-04-26T23:50:16.614632+0000","last_clean":"2024-04-26T23:50:16.614632+0000","last_became_active":"2024-04-26T23:40:41.691160+0000","last_became_peered":"2024-04-26T23:40:41.691160+0000","last_unstale":"2024-04-26T23:50:16.614632+0000","last_undegraded":"2024-04-26T23:50:16.614632+0000","last_fullsized":"2024-04-26T23:50:16.614632+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4215","last_scrub_stamp":"2024-04-26T23:50:16.614474+0000","last_deep_scrub":"26'4215","last_deep_scrub_stamp":"2024-04-26T23:50:16.614474+0000","last_clean_scrub_stamp":"2024-04-26T23:50:16.614474+0000","objects_scrubbed":0,"log_size":4215,"log_dups_size":0,"ondisk_log_size":4215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:43:36.663142+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":63478,"num_write_kb":811778,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"26'4684","reported_seq":4721,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:51.564872+0000","last_change":"2024-04-26T23:49:51.564872+0000","last_active":"2024-04-26T23:49:51.564872+0000","last_peered":"2024-04-26T23:49:51.564872+0000","last_clean":"2024-04-26T23:49:51.564872+0000","last_became_active":"2024-04-26T23:40:32.595032+0000","last_became_peered":"2024-04-26T23:40:32.595032+0000","last_unstale":"2024-04-26T23:49:51.564872+0000","last_undegraded":"2024-04-26T23:49:51.564872+0000","last_fullsized":"2024-04-26T23:49:51.564872+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4684","last_scrub_stamp":"2024-04-26T23:49:51.564727+0000","last_deep_scrub":"26'4684","last_deep_scrub_stamp":"2024-04-26T23:49:51.564727+0000","last_clean_scrub_stamp":"2024-04-26T23:49:51.564727+0000","objects_scrubbed":0,"log_size":4684,"log_dups_size":0,"ondisk_log_size":4684,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:45:07.355262+0000","scrub_duration":16,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":70001,"num_write_kb":901416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"26'5","reported_seq":44,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:50:05.643628+0000","last_change":"2024-04-26T23:50:05.643655+0000","last_active":"2024-04-26T23:50:05.643628+0000","last_peered":"2024-04-26T23:50:05.643628+0000","last_clean":"2024-04-26T23:50:05.643628+0000","last_became_active":"2024-04-26T23:40:31.575039+0000","last_became_peered":"2024-04-26T23:40:31.575039+0000","last_unstale":"2024-04-26T23:50:05.643628+0000","last_undegraded":"2024-04-26T23:50:05.643628+0000","last_fullsized":"2024-04-26T23:50:05.643628+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5","last_scrub_stamp":"2024-04-26T23:50:05.643520+0000","last_deep_scrub":"26'5","last_deep_scrub_stamp":"2024-04-26T23:50:05.643520+0000","last_clean_scrub_stamp":"2024-04-26T23:50:05.643520+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:37:34.502177+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"26'250","reported_seq":281,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:57.201931+0000","last_change":"2024-04-26T23:49:57.201931+0000","last_active":"2024-04-26T23:49:57.201931+0000","last_peered":"2024-04-26T23:49:57.201931+0000","last_clean":"2024-04-26T23:49:57.201931+0000","last_became_active":"2024-04-26T23:40:40.676124+0000","last_became_peered":"2024-04-26T23:40:40.676124+0000","last_unstale":"2024-04-26T23:49:57.201931+0000","last_undegraded":"2024-04-26T23:49:57.201931+0000","last_fullsized":"2024-04-26T23:49:57.201931+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'250","last_scrub_stamp":"2024-04-26T23:49:57.201801+0000","last_deep_scrub":"26'250","last_deep_scrub_stamp":"2024-04-26T23:49:57.201801+0000","last_clean_scrub_stamp":"2024-04-26T23:49:57.201801+0000","objects_scrubbed":6,"log_size":250,"log_dups_size":0,"ondisk_log_size":250,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:33:43.884787+0000","scrub_duration":37,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583584,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":239,"num_write_kb":12458,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"26'6179","reported_seq":6208,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:50:14.407959+0000","last_change":"2024-04-26T23:50:14.407988+0000","last_active":"2024-04-26T23:50:14.407959+0000","last_peered":"2024-04-26T23:50:14.407959+0000","last_clean":"2024-04-26T23:50:14.407959+0000","last_became_active":"2024-04-26T23:40:41.680485+0000","last_became_peered":"2024-04-26T23:40:41.680485+0000","last_unstale":"2024-04-26T23:50:14.407959+0000","last_undegraded":"2024-04-26T23:50:14.407959+0000","last_fullsized":"2024-04-26T23:50:14.407959+0000","mapping_epoch":22,"log_start":"26'1000","ondisk_log_start":"26'1000","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'6179","last_scrub_stamp":"2024-04-26T23:50:14.407855+0000","last_deep_scrub":"26'6179","last_deep_scrub_stamp":"2024-04-26T23:50:14.407855+0000","last_clean_scrub_stamp":"2024-04-26T23:50:14.407855+0000","objects_scrubbed":0,"log_size":5179,"log_dups_size":0,"ondisk_log_size":5179,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:02:51.525744+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":93116,"num_write_kb":1152811,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"26'3934","reported_seq":3971,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:57.742765+0000","last_change":"2024-04-26T23:49:57.742765+0000","last_active":"2024-04-26T23:49:57.742765+0000","last_peered":"2024-04-26T23:49:57.742765+0000","last_clean":"2024-04-26T23:49:57.742765+0000","last_became_active":"2024-04-26T23:40:32.589452+0000","last_became_peered":"2024-04-26T23:40:32.589452+0000","last_unstale":"2024-04-26T23:49:57.742765+0000","last_undegraded":"2024-04-26T23:49:57.742765+0000","last_fullsized":"2024-04-26T23:49:57.742765+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3934","last_scrub_stamp":"2024-04-26T23:49:57.742585+0000","last_deep_scrub":"26'3934","last_deep_scrub_stamp":"2024-04-26T23:49:57.742585+0000","last_clean_scrub_stamp":"2024-04-26T23:49:57.742585+0000","objects_scrubbed":0,"log_size":3934,"log_dups_size":0,"ondisk_log_size":3934,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:38:46.985051+0000","scrub_duration":25,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":58864,"num_write_kb":755351,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"26'31","reported_seq":70,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:52.757879+0000","last_change":"2024-04-26T23:49:52.757879+0000","last_active":"2024-04-26T23:49:52.757879+0000","last_peered":"2024-04-26T23:49:52.757879+0000","last_clean":"2024-04-26T23:49:52.757879+0000","last_became_active":"2024-04-26T23:40:31.573668+0000","last_became_peered":"2024-04-26T23:40:31.573668+0000","last_unstale":"2024-04-26T23:49:52.757879+0000","last_undegraded":"2024-04-26T23:49:52.757879+0000","last_fullsized":"2024-04-26T23:49:52.757879+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'31","last_scrub_stamp":"2024-04-26T23:49:52.757694+0000","last_deep_scrub":"26'31","last_deep_scrub_stamp":"2024-04-26T23:49:52.757694+0000","last_clean_scrub_stamp":"2024-04-26T23:49:52.757694+0000","objects_scrubbed":4,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:01:40.813406+0000","scrub_duration":20,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":8209,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"26'29","reported_seq":60,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:56.664697+0000","last_change":"2024-04-26T23:49:56.664697+0000","last_active":"2024-04-26T23:49:56.664697+0000","last_peered":"2024-04-26T23:49:56.664697+0000","last_clean":"2024-04-26T23:49:56.664697+0000","last_became_active":"2024-04-26T23:40:40.676147+0000","last_became_peered":"2024-04-26T23:40:40.676147+0000","last_unstale":"2024-04-26T23:49:56.664697+0000","last_undegraded":"2024-04-26T23:49:56.664697+0000","last_fullsized":"2024-04-26T23:49:56.664697+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'29","last_scrub_stamp":"2024-04-26T23:49:56.664539+0000","last_deep_scrub":"26'29","last_deep_scrub_stamp":"2024-04-26T23:49:56.664539+0000","last_clean_scrub_stamp":"2024-04-26T23:49:56.664539+0000","objects_scrubbed":3,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:47:21.306973+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194394,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":4110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.13","version":"26'4994","reported_seq":5023,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:50:15.437587+0000","last_change":"2024-04-26T23:50:15.437616+0000","last_active":"2024-04-26T23:50:15.437587+0000","last_peered":"2024-04-26T23:50:15.437587+0000","last_clean":"2024-04-26T23:50:15.437587+0000","last_became_active":"2024-04-26T23:40:41.685403+0000","last_became_peered":"2024-04-26T23:40:41.685403+0000","last_unstale":"2024-04-26T23:50:15.437587+0000","last_undegraded":"2024-04-26T23:50:15.437587+0000","last_fullsized":"2024-04-26T23:50:15.437587+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4994","last_scrub_stamp":"2024-04-26T23:50:15.437475+0000","last_deep_scrub":"26'4994","last_deep_scrub_stamp":"2024-04-26T23:50:15.437475+0000","last_clean_scrub_stamp":"2024-04-26T23:50:15.437475+0000","objects_scrubbed":0,"log_size":4994,"log_dups_size":0,"ondisk_log_size":4994,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:07:02.713121+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":74752,"num_write_kb":961504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"26'3907","reported_seq":3944,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:50:10.602534+0000","last_change":"2024-04-26T23:50:10.602584+0000","last_active":"2024-04-26T23:50:10.602534+0000","last_peered":"2024-04-26T23:50:10.602534+0000","last_clean":"2024-04-26T23:50:10.602534+0000","last_became_active":"2024-04-26T23:40:32.587200+0000","last_became_peered":"2024-04-26T23:40:32.587200+0000","last_unstale":"2024-04-26T23:50:10.602534+0000","last_undegraded":"2024-04-26T23:50:10.602534+0000","last_fullsized":"2024-04-26T23:50:10.602534+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3907","last_scrub_stamp":"2024-04-26T23:50:10.602420+0000","last_deep_scrub":"26'3907","last_deep_scrub_stamp":"2024-04-26T23:50:10.602420+0000","last_clean_scrub_stamp":"2024-04-26T23:50:10.602420+0000","objects_scrubbed":0,"log_size":3907,"log_dups_size":0,"ondisk_log_size":3907,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:54:53.673581+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":58714,"num_write_kb":750642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"26'245","reported_seq":284,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:57.783049+0000","last_change":"2024-04-26T23:49:57.783049+0000","last_active":"2024-04-26T23:49:57.783049+0000","last_peered":"2024-04-26T23:49:57.783049+0000","last_clean":"2024-04-26T23:49:57.783049+0000","last_became_active":"2024-04-26T23:40:31.572074+0000","last_became_peered":"2024-04-26T23:40:31.572074+0000","last_unstale":"2024-04-26T23:49:57.783049+0000","last_undegraded":"2024-04-26T23:49:57.783049+0000","last_fullsized":"2024-04-26T23:49:57.783049+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'245","last_scrub_stamp":"2024-04-26T23:49:57.782886+0000","last_deep_scrub":"26'245","last_deep_scrub_stamp":"2024-04-26T23:49:57.782886+0000","last_clean_scrub_stamp":"2024-04-26T23:49:57.782886+0000","objects_scrubbed":6,"log_size":245,"log_dups_size":0,"ondisk_log_size":245,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:18:02.032656+0000","scrub_duration":28,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583584,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":234,"num_write_kb":12453,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"26'5","reported_seq":36,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:52.117618+0000","last_change":"2024-04-26T23:49:52.117618+0000","last_active":"2024-04-26T23:49:52.117618+0000","last_peered":"2024-04-26T23:49:52.117618+0000","last_clean":"2024-04-26T23:49:52.117618+0000","last_became_active":"2024-04-26T23:40:40.677714+0000","last_became_peered":"2024-04-26T23:40:40.677714+0000","last_unstale":"2024-04-26T23:49:52.117618+0000","last_undegraded":"2024-04-26T23:49:52.117618+0000","last_fullsized":"2024-04-26T23:49:52.117618+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5","last_scrub_stamp":"2024-04-26T23:49:52.117499+0000","last_deep_scrub":"26'5","last_deep_scrub_stamp":"2024-04-26T23:49:52.117499+0000","last_clean_scrub_stamp":"2024-04-26T23:49:52.117499+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:47:02.813805+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"26'4195","reported_seq":4224,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:50:06.281794+0000","last_change":"2024-04-26T23:50:06.281822+0000","last_active":"2024-04-26T23:50:06.281794+0000","last_peered":"2024-04-26T23:50:06.281794+0000","last_clean":"2024-04-26T23:50:06.281794+0000","last_became_active":"2024-04-26T23:40:41.685147+0000","last_became_peered":"2024-04-26T23:40:41.685147+0000","last_unstale":"2024-04-26T23:50:06.281794+0000","last_undegraded":"2024-04-26T23:50:06.281794+0000","last_fullsized":"2024-04-26T23:50:06.281794+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4195","last_scrub_stamp":"2024-04-26T23:50:06.281683+0000","last_deep_scrub":"26'4195","last_deep_scrub_stamp":"2024-04-26T23:50:06.281683+0000","last_clean_scrub_stamp":"2024-04-26T23:50:06.281683+0000","objects_scrubbed":0,"log_size":4195,"log_dups_size":0,"ondisk_log_size":4195,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:30:40.579686+0000","scrub_duration":41,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":62805,"num_write_kb":801211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"26'5530","reported_seq":5567,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:50:01.413084+0000","last_change":"2024-04-26T23:50:01.413084+0000","last_active":"2024-04-26T23:50:01.413084+0000","last_peered":"2024-04-26T23:50:01.413084+0000","last_clean":"2024-04-26T23:50:01.413084+0000","last_became_active":"2024-04-26T23:40:32.593030+0000","last_became_peered":"2024-04-26T23:40:32.593030+0000","last_unstale":"2024-04-26T23:50:01.413084+0000","last_undegraded":"2024-04-26T23:50:01.413084+0000","last_fullsized":"2024-04-26T23:50:01.413084+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5530","last_scrub_stamp":"2024-04-26T23:50:01.412932+0000","last_deep_scrub":"26'5530","last_deep_scrub_stamp":"2024-04-26T23:50:01.412932+0000","last_clean_scrub_stamp":"2024-04-26T23:50:01.412932+0000","objects_scrubbed":0,"log_size":5530,"log_dups_size":0,"ondisk_log_size":5530,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:05:00.364700+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":83076,"num_write_kb":1053123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"26'27","reported_seq":66,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:59.094453+0000","last_change":"2024-04-26T23:49:59.094453+0000","last_active":"2024-04-26T23:49:59.094453+0000","last_peered":"2024-04-26T23:49:59.094453+0000","last_clean":"2024-04-26T23:49:59.094453+0000","last_became_active":"2024-04-26T23:40:31.572218+0000","last_became_peered":"2024-04-26T23:40:31.572218+0000","last_unstale":"2024-04-26T23:49:59.094453+0000","last_undegraded":"2024-04-26T23:49:59.094453+0000","last_fullsized":"2024-04-26T23:49:59.094453+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'27","last_scrub_stamp":"2024-04-26T23:49:59.094310+0000","last_deep_scrub":"26'27","last_deep_scrub_stamp":"2024-04-26T23:49:59.094310+0000","last_clean_scrub_stamp":"2024-04-26T23:49:59.094310+0000","objects_scrubbed":3,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:47:23.736744+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194394,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":4108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"26'35","reported_seq":66,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:50:04.392903+0000","last_change":"2024-04-26T23:50:04.392903+0000","last_active":"2024-04-26T23:50:04.392903+0000","last_peered":"2024-04-26T23:50:04.392903+0000","last_clean":"2024-04-26T23:50:04.392903+0000","last_became_active":"2024-04-26T23:40:40.674487+0000","last_became_peered":"2024-04-26T23:40:40.674487+0000","last_unstale":"2024-04-26T23:50:04.392903+0000","last_undegraded":"2024-04-26T23:50:04.392903+0000","last_fullsized":"2024-04-26T23:50:04.392903+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'35","last_scrub_stamp":"2024-04-26T23:50:04.392751+0000","last_deep_scrub":"26'35","last_deep_scrub_stamp":"2024-04-26T23:50:04.392751+0000","last_clean_scrub_stamp":"2024-04-26T23:50:04.392751+0000","objects_scrubbed":4,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:43:08.954722+0000","scrub_duration":22,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":8207,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"26'4277","reported_seq":4306,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:50:07.730698+0000","last_change":"2024-04-26T23:50:07.730698+0000","last_active":"2024-04-26T23:50:07.730698+0000","last_peered":"2024-04-26T23:50:07.730698+0000","last_clean":"2024-04-26T23:50:07.730698+0000","last_became_active":"2024-04-26T23:40:41.686259+0000","last_became_peered":"2024-04-26T23:40:41.686259+0000","last_unstale":"2024-04-26T23:50:07.730698+0000","last_undegraded":"2024-04-26T23:50:07.730698+0000","last_fullsized":"2024-04-26T23:50:07.730698+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4277","last_scrub_stamp":"2024-04-26T23:50:07.730578+0000","last_deep_scrub":"26'4277","last_deep_scrub_stamp":"2024-04-26T23:50:07.730578+0000","last_clean_scrub_stamp":"2024-04-26T23:50:07.730578+0000","objects_scrubbed":0,"log_size":4277,"log_dups_size":0,"ondisk_log_size":4277,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:00:34.997076+0000","scrub_duration":28,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":64273,"num_write_kb":853172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"26'3697","reported_seq":3739,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:50:07.672671+0000","last_change":"2024-04-26T23:50:07.672671+0000","last_active":"2024-04-26T23:50:07.672671+0000","last_peered":"2024-04-26T23:50:07.672671+0000","last_clean":"2024-04-26T23:50:07.672671+0000","last_became_active":"2024-04-26T23:41:30.513492+0000","last_became_peered":"2024-04-26T23:41:30.513492+0000","last_unstale":"2024-04-26T23:50:07.672671+0000","last_undegraded":"2024-04-26T23:50:07.672671+0000","last_fullsized":"2024-04-26T23:50:07.672671+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3697","last_scrub_stamp":"2024-04-26T23:50:07.672563+0000","last_deep_scrub":"26'3697","last_deep_scrub_stamp":"2024-04-26T23:50:07.672563+0000","last_clean_scrub_stamp":"2024-04-26T23:50:07.672563+0000","objects_scrubbed":0,"log_size":3697,"log_dups_size":0,"ondisk_log_size":3697,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:33:31.274279+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55355,"num_write_kb":693310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"26'23","reported_seq":62,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:50:06.626741+0000","last_change":"2024-04-26T23:50:06.626741+0000","last_active":"2024-04-26T23:50:06.626741+0000","last_peered":"2024-04-26T23:50:06.626741+0000","last_clean":"2024-04-26T23:50:06.626741+0000","last_became_active":"2024-04-26T23:40:31.575211+0000","last_became_peered":"2024-04-26T23:40:31.575211+0000","last_unstale":"2024-04-26T23:50:06.626741+0000","last_undegraded":"2024-04-26T23:50:06.626741+0000","last_fullsized":"2024-04-26T23:50:06.626741+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'23","last_scrub_stamp":"2024-04-26T23:50:06.626580+0000","last_deep_scrub":"26'23","last_deep_scrub_stamp":"2024-04-26T23:50:06.626580+0000","last_clean_scrub_stamp":"2024-04-26T23:50:06.626580+0000","objects_scrubbed":1,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:46:10.782838+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":4104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"26'44","reported_seq":75,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:55.230212+0000","last_change":"2024-04-26T23:49:55.230212+0000","last_active":"2024-04-26T23:49:55.230212+0000","last_peered":"2024-04-26T23:49:55.230212+0000","last_clean":"2024-04-26T23:49:55.230212+0000","last_became_active":"2024-04-26T23:40:40.675459+0000","last_became_peered":"2024-04-26T23:40:40.675459+0000","last_unstale":"2024-04-26T23:49:55.230212+0000","last_undegraded":"2024-04-26T23:49:55.230212+0000","last_fullsized":"2024-04-26T23:49:55.230212+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'44","last_scrub_stamp":"2024-04-26T23:49:55.230087+0000","last_deep_scrub":"26'44","last_deep_scrub_stamp":"2024-04-26T23:49:55.230087+0000","last_clean_scrub_stamp":"2024-04-26T23:49:55.230087+0000","objects_scrubbed":6,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:47:19.872521+0000","scrub_duration":25,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36,"num_write_kb":8203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"26'4899","reported_seq":4928,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:50:15.685427+0000","last_change":"2024-04-26T23:50:15.685455+0000","last_active":"2024-04-26T23:50:15.685427+0000","last_peered":"2024-04-26T23:50:15.685427+0000","last_clean":"2024-04-26T23:50:15.685427+0000","last_became_active":"2024-04-26T23:40:41.687210+0000","last_became_peered":"2024-04-26T23:40:41.687210+0000","last_unstale":"2024-04-26T23:50:15.685427+0000","last_undegraded":"2024-04-26T23:50:15.685427+0000","last_fullsized":"2024-04-26T23:50:15.685427+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4899","last_scrub_stamp":"2024-04-26T23:50:15.685318+0000","last_deep_scrub":"26'4899","last_deep_scrub_stamp":"2024-04-26T23:50:15.685318+0000","last_clean_scrub_stamp":"2024-04-26T23:50:15.685318+0000","objects_scrubbed":0,"log_size":4899,"log_dups_size":0,"ondisk_log_size":4899,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:51:56.258780+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":73846,"num_write_kb":901080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"26'4194","reported_seq":4216,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:50:06.428414+0000","last_change":"2024-04-26T23:50:06.428448+0000","last_active":"2024-04-26T23:50:06.428414+0000","last_peered":"2024-04-26T23:50:06.428414+0000","last_clean":"2024-04-26T23:50:06.428414+0000","last_became_active":"2024-04-26T23:41:30.751285+0000","last_became_peered":"2024-04-26T23:41:30.751285+0000","last_unstale":"2024-04-26T23:50:06.428414+0000","last_undegraded":"2024-04-26T23:50:06.428414+0000","last_fullsized":"2024-04-26T23:50:06.428414+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4194","last_scrub_stamp":"2024-04-26T23:50:06.428283+0000","last_deep_scrub":"26'4194","last_deep_scrub_stamp":"2024-04-26T23:50:06.428283+0000","last_clean_scrub_stamp":"2024-04-26T23:50:06.428283+0000","objects_scrubbed":0,"log_size":4194,"log_dups_size":0,"ondisk_log_size":4194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:24:25.817915+0000","scrub_duration":16,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":63007,"num_write_kb":791881,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"26'2","reported_seq":41,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:59.725122+0000","last_change":"2024-04-26T23:49:59.725122+0000","last_active":"2024-04-26T23:49:59.725122+0000","last_peered":"2024-04-26T23:49:59.725122+0000","last_clean":"2024-04-26T23:49:59.725122+0000","last_became_active":"2024-04-26T23:40:31.573164+0000","last_became_peered":"2024-04-26T23:40:31.573164+0000","last_unstale":"2024-04-26T23:49:59.725122+0000","last_undegraded":"2024-04-26T23:49:59.725122+0000","last_fullsized":"2024-04-26T23:49:59.725122+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2","last_scrub_stamp":"2024-04-26T23:49:59.724973+0000","last_deep_scrub":"26'2","last_deep_scrub_stamp":"2024-04-26T23:49:59.724973+0000","last_clean_scrub_stamp":"2024-04-26T23:49:59.724973+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:45:15.515508+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"26'6","reported_seq":37,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:51.231450+0000","last_change":"2024-04-26T23:49:51.231450+0000","last_active":"2024-04-26T23:49:51.231450+0000","last_peered":"2024-04-26T23:49:51.231450+0000","last_clean":"2024-04-26T23:49:51.231450+0000","last_became_active":"2024-04-26T23:40:40.673793+0000","last_became_peered":"2024-04-26T23:40:40.673793+0000","last_unstale":"2024-04-26T23:49:51.231450+0000","last_undegraded":"2024-04-26T23:49:51.231450+0000","last_fullsized":"2024-04-26T23:49:51.231450+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'6","last_scrub_stamp":"2024-04-26T23:49:51.231353+0000","last_deep_scrub":"26'6","last_deep_scrub_stamp":"2024-04-26T23:49:51.231353+0000","last_clean_scrub_stamp":"2024-04-26T23:49:51.231353+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:27:15.750889+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"26'5252","reported_seq":5281,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:50:08.719248+0000","last_change":"2024-04-26T23:50:08.719273+0000","last_active":"2024-04-26T23:50:08.719248+0000","last_peered":"2024-04-26T23:50:08.719248+0000","last_clean":"2024-04-26T23:50:08.719248+0000","last_became_active":"2024-04-26T23:40:41.686536+0000","last_became_peered":"2024-04-26T23:40:41.686536+0000","last_unstale":"2024-04-26T23:50:08.719248+0000","last_undegraded":"2024-04-26T23:50:08.719248+0000","last_fullsized":"2024-04-26T23:50:08.719248+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5252","last_scrub_stamp":"2024-04-26T23:50:08.719149+0000","last_deep_scrub":"26'5252","last_deep_scrub_stamp":"2024-04-26T23:50:08.719149+0000","last_clean_scrub_stamp":"2024-04-26T23:50:08.719149+0000","objects_scrubbed":0,"log_size":5252,"log_dups_size":0,"ondisk_log_size":5252,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:43:13.281120+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":78945,"num_write_kb":1046825,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"26'14","reported_seq":45,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:50.729610+0000","last_change":"2024-04-26T23:49:50.729657+0000","last_active":"2024-04-26T23:49:50.729610+0000","last_peered":"2024-04-26T23:49:50.729610+0000","last_clean":"2024-04-26T23:49:50.729610+0000","last_became_active":"2024-04-26T23:40:40.674639+0000","last_became_peered":"2024-04-26T23:40:40.674639+0000","last_unstale":"2024-04-26T23:49:50.729610+0000","last_undegraded":"2024-04-26T23:49:50.729610+0000","last_fullsized":"2024-04-26T23:49:50.729610+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'14","last_scrub_stamp":"2024-04-26T23:49:50.729509+0000","last_deep_scrub":"26'14","last_deep_scrub_stamp":"2024-04-26T23:49:50.729509+0000","last_clean_scrub_stamp":"2024-04-26T23:49:50.729509+0000","objects_scrubbed":1,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:45:30.230613+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":4106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"26'4888","reported_seq":4925,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:57.127212+0000","last_change":"2024-04-26T23:49:57.127212+0000","last_active":"2024-04-26T23:49:57.127212+0000","last_peered":"2024-04-26T23:49:57.127212+0000","last_clean":"2024-04-26T23:49:57.127212+0000","last_became_active":"2024-04-26T23:40:32.582751+0000","last_became_peered":"2024-04-26T23:40:32.582751+0000","last_unstale":"2024-04-26T23:49:57.127212+0000","last_undegraded":"2024-04-26T23:49:57.127212+0000","last_fullsized":"2024-04-26T23:49:57.127212+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4888","last_scrub_stamp":"2024-04-26T23:49:57.127049+0000","last_deep_scrub":"26'4888","last_deep_scrub_stamp":"2024-04-26T23:49:57.127049+0000","last_clean_scrub_stamp":"2024-04-26T23:49:57.127049+0000","objects_scrubbed":0,"log_size":4888,"log_dups_size":0,"ondisk_log_size":4888,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:19:17.141317+0000","scrub_duration":20,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":73256,"num_write_kb":928290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"26'29","reported_seq":68,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:50:03.616152+0000","last_change":"2024-04-26T23:50:03.616152+0000","last_active":"2024-04-26T23:50:03.616152+0000","last_peered":"2024-04-26T23:50:03.616152+0000","last_clean":"2024-04-26T23:50:03.616152+0000","last_became_active":"2024-04-26T23:40:31.572111+0000","last_became_peered":"2024-04-26T23:40:31.572111+0000","last_unstale":"2024-04-26T23:50:03.616152+0000","last_undegraded":"2024-04-26T23:50:03.616152+0000","last_fullsized":"2024-04-26T23:50:03.616152+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'29","last_scrub_stamp":"2024-04-26T23:50:03.615978+0000","last_deep_scrub":"26'29","last_deep_scrub_stamp":"2024-04-26T23:50:03.615978+0000","last_clean_scrub_stamp":"2024-04-26T23:50:03.615978+0000","objects_scrubbed":2,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:07:13.243878+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":8213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"26'4754","reported_seq":4783,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:50:03.668074+0000","last_change":"2024-04-26T23:50:03.668101+0000","last_active":"2024-04-26T23:50:03.668074+0000","last_peered":"2024-04-26T23:50:03.668074+0000","last_clean":"2024-04-26T23:50:03.668074+0000","last_became_active":"2024-04-26T23:40:41.684207+0000","last_became_peered":"2024-04-26T23:40:41.684207+0000","last_unstale":"2024-04-26T23:50:03.668074+0000","last_undegraded":"2024-04-26T23:50:03.668074+0000","last_fullsized":"2024-04-26T23:50:03.668074+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4754","last_scrub_stamp":"2024-04-26T23:50:03.667957+0000","last_deep_scrub":"26'4754","last_deep_scrub_stamp":"2024-04-26T23:50:03.667957+0000","last_clean_scrub_stamp":"2024-04-26T23:50:03.667957+0000","objects_scrubbed":0,"log_size":4754,"log_dups_size":0,"ondisk_log_size":4754,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:24:23.057589+0000","scrub_duration":20,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":71582,"num_write_kb":928660,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"26'148","reported_seq":179,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:50:04.799728+0000","last_change":"2024-04-26T23:50:04.799763+0000","last_active":"2024-04-26T23:50:04.799728+0000","last_peered":"2024-04-26T23:50:04.799728+0000","last_clean":"2024-04-26T23:50:04.799728+0000","last_became_active":"2024-04-26T23:40:40.674628+0000","last_became_peered":"2024-04-26T23:40:40.674628+0000","last_unstale":"2024-04-26T23:50:04.799728+0000","last_undegraded":"2024-04-26T23:50:04.799728+0000","last_fullsized":"2024-04-26T23:50:04.799728+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'148","last_scrub_stamp":"2024-04-26T23:50:04.799609+0000","last_deep_scrub":"26'148","last_deep_scrub_stamp":"2024-04-26T23:50:04.799609+0000","last_clean_scrub_stamp":"2024-04-26T23:50:04.799609+0000","objects_scrubbed":4,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:38:34.947495+0000","scrub_duration":29,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7745351,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":142,"num_write_kb":7622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"26'4156","reported_seq":4193,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:50:11.390039+0000","last_change":"2024-04-26T23:50:11.390039+0000","last_active":"2024-04-26T23:50:11.390039+0000","last_peered":"2024-04-26T23:50:11.390039+0000","last_clean":"2024-04-26T23:50:11.390039+0000","last_became_active":"2024-04-26T23:40:32.585725+0000","last_became_peered":"2024-04-26T23:40:32.585725+0000","last_unstale":"2024-04-26T23:50:11.390039+0000","last_undegraded":"2024-04-26T23:50:11.390039+0000","last_fullsized":"2024-04-26T23:50:11.390039+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4156","last_scrub_stamp":"2024-04-26T23:50:11.389897+0000","last_deep_scrub":"26'4156","last_deep_scrub_stamp":"2024-04-26T23:50:11.389897+0000","last_clean_scrub_stamp":"2024-04-26T23:50:11.389897+0000","objects_scrubbed":0,"log_size":4156,"log_dups_size":0,"ondisk_log_size":4156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:12:38.170707+0000","scrub_duration":18,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":62294,"num_write_kb":802311,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"26'21","reported_seq":60,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:50:07.271620+0000","last_change":"2024-04-26T23:50:07.271620+0000","last_active":"2024-04-26T23:50:07.271620+0000","last_peered":"2024-04-26T23:50:07.271620+0000","last_clean":"2024-04-26T23:50:07.271620+0000","last_became_active":"2024-04-26T23:40:31.578623+0000","last_became_peered":"2024-04-26T23:40:31.578623+0000","last_unstale":"2024-04-26T23:50:07.271620+0000","last_undegraded":"2024-04-26T23:50:07.271620+0000","last_fullsized":"2024-04-26T23:50:07.271620+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'21","last_scrub_stamp":"2024-04-26T23:50:07.271479+0000","last_deep_scrub":"26'21","last_deep_scrub_stamp":"2024-04-26T23:50:07.271479+0000","last_clean_scrub_stamp":"2024-04-26T23:50:07.271479+0000","objects_scrubbed":1,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:29:56.825879+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":4105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"26'5418","reported_seq":5446,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:50:11.269744+0000","last_change":"2024-04-26T23:50:11.269772+0000","last_active":"2024-04-26T23:50:11.269744+0000","last_peered":"2024-04-26T23:50:11.269744+0000","last_clean":"2024-04-26T23:50:11.269744+0000","last_became_active":"2024-04-26T23:40:41.688428+0000","last_became_peered":"2024-04-26T23:40:41.688428+0000","last_unstale":"2024-04-26T23:50:11.269744+0000","last_undegraded":"2024-04-26T23:50:11.269744+0000","last_fullsized":"2024-04-26T23:50:11.269744+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5418","last_scrub_stamp":"2024-04-26T23:50:11.269587+0000","last_deep_scrub":"26'5418","last_deep_scrub_stamp":"2024-04-26T23:50:11.269587+0000","last_clean_scrub_stamp":"2024-04-26T23:50:11.269587+0000","objects_scrubbed":0,"log_size":5418,"log_dups_size":0,"ondisk_log_size":5418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:02:54.673736+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":81566,"num_write_kb":1040251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1a","version":"26'36","reported_seq":75,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:55.800871+0000","last_change":"2024-04-26T23:49:55.800871+0000","last_active":"2024-04-26T23:49:55.800871+0000","last_peered":"2024-04-26T23:49:55.800871+0000","last_clean":"2024-04-26T23:49:55.800871+0000","last_became_active":"2024-04-26T23:40:31.567484+0000","last_became_peered":"2024-04-26T23:40:31.567484+0000","last_unstale":"2024-04-26T23:49:55.800871+0000","last_undegraded":"2024-04-26T23:49:55.800871+0000","last_fullsized":"2024-04-26T23:49:55.800871+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'36","last_scrub_stamp":"2024-04-26T23:49:55.800751+0000","last_deep_scrub":"26'36","last_deep_scrub_stamp":"2024-04-26T23:49:55.800751+0000","last_clean_scrub_stamp":"2024-04-26T23:49:55.800751+0000","objects_scrubbed":3,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:50:52.340698+0000","scrub_duration":30,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":12305,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"26'3282","reported_seq":3318,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:51.719257+0000","last_change":"2024-04-26T23:49:51.719279+0000","last_active":"2024-04-26T23:49:51.719257+0000","last_peered":"2024-04-26T23:49:51.719257+0000","last_clean":"2024-04-26T23:49:51.719257+0000","last_became_active":"2024-04-26T23:40:32.592365+0000","last_became_peered":"2024-04-26T23:40:32.592365+0000","last_unstale":"2024-04-26T23:49:51.719257+0000","last_undegraded":"2024-04-26T23:49:51.719257+0000","last_fullsized":"2024-04-26T23:49:51.719257+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3282","last_scrub_stamp":"2024-04-26T23:49:51.719172+0000","last_deep_scrub":"26'3282","last_deep_scrub_stamp":"2024-04-26T23:49:51.719172+0000","last_clean_scrub_stamp":"2024-04-26T23:49:51.719172+0000","objects_scrubbed":0,"log_size":3282,"log_dups_size":0,"ondisk_log_size":3282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:50:48.259119+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49199,"num_write_kb":619171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"26'16","reported_seq":46,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:57.465757+0000","last_change":"2024-04-26T23:49:57.465791+0000","last_active":"2024-04-26T23:49:57.465757+0000","last_peered":"2024-04-26T23:49:57.465757+0000","last_clean":"2024-04-26T23:49:57.465757+0000","last_became_active":"2024-04-26T23:40:40.675736+0000","last_became_peered":"2024-04-26T23:40:40.675736+0000","last_unstale":"2024-04-26T23:49:57.465757+0000","last_undegraded":"2024-04-26T23:49:57.465757+0000","last_fullsized":"2024-04-26T23:49:57.465757+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'16","last_scrub_stamp":"2024-04-26T23:49:57.465670+0000","last_deep_scrub":"26'16","last_deep_scrub_stamp":"2024-04-26T23:49:57.465670+0000","last_clean_scrub_stamp":"2024-04-26T23:49:57.465670+0000","objects_scrubbed":2,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:02:15.307784+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":4102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"26'3303","reported_seq":3331,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:50:09.212977+0000","last_change":"2024-04-26T23:50:09.213002+0000","last_active":"2024-04-26T23:50:09.212977+0000","last_peered":"2024-04-26T23:50:09.212977+0000","last_clean":"2024-04-26T23:50:09.212977+0000","last_became_active":"2024-04-26T23:40:41.689765+0000","last_became_peered":"2024-04-26T23:40:41.689765+0000","last_unstale":"2024-04-26T23:50:09.212977+0000","last_undegraded":"2024-04-26T23:50:09.212977+0000","last_fullsized":"2024-04-26T23:50:09.212977+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3303","last_scrub_stamp":"2024-04-26T23:50:09.212879+0000","last_deep_scrub":"26'3303","last_deep_scrub_stamp":"2024-04-26T23:50:09.212879+0000","last_clean_scrub_stamp":"2024-04-26T23:50:09.212879+0000","objects_scrubbed":0,"log_size":3303,"log_dups_size":0,"ondisk_log_size":3303,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:07:18.840779+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49600,"num_write_kb":609763,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"26'1222","reported_seq":1260,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:50:05.276185+0000","last_change":"2024-04-26T23:50:05.276216+0000","last_active":"2024-04-26T23:50:05.276185+0000","last_peered":"2024-04-26T23:50:05.276185+0000","last_clean":"2024-04-26T23:50:05.276185+0000","last_became_active":"2024-04-26T23:40:31.576178+0000","last_became_peered":"2024-04-26T23:40:31.576178+0000","last_unstale":"2024-04-26T23:50:05.276185+0000","last_undegraded":"2024-04-26T23:50:05.276185+0000","last_fullsized":"2024-04-26T23:50:05.276185+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'1222","last_scrub_stamp":"2024-04-26T23:50:05.276080+0000","last_deep_scrub":"26'1222","last_deep_scrub_stamp":"2024-04-26T23:50:05.276080+0000","last_clean_scrub_stamp":"2024-04-26T23:50:05.276080+0000","objects_scrubbed":1,"log_size":1222,"log_dups_size":0,"ondisk_log_size":1222,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:46:09.432338+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1219,"num_write_kb":5208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"26'3626","reported_seq":3662,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:59.399974+0000","last_change":"2024-04-26T23:49:59.400035+0000","last_active":"2024-04-26T23:49:59.399974+0000","last_peered":"2024-04-26T23:49:59.399974+0000","last_clean":"2024-04-26T23:49:59.399974+0000","last_became_active":"2024-04-26T23:40:32.588927+0000","last_became_peered":"2024-04-26T23:40:32.588927+0000","last_unstale":"2024-04-26T23:49:59.399974+0000","last_undegraded":"2024-04-26T23:49:59.399974+0000","last_fullsized":"2024-04-26T23:49:59.399974+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3626","last_scrub_stamp":"2024-04-26T23:49:59.399848+0000","last_deep_scrub":"26'3626","last_deep_scrub_stamp":"2024-04-26T23:49:59.399848+0000","last_clean_scrub_stamp":"2024-04-26T23:49:59.399848+0000","objects_scrubbed":0,"log_size":3626,"log_dups_size":0,"ondisk_log_size":3626,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:19:19.414116+0000","scrub_duration":21,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":54465,"num_write_kb":670678,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"26'36","reported_seq":66,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:59.203203+0000","last_change":"2024-04-26T23:49:59.203238+0000","last_active":"2024-04-26T23:49:59.203203+0000","last_peered":"2024-04-26T23:49:59.203203+0000","last_clean":"2024-04-26T23:49:59.203203+0000","last_became_active":"2024-04-26T23:40:40.676070+0000","last_became_peered":"2024-04-26T23:40:40.676070+0000","last_unstale":"2024-04-26T23:49:59.203203+0000","last_undegraded":"2024-04-26T23:49:59.203203+0000","last_fullsized":"2024-04-26T23:49:59.203203+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'36","last_scrub_stamp":"2024-04-26T23:49:59.203111+0000","last_deep_scrub":"26'36","last_deep_scrub_stamp":"2024-04-26T23:49:59.203111+0000","last_clean_scrub_stamp":"2024-04-26T23:49:59.203111+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:20:21.798228+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":12296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.26","version":"26'4010","reported_seq":4039,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:50:13.418115+0000","last_change":"2024-04-26T23:50:13.418147+0000","last_active":"2024-04-26T23:50:13.418115+0000","last_peered":"2024-04-26T23:50:13.418115+0000","last_clean":"2024-04-26T23:50:13.418115+0000","last_became_active":"2024-04-26T23:40:41.679523+0000","last_became_peered":"2024-04-26T23:40:41.679523+0000","last_unstale":"2024-04-26T23:50:13.418115+0000","last_undegraded":"2024-04-26T23:50:13.418115+0000","last_fullsized":"2024-04-26T23:50:13.418115+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4010","last_scrub_stamp":"2024-04-26T23:50:13.418018+0000","last_deep_scrub":"26'4010","last_deep_scrub_stamp":"2024-04-26T23:50:13.418018+0000","last_clean_scrub_stamp":"2024-04-26T23:50:13.418018+0000","objects_scrubbed":0,"log_size":4010,"log_dups_size":0,"ondisk_log_size":4010,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:51:53.991480+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":60148,"num_write_kb":773318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"26'5261","reported_seq":5298,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:50:02.806261+0000","last_change":"2024-04-26T23:50:02.806302+0000","last_active":"2024-04-26T23:50:02.806261+0000","last_peered":"2024-04-26T23:50:02.806261+0000","last_clean":"2024-04-26T23:50:02.806261+0000","last_became_active":"2024-04-26T23:40:32.586399+0000","last_became_peered":"2024-04-26T23:40:32.586399+0000","last_unstale":"2024-04-26T23:50:02.806261+0000","last_undegraded":"2024-04-26T23:50:02.806261+0000","last_fullsized":"2024-04-26T23:50:02.806261+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5261","last_scrub_stamp":"2024-04-26T23:50:02.806117+0000","last_deep_scrub":"26'5261","last_deep_scrub_stamp":"2024-04-26T23:50:02.806117+0000","last_clean_scrub_stamp":"2024-04-26T23:50:02.806117+0000","objects_scrubbed":0,"log_size":5261,"log_dups_size":0,"ondisk_log_size":5261,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:38:03.826486+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":78910,"num_write_kb":993537,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.27","version":"26'5344","reported_seq":5373,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:50:07.295026+0000","last_change":"2024-04-26T23:50:07.295050+0000","last_active":"2024-04-26T23:50:07.295026+0000","last_peered":"2024-04-26T23:50:07.295026+0000","last_clean":"2024-04-26T23:50:07.295026+0000","last_became_active":"2024-04-26T23:40:41.686974+0000","last_became_peered":"2024-04-26T23:40:41.686974+0000","last_unstale":"2024-04-26T23:50:07.295026+0000","last_undegraded":"2024-04-26T23:50:07.295026+0000","last_fullsized":"2024-04-26T23:50:07.295026+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5344","last_scrub_stamp":"2024-04-26T23:50:07.294929+0000","last_deep_scrub":"26'5344","last_deep_scrub_stamp":"2024-04-26T23:50:07.294929+0000","last_clean_scrub_stamp":"2024-04-26T23:50:07.294929+0000","objects_scrubbed":0,"log_size":5344,"log_dups_size":0,"ondisk_log_size":5344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:07:16.922829+0000","scrub_duration":17,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":80446,"num_write_kb":1002267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"26'4431","reported_seq":4468,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:56.443586+0000","last_change":"2024-04-26T23:49:56.443613+0000","last_active":"2024-04-26T23:49:56.443586+0000","last_peered":"2024-04-26T23:49:56.443586+0000","last_clean":"2024-04-26T23:49:56.443586+0000","last_became_active":"2024-04-26T23:40:32.584234+0000","last_became_peered":"2024-04-26T23:40:32.584234+0000","last_unstale":"2024-04-26T23:49:56.443586+0000","last_undegraded":"2024-04-26T23:49:56.443586+0000","last_fullsized":"2024-04-26T23:49:56.443586+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4431","last_scrub_stamp":"2024-04-26T23:49:56.443483+0000","last_deep_scrub":"26'4431","last_deep_scrub_stamp":"2024-04-26T23:49:56.443483+0000","last_clean_scrub_stamp":"2024-04-26T23:49:56.443483+0000","objects_scrubbed":0,"log_size":4431,"log_dups_size":0,"ondisk_log_size":4431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:27:14.476629+0000","scrub_duration":16,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":66416,"num_write_kb":857324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.24","version":"26'4132","reported_seq":4161,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:50:00.579416+0000","last_change":"2024-04-26T23:50:00.579467+0000","last_active":"2024-04-26T23:50:00.579416+0000","last_peered":"2024-04-26T23:50:00.579416+0000","last_clean":"2024-04-26T23:50:00.579416+0000","last_became_active":"2024-04-26T23:40:41.679254+0000","last_became_peered":"2024-04-26T23:40:41.679254+0000","last_unstale":"2024-04-26T23:50:00.579416+0000","last_undegraded":"2024-04-26T23:50:00.579416+0000","last_fullsized":"2024-04-26T23:50:00.579416+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4132","last_scrub_stamp":"2024-04-26T23:50:00.579322+0000","last_deep_scrub":"26'4132","last_deep_scrub_stamp":"2024-04-26T23:50:00.579322+0000","last_clean_scrub_stamp":"2024-04-26T23:50:00.579322+0000","objects_scrubbed":0,"log_size":4132,"log_dups_size":0,"ondisk_log_size":4132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:57:53.160154+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":62260,"num_write_kb":792966,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"26'5020","reported_seq":5057,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:50:07.636352+0000","last_change":"2024-04-26T23:50:07.636394+0000","last_active":"2024-04-26T23:50:07.636352+0000","last_peered":"2024-04-26T23:50:07.636352+0000","last_clean":"2024-04-26T23:50:07.636352+0000","last_became_active":"2024-04-26T23:40:32.580196+0000","last_became_peered":"2024-04-26T23:40:32.580196+0000","last_unstale":"2024-04-26T23:50:07.636352+0000","last_undegraded":"2024-04-26T23:50:07.636352+0000","last_fullsized":"2024-04-26T23:50:07.636352+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5020","last_scrub_stamp":"2024-04-26T23:50:07.636218+0000","last_deep_scrub":"26'5020","last_deep_scrub_stamp":"2024-04-26T23:50:07.636218+0000","last_clean_scrub_stamp":"2024-04-26T23:50:07.636218+0000","objects_scrubbed":0,"log_size":5020,"log_dups_size":0,"ondisk_log_size":5020,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:02:51.040367+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":75519,"num_write_kb":963103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.25","version":"26'4764","reported_seq":4793,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:50:12.227151+0000","last_change":"2024-04-26T23:50:12.227175+0000","last_active":"2024-04-26T23:50:12.227151+0000","last_peered":"2024-04-26T23:50:12.227151+0000","last_clean":"2024-04-26T23:50:12.227151+0000","last_became_active":"2024-04-26T23:40:41.690262+0000","last_became_peered":"2024-04-26T23:40:41.690262+0000","last_unstale":"2024-04-26T23:50:12.227151+0000","last_undegraded":"2024-04-26T23:50:12.227151+0000","last_fullsized":"2024-04-26T23:50:12.227151+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4764","last_scrub_stamp":"2024-04-26T23:50:12.227046+0000","last_deep_scrub":"26'4764","last_deep_scrub_stamp":"2024-04-26T23:50:12.227046+0000","last_clean_scrub_stamp":"2024-04-26T23:50:12.227046+0000","objects_scrubbed":0,"log_size":4764,"log_dups_size":0,"ondisk_log_size":4764,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:30:01.781447+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":71706,"num_write_kb":928511,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"26'3562","reported_seq":3604,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:50:06.697678+0000","last_change":"2024-04-26T23:50:06.697702+0000","last_active":"2024-04-26T23:50:06.697678+0000","last_peered":"2024-04-26T23:50:06.697678+0000","last_clean":"2024-04-26T23:50:06.697678+0000","last_became_active":"2024-04-26T23:41:30.513571+0000","last_became_peered":"2024-04-26T23:41:30.513571+0000","last_unstale":"2024-04-26T23:50:06.697678+0000","last_undegraded":"2024-04-26T23:50:06.697678+0000","last_fullsized":"2024-04-26T23:50:06.697678+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3562","last_scrub_stamp":"2024-04-26T23:50:06.697582+0000","last_deep_scrub":"26'3562","last_deep_scrub_stamp":"2024-04-26T23:50:06.697582+0000","last_clean_scrub_stamp":"2024-04-26T23:50:06.697582+0000","objects_scrubbed":0,"log_size":3562,"log_dups_size":0,"ondisk_log_size":3562,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:20:29.292700+0000","scrub_duration":18,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53479,"num_write_kb":687907,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.22","version":"26'5438","reported_seq":5467,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:57.493283+0000","last_change":"2024-04-26T23:49:57.493307+0000","last_active":"2024-04-26T23:49:57.493283+0000","last_peered":"2024-04-26T23:49:57.493283+0000","last_clean":"2024-04-26T23:49:57.493283+0000","last_became_active":"2024-04-26T23:40:41.677398+0000","last_became_peered":"2024-04-26T23:40:41.677398+0000","last_unstale":"2024-04-26T23:49:57.493283+0000","last_undegraded":"2024-04-26T23:49:57.493283+0000","last_fullsized":"2024-04-26T23:49:57.493283+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5438","last_scrub_stamp":"2024-04-26T23:49:57.493184+0000","last_deep_scrub":"26'5438","last_deep_scrub_stamp":"2024-04-26T23:49:57.493184+0000","last_clean_scrub_stamp":"2024-04-26T23:49:57.493184+0000","objects_scrubbed":0,"log_size":5438,"log_dups_size":0,"ondisk_log_size":5438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:41:57.160176+0000","scrub_duration":16,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":81903,"num_write_kb":1031435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.24","version":"26'3690","reported_seq":3727,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:50:12.382986+0000","last_change":"2024-04-26T23:50:12.383011+0000","last_active":"2024-04-26T23:50:12.382986+0000","last_peered":"2024-04-26T23:50:12.382986+0000","last_clean":"2024-04-26T23:50:12.382986+0000","last_became_active":"2024-04-26T23:40:32.587630+0000","last_became_peered":"2024-04-26T23:40:32.587630+0000","last_unstale":"2024-04-26T23:50:12.382986+0000","last_undegraded":"2024-04-26T23:50:12.382986+0000","last_fullsized":"2024-04-26T23:50:12.382986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3690","last_scrub_stamp":"2024-04-26T23:50:12.382907+0000","last_deep_scrub":"26'3690","last_deep_scrub_stamp":"2024-04-26T23:50:12.382907+0000","last_clean_scrub_stamp":"2024-04-26T23:50:12.382907+0000","objects_scrubbed":0,"log_size":3690,"log_dups_size":0,"ondisk_log_size":3690,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:03:26.450135+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55280,"num_write_kb":715530,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.23","version":"26'3842","reported_seq":3871,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:50:10.200243+0000","last_change":"2024-04-26T23:50:10.200287+0000","last_active":"2024-04-26T23:50:10.200243+0000","last_peered":"2024-04-26T23:50:10.200243+0000","last_clean":"2024-04-26T23:50:10.200243+0000","last_became_active":"2024-04-26T23:40:41.689911+0000","last_became_peered":"2024-04-26T23:40:41.689911+0000","last_unstale":"2024-04-26T23:50:10.200243+0000","last_undegraded":"2024-04-26T23:50:10.200243+0000","last_fullsized":"2024-04-26T23:50:10.200243+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3842","last_scrub_stamp":"2024-04-26T23:50:10.200096+0000","last_deep_scrub":"26'3842","last_deep_scrub_stamp":"2024-04-26T23:50:10.200096+0000","last_clean_scrub_stamp":"2024-04-26T23:50:10.200096+0000","objects_scrubbed":0,"log_size":3842,"log_dups_size":0,"ondisk_log_size":3842,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:49:38.038404+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":57757,"num_write_kb":753623,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"26'4516","reported_seq":4553,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:55.098331+0000","last_change":"2024-04-26T23:49:55.098366+0000","last_active":"2024-04-26T23:49:55.098331+0000","last_peered":"2024-04-26T23:49:55.098331+0000","last_clean":"2024-04-26T23:49:55.098331+0000","last_became_active":"2024-04-26T23:40:32.583089+0000","last_became_peered":"2024-04-26T23:40:32.583089+0000","last_unstale":"2024-04-26T23:49:55.098331+0000","last_undegraded":"2024-04-26T23:49:55.098331+0000","last_fullsized":"2024-04-26T23:49:55.098331+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4516","last_scrub_stamp":"2024-04-26T23:49:55.098179+0000","last_deep_scrub":"26'4516","last_deep_scrub_stamp":"2024-04-26T23:49:55.098179+0000","last_clean_scrub_stamp":"2024-04-26T23:49:55.098179+0000","objects_scrubbed":0,"log_size":4516,"log_dups_size":0,"ondisk_log_size":4516,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:22:12.484508+0000","scrub_duration":16,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":67860,"num_write_kb":874899,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.20","version":"26'5612","reported_seq":5641,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:50:16.677992+0000","last_change":"2024-04-26T23:50:16.678021+0000","last_active":"2024-04-26T23:50:16.677992+0000","last_peered":"2024-04-26T23:50:16.677992+0000","last_clean":"2024-04-26T23:50:16.677992+0000","last_became_active":"2024-04-26T23:40:41.688028+0000","last_became_peered":"2024-04-26T23:40:41.688028+0000","last_unstale":"2024-04-26T23:50:16.677992+0000","last_undegraded":"2024-04-26T23:50:16.677992+0000","last_fullsized":"2024-04-26T23:50:16.677992+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5612","last_scrub_stamp":"2024-04-26T23:50:16.677865+0000","last_deep_scrub":"26'5612","last_deep_scrub_stamp":"2024-04-26T23:50:16.677865+0000","last_clean_scrub_stamp":"2024-04-26T23:50:16.677865+0000","objects_scrubbed":0,"log_size":5612,"log_dups_size":0,"ondisk_log_size":5612,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:02:53.795754+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":84399,"num_write_kb":1068733,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.26","version":"26'3757","reported_seq":3794,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:52.778509+0000","last_change":"2024-04-26T23:49:52.778534+0000","last_active":"2024-04-26T23:49:52.778509+0000","last_peered":"2024-04-26T23:49:52.778509+0000","last_clean":"2024-04-26T23:49:52.778509+0000","last_became_active":"2024-04-26T23:40:32.588793+0000","last_became_peered":"2024-04-26T23:40:32.588793+0000","last_unstale":"2024-04-26T23:49:52.778509+0000","last_undegraded":"2024-04-26T23:49:52.778509+0000","last_fullsized":"2024-04-26T23:49:52.778509+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3757","last_scrub_stamp":"2024-04-26T23:49:52.778402+0000","last_deep_scrub":"26'3757","last_deep_scrub_stamp":"2024-04-26T23:49:52.778402+0000","last_clean_scrub_stamp":"2024-04-26T23:49:52.778402+0000","objects_scrubbed":0,"log_size":3757,"log_dups_size":0,"ondisk_log_size":3757,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:00:06.766306+0000","scrub_duration":17,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":56209,"num_write_kb":727106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.21","version":"26'4827","reported_seq":4856,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:50:09.710128+0000","last_change":"2024-04-26T23:50:09.710152+0000","last_active":"2024-04-26T23:50:09.710128+0000","last_peered":"2024-04-26T23:50:09.710128+0000","last_clean":"2024-04-26T23:50:09.710128+0000","last_became_active":"2024-04-26T23:40:41.688163+0000","last_became_peered":"2024-04-26T23:40:41.688163+0000","last_unstale":"2024-04-26T23:50:09.710128+0000","last_undegraded":"2024-04-26T23:50:09.710128+0000","last_fullsized":"2024-04-26T23:50:09.710128+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4827","last_scrub_stamp":"2024-04-26T23:50:09.710035+0000","last_deep_scrub":"26'4827","last_deep_scrub_stamp":"2024-04-26T23:50:09.710035+0000","last_clean_scrub_stamp":"2024-04-26T23:50:09.710035+0000","objects_scrubbed":0,"log_size":4827,"log_dups_size":0,"ondisk_log_size":4827,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:45:44.448733+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":72614,"num_write_kb":926316,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"26'4897","reported_seq":4934,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:50:04.258098+0000","last_change":"2024-04-26T23:50:04.258124+0000","last_active":"2024-04-26T23:50:04.258098+0000","last_peered":"2024-04-26T23:50:04.258098+0000","last_clean":"2024-04-26T23:50:04.258098+0000","last_became_active":"2024-04-26T23:40:32.586926+0000","last_became_peered":"2024-04-26T23:40:32.586926+0000","last_unstale":"2024-04-26T23:50:04.258098+0000","last_undegraded":"2024-04-26T23:50:04.258098+0000","last_fullsized":"2024-04-26T23:50:04.258098+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4897","last_scrub_stamp":"2024-04-26T23:50:04.257990+0000","last_deep_scrub":"26'4897","last_deep_scrub_stamp":"2024-04-26T23:50:04.257990+0000","last_clean_scrub_stamp":"2024-04-26T23:50:04.257990+0000","objects_scrubbed":0,"log_size":4897,"log_dups_size":0,"ondisk_log_size":4897,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:37:33.116648+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":73419,"num_write_kb":930971,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2e","version":"26'3627","reported_seq":3656,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:50:17.405731+0000","last_change":"2024-04-26T23:50:17.405759+0000","last_active":"2024-04-26T23:50:17.405731+0000","last_peered":"2024-04-26T23:50:17.405731+0000","last_clean":"2024-04-26T23:50:17.405731+0000","last_became_active":"2024-04-26T23:40:41.688087+0000","last_became_peered":"2024-04-26T23:40:41.688087+0000","last_unstale":"2024-04-26T23:50:17.405731+0000","last_undegraded":"2024-04-26T23:50:17.405731+0000","last_fullsized":"2024-04-26T23:50:17.405731+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3627","last_scrub_stamp":"2024-04-26T23:50:17.405621+0000","last_deep_scrub":"26'3627","last_deep_scrub_stamp":"2024-04-26T23:50:17.405621+0000","last_clean_scrub_stamp":"2024-04-26T23:50:17.405621+0000","objects_scrubbed":0,"log_size":3627,"log_dups_size":0,"ondisk_log_size":3627,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:57:20.423941+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":54377,"num_write_kb":682463,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"26'3685","reported_seq":3722,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:50:09.636672+0000","last_change":"2024-04-26T23:50:09.636720+0000","last_active":"2024-04-26T23:50:09.636672+0000","last_peered":"2024-04-26T23:50:09.636672+0000","last_clean":"2024-04-26T23:50:09.636672+0000","last_became_active":"2024-04-26T23:40:32.582100+0000","last_became_peered":"2024-04-26T23:40:32.582100+0000","last_unstale":"2024-04-26T23:50:09.636672+0000","last_undegraded":"2024-04-26T23:50:09.636672+0000","last_fullsized":"2024-04-26T23:50:09.636672+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3685","last_scrub_stamp":"2024-04-26T23:50:09.636526+0000","last_deep_scrub":"26'3685","last_deep_scrub_stamp":"2024-04-26T23:50:09.636526+0000","last_clean_scrub_stamp":"2024-04-26T23:50:09.636526+0000","objects_scrubbed":0,"log_size":3685,"log_dups_size":0,"ondisk_log_size":3685,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:24:02.282070+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55124,"num_write_kb":707502,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2f","version":"26'5401","reported_seq":5430,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:59.576779+0000","last_change":"2024-04-26T23:49:59.576823+0000","last_active":"2024-04-26T23:49:59.576779+0000","last_peered":"2024-04-26T23:49:59.576779+0000","last_clean":"2024-04-26T23:49:59.576779+0000","last_became_active":"2024-04-26T23:40:41.680581+0000","last_became_peered":"2024-04-26T23:40:41.680581+0000","last_unstale":"2024-04-26T23:49:59.576779+0000","last_undegraded":"2024-04-26T23:49:59.576779+0000","last_fullsized":"2024-04-26T23:49:59.576779+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5401","last_scrub_stamp":"2024-04-26T23:49:59.576612+0000","last_deep_scrub":"26'5401","last_deep_scrub_stamp":"2024-04-26T23:49:59.576612+0000","last_clean_scrub_stamp":"2024-04-26T23:49:59.576612+0000","objects_scrubbed":0,"log_size":5401,"log_dups_size":0,"ondisk_log_size":5401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:00:26.843111+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":81323,"num_write_kb":1040915,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.29","version":"26'4135","reported_seq":4172,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:56.201108+0000","last_change":"2024-04-26T23:49:56.201135+0000","last_active":"2024-04-26T23:49:56.201108+0000","last_peered":"2024-04-26T23:49:56.201108+0000","last_clean":"2024-04-26T23:49:56.201108+0000","last_became_active":"2024-04-26T23:40:32.593639+0000","last_became_peered":"2024-04-26T23:40:32.593639+0000","last_unstale":"2024-04-26T23:49:56.201108+0000","last_undegraded":"2024-04-26T23:49:56.201108+0000","last_fullsized":"2024-04-26T23:49:56.201108+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4135","last_scrub_stamp":"2024-04-26T23:49:56.200995+0000","last_deep_scrub":"26'4135","last_deep_scrub_stamp":"2024-04-26T23:49:56.200995+0000","last_clean_scrub_stamp":"2024-04-26T23:49:56.200995+0000","objects_scrubbed":0,"log_size":4135,"log_dups_size":0,"ondisk_log_size":4135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:42:04.223019+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":62129,"num_write_kb":797085,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"26'4466","reported_seq":4495,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:50.424214+0000","last_change":"2024-04-26T23:49:50.424238+0000","last_active":"2024-04-26T23:49:50.424214+0000","last_peered":"2024-04-26T23:49:50.424214+0000","last_clean":"2024-04-26T23:49:50.424214+0000","last_became_active":"2024-04-26T23:40:41.674274+0000","last_became_peered":"2024-04-26T23:40:41.674274+0000","last_unstale":"2024-04-26T23:49:50.424214+0000","last_undegraded":"2024-04-26T23:49:50.424214+0000","last_fullsized":"2024-04-26T23:49:50.424214+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4466","last_scrub_stamp":"2024-04-26T23:49:50.424132+0000","last_deep_scrub":"26'4466","last_deep_scrub_stamp":"2024-04-26T23:49:50.424132+0000","last_clean_scrub_stamp":"2024-04-26T23:49:50.424132+0000","objects_scrubbed":0,"log_size":4466,"log_dups_size":0,"ondisk_log_size":4466,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:06:59.444996+0000","scrub_duration":20,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":67376,"num_write_kb":867303,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"26'4512","reported_seq":4549,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:50.782111+0000","last_change":"2024-04-26T23:49:50.782141+0000","last_active":"2024-04-26T23:49:50.782111+0000","last_peered":"2024-04-26T23:49:50.782111+0000","last_clean":"2024-04-26T23:49:50.782111+0000","last_became_active":"2024-04-26T23:40:32.591366+0000","last_became_peered":"2024-04-26T23:40:32.591366+0000","last_unstale":"2024-04-26T23:49:50.782111+0000","last_undegraded":"2024-04-26T23:49:50.782111+0000","last_fullsized":"2024-04-26T23:49:50.782111+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4512","last_scrub_stamp":"2024-04-26T23:49:50.782003+0000","last_deep_scrub":"26'4512","last_deep_scrub_stamp":"2024-04-26T23:49:50.782003+0000","last_clean_scrub_stamp":"2024-04-26T23:49:50.782003+0000","objects_scrubbed":0,"log_size":4512,"log_dups_size":0,"ondisk_log_size":4512,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:44:12.537910+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":67679,"num_write_kb":882467,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2d","version":"26'4496","reported_seq":4525,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:50:20.427155+0000","last_change":"2024-04-26T23:50:20.427181+0000","last_active":"2024-04-26T23:50:20.427155+0000","last_peered":"2024-04-26T23:50:20.427155+0000","last_clean":"2024-04-26T23:50:20.427155+0000","last_became_active":"2024-04-26T23:40:41.692122+0000","last_became_peered":"2024-04-26T23:40:41.692122+0000","last_unstale":"2024-04-26T23:50:20.427155+0000","last_undegraded":"2024-04-26T23:50:20.427155+0000","last_fullsized":"2024-04-26T23:50:20.427155+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4496","last_scrub_stamp":"2024-04-26T23:50:20.427030+0000","last_deep_scrub":"26'4496","last_deep_scrub_stamp":"2024-04-26T23:50:20.427030+0000","last_clean_scrub_stamp":"2024-04-26T23:50:20.427030+0000","objects_scrubbed":0,"log_size":4496,"log_dups_size":0,"ondisk_log_size":4496,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:53:30.239381+0000","scrub_duration":18,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":67600,"num_write_kb":861109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2b","version":"26'4261","reported_seq":4298,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:58.725024+0000","last_change":"2024-04-26T23:49:58.725054+0000","last_active":"2024-04-26T23:49:58.725024+0000","last_peered":"2024-04-26T23:49:58.725024+0000","last_clean":"2024-04-26T23:49:58.725024+0000","last_became_active":"2024-04-26T23:40:32.590193+0000","last_became_peered":"2024-04-26T23:40:32.590193+0000","last_unstale":"2024-04-26T23:49:58.725024+0000","last_undegraded":"2024-04-26T23:49:58.725024+0000","last_fullsized":"2024-04-26T23:49:58.725024+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4261","last_scrub_stamp":"2024-04-26T23:49:58.724905+0000","last_deep_scrub":"26'4261","last_deep_scrub_stamp":"2024-04-26T23:49:58.724905+0000","last_clean_scrub_stamp":"2024-04-26T23:49:58.724905+0000","objects_scrubbed":0,"log_size":4261,"log_dups_size":0,"ondisk_log_size":4261,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:37:59.745275+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":63685,"num_write_kb":822261,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2a","version":"26'5005","reported_seq":5034,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:50:11.168878+0000","last_change":"2024-04-26T23:50:11.168904+0000","last_active":"2024-04-26T23:50:11.168878+0000","last_peered":"2024-04-26T23:50:11.168878+0000","last_clean":"2024-04-26T23:50:11.168878+0000","last_became_active":"2024-04-26T23:40:41.691837+0000","last_became_peered":"2024-04-26T23:40:41.691837+0000","last_unstale":"2024-04-26T23:50:11.168878+0000","last_undegraded":"2024-04-26T23:50:11.168878+0000","last_fullsized":"2024-04-26T23:50:11.168878+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5005","last_scrub_stamp":"2024-04-26T23:50:11.168777+0000","last_deep_scrub":"26'5005","last_deep_scrub_stamp":"2024-04-26T23:50:11.168777+0000","last_clean_scrub_stamp":"2024-04-26T23:50:11.168777+0000","objects_scrubbed":0,"log_size":5005,"log_dups_size":0,"ondisk_log_size":5005,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:37:40.027434+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":75356,"num_write_kb":950203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"26'4090","reported_seq":4127,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:53.766047+0000","last_change":"2024-04-26T23:49:53.766076+0000","last_active":"2024-04-26T23:49:53.766047+0000","last_peered":"2024-04-26T23:49:53.766047+0000","last_clean":"2024-04-26T23:49:53.766047+0000","last_became_active":"2024-04-26T23:40:32.590241+0000","last_became_peered":"2024-04-26T23:40:32.590241+0000","last_unstale":"2024-04-26T23:49:53.766047+0000","last_undegraded":"2024-04-26T23:49:53.766047+0000","last_fullsized":"2024-04-26T23:49:53.766047+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4090","last_scrub_stamp":"2024-04-26T23:49:53.765930+0000","last_deep_scrub":"26'4090","last_deep_scrub_stamp":"2024-04-26T23:49:53.765930+0000","last_clean_scrub_stamp":"2024-04-26T23:49:53.765930+0000","objects_scrubbed":0,"log_size":4090,"log_dups_size":0,"ondisk_log_size":4090,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:09:14.203814+0000","scrub_duration":21,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":61267,"num_write_kb":785631,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"26'4591","reported_seq":4620,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:50:07.303390+0000","last_change":"2024-04-26T23:50:07.303415+0000","last_active":"2024-04-26T23:50:07.303390+0000","last_peered":"2024-04-26T23:50:07.303390+0000","last_clean":"2024-04-26T23:50:07.303390+0000","last_became_active":"2024-04-26T23:40:41.689215+0000","last_became_peered":"2024-04-26T23:40:41.689215+0000","last_unstale":"2024-04-26T23:50:07.303390+0000","last_undegraded":"2024-04-26T23:50:07.303390+0000","last_fullsized":"2024-04-26T23:50:07.303390+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4591","last_scrub_stamp":"2024-04-26T23:50:07.303285+0000","last_deep_scrub":"26'4591","last_deep_scrub_stamp":"2024-04-26T23:50:07.303285+0000","last_clean_scrub_stamp":"2024-04-26T23:50:07.303285+0000","objects_scrubbed":0,"log_size":4591,"log_dups_size":0,"ondisk_log_size":4591,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:01:03.847713+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":68781,"num_write_kb":892789,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2d","version":"26'4171","reported_seq":4208,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:50:02.598710+0000","last_change":"2024-04-26T23:50:02.598737+0000","last_active":"2024-04-26T23:50:02.598710+0000","last_peered":"2024-04-26T23:50:02.598710+0000","last_clean":"2024-04-26T23:50:02.598710+0000","last_became_active":"2024-04-26T23:40:32.588063+0000","last_became_peered":"2024-04-26T23:40:32.588063+0000","last_unstale":"2024-04-26T23:50:02.598710+0000","last_undegraded":"2024-04-26T23:50:02.598710+0000","last_fullsized":"2024-04-26T23:50:02.598710+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4171","last_scrub_stamp":"2024-04-26T23:50:02.598602+0000","last_deep_scrub":"26'4171","last_deep_scrub_stamp":"2024-04-26T23:50:02.598602+0000","last_clean_scrub_stamp":"2024-04-26T23:50:02.598602+0000","objects_scrubbed":0,"log_size":4171,"log_dups_size":0,"ondisk_log_size":4171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:57:55.179434+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":62428,"num_write_kb":793377,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.28","version":"26'4028","reported_seq":4057,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:58.662845+0000","last_change":"2024-04-26T23:49:58.662896+0000","last_active":"2024-04-26T23:49:58.662845+0000","last_peered":"2024-04-26T23:49:58.662845+0000","last_clean":"2024-04-26T23:49:58.662845+0000","last_became_active":"2024-04-26T23:40:41.674573+0000","last_became_peered":"2024-04-26T23:40:41.674573+0000","last_unstale":"2024-04-26T23:49:58.662845+0000","last_undegraded":"2024-04-26T23:49:58.662845+0000","last_fullsized":"2024-04-26T23:49:58.662845+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4028","last_scrub_stamp":"2024-04-26T23:49:58.662739+0000","last_deep_scrub":"26'4028","last_deep_scrub_stamp":"2024-04-26T23:49:58.662739+0000","last_clean_scrub_stamp":"2024-04-26T23:49:58.662739+0000","objects_scrubbed":0,"log_size":4028,"log_dups_size":0,"ondisk_log_size":4028,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:00:25.929238+0000","scrub_duration":18,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":60451,"num_write_kb":760274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"26'3337","reported_seq":3374,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:55.399690+0000","last_change":"2024-04-26T23:49:55.399718+0000","last_active":"2024-04-26T23:49:55.399690+0000","last_peered":"2024-04-26T23:49:55.399690+0000","last_clean":"2024-04-26T23:49:55.399690+0000","last_became_active":"2024-04-26T23:40:32.574503+0000","last_became_peered":"2024-04-26T23:40:32.574503+0000","last_unstale":"2024-04-26T23:49:55.399690+0000","last_undegraded":"2024-04-26T23:49:55.399690+0000","last_fullsized":"2024-04-26T23:49:55.399690+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3337","last_scrub_stamp":"2024-04-26T23:49:55.399592+0000","last_deep_scrub":"26'3337","last_deep_scrub_stamp":"2024-04-26T23:49:55.399592+0000","last_clean_scrub_stamp":"2024-04-26T23:49:55.399592+0000","objects_scrubbed":0,"log_size":3337,"log_dups_size":0,"ondisk_log_size":3337,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:50:51.939539+0000","scrub_duration":17,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49634,"num_write_kb":627043,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.29","version":"26'4410","reported_seq":4439,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:50:02.658165+0000","last_change":"2024-04-26T23:50:02.658193+0000","last_active":"2024-04-26T23:50:02.658165+0000","last_peered":"2024-04-26T23:50:02.658165+0000","last_clean":"2024-04-26T23:50:02.658165+0000","last_became_active":"2024-04-26T23:40:41.679920+0000","last_became_peered":"2024-04-26T23:40:41.679920+0000","last_unstale":"2024-04-26T23:50:02.658165+0000","last_undegraded":"2024-04-26T23:50:02.658165+0000","last_fullsized":"2024-04-26T23:50:02.658165+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4410","last_scrub_stamp":"2024-04-26T23:50:02.658071+0000","last_deep_scrub":"26'4410","last_deep_scrub_stamp":"2024-04-26T23:50:02.658071+0000","last_clean_scrub_stamp":"2024-04-26T23:50:02.658071+0000","objects_scrubbed":0,"log_size":4410,"log_dups_size":0,"ondisk_log_size":4410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:47:27.300505+0000","scrub_duration":16,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":66255,"num_write_kb":845549,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2f","version":"26'5167","reported_seq":5204,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:52.712843+0000","last_change":"2024-04-26T23:49:52.712843+0000","last_active":"2024-04-26T23:49:52.712843+0000","last_peered":"2024-04-26T23:49:52.712843+0000","last_clean":"2024-04-26T23:49:52.712843+0000","last_became_active":"2024-04-26T23:40:32.593169+0000","last_became_peered":"2024-04-26T23:40:32.593169+0000","last_unstale":"2024-04-26T23:49:52.712843+0000","last_undegraded":"2024-04-26T23:49:52.712843+0000","last_fullsized":"2024-04-26T23:49:52.712843+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5167","last_scrub_stamp":"2024-04-26T23:49:52.712701+0000","last_deep_scrub":"26'5167","last_deep_scrub_stamp":"2024-04-26T23:49:52.712701+0000","last_clean_scrub_stamp":"2024-04-26T23:49:52.712701+0000","objects_scrubbed":0,"log_size":5167,"log_dups_size":0,"ondisk_log_size":5167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:37:53.733071+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":77406,"num_write_kb":981579,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.36","version":"26'5055","reported_seq":5083,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:50:13.264495+0000","last_change":"2024-04-26T23:50:13.264522+0000","last_active":"2024-04-26T23:50:13.264495+0000","last_peered":"2024-04-26T23:50:13.264495+0000","last_clean":"2024-04-26T23:50:13.264495+0000","last_became_active":"2024-04-26T23:40:41.694297+0000","last_became_peered":"2024-04-26T23:40:41.694297+0000","last_unstale":"2024-04-26T23:50:13.264495+0000","last_undegraded":"2024-04-26T23:50:13.264495+0000","last_fullsized":"2024-04-26T23:50:13.264495+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5055","last_scrub_stamp":"2024-04-26T23:50:13.264388+0000","last_deep_scrub":"26'5055","last_deep_scrub_stamp":"2024-04-26T23:50:13.264388+0000","last_clean_scrub_stamp":"2024-04-26T23:50:13.264388+0000","objects_scrubbed":0,"log_size":5055,"log_dups_size":0,"ondisk_log_size":5055,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:49:46.520300+0000","scrub_duration":37,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":75865,"num_write_kb":998838,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"26'3722","reported_seq":3759,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:55.641992+0000","last_change":"2024-04-26T23:49:55.641992+0000","last_active":"2024-04-26T23:49:55.641992+0000","last_peered":"2024-04-26T23:49:55.641992+0000","last_clean":"2024-04-26T23:49:55.641992+0000","last_became_active":"2024-04-26T23:40:32.584678+0000","last_became_peered":"2024-04-26T23:40:32.584678+0000","last_unstale":"2024-04-26T23:49:55.641992+0000","last_undegraded":"2024-04-26T23:49:55.641992+0000","last_fullsized":"2024-04-26T23:49:55.641992+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3722","last_scrub_stamp":"2024-04-26T23:49:55.641842+0000","last_deep_scrub":"26'3722","last_deep_scrub_stamp":"2024-04-26T23:49:55.641842+0000","last_clean_scrub_stamp":"2024-04-26T23:49:55.641842+0000","objects_scrubbed":0,"log_size":3722,"log_dups_size":0,"ondisk_log_size":3722,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:41:55.308834+0000","scrub_duration":21,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55693,"num_write_kb":722935,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.37","version":"26'5541","reported_seq":5569,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:50:12.188737+0000","last_change":"2024-04-26T23:50:12.188765+0000","last_active":"2024-04-26T23:50:12.188737+0000","last_peered":"2024-04-26T23:50:12.188737+0000","last_clean":"2024-04-26T23:50:12.188737+0000","last_became_active":"2024-04-26T23:40:41.692090+0000","last_became_peered":"2024-04-26T23:40:41.692090+0000","last_unstale":"2024-04-26T23:50:12.188737+0000","last_undegraded":"2024-04-26T23:50:12.188737+0000","last_fullsized":"2024-04-26T23:50:12.188737+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5541","last_scrub_stamp":"2024-04-26T23:50:12.188626+0000","last_deep_scrub":"26'5541","last_deep_scrub_stamp":"2024-04-26T23:50:12.188626+0000","last_clean_scrub_stamp":"2024-04-26T23:50:12.188626+0000","objects_scrubbed":0,"log_size":5541,"log_dups_size":0,"ondisk_log_size":5541,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:46:16.344884+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":83365,"num_write_kb":1062103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"26'4290","reported_seq":4327,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:51.180512+0000","last_change":"2024-04-26T23:49:51.180512+0000","last_active":"2024-04-26T23:49:51.180512+0000","last_peered":"2024-04-26T23:49:51.180512+0000","last_clean":"2024-04-26T23:49:51.180512+0000","last_became_active":"2024-04-26T23:40:32.590162+0000","last_became_peered":"2024-04-26T23:40:32.590162+0000","last_unstale":"2024-04-26T23:49:51.180512+0000","last_undegraded":"2024-04-26T23:49:51.180512+0000","last_fullsized":"2024-04-26T23:49:51.180512+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4290","last_scrub_stamp":"2024-04-26T23:49:51.180393+0000","last_deep_scrub":"26'4290","last_deep_scrub_stamp":"2024-04-26T23:49:51.180393+0000","last_clean_scrub_stamp":"2024-04-26T23:49:51.180393+0000","objects_scrubbed":0,"log_size":4290,"log_dups_size":0,"ondisk_log_size":4290,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:02:52.187012+0000","scrub_duration":24,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":64302,"num_write_kb":811481,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.34","version":"26'3759","reported_seq":3788,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:50:13.643428+0000","last_change":"2024-04-26T23:50:13.643428+0000","last_active":"2024-04-26T23:50:13.643428+0000","last_peered":"2024-04-26T23:50:13.643428+0000","last_clean":"2024-04-26T23:50:13.643428+0000","last_became_active":"2024-04-26T23:40:41.686999+0000","last_became_peered":"2024-04-26T23:40:41.686999+0000","last_unstale":"2024-04-26T23:50:13.643428+0000","last_undegraded":"2024-04-26T23:50:13.643428+0000","last_fullsized":"2024-04-26T23:50:13.643428+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3759","last_scrub_stamp":"2024-04-26T23:50:13.643252+0000","last_deep_scrub":"26'3759","last_deep_scrub_stamp":"2024-04-26T23:50:13.643252+0000","last_clean_scrub_stamp":"2024-04-26T23:50:13.643252+0000","objects_scrubbed":0,"log_size":3759,"log_dups_size":0,"ondisk_log_size":3759,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:51:54.216714+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":56674,"num_write_kb":713071,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"26'4299","reported_seq":4336,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:56.751622+0000","last_change":"2024-04-26T23:49:56.751622+0000","last_active":"2024-04-26T23:49:56.751622+0000","last_peered":"2024-04-26T23:49:56.751622+0000","last_clean":"2024-04-26T23:49:56.751622+0000","last_became_active":"2024-04-26T23:40:32.585995+0000","last_became_peered":"2024-04-26T23:40:32.585995+0000","last_unstale":"2024-04-26T23:49:56.751622+0000","last_undegraded":"2024-04-26T23:49:56.751622+0000","last_fullsized":"2024-04-26T23:49:56.751622+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4299","last_scrub_stamp":"2024-04-26T23:49:56.751481+0000","last_deep_scrub":"26'4299","last_deep_scrub_stamp":"2024-04-26T23:49:56.751481+0000","last_clean_scrub_stamp":"2024-04-26T23:49:56.751481+0000","objects_scrubbed":0,"log_size":4299,"log_dups_size":0,"ondisk_log_size":4299,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:45:55.226502+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":64455,"num_write_kb":829744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.35","version":"26'4332","reported_seq":4361,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:50:18.708074+0000","last_change":"2024-04-26T23:50:18.708074+0000","last_active":"2024-04-26T23:50:18.708074+0000","last_peered":"2024-04-26T23:50:18.708074+0000","last_clean":"2024-04-26T23:50:18.708074+0000","last_became_active":"2024-04-26T23:40:41.691437+0000","last_became_peered":"2024-04-26T23:40:41.691437+0000","last_unstale":"2024-04-26T23:50:18.708074+0000","last_undegraded":"2024-04-26T23:50:18.708074+0000","last_fullsized":"2024-04-26T23:50:18.708074+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4332","last_scrub_stamp":"2024-04-26T23:50:18.707930+0000","last_deep_scrub":"26'4332","last_deep_scrub_stamp":"2024-04-26T23:50:18.707930+0000","last_clean_scrub_stamp":"2024-04-26T23:50:18.707930+0000","objects_scrubbed":0,"log_size":4332,"log_dups_size":0,"ondisk_log_size":4332,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:43:38.756599+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":65307,"num_write_kb":818233,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.33","version":"26'3786","reported_seq":3823,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:50:00.233984+0000","last_change":"2024-04-26T23:50:00.233984+0000","last_active":"2024-04-26T23:50:00.233984+0000","last_peered":"2024-04-26T23:50:00.233984+0000","last_clean":"2024-04-26T23:50:00.233984+0000","last_became_active":"2024-04-26T23:40:32.592717+0000","last_became_peered":"2024-04-26T23:40:32.592717+0000","last_unstale":"2024-04-26T23:50:00.233984+0000","last_undegraded":"2024-04-26T23:50:00.233984+0000","last_fullsized":"2024-04-26T23:50:00.233984+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3786","last_scrub_stamp":"2024-04-26T23:50:00.233785+0000","last_deep_scrub":"26'3786","last_deep_scrub_stamp":"2024-04-26T23:50:00.233785+0000","last_clean_scrub_stamp":"2024-04-26T23:50:00.233785+0000","objects_scrubbed":0,"log_size":3786,"log_dups_size":0,"ondisk_log_size":3786,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:57:52.814617+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":56607,"num_write_kb":740250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.32","version":"26'4732","reported_seq":4761,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:50:01.257042+0000","last_change":"2024-04-26T23:50:01.257042+0000","last_active":"2024-04-26T23:50:01.257042+0000","last_peered":"2024-04-26T23:50:01.257042+0000","last_clean":"2024-04-26T23:50:01.257042+0000","last_became_active":"2024-04-26T23:40:41.675042+0000","last_became_peered":"2024-04-26T23:40:41.675042+0000","last_unstale":"2024-04-26T23:50:01.257042+0000","last_undegraded":"2024-04-26T23:50:01.257042+0000","last_fullsized":"2024-04-26T23:50:01.257042+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4732","last_scrub_stamp":"2024-04-26T23:50:01.256864+0000","last_deep_scrub":"26'4732","last_deep_scrub_stamp":"2024-04-26T23:50:01.256864+0000","last_clean_scrub_stamp":"2024-04-26T23:50:01.256864+0000","objects_scrubbed":0,"log_size":4732,"log_dups_size":0,"ondisk_log_size":4732,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:00:57.801291+0000","scrub_duration":17,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":71116,"num_write_kb":894316,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"26'3513","reported_seq":3550,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:50:02.386713+0000","last_change":"2024-04-26T23:50:02.386713+0000","last_active":"2024-04-26T23:50:02.386713+0000","last_peered":"2024-04-26T23:50:02.386713+0000","last_clean":"2024-04-26T23:50:02.386713+0000","last_became_active":"2024-04-26T23:40:32.594802+0000","last_became_peered":"2024-04-26T23:40:32.594802+0000","last_unstale":"2024-04-26T23:50:02.386713+0000","last_undegraded":"2024-04-26T23:50:02.386713+0000","last_fullsized":"2024-04-26T23:50:02.386713+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3513","last_scrub_stamp":"2024-04-26T23:50:02.386576+0000","last_deep_scrub":"26'3513","last_deep_scrub_stamp":"2024-04-26T23:50:02.386576+0000","last_clean_scrub_stamp":"2024-04-26T23:50:02.386576+0000","objects_scrubbed":0,"log_size":3513,"log_dups_size":0,"ondisk_log_size":3513,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:04:50.151949+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":52734,"num_write_kb":670887,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.33","version":"26'4045","reported_seq":4074,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:50:03.422944+0000","last_change":"2024-04-26T23:50:03.422944+0000","last_active":"2024-04-26T23:50:03.422944+0000","last_peered":"2024-04-26T23:50:03.422944+0000","last_clean":"2024-04-26T23:50:03.422944+0000","last_became_active":"2024-04-26T23:40:41.690846+0000","last_became_peered":"2024-04-26T23:40:41.690846+0000","last_unstale":"2024-04-26T23:50:03.422944+0000","last_undegraded":"2024-04-26T23:50:03.422944+0000","last_fullsized":"2024-04-26T23:50:03.422944+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4045","last_scrub_stamp":"2024-04-26T23:50:03.422796+0000","last_deep_scrub":"26'4045","last_deep_scrub_stamp":"2024-04-26T23:50:03.422796+0000","last_clean_scrub_stamp":"2024-04-26T23:50:03.422796+0000","objects_scrubbed":0,"log_size":4045,"log_dups_size":0,"ondisk_log_size":4045,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:55:13.464010+0000","scrub_duration":20,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":60666,"num_write_kb":797602,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.35","version":"26'4035","reported_seq":4072,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:50:01.761473+0000","last_change":"2024-04-26T23:50:01.761473+0000","last_active":"2024-04-26T23:50:01.761473+0000","last_peered":"2024-04-26T23:50:01.761473+0000","last_clean":"2024-04-26T23:50:01.761473+0000","last_became_active":"2024-04-26T23:40:32.578556+0000","last_became_peered":"2024-04-26T23:40:32.578556+0000","last_unstale":"2024-04-26T23:50:01.761473+0000","last_undegraded":"2024-04-26T23:50:01.761473+0000","last_fullsized":"2024-04-26T23:50:01.761473+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4035","last_scrub_stamp":"2024-04-26T23:50:01.761312+0000","last_deep_scrub":"26'4035","last_deep_scrub_stamp":"2024-04-26T23:50:01.761312+0000","last_clean_scrub_stamp":"2024-04-26T23:50:01.761312+0000","objects_scrubbed":0,"log_size":4035,"log_dups_size":0,"ondisk_log_size":4035,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:38:51.003778+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":60570,"num_write_kb":769077,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.30","version":"26'3969","reported_seq":3998,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:50:17.670984+0000","last_change":"2024-04-26T23:50:17.671045+0000","last_active":"2024-04-26T23:50:17.670984+0000","last_peered":"2024-04-26T23:50:17.670984+0000","last_clean":"2024-04-26T23:50:17.670984+0000","last_became_active":"2024-04-26T23:40:41.689267+0000","last_became_peered":"2024-04-26T23:40:41.689267+0000","last_unstale":"2024-04-26T23:50:17.670984+0000","last_undegraded":"2024-04-26T23:50:17.670984+0000","last_fullsized":"2024-04-26T23:50:17.670984+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3969","last_scrub_stamp":"2024-04-26T23:50:17.670828+0000","last_deep_scrub":"26'3969","last_deep_scrub_stamp":"2024-04-26T23:50:17.670828+0000","last_clean_scrub_stamp":"2024-04-26T23:50:17.670828+0000","objects_scrubbed":0,"log_size":3969,"log_dups_size":0,"ondisk_log_size":3969,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:07:04.946473+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":59630,"num_write_kb":775739,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"26'4731","reported_seq":4768,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:50:00.747156+0000","last_change":"2024-04-26T23:50:00.747156+0000","last_active":"2024-04-26T23:50:00.747156+0000","last_peered":"2024-04-26T23:50:00.747156+0000","last_clean":"2024-04-26T23:50:00.747156+0000","last_became_active":"2024-04-26T23:40:32.577865+0000","last_became_peered":"2024-04-26T23:40:32.577865+0000","last_unstale":"2024-04-26T23:50:00.747156+0000","last_undegraded":"2024-04-26T23:50:00.747156+0000","last_fullsized":"2024-04-26T23:50:00.747156+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4731","last_scrub_stamp":"2024-04-26T23:50:00.747009+0000","last_deep_scrub":"26'4731","last_deep_scrub_stamp":"2024-04-26T23:50:00.747009+0000","last_clean_scrub_stamp":"2024-04-26T23:50:00.747009+0000","objects_scrubbed":0,"log_size":4731,"log_dups_size":0,"ondisk_log_size":4731,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:45:59.222030+0000","scrub_duration":17,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":70795,"num_write_kb":915734,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.31","version":"26'4442","reported_seq":4471,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:50:11.648493+0000","last_change":"2024-04-26T23:50:11.648521+0000","last_active":"2024-04-26T23:50:11.648493+0000","last_peered":"2024-04-26T23:50:11.648493+0000","last_clean":"2024-04-26T23:50:11.648493+0000","last_became_active":"2024-04-26T23:40:41.680676+0000","last_became_peered":"2024-04-26T23:40:41.680676+0000","last_unstale":"2024-04-26T23:50:11.648493+0000","last_undegraded":"2024-04-26T23:50:11.648493+0000","last_fullsized":"2024-04-26T23:50:11.648493+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4442","last_scrub_stamp":"2024-04-26T23:50:11.648381+0000","last_deep_scrub":"26'4442","last_deep_scrub_stamp":"2024-04-26T23:50:11.648381+0000","last_clean_scrub_stamp":"2024-04-26T23:50:11.648381+0000","objects_scrubbed":0,"log_size":4442,"log_dups_size":0,"ondisk_log_size":4442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:12:38.429191+0000","scrub_duration":16,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":66738,"num_write_kb":853261,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"26'4979","reported_seq":5016,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:58.521386+0000","last_change":"2024-04-26T23:49:58.521386+0000","last_active":"2024-04-26T23:49:58.521386+0000","last_peered":"2024-04-26T23:49:58.521386+0000","last_clean":"2024-04-26T23:49:58.521386+0000","last_became_active":"2024-04-26T23:40:32.591209+0000","last_became_peered":"2024-04-26T23:40:32.591209+0000","last_unstale":"2024-04-26T23:49:58.521386+0000","last_undegraded":"2024-04-26T23:49:58.521386+0000","last_fullsized":"2024-04-26T23:49:58.521386+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4979","last_scrub_stamp":"2024-04-26T23:49:58.521242+0000","last_deep_scrub":"26'4979","last_deep_scrub_stamp":"2024-04-26T23:49:58.521242+0000","last_clean_scrub_stamp":"2024-04-26T23:49:58.521242+0000","objects_scrubbed":0,"log_size":4979,"log_dups_size":0,"ondisk_log_size":4979,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:04:46.286615+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":74710,"num_write_kb":992211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3e","version":"26'5670","reported_seq":5699,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:50:16.440372+0000","last_change":"2024-04-26T23:50:16.440416+0000","last_active":"2024-04-26T23:50:16.440372+0000","last_peered":"2024-04-26T23:50:16.440372+0000","last_clean":"2024-04-26T23:50:16.440372+0000","last_became_active":"2024-04-26T23:40:41.685786+0000","last_became_peered":"2024-04-26T23:40:41.685786+0000","last_unstale":"2024-04-26T23:50:16.440372+0000","last_undegraded":"2024-04-26T23:50:16.440372+0000","last_fullsized":"2024-04-26T23:50:16.440372+0000","mapping_epoch":22,"log_start":"26'400","ondisk_log_start":"26'400","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5670","last_scrub_stamp":"2024-04-26T23:50:16.440207+0000","last_deep_scrub":"26'5670","last_deep_scrub_stamp":"2024-04-26T23:50:16.440207+0000","last_clean_scrub_stamp":"2024-04-26T23:50:16.440207+0000","objects_scrubbed":0,"log_size":5270,"log_dups_size":0,"ondisk_log_size":5270,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:43:36.488876+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":85672,"num_write_kb":1105852,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.38","version":"26'4537","reported_seq":4573,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:50:02.245307+0000","last_change":"2024-04-26T23:50:02.245335+0000","last_active":"2024-04-26T23:50:02.245307+0000","last_peered":"2024-04-26T23:50:02.245307+0000","last_clean":"2024-04-26T23:50:02.245307+0000","last_became_active":"2024-04-26T23:40:32.592282+0000","last_became_peered":"2024-04-26T23:40:32.592282+0000","last_unstale":"2024-04-26T23:50:02.245307+0000","last_undegraded":"2024-04-26T23:50:02.245307+0000","last_fullsized":"2024-04-26T23:50:02.245307+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4537","last_scrub_stamp":"2024-04-26T23:50:02.245206+0000","last_deep_scrub":"26'4537","last_deep_scrub_stamp":"2024-04-26T23:50:02.245206+0000","last_clean_scrub_stamp":"2024-04-26T23:50:02.245206+0000","objects_scrubbed":0,"log_size":4537,"log_dups_size":0,"ondisk_log_size":4537,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:56:14.580169+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":68313,"num_write_kb":849602,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3f","version":"26'3838","reported_seq":3867,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:50:06.748529+0000","last_change":"2024-04-26T23:50:06.748572+0000","last_active":"2024-04-26T23:50:06.748529+0000","last_peered":"2024-04-26T23:50:06.748529+0000","last_clean":"2024-04-26T23:50:06.748529+0000","last_became_active":"2024-04-26T23:40:41.678926+0000","last_became_peered":"2024-04-26T23:40:41.678926+0000","last_unstale":"2024-04-26T23:50:06.748529+0000","last_undegraded":"2024-04-26T23:50:06.748529+0000","last_fullsized":"2024-04-26T23:50:06.748529+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3838","last_scrub_stamp":"2024-04-26T23:50:06.748423+0000","last_deep_scrub":"26'3838","last_deep_scrub_stamp":"2024-04-26T23:50:06.748423+0000","last_clean_scrub_stamp":"2024-04-26T23:50:06.748423+0000","objects_scrubbed":0,"log_size":3838,"log_dups_size":0,"ondisk_log_size":3838,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:24:26.138055+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":57629,"num_write_kb":750507,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.39","version":"26'4047","reported_seq":4069,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:50:04.445267+0000","last_change":"2024-04-26T23:50:04.445325+0000","last_active":"2024-04-26T23:50:04.445267+0000","last_peered":"2024-04-26T23:50:04.445267+0000","last_clean":"2024-04-26T23:50:04.445267+0000","last_became_active":"2024-04-26T23:41:30.372928+0000","last_became_peered":"2024-04-26T23:41:30.372928+0000","last_unstale":"2024-04-26T23:50:04.445267+0000","last_undegraded":"2024-04-26T23:50:04.445267+0000","last_fullsized":"2024-04-26T23:50:04.445267+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4047","last_scrub_stamp":"2024-04-26T23:50:04.445130+0000","last_deep_scrub":"26'4047","last_deep_scrub_stamp":"2024-04-26T23:50:04.445130+0000","last_clean_scrub_stamp":"2024-04-26T23:50:04.445130+0000","objects_scrubbed":0,"log_size":4047,"log_dups_size":0,"ondisk_log_size":4047,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:38:34.593016+0000","scrub_duration":20,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":60897,"num_write_kb":776135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3c","version":"26'4076","reported_seq":4105,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:50:09.316670+0000","last_change":"2024-04-26T23:50:09.316717+0000","last_active":"2024-04-26T23:50:09.316670+0000","last_peered":"2024-04-26T23:50:09.316670+0000","last_clean":"2024-04-26T23:50:09.316670+0000","last_became_active":"2024-04-26T23:40:41.688585+0000","last_became_peered":"2024-04-26T23:40:41.688585+0000","last_unstale":"2024-04-26T23:50:09.316670+0000","last_undegraded":"2024-04-26T23:50:09.316670+0000","last_fullsized":"2024-04-26T23:50:09.316670+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4076","last_scrub_stamp":"2024-04-26T23:50:09.316552+0000","last_deep_scrub":"26'4076","last_deep_scrub_stamp":"2024-04-26T23:50:09.316552+0000","last_clean_scrub_stamp":"2024-04-26T23:50:09.316552+0000","objects_scrubbed":0,"log_size":4076,"log_dups_size":0,"ondisk_log_size":4076,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:58:59.475904+0000","scrub_duration":39,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":61409,"num_write_kb":797665,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"26'3610","reported_seq":3646,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:57.652428+0000","last_change":"2024-04-26T23:49:57.652457+0000","last_active":"2024-04-26T23:49:57.652428+0000","last_peered":"2024-04-26T23:49:57.652428+0000","last_clean":"2024-04-26T23:49:57.652428+0000","last_became_active":"2024-04-26T23:40:32.584293+0000","last_became_peered":"2024-04-26T23:40:32.584293+0000","last_unstale":"2024-04-26T23:49:57.652428+0000","last_undegraded":"2024-04-26T23:49:57.652428+0000","last_fullsized":"2024-04-26T23:49:57.652428+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3610","last_scrub_stamp":"2024-04-26T23:49:57.652315+0000","last_deep_scrub":"26'3610","last_deep_scrub_stamp":"2024-04-26T23:49:57.652315+0000","last_clean_scrub_stamp":"2024-04-26T23:49:57.652315+0000","objects_scrubbed":0,"log_size":3610,"log_dups_size":0,"ondisk_log_size":3610,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:24:17.041947+0000","scrub_duration":17,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":54297,"num_write_kb":686705,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3d","version":"26'4621","reported_seq":4650,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:50:17.605396+0000","last_change":"2024-04-26T23:50:17.605425+0000","last_active":"2024-04-26T23:50:17.605396+0000","last_peered":"2024-04-26T23:50:17.605396+0000","last_clean":"2024-04-26T23:50:17.605396+0000","last_became_active":"2024-04-26T23:40:41.691081+0000","last_became_peered":"2024-04-26T23:40:41.691081+0000","last_unstale":"2024-04-26T23:50:17.605396+0000","last_undegraded":"2024-04-26T23:50:17.605396+0000","last_fullsized":"2024-04-26T23:50:17.605396+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4621","last_scrub_stamp":"2024-04-26T23:50:17.605284+0000","last_deep_scrub":"26'4621","last_deep_scrub_stamp":"2024-04-26T23:50:17.605284+0000","last_clean_scrub_stamp":"2024-04-26T23:50:17.605284+0000","objects_scrubbed":0,"log_size":4621,"log_dups_size":0,"ondisk_log_size":4621,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:57:20.623604+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69615,"num_write_kb":867426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"26'4911","reported_seq":4947,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:50:00.554507+0000","last_change":"2024-04-26T23:50:00.554533+0000","last_active":"2024-04-26T23:50:00.554507+0000","last_peered":"2024-04-26T23:50:00.554507+0000","last_clean":"2024-04-26T23:50:00.554507+0000","last_became_active":"2024-04-26T23:40:32.588409+0000","last_became_peered":"2024-04-26T23:40:32.588409+0000","last_unstale":"2024-04-26T23:50:00.554507+0000","last_undegraded":"2024-04-26T23:50:00.554507+0000","last_fullsized":"2024-04-26T23:50:00.554507+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4911","last_scrub_stamp":"2024-04-26T23:50:00.554399+0000","last_deep_scrub":"26'4911","last_deep_scrub_stamp":"2024-04-26T23:50:00.554399+0000","last_clean_scrub_stamp":"2024-04-26T23:50:00.554399+0000","objects_scrubbed":0,"log_size":4911,"log_dups_size":0,"ondisk_log_size":4911,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:43:05.116370+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":73569,"num_write_kb":917520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3a","version":"26'3815","reported_seq":3843,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:50:03.274167+0000","last_change":"2024-04-26T23:50:03.274212+0000","last_active":"2024-04-26T23:50:03.274167+0000","last_peered":"2024-04-26T23:50:03.274167+0000","last_clean":"2024-04-26T23:50:03.274167+0000","last_became_active":"2024-04-26T23:40:41.678333+0000","last_became_peered":"2024-04-26T23:40:41.678333+0000","last_unstale":"2024-04-26T23:50:03.274167+0000","last_undegraded":"2024-04-26T23:50:03.274167+0000","last_fullsized":"2024-04-26T23:50:03.274167+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3815","last_scrub_stamp":"2024-04-26T23:50:03.274029+0000","last_deep_scrub":"26'3815","last_deep_scrub_stamp":"2024-04-26T23:50:03.274029+0000","last_clean_scrub_stamp":"2024-04-26T23:50:03.274029+0000","objects_scrubbed":0,"log_size":3815,"log_dups_size":0,"ondisk_log_size":3815,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:26:36.047072+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":57471,"num_write_kb":738181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"26'3683","reported_seq":3720,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:50:08.625099+0000","last_change":"2024-04-26T23:50:08.625142+0000","last_active":"2024-04-26T23:50:08.625099+0000","last_peered":"2024-04-26T23:50:08.625099+0000","last_clean":"2024-04-26T23:50:08.625099+0000","last_became_active":"2024-04-26T23:40:32.580987+0000","last_became_peered":"2024-04-26T23:40:32.580987+0000","last_unstale":"2024-04-26T23:50:08.625099+0000","last_undegraded":"2024-04-26T23:50:08.625099+0000","last_fullsized":"2024-04-26T23:50:08.625099+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3683","last_scrub_stamp":"2024-04-26T23:50:08.624981+0000","last_deep_scrub":"26'3683","last_deep_scrub_stamp":"2024-04-26T23:50:08.624981+0000","last_clean_scrub_stamp":"2024-04-26T23:50:08.624981+0000","objects_scrubbed":0,"log_size":3683,"log_dups_size":0,"ondisk_log_size":3683,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:54:51.696142+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55303,"num_write_kb":749693,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3b","version":"26'5311","reported_seq":5339,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:49.447748+0000","last_change":"2024-04-26T23:49:49.447775+0000","last_active":"2024-04-26T23:49:49.447748+0000","last_peered":"2024-04-26T23:49:49.447748+0000","last_clean":"2024-04-26T23:49:49.447748+0000","last_became_active":"2024-04-26T23:40:41.678067+0000","last_became_peered":"2024-04-26T23:40:41.678067+0000","last_unstale":"2024-04-26T23:49:49.447748+0000","last_undegraded":"2024-04-26T23:49:49.447748+0000","last_fullsized":"2024-04-26T23:49:49.447748+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5311","last_scrub_stamp":"2024-04-26T23:49:49.447659+0000","last_deep_scrub":"26'5311","last_deep_scrub_stamp":"2024-04-26T23:49:49.447659+0000","last_clean_scrub_stamp":"2024-04-26T23:49:49.447659+0000","objects_scrubbed":0,"log_size":5311,"log_dups_size":0,"ondisk_log_size":5311,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:44:34.964705+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79871,"num_write_kb":1001680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"26'4313","reported_seq":4350,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:54.749758+0000","last_change":"2024-04-26T23:49:54.749786+0000","last_active":"2024-04-26T23:49:54.749758+0000","last_peered":"2024-04-26T23:49:54.749758+0000","last_clean":"2024-04-26T23:49:54.749758+0000","last_became_active":"2024-04-26T23:40:32.579569+0000","last_became_peered":"2024-04-26T23:40:32.579569+0000","last_unstale":"2024-04-26T23:49:54.749758+0000","last_undegraded":"2024-04-26T23:49:54.749758+0000","last_fullsized":"2024-04-26T23:49:54.749758+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4313","last_scrub_stamp":"2024-04-26T23:49:54.749654+0000","last_deep_scrub":"26'4313","last_deep_scrub_stamp":"2024-04-26T23:49:54.749654+0000","last_clean_scrub_stamp":"2024-04-26T23:49:54.749654+0000","objects_scrubbed":0,"log_size":4313,"log_dups_size":0,"ondisk_log_size":4313,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:00:57.933982+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":64676,"num_write_kb":807158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.38","version":"26'4952","reported_seq":4980,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:50:12.649194+0000","last_change":"2024-04-26T23:50:12.649218+0000","last_active":"2024-04-26T23:50:12.649194+0000","last_peered":"2024-04-26T23:50:12.649194+0000","last_clean":"2024-04-26T23:50:12.649194+0000","last_became_active":"2024-04-26T23:40:41.683734+0000","last_became_peered":"2024-04-26T23:40:41.683734+0000","last_unstale":"2024-04-26T23:50:12.649194+0000","last_undegraded":"2024-04-26T23:50:12.649194+0000","last_fullsized":"2024-04-26T23:50:12.649194+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4952","last_scrub_stamp":"2024-04-26T23:50:12.649095+0000","last_deep_scrub":"26'4952","last_deep_scrub_stamp":"2024-04-26T23:50:12.649095+0000","last_clean_scrub_stamp":"2024-04-26T23:50:12.649095+0000","objects_scrubbed":0,"log_size":4952,"log_dups_size":0,"ondisk_log_size":4952,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:20:10.752109+0000","scrub_duration":16,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":74716,"num_write_kb":913038,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"26'5195","reported_seq":5232,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:53.130712+0000","last_change":"2024-04-26T23:49:53.130759+0000","last_active":"2024-04-26T23:49:53.130712+0000","last_peered":"2024-04-26T23:49:53.130712+0000","last_clean":"2024-04-26T23:49:53.130712+0000","last_became_active":"2024-04-26T23:40:32.583655+0000","last_became_peered":"2024-04-26T23:40:32.583655+0000","last_unstale":"2024-04-26T23:49:53.130712+0000","last_undegraded":"2024-04-26T23:49:53.130712+0000","last_fullsized":"2024-04-26T23:49:53.130712+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5195","last_scrub_stamp":"2024-04-26T23:49:53.130581+0000","last_deep_scrub":"26'5195","last_deep_scrub_stamp":"2024-04-26T23:49:53.130581+0000","last_clean_scrub_stamp":"2024-04-26T23:49:53.130581+0000","objects_scrubbed":0,"log_size":5195,"log_dups_size":0,"ondisk_log_size":5195,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:44:14.886488+0000","scrub_duration":32,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":78237,"num_write_kb":1038116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.39","version":"26'4261","reported_seq":4289,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:50:11.610072+0000","last_change":"2024-04-26T23:50:11.610095+0000","last_active":"2024-04-26T23:50:11.610072+0000","last_peered":"2024-04-26T23:50:11.610072+0000","last_clean":"2024-04-26T23:50:11.610072+0000","last_became_active":"2024-04-26T23:40:41.681092+0000","last_became_peered":"2024-04-26T23:40:41.681092+0000","last_unstale":"2024-04-26T23:50:11.610072+0000","last_undegraded":"2024-04-26T23:50:11.610072+0000","last_fullsized":"2024-04-26T23:50:11.610072+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4261","last_scrub_stamp":"2024-04-26T23:50:11.609939+0000","last_deep_scrub":"26'4261","last_deep_scrub_stamp":"2024-04-26T23:50:11.609939+0000","last_clean_scrub_stamp":"2024-04-26T23:50:11.609939+0000","objects_scrubbed":0,"log_size":4261,"log_dups_size":0,"ondisk_log_size":4261,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:24:04.255482+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":64162,"num_write_kb":832623,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"26'3628","reported_seq":3665,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-26T23:49:55.462502+0000","last_change":"2024-04-26T23:49:55.462530+0000","last_active":"2024-04-26T23:49:55.462502+0000","last_peered":"2024-04-26T23:49:55.462502+0000","last_clean":"2024-04-26T23:49:55.462502+0000","last_became_active":"2024-04-26T23:40:32.596050+0000","last_became_peered":"2024-04-26T23:40:32.596050+0000","last_unstale":"2024-04-26T23:49:55.462502+0000","last_undegraded":"2024-04-26T23:49:55.462502+0000","last_fullsized":"2024-04-26T23:49:55.462502+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3628","last_scrub_stamp":"2024-04-26T23:49:55.462396+0000","last_deep_scrub":"26'3628","last_deep_scrub_stamp":"2024-04-26T23:49:55.462396+0000","last_clean_scrub_stamp":"2024-04-26T23:49:55.462396+0000","objects_scrubbed":0,"log_size":3628,"log_dups_size":0,"ondisk_log_size":3628,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:55:05.503610+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":54568,"num_write_kb":695399,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4349618,"num_write_kb":55464628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":287816,"ondisk_log_size":287816,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":158829364,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":18,"num_read_kb":98,"num_write":2627,"num_write_kb":157093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":317718528,"data_stored":317658728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2581,"ondisk_log_size":2581,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4020088,"num_write_kb":51543156,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":268065,"ondisk_log_size":268065,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":149566157,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":15,"num_read_kb":95,"num_write":2737,"num_write_kb":148086,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":299196416,"data_stored":299132314,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2652,"ondisk_log_size":2652,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574968,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":835292,"kb_used_data":81300,"kb_used_omap":1,"kb_used_meta":753982,"kb_avail":93536548,"statfs":{"total":96636764160,"available":95781425152,"internally_reserved":0,"allocated":83251200,"data_stored":83071836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":772078026},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574973,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":602412,"kb_used_data":84196,"kb_used_omap":1,"kb_used_meta":518206,"kb_avail":93769428,"statfs":{"total":96636764160,"available":96019894272,"internally_reserved":0,"allocated":86216704,"data_stored":86032549,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":530643398},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574970,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":756680,"kb_used_data":57088,"kb_used_omap":1,"kb_used_meta":699582,"kb_avail":93615160,"statfs":{"total":96636764160,"available":95861923840,"internally_reserved":0,"allocated":58458112,"data_stored":58278514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":716372421},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574971,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":827012,"kb_used_data":94588,"kb_used_omap":1,"kb_used_meta":732414,"kb_avail":93544828,"statfs":{"total":96636764160,"available":95789903872,"internally_reserved":0,"allocated":96858112,"data_stored":96670557,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":749992389},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574970,"num_pgs":58,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":830660,"kb_used_data":106876,"kb_used_omap":1,"kb_used_meta":723774,"kb_avail":93541180,"statfs":{"total":96636764160,"available":95786168320,"internally_reserved":0,"allocated":109441024,"data_stored":109254605,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":741145031},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574972,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":520948,"kb_used_data":24940,"kb_used_omap":1,"kb_used_meta":495998,"kb_avail":93850892,"statfs":{"total":96636764160,"available":96103313408,"internally_reserved":0,"allocated":25538560,"data_stored":25367229,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":507902405},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574971,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":751212,"kb_used_data":110884,"kb_used_omap":1,"kb_used_meta":640318,"kb_avail":93620628,"statfs":{"total":96636764160,"available":95867523072,"internally_reserved":0,"allocated":113545216,"data_stored":113360216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":655686085},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574974,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":604392,"kb_used_data":45920,"kb_used_omap":1,"kb_used_meta":558462,"kb_avail":93767448,"statfs":{"total":96636764160,"available":96017866752,"internally_reserved":0,"allocated":47022080,"data_stored":46841504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":571865541},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":29372416,"data_stored":29360766,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":41951232,"data_stored":41943200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12673024,"data_stored":12671093,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":33652736,"data_stored":33643285,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":46149632,"data_stored":46137470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":29364224,"data_stored":29360218,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":48824320,"data_stored":48813882,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":57208832,"data_stored":57202400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16777216,"data_stored":16777216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":71315456,"data_stored":71303862,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12587008,"data_stored":12582982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":75509760,"data_stored":75498166,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":50429952,"data_stored":50419933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28815360,"data_stored":28805142,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":37113856,"data_stored":37105513,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":25169920,"data_stored":25165914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T23:50:32.448 DEBUG:teuthology.orchestra.run.smithi088:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-04-26T23:50:32.577 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:32.572+0000 7f3a7b3a4640 1 Processor -- start 2024-04-26T23:50:32.577 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:32.572+0000 7f3a7b3a4640 1 -- start start 2024-04-26T23:50:32.578 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:32.573+0000 7f3a7b3a4640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f3a740ca5a0 0x7f3a74156bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:32.579 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:32.573+0000 7f3a7b3a4640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3a740c8df0 con 0x7f3a7415a1a0 2024-04-26T23:50:32.579 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:32.573+0000 7f3a7b3a4640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3a74154540 con 0x7f3a74154160 2024-04-26T23:50:32.579 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:32.573+0000 7f3a7b3a4640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f3a740c9100 con 0x7f3a740ca5a0 2024-04-26T23:50:32.579 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:32.573+0000 7f3a7893f640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f3a740ca5a0 0x7f3a74156bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:32.579 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:32.573+0000 7f3a79941640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f3a7415a1a0 0x7f3a740c9590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:48654/0 (socket says 172.21.15.88:48654) 2024-04-26T23:50:32.579 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:32.573+0000 7f3a79941640 1 -- 172.21.15.88:0/3199944791 learned_addr learned my addr 172.21.15.88:0/3199944791 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-26T23:50:32.579 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:32.574+0000 7f3a7893f640 1 -- 172.21.15.88:0/3199944791 >> v1:172.21.15.175:6789/0 conn(0x7f3a74154160 legacy=0x7f3a740c6e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:50:32.579 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:32.574+0000 7f3a7893f640 1 -- 172.21.15.88:0/3199944791 >> v1:172.21.15.88:6789/0 conn(0x7f3a7415a1a0 legacy=0x7f3a740c9590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:32.579 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:32.574+0000 7f3a7893f640 1 -- 172.21.15.88:0/3199944791 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a7415a910 con 0x7f3a740ca5a0 2024-04-26T23:50:32.579 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:32.574+0000 7f3a6bfff640 1 -- 172.21.15.88:0/3199944791 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2553314901 0 0) 0x7f3a6c001110 con 0x7f3a7415a1a0 2024-04-26T23:50:32.579 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:32.574+0000 7f3a7893f640 1 --2- 172.21.15.88:0/3199944791 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3a740ca5a0 0x7f3a74156bb0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f3a74069220 tx=0x7f3a6402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e07721c558bb4a53 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:50:32.579 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:32.574+0000 7f3a6bfff640 1 -- 172.21.15.88:0/3199944791 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a64037070 con 0x7f3a740ca5a0 2024-04-26T23:50:32.579 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:32.574+0000 7f3a6bfff640 1 -- 172.21.15.88:0/3199944791 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a64032440 con 0x7f3a740ca5a0 2024-04-26T23:50:32.580 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:32.574+0000 7f3a6bfff640 1 -- 172.21.15.88:0/3199944791 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a64032810 con 0x7f3a740ca5a0 2024-04-26T23:50:32.580 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:32.575+0000 7f3a7b3a4640 1 -- 172.21.15.88:0/3199944791 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3a740ca5a0 msgr2=0x7f3a74156bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:32.581 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:32.575+0000 7f3a7b3a4640 1 --2- 172.21.15.88:0/3199944791 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3a740ca5a0 0x7f3a74156bb0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f3a74069220 tx=0x7f3a6402a1a0 comp rx=0 tx=0).stop 2024-04-26T23:50:32.581 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:32.575+0000 7f3a7b3a4640 1 -- 172.21.15.88:0/3199944791 shutdown_connections 2024-04-26T23:50:32.581 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:32.575+0000 7f3a7b3a4640 1 --2- 172.21.15.88:0/3199944791 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3a740ca5a0 0x7f3a74156bb0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:32.581 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:32.575+0000 7f3a7b3a4640 1 -- 172.21.15.88:0/3199944791 >> 172.21.15.88:0/3199944791 conn(0x7f3a740ae010 msgr2=0x7f3a740ae3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:50:32.581 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:32.575+0000 7f3a7b3a4640 1 -- 172.21.15.88:0/3199944791 shutdown_connections 2024-04-26T23:50:32.581 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:32.575+0000 7f3a7b3a4640 1 -- 172.21.15.88:0/3199944791 wait complete. 2024-04-26T23:50:32.581 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:32.576+0000 7f3a7b3a4640 1 Processor -- start 2024-04-26T23:50:32.581 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:32.576+0000 7f3a7b3a4640 1 -- start start 2024-04-26T23:50:32.584 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:32.577+0000 7f3a7b3a4640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3a740ca5a0 0x7f3a741532d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:32.584 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:32.577+0000 7f3a7b3a4640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3a74154160 0x7f3a741ec9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:32.584 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:32.577+0000 7f3a7b3a4640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3a7415a1a0 0x7f3a741ecef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:32.584 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:32.577+0000 7f3a7b3a4640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f3a7415a5b0 con 0x7f3a74154160 2024-04-26T23:50:32.584 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:32.577+0000 7f3a7b3a4640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f3a7415aed0 con 0x7f3a7415a1a0 2024-04-26T23:50:32.584 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:32.577+0000 7f3a7b3a4640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f3a740c7510 con 0x7f3a740ca5a0 2024-04-26T23:50:32.584 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:32.577+0000 7f3a7893f640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3a74154160 0x7f3a741ec9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:32.584 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:32.577+0000 7f3a7893f640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3a74154160 0x7f3a741ec9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:60676/0 (socket says 172.21.15.88:60676) 2024-04-26T23:50:32.584 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:32.577+0000 7f3a7893f640 1 -- 172.21.15.88:0/388743204 learned_addr learned my addr 172.21.15.88:0/388743204 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:50:32.584 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:32.577+0000 7f3a79941640 1 --2- 172.21.15.88:0/388743204 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3a7415a1a0 0x7f3a741ecef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:32.584 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:32.577+0000 7f3a79140640 1 --2- 172.21.15.88:0/388743204 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3a740ca5a0 0x7f3a741532d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:32.585 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:32.577+0000 7f3a7893f640 1 -- 172.21.15.88:0/388743204 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3a740ca5a0 msgr2=0x7f3a741532d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:32.585 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:32.577+0000 7f3a7893f640 1 --2- 172.21.15.88:0/388743204 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3a740ca5a0 0x7f3a741532d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:32.585 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:32.577+0000 7f3a7893f640 1 -- 172.21.15.88:0/388743204 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3a7415a1a0 msgr2=0x7f3a741ecef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:32.585 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:32.577+0000 7f3a7893f640 1 --2- 172.21.15.88:0/388743204 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3a7415a1a0 0x7f3a741ecef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:32.585 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:32.577+0000 7f3a7893f640 1 -- 172.21.15.88:0/388743204 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a74149750 con 0x7f3a74154160 2024-04-26T23:50:32.585 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:32.577+0000 7f3a7893f640 1 --2- 172.21.15.88:0/388743204 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3a74154160 0x7f3a741ec9b0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f3a64035040 tx=0x7f3a640046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:50:32.585 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:32.577+0000 7f3a69ffb640 1 -- 172.21.15.88:0/388743204 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a64037040 con 0x7f3a74154160 2024-04-26T23:50:32.585 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:32.578+0000 7f3a69ffb640 1 -- 172.21.15.88:0/388743204 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a64004230 con 0x7f3a74154160 2024-04-26T23:50:32.585 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:32.578+0000 7f3a7b3a4640 1 -- 172.21.15.88:0/388743204 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a741f00c0 con 0x7f3a74154160 2024-04-26T23:50:32.585 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:32.578+0000 7f3a69ffb640 1 -- 172.21.15.88:0/388743204 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a64032e20 con 0x7f3a74154160 2024-04-26T23:50:32.585 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:32.578+0000 7f3a7b3a4640 1 -- 172.21.15.88:0/388743204 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a74153810 con 0x7f3a74154160 2024-04-26T23:50:32.585 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:32.579+0000 7f3a7b3a4640 1 -- 172.21.15.88:0/388743204 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a7414fae0 con 0x7f3a74154160 2024-04-26T23:50:32.585 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:32.579+0000 7f3a69ffb640 1 -- 172.21.15.88:0/388743204 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f3a64030770 con 0x7f3a74154160 2024-04-26T23:50:32.585 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:32.579+0000 7f3a69ffb640 1 --2- 172.21.15.88:0/388743204 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f3a5806c8f0 0x7f3a5806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:32.585 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:32.580+0000 7f3a69ffb640 1 -- 172.21.15.88:0/388743204 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6666+0+0 (secure 0 0 0) 0x7f3a640ad1f0 con 0x7f3a74154160 2024-04-26T23:50:32.586 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:32.580+0000 7f3a79140640 1 --2- 172.21.15.88:0/388743204 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f3a5806c8f0 0x7f3a5806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:32.586 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:32.580+0000 7f3a79140640 1 --2- 172.21.15.88:0/388743204 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f3a5806c8f0 0x7f3a5806edb0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f3a70005520 tx=0x7f3a70009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:50:32.588 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:32.584+0000 7f3a69ffb640 1 -- 172.21.15.88:0/388743204 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f3a7414fae0 con 0x7f3a74154160 2024-04-26T23:50:32.762 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:32.758+0000 7f3a7b3a4640 1 -- 172.21.15.88:0/388743204 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7f3a740c6f20 con 0x7f3a74154160 2024-04-26T23:50:32.765 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:32.761+0000 7f3a69ffb640 1 -- 172.21.15.88:0/388743204 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v10)=0 v10) ==== 123+0+0 (secure 0 0 0) 0x7f3a740c6f20 con 0x7f3a74154160 2024-04-26T23:50:32.765 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:32.761+0000 7f3a69ffb640 1 -- 172.21.15.88:0/388743204 <== mon.0 v2:172.21.15.88:3300/0 8 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f3a64032440 con 0x7f3a74154160 2024-04-26T23:50:32.768 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:32.763+0000 7f3a7b3a4640 1 -- 172.21.15.88:0/388743204 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f3a5806c8f0 msgr2=0x7f3a5806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:32.768 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:32.763+0000 7f3a7b3a4640 1 --2- 172.21.15.88:0/388743204 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f3a5806c8f0 0x7f3a5806edb0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f3a70005520 tx=0x7f3a70009040 comp rx=0 tx=0).stop 2024-04-26T23:50:32.769 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:32.763+0000 7f3a7b3a4640 1 -- 172.21.15.88:0/388743204 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3a74154160 msgr2=0x7f3a741ec9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:32.769 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:32.763+0000 7f3a7b3a4640 1 --2- 172.21.15.88:0/388743204 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3a74154160 0x7f3a741ec9b0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f3a64035040 tx=0x7f3a640046c0 comp rx=0 tx=0).stop 2024-04-26T23:50:32.769 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:32.764+0000 7f3a7b3a4640 1 -- 172.21.15.88:0/388743204 shutdown_connections 2024-04-26T23:50:32.769 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:32.764+0000 7f3a7b3a4640 1 --2- 172.21.15.88:0/388743204 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f3a5806c8f0 0x7f3a5806edb0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:32.769 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:32.764+0000 7f3a7b3a4640 1 --2- 172.21.15.88:0/388743204 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3a7415a1a0 0x7f3a741ecef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:32.769 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:32.764+0000 7f3a7b3a4640 1 --2- 172.21.15.88:0/388743204 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3a74154160 0x7f3a741ec9b0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:32.769 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:32.764+0000 7f3a7b3a4640 1 --2- 172.21.15.88:0/388743204 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3a740ca5a0 0x7f3a741532d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:32.769 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:32.764+0000 7f3a7b3a4640 1 -- 172.21.15.88:0/388743204 >> 172.21.15.88:0/388743204 conn(0x7f3a740ae010 msgr2=0x7f3a740ca980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:50:32.769 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:32.764+0000 7f3a7b3a4640 1 -- 172.21.15.88:0/388743204 shutdown_connections 2024-04-26T23:50:32.769 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:32.764+0000 7f3a7b3a4640 1 -- 172.21.15.88:0/388743204 wait complete. 2024-04-26T23:50:32.779 INFO:tasks.cephfs.filesystem:Destroying file system a and related pools 2024-04-26T23:50:32.779 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T23:50:32.876 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:32.871+0000 7f5aac072640 1 Processor -- start 2024-04-26T23:50:32.876 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:32.872+0000 7f5aac072640 1 -- start start 2024-04-26T23:50:32.877 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:32.872+0000 7f5aac072640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5aa40acc30 0x7f5aa415abf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:32.877 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:32.872+0000 7f5aac072640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f5aa40c4250 0x7f5aa40c3790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:32.877 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:32.872+0000 7f5aac072640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5aa40ad010 con 0x7f5aa40c3cd0 2024-04-26T23:50:32.878 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:32.872+0000 7f5aac072640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f5aa40c8ba0 con 0x7f5aa40c4250 2024-04-26T23:50:32.878 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:32.872+0000 7f5aac072640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f5aa4156e50 con 0x7f5aa40acc30 2024-04-26T23:50:32.878 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:32.873+0000 7f5aa9e0e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5aa40acc30 0x7f5aa415abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:32.878 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:32.873+0000 7f5aa960d640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f5aa40c4250 0x7f5aa40c3790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:32.878 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:32.873+0000 7f5aaa60f640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f5aa40c3cd0 0x7f5aa41572e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.88:37302/0 (socket says 172.21.15.88:37302) 2024-04-26T23:50:32.878 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:32.873+0000 7f5aa9e0e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5aa40acc30 0x7f5aa415abf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.88:46762/0 (socket says 172.21.15.88:46762) 2024-04-26T23:50:32.878 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:32.873+0000 7f5aaa60f640 1 -- 172.21.15.88:0/1609488412 learned_addr learned my addr 172.21.15.88:0/1609488412 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-26T23:50:32.878 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:32.873+0000 7f5aa9e0e640 1 -- 172.21.15.88:0/1609488412 >> v2:172.21.15.175:3300/0 conn(0x7f5aa40c4250 msgr2=0x7f5aa40c3790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:50:32.878 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:32.873+0000 7f5aa9e0e640 1 --2- 172.21.15.88:0/1609488412 >> v2:172.21.15.175:3300/0 conn(0x7f5aa40c4250 0x7f5aa40c3790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:32.878 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:32.873+0000 7f5aa9e0e640 1 -- 172.21.15.88:0/1609488412 >> v1:172.21.15.175:6789/0 conn(0x7f5aa40c3cd0 legacy=0x7f5aa41572e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:32.879 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:32.873+0000 7f5aa9e0e640 1 -- 172.21.15.88:0/1609488412 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5aa415b130 con 0x7f5aa40acc30 2024-04-26T23:50:32.884 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:32.874+0000 7f5aa9e0e640 1 --2- 172.21.15.88:0/1609488412 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5aa40acc30 0x7f5aa415abf0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f5aa00097a0 tx=0x7f5aa002a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e7367989b5f43d8c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:50:32.884 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:32.874+0000 7f5aa8e0c640 1 -- 172.21.15.88:0/1609488412 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5aa0037070 con 0x7f5aa40acc30 2024-04-26T23:50:32.884 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:32.874+0000 7f5aa8e0c640 1 -- 172.21.15.88:0/1609488412 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f5aa002ae50 con 0x7f5aa40acc30 2024-04-26T23:50:32.884 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:32.874+0000 7f5aa8e0c640 1 -- 172.21.15.88:0/1609488412 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5aa0032680 con 0x7f5aa40acc30 2024-04-26T23:50:32.884 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:32.874+0000 7f5aac072640 1 -- 172.21.15.88:0/1609488412 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5aa40acc30 msgr2=0x7f5aa415abf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:32.884 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:32.874+0000 7f5aac072640 1 --2- 172.21.15.88:0/1609488412 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5aa40acc30 0x7f5aa415abf0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f5aa00097a0 tx=0x7f5aa002a100 comp rx=0 tx=0).stop 2024-04-26T23:50:32.884 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:32.874+0000 7f5aac072640 1 -- 172.21.15.88:0/1609488412 shutdown_connections 2024-04-26T23:50:32.884 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:32.874+0000 7f5aac072640 1 --2- 172.21.15.88:0/1609488412 >> v2:172.21.15.175:3300/0 conn(0x7f5aa40c4250 0x7f5aa40c3790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:32.884 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:32.874+0000 7f5aac072640 1 --2- 172.21.15.88:0/1609488412 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5aa40acc30 0x7f5aa415abf0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:32.884 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:32.874+0000 7f5aac072640 1 -- 172.21.15.88:0/1609488412 >> 172.21.15.88:0/1609488412 conn(0x7f5aa40c6e60 msgr2=0x7f5aa40c7270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:50:32.885 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:32.875+0000 7f5aac072640 1 -- 172.21.15.88:0/1609488412 shutdown_connections 2024-04-26T23:50:32.885 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:32.875+0000 7f5aac072640 1 -- 172.21.15.88:0/1609488412 wait complete. 2024-04-26T23:50:32.885 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:32.876+0000 7f5aac072640 1 Processor -- start 2024-04-26T23:50:32.885 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:32.876+0000 7f5aac072640 1 -- start start 2024-04-26T23:50:32.885 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:32.876+0000 7f5aac072640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5aa40acc30 0x7f5aa4070d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:32.885 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:32.876+0000 7f5aac072640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5aa40c3cd0 0x7f5aa4144270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:32.885 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:32.876+0000 7f5aac072640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5aa40c4250 0x7f5aa41447b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:32.885 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:32.876+0000 7f5aac072640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f5aa40c88c0 con 0x7f5aa40acc30 2024-04-26T23:50:32.885 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:32.876+0000 7f5aac072640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f5aa40c85e0 con 0x7f5aa40c3cd0 2024-04-26T23:50:32.885 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:32.876+0000 7f5aac072640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f5aa40abec0 con 0x7f5aa40c4250 2024-04-26T23:50:32.885 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:32.876+0000 7f5aa9e0e640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5aa40acc30 0x7f5aa4070d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:32.885 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:32.876+0000 7f5aa9e0e640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5aa40acc30 0x7f5aa4070d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:60684/0 (socket says 172.21.15.88:60684) 2024-04-26T23:50:32.886 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:32.876+0000 7f5aa9e0e640 1 -- 172.21.15.88:0/779165185 learned_addr learned my addr 172.21.15.88:0/779165185 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:50:32.886 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:32.876+0000 7f5aaa60f640 1 --2- 172.21.15.88:0/779165185 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5aa40c4250 0x7f5aa41447b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:32.886 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:32.876+0000 7f5aa960d640 1 --2- 172.21.15.88:0/779165185 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5aa40c3cd0 0x7f5aa4144270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:32.886 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:32.877+0000 7f5aa9e0e640 1 -- 172.21.15.88:0/779165185 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5aa40c4250 msgr2=0x7f5aa41447b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:32.886 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:32.877+0000 7f5aa9e0e640 1 --2- 172.21.15.88:0/779165185 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5aa40c4250 0x7f5aa41447b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:32.886 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:32.877+0000 7f5aa9e0e640 1 -- 172.21.15.88:0/779165185 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5aa40c3cd0 msgr2=0x7f5aa4144270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:32.886 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:32.877+0000 7f5aa9e0e640 1 --2- 172.21.15.88:0/779165185 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5aa40c3cd0 0x7f5aa4144270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:32.886 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:32.877+0000 7f5aa9e0e640 1 -- 172.21.15.88:0/779165185 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5aa41f0690 con 0x7f5aa40acc30 2024-04-26T23:50:32.886 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:32.877+0000 7f5aa9e0e640 1 --2- 172.21.15.88:0/779165185 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5aa40acc30 0x7f5aa4070d90 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f5aa0035040 tx=0x7f5aa00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:50:32.886 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:32.877+0000 7f5a9a7fc640 1 -- 172.21.15.88:0/779165185 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5aa0041020 con 0x7f5aa40acc30 2024-04-26T23:50:32.887 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:32.877+0000 7f5a9a7fc640 1 -- 172.21.15.88:0/779165185 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f5aa003c870 con 0x7f5aa40acc30 2024-04-26T23:50:32.887 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:32.877+0000 7f5aac072640 1 -- 172.21.15.88:0/779165185 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5aa40ad2a0 con 0x7f5aa40acc30 2024-04-26T23:50:32.887 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:32.877+0000 7f5a9a7fc640 1 -- 172.21.15.88:0/779165185 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5aa0037040 con 0x7f5aa40acc30 2024-04-26T23:50:32.887 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:32.877+0000 7f5aac072640 1 -- 172.21.15.88:0/779165185 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5aa40ad860 con 0x7f5aa40acc30 2024-04-26T23:50:32.887 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:32.878+0000 7f5aac072640 1 -- 172.21.15.88:0/779165185 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5aa40507a0 con 0x7f5aa40acc30 2024-04-26T23:50:32.887 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:32.878+0000 7f5a9a7fc640 1 -- 172.21.15.88:0/779165185 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f5aa002ad10 con 0x7f5aa40acc30 2024-04-26T23:50:32.887 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:32.879+0000 7f5a9a7fc640 1 --2- 172.21.15.88:0/779165185 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f5a8806c8f0 0x7f5a8806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:32.887 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:32.879+0000 7f5a9a7fc640 1 -- 172.21.15.88:0/779165185 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6666+0+0 (secure 0 0 0) 0x7f5aa00ac5e0 con 0x7f5aa40acc30 2024-04-26T23:50:32.887 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:32.879+0000 7f5aa960d640 1 --2- 172.21.15.88:0/779165185 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f5a8806c8f0 0x7f5a8806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:32.887 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:32.879+0000 7f5aa960d640 1 --2- 172.21.15.88:0/779165185 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f5a8806c8f0 0x7f5a8806edb0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f5aa40adee0 tx=0x7f5a94009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:50:32.888 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:32.883+0000 7f5a9a7fc640 1 -- 172.21.15.88:0/779165185 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f5aa004b070 con 0x7f5aa40acc30 2024-04-26T23:50:33.105 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:33.101+0000 7f5aac072640 1 -- 172.21.15.88:0/779165185 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5aa40c46f0 con 0x7f5aa40acc30 2024-04-26T23:50:33.106 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:33.101+0000 7f5a9a7fc640 1 -- 172.21.15.88:0/779165185 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+6488 (secure 0 0 0) 0x7f5aa007a000 con 0x7f5aa40acc30 2024-04-26T23:50:33.106 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-26T23:50:33.106 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":12,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6834/3199540397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":3199540397},{"type":"v1","addr":"172.21.15.175:6834","nonce":3199540397}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4270,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6837/2790134952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6835","nonce":2790134952},{"type":"v1","addr":"172.21.15.88:6837","nonce":2790134952}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T23:40:31.909505+0000","modified":"2024-04-26T23:40:34.974455+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4279},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4279":{"gid":4279,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.175:6835/3932058274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6833","nonce":3932058274},{"type":"v1","addr":"172.21.15.175:6835","nonce":3932058274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4279,"qdb_cluster":[4279]},"id":1},{"mdsmap":{"epoch":12,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T23:40:41.008364+0000","modified":"2024-04-26T23:40:44.027288+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4272":{"gid":4272,"name":"c","rank":0,"incarnation":9,"state":"up:active","state_seq":6,"addr":"172.21.15.88:6836/4159390276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6834","nonce":4159390276},{"type":"v1","addr":"172.21.15.88:6836","nonce":4159390276}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4272,"qdb_cluster":[4272]},"id":2}]} 2024-04-26T23:50:33.106 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 12 2024-04-26T23:50:33.108 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:33.103+0000 7f5aac072640 1 -- 172.21.15.88:0/779165185 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f5a8806c8f0 msgr2=0x7f5a8806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:33.108 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:33.103+0000 7f5aac072640 1 --2- 172.21.15.88:0/779165185 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f5a8806c8f0 0x7f5a8806edb0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f5aa40adee0 tx=0x7f5a94009190 comp rx=0 tx=0).stop 2024-04-26T23:50:33.108 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:33.103+0000 7f5aac072640 1 -- 172.21.15.88:0/779165185 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5aa40acc30 msgr2=0x7f5aa4070d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:33.108 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:33.103+0000 7f5aac072640 1 --2- 172.21.15.88:0/779165185 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5aa40acc30 0x7f5aa4070d90 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f5aa0035040 tx=0x7f5aa00046c0 comp rx=0 tx=0).stop 2024-04-26T23:50:33.108 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:33.103+0000 7f5aac072640 1 -- 172.21.15.88:0/779165185 shutdown_connections 2024-04-26T23:50:33.108 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:33.103+0000 7f5aac072640 1 --2- 172.21.15.88:0/779165185 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f5a8806c8f0 0x7f5a8806edb0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:33.109 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:33.103+0000 7f5aac072640 1 --2- 172.21.15.88:0/779165185 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5aa40c4250 0x7f5aa41447b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:33.109 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:33.103+0000 7f5aac072640 1 --2- 172.21.15.88:0/779165185 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5aa40c3cd0 0x7f5aa4144270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:33.109 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:33.103+0000 7f5aac072640 1 --2- 172.21.15.88:0/779165185 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5aa40acc30 0x7f5aa4070d90 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:33.109 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:33.103+0000 7f5aac072640 1 -- 172.21.15.88:0/779165185 >> 172.21.15.88:0/779165185 conn(0x7f5aa40c6e60 msgr2=0x7f5aa406e920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:50:33.109 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:33.103+0000 7f5aac072640 1 -- 172.21.15.88:0/779165185 shutdown_connections 2024-04-26T23:50:33.109 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:33.103+0000 7f5aac072640 1 -- 172.21.15.88:0/779165185 wait complete. 2024-04-26T23:50:33.119 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T23:50:33.215 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:33.210+0000 7f9857b90640 1 Processor -- start 2024-04-26T23:50:33.215 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:33.211+0000 7f9857b90640 1 -- start start 2024-04-26T23:50:33.218 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:33.211+0000 7f9857b90640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f985013fe20 0x7f98500c5430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:33.218 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:33.211+0000 7f9857b90640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f9850157010 0x7f98501574a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:33.218 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:33.211+0000 7f9857b90640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f985015a230 con 0x7f98500c3c70 2024-04-26T23:50:33.218 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:33.211+0000 7f9857b90640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f98500c39b0 con 0x7f9850157010 2024-04-26T23:50:33.218 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:33.211+0000 7f9857b90640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f985015b120 con 0x7f985013fe20 2024-04-26T23:50:33.218 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:33.212+0000 7f985612d640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f9850157010 0x7f98501574a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:33.218 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:33.212+0000 7f985512b640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f98500c3c70 0x7f985006d320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:48666/0 (socket says 172.21.15.88:48666) 2024-04-26T23:50:33.218 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:33.212+0000 7f985512b640 1 -- 172.21.15.88:0/2963177953 learned_addr learned my addr 172.21.15.88:0/2963177953 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-26T23:50:33.219 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:33.212+0000 7f985592c640 1 --2- 172.21.15.88:0/2963177953 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f985013fe20 0x7f98500c5430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:33.219 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:33.212+0000 7f985612d640 1 -- 172.21.15.88:0/2963177953 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f985013fe20 msgr2=0x7f98500c5430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:50:33.219 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:33.212+0000 7f985612d640 1 --2- 172.21.15.88:0/2963177953 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f985013fe20 0x7f98500c5430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:33.219 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:33.212+0000 7f985612d640 1 -- 172.21.15.88:0/2963177953 >> v1:172.21.15.88:6789/0 conn(0x7f98500c3c70 legacy=0x7f985006d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:33.219 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:33.212+0000 7f985612d640 1 -- 172.21.15.88:0/2963177953 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f985015a510 con 0x7f9850157010 2024-04-26T23:50:33.219 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:33.212+0000 7f985592c640 1 --2- 172.21.15.88:0/2963177953 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f985013fe20 0x7f98500c5430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:50:33.219 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:33.213+0000 7f985612d640 1 --2- 172.21.15.88:0/2963177953 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9850157010 0x7f98501574a0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f9848009d90 tx=0x7f984802a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df930cbf600b23ad server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:50:33.219 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:33.213+0000 7f985492a640 1 -- 172.21.15.88:0/2963177953 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9848007740 con 0x7f9850157010 2024-04-26T23:50:33.219 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:33.213+0000 7f985492a640 1 -- 172.21.15.88:0/2963177953 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f98480078e0 con 0x7f9850157010 2024-04-26T23:50:33.219 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:33.213+0000 7f985492a640 1 -- 172.21.15.88:0/2963177953 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9848007cd0 con 0x7f9850157010 2024-04-26T23:50:33.219 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:33.213+0000 7f9857b90640 1 -- 172.21.15.88:0/2963177953 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9850157010 msgr2=0x7f98501574a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:33.220 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:33.213+0000 7f9857b90640 1 --2- 172.21.15.88:0/2963177953 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9850157010 0x7f98501574a0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f9848009d90 tx=0x7f984802a660 comp rx=0 tx=0).stop 2024-04-26T23:50:33.220 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:33.213+0000 7f9857b90640 1 -- 172.21.15.88:0/2963177953 shutdown_connections 2024-04-26T23:50:33.220 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:33.213+0000 7f9857b90640 1 --2- 172.21.15.88:0/2963177953 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9850157010 0x7f98501574a0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:33.220 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:33.213+0000 7f9857b90640 1 --2- 172.21.15.88:0/2963177953 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f985013fe20 0x7f98500c5430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:33.220 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:33.213+0000 7f9857b90640 1 -- 172.21.15.88:0/2963177953 >> 172.21.15.88:0/2963177953 conn(0x7f98500c5d70 msgr2=0x7f98500c6180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:50:33.220 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:33.213+0000 7f9857b90640 1 -- 172.21.15.88:0/2963177953 shutdown_connections 2024-04-26T23:50:33.220 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:33.213+0000 7f9857b90640 1 -- 172.21.15.88:0/2963177953 wait complete. 2024-04-26T23:50:33.223 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:33.214+0000 7f9857b90640 1 Processor -- start 2024-04-26T23:50:33.223 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:33.214+0000 7f9857b90640 1 -- start start 2024-04-26T23:50:33.223 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:33.215+0000 7f9857b90640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f98500c3c70 0x7f98500ac550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:33.223 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:33.215+0000 7f9857b90640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f985013fe20 0x7f985013a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:33.223 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:33.215+0000 7f9857b90640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9850157010 0x7f985013aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:33.223 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:33.215+0000 7f9857b90640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f985015adb0 con 0x7f9850157010 2024-04-26T23:50:33.223 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:33.215+0000 7f9857b90640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f985015aad0 con 0x7f985013fe20 2024-04-26T23:50:33.223 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:33.215+0000 7f9857b90640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f9850140200 con 0x7f98500c3c70 2024-04-26T23:50:33.224 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:33.215+0000 7f985612d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9850157010 0x7f985013aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:33.224 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:33.215+0000 7f985612d640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9850157010 0x7f985013aab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:60714/0 (socket says 172.21.15.88:60714) 2024-04-26T23:50:33.224 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:33.215+0000 7f985612d640 1 -- 172.21.15.88:0/2881344961 learned_addr learned my addr 172.21.15.88:0/2881344961 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:50:33.224 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:33.215+0000 7f985592c640 1 --2- 172.21.15.88:0/2881344961 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f98500c3c70 0x7f98500ac550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:33.224 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:33.215+0000 7f985512b640 1 --2- 172.21.15.88:0/2881344961 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f985013fe20 0x7f985013a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:33.224 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:33.215+0000 7f985612d640 1 -- 172.21.15.88:0/2881344961 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f98500c3c70 msgr2=0x7f98500ac550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:33.224 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:33.215+0000 7f985612d640 1 --2- 172.21.15.88:0/2881344961 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f98500c3c70 0x7f98500ac550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:33.224 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:33.215+0000 7f985612d640 1 -- 172.21.15.88:0/2881344961 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f985013fe20 msgr2=0x7f985013a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:33.224 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:33.215+0000 7f985612d640 1 --2- 172.21.15.88:0/2881344961 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f985013fe20 0x7f985013a570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:33.224 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:33.215+0000 7f985612d640 1 -- 172.21.15.88:0/2881344961 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f985013b340 con 0x7f9850157010 2024-04-26T23:50:33.224 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:33.216+0000 7f985612d640 1 --2- 172.21.15.88:0/2881344961 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9850157010 0x7f985013aab0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f9848009d90 tx=0x7f9848004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:50:33.224 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:33.216+0000 7f98467fc640 1 -- 172.21.15.88:0/2881344961 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f984803f070 con 0x7f9850157010 2024-04-26T23:50:33.225 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:33.216+0000 7f98467fc640 1 -- 172.21.15.88:0/2881344961 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f9848031c90 con 0x7f9850157010 2024-04-26T23:50:33.225 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:33.216+0000 7f9857b90640 1 -- 172.21.15.88:0/2881344961 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9850073180 con 0x7f9850157010 2024-04-26T23:50:33.225 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:33.216+0000 7f98467fc640 1 -- 172.21.15.88:0/2881344961 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9848044680 con 0x7f9850157010 2024-04-26T23:50:33.225 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:33.216+0000 7f9857b90640 1 -- 172.21.15.88:0/2881344961 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98501ed800 con 0x7f9850157010 2024-04-26T23:50:33.225 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:33.217+0000 7f9857b90640 1 -- 172.21.15.88:0/2881344961 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f98501ed330 con 0x7f9850157010 2024-04-26T23:50:33.225 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:33.217+0000 7f98467fc640 1 -- 172.21.15.88:0/2881344961 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f9848044820 con 0x7f9850157010 2024-04-26T23:50:33.225 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:33.218+0000 7f98467fc640 1 --2- 172.21.15.88:0/2881344961 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f983406c8f0 0x7f983406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:33.225 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:33.218+0000 7f98467fc640 1 -- 172.21.15.88:0/2881344961 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6666+0+0 (secure 0 0 0) 0x7f98480ad910 con 0x7f9850157010 2024-04-26T23:50:33.225 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:33.218+0000 7f985592c640 1 --2- 172.21.15.88:0/2881344961 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f983406c8f0 0x7f983406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:33.225 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:33.218+0000 7f985592c640 1 --2- 172.21.15.88:0/2881344961 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f983406c8f0 0x7f983406edb0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f98500c8850 tx=0x7f984c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:50:33.226 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:33.222+0000 7f98467fc640 1 -- 172.21.15.88:0/2881344961 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f984807b980 con 0x7f9850157010 2024-04-26T23:50:33.440 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:33.435+0000 7f9857b90640 1 -- 172.21.15.88:0/2881344961 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f98500ad350 con 0x7f9850157010 2024-04-26T23:50:33.440 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:33.436+0000 7f98467fc640 1 -- 172.21.15.88:0/2881344961 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+6488 (secure 0 0 0) 0x7f984807b280 con 0x7f9850157010 2024-04-26T23:50:33.441 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-26T23:50:33.441 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":12,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6834/3199540397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":3199540397},{"type":"v1","addr":"172.21.15.175:6834","nonce":3199540397}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4270,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6837/2790134952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6835","nonce":2790134952},{"type":"v1","addr":"172.21.15.88:6837","nonce":2790134952}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T23:40:31.909505+0000","modified":"2024-04-26T23:40:34.974455+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4279},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4279":{"gid":4279,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.175:6835/3932058274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6833","nonce":3932058274},{"type":"v1","addr":"172.21.15.175:6835","nonce":3932058274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4279,"qdb_cluster":[4279]},"id":1},{"mdsmap":{"epoch":12,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T23:40:41.008364+0000","modified":"2024-04-26T23:40:44.027288+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4272":{"gid":4272,"name":"c","rank":0,"incarnation":9,"state":"up:active","state_seq":6,"addr":"172.21.15.88:6836/4159390276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6834","nonce":4159390276},{"type":"v1","addr":"172.21.15.88:6836","nonce":4159390276}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4272,"qdb_cluster":[4272]},"id":2}]} 2024-04-26T23:50:33.441 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 12 2024-04-26T23:50:33.443 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:33.438+0000 7f9857b90640 1 -- 172.21.15.88:0/2881344961 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f983406c8f0 msgr2=0x7f983406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:33.443 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:33.438+0000 7f9857b90640 1 --2- 172.21.15.88:0/2881344961 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f983406c8f0 0x7f983406edb0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f98500c8850 tx=0x7f984c008040 comp rx=0 tx=0).stop 2024-04-26T23:50:33.443 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:33.438+0000 7f9857b90640 1 -- 172.21.15.88:0/2881344961 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9850157010 msgr2=0x7f985013aab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:33.443 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:33.438+0000 7f9857b90640 1 --2- 172.21.15.88:0/2881344961 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9850157010 0x7f985013aab0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f9848009d90 tx=0x7f9848004a40 comp rx=0 tx=0).stop 2024-04-26T23:50:33.443 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:33.438+0000 7f9857b90640 1 -- 172.21.15.88:0/2881344961 shutdown_connections 2024-04-26T23:50:33.443 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:33.438+0000 7f9857b90640 1 --2- 172.21.15.88:0/2881344961 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f983406c8f0 0x7f983406edb0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:33.443 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:33.438+0000 7f9857b90640 1 --2- 172.21.15.88:0/2881344961 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9850157010 0x7f985013aab0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:33.443 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:33.438+0000 7f9857b90640 1 --2- 172.21.15.88:0/2881344961 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f985013fe20 0x7f985013a570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:33.443 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:33.438+0000 7f9857b90640 1 --2- 172.21.15.88:0/2881344961 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f98500c3c70 0x7f98500ac550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:33.444 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:33.438+0000 7f9857b90640 1 -- 172.21.15.88:0/2881344961 >> 172.21.15.88:0/2881344961 conn(0x7f98500c5d70 msgr2=0x7f9850157690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:50:33.444 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:33.438+0000 7f9857b90640 1 -- 172.21.15.88:0/2881344961 shutdown_connections 2024-04-26T23:50:33.444 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:33.438+0000 7f9857b90640 1 -- 172.21.15.88:0/2881344961 wait complete. 2024-04-26T23:50:33.454 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T23:50:33.550 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:33.545+0000 7f00816c8640 1 Processor -- start 2024-04-26T23:50:33.550 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:33.545+0000 7f00816c8640 1 -- start start 2024-04-26T23:50:33.553 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:33.546+0000 7f00816c8640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f007c13ffb0 0x7f007c0c82a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:33.553 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:33.546+0000 7f00816c8640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f007c15a280 0x7f007c072ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:33.553 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:33.546+0000 7f00816c8640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f007c0c8a30 con 0x7f007c073530 2024-04-26T23:50:33.553 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:33.546+0000 7f00816c8640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f007c072be0 con 0x7f007c13ffb0 2024-04-26T23:50:33.553 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:33.546+0000 7f00816c8640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f007c0c9640 con 0x7f007c15a280 2024-04-26T23:50:33.553 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:33.546+0000 7f007affd640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f007c13ffb0 0x7f007c0c82a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:33.553 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:33.546+0000 7f007b7fe640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f007c073530 0x7f007c158180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:48674/0 (socket says 172.21.15.88:48674) 2024-04-26T23:50:33.553 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:33.546+0000 7f007b7fe640 1 -- 172.21.15.88:0/4158768229 learned_addr learned my addr 172.21.15.88:0/4158768229 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-26T23:50:33.554 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:33.547+0000 7f007affd640 1 -- 172.21.15.88:0/4158768229 >> v2:172.21.15.175:3300/0 conn(0x7f007c15a280 msgr2=0x7f007c072ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:50:33.554 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:33.547+0000 7f007a7fc640 1 --2- 172.21.15.88:0/4158768229 >> v2:172.21.15.175:3300/0 conn(0x7f007c15a280 0x7f007c072ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:33.554 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:33.547+0000 7f007affd640 1 --2- 172.21.15.88:0/4158768229 >> v2:172.21.15.175:3300/0 conn(0x7f007c15a280 0x7f007c072ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:33.554 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:33.547+0000 7f0079ffb640 1 -- 172.21.15.88:0/4158768229 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3749275321 0 0) 0x7f007c0c8a30 con 0x7f007c073530 2024-04-26T23:50:33.554 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:33.547+0000 7f007affd640 1 -- 172.21.15.88:0/4158768229 >> v1:172.21.15.88:6789/0 conn(0x7f007c073530 legacy=0x7f007c158180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:33.554 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:33.547+0000 7f007affd640 1 -- 172.21.15.88:0/4158768229 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f007c0c8d10 con 0x7f007c13ffb0 2024-04-26T23:50:33.554 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:33.547+0000 7f007affd640 1 --2- 172.21.15.88:0/4158768229 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f007c13ffb0 0x7f007c0c82a0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f007c06d2f0 tx=0x7f006c02a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=332250acd73490c2 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:50:33.554 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:33.547+0000 7f0079ffb640 1 -- 172.21.15.88:0/4158768229 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f006c007740 con 0x7f007c13ffb0 2024-04-26T23:50:33.554 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:33.547+0000 7f0079ffb640 1 -- 172.21.15.88:0/4158768229 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f006c0078e0 con 0x7f007c13ffb0 2024-04-26T23:50:33.554 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:33.547+0000 7f0079ffb640 1 -- 172.21.15.88:0/4158768229 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f006c007cd0 con 0x7f007c13ffb0 2024-04-26T23:50:33.554 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:33.548+0000 7f00816c8640 1 -- 172.21.15.88:0/4158768229 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f007c13ffb0 msgr2=0x7f007c0c82a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:33.554 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:33.548+0000 7f00816c8640 1 --2- 172.21.15.88:0/4158768229 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f007c13ffb0 0x7f007c0c82a0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f007c06d2f0 tx=0x7f006c02a5f0 comp rx=0 tx=0).stop 2024-04-26T23:50:33.554 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:33.548+0000 7f00816c8640 1 -- 172.21.15.88:0/4158768229 shutdown_connections 2024-04-26T23:50:33.554 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:33.548+0000 7f00816c8640 1 --2- 172.21.15.88:0/4158768229 >> v2:172.21.15.175:3300/0 conn(0x7f007c15a280 0x7f007c072ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:33.555 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:33.548+0000 7f00816c8640 1 --2- 172.21.15.88:0/4158768229 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f007c13ffb0 0x7f007c0c82a0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:33.555 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:33.548+0000 7f00816c8640 1 -- 172.21.15.88:0/4158768229 >> 172.21.15.88:0/4158768229 conn(0x7f007c06dc10 msgr2=0x7f007c06c310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:50:33.555 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:33.548+0000 7f00816c8640 1 -- 172.21.15.88:0/4158768229 shutdown_connections 2024-04-26T23:50:33.555 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:33.548+0000 7f00816c8640 1 -- 172.21.15.88:0/4158768229 wait complete. 2024-04-26T23:50:33.558 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:33.549+0000 7f00816c8640 1 Processor -- start 2024-04-26T23:50:33.558 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:33.549+0000 7f00816c8640 1 -- start start 2024-04-26T23:50:33.558 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:33.550+0000 7f00816c8640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f007c073530 0x7f007c155160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:33.558 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:33.550+0000 7f00816c8640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f007c13ffb0 0x7f007c137470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:33.558 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:33.550+0000 7f00816c8640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f007c15a280 0x7f007c1379b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:33.558 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:33.550+0000 7f00816c8640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f007c0c92d0 con 0x7f007c15a280 2024-04-26T23:50:33.558 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:33.550+0000 7f00816c8640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f007c0c87e0 con 0x7f007c073530 2024-04-26T23:50:33.558 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:33.550+0000 7f00816c8640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f007c140390 con 0x7f007c13ffb0 2024-04-26T23:50:33.558 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:33.550+0000 7f007b7fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f007c15a280 0x7f007c1379b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:33.558 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:33.550+0000 7f007b7fe640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f007c15a280 0x7f007c1379b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:60730/0 (socket says 172.21.15.88:60730) 2024-04-26T23:50:33.558 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:33.550+0000 7f007b7fe640 1 -- 172.21.15.88:0/2025266521 learned_addr learned my addr 172.21.15.88:0/2025266521 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:50:33.559 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:33.550+0000 7f007affd640 1 --2- 172.21.15.88:0/2025266521 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f007c073530 0x7f007c155160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:33.559 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:33.550+0000 7f007a7fc640 1 --2- 172.21.15.88:0/2025266521 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f007c13ffb0 0x7f007c137470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:33.559 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:33.550+0000 7f007b7fe640 1 -- 172.21.15.88:0/2025266521 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f007c13ffb0 msgr2=0x7f007c137470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:33.559 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:33.550+0000 7f007b7fe640 1 --2- 172.21.15.88:0/2025266521 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f007c13ffb0 0x7f007c137470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:33.559 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:33.550+0000 7f007b7fe640 1 -- 172.21.15.88:0/2025266521 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f007c073530 msgr2=0x7f007c155160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:33.559 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:33.550+0000 7f007b7fe640 1 --2- 172.21.15.88:0/2025266521 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f007c073530 0x7f007c155160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:33.559 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:33.550+0000 7f007b7fe640 1 -- 172.21.15.88:0/2025266521 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f007c153c50 con 0x7f007c15a280 2024-04-26T23:50:33.559 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:33.551+0000 7f007b7fe640 1 --2- 172.21.15.88:0/2025266521 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f007c15a280 0x7f007c1379b0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f007400c480 tx=0x7f007400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:50:33.559 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:33.551+0000 7f00637fe640 1 -- 172.21.15.88:0/2025266521 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0074018070 con 0x7f007c15a280 2024-04-26T23:50:33.559 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:33.551+0000 7f00637fe640 1 -- 172.21.15.88:0/2025266521 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f0074007500 con 0x7f007c15a280 2024-04-26T23:50:33.559 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:33.551+0000 7f00637fe640 1 -- 172.21.15.88:0/2025266521 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0074004a40 con 0x7f007c15a280 2024-04-26T23:50:33.559 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:33.551+0000 7f00816c8640 1 -- 172.21.15.88:0/2025266521 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f007c1ed1e0 con 0x7f007c15a280 2024-04-26T23:50:33.559 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:33.551+0000 7f00816c8640 1 -- 172.21.15.88:0/2025266521 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f007c153f30 con 0x7f007c15a280 2024-04-26T23:50:33.559 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:33.552+0000 7f00816c8640 1 -- 172.21.15.88:0/2025266521 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f007c076650 con 0x7f007c15a280 2024-04-26T23:50:33.559 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:33.552+0000 7f00637fe640 1 -- 172.21.15.88:0/2025266521 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f007401b070 con 0x7f007c15a280 2024-04-26T23:50:33.560 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:33.552+0000 7f00637fe640 1 --2- 172.21.15.88:0/2025266521 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f006806c8f0 0x7f006806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:33.560 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:33.553+0000 7f00637fe640 1 -- 172.21.15.88:0/2025266521 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6666+0+0 (secure 0 0 0) 0x7f007408b210 con 0x7f007c15a280 2024-04-26T23:50:33.560 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:33.553+0000 7f007affd640 1 --2- 172.21.15.88:0/2025266521 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f006806c8f0 0x7f006806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:33.560 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:33.553+0000 7f007affd640 1 --2- 172.21.15.88:0/2025266521 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f006806c8f0 0x7f006806edb0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f006c034000 tx=0x7f006c02f000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:50:33.561 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:33.557+0000 7f00637fe640 1 -- 172.21.15.88:0/2025266521 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f0074059310 con 0x7f007c15a280 2024-04-26T23:50:33.736 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:33.732+0000 7f00816c8640 1 -- 172.21.15.88:0/2025266521 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f007c0507a0 con 0x7f007c15a280 2024-04-26T23:50:33.737 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:33.733+0000 7f00637fe640 1 -- 172.21.15.88:0/2025266521 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+20640 (secure 0 0 0) 0x7f0074058c10 con 0x7f007c15a280 2024-04-26T23:50:33.738 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-26T23:50:33.738 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":26,"fsid":"555255e9-7ef9-4454-8dc9-35e96b70035c","created":"2024-04-26T23:40:07.836009+0000","modified":"2024-04-26T23:41:30.360444+0000","last_up_change":"2024-04-26T23:40:18.831369+0000","last_in_change":"2024-04-26T23:40:09.944777+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T23:40:19.936127+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"a_metadata","create_time":"2024-04-26T23:40:29.837465+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"a_data","create_time":"2024-04-26T23:40:30.868651+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"b_metadata","create_time":"2024-04-26T23:40:38.753441+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"b_data","create_time":"2024-04-26T23:40:39.974557+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"92aecea3-ed62-4a29-87c0-76758a0816a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":2803186054},{"type":"v1","addr":"172.21.15.88:6801","nonce":2803186054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":2803186054},{"type":"v1","addr":"172.21.15.88:6803","nonce":2803186054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":2803186054},{"type":"v1","addr":"172.21.15.88:6807","nonce":2803186054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":2803186054},{"type":"v1","addr":"172.21.15.88:6805","nonce":2803186054}]},"public_addr":"172.21.15.88:6801/2803186054","cluster_addr":"172.21.15.88:6803/2803186054","heartbeat_back_addr":"172.21.15.88:6807/2803186054","heartbeat_front_addr":"172.21.15.88:6805/2803186054","state":["exists","up"]},{"osd":1,"uuid":"7a6f0fa9-23d0-4747-880f-798d45ec5eeb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":1897380484},{"type":"v1","addr":"172.21.15.88:6817","nonce":1897380484}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":1897380484},{"type":"v1","addr":"172.21.15.88:6819","nonce":1897380484}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1897380484},{"type":"v1","addr":"172.21.15.88:6823","nonce":1897380484}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":1897380484},{"type":"v1","addr":"172.21.15.88:6821","nonce":1897380484}]},"public_addr":"172.21.15.88:6817/1897380484","cluster_addr":"172.21.15.88:6819/1897380484","heartbeat_back_addr":"172.21.15.88:6823/1897380484","heartbeat_front_addr":"172.21.15.88:6821/1897380484","state":["exists","up"]},{"osd":2,"uuid":"6be88ea0-e133-4200-a4b5-f92d664b248a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":648396269},{"type":"v1","addr":"172.21.15.88:6809","nonce":648396269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":648396269},{"type":"v1","addr":"172.21.15.88:6811","nonce":648396269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":648396269},{"type":"v1","addr":"172.21.15.88:6815","nonce":648396269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":648396269},{"type":"v1","addr":"172.21.15.88:6813","nonce":648396269}]},"public_addr":"172.21.15.88:6809/648396269","cluster_addr":"172.21.15.88:6811/648396269","heartbeat_back_addr":"172.21.15.88:6815/648396269","heartbeat_front_addr":"172.21.15.88:6813/648396269","state":["exists","up"]},{"osd":3,"uuid":"dcb0746b-7b3d-4ecf-8089-2493a5d1857c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":2328028922},{"type":"v1","addr":"172.21.15.88:6825","nonce":2328028922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":2328028922},{"type":"v1","addr":"172.21.15.88:6827","nonce":2328028922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":2328028922},{"type":"v1","addr":"172.21.15.88:6831","nonce":2328028922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":2328028922},{"type":"v1","addr":"172.21.15.88:6829","nonce":2328028922}]},"public_addr":"172.21.15.88:6825/2328028922","cluster_addr":"172.21.15.88:6827/2328028922","heartbeat_back_addr":"172.21.15.88:6831/2328028922","heartbeat_front_addr":"172.21.15.88:6829/2328028922","state":["exists","up"]},{"osd":4,"uuid":"c483de66-c44f-450e-a4ce-b132d50882c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":3929617402},{"type":"v1","addr":"172.21.15.175:6809","nonce":3929617402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":3929617402},{"type":"v1","addr":"172.21.15.175:6811","nonce":3929617402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":3929617402},{"type":"v1","addr":"172.21.15.175:6815","nonce":3929617402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":3929617402},{"type":"v1","addr":"172.21.15.175:6813","nonce":3929617402}]},"public_addr":"172.21.15.175:6809/3929617402","cluster_addr":"172.21.15.175:6811/3929617402","heartbeat_back_addr":"172.21.15.175:6815/3929617402","heartbeat_front_addr":"172.21.15.175:6813/3929617402","state":["exists","up"]},{"osd":5,"uuid":"ac3b1669-d228-40dd-9f9a-cb46aa73dd6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":2476644457},{"type":"v1","addr":"172.21.15.175:6801","nonce":2476644457}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":2476644457},{"type":"v1","addr":"172.21.15.175:6803","nonce":2476644457}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":2476644457},{"type":"v1","addr":"172.21.15.175:6807","nonce":2476644457}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":2476644457},{"type":"v1","addr":"172.21.15.175:6805","nonce":2476644457}]},"public_addr":"172.21.15.175:6801/2476644457","cluster_addr":"172.21.15.175:6803/2476644457","heartbeat_back_addr":"172.21.15.175:6807/2476644457","heartbeat_front_addr":"172.21.15.175:6805/2476644457","state":["exists","up"]},{"osd":6,"uuid":"7bef4896-857e-4c11-b3b2-c2e9a8548338","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":3824112919},{"type":"v1","addr":"172.21.15.175:6819","nonce":3824112919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6821","nonce":3824112919},{"type":"v1","addr":"172.21.15.175:6824","nonce":3824112919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":3824112919},{"type":"v1","addr":"172.21.15.175:6831","nonce":3824112919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":3824112919},{"type":"v1","addr":"172.21.15.175:6829","nonce":3824112919}]},"public_addr":"172.21.15.175:6819/3824112919","cluster_addr":"172.21.15.175:6824/3824112919","heartbeat_back_addr":"172.21.15.175:6831/3824112919","heartbeat_front_addr":"172.21.15.175:6829/3824112919","state":["exists","up"]},{"osd":7,"uuid":"e18d9e09-8673-470d-b9dc-280a409b63f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6817","nonce":3319361162},{"type":"v1","addr":"172.21.15.175:6818","nonce":3319361162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":3319361162},{"type":"v1","addr":"172.21.15.175:6822","nonce":3319361162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6827","nonce":3319361162},{"type":"v1","addr":"172.21.15.175:6828","nonce":3319361162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6823","nonce":3319361162},{"type":"v1","addr":"172.21.15.175:6825","nonce":3319361162}]},"public_addr":"172.21.15.175:6818/3319361162","cluster_addr":"172.21.15.175:6822/3319361162","heartbeat_back_addr":"172.21.15.175:6828/3319361162","heartbeat_front_addr":"172.21.15.175:6825/3319361162","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:40:15.126268+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:40:15.050614+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:40:14.995164+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:40:15.078112+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:40:15.159637+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:40:15.091226+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:40:15.140316+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:40:15.089431+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.16","mappings":[{"from":5,"to":2}]},{"pgid":"3.17","mappings":[{"from":5,"to":1}]},{"pgid":"3.1f","mappings":[{"from":0,"to":2}]},{"pgid":"3.23","mappings":[{"from":3,"to":1}]},{"pgid":"3.39","mappings":[{"from":7,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:50:33.740 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:33.735+0000 7f00816c8640 1 -- 172.21.15.88:0/2025266521 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f006806c8f0 msgr2=0x7f006806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:33.740 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:33.735+0000 7f00816c8640 1 --2- 172.21.15.88:0/2025266521 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f006806c8f0 0x7f006806edb0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f006c034000 tx=0x7f006c02f000 comp rx=0 tx=0).stop 2024-04-26T23:50:33.740 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:33.735+0000 7f00816c8640 1 -- 172.21.15.88:0/2025266521 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f007c15a280 msgr2=0x7f007c1379b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:33.740 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:33.735+0000 7f00816c8640 1 --2- 172.21.15.88:0/2025266521 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f007c15a280 0x7f007c1379b0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f007400c480 tx=0x7f007400c940 comp rx=0 tx=0).stop 2024-04-26T23:50:33.740 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:33.735+0000 7f00816c8640 1 -- 172.21.15.88:0/2025266521 shutdown_connections 2024-04-26T23:50:33.740 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:33.735+0000 7f00816c8640 1 --2- 172.21.15.88:0/2025266521 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f006806c8f0 0x7f006806edb0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:33.740 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:33.735+0000 7f00816c8640 1 --2- 172.21.15.88:0/2025266521 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f007c13ffb0 0x7f007c137470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:33.740 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:33.735+0000 7f00816c8640 1 --2- 172.21.15.88:0/2025266521 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f007c15a280 0x7f007c1379b0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:33.740 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:33.735+0000 7f00816c8640 1 --2- 172.21.15.88:0/2025266521 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f007c073530 0x7f007c155160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:33.740 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:33.735+0000 7f00816c8640 1 -- 172.21.15.88:0/2025266521 >> 172.21.15.88:0/2025266521 conn(0x7f007c06dc10 msgr2=0x7f007c159810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:50:33.740 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:33.735+0000 7f00816c8640 1 -- 172.21.15.88:0/2025266521 shutdown_connections 2024-04-26T23:50:33.740 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:33.735+0000 7f00816c8640 1 -- 172.21.15.88:0/2025266521 wait complete. 2024-04-26T23:50:33.751 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail a 2024-04-26T23:50:33.849 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:33.845+0000 7f0d33f1b640 1 Processor -- start 2024-04-26T23:50:33.850 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:33.845+0000 7f0d33f1b640 1 -- start start 2024-04-26T23:50:33.851 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:33.846+0000 7f0d33f1b640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f0d2c1570d0 0x7f0d2c150a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:33.851 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:33.846+0000 7f0d33f1b640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0d2c0c3810 con 0x7f0d2c150f90 2024-04-26T23:50:33.851 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:33.846+0000 7f0d33f1b640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0d2c0c3ab0 con 0x7f0d2c0ab3f0 2024-04-26T23:50:33.851 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:33.846+0000 7f0d33f1b640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f0d2c0c4330 con 0x7f0d2c1570d0 2024-04-26T23:50:33.851 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:33.846+0000 7f0d324b8640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f0d2c150f90 0x7f0d2c1574b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:48690/0 (socket says 172.21.15.88:48690) 2024-04-26T23:50:33.852 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:33.846+0000 7f0d324b8640 1 -- 172.21.15.88:0/3085624049 learned_addr learned my addr 172.21.15.88:0/3085624049 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-26T23:50:33.852 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:33.846+0000 7f0d31cb7640 1 --2- 172.21.15.88:0/3085624049 >> v2:172.21.15.175:3300/0 conn(0x7f0d2c1570d0 0x7f0d2c150a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:33.852 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:33.846+0000 7f0d30cb5640 1 -- 172.21.15.88:0/3085624049 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1908467382 0 0) 0x7f0d2c0c3810 con 0x7f0d2c150f90 2024-04-26T23:50:33.852 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:33.846+0000 7f0d30cb5640 1 -- 172.21.15.88:0/3085624049 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0d14003520 con 0x7f0d2c150f90 2024-04-26T23:50:33.852 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:33.846+0000 7f0d30cb5640 1 -- 172.21.15.88:0/3085624049 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2888408877 0 0) 0x7f0d14003520 con 0x7f0d2c150f90 2024-04-26T23:50:33.852 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:33.846+0000 7f0d31cb7640 1 -- 172.21.15.88:0/3085624049 >> v1:172.21.15.175:6789/0 conn(0x7f0d2c0ab3f0 legacy=0x7f0d2c0c4d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:33.852 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:33.846+0000 7f0d31cb7640 1 -- 172.21.15.88:0/3085624049 >> v1:172.21.15.88:6789/0 conn(0x7f0d2c150f90 legacy=0x7f0d2c1574b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:33.852 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:33.846+0000 7f0d31cb7640 1 -- 172.21.15.88:0/3085624049 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d2c0c4580 con 0x7f0d2c1570d0 2024-04-26T23:50:33.852 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:33.847+0000 7f0d31cb7640 1 --2- 172.21.15.88:0/3085624049 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0d2c1570d0 0x7f0d2c150a50 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f0d240097a0 tx=0x7f0d2402a0a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5444429749d378d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:50:33.855 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:33.847+0000 7f0d30cb5640 1 -- 172.21.15.88:0/3085624049 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d24037070 con 0x7f0d2c1570d0 2024-04-26T23:50:33.856 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:33.847+0000 7f0d30cb5640 1 -- 172.21.15.88:0/3085624049 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f0d2402ab30 con 0x7f0d2c1570d0 2024-04-26T23:50:33.856 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:33.847+0000 7f0d30cb5640 1 -- 172.21.15.88:0/3085624049 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d1c001670 con 0x7f0d2c1570d0 2024-04-26T23:50:33.856 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:33.848+0000 7f0d33f1b640 1 -- 172.21.15.88:0/3085624049 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0d2c1570d0 msgr2=0x7f0d2c150a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:33.856 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:33.848+0000 7f0d33f1b640 1 --2- 172.21.15.88:0/3085624049 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0d2c1570d0 0x7f0d2c150a50 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f0d240097a0 tx=0x7f0d2402a0a0 comp rx=0 tx=0).stop 2024-04-26T23:50:33.856 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:33.848+0000 7f0d33f1b640 1 -- 172.21.15.88:0/3085624049 shutdown_connections 2024-04-26T23:50:33.856 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:33.848+0000 7f0d33f1b640 1 --2- 172.21.15.88:0/3085624049 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0d2c1570d0 0x7f0d2c150a50 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:33.856 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:33.848+0000 7f0d33f1b640 1 -- 172.21.15.88:0/3085624049 >> 172.21.15.88:0/3085624049 conn(0x7f0d2c06c310 msgr2=0x7f0d2c06c6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:50:33.856 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:33.848+0000 7f0d33f1b640 1 -- 172.21.15.88:0/3085624049 shutdown_connections 2024-04-26T23:50:33.856 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:33.848+0000 7f0d33f1b640 1 -- 172.21.15.88:0/3085624049 wait complete. 2024-04-26T23:50:33.856 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:33.849+0000 7f0d33f1b640 1 Processor -- start 2024-04-26T23:50:33.856 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:33.849+0000 7f0d33f1b640 1 -- start start 2024-04-26T23:50:33.856 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:33.850+0000 7f0d33f1b640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0d2c0ab3f0 0x7f0d2c0c5e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:33.856 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:33.850+0000 7f0d33f1b640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0d2c150f90 0x7f0d2c074770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:33.857 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:33.850+0000 7f0d33f1b640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0d2c1570d0 0x7f0d2c0c1700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:33.857 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:33.850+0000 7f0d33f1b640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f0d2c0abbe0 con 0x7f0d2c1570d0 2024-04-26T23:50:33.857 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:33.850+0000 7f0d33f1b640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f0d2c0aba60 con 0x7f0d2c150f90 2024-04-26T23:50:33.857 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:33.850+0000 7f0d33f1b640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f0d2c0c5490 con 0x7f0d2c0ab3f0 2024-04-26T23:50:33.857 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:33.850+0000 7f0d324b8640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0d2c1570d0 0x7f0d2c0c1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:33.857 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:33.850+0000 7f0d324b8640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0d2c1570d0 0x7f0d2c0c1700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:60732/0 (socket says 172.21.15.88:60732) 2024-04-26T23:50:33.857 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:33.850+0000 7f0d324b8640 1 -- 172.21.15.88:0/442762488 learned_addr learned my addr 172.21.15.88:0/442762488 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:50:33.857 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:33.850+0000 7f0d324b8640 1 -- 172.21.15.88:0/442762488 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0d2c0ab3f0 msgr2=0x7f0d2c0c5e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:33.857 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:33.850+0000 7f0d324b8640 1 --2- 172.21.15.88:0/442762488 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0d2c0ab3f0 0x7f0d2c0c5e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:33.857 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:33.850+0000 7f0d324b8640 1 -- 172.21.15.88:0/442762488 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0d2c150f90 msgr2=0x7f0d2c074770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:33.857 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:33.850+0000 7f0d324b8640 1 --2- 172.21.15.88:0/442762488 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0d2c150f90 0x7f0d2c074770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:33.858 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:33.850+0000 7f0d324b8640 1 -- 172.21.15.88:0/442762488 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d2c0c6380 con 0x7f0d2c1570d0 2024-04-26T23:50:33.858 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:33.850+0000 7f0d324b8640 1 --2- 172.21.15.88:0/442762488 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0d2c1570d0 0x7f0d2c0c1700 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f0d1c00c550 tx=0x7f0d1c00ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:50:33.858 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:33.850+0000 7f0d2a7fc640 1 -- 172.21.15.88:0/442762488 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d1c017070 con 0x7f0d2c1570d0 2024-04-26T23:50:33.858 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:33.850+0000 7f0d2a7fc640 1 -- 172.21.15.88:0/442762488 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f0d1c005d00 con 0x7f0d2c1570d0 2024-04-26T23:50:33.858 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:33.850+0000 7f0d2a7fc640 1 -- 172.21.15.88:0/442762488 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d1c0072d0 con 0x7f0d2c1570d0 2024-04-26T23:50:33.858 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:33.850+0000 7f0d33f1b640 1 -- 172.21.15.88:0/442762488 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d2c072cf0 con 0x7f0d2c1570d0 2024-04-26T23:50:33.858 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:33.850+0000 7f0d33f1b640 1 -- 172.21.15.88:0/442762488 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d2c06f380 con 0x7f0d2c1570d0 2024-04-26T23:50:33.858 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:33.851+0000 7f0d33f1b640 1 -- 172.21.15.88:0/442762488 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d2c0507a0 con 0x7f0d2c1570d0 2024-04-26T23:50:33.859 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:33.852+0000 7f0d2a7fc640 1 -- 172.21.15.88:0/442762488 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f0d1c01a070 con 0x7f0d2c1570d0 2024-04-26T23:50:33.859 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:33.852+0000 7f0d2a7fc640 1 --2- 172.21.15.88:0/442762488 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f0d1806c920 0x7f0d1806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:33.859 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:33.852+0000 7f0d31cb7640 1 --2- 172.21.15.88:0/442762488 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f0d1806c920 0x7f0d1806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:33.859 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:33.852+0000 7f0d2a7fc640 1 -- 172.21.15.88:0/442762488 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6666+0+0 (secure 0 0 0) 0x7f0d1c08b390 con 0x7f0d2c1570d0 2024-04-26T23:50:33.859 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:33.853+0000 7f0d31cb7640 1 --2- 172.21.15.88:0/442762488 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f0d1806c920 0x7f0d1806ede0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f0d24034000 tx=0x7f0d2402c000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:50:33.861 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:33.857+0000 7f0d2a7fc640 1 -- 172.21.15.88:0/442762488 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f0d1c059400 con 0x7f0d2c1570d0 2024-04-26T23:50:34.076 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:34.072+0000 7f0d33f1b640 1 -- 172.21.15.88:0/442762488 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "a"} v 0) -- 0x7f0d2c14c1f0 con 0x7f0d2c1570d0 2024-04-26T23:50:34.078 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:34.074+0000 7f0d2a7fc640 1 -- 172.21.15.88:0/442762488 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "a"}]=0 a marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v13) ==== 151+0+0 (secure 0 0 0) 0x7f0d1c058d00 con 0x7f0d2c1570d0 2024-04-26T23:50:34.079 INFO:teuthology.orchestra.run.smithi088.stderr:a marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-26T23:50:34.082 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:34.077+0000 7f0d33f1b640 1 -- 172.21.15.88:0/442762488 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f0d1806c920 msgr2=0x7f0d1806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:34.082 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:34.077+0000 7f0d33f1b640 1 --2- 172.21.15.88:0/442762488 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f0d1806c920 0x7f0d1806ede0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f0d24034000 tx=0x7f0d2402c000 comp rx=0 tx=0).stop 2024-04-26T23:50:34.082 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:34.077+0000 7f0d33f1b640 1 -- 172.21.15.88:0/442762488 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0d2c1570d0 msgr2=0x7f0d2c0c1700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:34.082 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:34.077+0000 7f0d33f1b640 1 --2- 172.21.15.88:0/442762488 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0d2c1570d0 0x7f0d2c0c1700 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f0d1c00c550 tx=0x7f0d1c00ca10 comp rx=0 tx=0).stop 2024-04-26T23:50:34.082 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:34.077+0000 7f0d33f1b640 1 -- 172.21.15.88:0/442762488 shutdown_connections 2024-04-26T23:50:34.082 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:34.077+0000 7f0d33f1b640 1 --2- 172.21.15.88:0/442762488 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f0d1806c920 0x7f0d1806ede0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:34.082 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:34.077+0000 7f0d33f1b640 1 --2- 172.21.15.88:0/442762488 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0d2c1570d0 0x7f0d2c0c1700 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:34.082 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:34.077+0000 7f0d33f1b640 1 --2- 172.21.15.88:0/442762488 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0d2c150f90 0x7f0d2c074770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:34.083 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:34.077+0000 7f0d33f1b640 1 --2- 172.21.15.88:0/442762488 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0d2c0ab3f0 0x7f0d2c0c5e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:34.083 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:34.077+0000 7f0d33f1b640 1 -- 172.21.15.88:0/442762488 >> 172.21.15.88:0/442762488 conn(0x7f0d2c06c310 msgr2=0x7f0d2c14e1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:50:34.083 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:34.077+0000 7f0d33f1b640 1 -- 172.21.15.88:0/442762488 shutdown_connections 2024-04-26T23:50:34.083 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:34.077+0000 7f0d33f1b640 1 -- 172.21.15.88:0/442762488 wait complete. 2024-04-26T23:50:34.093 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm a --yes-i-really-mean-it 2024-04-26T23:50:34.145 INFO:tasks.ceph.mds.b.smithi175.stdout:starting mds.b at 2024-04-26T23:50:34.193 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:34.188+0000 7f3470a83640 1 Processor -- start 2024-04-26T23:50:34.193 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:34.188+0000 7f3470a83640 1 -- start start 2024-04-26T23:50:34.194 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:34.189+0000 7f3470a83640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f346c13ffb0 0x7f346c0c3b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:34.194 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:34.189+0000 7f3470a83640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f346c073700 0x7f346c073b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:34.194 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:34.189+0000 7f3470a83640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f346c1579d0 con 0x7f346c074c10 2024-04-26T23:50:34.194 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:34.189+0000 7f3470a83640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f346c070880 con 0x7f346c13ffb0 2024-04-26T23:50:34.194 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:34.189+0000 7f3470a83640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f346c0ab680 con 0x7f346c073700 2024-04-26T23:50:34.195 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:34.189+0000 7f346a59c640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f346c13ffb0 0x7f346c0c3b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:34.195 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:34.189+0000 7f346a59c640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f346c13ffb0 0x7f346c0c3b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:60742/0 (socket says 172.21.15.88:60742) 2024-04-26T23:50:34.195 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:34.189+0000 7f346a59c640 1 -- 172.21.15.88:0/512975632 learned_addr learned my addr 172.21.15.88:0/512975632 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:50:34.195 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:34.190+0000 7f346a59c640 1 -- 172.21.15.88:0/512975632 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f346c073700 msgr2=0x7f346c073b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:50:34.195 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:34.190+0000 7f346ad9d640 1 --2- 172.21.15.88:0/512975632 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f346c073700 0x7f346c073b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:34.195 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:34.190+0000 7f346a59c640 1 --2- 172.21.15.88:0/512975632 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f346c073700 0x7f346c073b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:34.195 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:34.190+0000 7f346a59c640 1 -- 172.21.15.88:0/512975632 >> v1:172.21.15.175:6789/0 conn(0x7f346c074c10 legacy=0x7f346c0c40b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:50:34.195 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:34.190+0000 7f346a59c640 1 -- 172.21.15.88:0/512975632 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f346c0ab960 con 0x7f346c13ffb0 2024-04-26T23:50:34.197 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:34.190+0000 7f346a59c640 1 --2- 172.21.15.88:0/512975632 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f346c13ffb0 0x7f346c0c3b70 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f346c0cb1e0 tx=0x7f346402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=223bbf83f8468e92 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:50:34.197 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:34.191+0000 7f346959a640 1 -- 172.21.15.88:0/512975632 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3464037070 con 0x7f346c13ffb0 2024-04-26T23:50:34.197 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:34.191+0000 7f346959a640 1 -- 172.21.15.88:0/512975632 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f3464032440 con 0x7f346c13ffb0 2024-04-26T23:50:34.197 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:34.191+0000 7f346959a640 1 -- 172.21.15.88:0/512975632 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3464032830 con 0x7f346c13ffb0 2024-04-26T23:50:34.197 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:34.191+0000 7f3470a83640 1 -- 172.21.15.88:0/512975632 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f346c13ffb0 msgr2=0x7f346c0c3b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:34.197 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:34.191+0000 7f3470a83640 1 --2- 172.21.15.88:0/512975632 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f346c13ffb0 0x7f346c0c3b70 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f346c0cb1e0 tx=0x7f346402a1e0 comp rx=0 tx=0).stop 2024-04-26T23:50:34.197 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:34.191+0000 7f3470a83640 1 -- 172.21.15.88:0/512975632 shutdown_connections 2024-04-26T23:50:34.197 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:34.191+0000 7f3470a83640 1 --2- 172.21.15.88:0/512975632 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f346c073700 0x7f346c073b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:34.197 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:34.191+0000 7f3470a83640 1 --2- 172.21.15.88:0/512975632 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f346c13ffb0 0x7f346c0c3b70 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:34.197 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:34.191+0000 7f3470a83640 1 -- 172.21.15.88:0/512975632 >> 172.21.15.88:0/512975632 conn(0x7f346c0ca2f0 msgr2=0x7f346c0ca6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:50:34.197 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:34.191+0000 7f3470a83640 1 -- 172.21.15.88:0/512975632 shutdown_connections 2024-04-26T23:50:34.197 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:34.191+0000 7f3470a83640 1 -- 172.21.15.88:0/512975632 wait complete. 2024-04-26T23:50:34.197 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:34.192+0000 7f3470a83640 1 Processor -- start 2024-04-26T23:50:34.198 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:34.193+0000 7f3470a83640 1 -- start start 2024-04-26T23:50:34.200 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:34.193+0000 7f3470a83640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f346c073700 0x7f346c156860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:34.200 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:34.193+0000 7f3470a83640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f346c074c10 0x7f346c15a210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:34.200 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:34.193+0000 7f3470a83640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f346c13ffb0 0x7f346c157e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:34.200 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:34.193+0000 7f3470a83640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f346c157660 con 0x7f346c073700 2024-04-26T23:50:34.200 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:34.193+0000 7f3470a83640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f346c140390 con 0x7f346c13ffb0 2024-04-26T23:50:34.200 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:34.193+0000 7f3470a83640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f346c074090 con 0x7f346c074c10 2024-04-26T23:50:34.201 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:34.193+0000 7f346a59c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f346c073700 0x7f346c156860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:34.201 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:34.193+0000 7f346a59c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f346c073700 0x7f346c156860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:60752/0 (socket says 172.21.15.88:60752) 2024-04-26T23:50:34.201 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:34.193+0000 7f346a59c640 1 -- 172.21.15.88:0/2543372588 learned_addr learned my addr 172.21.15.88:0/2543372588 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:50:34.201 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:34.193+0000 7f346ad9d640 1 --2- 172.21.15.88:0/2543372588 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f346c13ffb0 0x7f346c157e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:34.201 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:34.193+0000 7f3469d9b640 1 --2- 172.21.15.88:0/2543372588 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f346c074c10 0x7f346c15a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:34.201 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:34.194+0000 7f346a59c640 1 -- 172.21.15.88:0/2543372588 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f346c074c10 msgr2=0x7f346c15a210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:34.201 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:34.194+0000 7f346a59c640 1 --2- 172.21.15.88:0/2543372588 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f346c074c10 0x7f346c15a210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:34.201 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:34.194+0000 7f346a59c640 1 -- 172.21.15.88:0/2543372588 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f346c13ffb0 msgr2=0x7f346c157e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:34.201 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:34.194+0000 7f346a59c640 1 --2- 172.21.15.88:0/2543372588 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f346c13ffb0 0x7f346c157e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:34.201 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:34.194+0000 7f346a59c640 1 -- 172.21.15.88:0/2543372588 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f346c153f20 con 0x7f346c073700 2024-04-26T23:50:34.201 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:34.194+0000 7f346a59c640 1 --2- 172.21.15.88:0/2543372588 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f346c073700 0x7f346c156860 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f3464000c00 tx=0x7f34640046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:50:34.201 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:34.194+0000 7f345affd640 1 -- 172.21.15.88:0/2543372588 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3464037040 con 0x7f346c073700 2024-04-26T23:50:34.201 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:34.194+0000 7f345affd640 1 -- 172.21.15.88:0/2543372588 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f3464042070 con 0x7f346c073700 2024-04-26T23:50:34.202 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:34.194+0000 7f3470a83640 1 -- 172.21.15.88:0/2543372588 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f346c153c40 con 0x7f346c073700 2024-04-26T23:50:34.202 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:34.194+0000 7f345affd640 1 -- 172.21.15.88:0/2543372588 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3464030bd0 con 0x7f346c073700 2024-04-26T23:50:34.202 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:34.194+0000 7f3470a83640 1 -- 172.21.15.88:0/2543372588 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f346c151900 con 0x7f346c073700 2024-04-26T23:50:34.202 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:34.195+0000 7f3470a83640 1 -- 172.21.15.88:0/2543372588 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f346c0507a0 con 0x7f346c073700 2024-04-26T23:50:34.202 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:34.195+0000 7f345affd640 1 -- 172.21.15.88:0/2543372588 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f3464047460 con 0x7f346c073700 2024-04-26T23:50:34.202 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:34.196+0000 7f345affd640 1 --2- 172.21.15.88:0/2543372588 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f344c06c8f0 0x7f344c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:34.202 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:34.196+0000 7f345affd640 1 -- 172.21.15.88:0/2543372588 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6752+0+0 (secure 0 0 0) 0x7f34640acc20 con 0x7f346c073700 2024-04-26T23:50:34.202 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:34.196+0000 7f3469d9b640 1 --2- 172.21.15.88:0/2543372588 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f344c06c8f0 0x7f344c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:34.202 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:34.196+0000 7f3469d9b640 1 --2- 172.21.15.88:0/2543372588 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f344c06c8f0 0x7f344c06edb0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f346c0c85a0 tx=0x7f3460009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:50:34.204 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:34.200+0000 7f345affd640 1 -- 172.21.15.88:0/2543372588 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f346407abb0 con 0x7f346c073700 2024-04-26T23:50:34.419 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:34.415+0000 7f3470a83640 1 -- 172.21.15.88:0/2543372588 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "a", "yes_i_really_mean_it": true} v 0) -- 0x7f346c076650 con 0x7f346c073700 2024-04-26T23:50:35.087 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:35.083+0000 7f345affd640 1 -- 172.21.15.88:0/2543372588 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "a", "yes_i_really_mean_it": true}]=0 v14) ==== 99+0+0 (secure 0 0 0) 0x7f346407a4b0 con 0x7f346c073700 2024-04-26T23:50:35.089 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:35.085+0000 7f3470a83640 1 -- 172.21.15.88:0/2543372588 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f344c06c8f0 msgr2=0x7f344c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:35.089 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:35.085+0000 7f3470a83640 1 --2- 172.21.15.88:0/2543372588 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f344c06c8f0 0x7f344c06edb0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f346c0c85a0 tx=0x7f3460009040 comp rx=0 tx=0).stop 2024-04-26T23:50:35.089 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:35.085+0000 7f3470a83640 1 -- 172.21.15.88:0/2543372588 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f346c073700 msgr2=0x7f346c156860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:35.090 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:35.085+0000 7f3470a83640 1 --2- 172.21.15.88:0/2543372588 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f346c073700 0x7f346c156860 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f3464000c00 tx=0x7f34640046c0 comp rx=0 tx=0).stop 2024-04-26T23:50:35.090 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:35.085+0000 7f3470a83640 1 -- 172.21.15.88:0/2543372588 shutdown_connections 2024-04-26T23:50:35.090 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:35.085+0000 7f3470a83640 1 --2- 172.21.15.88:0/2543372588 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f344c06c8f0 0x7f344c06edb0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:35.090 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:35.085+0000 7f3470a83640 1 --2- 172.21.15.88:0/2543372588 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f346c074c10 0x7f346c15a210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:35.090 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:35.085+0000 7f3470a83640 1 --2- 172.21.15.88:0/2543372588 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f346c13ffb0 0x7f346c157e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:35.090 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:35.085+0000 7f3470a83640 1 --2- 172.21.15.88:0/2543372588 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f346c073700 0x7f346c156860 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:35.090 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:35.085+0000 7f3470a83640 1 -- 172.21.15.88:0/2543372588 >> 172.21.15.88:0/2543372588 conn(0x7f346c0ca2f0 msgr2=0x7f346c0c97b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:50:35.090 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:35.085+0000 7f3470a83640 1 -- 172.21.15.88:0/2543372588 shutdown_connections 2024-04-26T23:50:35.090 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:35.085+0000 7f3470a83640 1 -- 172.21.15.88:0/2543372588 wait complete. 2024-04-26T23:50:35.101 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm a_metadata a_metadata --yes-i-really-really-mean-it 2024-04-26T23:50:35.203 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:35.199+0000 7f2ec5e83640 1 Processor -- start 2024-04-26T23:50:35.204 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:35.199+0000 7f2ec5e83640 1 -- start start 2024-04-26T23:50:35.205 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:35.200+0000 7f2ec5e83640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f2ec0074b20 0x7f2ec0158a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:35.205 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:35.200+0000 7f2ec5e83640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2ec00acf30 con 0x7f2ec00c6080 2024-04-26T23:50:35.205 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:35.200+0000 7f2ec5e83640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2ec00c6710 con 0x7f2ec00acb50 2024-04-26T23:50:35.205 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:35.200+0000 7f2ec5e83640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f2ec01585f0 con 0x7f2ec0074b20 2024-04-26T23:50:35.206 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:35.200+0000 7f2ebeffd640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f2ec0074b20 0x7f2ec0158a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:35.206 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:35.200+0000 7f2ebffff640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f2ec00c6080 0x7f2ec006e520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:48702/0 (socket says 172.21.15.88:48702) 2024-04-26T23:50:35.206 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:35.200+0000 7f2ebffff640 1 -- 172.21.15.88:0/1365038359 learned_addr learned my addr 172.21.15.88:0/1365038359 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-26T23:50:35.206 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:35.200+0000 7f2ebeffd640 1 -- 172.21.15.88:0/1365038359 >> v1:172.21.15.175:6789/0 conn(0x7f2ec00acb50 legacy=0x7f2ec01549b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:35.206 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:35.200+0000 7f2ebeffd640 1 -- 172.21.15.88:0/1365038359 >> v1:172.21.15.88:6789/0 conn(0x7f2ec00c6080 legacy=0x7f2ec006e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:35.206 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:35.200+0000 7f2ebe7fc640 1 -- 172.21.15.88:0/1365038359 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3770036548 0 0) 0x7f2eb8001490 con 0x7f2ec00c6080 2024-04-26T23:50:35.206 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:35.200+0000 7f2ebeffd640 1 -- 172.21.15.88:0/1365038359 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ec00c69f0 con 0x7f2ec0074b20 2024-04-26T23:50:35.206 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:35.201+0000 7f2ebeffd640 1 --2- 172.21.15.88:0/1365038359 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2ec0074b20 0x7f2ec0158a80 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f2eb40097a0 tx=0x7f2eb402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bce7f5314db66f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:50:35.206 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:35.201+0000 7f2ebe7fc640 1 -- 172.21.15.88:0/1365038359 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2eb4037070 con 0x7f2ec0074b20 2024-04-26T23:50:35.206 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:35.201+0000 7f2ebe7fc640 1 -- 172.21.15.88:0/1365038359 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f2eb4032440 con 0x7f2ec0074b20 2024-04-26T23:50:35.206 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:35.201+0000 7f2ebe7fc640 1 -- 172.21.15.88:0/1365038359 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2eb4032830 con 0x7f2ec0074b20 2024-04-26T23:50:35.209 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:35.201+0000 7f2ec5e83640 1 -- 172.21.15.88:0/1365038359 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2ec0074b20 msgr2=0x7f2ec0158a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:35.209 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:35.201+0000 7f2ec5e83640 1 --2- 172.21.15.88:0/1365038359 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2ec0074b20 0x7f2ec0158a80 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f2eb40097a0 tx=0x7f2eb402a230 comp rx=0 tx=0).stop 2024-04-26T23:50:35.209 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:35.202+0000 7f2ec5e83640 1 -- 172.21.15.88:0/1365038359 shutdown_connections 2024-04-26T23:50:35.210 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:35.202+0000 7f2ec5e83640 1 --2- 172.21.15.88:0/1365038359 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2ec0074b20 0x7f2ec0158a80 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:35.210 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:35.202+0000 7f2ec5e83640 1 -- 172.21.15.88:0/1365038359 >> 172.21.15.88:0/1365038359 conn(0x7f2ec00ca2f0 msgr2=0x7f2ec00ca6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:50:35.210 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:35.202+0000 7f2ec5e83640 1 -- 172.21.15.88:0/1365038359 shutdown_connections 2024-04-26T23:50:35.210 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:35.202+0000 7f2ec5e83640 1 -- 172.21.15.88:0/1365038359 wait complete. 2024-04-26T23:50:35.210 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:35.203+0000 7f2ec5e83640 1 Processor -- start 2024-04-26T23:50:35.210 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:35.203+0000 7f2ec5e83640 1 -- start start 2024-04-26T23:50:35.210 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:35.203+0000 7f2ec5e83640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2ec0074b20 0x7f2ec014e460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:35.210 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:35.203+0000 7f2ec5e83640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2ec00acb50 0x7f2ec0153d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:35.210 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:35.203+0000 7f2ec5e83640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2ec00c6080 0x7f2ec014a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:35.211 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:35.203+0000 7f2ec5e83640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f2ec0158280 con 0x7f2ec00acb50 2024-04-26T23:50:35.211 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:35.203+0000 7f2ec5e83640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f2ec00c64b0 con 0x7f2ec00c6080 2024-04-26T23:50:35.211 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:35.203+0000 7f2ec5e83640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f2ec01550c0 con 0x7f2ec0074b20 2024-04-26T23:50:35.211 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:35.204+0000 7f2ebeffd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2ec00acb50 0x7f2ec0153d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:35.211 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:35.204+0000 7f2ebeffd640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2ec00acb50 0x7f2ec0153d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:60778/0 (socket says 172.21.15.88:60778) 2024-04-26T23:50:35.211 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:35.204+0000 7f2ebeffd640 1 -- 172.21.15.88:0/1035731212 learned_addr learned my addr 172.21.15.88:0/1035731212 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:50:35.211 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:35.204+0000 7f2ebf7fe640 1 --2- 172.21.15.88:0/1035731212 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2ec0074b20 0x7f2ec014e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:35.211 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:35.204+0000 7f2ebffff640 1 --2- 172.21.15.88:0/1035731212 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2ec00c6080 0x7f2ec014a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:35.211 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:35.204+0000 7f2ebeffd640 1 -- 172.21.15.88:0/1035731212 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2ec0074b20 msgr2=0x7f2ec014e460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:35.211 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:35.204+0000 7f2ebeffd640 1 --2- 172.21.15.88:0/1035731212 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2ec0074b20 0x7f2ec014e460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:35.211 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:35.204+0000 7f2ebeffd640 1 -- 172.21.15.88:0/1035731212 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2ec00c6080 msgr2=0x7f2ec014a6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:35.211 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:35.204+0000 7f2ebeffd640 1 --2- 172.21.15.88:0/1035731212 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2ec00c6080 0x7f2ec014a6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:35.211 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:35.204+0000 7f2ebeffd640 1 -- 172.21.15.88:0/1035731212 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ec01ed910 con 0x7f2ec00acb50 2024-04-26T23:50:35.211 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:35.204+0000 7f2ebeffd640 1 --2- 172.21.15.88:0/1035731212 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2ec00acb50 0x7f2ec0153d20 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f2eb4035040 tx=0x7f2eb40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:50:35.212 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:35.204+0000 7f2ea7fff640 1 -- 172.21.15.88:0/1035731212 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2eb4037040 con 0x7f2ec00acb50 2024-04-26T23:50:35.212 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:35.204+0000 7f2ea7fff640 1 -- 172.21.15.88:0/1035731212 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f2eb4030770 con 0x7f2ec00acb50 2024-04-26T23:50:35.212 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:35.204+0000 7f2ec5e83640 1 -- 172.21.15.88:0/1035731212 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ec01edbf0 con 0x7f2ec00acb50 2024-04-26T23:50:35.212 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:35.204+0000 7f2ea7fff640 1 -- 172.21.15.88:0/1035731212 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2eb4030b80 con 0x7f2ec00acb50 2024-04-26T23:50:35.212 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:35.204+0000 7f2ec5e83640 1 -- 172.21.15.88:0/1035731212 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ec014e9a0 con 0x7f2ec00acb50 2024-04-26T23:50:35.212 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:35.205+0000 7f2ec5e83640 1 -- 172.21.15.88:0/1035731212 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ec00694b0 con 0x7f2ec00acb50 2024-04-26T23:50:35.213 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:35.206+0000 7f2ea7fff640 1 -- 172.21.15.88:0/1035731212 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2eb4044020 con 0x7f2ec00acb50 2024-04-26T23:50:35.213 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:35.206+0000 7f2ea7fff640 1 --2- 172.21.15.88:0/1035731212 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f2eac06c920 0x7f2eac06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:35.213 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:35.206+0000 7f2ebf7fe640 1 --2- 172.21.15.88:0/1035731212 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f2eac06c920 0x7f2eac06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:35.213 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:35.206+0000 7f2ea7fff640 1 -- 172.21.15.88:0/1035731212 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6752+0+0 (secure 0 0 0) 0x7f2eb40ac5d0 con 0x7f2ec00acb50 2024-04-26T23:50:35.213 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:35.206+0000 7f2ebf7fe640 1 --2- 172.21.15.88:0/1035731212 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f2eac06c920 0x7f2eac06ede0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f2eb0000f60 tx=0x7f2eb0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:50:35.214 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:35.210+0000 7f2ea7fff640 1 -- 172.21.15.88:0/1035731212 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f2eb407a560 con 0x7f2ec00acb50 2024-04-26T23:50:35.392 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:35.387+0000 7f2ec5e83640 1 -- 172.21.15.88:0/1035731212 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "a_metadata", "pool2": "a_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f2ec0152340 con 0x7f2ec00acb50 2024-04-26T23:50:36.090 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:36.085+0000 7f2ea7fff640 1 -- 172.21.15.88:0/1035731212 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "a_metadata", "pool2": "a_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'a_metadata' removed v28) ==== 166+0+0 (secure 0 0 0) 0x7f2eb4079e60 con 0x7f2ec00acb50 2024-04-26T23:50:36.090 INFO:teuthology.orchestra.run.smithi088.stderr:pool 'a_metadata' removed 2024-04-26T23:50:36.093 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:36.088+0000 7f2ec5e83640 1 -- 172.21.15.88:0/1035731212 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f2eac06c920 msgr2=0x7f2eac06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:36.093 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:36.088+0000 7f2ec5e83640 1 --2- 172.21.15.88:0/1035731212 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f2eac06c920 0x7f2eac06ede0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f2eb0000f60 tx=0x7f2eb0009040 comp rx=0 tx=0).stop 2024-04-26T23:50:36.093 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:36.088+0000 7f2ec5e83640 1 -- 172.21.15.88:0/1035731212 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2ec00acb50 msgr2=0x7f2ec0153d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:36.093 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:36.088+0000 7f2ec5e83640 1 --2- 172.21.15.88:0/1035731212 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2ec00acb50 0x7f2ec0153d20 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f2eb4035040 tx=0x7f2eb40046c0 comp rx=0 tx=0).stop 2024-04-26T23:50:36.093 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:36.088+0000 7f2ec5e83640 1 -- 172.21.15.88:0/1035731212 shutdown_connections 2024-04-26T23:50:36.093 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:36.088+0000 7f2ec5e83640 1 --2- 172.21.15.88:0/1035731212 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f2eac06c920 0x7f2eac06ede0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:36.093 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:36.088+0000 7f2ec5e83640 1 --2- 172.21.15.88:0/1035731212 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2ec00c6080 0x7f2ec014a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:36.093 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:36.088+0000 7f2ec5e83640 1 --2- 172.21.15.88:0/1035731212 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2ec00acb50 0x7f2ec0153d20 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:36.093 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:36.088+0000 7f2ec5e83640 1 --2- 172.21.15.88:0/1035731212 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2ec0074b20 0x7f2ec014e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:36.093 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:36.088+0000 7f2ec5e83640 1 -- 172.21.15.88:0/1035731212 >> 172.21.15.88:0/1035731212 conn(0x7f2ec00ca2f0 msgr2=0x7f2ec00ca6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:50:36.093 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:36.088+0000 7f2ec5e83640 1 -- 172.21.15.88:0/1035731212 shutdown_connections 2024-04-26T23:50:36.094 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:36.088+0000 7f2ec5e83640 1 -- 172.21.15.88:0/1035731212 wait complete. 2024-04-26T23:50:36.106 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm a_data a_data --yes-i-really-really-mean-it 2024-04-26T23:50:36.201 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:50:36.204 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:50:36.210 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:36.205+0000 7f7424cf9640 1 Processor -- start 2024-04-26T23:50:36.210 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:36.205+0000 7f7424cf9640 1 -- start start 2024-04-26T23:50:36.211 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:36.206+0000 7f7424cf9640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f742013e000 0x7f742006d540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:36.211 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:36.206+0000 7f7424cf9640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f74200703f0 0x7f74200756f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:36.211 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:36.206+0000 7f7424cf9640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f74201583d0 con 0x7f7420075c30 2024-04-26T23:50:36.211 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:36.206+0000 7f7424cf9640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f742006da80 con 0x7f742013e000 2024-04-26T23:50:36.211 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:36.206+0000 7f7424cf9640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f7420158180 con 0x7f74200703f0 2024-04-26T23:50:36.211 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:36.206+0000 7f741ed9d640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f7420075c30 0x7f7420154c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:48712/0 (socket says 172.21.15.88:48712) 2024-04-26T23:50:36.211 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:36.206+0000 7f741ed9d640 1 -- 172.21.15.88:0/1689290767 learned_addr learned my addr 172.21.15.88:0/1689290767 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-26T23:50:36.212 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:36.206+0000 7f741e59c640 1 --2- 172.21.15.88:0/1689290767 >> v2:172.21.15.88:3300/0 conn(0x7f742013e000 0x7f742006d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:36.212 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:36.206+0000 7f7417fff640 1 --2- 172.21.15.88:0/1689290767 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f74200703f0 0x7f74200756f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:36.212 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:36.207+0000 7f741e59c640 1 -- 172.21.15.88:0/1689290767 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f74200703f0 msgr2=0x7f74200756f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:50:36.212 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:36.207+0000 7f741e59c640 1 --2- 172.21.15.88:0/1689290767 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f74200703f0 0x7f74200756f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:36.212 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:36.207+0000 7f741e59c640 1 -- 172.21.15.88:0/1689290767 >> v1:172.21.15.88:6789/0 conn(0x7f7420075c30 legacy=0x7f7420154c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:36.212 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:36.207+0000 7f741dd9b640 1 -- 172.21.15.88:0/1689290767 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1406041914 0 0) 0x7f74201583d0 con 0x7f7420075c30 2024-04-26T23:50:36.212 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:36.207+0000 7f741e59c640 1 -- 172.21.15.88:0/1689290767 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74201586b0 con 0x7f742013e000 2024-04-26T23:50:36.214 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:36.208+0000 7f741e59c640 1 --2- 172.21.15.88:0/1689290767 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f742013e000 0x7f742006d540 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f74100097a0 tx=0x7f741002a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22d4ef8b08220635 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:50:36.214 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:36.208+0000 7f741dd9b640 1 -- 172.21.15.88:0/1689290767 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7410037070 con 0x7f742013e000 2024-04-26T23:50:36.214 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:36.208+0000 7f741dd9b640 1 -- 172.21.15.88:0/1689290767 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f741002adb0 con 0x7f742013e000 2024-04-26T23:50:36.214 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:36.208+0000 7f741dd9b640 1 -- 172.21.15.88:0/1689290767 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7410032680 con 0x7f742013e000 2024-04-26T23:50:36.214 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:36.208+0000 7f7424cf9640 1 -- 172.21.15.88:0/1689290767 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f742013e000 msgr2=0x7f742006d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:36.214 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:36.208+0000 7f7424cf9640 1 --2- 172.21.15.88:0/1689290767 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f742013e000 0x7f742006d540 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f74100097a0 tx=0x7f741002a060 comp rx=0 tx=0).stop 2024-04-26T23:50:36.214 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:36.208+0000 7f7424cf9640 1 -- 172.21.15.88:0/1689290767 shutdown_connections 2024-04-26T23:50:36.215 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:36.208+0000 7f7424cf9640 1 --2- 172.21.15.88:0/1689290767 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f74200703f0 0x7f74200756f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:36.215 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:36.208+0000 7f7424cf9640 1 --2- 172.21.15.88:0/1689290767 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f742013e000 0x7f742006d540 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:36.215 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:36.208+0000 7f7424cf9640 1 -- 172.21.15.88:0/1689290767 >> 172.21.15.88:0/1689290767 conn(0x7f74200c5ce0 msgr2=0x7f74200c60f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:50:36.215 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:36.208+0000 7f7424cf9640 1 -- 172.21.15.88:0/1689290767 shutdown_connections 2024-04-26T23:50:36.215 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:36.208+0000 7f7424cf9640 1 -- 172.21.15.88:0/1689290767 wait complete. 2024-04-26T23:50:36.215 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:36.210+0000 7f7424cf9640 1 Processor -- start 2024-04-26T23:50:36.215 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:36.210+0000 7f7424cf9640 1 -- start start 2024-04-26T23:50:36.218 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:36.210+0000 7f7424cf9640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f74200703f0 0x7f74201537f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:36.218 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:36.210+0000 7f7424cf9640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7420075c30 0x7f7420137800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:36.218 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:36.210+0000 7f7424cf9640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f742013e000 0x7f74201edf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:36.218 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:36.210+0000 7f7424cf9640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f7420155320 con 0x7f74200703f0 2024-04-26T23:50:36.218 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:36.210+0000 7f7424cf9640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f7420158c70 con 0x7f7420075c30 2024-04-26T23:50:36.219 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:36.210+0000 7f7424cf9640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f74201554a0 con 0x7f742013e000 2024-04-26T23:50:36.219 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:36.210+0000 7f741e59c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f74200703f0 0x7f74201537f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:36.219 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:36.210+0000 7f741e59c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f74200703f0 0x7f74201537f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:60796/0 (socket says 172.21.15.88:60796) 2024-04-26T23:50:36.219 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:36.210+0000 7f741e59c640 1 -- 172.21.15.88:0/3225742058 learned_addr learned my addr 172.21.15.88:0/3225742058 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:50:36.219 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:36.211+0000 7f741ed9d640 1 --2- 172.21.15.88:0/3225742058 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f742013e000 0x7f74201edf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:36.219 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:36.211+0000 7f7417fff640 1 --2- 172.21.15.88:0/3225742058 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7420075c30 0x7f7420137800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:36.219 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:36.211+0000 7f741e59c640 1 -- 172.21.15.88:0/3225742058 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f742013e000 msgr2=0x7f74201edf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:36.219 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:36.211+0000 7f741e59c640 1 --2- 172.21.15.88:0/3225742058 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f742013e000 0x7f74201edf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:36.219 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:36.211+0000 7f741e59c640 1 -- 172.21.15.88:0/3225742058 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7420075c30 msgr2=0x7f7420137800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:36.220 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:36.211+0000 7f741e59c640 1 --2- 172.21.15.88:0/3225742058 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7420075c30 0x7f7420137800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:36.220 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:36.211+0000 7f741e59c640 1 -- 172.21.15.88:0/3225742058 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7420137d40 con 0x7f74200703f0 2024-04-26T23:50:36.220 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:36.211+0000 7f7417fff640 1 --2- 172.21.15.88:0/3225742058 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7420075c30 0x7f7420137800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:50:36.220 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:36.211+0000 7f741e59c640 1 --2- 172.21.15.88:0/3225742058 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f74200703f0 0x7f74201537f0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f7410000c00 tx=0x7f74100046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:50:36.220 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:36.211+0000 7f7416ffd640 1 -- 172.21.15.88:0/3225742058 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7410041070 con 0x7f74200703f0 2024-04-26T23:50:36.220 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:36.211+0000 7f7424cf9640 1 -- 172.21.15.88:0/3225742058 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74201ee840 con 0x7f74200703f0 2024-04-26T23:50:36.220 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:36.211+0000 7f7416ffd640 1 -- 172.21.15.88:0/3225742058 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f741003c670 con 0x7f74200703f0 2024-04-26T23:50:36.220 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:36.211+0000 7f7416ffd640 1 -- 172.21.15.88:0/3225742058 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7410037040 con 0x7f74200703f0 2024-04-26T23:50:36.220 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:36.211+0000 7f7424cf9640 1 -- 172.21.15.88:0/3225742058 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74201eeb20 con 0x7f74200703f0 2024-04-26T23:50:36.220 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:36.212+0000 7f7424cf9640 1 -- 172.21.15.88:0/3225742058 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7420068dc0 con 0x7f74200703f0 2024-04-26T23:50:36.220 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:36.213+0000 7f7416ffd640 1 -- 172.21.15.88:0/3225742058 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f741003a070 con 0x7f74200703f0 2024-04-26T23:50:36.220 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:36.213+0000 7f7416ffd640 1 --2- 172.21.15.88:0/3225742058 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f740006c8f0 0x7f740006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:36.221 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:36.213+0000 7f7416ffd640 1 -- 172.21.15.88:0/3225742058 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6324+0+0 (secure 0 0 0) 0x7f74100ac150 con 0x7f74200703f0 2024-04-26T23:50:36.221 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:36.213+0000 7f7417fff640 1 --2- 172.21.15.88:0/3225742058 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f740006c8f0 0x7f740006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:36.221 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:36.214+0000 7f7417fff640 1 --2- 172.21.15.88:0/3225742058 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f740006c8f0 0x7f740006edb0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f742013c430 tx=0x7f7408008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:50:36.222 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:36.217+0000 7f7416ffd640 1 -- 172.21.15.88:0/3225742058 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f7420068dc0 con 0x7f74200703f0 2024-04-26T23:50:36.401 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:36.396+0000 7f7424cf9640 1 -- 172.21.15.88:0/3225742058 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "a_data", "pool2": "a_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f7420069bc0 con 0x7f74200703f0 2024-04-26T23:50:37.094 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:37.090+0000 7f7416ffd640 1 -- 172.21.15.88:0/3225742058 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "a_data", "pool2": "a_data", "yes_i_really_really_mean_it": true}]=0 pool 'a_data' removed v29) ==== 154+0+0 (secure 0 0 0) 0x7f7410079c40 con 0x7f74200703f0 2024-04-26T23:50:37.094 INFO:teuthology.orchestra.run.smithi088.stderr:pool 'a_data' removed 2024-04-26T23:50:37.097 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:37.093+0000 7f7424cf9640 1 -- 172.21.15.88:0/3225742058 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f740006c8f0 msgr2=0x7f740006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:37.097 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:37.093+0000 7f7424cf9640 1 --2- 172.21.15.88:0/3225742058 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f740006c8f0 0x7f740006edb0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f742013c430 tx=0x7f7408008040 comp rx=0 tx=0).stop 2024-04-26T23:50:37.097 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:37.093+0000 7f7424cf9640 1 -- 172.21.15.88:0/3225742058 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f74200703f0 msgr2=0x7f74201537f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:37.097 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:37.093+0000 7f7424cf9640 1 --2- 172.21.15.88:0/3225742058 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f74200703f0 0x7f74201537f0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f7410000c00 tx=0x7f74100046c0 comp rx=0 tx=0).stop 2024-04-26T23:50:37.098 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:37.094+0000 7f7424cf9640 1 -- 172.21.15.88:0/3225742058 shutdown_connections 2024-04-26T23:50:37.098 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:37.094+0000 7f7424cf9640 1 --2- 172.21.15.88:0/3225742058 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f740006c8f0 0x7f740006edb0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:37.098 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:37.094+0000 7f7424cf9640 1 --2- 172.21.15.88:0/3225742058 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f742013e000 0x7f74201edf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:37.098 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:37.094+0000 7f7424cf9640 1 --2- 172.21.15.88:0/3225742058 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7420075c30 0x7f7420137800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:37.099 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:37.094+0000 7f7424cf9640 1 --2- 172.21.15.88:0/3225742058 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f74200703f0 0x7f74201537f0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:37.099 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:37.094+0000 7f7424cf9640 1 -- 172.21.15.88:0/3225742058 >> 172.21.15.88:0/3225742058 conn(0x7f74200c5ce0 msgr2=0x7f742006ef90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:50:37.099 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:37.094+0000 7f7424cf9640 1 -- 172.21.15.88:0/3225742058 shutdown_connections 2024-04-26T23:50:37.099 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:37.094+0000 7f7424cf9640 1 -- 172.21.15.88:0/3225742058 wait complete. 2024-04-26T23:50:37.115 INFO:tasks.cephfs.filesystem:Destroying file system b and related pools 2024-04-26T23:50:37.115 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T23:50:37.225 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:37.219+0000 7feb8672b640 1 Processor -- start 2024-04-26T23:50:37.225 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:37.219+0000 7feb8672b640 1 -- start start 2024-04-26T23:50:37.225 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:37.219+0000 7feb8672b640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7feb80154160 0x7feb80156bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:37.225 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:37.219+0000 7feb8672b640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7feb800ca5a0 0x7feb8015a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:37.225 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:37.219+0000 7feb8672b640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb800c8df0 con 0x7feb800c6e00 2024-04-26T23:50:37.226 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:37.219+0000 7feb8672b640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7feb8015a6e0 con 0x7feb800ca5a0 2024-04-26T23:50:37.226 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:37.219+0000 7feb8672b640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7feb800c9100 con 0x7feb80154160 2024-04-26T23:50:37.226 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:37.220+0000 7feb7f7fe640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7feb800ca5a0 0x7feb8015a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:37.226 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:37.220+0000 7feb84cc8640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7feb800c6e00 0x7feb800c9590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:48728/0 (socket says 172.21.15.88:48728) 2024-04-26T23:50:37.226 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:37.220+0000 7feb84cc8640 1 -- 172.21.15.88:0/1158169547 learned_addr learned my addr 172.21.15.88:0/1158169547 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-26T23:50:37.226 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:37.220+0000 7feb7f7fe640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7feb800ca5a0 0x7feb8015a1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:60798/0 (socket says 172.21.15.88:60798) 2024-04-26T23:50:37.226 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:37.220+0000 7feb7ffff640 1 --2- 172.21.15.88:0/1158169547 >> v2:172.21.15.175:3300/0 conn(0x7feb80154160 0x7feb80156bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:37.226 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:37.220+0000 7feb7f7fe640 1 -- 172.21.15.88:0/1158169547 >> v2:172.21.15.175:3300/0 conn(0x7feb80154160 msgr2=0x7feb80156bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:50:37.226 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:37.220+0000 7feb7f7fe640 1 --2- 172.21.15.88:0/1158169547 >> v2:172.21.15.175:3300/0 conn(0x7feb80154160 0x7feb80156bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:37.226 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:37.220+0000 7feb7f7fe640 1 -- 172.21.15.88:0/1158169547 >> v1:172.21.15.88:6789/0 conn(0x7feb800c6e00 legacy=0x7feb800c9590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:37.226 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:37.220+0000 7feb7f7fe640 1 -- 172.21.15.88:0/1158169547 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb80154540 con 0x7feb800ca5a0 2024-04-26T23:50:37.226 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:37.221+0000 7feb7f7fe640 1 --2- 172.21.15.88:0/1158169547 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feb800ca5a0 0x7feb8015a1a0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7feb800c9280 tx=0x7feb7402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8767a8bf2f7dadf server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:50:37.227 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:37.221+0000 7feb7effd640 1 -- 172.21.15.88:0/1158169547 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb74037070 con 0x7feb800ca5a0 2024-04-26T23:50:37.227 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:37.221+0000 7feb7effd640 1 -- 172.21.15.88:0/1158169547 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7feb74032440 con 0x7feb800ca5a0 2024-04-26T23:50:37.227 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:37.221+0000 7feb7effd640 1 -- 172.21.15.88:0/1158169547 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb74032830 con 0x7feb800ca5a0 2024-04-26T23:50:37.230 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:37.221+0000 7feb8672b640 1 -- 172.21.15.88:0/1158169547 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feb800ca5a0 msgr2=0x7feb8015a1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:37.230 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:37.221+0000 7feb8672b640 1 --2- 172.21.15.88:0/1158169547 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feb800ca5a0 0x7feb8015a1a0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7feb800c9280 tx=0x7feb7402a1a0 comp rx=0 tx=0).stop 2024-04-26T23:50:37.230 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:37.221+0000 7feb8672b640 1 -- 172.21.15.88:0/1158169547 shutdown_connections 2024-04-26T23:50:37.230 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:37.221+0000 7feb8672b640 1 --2- 172.21.15.88:0/1158169547 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feb800ca5a0 0x7feb8015a1a0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:37.230 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:37.221+0000 7feb8672b640 1 --2- 172.21.15.88:0/1158169547 >> v2:172.21.15.175:3300/0 conn(0x7feb80154160 0x7feb80156bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:37.230 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:37.221+0000 7feb8672b640 1 -- 172.21.15.88:0/1158169547 >> 172.21.15.88:0/1158169547 conn(0x7feb800ae010 msgr2=0x7feb800ae3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:50:37.230 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:37.221+0000 7feb8672b640 1 -- 172.21.15.88:0/1158169547 shutdown_connections 2024-04-26T23:50:37.230 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:37.221+0000 7feb8672b640 1 -- 172.21.15.88:0/1158169547 wait complete. 2024-04-26T23:50:37.230 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:37.223+0000 7feb8672b640 1 Processor -- start 2024-04-26T23:50:37.231 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:37.223+0000 7feb8672b640 1 -- start start 2024-04-26T23:50:37.231 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:37.223+0000 7feb8672b640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7feb800c6e00 0x7feb80152440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:37.231 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:37.223+0000 7feb8672b640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7feb800ca5a0 0x7feb80159bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:37.231 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:37.223+0000 7feb8672b640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feb80154160 0x7feb8014a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:37.231 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:37.223+0000 7feb8672b640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7feb8015aed0 con 0x7feb80154160 2024-04-26T23:50:37.231 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:37.223+0000 7feb8672b640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7feb8015abf0 con 0x7feb800ca5a0 2024-04-26T23:50:37.231 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:37.223+0000 7feb8672b640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7feb800c9ca0 con 0x7feb800c6e00 2024-04-26T23:50:37.231 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:37.224+0000 7feb84cc8640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feb80154160 0x7feb8014a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:37.231 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:37.224+0000 7feb84cc8640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feb80154160 0x7feb8014a4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:60808/0 (socket says 172.21.15.88:60808) 2024-04-26T23:50:37.231 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:37.224+0000 7feb84cc8640 1 -- 172.21.15.88:0/2970680377 learned_addr learned my addr 172.21.15.88:0/2970680377 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:50:37.231 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:37.224+0000 7feb7f7fe640 1 --2- 172.21.15.88:0/2970680377 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7feb800ca5a0 0x7feb80159bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:37.231 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:37.224+0000 7feb7ffff640 1 --2- 172.21.15.88:0/2970680377 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7feb800c6e00 0x7feb80152440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:37.231 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:37.224+0000 7feb84cc8640 1 -- 172.21.15.88:0/2970680377 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7feb800c6e00 msgr2=0x7feb80152440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:37.231 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:37.224+0000 7feb84cc8640 1 --2- 172.21.15.88:0/2970680377 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7feb800c6e00 0x7feb80152440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:37.232 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:37.224+0000 7feb84cc8640 1 -- 172.21.15.88:0/2970680377 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7feb800ca5a0 msgr2=0x7feb80159bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:37.232 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:37.224+0000 7feb84cc8640 1 --2- 172.21.15.88:0/2970680377 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7feb800ca5a0 0x7feb80159bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:37.232 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:37.224+0000 7feb84cc8640 1 -- 172.21.15.88:0/2970680377 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb8014b5b0 con 0x7feb80154160 2024-04-26T23:50:37.232 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:37.224+0000 7feb84cc8640 1 --2- 172.21.15.88:0/2970680377 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feb80154160 0x7feb8014a4c0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7feb7800cbc0 tx=0x7feb7800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:50:37.232 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:37.224+0000 7feb7cff9640 1 -- 172.21.15.88:0/2970680377 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb78017070 con 0x7feb80154160 2024-04-26T23:50:37.232 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:37.224+0000 7feb7cff9640 1 -- 172.21.15.88:0/2970680377 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7feb7800ad40 con 0x7feb80154160 2024-04-26T23:50:37.232 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:37.224+0000 7feb8672b640 1 -- 172.21.15.88:0/2970680377 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb801efa60 con 0x7feb80154160 2024-04-26T23:50:37.232 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:37.224+0000 7feb7cff9640 1 -- 172.21.15.88:0/2970680377 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb78012620 con 0x7feb80154160 2024-04-26T23:50:37.232 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:37.224+0000 7feb8672b640 1 -- 172.21.15.88:0/2970680377 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb80152980 con 0x7feb80154160 2024-04-26T23:50:37.232 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:37.225+0000 7feb8672b640 1 -- 172.21.15.88:0/2970680377 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb80076650 con 0x7feb80154160 2024-04-26T23:50:37.232 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:37.226+0000 7feb7cff9640 1 -- 172.21.15.88:0/2970680377 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7feb7801a070 con 0x7feb80154160 2024-04-26T23:50:37.233 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:37.226+0000 7feb7cff9640 1 --2- 172.21.15.88:0/2970680377 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7feb6c06c8f0 0x7feb6c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:37.233 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:37.226+0000 7feb7cff9640 1 -- 172.21.15.88:0/2970680377 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5775+0+0 (secure 0 0 0) 0x7feb7808b8e0 con 0x7feb80154160 2024-04-26T23:50:37.233 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:37.226+0000 7feb7ffff640 1 --2- 172.21.15.88:0/2970680377 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7feb6c06c8f0 0x7feb6c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:37.233 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:37.227+0000 7feb7ffff640 1 --2- 172.21.15.88:0/2970680377 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7feb6c06c8f0 0x7feb6c06edb0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7feb700079a0 tx=0x7feb70008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:50:37.235 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:37.231+0000 7feb7cff9640 1 -- 172.21.15.88:0/2970680377 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7feb800c8df0 con 0x7feb80154160 2024-04-26T23:50:37.451 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:37.447+0000 7feb8672b640 1 -- 172.21.15.88:0/2970680377 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7feb800507a0 con 0x7feb80154160 2024-04-26T23:50:37.452 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:37.447+0000 7feb7cff9640 1 -- 172.21.15.88:0/2970680377 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) ==== 94+0+5182 (secure 0 0 0) 0x7feb78059680 con 0x7feb80154160 2024-04-26T23:50:37.452 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-26T23:50:37.452 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":14,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6834/3199540397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":3199540397},{"type":"v1","addr":"172.21.15.175:6834","nonce":3199540397}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4270,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6837/2790134952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6835","nonce":2790134952},{"type":"v1","addr":"172.21.15.88:6837","nonce":2790134952}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":94378,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/1650009191","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6833","nonce":1650009191},{"type":"v1","addr":"172.21.15.175:6835","nonce":1650009191}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":14}],"filesystems":[{"mdsmap":{"epoch":12,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T23:40:41.008364+0000","modified":"2024-04-26T23:40:44.027288+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4272":{"gid":4272,"name":"c","rank":0,"incarnation":9,"state":"up:active","state_seq":6,"addr":"172.21.15.88:6836/4159390276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6834","nonce":4159390276},{"type":"v1","addr":"172.21.15.88:6836","nonce":4159390276}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4272,"qdb_cluster":[4272]},"id":2}]} 2024-04-26T23:50:37.453 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 14 2024-04-26T23:50:37.454 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:37.449+0000 7feb8672b640 1 -- 172.21.15.88:0/2970680377 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7feb6c06c8f0 msgr2=0x7feb6c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:37.454 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:37.449+0000 7feb8672b640 1 --2- 172.21.15.88:0/2970680377 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7feb6c06c8f0 0x7feb6c06edb0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7feb700079a0 tx=0x7feb70008040 comp rx=0 tx=0).stop 2024-04-26T23:50:37.454 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:37.449+0000 7feb8672b640 1 -- 172.21.15.88:0/2970680377 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feb80154160 msgr2=0x7feb8014a4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:37.454 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:37.449+0000 7feb8672b640 1 --2- 172.21.15.88:0/2970680377 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feb80154160 0x7feb8014a4c0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7feb7800cbc0 tx=0x7feb7800a430 comp rx=0 tx=0).stop 2024-04-26T23:50:37.454 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:37.449+0000 7feb8672b640 1 -- 172.21.15.88:0/2970680377 shutdown_connections 2024-04-26T23:50:37.454 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:37.449+0000 7feb8672b640 1 --2- 172.21.15.88:0/2970680377 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7feb6c06c8f0 0x7feb6c06edb0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:37.455 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:37.449+0000 7feb8672b640 1 --2- 172.21.15.88:0/2970680377 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feb80154160 0x7feb8014a4c0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:37.455 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:37.449+0000 7feb8672b640 1 --2- 172.21.15.88:0/2970680377 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7feb800ca5a0 0x7feb80159bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:37.455 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:37.449+0000 7feb8672b640 1 --2- 172.21.15.88:0/2970680377 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7feb800c6e00 0x7feb80152440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:37.455 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:37.450+0000 7feb8672b640 1 -- 172.21.15.88:0/2970680377 >> 172.21.15.88:0/2970680377 conn(0x7feb800ae010 msgr2=0x7feb800ca980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:50:37.455 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:37.450+0000 7feb8672b640 1 -- 172.21.15.88:0/2970680377 shutdown_connections 2024-04-26T23:50:37.455 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:37.450+0000 7feb8672b640 1 -- 172.21.15.88:0/2970680377 wait complete. 2024-04-26T23:50:37.466 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T23:50:37.562 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:37.557+0000 7fbdfb493640 1 Processor -- start 2024-04-26T23:50:37.562 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:37.558+0000 7fbdfb493640 1 -- start start 2024-04-26T23:50:37.564 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:37.558+0000 7fbdfb493640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fbdf40ca5a0 0x7fbdf4156bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:37.564 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:37.558+0000 7fbdfb493640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fbdf415a1a0 0x7fbdf40c9590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:37.564 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:37.558+0000 7fbdfb493640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbdf40c8df0 con 0x7fbdf4154160 2024-04-26T23:50:37.564 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:37.558+0000 7fbdfb493640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7fbdf40c9100 con 0x7fbdf40ca5a0 2024-04-26T23:50:37.564 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:37.558+0000 7fbdfb493640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7fbdf4154540 con 0x7fbdf415a1a0 2024-04-26T23:50:37.564 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:37.558+0000 7fbdf8a2e640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fbdf40ca5a0 0x7fbdf4156bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:37.564 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:37.558+0000 7fbdf8a2e640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fbdf40ca5a0 0x7fbdf4156bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:60816/0 (socket says 172.21.15.88:60816) 2024-04-26T23:50:37.564 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:37.558+0000 7fbdf8a2e640 1 -- 172.21.15.88:0/656414592 learned_addr learned my addr 172.21.15.88:0/656414592 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:50:37.564 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:37.559+0000 7fbdf9a30640 1 --2- 172.21.15.88:0/656414592 >> v2:172.21.15.175:3300/0 conn(0x7fbdf415a1a0 0x7fbdf40c9590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:37.564 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:37.559+0000 7fbdf8a2e640 1 -- 172.21.15.88:0/656414592 >> v2:172.21.15.175:3300/0 conn(0x7fbdf415a1a0 msgr2=0x7fbdf40c9590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:50:37.565 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:37.559+0000 7fbdf8a2e640 1 --2- 172.21.15.88:0/656414592 >> v2:172.21.15.175:3300/0 conn(0x7fbdf415a1a0 0x7fbdf40c9590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:37.565 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:37.559+0000 7fbdf8a2e640 1 -- 172.21.15.88:0/656414592 >> v1:172.21.15.175:6789/0 conn(0x7fbdf4154160 legacy=0x7fbdf40c6e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:37.565 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:37.559+0000 7fbdf8a2e640 1 -- 172.21.15.88:0/656414592 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbdf415a910 con 0x7fbdf40ca5a0 2024-04-26T23:50:37.565 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:37.559+0000 7fbdf8a2e640 1 --2- 172.21.15.88:0/656414592 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbdf40ca5a0 0x7fbdf4156bb0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fbdf40c9280 tx=0x7fbde402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=901a362a914dc724 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:50:37.565 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:37.559+0000 7fbdebfff640 1 -- 172.21.15.88:0/656414592 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbde4037070 con 0x7fbdf40ca5a0 2024-04-26T23:50:37.565 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:37.559+0000 7fbdebfff640 1 -- 172.21.15.88:0/656414592 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fbde4032440 con 0x7fbdf40ca5a0 2024-04-26T23:50:37.565 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:37.560+0000 7fbdebfff640 1 -- 172.21.15.88:0/656414592 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbde4032830 con 0x7fbdf40ca5a0 2024-04-26T23:50:37.569 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:37.560+0000 7fbdfb493640 1 -- 172.21.15.88:0/656414592 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbdf40ca5a0 msgr2=0x7fbdf4156bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:37.569 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:37.560+0000 7fbdfb493640 1 --2- 172.21.15.88:0/656414592 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbdf40ca5a0 0x7fbdf4156bb0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fbdf40c9280 tx=0x7fbde402a270 comp rx=0 tx=0).stop 2024-04-26T23:50:37.569 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:37.560+0000 7fbdfb493640 1 -- 172.21.15.88:0/656414592 shutdown_connections 2024-04-26T23:50:37.569 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:37.560+0000 7fbdfb493640 1 --2- 172.21.15.88:0/656414592 >> v2:172.21.15.175:3300/0 conn(0x7fbdf415a1a0 0x7fbdf40c9590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:37.570 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:37.560+0000 7fbdfb493640 1 --2- 172.21.15.88:0/656414592 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbdf40ca5a0 0x7fbdf4156bb0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:37.570 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:37.560+0000 7fbdfb493640 1 -- 172.21.15.88:0/656414592 >> 172.21.15.88:0/656414592 conn(0x7fbdf40ae010 msgr2=0x7fbdf40ae3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:50:37.570 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:37.560+0000 7fbdfb493640 1 -- 172.21.15.88:0/656414592 shutdown_connections 2024-04-26T23:50:37.570 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:37.560+0000 7fbdfb493640 1 -- 172.21.15.88:0/656414592 wait complete. 2024-04-26T23:50:37.570 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:37.561+0000 7fbdfb493640 1 Processor -- start 2024-04-26T23:50:37.570 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:37.561+0000 7fbdfb493640 1 -- start start 2024-04-26T23:50:37.570 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:37.562+0000 7fbdfb493640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbdf40ca5a0 0x7fbdf41f01a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:37.570 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:37.562+0000 7fbdfb493640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbdf4154160 0x7fbdf40ad370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:37.570 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:37.562+0000 7fbdfb493640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbdf415a1a0 0x7fbdf41482c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:37.570 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:37.562+0000 7fbdfb493640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fbdf415a5b0 con 0x7fbdf415a1a0 2024-04-26T23:50:37.570 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:37.562+0000 7fbdfb493640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fbdf415aed0 con 0x7fbdf40ca5a0 2024-04-26T23:50:37.570 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:37.562+0000 7fbdfb493640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fbdf40c7510 con 0x7fbdf4154160 2024-04-26T23:50:37.570 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:37.562+0000 7fbdf9a30640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbdf415a1a0 0x7fbdf41482c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:37.571 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:37.562+0000 7fbdf9a30640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbdf415a1a0 0x7fbdf41482c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:60818/0 (socket says 172.21.15.88:60818) 2024-04-26T23:50:37.571 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:37.562+0000 7fbdf9a30640 1 -- 172.21.15.88:0/3132775122 learned_addr learned my addr 172.21.15.88:0/3132775122 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:50:37.571 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:37.562+0000 7fbdf922f640 1 --2- 172.21.15.88:0/3132775122 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbdf40ca5a0 0x7fbdf41f01a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:37.571 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:37.562+0000 7fbdf8a2e640 1 --2- 172.21.15.88:0/3132775122 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbdf4154160 0x7fbdf40ad370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:37.571 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:37.562+0000 7fbdf9a30640 1 -- 172.21.15.88:0/3132775122 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbdf4154160 msgr2=0x7fbdf40ad370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:37.571 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:37.562+0000 7fbdf9a30640 1 --2- 172.21.15.88:0/3132775122 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbdf4154160 0x7fbdf40ad370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:37.571 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:37.562+0000 7fbdf9a30640 1 -- 172.21.15.88:0/3132775122 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbdf40ca5a0 msgr2=0x7fbdf41f01a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:37.571 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:37.562+0000 7fbdf9a30640 1 --2- 172.21.15.88:0/3132775122 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbdf40ca5a0 0x7fbdf41f01a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:37.571 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:37.562+0000 7fbdf9a30640 1 -- 172.21.15.88:0/3132775122 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbdf4151b60 con 0x7fbdf415a1a0 2024-04-26T23:50:37.571 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:37.562+0000 7fbdf8a2e640 1 --2- 172.21.15.88:0/3132775122 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbdf4154160 0x7fbdf40ad370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:50:37.571 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:37.562+0000 7fbdf9a30640 1 --2- 172.21.15.88:0/3132775122 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbdf415a1a0 0x7fbdf41482c0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fbdf000d5d0 tx=0x7fbdf000da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:50:37.571 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:37.562+0000 7fbde9ffb640 1 -- 172.21.15.88:0/3132775122 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdf00125f0 con 0x7fbdf415a1a0 2024-04-26T23:50:37.572 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:37.563+0000 7fbde9ffb640 1 -- 172.21.15.88:0/3132775122 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fbdf0019070 con 0x7fbdf415a1a0 2024-04-26T23:50:37.572 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:37.563+0000 7fbdfb493640 1 -- 172.21.15.88:0/3132775122 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbdf4151e40 con 0x7fbdf415a1a0 2024-04-26T23:50:37.572 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:37.563+0000 7fbde9ffb640 1 -- 172.21.15.88:0/3132775122 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdf0012a10 con 0x7fbdf415a1a0 2024-04-26T23:50:37.572 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:37.563+0000 7fbdfb493640 1 -- 172.21.15.88:0/3132775122 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbdf4152400 con 0x7fbdf415a1a0 2024-04-26T23:50:37.572 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:37.564+0000 7fbdfb493640 1 -- 172.21.15.88:0/3132775122 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbdf4076650 con 0x7fbdf415a1a0 2024-04-26T23:50:37.572 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:37.564+0000 7fbde9ffb640 1 -- 172.21.15.88:0/3132775122 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fbdf0012bb0 con 0x7fbdf415a1a0 2024-04-26T23:50:37.572 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:37.564+0000 7fbde9ffb640 1 --2- 172.21.15.88:0/3132775122 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fbdd806c8f0 0x7fbdd806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:37.572 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:37.565+0000 7fbde9ffb640 1 -- 172.21.15.88:0/3132775122 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5775+0+0 (secure 0 0 0) 0x7fbdf008bf10 con 0x7fbdf415a1a0 2024-04-26T23:50:37.572 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:37.565+0000 7fbdf922f640 1 --2- 172.21.15.88:0/3132775122 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fbdd806c8f0 0x7fbdd806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:37.573 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:37.565+0000 7fbdf922f640 1 --2- 172.21.15.88:0/3132775122 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fbdd806c8f0 0x7fbdd806edb0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fbdec001f10 tx=0x7fbdec009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:50:37.573 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:37.569+0000 7fbde9ffb640 1 -- 172.21.15.88:0/3132775122 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fbdf005a280 con 0x7fbdf415a1a0 2024-04-26T23:50:37.809 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:37.805+0000 7fbdfb493640 1 -- 172.21.15.88:0/3132775122 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbdf40507a0 con 0x7fbdf415a1a0 2024-04-26T23:50:37.810 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:37.805+0000 7fbde9ffb640 1 -- 172.21.15.88:0/3132775122 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) ==== 94+0+5182 (secure 0 0 0) 0x7fbdf0059b80 con 0x7fbdf415a1a0 2024-04-26T23:50:37.810 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-26T23:50:37.810 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":14,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6834/3199540397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":3199540397},{"type":"v1","addr":"172.21.15.175:6834","nonce":3199540397}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4270,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6837/2790134952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6835","nonce":2790134952},{"type":"v1","addr":"172.21.15.88:6837","nonce":2790134952}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":94378,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/1650009191","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6833","nonce":1650009191},{"type":"v1","addr":"172.21.15.175:6835","nonce":1650009191}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":14}],"filesystems":[{"mdsmap":{"epoch":12,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T23:40:41.008364+0000","modified":"2024-04-26T23:40:44.027288+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4272":{"gid":4272,"name":"c","rank":0,"incarnation":9,"state":"up:active","state_seq":6,"addr":"172.21.15.88:6836/4159390276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6834","nonce":4159390276},{"type":"v1","addr":"172.21.15.88:6836","nonce":4159390276}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4272,"qdb_cluster":[4272]},"id":2}]} 2024-04-26T23:50:37.810 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 14 2024-04-26T23:50:37.812 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:37.807+0000 7fbdfb493640 1 -- 172.21.15.88:0/3132775122 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fbdd806c8f0 msgr2=0x7fbdd806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:37.812 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:37.807+0000 7fbdfb493640 1 --2- 172.21.15.88:0/3132775122 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fbdd806c8f0 0x7fbdd806edb0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fbdec001f10 tx=0x7fbdec009040 comp rx=0 tx=0).stop 2024-04-26T23:50:37.812 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:37.807+0000 7fbdfb493640 1 -- 172.21.15.88:0/3132775122 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbdf415a1a0 msgr2=0x7fbdf41482c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:37.812 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:37.807+0000 7fbdfb493640 1 --2- 172.21.15.88:0/3132775122 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbdf415a1a0 0x7fbdf41482c0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fbdf000d5d0 tx=0x7fbdf000da90 comp rx=0 tx=0).stop 2024-04-26T23:50:37.812 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:37.807+0000 7fbdfb493640 1 -- 172.21.15.88:0/3132775122 shutdown_connections 2024-04-26T23:50:37.812 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:37.807+0000 7fbdfb493640 1 --2- 172.21.15.88:0/3132775122 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fbdd806c8f0 0x7fbdd806edb0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:37.812 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:37.807+0000 7fbdfb493640 1 --2- 172.21.15.88:0/3132775122 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbdf4154160 0x7fbdf40ad370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:37.812 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:37.807+0000 7fbdfb493640 1 --2- 172.21.15.88:0/3132775122 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbdf415a1a0 0x7fbdf41482c0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:37.812 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:37.807+0000 7fbdfb493640 1 --2- 172.21.15.88:0/3132775122 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbdf40ca5a0 0x7fbdf41f01a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:37.812 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:37.807+0000 7fbdfb493640 1 -- 172.21.15.88:0/3132775122 >> 172.21.15.88:0/3132775122 conn(0x7fbdf40ae010 msgr2=0x7fbdf414c820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:50:37.813 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:37.807+0000 7fbdfb493640 1 -- 172.21.15.88:0/3132775122 shutdown_connections 2024-04-26T23:50:37.813 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:37.807+0000 7fbdfb493640 1 -- 172.21.15.88:0/3132775122 wait complete. 2024-04-26T23:50:37.823 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T23:50:37.919 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:37.915+0000 7f7ec3797640 1 Processor -- start 2024-04-26T23:50:37.920 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:37.915+0000 7f7ec3797640 1 -- start start 2024-04-26T23:50:37.921 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:37.916+0000 7f7ec3797640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7ebc1541d0 0x7f7ebc0c8400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:37.921 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:37.916+0000 7f7ec3797640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f7ebc15a3c0 0x7f7ebc15a850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:37.921 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:37.916+0000 7f7ec3797640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ebc0c3fc0 con 0x7f7ebc070490 2024-04-26T23:50:37.921 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:37.916+0000 7f7ec3797640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f7ebc0c3500 con 0x7f7ebc15a3c0 2024-04-26T23:50:37.921 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:37.916+0000 7f7ec3797640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f7ebc0c37e0 con 0x7f7ebc1541d0 2024-04-26T23:50:37.921 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:37.916+0000 7f7ec1d34640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f7ebc15a3c0 0x7f7ebc15a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:37.921 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:37.916+0000 7f7ec1d34640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f7ebc15a3c0 0x7f7ebc15a850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:60834/0 (socket says 172.21.15.88:60834) 2024-04-26T23:50:37.921 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:37.916+0000 7f7ec0d32640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f7ebc070490 0x7f7ebc0c7420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:48744/0 (socket says 172.21.15.88:48744) 2024-04-26T23:50:37.922 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:37.916+0000 7f7ec1d34640 1 -- 172.21.15.88:0/3807775475 learned_addr learned my addr 172.21.15.88:0/3807775475 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:50:37.922 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:37.916+0000 7f7ec1533640 1 --2- 172.21.15.88:0/3807775475 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7ebc1541d0 0x7f7ebc0c8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:37.922 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:37.916+0000 7f7ec1d34640 1 -- 172.21.15.88:0/3807775475 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7ebc1541d0 msgr2=0x7f7ebc0c8400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:50:37.922 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:37.916+0000 7f7ec1d34640 1 --2- 172.21.15.88:0/3807775475 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7ebc1541d0 0x7f7ebc0c8400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:37.922 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:37.916+0000 7f7ec1d34640 1 -- 172.21.15.88:0/3807775475 >> v1:172.21.15.88:6789/0 conn(0x7f7ebc070490 legacy=0x7f7ebc0c7420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:37.922 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:37.916+0000 7f7ec1d34640 1 -- 172.21.15.88:0/3807775475 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ebc0c3ac0 con 0x7f7ebc15a3c0 2024-04-26T23:50:37.923 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:37.917+0000 7f7ec1d34640 1 --2- 172.21.15.88:0/3807775475 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7ebc15a3c0 0x7f7ebc15a850 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f7eb4009e50 tx=0x7f7eb402a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e57c10a6d27f660 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:50:37.923 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:37.917+0000 7f7eb3fff640 1 -- 172.21.15.88:0/3807775475 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7eb4036070 con 0x7f7ebc15a3c0 2024-04-26T23:50:37.923 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:37.917+0000 7f7eb3fff640 1 -- 172.21.15.88:0/3807775475 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f7eb4031600 con 0x7f7ebc15a3c0 2024-04-26T23:50:37.924 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:37.917+0000 7f7eb3fff640 1 -- 172.21.15.88:0/3807775475 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7eb40319f0 con 0x7f7ebc15a3c0 2024-04-26T23:50:37.924 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:37.918+0000 7f7ec3797640 1 -- 172.21.15.88:0/3807775475 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7ebc15a3c0 msgr2=0x7f7ebc15a850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:37.924 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:37.918+0000 7f7ec3797640 1 --2- 172.21.15.88:0/3807775475 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7ebc15a3c0 0x7f7ebc15a850 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f7eb4009e50 tx=0x7f7eb402a680 comp rx=0 tx=0).stop 2024-04-26T23:50:37.924 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:37.918+0000 7f7ec3797640 1 -- 172.21.15.88:0/3807775475 shutdown_connections 2024-04-26T23:50:37.924 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:37.918+0000 7f7ec3797640 1 --2- 172.21.15.88:0/3807775475 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7ebc15a3c0 0x7f7ebc15a850 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:37.924 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:37.918+0000 7f7ec3797640 1 --2- 172.21.15.88:0/3807775475 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7ebc1541d0 0x7f7ebc0c8400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:37.924 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:37.918+0000 7f7ec3797640 1 -- 172.21.15.88:0/3807775475 >> 172.21.15.88:0/3807775475 conn(0x7f7ebc0c8c40 msgr2=0x7f7ebc0c9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:50:37.924 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:37.918+0000 7f7ec3797640 1 -- 172.21.15.88:0/3807775475 shutdown_connections 2024-04-26T23:50:37.924 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:37.918+0000 7f7ec3797640 1 -- 172.21.15.88:0/3807775475 wait complete. 2024-04-26T23:50:37.924 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:37.919+0000 7f7ec3797640 1 Processor -- start 2024-04-26T23:50:37.924 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:37.919+0000 7f7ec3797640 1 -- start start 2024-04-26T23:50:37.927 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:37.920+0000 7f7ec3797640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7ebc070490 0x7f7ebc06fa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:37.927 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:37.920+0000 7f7ec3797640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7ebc1541d0 0x7f7ebc0aa7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:37.927 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:37.920+0000 7f7ec3797640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7ebc15a3c0 0x7f7ebc1ecbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:37.927 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:37.920+0000 7f7ec3797640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f7ebc0c7cb0 con 0x7f7ebc070490 2024-04-26T23:50:37.927 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:37.920+0000 7f7ec3797640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f7ebc0c7b30 con 0x7f7ebc15a3c0 2024-04-26T23:50:37.928 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:37.920+0000 7f7ec3797640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f7ebc0c42a0 con 0x7f7ebc1541d0 2024-04-26T23:50:37.928 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:37.920+0000 7f7ec1533640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7ebc070490 0x7f7ebc06fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:37.928 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:37.920+0000 7f7ec1533640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7ebc070490 0x7f7ebc06fa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:60844/0 (socket says 172.21.15.88:60844) 2024-04-26T23:50:37.928 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:37.920+0000 7f7ec1533640 1 -- 172.21.15.88:0/3460239128 learned_addr learned my addr 172.21.15.88:0/3460239128 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:50:37.928 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:37.920+0000 7f7ec0d32640 1 --2- 172.21.15.88:0/3460239128 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7ebc1541d0 0x7f7ebc0aa7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:37.928 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:37.920+0000 7f7ec1d34640 1 --2- 172.21.15.88:0/3460239128 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7ebc15a3c0 0x7f7ebc1ecbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:37.928 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:37.920+0000 7f7ec1533640 1 -- 172.21.15.88:0/3460239128 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7ebc1541d0 msgr2=0x7f7ebc0aa7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:37.928 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:37.920+0000 7f7ec1533640 1 --2- 172.21.15.88:0/3460239128 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7ebc1541d0 0x7f7ebc0aa7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:37.928 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:37.920+0000 7f7ec1533640 1 -- 172.21.15.88:0/3460239128 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7ebc15a3c0 msgr2=0x7f7ebc1ecbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:37.928 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:37.920+0000 7f7ec1533640 1 --2- 172.21.15.88:0/3460239128 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7ebc15a3c0 0x7f7ebc1ecbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:37.928 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:37.920+0000 7f7ec1533640 1 -- 172.21.15.88:0/3460239128 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ebc06e010 con 0x7f7ebc070490 2024-04-26T23:50:37.928 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:37.920+0000 7f7ec1533640 1 --2- 172.21.15.88:0/3460239128 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7ebc070490 0x7f7ebc06fa70 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f7eb800d800 tx=0x7f7eb800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:50:37.928 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:37.920+0000 7f7eb1ffb640 1 -- 172.21.15.88:0/3460239128 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7eb800b6c0 con 0x7f7ebc070490 2024-04-26T23:50:37.928 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:37.920+0000 7f7eb1ffb640 1 -- 172.21.15.88:0/3460239128 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f7eb8019070 con 0x7f7ebc070490 2024-04-26T23:50:37.929 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:37.920+0000 7f7ec3797640 1 -- 172.21.15.88:0/3460239128 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ebc0aa280 con 0x7f7ebc070490 2024-04-26T23:50:37.929 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:37.920+0000 7f7eb1ffb640 1 -- 172.21.15.88:0/3460239128 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7eb800baa0 con 0x7f7ebc070490 2024-04-26T23:50:37.929 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:37.921+0000 7f7ec3797640 1 -- 172.21.15.88:0/3460239128 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ebc1f0c50 con 0x7f7ebc070490 2024-04-26T23:50:37.929 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:37.921+0000 7f7ec3797640 1 -- 172.21.15.88:0/3460239128 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ebc068c30 con 0x7f7ebc070490 2024-04-26T23:50:37.929 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:37.922+0000 7f7eb1ffb640 1 -- 172.21.15.88:0/3460239128 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f7eb800bc40 con 0x7f7ebc070490 2024-04-26T23:50:37.929 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:37.922+0000 7f7eb1ffb640 1 --2- 172.21.15.88:0/3460239128 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f7ea006c8f0 0x7f7ea006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:37.929 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:37.922+0000 7f7eb1ffb640 1 -- 172.21.15.88:0/3460239128 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5775+0+0 (secure 0 0 0) 0x7f7eb808bfa0 con 0x7f7ebc070490 2024-04-26T23:50:37.929 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:37.922+0000 7f7ec0d32640 1 --2- 172.21.15.88:0/3460239128 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f7ea006c8f0 0x7f7ea006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:37.929 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:37.923+0000 7f7ec0d32640 1 --2- 172.21.15.88:0/3460239128 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f7ea006c8f0 0x7f7ea006edb0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f7ebc158200 tx=0x7f7eac007cc0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:50:37.930 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:37.926+0000 7f7eb1ffb640 1 -- 172.21.15.88:0/3460239128 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f7eb805a420 con 0x7f7ebc070490 2024-04-26T23:50:38.198 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:38.193+0000 7f7ec3797640 1 -- 172.21.15.88:0/3460239128 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7ebc0507a0 con 0x7f7ebc070490 2024-04-26T23:50:38.199 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:38.194+0000 7f7eb1ffb640 1 -- 172.21.15.88:0/3460239128 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) ==== 74+0+16780 (secure 0 0 0) 0x7f7eb8059d20 con 0x7f7ebc070490 2024-04-26T23:50:38.199 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-26T23:50:38.199 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":29,"fsid":"555255e9-7ef9-4454-8dc9-35e96b70035c","created":"2024-04-26T23:40:07.836009+0000","modified":"2024-04-26T23:50:37.087425+0000","last_up_change":"2024-04-26T23:40:18.831369+0000","last_in_change":"2024-04-26T23:40:09.944777+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T23:40:19.936127+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"b_metadata","create_time":"2024-04-26T23:40:38.753441+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"b_data","create_time":"2024-04-26T23:40:39.974557+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"92aecea3-ed62-4a29-87c0-76758a0816a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":2803186054},{"type":"v1","addr":"172.21.15.88:6801","nonce":2803186054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":2803186054},{"type":"v1","addr":"172.21.15.88:6803","nonce":2803186054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":2803186054},{"type":"v1","addr":"172.21.15.88:6807","nonce":2803186054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":2803186054},{"type":"v1","addr":"172.21.15.88:6805","nonce":2803186054}]},"public_addr":"172.21.15.88:6801/2803186054","cluster_addr":"172.21.15.88:6803/2803186054","heartbeat_back_addr":"172.21.15.88:6807/2803186054","heartbeat_front_addr":"172.21.15.88:6805/2803186054","state":["exists","up"]},{"osd":1,"uuid":"7a6f0fa9-23d0-4747-880f-798d45ec5eeb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":1897380484},{"type":"v1","addr":"172.21.15.88:6817","nonce":1897380484}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":1897380484},{"type":"v1","addr":"172.21.15.88:6819","nonce":1897380484}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":1897380484},{"type":"v1","addr":"172.21.15.88:6823","nonce":1897380484}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":1897380484},{"type":"v1","addr":"172.21.15.88:6821","nonce":1897380484}]},"public_addr":"172.21.15.88:6817/1897380484","cluster_addr":"172.21.15.88:6819/1897380484","heartbeat_back_addr":"172.21.15.88:6823/1897380484","heartbeat_front_addr":"172.21.15.88:6821/1897380484","state":["exists","up"]},{"osd":2,"uuid":"6be88ea0-e133-4200-a4b5-f92d664b248a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":648396269},{"type":"v1","addr":"172.21.15.88:6809","nonce":648396269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":648396269},{"type":"v1","addr":"172.21.15.88:6811","nonce":648396269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":648396269},{"type":"v1","addr":"172.21.15.88:6815","nonce":648396269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":648396269},{"type":"v1","addr":"172.21.15.88:6813","nonce":648396269}]},"public_addr":"172.21.15.88:6809/648396269","cluster_addr":"172.21.15.88:6811/648396269","heartbeat_back_addr":"172.21.15.88:6815/648396269","heartbeat_front_addr":"172.21.15.88:6813/648396269","state":["exists","up"]},{"osd":3,"uuid":"dcb0746b-7b3d-4ecf-8089-2493a5d1857c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":2328028922},{"type":"v1","addr":"172.21.15.88:6825","nonce":2328028922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":2328028922},{"type":"v1","addr":"172.21.15.88:6827","nonce":2328028922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":2328028922},{"type":"v1","addr":"172.21.15.88:6831","nonce":2328028922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":2328028922},{"type":"v1","addr":"172.21.15.88:6829","nonce":2328028922}]},"public_addr":"172.21.15.88:6825/2328028922","cluster_addr":"172.21.15.88:6827/2328028922","heartbeat_back_addr":"172.21.15.88:6831/2328028922","heartbeat_front_addr":"172.21.15.88:6829/2328028922","state":["exists","up"]},{"osd":4,"uuid":"c483de66-c44f-450e-a4ce-b132d50882c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":3929617402},{"type":"v1","addr":"172.21.15.175:6809","nonce":3929617402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":3929617402},{"type":"v1","addr":"172.21.15.175:6811","nonce":3929617402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":3929617402},{"type":"v1","addr":"172.21.15.175:6815","nonce":3929617402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":3929617402},{"type":"v1","addr":"172.21.15.175:6813","nonce":3929617402}]},"public_addr":"172.21.15.175:6809/3929617402","cluster_addr":"172.21.15.175:6811/3929617402","heartbeat_back_addr":"172.21.15.175:6815/3929617402","heartbeat_front_addr":"172.21.15.175:6813/3929617402","state":["exists","up"]},{"osd":5,"uuid":"ac3b1669-d228-40dd-9f9a-cb46aa73dd6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":2476644457},{"type":"v1","addr":"172.21.15.175:6801","nonce":2476644457}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":2476644457},{"type":"v1","addr":"172.21.15.175:6803","nonce":2476644457}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":2476644457},{"type":"v1","addr":"172.21.15.175:6807","nonce":2476644457}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":2476644457},{"type":"v1","addr":"172.21.15.175:6805","nonce":2476644457}]},"public_addr":"172.21.15.175:6801/2476644457","cluster_addr":"172.21.15.175:6803/2476644457","heartbeat_back_addr":"172.21.15.175:6807/2476644457","heartbeat_front_addr":"172.21.15.175:6805/2476644457","state":["exists","up"]},{"osd":6,"uuid":"7bef4896-857e-4c11-b3b2-c2e9a8548338","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":3824112919},{"type":"v1","addr":"172.21.15.175:6819","nonce":3824112919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6821","nonce":3824112919},{"type":"v1","addr":"172.21.15.175:6824","nonce":3824112919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":3824112919},{"type":"v1","addr":"172.21.15.175:6831","nonce":3824112919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":3824112919},{"type":"v1","addr":"172.21.15.175:6829","nonce":3824112919}]},"public_addr":"172.21.15.175:6819/3824112919","cluster_addr":"172.21.15.175:6824/3824112919","heartbeat_back_addr":"172.21.15.175:6831/3824112919","heartbeat_front_addr":"172.21.15.175:6829/3824112919","state":["exists","up"]},{"osd":7,"uuid":"e18d9e09-8673-470d-b9dc-280a409b63f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6817","nonce":3319361162},{"type":"v1","addr":"172.21.15.175:6818","nonce":3319361162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":3319361162},{"type":"v1","addr":"172.21.15.175:6822","nonce":3319361162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6827","nonce":3319361162},{"type":"v1","addr":"172.21.15.175:6828","nonce":3319361162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6823","nonce":3319361162},{"type":"v1","addr":"172.21.15.175:6825","nonce":3319361162}]},"public_addr":"172.21.15.175:6818/3319361162","cluster_addr":"172.21.15.175:6822/3319361162","heartbeat_back_addr":"172.21.15.175:6828/3319361162","heartbeat_front_addr":"172.21.15.175:6825/3319361162","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:40:15.126268+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:40:15.050614+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:40:14.995164+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:40:15.078112+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:40:15.159637+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:40:15.091226+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:40:15.140316+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:40:15.089431+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.175:6835/3932058274":"2024-04-27T23:50:34.074078+0000","172.21.15.175:6833/3932058274":"2024-04-27T23:50:34.074078+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:50:38.202 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:38.197+0000 7f7ec3797640 1 -- 172.21.15.88:0/3460239128 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f7ea006c8f0 msgr2=0x7f7ea006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:38.202 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:38.197+0000 7f7ec3797640 1 --2- 172.21.15.88:0/3460239128 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f7ea006c8f0 0x7f7ea006edb0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f7ebc158200 tx=0x7f7eac007cc0 comp rx=0 tx=0).stop 2024-04-26T23:50:38.203 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:38.197+0000 7f7ec3797640 1 -- 172.21.15.88:0/3460239128 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7ebc070490 msgr2=0x7f7ebc06fa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:38.203 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:38.197+0000 7f7ec3797640 1 --2- 172.21.15.88:0/3460239128 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7ebc070490 0x7f7ebc06fa70 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f7eb800d800 tx=0x7f7eb800dcc0 comp rx=0 tx=0).stop 2024-04-26T23:50:38.203 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:38.197+0000 7f7ec3797640 1 -- 172.21.15.88:0/3460239128 shutdown_connections 2024-04-26T23:50:38.203 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:38.198+0000 7f7ec3797640 1 --2- 172.21.15.88:0/3460239128 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f7ea006c8f0 0x7f7ea006edb0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:38.203 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:38.198+0000 7f7ec3797640 1 --2- 172.21.15.88:0/3460239128 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7ebc1541d0 0x7f7ebc0aa7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:38.203 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:38.198+0000 7f7ec3797640 1 --2- 172.21.15.88:0/3460239128 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7ebc15a3c0 0x7f7ebc1ecbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:38.203 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:38.198+0000 7f7ec3797640 1 --2- 172.21.15.88:0/3460239128 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7ebc070490 0x7f7ebc06fa70 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:38.203 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:38.198+0000 7f7ec3797640 1 -- 172.21.15.88:0/3460239128 >> 172.21.15.88:0/3460239128 conn(0x7f7ebc0c8c40 msgr2=0x7f7ebc0c7f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:50:38.203 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:38.198+0000 7f7ec3797640 1 -- 172.21.15.88:0/3460239128 shutdown_connections 2024-04-26T23:50:38.203 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:38.198+0000 7f7ec3797640 1 -- 172.21.15.88:0/3460239128 wait complete. 2024-04-26T23:50:38.217 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail b 2024-04-26T23:50:38.319 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:38.314+0000 7f2bc0207640 1 Processor -- start 2024-04-26T23:50:38.319 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:38.315+0000 7f2bc0207640 1 -- start start 2024-04-26T23:50:38.320 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:38.315+0000 7f2bc0207640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f2bb8154160 0x7f2bb8156bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:38.320 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:38.315+0000 7f2bc0207640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f2bb815a1a0 0x7f2bb80c9590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:38.320 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:38.315+0000 7f2bc0207640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2bb80c8df0 con 0x7f2bb80ca5a0 2024-04-26T23:50:38.320 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:38.315+0000 7f2bc0207640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7f2bb80c9100 con 0x7f2bb815a1a0 2024-04-26T23:50:38.320 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:38.315+0000 7f2bc0207640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f2bb8154540 con 0x7f2bb8154160 2024-04-26T23:50:38.321 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:38.315+0000 7f2bbe7a4640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f2bb815a1a0 0x7f2bb80c9590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:38.321 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:38.315+0000 7f2bbe7a4640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f2bb815a1a0 0x7f2bb80c9590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:60852/0 (socket says 172.21.15.88:60852) 2024-04-26T23:50:38.321 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:38.315+0000 7f2bbe7a4640 1 -- 172.21.15.88:0/1750929358 learned_addr learned my addr 172.21.15.88:0/1750929358 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:50:38.321 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:38.316+0000 7f2bbdfa3640 1 --2- 172.21.15.88:0/1750929358 >> v2:172.21.15.175:3300/0 conn(0x7f2bb8154160 0x7f2bb8156bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:38.321 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:38.316+0000 7f2bbe7a4640 1 -- 172.21.15.88:0/1750929358 >> v2:172.21.15.175:3300/0 conn(0x7f2bb8154160 msgr2=0x7f2bb8156bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:50:38.321 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:38.316+0000 7f2bbe7a4640 1 --2- 172.21.15.88:0/1750929358 >> v2:172.21.15.175:3300/0 conn(0x7f2bb8154160 0x7f2bb8156bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:38.321 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:38.316+0000 7f2bbe7a4640 1 -- 172.21.15.88:0/1750929358 >> v1:172.21.15.175:6789/0 conn(0x7f2bb80ca5a0 legacy=0x7f2bb80c6e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:38.321 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:38.316+0000 7f2bbe7a4640 1 -- 172.21.15.88:0/1750929358 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2bb815a910 con 0x7f2bb815a1a0 2024-04-26T23:50:38.322 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:38.316+0000 7f2bbe7a4640 1 --2- 172.21.15.88:0/1750929358 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2bb815a1a0 0x7f2bb80c9590 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f2bb80c9280 tx=0x7f2bb002a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5c50e08c12825c7 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:50:38.322 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:38.318+0000 7f2bbcfa1640 1 -- 172.21.15.88:0/1750929358 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bb0036070 con 0x7f2bb815a1a0 2024-04-26T23:50:38.322 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:38.318+0000 7f2bbcfa1640 1 -- 172.21.15.88:0/1750929358 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f2bb0031600 con 0x7f2bb815a1a0 2024-04-26T23:50:38.322 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:38.318+0000 7f2bbcfa1640 1 -- 172.21.15.88:0/1750929358 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bb00319f0 con 0x7f2bb815a1a0 2024-04-26T23:50:38.323 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:38.318+0000 7f2bc0207640 1 -- 172.21.15.88:0/1750929358 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2bb815a1a0 msgr2=0x7f2bb80c9590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:38.323 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:38.318+0000 7f2bc0207640 1 --2- 172.21.15.88:0/1750929358 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2bb815a1a0 0x7f2bb80c9590 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f2bb80c9280 tx=0x7f2bb002a730 comp rx=0 tx=0).stop 2024-04-26T23:50:38.323 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:38.318+0000 7f2bc0207640 1 -- 172.21.15.88:0/1750929358 shutdown_connections 2024-04-26T23:50:38.323 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:38.318+0000 7f2bc0207640 1 --2- 172.21.15.88:0/1750929358 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2bb815a1a0 0x7f2bb80c9590 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:38.323 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:38.318+0000 7f2bc0207640 1 --2- 172.21.15.88:0/1750929358 >> v2:172.21.15.175:3300/0 conn(0x7f2bb8154160 0x7f2bb8156bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:38.323 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:38.318+0000 7f2bc0207640 1 -- 172.21.15.88:0/1750929358 >> 172.21.15.88:0/1750929358 conn(0x7f2bb80ae010 msgr2=0x7f2bb80ae3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:50:38.323 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:38.318+0000 7f2bc0207640 1 -- 172.21.15.88:0/1750929358 shutdown_connections 2024-04-26T23:50:38.323 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:38.318+0000 7f2bc0207640 1 -- 172.21.15.88:0/1750929358 wait complete. 2024-04-26T23:50:38.324 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:38.319+0000 7f2bc0207640 1 Processor -- start 2024-04-26T23:50:38.324 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:38.320+0000 7f2bc0207640 1 -- start start 2024-04-26T23:50:38.326 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:38.320+0000 7f2bc0207640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2bb80ca5a0 0x7f2bb814bde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:38.326 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:38.321+0000 7f2bc0207640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2bb8154160 0x7f2bb81ecd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:38.327 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:38.321+0000 7f2bc0207640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2bb815a1a0 0x7f2bb81ed270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:38.327 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:38.321+0000 7f2bc0207640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f2bb815a5b0 con 0x7f2bb80ca5a0 2024-04-26T23:50:38.327 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:38.321+0000 7f2bc0207640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f2bb815aed0 con 0x7f2bb8154160 2024-04-26T23:50:38.327 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:38.321+0000 7f2bc0207640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f2bb80c7510 con 0x7f2bb815a1a0 2024-04-26T23:50:38.327 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:38.321+0000 7f2bbdfa3640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2bb80ca5a0 0x7f2bb814bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:38.327 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:38.321+0000 7f2bbdfa3640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2bb80ca5a0 0x7f2bb814bde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:60854/0 (socket says 172.21.15.88:60854) 2024-04-26T23:50:38.327 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:38.321+0000 7f2bbdfa3640 1 -- 172.21.15.88:0/769342138 learned_addr learned my addr 172.21.15.88:0/769342138 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:50:38.327 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:38.321+0000 7f2bbd7a2640 1 --2- 172.21.15.88:0/769342138 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2bb8154160 0x7f2bb81ecd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:38.327 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:38.321+0000 7f2bbe7a4640 1 --2- 172.21.15.88:0/769342138 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2bb815a1a0 0x7f2bb81ed270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:38.327 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:38.321+0000 7f2bbdfa3640 1 -- 172.21.15.88:0/769342138 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2bb815a1a0 msgr2=0x7f2bb81ed270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:38.327 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:38.321+0000 7f2bbdfa3640 1 --2- 172.21.15.88:0/769342138 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2bb815a1a0 0x7f2bb81ed270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:38.327 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:38.321+0000 7f2bbdfa3640 1 -- 172.21.15.88:0/769342138 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2bb8154160 msgr2=0x7f2bb81ecd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:38.327 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:38.321+0000 7f2bbdfa3640 1 --2- 172.21.15.88:0/769342138 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2bb8154160 0x7f2bb81ecd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:38.327 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:38.321+0000 7f2bbdfa3640 1 -- 172.21.15.88:0/769342138 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2bb8159ac0 con 0x7f2bb80ca5a0 2024-04-26T23:50:38.328 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:38.321+0000 7f2bbdfa3640 1 --2- 172.21.15.88:0/769342138 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2bb80ca5a0 0x7f2bb814bde0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f2bb400e9e0 tx=0x7f2bb400eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:50:38.328 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:38.321+0000 7f2bae7fc640 1 -- 172.21.15.88:0/769342138 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bb4017070 con 0x7f2bb80ca5a0 2024-04-26T23:50:38.328 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:38.321+0000 7f2bae7fc640 1 -- 172.21.15.88:0/769342138 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f2bb400c9d0 con 0x7f2bb80ca5a0 2024-04-26T23:50:38.328 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:38.321+0000 7f2bc0207640 1 -- 172.21.15.88:0/769342138 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2bb8159d30 con 0x7f2bb80ca5a0 2024-04-26T23:50:38.328 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:38.321+0000 7f2bae7fc640 1 -- 172.21.15.88:0/769342138 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bb400cde0 con 0x7f2bb80ca5a0 2024-04-26T23:50:38.328 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:38.321+0000 7f2bc0207640 1 -- 172.21.15.88:0/769342138 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2bb81f0720 con 0x7f2bb80ca5a0 2024-04-26T23:50:38.328 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:38.322+0000 7f2bc0207640 1 -- 172.21.15.88:0/769342138 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2bb8076650 con 0x7f2bb80ca5a0 2024-04-26T23:50:38.329 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:38.323+0000 7f2bae7fc640 1 -- 172.21.15.88:0/769342138 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2bb401a070 con 0x7f2bb80ca5a0 2024-04-26T23:50:38.329 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:38.323+0000 7f2bae7fc640 1 --2- 172.21.15.88:0/769342138 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f2b9c06c8f0 0x7f2b9c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:38.329 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:38.324+0000 7f2bbd7a2640 1 --2- 172.21.15.88:0/769342138 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f2b9c06c8f0 0x7f2b9c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:38.329 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:38.324+0000 7f2bae7fc640 1 -- 172.21.15.88:0/769342138 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5775+0+0 (secure 0 0 0) 0x7f2bb408bf70 con 0x7f2bb80ca5a0 2024-04-26T23:50:38.329 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:38.324+0000 7f2bbd7a2640 1 --2- 172.21.15.88:0/769342138 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f2b9c06c8f0 0x7f2b9c06edb0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f2bb8157c00 tx=0x7f2ba8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:50:38.332 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:38.328+0000 7f2bae7fc640 1 -- 172.21.15.88:0/769342138 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f2bb405a360 con 0x7f2bb80ca5a0 2024-04-26T23:50:38.550 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:38.545+0000 7f2bc0207640 1 -- 172.21.15.88:0/769342138 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "b"} v 0) -- 0x7f2bb80c2fe0 con 0x7f2bb80ca5a0 2024-04-26T23:50:38.552 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:38.547+0000 7f2bae7fc640 1 -- 172.21.15.88:0/769342138 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "b"}]=0 b marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v15) ==== 151+0+0 (secure 0 0 0) 0x7f2bb4059c60 con 0x7f2bb80ca5a0 2024-04-26T23:50:38.552 INFO:teuthology.orchestra.run.smithi088.stderr:b marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-26T23:50:38.555 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:38.549+0000 7f2bc0207640 1 -- 172.21.15.88:0/769342138 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f2b9c06c8f0 msgr2=0x7f2b9c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:38.555 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:38.549+0000 7f2bc0207640 1 --2- 172.21.15.88:0/769342138 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f2b9c06c8f0 0x7f2b9c06edb0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f2bb8157c00 tx=0x7f2ba8009040 comp rx=0 tx=0).stop 2024-04-26T23:50:38.555 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:38.550+0000 7f2bc0207640 1 -- 172.21.15.88:0/769342138 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2bb80ca5a0 msgr2=0x7f2bb814bde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:38.555 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:38.550+0000 7f2bc0207640 1 --2- 172.21.15.88:0/769342138 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2bb80ca5a0 0x7f2bb814bde0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f2bb400e9e0 tx=0x7f2bb400eea0 comp rx=0 tx=0).stop 2024-04-26T23:50:38.555 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:38.550+0000 7f2bc0207640 1 -- 172.21.15.88:0/769342138 shutdown_connections 2024-04-26T23:50:38.555 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:38.550+0000 7f2bc0207640 1 --2- 172.21.15.88:0/769342138 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f2b9c06c8f0 0x7f2b9c06edb0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:38.555 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:38.550+0000 7f2bc0207640 1 --2- 172.21.15.88:0/769342138 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2bb815a1a0 0x7f2bb81ed270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:38.555 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:38.550+0000 7f2bc0207640 1 --2- 172.21.15.88:0/769342138 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2bb8154160 0x7f2bb81ecd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:38.555 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:38.550+0000 7f2bc0207640 1 --2- 172.21.15.88:0/769342138 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2bb80ca5a0 0x7f2bb814bde0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:38.555 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:38.550+0000 7f2bc0207640 1 -- 172.21.15.88:0/769342138 >> 172.21.15.88:0/769342138 conn(0x7f2bb80ae010 msgr2=0x7f2bb814f250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:50:38.555 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:38.550+0000 7f2bc0207640 1 -- 172.21.15.88:0/769342138 shutdown_connections 2024-04-26T23:50:38.555 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:38.550+0000 7f2bc0207640 1 -- 172.21.15.88:0/769342138 wait complete. 2024-04-26T23:50:38.567 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm b --yes-i-really-mean-it 2024-04-26T23:50:38.602 INFO:tasks.ceph.mds.c.smithi088.stdout:starting mds.c at 2024-04-26T23:50:38.666 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:38.663+0000 7f921c607640 1 Processor -- start 2024-04-26T23:50:38.666 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:38.663+0000 7f921c607640 1 -- start start 2024-04-26T23:50:38.670 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:38.664+0000 7f921c607640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f92140c63d0 0x7f9214155420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:38.671 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:38.664+0000 7f921c607640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f92140acdc0 0x7f92140c97c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:38.671 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:38.664+0000 7f921c607640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f92140737a0 con 0x7f92140c9d00 2024-04-26T23:50:38.671 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:38.664+0000 7f921c607640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f9214073a40 con 0x7f92140acdc0 2024-04-26T23:50:38.671 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:38.664+0000 7f921c607640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f9214073d20 con 0x7f92140c63d0 2024-04-26T23:50:38.671 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:38.664+0000 7f921aba4640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f92140c9d00 0x7f92140ab620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:58816/0 (socket says 172.21.15.88:58816) 2024-04-26T23:50:38.671 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:38.664+0000 7f921aba4640 1 -- 172.21.15.88:0/3358162989 learned_addr learned my addr 172.21.15.88:0/3358162989 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-26T23:50:38.671 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:38.664+0000 7f92193a1640 1 -- 172.21.15.88:0/3358162989 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1965751254 0 0) 0x7f92140737a0 con 0x7f92140c9d00 2024-04-26T23:50:38.671 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:38.664+0000 7f92193a1640 1 -- 172.21.15.88:0/3358162989 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9200003520 con 0x7f92140c9d00 2024-04-26T23:50:38.671 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:38.664+0000 7f9219ba2640 1 --2- 172.21.15.88:0/3358162989 >> v2:172.21.15.175:3300/0 conn(0x7f92140acdc0 0x7f92140c97c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:38.671 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:38.664+0000 7f921a3a3640 1 --2- 172.21.15.88:0/3358162989 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f92140c63d0 0x7f9214155420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:38.671 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:38.664+0000 7f92193a1640 1 -- 172.21.15.88:0/3358162989 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4050466140 0 0) 0x7f9200003520 con 0x7f92140c9d00 2024-04-26T23:50:38.671 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:38.664+0000 7f92193a1640 1 -- 172.21.15.88:0/3358162989 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f92140c63d0 msgr2=0x7f9214155420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:50:38.671 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:38.664+0000 7f92193a1640 1 --2- 172.21.15.88:0/3358162989 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f92140c63d0 0x7f9214155420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:38.671 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:38.664+0000 7f92193a1640 1 -- 172.21.15.88:0/3358162989 >> v2:172.21.15.175:3300/0 conn(0x7f92140acdc0 msgr2=0x7f92140c97c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:50:38.672 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:38.664+0000 7f92193a1640 1 --2- 172.21.15.88:0/3358162989 >> v2:172.21.15.175:3300/0 conn(0x7f92140acdc0 0x7f92140c97c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:38.672 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:38.664+0000 7f92193a1640 1 -- 172.21.15.88:0/3358162989 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9214074000 con 0x7f92140c9d00 2024-04-26T23:50:38.672 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:38.664+0000 7f92193a1640 1 -- 172.21.15.88:0/3358162989 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 356324787 0 0) 0x7f920c001670 con 0x7f92140c9d00 2024-04-26T23:50:38.672 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:38.664+0000 7f92193a1640 1 -- 172.21.15.88:0/3358162989 >> v1:172.21.15.88:6789/0 conn(0x7f92140c9d00 legacy=0x7f92140ab620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:38.672 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:38.664+0000 7f92193a1640 1 --2- 172.21.15.88:0/3358162989 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f92000039b0 0x7f9200003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:38.672 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:38.664+0000 7f92193a1640 1 --2- 172.21.15.88:0/3358162989 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9200004800 0x7f9200004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:38.672 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:38.664+0000 7f92193a1640 1 --2- 172.21.15.88:0/3358162989 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f92140c63d0 0x7f92000051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:38.672 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:38.664+0000 7f92193a1640 1 -- 172.21.15.88:0/3358162989 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f9214073a40 con 0x7f9200004800 2024-04-26T23:50:38.672 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:38.664+0000 7f92193a1640 1 -- 172.21.15.88:0/3358162989 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f9214073d20 con 0x7f92000039b0 2024-04-26T23:50:38.672 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:38.664+0000 7f92193a1640 1 -- 172.21.15.88:0/3358162989 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f920000ba70 con 0x7f92140c63d0 2024-04-26T23:50:38.672 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:38.665+0000 7f9219ba2640 1 --2- 172.21.15.88:0/3358162989 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9200004800 0x7f9200004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:38.672 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:38.665+0000 7f921a3a3640 1 --2- 172.21.15.88:0/3358162989 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f92000039b0 0x7f9200003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:38.672 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:38.665+0000 7f921aba4640 1 --2- 172.21.15.88:0/3358162989 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f92140c63d0 0x7f92000051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:38.672 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:38.665+0000 7f9219ba2640 1 -- 172.21.15.88:0/3358162989 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f92140c63d0 msgr2=0x7f92000051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:50:38.672 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:38.665+0000 7f9219ba2640 1 --2- 172.21.15.88:0/3358162989 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f92140c63d0 0x7f92000051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:38.673 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:38.665+0000 7f9219ba2640 1 -- 172.21.15.88:0/3358162989 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f92000039b0 msgr2=0x7f9200003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:50:38.673 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:38.665+0000 7f9219ba2640 1 --2- 172.21.15.88:0/3358162989 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f92000039b0 0x7f9200003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:38.673 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:38.665+0000 7f9219ba2640 1 -- 172.21.15.88:0/3358162989 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9200003520 con 0x7f9200004800 2024-04-26T23:50:38.673 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:38.666+0000 7f9219ba2640 1 --2- 172.21.15.88:0/3358162989 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9200004800 0x7f9200004c80 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f920400ba00 tx=0x7f9200005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c9d875341c9ec2d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:50:38.673 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:38.666+0000 7f92193a1640 1 -- 172.21.15.88:0/3358162989 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9204030070 con 0x7f9200004800 2024-04-26T23:50:38.673 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:38.666+0000 7f92193a1640 1 -- 172.21.15.88:0/3358162989 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f920402adb0 con 0x7f9200004800 2024-04-26T23:50:38.673 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:38.666+0000 7f92193a1640 1 -- 172.21.15.88:0/3358162989 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f920400b600 con 0x7f9200004800 2024-04-26T23:50:38.673 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:38.666+0000 7f921c607640 1 -- 172.21.15.88:0/3358162989 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9200004800 msgr2=0x7f9200004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:38.673 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:38.666+0000 7f921c607640 1 --2- 172.21.15.88:0/3358162989 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9200004800 0x7f9200004c80 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f920400ba00 tx=0x7f9200005830 comp rx=0 tx=0).stop 2024-04-26T23:50:38.673 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:38.666+0000 7f921aba4640 1 -- 172.21.15.88:0/3358162989 reap_dead start 2024-04-26T23:50:38.673 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:38.666+0000 7f921c607640 1 -- 172.21.15.88:0/3358162989 shutdown_connections 2024-04-26T23:50:38.673 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:38.666+0000 7f921c607640 1 -- 172.21.15.88:0/3358162989 >> 172.21.15.88:0/3358162989 conn(0x7f92140c6e60 msgr2=0x7f92140c7270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:50:38.673 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:38.666+0000 7f921c607640 1 -- 172.21.15.88:0/3358162989 shutdown_connections 2024-04-26T23:50:38.673 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:38.666+0000 7f921c607640 1 -- 172.21.15.88:0/3358162989 wait complete. 2024-04-26T23:50:38.674 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:38.667+0000 7f921c607640 1 Processor -- start 2024-04-26T23:50:38.674 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:38.667+0000 7f921c607640 1 -- start start 2024-04-26T23:50:38.676 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:38.668+0000 7f921c607640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9200004800 0x7f9214157770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:38.676 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:38.668+0000 7f921c607640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9214151e20 0x7f92140ae800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:38.676 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:38.668+0000 7f921c607640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9214147500 0x7f92141479b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:38.676 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:38.668+0000 7f921c607640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f92140c67b0 con 0x7f9214151e20 2024-04-26T23:50:38.676 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:38.668+0000 7f921c607640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f9214074d60 con 0x7f9200004800 2024-04-26T23:50:38.676 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:38.668+0000 7f921c607640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f92140c6930 con 0x7f9214147500 2024-04-26T23:50:38.677 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:38.668+0000 7f9219ba2640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9214151e20 0x7f92140ae800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:38.677 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:38.668+0000 7f9219ba2640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9214151e20 0x7f92140ae800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:39330/0 (socket says 172.21.15.88:39330) 2024-04-26T23:50:38.677 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:38.668+0000 7f9219ba2640 1 -- 172.21.15.88:0/567707783 learned_addr learned my addr 172.21.15.88:0/567707783 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:50:38.677 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:38.668+0000 7f9219ba2640 1 -- 172.21.15.88:0/567707783 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9214147500 msgr2=0x7f92141479b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:38.677 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:38.668+0000 7f9219ba2640 1 --2- 172.21.15.88:0/567707783 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9214147500 0x7f92141479b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:38.677 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:38.668+0000 7f9219ba2640 1 -- 172.21.15.88:0/567707783 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9200004800 msgr2=0x7f9214157770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:38.677 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:38.668+0000 7f921a3a3640 1 --2- 172.21.15.88:0/567707783 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9200004800 0x7f9214157770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:38.677 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:38.668+0000 7f9219ba2640 1 --2- 172.21.15.88:0/567707783 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9200004800 0x7f9214157770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:38.677 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:38.668+0000 7f9219ba2640 1 -- 172.21.15.88:0/567707783 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9214157d50 con 0x7f9214151e20 2024-04-26T23:50:38.677 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:38.669+0000 7f9219ba2640 1 --2- 172.21.15.88:0/567707783 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9214151e20 0x7f92140ae800 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f920400bb20 tx=0x7f9204004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:50:38.677 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:38.669+0000 7f920affd640 1 -- 172.21.15.88:0/567707783 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9204043020 con 0x7f9214151e20 2024-04-26T23:50:38.677 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:38.669+0000 7f920affd640 1 -- 172.21.15.88:0/567707783 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f9204035eb0 con 0x7f9214151e20 2024-04-26T23:50:38.677 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:38.669+0000 7f921c607640 1 -- 172.21.15.88:0/567707783 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9214158250 con 0x7f9214151e20 2024-04-26T23:50:38.678 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:38.669+0000 7f920affd640 1 -- 172.21.15.88:0/567707783 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f920403f8c0 con 0x7f9214151e20 2024-04-26T23:50:38.678 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:38.669+0000 7f921c607640 1 -- 172.21.15.88:0/567707783 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9214158810 con 0x7f9214151e20 2024-04-26T23:50:38.678 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:38.670+0000 7f921c607640 1 -- 172.21.15.88:0/567707783 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f92140507a0 con 0x7f9214151e20 2024-04-26T23:50:38.678 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:38.670+0000 7f920affd640 1 -- 172.21.15.88:0/567707783 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f9204046020 con 0x7f9214151e20 2024-04-26T23:50:38.678 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:38.670+0000 7f920affd640 1 --2- 172.21.15.88:0/567707783 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f91f806c8f0 0x7f91f806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:38.678 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:38.671+0000 7f920affd640 1 -- 172.21.15.88:0/567707783 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5861+0+0 (secure 0 0 0) 0x7f92040ac830 con 0x7f9214151e20 2024-04-26T23:50:38.678 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:38.671+0000 7f921a3a3640 1 --2- 172.21.15.88:0/567707783 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f91f806c8f0 0x7f91f806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:38.678 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:38.671+0000 7f921a3a3640 1 --2- 172.21.15.88:0/567707783 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f91f806c8f0 0x7f91f806edb0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f92141ee8f0 tx=0x7f9210009760 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:50:38.678 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:38.675+0000 7f920affd640 1 -- 172.21.15.88:0/567707783 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f920404d030 con 0x7f9214151e20 2024-04-26T23:50:38.890 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:38.887+0000 7f921c607640 1 -- 172.21.15.88:0/567707783 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "b", "yes_i_really_mean_it": true} v 0) -- 0x7f92140af910 con 0x7f9214151e20 2024-04-26T23:50:39.553 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:39.550+0000 7f920affd640 1 -- 172.21.15.88:0/567707783 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "b", "yes_i_really_mean_it": true}]=0 v16) ==== 99+0+0 (secure 0 0 0) 0x7f920407abc0 con 0x7f9214151e20 2024-04-26T23:50:39.556 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:39.553+0000 7f921c607640 1 -- 172.21.15.88:0/567707783 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f91f806c8f0 msgr2=0x7f91f806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:39.556 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:39.553+0000 7f921c607640 1 --2- 172.21.15.88:0/567707783 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f91f806c8f0 0x7f91f806edb0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f92141ee8f0 tx=0x7f9210009760 comp rx=0 tx=0).stop 2024-04-26T23:50:39.556 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:39.553+0000 7f921c607640 1 -- 172.21.15.88:0/567707783 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9214151e20 msgr2=0x7f92140ae800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:39.556 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:39.553+0000 7f921c607640 1 --2- 172.21.15.88:0/567707783 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9214151e20 0x7f92140ae800 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f920400bb20 tx=0x7f9204004730 comp rx=0 tx=0).stop 2024-04-26T23:50:39.557 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:39.553+0000 7f921c607640 1 -- 172.21.15.88:0/567707783 shutdown_connections 2024-04-26T23:50:39.557 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:39.553+0000 7f921c607640 1 --2- 172.21.15.88:0/567707783 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f91f806c8f0 0x7f91f806edb0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:39.557 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:39.553+0000 7f921c607640 1 --2- 172.21.15.88:0/567707783 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9214147500 0x7f92141479b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:39.557 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:39.553+0000 7f921c607640 1 --2- 172.21.15.88:0/567707783 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9214151e20 0x7f92140ae800 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:39.557 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:39.553+0000 7f921c607640 1 --2- 172.21.15.88:0/567707783 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9200004800 0x7f9214157770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:39.558 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:39.553+0000 7f921c607640 1 -- 172.21.15.88:0/567707783 >> 172.21.15.88:0/567707783 conn(0x7f92140c6e60 msgr2=0x7f92140680c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:50:39.558 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:39.553+0000 7f921c607640 1 -- 172.21.15.88:0/567707783 shutdown_connections 2024-04-26T23:50:39.558 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:39.553+0000 7f921c607640 1 -- 172.21.15.88:0/567707783 wait complete. 2024-04-26T23:50:39.571 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm b_metadata b_metadata --yes-i-really-really-mean-it 2024-04-26T23:50:39.724 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:39.720+0000 7f58a4daf640 1 Processor -- start 2024-04-26T23:50:39.724 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:39.720+0000 7f58a4daf640 1 -- start start 2024-04-26T23:50:39.731 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:39.721+0000 7f58a4daf640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f58a00ad690 0x7f58a00735c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:39.732 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:39.721+0000 7f58a4daf640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f58a00adb70 con 0x7f58a006e720 2024-04-26T23:50:39.732 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:39.721+0000 7f58a4daf640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f58a00ade50 con 0x7f58a014ea10 2024-04-26T23:50:39.732 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:39.721+0000 7f58a4daf640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f58a0154de0 con 0x7f58a00ad690 2024-04-26T23:50:39.732 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:39.721+0000 7f589ed9d640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f58a006e720 0x7f58a006ec30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:58826/0 (socket says 172.21.15.88:58826) 2024-04-26T23:50:39.732 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:39.721+0000 7f589ed9d640 1 -- 172.21.15.88:0/2779928183 learned_addr learned my addr 172.21.15.88:0/2779928183 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-26T23:50:39.732 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:39.721+0000 7f589dd9b640 1 --2- 172.21.15.88:0/2779928183 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f58a00ad690 0x7f58a00735c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:39.732 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:39.721+0000 7f589d59a640 1 -- 172.21.15.88:0/2779928183 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2458422972 0 0) 0x7f58a00adb70 con 0x7f58a006e720 2024-04-26T23:50:39.732 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:39.721+0000 7f589d59a640 1 -- 172.21.15.88:0/2779928183 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5888003520 con 0x7f58a006e720 2024-04-26T23:50:39.732 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:39.722+0000 7f589d59a640 1 -- 172.21.15.88:0/2779928183 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3734989165 0 0) 0x7f58a00ade50 con 0x7f58a014ea10 2024-04-26T23:50:39.732 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:39.722+0000 7f589d59a640 1 -- 172.21.15.88:0/2779928183 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f58a00adb70 con 0x7f58a014ea10 2024-04-26T23:50:39.732 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:39.722+0000 7f589d59a640 1 -- 172.21.15.88:0/2779928183 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1216343481 0 0) 0x7f5888003520 con 0x7f58a006e720 2024-04-26T23:50:39.732 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:39.722+0000 7f589d59a640 1 -- 172.21.15.88:0/2779928183 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f58a00ad690 msgr2=0x7f58a00735c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:50:39.733 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:39.722+0000 7f589d59a640 1 --2- 172.21.15.88:0/2779928183 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f58a00ad690 0x7f58a00735c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:39.733 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:39.722+0000 7f589d59a640 1 -- 172.21.15.88:0/2779928183 >> v1:172.21.15.175:6789/0 conn(0x7f58a014ea10 legacy=0x7f58a0155270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:39.733 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:39.722+0000 7f589d59a640 1 -- 172.21.15.88:0/2779928183 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58a0154a70 con 0x7f58a006e720 2024-04-26T23:50:39.733 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:39.722+0000 7f589d59a640 1 -- 172.21.15.88:0/2779928183 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 356324787 0 0) 0x7f5898001670 con 0x7f58a006e720 2024-04-26T23:50:39.733 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:39.722+0000 7f589d59a640 1 -- 172.21.15.88:0/2779928183 >> v1:172.21.15.88:6789/0 conn(0x7f58a006e720 legacy=0x7f58a006ec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:39.733 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:39.722+0000 7f589d59a640 1 --2- 172.21.15.88:0/2779928183 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f58a00ad690 0x7f5888003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:39.733 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:39.722+0000 7f589d59a640 1 --2- 172.21.15.88:0/2779928183 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f58880040d0 0x7f5888004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:39.733 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:39.722+0000 7f589d59a640 1 --2- 172.21.15.88:0/2779928183 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5888004d40 0x7f58880051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:39.733 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:39.722+0000 7f589d59a640 1 -- 172.21.15.88:0/2779928183 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f58a0154de0 con 0x7f58880040d0 2024-04-26T23:50:39.733 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:39.722+0000 7f589d59a640 1 -- 172.21.15.88:0/2779928183 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f588800baa0 con 0x7f5888004d40 2024-04-26T23:50:39.733 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:39.722+0000 7f589d59a640 1 -- 172.21.15.88:0/2779928183 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f588800bca0 con 0x7f58a00ad690 2024-04-26T23:50:39.733 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:39.722+0000 7f589dd9b640 1 --2- 172.21.15.88:0/2779928183 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f58880040d0 0x7f5888004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:39.733 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:39.722+0000 7f589ed9d640 1 --2- 172.21.15.88:0/2779928183 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5888004d40 0x7f58880051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:39.734 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:39.722+0000 7f589e59c640 1 --2- 172.21.15.88:0/2779928183 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f58a00ad690 0x7f5888003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:39.734 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:39.722+0000 7f589dd9b640 1 -- 172.21.15.88:0/2779928183 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f58a00ad690 msgr2=0x7f5888003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:50:39.734 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:39.722+0000 7f589dd9b640 1 --2- 172.21.15.88:0/2779928183 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f58a00ad690 0x7f5888003b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:39.734 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:39.722+0000 7f589dd9b640 1 -- 172.21.15.88:0/2779928183 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5888004d40 msgr2=0x7f58880051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:50:39.734 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:39.722+0000 7f589dd9b640 1 --2- 172.21.15.88:0/2779928183 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5888004d40 0x7f58880051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:39.734 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:39.722+0000 7f589dd9b640 1 -- 172.21.15.88:0/2779928183 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5888003520 con 0x7f58880040d0 2024-04-26T23:50:39.734 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:39.723+0000 7f589dd9b640 1 --2- 172.21.15.88:0/2779928183 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f58880040d0 0x7f5888004800 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f5894009ac0 tx=0x7f5888005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29856141c1534f52 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:50:39.734 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:39.723+0000 7f589d59a640 1 -- 172.21.15.88:0/2779928183 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5894036070 con 0x7f58880040d0 2024-04-26T23:50:39.734 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:39.723+0000 7f589d59a640 1 -- 172.21.15.88:0/2779928183 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f5894031400 con 0x7f58880040d0 2024-04-26T23:50:39.734 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:39.723+0000 7f589d59a640 1 -- 172.21.15.88:0/2779928183 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5894009690 con 0x7f58880040d0 2024-04-26T23:50:39.734 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:39.724+0000 7f58a4daf640 1 -- 172.21.15.88:0/2779928183 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f58880040d0 msgr2=0x7f5888004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:39.734 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:39.724+0000 7f58a4daf640 1 --2- 172.21.15.88:0/2779928183 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f58880040d0 0x7f5888004800 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f5894009ac0 tx=0x7f5888005830 comp rx=0 tx=0).stop 2024-04-26T23:50:39.734 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:39.724+0000 7f589ed9d640 1 -- 172.21.15.88:0/2779928183 reap_dead start 2024-04-26T23:50:39.735 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:39.724+0000 7f58a4daf640 1 -- 172.21.15.88:0/2779928183 shutdown_connections 2024-04-26T23:50:39.735 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:39.724+0000 7f58a4daf640 1 -- 172.21.15.88:0/2779928183 >> 172.21.15.88:0/2779928183 conn(0x7f58a006c310 msgr2=0x7f58a006c720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:50:39.735 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:39.724+0000 7f58a4daf640 1 -- 172.21.15.88:0/2779928183 shutdown_connections 2024-04-26T23:50:39.735 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:39.724+0000 7f58a4daf640 1 -- 172.21.15.88:0/2779928183 wait complete. 2024-04-26T23:50:39.735 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:39.725+0000 7f58a4daf640 1 Processor -- start 2024-04-26T23:50:39.735 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:39.725+0000 7f58a4daf640 1 -- start start 2024-04-26T23:50:39.735 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:39.726+0000 7f58a4daf640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f58880040d0 0x7f58a01ed9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:39.735 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:39.726+0000 7f58a4daf640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f58a01edf20 0x7f58a0152bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:39.735 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:39.726+0000 7f58a4daf640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f58a0147700 0x7f58a0153130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:39.735 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:39.726+0000 7f58a4daf640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7f58a006d510 con 0x7f58880040d0 2024-04-26T23:50:39.735 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:39.726+0000 7f58a4daf640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f58a006d390 con 0x7f58a01edf20 2024-04-26T23:50:39.735 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:39.726+0000 7f58a4daf640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f58a00735c0 con 0x7f58a0147700 2024-04-26T23:50:39.735 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:39.726+0000 7f589e59c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f58880040d0 0x7f58a01ed9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:39.735 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:39.726+0000 7f589e59c640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f58880040d0 0x7f58a01ed9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:39348/0 (socket says 172.21.15.88:39348) 2024-04-26T23:50:39.736 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:39.726+0000 7f589e59c640 1 -- 172.21.15.88:0/2325960480 learned_addr learned my addr 172.21.15.88:0/2325960480 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:50:39.736 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:39.726+0000 7f589dd9b640 1 --2- 172.21.15.88:0/2325960480 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f58a01edf20 0x7f58a0152bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:39.736 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:39.726+0000 7f589ed9d640 1 --2- 172.21.15.88:0/2325960480 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f58a0147700 0x7f58a0153130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:39.736 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:39.726+0000 7f589e59c640 1 -- 172.21.15.88:0/2325960480 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f58a0147700 msgr2=0x7f58a0153130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:39.736 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:39.726+0000 7f589e59c640 1 --2- 172.21.15.88:0/2325960480 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f58a0147700 0x7f58a0153130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:39.736 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:39.726+0000 7f589e59c640 1 -- 172.21.15.88:0/2325960480 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f58a01edf20 msgr2=0x7f58a0152bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:39.736 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:39.726+0000 7f589e59c640 1 --2- 172.21.15.88:0/2325960480 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f58a01edf20 0x7f58a0152bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:39.736 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:39.726+0000 7f589e59c640 1 -- 172.21.15.88:0/2325960480 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58a0154800 con 0x7f58880040d0 2024-04-26T23:50:39.736 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:39.726+0000 7f589e59c640 1 --2- 172.21.15.88:0/2325960480 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f58880040d0 0x7f58a01ed9e0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f589000fb40 tx=0x7f58900021e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:50:39.736 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:39.726+0000 7f588effd640 1 -- 172.21.15.88:0/2325960480 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5890003b80 con 0x7f58880040d0 2024-04-26T23:50:39.736 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:39.726+0000 7f588effd640 1 -- 172.21.15.88:0/2325960480 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f5890018070 con 0x7f58880040d0 2024-04-26T23:50:39.736 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:39.726+0000 7f58a4daf640 1 -- 172.21.15.88:0/2325960480 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58a0147370 con 0x7f58880040d0 2024-04-26T23:50:39.736 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:39.726+0000 7f588effd640 1 -- 172.21.15.88:0/2325960480 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f589000d910 con 0x7f58880040d0 2024-04-26T23:50:39.736 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:39.726+0000 7f58a4daf640 1 -- 172.21.15.88:0/2325960480 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58a014f3f0 con 0x7f58880040d0 2024-04-26T23:50:39.737 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:39.728+0000 7f58a4daf640 1 -- 172.21.15.88:0/2325960480 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f58a01ee610 con 0x7f58880040d0 2024-04-26T23:50:39.737 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:39.728+0000 7f588effd640 1 -- 172.21.15.88:0/2325960480 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f589000dab0 con 0x7f58880040d0 2024-04-26T23:50:39.737 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:39.728+0000 7f588effd640 1 --2- 172.21.15.88:0/2325960480 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f588006c8f0 0x7f588006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:39.737 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:39.729+0000 7f589dd9b640 1 --2- 172.21.15.88:0/2325960480 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f588006c8f0 0x7f588006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:39.738 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:39.729+0000 7f588effd640 1 -- 172.21.15.88:0/2325960480 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5861+0+0 (secure 0 0 0) 0x7f589008bf40 con 0x7f58880040d0 2024-04-26T23:50:39.738 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:39.729+0000 7f589dd9b640 1 --2- 172.21.15.88:0/2325960480 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f588006c8f0 0x7f588006edb0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f5894033000 tx=0x7f5894008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:50:39.738 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:39.734+0000 7f588effd640 1 -- 172.21.15.88:0/2325960480 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f589005a2d0 con 0x7f58880040d0 2024-04-26T23:50:39.915 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:39.912+0000 7f58a4daf640 1 -- 172.21.15.88:0/2325960480 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "b_metadata", "pool2": "b_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f58a00694b0 con 0x7f58880040d0 2024-04-26T23:50:40.558 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:40.555+0000 7f588effd640 1 -- 172.21.15.88:0/2325960480 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "b_metadata", "pool2": "b_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'b_metadata' removed v31) ==== 166+0+0 (secure 0 0 0) 0x7f5890059bd0 con 0x7f58880040d0 2024-04-26T23:50:40.558 INFO:teuthology.orchestra.run.smithi088.stderr:pool 'b_metadata' removed 2024-04-26T23:50:40.563 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:40.558+0000 7f58a4daf640 1 -- 172.21.15.88:0/2325960480 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f588006c8f0 msgr2=0x7f588006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:40.563 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:40.558+0000 7f58a4daf640 1 --2- 172.21.15.88:0/2325960480 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f588006c8f0 0x7f588006edb0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f5894033000 tx=0x7f5894008030 comp rx=0 tx=0).stop 2024-04-26T23:50:40.563 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:40.558+0000 7f58a4daf640 1 -- 172.21.15.88:0/2325960480 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f58880040d0 msgr2=0x7f58a01ed9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:40.563 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:40.558+0000 7f58a4daf640 1 --2- 172.21.15.88:0/2325960480 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f58880040d0 0x7f58a01ed9e0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f589000fb40 tx=0x7f58900021e0 comp rx=0 tx=0).stop 2024-04-26T23:50:40.563 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:40.559+0000 7f58a4daf640 1 -- 172.21.15.88:0/2325960480 shutdown_connections 2024-04-26T23:50:40.563 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:40.559+0000 7f58a4daf640 1 --2- 172.21.15.88:0/2325960480 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7f588006c8f0 0x7f588006edb0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:40.563 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:40.559+0000 7f58a4daf640 1 --2- 172.21.15.88:0/2325960480 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f58a0147700 0x7f58a0153130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:40.563 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:40.559+0000 7f58a4daf640 1 --2- 172.21.15.88:0/2325960480 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f58a01edf20 0x7f58a0152bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:40.563 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:40.559+0000 7f58a4daf640 1 --2- 172.21.15.88:0/2325960480 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f58880040d0 0x7f58a01ed9e0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:40.563 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:40.559+0000 7f58a4daf640 1 -- 172.21.15.88:0/2325960480 >> 172.21.15.88:0/2325960480 conn(0x7f58a006c310 msgr2=0x7f58a00c3a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:50:40.564 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:40.559+0000 7f58a4daf640 1 -- 172.21.15.88:0/2325960480 shutdown_connections 2024-04-26T23:50:40.564 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:40.559+0000 7f58a4daf640 1 -- 172.21.15.88:0/2325960480 wait complete. 2024-04-26T23:50:40.581 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm b_data b_data --yes-i-really-really-mean-it 2024-04-26T23:50:40.685 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:40.681+0000 7fbd26adc640 1 Processor -- start 2024-04-26T23:50:40.685 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:40.681+0000 7fbd26adc640 1 -- start start 2024-04-26T23:50:40.686 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:40.682+0000 7fbd26adc640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fbd200a8190 0x7fbd200c67f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:40.686 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:40.682+0000 7fbd26adc640 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbd2015af60 con 0x7fbd20154180 2024-04-26T23:50:40.686 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:40.682+0000 7fbd26adc640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbd2015ac80 con 0x7fbd200705a0 2024-04-26T23:50:40.686 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:40.682+0000 7fbd26adc640 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 -- 0x7fbd2015aa30 con 0x7fbd200a8190 2024-04-26T23:50:40.686 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:40.682+0000 7fbd1ffff640 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fbd200a8190 0x7fbd200c67f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:40.686 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:40.682+0000 7fbd24878640 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fbd20154180 0x7fbd201573d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:58832/0 (socket says 172.21.15.88:58832) 2024-04-26T23:50:40.686 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:40.682+0000 7fbd24878640 1 -- 172.21.15.88:0/391531244 learned_addr learned my addr 172.21.15.88:0/391531244 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-04-26T23:50:40.686 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:40.682+0000 7fbd1ffff640 1 -- 172.21.15.88:0/391531244 >> v1:172.21.15.175:6789/0 conn(0x7fbd200705a0 legacy=0x7fbd200c1d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:50:40.686 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:40.682+0000 7fbd1ffff640 1 -- 172.21.15.88:0/391531244 >> v1:172.21.15.88:6789/0 conn(0x7fbd20154180 legacy=0x7fbd201573d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:40.687 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:40.682+0000 7fbd1ffff640 1 -- 172.21.15.88:0/391531244 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd20156bd0 con 0x7fbd200a8190 2024-04-26T23:50:40.687 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:40.682+0000 7fbd1f7fe640 1 -- 172.21.15.88:0/391531244 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1095446247 0 0) 0x7fbd2015af60 con 0x7fbd20154180 2024-04-26T23:50:40.688 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:40.683+0000 7fbd1ffff640 1 --2- 172.21.15.88:0/391531244 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbd200a8190 0x7fbd200c67f0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fbd140097a0 tx=0x7fbd1402a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f73e072b359d24d2 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:50:40.688 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:40.683+0000 7fbd1f7fe640 1 -- 172.21.15.88:0/391531244 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd14037070 con 0x7fbd200a8190 2024-04-26T23:50:40.688 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:40.683+0000 7fbd1f7fe640 1 -- 172.21.15.88:0/391531244 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fbd1402ae50 con 0x7fbd200a8190 2024-04-26T23:50:40.688 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:40.683+0000 7fbd1f7fe640 1 -- 172.21.15.88:0/391531244 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd14032680 con 0x7fbd200a8190 2024-04-26T23:50:40.688 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:40.684+0000 7fbd26adc640 1 -- 172.21.15.88:0/391531244 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbd200a8190 msgr2=0x7fbd200c67f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:40.689 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:40.684+0000 7fbd26adc640 1 --2- 172.21.15.88:0/391531244 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbd200a8190 0x7fbd200c67f0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fbd140097a0 tx=0x7fbd1402a140 comp rx=0 tx=0).stop 2024-04-26T23:50:40.689 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:40.684+0000 7fbd26adc640 1 -- 172.21.15.88:0/391531244 shutdown_connections 2024-04-26T23:50:40.689 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:40.684+0000 7fbd26adc640 1 --2- 172.21.15.88:0/391531244 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbd200a8190 0x7fbd200c67f0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:40.689 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:40.684+0000 7fbd26adc640 1 -- 172.21.15.88:0/391531244 >> 172.21.15.88:0/391531244 conn(0x7fbd200aa6a0 msgr2=0x7fbd200aaab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:50:40.689 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:40.684+0000 7fbd26adc640 1 -- 172.21.15.88:0/391531244 shutdown_connections 2024-04-26T23:50:40.689 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:40.684+0000 7fbd26adc640 1 -- 172.21.15.88:0/391531244 wait complete. 2024-04-26T23:50:40.689 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:40.685+0000 7fbd26adc640 1 Processor -- start 2024-04-26T23:50:40.689 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:40.685+0000 7fbd26adc640 1 -- start start 2024-04-26T23:50:40.692 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:40.686+0000 7fbd26adc640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbd200705a0 0x7fbd20152c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:40.692 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:40.686+0000 7fbd26adc640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbd200a8190 0x7fbd200acc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:40.692 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:40.686+0000 7fbd26adc640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbd20154180 0x7fbd201ef9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:40.692 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:40.686+0000 7fbd26adc640 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 -- 0x7fbd200c25b0 con 0x7fbd200a8190 2024-04-26T23:50:40.692 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:40.686+0000 7fbd26adc640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fbd200c2430 con 0x7fbd200705a0 2024-04-26T23:50:40.692 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:40.686+0000 7fbd26adc640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fbd20154560 con 0x7fbd20154180 2024-04-26T23:50:40.692 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:40.686+0000 7fbd1ffff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbd200a8190 0x7fbd200acc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:40.693 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:40.686+0000 7fbd1ffff640 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbd200a8190 0x7fbd200acc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:39368/0 (socket says 172.21.15.88:39368) 2024-04-26T23:50:40.693 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:40.686+0000 7fbd1ffff640 1 -- 172.21.15.88:0/4233966470 learned_addr learned my addr 172.21.15.88:0/4233966470 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-04-26T23:50:40.693 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:40.686+0000 7fbd24878640 1 --2- 172.21.15.88:0/4233966470 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbd200705a0 0x7fbd20152c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:40.693 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:40.686+0000 7fbd1ffff640 1 -- 172.21.15.88:0/4233966470 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbd20154180 msgr2=0x7fbd201ef9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:40.693 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:40.686+0000 7fbd1ffff640 1 --2- 172.21.15.88:0/4233966470 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbd20154180 0x7fbd201ef9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:40.693 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:40.686+0000 7fbd1ffff640 1 -- 172.21.15.88:0/4233966470 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbd200705a0 msgr2=0x7fbd20152c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:40.693 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:40.686+0000 7fbd1ffff640 1 --2- 172.21.15.88:0/4233966470 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbd200705a0 0x7fbd20152c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:40.693 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:40.686+0000 7fbd1ffff640 1 -- 172.21.15.88:0/4233966470 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd201ed3e0 con 0x7fbd200a8190 2024-04-26T23:50:40.693 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:40.686+0000 7fbd24878640 1 --2- 172.21.15.88:0/4233966470 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbd200705a0 0x7fbd20152c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:50:40.693 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:40.686+0000 7fbd1ffff640 1 --2- 172.21.15.88:0/4233966470 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbd200a8190 0x7fbd200acc60 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fbd14000c00 tx=0x7fbd140046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:50:40.693 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:40.686+0000 7fbd1d7fa640 1 -- 172.21.15.88:0/4233966470 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd14041020 con 0x7fbd200a8190 2024-04-26T23:50:40.693 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:40.686+0000 7fbd1d7fa640 1 -- 172.21.15.88:0/4233966470 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fbd1403c870 con 0x7fbd200a8190 2024-04-26T23:50:40.693 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:40.686+0000 7fbd26adc640 1 -- 172.21.15.88:0/4233966470 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd201ec620 con 0x7fbd200a8190 2024-04-26T23:50:40.693 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:40.686+0000 7fbd1d7fa640 1 -- 172.21.15.88:0/4233966470 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd14037040 con 0x7fbd200a8190 2024-04-26T23:50:40.694 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:40.686+0000 7fbd26adc640 1 -- 172.21.15.88:0/4233966470 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd201ecbe0 con 0x7fbd200a8190 2024-04-26T23:50:40.694 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:40.687+0000 7fbd26adc640 1 -- 172.21.15.88:0/4233966470 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd200694b0 con 0x7fbd200a8190 2024-04-26T23:50:40.694 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:40.688+0000 7fbd1d7fa640 1 -- 172.21.15.88:0/4233966470 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fbd14044020 con 0x7fbd200a8190 2024-04-26T23:50:40.694 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:40.688+0000 7fbd1d7fa640 1 --2- 172.21.15.88:0/4233966470 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fbd0c06c920 0x7fbd0c06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:40.694 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:40.688+0000 7fbd1d7fa640 1 -- 172.21.15.88:0/4233966470 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5433+0+0 (secure 0 0 0) 0x7fbd140ac350 con 0x7fbd200a8190 2024-04-26T23:50:40.694 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:40.688+0000 7fbd24878640 1 --2- 172.21.15.88:0/4233966470 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fbd0c06c920 0x7fbd0c06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:40.694 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:40.689+0000 7fbd24878640 1 --2- 172.21.15.88:0/4233966470 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fbd0c06c920 0x7fbd0c06ede0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fbd10007fd0 tx=0x7fbd10009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:50:40.696 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:40.692+0000 7fbd1d7fa640 1 -- 172.21.15.88:0/4233966470 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fbd1404b030 con 0x7fbd200a8190 2024-04-26T23:50:40.872 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:40.869+0000 7fbd26adc640 1 -- 172.21.15.88:0/4233966470 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "b_data", "pool2": "b_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fbd20156810 con 0x7fbd200a8190 2024-04-26T23:50:41.569 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:41.565+0000 7fbd1d7fa640 1 -- 172.21.15.88:0/4233966470 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "b_data", "pool2": "b_data", "yes_i_really_really_mean_it": true}]=0 pool 'b_data' removed v32) ==== 154+0+0 (secure 0 0 0) 0x7fbd1407a1b0 con 0x7fbd200a8190 2024-04-26T23:50:41.569 INFO:teuthology.orchestra.run.smithi088.stderr:pool 'b_data' removed 2024-04-26T23:50:41.571 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:41.567+0000 7fbd26adc640 1 -- 172.21.15.88:0/4233966470 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fbd0c06c920 msgr2=0x7fbd0c06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:41.571 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:41.567+0000 7fbd26adc640 1 --2- 172.21.15.88:0/4233966470 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fbd0c06c920 0x7fbd0c06ede0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fbd10007fd0 tx=0x7fbd10009040 comp rx=0 tx=0).stop 2024-04-26T23:50:41.571 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:41.567+0000 7fbd26adc640 1 -- 172.21.15.88:0/4233966470 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbd200a8190 msgr2=0x7fbd200acc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:41.571 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:41.567+0000 7fbd26adc640 1 --2- 172.21.15.88:0/4233966470 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbd200a8190 0x7fbd200acc60 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fbd14000c00 tx=0x7fbd140046c0 comp rx=0 tx=0).stop 2024-04-26T23:50:41.571 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:41.567+0000 7fbd26adc640 1 -- 172.21.15.88:0/4233966470 shutdown_connections 2024-04-26T23:50:41.571 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:41.567+0000 7fbd26adc640 1 --2- 172.21.15.88:0/4233966470 >> [v2:172.21.15.88:6832/651674297,v1:172.21.15.88:6833/651674297] conn(0x7fbd0c06c920 0x7fbd0c06ede0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:41.571 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:41.567+0000 7fbd26adc640 1 --2- 172.21.15.88:0/4233966470 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbd20154180 0x7fbd201ef9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:41.571 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:41.567+0000 7fbd26adc640 1 --2- 172.21.15.88:0/4233966470 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbd200a8190 0x7fbd200acc60 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:41.571 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:41.567+0000 7fbd26adc640 1 --2- 172.21.15.88:0/4233966470 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbd200705a0 0x7fbd20152c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:41.572 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:41.567+0000 7fbd26adc640 1 -- 172.21.15.88:0/4233966470 >> 172.21.15.88:0/4233966470 conn(0x7fbd200aa6a0 msgr2=0x7fbd200c64e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:50:41.572 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:41.567+0000 7fbd26adc640 1 -- 172.21.15.88:0/4233966470 shutdown_connections 2024-04-26T23:50:41.572 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T23:50:41.567+0000 7fbd26adc640 1 -- 172.21.15.88:0/4233966470 wait complete. 2024-04-26T23:50:41.583 INFO:teuthology.misc:Shutting down mds daemons... 2024-04-26T23:50:41.583 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-26T23:50:41.583 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T23:50:41.592 INFO:tasks.ceph.mds.a:Stopped 2024-04-26T23:50:41.592 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-04-26T23:50:41.592 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T23:50:41.641 INFO:tasks.ceph.mds.c:Stopped 2024-04-26T23:50:41.642 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-26T23:50:41.642 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T23:50:41.653 INFO:tasks.ceph.mds.b:Stopped 2024-04-26T23:50:41.653 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-04-26T23:50:41.653 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T23:50:41.703 INFO:tasks.ceph.mds.d:Stopped 2024-04-26T23:50:41.703 INFO:teuthology.misc:Shutting down osd daemons... 2024-04-26T23:50:41.703 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-04-26T23:50:41.703 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T23:50:41.773 INFO:tasks.ceph.osd.0:Stopped 2024-04-26T23:50:41.774 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-04-26T23:50:41.774 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T23:50:41.863 INFO:tasks.ceph.osd.1:Stopped 2024-04-26T23:50:41.863 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-04-26T23:50:41.863 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T23:50:41.938 INFO:tasks.ceph.osd.2:Stopped 2024-04-26T23:50:41.939 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-04-26T23:50:41.939 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T23:50:42.013 INFO:tasks.ceph.osd.3:Stopped 2024-04-26T23:50:42.014 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-04-26T23:50:42.014 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T23:50:42.076 INFO:tasks.ceph.osd.4:Stopped 2024-04-26T23:50:42.077 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-04-26T23:50:42.077 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T23:50:42.146 INFO:tasks.ceph.osd.5:Stopped 2024-04-26T23:50:42.146 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-04-26T23:50:42.146 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T23:50:42.229 INFO:tasks.ceph.osd.6:Stopped 2024-04-26T23:50:42.230 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-04-26T23:50:42.230 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T23:50:42.299 INFO:tasks.ceph.osd.7:Stopped 2024-04-26T23:50:42.299 INFO:teuthology.misc:Shutting down mgr daemons... 2024-04-26T23:50:42.299 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-04-26T23:50:42.299 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T23:50:42.325 INFO:tasks.ceph.mgr.y:Stopped 2024-04-26T23:50:42.326 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-04-26T23:50:42.326 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T23:50:42.350 INFO:tasks.ceph.mgr.x:Stopped 2024-04-26T23:50:42.350 INFO:teuthology.misc:Shutting down mon daemons... 2024-04-26T23:50:42.350 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-04-26T23:50:42.350 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T23:50:42.377 INFO:tasks.ceph.mon.a:Stopped 2024-04-26T23:50:42.377 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-04-26T23:50:42.377 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T23:50:42.401 INFO:tasks.ceph.mon.b:Stopped 2024-04-26T23:50:42.401 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-04-26T23:50:42.401 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T23:50:42.452 INFO:tasks.ceph.mon.c:Stopped 2024-04-26T23:50:42.452 INFO:tasks.ceph:Checking cluster log for badness... 2024-04-26T23:50:42.452 DEBUG:teuthology.orchestra.run.smithi088:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'overall HEALTH_' | egrep -v '\(OSDMAP_FLAGS\)' | egrep -v '\(OSD_' | egrep -v '\(PG_' | egrep -v '\(POOL_' | egrep -v '\(CACHE_POOL_' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(OBJECT_' | egrep -v '\(SLOW_OPS\)' | egrep -v '\(REQUEST_SLOW\)' | egrep -v '\(TOO_FEW_PGS\)' | egrep -v 'slow request' | egrep -v 'timeout on replica' | egrep -v 'late reservation from' | egrep -v MON_DOWN | egrep -v OSDMAP_FLAGS | egrep -v OSD_DOWN | egrep -v PG_DEGRADED | egrep -v PG_AVAILABILITY | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'mons down' | egrep -v 'mon down' | egrep -v 'out of quorum' | egrep -v 'overall HEALTH_' | egrep -v '\(MON_DOWN\)' | egrep -v SLOW_OPS | egrep -v 'slow request' | head -n 1 2024-04-26T23:50:42.505 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi088.front.sepia.ceph.com 2024-04-26T23:50:42.506 DEBUG:teuthology.orchestra.run.smithi088:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-04-26T23:50:42.868 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi088.front.sepia.ceph.com 2024-04-26T23:50:42.869 DEBUG:teuthology.orchestra.run.smithi088:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-04-26T23:50:43.005 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi088.front.sepia.ceph.com 2024-04-26T23:50:43.005 DEBUG:teuthology.orchestra.run.smithi088:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-04-26T23:50:43.087 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi088.front.sepia.ceph.com 2024-04-26T23:50:43.087 DEBUG:teuthology.orchestra.run.smithi088:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-04-26T23:50:43.186 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi175.front.sepia.ceph.com 2024-04-26T23:50:43.186 DEBUG:teuthology.orchestra.run.smithi175:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-04-26T23:50:43.480 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi175.front.sepia.ceph.com 2024-04-26T23:50:43.480 DEBUG:teuthology.orchestra.run.smithi175:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-04-26T23:50:43.578 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi175.front.sepia.ceph.com 2024-04-26T23:50:43.578 DEBUG:teuthology.orchestra.run.smithi175:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-04-26T23:50:43.656 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi175.front.sepia.ceph.com 2024-04-26T23:50:43.656 DEBUG:teuthology.orchestra.run.smithi175:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-04-26T23:50:43.734 INFO:tasks.ceph:Archiving mon data... 2024-04-26T23:50:43.735 DEBUG:teuthology.misc:Transferring archived files from smithi088:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675323/data/mon.a.tgz 2024-04-26T23:50:43.736 DEBUG:teuthology.orchestra.run.smithi088:> mktemp 2024-04-26T23:50:43.757 INFO:teuthology.orchestra.run.smithi088.stdout:/tmp/tmp.SkMYpklT1r 2024-04-26T23:50:43.757 DEBUG:teuthology.orchestra.run.smithi088:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.SkMYpklT1r 2024-04-26T23:50:43.931 DEBUG:teuthology.orchestra.run.smithi088:> sudo chmod 0666 /tmp/tmp.SkMYpklT1r 2024-04-26T23:50:44.011 DEBUG:teuthology.orchestra.remote:smithi088:/tmp/tmp.SkMYpklT1r is 555KB 2024-04-26T23:50:44.081 DEBUG:teuthology.orchestra.run.smithi088:> rm -fr /tmp/tmp.SkMYpklT1r 2024-04-26T23:50:44.095 DEBUG:teuthology.misc:Transferring archived files from smithi175:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675323/data/mon.b.tgz 2024-04-26T23:50:44.095 DEBUG:teuthology.orchestra.run.smithi175:> mktemp 2024-04-26T23:50:44.111 INFO:teuthology.orchestra.run.smithi175.stdout:/tmp/tmp.Ie1nVuB2Fe 2024-04-26T23:50:44.111 DEBUG:teuthology.orchestra.run.smithi175:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.Ie1nVuB2Fe 2024-04-26T23:50:44.289 DEBUG:teuthology.orchestra.run.smithi175:> sudo chmod 0666 /tmp/tmp.Ie1nVuB2Fe 2024-04-26T23:50:44.395 DEBUG:teuthology.orchestra.remote:smithi175:/tmp/tmp.Ie1nVuB2Fe is 571KB 2024-04-26T23:50:44.494 DEBUG:teuthology.orchestra.run.smithi175:> rm -fr /tmp/tmp.Ie1nVuB2Fe 2024-04-26T23:50:44.508 DEBUG:teuthology.misc:Transferring archived files from smithi175:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675323/data/mon.c.tgz 2024-04-26T23:50:44.508 DEBUG:teuthology.orchestra.run.smithi175:> mktemp 2024-04-26T23:50:44.562 INFO:teuthology.orchestra.run.smithi175.stdout:/tmp/tmp.japV6tiPXI 2024-04-26T23:50:44.562 DEBUG:teuthology.orchestra.run.smithi175:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.japV6tiPXI 2024-04-26T23:50:44.731 DEBUG:teuthology.orchestra.run.smithi175:> sudo chmod 0666 /tmp/tmp.japV6tiPXI 2024-04-26T23:50:44.812 DEBUG:teuthology.orchestra.remote:smithi175:/tmp/tmp.japV6tiPXI is 552KB 2024-04-26T23:50:44.910 DEBUG:teuthology.orchestra.run.smithi175:> rm -fr /tmp/tmp.japV6tiPXI 2024-04-26T23:50:44.924 INFO:tasks.ceph:Cleaning ceph cluster... 2024-04-26T23:50:44.924 DEBUG:teuthology.orchestra.run.smithi088:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-26T23:50:44.926 DEBUG:teuthology.orchestra.run.smithi175:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-26T23:50:45.009 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-26T23:50:45.048 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-26T23:50:45.048 INFO:tasks.ceph:Archiving crash dumps... 2024-04-26T23:50:45.050 DEBUG:teuthology.misc:Transferring archived files from smithi088:/var/lib/ceph/crash to /home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675323/remote/smithi088/crash 2024-04-26T23:50:45.051 DEBUG:teuthology.orchestra.run.smithi088:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-26T23:50:45.078 DEBUG:teuthology.misc:Transferring archived files from smithi175:/var/lib/ceph/crash to /home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675323/remote/smithi175/crash 2024-04-26T23:50:45.079 DEBUG:teuthology.orchestra.run.smithi175:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-26T23:50:45.111 INFO:tasks.ceph:Shutting down logrotate 2024-04-26T23:50:45.111 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:50:45.122 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:50:45.236 DEBUG:teuthology.orchestra.run.smithi088:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-04-26T23:50:45.265 DEBUG:teuthology.orchestra.run.smithi175:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-04-26T23:50:45.292 INFO:tasks.ceph:Compressing logs... 2024-04-26T23:50:45.293 DEBUG:teuthology.orchestra.run.smithi088:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-26T23:50:45.307 DEBUG:teuthology.orchestra.run.smithi175:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-26T23:50:45.391 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-04-26T23:50:45.391 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34942.log 2024-04-26T23:50:45.391 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-04-26T23:50:45.391 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.34942.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-04-26T23:50:45.391 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-04-26T23:50:45.391 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-04-26T23:50:45.391 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-04-26T23:50:45.391 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35062.log 2024-04-26T23:50:45.391 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34771.log 2024-04-26T23:50:45.391 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.35062.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-04-26T23:50:45.391 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.34771.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34851.log 2024-04-26T23:50:45.392 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-04-26T23:50:45.392 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.34851.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-04-26T23:50:45.392 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34982.log 2024-04-26T23:50:45.392 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35022.log 2024-04-26T23:50:45.392 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.34982.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34811.log 2024-04-26T23:50:45.392 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.35022.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.41102.log 2024-04-26T23:50:45.392 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.34811.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2024-04-26T23:50:45.392 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.1.41102.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-04-26T23:50:45.392 INFO:teuthology.orchestra.run.smithi175.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.41102.log.gz 2024-04-26T23:50:45.392 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34895.log 2024-04-26T23:50:45.392 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-mon.b.log: /var/log/ceph/ceph-client.admin.34895.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.34771.log.gz 2024-04-26T23:50:45.392 INFO:teuthology.orchestra.run.smithi175.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.34811.log.gz 2024-04-26T23:50:45.392 INFO:teuthology.orchestra.run.smithi175.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.34851.log.gz 2024-04-26T23:50:45.392 INFO:teuthology.orchestra.run.smithi175.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.34895.log.gz 2024-04-26T23:50:45.392 INFO:teuthology.orchestra.run.smithi175.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.34942.log.gz 2024-04-26T23:50:45.393 INFO:teuthology.orchestra.run.smithi175.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.34982.log.gz 2024-04-26T23:50:45.393 INFO:teuthology.orchestra.run.smithi175.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.35022.log.gz 2024-04-26T23:50:45.393 INFO:teuthology.orchestra.run.smithi175.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.35062.log.gz 2024-04-26T23:50:45.415 INFO:teuthology.orchestra.run.smithi175.stderr: 94.0% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-04-26T23:50:45.449 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51026.log 2024-04-26T23:50:45.450 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40939.log 2024-04-26T23:50:45.450 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.51026.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52572.log 2024-04-26T23:50:45.450 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.40939.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.51026.log.gz 2024-04-26T23:50:45.450 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51254.log 2024-04-26T23:50:45.450 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.52572.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44969.log 2024-04-26T23:50:45.450 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.51254.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57266.log 2024-04-26T23:50:45.450 INFO:teuthology.orchestra.run.smithi088.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.52572.log.gz 2024-04-26T23:50:45.450 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.44969.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40319.log 2024-04-26T23:50:45.450 INFO:teuthology.orchestra.run.smithi088.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.51254.log.gz 2024-04-26T23:50:45.450 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.57266.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52176.log 2024-04-26T23:50:45.450 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.40319.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.57266.log.gz 2024-04-26T23:50:45.450 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56318.log 2024-04-26T23:50:45.451 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.52176.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52530.log 2024-04-26T23:50:45.451 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.56318.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42603.log 2024-04-26T23:50:45.451 INFO:teuthology.orchestra.run.smithi088.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.52176.log.gz 2024-04-26T23:50:45.451 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.52530.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50723.log 2024-04-26T23:50:45.451 INFO:teuthology.orchestra.run.smithi088.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.56318.log.gz 2024-04-26T23:50:45.451 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.42603.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55501.log 2024-04-26T23:50:45.451 INFO:teuthology.orchestra.run.smithi088.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.52530.log.gz 2024-04-26T23:50:45.451 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.50723.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41065.log 2024-04-26T23:50:45.451 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.55501.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45757.log 2024-04-26T23:50:45.451 INFO:teuthology.orchestra.run.smithi088.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.50723.log.gz 2024-04-26T23:50:45.451 INFO:teuthology.orchestra.run.smithi088.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.55501.log.gz 2024-04-26T23:50:45.451 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54646.log 2024-04-26T23:50:45.451 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.41065.log: /var/log/ceph/ceph-client.admin.45757.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55814.log 2024-04-26T23:50:45.451 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.54646.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46319.log 2024-04-26T23:50:45.451 INFO:teuthology.orchestra.run.smithi088.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.41065.log.gz 2024-04-26T23:50:45.452 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.55814.log: 89.7%gzip -- replaced with /var/log/ceph/ceph-client.admin.45757.log.gz -5 2024-04-26T23:50:45.452 INFO:teuthology.orchestra.run.smithi088.stderr: --verbose -- /var/log/ceph/ceph-client.admin.55940.log 2024-04-26T23:50:45.452 INFO:teuthology.orchestra.run.smithi088.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.54646.log.gz 2024-04-26T23:50:45.452 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.46319.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.55814.log.gz 2024-04-26T23:50:45.452 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56935.log 2024-04-26T23:50:45.452 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.55940.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52488.log 2024-04-26T23:50:45.452 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.56935.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54300.log 2024-04-26T23:50:45.452 INFO:teuthology.orchestra.run.smithi088.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.46319.log.gz 2024-04-26T23:50:45.452 INFO:teuthology.orchestra.run.smithi088.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.55940.log.gz 2024-04-26T23:50:45.452 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.52488.log: gzip -5 --verbose -- 88.0% /var/log/ceph/ceph-client.admin.46147.log -- replaced with /var/log/ceph/ceph-client.admin.56935.log.gz 2024-04-26T23:50:45.452 INFO:teuthology.orchestra.run.smithi088.stderr: 2024-04-26T23:50:45.452 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.54300.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45968.log 2024-04-26T23:50:45.452 INFO:teuthology.orchestra.run.smithi088.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.52488.log.gz 2024-04-26T23:50:45.452 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.46147.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.54300.log.gz 2024-04-26T23:50:45.452 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50555.log 2024-04-26T23:50:45.453 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.45968.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42270.log 2024-04-26T23:50:45.453 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41317.log 2024-04-26T23:50:45.453 INFO:teuthology.orchestra.run.smithi088.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.46147.log.gz 2024-04-26T23:50:45.453 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.50555.log: /var/log/ceph/ceph-client.admin.42270.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52404.log 2024-04-26T23:50:45.453 INFO:teuthology.orchestra.run.smithi088.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.50555.log.gz 2024-04-26T23:50:45.453 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.41317.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51990.log 2024-04-26T23:50:45.453 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.52404.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52032.log 2024-04-26T23:50:45.453 INFO:teuthology.orchestra.run.smithi088.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.40939.log.gz 2024-04-26T23:50:45.453 INFO:teuthology.orchestra.run.smithi088.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.52404.log.gz 2024-04-26T23:50:45.453 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-04-26T23:50:45.453 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.51990.log: /var/log/ceph/ceph-client.admin.52032.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45113.log 2024-04-26T23:50:45.453 INFO:teuthology.orchestra.run.smithi088.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.51990.log.gz 2024-04-26T23:50:45.453 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52362.log 2024-04-26T23:50:45.453 INFO:teuthology.orchestra.run.smithi088.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.52032.log.gz 2024-04-26T23:50:45.453 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.45113.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50639.log 2024-04-26T23:50:45.454 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.52362.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45884.log 2024-04-26T23:50:45.454 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.50639.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.52362.log.gz 2024-04-26T23:50:45.454 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52320.log 2024-04-26T23:50:45.454 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.45884.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53380.log 87.8% 2024-04-26T23:50:45.454 INFO:teuthology.orchestra.run.smithi088.stderr: -- replaced with /var/log/ceph/ceph-client.admin.50639.log.gz 2024-04-26T23:50:45.454 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.52320.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41023.log 2024-04-26T23:50:45.454 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.53380.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.52320.log.gz 2024-04-26T23:50:45.454 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54730.log 2024-04-26T23:50:45.454 INFO:teuthology.orchestra.run.smithi088.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.admin.45884.log.gz 2024-04-26T23:50:45.454 INFO:teuthology.orchestra.run.smithi088.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.53380.log.gz 2024-04-26T23:50:45.454 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44298.log 2024-04-26T23:50:45.454 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.41023.log: /var/log/ceph/ceph-client.admin.54730.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-04-26T23:50:45.454 INFO:teuthology.orchestra.run.smithi088.stderr: 86.8% -- replaced with /var/log/ceph/ceph.log.gz 2024-04-26T23:50:45.454 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.44298.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52614.log 2024-04-26T23:50:45.454 INFO:teuthology.orchestra.run.smithi088.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.54730.log.gz 2024-04-26T23:50:45.455 INFO:teuthology.orchestra.run.smithi088.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.42603.log.gz 2024-04-26T23:50:45.455 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54887.log 2024-04-26T23:50:45.455 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-osd.2.log: /var/log/ceph/ceph-client.admin.52614.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55730.log 2024-04-26T23:50:45.455 INFO:teuthology.orchestra.run.smithi088.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.52614.log.gz 2024-04-26T23:50:45.455 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.54887.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41708.log 2024-04-26T23:50:45.455 INFO:teuthology.orchestra.run.smithi088.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.54887.log.gz 2024-04-26T23:50:45.455 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.55730.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.44833.log 2024-04-26T23:50:45.455 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43140.log 2024-04-26T23:50:45.455 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.41708.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.55730.log.gz 2024-04-26T23:50:45.455 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.0.44833.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53464.log 2024-04-26T23:50:45.455 INFO:teuthology.orchestra.run.smithi088.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.44833.log.gz 2024-04-26T23:50:45.455 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.43140.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41880.log 2024-04-26T23:50:45.455 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.53464.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42263.log 2024-04-26T23:50:45.455 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.41880.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50765.log 2024-04-26T23:50:45.455 INFO:teuthology.orchestra.run.smithi088.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.53464.log.gz 2024-04-26T23:50:45.456 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.42263.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52698.log 2024-04-26T23:50:45.456 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.50765.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46571.log 2024-04-26T23:50:45.456 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.52698.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54402.log 2024-04-26T23:50:45.456 INFO:teuthology.orchestra.run.smithi088.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.50765.log.gz 2024-04-26T23:50:45.456 INFO:teuthology.orchestra.run.smithi088.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44969.log.gz 2024-04-26T23:50:45.456 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.46571.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50078.log 2024-04-26T23:50:45.456 INFO:teuthology.orchestra.run.smithi088.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.52698.log.gz 2024-04-26T23:50:45.456 INFO:teuthology.orchestra.run.smithi088.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.45113.log.gz 2024-04-26T23:50:45.456 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.54402.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52968.log 2024-04-26T23:50:45.456 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.50078.log: gzip 89.3% -5 -- replaced with /var/log/ceph/ceph-client.admin.54402.log.gz --verbose 2024-04-26T23:50:45.456 INFO:teuthology.orchestra.run.smithi088.stderr: -- /var/log/ceph/ceph-client.admin.51464.log 2024-04-26T23:50:45.456 INFO:teuthology.orchestra.run.smithi088.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.50078.log.gz 2024-04-26T23:50:45.456 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.52968.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-04-26T23:50:45.456 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.51464.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.52968.log.gz 2024-04-26T23:50:45.456 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54258.log 2024-04-26T23:50:45.457 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50900.log 2024-04-26T23:50:45.457 INFO:teuthology.orchestra.run.smithi088.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.51464.log.gz 2024-04-26T23:50:45.457 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.54258.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55688.log 2024-04-26T23:50:45.457 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.50900.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51738.log 2024-04-26T23:50:45.457 INFO:teuthology.orchestra.run.smithi088.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.54258.log.gz 2024-04-26T23:50:45.457 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.55688.log: 88.7%gzip -- replaced with /var/log/ceph/ceph-client.admin.50900.log.gz -5 2024-04-26T23:50:45.457 INFO:teuthology.orchestra.run.smithi088.stderr: --verbose -- /var/log/ceph/ceph-client.admin.53692.log 2024-04-26T23:50:45.457 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.51738.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45155.log 2024-04-26T23:50:45.457 INFO:teuthology.orchestra.run.smithi088.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.55688.log.gz 2024-04-26T23:50:45.457 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.53692.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.51738.log.gz 2024-04-26T23:50:45.457 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49722.log 2024-04-26T23:50:45.457 INFO:teuthology.orchestra.run.smithi088.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.41708.log.gz 2024-04-26T23:50:45.457 INFO:teuthology.orchestra.run.smithi088.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.53692.log.gz 2024-04-26T23:50:45.457 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.45155.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56360.log 2024-04-26T23:50:45.457 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55087.log 2024-04-26T23:50:45.458 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.49722.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.41880.log.gz 2024-04-26T23:50:45.458 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53170.log/var/log/ceph/ceph-client.admin.56360.log: 2024-04-26T23:50:45.458 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.55087.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57079.log 2024-04-26T23:50:45.458 INFO:teuthology.orchestra.run.smithi088.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.56360.log.gz 2024-04-26T23:50:45.458 INFO:teuthology.orchestra.run.smithi088.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.55087.log.gz 2024-04-26T23:50:45.458 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43224.log/var/log/ceph/ceph-client.admin.53170.log: 2024-04-26T23:50:45.458 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.57079.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50984.log 2024-04-26T23:50:45.458 INFO:teuthology.orchestra.run.smithi088.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.53170.log.gz 2024-04-26T23:50:45.458 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.43224.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.57079.log.gzgzip 2024-04-26T23:50:45.458 INFO:teuthology.orchestra.run.smithi088.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.46445.log 2024-04-26T23:50:45.458 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.50984.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56995.log 2024-04-26T23:50:45.458 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.46445.log: gzip -5 88.9% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.50984.log.gz /var/log/ceph/ceph-client.admin.53548.log 2024-04-26T23:50:45.458 INFO:teuthology.orchestra.run.smithi088.stderr: 2024-04-26T23:50:45.458 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.56995.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44340.log 2024-04-26T23:50:45.459 INFO:teuthology.orchestra.run.smithi088.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.56995.log.gz 2024-04-26T23:50:45.459 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34669.log 2024-04-26T23:50:45.459 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.53548.log: /var/log/ceph/ceph-client.admin.44340.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52740.log 2024-04-26T23:50:45.459 INFO:teuthology.orchestra.run.smithi088.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.53548.log.gz 2024-04-26T23:50:45.459 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.34669.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-04-26T23:50:45.459 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.52740.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42604.log 2024-04-26T23:50:45.459 INFO:teuthology.orchestra.run.smithi088.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.45968.log.gz 2024-04-26T23:50:45.459 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose 88.8% -- -- replaced with /var/log/ceph/ceph-client.admin.52740.log.gz /var/log/ceph/ceph-client.admin.55213.log 2024-04-26T23:50:45.459 INFO:teuthology.orchestra.run.smithi088.stderr: 2024-04-26T23:50:45.459 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-osd.3.log: /var/log/ceph/ceph-client.admin.42604.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51068.log 2024-04-26T23:50:45.459 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.55213.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56192.log 2024-04-26T23:50:45.459 INFO:teuthology.orchestra.run.smithi088.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.55213.log.gz 2024-04-26T23:50:45.459 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.51068.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43392.log 2024-04-26T23:50:45.459 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.56192.log: /var/log/ceph/ceph-client.admin.45714.log 2024-04-26T23:50:45.459 INFO:teuthology.orchestra.run.smithi088.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.51068.log.gz 2024-04-26T23:50:45.460 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.43392.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45449.log 2024-04-26T23:50:45.460 INFO:teuthology.orchestra.run.smithi088.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.56192.log.gz 2024-04-26T23:50:45.460 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.45714.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41964.log 2024-04-26T23:50:45.460 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.45449.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52782.log 2024-04-26T23:50:45.460 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.41964.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54006.log 2024-04-26T23:50:45.460 INFO:teuthology.orchestra.run.smithi088.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.42604.log.gz 2024-04-26T23:50:45.460 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.52782.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56893.log 2024-04-26T23:50:45.460 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.54006.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53506.log 2024-04-26T23:50:45.460 INFO:teuthology.orchestra.run.smithi088.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.52782.log.gz 2024-04-26T23:50:45.460 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.56893.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56601.log 2024-04-26T23:50:45.460 INFO:teuthology.orchestra.run.smithi088.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.54006.log.gz 2024-04-26T23:50:45.460 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.53506.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.56893.log.gz 2024-04-26T23:50:45.460 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55045.log 2024-04-26T23:50:45.460 INFO:teuthology.orchestra.run.smithi088.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.40319.log.gz 2024-04-26T23:50:45.460 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.56601.log: gzip 89.1% -- replaced with /var/log/ceph/ceph-client.admin.53506.log.gz -5 2024-04-26T23:50:45.461 INFO:teuthology.orchestra.run.smithi088.stderr: --verbose -- /var/log/ceph/ceph-client.admin.51696.log 2024-04-26T23:50:45.461 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.55045.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.56601.log.gz 2024-04-26T23:50:45.461 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50597.log 2024-04-26T23:50:45.461 INFO:teuthology.orchestra.run.smithi088.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.55045.log.gz 2024-04-26T23:50:45.461 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.51696.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-04-26T23:50:45.461 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.50597.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43560.log 2024-04-26T23:50:45.461 INFO:teuthology.orchestra.run.smithi088.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.51696.log.gz 2024-04-26T23:50:45.461 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56276.log 2024-04-26T23:50:45.461 INFO:teuthology.orchestra.run.smithi088.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.50597.log.gz 2024-04-26T23:50:45.461 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.43560.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51380.log 2024-04-26T23:50:45.461 INFO:teuthology.orchestra.run.smithi088.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.41023.log.gz 2024-04-26T23:50:45.461 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.56276.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42596.log 2024-04-26T23:50:45.461 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.51380.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.56276.log.gz 2024-04-26T23:50:45.461 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55375.log 2024-04-26T23:50:45.462 INFO:teuthology.orchestra.run.smithi088.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.45714.log.gz 2024-04-26T23:50:45.462 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.42596.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55333.log 2024-04-26T23:50:45.462 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.55375.log: 92.8% -- replaced with /var/log/ceph/ceph-client.admin.51380.log.gz 2024-04-26T23:50:45.462 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43770.log 2024-04-26T23:50:45.462 INFO:teuthology.orchestra.run.smithi088.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.55375.log.gz 2024-04-26T23:50:45.462 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.55333.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41922.log 2024-04-26T23:50:45.462 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.43770.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43182.log 2024-04-26T23:50:45.462 INFO:teuthology.orchestra.run.smithi088.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.55333.log.gz 2024-04-26T23:50:45.462 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.41922.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-04-26T23:50:45.462 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.43182.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-04-26T23:50:45.462 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44046.log 2024-04-26T23:50:45.462 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53922.log 2024-04-26T23:50:45.462 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.44046.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43812.log 2024-04-26T23:50:45.463 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.53922.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55772.log 2024-04-26T23:50:45.463 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.43812.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40665.log 2024-04-26T23:50:45.463 INFO:teuthology.orchestra.run.smithi088.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.53922.log.gz 2024-04-26T23:50:45.463 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.55772.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45575.log 2024-04-26T23:50:45.463 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.40665.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56444.log 2024-04-26T23:50:45.463 INFO:teuthology.orchestra.run.smithi088.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.55772.log.gz 2024-04-26T23:50:45.463 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.45575.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42823.log 2024-04-26T23:50:45.463 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41275.log 2024-04-26T23:50:45.463 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.56444.log: /var/log/ceph/ceph-client.admin.42823.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44382.log 2024-04-26T23:50:45.463 INFO:teuthology.orchestra.run.smithi088.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.56444.log.gz 2024-04-26T23:50:45.463 INFO:teuthology.orchestra.run.smithi088.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.42596.log.gz 2024-04-26T23:50:45.463 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.41275.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41485.log 2024-04-26T23:50:45.463 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.44382.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40415.log 2024-04-26T23:50:45.463 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.41485.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50681.log 2024-04-26T23:50:45.463 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.40415.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45533.log 2024-04-26T23:50:45.464 INFO:teuthology.orchestra.run.smithi088.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44298.log.gz 2024-04-26T23:50:45.464 INFO:teuthology.orchestra.run.smithi088.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.44340.log.gz 2024-04-26T23:50:45.464 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.50681.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-04-26T23:50:45.464 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.45533.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34302.log 2024-04-26T23:50:45.464 INFO:teuthology.orchestra.run.smithi088.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.40665.log.gz 2024-04-26T23:50:45.464 INFO:teuthology.orchestra.run.smithi088.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.50681.log.gz 2024-04-26T23:50:45.464 INFO:teuthology.orchestra.run.smithi088.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.42823.log.gz 2024-04-26T23:50:45.464 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55459.log 2024-04-26T23:50:45.464 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.34302.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45155.log.gz 2024-04-26T23:50:45.464 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50036.log 2024-04-26T23:50:45.464 INFO:teuthology.orchestra.run.smithi088.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.44382.log.gz 2024-04-26T23:50:45.464 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.55459.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54604.log 2024-04-26T23:50:45.464 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.50036.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46715.log 2024-04-26T23:50:45.464 INFO:teuthology.orchestra.run.smithi088.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.55459.log.gz 2024-04-26T23:50:45.464 INFO:teuthology.orchestra.run.smithi088.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.45449.log.gz 2024-04-26T23:50:45.465 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.54604.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.40415.log.gz 2024-04-26T23:50:45.465 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 90.6% -- replaced with /var/log/ceph/ceph-client.admin.50036.log.gz 2024-04-26T23:50:45.465 INFO:teuthology.orchestra.run.smithi088.stderr: --verbose 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45533.log.gz 2024-04-26T23:50:45.465 INFO:teuthology.orchestra.run.smithi088.stderr: -- /var/log/ceph/ceph-client.admin.44004.log 2024-04-26T23:50:45.465 INFO:teuthology.orchestra.run.smithi088.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.45575.log.gz 2024-04-26T23:50:45.465 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.46715.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.54604.log.gz 2024-04-26T23:50:45.465 INFO:teuthology.orchestra.run.smithi088.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44046.log.gz 2024-04-26T23:50:45.465 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44172.log 2024-04-26T23:50:45.465 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.44004.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55646.log 2024-04-26T23:50:45.465 INFO:teuthology.orchestra.run.smithi088.stderr:gzip/var/log/ceph/ceph-client.admin.44172.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.53590.log 2024-04-26T23:50:45.465 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.55646.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42606.log 2024-04-26T23:50:45.465 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53010.log 87.3% 2024-04-26T23:50:45.465 INFO:teuthology.orchestra.run.smithi088.stderr: -- replaced with /var/log/ceph/ceph-client.admin.55646.log.gz 2024-04-26T23:50:45.465 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.53590.log: /var/log/ceph/ceph-client.admin.42606.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55003.log 2024-04-26T23:50:45.465 INFO:teuthology.orchestra.run.smithi088.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.53590.log.gz 2024-04-26T23:50:45.466 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.53010.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41573.log 2024-04-26T23:50:45.466 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.55003.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42939.log 2024-04-26T23:50:45.466 INFO:teuthology.orchestra.run.smithi088.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.53010.log.gz 2024-04-26T23:50:45.466 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.41573.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.55003.log.gz 2024-04-26T23:50:45.466 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41359.log 2024-04-26T23:50:45.466 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.42939.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.46445.log.gz 2024-04-26T23:50:45.466 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34566.log 2024-04-26T23:50:45.466 INFO:teuthology.orchestra.run.smithi088.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.46571.log.gz 2024-04-26T23:50:45.466 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52656.log 2024-04-26T23:50:45.466 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.41359.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.34302.log.gz 2024-04-26T23:50:45.466 INFO:teuthology.orchestra.run.smithi088.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.44172.log.gz 2024-04-26T23:50:45.466 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.34566.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44484.log 2024-04-26T23:50:45.466 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.52656.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44214.log 2024-04-26T23:50:45.466 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.44484.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.52656.log.gz 2024-04-26T23:50:45.466 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49994.log 2024-04-26T23:50:45.467 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.44214.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52092.log 2024-04-26T23:50:45.467 INFO:teuthology.orchestra.run.smithi088.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.46715.log.gz 2024-04-26T23:50:45.467 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.49994.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57163.log 2024-04-26T23:50:45.467 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.52092.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54444.log 2024-04-26T23:50:45.467 INFO:teuthology.orchestra.run.smithi088.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.49994.log.gz 2024-04-26T23:50:45.467 INFO:teuthology.orchestra.run.smithi088.stderr: 89.5% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-04-26T23:50:45.467 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.57163.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53338.log 2024-04-26T23:50:45.467 INFO:teuthology.orchestra.run.smithi088.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.52092.log.gz 2024-04-26T23:50:45.467 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.54444.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.57163.log.gz 2024-04-26T23:50:45.467 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53089.log 2024-04-26T23:50:45.467 INFO:teuthology.orchestra.run.smithi088.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.42606.log.gz 2024-04-26T23:50:45.467 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.53338.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45323.log 2024-04-26T23:50:45.467 INFO:teuthology.orchestra.run.smithi088.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.54444.log.gz 2024-04-26T23:50:45.467 INFO:teuthology.orchestra.run.smithi088.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.41573.log.gz 2024-04-26T23:50:45.467 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56683.log 2024-04-26T23:50:45.467 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.53089.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.53338.log.gz 2024-04-26T23:50:45.468 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.45323.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46529.log 2024-04-26T23:50:45.468 INFO:teuthology.orchestra.run.smithi088.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.53089.log.gz 2024-04-26T23:50:45.468 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.56683.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55982.log 2024-04-26T23:50:45.468 INFO:teuthology.orchestra.run.smithi088.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.56683.log.gz 2024-04-26T23:50:45.468 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.46529.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42272.log 2024-04-26T23:50:45.468 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.55982.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56150.log 2024-04-26T23:50:45.468 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.42272.log: gzip -5 --verbose -- 88.3% /var/log/ceph/ceph-client.admin.40749.log 2024-04-26T23:50:45.468 INFO:teuthology.orchestra.run.smithi088.stderr: -- replaced with /var/log/ceph/ceph-client.admin.55982.log.gz 2024-04-26T23:50:45.468 INFO:teuthology.orchestra.run.smithi088.stderr:gzip/var/log/ceph/ceph-client.admin.56150.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.46189.log 2024-04-26T23:50:45.468 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.40749.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51212.log 2024-04-26T23:50:45.468 INFO:teuthology.orchestra.run.smithi088.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.56150.log.gz 2024-04-26T23:50:45.468 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.46189.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41624.log 2024-04-26T23:50:45.468 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.51212.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41401.log 2024-04-26T23:50:45.468 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.41624.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.44484.log.gz 2024-04-26T23:50:45.468 INFO:teuthology.orchestra.run.smithi088.stderr: 89.6%gzip -- replaced with /var/log/ceph/ceph-client.admin.51212.log.gz 2024-04-26T23:50:45.469 INFO:teuthology.orchestra.run.smithi088.stderr: -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-04-26T23:50:45.469 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.41401.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53254.log 2024-04-26T23:50:45.469 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43476.log 2024-04-26T23:50:45.469 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.53254.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42944.log 2024-04-26T23:50:45.469 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.43476.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.28325.log 2024-04-26T23:50:45.469 INFO:teuthology.orchestra.run.smithi088.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.53254.log.gz 2024-04-26T23:50:45.469 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.42944.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43266.log 2024-04-26T23:50:45.469 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph.tmp-client.admin.28325.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56851.log 2024-04-26T23:50:45.469 INFO:teuthology.orchestra.run.smithi088.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.28325.log.gz 2024-04-26T23:50:45.469 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.43266.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45281.log 2024-04-26T23:50:45.469 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.56851.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54688.log 2024-04-26T23:50:45.469 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.45281.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54048.log 2024-04-26T23:50:45.469 INFO:teuthology.orchestra.run.smithi088.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.56851.log.gz 2024-04-26T23:50:45.469 INFO:teuthology.orchestra.run.smithi088.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44214.log.gz 2024-04-26T23:50:45.469 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.54688.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53212.log 2024-04-26T23:50:45.470 INFO:teuthology.orchestra.run.smithi088.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.54688.log.gz 2024-04-26T23:50:45.470 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.54048.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53734.log 2024-04-26T23:50:45.470 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.53212.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51948.log 2024-04-26T23:50:45.470 INFO:teuthology.orchestra.run.smithi088.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.54048.log.gz 2024-04-26T23:50:45.470 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.53734.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57121.log 2024-04-26T23:50:45.470 INFO:teuthology.orchestra.run.smithi088.stderr: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.53212.log.gz 2024-04-26T23:50:45.470 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.51948.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46231.log 2024-04-26T23:50:45.470 INFO:teuthology.orchestra.run.smithi088.stderr: 91.9% -- replaced with /var/log/ceph/ceph-client.admin.53734.log.gz 2024-04-26T23:50:45.470 INFO:teuthology.orchestra.run.smithi088.stderr:gzip/var/log/ceph/ceph-client.admin.57121.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.53880.log 2024-04-26T23:50:45.470 INFO:teuthology.orchestra.run.smithi088.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.51948.log.gz 2024-04-26T23:50:45.470 INFO:teuthology.orchestra.run.smithi088.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.45323.log.gz 2024-04-26T23:50:45.470 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.46231.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42941.log 2024-04-26T23:50:45.470 INFO:teuthology.orchestra.run.smithi088.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.57121.log.gz 2024-04-26T23:50:45.470 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.53880.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51822.log 2024-04-26T23:50:45.470 INFO:teuthology.orchestra.run.smithi088.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.53880.log.gz 2024-04-26T23:50:45.471 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.42941.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42600.log 2024-04-26T23:50:45.471 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.51822.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50387.log 2024-04-26T23:50:45.471 INFO:teuthology.orchestra.run.smithi088.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.51822.log.gz 2024-04-26T23:50:45.471 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.42600.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52218.log 2024-04-26T23:50:45.471 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.50387.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45491.log 2024-04-26T23:50:45.471 INFO:teuthology.orchestra.run.smithi088.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.46529.log.gz 2024-04-26T23:50:45.471 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55291.log 2024-04-26T23:50:45.471 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.52218.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.50387.log.gz 2024-04-26T23:50:45.471 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.45491.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.52218.log.gz 2024-04-26T23:50:45.471 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50471.log 2024-04-26T23:50:45.471 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.55291.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56767.log 2024-04-26T23:50:45.471 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.50471.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.55291.log.gz 2024-04-26T23:50:45.471 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45799.log 2024-04-26T23:50:45.471 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.56767.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53818.log 2024-04-26T23:50:45.471 INFO:teuthology.orchestra.run.smithi088.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.50471.log.gz 2024-04-26T23:50:45.472 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.45799.log: gzip -5 88.2% --verbose -- replaced with /var/log/ceph/ceph-client.admin.56767.log.gz -- 2024-04-26T23:50:45.472 INFO:teuthology.orchestra.run.smithi088.stderr: /var/log/ceph/ceph-client.admin.49952.log 2024-04-26T23:50:45.472 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.53818.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43644.log 2024-04-26T23:50:45.472 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.49952.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.53818.log.gz 2024-04-26T23:50:45.472 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53422.log 2024-04-26T23:50:45.472 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.43644.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.49952.log.gz 2024-04-26T23:50:45.472 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40981.log 2024-04-26T23:50:45.472 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.53422.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52824.log 2024-04-26T23:50:45.472 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.40981.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.53422.log.gz 2024-04-26T23:50:45.472 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55417.log 2024-04-26T23:50:45.472 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.52824.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41233.log 2024-04-26T23:50:45.472 INFO:teuthology.orchestra.run.smithi088.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.52824.log.gz 2024-04-26T23:50:45.472 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.55417.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56108.log 2024-04-26T23:50:45.472 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.41233.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50429.log 2024-04-26T23:50:45.473 INFO:teuthology.orchestra.run.smithi088.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.55417.log.gz 2024-04-26T23:50:45.473 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.56108.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46613.log 2024-04-26T23:50:45.473 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.50429.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.56108.log.gz 2024-04-26T23:50:45.473 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42090.log 2024-04-26T23:50:45.473 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.46613.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.50429.log.gz 2024-04-26T23:50:45.473 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40226.log 2024-04-26T23:50:45.473 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.42090.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41191.log 2024-04-26T23:50:45.473 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.40226.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56641.log 2024-04-26T23:50:45.473 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.41191.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56486.log 2024-04-26T23:50:45.473 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.56641.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43350.log 2024-04-26T23:50:45.473 INFO:teuthology.orchestra.run.smithi088.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.56641.log.gz 2024-04-26T23:50:45.473 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.56486.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44256.log 2024-04-26T23:50:45.473 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.43350.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42265.log 2024-04-26T23:50:45.473 INFO:teuthology.orchestra.run.smithi088.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.56486.log.gz 2024-04-26T23:50:45.473 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.44256.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46273.log 2024-04-26T23:50:45.474 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42943.log 2024-04-26T23:50:45.474 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.42265.log: /var/log/ceph/ceph-client.admin.46273.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43602.log 2024-04-26T23:50:45.474 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.42943.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43308.log 2024-04-26T23:50:45.474 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.43602.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41838.log 2024-04-26T23:50:45.474 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.43308.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41529.log 2024-04-26T23:50:45.474 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.41838.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40581.log 2024-04-26T23:50:45.474 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42006.log 2024-04-26T23:50:45.474 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.41529.log: /var/log/ceph/ceph-client.admin.40581.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42824.log 2024-04-26T23:50:45.474 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.42006.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41796.log 2024-04-26T23:50:45.474 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.42824.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54961.log 2024-04-26T23:50:45.474 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.41796.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42267.log 2024-04-26T23:50:45.474 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.54961.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41754.log 2024-04-26T23:50:45.474 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.42267.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52134.log 2024-04-26T23:50:45.474 INFO:teuthology.orchestra.run.smithi088.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.54961.log.gz 2024-04-26T23:50:45.475 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.41754.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51128.log 2024-04-26T23:50:45.475 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45197.log 2024-04-26T23:50:45.475 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.52134.log: /var/log/ceph/ceph-client.admin.51128.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46403.log 2024-04-26T23:50:45.475 INFO:teuthology.orchestra.run.smithi088.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.52134.log.gz 2024-04-26T23:50:45.475 INFO:teuthology.orchestra.run.smithi088.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.51128.log.gz 2024-04-26T23:50:45.475 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.45197.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.40749.log.gz 2024-04-26T23:50:45.475 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42605.log 2024-04-26T23:50:45.475 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.46403.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42607.log 2024-04-26T23:50:45.475 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.42605.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41107.log 2024-04-26T23:50:45.475 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.42607.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45071.log 2024-04-26T23:50:45.475 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.41107.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43434.log 2024-04-26T23:50:45.475 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.45071.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52926.log 2024-04-26T23:50:45.475 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.43434.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46361.log 2024-04-26T23:50:45.475 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.52926.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41149.log 2024-04-26T23:50:45.476 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.46361.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56024.log 2024-04-26T23:50:45.476 INFO:teuthology.orchestra.run.smithi088.stderr: 92.0% -- replaced with /var/log/ceph/ceph-client.admin.52926.log.gz 2024-04-26T23:50:45.476 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.41149.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41666.log 2024-04-26T23:50:45.476 INFO:teuthology.orchestra.run.smithi088.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.46189.log.gz 2024-04-26T23:50:45.476 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.56024.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45407.log 2024-04-26T23:50:45.476 INFO:teuthology.orchestra.run.smithi088.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.56024.log.gz 2024-04-26T23:50:45.476 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.41666.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54360.log 2024-04-26T23:50:45.476 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.45407.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51422.log 2024-04-26T23:50:45.476 INFO:teuthology.orchestra.run.smithi088.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.41624.log.gz 2024-04-26T23:50:45.476 INFO:teuthology.orchestra.run.smithi088.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.42600.log.gz 2024-04-26T23:50:45.476 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.54360.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54174.log 2024-04-26T23:50:45.476 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.51422.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51864.log 2024-04-26T23:50:45.476 INFO:teuthology.orchestra.run.smithi088.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.admin.54360.log.gz 2024-04-26T23:50:45.476 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.54174.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52446.log 2024-04-26T23:50:45.476 INFO:teuthology.orchestra.run.smithi088.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.51422.log.gz 2024-04-26T23:50:45.477 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.51864.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40707.log 2024-04-26T23:50:45.477 INFO:teuthology.orchestra.run.smithi088.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.54174.log.gz 2024-04-26T23:50:45.477 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.52446.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.51864.log.gz 2024-04-26T23:50:45.477 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55129.log 2024-04-26T23:50:45.477 INFO:teuthology.orchestra.run.smithi088.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.52446.log.gz 2024-04-26T23:50:45.477 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51906.log 2024-04-26T23:50:45.477 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.40707.log: /var/log/ceph/ceph-client.admin.55129.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46487.log 2024-04-26T23:50:45.477 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.51906.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.55129.log.gz 2024-04-26T23:50:45.477 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51543.log 2024-04-26T23:50:45.477 INFO:teuthology.orchestra.run.smithi088.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.51906.log.gz 2024-04-26T23:50:45.477 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53776.log 2024-04-26T23:50:45.477 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.46487.log: 88.3% 88.5% -- replaced with /var/log/ceph/ceph-client.admin.41796.log.gz 2024-04-26T23:50:45.477 INFO:teuthology.orchestra.run.smithi088.stderr: -- replaced with /var/log/ceph/ceph-client.admin.41754.log.gz 2024-04-26T23:50:45.477 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.51543.log: gzip 88.6% -5 --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.41838.log.gz /var/log/ceph/ceph-client.admin.53964.log 2024-04-26T23:50:45.477 INFO:teuthology.orchestra.run.smithi088.stderr: 2024-04-26T23:50:45.477 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42262.log/var/log/ceph/ceph-client.admin.53776.log: 2024-04-26T23:50:45.478 INFO:teuthology.orchestra.run.smithi088.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.51543.log.gz 2024-04-26T23:50:45.478 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.53964.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56066.log 2024-04-26T23:50:45.478 INFO:teuthology.orchestra.run.smithi088.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.53776.log.gz 2024-04-26T23:50:45.478 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.42262.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.53964.log.gz 2024-04-26T23:50:45.478 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50513.log 2024-04-26T23:50:45.478 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.56066.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54216.log 2024-04-26T23:50:45.478 INFO:teuthology.orchestra.run.smithi088.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.56066.log.gz 2024-04-26T23:50:45.478 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.50513.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46673.log 2024-04-26T23:50:45.478 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.54216.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43518.log 2024-04-26T23:50:45.478 INFO:teuthology.orchestra.run.smithi088.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44256.log.gz 2024-04-26T23:50:45.478 INFO:teuthology.orchestra.run.smithi088.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.50513.log.gz 2024-04-26T23:50:45.478 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.46673.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40793.log 2024-04-26T23:50:45.478 INFO:teuthology.orchestra.run.smithi088.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.54216.log.gz 2024-04-26T23:50:45.478 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.43518.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43728.log 2024-04-26T23:50:45.479 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.40793.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56559.log 2024-04-26T23:50:45.479 INFO:teuthology.orchestra.run.smithi088.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45071.log.gz 2024-04-26T23:50:45.479 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.43728.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51170.log 2024-04-26T23:50:45.479 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.56559.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52884.log 2024-04-26T23:50:45.479 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.51170.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40538.log 2024-04-26T23:50:45.479 INFO:teuthology.orchestra.run.smithi088.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.56559.log.gz 2024-04-26T23:50:45.479 INFO:teuthology.orchestra.run.smithi088.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.51170.log.gz 2024-04-26T23:50:45.479 INFO:teuthology.orchestra.run.smithi088.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.45197.log.gz 2024-04-26T23:50:45.479 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.52884.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54562.log 2024-04-26T23:50:45.479 INFO:teuthology.orchestra.run.smithi088.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.52884.log.gz 2024-04-26T23:50:45.479 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.40538.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45926.log 2024-04-26T23:50:45.479 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.54562.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-04-26T23:50:45.479 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.45926.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.54562.log.gz 2024-04-26T23:50:45.479 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49892.log 2024-04-26T23:50:45.479 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-mds.a.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.45281.log.gz 2024-04-26T23:50:45.479 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41443.log 2024-04-26T23:50:45.480 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.49892.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52260.log 2024-04-26T23:50:45.480 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.41443.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.49892.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45365.log 2024-04-26T23:50:45.480 INFO:teuthology.orchestra.run.smithi088.stderr: 2024-04-26T23:50:45.480 INFO:teuthology.orchestra.run.smithi088.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45407.log.gz 2024-04-26T23:50:45.480 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.52260.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51338.log 2024-04-26T23:50:45.480 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.45365.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.52260.log.gz 2024-04-26T23:50:45.480 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42269.log 2024-04-26T23:50:45.480 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.51338.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56402.log 2024-04-26T23:50:45.480 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.42269.log: gzip 88.9% -- replaced with /var/log/ceph/ceph-client.admin.45491.log.gz -5 2024-04-26T23:50:45.480 INFO:teuthology.orchestra.run.smithi088.stderr: --verbose -- /var/log/ceph/ceph-client.admin.51654.log 2024-04-26T23:50:45.480 INFO:teuthology.orchestra.run.smithi088.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.51338.log.gz 2024-04-26T23:50:45.480 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.56402.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42608.log 2024-04-26T23:50:45.480 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.51654.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40623.log 2024-04-26T23:50:45.480 INFO:teuthology.orchestra.run.smithi088.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.56402.log.gz 2024-04-26T23:50:45.480 INFO:teuthology.orchestra.run.smithi088.stderr: 88.0%/var/log/ceph/ceph-client.admin.42608.log: -- replaced with /var/log/ceph/ceph-client.admin.51654.log.gz 2024-04-26T23:50:45.481 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53296.log 2024-04-26T23:50:45.481 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.40623.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.41922.log.gz 2024-04-26T23:50:45.481 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50942.log 2024-04-26T23:50:45.481 INFO:teuthology.orchestra.run.smithi088.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.41964.log.gz 2024-04-26T23:50:45.481 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.53296.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42938.log 2024-04-26T23:50:45.481 INFO:teuthology.orchestra.run.smithi088.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.42270.log.gz 2024-04-26T23:50:45.481 INFO:teuthology.orchestra.run.smithi088.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.53296.log.gz 2024-04-26T23:50:45.481 INFO:teuthology.orchestra.run.smithi088.stderr: 89.0%/var/log/ceph/ceph-client.admin.42938.log: -- replaced with /var/log/ceph/ceph-client.admin.42263.log.gz 2024-04-26T23:50:45.481 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose 88.5% -- replaced with /var/log/ceph/ceph-client.admin.42272.log.gz 2024-04-26T23:50:45.481 INFO:teuthology.orchestra.run.smithi088.stderr: -- /var/log/ceph/ceph-client.admin.54845.log 2024-04-26T23:50:45.481 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.50942.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53650.log 2024-04-26T23:50:45.481 INFO:teuthology.orchestra.run.smithi088.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.50942.log.gz 2024-04-26T23:50:45.481 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.54845.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55898.log 2024-04-26T23:50:45.481 INFO:teuthology.orchestra.run.smithi088.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.54845.log.gz 2024-04-26T23:50:45.482 INFO:teuthology.orchestra.run.smithi088.stderr:gzip/var/log/ceph/ceph-client.admin.53650.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.46105.log 2024-04-26T23:50:45.482 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.55898.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.53650.log.gz 2024-04-26T23:50:45.482 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56725.log 2024-04-26T23:50:45.482 INFO:teuthology.orchestra.run.smithi088.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.42824.log.gz 2024-04-26T23:50:45.482 INFO:teuthology.orchestra.run.smithi088.stderr: 88.5% 88.3% 89.2% -- replaced with /var/log/ceph/ceph-client.admin.55898.log.gz 2024-04-26T23:50:45.482 INFO:teuthology.orchestra.run.smithi088.stderr: -- replaced with /var/log/ceph/ceph-client.admin.42943.log.gz 2024-04-26T23:50:45.482 INFO:teuthology.orchestra.run.smithi088.stderr: -- replaced with /var/log/ceph/ceph-client.admin.42944.log.gz 2024-04-26T23:50:45.482 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57224.log 2024-04-26T23:50:45.482 INFO:teuthology.orchestra.run.smithi088.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.42939.log.gz 2024-04-26T23:50:45.482 INFO:teuthology.orchestra.run.smithi088.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.42941.log.gz 2024-04-26T23:50:45.482 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.46105.log: /var/log/ceph/ceph-client.admin.56725.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40897.log 2024-04-26T23:50:45.482 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42942.log 2024-04-26T23:50:45.482 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.57224.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.43140.log.gz 88.5% 2024-04-26T23:50:45.482 INFO:teuthology.orchestra.run.smithi088.stderr: -- replaced with /var/log/ceph/ceph-client.admin.56725.log.gz 2024-04-26T23:50:45.482 INFO:teuthology.orchestra.run.smithi088.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43182.log.gz 2024-04-26T23:50:45.483 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.40897.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55856.log 2024-04-26T23:50:45.483 INFO:teuthology.orchestra.run.smithi088.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.57224.log.gz 2024-04-26T23:50:45.483 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.42942.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45239.log 2024-04-26T23:50:45.483 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.55856.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45633.log 2024-04-26T23:50:45.483 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.45239.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.55856.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42271.log 2024-04-26T23:50:45.483 INFO:teuthology.orchestra.run.smithi088.stderr: 2024-04-26T23:50:45.483 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.45633.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43938.log 2024-04-26T23:50:45.483 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.42271.log: gzip 89.8% -- replaced with /var/log/ceph/ceph-client.admin.45799.log.gz 2024-04-26T23:50:45.483 INFO:teuthology.orchestra.run.smithi088.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.44130.log 2024-04-26T23:50:45.483 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.43938.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51780.log 2024-04-26T23:50:45.483 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.44130.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51296.log 2024-04-26T23:50:45.483 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.51780.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54090.log 2024-04-26T23:50:45.483 INFO:teuthology.orchestra.run.smithi088.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.51780.log.gz 2024-04-26T23:50:45.483 INFO:teuthology.orchestra.run.smithi088.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.46273.log.gz 2024-04-26T23:50:45.483 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.51296.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.46231.log.gz 2024-04-26T23:50:45.485 INFO:teuthology.orchestra.run.smithi088.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.51296.log.gz 2024-04-26T23:50:45.485 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 87.9% --verbose -- /var/log/ceph/ceph-client.admin.43686.log 2024-04-26T23:50:45.485 INFO:teuthology.orchestra.run.smithi088.stderr: 88.9% 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46361.log.gz -- replaced with /var/log/ceph/ceph-client.admin.46403.log.gz 2024-04-26T23:50:45.485 INFO:teuthology.orchestra.run.smithi088.stderr: 2024-04-26T23:50:45.485 INFO:teuthology.orchestra.run.smithi088.stderr: -- replaced with /var/log/ceph/ceph-client.admin.46487.log.gz 2024-04-26T23:50:45.485 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.54090.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44088.log 2024-04-26T23:50:45.485 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.43686.log: 89.0% 90.8% -- replaced with /var/log/ceph/ceph-client.admin.46613.log.gz -- replaced with /var/log/ceph/ceph-client.admin.46673.log.gz 2024-04-26T23:50:45.485 INFO:teuthology.orchestra.run.smithi088.stderr: 2024-04-26T23:50:45.485 INFO:teuthology.orchestra.run.smithi088.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.54090.log.gz 2024-04-26T23:50:45.485 INFO:teuthology.orchestra.run.smithi088.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.40226.log.gz 2024-04-26T23:50:45.485 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40837.log 2024-04-26T23:50:45.486 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.44088.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.40581.log.gz 2024-04-26T23:50:45.486 INFO:teuthology.orchestra.run.smithi088.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.40538.log.gz 2024-04-26T23:50:45.486 INFO:teuthology.orchestra.run.smithi088.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.40623.log.gz 2024-04-26T23:50:45.486 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54132.log 2024-04-26T23:50:45.486 INFO:teuthology.orchestra.run.smithi088.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.40707.log.gz 2024-04-26T23:50:45.486 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.40837.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40496.log 2024-04-26T23:50:45.486 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.54132.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50858.log 2024-04-26T23:50:45.486 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.40496.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.54132.log.gz 2024-04-26T23:50:45.486 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43896.log 2024-04-26T23:50:45.486 INFO:teuthology.orchestra.run.smithi088.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.34669.log.gz 2024-04-26T23:50:45.486 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.50858.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56234.log 2024-04-26T23:50:45.486 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.43896.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.50858.log.gz 2024-04-26T23:50:45.486 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56809.log 2024-04-26T23:50:45.486 INFO:teuthology.orchestra.run.smithi088.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.40793.log.gz 2024-04-26T23:50:45.486 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.56234.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43854.log 2024-04-26T23:50:45.487 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.56809.log: gzip -5 88.6% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.56234.log.gz 2024-04-26T23:50:45.487 INFO:teuthology.orchestra.run.smithi088.stderr: /var/log/ceph/ceph-client.admin.55171.log 2024-04-26T23:50:45.487 INFO:teuthology.orchestra.run.smithi088.stderr: 87.1%/var/log/ceph/ceph-client.admin.43854.log: -- replaced with /var/log/ceph/ceph-client.admin.56809.log.gz 2024-04-26T23:50:45.487 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57037.log 2024-04-26T23:50:45.487 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.55171.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55543.log 2024-04-26T23:50:45.487 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.57037.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.55171.log.gz 2024-04-26T23:50:45.487 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45029.log 2024-04-26T23:50:45.487 INFO:teuthology.orchestra.run.smithi088.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.57037.log.gz 2024-04-26T23:50:45.487 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42048.log 2024-04-26T23:50:45.487 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.55543.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.45926.log.gz 2024-04-26T23:50:45.487 INFO:teuthology.orchestra.run.smithi088.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.40897.log.gz 2024-04-26T23:50:45.487 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.45029.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45841.log 2024-04-26T23:50:45.487 INFO:teuthology.orchestra.run.smithi088.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.55543.log.gz 2024-04-26T23:50:45.487 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.42048.log: /var/log/ceph/ceph-client.admin.45841.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.40981.log.gz 2024-04-26T23:50:45.487 INFO:teuthology.orchestra.run.smithi088.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.49722.log.gz 2024-04-26T23:50:45.488 INFO:teuthology.orchestra.run.smithi088.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.42006.log.gz 2024-04-26T23:50:45.488 INFO:teuthology.orchestra.run.smithi088.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.42090.log.gz 2024-04-26T23:50:45.488 INFO:teuthology.orchestra.run.smithi088.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.42267.log.gz 2024-04-26T23:50:45.488 INFO:teuthology.orchestra.run.smithi088.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.42265.log.gz 2024-04-26T23:50:45.488 INFO:teuthology.orchestra.run.smithi088.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.42271.log.gz 2024-04-26T23:50:45.488 INFO:teuthology.orchestra.run.smithi088.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.42262.log.gz 2024-04-26T23:50:45.488 INFO:teuthology.orchestra.run.smithi088.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.42269.log.gz 2024-04-26T23:50:45.488 INFO:teuthology.orchestra.run.smithi088.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.42605.log.gz 2024-04-26T23:50:45.488 INFO:teuthology.orchestra.run.smithi088.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.42607.log.gz 2024-04-26T23:50:45.488 INFO:teuthology.orchestra.run.smithi088.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.42608.log.gz 2024-04-26T23:50:45.488 INFO:teuthology.orchestra.run.smithi088.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.42938.log.gz 2024-04-26T23:50:45.488 INFO:teuthology.orchestra.run.smithi088.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.42942.log.gz 2024-04-26T23:50:45.488 INFO:teuthology.orchestra.run.smithi088.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.41666.log.gz 2024-04-26T23:50:45.488 INFO:teuthology.orchestra.run.smithi088.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44130.log.gz 2024-04-26T23:50:45.488 INFO:teuthology.orchestra.run.smithi088.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.44088.log.gz 2024-04-26T23:50:45.489 INFO:teuthology.orchestra.run.smithi088.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.45029.log.gz 2024-04-26T23:50:45.489 INFO:teuthology.orchestra.run.smithi088.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.45239.log.gz 2024-04-26T23:50:45.489 INFO:teuthology.orchestra.run.smithi088.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.45365.log.gz 2024-04-26T23:50:45.489 INFO:teuthology.orchestra.run.smithi088.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.34566.log.gz 2024-04-26T23:50:45.489 INFO:teuthology.orchestra.run.smithi088.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.45633.log.gz 2024-04-26T23:50:45.489 INFO:teuthology.orchestra.run.smithi088.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.45841.log.gz 2024-04-26T23:50:45.489 INFO:teuthology.orchestra.run.smithi088.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.46105.log.gz 2024-04-26T23:50:45.489 INFO:teuthology.orchestra.run.smithi088.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.40496.log.gz 2024-04-26T23:50:45.489 INFO:teuthology.orchestra.run.smithi088.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.40837.log.gz 2024-04-26T23:50:45.489 INFO:teuthology.orchestra.run.smithi088.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.43224.log.gz 2024-04-26T23:50:45.489 INFO:teuthology.orchestra.run.smithi088.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43308.log.gz 2024-04-26T23:50:45.489 INFO:teuthology.orchestra.run.smithi088.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43350.log.gz 2024-04-26T23:50:45.489 INFO:teuthology.orchestra.run.smithi088.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.43266.log.gz 2024-04-26T23:50:45.489 INFO:teuthology.orchestra.run.smithi088.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43392.log.gz 2024-04-26T23:50:45.489 INFO:teuthology.orchestra.run.smithi088.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.43434.log.gz 2024-04-26T23:50:45.489 INFO:teuthology.orchestra.run.smithi088.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43476.log.gz 2024-04-26T23:50:45.490 INFO:teuthology.orchestra.run.smithi088.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.43518.log.gz 2024-04-26T23:50:45.490 INFO:teuthology.orchestra.run.smithi088.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43560.log.gz 2024-04-26T23:50:45.490 INFO:teuthology.orchestra.run.smithi088.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.43602.log.gz 2024-04-26T23:50:45.490 INFO:teuthology.orchestra.run.smithi088.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43644.log.gz 2024-04-26T23:50:45.490 INFO:teuthology.orchestra.run.smithi088.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43686.log.gz 2024-04-26T23:50:45.490 INFO:teuthology.orchestra.run.smithi088.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43728.log.gz 2024-04-26T23:50:45.490 INFO:teuthology.orchestra.run.smithi088.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43770.log.gz 2024-04-26T23:50:45.490 INFO:teuthology.orchestra.run.smithi088.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.43812.log.gz 2024-04-26T23:50:45.490 INFO:teuthology.orchestra.run.smithi088.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43896.log.gz 2024-04-26T23:50:45.490 INFO:teuthology.orchestra.run.smithi088.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43854.log.gz 2024-04-26T23:50:45.490 INFO:teuthology.orchestra.run.smithi088.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.44004.log.gz 2024-04-26T23:50:45.490 INFO:teuthology.orchestra.run.smithi088.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.43938.log.gz 2024-04-26T23:50:45.490 INFO:teuthology.orchestra.run.smithi088.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.42048.log.gz 2024-04-26T23:50:45.491 INFO:teuthology.orchestra.run.smithi175.stderr: 94.1% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-04-26T23:50:45.492 INFO:teuthology.orchestra.run.smithi088.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.41107.log.gz 88.7% -- replaced with /var/log/ceph/ceph-client.admin.41275.log.gz 2024-04-26T23:50:45.492 INFO:teuthology.orchestra.run.smithi088.stderr: 88.8% 87.9% -- replaced with /var/log/ceph/ceph-client.admin.41149.log.gz -- replaced with /var/log/ceph/ceph-client.admin.41233.log.gz 2024-04-26T23:50:45.493 INFO:teuthology.orchestra.run.smithi088.stderr: 2024-04-26T23:50:45.493 INFO:teuthology.orchestra.run.smithi088.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.41191.log.gz 2024-04-26T23:50:45.493 INFO:teuthology.orchestra.run.smithi088.stderr: 2024-04-26T23:50:45.493 INFO:teuthology.orchestra.run.smithi088.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.41317.log.gz 2024-04-26T23:50:45.493 INFO:teuthology.orchestra.run.smithi088.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.41359.log.gz 2024-04-26T23:50:45.493 INFO:teuthology.orchestra.run.smithi088.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.41401.log.gz 2024-04-26T23:50:45.493 INFO:teuthology.orchestra.run.smithi088.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.41443.log.gz 2024-04-26T23:50:45.493 INFO:teuthology.orchestra.run.smithi088.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.41529.log.gz 2024-04-26T23:50:45.493 INFO:teuthology.orchestra.run.smithi088.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.41485.log.gz 2024-04-26T23:50:45.493 INFO:teuthology.orchestra.run.smithi088.stderr: 93.4% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-04-26T23:50:45.538 INFO:teuthology.orchestra.run.smithi175.stderr: 93.2% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-04-26T23:50:45.543 INFO:teuthology.orchestra.run.smithi175.stderr: 92.4% -- replaced with /var/log/ceph/ceph.log.gz 2024-04-26T23:50:45.794 INFO:teuthology.orchestra.run.smithi088.stderr: 91.7% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-04-26T23:50:45.984 INFO:teuthology.orchestra.run.smithi175.stderr: 91.8% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-04-26T23:50:46.323 INFO:teuthology.orchestra.run.smithi175.stderr: 91.4% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-04-26T23:50:47.140 INFO:teuthology.orchestra.run.smithi088.stderr: 91.0% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-04-26T23:51:10.139 INFO:teuthology.orchestra.run.smithi088.stderr: 93.2% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-04-26T23:51:10.176 INFO:teuthology.orchestra.run.smithi175.stderr: 93.2% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-04-26T23:51:11.755 INFO:teuthology.orchestra.run.smithi088.stderr: 93.1% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-04-26T23:51:17.747 INFO:teuthology.orchestra.run.smithi175.stderr: 95.5% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-04-26T23:51:19.131 INFO:teuthology.orchestra.run.smithi088.stderr: 95.6% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-04-26T23:51:23.239 INFO:teuthology.orchestra.run.smithi175.stderr: 92.9% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-04-26T23:51:23.853 INFO:teuthology.orchestra.run.smithi088.stderr: 93.0% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-04-26T23:51:24.328 INFO:teuthology.orchestra.run.smithi175.stderr: 92.9% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-04-26T23:51:26.299 INFO:teuthology.orchestra.run.smithi088.stderr: 93.0% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-04-26T23:51:26.301 INFO:teuthology.orchestra.run.smithi088.stderr: 2024-04-26T23:51:26.301 INFO:teuthology.orchestra.run.smithi088.stderr:real 0m40.982s 2024-04-26T23:51:26.301 INFO:teuthology.orchestra.run.smithi088.stderr:user 2m27.860s 2024-04-26T23:51:26.302 INFO:teuthology.orchestra.run.smithi088.stderr:sys 0m5.101s 2024-04-26T23:51:27.783 INFO:teuthology.orchestra.run.smithi175.stderr: 92.8% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-04-26T23:51:27.785 INFO:teuthology.orchestra.run.smithi175.stderr: 2024-04-26T23:51:27.785 INFO:teuthology.orchestra.run.smithi175.stderr:real 0m42.439s 2024-04-26T23:51:27.785 INFO:teuthology.orchestra.run.smithi175.stderr:user 2m40.703s 2024-04-26T23:51:27.785 INFO:teuthology.orchestra.run.smithi175.stderr:sys 0m5.459s 2024-04-26T23:51:27.786 INFO:tasks.ceph:Archiving logs... 2024-04-26T23:51:27.786 DEBUG:teuthology.misc:Transferring archived files from smithi088:/var/log/ceph to /home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675323/remote/smithi088/log 2024-04-26T23:51:27.787 DEBUG:teuthology.orchestra.run.smithi088:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-26T23:51:49.495 DEBUG:teuthology.misc:Transferring archived files from smithi175:/var/log/ceph to /home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675323/remote/smithi175/log 2024-04-26T23:51:49.496 DEBUG:teuthology.orchestra.run.smithi175:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-26T23:52:13.182 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-04-26T23:52:13.192 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-04-26T23:52:13.192 DEBUG:teuthology.orchestra.run.smithi088:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-26T23:52:13.195 DEBUG:teuthology.orchestra.run.smithi175:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-26T23:52:13.305 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-04-26T23:52:13.314 INFO:teuthology.task.clock:Checking final clock skew... 2024-04-26T23:52:13.314 DEBUG:teuthology.orchestra.run.smithi088:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-26T23:52:13.317 DEBUG:teuthology.orchestra.run.smithi175:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-26T23:52:13.330 INFO:teuthology.orchestra.run.smithi088.stderr:bash: line 1: ntpq: command not found 2024-04-26T23:52:13.333 INFO:teuthology.orchestra.run.smithi175.stderr:bash: line 1: ntpq: command not found 2024-04-26T23:52:13.349 INFO:teuthology.orchestra.run.smithi088.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-26T23:52:13.350 INFO:teuthology.orchestra.run.smithi088.stdout:=============================================================================== 2024-04-26T23:52:13.350 INFO:teuthology.orchestra.run.smithi088.stdout:^* hv01.front.sepia.ceph.com 3 6 377 10 +1264us[+1247us] +/- 52ms 2024-04-26T23:52:13.350 INFO:teuthology.orchestra.run.smithi088.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 11 -304us[ -321us] +/- 52ms 2024-04-26T23:52:13.350 INFO:teuthology.orchestra.run.smithi088.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 12 -1699us[-1716us] +/- 93ms 2024-04-26T23:52:13.350 INFO:teuthology.orchestra.run.smithi088.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T23:52:13.353 INFO:teuthology.orchestra.run.smithi175.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-26T23:52:13.353 INFO:teuthology.orchestra.run.smithi175.stdout:=============================================================================== 2024-04-26T23:52:13.353 INFO:teuthology.orchestra.run.smithi175.stdout:^* hv01.front.sepia.ceph.com 3 6 377 10 +1180us[+1109us] +/- 52ms 2024-04-26T23:52:13.353 INFO:teuthology.orchestra.run.smithi175.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 9 -383us[ -383us] +/- 52ms 2024-04-26T23:52:13.353 INFO:teuthology.orchestra.run.smithi175.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 12 -1762us[-1834us] +/- 93ms 2024-04-26T23:52:13.353 INFO:teuthology.orchestra.run.smithi175.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T23:52:13.354 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-04-26T23:52:13.364 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-04-26T23:52:13.365 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-04-26T23:52:13.391 DEBUG:teuthology.orchestra.run.smithi088:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-26T23:52:13.500 DEBUG:teuthology.orchestra.run.smithi175:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-26T23:52:13.583 DEBUG:teuthology.orchestra.run.smithi088:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-26T23:52:13.612 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T23:52:13.612 DEBUG:teuthology.orchestra.run.smithi175:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-26T23:52:13.640 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T23:52:13.641 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-04-26T23:52:13.651 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-04-26T23:52:13.684 INFO:teuthology.task.internal:Duration was 1069.062378 seconds 2024-04-26T23:52:13.685 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-04-26T23:52:13.717 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-04-26T23:52:13.717 DEBUG:teuthology.orchestra.run.smithi088:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-26T23:52:13.720 DEBUG:teuthology.orchestra.run.smithi175:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-26T23:52:13.781 INFO:teuthology.orchestra.run.smithi088.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-26T23:52:13.801 INFO:teuthology.orchestra.run.smithi175.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-26T23:52:14.248 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-04-26T23:52:14.248 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi088.front.sepia.ceph.com 2024-04-26T23:52:14.248 DEBUG:teuthology.orchestra.run.smithi088:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-26T23:52:14.269 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi175.front.sepia.ceph.com 2024-04-26T23:52:14.270 DEBUG:teuthology.orchestra.run.smithi175:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-26T23:52:14.311 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-04-26T23:52:14.311 DEBUG:teuthology.orchestra.run.smithi088:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-26T23:52:14.313 DEBUG:teuthology.orchestra.run.smithi175:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-26T23:52:14.381 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-04-26T23:52:14.381 DEBUG:teuthology.orchestra.run.smithi088:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-26T23:52:14.384 DEBUG:teuthology.orchestra.run.smithi175:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-26T23:52:14.534 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-04-26T23:52:14.544 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-04-26T23:52:14.545 DEBUG:teuthology.orchestra.run.smithi088:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-26T23:52:14.586 DEBUG:teuthology.orchestra.run.smithi175:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-26T23:52:14.623 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-04-26T23:52:14.634 DEBUG:teuthology.orchestra.run.smithi088:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-26T23:52:14.637 DEBUG:teuthology.orchestra.run.smithi175:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-26T23:52:14.679 INFO:teuthology.orchestra.run.smithi088.stdout:kernel.core_pattern = core 2024-04-26T23:52:14.708 INFO:teuthology.orchestra.run.smithi175.stdout:kernel.core_pattern = core 2024-04-26T23:52:14.721 DEBUG:teuthology.orchestra.run.smithi088:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-26T23:52:14.735 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T23:52:14.736 DEBUG:teuthology.orchestra.run.smithi175:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-26T23:52:14.775 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T23:52:14.775 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-04-26T23:52:14.787 INFO:teuthology.task.internal:Transferring archived files... 2024-04-26T23:52:14.787 DEBUG:teuthology.misc:Transferring archived files from smithi088:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675323/remote/smithi088 2024-04-26T23:52:14.788 DEBUG:teuthology.orchestra.run.smithi088:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-26T23:52:14.821 DEBUG:teuthology.misc:Transferring archived files from smithi175:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675323/remote/smithi175 2024-04-26T23:52:14.821 DEBUG:teuthology.orchestra.run.smithi175:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-26T23:52:14.853 INFO:teuthology.task.internal:Removing archive directory... 2024-04-26T23:52:14.853 DEBUG:teuthology.orchestra.run.smithi088:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-26T23:52:14.858 DEBUG:teuthology.orchestra.run.smithi175:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-26T23:52:14.903 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-04-26T23:52:14.920 INFO:teuthology.task.internal:Not uploading archives. 2024-04-26T23:52:14.920 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-04-26T23:52:14.949 INFO:teuthology.task.internal:Tidying up after the test... 2024-04-26T23:52:14.949 DEBUG:teuthology.orchestra.run.smithi088:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-26T23:52:14.952 DEBUG:teuthology.orchestra.run.smithi175:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-26T23:52:14.963 INFO:teuthology.orchestra.run.smithi088.stdout: 262213 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 26 23:52 /home/ubuntu/cephtest 2024-04-26T23:52:14.965 INFO:teuthology.orchestra.run.smithi175.stdout: 262213 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 26 23:52 /home/ubuntu/cephtest 2024-04-26T23:52:14.967 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-04-26T23:52:14.984 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-04-26T23:52:15.012 INFO:teuthology.run:Summary data: description: fs/thrash/multifs/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-2c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} msgr-failures/none objectstore/bluestore-bitmap overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down multifs pg_health session_timeout thrashosds-health} tasks/{1-thrash/mon 2-workunit/ffsb}} duration: 1069.062378168106 flavor: default owner: scheduled_rishabh@teuthology success: true 2024-04-26T23:52:15.012 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-26T23:52:15.114 INFO:teuthology.run:pass